2024-05-08T05:23:34.730 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-08T05:23:34.730 DEBUG:teuthology.run:Teuthology command: teuthology --description fs:workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/postgres}} --verbose --archive /home/teuthworker/archive/vshankar-2024-05-08_04:00:39-fs:workload-wip-57676-3-testing-default-smithi/7697239 --name vshankar-2024-05-08_04:00:39-fs:workload-wip-57676-3-testing-default-smithi --owner scheduled_vshankar@teuthology -- /home/teuthworker/archive/vshankar-2024-05-08_04:00:39-fs:workload-wip-57676-3-testing-default-smithi/7697239/orig.config.yaml 2024-05-08T05:23:34.783 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-08T05:23:34.877 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2024-05-08_04:00:39-fs:workload-wip-57676-3-testing-default-smithi/7697239 branch: wip-57676-3 description: fs:workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/postgres}} email: vshankar@redhat.com first_in_suite: false job_id: '7697239' kernel: client: branch: testing flavor: default kdb: true sha1: 806ec36b21129f113ce356c007dd59694d340b37 ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: vshankar-2024-05-08_04:00:39-fs:workload-wip-57676-3-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-57676-3 ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_export_ephemeral_random_max: 0.1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - slow metadata IO - SLOW_OPS - slow request sha1: bee299f4ac344e4c45e550d7a80abcadd7bc3d5a subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 ceph-fuse: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 0 mountpoint: /tmp/cephfs check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: bee299f4ac344e4c45e550d7a80abcadd7bc3d5a kclient: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 1 mountpoint: /tmp/cephfs mntopts: - ms_mode=secure - wsync syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-57676-3 sha1: bee299f4ac344e4c45e550d7a80abcadd7bc3d5a owner: scheduled_vshankar@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 5998 sha1: bee299f4ac344e4c45e550d7a80abcadd7bc3d5a sleep_before_teardown: 0 subset: 915/1024 suite: fs:workload suite_branch: wip-57676-3 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: bee299f4ac344e4c45e550d7a80abcadd7bc3d5a syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi082.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKmAsTz/eFcAu+5QlbFHJujSdGViuJhAryWnasMIJ5w2AGQ278/V1CmHWsrV32ZuB4KY6vNUUKqM9lucR0Fydzo= smithi134.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLII9rerQ+nNOn4yqZDB38kEzD0CfaV3SXzKEKfnCA8y9QheZiELhnPYPMqhaHA3ow5w23NMhzju5YlZej9i0dg= smithi151.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIfnunSbYk67M1lieW0uV/ZhDaGqO4fPeMFXzR7zfePOsrJECMljsOU/uh3O4TnT2+l0Db6VWvp6uJUUGRejxAo= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: client.0: - sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/ - sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres - sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data - sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?" - sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local - sudo restorecon -R -v /tmp/cephfs/postgres - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf - sudo -u postgres -- postgresql-setup --initdb - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo systemctl start postgresql - sudo -u postgres -- pgbench -s 32 -i - sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900 - sudo systemctl stop postgresql - sudo ls -lZaR /tmp/cephfs/postgres/ teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-08_04:00:39 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-08T05:23:34.877 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/qa; will attempt to use it 2024-05-08T05:23:34.878 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/qa/tasks 2024-05-08T05:23:34.878 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-08T05:23:34.880 INFO:teuthology.task.internal:Checking packages... 2024-05-08T05:23:34.901 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'bee299f4ac344e4c45e550d7a80abcadd7bc3d5a' 2024-05-08T05:23:34.901 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-08T05:23:34.902 INFO:teuthology.packaging:ref: None 2024-05-08T05:23:34.902 INFO:teuthology.packaging:tag: None 2024-05-08T05:23:34.902 INFO:teuthology.packaging:branch: wip-57676-3 2024-05-08T05:23:34.902 INFO:teuthology.packaging:sha1: bee299f4ac344e4c45e550d7a80abcadd7bc3d5a 2024-05-08T05:23:34.902 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-57676-3 2024-05-08T05:23:35.045 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3538.gbee299f4 2024-05-08T05:23:35.047 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-08T05:23:35.053 INFO:teuthology.task.internal:no buildpackages task found 2024-05-08T05:23:35.053 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-08T05:23:35.079 INFO:teuthology.task.internal:Saving configuration 2024-05-08T05:23:35.099 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-08T05:23:35.106 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-08T05:23:35.131 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi082.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-05-08_04:00:39-fs:workload-wip-57676-3-testing-default-smithi/7697239', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 05:18:08.297057', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKmAsTz/eFcAu+5QlbFHJujSdGViuJhAryWnasMIJ5w2AGQ278/V1CmHWsrV32ZuB4KY6vNUUKqM9lucR0Fydzo='} 2024-05-08T05:23:35.151 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-05-08_04:00:39-fs:workload-wip-57676-3-testing-default-smithi/7697239', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 05:18:08.298431', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLII9rerQ+nNOn4yqZDB38kEzD0CfaV3SXzKEKfnCA8y9QheZiELhnPYPMqhaHA3ow5w23NMhzju5YlZej9i0dg='} 2024-05-08T05:23:35.171 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi151.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-05-08_04:00:39-fs:workload-wip-57676-3-testing-default-smithi/7697239', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-08 05:18:08.299634', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIfnunSbYk67M1lieW0uV/ZhDaGqO4fPeMFXzR7zfePOsrJECMljsOU/uh3O4TnT2+l0Db6VWvp6uJUUGRejxAo='} 2024-05-08T05:23:35.171 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-08T05:23:35.177 INFO:teuthology.task.internal:roles: ubuntu@smithi082.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-05-08T05:23:35.177 INFO:teuthology.task.internal:roles: ubuntu@smithi134.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-05-08T05:23:35.177 INFO:teuthology.task.internal:roles: ubuntu@smithi151.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-05-08T05:23:35.177 INFO:teuthology.run_tasks:Running task console_log... 2024-05-08T05:23:35.281 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8caa09f0d0>, signals=[15]) 2024-05-08T05:23:35.282 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-08T05:23:35.288 INFO:teuthology.task.internal:Opening connections... 2024-05-08T05:23:35.288 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi082.front.sepia.ceph.com 2024-05-08T05:23:35.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T05:23:35.364 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi134.front.sepia.ceph.com 2024-05-08T05:23:35.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T05:23:35.435 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi151.front.sepia.ceph.com 2024-05-08T05:23:35.436 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T05:23:35.505 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-08T05:23:35.512 DEBUG:teuthology.orchestra.run.smithi082:> uname -m 2024-05-08T05:23:35.530 INFO:teuthology.orchestra.run.smithi082.stdout:x86_64 2024-05-08T05:23:35.530 DEBUG:teuthology.orchestra.run.smithi082:> cat /etc/os-release 2024-05-08T05:23:35.587 INFO:teuthology.orchestra.run.smithi082.stdout:NAME="CentOS Stream" 2024-05-08T05:23:35.587 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION="9" 2024-05-08T05:23:35.587 INFO:teuthology.orchestra.run.smithi082.stdout:ID="centos" 2024-05-08T05:23:35.588 INFO:teuthology.orchestra.run.smithi082.stdout:ID_LIKE="rhel fedora" 2024-05-08T05:23:35.588 INFO:teuthology.orchestra.run.smithi082.stdout:VERSION_ID="9" 2024-05-08T05:23:35.588 INFO:teuthology.orchestra.run.smithi082.stdout:PLATFORM_ID="platform:el9" 2024-05-08T05:23:35.588 INFO:teuthology.orchestra.run.smithi082.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-08T05:23:35.588 INFO:teuthology.orchestra.run.smithi082.stdout:ANSI_COLOR="0;31" 2024-05-08T05:23:35.588 INFO:teuthology.orchestra.run.smithi082.stdout:LOGO="fedora-logo-icon" 2024-05-08T05:23:35.588 INFO:teuthology.orchestra.run.smithi082.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-08T05:23:35.588 INFO:teuthology.orchestra.run.smithi082.stdout:HOME_URL="https://centos.org/" 2024-05-08T05:23:35.588 INFO:teuthology.orchestra.run.smithi082.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-08T05:23:35.588 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-08T05:23:35.588 INFO:teuthology.orchestra.run.smithi082.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-08T05:23:35.589 INFO:teuthology.lock.ops:Updating smithi082.front.sepia.ceph.com on lock server 2024-05-08T05:23:35.614 DEBUG:teuthology.orchestra.run.smithi134:> uname -m 2024-05-08T05:23:35.632 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64 2024-05-08T05:23:35.632 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2024-05-08T05:23:35.688 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="CentOS Stream" 2024-05-08T05:23:35.689 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="9" 2024-05-08T05:23:35.689 INFO:teuthology.orchestra.run.smithi134.stdout:ID="centos" 2024-05-08T05:23:35.689 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="rhel fedora" 2024-05-08T05:23:35.689 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="9" 2024-05-08T05:23:35.689 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el9" 2024-05-08T05:23:35.689 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-08T05:23:35.689 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31" 2024-05-08T05:23:35.689 INFO:teuthology.orchestra.run.smithi134.stdout:LOGO="fedora-logo-icon" 2024-05-08T05:23:35.689 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-08T05:23:35.689 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://centos.org/" 2024-05-08T05:23:35.689 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-08T05:23:35.689 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-08T05:23:35.689 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-08T05:23:35.690 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2024-05-08T05:23:35.705 DEBUG:teuthology.orchestra.run.smithi151:> uname -m 2024-05-08T05:23:35.723 INFO:teuthology.orchestra.run.smithi151.stdout:x86_64 2024-05-08T05:23:35.723 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release 2024-05-08T05:23:35.780 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="CentOS Stream" 2024-05-08T05:23:35.780 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="9" 2024-05-08T05:23:35.780 INFO:teuthology.orchestra.run.smithi151.stdout:ID="centos" 2024-05-08T05:23:35.781 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE="rhel fedora" 2024-05-08T05:23:35.781 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="9" 2024-05-08T05:23:35.781 INFO:teuthology.orchestra.run.smithi151.stdout:PLATFORM_ID="platform:el9" 2024-05-08T05:23:35.781 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-08T05:23:35.781 INFO:teuthology.orchestra.run.smithi151.stdout:ANSI_COLOR="0;31" 2024-05-08T05:23:35.781 INFO:teuthology.orchestra.run.smithi151.stdout:LOGO="fedora-logo-icon" 2024-05-08T05:23:35.781 INFO:teuthology.orchestra.run.smithi151.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-08T05:23:35.781 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://centos.org/" 2024-05-08T05:23:35.781 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-08T05:23:35.781 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-08T05:23:35.781 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-08T05:23:35.781 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2024-05-08T05:23:35.805 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-08T05:23:35.815 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-08T05:23:35.820 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-08T05:23:35.820 DEBUG:teuthology.orchestra.run.smithi082:> test '!' -e /home/ubuntu/cephtest 2024-05-08T05:23:35.823 DEBUG:teuthology.orchestra.run.smithi134:> test '!' -e /home/ubuntu/cephtest 2024-05-08T05:23:35.825 DEBUG:teuthology.orchestra.run.smithi151:> test '!' -e /home/ubuntu/cephtest 2024-05-08T05:23:35.841 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-08T05:23:35.847 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-08T05:23:35.847 DEBUG:teuthology.orchestra.run.smithi082:> test -z $(ls -A /var/lib/ceph) 2024-05-08T05:23:35.879 DEBUG:teuthology.orchestra.run.smithi134:> test -z $(ls -A /var/lib/ceph) 2024-05-08T05:23:35.882 DEBUG:teuthology.orchestra.run.smithi151:> test -z $(ls -A /var/lib/ceph) 2024-05-08T05:23:35.910 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-08T05:23:36.016 INFO:teuthology.run_tasks:Running task kernel... 2024-05-08T05:23:36.030 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'} 2024-05-08T05:23:36.030 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2024-05-08T05:23:36.030 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2024-05-08T05:23:36.030 DEBUG:teuthology.orchestra.run.smithi082:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-08T05:23:36.047 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T05:23:36.048 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-05-08T05:23:36.277 DEBUG:teuthology.task.kernel:sha1 for client.0 is 806ec36b21129f113ce356c007dd59694d340b37 2024-05-08T05:23:36.277 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "806ec36b21129f113ce356c007dd59694d340b37"... 2024-05-08T05:23:36.277 DEBUG:teuthology.orchestra.run.smithi082:> uname -r 2024-05-08T05:23:36.294 INFO:teuthology.orchestra.run.smithi082.stdout:5.14.0-437.el9.x86_64 2024-05-08T05:23:36.294 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs 806ec36b21129f113ce356c007dd59694d340b37 2024-05-08T05:23:36.294 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-08T05:23:36.294 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum upgrade -y linux-firmware 2024-05-08T05:23:38.483 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.1 MB 00:00 2024-05-08T05:23:41.283 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - AppStream 11 MB/s | 19 MB 00:01 2024-05-08T05:23:45.267 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.2 MB 00:00 2024-05-08T05:23:46.751 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - Extras packages 52 kB/s | 16 kB 00:00 2024-05-08T05:23:47.936 INFO:teuthology.orchestra.run.smithi082.stdout:Extra Packages for Enterprise Linux 20 MB/s | 21 MB 00:01 2024-05-08T05:23:53.135 INFO:teuthology.orchestra.run.smithi082.stdout:lab-extras 37 kB/s | 1.7 kB 00:00 2024-05-08T05:23:55.206 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-05-08T05:23:55.207 INFO:teuthology.orchestra.run.smithi082.stdout:Nothing to do. 2024-05-08T05:23:55.207 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-05-08T05:23:55.311 INFO:teuthology.task.kernel:Downloading kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-05-08T05:23:55.312 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=806ec36b21129f113ce356c007dd59694d340b37 2024-05-08T05:23:55.533 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ 2024-05-08T05:23:55.533 DEBUG:teuthology.orchestra.run.smithi082:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/ --input-file=- 2024-05-08T05:23:55.536 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi082.front.sepia.ceph.com to complete... 2024-05-08T05:24:46.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08 05:24:46 URL:https://4.chacra.ceph.com/r/kernel/testing/806ec36b21129f113ce356c007dd59694d340b37/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g806ec36b2112-1.x86_64.rpm [357367792/357367792] -> "/tmp/kernel.x86_64.rpm" [1] 2024-05-08T05:24:46.541 INFO:teuthology.orchestra.run.smithi082.stderr:FINISHED --2024-05-08 05:24:46-- 2024-05-08T05:24:46.541 INFO:teuthology.orchestra.run.smithi082.stderr:Total wall clock time: 51s 2024-05-08T05:24:46.541 INFO:teuthology.orchestra.run.smithi082.stderr:Downloaded: 1 files, 341M in 50s (6.77 MB/s) 2024-05-08T05:24:46.545 INFO:teuthology.task.kernel:Installing kernel 806ec36b21129f113ce356c007dd59694d340b37 on client.0... 2024-05-08T05:24:46.545 DEBUG:teuthology.orchestra.run.smithi082:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-05-08T05:24:48.623 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying... ######################################## 2024-05-08T05:24:48.758 INFO:teuthology.orchestra.run.smithi082.stdout:Preparing... ######################################## 2024-05-08T05:24:48.858 INFO:teuthology.orchestra.run.smithi082.stdout:Updating / installing... 2024-05-08T05:24:56.823 INFO:teuthology.orchestra.run.smithi082.stdout:kernel-6.9.0_rc3_g806ec36b2112-1 ######################################## 2024-05-08T05:25:34.995 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi082.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-05-08T05:25:34.996 DEBUG:teuthology.orchestra.run.smithi082:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-05-08T05:25:35.076 INFO:teuthology.orchestra.run.smithi082.stdout:/boot/System.map-6.9.0-rc3-g806ec36b2112 2024-05-08T05:25:35.076 INFO:teuthology.orchestra.run.smithi082.stdout:/boot/config-6.9.0-rc3-g806ec36b2112 2024-05-08T05:25:35.076 INFO:teuthology.orchestra.run.smithi082.stdout:/boot/vmlinuz-6.9.0-rc3-g806ec36b2112 2024-05-08T05:25:35.076 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/System.map 2024-05-08T05:25:35.077 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/config 2024-05-08T05:25:35.077 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel 2024-05-08T05:25:35.077 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch 2024-05-08T05:25:35.077 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86 2024-05-08T05:25:35.077 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto 2024-05-08T05:25:35.077 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-08T05:25:35.077 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-08T05:25:35.077 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-08T05:25:35.077 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-08T05:25:35.077 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-08T05:25:35.077 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-08T05:25:35.077 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-08T05:25:35.077 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crc32c-intel.ko 2024-05-08T05:25:35.077 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-08T05:25:35.078 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-08T05:25:35.078 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-08T05:25:35.078 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-08T05:25:35.078 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-08T05:25:35.078 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-08T05:25:35.078 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-08T05:25:35.078 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-08T05:25:35.078 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-08T05:25:35.078 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-08T05:25:35.078 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-08T05:25:35.078 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-08T05:25:35.078 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel 2024-05-08T05:25:35.078 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu 2024-05-08T05:25:35.079 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce 2024-05-08T05:25:35.079 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-08T05:25:35.079 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm 2024-05-08T05:25:35.079 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-08T05:25:35.079 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-08T05:25:35.079 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/arch/x86/kvm/kvm.ko 2024-05-08T05:25:35.079 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto 2024-05-08T05:25:35.079 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ansi_cprng.ko 2024-05-08T05:25:35.079 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/anubis.ko 2024-05-08T05:25:35.079 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/arc4.ko 2024-05-08T05:25:35.079 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx 2024-05-08T05:25:35.079 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_memcpy.ko 2024-05-08T05:25:35.079 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_pq.ko 2024-05-08T05:25:35.079 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-08T05:25:35.079 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_tx.ko 2024-05-08T05:25:35.080 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/async_xor.ko 2024-05-08T05:25:35.080 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/async_tx/raid6test.ko 2024-05-08T05:25:35.080 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authenc.ko 2024-05-08T05:25:35.080 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/authencesn.ko 2024-05-08T05:25:35.080 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blake2b_generic.ko 2024-05-08T05:25:35.080 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_common.ko 2024-05-08T05:25:35.080 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/blowfish_generic.ko 2024-05-08T05:25:35.080 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/camellia_generic.ko 2024-05-08T05:25:35.080 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast5_generic.ko 2024-05-08T05:25:35.080 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast6_generic.ko 2024-05-08T05:25:35.080 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cast_common.ko 2024-05-08T05:25:35.080 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/ccm.ko 2024-05-08T05:25:35.080 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cmac.ko 2024-05-08T05:25:35.080 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crc32_generic.ko 2024-05-08T05:25:35.081 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_engine.ko 2024-05-08T05:25:35.081 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/crypto_user.ko 2024-05-08T05:25:35.081 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/cts.ko 2024-05-08T05:25:35.081 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/des_generic.ko 2024-05-08T05:25:35.081 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/dh_generic.ko 2024-05-08T05:25:35.081 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/echainiv.ko 2024-05-08T05:25:35.081 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/essiv.ko 2024-05-08T05:25:35.081 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/fcrypt.ko 2024-05-08T05:25:35.081 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/khazad.ko 2024-05-08T05:25:35.081 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4.ko 2024-05-08T05:25:35.081 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/lz4hc.ko 2024-05-08T05:25:35.081 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/md4.ko 2024-05-08T05:25:35.081 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/michael_mic.ko 2024-05-08T05:25:35.081 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcbc.ko 2024-05-08T05:25:35.082 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/pcrypt.ko 2024-05-08T05:25:35.082 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/rmd160.ko 2024-05-08T05:25:35.082 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/seed.ko 2024-05-08T05:25:35.082 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/serpent_generic.ko 2024-05-08T05:25:35.082 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tcrypt.ko 2024-05-08T05:25:35.082 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/tea.ko 2024-05-08T05:25:35.082 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_common.ko 2024-05-08T05:25:35.082 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/twofish_generic.ko 2024-05-08T05:25:35.082 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/vmac.ko 2024-05-08T05:25:35.082 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/wp512.ko 2024-05-08T05:25:35.082 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xcbc.ko 2024-05-08T05:25:35.082 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xor.ko 2024-05-08T05:25:35.082 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/crypto/xxhash_generic.ko 2024-05-08T05:25:35.082 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers 2024-05-08T05:25:35.083 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi 2024-05-08T05:25:35.083 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-08T05:25:35.083 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/acpi_pad.ko 2024-05-08T05:25:35.083 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/ec_sys.ko 2024-05-08T05:25:35.083 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/platform_profile.ko 2024-05-08T05:25:35.083 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbs.ko 2024-05-08T05:25:35.083 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/sbshc.ko 2024-05-08T05:25:35.083 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/acpi/video.ko 2024-05-08T05:25:35.083 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata 2024-05-08T05:25:35.083 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/acard-ahci.ko 2024-05-08T05:25:35.083 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ahci_platform.ko 2024-05-08T05:25:35.083 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/ata_generic.ko 2024-05-08T05:25:35.083 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/libahci_platform.ko 2024-05-08T05:25:35.083 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_acpi.ko 2024-05-08T05:25:35.084 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ali.ko 2024-05-08T05:25:35.084 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_amd.ko 2024-05-08T05:25:35.084 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_artop.ko 2024-05-08T05:25:35.084 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atiixp.ko 2024-05-08T05:25:35.084 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_atp867x.ko 2024-05-08T05:25:35.084 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd640.ko 2024-05-08T05:25:35.084 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cmd64x.ko 2024-05-08T05:25:35.084 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_cypress.ko 2024-05-08T05:25:35.084 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_efar.ko 2024-05-08T05:25:35.084 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt366.ko 2024-05-08T05:25:35.084 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt37x.ko 2024-05-08T05:25:35.084 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-08T05:25:35.084 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-08T05:25:35.084 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it8213.ko 2024-05-08T05:25:35.084 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_it821x.ko 2024-05-08T05:25:35.084 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_jmicron.ko 2024-05-08T05:25:35.085 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_marvell.ko 2024-05-08T05:25:35.085 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_mpiix.ko 2024-05-08T05:25:35.085 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_netcell.ko 2024-05-08T05:25:35.085 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ninja32.ko 2024-05-08T05:25:35.085 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87410.ko 2024-05-08T05:25:35.085 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_ns87415.ko 2024-05-08T05:25:35.085 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_oldpiix.ko 2024-05-08T05:25:35.085 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_opti.ko 2024-05-08T05:25:35.085 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_optidma.ko 2024-05-08T05:25:35.085 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pcmcia.ko 2024-05-08T05:25:35.085 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-08T05:25:35.085 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-08T05:25:35.085 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_piccolo.ko 2024-05-08T05:25:35.085 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_rdc.ko 2024-05-08T05:25:35.085 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sch.ko 2024-05-08T05:25:35.086 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_serverworks.ko 2024-05-08T05:25:35.086 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sil680.ko 2024-05-08T05:25:35.086 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sis.ko 2024-05-08T05:25:35.086 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_sl82c105.ko 2024-05-08T05:25:35.086 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_triflex.ko 2024-05-08T05:25:35.086 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pata_via.ko 2024-05-08T05:25:35.086 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/pdc_adma.ko 2024-05-08T05:25:35.086 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_inic162x.ko 2024-05-08T05:25:35.086 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_mv.ko 2024-05-08T05:25:35.086 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_nv.ko 2024-05-08T05:25:35.086 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_promise.ko 2024-05-08T05:25:35.086 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_qstor.ko 2024-05-08T05:25:35.086 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil.ko 2024-05-08T05:25:35.086 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sil24.ko 2024-05-08T05:25:35.087 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sis.ko 2024-05-08T05:25:35.087 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_svw.ko 2024-05-08T05:25:35.087 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_sx4.ko 2024-05-08T05:25:35.087 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_uli.ko 2024-05-08T05:25:35.087 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_via.ko 2024-05-08T05:25:35.087 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ata/sata_vsc.ko 2024-05-08T05:25:35.087 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay 2024-05-08T05:25:35.087 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/auxdisplay/ks0108.ko 2024-05-08T05:25:35.087 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base 2024-05-08T05:25:35.087 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap 2024-05-08T05:25:35.087 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-i2c.ko 2024-05-08T05:25:35.087 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/base/regmap/regmap-mmio.ko 2024-05-08T05:25:35.087 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma 2024-05-08T05:25:35.087 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/bcma/bcma.ko 2024-05-08T05:25:35.087 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block 2024-05-08T05:25:35.088 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe 2024-05-08T05:25:35.088 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/aoe/aoe.ko 2024-05-08T05:25:35.088 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/brd.ko 2024-05-08T05:25:35.088 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd 2024-05-08T05:25:35.088 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/drbd/drbd.ko 2024-05-08T05:25:35.088 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/floppy.ko 2024-05-08T05:25:35.088 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/loop.ko 2024-05-08T05:25:35.088 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx 2024-05-08T05:25:35.088 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-08T05:25:35.088 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/nbd.ko 2024-05-08T05:25:35.088 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk 2024-05-08T05:25:35.088 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/null_blk/null_blk.ko 2024-05-08T05:25:35.088 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/pktcdvd.ko 2024-05-08T05:25:35.088 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/rbd.ko 2024-05-08T05:25:35.088 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/virtio_blk.ko 2024-05-08T05:25:35.089 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback 2024-05-08T05:25:35.089 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-08T05:25:35.089 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/xen-blkfront.ko 2024-05-08T05:25:35.089 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram 2024-05-08T05:25:35.089 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/block/zram/zram.ko 2024-05-08T05:25:35.089 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char 2024-05-08T05:25:35.089 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hangcheck-timer.ko 2024-05-08T05:25:35.089 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random 2024-05-08T05:25:35.089 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-08T05:25:35.089 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-08T05:25:35.089 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-08T05:25:35.089 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/via-rng.ko 2024-05-08T05:25:35.089 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-08T05:25:35.089 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi 2024-05-08T05:25:35.089 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-08T05:25:35.089 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-08T05:25:35.089 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-08T05:25:35.090 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-08T05:25:35.090 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-08T05:25:35.090 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-08T05:25:35.090 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/lp.ko 2024-05-08T05:25:35.090 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave 2024-05-08T05:25:35.090 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/mwave/mwave.ko 2024-05-08T05:25:35.090 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/ppdev.ko 2024-05-08T05:25:35.090 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tlclk.ko 2024-05-08T05:25:35.090 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm 2024-05-08T05:25:35.090 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm.ko 2024-05-08T05:25:35.090 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-08T05:25:35.090 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-08T05:25:35.090 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-08T05:25:35.090 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis.ko 2024-05-08T05:25:35.091 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-05-08T05:25:35.091 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/uv_mmtimer.ko 2024-05-08T05:25:35.091 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/char/virtio_console.ko 2024-05-08T05:25:35.091 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq 2024-05-08T05:25:35.091 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-05-08T05:25:35.091 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-08T05:25:35.091 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-08T05:25:35.091 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-05-08T05:25:35.091 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/powernow-k8.ko 2024-05-08T05:25:35.091 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-08T05:25:35.091 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto 2024-05-08T05:25:35.091 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp 2024-05-08T05:25:35.091 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-08T05:25:35.091 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/ccp/ccp.ko 2024-05-08T05:25:35.091 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel 2024-05-08T05:25:35.092 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat 2024-05-08T05:25:35.092 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common 2024-05-08T05:25:35.092 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-08T05:25:35.092 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-05-08T05:25:35.092 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-08T05:25:35.092 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-aes.ko 2024-05-08T05:25:35.092 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/padlock-sha.ko 2024-05-08T05:25:35.092 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio 2024-05-08T05:25:35.092 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-08T05:25:35.092 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca 2024-05-08T05:25:35.092 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dca/dca.ko 2024-05-08T05:25:35.092 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq 2024-05-08T05:25:35.092 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-05-08T05:25:35.093 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma 2024-05-08T05:25:35.093 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw 2024-05-08T05:25:35.093 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-08T05:25:35.093 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat 2024-05-08T05:25:35.093 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-08T05:25:35.093 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac 2024-05-08T05:25:35.093 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/amd64_edac.ko 2024-05-08T05:25:35.093 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/e752x_edac.ko 2024-05-08T05:25:35.093 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/edac_mce_amd.ko 2024-05-08T05:25:35.093 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3000_edac.ko 2024-05-08T05:25:35.093 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i3200_edac.ko 2024-05-08T05:25:35.093 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5100_edac.ko 2024-05-08T05:25:35.093 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i5400_edac.ko 2024-05-08T05:25:35.093 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7300_edac.ko 2024-05-08T05:25:35.094 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i7core_edac.ko 2024-05-08T05:25:35.094 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/i82975x_edac.ko 2024-05-08T05:25:35.094 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/ie31200_edac.ko 2024-05-08T05:25:35.094 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/sb_edac.ko 2024-05-08T05:25:35.094 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/edac/x38_edac.ko 2024-05-08T05:25:35.094 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware 2024-05-08T05:25:35.094 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/edd.ko 2024-05-08T05:25:35.094 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-08T05:25:35.094 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio 2024-05-08T05:25:35.094 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-ich.ko 2024-05-08T05:25:35.094 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-08T05:25:35.094 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid 2024-05-08T05:25:35.094 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-appleir.ko 2024-05-08T05:25:35.094 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-aureal.ko 2024-05-08T05:25:35.095 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-axff.ko 2024-05-08T05:25:35.095 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-dr.ko 2024-05-08T05:25:35.095 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elecom.ko 2024-05-08T05:25:35.095 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-elo.ko 2024-05-08T05:25:35.095 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-emsff.ko 2024-05-08T05:25:35.095 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gaff.ko 2024-05-08T05:25:35.095 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gt683r.ko 2024-05-08T05:25:35.095 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-gyration.ko 2024-05-08T05:25:35.095 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-08T05:25:35.095 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-08T05:25:35.095 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-holtekff.ko 2024-05-08T05:25:35.095 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-hyperv.ko 2024-05-08T05:25:35.095 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-icade.ko 2024-05-08T05:25:35.095 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-keytouch.ko 2024-05-08T05:25:35.095 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-kye.ko 2024-05-08T05:25:35.096 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lcpower.ko 2024-05-08T05:25:35.096 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-led.ko 2024-05-08T05:25:35.096 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-lenovo.ko 2024-05-08T05:25:35.096 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-08T05:25:35.096 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-08T05:25:35.096 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-multitouch.ko 2024-05-08T05:25:35.096 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-ortek.ko 2024-05-08T05:25:35.096 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-penmount.ko 2024-05-08T05:25:35.096 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-petalynx.ko 2024-05-08T05:25:35.096 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-picolcd.ko 2024-05-08T05:25:35.096 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-pl.ko 2024-05-08T05:25:35.096 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-plantronics.ko 2024-05-08T05:25:35.096 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-primax.ko 2024-05-08T05:25:35.096 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-rmi.ko 2024-05-08T05:25:35.096 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-08T05:25:35.096 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-common.ko 2024-05-08T05:25:35.097 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-08T05:25:35.097 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-08T05:25:35.097 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-08T05:25:35.097 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-08T05:25:35.097 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-08T05:25:35.097 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-08T05:25:35.097 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-08T05:25:35.097 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-08T05:25:35.097 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-08T05:25:35.097 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-roccat.ko 2024-05-08T05:25:35.097 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-saitek.ko 2024-05-08T05:25:35.097 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-samsung.ko 2024-05-08T05:25:35.097 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-08T05:25:35.097 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sjoy.ko 2024-05-08T05:25:35.097 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sony.ko 2024-05-08T05:25:35.098 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-speedlink.ko 2024-05-08T05:25:35.098 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-steelseries.ko 2024-05-08T05:25:35.098 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-sunplus.ko 2024-05-08T05:25:35.098 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-08T05:25:35.098 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tivo.ko 2024-05-08T05:25:35.098 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-tmff.ko 2024-05-08T05:25:35.098 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-topseed.ko 2024-05-08T05:25:35.098 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-twinhan.ko 2024-05-08T05:25:35.098 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-uclogic.ko 2024-05-08T05:25:35.098 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-waltop.ko 2024-05-08T05:25:35.098 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-wiimote.ko 2024-05-08T05:25:35.098 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-xinmo.ko 2024-05-08T05:25:35.098 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zpff.ko 2024-05-08T05:25:35.098 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/hid-zydacron.ko 2024-05-08T05:25:35.098 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/uhid.ko 2024-05-08T05:25:35.099 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hid/wacom.ko 2024-05-08T05:25:35.099 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv 2024-05-08T05:25:35.099 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_balloon.ko 2024-05-08T05:25:35.099 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_utils.ko 2024-05-08T05:25:35.099 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hv/hv_vmbus.ko 2024-05-08T05:25:35.099 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon 2024-05-08T05:25:35.099 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru.ko 2024-05-08T05:25:35.099 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/abituguru3.ko 2024-05-08T05:25:35.099 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-08T05:25:35.099 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7414.ko 2024-05-08T05:25:35.099 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ad7418.ko 2024-05-08T05:25:35.099 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adc128d818.ko 2024-05-08T05:25:35.099 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1025.ko 2024-05-08T05:25:35.099 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1026.ko 2024-05-08T05:25:35.099 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1029.ko 2024-05-08T05:25:35.099 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm1031.ko 2024-05-08T05:25:35.100 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adm9240.ko 2024-05-08T05:25:35.100 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ads7828.ko 2024-05-08T05:25:35.100 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7410.ko 2024-05-08T05:25:35.100 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7411.ko 2024-05-08T05:25:35.100 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7462.ko 2024-05-08T05:25:35.100 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7470.ko 2024-05-08T05:25:35.100 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7475.ko 2024-05-08T05:25:35.100 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/adt7x10.ko 2024-05-08T05:25:35.100 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/amc6821.ko 2024-05-08T05:25:35.100 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/applesmc.ko 2024-05-08T05:25:35.100 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asb100.ko 2024-05-08T05:25:35.100 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asc7621.ko 2024-05-08T05:25:35.101 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-08T05:25:35.101 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/atxp1.ko 2024-05-08T05:25:35.101 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/coretemp.ko 2024-05-08T05:25:35.101 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-08T05:25:35.101 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/dme1737.ko 2024-05-08T05:25:35.101 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds1621.ko 2024-05-08T05:25:35.101 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ds620.ko 2024-05-08T05:25:35.101 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc1403.ko 2024-05-08T05:25:35.101 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/emc6w201.ko 2024-05-08T05:25:35.101 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71805f.ko 2024-05-08T05:25:35.101 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f71882fg.ko 2024-05-08T05:25:35.101 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/f75375s.ko 2024-05-08T05:25:35.101 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fam15h_power.ko 2024-05-08T05:25:35.101 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/fschmd.ko 2024-05-08T05:25:35.102 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g760a.ko 2024-05-08T05:25:35.102 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/g762.ko 2024-05-08T05:25:35.102 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl518sm.ko 2024-05-08T05:25:35.102 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/gl520sm.ko 2024-05-08T05:25:35.102 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-08T05:25:35.102 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5500_temp.ko 2024-05-08T05:25:35.102 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/i5k_amb.ko 2024-05-08T05:25:35.102 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmaem.ko 2024-05-08T05:25:35.102 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ibmpex.ko 2024-05-08T05:25:35.102 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina209.ko 2024-05-08T05:25:35.102 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ina2xx.ko 2024-05-08T05:25:35.102 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/it87.ko 2024-05-08T05:25:35.102 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k10temp.ko 2024-05-08T05:25:35.102 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/k8temp.ko 2024-05-08T05:25:35.103 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lineage-pem.ko 2024-05-08T05:25:35.103 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm63.ko 2024-05-08T05:25:35.103 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm73.ko 2024-05-08T05:25:35.103 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm75.ko 2024-05-08T05:25:35.103 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm77.ko 2024-05-08T05:25:35.103 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm78.ko 2024-05-08T05:25:35.103 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm80.ko 2024-05-08T05:25:35.103 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm83.ko 2024-05-08T05:25:35.103 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm85.ko 2024-05-08T05:25:35.103 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm87.ko 2024-05-08T05:25:35.103 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm90.ko 2024-05-08T05:25:35.103 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm92.ko 2024-05-08T05:25:35.103 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm93.ko 2024-05-08T05:25:35.103 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95234.ko 2024-05-08T05:25:35.104 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95241.ko 2024-05-08T05:25:35.104 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/lm95245.ko 2024-05-08T05:25:35.104 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc2945.ko 2024-05-08T05:25:35.104 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4151.ko 2024-05-08T05:25:35.104 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4215.ko 2024-05-08T05:25:35.104 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4222.ko 2024-05-08T05:25:35.104 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4245.ko 2024-05-08T05:25:35.104 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4260.ko 2024-05-08T05:25:35.104 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/ltc4261.ko 2024-05-08T05:25:35.104 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max16065.ko 2024-05-08T05:25:35.104 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1619.ko 2024-05-08T05:25:35.104 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max1668.ko 2024-05-08T05:25:35.104 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max197.ko 2024-05-08T05:25:35.104 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6639.ko 2024-05-08T05:25:35.104 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6650.ko 2024-05-08T05:25:35.104 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/max6697.ko 2024-05-08T05:25:35.105 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/mcp3021.ko 2024-05-08T05:25:35.105 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6683.ko 2024-05-08T05:25:35.105 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775-core.ko 2024-05-08T05:25:35.105 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct6775.ko 2024-05-08T05:25:35.105 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/nct7802.ko 2024-05-08T05:25:35.105 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87360.ko 2024-05-08T05:25:35.105 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pc87427.ko 2024-05-08T05:25:35.105 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pcf8591.ko 2024-05-08T05:25:35.105 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus 2024-05-08T05:25:35.105 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-08T05:25:35.105 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-08T05:25:35.105 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-08T05:25:35.105 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-08T05:25:35.105 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-08T05:25:35.105 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-08T05:25:35.106 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-08T05:25:35.106 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-08T05:25:35.106 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-08T05:25:35.106 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-08T05:25:35.106 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-08T05:25:35.106 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-08T05:25:35.106 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/powr1220.ko 2024-05-08T05:25:35.106 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5627.ko 2024-05-08T05:25:35.106 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch5636.ko 2024-05-08T05:25:35.106 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-08T05:25:35.106 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht15.ko 2024-05-08T05:25:35.106 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sht21.ko 2024-05-08T05:25:35.106 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/shtc1.ko 2024-05-08T05:25:35.106 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/sis5595.ko 2024-05-08T05:25:35.106 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47b397.ko 2024-05-08T05:25:35.107 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m1.ko 2024-05-08T05:25:35.107 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/smsc47m192.ko 2024-05-08T05:25:35.107 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/thmc50.ko 2024-05-08T05:25:35.107 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp102.ko 2024-05-08T05:25:35.107 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp103.ko 2024-05-08T05:25:35.107 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp401.ko 2024-05-08T05:25:35.107 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/tmp421.ko 2024-05-08T05:25:35.107 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via-cputemp.ko 2024-05-08T05:25:35.107 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/via686a.ko 2024-05-08T05:25:35.107 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt1211.ko 2024-05-08T05:25:35.107 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/vt8231.ko 2024-05-08T05:25:35.107 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627ehf.ko 2024-05-08T05:25:35.107 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83627hf.ko 2024-05-08T05:25:35.107 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83781d.ko 2024-05-08T05:25:35.108 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83791d.ko 2024-05-08T05:25:35.108 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83792d.ko 2024-05-08T05:25:35.108 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83793.ko 2024-05-08T05:25:35.108 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83795.ko 2024-05-08T05:25:35.108 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l785ts.ko 2024-05-08T05:25:35.108 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/hwmon/w83l786ng.ko 2024-05-08T05:25:35.108 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c 2024-05-08T05:25:35.108 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos 2024-05-08T05:25:35.108 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-08T05:25:35.108 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-08T05:25:35.108 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses 2024-05-08T05:25:35.108 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-08T05:25:35.108 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-08T05:25:35.108 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-08T05:25:35.108 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-08T05:25:35.109 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-08T05:25:35.109 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-08T05:25:35.109 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-08T05:25:35.109 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-08T05:25:35.109 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-08T05:25:35.109 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-08T05:25:35.109 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-08T05:25:35.109 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-08T05:25:35.109 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-08T05:25:35.109 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-08T05:25:35.109 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-08T05:25:35.109 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-08T05:25:35.109 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-08T05:25:35.110 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-08T05:25:35.110 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-08T05:25:35.110 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-08T05:25:35.110 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-08T05:25:35.110 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-08T05:25:35.110 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-08T05:25:35.110 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-dev.ko 2024-05-08T05:25:35.110 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-mux.ko 2024-05-08T05:25:35.110 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-05-08T05:25:35.110 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-smbus.ko 2024-05-08T05:25:35.110 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/i2c/i2c-stub.ko 2024-05-08T05:25:35.110 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband 2024-05-08T05:25:35.110 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core 2024-05-08T05:25:35.110 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-08T05:25:35.111 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_core.ko 2024-05-08T05:25:35.111 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-08T05:25:35.111 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-08T05:25:35.111 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-08T05:25:35.111 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-08T05:25:35.111 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-08T05:25:35.111 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw 2024-05-08T05:25:35.111 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4 2024-05-08T05:25:35.111 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-08T05:25:35.111 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4 2024-05-08T05:25:35.111 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-08T05:25:35.111 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5 2024-05-08T05:25:35.111 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-08T05:25:35.111 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca 2024-05-08T05:25:35.112 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-08T05:25:35.112 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp 2024-05-08T05:25:35.112 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib 2024-05-08T05:25:35.112 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-08T05:25:35.112 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser 2024-05-08T05:25:35.112 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-08T05:25:35.112 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert 2024-05-08T05:25:35.112 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-08T05:25:35.112 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp 2024-05-08T05:25:35.112 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-08T05:25:35.112 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt 2024-05-08T05:25:35.112 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-08T05:25:35.112 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input 2024-05-08T05:25:35.112 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport 2024-05-08T05:25:35.112 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-08T05:25:35.113 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-08T05:25:35.113 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/gameport/gameport.ko 2024-05-08T05:25:35.113 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/joydev.ko 2024-05-08T05:25:35.113 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard 2024-05-08T05:25:35.113 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-08T05:25:35.113 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse 2024-05-08T05:25:35.113 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/appletouch.ko 2024-05-08T05:25:35.113 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/bcm5974.ko 2024-05-08T05:25:35.113 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/cyapatp.ko 2024-05-08T05:25:35.113 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-08T05:25:35.113 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/sermouse.ko 2024-05-08T05:25:35.113 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-08T05:25:35.113 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-08T05:25:35.113 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-08T05:25:35.113 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4 2024-05-08T05:25:35.114 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-08T05:25:35.114 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio 2024-05-08T05:25:35.114 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/altera_ps2.ko 2024-05-08T05:25:35.114 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/arc_ps2.ko 2024-05-08T05:25:35.114 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-08T05:25:35.114 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/serio/serio_raw.ko 2024-05-08T05:25:35.114 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/input/sparse-keymap.ko 2024-05-08T05:25:35.114 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds 2024-05-08T05:25:35.114 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-blinkm.ko 2024-05-08T05:25:35.114 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lm3530.ko 2024-05-08T05:25:35.114 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-lp3944.ko 2024-05-08T05:25:35.114 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/leds-ss4200.ko 2024-05-08T05:25:35.114 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger 2024-05-08T05:25:35.114 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-08T05:25:35.114 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-08T05:25:35.115 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-08T05:25:35.115 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-08T05:25:35.115 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-08T05:25:35.115 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-08T05:25:35.115 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-08T05:25:35.115 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-08T05:25:35.115 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-08T05:25:35.115 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md 2024-05-08T05:25:35.115 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache 2024-05-08T05:25:35.115 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/bcache/bcache.ko 2024-05-08T05:25:35.115 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-bio-prison.ko 2024-05-08T05:25:35.115 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache-smq.ko 2024-05-08T05:25:35.115 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-cache.ko 2024-05-08T05:25:35.115 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-crypt.ko 2024-05-08T05:25:35.116 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-delay.ko 2024-05-08T05:25:35.116 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-flakey.ko 2024-05-08T05:25:35.116 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-log-userspace.ko 2024-05-08T05:25:35.116 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-multipath.ko 2024-05-08T05:25:35.116 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-queue-length.ko 2024-05-08T05:25:35.116 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-raid.ko 2024-05-08T05:25:35.116 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-round-robin.ko 2024-05-08T05:25:35.116 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-service-time.ko 2024-05-08T05:25:35.116 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-switch.ko 2024-05-08T05:25:35.116 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-thin-pool.ko 2024-05-08T05:25:35.116 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/dm-verity.ko 2024-05-08T05:25:35.116 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data 2024-05-08T05:25:35.116 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-08T05:25:35.116 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid0.ko 2024-05-08T05:25:35.117 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid1.ko 2024-05-08T05:25:35.117 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid10.ko 2024-05-08T05:25:35.117 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/md/raid456.ko 2024-05-08T05:25:35.117 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message 2024-05-08T05:25:35.117 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion 2024-05-08T05:25:35.117 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptbase.ko 2024-05-08T05:25:35.117 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptctl.ko 2024-05-08T05:25:35.117 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptfc.ko 2024-05-08T05:25:35.117 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptlan.ko 2024-05-08T05:25:35.117 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptsas.ko 2024-05-08T05:25:35.117 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptscsih.ko 2024-05-08T05:25:35.117 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/message/fusion/mptspi.ko 2024-05-08T05:25:35.117 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd 2024-05-08T05:25:35.117 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_ich.ko 2024-05-08T05:25:35.117 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/lpc_sch.ko 2024-05-08T05:25:35.118 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/mfd-core.ko 2024-05-08T05:25:35.118 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/sm501.ko 2024-05-08T05:25:35.118 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/viperboard.ko 2024-05-08T05:25:35.118 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/vx855.ko 2024-05-08T05:25:35.118 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/mfd/wl1273-core.ko 2024-05-08T05:25:35.118 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc 2024-05-08T05:25:35.118 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl 2024-05-08T05:25:35.118 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-08T05:25:35.118 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds9802als.ko 2024-05-08T05:25:35.118 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/apds990x.ko 2024-05-08T05:25:35.118 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/bh1770glc.ko 2024-05-08T05:25:35.118 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710 2024-05-08T05:25:35.118 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/cb710/cb710.ko 2024-05-08T05:25:35.118 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom 2024-05-08T05:25:35.118 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/at24.ko 2024-05-08T05:25:35.119 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-08T05:25:35.119 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/eeprom/max6875.ko 2024-05-08T05:25:35.119 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/enclosure.ko 2024-05-08T05:25:35.119 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/hpilo.ko 2024-05-08T05:25:35.119 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29003.ko 2024-05-08T05:25:35.119 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/isl29020.ko 2024-05-08T05:25:35.119 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d 2024-05-08T05:25:35.119 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-08T05:25:35.119 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-08T05:25:35.119 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei 2024-05-08T05:25:35.119 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-me.ko 2024-05-08T05:25:35.119 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei-txe.ko 2024-05-08T05:25:35.119 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/mei/mei.ko 2024-05-08T05:25:35.119 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru 2024-05-08T05:25:35.119 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-gru/gru.ko 2024-05-08T05:25:35.119 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp 2024-05-08T05:25:35.120 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xp.ko 2024-05-08T05:25:35.120 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpc.ko 2024-05-08T05:25:35.120 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-05-08T05:25:35.120 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_7xx1.ko 2024-05-08T05:25:35.120 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tifm_core.ko 2024-05-08T05:25:35.120 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/tsl2550.ko 2024-05-08T05:25:35.120 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_balloon.ko 2024-05-08T05:25:35.120 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci 2024-05-08T05:25:35.120 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-08T05:25:35.120 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net 2024-05-08T05:25:35.120 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding 2024-05-08T05:25:35.120 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/bonding/bonding.ko 2024-05-08T05:25:35.120 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa 2024-05-08T05:25:35.120 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53 2024-05-08T05:25:35.120 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-08T05:25:35.120 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-08T05:25:35.121 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-08T05:25:35.121 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx 2024-05-08T05:25:35.121 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-08T05:25:35.121 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/dummy.ko 2024-05-08T05:25:35.121 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/eql.ko 2024-05-08T05:25:35.121 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet 2024-05-08T05:25:35.121 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com 2024-05-08T05:25:35.121 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-08T05:25:35.121 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-08T05:25:35.121 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-08T05:25:35.121 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-08T05:25:35.121 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390 2024-05-08T05:25:35.121 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-08T05:25:35.121 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-08T05:25:35.121 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-08T05:25:35.121 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-08T05:25:35.121 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec 2024-05-08T05:25:35.122 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-08T05:25:35.122 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere 2024-05-08T05:25:35.122 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-08T05:25:35.122 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon 2024-05-08T05:25:35.122 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-08T05:25:35.122 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera 2024-05-08T05:25:35.122 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-08T05:25:35.122 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd 2024-05-08T05:25:35.122 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-08T05:25:35.122 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-08T05:25:35.122 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-08T05:25:35.122 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros 2024-05-08T05:25:35.122 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx 2024-05-08T05:25:35.122 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-08T05:25:35.122 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c 2024-05-08T05:25:35.123 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-08T05:25:35.123 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e 2024-05-08T05:25:35.123 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-08T05:25:35.123 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx 2024-05-08T05:25:35.123 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-08T05:25:35.123 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-08T05:25:35.123 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom 2024-05-08T05:25:35.123 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-08T05:25:35.123 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-08T05:25:35.123 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-05-08T05:25:35.123 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-08T05:25:35.123 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-08T05:25:35.123 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet 2024-05-08T05:25:35.123 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-08T05:25:35.123 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-08T05:25:35.123 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade 2024-05-08T05:25:35.124 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna 2024-05-08T05:25:35.124 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-08T05:25:35.124 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio 2024-05-08T05:25:35.124 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb 2024-05-08T05:25:35.124 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-08T05:25:35.124 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-05-08T05:25:35.124 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-08T05:25:35.124 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-05-08T05:25:35.124 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-08T05:25:35.124 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-05-08T05:25:35.124 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-08T05:25:35.124 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-05-08T05:25:35.124 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-08T05:25:35.124 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco 2024-05-08T05:25:35.124 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic 2024-05-08T05:25:35.125 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-08T05:25:35.125 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec 2024-05-08T05:25:35.125 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip 2024-05-08T05:25:35.125 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-08T05:25:35.125 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-08T05:25:35.125 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-08T05:25:35.125 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-08T05:25:35.125 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-08T05:25:35.125 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-08T05:25:35.125 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink 2024-05-08T05:25:35.125 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-08T05:25:35.125 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-08T05:25:35.125 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/dnet.ko 2024-05-08T05:25:35.125 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex 2024-05-08T05:25:35.125 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet 2024-05-08T05:25:35.126 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-08T05:25:35.126 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ethoc.ko 2024-05-08T05:25:35.126 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/fealnx.ko 2024-05-08T05:25:35.126 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel 2024-05-08T05:25:35.126 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-08T05:25:35.126 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000 2024-05-08T05:25:35.126 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-08T05:25:35.126 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e 2024-05-08T05:25:35.126 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-08T05:25:35.126 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k 2024-05-08T05:25:35.126 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-08T05:25:35.126 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e 2024-05-08T05:25:35.126 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-08T05:25:35.126 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf 2024-05-08T05:25:35.127 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-08T05:25:35.127 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb 2024-05-08T05:25:35.127 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-08T05:25:35.127 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf 2024-05-08T05:25:35.127 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-08T05:25:35.127 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe 2024-05-08T05:25:35.127 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-08T05:25:35.127 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf 2024-05-08T05:25:35.127 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-08T05:25:35.127 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/jme.ko 2024-05-08T05:25:35.127 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell 2024-05-08T05:25:35.127 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-08T05:25:35.127 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-08T05:25:35.127 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-08T05:25:35.127 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox 2024-05-08T05:25:35.127 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4 2024-05-08T05:25:35.128 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-08T05:25:35.128 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-08T05:25:35.128 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5 2024-05-08T05:25:35.128 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-05-08T05:25:35.128 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-08T05:25:35.128 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel 2024-05-08T05:25:35.128 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-08T05:25:35.128 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom 2024-05-08T05:25:35.128 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge 2024-05-08T05:25:35.128 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-08T05:25:35.128 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi 2024-05-08T05:25:35.128 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-08T05:25:35.128 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-08T05:25:35.128 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion 2024-05-08T05:25:35.129 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-08T05:25:35.129 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia 2024-05-08T05:25:35.129 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-08T05:25:35.129 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines 2024-05-08T05:25:35.129 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-08T05:25:35.129 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-08T05:25:35.129 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic 2024-05-08T05:25:35.129 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen 2024-05-08T05:25:35.129 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-08T05:25:35.129 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-08T05:25:35.129 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-05-08T05:25:35.129 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-08T05:25:35.129 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc 2024-05-08T05:25:35.129 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-08T05:25:35.129 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek 2024-05-08T05:25:35.129 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-08T05:25:35.130 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-08T05:25:35.130 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-08T05:25:35.130 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-08T05:25:35.130 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker 2024-05-08T05:25:35.130 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-05-08T05:25:35.130 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc 2024-05-08T05:25:35.130 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-08T05:25:35.130 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan 2024-05-08T05:25:35.130 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-08T05:25:35.130 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis 2024-05-08T05:25:35.130 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-08T05:25:35.130 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-08T05:25:35.130 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc 2024-05-08T05:25:35.131 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-08T05:25:35.131 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-08T05:25:35.131 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-08T05:25:35.131 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-08T05:25:35.131 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro 2024-05-08T05:25:35.131 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac 2024-05-08T05:25:35.131 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-08T05:25:35.131 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-08T05:25:35.131 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun 2024-05-08T05:25:35.131 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-08T05:25:35.131 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-08T05:25:35.131 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-08T05:25:35.131 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-08T05:25:35.131 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti 2024-05-08T05:25:35.131 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-08T05:25:35.132 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti 2024-05-08T05:25:35.132 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-08T05:25:35.132 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via 2024-05-08T05:25:35.132 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-08T05:25:35.132 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-08T05:25:35.132 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet 2024-05-08T05:25:35.132 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-08T05:25:35.132 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-08T05:25:35.132 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom 2024-05-08T05:25:35.132 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-08T05:25:35.132 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/geneve.ko 2024-05-08T05:25:35.132 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv 2024-05-08T05:25:35.132 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-08T05:25:35.132 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154 2024-05-08T05:25:35.132 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-08T05:25:35.133 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ifb.ko 2024-05-08T05:25:35.133 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan 2024-05-08T05:25:35.133 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-08T05:25:35.133 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvlan.ko 2024-05-08T05:25:35.133 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/macvtap.ko 2024-05-08T05:25:35.133 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio 2024-05-08T05:25:35.133 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio.ko 2024-05-08T05:25:35.133 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-08T05:25:35.133 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-08T05:25:35.133 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-08T05:25:35.133 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/mii.ko 2024-05-08T05:25:35.133 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/net_failover.ko 2024-05-08T05:25:35.133 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/netconsole.ko 2024-05-08T05:25:35.133 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/nlmon.ko 2024-05-08T05:25:35.134 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs 2024-05-08T05:25:35.134 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-08T05:25:35.134 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-08T05:25:35.134 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy 2024-05-08T05:25:35.134 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/amd.ko 2024-05-08T05:25:35.134 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-08T05:25:35.134 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-05-08T05:25:35.134 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-08T05:25:35.134 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/bcm87xx.ko 2024-05-08T05:25:35.134 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/broadcom.ko 2024-05-08T05:25:35.134 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/cicada.ko 2024-05-08T05:25:35.134 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/davicom.ko 2024-05-08T05:25:35.134 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/dp83640.ko 2024-05-08T05:25:35.134 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/et1011c.ko 2024-05-08T05:25:35.135 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/icplus.ko 2024-05-08T05:25:35.135 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/lxt.ko 2024-05-08T05:25:35.135 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/marvell.ko 2024-05-08T05:25:35.135 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/micrel.ko 2024-05-08T05:25:35.135 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/national.ko 2024-05-08T05:25:35.135 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/phylink.ko 2024-05-08T05:25:35.135 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/qsemi.ko 2024-05-08T05:25:35.135 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/realtek.ko 2024-05-08T05:25:35.135 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/smsc.ko 2024-05-08T05:25:35.135 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/ste10Xp.ko 2024-05-08T05:25:35.135 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/phy/vitesse.ko 2024-05-08T05:25:35.135 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp 2024-05-08T05:25:35.135 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-08T05:25:35.135 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_async.ko 2024-05-08T05:25:35.135 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-08T05:25:35.135 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_generic.ko 2024-05-08T05:25:35.136 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-08T05:25:35.136 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-08T05:25:35.136 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppoe.ko 2024-05-08T05:25:35.136 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pppox.ko 2024-05-08T05:25:35.136 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/ppp/pptp.ko 2024-05-08T05:25:35.136 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip 2024-05-08T05:25:35.136 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slhc.ko 2024-05-08T05:25:35.136 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/slip/slip.ko 2024-05-08T05:25:35.136 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/sungem_phy.ko 2024-05-08T05:25:35.136 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tap.ko 2024-05-08T05:25:35.136 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team 2024-05-08T05:25:35.136 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team.ko 2024-05-08T05:25:35.136 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-08T05:25:35.136 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-08T05:25:35.137 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-08T05:25:35.137 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_random.ko 2024-05-08T05:25:35.137 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-08T05:25:35.137 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/tun.ko 2024-05-08T05:25:35.137 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/veth.ko 2024-05-08T05:25:35.137 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/virtio_net.ko 2024-05-08T05:25:35.137 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3 2024-05-08T05:25:35.137 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-08T05:25:35.137 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan 2024-05-08T05:25:35.137 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/vxlan/vxlan.ko 2024-05-08T05:25:35.137 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback 2024-05-08T05:25:35.137 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-08T05:25:35.137 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/net/xen-netfront.ko 2024-05-08T05:25:35.137 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb 2024-05-08T05:25:35.137 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ntb/ntb.ko 2024-05-08T05:25:35.138 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme 2024-05-08T05:25:35.138 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host 2024-05-08T05:25:35.138 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme-core.ko 2024-05-08T05:25:35.138 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/nvme/host/nvme.ko 2024-05-08T05:25:35.138 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport 2024-05-08T05:25:35.138 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport.ko 2024-05-08T05:25:35.138 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_cs.ko 2024-05-08T05:25:35.138 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_pc.ko 2024-05-08T05:25:35.138 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/parport/parport_serial.ko 2024-05-08T05:25:35.138 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci 2024-05-08T05:25:35.138 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug 2024-05-08T05:25:35.138 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-08T05:25:35.138 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie 2024-05-08T05:25:35.138 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/pcie/aer_inject.ko 2024-05-08T05:25:35.139 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pci/xen-pcifront.ko 2024-05-08T05:25:35.139 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia 2024-05-08T05:25:35.139 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/i82092.ko 2024-05-08T05:25:35.139 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/pd6729.ko 2024-05-08T05:25:35.139 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-08T05:25:35.139 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl 2024-05-08T05:25:35.139 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel 2024-05-08T05:25:35.139 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-08T05:25:35.139 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform 2024-05-08T05:25:35.139 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86 2024-05-08T05:25:35.139 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-08T05:25:35.139 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/acerhdf.ko 2024-05-08T05:25:35.139 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-08T05:25:35.139 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-08T05:25:35.139 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-08T05:25:35.139 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-08T05:25:35.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-08T05:25:35.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-08T05:25:35.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-08T05:25:35.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-08T05:25:35.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-08T05:25:35.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/hdaps.ko 2024-05-08T05:25:35.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel 2024-05-08T05:25:35.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-08T05:25:35.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/intel_ips.ko 2024-05-08T05:25:35.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-08T05:25:35.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-08T05:25:35.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-08T05:25:35.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-08T05:25:35.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-08T05:25:35.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-08T05:25:35.140 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-08T05:25:35.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-08T05:25:35.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-08T05:25:35.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/platform/x86/wmi.ko 2024-05-08T05:25:35.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap 2024-05-08T05:25:35.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-08T05:25:35.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-08T05:25:35.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps 2024-05-08T05:25:35.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients 2024-05-08T05:25:35.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-08T05:25:35.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-08T05:25:35.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/clients/pps_parport.ko 2024-05-08T05:25:35.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/pps/pps_core.ko 2024-05-08T05:25:35.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp 2024-05-08T05:25:35.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp.ko 2024-05-08T05:25:35.141 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ptp/ptp_kvm.ko 2024-05-08T05:25:35.142 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras 2024-05-08T05:25:35.142 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd 2024-05-08T05:25:35.142 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl 2024-05-08T05:25:35.142 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-08T05:25:35.142 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ras/amd/fmpm.ko 2024-05-08T05:25:35.142 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc 2024-05-08T05:25:35.142 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-08T05:25:35.142 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-08T05:25:35.142 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-08T05:25:35.142 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-08T05:25:35.142 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-08T05:25:35.142 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-08T05:25:35.142 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-08T05:25:35.142 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-08T05:25:35.143 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-08T05:25:35.143 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-08T05:25:35.143 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-em3027.ko 2024-05-08T05:25:35.143 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-08T05:25:35.143 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-08T05:25:35.143 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-08T05:25:35.143 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-08T05:25:35.143 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-08T05:25:35.143 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-08T05:25:35.143 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-max6900.ko 2024-05-08T05:25:35.143 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-08T05:25:35.143 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-08T05:25:35.143 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-08T05:25:35.143 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-08T05:25:35.143 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-08T05:25:35.144 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-08T05:25:35.144 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-08T05:25:35.144 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-08T05:25:35.144 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-08T05:25:35.144 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-08T05:25:35.144 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-08T05:25:35.144 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-08T05:25:35.144 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/rtc/rtc-x1205.ko 2024-05-08T05:25:35.144 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi 2024-05-08T05:25:35.144 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-9xxx.ko 2024-05-08T05:25:35.144 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-sas.ko 2024-05-08T05:25:35.144 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/3w-xxxx.ko 2024-05-08T05:25:35.144 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/BusLogic.ko 2024-05-08T05:25:35.144 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/a100u2w.ko 2024-05-08T05:25:35.144 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid 2024-05-08T05:25:35.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-08T05:25:35.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/advansys.ko 2024-05-08T05:25:35.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx 2024-05-08T05:25:35.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-08T05:25:35.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-08T05:25:35.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/am53c974.ko 2024-05-08T05:25:35.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr 2024-05-08T05:25:35.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-08T05:25:35.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/atp870u.ko 2024-05-08T05:25:35.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi 2024-05-08T05:25:35.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-08T05:25:35.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa 2024-05-08T05:25:35.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bfa/bfa.ko 2024-05-08T05:25:35.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc 2024-05-08T05:25:35.145 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-08T05:25:35.146 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i 2024-05-08T05:25:35.146 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-08T05:25:35.146 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ch.ko 2024-05-08T05:25:35.146 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor 2024-05-08T05:25:35.146 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-08T05:25:35.146 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi 2024-05-08T05:25:35.146 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i 2024-05-08T05:25:35.146 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-08T05:25:35.146 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i 2024-05-08T05:25:35.146 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-08T05:25:35.146 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-08T05:25:35.146 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dc395x.ko 2024-05-08T05:25:35.146 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler 2024-05-08T05:25:35.147 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-05-08T05:25:35.147 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-05-08T05:25:35.147 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-05-08T05:25:35.147 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-05-08T05:25:35.147 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/dmx3191d.ko 2024-05-08T05:25:35.147 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r 2024-05-08T05:25:35.147 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-08T05:25:35.147 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/esp_scsi.ko 2024-05-08T05:25:35.147 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe 2024-05-08T05:25:35.147 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-08T05:25:35.147 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-08T05:25:35.147 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic 2024-05-08T05:25:35.147 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/fnic/fnic.ko 2024-05-08T05:25:35.147 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hpsa.ko 2024-05-08T05:25:35.147 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hptiop.ko 2024-05-08T05:25:35.148 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/hv_storvsc.ko 2024-05-08T05:25:35.148 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/initio.ko 2024-05-08T05:25:35.148 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ipr.ko 2024-05-08T05:25:35.148 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ips.ko 2024-05-08T05:25:35.148 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci 2024-05-08T05:25:35.148 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/isci/isci.ko 2024-05-08T05:25:35.148 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-08T05:25:35.148 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-08T05:25:35.148 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc 2024-05-08T05:25:35.148 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libfc/libfc.ko 2024-05-08T05:25:35.148 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi.ko 2024-05-08T05:25:35.148 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-08T05:25:35.148 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas 2024-05-08T05:25:35.148 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/libsas/libsas.ko 2024-05-08T05:25:35.148 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc 2024-05-08T05:25:35.149 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-08T05:25:35.149 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid 2024-05-08T05:25:35.149 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid.ko 2024-05-08T05:25:35.149 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-08T05:25:35.149 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-08T05:25:35.149 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-08T05:25:35.149 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas 2024-05-08T05:25:35.149 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-08T05:25:35.149 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas 2024-05-08T05:25:35.149 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-08T05:25:35.149 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/mvumi.ko 2024-05-08T05:25:35.149 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001 2024-05-08T05:25:35.149 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-08T05:25:35.149 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/pmcraid.ko 2024-05-08T05:25:35.149 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla1280.ko 2024-05-08T05:25:35.150 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx 2024-05-08T05:25:35.150 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-08T05:25:35.150 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-08T05:25:35.150 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx 2024-05-08T05:25:35.150 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-08T05:25:35.150 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/raid_class.ko 2024-05-08T05:25:35.150 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_debug.ko 2024-05-08T05:25:35.150 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-08T05:25:35.150 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-08T05:25:35.150 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-08T05:25:35.150 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-08T05:25:35.150 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-08T05:25:35.150 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/ses.ko 2024-05-08T05:25:35.150 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/st.ko 2024-05-08T05:25:35.150 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/stex.ko 2024-05-08T05:25:35.151 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2 2024-05-08T05:25:35.151 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-08T05:25:35.151 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/virtio_scsi.ko 2024-05-08T05:25:35.151 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-08T05:25:35.151 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/scsi/wd719x.ko 2024-05-08T05:25:35.151 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb 2024-05-08T05:25:35.151 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ssb/ssb.ko 2024-05-08T05:25:35.151 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target 2024-05-08T05:25:35.151 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi 2024-05-08T05:25:35.151 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-08T05:25:35.151 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback 2024-05-08T05:25:35.151 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-08T05:25:35.151 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_file.ko 2024-05-08T05:25:35.151 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_iblock.ko 2024-05-08T05:25:35.151 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_mod.ko 2024-05-08T05:25:35.152 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_pscsi.ko 2024-05-08T05:25:35.152 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/target_core_user.ko 2024-05-08T05:25:35.152 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc 2024-05-08T05:25:35.152 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-08T05:25:35.152 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal 2024-05-08T05:25:35.152 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel 2024-05-08T05:25:35.152 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal 2024-05-08T05:25:35.152 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-08T05:25:35.152 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-08T05:25:35.152 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-08T05:25:35.152 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-08T05:25:35.152 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-08T05:25:35.152 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-08T05:25:35.152 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-08T05:25:35.152 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-08T05:25:35.153 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-08T05:25:35.153 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-08T05:25:35.153 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-08T05:25:35.153 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-08T05:25:35.153 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-08T05:25:35.153 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-08T05:25:35.153 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-08T05:25:35.153 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-08T05:25:35.153 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-08T05:25:35.153 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-08T05:25:35.153 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty 2024-05-08T05:25:35.153 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless 2024-05-08T05:25:35.153 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-08T05:25:35.154 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_gsm.ko 2024-05-08T05:25:35.154 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/n_hdlc.ko 2024-05-08T05:25:35.154 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/nozomi.ko 2024-05-08T05:25:35.154 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial 2024-05-08T05:25:35.154 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250 2024-05-08T05:25:35.154 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-08T05:25:35.154 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/arc_uart.ko 2024-05-08T05:25:35.154 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm 2024-05-08T05:25:35.154 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-08T05:25:35.154 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs 2024-05-08T05:25:35.154 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core 2024-05-08T05:25:35.154 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-08T05:25:35.154 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host 2024-05-08T05:25:35.154 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-08T05:25:35.154 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio 2024-05-08T05:25:35.155 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio.ko 2024-05-08T05:25:35.155 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_aec.ko 2024-05-08T05:25:35.155 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_cif.ko 2024-05-08T05:25:35.155 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_pci_generic.ko 2024-05-08T05:25:35.155 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/uio/uio_sercos3.ko 2024-05-08T05:25:35.155 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb 2024-05-08T05:25:35.155 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class 2024-05-08T05:25:35.155 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-acm.ko 2024-05-08T05:25:35.155 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-08T05:25:35.155 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usblp.ko 2024-05-08T05:25:35.155 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/class/usbtmc.ko 2024-05-08T05:25:35.155 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host 2024-05-08T05:25:35.155 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-08T05:25:35.155 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image 2024-05-08T05:25:35.155 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/mdc800.ko 2024-05-08T05:25:35.156 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/image/microtek.ko 2024-05-08T05:25:35.156 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc 2024-05-08T05:25:35.156 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/adutux.ko 2024-05-08T05:25:35.156 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/appledisplay.ko 2024-05-08T05:25:35.156 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi26.ko 2024-05-08T05:25:35.156 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/emi62.ko 2024-05-08T05:25:35.156 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ezusb.ko 2024-05-08T05:25:35.156 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/idmouse.ko 2024-05-08T05:25:35.156 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/iowarrior.ko 2024-05-08T05:25:35.156 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-08T05:25:35.156 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/ldusb.ko 2024-05-08T05:25:35.156 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/legousbtower.ko 2024-05-08T05:25:35.156 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga 2024-05-08T05:25:35.156 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-08T05:25:35.156 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-08T05:25:35.157 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usb3503.ko 2024-05-08T05:25:35.157 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usblcd.ko 2024-05-08T05:25:35.157 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-08T05:25:35.157 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/uss720.ko 2024-05-08T05:25:35.157 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/misc/yurex.ko 2024-05-08T05:25:35.157 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy 2024-05-08T05:25:35.157 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/phy/phy-generic.ko 2024-05-08T05:25:35.157 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial 2024-05-08T05:25:35.157 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/aircable.ko 2024-05-08T05:25:35.157 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ark3116.ko 2024-05-08T05:25:35.157 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-08T05:25:35.157 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ch341.ko 2024-05-08T05:25:35.157 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cp210x.ko 2024-05-08T05:25:35.157 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cyberjack.ko 2024-05-08T05:25:35.157 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-08T05:25:35.158 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-08T05:25:35.158 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/empeg.ko 2024-05-08T05:25:35.158 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-08T05:25:35.158 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-08T05:25:35.158 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-08T05:25:35.158 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/io_ti.ko 2024-05-08T05:25:35.158 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipaq.ko 2024-05-08T05:25:35.158 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ipw.ko 2024-05-08T05:25:35.158 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ir-usb.ko 2024-05-08T05:25:35.158 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-08T05:25:35.158 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan.ko 2024-05-08T05:25:35.158 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-08T05:25:35.158 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-08T05:25:35.158 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-08T05:25:35.158 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mct_u232.ko 2024-05-08T05:25:35.159 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7720.ko 2024-05-08T05:25:35.159 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/mos7840.ko 2024-05-08T05:25:35.159 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/navman.ko 2024-05-08T05:25:35.159 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/omninet.ko 2024-05-08T05:25:35.159 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/opticon.ko 2024-05-08T05:25:35.159 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/option.ko 2024-05-08T05:25:35.159 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/oti6858.ko 2024-05-08T05:25:35.159 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/pl2303.ko 2024-05-08T05:25:35.159 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcaux.ko 2024-05-08T05:25:35.159 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/qcserial.ko 2024-05-08T05:25:35.159 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/quatech2.ko 2024-05-08T05:25:35.159 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/safe_serial.ko 2024-05-08T05:25:35.159 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/sierra.ko 2024-05-08T05:25:35.159 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-08T05:25:35.159 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ssu100.ko 2024-05-08T05:25:35.159 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/symbolserial.ko 2024-05-08T05:25:35.160 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-08T05:25:35.160 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-08T05:25:35.160 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_debug.ko 2024-05-08T05:25:35.160 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-08T05:25:35.160 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/visor.ko 2024-05-08T05:25:35.160 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/whiteheat.ko 2024-05-08T05:25:35.160 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-08T05:25:35.160 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage 2024-05-08T05:25:35.160 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/uas.ko 2024-05-08T05:25:35.160 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-08T05:25:35.160 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-08T05:25:35.160 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-08T05:25:35.160 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-08T05:25:35.160 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-08T05:25:35.160 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-08T05:25:35.160 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-08T05:25:35.161 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-karma.ko 2024-05-08T05:25:35.161 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-08T05:25:35.161 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-08T05:25:35.161 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-08T05:25:35.161 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-08T05:25:35.161 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-08T05:25:35.161 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/storage/usb-storage.ko 2024-05-08T05:25:35.161 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip 2024-05-08T05:25:35.161 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-08T05:25:35.161 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-08T05:25:35.161 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-08T05:25:35.161 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio 2024-05-08T05:25:35.161 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci 2024-05-08T05:25:35.161 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-08T05:25:35.161 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-08T05:25:35.162 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio.ko 2024-05-08T05:25:35.162 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-08T05:25:35.162 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost 2024-05-08T05:25:35.162 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost.ko 2024-05-08T05:25:35.162 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-08T05:25:35.162 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_net.ko 2024-05-08T05:25:35.162 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/vhost/vhost_scsi.ko 2024-05-08T05:25:35.162 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video 2024-05-08T05:25:35.162 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight 2024-05-08T05:25:35.162 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/apple_bl.ko 2024-05-08T05:25:35.162 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/lcd.ko 2024-05-08T05:25:35.162 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-08T05:25:35.162 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio 2024-05-08T05:25:35.162 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio.ko 2024-05-08T05:25:35.163 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_balloon.ko 2024-05-08T05:25:35.163 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_mmio.ko 2024-05-08T05:25:35.163 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci.ko 2024-05-08T05:25:35.163 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-05-08T05:25:35.163 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-05-08T05:25:35.163 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/virtio/virtio_ring.ko 2024-05-08T05:25:35.163 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1 2024-05-08T05:25:35.163 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters 2024-05-08T05:25:35.163 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2482.ko 2024-05-08T05:25:35.163 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/masters/ds2490.ko 2024-05-08T05:25:35.163 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves 2024-05-08T05:25:35.163 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-08T05:25:35.163 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-08T05:25:35.163 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-08T05:25:35.163 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-08T05:25:35.164 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-08T05:25:35.164 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-08T05:25:35.164 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-08T05:25:35.164 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-08T05:25:35.164 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-08T05:25:35.164 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-08T05:25:35.164 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-08T05:25:35.164 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/w1/wire.ko 2024-05-08T05:25:35.164 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog 2024-05-08T05:25:35.164 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-08T05:25:35.164 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-08T05:25:35.164 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-08T05:25:35.164 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/hpwdt.ko 2024-05-08T05:25:35.164 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/i6300esb.ko 2024-05-08T05:25:35.164 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-08T05:25:35.165 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-08T05:25:35.165 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ib700wdt.ko 2024-05-08T05:25:35.165 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ibmasr.ko 2024-05-08T05:25:35.165 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-08T05:25:35.165 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-08T05:25:35.165 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/it87_wdt.ko 2024-05-08T05:25:35.165 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/machzwd.ko 2024-05-08T05:25:35.165 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/nv_tco.ko 2024-05-08T05:25:35.165 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-08T05:25:35.165 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-08T05:25:35.165 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-08T05:25:35.165 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-08T05:25:35.165 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/softdog.ko 2024-05-08T05:25:35.165 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-08T05:25:35.166 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/via_wdt.ko 2024-05-08T05:25:35.166 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-08T05:25:35.166 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-08T05:25:35.166 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-08T05:25:35.166 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/wdt_pci.ko 2024-05-08T05:25:35.166 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/watchdog/xen_wdt.ko 2024-05-08T05:25:35.166 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen 2024-05-08T05:25:35.166 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-acpi-processor.ko 2024-05-08T05:25:35.166 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-evtchn.ko 2024-05-08T05:25:35.166 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntalloc.ko 2024-05-08T05:25:35.166 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-gntdev.ko 2024-05-08T05:25:35.166 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback 2024-05-08T05:25:35.166 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-08T05:25:35.166 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xen-privcmd.ko 2024-05-08T05:25:35.166 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs 2024-05-08T05:25:35.167 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-08T05:25:35.167 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs 2024-05-08T05:25:35.167 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p 2024-05-08T05:25:35.167 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/9p/9p.ko 2024-05-08T05:25:35.167 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs 2024-05-08T05:25:35.167 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/affs/affs.ko 2024-05-08T05:25:35.167 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs 2024-05-08T05:25:35.167 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/befs/befs.ko 2024-05-08T05:25:35.167 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/binfmt_misc.ko 2024-05-08T05:25:35.167 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs 2024-05-08T05:25:35.167 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/btrfs/btrfs.ko 2024-05-08T05:25:35.167 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles 2024-05-08T05:25:35.167 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cachefiles/cachefiles.ko 2024-05-08T05:25:35.167 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph 2024-05-08T05:25:35.167 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ceph/ceph.ko 2024-05-08T05:25:35.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda 2024-05-08T05:25:35.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/coda/coda.ko 2024-05-08T05:25:35.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs 2024-05-08T05:25:35.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/cramfs/cramfs.ko 2024-05-08T05:25:35.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm 2024-05-08T05:25:35.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/dlm/dlm.ko 2024-05-08T05:25:35.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs 2024-05-08T05:25:35.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ecryptfs/ecryptfs.ko 2024-05-08T05:25:35.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs 2024-05-08T05:25:35.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/f2fs/f2fs.ko 2024-05-08T05:25:35.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat 2024-05-08T05:25:35.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/fat.ko 2024-05-08T05:25:35.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/msdos.ko 2024-05-08T05:25:35.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fat/vfat.ko 2024-05-08T05:25:35.168 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse 2024-05-08T05:25:35.169 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/cuse.ko 2024-05-08T05:25:35.169 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/fuse/fuse.ko 2024-05-08T05:25:35.169 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2 2024-05-08T05:25:35.169 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/gfs2/gfs2.ko 2024-05-08T05:25:35.169 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs 2024-05-08T05:25:35.169 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfs/hfs.ko 2024-05-08T05:25:35.169 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus 2024-05-08T05:25:35.169 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/hfsplus/hfsplus.ko 2024-05-08T05:25:35.169 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs 2024-05-08T05:25:35.169 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/isofs/isofs.ko 2024-05-08T05:25:35.169 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs 2024-05-08T05:25:35.169 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/jfs/jfs.ko 2024-05-08T05:25:35.169 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd 2024-05-08T05:25:35.169 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/lockd/lockd.ko 2024-05-08T05:25:35.170 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix 2024-05-08T05:25:35.170 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/minix/minix.ko 2024-05-08T05:25:35.170 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs 2024-05-08T05:25:35.170 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/netfs/netfs.ko 2024-05-08T05:25:35.170 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs 2024-05-08T05:25:35.170 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout 2024-05-08T05:25:35.170 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-08T05:25:35.170 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout 2024-05-08T05:25:35.170 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-08T05:25:35.170 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout 2024-05-08T05:25:35.170 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-08T05:25:35.170 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfs.ko 2024-05-08T05:25:35.170 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv3.ko 2024-05-08T05:25:35.170 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs/nfsv4.ko 2024-05-08T05:25:35.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common 2024-05-08T05:25:35.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/grace.ko 2024-05-08T05:25:35.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfs_common/nfs_acl.ko 2024-05-08T05:25:35.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd 2024-05-08T05:25:35.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nfsd/nfsd.ko 2024-05-08T05:25:35.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2 2024-05-08T05:25:35.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nilfs2/nilfs2.ko 2024-05-08T05:25:35.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls 2024-05-08T05:25:35.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-celtic.ko 2024-05-08T05:25:35.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-centeuro.ko 2024-05-08T05:25:35.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-croatian.ko 2024-05-08T05:25:35.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-cyrillic.ko 2024-05-08T05:25:35.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-gaelic.ko 2024-05-08T05:25:35.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-greek.ko 2024-05-08T05:25:35.171 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-iceland.ko 2024-05-08T05:25:35.172 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-inuit.ko 2024-05-08T05:25:35.172 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-roman.ko 2024-05-08T05:25:35.172 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-romanian.ko 2024-05-08T05:25:35.172 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/mac-turkish.ko 2024-05-08T05:25:35.172 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1250.ko 2024-05-08T05:25:35.172 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1251.ko 2024-05-08T05:25:35.172 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp1255.ko 2024-05-08T05:25:35.172 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp737.ko 2024-05-08T05:25:35.172 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp775.ko 2024-05-08T05:25:35.172 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp850.ko 2024-05-08T05:25:35.172 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp852.ko 2024-05-08T05:25:35.172 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp855.ko 2024-05-08T05:25:35.172 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp857.ko 2024-05-08T05:25:35.172 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp860.ko 2024-05-08T05:25:35.172 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp861.ko 2024-05-08T05:25:35.173 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp862.ko 2024-05-08T05:25:35.173 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp863.ko 2024-05-08T05:25:35.173 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp864.ko 2024-05-08T05:25:35.173 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp865.ko 2024-05-08T05:25:35.173 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp866.ko 2024-05-08T05:25:35.173 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp869.ko 2024-05-08T05:25:35.173 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp874.ko 2024-05-08T05:25:35.173 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp932.ko 2024-05-08T05:25:35.173 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp936.ko 2024-05-08T05:25:35.173 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp949.ko 2024-05-08T05:25:35.173 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_cp950.ko 2024-05-08T05:25:35.173 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_euc-jp.ko 2024-05-08T05:25:35.173 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-1.ko 2024-05-08T05:25:35.173 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-13.ko 2024-05-08T05:25:35.173 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-14.ko 2024-05-08T05:25:35.174 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-15.ko 2024-05-08T05:25:35.174 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-2.ko 2024-05-08T05:25:35.174 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-3.ko 2024-05-08T05:25:35.174 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-4.ko 2024-05-08T05:25:35.174 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-5.ko 2024-05-08T05:25:35.174 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-6.ko 2024-05-08T05:25:35.174 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-7.ko 2024-05-08T05:25:35.174 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_iso8859-9.ko 2024-05-08T05:25:35.174 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-r.ko 2024-05-08T05:25:35.174 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-ru.ko 2024-05-08T05:25:35.174 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_koi8-u.ko 2024-05-08T05:25:35.174 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-08T05:25:35.174 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/nls/nls_utf8.ko 2024-05-08T05:25:35.174 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2 2024-05-08T05:25:35.175 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster 2024-05-08T05:25:35.175 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-08T05:25:35.175 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm 2024-05-08T05:25:35.175 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-08T05:25:35.175 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs 2024-05-08T05:25:35.175 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-08T05:25:35.175 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2.ko 2024-05-08T05:25:35.175 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-08T05:25:35.175 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-08T05:25:35.175 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-08T05:25:35.175 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs 2024-05-08T05:25:35.175 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/overlayfs/overlay.ko 2024-05-08T05:25:35.175 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore 2024-05-08T05:25:35.175 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/pstore/ramoops.ko 2024-05-08T05:25:35.175 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs 2024-05-08T05:25:35.175 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/reiserfs/reiserfs.ko 2024-05-08T05:25:35.176 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs 2024-05-08T05:25:35.176 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/romfs/romfs.ko 2024-05-08T05:25:35.176 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb 2024-05-08T05:25:35.176 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client 2024-05-08T05:25:35.176 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/client/cifs.ko 2024-05-08T05:25:35.176 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common 2024-05-08T05:25:35.176 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_arc4.ko 2024-05-08T05:25:35.176 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/smb/common/cifs_md4.ko 2024-05-08T05:25:35.176 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs 2024-05-08T05:25:35.176 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/squashfs/squashfs.ko 2024-05-08T05:25:35.176 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv 2024-05-08T05:25:35.176 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/sysv/sysv.ko 2024-05-08T05:25:35.176 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf 2024-05-08T05:25:35.176 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/udf/udf.ko 2024-05-08T05:25:35.176 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs 2024-05-08T05:25:35.177 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/ufs/ufs.ko 2024-05-08T05:25:35.177 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs 2024-05-08T05:25:35.177 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/fs/xfs/xfs.ko 2024-05-08T05:25:35.177 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel 2024-05-08T05:25:35.177 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu 2024-05-08T05:25:35.177 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/rcu/rcutorture.ko 2024-05-08T05:25:35.177 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/torture.ko 2024-05-08T05:25:35.177 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace 2024-05-08T05:25:35.177 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-05-08T05:25:35.177 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib 2024-05-08T05:25:35.177 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/asn1_encoder.ko 2024-05-08T05:25:35.177 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc-itu-t.ko 2024-05-08T05:25:35.177 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crc8.ko 2024-05-08T05:25:35.177 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto 2024-05-08T05:25:35.178 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libarc4.ko 2024-05-08T05:25:35.178 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/crypto/libdes.ko 2024-05-08T05:25:35.178 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/libcrc32c.ko 2024-05-08T05:25:35.178 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lru_cache.ko 2024-05-08T05:25:35.178 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4 2024-05-08T05:25:35.178 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4_compress.ko 2024-05-08T05:25:35.178 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/lz4/lz4hc_compress.ko 2024-05-08T05:25:35.178 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math 2024-05-08T05:25:35.178 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/math/cordic.ko 2024-05-08T05:25:35.178 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6 2024-05-08T05:25:35.178 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/raid6/raid6_pq.ko 2024-05-08T05:25:35.178 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon 2024-05-08T05:25:35.178 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-08T05:25:35.178 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_bm.ko 2024-05-08T05:25:35.179 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_fsm.ko 2024-05-08T05:25:35.179 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/ts_kmp.ko 2024-05-08T05:25:35.179 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd 2024-05-08T05:25:35.179 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/lib/zstd/zstd_compress.ko 2024-05-08T05:25:35.179 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm 2024-05-08T05:25:35.179 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/mm/hwpoison-inject.ko 2024-05-08T05:25:35.179 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net 2024-05-08T05:25:35.179 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan 2024-05-08T05:25:35.179 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/6lowpan.ko 2024-05-08T05:25:35.179 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_dest.ko 2024-05-08T05:25:35.179 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_fragment.ko 2024-05-08T05:25:35.179 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_hop.ko 2024-05-08T05:25:35.179 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-08T05:25:35.179 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_mobility.ko 2024-05-08T05:25:35.179 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_routing.ko 2024-05-08T05:25:35.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/6lowpan/nhc_udp.ko 2024-05-08T05:25:35.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802 2024-05-08T05:25:35.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/garp.ko 2024-05-08T05:25:35.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/mrp.ko 2024-05-08T05:25:35.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/p8022.ko 2024-05-08T05:25:35.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/psnap.ko 2024-05-08T05:25:35.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/802/stp.ko 2024-05-08T05:25:35.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q 2024-05-08T05:25:35.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/8021q/8021q.ko 2024-05-08T05:25:35.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p 2024-05-08T05:25:35.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet.ko 2024-05-08T05:25:35.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_fd.ko 2024-05-08T05:25:35.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_rdma.ko 2024-05-08T05:25:35.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/9p/9pnet_virtio.ko 2024-05-08T05:25:35.180 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv 2024-05-08T05:25:35.181 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/batman-adv/batman-adv.ko 2024-05-08T05:25:35.181 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge 2024-05-08T05:25:35.181 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/br_netfilter.ko 2024-05-08T05:25:35.181 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/bridge.ko 2024-05-08T05:25:35.181 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter 2024-05-08T05:25:35.181 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-08T05:25:35.181 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-08T05:25:35.181 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-08T05:25:35.181 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-08T05:25:35.181 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-08T05:25:35.181 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-08T05:25:35.181 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-08T05:25:35.181 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-08T05:25:35.181 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-08T05:25:35.181 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-08T05:25:35.182 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-08T05:25:35.182 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-08T05:25:35.182 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-08T05:25:35.182 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-08T05:25:35.182 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-08T05:25:35.182 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-08T05:25:35.182 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-08T05:25:35.182 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-08T05:25:35.182 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-08T05:25:35.182 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-08T05:25:35.182 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/ebtables.ko 2024-05-08T05:25:35.182 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-05-08T05:25:35.182 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-08T05:25:35.182 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-08T05:25:35.183 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph 2024-05-08T05:25:35.183 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ceph/libceph.ko 2024-05-08T05:25:35.183 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core 2024-05-08T05:25:35.183 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/failover.ko 2024-05-08T05:25:35.183 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/core/pktgen.ko 2024-05-08T05:25:35.183 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp 2024-05-08T05:25:35.183 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp.ko 2024-05-08T05:25:35.183 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_diag.ko 2024-05-08T05:25:35.183 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv4.ko 2024-05-08T05:25:35.183 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dccp/dccp_ipv6.ko 2024-05-08T05:25:35.183 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver 2024-05-08T05:25:35.183 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dns_resolver/dns_resolver.ko 2024-05-08T05:25:35.183 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa 2024-05-08T05:25:35.183 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/dsa_core.ko 2024-05-08T05:25:35.183 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_brcm.ko 2024-05-08T05:25:35.184 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_dsa.ko 2024-05-08T05:25:35.184 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_none.ko 2024-05-08T05:25:35.184 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/dsa/tag_trailer.ko 2024-05-08T05:25:35.184 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154 2024-05-08T05:25:35.184 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan 2024-05-08T05:25:35.184 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-08T05:25:35.184 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154.ko 2024-05-08T05:25:35.184 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-08T05:25:35.184 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4 2024-05-08T05:25:35.184 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ah4.ko 2024-05-08T05:25:35.184 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/esp4.ko 2024-05-08T05:25:35.184 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/fou.ko 2024-05-08T05:25:35.184 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/gre.ko 2024-05-08T05:25:35.184 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/inet_diag.ko 2024-05-08T05:25:35.184 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_gre.ko 2024-05-08T05:25:35.184 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_tunnel.ko 2024-05-08T05:25:35.185 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ip_vti.ko 2024-05-08T05:25:35.185 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipcomp.ko 2024-05-08T05:25:35.185 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/ipip.ko 2024-05-08T05:25:35.185 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter 2024-05-08T05:25:35.185 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-08T05:25:35.185 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-08T05:25:35.185 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-08T05:25:35.185 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-08T05:25:35.185 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-08T05:25:35.185 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-08T05:25:35.185 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-08T05:25:35.185 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-08T05:25:35.185 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-08T05:25:35.185 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-08T05:25:35.185 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-08T05:25:35.185 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-08T05:25:35.186 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-08T05:25:35.186 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-08T05:25:35.186 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-08T05:25:35.186 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-08T05:25:35.186 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-08T05:25:35.186 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-08T05:25:35.186 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-08T05:25:35.186 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-08T05:25:35.186 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-08T05:25:35.186 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_bic.ko 2024-05-08T05:25:35.186 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_dctcp.ko 2024-05-08T05:25:35.186 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_diag.ko 2024-05-08T05:25:35.186 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_highspeed.ko 2024-05-08T05:25:35.186 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_htcp.ko 2024-05-08T05:25:35.187 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_hybla.ko 2024-05-08T05:25:35.187 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_illinois.ko 2024-05-08T05:25:35.187 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_lp.ko 2024-05-08T05:25:35.187 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_scalable.ko 2024-05-08T05:25:35.187 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_vegas.ko 2024-05-08T05:25:35.187 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_veno.ko 2024-05-08T05:25:35.187 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_westwood.ko 2024-05-08T05:25:35.187 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tcp_yeah.ko 2024-05-08T05:25:35.187 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/tunnel4.ko 2024-05-08T05:25:35.187 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_diag.ko 2024-05-08T05:25:35.187 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/udp_tunnel.ko 2024-05-08T05:25:35.187 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-08T05:25:35.187 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6 2024-05-08T05:25:35.187 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ah6.ko 2024-05-08T05:25:35.187 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/esp6.ko 2024-05-08T05:25:35.188 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/fou6.ko 2024-05-08T05:25:35.188 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_tunnel.ko 2024-05-08T05:25:35.188 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-08T05:25:35.188 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ip6_vti.ko 2024-05-08T05:25:35.188 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/ipcomp6.ko 2024-05-08T05:25:35.188 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter 2024-05-08T05:25:35.188 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-08T05:25:35.188 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-08T05:25:35.188 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-08T05:25:35.188 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-08T05:25:35.188 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-08T05:25:35.188 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-08T05:25:35.188 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-08T05:25:35.188 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-08T05:25:35.188 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-08T05:25:35.189 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-08T05:25:35.189 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-08T05:25:35.189 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-08T05:25:35.189 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-08T05:25:35.189 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-08T05:25:35.189 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-08T05:25:35.189 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-08T05:25:35.189 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-08T05:25:35.189 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-08T05:25:35.189 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-08T05:25:35.189 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-08T05:25:35.189 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-08T05:25:35.189 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-08T05:25:35.189 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-08T05:25:35.189 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-08T05:25:35.190 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/sit.ko 2024-05-08T05:25:35.190 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/tunnel6.ko 2024-05-08T05:25:35.190 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-08T05:25:35.190 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key 2024-05-08T05:25:35.190 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/key/af_key.ko 2024-05-08T05:25:35.190 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp 2024-05-08T05:25:35.190 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_core.ko 2024-05-08T05:25:35.190 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-08T05:25:35.190 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_eth.ko 2024-05-08T05:25:35.190 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip.ko 2024-05-08T05:25:35.190 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ip6.ko 2024-05-08T05:25:35.190 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_netlink.ko 2024-05-08T05:25:35.190 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/l2tp/l2tp_ppp.ko 2024-05-08T05:25:35.190 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc 2024-05-08T05:25:35.190 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/llc/llc.ko 2024-05-08T05:25:35.191 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154 2024-05-08T05:25:35.191 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mac802154/mac802154.ko 2024-05-08T05:25:35.191 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls 2024-05-08T05:25:35.191 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/mpls/mpls_gso.ko 2024-05-08T05:25:35.191 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter 2024-05-08T05:25:35.191 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset 2024-05-08T05:25:35.191 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set.ko 2024-05-08T05:25:35.191 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-08T05:25:35.191 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-08T05:25:35.191 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-08T05:25:35.191 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-08T05:25:35.191 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-08T05:25:35.191 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-08T05:25:35.191 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-08T05:25:35.191 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-08T05:25:35.192 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-08T05:25:35.192 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-08T05:25:35.192 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-08T05:25:35.192 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-08T05:25:35.192 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-08T05:25:35.192 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-08T05:25:35.192 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-08T05:25:35.192 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs 2024-05-08T05:25:35.192 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-08T05:25:35.192 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-08T05:25:35.192 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-08T05:25:35.192 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-08T05:25:35.192 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-08T05:25:35.192 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-08T05:25:35.193 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-08T05:25:35.193 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-08T05:25:35.193 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-08T05:25:35.193 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-08T05:25:35.193 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-08T05:25:35.193 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-08T05:25:35.193 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-08T05:25:35.193 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-08T05:25:35.193 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conncount.ko 2024-05-08T05:25:35.193 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack.ko 2024-05-08T05:25:35.193 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-08T05:25:35.193 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-08T05:25:35.193 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-08T05:25:35.193 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-08T05:25:35.193 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-08T05:25:35.194 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-08T05:25:35.194 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-08T05:25:35.194 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-08T05:25:35.194 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-08T05:25:35.194 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-08T05:25:35.194 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-08T05:25:35.194 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-08T05:25:35.194 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-08T05:25:35.194 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table.ko 2024-05-08T05:25:35.194 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-08T05:25:35.194 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_log_syslog.ko 2024-05-08T05:25:35.194 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat.ko 2024-05-08T05:25:35.194 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-08T05:25:35.194 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-08T05:25:35.195 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_irc.ko 2024-05-08T05:25:35.195 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_sip.ko 2024-05-08T05:25:35.195 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-08T05:25:35.195 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-08T05:25:35.195 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nf_tables.ko 2024-05-08T05:25:35.195 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink.ko 2024-05-08T05:25:35.195 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-08T05:25:35.195 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_log.ko 2024-05-08T05:25:35.195 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-08T05:25:35.195 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-08T05:25:35.195 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_chain_nat.ko 2024-05-08T05:25:35.195 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_compat.ko 2024-05-08T05:25:35.195 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_ct.ko 2024-05-08T05:25:35.195 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-08T05:25:35.196 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fib.ko 2024-05-08T05:25:35.196 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-08T05:25:35.196 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_hash.ko 2024-05-08T05:25:35.196 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_limit.ko 2024-05-08T05:25:35.196 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_log.ko 2024-05-08T05:25:35.196 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_masq.ko 2024-05-08T05:25:35.196 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_nat.ko 2024-05-08T05:25:35.196 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_numgen.ko 2024-05-08T05:25:35.196 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_queue.ko 2024-05-08T05:25:35.196 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_quota.ko 2024-05-08T05:25:35.196 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_redir.ko 2024-05-08T05:25:35.196 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject.ko 2024-05-08T05:25:35.196 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_reject_inet.ko 2024-05-08T05:25:35.196 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_socket.ko 2024-05-08T05:25:35.196 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/nft_tunnel.ko 2024-05-08T05:25:35.197 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_AUDIT.ko 2024-05-08T05:25:35.197 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-08T05:25:35.197 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-08T05:25:35.197 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-08T05:25:35.197 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_CT.ko 2024-05-08T05:25:35.197 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_DSCP.ko 2024-05-08T05:25:35.197 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HL.ko 2024-05-08T05:25:35.197 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_HMARK.ko 2024-05-08T05:25:35.197 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-08T05:25:35.197 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LED.ko 2024-05-08T05:25:35.197 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_LOG.ko 2024-05-08T05:25:35.197 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-08T05:25:35.197 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NETMAP.ko 2024-05-08T05:25:35.197 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFLOG.ko 2024-05-08T05:25:35.198 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-08T05:25:35.198 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_RATEEST.ko 2024-05-08T05:25:35.198 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-08T05:25:35.198 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_SECMARK.ko 2024-05-08T05:25:35.198 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-08T05:25:35.198 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-08T05:25:35.198 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TEE.ko 2024-05-08T05:25:35.198 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TPROXY.ko 2024-05-08T05:25:35.198 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_TRACE.ko 2024-05-08T05:25:35.198 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_addrtype.ko 2024-05-08T05:25:35.198 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_bpf.ko 2024-05-08T05:25:35.198 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cgroup.ko 2024-05-08T05:25:35.198 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cluster.ko 2024-05-08T05:25:35.198 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_comment.ko 2024-05-08T05:25:35.198 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connbytes.ko 2024-05-08T05:25:35.199 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlabel.ko 2024-05-08T05:25:35.199 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connlimit.ko 2024-05-08T05:25:35.199 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_connmark.ko 2024-05-08T05:25:35.199 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_conntrack.ko 2024-05-08T05:25:35.199 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_cpu.ko 2024-05-08T05:25:35.199 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dccp.ko 2024-05-08T05:25:35.199 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_devgroup.ko 2024-05-08T05:25:35.199 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_dscp.ko 2024-05-08T05:25:35.199 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ecn.ko 2024-05-08T05:25:35.199 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_esp.ko 2024-05-08T05:25:35.199 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hashlimit.ko 2024-05-08T05:25:35.199 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_helper.ko 2024-05-08T05:25:35.199 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_hl.ko 2024-05-08T05:25:35.199 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipcomp.ko 2024-05-08T05:25:35.199 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_iprange.ko 2024-05-08T05:25:35.200 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_ipvs.ko 2024-05-08T05:25:35.200 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_l2tp.ko 2024-05-08T05:25:35.200 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_length.ko 2024-05-08T05:25:35.200 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_limit.ko 2024-05-08T05:25:35.200 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mac.ko 2024-05-08T05:25:35.200 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_mark.ko 2024-05-08T05:25:35.200 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_multiport.ko 2024-05-08T05:25:35.200 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nat.ko 2024-05-08T05:25:35.200 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_nfacct.ko 2024-05-08T05:25:35.200 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_osf.ko 2024-05-08T05:25:35.200 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_owner.ko 2024-05-08T05:25:35.200 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_physdev.ko 2024-05-08T05:25:35.200 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_pkttype.ko 2024-05-08T05:25:35.200 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_policy.ko 2024-05-08T05:25:35.201 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_quota.ko 2024-05-08T05:25:35.201 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_rateest.ko 2024-05-08T05:25:35.201 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_realm.ko 2024-05-08T05:25:35.201 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_recent.ko 2024-05-08T05:25:35.201 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_sctp.ko 2024-05-08T05:25:35.201 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_set.ko 2024-05-08T05:25:35.201 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_socket.ko 2024-05-08T05:25:35.201 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_state.ko 2024-05-08T05:25:35.201 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_statistic.ko 2024-05-08T05:25:35.201 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_string.ko 2024-05-08T05:25:35.201 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_tcpmss.ko 2024-05-08T05:25:35.201 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_time.ko 2024-05-08T05:25:35.201 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netfilter/xt_u32.ko 2024-05-08T05:25:35.202 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink 2024-05-08T05:25:35.202 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/netlink/netlink_diag.ko 2024-05-08T05:25:35.202 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh 2024-05-08T05:25:35.202 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/nsh/nsh.ko 2024-05-08T05:25:35.202 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch 2024-05-08T05:25:35.202 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/openvswitch.ko 2024-05-08T05:25:35.202 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-geneve.ko 2024-05-08T05:25:35.202 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-gre.ko 2024-05-08T05:25:35.202 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/openvswitch/vport-vxlan.ko 2024-05-08T05:25:35.202 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet 2024-05-08T05:25:35.202 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/packet/af_packet_diag.ko 2024-05-08T05:25:35.202 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds 2024-05-08T05:25:35.202 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds.ko 2024-05-08T05:25:35.202 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_rdma.ko 2024-05-08T05:25:35.202 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/rds/rds_tcp.ko 2024-05-08T05:25:35.203 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched 2024-05-08T05:25:35.203 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_csum.ko 2024-05-08T05:25:35.203 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_gact.ko 2024-05-08T05:25:35.203 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_mirred.ko 2024-05-08T05:25:35.203 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_nat.ko 2024-05-08T05:25:35.203 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_pedit.ko 2024-05-08T05:25:35.203 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_police.ko 2024-05-08T05:25:35.203 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_simple.ko 2024-05-08T05:25:35.203 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_skbedit.ko 2024-05-08T05:25:35.203 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/act_vlan.ko 2024-05-08T05:25:35.203 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_basic.ko 2024-05-08T05:25:35.203 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_bpf.ko 2024-05-08T05:25:35.203 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_flow.ko 2024-05-08T05:25:35.203 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_fw.ko 2024-05-08T05:25:35.204 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_route.ko 2024-05-08T05:25:35.204 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/cls_u32.ko 2024-05-08T05:25:35.204 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_cmp.ko 2024-05-08T05:25:35.204 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_ipset.ko 2024-05-08T05:25:35.204 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_meta.ko 2024-05-08T05:25:35.204 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_nbyte.ko 2024-05-08T05:25:35.204 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_text.ko 2024-05-08T05:25:35.204 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/em_u32.ko 2024-05-08T05:25:35.204 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_choke.ko 2024-05-08T05:25:35.204 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_codel.ko 2024-05-08T05:25:35.204 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_drr.ko 2024-05-08T05:25:35.204 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_fq.ko 2024-05-08T05:25:35.204 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_gred.ko 2024-05-08T05:25:35.204 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hfsc.ko 2024-05-08T05:25:35.205 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_hhf.ko 2024-05-08T05:25:35.205 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_htb.ko 2024-05-08T05:25:35.205 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_ingress.ko 2024-05-08T05:25:35.205 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio.ko 2024-05-08T05:25:35.205 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_mqprio_lib.ko 2024-05-08T05:25:35.205 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_multiq.ko 2024-05-08T05:25:35.205 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_netem.ko 2024-05-08T05:25:35.205 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_pie.ko 2024-05-08T05:25:35.205 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_plug.ko 2024-05-08T05:25:35.205 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_prio.ko 2024-05-08T05:25:35.205 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_qfq.ko 2024-05-08T05:25:35.205 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_red.ko 2024-05-08T05:25:35.205 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfb.ko 2024-05-08T05:25:35.205 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_sfq.ko 2024-05-08T05:25:35.205 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_tbf.ko 2024-05-08T05:25:35.206 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sched/sch_teql.ko 2024-05-08T05:25:35.206 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp 2024-05-08T05:25:35.206 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp.ko 2024-05-08T05:25:35.206 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sctp/sctp_diag.ko 2024-05-08T05:25:35.206 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc 2024-05-08T05:25:35.206 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss 2024-05-08T05:25:35.206 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-08T05:25:35.206 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-08T05:25:35.206 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/sunrpc.ko 2024-05-08T05:25:35.206 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma 2024-05-08T05:25:35.206 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-08T05:25:35.206 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc 2024-05-08T05:25:35.206 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc.ko 2024-05-08T05:25:35.206 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/tipc/tipc_diag.ko 2024-05-08T05:25:35.206 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix 2024-05-08T05:25:35.207 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/unix/unix_diag.ko 2024-05-08T05:25:35.207 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock 2024-05-08T05:25:35.207 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-08T05:25:35.207 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-08T05:25:35.207 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock.ko 2024-05-08T05:25:35.207 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-08T05:25:35.207 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-08T05:25:35.207 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm 2024-05-08T05:25:35.207 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-08T05:25:35.207 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security 2024-05-08T05:25:35.207 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys 2024-05-08T05:25:35.207 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys 2024-05-08T05:25:35.207 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-05-08T05:25:35.207 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys 2024-05-08T05:25:35.207 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/kernel/security/keys/trusted-keys/trusted.ko 2024-05-08T05:25:35.207 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias 2024-05-08T05:25:35.207 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.alias.bin 2024-05-08T05:25:35.208 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin 2024-05-08T05:25:35.208 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.alias.bin 2024-05-08T05:25:35.208 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.bin 2024-05-08T05:25:35.208 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.builtin.modinfo 2024-05-08T05:25:35.208 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep 2024-05-08T05:25:35.208 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep.bin 2024-05-08T05:25:35.208 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.devname 2024-05-08T05:25:35.208 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.order 2024-05-08T05:25:35.208 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.softdep 2024-05-08T05:25:35.208 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols 2024-05-08T05:25:35.208 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/modules.symbols.bin 2024-05-08T05:25:35.208 INFO:teuthology.orchestra.run.smithi082.stdout:/lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-05-08T05:25:35.212 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g806ec36b2112 2024-05-08T05:25:35.212 DEBUG:teuthology.orchestra.run.smithi082:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-05-08T05:25:35.237 INFO:teuthology.orchestra.run.smithi082.stdout:postinstall scriptlet (using /bin/sh): 2024-05-08T05:25:35.237 INFO:teuthology.orchestra.run.smithi082.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-08T05:25:35.237 INFO:teuthology.orchestra.run.smithi082.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g806ec36b2112 /lib/modules/6.9.0-rc3-g806ec36b2112/vmlinuz 2024-05-08T05:25:35.237 INFO:teuthology.orchestra.run.smithi082.stdout:fi 2024-05-08T05:25:35.237 INFO:teuthology.orchestra.run.smithi082.stdout:for file in vmlinuz System.map config; do 2024-05-08T05:25:35.237 INFO:teuthology.orchestra.run.smithi082.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112"; then 2024-05-08T05:25:35.237 INFO:teuthology.orchestra.run.smithi082.stdout: cp "/lib/modules/6.9.0-rc3-g806ec36b2112/${file}" "/boot/${file}-6.9.0-rc3-g806ec36b2112" 2024-05-08T05:25:35.237 INFO:teuthology.orchestra.run.smithi082.stdout: fi 2024-05-08T05:25:35.238 INFO:teuthology.orchestra.run.smithi082.stdout:done 2024-05-08T05:25:35.238 INFO:teuthology.orchestra.run.smithi082.stdout:if [ -d "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" ] && \ 2024-05-08T05:25:35.238 INFO:teuthology.orchestra.run.smithi082.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" >/dev/null 2>&1; then 2024-05-08T05:25:35.238 INFO:teuthology.orchestra.run.smithi082.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-05-08T05:25:35.238 INFO:teuthology.orchestra.run.smithi082.stdout: cp -r "/lib/modules/6.9.0-rc3-g806ec36b2112/dtb" "/boot/dtb-6.9.0-rc3-g806ec36b2112" 2024-05-08T05:25:35.238 INFO:teuthology.orchestra.run.smithi082.stdout:fi 2024-05-08T05:25:35.238 INFO:teuthology.orchestra.run.smithi082.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g806ec36b2112/modules.dep" ]; then 2024-05-08T05:25:35.238 INFO:teuthology.orchestra.run.smithi082.stdout: /usr/sbin/depmod 6.9.0-rc3-g806ec36b2112 2024-05-08T05:25:35.238 INFO:teuthology.orchestra.run.smithi082.stdout:fi 2024-05-08T05:25:35.238 INFO:teuthology.orchestra.run.smithi082.stdout:preuninstall scriptlet (using /bin/sh): 2024-05-08T05:25:35.238 INFO:teuthology.orchestra.run.smithi082.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-08T05:25:35.238 INFO:teuthology.orchestra.run.smithi082.stdout:kernel-install remove 6.9.0-rc3-g806ec36b2112 2024-05-08T05:25:35.238 INFO:teuthology.orchestra.run.smithi082.stdout:fi 2024-05-08T05:25:35.239 DEBUG:teuthology.orchestra.run.smithi082:> sudo rpm -qi grub2-tools 2024-05-08T05:25:35.313 INFO:teuthology.orchestra.run.smithi082.stdout:Name : grub2-tools 2024-05-08T05:25:35.313 INFO:teuthology.orchestra.run.smithi082.stdout:Epoch : 1 2024-05-08T05:25:35.313 INFO:teuthology.orchestra.run.smithi082.stdout:Version : 2.06 2024-05-08T05:25:35.313 INFO:teuthology.orchestra.run.smithi082.stdout:Release : 68.el9 2024-05-08T05:25:35.314 INFO:teuthology.orchestra.run.smithi082.stdout:Architecture: x86_64 2024-05-08T05:25:35.314 INFO:teuthology.orchestra.run.smithi082.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-08T05:25:35.314 INFO:teuthology.orchestra.run.smithi082.stdout:Group : Unspecified 2024-05-08T05:25:35.314 INFO:teuthology.orchestra.run.smithi082.stdout:Size : 8264254 2024-05-08T05:25:35.314 INFO:teuthology.orchestra.run.smithi082.stdout:License : GPLv3+ 2024-05-08T05:25:35.314 INFO:teuthology.orchestra.run.smithi082.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-08T05:25:35.314 INFO:teuthology.orchestra.run.smithi082.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-08T05:25:35.314 INFO:teuthology.orchestra.run.smithi082.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-08T05:25:35.314 INFO:teuthology.orchestra.run.smithi082.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-08T05:25:35.314 INFO:teuthology.orchestra.run.smithi082.stdout:Packager : builder@centos.org 2024-05-08T05:25:35.314 INFO:teuthology.orchestra.run.smithi082.stdout:Vendor : CentOS 2024-05-08T05:25:35.315 INFO:teuthology.orchestra.run.smithi082.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-08T05:25:35.315 INFO:teuthology.orchestra.run.smithi082.stdout:Summary : Support tools for GRUB. 2024-05-08T05:25:35.315 INFO:teuthology.orchestra.run.smithi082.stdout:Description : 2024-05-08T05:25:35.315 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:25:35.315 INFO:teuthology.orchestra.run.smithi082.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-08T05:25:35.315 INFO:teuthology.orchestra.run.smithi082.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-08T05:25:35.315 INFO:teuthology.orchestra.run.smithi082.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-08T05:25:35.315 INFO:teuthology.orchestra.run.smithi082.stdout:hardware devices. 2024-05-08T05:25:35.315 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:25:35.315 INFO:teuthology.orchestra.run.smithi082.stdout:This subpackage provides tools for support of all platforms. 2024-05-08T05:25:35.316 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-08T05:25:35.316 INFO:teuthology.task.kernel:Updating grub on smithi082 to boot 6.9.0-rc3-g806ec36b2112 2024-05-08T05:25:35.316 DEBUG:teuthology.orchestra.run.smithi082:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-08T05:25:35.907 INFO:teuthology.orchestra.run.smithi082.stderr:Generating grub configuration file ... 2024-05-08T05:25:37.319 INFO:teuthology.orchestra.run.smithi082.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-08T05:25:37.352 INFO:teuthology.orchestra.run.smithi082.stderr:done 2024-05-08T05:25:37.355 DEBUG:teuthology.orchestra.run.smithi082:> mktemp 2024-05-08T05:25:37.394 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/tmp.9mUHIpuX4S 2024-05-08T05:25:37.394 DEBUG:teuthology.orchestra.run.smithi082:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.9mUHIpuX4S 2024-05-08T05:25:37.470 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0666 /tmp/tmp.9mUHIpuX4S 2024-05-08T05:25:37.608 DEBUG:teuthology.orchestra.remote:smithi082:/tmp/tmp.9mUHIpuX4S is 6KB 2024-05-08T05:25:37.627 DEBUG:teuthology.orchestra.run.smithi082:> rm -fr /tmp/tmp.9mUHIpuX4S 2024-05-08T05:25:37.641 DEBUG:teuthology.orchestra.run.smithi082:> sudo /bin/ls /boot/loader/entries || true 2024-05-08T05:25:37.702 INFO:teuthology.orchestra.run.smithi082.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-08T05:25:37.702 INFO:teuthology.orchestra.run.smithi082.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-08T05:25:37.702 INFO:teuthology.orchestra.run.smithi082.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-08T05:25:37.702 INFO:teuthology.orchestra.run.smithi082.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112.conf 2024-05-08T05:25:37.703 DEBUG:teuthology.orchestra.run.smithi082:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-g806ec36b2112 2024-05-08T05:25:37.879 DEBUG:teuthology.orchestra.run.smithi082:> sudo shutdown -r now 2024-05-08T05:26:07.882 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-05-08T05:26:07.882 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-05-08T05:26:07.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T05:26:26.334 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-05-08T05:26:35.335 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-05-08T05:26:35.336 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T05:26:38.398 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-05-08T05:26:50.399 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-05-08T05:26:50.400 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T05:26:53.470 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-05-08T05:27:08.471 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-05-08T05:27:08.472 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T05:27:11.550 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.82 2024-05-08T05:27:29.551 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-05-08T05:27:29.553 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T05:27:30.062 DEBUG:teuthology.orchestra.run.smithi082:> true 2024-05-08T05:27:30.853 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-05-08T05:27:30.853 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.9.0-rc3-g806ec36b2112"... 2024-05-08T05:27:30.853 DEBUG:teuthology.orchestra.run.smithi082:> uname -r 2024-05-08T05:27:30.900 INFO:teuthology.orchestra.run.smithi082.stdout:6.9.0-rc3-g806ec36b2112 2024-05-08T05:27:30.900 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g806ec36b2112 vs 6.9.0-rc3-g806ec36b2112 2024-05-08T05:27:30.900 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-08T05:27:30.900 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-08T05:27:31.901 DEBUG:teuthology.parallel:result is None 2024-05-08T05:27:31.902 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-08T05:27:31.910 INFO:teuthology.task.internal:Creating test directory... 2024-05-08T05:27:31.910 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-08T05:27:31.915 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-08T05:27:31.918 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-08T05:27:31.949 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-08T05:27:31.956 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-08T05:27:31.964 INFO:teuthology.task.internal:Creating archive directory... 2024-05-08T05:27:31.965 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-08T05:27:31.995 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-08T05:27:31.997 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-08T05:27:32.040 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-08T05:27:32.047 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-08T05:27:32.047 DEBUG:teuthology.orchestra.run.smithi134:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-08T05:27:32.074 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T05:27:32.075 DEBUG:teuthology.orchestra.run.smithi151:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-08T05:27:32.091 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T05:27:32.091 DEBUG:teuthology.orchestra.run.smithi082:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-08T05:27:32.096 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-08T05:27:32.117 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-08T05:27:32.165 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T05:27:32.171 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T05:27:32.182 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T05:27:32.210 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T05:27:32.290 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T05:27:32.348 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-08T05:27:32.352 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-08T05:27:32.362 INFO:teuthology.task.internal:Configuring sudo... 2024-05-08T05:27:32.363 DEBUG:teuthology.orchestra.run.smithi082:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-08T05:27:32.370 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-08T05:27:32.373 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-08T05:27:32.431 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-08T05:27:32.440 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-08T05:27:32.440 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-08T05:27:32.444 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-08T05:27:32.446 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-08T05:27:32.478 DEBUG:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T05:27:32.588 DEBUG:teuthology.orchestra.run.smithi082:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T05:27:32.683 DEBUG:teuthology.orchestra.run.smithi082:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T05:27:32.753 DEBUG:teuthology.orchestra.run.smithi082:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T05:27:32.830 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-08T05:27:32.831 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-08T05:27:32.903 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T05:27:32.947 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T05:27:33.001 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T05:27:33.084 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T05:27:33.126 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-05-08T05:27:33.126 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-08T05:27:33.192 DEBUG:teuthology.orchestra.run.smithi151:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T05:27:33.237 DEBUG:teuthology.orchestra.run.smithi151:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-08T05:27:33.296 DEBUG:teuthology.orchestra.run.smithi151:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T05:27:33.339 DEBUG:teuthology.orchestra.run.smithi151:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-08T05:27:33.382 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-05-08T05:27:33.382 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-08T05:27:33.449 DEBUG:teuthology.orchestra.run.smithi082:> sudo service rsyslog restart 2024-05-08T05:27:33.454 DEBUG:teuthology.orchestra.run.smithi134:> sudo service rsyslog restart 2024-05-08T05:27:33.456 DEBUG:teuthology.orchestra.run.smithi151:> sudo service rsyslog restart 2024-05-08T05:27:33.488 INFO:teuthology.orchestra.run.smithi134.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T05:27:33.526 INFO:teuthology.orchestra.run.smithi151.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T05:27:33.542 INFO:teuthology.orchestra.run.smithi082.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T05:27:33.782 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-08T05:27:33.795 INFO:teuthology.task.internal:Starting timer... 2024-05-08T05:27:33.795 INFO:teuthology.run_tasks:Running task pcp... 2024-05-08T05:27:33.814 INFO:teuthology.run_tasks:Running task selinux... 2024-05-08T05:27:33.822 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-05-08T05:27:33.823 DEBUG:teuthology.orchestra.run.smithi082:> sudo service auditd rotate 2024-05-08T05:27:33.959 INFO:teuthology.orchestra.run.smithi082.stdout:Rotating logs: 2024-05-08T05:27:33.963 DEBUG:teuthology.orchestra.run.smithi134:> sudo service auditd rotate 2024-05-08T05:27:34.023 INFO:teuthology.orchestra.run.smithi134.stdout:Rotating logs: 2024-05-08T05:27:34.025 DEBUG:teuthology.orchestra.run.smithi151:> sudo service auditd rotate 2024-05-08T05:27:34.100 INFO:teuthology.orchestra.run.smithi151.stdout:Rotating logs: 2024-05-08T05:27:34.102 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-08T05:27:34.103 DEBUG:teuthology.orchestra.run.smithi082:> /usr/sbin/getenforce 2024-05-08T05:27:34.161 INFO:teuthology.orchestra.run.smithi082.stdout:Permissive 2024-05-08T05:27:34.161 DEBUG:teuthology.orchestra.run.smithi134:> /usr/sbin/getenforce 2024-05-08T05:27:34.216 INFO:teuthology.orchestra.run.smithi134.stdout:Permissive 2024-05-08T05:27:34.217 DEBUG:teuthology.orchestra.run.smithi151:> /usr/sbin/getenforce 2024-05-08T05:27:34.239 INFO:teuthology.orchestra.run.smithi151.stdout:Permissive 2024-05-08T05:27:34.239 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi082.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi134.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi151.front.sepia.ceph.com': 'permissive'} 2024-05-08T05:27:34.239 DEBUG:teuthology.orchestra.run.smithi082:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-08T05:27:34.314 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T05:27:34.315 DEBUG:teuthology.orchestra.run.smithi134:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-08T05:27:34.343 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T05:27:34.344 DEBUG:teuthology.orchestra.run.smithi151:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-08T05:27:34.368 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T05:27:34.369 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-08T05:27:34.369 DEBUG:teuthology.orchestra.run.smithi082:> sudo /usr/sbin/setenforce permissive 2024-05-08T05:27:34.447 DEBUG:teuthology.orchestra.run.smithi134:> sudo /usr/sbin/setenforce permissive 2024-05-08T05:27:34.475 DEBUG:teuthology.orchestra.run.smithi151:> sudo /usr/sbin/setenforce permissive 2024-05-08T05:27:34.500 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-08T05:27:34.509 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-08T05:27:34.526 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-08T05:27:34.527 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi082.front.sepia.ceph.com,smithi134.front.sepia.ceph.com,smithi151.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-08T05:33:01.855 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi082.front.sepia.ceph.com'), Remote(name='ubuntu@smithi134.front.sepia.ceph.com'), Remote(name='ubuntu@smithi151.front.sepia.ceph.com')] 2024-05-08T05:33:01.856 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-05-08T05:33:01.858 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi082.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T05:33:01.962 DEBUG:teuthology.orchestra.run.smithi082:> true 2024-05-08T05:33:02.118 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi082.front.sepia.ceph.com' 2024-05-08T05:33:02.119 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-05-08T05:33:02.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T05:33:02.191 DEBUG:teuthology.orchestra.run.smithi134:> true 2024-05-08T05:33:02.271 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-05-08T05:33:02.271 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-05-08T05:33:02.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-08T05:33:02.344 DEBUG:teuthology.orchestra.run.smithi151:> true 2024-05-08T05:33:02.434 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-05-08T05:33:02.434 INFO:teuthology.run_tasks:Running task clock... 2024-05-08T05:33:02.448 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-08T05:33:02.448 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-08T05:33:02.448 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T05:33:02.458 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-08T05:33:02.458 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T05:33:02.461 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-08T05:33:02.461 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T05:33:02.488 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-08T05:33:02.502 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-08T05:33:02.504 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-08T05:33:02.518 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-08T05:33:02.526 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: ntpd: command not found 2024-05-08T05:33:02.537 INFO:teuthology.orchestra.run.smithi134.stdout:506 Cannot talk to daemon 2024-05-08T05:33:02.541 INFO:teuthology.orchestra.run.smithi151.stderr:sudo: ntpd: command not found 2024-05-08T05:33:02.542 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-08T05:33:02.550 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-08T05:33:02.551 INFO:teuthology.orchestra.run.smithi151.stdout:506 Cannot talk to daemon 2024-05-08T05:33:02.564 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-08T05:33:02.565 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-08T05:33:02.578 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-08T05:33:02.582 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-08T05:33:02.616 INFO:teuthology.orchestra.run.smithi134.stderr:bash: line 1: ntpq: command not found 2024-05-08T05:33:02.620 INFO:teuthology.orchestra.run.smithi134.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T05:33:02.620 INFO:teuthology.orchestra.run.smithi134.stdout:=============================================================================== 2024-05-08T05:33:02.621 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T05:33:02.621 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T05:33:02.621 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T05:33:02.621 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T05:33:02.635 INFO:teuthology.orchestra.run.smithi151.stderr:bash: line 1: ntpq: command not found 2024-05-08T05:33:02.638 INFO:teuthology.orchestra.run.smithi151.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T05:33:02.638 INFO:teuthology.orchestra.run.smithi151.stdout:=============================================================================== 2024-05-08T05:33:02.638 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T05:33:02.638 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T05:33:02.639 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T05:33:02.639 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T05:33:02.653 INFO:teuthology.orchestra.run.smithi082.stderr:sudo: ntpd: command not found 2024-05-08T05:33:02.685 INFO:teuthology.orchestra.run.smithi082.stdout:506 Cannot talk to daemon 2024-05-08T05:33:02.726 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-08T05:33:02.767 INFO:teuthology.orchestra.run.smithi082.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-08T05:33:02.902 INFO:teuthology.orchestra.run.smithi082.stderr:bash: line 1: ntpq: command not found 2024-05-08T05:33:02.910 INFO:teuthology.orchestra.run.smithi082.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T05:33:02.910 INFO:teuthology.orchestra.run.smithi082.stdout:=============================================================================== 2024-05-08T05:33:02.910 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T05:33:02.910 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T05:33:02.911 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T05:33:02.911 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T05:33:02.912 INFO:teuthology.run_tasks:Running task install... 2024-05-08T05:33:02.921 DEBUG:teuthology.task.install:project ceph 2024-05-08T05:33:02.921 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'bee299f4ac344e4c45e550d7a80abcadd7bc3d5a'}} 2024-05-08T05:33:02.921 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'bee299f4ac344e4c45e550d7a80abcadd7bc3d5a'} 2024-05-08T05:33:02.921 INFO:teuthology.task.install:Using flavor: default 2024-05-08T05:33:02.927 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-08T05:33:02.928 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-05-08T05:33:02.928 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bee299f4ac344e4c45e550d7a80abcadd7bc3d5a', 'tag': None, 'wait_for_package': False} 2024-05-08T05:33:02.928 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bee299f4ac344e4c45e550d7a80abcadd7bc3d5a 2024-05-08T05:33:02.932 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bee299f4ac344e4c45e550d7a80abcadd7bc3d5a', 'tag': None, 'wait_for_package': False} 2024-05-08T05:33:02.932 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bee299f4ac344e4c45e550d7a80abcadd7bc3d5a 2024-05-08T05:33:02.933 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bee299f4ac344e4c45e550d7a80abcadd7bc3d5a', 'tag': None, 'wait_for_package': False} 2024-05-08T05:33:02.933 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bee299f4ac344e4c45e550d7a80abcadd7bc3d5a 2024-05-08T05:33:03.090 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-57676-3/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/centos/9/flavors/default/ 2024-05-08T05:33:03.091 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3538.gbee299f4 2024-05-08T05:33:03.151 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-57676-3/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/centos/9/flavors/default/ 2024-05-08T05:33:03.152 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3538.gbee299f4 2024-05-08T05:33:03.155 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-57676-3/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/centos/9/flavors/default/ 2024-05-08T05:33:03.155 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3538.gbee299f4 2024-05-08T05:33:03.262 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-57676-3/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-57676-3/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-57676-3/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-08T05:33:03.262 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-08T05:33:03.263 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-08T05:33:03.265 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-57676-3/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-57676-3/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-57676-3/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-08T05:33:03.265 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-05-08T05:33:03.265 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-08T05:33:03.277 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-57676-3/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-57676-3/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-57676-3/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-08T05:33:03.277 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-05-08T05:33:03.277 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-08T05:33:03.290 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-08T05:33:03.290 DEBUG:teuthology.orchestra.run.smithi134:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-08T05:33:03.304 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-08T05:33:03.304 DEBUG:teuthology.orchestra.run.smithi151:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-08T05:33:03.352 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-08T05:33:03.352 DEBUG:teuthology.orchestra.run.smithi082:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-08T05:33:03.355 DEBUG:teuthology.orchestra.run.smithi134:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-08T05:33:03.370 DEBUG:teuthology.orchestra.run.smithi151:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-08T05:33:03.427 DEBUG:teuthology.orchestra.run.smithi134:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-08T05:33:03.446 DEBUG:teuthology.orchestra.run.smithi151:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-08T05:33:03.481 DEBUG:teuthology.orchestra.run.smithi082:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-08T05:33:03.491 INFO:teuthology.orchestra.run.smithi134.stdout:check_obsoletes = 1 2024-05-08T05:33:03.492 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum clean all 2024-05-08T05:33:03.510 INFO:teuthology.orchestra.run.smithi151.stdout:check_obsoletes = 1 2024-05-08T05:33:03.511 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum clean all 2024-05-08T05:33:03.591 DEBUG:teuthology.orchestra.run.smithi082:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-08T05:33:03.670 INFO:teuthology.orchestra.run.smithi082.stdout:check_obsoletes = 1 2024-05-08T05:33:03.674 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum clean all 2024-05-08T05:33:03.718 INFO:teuthology.orchestra.run.smithi134.stdout:54 files removed 2024-05-08T05:33:03.739 INFO:teuthology.orchestra.run.smithi151.stdout:54 files removed 2024-05-08T05:33:03.745 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-08T05:33:03.766 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-08T05:33:04.010 INFO:teuthology.orchestra.run.smithi082.stdout:54 files removed 2024-05-08T05:33:04.052 DEBUG:teuthology.orchestra.run.smithi082:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-08T05:33:04.710 INFO:teuthology.orchestra.run.smithi134.stdout:ceph packages for x86_64 119 kB/s | 84 kB 00:00 2024-05-08T05:33:05.112 INFO:teuthology.orchestra.run.smithi151.stdout:ceph packages for x86_64 77 kB/s | 84 kB 00:01 2024-05-08T05:33:05.166 INFO:teuthology.orchestra.run.smithi082.stdout:ceph packages for x86_64 123 kB/s | 84 kB 00:00 2024-05-08T05:33:05.318 INFO:teuthology.orchestra.run.smithi134.stdout:ceph noarch packages 21 kB/s | 12 kB 00:00 2024-05-08T05:33:05.796 INFO:teuthology.orchestra.run.smithi151.stdout:ceph noarch packages 18 kB/s | 12 kB 00:00 2024-05-08T05:33:05.967 INFO:teuthology.orchestra.run.smithi082.stdout:ceph noarch packages 17 kB/s | 12 kB 00:00 2024-05-08T05:33:06.286 INFO:teuthology.orchestra.run.smithi134.stdout:ceph source packages 2.0 kB/s | 1.9 kB 00:00 2024-05-08T05:33:06.472 INFO:teuthology.orchestra.run.smithi151.stdout:ceph source packages 3.0 kB/s | 1.9 kB 00:00 2024-05-08T05:33:06.976 INFO:teuthology.orchestra.run.smithi082.stdout:ceph source packages 2.1 kB/s | 1.9 kB 00:00 2024-05-08T05:33:07.238 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.1 MB 00:00 2024-05-08T05:33:08.108 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - BaseOS 7.7 MB/s | 8.1 MB 00:01 2024-05-08T05:33:09.481 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - AppStream 17 MB/s | 19 MB 00:01 2024-05-08T05:33:09.852 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - BaseOS 2.3 MB/s | 8.1 MB 00:03 2024-05-08T05:33:10.100 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - AppStream 25 MB/s | 19 MB 00:00 2024-05-08T05:33:11.795 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - AppStream 23 MB/s | 19 MB 00:00 2024-05-08T05:33:15.159 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - CRB 5.4 MB/s | 6.2 MB 00:01 2024-05-08T05:33:16.398 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - CRB 1.8 MB/s | 6.2 MB 00:03 2024-05-08T05:33:16.768 INFO:teuthology.orchestra.run.smithi082.stdout:CentOS Stream 9 - Extras packages 57 kB/s | 16 kB 00:00 2024-05-08T05:33:16.937 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 6.2 MB 00:01 2024-05-08T05:33:18.062 INFO:teuthology.orchestra.run.smithi082.stdout:Extra Packages for Enterprise Linux 19 MB/s | 21 MB 00:01 2024-05-08T05:33:18.141 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - Extras packages 29 kB/s | 16 kB 00:00 2024-05-08T05:33:18.629 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - Extras packages 31 kB/s | 16 kB 00:00 2024-05-08T05:33:20.454 INFO:teuthology.orchestra.run.smithi151.stdout:Extra Packages for Enterprise Linux 9.7 MB/s | 21 MB 00:02 2024-05-08T05:33:20.792 INFO:teuthology.orchestra.run.smithi134.stdout:Extra Packages for Enterprise Linux 10 MB/s | 21 MB 00:02 2024-05-08T05:33:24.178 INFO:teuthology.orchestra.run.smithi082.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-05-08T05:33:25.684 INFO:teuthology.orchestra.run.smithi151.stdout:lab-extras 19 kB/s | 1.7 kB 00:00 2024-05-08T05:33:25.981 INFO:teuthology.orchestra.run.smithi134.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-05-08T05:33:26.728 INFO:teuthology.orchestra.run.smithi082.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-08T05:33:26.730 INFO:teuthology.orchestra.run.smithi082.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-08T05:33:26.750 INFO:teuthology.orchestra.run.smithi082.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-08T05:33:26.751 INFO:teuthology.orchestra.run.smithi082.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-08T05:33:26.753 INFO:teuthology.orchestra.run.smithi082.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-08T05:33:26.754 INFO:teuthology.orchestra.run.smithi082.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-08T05:33:26.756 INFO:teuthology.orchestra.run.smithi082.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-08T05:33:26.760 INFO:teuthology.orchestra.run.smithi082.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-08T05:33:26.761 INFO:teuthology.orchestra.run.smithi082.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-08T05:33:26.831 INFO:teuthology.orchestra.run.smithi082.stdout:Dependencies resolved. 2024-05-08T05:33:26.847 INFO:teuthology.orchestra.run.smithi082.stdout:======================================================================================= 2024-05-08T05:33:26.847 INFO:teuthology.orchestra.run.smithi082.stdout: Package Arch Version Repository Size 2024-05-08T05:33:26.847 INFO:teuthology.orchestra.run.smithi082.stdout:======================================================================================= 2024-05-08T05:33:26.847 INFO:teuthology.orchestra.run.smithi082.stdout:Installing: 2024-05-08T05:33:26.847 INFO:teuthology.orchestra.run.smithi082.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-08T05:33:26.847 INFO:teuthology.orchestra.run.smithi082.stdout: ceph x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 6.6 k 2024-05-08T05:33:26.847 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-base x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 5.4 M 2024-05-08T05:33:26.847 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-fuse x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 890 k 2024-05-08T05:33:26.848 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 145 k 2024-05-08T05:33:26.848 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 1.5 M 2024-05-08T05:33:26.848 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 142 k 2024-05-08T05:33:26.848 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 3.5 M 2024-05-08T05:33:26.848 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 7.4 M 2024-05-08T05:33:26.848 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-rook noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 49 k 2024-05-08T05:33:26.848 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-radosgw x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 11 M 2024-05-08T05:33:26.848 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-test x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 49 M 2024-05-08T05:33:26.848 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-volume noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 273 k 2024-05-08T05:33:26.848 INFO:teuthology.orchestra.run.smithi082.stdout: cephadm noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 763 k 2024-05-08T05:33:26.848 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-mirror x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 225 k 2024-05-08T05:33:26.848 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-shell x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 27 k 2024-05-08T05:33:26.848 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-top noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 18 k 2024-05-08T05:33:26.849 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-08T05:33:26.849 INFO:teuthology.orchestra.run.smithi082.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-08T05:33:26.849 INFO:teuthology.orchestra.run.smithi082.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-08T05:33:26.849 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs-devel x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 32 k 2024-05-08T05:33:26.849 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs2 x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 747 k 2024-05-08T05:33:26.849 INFO:teuthology.orchestra.run.smithi082.stdout: librados-devel x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 127 k 2024-05-08T05:33:26.849 INFO:teuthology.orchestra.run.smithi082.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-08T05:33:26.849 INFO:teuthology.orchestra.run.smithi082.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-08T05:33:26.849 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-08T05:33:26.849 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-08T05:33:26.849 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-08T05:33:26.849 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-08T05:33:26.849 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cephfs x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 161 k 2024-05-08T05:33:26.849 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rados x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 321 k 2024-05-08T05:33:26.850 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rbd x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 299 k 2024-05-08T05:33:26.850 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rgw x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 100 k 2024-05-08T05:33:26.850 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-fuse x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 85 k 2024-05-08T05:33:26.850 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-mirror x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 3.1 M 2024-05-08T05:33:26.850 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-nbd x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 171 k 2024-05-08T05:33:26.850 INFO:teuthology.orchestra.run.smithi082.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-08T05:33:26.850 INFO:teuthology.orchestra.run.smithi082.stdout:Upgrading: 2024-05-08T05:33:26.850 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager x86_64 1:1.47.5-1.el9 baseos 2.3 M 2024-05-08T05:33:26.851 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-libnm x86_64 1:1.47.5-1.el9 baseos 1.8 M 2024-05-08T05:33:26.851 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-team x86_64 1:1.47.5-1.el9 baseos 42 k 2024-05-08T05:33:26.851 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-tui x86_64 1:1.47.5-1.el9 baseos 248 k 2024-05-08T05:33:26.851 INFO:teuthology.orchestra.run.smithi082.stdout: librados2 x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 3.4 M 2024-05-08T05:33:26.851 INFO:teuthology.orchestra.run.smithi082.stdout: librbd1 x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 3.1 M 2024-05-08T05:33:26.851 INFO:teuthology.orchestra.run.smithi082.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-08T05:33:26.851 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-08T05:33:26.851 INFO:teuthology.orchestra.run.smithi082.stdout:Installing dependencies: 2024-05-08T05:33:26.851 INFO:teuthology.orchestra.run.smithi082.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-08T05:33:26.851 INFO:teuthology.orchestra.run.smithi082.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-08T05:33:26.851 INFO:teuthology.orchestra.run.smithi082.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-08T05:33:26.851 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-common x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 21 M 2024-05-08T05:33:26.851 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 34 k 2024-05-08T05:33:26.851 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mds x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 2.4 M 2024-05-08T05:33:26.852 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 274 k 2024-05-08T05:33:26.852 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mon x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 4.7 M 2024-05-08T05:33:26.852 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-osd x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 17 M 2024-05-08T05:33:26.852 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 16 k 2024-05-08T05:33:26.852 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-selinux x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 25 k 2024-05-08T05:33:26.852 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-08T05:33:26.852 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-08T05:33:26.852 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-08T05:33:26.852 INFO:teuthology.orchestra.run.smithi082.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-08T05:33:26.852 INFO:teuthology.orchestra.run.smithi082.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-08T05:33:26.852 INFO:teuthology.orchestra.run.smithi082.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-08T05:33:26.852 INFO:teuthology.orchestra.run.smithi082.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-08T05:33:26.852 INFO:teuthology.orchestra.run.smithi082.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-08T05:33:26.853 INFO:teuthology.orchestra.run.smithi082.stdout: libcephsqlite x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 163 k 2024-05-08T05:33:26.853 INFO:teuthology.orchestra.run.smithi082.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-08T05:33:26.853 INFO:teuthology.orchestra.run.smithi082.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-08T05:33:26.853 INFO:teuthology.orchestra.run.smithi082.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-08T05:33:26.853 INFO:teuthology.orchestra.run.smithi082.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-08T05:33:26.853 INFO:teuthology.orchestra.run.smithi082.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-08T05:33:26.853 INFO:teuthology.orchestra.run.smithi082.stdout: libradosstriper1 x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 500 k 2024-05-08T05:33:26.853 INFO:teuthology.orchestra.run.smithi082.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-08T05:33:26.853 INFO:teuthology.orchestra.run.smithi082.stdout: librgw2 x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 5.4 M 2024-05-08T05:33:26.853 INFO:teuthology.orchestra.run.smithi082.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-08T05:33:26.853 INFO:teuthology.orchestra.run.smithi082.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-08T05:33:26.853 INFO:teuthology.orchestra.run.smithi082.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-08T05:33:26.853 INFO:teuthology.orchestra.run.smithi082.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-08T05:33:26.854 INFO:teuthology.orchestra.run.smithi082.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-08T05:33:26.854 INFO:teuthology.orchestra.run.smithi082.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-08T05:33:26.854 INFO:teuthology.orchestra.run.smithi082.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-08T05:33:26.854 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-08T05:33:26.854 INFO:teuthology.orchestra.run.smithi082.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-08T05:33:26.854 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-08T05:33:26.854 INFO:teuthology.orchestra.run.smithi082.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-08T05:33:26.854 INFO:teuthology.orchestra.run.smithi082.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-08T05:33:26.854 INFO:teuthology.orchestra.run.smithi082.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-08T05:33:26.854 INFO:teuthology.orchestra.run.smithi082.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-08T05:33:26.854 INFO:teuthology.orchestra.run.smithi082.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-08T05:33:26.854 INFO:teuthology.orchestra.run.smithi082.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-08T05:33:26.854 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-08T05:33:26.855 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-argparse x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 45 k 2024-05-08T05:33:26.855 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-common x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 135 k 2024-05-08T05:33:26.855 INFO:teuthology.orchestra.run.smithi082.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-08T05:33:26.855 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-08T05:33:26.855 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-08T05:33:26.855 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-08T05:33:26.855 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-08T05:33:26.855 INFO:teuthology.orchestra.run.smithi082.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-08T05:33:26.855 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-08T05:33:26.855 INFO:teuthology.orchestra.run.smithi082.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-08T05:33:26.855 INFO:teuthology.orchestra.run.smithi082.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-08T05:33:26.855 INFO:teuthology.orchestra.run.smithi082.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-08T05:33:26.855 INFO:teuthology.orchestra.run.smithi082.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-08T05:33:26.856 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-08T05:33:26.856 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-08T05:33:26.856 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-08T05:33:26.856 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-08T05:33:26.856 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-08T05:33:26.856 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-08T05:33:26.856 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-08T05:33:26.856 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-08T05:33:26.856 INFO:teuthology.orchestra.run.smithi082.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-08T05:33:26.856 INFO:teuthology.orchestra.run.smithi082.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-08T05:33:26.856 INFO:teuthology.orchestra.run.smithi082.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-08T05:33:26.856 INFO:teuthology.orchestra.run.smithi082.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-08T05:33:26.856 INFO:teuthology.orchestra.run.smithi082.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-08T05:33:26.856 INFO:teuthology.orchestra.run.smithi082.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-08T05:33:26.857 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-08T05:33:26.857 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-08T05:33:26.857 INFO:teuthology.orchestra.run.smithi082.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-08T05:33:26.857 INFO:teuthology.orchestra.run.smithi082.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-08T05:33:26.857 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-08T05:33:26.857 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-08T05:33:26.857 INFO:teuthology.orchestra.run.smithi082.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-08T05:33:26.857 INFO:teuthology.orchestra.run.smithi082.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-08T05:33:26.857 INFO:teuthology.orchestra.run.smithi082.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-08T05:33:26.857 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-08T05:33:26.857 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-08T05:33:26.857 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-08T05:33:26.857 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-08T05:33:26.857 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-08T05:33:26.858 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-08T05:33:26.858 INFO:teuthology.orchestra.run.smithi082.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-08T05:33:26.858 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-08T05:33:26.858 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-08T05:33:26.858 INFO:teuthology.orchestra.run.smithi082.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-08T05:33:26.858 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-08T05:33:26.858 INFO:teuthology.orchestra.run.smithi082.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-08T05:33:26.858 INFO:teuthology.orchestra.run.smithi082.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-08T05:33:26.858 INFO:teuthology.orchestra.run.smithi082.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-08T05:33:26.858 INFO:teuthology.orchestra.run.smithi082.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-08T05:33:26.858 INFO:teuthology.orchestra.run.smithi082.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-08T05:33:26.858 INFO:teuthology.orchestra.run.smithi082.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-08T05:33:26.858 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-08T05:33:26.858 INFO:teuthology.orchestra.run.smithi082.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-08T05:33:26.859 INFO:teuthology.orchestra.run.smithi082.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-08T05:33:26.859 INFO:teuthology.orchestra.run.smithi082.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-08T05:33:26.859 INFO:teuthology.orchestra.run.smithi082.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-08T05:33:26.859 INFO:teuthology.orchestra.run.smithi082.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-08T05:33:26.859 INFO:teuthology.orchestra.run.smithi082.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-08T05:33:26.859 INFO:teuthology.orchestra.run.smithi082.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-08T05:33:26.859 INFO:teuthology.orchestra.run.smithi082.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-08T05:33:26.859 INFO:teuthology.orchestra.run.smithi082.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-08T05:33:26.859 INFO:teuthology.orchestra.run.smithi082.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-08T05:33:26.859 INFO:teuthology.orchestra.run.smithi082.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-08T05:33:26.859 INFO:teuthology.orchestra.run.smithi082.stdout:Installing weak dependencies: 2024-05-08T05:33:26.859 INFO:teuthology.orchestra.run.smithi082.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-08T05:33:26.859 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:33:26.859 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction Summary 2024-05-08T05:33:26.860 INFO:teuthology.orchestra.run.smithi082.stdout:======================================================================================= 2024-05-08T05:33:26.860 INFO:teuthology.orchestra.run.smithi082.stdout:Install 148 Packages 2024-05-08T05:33:26.860 INFO:teuthology.orchestra.run.smithi082.stdout:Upgrade 8 Packages 2024-05-08T05:33:26.860 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:33:26.860 INFO:teuthology.orchestra.run.smithi082.stdout:Total download size: 226 M 2024-05-08T05:33:26.860 INFO:teuthology.orchestra.run.smithi082.stdout:Downloading Packages: 2024-05-08T05:33:27.913 INFO:teuthology.orchestra.run.smithi082.stdout:(1/156): ceph-19.0.0-3538.gbee299f4.el9.x86_64. 14 kB/s | 6.6 kB 00:00 2024-05-08T05:33:27.994 INFO:teuthology.orchestra.run.smithi151.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-08T05:33:27.995 INFO:teuthology.orchestra.run.smithi151.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-08T05:33:28.006 INFO:teuthology.orchestra.run.smithi151.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-08T05:33:28.006 INFO:teuthology.orchestra.run.smithi151.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-08T05:33:28.007 INFO:teuthology.orchestra.run.smithi151.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-08T05:33:28.008 INFO:teuthology.orchestra.run.smithi151.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-08T05:33:28.010 INFO:teuthology.orchestra.run.smithi151.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-08T05:33:28.012 INFO:teuthology.orchestra.run.smithi151.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-08T05:33:28.013 INFO:teuthology.orchestra.run.smithi151.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-08T05:33:28.074 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-05-08T05:33:28.097 INFO:teuthology.orchestra.run.smithi151.stdout:======================================================================================= 2024-05-08T05:33:28.097 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repository Size 2024-05-08T05:33:28.097 INFO:teuthology.orchestra.run.smithi151.stdout:======================================================================================= 2024-05-08T05:33:28.097 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2024-05-08T05:33:28.097 INFO:teuthology.orchestra.run.smithi151.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-08T05:33:28.097 INFO:teuthology.orchestra.run.smithi151.stdout: ceph x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 6.6 k 2024-05-08T05:33:28.097 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-base x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 5.4 M 2024-05-08T05:33:28.097 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-fuse x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 890 k 2024-05-08T05:33:28.097 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 145 k 2024-05-08T05:33:28.097 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 1.5 M 2024-05-08T05:33:28.097 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 142 k 2024-05-08T05:33:28.097 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 3.5 M 2024-05-08T05:33:28.098 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 7.4 M 2024-05-08T05:33:28.098 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-rook noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 49 k 2024-05-08T05:33:28.098 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-radosgw x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 11 M 2024-05-08T05:33:28.098 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-test x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 49 M 2024-05-08T05:33:28.098 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-volume noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 273 k 2024-05-08T05:33:28.098 INFO:teuthology.orchestra.run.smithi151.stdout: cephadm noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 763 k 2024-05-08T05:33:28.098 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-mirror x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 225 k 2024-05-08T05:33:28.098 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-shell x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 27 k 2024-05-08T05:33:28.098 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-top noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 18 k 2024-05-08T05:33:28.098 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-08T05:33:28.098 INFO:teuthology.orchestra.run.smithi151.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-08T05:33:28.098 INFO:teuthology.orchestra.run.smithi151.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-08T05:33:28.098 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs-devel x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 32 k 2024-05-08T05:33:28.098 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs2 x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 747 k 2024-05-08T05:33:28.099 INFO:teuthology.orchestra.run.smithi151.stdout: librados-devel x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 127 k 2024-05-08T05:33:28.099 INFO:teuthology.orchestra.run.smithi151.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-08T05:33:28.099 INFO:teuthology.orchestra.run.smithi151.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-08T05:33:28.099 INFO:teuthology.orchestra.run.smithi151.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-08T05:33:28.099 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-08T05:33:28.099 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-08T05:33:28.099 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-08T05:33:28.099 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cephfs x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 161 k 2024-05-08T05:33:28.099 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rados x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 321 k 2024-05-08T05:33:28.099 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rbd x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 299 k 2024-05-08T05:33:28.099 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rgw x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 100 k 2024-05-08T05:33:28.099 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-fuse x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 85 k 2024-05-08T05:33:28.099 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-mirror x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 3.1 M 2024-05-08T05:33:28.099 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-nbd x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 171 k 2024-05-08T05:33:28.100 INFO:teuthology.orchestra.run.smithi151.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-08T05:33:28.100 INFO:teuthology.orchestra.run.smithi151.stdout:Upgrading: 2024-05-08T05:33:28.100 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager x86_64 1:1.47.5-1.el9 baseos 2.3 M 2024-05-08T05:33:28.100 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-libnm x86_64 1:1.47.5-1.el9 baseos 1.8 M 2024-05-08T05:33:28.100 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-team x86_64 1:1.47.5-1.el9 baseos 42 k 2024-05-08T05:33:28.100 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-tui x86_64 1:1.47.5-1.el9 baseos 248 k 2024-05-08T05:33:28.100 INFO:teuthology.orchestra.run.smithi151.stdout: librados2 x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 3.4 M 2024-05-08T05:33:28.100 INFO:teuthology.orchestra.run.smithi151.stdout: librbd1 x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 3.1 M 2024-05-08T05:33:28.100 INFO:teuthology.orchestra.run.smithi151.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-08T05:33:28.100 INFO:teuthology.orchestra.run.smithi151.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-08T05:33:28.100 INFO:teuthology.orchestra.run.smithi151.stdout:Installing dependencies: 2024-05-08T05:33:28.100 INFO:teuthology.orchestra.run.smithi151.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-08T05:33:28.100 INFO:teuthology.orchestra.run.smithi151.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-08T05:33:28.101 INFO:teuthology.orchestra.run.smithi151.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-08T05:33:28.101 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-common x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 21 M 2024-05-08T05:33:28.101 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 34 k 2024-05-08T05:33:28.101 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mds x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 2.4 M 2024-05-08T05:33:28.101 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 274 k 2024-05-08T05:33:28.101 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mon x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 4.7 M 2024-05-08T05:33:28.101 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-osd x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 17 M 2024-05-08T05:33:28.101 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 16 k 2024-05-08T05:33:28.101 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-selinux x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 25 k 2024-05-08T05:33:28.101 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-08T05:33:28.101 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-08T05:33:28.101 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-08T05:33:28.101 INFO:teuthology.orchestra.run.smithi151.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-08T05:33:28.101 INFO:teuthology.orchestra.run.smithi151.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-08T05:33:28.102 INFO:teuthology.orchestra.run.smithi151.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-08T05:33:28.102 INFO:teuthology.orchestra.run.smithi151.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-08T05:33:28.102 INFO:teuthology.orchestra.run.smithi151.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-08T05:33:28.102 INFO:teuthology.orchestra.run.smithi151.stdout: libcephsqlite x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 163 k 2024-05-08T05:33:28.102 INFO:teuthology.orchestra.run.smithi151.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-08T05:33:28.102 INFO:teuthology.orchestra.run.smithi151.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-08T05:33:28.102 INFO:teuthology.orchestra.run.smithi151.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-08T05:33:28.102 INFO:teuthology.orchestra.run.smithi151.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-08T05:33:28.102 INFO:teuthology.orchestra.run.smithi151.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-08T05:33:28.102 INFO:teuthology.orchestra.run.smithi151.stdout: libradosstriper1 x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 500 k 2024-05-08T05:33:28.102 INFO:teuthology.orchestra.run.smithi151.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-08T05:33:28.102 INFO:teuthology.orchestra.run.smithi151.stdout: librgw2 x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 5.4 M 2024-05-08T05:33:28.102 INFO:teuthology.orchestra.run.smithi151.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-08T05:33:28.102 INFO:teuthology.orchestra.run.smithi151.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-08T05:33:28.103 INFO:teuthology.orchestra.run.smithi151.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-08T05:33:28.103 INFO:teuthology.orchestra.run.smithi151.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-08T05:33:28.103 INFO:teuthology.orchestra.run.smithi151.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-08T05:33:28.103 INFO:teuthology.orchestra.run.smithi151.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-08T05:33:28.103 INFO:teuthology.orchestra.run.smithi151.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-08T05:33:28.103 INFO:teuthology.orchestra.run.smithi151.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-08T05:33:28.103 INFO:teuthology.orchestra.run.smithi151.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-08T05:33:28.103 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-08T05:33:28.103 INFO:teuthology.orchestra.run.smithi151.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-08T05:33:28.103 INFO:teuthology.orchestra.run.smithi151.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-08T05:33:28.103 INFO:teuthology.orchestra.run.smithi151.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-08T05:33:28.103 INFO:teuthology.orchestra.run.smithi151.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-08T05:33:28.103 INFO:teuthology.orchestra.run.smithi151.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-08T05:33:28.104 INFO:teuthology.orchestra.run.smithi151.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-08T05:33:28.104 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-08T05:33:28.104 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-argparse x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 45 k 2024-05-08T05:33:28.104 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-common x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 135 k 2024-05-08T05:33:28.104 INFO:teuthology.orchestra.run.smithi151.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-08T05:33:28.104 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-08T05:33:28.104 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-08T05:33:28.104 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-08T05:33:28.104 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-08T05:33:28.104 INFO:teuthology.orchestra.run.smithi151.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-08T05:33:28.104 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-08T05:33:28.104 INFO:teuthology.orchestra.run.smithi151.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-08T05:33:28.104 INFO:teuthology.orchestra.run.smithi151.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-08T05:33:28.104 INFO:teuthology.orchestra.run.smithi151.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-08T05:33:28.104 INFO:teuthology.orchestra.run.smithi151.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-08T05:33:28.105 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-08T05:33:28.105 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-08T05:33:28.105 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-08T05:33:28.105 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-08T05:33:28.105 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-08T05:33:28.105 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-08T05:33:28.105 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-08T05:33:28.105 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-08T05:33:28.105 INFO:teuthology.orchestra.run.smithi151.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-08T05:33:28.105 INFO:teuthology.orchestra.run.smithi151.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-08T05:33:28.105 INFO:teuthology.orchestra.run.smithi151.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-08T05:33:28.105 INFO:teuthology.orchestra.run.smithi151.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-08T05:33:28.105 INFO:teuthology.orchestra.run.smithi151.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-08T05:33:28.105 INFO:teuthology.orchestra.run.smithi151.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-08T05:33:28.105 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-08T05:33:28.106 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-08T05:33:28.106 INFO:teuthology.orchestra.run.smithi151.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-08T05:33:28.106 INFO:teuthology.orchestra.run.smithi151.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-08T05:33:28.106 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-08T05:33:28.106 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-08T05:33:28.106 INFO:teuthology.orchestra.run.smithi151.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-08T05:33:28.106 INFO:teuthology.orchestra.run.smithi151.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-08T05:33:28.106 INFO:teuthology.orchestra.run.smithi151.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-08T05:33:28.106 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-08T05:33:28.106 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-08T05:33:28.106 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-08T05:33:28.106 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-08T05:33:28.106 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-08T05:33:28.106 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-08T05:33:28.106 INFO:teuthology.orchestra.run.smithi151.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-08T05:33:28.107 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-08T05:33:28.107 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-08T05:33:28.107 INFO:teuthology.orchestra.run.smithi151.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-08T05:33:28.107 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-08T05:33:28.107 INFO:teuthology.orchestra.run.smithi151.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-08T05:33:28.107 INFO:teuthology.orchestra.run.smithi151.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-08T05:33:28.107 INFO:teuthology.orchestra.run.smithi151.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-08T05:33:28.107 INFO:teuthology.orchestra.run.smithi151.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-08T05:33:28.107 INFO:teuthology.orchestra.run.smithi151.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-08T05:33:28.107 INFO:teuthology.orchestra.run.smithi151.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-08T05:33:28.107 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-08T05:33:28.107 INFO:teuthology.orchestra.run.smithi151.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-08T05:33:28.107 INFO:teuthology.orchestra.run.smithi151.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-08T05:33:28.107 INFO:teuthology.orchestra.run.smithi151.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-08T05:33:28.107 INFO:teuthology.orchestra.run.smithi151.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-08T05:33:28.108 INFO:teuthology.orchestra.run.smithi151.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-08T05:33:28.108 INFO:teuthology.orchestra.run.smithi151.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-08T05:33:28.108 INFO:teuthology.orchestra.run.smithi151.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-08T05:33:28.108 INFO:teuthology.orchestra.run.smithi151.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-08T05:33:28.108 INFO:teuthology.orchestra.run.smithi151.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-08T05:33:28.108 INFO:teuthology.orchestra.run.smithi151.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-08T05:33:28.108 INFO:teuthology.orchestra.run.smithi151.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-08T05:33:28.108 INFO:teuthology.orchestra.run.smithi151.stdout:Installing weak dependencies: 2024-05-08T05:33:28.108 INFO:teuthology.orchestra.run.smithi151.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-08T05:33:28.108 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-08T05:33:28.108 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2024-05-08T05:33:28.108 INFO:teuthology.orchestra.run.smithi151.stdout:======================================================================================= 2024-05-08T05:33:28.108 INFO:teuthology.orchestra.run.smithi151.stdout:Install 148 Packages 2024-05-08T05:33:28.108 INFO:teuthology.orchestra.run.smithi151.stdout:Upgrade 8 Packages 2024-05-08T05:33:28.109 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-08T05:33:28.109 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 226 M 2024-05-08T05:33:28.109 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2024-05-08T05:33:28.291 INFO:teuthology.orchestra.run.smithi134.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-08T05:33:28.291 INFO:teuthology.orchestra.run.smithi134.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-08T05:33:28.302 INFO:teuthology.orchestra.run.smithi134.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-08T05:33:28.303 INFO:teuthology.orchestra.run.smithi134.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-08T05:33:28.304 INFO:teuthology.orchestra.run.smithi134.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-08T05:33:28.305 INFO:teuthology.orchestra.run.smithi134.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-08T05:33:28.306 INFO:teuthology.orchestra.run.smithi134.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-08T05:33:28.309 INFO:teuthology.orchestra.run.smithi134.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-08T05:33:28.309 INFO:teuthology.orchestra.run.smithi134.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-08T05:33:28.370 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-05-08T05:33:28.390 INFO:teuthology.orchestra.run.smithi134.stdout:======================================================================================= 2024-05-08T05:33:28.390 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-05-08T05:33:28.390 INFO:teuthology.orchestra.run.smithi134.stdout:======================================================================================= 2024-05-08T05:33:28.390 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-05-08T05:33:28.391 INFO:teuthology.orchestra.run.smithi134.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-08T05:33:28.391 INFO:teuthology.orchestra.run.smithi134.stdout: ceph x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 6.6 k 2024-05-08T05:33:28.391 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 5.4 M 2024-05-08T05:33:28.391 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-fuse x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 890 k 2024-05-08T05:33:28.391 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 145 k 2024-05-08T05:33:28.391 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 1.5 M 2024-05-08T05:33:28.391 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 142 k 2024-05-08T05:33:28.391 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 3.5 M 2024-05-08T05:33:28.391 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 7.4 M 2024-05-08T05:33:28.391 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-rook noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 49 k 2024-05-08T05:33:28.391 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-radosgw x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 11 M 2024-05-08T05:33:28.391 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-test x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 49 M 2024-05-08T05:33:28.391 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-volume noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 273 k 2024-05-08T05:33:28.391 INFO:teuthology.orchestra.run.smithi134.stdout: cephadm noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 763 k 2024-05-08T05:33:28.392 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-mirror x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 225 k 2024-05-08T05:33:28.392 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-shell x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 27 k 2024-05-08T05:33:28.392 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-top noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 18 k 2024-05-08T05:33:28.392 INFO:teuthology.orchestra.run.smithi134.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-08T05:33:28.392 INFO:teuthology.orchestra.run.smithi134.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-08T05:33:28.392 INFO:teuthology.orchestra.run.smithi134.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-08T05:33:28.392 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-devel x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 32 k 2024-05-08T05:33:28.392 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs2 x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 747 k 2024-05-08T05:33:28.392 INFO:teuthology.orchestra.run.smithi134.stdout: librados-devel x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 127 k 2024-05-08T05:33:28.392 INFO:teuthology.orchestra.run.smithi134.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-08T05:33:28.392 INFO:teuthology.orchestra.run.smithi134.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-08T05:33:28.392 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-08T05:33:28.392 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-08T05:33:28.392 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-08T05:33:28.393 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-08T05:33:28.393 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cephfs x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 161 k 2024-05-08T05:33:28.393 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 321 k 2024-05-08T05:33:28.393 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rbd x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 299 k 2024-05-08T05:33:28.393 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rgw x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 100 k 2024-05-08T05:33:28.393 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-fuse x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 85 k 2024-05-08T05:33:28.393 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-mirror x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 3.1 M 2024-05-08T05:33:28.393 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-nbd x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 171 k 2024-05-08T05:33:28.393 INFO:teuthology.orchestra.run.smithi134.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-08T05:33:28.393 INFO:teuthology.orchestra.run.smithi134.stdout:Upgrading: 2024-05-08T05:33:28.393 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager x86_64 1:1.47.5-1.el9 baseos 2.3 M 2024-05-08T05:33:28.393 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-libnm x86_64 1:1.47.5-1.el9 baseos 1.8 M 2024-05-08T05:33:28.393 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-team x86_64 1:1.47.5-1.el9 baseos 42 k 2024-05-08T05:33:28.394 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-tui x86_64 1:1.47.5-1.el9 baseos 248 k 2024-05-08T05:33:28.394 INFO:teuthology.orchestra.run.smithi134.stdout: librados2 x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 3.4 M 2024-05-08T05:33:28.394 INFO:teuthology.orchestra.run.smithi134.stdout: librbd1 x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 3.1 M 2024-05-08T05:33:28.394 INFO:teuthology.orchestra.run.smithi134.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-08T05:33:28.394 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-08T05:33:28.394 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-05-08T05:33:28.394 INFO:teuthology.orchestra.run.smithi134.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-08T05:33:28.394 INFO:teuthology.orchestra.run.smithi134.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-08T05:33:28.394 INFO:teuthology.orchestra.run.smithi134.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-08T05:33:28.394 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-common x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 21 M 2024-05-08T05:33:28.394 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 34 k 2024-05-08T05:33:28.394 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mds x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 2.4 M 2024-05-08T05:33:28.394 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 274 k 2024-05-08T05:33:28.395 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mon x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 4.7 M 2024-05-08T05:33:28.395 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-osd x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 17 M 2024-05-08T05:33:28.395 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3538.gbee299f4.el9 ceph-noarch 16 k 2024-05-08T05:33:28.395 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-selinux x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 25 k 2024-05-08T05:33:28.395 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-08T05:33:28.395 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-08T05:33:28.395 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-08T05:33:28.395 INFO:teuthology.orchestra.run.smithi134.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-08T05:33:28.395 INFO:teuthology.orchestra.run.smithi134.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-08T05:33:28.395 INFO:teuthology.orchestra.run.smithi134.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-08T05:33:28.395 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-08T05:33:28.395 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-08T05:33:28.395 INFO:teuthology.orchestra.run.smithi134.stdout: libcephsqlite x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 163 k 2024-05-08T05:33:28.396 INFO:teuthology.orchestra.run.smithi134.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-08T05:33:28.396 INFO:teuthology.orchestra.run.smithi134.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-08T05:33:28.396 INFO:teuthology.orchestra.run.smithi134.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-08T05:33:28.396 INFO:teuthology.orchestra.run.smithi134.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-08T05:33:28.396 INFO:teuthology.orchestra.run.smithi134.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-08T05:33:28.396 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1 x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 500 k 2024-05-08T05:33:28.396 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-08T05:33:28.396 INFO:teuthology.orchestra.run.smithi134.stdout: librgw2 x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 5.4 M 2024-05-08T05:33:28.396 INFO:teuthology.orchestra.run.smithi134.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-08T05:33:28.396 INFO:teuthology.orchestra.run.smithi134.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-08T05:33:28.396 INFO:teuthology.orchestra.run.smithi134.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-08T05:33:28.396 INFO:teuthology.orchestra.run.smithi134.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-08T05:33:28.396 INFO:teuthology.orchestra.run.smithi134.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-08T05:33:28.397 INFO:teuthology.orchestra.run.smithi134.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-08T05:33:28.397 INFO:teuthology.orchestra.run.smithi134.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-08T05:33:28.397 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-08T05:33:28.397 INFO:teuthology.orchestra.run.smithi134.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-08T05:33:28.397 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-08T05:33:28.397 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-08T05:33:28.397 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-08T05:33:28.397 INFO:teuthology.orchestra.run.smithi134.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-08T05:33:28.397 INFO:teuthology.orchestra.run.smithi134.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-08T05:33:28.397 INFO:teuthology.orchestra.run.smithi134.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-08T05:33:28.397 INFO:teuthology.orchestra.run.smithi134.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-08T05:33:28.397 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-08T05:33:28.397 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 45 k 2024-05-08T05:33:28.397 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-common x86_64 2:19.0.0-3538.gbee299f4.el9 ceph 135 k 2024-05-08T05:33:28.398 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-08T05:33:28.398 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-08T05:33:28.398 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-08T05:33:28.398 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-08T05:33:28.398 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-08T05:33:28.398 INFO:teuthology.orchestra.run.smithi134.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-08T05:33:28.398 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-08T05:33:28.398 INFO:teuthology.orchestra.run.smithi134.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-08T05:33:28.398 INFO:teuthology.orchestra.run.smithi134.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-08T05:33:28.398 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-08T05:33:28.398 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-08T05:33:28.398 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-08T05:33:28.399 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-08T05:33:28.399 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-08T05:33:28.399 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-08T05:33:28.399 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-08T05:33:28.399 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-08T05:33:28.399 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-08T05:33:28.399 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-08T05:33:28.399 INFO:teuthology.orchestra.run.smithi134.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-08T05:33:28.399 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-08T05:33:28.399 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-08T05:33:28.399 INFO:teuthology.orchestra.run.smithi134.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-08T05:33:28.399 INFO:teuthology.orchestra.run.smithi134.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-08T05:33:28.399 INFO:teuthology.orchestra.run.smithi134.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-08T05:33:28.399 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-08T05:33:28.400 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-08T05:33:28.400 INFO:teuthology.orchestra.run.smithi134.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-08T05:33:28.400 INFO:teuthology.orchestra.run.smithi134.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-08T05:33:28.400 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-08T05:33:28.400 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-08T05:33:28.400 INFO:teuthology.orchestra.run.smithi134.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-08T05:33:28.400 INFO:teuthology.orchestra.run.smithi134.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-08T05:33:28.400 INFO:teuthology.orchestra.run.smithi134.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-08T05:33:28.400 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-08T05:33:28.400 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-08T05:33:28.400 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-08T05:33:28.400 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-08T05:33:28.400 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-08T05:33:28.401 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-08T05:33:28.401 INFO:teuthology.orchestra.run.smithi134.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-08T05:33:28.401 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-08T05:33:28.401 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-08T05:33:28.401 INFO:teuthology.orchestra.run.smithi134.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-08T05:33:28.401 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-08T05:33:28.401 INFO:teuthology.orchestra.run.smithi134.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-08T05:33:28.401 INFO:teuthology.orchestra.run.smithi134.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-08T05:33:28.401 INFO:teuthology.orchestra.run.smithi134.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-08T05:33:28.401 INFO:teuthology.orchestra.run.smithi134.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-08T05:33:28.401 INFO:teuthology.orchestra.run.smithi134.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-08T05:33:28.401 INFO:teuthology.orchestra.run.smithi134.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-08T05:33:28.401 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-08T05:33:28.402 INFO:teuthology.orchestra.run.smithi134.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-08T05:33:28.402 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-08T05:33:28.402 INFO:teuthology.orchestra.run.smithi134.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-08T05:33:28.402 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-08T05:33:28.402 INFO:teuthology.orchestra.run.smithi134.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-08T05:33:28.402 INFO:teuthology.orchestra.run.smithi134.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-08T05:33:28.402 INFO:teuthology.orchestra.run.smithi134.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-08T05:33:28.402 INFO:teuthology.orchestra.run.smithi134.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-08T05:33:28.402 INFO:teuthology.orchestra.run.smithi134.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-08T05:33:28.402 INFO:teuthology.orchestra.run.smithi134.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-08T05:33:28.402 INFO:teuthology.orchestra.run.smithi134.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-08T05:33:28.402 INFO:teuthology.orchestra.run.smithi134.stdout:Installing weak dependencies: 2024-05-08T05:33:28.402 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-08T05:33:28.402 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-08T05:33:28.403 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-05-08T05:33:28.403 INFO:teuthology.orchestra.run.smithi134.stdout:======================================================================================= 2024-05-08T05:33:28.403 INFO:teuthology.orchestra.run.smithi134.stdout:Install 148 Packages 2024-05-08T05:33:28.403 INFO:teuthology.orchestra.run.smithi134.stdout:Upgrade 8 Packages 2024-05-08T05:33:28.403 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-08T05:33:28.403 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 226 M 2024-05-08T05:33:28.403 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-05-08T05:33:28.805 INFO:teuthology.orchestra.run.smithi082.stdout:(2/156): ceph-fuse-19.0.0-3538.gbee299f4.el9.x8 1.0 MB/s | 890 kB 00:00 2024-05-08T05:33:28.913 INFO:teuthology.orchestra.run.smithi082.stdout:(3/156): ceph-immutable-object-cache-19.0.0-353 1.3 MB/s | 145 kB 00:00 2024-05-08T05:33:29.066 INFO:teuthology.orchestra.run.smithi134.stdout:(1/156): ceph-19.0.0-3538.gbee299f4.el9.x86_64. 22 kB/s | 6.6 kB 00:00 2024-05-08T05:33:29.177 INFO:teuthology.orchestra.run.smithi151.stdout:(1/156): ceph-19.0.0-3538.gbee299f4.el9.x86_64. 16 kB/s | 6.6 kB 00:00 2024-05-08T05:33:29.672 INFO:teuthology.orchestra.run.smithi082.stdout:(4/156): ceph-base-19.0.0-3538.gbee299f4.el9.x8 2.4 MB/s | 5.4 MB 00:02 2024-05-08T05:33:29.957 INFO:teuthology.orchestra.run.smithi134.stdout:(2/156): ceph-fuse-19.0.0-3538.gbee299f4.el9.x8 999 kB/s | 890 kB 00:00 2024-05-08T05:33:30.116 INFO:teuthology.orchestra.run.smithi134.stdout:(3/156): ceph-immutable-object-cache-19.0.0-353 914 kB/s | 145 kB 00:00 2024-05-08T05:33:30.186 INFO:teuthology.orchestra.run.smithi151.stdout:(2/156): ceph-fuse-19.0.0-3538.gbee299f4.el9.x8 883 kB/s | 890 kB 00:01 2024-05-08T05:33:30.213 INFO:teuthology.orchestra.run.smithi082.stdout:(5/156): ceph-mgr-19.0.0-3538.gbee299f4.el9.x86 2.8 MB/s | 1.5 MB 00:00 2024-05-08T05:33:30.378 INFO:teuthology.orchestra.run.smithi151.stdout:(3/156): ceph-immutable-object-cache-19.0.0-353 756 kB/s | 145 kB 00:00 2024-05-08T05:33:30.514 INFO:teuthology.orchestra.run.smithi082.stdout:(6/156): ceph-mds-19.0.0-3538.gbee299f4.el9.x86 1.5 MB/s | 2.4 MB 00:01 2024-05-08T05:33:31.183 INFO:teuthology.orchestra.run.smithi134.stdout:(4/156): ceph-mds-19.0.0-3538.gbee299f4.el9.x86 2.2 MB/s | 2.4 MB 00:01 2024-05-08T05:33:31.609 INFO:teuthology.orchestra.run.smithi134.stdout:(5/156): ceph-mgr-19.0.0-3538.gbee299f4.el9.x86 3.6 MB/s | 1.5 MB 00:00 2024-05-08T05:33:31.644 INFO:teuthology.orchestra.run.smithi151.stdout:(4/156): ceph-mds-19.0.0-3538.gbee299f4.el9.x86 1.9 MB/s | 2.4 MB 00:01 2024-05-08T05:33:31.664 INFO:teuthology.orchestra.run.smithi082.stdout:(7/156): ceph-mon-19.0.0-3538.gbee299f4.el9.x86 3.2 MB/s | 4.7 MB 00:01 2024-05-08T05:33:32.211 INFO:teuthology.orchestra.run.smithi151.stdout:(5/156): ceph-mgr-19.0.0-3538.gbee299f4.el9.x86 2.7 MB/s | 1.5 MB 00:00 2024-05-08T05:33:32.292 INFO:teuthology.orchestra.run.smithi134.stdout:(6/156): ceph-base-19.0.0-3538.gbee299f4.el9.x8 1.5 MB/s | 5.4 MB 00:03 2024-05-08T05:33:32.567 INFO:teuthology.orchestra.run.smithi134.stdout:(7/156): ceph-mon-19.0.0-3538.gbee299f4.el9.x86 4.9 MB/s | 4.7 MB 00:00 2024-05-08T05:33:32.870 INFO:teuthology.orchestra.run.smithi151.stdout:(6/156): ceph-base-19.0.0-3538.gbee299f4.el9.x8 1.3 MB/s | 5.4 MB 00:04 2024-05-08T05:33:33.795 INFO:teuthology.orchestra.run.smithi151.stdout:(7/156): ceph-mon-19.0.0-3538.gbee299f4.el9.x86 3.0 MB/s | 4.7 MB 00:01 2024-05-08T05:33:35.330 INFO:teuthology.orchestra.run.smithi082.stdout:(8/156): ceph-radosgw-19.0.0-3538.gbee299f4.el9 2.9 MB/s | 11 MB 00:03 2024-05-08T05:33:35.413 INFO:teuthology.orchestra.run.smithi082.stdout:(9/156): ceph-selinux-19.0.0-3538.gbee299f4.el9 306 kB/s | 25 kB 00:00 2024-05-08T05:33:35.425 INFO:teuthology.orchestra.run.smithi134.stdout:(8/156): ceph-radosgw-19.0.0-3538.gbee299f4.el9 3.7 MB/s | 11 MB 00:02 2024-05-08T05:33:35.484 INFO:teuthology.orchestra.run.smithi134.stdout:(9/156): ceph-selinux-19.0.0-3538.gbee299f4.el9 433 kB/s | 25 kB 00:00 2024-05-08T05:33:35.495 INFO:teuthology.orchestra.run.smithi151.stdout:(8/156): ceph-radosgw-19.0.0-3538.gbee299f4.el9 6.2 MB/s | 11 MB 00:01 2024-05-08T05:33:35.570 INFO:teuthology.orchestra.run.smithi151.stdout:(9/156): ceph-selinux-19.0.0-3538.gbee299f4.el9 338 kB/s | 25 kB 00:00 2024-05-08T05:33:35.705 INFO:teuthology.orchestra.run.smithi082.stdout:(10/156): ceph-common-19.0.0-3538.gbee299f4.el9 2.6 MB/s | 21 MB 00:08 2024-05-08T05:33:35.906 INFO:teuthology.orchestra.run.smithi082.stdout:(11/156): cephfs-mirror-19.0.0-3538.gbee299f4.e 1.1 MB/s | 225 kB 00:00 2024-05-08T05:33:36.014 INFO:teuthology.orchestra.run.smithi082.stdout:(12/156): cephfs-shell-19.0.0-3538.gbee299f4.el 251 kB/s | 27 kB 00:00 2024-05-08T05:33:36.123 INFO:teuthology.orchestra.run.smithi082.stdout:(13/156): libcephfs-devel-19.0.0-3538.gbee299f4 295 kB/s | 32 kB 00:00 2024-05-08T05:33:36.590 INFO:teuthology.orchestra.run.smithi082.stdout:(14/156): libcephfs2-19.0.0-3538.gbee299f4.el9. 1.6 MB/s | 747 kB 00:00 2024-05-08T05:33:36.698 INFO:teuthology.orchestra.run.smithi082.stdout:(15/156): libcephsqlite-19.0.0-3538.gbee299f4.e 1.5 MB/s | 163 kB 00:00 2024-05-08T05:33:36.798 INFO:teuthology.orchestra.run.smithi082.stdout:(16/156): librados-devel-19.0.0-3538.gbee299f4. 1.2 MB/s | 127 kB 00:00 2024-05-08T05:33:36.943 INFO:teuthology.orchestra.run.smithi134.stdout:(10/156): ceph-osd-19.0.0-3538.gbee299f4.el9.x8 3.6 MB/s | 17 MB 00:04 2024-05-08T05:33:37.065 INFO:teuthology.orchestra.run.smithi082.stdout:(17/156): libradosstriper1-19.0.0-3538.gbee299f 1.8 MB/s | 500 kB 00:00 2024-05-08T05:33:37.134 INFO:teuthology.orchestra.run.smithi134.stdout:(11/156): cephfs-mirror-19.0.0-3538.gbee299f4.e 1.1 MB/s | 225 kB 00:00 2024-05-08T05:33:37.243 INFO:teuthology.orchestra.run.smithi134.stdout:(12/156): cephfs-shell-19.0.0-3538.gbee299f4.el 250 kB/s | 27 kB 00:00 2024-05-08T05:33:37.377 INFO:teuthology.orchestra.run.smithi134.stdout:(13/156): libcephfs-devel-19.0.0-3538.gbee299f4 238 kB/s | 32 kB 00:00 2024-05-08T05:33:37.677 INFO:teuthology.orchestra.run.smithi134.stdout:(14/156): libcephfs2-19.0.0-3538.gbee299f4.el9. 2.4 MB/s | 747 kB 00:00 2024-05-08T05:33:37.794 INFO:teuthology.orchestra.run.smithi134.stdout:(15/156): libcephsqlite-19.0.0-3538.gbee299f4.e 1.4 MB/s | 163 kB 00:00 2024-05-08T05:33:37.902 INFO:teuthology.orchestra.run.smithi134.stdout:(16/156): librados-devel-19.0.0-3538.gbee299f4. 1.1 MB/s | 127 kB 00:00 2024-05-08T05:33:38.114 INFO:teuthology.orchestra.run.smithi134.stdout:(17/156): libradosstriper1-19.0.0-3538.gbee299f 2.3 MB/s | 500 kB 00:00 2024-05-08T05:33:39.495 INFO:teuthology.orchestra.run.smithi134.stdout:(18/156): librgw2-19.0.0-3538.gbee299f4.el9.x86 3.9 MB/s | 5.4 MB 00:01 2024-05-08T05:33:39.578 INFO:teuthology.orchestra.run.smithi134.stdout:(19/156): python3-ceph-argparse-19.0.0-3538.gbe 543 kB/s | 45 kB 00:00 2024-05-08T05:33:39.670 INFO:teuthology.orchestra.run.smithi134.stdout:(20/156): python3-ceph-common-19.0.0-3538.gbee2 1.4 MB/s | 135 kB 00:00 2024-05-08T05:33:39.691 INFO:teuthology.orchestra.run.smithi082.stdout:(18/156): ceph-osd-19.0.0-3538.gbee299f4.el9.x8 1.8 MB/s | 17 MB 00:09 2024-05-08T05:33:39.762 INFO:teuthology.orchestra.run.smithi134.stdout:(21/156): python3-cephfs-19.0.0-3538.gbee299f4. 1.7 MB/s | 161 kB 00:00 2024-05-08T05:33:39.808 INFO:teuthology.orchestra.run.smithi082.stdout:(19/156): python3-ceph-argparse-19.0.0-3538.gbe 390 kB/s | 45 kB 00:00 2024-05-08T05:33:39.871 INFO:teuthology.orchestra.run.smithi134.stdout:(22/156): python3-rados-19.0.0-3538.gbee299f4.e 2.9 MB/s | 321 kB 00:00 2024-05-08T05:33:39.979 INFO:teuthology.orchestra.run.smithi134.stdout:(23/156): python3-rbd-19.0.0-3538.gbee299f4.el9 2.7 MB/s | 299 kB 00:00 2024-05-08T05:33:39.999 INFO:teuthology.orchestra.run.smithi082.stdout:(20/156): python3-ceph-common-19.0.0-3538.gbee2 710 kB/s | 135 kB 00:00 2024-05-08T05:33:40.080 INFO:teuthology.orchestra.run.smithi134.stdout:(24/156): python3-rgw-19.0.0-3538.gbee299f4.el9 996 kB/s | 100 kB 00:00 2024-05-08T05:33:40.175 INFO:teuthology.orchestra.run.smithi082.stdout:(21/156): librgw2-19.0.0-3538.gbee299f4.el9.x86 1.7 MB/s | 5.4 MB 00:03 2024-05-08T05:33:40.187 INFO:teuthology.orchestra.run.smithi134.stdout:(25/156): rbd-fuse-19.0.0-3538.gbee299f4.el9.x8 796 kB/s | 85 kB 00:00 2024-05-08T05:33:40.208 INFO:teuthology.orchestra.run.smithi082.stdout:(22/156): python3-cephfs-19.0.0-3538.gbee299f4. 777 kB/s | 161 kB 00:00 2024-05-08T05:33:40.409 INFO:teuthology.orchestra.run.smithi082.stdout:(23/156): python3-rbd-19.0.0-3538.gbee299f4.el9 1.5 MB/s | 299 kB 00:00 2024-05-08T05:33:40.442 INFO:teuthology.orchestra.run.smithi082.stdout:(24/156): python3-rados-19.0.0-3538.gbee299f4.e 1.2 MB/s | 321 kB 00:00 2024-05-08T05:33:40.518 INFO:teuthology.orchestra.run.smithi082.stdout:(25/156): python3-rgw-19.0.0-3538.gbee299f4.el9 922 kB/s | 100 kB 00:00 2024-05-08T05:33:40.551 INFO:teuthology.orchestra.run.smithi082.stdout:(26/156): rbd-fuse-19.0.0-3538.gbee299f4.el9.x8 789 kB/s | 85 kB 00:00 2024-05-08T05:33:40.752 INFO:teuthology.orchestra.run.smithi082.stdout:(27/156): rbd-nbd-19.0.0-3538.gbee299f4.el9.x86 856 kB/s | 171 kB 00:00 2024-05-08T05:33:40.869 INFO:teuthology.orchestra.run.smithi082.stdout:(28/156): ceph-grafana-dashboards-19.0.0-3538.g 294 kB/s | 34 kB 00:00 2024-05-08T05:33:40.988 INFO:teuthology.orchestra.run.smithi134.stdout:(26/156): rbd-mirror-19.0.0-3538.gbee299f4.el9. 3.9 MB/s | 3.1 MB 00:00 2024-05-08T05:33:40.994 INFO:teuthology.orchestra.run.smithi082.stdout:(29/156): ceph-mgr-cephadm-19.0.0-3538.gbee299f 1.1 MB/s | 142 kB 00:00 2024-05-08T05:33:41.089 INFO:teuthology.orchestra.run.smithi134.stdout:(27/156): rbd-nbd-19.0.0-3538.gbee299f4.el9.x86 1.7 MB/s | 171 kB 00:00 2024-05-08T05:33:41.189 INFO:teuthology.orchestra.run.smithi134.stdout:(28/156): ceph-grafana-dashboards-19.0.0-3538.g 341 kB/s | 34 kB 00:00 2024-05-08T05:33:41.281 INFO:teuthology.orchestra.run.smithi134.stdout:(29/156): ceph-mgr-cephadm-19.0.0-3538.gbee299f 1.5 MB/s | 142 kB 00:00 2024-05-08T05:33:41.420 INFO:teuthology.orchestra.run.smithi151.stdout:(10/156): ceph-common-19.0.0-3538.gbee299f4.el9 1.7 MB/s | 21 MB 00:12 2024-05-08T05:33:41.712 INFO:teuthology.orchestra.run.smithi151.stdout:(11/156): cephfs-mirror-19.0.0-3538.gbee299f4.e 773 kB/s | 225 kB 00:00 2024-05-08T05:33:41.821 INFO:teuthology.orchestra.run.smithi151.stdout:(12/156): cephfs-shell-19.0.0-3538.gbee299f4.el 250 kB/s | 27 kB 00:00 2024-05-08T05:33:41.938 INFO:teuthology.orchestra.run.smithi151.stdout:(13/156): libcephfs-devel-19.0.0-3538.gbee299f4 272 kB/s | 32 kB 00:00 2024-05-08T05:33:42.069 INFO:teuthology.orchestra.run.smithi082.stdout:(30/156): rbd-mirror-19.0.0-3538.gbee299f4.el9. 2.0 MB/s | 3.1 MB 00:01 2024-05-08T05:33:42.173 INFO:teuthology.orchestra.run.smithi134.stdout:(30/156): ceph-mgr-dashboard-19.0.0-3538.gbee29 4.0 MB/s | 3.5 MB 00:00 2024-05-08T05:33:42.830 INFO:teuthology.orchestra.run.smithi151.stdout:(14/156): ceph-test-19.0.0-3538.gbee299f4.el9.x 6.8 MB/s | 49 MB 00:07 2024-05-08T05:33:42.863 INFO:teuthology.orchestra.run.smithi151.stdout:(15/156): libcephfs2-19.0.0-3538.gbee299f4.el9. 807 kB/s | 747 kB 00:00 2024-05-08T05:33:42.894 INFO:teuthology.orchestra.run.smithi082.stdout:(31/156): ceph-mgr-dashboard-19.0.0-3538.gbee29 1.9 MB/s | 3.5 MB 00:01 2024-05-08T05:33:42.913 INFO:teuthology.orchestra.run.smithi151.stdout:(16/156): libcephsqlite-19.0.0-3538.gbee299f4.e 1.9 MB/s | 163 kB 00:00 2024-05-08T05:33:43.039 INFO:teuthology.orchestra.run.smithi151.stdout:(17/156): librados-devel-19.0.0-3538.gbee299f4. 723 kB/s | 127 kB 00:00 2024-05-08T05:33:43.061 INFO:teuthology.orchestra.run.smithi082.stdout:(32/156): ceph-mgr-modules-core-19.0.0-3538.gbe 1.6 MB/s | 274 kB 00:00 2024-05-08T05:33:43.089 INFO:teuthology.orchestra.run.smithi151.stdout:(18/156): libradosstriper1-19.0.0-3538.gbee299f 2.8 MB/s | 500 kB 00:00 2024-05-08T05:33:43.161 INFO:teuthology.orchestra.run.smithi082.stdout:(33/156): ceph-mgr-rook-19.0.0-3538.gbee299f4.e 497 kB/s | 49 kB 00:00 2024-05-08T05:33:43.181 INFO:teuthology.orchestra.run.smithi151.stdout:(19/156): python3-ceph-argparse-19.0.0-3538.gbe 492 kB/s | 45 kB 00:00 2024-05-08T05:33:43.270 INFO:teuthology.orchestra.run.smithi082.stdout:(34/156): ceph-prometheus-alerts-19.0.0-3538.gb 153 kB/s | 16 kB 00:00 2024-05-08T05:33:43.348 INFO:teuthology.orchestra.run.smithi151.stdout:(20/156): ceph-osd-19.0.0-3538.gbee299f4.el9.x8 1.6 MB/s | 17 MB 00:10 2024-05-08T05:33:43.374 INFO:teuthology.orchestra.run.smithi151.stdout:(21/156): python3-ceph-common-19.0.0-3538.gbee2 706 kB/s | 135 kB 00:00 2024-05-08T05:33:43.422 INFO:teuthology.orchestra.run.smithi082.stdout:(35/156): ceph-volume-19.0.0-3538.gbee299f4.el9 1.8 MB/s | 273 kB 00:00 2024-05-08T05:33:43.482 INFO:teuthology.orchestra.run.smithi151.stdout:(22/156): python3-rados-19.0.0-3538.gbee299f4.e 2.9 MB/s | 321 kB 00:00 2024-05-08T05:33:43.508 INFO:teuthology.orchestra.run.smithi151.stdout:(23/156): python3-cephfs-19.0.0-3538.gbee299f4. 1.0 MB/s | 161 kB 00:00 2024-05-08T05:33:43.583 INFO:teuthology.orchestra.run.smithi151.stdout:(24/156): python3-rbd-19.0.0-3538.gbee299f4.el9 2.9 MB/s | 299 kB 00:00 2024-05-08T05:33:43.608 INFO:teuthology.orchestra.run.smithi151.stdout:(25/156): python3-rgw-19.0.0-3538.gbee299f4.el9 994 kB/s | 100 kB 00:00 2024-05-08T05:33:43.658 INFO:teuthology.orchestra.run.smithi151.stdout:(26/156): rbd-fuse-19.0.0-3538.gbee299f4.el9.x8 1.1 MB/s | 85 kB 00:00 2024-05-08T05:33:43.698 INFO:teuthology.orchestra.run.smithi134.stdout:(31/156): ceph-mgr-diskprediction-local-19.0.0- 4.9 MB/s | 7.4 MB 00:01 2024-05-08T05:33:43.742 INFO:teuthology.orchestra.run.smithi151.stdout:(27/156): rbd-nbd-19.0.0-3538.gbee299f4.el9.x86 2.0 MB/s | 171 kB 00:00 2024-05-08T05:33:43.770 INFO:teuthology.orchestra.run.smithi082.stdout:(36/156): cephadm-19.0.0-3538.gbee299f4.el9.noa 2.1 MB/s | 763 kB 00:00 2024-05-08T05:33:43.798 INFO:teuthology.orchestra.run.smithi134.stdout:(32/156): ceph-mgr-modules-core-19.0.0-3538.gbe 2.7 MB/s | 274 kB 00:00 2024-05-08T05:33:43.825 INFO:teuthology.orchestra.run.smithi151.stdout:(28/156): ceph-grafana-dashboards-19.0.0-3538.g 411 kB/s | 34 kB 00:00 2024-05-08T05:33:43.862 INFO:teuthology.orchestra.run.smithi082.stdout:(37/156): cephfs-top-19.0.0-3538.gbee299f4.el9. 201 kB/s | 18 kB 00:00 2024-05-08T05:33:44.001 INFO:teuthology.orchestra.run.smithi151.stdout:(29/156): ceph-mgr-cephadm-19.0.0-3538.gbee299f 813 kB/s | 142 kB 00:00 2024-05-08T05:33:44.046 INFO:teuthology.orchestra.run.smithi082.stdout:(38/156): fuse-2.9.9-15.el9.x86_64.rpm 441 kB/s | 80 kB 00:00 2024-05-08T05:33:44.174 INFO:teuthology.orchestra.run.smithi134.stdout:(33/156): ceph-mgr-rook-19.0.0-3538.gbee299f4.e 131 kB/s | 49 kB 00:00 2024-05-08T05:33:44.238 INFO:teuthology.orchestra.run.smithi082.stdout:(39/156): libgfortran-11.4.1-3.el9.x86_64.rpm 4.1 MB/s | 803 kB 00:00 2024-05-08T05:33:44.386 INFO:teuthology.orchestra.run.smithi134.stdout:(34/156): ceph-prometheus-alerts-19.0.0-3538.gb 78 kB/s | 16 kB 00:00 2024-05-08T05:33:44.572 INFO:teuthology.orchestra.run.smithi082.stdout:(40/156): libquadmath-11.4.1-3.el9.x86_64.rpm 587 kB/s | 195 kB 00:00 2024-05-08T05:33:44.591 INFO:teuthology.orchestra.run.smithi134.stdout:(35/156): ceph-volume-19.0.0-3538.gbee299f4.el9 1.3 MB/s | 273 kB 00:00 2024-05-08T05:33:44.709 INFO:teuthology.orchestra.run.smithi151.stdout:(30/156): ceph-mgr-dashboard-19.0.0-3538.gbee29 5.0 MB/s | 3.5 MB 00:00 2024-05-08T05:33:44.747 INFO:teuthology.orchestra.run.smithi082.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.4 MB/s | 253 kB 00:00 2024-05-08T05:33:44.850 INFO:teuthology.orchestra.run.smithi134.stdout:(36/156): cephadm-19.0.0-3538.gbee299f4.el9.noa 2.9 MB/s | 763 kB 00:00 2024-05-08T05:33:44.942 INFO:teuthology.orchestra.run.smithi134.stdout:(37/156): cephfs-top-19.0.0-3538.gbee299f4.el9. 199 kB/s | 18 kB 00:00 2024-05-08T05:33:44.955 INFO:teuthology.orchestra.run.smithi082.stdout:(42/156): ceph-mgr-diskprediction-local-19.0.0- 2.6 MB/s | 7.4 MB 00:02 2024-05-08T05:33:45.014 INFO:teuthology.orchestra.run.smithi082.stdout:(43/156): python3-cryptography-36.0.1-4.el9.x86 4.6 MB/s | 1.2 MB 00:00 2024-05-08T05:33:45.068 INFO:teuthology.orchestra.run.smithi151.stdout:(31/156): rbd-mirror-19.0.0-3538.gbee299f4.el9. 2.1 MB/s | 3.1 MB 00:01 2024-05-08T05:33:45.098 INFO:teuthology.orchestra.run.smithi082.stdout:(44/156): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-05-08T05:33:45.167 INFO:teuthology.orchestra.run.smithi134.stdout:(38/156): fuse-2.9.9-15.el9.x86_64.rpm 357 kB/s | 80 kB 00:00 2024-05-08T05:33:45.190 INFO:teuthology.orchestra.run.smithi082.stdout:(45/156): python3-requests-2.25.1-8.el9.noarch. 1.3 MB/s | 125 kB 00:00 2024-05-08T05:33:45.224 INFO:teuthology.orchestra.run.smithi082.stdout:(46/156): python3-ply-3.11-14.el9.noarch.rpm 399 kB/s | 106 kB 00:00 2024-05-08T05:33:45.235 INFO:teuthology.orchestra.run.smithi151.stdout:(32/156): ceph-mgr-modules-core-19.0.0-3538.gbe 1.6 MB/s | 274 kB 00:00 2024-05-08T05:33:45.257 INFO:teuthology.orchestra.run.smithi082.stdout:(47/156): python3-urllib3-1.26.5-5.el9.noarch.r 3.2 MB/s | 215 kB 00:00 2024-05-08T05:33:45.293 INFO:teuthology.orchestra.run.smithi151.stdout:(33/156): ceph-mgr-rook-19.0.0-3538.gbee299f4.e 850 kB/s | 49 kB 00:00 2024-05-08T05:33:45.361 INFO:teuthology.orchestra.run.smithi151.stdout:(34/156): ceph-prometheus-alerts-19.0.0-3538.gb 246 kB/s | 16 kB 00:00 2024-05-08T05:33:45.401 INFO:teuthology.orchestra.run.smithi134.stdout:(39/156): ceph-common-19.0.0-3538.gbee299f4.el9 1.3 MB/s | 21 MB 00:16 2024-05-08T05:33:45.509 INFO:teuthology.orchestra.run.smithi134.stdout:(40/156): libgfortran-11.4.1-3.el9.x86_64.rpm 2.3 MB/s | 803 kB 00:00 2024-05-08T05:33:45.511 INFO:teuthology.orchestra.run.smithi151.stdout:(35/156): ceph-volume-19.0.0-3538.gbee299f4.el9 1.8 MB/s | 273 kB 00:00 2024-05-08T05:33:45.568 INFO:teuthology.orchestra.run.smithi134.stdout:(41/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.2 MB/s | 253 kB 00:00 2024-05-08T05:33:45.661 INFO:teuthology.orchestra.run.smithi151.stdout:(36/156): librgw2-19.0.0-3538.gbee299f4.el9.x86 2.0 MB/s | 5.4 MB 00:02 2024-05-08T05:33:45.668 INFO:teuthology.orchestra.run.smithi134.stdout:(42/156): libquadmath-11.4.1-3.el9.x86_64.rpm 732 kB/s | 195 kB 00:00 2024-05-08T05:33:45.701 INFO:teuthology.orchestra.run.smithi134.stdout:(43/156): python3-cryptography-36.0.1-4.el9.x86 9.2 MB/s | 1.2 MB 00:00 2024-05-08T05:33:45.762 INFO:teuthology.orchestra.run.smithi151.stdout:(37/156): cephfs-top-19.0.0-3538.gbee299f4.el9. 183 kB/s | 18 kB 00:00 2024-05-08T05:33:45.768 INFO:teuthology.orchestra.run.smithi134.stdout:(44/156): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-05-08T05:33:45.794 INFO:teuthology.orchestra.run.smithi134.stdout:(45/156): python3-ply-3.11-14.el9.noarch.rpm 849 kB/s | 106 kB 00:00 2024-05-08T05:33:45.820 INFO:teuthology.orchestra.run.smithi151.stdout:(38/156): fuse-2.9.9-15.el9.x86_64.rpm 1.4 MB/s | 80 kB 00:00 2024-05-08T05:33:45.827 INFO:teuthology.orchestra.run.smithi134.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-05-08T05:33:45.863 INFO:teuthology.orchestra.run.smithi151.stdout:(39/156): cephadm-19.0.0-3538.gbee299f4.el9.noa 2.1 MB/s | 763 kB 00:00 2024-05-08T05:33:45.953 INFO:teuthology.orchestra.run.smithi134.stdout:(47/156): python3-urllib3-1.26.5-5.el9.noarch.r 1.3 MB/s | 215 kB 00:00 2024-05-08T05:33:45.996 INFO:teuthology.orchestra.run.smithi151.stdout:(40/156): ceph-mgr-diskprediction-local-19.0.0- 5.8 MB/s | 7.4 MB 00:01 2024-05-08T05:33:46.063 INFO:teuthology.orchestra.run.smithi151.stdout:(41/156): libquadmath-11.4.1-3.el9.x86_64.rpm 976 kB/s | 195 kB 00:00 2024-05-08T05:33:46.119 INFO:teuthology.orchestra.run.smithi151.stdout:(42/156): libgfortran-11.4.1-3.el9.x86_64.rpm 2.6 MB/s | 803 kB 00:00 2024-05-08T05:33:46.146 INFO:teuthology.orchestra.run.smithi151.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.6 MB/s | 253 kB 00:00 2024-05-08T05:33:46.205 INFO:teuthology.orchestra.run.smithi151.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 106 kB 00:00 2024-05-08T05:33:46.222 INFO:teuthology.orchestra.run.smithi151.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.8 MB/s | 135 kB 00:00 2024-05-08T05:33:46.256 INFO:teuthology.orchestra.run.smithi151.stdout:(46/156): python3-cryptography-36.0.1-4.el9.x86 6.4 MB/s | 1.2 MB 00:00 2024-05-08T05:33:46.298 INFO:teuthology.orchestra.run.smithi151.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 1.3 MB/s | 125 kB 00:00 2024-05-08T05:33:46.348 INFO:teuthology.orchestra.run.smithi151.stdout:(48/156): python3-urllib3-1.26.5-5.el9.noarch.r 1.7 MB/s | 215 kB 00:00 2024-05-08T05:33:46.549 INFO:teuthology.orchestra.run.smithi082.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 520 kB/s | 689 kB 00:01 2024-05-08T05:33:46.657 INFO:teuthology.orchestra.run.smithi082.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 674 kB/s | 943 kB 00:01 2024-05-08T05:33:46.773 INFO:teuthology.orchestra.run.smithi151.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 251 kB/s | 107 kB 00:00 2024-05-08T05:33:46.873 INFO:teuthology.orchestra.run.smithi151.stdout:(50/156): elfutils-libelf-devel-0.190-2.el9.x86 215 kB/s | 21 kB 00:00 2024-05-08T05:33:47.007 INFO:teuthology.orchestra.run.smithi151.stdout:(51/156): automake-1.16.2-8.el9.noarch.rpm 917 kB/s | 689 kB 00:00 2024-05-08T05:33:47.074 INFO:teuthology.orchestra.run.smithi151.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 1.2 MB/s | 943 kB 00:00 2024-05-08T05:33:47.099 INFO:teuthology.orchestra.run.smithi151.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 356 kB/s | 33 kB 00:00 2024-05-08T05:33:47.200 INFO:teuthology.orchestra.run.smithi151.stdout:(54/156): flexiblas-openblas-openmp-3.0.4-8.el9 182 kB/s | 18 kB 00:00 2024-05-08T05:33:47.258 INFO:teuthology.orchestra.run.smithi151.stdout:(55/156): flex-2.6.4-9.el9.x86_64.rpm 816 kB/s | 313 kB 00:00 2024-05-08T05:33:47.292 INFO:teuthology.orchestra.run.smithi151.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 121 kB/s | 11 kB 00:00 2024-05-08T05:33:47.303 INFO:teuthology.orchestra.run.smithi134.stdout:(48/156): automake-1.16.2-8.el9.noarch.rpm 467 kB/s | 689 kB 00:01 2024-05-08T05:33:47.345 INFO:teuthology.orchestra.run.smithi134.stdout:(49/156): bison-3.7.4-5.el9.x86_64.rpm 678 kB/s | 943 kB 00:01 2024-05-08T05:33:47.367 INFO:teuthology.orchestra.run.smithi151.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-05-08T05:33:47.392 INFO:teuthology.orchestra.run.smithi151.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 451 kB/s | 45 kB 00:00 2024-05-08T05:33:47.499 INFO:teuthology.orchestra.run.smithi082.stdout:(50/156): elfutils-libelf-devel-0.190-2.el9.x86 26 kB/s | 21 kB 00:00 2024-05-08T05:33:47.509 INFO:teuthology.orchestra.run.smithi151.stdout:(59/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 6.9 MB/s | 3.0 MB 00:00 2024-05-08T05:33:47.533 INFO:teuthology.orchestra.run.smithi082.stdout:(51/156): boost-program-options-1.75.0-8.el9.x8 109 kB/s | 107 kB 00:00 2024-05-08T05:33:47.618 INFO:teuthology.orchestra.run.smithi151.stdout:(60/156): libtool-2.4.6-45.el9.x86_64.rpm 2.5 MB/s | 582 kB 00:00 2024-05-08T05:33:47.643 INFO:teuthology.orchestra.run.smithi151.stdout:(61/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 191 kB/s | 25 kB 00:00 2024-05-08T05:33:47.685 INFO:teuthology.orchestra.run.smithi151.stdout:(62/156): librdkafka-1.6.1-102.el9.x86_64.rpm 2.0 MB/s | 662 kB 00:00 2024-05-08T05:33:47.719 INFO:teuthology.orchestra.run.smithi151.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 470 kB/s | 47 kB 00:00 2024-05-08T05:33:47.753 INFO:teuthology.orchestra.run.smithi151.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-05-08T05:33:47.795 INFO:teuthology.orchestra.run.smithi151.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-05-08T05:33:47.820 INFO:teuthology.orchestra.run.smithi151.stdout:(66/156): openblas-0.3.21-2.el9.x86_64.rpm 350 kB/s | 35 kB 00:00 2024-05-08T05:33:48.045 INFO:teuthology.orchestra.run.smithi151.stdout:(67/156): postgresql-13.14-1.el9.x86_64.rpm 7.1 MB/s | 1.6 MB 00:00 2024-05-08T05:33:48.179 INFO:teuthology.orchestra.run.smithi151.stdout:(68/156): postgresql-contrib-13.14-1.el9.x86_64 6.7 MB/s | 911 kB 00:00 2024-05-08T05:33:48.204 INFO:teuthology.orchestra.run.smithi134.stdout:(50/156): ceph-test-19.0.0-3538.gbee299f4.el9.x 3.9 MB/s | 49 MB 00:12 2024-05-08T05:33:48.296 INFO:teuthology.orchestra.run.smithi151.stdout:(69/156): postgresql-private-libs-13.14-1.el9.x 1.1 MB/s | 133 kB 00:00 2024-05-08T05:33:48.591 INFO:teuthology.orchestra.run.smithi082.stdout:(52/156): ceph-test-19.0.0-3538.gbee299f4.el9.x 3.7 MB/s | 49 MB 00:13 2024-05-08T05:33:48.620 INFO:teuthology.orchestra.run.smithi134.stdout:(51/156): elfutils-libelf-devel-0.190-2.el9.x86 17 kB/s | 21 kB 00:01 2024-05-08T05:33:48.704 INFO:teuthology.orchestra.run.smithi134.stdout:(52/156): boost-program-options-1.75.0-8.el9.x8 76 kB/s | 107 kB 00:01 2024-05-08T05:33:48.891 INFO:teuthology.orchestra.run.smithi082.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 24 kB/s | 33 kB 00:01 2024-05-08T05:33:49.259 INFO:teuthology.orchestra.run.smithi082.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 179 kB/s | 313 kB 00:01 2024-05-08T05:33:49.490 INFO:teuthology.orchestra.run.smithi151.stdout:(70/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 2.6 MB/s | 4.4 MB 00:01 2024-05-08T05:33:49.562 INFO:teuthology.orchestra.run.smithi134.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 231 kB/s | 313 kB 00:01 2024-05-08T05:33:49.588 INFO:teuthology.orchestra.run.smithi134.stdout:(54/156): flexiblas-3.0.4-8.el9.x86_64.rpm 34 kB/s | 33 kB 00:00 2024-05-08T05:33:49.992 INFO:teuthology.orchestra.run.smithi082.stdout:(55/156): libaio-devel-0.3.111-13.el9.x86_64.rp 15 kB/s | 11 kB 00:00 2024-05-08T05:33:50.346 INFO:teuthology.orchestra.run.smithi134.stdout:(55/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 1.8 MB/s | 3.0 MB 00:01 2024-05-08T05:33:50.584 INFO:teuthology.orchestra.run.smithi082.stdout:(56/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 1.5 MB/s | 3.0 MB 00:01 2024-05-08T05:33:50.588 INFO:teuthology.orchestra.run.smithi134.stdout:(56/156): flexiblas-openblas-openmp-3.0.4-8.el9 18 kB/s | 18 kB 00:01 2024-05-08T05:33:50.613 INFO:teuthology.orchestra.run.smithi134.stdout:(57/156): libaio-devel-0.3.111-13.el9.x86_64.rp 11 kB/s | 11 kB 00:01 2024-05-08T05:33:51.109 INFO:teuthology.orchestra.run.smithi082.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 144 kB/s | 160 kB 00:01 2024-05-08T05:33:51.188 INFO:teuthology.orchestra.run.smithi151.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 608 kB/s | 1.0 MB 00:01 2024-05-08T05:33:51.371 INFO:teuthology.orchestra.run.smithi151.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 477 kB/s | 87 kB 00:00 2024-05-08T05:33:51.438 INFO:teuthology.orchestra.run.smithi134.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 147 kB/s | 160 kB 00:01 2024-05-08T05:33:51.464 INFO:teuthology.orchestra.run.smithi134.stdout:(59/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 52 kB/s | 45 kB 00:00 2024-05-08T05:33:51.543 INFO:teuthology.orchestra.run.smithi082.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 47 kB/s | 45 kB 00:00 2024-05-08T05:33:51.718 INFO:teuthology.orchestra.run.smithi082.stdout:(59/156): flexiblas-openblas-openmp-3.0.4-8.el9 6.4 kB/s | 18 kB 00:02 2024-05-08T05:33:51.931 INFO:teuthology.orchestra.run.smithi134.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 503 kB/s | 662 kB 00:01 2024-05-08T05:33:52.071 INFO:teuthology.orchestra.run.smithi151.stdout:(73/156): openblas-openmp-0.3.21-2.el9.x86_64.r 1.1 MB/s | 4.7 MB 00:04 2024-05-08T05:33:52.223 INFO:teuthology.orchestra.run.smithi134.stdout:(61/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 33 kB/s | 25 kB 00:00 2024-05-08T05:33:52.414 INFO:teuthology.orchestra.run.smithi151.stdout:(74/156): python3-devel-3.9.18-3.el9.x86_64.rpm 715 kB/s | 244 kB 00:00 2024-05-08T05:33:52.451 INFO:teuthology.orchestra.run.smithi082.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 495 kB/s | 662 kB 00:01 2024-05-08T05:33:52.560 INFO:teuthology.orchestra.run.smithi082.stdout:(61/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 30 kB/s | 25 kB 00:00 2024-05-08T05:33:52.665 INFO:teuthology.orchestra.run.smithi134.stdout:(62/156): libtool-2.4.6-45.el9.x86_64.rpm 475 kB/s | 582 kB 00:01 2024-05-08T05:33:52.764 INFO:teuthology.orchestra.run.smithi151.stdout:(75/156): python3-jinja2-2.11.3-5.el9.noarch.rp 708 kB/s | 248 kB 00:00 2024-05-08T05:33:52.864 INFO:teuthology.orchestra.run.smithi151.stdout:(76/156): python3-jsonpatch-1.21-16.el9.noarch. 256 kB/s | 26 kB 00:00 2024-05-08T05:33:52.868 INFO:teuthology.orchestra.run.smithi082.stdout:(62/156): libtool-2.4.6-45.el9.x86_64.rpm 440 kB/s | 582 kB 00:01 2024-05-08T05:33:52.964 INFO:teuthology.orchestra.run.smithi151.stdout:(77/156): python3-jsonpointer-2.0-4.el9.noarch. 192 kB/s | 19 kB 00:00 2024-05-08T05:33:53.115 INFO:teuthology.orchestra.run.smithi134.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 40 kB/s | 47 kB 00:01 2024-05-08T05:33:53.231 INFO:teuthology.orchestra.run.smithi151.stdout:(78/156): python3-mako-1.1.4-6.el9.noarch.rpm 646 kB/s | 172 kB 00:00 2024-05-08T05:33:53.340 INFO:teuthology.orchestra.run.smithi151.stdout:(79/156): python3-markupsafe-1.1.1-12.el9.x86_6 320 kB/s | 35 kB 00:00 2024-05-08T05:33:53.340 INFO:teuthology.orchestra.run.smithi134.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 262 kB/s | 292 kB 00:01 2024-05-08T05:33:53.352 INFO:teuthology.orchestra.run.smithi082.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 53 kB/s | 47 kB 00:00 2024-05-08T05:33:53.740 INFO:teuthology.orchestra.run.smithi151.stdout:(80/156): postgresql-server-13.14-1.el9.x86_64. 1.1 MB/s | 5.8 MB 00:05 2024-05-08T05:33:53.765 INFO:teuthology.orchestra.run.smithi134.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 171 kB/s | 188 kB 00:01 2024-05-08T05:33:53.777 INFO:teuthology.orchestra.run.smithi082.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 240 kB/s | 292 kB 00:01 2024-05-08T05:33:53.986 INFO:teuthology.orchestra.run.smithi134.stdout:(66/156): openblas-0.3.21-2.el9.x86_64.rpm 41 kB/s | 35 kB 00:00 2024-05-08T05:33:54.027 INFO:teuthology.orchestra.run.smithi082.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 172 kB/s | 188 kB 00:01 2024-05-08T05:33:54.190 INFO:teuthology.orchestra.run.smithi151.stdout:(81/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 557 kB/s | 250 kB 00:00 2024-05-08T05:33:54.254 INFO:teuthology.orchestra.run.smithi082.stdout:(66/156): openblas-0.3.21-2.el9.x86_64.rpm 39 kB/s | 35 kB 00:00 2024-05-08T05:33:54.524 INFO:teuthology.orchestra.run.smithi151.stdout:(82/156): python3-oauthlib-3.1.1-5.el9.noarch.r 667 kB/s | 222 kB 00:00 2024-05-08T05:33:54.708 INFO:teuthology.orchestra.run.smithi151.stdout:(83/156): python3-packaging-20.9-5.el9.noarch.r 421 kB/s | 77 kB 00:00 2024-05-08T05:33:54.808 INFO:teuthology.orchestra.run.smithi151.stdout:(84/156): python3-prettytable-0.7.2-27.el9.noar 423 kB/s | 42 kB 00:00 2024-05-08T05:33:54.991 INFO:teuthology.orchestra.run.smithi134.stdout:(67/156): openblas-openmp-0.3.21-2.el9.x86_64.r 2.9 MB/s | 4.7 MB 00:01 2024-05-08T05:33:55.233 INFO:teuthology.orchestra.run.smithi151.stdout:(85/156): python3-protobuf-3.14.0-13.el9.noarch 634 kB/s | 269 kB 00:00 2024-05-08T05:33:55.391 INFO:teuthology.orchestra.run.smithi134.stdout:(68/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 2.7 MB/s | 4.4 MB 00:01 2024-05-08T05:33:55.433 INFO:teuthology.orchestra.run.smithi134.stdout:(69/156): postgresql-13.14-1.el9.x86_64.rpm 1.1 MB/s | 1.6 MB 00:01 2024-05-08T05:33:55.486 INFO:teuthology.orchestra.run.smithi082.stdout:(67/156): openblas-openmp-0.3.21-2.el9.x86_64.r 2.8 MB/s | 4.7 MB 00:01 2024-05-08T05:33:55.500 INFO:teuthology.orchestra.run.smithi151.stdout:(86/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 595 kB/s | 159 kB 00:00 2024-05-08T05:33:55.711 INFO:teuthology.orchestra.run.smithi082.stdout:(68/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 2.6 MB/s | 4.4 MB 00:01 2024-05-08T05:33:55.770 INFO:teuthology.orchestra.run.smithi082.stdout:(69/156): postgresql-13.14-1.el9.x86_64.rpm 1.0 MB/s | 1.6 MB 00:01 2024-05-08T05:33:55.925 INFO:teuthology.orchestra.run.smithi151.stdout:(87/156): python3-pyasn1-modules-0.4.8-6.el9.no 656 kB/s | 279 kB 00:00 2024-05-08T05:33:56.017 INFO:teuthology.orchestra.run.smithi151.stdout:(88/156): python3-pytz-2021.1-5.el9.noarch.rpm 556 kB/s | 51 kB 00:00 2024-05-08T05:33:56.126 INFO:teuthology.orchestra.run.smithi151.stdout:(89/156): python3-requests-oauthlib-1.3.0-12.el 494 kB/s | 54 kB 00:00 2024-05-08T05:33:56.300 INFO:teuthology.orchestra.run.smithi134.stdout:(70/156): postgresql-contrib-13.14-1.el9.x86_64 696 kB/s | 911 kB 00:01 2024-05-08T05:33:56.383 INFO:teuthology.orchestra.run.smithi134.stdout:(71/156): postgresql-private-libs-13.14-1.el9.x 134 kB/s | 133 kB 00:00 2024-05-08T05:33:56.770 INFO:teuthology.orchestra.run.smithi082.stdout:(70/156): postgresql-private-libs-13.14-1.el9.x 126 kB/s | 133 kB 00:01 2024-05-08T05:33:57.075 INFO:teuthology.orchestra.run.smithi134.stdout:(72/156): postgresql-server-13.14-1.el9.x86_64. 3.5 MB/s | 5.8 MB 00:01 2024-05-08T05:33:57.093 INFO:teuthology.orchestra.run.smithi151.stdout:(90/156): python3-babel-2.9.1-2.el9.noarch.rpm 1.0 MB/s | 6.0 MB 00:05 2024-05-08T05:33:57.193 INFO:teuthology.orchestra.run.smithi151.stdout:(91/156): python3-toml-0.10.2-6.el9.noarch.rpm 417 kB/s | 42 kB 00:00 2024-05-08T05:33:57.267 INFO:teuthology.orchestra.run.smithi134.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 99 kB/s | 87 kB 00:00 2024-05-08T05:33:57.270 INFO:teuthology.orchestra.run.smithi082.stdout:(71/156): postgresql-contrib-13.14-1.el9.x86_64 511 kB/s | 911 kB 00:01 2024-05-08T05:33:57.285 INFO:teuthology.orchestra.run.smithi151.stdout:(92/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 482 kB/s | 44 kB 00:00 2024-05-08T05:33:57.537 INFO:teuthology.orchestra.run.smithi082.stdout:(72/156): postgresql-server-13.14-1.el9.x86_64. 3.3 MB/s | 5.8 MB 00:01 2024-05-08T05:33:57.627 INFO:teuthology.orchestra.run.smithi151.stdout:(93/156): qatlib-24.02.0-1.el9.x86_64.rpm 646 kB/s | 221 kB 00:00 2024-05-08T05:33:57.634 INFO:teuthology.orchestra.run.smithi134.stdout:(74/156): protobuf-3.14.0-13.el9.x86_64.rpm 775 kB/s | 1.0 MB 00:01 2024-05-08T05:33:57.719 INFO:teuthology.orchestra.run.smithi151.stdout:(94/156): qatlib-service-24.02.0-1.el9.x86_64.r 391 kB/s | 36 kB 00:00 2024-05-08T05:33:57.820 INFO:teuthology.orchestra.run.smithi151.stdout:(95/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 473 kB/s | 47 kB 00:00 2024-05-08T05:33:58.245 INFO:teuthology.orchestra.run.smithi151.stdout:(96/156): socat-1.7.4.1-5.el9.x86_64.rpm 717 kB/s | 305 kB 00:00 2024-05-08T05:33:58.304 INFO:teuthology.orchestra.run.smithi082.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 674 kB/s | 1.0 MB 00:01 2024-05-08T05:33:58.345 INFO:teuthology.orchestra.run.smithi151.stdout:(97/156): uuid-1.6.2-55.el9.x86_64.rpm 578 kB/s | 58 kB 00:00 2024-05-08T05:33:58.359 INFO:teuthology.orchestra.run.smithi134.stdout:(75/156): python3-devel-3.9.18-3.el9.x86_64.rpm 224 kB/s | 244 kB 00:01 2024-05-08T05:33:58.388 INFO:teuthology.orchestra.run.smithi082.stdout:(74/156): python3-attrs-20.3.0-7.el9.noarch.rpm 78 kB/s | 87 kB 00:01 2024-05-08T05:33:58.529 INFO:teuthology.orchestra.run.smithi151.stdout:(98/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 511 kB/s | 94 kB 00:00 2024-05-08T05:33:58.712 INFO:teuthology.orchestra.run.smithi151.stdout:(99/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 347 kB/s | 64 kB 00:00 2024-05-08T05:33:58.734 INFO:teuthology.orchestra.run.smithi134.stdout:(76/156): python3-babel-2.9.1-2.el9.noarch.rpm 3.6 MB/s | 6.0 MB 00:01 2024-05-08T05:33:58.813 INFO:teuthology.orchestra.run.smithi151.stdout:(100/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 448 kB/s | 45 kB 00:00 2024-05-08T05:33:58.929 INFO:teuthology.orchestra.run.smithi151.stdout:(101/156): lua-devel-5.4.4-4.el9.x86_64.rpm 191 kB/s | 22 kB 00:00 2024-05-08T05:33:59.147 INFO:teuthology.orchestra.run.smithi151.stdout:(102/156): protobuf-compiler-3.14.0-13.el9.x86_ 3.9 MB/s | 863 kB 00:00 2024-05-08T05:33:59.193 INFO:teuthology.orchestra.run.smithi134.stdout:(77/156): python3-jinja2-2.11.3-5.el9.noarch.rp 159 kB/s | 248 kB 00:01 2024-05-08T05:33:59.339 INFO:teuthology.orchestra.run.smithi151.stdout:(103/156): abseil-cpp-20211102.0-3.el9.x86_64.r 2.8 MB/s | 548 kB 00:00 2024-05-08T05:33:59.413 INFO:teuthology.orchestra.run.smithi082.stdout:(75/156): python3-babel-2.9.1-2.el9.noarch.rpm 3.2 MB/s | 6.0 MB 00:01 2024-05-08T05:33:59.430 INFO:teuthology.orchestra.run.smithi151.stdout:(104/156): gperftools-libs-2.9.1-2.el9.x86_64.r 3.3 MB/s | 309 kB 00:00 2024-05-08T05:33:59.472 INFO:teuthology.orchestra.run.smithi151.stdout:(105/156): grpc-data-1.46.7-10.el9.noarch.rpm 466 kB/s | 19 kB 00:00 2024-05-08T05:33:59.543 INFO:teuthology.orchestra.run.smithi134.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 22 kB/s | 26 kB 00:01 2024-05-08T05:33:59.671 INFO:teuthology.orchestra.run.smithi082.stdout:(76/156): python3-devel-3.9.18-3.el9.x86_64.rpm 179 kB/s | 244 kB 00:01 2024-05-08T05:33:59.819 INFO:teuthology.orchestra.run.smithi134.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 18 kB/s | 19 kB 00:01 2024-05-08T05:34:00.155 INFO:teuthology.orchestra.run.smithi082.stdout:(77/156): python3-jinja2-2.11.3-5.el9.noarch.rp 140 kB/s | 248 kB 00:01 2024-05-08T05:34:00.269 INFO:teuthology.orchestra.run.smithi134.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 160 kB/s | 172 kB 00:01 2024-05-08T05:34:00.306 INFO:teuthology.orchestra.run.smithi151.stdout:(106/156): python3-numpy-1.20.1-5.el9.x86_64.rp 749 kB/s | 5.1 MB 00:06 2024-05-08T05:34:00.355 INFO:teuthology.orchestra.run.smithi082.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 28 kB/s | 19 kB 00:00 2024-05-08T05:34:00.373 INFO:teuthology.orchestra.run.smithi151.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 4.9 MB/s | 4.4 MB 00:00 2024-05-08T05:34:00.389 INFO:teuthology.orchestra.run.smithi082.stdout:(79/156): python3-jsonpatch-1.21-16.el9.noarch. 26 kB/s | 26 kB 00:00 2024-05-08T05:34:00.406 INFO:teuthology.orchestra.run.smithi151.stdout:(108/156): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-05-08T05:34:00.424 INFO:teuthology.orchestra.run.smithi151.stdout:(109/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 222 kB/s | 26 kB 00:00 2024-05-08T05:34:00.449 INFO:teuthology.orchestra.run.smithi151.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-05-08T05:34:00.524 INFO:teuthology.orchestra.run.smithi151.stdout:(111/156): luarocks-3.9.2-1.el9.noarch.rpm 1.5 MB/s | 151 kB 00:00 2024-05-08T05:34:00.649 INFO:teuthology.orchestra.run.smithi151.stdout:(112/156): python3-asyncssh-2.13.2-5.el9.noarch 4.3 MB/s | 548 kB 00:00 2024-05-08T05:34:00.675 INFO:teuthology.orchestra.run.smithi151.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.6 MB/s | 839 kB 00:00 2024-05-08T05:34:00.685 INFO:teuthology.orchestra.run.smithi134.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 30 kB/s | 35 kB 00:01 2024-05-08T05:34:00.700 INFO:teuthology.orchestra.run.smithi151.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 863 kB/s | 43 kB 00:00 2024-05-08T05:34:00.733 INFO:teuthology.orchestra.run.smithi151.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 551 kB/s | 32 kB 00:00 2024-05-08T05:34:00.759 INFO:teuthology.orchestra.run.smithi151.stdout:(116/156): python3-certifi-2021.10.8-2.el9.noar 254 kB/s | 15 kB 00:00 2024-05-08T05:34:00.801 INFO:teuthology.orchestra.run.smithi151.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.5 MB/s | 172 kB 00:00 2024-05-08T05:34:00.868 INFO:teuthology.orchestra.run.smithi151.stdout:(118/156): python3-cherrypy-18.6.1-2.el9.noarch 3.2 MB/s | 358 kB 00:00 2024-05-08T05:34:00.910 INFO:teuthology.orchestra.run.smithi151.stdout:(119/156): python3-colorama-0.4.4-12.el9.noarch 847 kB/s | 35 kB 00:00 2024-05-08T05:34:00.935 INFO:teuthology.orchestra.run.smithi151.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.2 MB/s | 303 kB 00:00 2024-05-08T05:34:00.977 INFO:teuthology.orchestra.run.smithi151.stdout:(121/156): python3-google-auth-2.29.0-1.el9.noa 3.0 MB/s | 206 kB 00:00 2024-05-08T05:34:01.019 INFO:teuthology.orchestra.run.smithi151.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 3.4 MB/s | 144 kB 00:00 2024-05-08T05:34:01.069 INFO:teuthology.orchestra.run.smithi151.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 214 kB/s | 11 kB 00:00 2024-05-08T05:34:01.111 INFO:teuthology.orchestra.run.smithi151.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 423 kB/s | 18 kB 00:00 2024-05-08T05:34:01.153 INFO:teuthology.orchestra.run.smithi151.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 558 kB/s | 23 kB 00:00 2024-05-08T05:34:01.210 INFO:teuthology.orchestra.run.smithi151.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 343 kB/s | 19 kB 00:00 2024-05-08T05:34:01.254 INFO:teuthology.orchestra.run.smithi151.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 452 kB/s | 20 kB 00:00 2024-05-08T05:34:01.314 INFO:teuthology.orchestra.run.smithi082.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 36 kB/s | 35 kB 00:00 2024-05-08T05:34:01.389 INFO:teuthology.orchestra.run.smithi082.stdout:(81/156): python3-mako-1.1.4-6.el9.noarch.rpm 140 kB/s | 172 kB 00:01 2024-05-08T05:34:01.402 INFO:teuthology.orchestra.run.smithi134.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 221 kB/s | 250 kB 00:01 2024-05-08T05:34:01.438 INFO:teuthology.orchestra.run.smithi151.stdout:(128/156): python3-kubernetes-26.1.0-2.el9.noar 5.6 MB/s | 1.0 MB 00:00 2024-05-08T05:34:01.480 INFO:teuthology.orchestra.run.smithi151.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.1 MB/s | 46 kB 00:00 2024-05-08T05:34:01.486 INFO:teuthology.orchestra.run.smithi134.stdout:(83/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.1 MB/s | 5.1 MB 00:01 2024-05-08T05:34:01.513 INFO:teuthology.orchestra.run.smithi151.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-05-08T05:34:01.555 INFO:teuthology.orchestra.run.smithi151.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 1.4 MB/s | 58 kB 00:00 2024-05-08T05:34:01.614 INFO:teuthology.orchestra.run.smithi151.stdout:(132/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.0 MB/s | 2.0 MB 00:00 2024-05-08T05:34:01.656 INFO:teuthology.orchestra.run.smithi151.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 394 kB/s | 16 kB 00:00 2024-05-08T05:34:01.681 INFO:teuthology.orchestra.run.smithi151.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.1 MB/s | 272 kB 00:00 2024-05-08T05:34:01.706 INFO:teuthology.orchestra.run.smithi151.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-05-08T05:34:01.732 INFO:teuthology.orchestra.run.smithi151.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 561 kB/s | 28 kB 00:00 2024-05-08T05:34:01.757 INFO:teuthology.orchestra.run.smithi151.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-05-08T05:34:01.807 INFO:teuthology.orchestra.run.smithi151.stdout:(138/156): python3-routes-2.5.1-5.el9.noarch.rp 2.5 MB/s | 188 kB 00:00 2024-05-08T05:34:01.811 INFO:teuthology.orchestra.run.smithi134.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 197 kB/s | 222 kB 00:01 2024-05-08T05:34:01.832 INFO:teuthology.orchestra.run.smithi151.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 786 kB/s | 59 kB 00:00 2024-05-08T05:34:01.858 INFO:teuthology.orchestra.run.smithi151.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 716 kB/s | 36 kB 00:00 2024-05-08T05:34:01.883 INFO:teuthology.orchestra.run.smithi151.stdout:(141/156): python3-typing-extensions-4.4.0-2.el 1.0 MB/s | 51 kB 00:00 2024-05-08T05:34:01.925 INFO:teuthology.orchestra.run.smithi151.stdout:(142/156): python3-webob-1.8.7-6.el9.noarch.rpm 3.4 MB/s | 230 kB 00:00 2024-05-08T05:34:01.950 INFO:teuthology.orchestra.run.smithi151.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-05-08T05:34:02.026 INFO:teuthology.orchestra.run.smithi151.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 265 kB/s | 20 kB 00:00 2024-05-08T05:34:02.085 INFO:teuthology.orchestra.run.smithi151.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 2.6 MB/s | 427 kB 00:00 2024-05-08T05:34:02.118 INFO:teuthology.orchestra.run.smithi151.stdout:(146/156): re2-20211101-3.el9.x86_64.rpm 2.0 MB/s | 192 kB 00:00 2024-05-08T05:34:02.215 INFO:teuthology.orchestra.run.smithi082.stdout:(82/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 2.8 MB/s | 5.1 MB 00:01 2024-05-08T05:34:02.335 INFO:teuthology.orchestra.run.smithi151.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 6.3 MB/s | 1.6 MB 00:00 2024-05-08T05:34:02.354 INFO:teuthology.orchestra.run.smithi134.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 49 kB/s | 42 kB 00:00 2024-05-08T05:34:02.379 INFO:teuthology.orchestra.run.smithi134.stdout:(86/156): python3-packaging-20.9-5.el9.noarch.r 79 kB/s | 77 kB 00:00 2024-05-08T05:34:02.523 INFO:teuthology.orchestra.run.smithi082.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 207 kB/s | 250 kB 00:01 2024-05-08T05:34:02.624 INFO:teuthology.orchestra.run.smithi082.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 180 kB/s | 222 kB 00:01 2024-05-08T05:34:02.644 INFO:teuthology.orchestra.run.smithi151.stdout:(148/156): librados2-19.0.0-3538.gbee299f4.el9. 6.5 MB/s | 3.4 MB 00:00 2024-05-08T05:34:02.786 INFO:teuthology.orchestra.run.smithi151.stdout:(149/156): NetworkManager-1.47.5-1.el9.x86_64.r 16 MB/s | 2.3 MB 00:00 2024-05-08T05:34:02.919 INFO:teuthology.orchestra.run.smithi151.stdout:(150/156): NetworkManager-libnm-1.47.5-1.el9.x8 14 MB/s | 1.8 MB 00:00 2024-05-08T05:34:02.962 INFO:teuthology.orchestra.run.smithi134.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 240 kB/s | 269 kB 00:01 2024-05-08T05:34:02.978 INFO:teuthology.orchestra.run.smithi151.stdout:(151/156): NetworkManager-team-1.47.5-1.el9.x86 716 kB/s | 42 kB 00:00 2024-05-08T05:34:03.053 INFO:teuthology.orchestra.run.smithi151.stdout:(152/156): NetworkManager-tui-1.47.5-1.el9.x86_ 3.2 MB/s | 248 kB 00:00 2024-05-08T05:34:03.162 INFO:teuthology.orchestra.run.smithi151.stdout:(153/156): openssl-3.2.1-1.el9.x86_64.rpm 12 MB/s | 1.3 MB 00:00 2024-05-08T05:34:03.265 INFO:teuthology.orchestra.run.smithi082.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 74 kB/s | 77 kB 00:01 2024-05-08T05:34:03.312 INFO:teuthology.orchestra.run.smithi151.stdout:(154/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 16 MB/s | 2.4 MB 00:00 2024-05-08T05:34:03.429 INFO:teuthology.orchestra.run.smithi151.stdout:(155/156): librbd1-19.0.0-3538.gbee299f4.el9.x8 2.9 MB/s | 3.1 MB 00:01 2024-05-08T05:34:03.430 INFO:teuthology.orchestra.run.smithi134.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 148 kB/s | 159 kB 00:01 2024-05-08T05:34:03.491 INFO:teuthology.orchestra.run.smithi082.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 47 kB/s | 42 kB 00:00 2024-05-08T05:34:03.521 INFO:teuthology.orchestra.run.smithi134.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 244 kB/s | 279 kB 00:01 2024-05-08T05:34:03.805 INFO:teuthology.orchestra.run.smithi134.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 61 kB/s | 51 kB 00:00 2024-05-08T05:34:04.225 INFO:teuthology.orchestra.run.smithi082.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 168 kB/s | 269 kB 00:01 2024-05-08T05:34:04.297 INFO:teuthology.orchestra.run.smithi134.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 62 kB/s | 54 kB 00:00 2024-05-08T05:34:04.399 INFO:teuthology.orchestra.run.smithi082.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 140 kB/s | 159 kB 00:01 2024-05-08T05:34:04.638 INFO:teuthology.orchestra.run.smithi134.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 50 kB/s | 42 kB 00:00 2024-05-08T05:34:04.791 INFO:teuthology.orchestra.run.smithi082.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 215 kB/s | 279 kB 00:01 2024-05-08T05:34:05.217 INFO:teuthology.orchestra.run.smithi082.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 51 kB/s | 51 kB 00:00 2024-05-08T05:34:05.334 INFO:teuthology.orchestra.run.smithi082.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 57 kB/s | 54 kB 00:00 2024-05-08T05:34:05.597 INFO:teuthology.orchestra.run.smithi134.stdout:(93/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 7.8 MB/s | 16 MB 00:02 2024-05-08T05:34:05.764 INFO:teuthology.orchestra.run.smithi134.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 196 kB/s | 221 kB 00:01 2024-05-08T05:34:06.109 INFO:teuthology.orchestra.run.smithi082.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 47 kB/s | 42 kB 00:00 2024-05-08T05:34:06.231 INFO:teuthology.orchestra.run.smithi134.stdout:(95/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 23 kB/s | 44 kB 00:01 2024-05-08T05:34:06.276 INFO:teuthology.orchestra.run.smithi082.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 47 kB/s | 44 kB 00:00 2024-05-08T05:34:06.406 INFO:teuthology.orchestra.run.smithi134.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 44 kB/s | 36 kB 00:00 2024-05-08T05:34:06.631 INFO:teuthology.orchestra.run.smithi134.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 55 kB/s | 47 kB 00:00 2024-05-08T05:34:07.106 INFO:teuthology.orchestra.run.smithi082.stdout:(94/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 7.0 MB/s | 16 MB 00:02 2024-05-08T05:34:07.143 INFO:teuthology.orchestra.run.smithi082.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 41 kB/s | 36 kB 00:00 2024-05-08T05:34:07.278 INFO:teuthology.orchestra.run.smithi082.stdout:(96/156): qatlib-24.02.0-1.el9.x86_64.rpm 189 kB/s | 221 kB 00:01 2024-05-08T05:34:07.342 INFO:teuthology.orchestra.run.smithi134.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 62 kB/s | 58 kB 00:00 2024-05-08T05:34:07.590 INFO:teuthology.orchestra.run.smithi134.stdout:(99/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 98 kB/s | 94 kB 00:00 2024-05-08T05:34:08.010 INFO:teuthology.orchestra.run.smithi082.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 53 kB/s | 47 kB 00:00 2024-05-08T05:34:08.260 INFO:teuthology.orchestra.run.smithi082.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 59 kB/s | 58 kB 00:00 2024-05-08T05:34:08.427 INFO:teuthology.orchestra.run.smithi082.stdout:(99/156): socat-1.7.4.1-5.el9.x86_64.rpm 238 kB/s | 305 kB 00:01 2024-05-08T05:34:08.449 INFO:teuthology.orchestra.run.smithi134.stdout:(100/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 52 kB/s | 45 kB 00:00 2024-05-08T05:34:08.532 INFO:teuthology.orchestra.run.smithi134.stdout:(101/156): lua-devel-5.4.4-4.el9.x86_64.rpm 271 kB/s | 22 kB 00:00 2024-05-08T05:34:08.624 INFO:teuthology.orchestra.run.smithi134.stdout:(102/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 50 kB/s | 64 kB 00:01 2024-05-08T05:34:08.758 INFO:teuthology.orchestra.run.smithi134.stdout:(103/156): protobuf-compiler-3.14.0-13.el9.x86_ 3.7 MB/s | 863 kB 00:00 2024-05-08T05:34:08.808 INFO:teuthology.orchestra.run.smithi134.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 2.9 MB/s | 548 kB 00:00 2024-05-08T05:34:08.842 INFO:teuthology.orchestra.run.smithi134.stdout:(105/156): grpc-data-1.46.7-10.el9.noarch.rpm 588 kB/s | 19 kB 00:00 2024-05-08T05:34:08.917 INFO:teuthology.orchestra.run.smithi134.stdout:(106/156): gperftools-libs-2.9.1-2.el9.x86_64.r 1.9 MB/s | 309 kB 00:00 2024-05-08T05:34:08.951 INFO:teuthology.orchestra.run.smithi134.stdout:(107/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 776 kB/s | 26 kB 00:00 2024-05-08T05:34:08.984 INFO:teuthology.orchestra.run.smithi134.stdout:(108/156): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-05-08T05:34:09.051 INFO:teuthology.orchestra.run.smithi134.stdout:(109/156): libarrow-9.0.0-11.el9.x86_64.rpm 21 MB/s | 4.4 MB 00:00 2024-05-08T05:34:09.076 INFO:teuthology.orchestra.run.smithi134.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 732 kB/s | 67 kB 00:00 2024-05-08T05:34:09.086 INFO:teuthology.orchestra.run.smithi082.stdout:(100/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 87 kB/s | 94 kB 00:01 2024-05-08T05:34:09.102 INFO:teuthology.orchestra.run.smithi134.stdout:(111/156): luarocks-3.9.2-1.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-05-08T05:34:09.152 INFO:teuthology.orchestra.run.smithi134.stdout:(112/156): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-05-08T05:34:09.177 INFO:teuthology.orchestra.run.smithi134.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.2 MB/s | 839 kB 00:00 2024-05-08T05:34:09.202 INFO:teuthology.orchestra.run.smithi134.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 866 kB/s | 43 kB 00:00 2024-05-08T05:34:09.228 INFO:teuthology.orchestra.run.smithi134.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 640 kB/s | 32 kB 00:00 2024-05-08T05:34:09.253 INFO:teuthology.orchestra.run.smithi082.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 64 kB/s | 64 kB 00:00 2024-05-08T05:34:09.254 INFO:teuthology.orchestra.run.smithi134.stdout:(116/156): python3-certifi-2021.10.8-2.el9.noar 299 kB/s | 15 kB 00:00 2024-05-08T05:34:09.278 INFO:teuthology.orchestra.run.smithi134.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-05-08T05:34:09.312 INFO:teuthology.orchestra.run.smithi134.stdout:(118/156): python3-cherrypy-18.6.1-2.el9.noarch 5.9 MB/s | 358 kB 00:00 2024-05-08T05:34:09.338 INFO:teuthology.orchestra.run.smithi134.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-05-08T05:34:09.353 INFO:teuthology.orchestra.run.smithi082.stdout:(102/156): lua-devel-5.4.4-4.el9.x86_64.rpm 84 kB/s | 22 kB 00:00 2024-05-08T05:34:09.363 INFO:teuthology.orchestra.run.smithi134.stdout:(120/156): python3-colorama-0.4.4-12.el9.noarch 705 kB/s | 35 kB 00:00 2024-05-08T05:34:09.388 INFO:teuthology.orchestra.run.smithi134.stdout:(121/156): python3-google-auth-2.29.0-1.el9.noa 4.0 MB/s | 206 kB 00:00 2024-05-08T05:34:09.430 INFO:teuthology.orchestra.run.smithi134.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 3.4 MB/s | 144 kB 00:00 2024-05-08T05:34:09.472 INFO:teuthology.orchestra.run.smithi134.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 256 kB/s | 11 kB 00:00 2024-05-08T05:34:09.539 INFO:teuthology.orchestra.run.smithi134.stdout:(124/156): python3-grpcio-1.46.7-10.el9.x86_64. 12 MB/s | 2.0 MB 00:00 2024-05-08T05:34:09.564 INFO:teuthology.orchestra.run.smithi134.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 193 kB/s | 18 kB 00:00 2024-05-08T05:34:09.589 INFO:teuthology.orchestra.run.smithi134.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 463 kB/s | 23 kB 00:00 2024-05-08T05:34:09.615 INFO:teuthology.orchestra.run.smithi134.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-05-08T05:34:09.640 INFO:teuthology.orchestra.run.smithi134.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-05-08T05:34:09.682 INFO:teuthology.orchestra.run.smithi134.stdout:(129/156): python3-kubernetes-26.1.0-2.el9.noar 15 MB/s | 1.0 MB 00:00 2024-05-08T05:34:09.712 INFO:teuthology.orchestra.run.smithi082.stdout:(103/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 35 kB/s | 45 kB 00:01 2024-05-08T05:34:09.732 INFO:teuthology.orchestra.run.smithi134.stdout:(130/156): python3-logutils-0.3.5-21.el9.noarch 504 kB/s | 46 kB 00:00 2024-05-08T05:34:09.757 INFO:teuthology.orchestra.run.smithi134.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 1.6 MB/s | 79 kB 00:00 2024-05-08T05:34:09.782 INFO:teuthology.orchestra.run.smithi134.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-05-08T05:34:09.808 INFO:teuthology.orchestra.run.smithi134.stdout:(133/156): python3-pecan-1.4.2-3.el9.noarch.rpm 5.3 MB/s | 272 kB 00:00 2024-05-08T05:34:09.825 INFO:teuthology.orchestra.run.smithi134.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 392 kB/s | 16 kB 00:00 2024-05-08T05:34:09.850 INFO:teuthology.orchestra.run.smithi134.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.2 MB/s | 90 kB 00:00 2024-05-08T05:34:09.867 INFO:teuthology.orchestra.run.smithi134.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 672 kB/s | 28 kB 00:00 2024-05-08T05:34:09.884 INFO:teuthology.orchestra.run.smithi134.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 919 kB/s | 31 kB 00:00 2024-05-08T05:34:09.926 INFO:teuthology.orchestra.run.smithi134.stdout:(138/156): python3-routes-2.5.1-5.el9.noarch.rp 3.1 MB/s | 188 kB 00:00 2024-05-08T05:34:09.943 INFO:teuthology.orchestra.run.smithi134.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-05-08T05:34:09.960 INFO:teuthology.orchestra.run.smithi134.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 1.0 MB/s | 36 kB 00:00 2024-05-08T05:34:09.976 INFO:teuthology.orchestra.run.smithi134.stdout:(141/156): python3-typing-extensions-4.4.0-2.el 1.5 MB/s | 51 kB 00:00 2024-05-08T05:34:10.002 INFO:teuthology.orchestra.run.smithi134.stdout:(142/156): python3-webob-1.8.7-6.el9.noarch.rpm 5.4 MB/s | 230 kB 00:00 2024-05-08T05:34:10.027 INFO:teuthology.orchestra.run.smithi134.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-05-08T05:34:10.052 INFO:teuthology.orchestra.run.smithi134.stdout:(144/156): python3-werkzeug-2.0.3-3.el9.1.noarc 8.3 MB/s | 427 kB 00:00 2024-05-08T05:34:10.078 INFO:teuthology.orchestra.run.smithi134.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 398 kB/s | 20 kB 00:00 2024-05-08T05:34:10.103 INFO:teuthology.orchestra.run.smithi134.stdout:(146/156): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2024-05-08T05:34:10.112 INFO:teuthology.orchestra.run.smithi082.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 723 kB/s | 548 kB 00:00 2024-05-08T05:34:10.145 INFO:teuthology.orchestra.run.smithi134.stdout:(147/156): thrift-0.15.0-2.el9.x86_64.rpm 24 MB/s | 1.6 MB 00:00 2024-05-08T05:34:10.154 INFO:teuthology.orchestra.run.smithi082.stdout:(105/156): protobuf-compiler-3.14.0-13.el9.x86_ 960 kB/s | 863 kB 00:00 2024-05-08T05:34:10.212 INFO:teuthology.orchestra.run.smithi082.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 195 kB/s | 19 kB 00:00 2024-05-08T05:34:10.329 INFO:teuthology.orchestra.run.smithi082.stdout:(107/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 224 kB/s | 26 kB 00:00 2024-05-08T05:34:10.379 INFO:teuthology.orchestra.run.smithi082.stdout:(108/156): gperftools-libs-2.9.1-2.el9.x86_64.r 463 kB/s | 309 kB 00:00 2024-05-08T05:34:10.430 INFO:teuthology.orchestra.run.smithi082.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 487 kB/s | 49 kB 00:00 2024-05-08T05:34:10.488 INFO:teuthology.orchestra.run.smithi082.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 639 kB/s | 67 kB 00:00 2024-05-08T05:34:10.512 INFO:teuthology.orchestra.run.smithi134.stdout:(148/156): socat-1.7.4.1-5.el9.x86_64.rpm 71 kB/s | 305 kB 00:04 2024-05-08T05:34:10.547 INFO:teuthology.orchestra.run.smithi082.stdout:(111/156): luarocks-3.9.2-1.el9.noarch.rpm 1.3 MB/s | 151 kB 00:00 2024-05-08T05:34:10.714 INFO:teuthology.orchestra.run.smithi082.stdout:(112/156): python3-asyncssh-2.13.2-5.el9.noarch 3.2 MB/s | 548 kB 00:00 2024-05-08T05:34:10.756 INFO:teuthology.orchestra.run.smithi082.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.1 MB/s | 839 kB 00:00 2024-05-08T05:34:10.806 INFO:teuthology.orchestra.run.smithi082.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 477 kB/s | 43 kB 00:00 2024-05-08T05:34:10.821 INFO:teuthology.orchestra.run.smithi134.stdout:(149/156): NetworkManager-1.47.5-1.el9.x86_64.r 7.5 MB/s | 2.3 MB 00:00 2024-05-08T05:34:10.856 INFO:teuthology.orchestra.run.smithi082.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 323 kB/s | 32 kB 00:00 2024-05-08T05:34:10.915 INFO:teuthology.orchestra.run.smithi082.stdout:(116/156): python3-certifi-2021.10.8-2.el9.noar 139 kB/s | 15 kB 00:00 2024-05-08T05:34:10.963 INFO:teuthology.orchestra.run.smithi134.stdout:(150/156): NetworkManager-libnm-1.47.5-1.el9.x8 13 MB/s | 1.8 MB 00:00 2024-05-08T05:34:10.974 INFO:teuthology.orchestra.run.smithi082.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 1.4 MB/s | 172 kB 00:00 2024-05-08T05:34:11.013 INFO:teuthology.orchestra.run.smithi134.stdout:(151/156): NetworkManager-team-1.47.5-1.el9.x86 839 kB/s | 42 kB 00:00 2024-05-08T05:34:11.049 INFO:teuthology.orchestra.run.smithi082.stdout:(118/156): python3-cherrypy-18.6.1-2.el9.noarch 2.6 MB/s | 358 kB 00:00 2024-05-08T05:34:11.071 INFO:teuthology.orchestra.run.smithi134.stdout:(152/156): NetworkManager-tui-1.47.5-1.el9.x86_ 4.2 MB/s | 248 kB 00:00 2024-05-08T05:34:11.091 INFO:teuthology.orchestra.run.smithi082.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.6 MB/s | 303 kB 00:00 2024-05-08T05:34:11.172 INFO:teuthology.orchestra.run.smithi134.stdout:(153/156): openssl-3.2.1-1.el9.x86_64.rpm 13 MB/s | 1.3 MB 00:00 2024-05-08T05:34:11.208 INFO:teuthology.orchestra.run.smithi082.stdout:(120/156): libarrow-9.0.0-11.el9.x86_64.rpm 4.2 MB/s | 4.4 MB 00:01 2024-05-08T05:34:11.233 INFO:teuthology.orchestra.run.smithi082.stdout:(121/156): python3-colorama-0.4.4-12.el9.noarch 192 kB/s | 35 kB 00:00 2024-05-08T05:34:11.267 INFO:teuthology.orchestra.run.smithi082.stdout:(122/156): python3-google-auth-2.29.0-1.el9.noa 1.1 MB/s | 206 kB 00:00 2024-05-08T05:34:11.322 INFO:teuthology.orchestra.run.smithi134.stdout:(154/156): librados2-19.0.0-3538.gbee299f4.el9. 2.8 MB/s | 3.4 MB 00:01 2024-05-08T05:34:11.350 INFO:teuthology.orchestra.run.smithi082.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 1.2 MB/s | 144 kB 00:00 2024-05-08T05:34:11.364 INFO:teuthology.orchestra.run.smithi134.stdout:(155/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 12 MB/s | 2.4 MB 00:00 2024-05-08T05:34:11.376 INFO:teuthology.orchestra.run.smithi082.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 99 kB/s | 11 kB 00:00 2024-05-08T05:34:11.442 INFO:teuthology.orchestra.run.smithi082.stdout:(125/156): python3-grpcio-1.46.7-10.el9.x86_64. 8.7 MB/s | 2.0 MB 00:00 2024-05-08T05:34:11.468 INFO:teuthology.orchestra.run.smithi082.stdout:(126/156): python3-jaraco-classes-3.2.1-5.el9.n 152 kB/s | 18 kB 00:00 2024-05-08T05:34:11.493 INFO:teuthology.orchestra.run.smithi082.stdout:(127/156): python3-jaraco-collections-3.0.0-8.e 198 kB/s | 23 kB 00:00 2024-05-08T05:34:11.560 INFO:teuthology.orchestra.run.smithi082.stdout:(128/156): python3-jaraco-functools-3.5.0-2.el9 166 kB/s | 19 kB 00:00 2024-05-08T05:34:11.586 INFO:teuthology.orchestra.run.smithi082.stdout:(129/156): python3-jaraco-text-3.2.0-6.el9.noar 168 kB/s | 20 kB 00:00 2024-05-08T05:34:11.669 INFO:teuthology.orchestra.run.smithi082.stdout:(130/156): python3-kubernetes-26.1.0-2.el9.noar 5.8 MB/s | 1.0 MB 00:00 2024-05-08T05:34:11.694 INFO:teuthology.orchestra.run.smithi082.stdout:(131/156): python3-logutils-0.3.5-21.el9.noarch 348 kB/s | 46 kB 00:00 2024-05-08T05:34:11.720 INFO:teuthology.orchestra.run.smithi082.stdout:(132/156): python3-more-itertools-8.12.0-2.el9. 592 kB/s | 79 kB 00:00 2024-05-08T05:34:11.770 INFO:teuthology.orchestra.run.smithi082.stdout:(133/156): python3-natsort-7.1.1-5.el9.noarch.r 579 kB/s | 58 kB 00:00 2024-05-08T05:34:11.803 INFO:teuthology.orchestra.run.smithi082.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.5 MB/s | 272 kB 00:00 2024-05-08T05:34:11.829 INFO:teuthology.orchestra.run.smithi082.stdout:(135/156): python3-portend-3.1.0-2.el9.noarch.r 151 kB/s | 16 kB 00:00 2024-05-08T05:34:11.887 INFO:teuthology.orchestra.run.smithi082.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 773 kB/s | 90 kB 00:00 2024-05-08T05:34:11.912 INFO:teuthology.orchestra.run.smithi082.stdout:(137/156): python3-pyperclip-1.8.2-2.el9.noarch 261 kB/s | 28 kB 00:00 2024-05-08T05:34:11.938 INFO:teuthology.orchestra.run.smithi082.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 284 kB/s | 31 kB 00:00 2024-05-08T05:34:12.005 INFO:teuthology.orchestra.run.smithi082.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2024-05-08T05:34:12.030 INFO:teuthology.orchestra.run.smithi082.stdout:(140/156): python3-rsa-4.9-2.el9.noarch.rpm 508 kB/s | 59 kB 00:00 2024-05-08T05:34:12.055 INFO:teuthology.orchestra.run.smithi082.stdout:(141/156): python3-tempora-5.0.0-2.el9.noarch.r 307 kB/s | 36 kB 00:00 2024-05-08T05:34:12.056 INFO:teuthology.orchestra.run.smithi134.stdout:(156/156): librbd1-19.0.0-3538.gbee299f4.el9.x8 1.6 MB/s | 3.1 MB 00:01 2024-05-08T05:34:12.058 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-05-08T05:34:12.059 INFO:teuthology.orchestra.run.smithi134.stdout:Total 5.2 MB/s | 226 MB 00:43 2024-05-08T05:34:12.106 INFO:teuthology.orchestra.run.smithi082.stdout:(142/156): python3-typing-extensions-4.4.0-2.el 509 kB/s | 51 kB 00:00 2024-05-08T05:34:12.148 INFO:teuthology.orchestra.run.smithi082.stdout:(143/156): python3-webob-1.8.7-6.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-05-08T05:34:12.189 INFO:teuthology.orchestra.run.smithi082.stdout:(144/156): python3-websocket-client-1.2.3-2.el9 671 kB/s | 90 kB 00:00 2024-05-08T05:34:12.231 INFO:teuthology.orchestra.run.smithi082.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-05-08T05:34:12.257 INFO:teuthology.orchestra.run.smithi082.stdout:(146/156): python3-zc-lockfile-2.0-10.el9.noarc 185 kB/s | 20 kB 00:00 2024-05-08T05:34:12.307 INFO:teuthology.orchestra.run.smithi082.stdout:(147/156): re2-20211101-3.el9.x86_64.rpm 1.6 MB/s | 192 kB 00:00 2024-05-08T05:34:12.432 INFO:teuthology.orchestra.run.smithi082.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 7.9 MB/s | 1.6 MB 00:00 2024-05-08T05:34:12.891 INFO:teuthology.orchestra.run.smithi082.stdout:(149/156): NetworkManager-1.47.5-1.el9.x86_64.r 5.0 MB/s | 2.3 MB 00:00 2024-05-08T05:34:12.966 INFO:teuthology.orchestra.run.smithi082.stdout:(150/156): librbd1-19.0.0-3538.gbee299f4.el9.x8 4.8 MB/s | 3.1 MB 00:00 2024-05-08T05:34:13.108 INFO:teuthology.orchestra.run.smithi082.stdout:(151/156): NetworkManager-team-1.47.5-1.el9.x86 296 kB/s | 42 kB 00:00 2024-05-08T05:34:13.167 INFO:teuthology.orchestra.run.smithi082.stdout:(152/156): NetworkManager-libnm-1.47.5-1.el9.x8 6.7 MB/s | 1.8 MB 00:00 2024-05-08T05:34:13.195 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-05-08T05:34:13.258 INFO:teuthology.orchestra.run.smithi082.stdout:(153/156): librados2-19.0.0-3538.gbee299f4.el9. 3.4 MB/s | 3.4 MB 00:01 2024-05-08T05:34:13.326 INFO:teuthology.orchestra.run.smithi082.stdout:(154/156): NetworkManager-tui-1.47.5-1.el9.x86_ 1.1 MB/s | 248 kB 00:00 2024-05-08T05:34:13.346 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-05-08T05:34:13.346 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-05-08T05:34:13.376 INFO:teuthology.orchestra.run.smithi082.stdout:(155/156): openssl-3.2.1-1.el9.x86_64.rpm 6.5 MB/s | 1.3 MB 00:00 2024-05-08T05:34:13.692 INFO:teuthology.orchestra.run.smithi082.stdout:(156/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 5.5 MB/s | 2.4 MB 00:00 2024-05-08T05:34:13.700 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-05-08T05:34:13.700 INFO:teuthology.orchestra.run.smithi082.stdout:Total 4.8 MB/s | 226 MB 00:46 2024-05-08T05:34:15.343 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-05-08T05:34:15.343 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-05-08T05:34:16.687 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction check 2024-05-08T05:34:16.931 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction check succeeded. 2024-05-08T05:34:16.932 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction test 2024-05-08T05:34:17.745 INFO:teuthology.orchestra.run.smithi151.stdout:(156/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 770 kB/s | 16 MB 00:21 2024-05-08T05:34:17.748 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2024-05-08T05:34:17.748 INFO:teuthology.orchestra.run.smithi151.stdout:Total 4.6 MB/s | 226 MB 00:49 2024-05-08T05:34:18.944 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2024-05-08T05:34:19.097 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2024-05-08T05:34:19.097 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2024-05-08T05:34:19.497 INFO:teuthology.orchestra.run.smithi082.stdout:Transaction test succeeded. 2024-05-08T05:34:19.497 INFO:teuthology.orchestra.run.smithi082.stdout:Running transaction 2024-05-08T05:34:20.912 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2024-05-08T05:34:20.912 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2024-05-08T05:34:21.461 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-05-08T05:34:21.534 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-08T05:34:21.573 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-08T05:34:21.626 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-08T05:34:21.660 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-08T05:34:21.694 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-08T05:34:21.737 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-08T05:34:22.055 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-08T05:34:22.154 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : librados2-2:19.0.0-3538.gbee299f4.el9.x86_64 8/164 2024-05-08T05:34:22.266 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados2-2:19.0.0-3538.gbee299f4.el9.x86_64 8/164 2024-05-08T05:34:22.322 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephfs2-2:19.0.0-3538.gbee299f4.el9.x86_64 9/164 2024-05-08T05:34:22.395 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephfs2-2:19.0.0-3538.gbee299f4.el9.x86_64 9/164 2024-05-08T05:34:22.425 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rados-2:19.0.0-3538.gbee299f4.el9.x86_64 10/164 2024-05-08T05:34:22.571 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-08T05:34:22.622 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-08T05:34:22.650 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephsqlite-2:19.0.0-3538.gbee299f4.el9.x86_64 13/164 2024-05-08T05:34:22.753 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3538.gbee299f4.el9.x86_64 13/164 2024-05-08T05:34:22.776 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libradosstriper1-2:19.0.0-3538.gbee299f4.el9.x86 14/164 2024-05-08T05:34:22.839 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3538.gbee299f4.el9.x86 14/164 2024-05-08T05:34:22.861 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-08T05:34:22.880 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-08T05:34:23.044 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-08T05:34:23.210 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-08T05:34:23.476 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-08T05:34:23.535 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-08T05:34:23.647 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-08T05:34:23.728 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-08T05:34:23.920 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-08T05:34:24.024 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-08T05:34:24.057 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-08T05:34:24.121 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/164 2024-05-08T05:34:24.190 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/164 2024-05-08T05:34:24.225 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/164 2024-05-08T05:34:24.268 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/164 2024-05-08T05:34:24.301 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/164 2024-05-08T05:34:24.328 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/164 2024-05-08T05:34:24.397 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/164 2024-05-08T05:34:24.450 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/164 2024-05-08T05:34:24.482 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/164 2024-05-08T05:34:24.517 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/164 2024-05-08T05:34:24.584 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/164 2024-05-08T05:34:24.619 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ceph-common-2:19.0.0-3538.gbee299f4.el9. 32/164 2024-05-08T05:34:24.662 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ceph-argparse-2:19.0.0-3538.gbee299f4.el 33/164 2024-05-08T05:34:24.691 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cephfs-2:19.0.0-3538.gbee299f4.el9.x86_6 34/164 2024-05-08T05:34:24.761 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/164 2024-05-08T05:34:24.806 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : luarocks-3.9.2-1.el9.noarch 36/164 2024-05-08T05:34:24.881 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/164 2024-05-08T05:34:25.012 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/164 2024-05-08T05:34:25.059 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/164 2024-05-08T05:34:25.581 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/164 2024-05-08T05:34:25.663 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/164 2024-05-08T05:34:25.691 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/164 2024-05-08T05:34:25.734 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/164 2024-05-08T05:34:25.772 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librados-devel-2:19.0.0-3538.gbee299f4.el9.x86_6 44/164 2024-05-08T05:34:25.814 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/164 2024-05-08T05:34:25.958 INFO:teuthology.orchestra.run.smithi082.stdout: Preparing : 1/1 2024-05-08T05:34:25.964 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/164 2024-05-08T05:34:26.017 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/164 2024-05-08T05:34:26.048 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-08T05:34:26.108 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/164 2024-05-08T05:34:26.121 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-08T05:34:26.164 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 49/164 2024-05-08T05:34:26.219 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-08T05:34:26.236 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-08T05:34:26.268 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-08T05:34:26.292 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-08T05:34:26.304 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-08T05:34:26.325 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-08T05:34:26.352 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-08T05:34:26.387 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-08T05:34:26.418 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-08T05:34:26.430 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-08T05:34:26.472 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-08T05:34:26.609 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-08T05:34:26.661 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-08T05:34:26.691 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-08T05:34:26.732 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-08T05:34:26.827 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-08T05:34:26.843 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-08T05:34:26.867 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-08T05:34:26.906 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-08T05:34:26.932 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-08T05:34:26.957 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-08T05:34:26.964 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : librados2-2:19.0.0-3538.gbee299f4.el9.x86_64 8/164 2024-05-08T05:34:27.015 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2024-05-08T05:34:27.031 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-08T05:34:27.099 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-08T05:34:27.137 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-08T05:34:27.151 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librados2-2:19.0.0-3538.gbee299f4.el9.x86_64 8/164 2024-05-08T05:34:27.158 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-08T05:34:27.183 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephfs2-2:19.0.0-3538.gbee299f4.el9.x86_64 9/164 2024-05-08T05:34:27.189 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-08T05:34:27.190 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-08T05:34:27.217 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-08T05:34:27.232 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-08T05:34:27.251 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-08T05:34:27.258 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-08T05:34:27.291 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-08T05:34:27.301 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-08T05:34:27.313 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libcephfs2-2:19.0.0-3538.gbee299f4.el9.x86_64 9/164 2024-05-08T05:34:27.321 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-08T05:34:27.352 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-08T05:34:27.357 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rados-2:19.0.0-3538.gbee299f4.el9.x86_64 10/164 2024-05-08T05:34:27.386 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-08T05:34:27.420 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-08T05:34:27.469 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-08T05:34:27.504 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-08T05:34:27.590 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-08T05:34:27.621 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-08T05:34:27.634 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-08T05:34:27.660 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-08T05:34:27.665 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-08T05:34:27.712 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-08T05:34:27.735 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-08T05:34:27.759 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : librados2-2:19.0.0-3538.gbee299f4.el9.x86_64 8/164 2024-05-08T05:34:27.761 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephsqlite-2:19.0.0-3538.gbee299f4.el9.x86_64 13/164 2024-05-08T05:34:27.811 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-08T05:34:27.866 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-08T05:34:27.873 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librados2-2:19.0.0-3538.gbee299f4.el9.x86_64 8/164 2024-05-08T05:34:27.902 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephfs2-2:19.0.0-3538.gbee299f4.el9.x86_64 9/164 2024-05-08T05:34:27.912 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3538.gbee299f4.el9.x86_64 13/164 2024-05-08T05:34:27.937 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libradosstriper1-2:19.0.0-3538.gbee299f4.el9.x86 14/164 2024-05-08T05:34:27.992 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libcephfs2-2:19.0.0-3538.gbee299f4.el9.x86_64 9/164 2024-05-08T05:34:28.024 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3538.gbee299f4.el9.x86 14/164 2024-05-08T05:34:28.024 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rados-2:19.0.0-3538.gbee299f4.el9.x86_64 10/164 2024-05-08T05:34:28.055 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-08T05:34:28.128 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-08T05:34:28.173 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-08T05:34:28.220 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-08T05:34:28.248 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephsqlite-2:19.0.0-3538.gbee299f4.el9.x86_64 13/164 2024-05-08T05:34:28.352 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3538.gbee299f4.el9.x86_64 13/164 2024-05-08T05:34:28.374 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libradosstriper1-2:19.0.0-3538.gbee299f4.el9.x86 14/164 2024-05-08T05:34:28.434 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-08T05:34:28.437 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3538.gbee299f4.el9.x86 14/164 2024-05-08T05:34:28.459 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-08T05:34:28.480 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-08T05:34:28.586 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-08T05:34:28.630 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-08T05:34:28.664 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-08T05:34:28.666 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-08T05:34:28.740 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-08T05:34:28.761 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-08T05:34:28.798 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-08T05:34:28.813 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-08T05:34:28.902 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-08T05:34:28.932 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-08T05:34:28.939 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-08T05:34:28.940 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-08T05:34:29.000 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-08T05:34:29.024 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 17/164 2024-05-08T05:34:29.107 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-08T05:34:29.117 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-08T05:34:29.147 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-08T05:34:29.193 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-08T05:34:29.199 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-08T05:34:29.224 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-08T05:34:29.348 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-08T05:34:29.386 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-08T05:34:29.498 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-08T05:34:29.530 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-08T05:34:29.565 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/164 2024-05-08T05:34:29.637 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/164 2024-05-08T05:34:29.670 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: NetworkManager-1:1.47.5-1.el9.x86_64 18/164 2024-05-08T05:34:29.672 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/164 2024-05-08T05:34:29.716 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/164 2024-05-08T05:34:29.749 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/164 2024-05-08T05:34:29.777 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/164 2024-05-08T05:34:29.845 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/164 2024-05-08T05:34:29.857 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-08T05:34:29.889 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-08T05:34:29.897 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-08T05:34:29.899 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/164 2024-05-08T05:34:29.930 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/164 2024-05-08T05:34:29.945 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/164 2024-05-08T05:34:29.965 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/164 2024-05-08T05:34:29.996 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-08T05:34:30.040 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/164 2024-05-08T05:34:30.050 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/164 2024-05-08T05:34:30.075 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-ceph-common-2:19.0.0-3538.gbee299f4.el9. 32/164 2024-05-08T05:34:30.107 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/164 2024-05-08T05:34:30.119 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-ceph-argparse-2:19.0.0-3538.gbee299f4.el 33/164 2024-05-08T05:34:30.139 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cephfs-2:19.0.0-3538.gbee299f4.el9.x86_6 34/164 2024-05-08T05:34:30.209 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/164 2024-05-08T05:34:30.254 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : luarocks-3.9.2-1.el9.noarch 36/164 2024-05-08T05:34:30.260 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/164 2024-05-08T05:34:30.328 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/164 2024-05-08T05:34:30.470 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/164 2024-05-08T05:34:30.523 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/164 2024-05-08T05:34:30.546 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/164 2024-05-08T05:34:30.599 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/164 2024-05-08T05:34:30.709 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/164 2024-05-08T05:34:30.771 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/164 2024-05-08T05:34:30.803 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/164 2024-05-08T05:34:30.867 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/164 2024-05-08T05:34:30.974 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/164 2024-05-08T05:34:31.015 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ceph-common-2:19.0.0-3538.gbee299f4.el9. 32/164 2024-05-08T05:34:31.052 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/164 2024-05-08T05:34:31.073 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ceph-argparse-2:19.0.0-3538.gbee299f4.el 33/164 2024-05-08T05:34:31.105 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cephfs-2:19.0.0-3538.gbee299f4.el9.x86_6 34/164 2024-05-08T05:34:31.135 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/164 2024-05-08T05:34:31.164 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/164 2024-05-08T05:34:31.207 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/164 2024-05-08T05:34:31.213 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-08T05:34:31.220 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/164 2024-05-08T05:34:31.245 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librados-devel-2:19.0.0-3538.gbee299f4.el9.x86_6 44/164 2024-05-08T05:34:31.285 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : luarocks-3.9.2-1.el9.noarch 36/164 2024-05-08T05:34:31.286 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-08T05:34:31.287 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/164 2024-05-08T05:34:31.314 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-08T05:34:31.347 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-08T05:34:31.394 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/164 2024-05-08T05:34:31.440 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/164 2024-05-08T05:34:31.500 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/164 2024-05-08T05:34:31.571 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/164 2024-05-08T05:34:31.615 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/164 2024-05-08T05:34:31.637 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/164 2024-05-08T05:34:31.660 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-08T05:34:31.672 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 49/164 2024-05-08T05:34:31.702 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : librbd1-2:19.0.0-3538.gbee299f4.el9.x86_64 101/164 2024-05-08T05:34:31.745 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-08T05:34:31.776 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librbd1-2:19.0.0-3538.gbee299f4.el9.x86_64 101/164 2024-05-08T05:34:31.776 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-08T05:34:31.807 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rbd-2:19.0.0-3538.gbee299f4.el9.x86_64 102/164 2024-05-08T05:34:31.813 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-08T05:34:31.851 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-08T05:34:31.860 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-08T05:34:31.895 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-08T05:34:31.938 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-08T05:34:31.981 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-08T05:34:32.116 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-08T05:34:32.161 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-08T05:34:32.191 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-08T05:34:32.232 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-08T05:34:32.323 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/164 2024-05-08T05:34:32.326 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-08T05:34:32.333 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-08T05:34:32.355 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librgw2-2:19.0.0-3538.gbee299f4.el9.x86_64 105/164 2024-05-08T05:34:32.366 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-08T05:34:32.405 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-08T05:34:32.425 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/164 2024-05-08T05:34:32.426 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librgw2-2:19.0.0-3538.gbee299f4.el9.x86_64 105/164 2024-05-08T05:34:32.431 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-08T05:34:32.449 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rgw-2:19.0.0-3538.gbee299f4.el9.x86_64 106/164 2024-05-08T05:34:32.457 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-08T05:34:32.470 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/164 2024-05-08T05:34:32.522 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/164 2024-05-08T05:34:32.531 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-08T05:34:32.565 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librados-devel-2:19.0.0-3538.gbee299f4.el9.x86_6 44/164 2024-05-08T05:34:32.627 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/164 2024-05-08T05:34:32.657 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-08T05:34:32.696 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-08T05:34:32.724 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-08T05:34:32.758 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-08T05:34:32.797 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-08T05:34:32.829 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-08T05:34:32.832 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/164 2024-05-08T05:34:32.859 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-08T05:34:32.893 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-08T05:34:32.905 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/164 2024-05-08T05:34:32.926 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-08T05:34:32.976 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-08T05:34:33.010 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-08T05:34:33.015 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/164 2024-05-08T05:34:33.091 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 49/164 2024-05-08T05:34:33.097 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-08T05:34:33.141 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-08T05:34:33.172 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-08T05:34:33.174 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-08T05:34:33.214 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-08T05:34:33.218 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-08T05:34:33.252 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-08T05:34:33.316 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-08T05:34:33.318 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-08T05:34:33.360 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-08T05:34:33.381 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-08T05:34:33.423 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-08T05:34:33.482 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-08T05:34:33.688 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-08T05:34:33.752 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-08T05:34:33.789 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-08T05:34:33.846 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-08T05:34:33.975 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-08T05:34:34.022 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-08T05:34:34.071 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-08T05:34:34.098 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-08T05:34:34.104 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-08T05:34:34.145 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-08T05:34:34.154 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-08T05:34:34.187 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-08T05:34:34.286 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-08T05:34:34.350 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-08T05:34:34.352 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-08T05:34:34.432 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-08T05:34:34.472 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-08T05:34:34.532 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-08T05:34:34.585 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-08T05:34:34.624 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-08T05:34:34.651 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-08T05:34:34.670 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-08T05:34:34.678 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-08T05:34:34.728 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-08T05:34:34.756 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-08T05:34:34.802 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-08T05:34:34.804 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-common-2:19.0.0-3538.gbee299f4.el9.x86_64 107/164 2024-05-08T05:34:34.846 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-common-2:19.0.0-3538.gbee299f4.el9.x86_64 107/164 2024-05-08T05:34:34.856 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-08T05:34:34.904 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-08T05:34:34.953 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-08T05:34:35.029 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-08T05:34:35.075 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-08T05:34:35.213 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-08T05:34:35.279 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-08T05:34:35.323 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-08T05:34:35.389 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-common-2:19.0.0-3538.gbee299f4.el9.x86_64 107/164 2024-05-08T05:34:35.394 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-08T05:34:35.399 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-08T05:34:35.425 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-base-2:19.0.0-3538.gbee299f4.el9.x86_64 108/164 2024-05-08T05:34:35.515 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-base-2:19.0.0-3538.gbee299f4.el9.x86_64 108/164 2024-05-08T05:34:35.515 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-08T05:34:35.515 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-08T05:34:35.515 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-08T05:34:35.517 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-08T05:34:35.543 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-selinux-2:19.0.0-3538.gbee299f4.el9.x86_64 109/164 2024-05-08T05:34:35.560 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-08T05:34:35.627 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-08T05:34:36.553 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-08T05:34:36.610 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-08T05:34:36.643 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-08T05:34:36.742 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-08T05:34:36.791 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-08T05:34:36.823 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-08T05:34:36.850 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-08T05:34:36.855 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-08T05:34:36.884 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-08T05:34:36.955 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-08T05:34:36.995 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-08T05:34:37.197 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-08T05:34:37.221 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-08T05:34:37.238 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : librbd1-2:19.0.0-3538.gbee299f4.el9.x86_64 101/164 2024-05-08T05:34:37.250 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-08T05:34:37.329 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librbd1-2:19.0.0-3538.gbee299f4.el9.x86_64 101/164 2024-05-08T05:34:37.352 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-08T05:34:37.359 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rbd-2:19.0.0-3538.gbee299f4.el9.x86_64 102/164 2024-05-08T05:34:37.395 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-08T05:34:37.878 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-08T05:34:37.908 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librgw2-2:19.0.0-3538.gbee299f4.el9.x86_64 105/164 2024-05-08T05:34:37.962 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librgw2-2:19.0.0-3538.gbee299f4.el9.x86_64 105/164 2024-05-08T05:34:37.992 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rgw-2:19.0.0-3538.gbee299f4.el9.x86_64 106/164 2024-05-08T05:34:38.197 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-08T05:34:38.340 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-08T05:34:39.936 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-08T05:34:40.050 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-08T05:34:40.086 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-08T05:34:40.129 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-08T05:34:40.280 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-common-2:19.0.0-3538.gbee299f4.el9.x86_64 107/164 2024-05-08T05:34:40.315 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-common-2:19.0.0-3538.gbee299f4.el9.x86_64 107/164 2024-05-08T05:34:40.506 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-08T05:34:40.569 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : librbd1-2:19.0.0-3538.gbee299f4.el9.x86_64 101/164 2024-05-08T05:34:40.692 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librbd1-2:19.0.0-3538.gbee299f4.el9.x86_64 101/164 2024-05-08T05:34:40.726 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rbd-2:19.0.0-3538.gbee299f4.el9.x86_64 102/164 2024-05-08T05:34:40.784 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-08T05:34:40.860 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-common-2:19.0.0-3538.gbee299f4.el9.x86_64 107/164 2024-05-08T05:34:40.893 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-base-2:19.0.0-3538.gbee299f4.el9.x86_64 108/164 2024-05-08T05:34:40.988 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-base-2:19.0.0-3538.gbee299f4.el9.x86_64 108/164 2024-05-08T05:34:40.988 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-08T05:34:40.988 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-08T05:34:40.988 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-08T05:34:41.020 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-selinux-2:19.0.0-3538.gbee299f4.el9.x86_64 109/164 2024-05-08T05:34:41.322 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-08T05:34:41.355 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : librgw2-2:19.0.0-3538.gbee299f4.el9.x86_64 105/164 2024-05-08T05:34:41.446 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librgw2-2:19.0.0-3538.gbee299f4.el9.x86_64 105/164 2024-05-08T05:34:41.473 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-rgw-2:19.0.0-3538.gbee299f4.el9.x86_64 106/164 2024-05-08T05:34:44.197 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-common-2:19.0.0-3538.gbee299f4.el9.x86_64 107/164 2024-05-08T05:34:44.238 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-common-2:19.0.0-3538.gbee299f4.el9.x86_64 107/164 2024-05-08T05:34:44.907 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-common-2:19.0.0-3538.gbee299f4.el9.x86_64 107/164 2024-05-08T05:34:44.950 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-base-2:19.0.0-3538.gbee299f4.el9.x86_64 108/164 2024-05-08T05:34:45.132 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-base-2:19.0.0-3538.gbee299f4.el9.x86_64 108/164 2024-05-08T05:34:45.132 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-08T05:34:45.132 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-08T05:34:45.132 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:34:45.176 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-selinux-2:19.0.0-3538.gbee299f4.el9.x86_64 109/164 2024-05-08T05:34:47.014 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3538.gbee299f4.el9.x86_64 109/164 2024-05-08T05:34:47.014 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /sys 2024-05-08T05:34:47.014 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /proc 2024-05-08T05:34:47.014 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /mnt 2024-05-08T05:34:47.014 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /var/tmp 2024-05-08T05:34:47.014 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /home 2024-05-08T05:34:47.014 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /root 2024-05-08T05:34:47.014 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /tmp 2024-05-08T05:34:47.014 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-08T05:34:47.183 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-volume-2:19.0.0-3538.gbee299f4.el9.noarch 110/164 2024-05-08T05:34:47.198 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-volume-2:19.0.0-3538.gbee299f4.el9.noarch 110/164 2024-05-08T05:34:47.198 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T05:34:47.198 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-08T05:34:47.198 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-08T05:34:48.670 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-osd-2:19.0.0-3538.gbee299f4.el9.x86_64 111/164 2024-05-08T05:34:48.695 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-osd-2:19.0.0-3538.gbee299f4.el9.x86_64 111/164 2024-05-08T05:34:48.695 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T05:34:48.695 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-08T05:34:48.696 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-08T05:34:48.696 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-08T05:34:48.696 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-08T05:34:48.912 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mds-2:19.0.0-3538.gbee299f4.el9.x86_64 112/164 2024-05-08T05:34:48.934 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mds-2:19.0.0-3538.gbee299f4.el9.x86_64 112/164 2024-05-08T05:34:48.934 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T05:34:48.934 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-08T05:34:48.934 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-08T05:34:48.934 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-08T05:34:48.935 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-08T05:34:49.380 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mon-2:19.0.0-3538.gbee299f4.el9.x86_64 113/164 2024-05-08T05:34:49.402 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mon-2:19.0.0-3538.gbee299f4.el9.x86_64 113/164 2024-05-08T05:34:49.402 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T05:34:49.402 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-08T05:34:49.402 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-08T05:34:49.402 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-08T05:34:49.402 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-08T05:34:49.501 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-08T05:34:49.558 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-08T05:34:49.614 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-08T05:34:49.800 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-08T05:34:49.847 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-08T05:34:49.925 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-08T05:34:50.015 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-08T05:34:50.152 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-08T05:34:50.206 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-08T05:34:50.238 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-08T05:34:50.265 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-08T05:34:50.692 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: cephadm-2:19.0.0-3538.gbee299f4.el9.noarch 125/164 2024-05-08T05:34:50.714 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephadm-2:19.0.0-3538.gbee299f4.el9.noarch 125/164 2024-05-08T05:34:50.746 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3538.gbee299f4.e 126/164 2024-05-08T05:34:50.808 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3538.gbee299f4. 127/164 2024-05-08T05:34:50.837 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3538.gbee299f4.el9.noa 128/164 2024-05-08T05:34:51.872 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3538.gbee299f4.el9.noa 128/164 2024-05-08T05:34:51.914 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3538.gbee299f4.el9.n 129/164 2024-05-08T05:34:52.714 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3538.gbee299f4.el9.x86_64 109/164 2024-05-08T05:34:52.715 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /sys 2024-05-08T05:34:52.715 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /proc 2024-05-08T05:34:52.715 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /mnt 2024-05-08T05:34:52.715 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /var/tmp 2024-05-08T05:34:52.715 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /home 2024-05-08T05:34:52.715 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /root 2024-05-08T05:34:52.715 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /tmp 2024-05-08T05:34:52.715 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-08T05:34:52.875 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3538.gbee299f4.el9.n 129/164 2024-05-08T05:34:52.889 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-volume-2:19.0.0-3538.gbee299f4.el9.noarch 110/164 2024-05-08T05:34:52.905 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-volume-2:19.0.0-3538.gbee299f4.el9.noarch 110/164 2024-05-08T05:34:52.906 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T05:34:52.906 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-08T05:34:52.906 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-08T05:34:52.906 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3538.gbee 130/164 2024-05-08T05:34:53.016 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3538.gbee 130/164 2024-05-08T05:34:53.175 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3538.gbee299f4.el 131/164 2024-05-08T05:34:53.200 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-2:19.0.0-3538.gbee299f4.el9.x86_64 132/164 2024-05-08T05:34:53.223 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3538.gbee299f4.el9.x86_64 132/164 2024-05-08T05:34:53.223 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T05:34:53.223 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-08T05:34:53.223 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-08T05:34:53.223 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-08T05:34:53.223 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-08T05:34:53.276 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-rook-2:19.0.0-3538.gbee299f4.el9.noarch 133/164 2024-05-08T05:34:53.286 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3538.gbee299f4.el9.noarch 133/164 2024-05-08T05:34:53.385 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-2:19.0.0-3538.gbee299f4.el9.x86_64 134/164 2024-05-08T05:34:53.440 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-fuse-2:19.0.0-3538.gbee299f4.el9.x86_64 135/164 2024-05-08T05:34:54.362 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-08T05:34:54.384 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-osd-2:19.0.0-3538.gbee299f4.el9.x86_64 111/164 2024-05-08T05:34:54.395 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-radosgw-2:19.0.0-3538.gbee299f4.el9.x86_64 137/164 2024-05-08T05:34:54.409 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-osd-2:19.0.0-3538.gbee299f4.el9.x86_64 111/164 2024-05-08T05:34:54.409 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T05:34:54.409 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-08T05:34:54.409 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-08T05:34:54.410 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-08T05:34:54.410 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-08T05:34:54.417 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3538.gbee299f4.el9.x86_64 137/164 2024-05-08T05:34:54.417 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T05:34:54.418 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-08T05:34:54.418 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-08T05:34:54.418 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-08T05:34:54.418 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-08T05:34:54.462 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3538.gbee29 138/164 2024-05-08T05:34:54.484 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3538.gbee29 138/164 2024-05-08T05:34:54.484 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T05:34:54.484 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-08T05:34:54.484 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-08T05:34:54.529 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephfs-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 139/164 2024-05-08T05:34:54.551 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 139/164 2024-05-08T05:34:54.551 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T05:34:54.552 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-08T05:34:54.552 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-08T05:34:54.552 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-08T05:34:54.552 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-08T05:34:54.634 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mds-2:19.0.0-3538.gbee299f4.el9.x86_64 112/164 2024-05-08T05:34:54.657 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mds-2:19.0.0-3538.gbee299f4.el9.x86_64 112/164 2024-05-08T05:34:54.657 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T05:34:54.657 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-08T05:34:54.657 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-08T05:34:54.657 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-08T05:34:54.657 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-08T05:34:54.847 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 140/164 2024-05-08T05:34:54.869 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 140/164 2024-05-08T05:34:54.870 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T05:34:54.870 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-08T05:34:54.870 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-08T05:34:54.870 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-08T05:34:54.870 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-08T05:34:55.102 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mon-2:19.0.0-3538.gbee299f4.el9.x86_64 113/164 2024-05-08T05:34:55.125 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mon-2:19.0.0-3538.gbee299f4.el9.x86_64 113/164 2024-05-08T05:34:55.125 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T05:34:55.125 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-08T05:34:55.125 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-08T05:34:55.125 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-08T05:34:55.125 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-08T05:34:55.231 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-08T05:34:55.279 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-08T05:34:55.336 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-08T05:34:55.520 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-08T05:34:55.568 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-08T05:34:55.653 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-08T05:34:55.743 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-08T05:34:55.880 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-08T05:34:55.927 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-08T05:34:55.959 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-08T05:34:55.986 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-08T05:34:56.449 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: cephadm-2:19.0.0-3538.gbee299f4.el9.noarch 125/164 2024-05-08T05:34:56.476 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cephadm-2:19.0.0-3538.gbee299f4.el9.noarch 125/164 2024-05-08T05:34:56.508 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3538.gbee299f4.e 126/164 2024-05-08T05:34:56.570 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3538.gbee299f4. 127/164 2024-05-08T05:34:56.599 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3538.gbee299f4.el9.noa 128/164 2024-05-08T05:34:57.641 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3538.gbee299f4.el9.noa 128/164 2024-05-08T05:34:57.685 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3538.gbee299f4.el9.n 129/164 2024-05-08T05:34:58.101 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3538.gbee299f4.el9.x86_64 109/164 2024-05-08T05:34:58.101 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /sys 2024-05-08T05:34:58.101 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /proc 2024-05-08T05:34:58.101 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /mnt 2024-05-08T05:34:58.101 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /var/tmp 2024-05-08T05:34:58.101 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /home 2024-05-08T05:34:58.102 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /root 2024-05-08T05:34:58.102 INFO:teuthology.orchestra.run.smithi082.stdout:skipping the directory /tmp 2024-05-08T05:34:58.102 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:34:58.356 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-volume-2:19.0.0-3538.gbee299f4.el9.noarch 110/164 2024-05-08T05:34:58.404 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-volume-2:19.0.0-3538.gbee299f4.el9.noarch 110/164 2024-05-08T05:34:58.404 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T05:34:58.404 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-08T05:34:58.404 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:34:58.651 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3538.gbee299f4.el9.n 129/164 2024-05-08T05:34:58.676 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3538.gbee 130/164 2024-05-08T05:34:58.787 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3538.gbee 130/164 2024-05-08T05:34:58.948 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3538.gbee299f4.el 131/164 2024-05-08T05:34:58.978 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-2:19.0.0-3538.gbee299f4.el9.x86_64 132/164 2024-05-08T05:34:59.001 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3538.gbee299f4.el9.x86_64 132/164 2024-05-08T05:34:59.002 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T05:34:59.002 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-08T05:34:59.002 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-08T05:34:59.002 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-08T05:34:59.002 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-08T05:34:59.046 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-rook-2:19.0.0-3538.gbee299f4.el9.noarch 133/164 2024-05-08T05:34:59.057 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3538.gbee299f4.el9.noarch 133/164 2024-05-08T05:34:59.155 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-2:19.0.0-3538.gbee299f4.el9.x86_64 134/164 2024-05-08T05:34:59.202 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-fuse-2:19.0.0-3538.gbee299f4.el9.x86_64 135/164 2024-05-08T05:34:59.450 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-test-2:19.0.0-3538.gbee299f4.el9.x86_64 141/164 2024-05-08T05:34:59.492 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-fuse-2:19.0.0-3538.gbee299f4.el9.x86_64 142/164 2024-05-08T05:34:59.533 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-nbd-2:19.0.0-3538.gbee299f4.el9.x86_64 143/164 2024-05-08T05:34:59.565 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-08T05:34:59.592 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-08T05:34:59.774 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephfs-shell-2:19.0.0-3538.gbee299f4.el9.x86_64 146/164 2024-05-08T05:34:59.822 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-08T05:34:59.852 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephfs-devel-2:19.0.0-3538.gbee299f4.el9.x86_ 148/164 2024-05-08T05:34:59.882 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : NetworkManager-team-1:1.47.5-1.el9.x86_64 149/164 2024-05-08T05:34:59.920 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : NetworkManager-tui-1:1.47.5-1.el9.x86_64 150/164 2024-05-08T05:35:00.067 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-osd-2:19.0.0-3538.gbee299f4.el9.x86_64 111/164 2024-05-08T05:35:00.126 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-08T05:35:00.142 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-osd-2:19.0.0-3538.gbee299f4.el9.x86_64 111/164 2024-05-08T05:35:00.142 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T05:35:00.142 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-08T05:35:00.142 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-08T05:35:00.142 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-08T05:35:00.143 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:35:00.156 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-radosgw-2:19.0.0-3538.gbee299f4.el9.x86_64 137/164 2024-05-08T05:35:00.179 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3538.gbee299f4.el9.x86_64 137/164 2024-05-08T05:35:00.179 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T05:35:00.179 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-08T05:35:00.180 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-08T05:35:00.180 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-08T05:35:00.180 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-08T05:35:00.232 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3538.gbee29 138/164 2024-05-08T05:35:00.254 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3538.gbee29 138/164 2024-05-08T05:35:00.254 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T05:35:00.255 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-08T05:35:00.255 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-08T05:35:00.299 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cephfs-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 139/164 2024-05-08T05:35:00.322 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 139/164 2024-05-08T05:35:00.322 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T05:35:00.323 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-08T05:35:00.323 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-08T05:35:00.323 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-08T05:35:00.323 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-08T05:35:00.384 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mds-2:19.0.0-3538.gbee299f4.el9.x86_64 112/164 2024-05-08T05:35:00.452 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mds-2:19.0.0-3538.gbee299f4.el9.x86_64 112/164 2024-05-08T05:35:00.452 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T05:35:00.452 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-08T05:35:00.452 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-08T05:35:00.452 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-08T05:35:00.453 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:35:00.532 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-08T05:35:00.585 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-08T05:35:00.604 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-08T05:35:00.634 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 140/164 2024-05-08T05:35:00.656 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 140/164 2024-05-08T05:35:00.657 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T05:35:00.657 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-08T05:35:00.657 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-08T05:35:00.657 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-08T05:35:00.657 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-08T05:35:00.934 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mon-2:19.0.0-3538.gbee299f4.el9.x86_64 113/164 2024-05-08T05:35:01.002 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mon-2:19.0.0-3538.gbee299f4.el9.x86_64 113/164 2024-05-08T05:35:01.002 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T05:35:01.002 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-08T05:35:01.002 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-08T05:35:01.003 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-08T05:35:01.003 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:35:01.143 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-08T05:35:01.205 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-08T05:35:01.288 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-08T05:35:01.432 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephfs-top-2:19.0.0-3538.gbee299f4.el9.noarch 152/164 2024-05-08T05:35:01.515 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-08T05:35:01.523 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-08T05:35:01.556 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-08T05:35:01.581 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-08T05:35:01.637 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-08T05:35:01.666 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-08T05:35:01.668 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-08T05:35:01.694 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-08T05:35:01.694 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-08T05:35:01.779 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-08T05:35:01.783 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-08T05:35:01.803 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-08T05:35:01.803 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-08T05:35:01.888 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-08T05:35:01.913 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-08T05:35:01.917 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-08T05:35:01.918 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-08T05:35:01.951 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-08T05:35:02.087 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-08T05:35:02.090 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-08T05:35:02.090 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-08T05:35:02.137 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-08T05:35:02.174 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-08T05:35:02.195 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-08T05:35:02.245 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-08T05:35:02.844 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: cephadm-2:19.0.0-3538.gbee299f4.el9.noarch 125/164 2024-05-08T05:35:02.881 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephadm-2:19.0.0-3538.gbee299f4.el9.noarch 125/164 2024-05-08T05:35:02.939 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3538.gbee299f4.e 126/164 2024-05-08T05:35:03.048 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3538.gbee299f4. 127/164 2024-05-08T05:35:03.091 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3538.gbee299f4.el9.noa 128/164 2024-05-08T05:35:04.411 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3538.gbee299f4.el9.noa 128/164 2024-05-08T05:35:04.459 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3538.gbee299f4.el9.n 129/164 2024-05-08T05:35:05.287 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-test-2:19.0.0-3538.gbee299f4.el9.x86_64 141/164 2024-05-08T05:35:05.328 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-fuse-2:19.0.0-3538.gbee299f4.el9.x86_64 142/164 2024-05-08T05:35:05.368 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-nbd-2:19.0.0-3538.gbee299f4.el9.x86_64 143/164 2024-05-08T05:35:05.401 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-08T05:35:05.428 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-08T05:35:05.556 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3538.gbee299f4.el9.n 129/164 2024-05-08T05:35:05.592 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3538.gbee 130/164 2024-05-08T05:35:05.610 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cephfs-shell-2:19.0.0-3538.gbee299f4.el9.x86_64 146/164 2024-05-08T05:35:05.667 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-08T05:35:05.696 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephfs-devel-2:19.0.0-3538.gbee299f4.el9.x86_ 148/164 2024-05-08T05:35:05.726 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : NetworkManager-team-1:1.47.5-1.el9.x86_64 149/164 2024-05-08T05:35:05.748 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3538.gbee 130/164 2024-05-08T05:35:05.772 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : NetworkManager-tui-1:1.47.5-1.el9.x86_64 150/164 2024-05-08T05:35:05.922 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3538.gbee299f4.el 131/164 2024-05-08T05:35:05.953 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-2:19.0.0-3538.gbee299f4.el9.x86_64 132/164 2024-05-08T05:35:06.025 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3538.gbee299f4.el9.x86_64 132/164 2024-05-08T05:35:06.025 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T05:35:06.025 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-08T05:35:06.026 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-08T05:35:06.026 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-08T05:35:06.026 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:35:06.087 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-mgr-rook-2:19.0.0-3538.gbee299f4.el9.noarch 133/164 2024-05-08T05:35:06.124 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3538.gbee299f4.el9.noarch 133/164 2024-05-08T05:35:06.240 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-2:19.0.0-3538.gbee299f4.el9.x86_64 134/164 2024-05-08T05:35:06.324 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-fuse-2:19.0.0-3538.gbee299f4.el9.x86_64 135/164 2024-05-08T05:35:06.368 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-08T05:35:06.403 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-08T05:35:06.423 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-08T05:35:07.262 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cephfs-top-2:19.0.0-3538.gbee299f4.el9.noarch 152/164 2024-05-08T05:35:07.347 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-08T05:35:07.348 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-08T05:35:07.381 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-radosgw-2:19.0.0-3538.gbee299f4.el9.x86_64 137/164 2024-05-08T05:35:07.389 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-08T05:35:07.456 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3538.gbee299f4.el9.x86_64 137/164 2024-05-08T05:35:07.456 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T05:35:07.456 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-08T05:35:07.456 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-08T05:35:07.456 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-08T05:35:07.456 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:35:07.470 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-08T05:35:07.501 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-08T05:35:07.506 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3538.gbee29 138/164 2024-05-08T05:35:07.528 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-08T05:35:07.528 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-08T05:35:07.575 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3538.gbee29 138/164 2024-05-08T05:35:07.575 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T05:35:07.576 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-08T05:35:07.576 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:35:07.612 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-08T05:35:07.645 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-08T05:35:07.645 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-08T05:35:07.648 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-08T05:35:07.648 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-2:19.0.0-3538.gbee299f4.el9.x86_64 1/164 2024-05-08T05:35:07.648 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-base-2:19.0.0-3538.gbee299f4.el9.x86_64 2/164 2024-05-08T05:35:07.648 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-common-2:19.0.0-3538.gbee299f4.el9.x86_64 3/164 2024-05-08T05:35:07.648 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-fuse-2:19.0.0-3538.gbee299f4.el9.x86_64 4/164 2024-05-08T05:35:07.648 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3538.gbee29 5/164 2024-05-08T05:35:07.648 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mds-2:19.0.0-3538.gbee299f4.el9.x86_64 6/164 2024-05-08T05:35:07.648 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-2:19.0.0-3538.gbee299f4.el9.x86_64 7/164 2024-05-08T05:35:07.648 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mon-2:19.0.0-3538.gbee299f4.el9.x86_64 8/164 2024-05-08T05:35:07.648 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-osd-2:19.0.0-3538.gbee299f4.el9.x86_64 9/164 2024-05-08T05:35:07.648 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-radosgw-2:19.0.0-3538.gbee299f4.el9.x86_64 10/164 2024-05-08T05:35:07.649 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-selinux-2:19.0.0-3538.gbee299f4.el9.x86_64 11/164 2024-05-08T05:35:07.649 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-test-2:19.0.0-3538.gbee299f4.el9.x86_64 12/164 2024-05-08T05:35:07.649 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephfs-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 13/164 2024-05-08T05:35:07.649 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephfs-shell-2:19.0.0-3538.gbee299f4.el9.x86_64 14/164 2024-05-08T05:35:07.649 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephfs-devel-2:19.0.0-3538.gbee299f4.el9.x86_ 15/164 2024-05-08T05:35:07.649 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephfs2-2:19.0.0-3538.gbee299f4.el9.x86_64 16/164 2024-05-08T05:35:07.649 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephsqlite-2:19.0.0-3538.gbee299f4.el9.x86_64 17/164 2024-05-08T05:35:07.649 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados-devel-2:19.0.0-3538.gbee299f4.el9.x86_6 18/164 2024-05-08T05:35:07.649 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libradosstriper1-2:19.0.0-3538.gbee299f4.el9.x86 19/164 2024-05-08T05:35:07.649 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librgw2-2:19.0.0-3538.gbee299f4.el9.x86_64 20/164 2024-05-08T05:35:07.649 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3538.gbee299f4.el 21/164 2024-05-08T05:35:07.649 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ceph-common-2:19.0.0-3538.gbee299f4.el9. 22/164 2024-05-08T05:35:07.649 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cephfs-2:19.0.0-3538.gbee299f4.el9.x86_6 23/164 2024-05-08T05:35:07.649 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rados-2:19.0.0-3538.gbee299f4.el9.x86_64 24/164 2024-05-08T05:35:07.649 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rbd-2:19.0.0-3538.gbee299f4.el9.x86_64 25/164 2024-05-08T05:35:07.650 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rgw-2:19.0.0-3538.gbee299f4.el9.x86_64 26/164 2024-05-08T05:35:07.650 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-fuse-2:19.0.0-3538.gbee299f4.el9.x86_64 27/164 2024-05-08T05:35:07.657 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephfs-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 139/164 2024-05-08T05:35:07.663 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 28/164 2024-05-08T05:35:07.663 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-nbd-2:19.0.0-3538.gbee299f4.el9.x86_64 29/164 2024-05-08T05:35:07.663 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3538.gbee299f4. 30/164 2024-05-08T05:35:07.663 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3538.gbee299f4.el9.noa 31/164 2024-05-08T05:35:07.663 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3538.gbee299f4.el9.n 32/164 2024-05-08T05:35:07.664 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3538.gbee 33/164 2024-05-08T05:35:07.664 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3538.gbee299f4.el 34/164 2024-05-08T05:35:07.664 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3538.gbee299f4.el9.noarch 35/164 2024-05-08T05:35:07.664 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3538.gbee299f4.e 36/164 2024-05-08T05:35:07.664 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-volume-2:19.0.0-3538.gbee299f4.el9.noarch 37/164 2024-05-08T05:35:07.664 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephadm-2:19.0.0-3538.gbee299f4.el9.noarch 38/164 2024-05-08T05:35:07.664 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephfs-top-2:19.0.0-3538.gbee299f4.el9.noarch 39/164 2024-05-08T05:35:07.664 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-08T05:35:07.664 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-08T05:35:07.664 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-08T05:35:07.664 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-08T05:35:07.664 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-08T05:35:07.664 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-08T05:35:07.664 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-08T05:35:07.665 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-08T05:35:07.665 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-08T05:35:07.665 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-08T05:35:07.665 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-08T05:35:07.665 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-08T05:35:07.665 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-08T05:35:07.665 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-08T05:35:07.665 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-08T05:35:07.665 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-08T05:35:07.665 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-08T05:35:07.665 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-08T05:35:07.666 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-08T05:35:07.666 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-08T05:35:07.666 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-08T05:35:07.666 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-08T05:35:07.666 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-08T05:35:07.666 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-08T05:35:07.666 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-08T05:35:07.666 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-08T05:35:07.666 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-08T05:35:07.666 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-08T05:35:07.666 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-08T05:35:07.667 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-08T05:35:07.667 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-08T05:35:07.667 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-08T05:35:07.667 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-08T05:35:07.667 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-08T05:35:07.667 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-08T05:35:07.667 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-08T05:35:07.667 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-08T05:35:07.667 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-08T05:35:07.667 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-08T05:35:07.667 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-08T05:35:07.667 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-08T05:35:07.667 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-08T05:35:07.667 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-08T05:35:07.668 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-08T05:35:07.668 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-08T05:35:07.668 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-08T05:35:07.668 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-08T05:35:07.668 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-08T05:35:07.668 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-08T05:35:07.668 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-08T05:35:07.668 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-08T05:35:07.668 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-08T05:35:07.668 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-08T05:35:07.668 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-08T05:35:07.668 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-08T05:35:07.668 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-08T05:35:07.668 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-08T05:35:07.669 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-08T05:35:07.669 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-08T05:35:07.669 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-08T05:35:07.669 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-08T05:35:07.669 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-08T05:35:07.669 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-08T05:35:07.669 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-08T05:35:07.669 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-08T05:35:07.669 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-08T05:35:07.669 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-08T05:35:07.669 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-08T05:35:07.670 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-08T05:35:07.670 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-08T05:35:07.670 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-08T05:35:07.670 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-08T05:35:07.670 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-08T05:35:07.670 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-08T05:35:07.670 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-08T05:35:07.670 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-08T05:35:07.670 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-08T05:35:07.670 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-08T05:35:07.670 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-08T05:35:07.670 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-08T05:35:07.670 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-08T05:35:07.670 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-08T05:35:07.671 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-08T05:35:07.671 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-08T05:35:07.671 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-08T05:35:07.671 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-08T05:35:07.671 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-08T05:35:07.671 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-08T05:35:07.671 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-08T05:35:07.671 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-08T05:35:07.671 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-08T05:35:07.671 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-08T05:35:07.671 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-08T05:35:07.671 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-08T05:35:07.671 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-08T05:35:07.671 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-08T05:35:07.671 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-08T05:35:07.672 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-08T05:35:07.672 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-08T05:35:07.672 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-08T05:35:07.672 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-08T05:35:07.672 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-08T05:35:07.672 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-08T05:35:07.672 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-08T05:35:07.672 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-08T05:35:07.672 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-08T05:35:07.672 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-08T05:35:07.672 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-08T05:35:07.672 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-08T05:35:07.672 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados2-2:19.0.0-3538.gbee299f4.el9.x86_64 149/164 2024-05-08T05:35:07.672 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-08T05:35:07.672 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librbd1-2:19.0.0-3538.gbee299f4.el9.x86_64 151/164 2024-05-08T05:35:07.672 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-08T05:35:07.673 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-1:1.47.5-1.el9.x86_64 153/164 2024-05-08T05:35:07.673 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-08T05:35:07.673 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 155/164 2024-05-08T05:35:07.673 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-08T05:35:07.673 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-team-1:1.47.5-1.el9.x86_64 157/164 2024-05-08T05:35:07.673 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-08T05:35:07.673 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-tui-1:1.47.5-1.el9.x86_64 159/164 2024-05-08T05:35:07.673 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-08T05:35:07.673 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-08T05:35:07.673 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-08T05:35:07.673 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-08T05:35:07.730 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 139/164 2024-05-08T05:35:07.730 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T05:35:07.730 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-08T05:35:07.730 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-08T05:35:07.730 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-08T05:35:07.730 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:35:07.754 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-08T05:35:07.779 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-08T05:35:07.784 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-08T05:35:07.785 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-08T05:35:07.964 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-08T05:35:07.964 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-08T05:35:08.049 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-08T05:35:08.099 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 140/164 2024-05-08T05:35:08.111 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-08T05:35:08.168 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 140/164 2024-05-08T05:35:08.168 INFO:teuthology.orchestra.run.smithi082.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-08T05:35:08.168 INFO:teuthology.orchestra.run.smithi082.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-08T05:35:08.168 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-08T05:35:08.168 INFO:teuthology.orchestra.run.smithi082.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-08T05:35:08.168 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:35:10.394 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-08T05:35:10.394 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-08T05:35:10.394 INFO:teuthology.orchestra.run.smithi134.stdout:Upgraded: 2024-05-08T05:35:10.394 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-1:1.47.5-1.el9.x86_64 2024-05-08T05:35:10.394 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 2024-05-08T05:35:10.394 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-team-1:1.47.5-1.el9.x86_64 2024-05-08T05:35:10.394 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-tui-1:1.47.5-1.el9.x86_64 2024-05-08T05:35:10.395 INFO:teuthology.orchestra.run.smithi134.stdout: librados2-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:10.395 INFO:teuthology.orchestra.run.smithi134.stdout: librbd1-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:10.395 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-08T05:35:10.395 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-08T05:35:10.395 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-05-08T05:35:10.395 INFO:teuthology.orchestra.run.smithi134.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-08T05:35:10.395 INFO:teuthology.orchestra.run.smithi134.stdout: automake-1.16.2-8.el9.noarch 2024-05-08T05:35:10.395 INFO:teuthology.orchestra.run.smithi134.stdout: bison-3.7.4-5.el9.x86_64 2024-05-08T05:35:10.395 INFO:teuthology.orchestra.run.smithi134.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-08T05:35:10.395 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:10.395 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:10.395 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-common-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:10.395 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-fuse-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:10.395 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-grafana-dashboards-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:35:10.395 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-immutable-object-cache-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:10.396 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mds-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:10.396 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:10.396 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-cephadm-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:35:10.396 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:35:10.396 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:35:10.396 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:35:10.396 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-rook-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:35:10.397 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mon-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:10.397 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-osd-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:10.397 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-prometheus-alerts-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:35:10.397 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-radosgw-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:10.397 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-selinux-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:10.397 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-test-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:10.398 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-volume-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:35:10.398 INFO:teuthology.orchestra.run.smithi134.stdout: cephadm-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:35:10.398 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:10.398 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-shell-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:10.398 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-top-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:35:10.398 INFO:teuthology.orchestra.run.smithi134.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-08T05:35:10.398 INFO:teuthology.orchestra.run.smithi134.stdout: flex-2.6.4-9.el9.x86_64 2024-05-08T05:35:10.398 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-08T05:35:10.398 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-08T05:35:10.398 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-08T05:35:10.398 INFO:teuthology.orchestra.run.smithi134.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-08T05:35:10.398 INFO:teuthology.orchestra.run.smithi134.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-08T05:35:10.399 INFO:teuthology.orchestra.run.smithi134.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-08T05:35:10.399 INFO:teuthology.orchestra.run.smithi134.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-08T05:35:10.399 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-08T05:35:10.399 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-08T05:35:10.399 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-devel-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:10.399 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs2-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:10.399 INFO:teuthology.orchestra.run.smithi134.stdout: libcephsqlite-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:10.400 INFO:teuthology.orchestra.run.smithi134.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-08T05:35:10.400 INFO:teuthology.orchestra.run.smithi134.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-08T05:35:10.400 INFO:teuthology.orchestra.run.smithi134.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-08T05:35:10.400 INFO:teuthology.orchestra.run.smithi134.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-08T05:35:10.400 INFO:teuthology.orchestra.run.smithi134.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-08T05:35:10.400 INFO:teuthology.orchestra.run.smithi134.stdout: librados-devel-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:10.400 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:10.400 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-08T05:35:10.400 INFO:teuthology.orchestra.run.smithi134.stdout: librgw2-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:10.400 INFO:teuthology.orchestra.run.smithi134.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-08T05:35:10.400 INFO:teuthology.orchestra.run.smithi134.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-08T05:35:10.400 INFO:teuthology.orchestra.run.smithi134.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-08T05:35:10.401 INFO:teuthology.orchestra.run.smithi134.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-08T05:35:10.401 INFO:teuthology.orchestra.run.smithi134.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-08T05:35:10.401 INFO:teuthology.orchestra.run.smithi134.stdout: lua-5.4.4-4.el9.x86_64 2024-05-08T05:35:10.401 INFO:teuthology.orchestra.run.smithi134.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-08T05:35:10.401 INFO:teuthology.orchestra.run.smithi134.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-08T05:35:10.401 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-08T05:35:10.401 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-08T05:35:10.401 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-08T05:35:10.401 INFO:teuthology.orchestra.run.smithi134.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-08T05:35:10.401 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-13.14-1.el9.x86_64 2024-05-08T05:35:10.401 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-08T05:35:10.401 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-08T05:35:10.401 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-08T05:35:10.401 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-08T05:35:10.402 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-08T05:35:10.402 INFO:teuthology.orchestra.run.smithi134.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-08T05:35:10.402 INFO:teuthology.orchestra.run.smithi134.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-08T05:35:10.402 INFO:teuthology.orchestra.run.smithi134.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-08T05:35:10.402 INFO:teuthology.orchestra.run.smithi134.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-08T05:35:10.402 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-08T05:35:10.402 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:10.402 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-common-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:10.402 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cephfs-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:10.402 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-08T05:35:10.402 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-08T05:35:10.402 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-08T05:35:10.402 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-08T05:35:10.403 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-08T05:35:10.403 INFO:teuthology.orchestra.run.smithi134.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-08T05:35:10.403 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-08T05:35:10.403 INFO:teuthology.orchestra.run.smithi134.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-08T05:35:10.403 INFO:teuthology.orchestra.run.smithi134.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-08T05:35:10.403 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-08T05:35:10.403 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-08T05:35:10.403 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-08T05:35:10.403 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-08T05:35:10.403 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-08T05:35:10.403 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-08T05:35:10.403 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-08T05:35:10.403 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-08T05:35:10.404 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-08T05:35:10.404 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-08T05:35:10.404 INFO:teuthology.orchestra.run.smithi134.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-08T05:35:10.404 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-08T05:35:10.404 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-08T05:35:10.404 INFO:teuthology.orchestra.run.smithi134.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-08T05:35:10.404 INFO:teuthology.orchestra.run.smithi134.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-08T05:35:10.404 INFO:teuthology.orchestra.run.smithi134.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-08T05:35:10.404 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-08T05:35:10.404 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-08T05:35:10.404 INFO:teuthology.orchestra.run.smithi134.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-08T05:35:10.404 INFO:teuthology.orchestra.run.smithi134.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-08T05:35:10.404 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-08T05:35:10.404 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ply-3.11-14.el9.noarch 2024-05-08T05:35:10.405 INFO:teuthology.orchestra.run.smithi134.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-08T05:35:10.405 INFO:teuthology.orchestra.run.smithi134.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-08T05:35:10.405 INFO:teuthology.orchestra.run.smithi134.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-08T05:35:10.405 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-08T05:35:10.405 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-08T05:35:10.405 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-08T05:35:10.405 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-08T05:35:10.405 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-08T05:35:10.405 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-08T05:35:10.405 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:10.405 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rbd-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:10.405 INFO:teuthology.orchestra.run.smithi134.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-08T05:35:10.405 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-08T05:35:10.405 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-08T05:35:10.406 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rgw-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:10.406 INFO:teuthology.orchestra.run.smithi134.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-08T05:35:10.406 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-08T05:35:10.406 INFO:teuthology.orchestra.run.smithi134.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-08T05:35:10.406 INFO:teuthology.orchestra.run.smithi134.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-08T05:35:10.406 INFO:teuthology.orchestra.run.smithi134.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-08T05:35:10.406 INFO:teuthology.orchestra.run.smithi134.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-08T05:35:10.406 INFO:teuthology.orchestra.run.smithi134.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-08T05:35:10.406 INFO:teuthology.orchestra.run.smithi134.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-08T05:35:10.406 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-08T05:35:10.406 INFO:teuthology.orchestra.run.smithi134.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-08T05:35:10.406 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-08T05:35:10.407 INFO:teuthology.orchestra.run.smithi134.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-08T05:35:10.407 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-08T05:35:10.407 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-08T05:35:10.407 INFO:teuthology.orchestra.run.smithi134.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-08T05:35:10.407 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-fuse-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:10.407 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:10.407 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-nbd-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:10.407 INFO:teuthology.orchestra.run.smithi134.stdout: re2-1:20211101-3.el9.x86_64 2024-05-08T05:35:10.407 INFO:teuthology.orchestra.run.smithi134.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-08T05:35:10.407 INFO:teuthology.orchestra.run.smithi134.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-08T05:35:10.407 INFO:teuthology.orchestra.run.smithi134.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-08T05:35:10.407 INFO:teuthology.orchestra.run.smithi134.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-08T05:35:10.407 INFO:teuthology.orchestra.run.smithi134.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-08T05:35:10.408 INFO:teuthology.orchestra.run.smithi134.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-08T05:35:10.408 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-05-08T05:35:10.408 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-05-08T05:35:10.803 DEBUG:teuthology.parallel:result is None 2024-05-08T05:35:13.253 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : ceph-test-2:19.0.0-3538.gbee299f4.el9.x86_64 141/164 2024-05-08T05:35:13.312 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-fuse-2:19.0.0-3538.gbee299f4.el9.x86_64 142/164 2024-05-08T05:35:13.386 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : rbd-nbd-2:19.0.0-3538.gbee299f4.el9.x86_64 143/164 2024-05-08T05:35:13.425 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-08T05:35:13.463 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-08T05:35:13.788 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephfs-shell-2:19.0.0-3538.gbee299f4.el9.x86_64 146/164 2024-05-08T05:35:13.836 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-08T05:35:13.865 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libcephfs-devel-2:19.0.0-3538.gbee299f4.el9.x86_ 148/164 2024-05-08T05:35:13.874 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-08T05:35:13.874 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-2:19.0.0-3538.gbee299f4.el9.x86_64 1/164 2024-05-08T05:35:13.874 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-base-2:19.0.0-3538.gbee299f4.el9.x86_64 2/164 2024-05-08T05:35:13.874 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-common-2:19.0.0-3538.gbee299f4.el9.x86_64 3/164 2024-05-08T05:35:13.874 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-fuse-2:19.0.0-3538.gbee299f4.el9.x86_64 4/164 2024-05-08T05:35:13.874 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3538.gbee29 5/164 2024-05-08T05:35:13.874 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mds-2:19.0.0-3538.gbee299f4.el9.x86_64 6/164 2024-05-08T05:35:13.874 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-2:19.0.0-3538.gbee299f4.el9.x86_64 7/164 2024-05-08T05:35:13.874 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mon-2:19.0.0-3538.gbee299f4.el9.x86_64 8/164 2024-05-08T05:35:13.874 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-osd-2:19.0.0-3538.gbee299f4.el9.x86_64 9/164 2024-05-08T05:35:13.874 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-radosgw-2:19.0.0-3538.gbee299f4.el9.x86_64 10/164 2024-05-08T05:35:13.875 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-selinux-2:19.0.0-3538.gbee299f4.el9.x86_64 11/164 2024-05-08T05:35:13.875 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-test-2:19.0.0-3538.gbee299f4.el9.x86_64 12/164 2024-05-08T05:35:13.875 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cephfs-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 13/164 2024-05-08T05:35:13.875 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cephfs-shell-2:19.0.0-3538.gbee299f4.el9.x86_64 14/164 2024-05-08T05:35:13.875 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephfs-devel-2:19.0.0-3538.gbee299f4.el9.x86_ 15/164 2024-05-08T05:35:13.875 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephfs2-2:19.0.0-3538.gbee299f4.el9.x86_64 16/164 2024-05-08T05:35:13.875 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephsqlite-2:19.0.0-3538.gbee299f4.el9.x86_64 17/164 2024-05-08T05:35:13.875 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados-devel-2:19.0.0-3538.gbee299f4.el9.x86_6 18/164 2024-05-08T05:35:13.875 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libradosstriper1-2:19.0.0-3538.gbee299f4.el9.x86 19/164 2024-05-08T05:35:13.875 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librgw2-2:19.0.0-3538.gbee299f4.el9.x86_64 20/164 2024-05-08T05:35:13.875 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3538.gbee299f4.el 21/164 2024-05-08T05:35:13.875 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-ceph-common-2:19.0.0-3538.gbee299f4.el9. 22/164 2024-05-08T05:35:13.875 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cephfs-2:19.0.0-3538.gbee299f4.el9.x86_6 23/164 2024-05-08T05:35:13.875 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rados-2:19.0.0-3538.gbee299f4.el9.x86_64 24/164 2024-05-08T05:35:13.876 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rbd-2:19.0.0-3538.gbee299f4.el9.x86_64 25/164 2024-05-08T05:35:13.876 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rgw-2:19.0.0-3538.gbee299f4.el9.x86_64 26/164 2024-05-08T05:35:13.876 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-fuse-2:19.0.0-3538.gbee299f4.el9.x86_64 27/164 2024-05-08T05:35:13.876 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 28/164 2024-05-08T05:35:13.876 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-nbd-2:19.0.0-3538.gbee299f4.el9.x86_64 29/164 2024-05-08T05:35:13.876 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3538.gbee299f4. 30/164 2024-05-08T05:35:13.876 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3538.gbee299f4.el9.noa 31/164 2024-05-08T05:35:13.876 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3538.gbee299f4.el9.n 32/164 2024-05-08T05:35:13.892 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3538.gbee 33/164 2024-05-08T05:35:13.893 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3538.gbee299f4.el 34/164 2024-05-08T05:35:13.893 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3538.gbee299f4.el9.noarch 35/164 2024-05-08T05:35:13.893 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3538.gbee299f4.e 36/164 2024-05-08T05:35:13.893 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-volume-2:19.0.0-3538.gbee299f4.el9.noarch 37/164 2024-05-08T05:35:13.893 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cephadm-2:19.0.0-3538.gbee299f4.el9.noarch 38/164 2024-05-08T05:35:13.893 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cephfs-top-2:19.0.0-3538.gbee299f4.el9.noarch 39/164 2024-05-08T05:35:13.893 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-08T05:35:13.893 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-08T05:35:13.893 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-08T05:35:13.893 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-08T05:35:13.893 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-08T05:35:13.893 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-08T05:35:13.893 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-08T05:35:13.893 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-08T05:35:13.894 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-08T05:35:13.894 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-08T05:35:13.894 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-08T05:35:13.894 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-08T05:35:13.894 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-08T05:35:13.894 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-08T05:35:13.894 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-08T05:35:13.894 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-08T05:35:13.894 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-08T05:35:13.894 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-08T05:35:13.894 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-08T05:35:13.894 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-08T05:35:13.894 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-08T05:35:13.895 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-08T05:35:13.895 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-08T05:35:13.895 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-08T05:35:13.895 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-08T05:35:13.895 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-08T05:35:13.895 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-08T05:35:13.895 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-08T05:35:13.895 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-08T05:35:13.895 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-08T05:35:13.895 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-08T05:35:13.895 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-08T05:35:13.895 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-08T05:35:13.895 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-08T05:35:13.895 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-08T05:35:13.896 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-08T05:35:13.896 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-08T05:35:13.896 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-08T05:35:13.896 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-08T05:35:13.896 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-08T05:35:13.896 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-08T05:35:13.896 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-08T05:35:13.896 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-08T05:35:13.896 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-08T05:35:13.896 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-08T05:35:13.896 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-08T05:35:13.896 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-08T05:35:13.896 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-08T05:35:13.896 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-08T05:35:13.896 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-08T05:35:13.897 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-08T05:35:13.897 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-08T05:35:13.897 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-08T05:35:13.897 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-08T05:35:13.897 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-08T05:35:13.897 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-08T05:35:13.897 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-08T05:35:13.897 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-08T05:35:13.897 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-08T05:35:13.897 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-08T05:35:13.897 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-08T05:35:13.897 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-08T05:35:13.897 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-08T05:35:13.897 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-08T05:35:13.898 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-08T05:35:13.898 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-08T05:35:13.898 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-08T05:35:13.898 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-08T05:35:13.898 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-08T05:35:13.898 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-08T05:35:13.898 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-08T05:35:13.898 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-08T05:35:13.898 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-08T05:35:13.898 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-08T05:35:13.898 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-08T05:35:13.898 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-08T05:35:13.898 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-08T05:35:13.898 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-08T05:35:13.899 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-08T05:35:13.899 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-08T05:35:13.899 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-08T05:35:13.899 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-08T05:35:13.899 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-08T05:35:13.899 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-08T05:35:13.899 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-08T05:35:13.899 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-08T05:35:13.899 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-08T05:35:13.899 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-08T05:35:13.899 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-08T05:35:13.899 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-08T05:35:13.899 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-08T05:35:13.899 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-08T05:35:13.899 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-08T05:35:13.900 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-08T05:35:13.900 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-08T05:35:13.900 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-08T05:35:13.900 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-08T05:35:13.900 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-08T05:35:13.900 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-08T05:35:13.900 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-08T05:35:13.900 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-08T05:35:13.900 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-08T05:35:13.900 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-08T05:35:13.900 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-08T05:35:13.900 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-08T05:35:13.900 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-08T05:35:13.900 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-08T05:35:13.900 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-08T05:35:13.901 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-08T05:35:13.901 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados2-2:19.0.0-3538.gbee299f4.el9.x86_64 149/164 2024-05-08T05:35:13.901 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-08T05:35:13.901 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librbd1-2:19.0.0-3538.gbee299f4.el9.x86_64 151/164 2024-05-08T05:35:13.901 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-08T05:35:13.901 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-1:1.47.5-1.el9.x86_64 153/164 2024-05-08T05:35:13.901 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-08T05:35:13.901 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 155/164 2024-05-08T05:35:13.901 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-08T05:35:13.901 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-team-1:1.47.5-1.el9.x86_64 157/164 2024-05-08T05:35:13.901 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-08T05:35:13.901 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-tui-1:1.47.5-1.el9.x86_64 159/164 2024-05-08T05:35:13.901 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-08T05:35:13.901 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-08T05:35:13.901 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-08T05:35:13.902 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-08T05:35:13.902 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : NetworkManager-team-1:1.47.5-1.el9.x86_64 149/164 2024-05-08T05:35:13.958 INFO:teuthology.orchestra.run.smithi082.stdout: Upgrading : NetworkManager-tui-1:1.47.5-1.el9.x86_64 150/164 2024-05-08T05:35:14.842 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-08T05:35:14.888 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-08T05:35:14.943 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-08T05:35:16.307 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : cephfs-top-2:19.0.0-3538.gbee299f4.el9.noarch 152/164 2024-05-08T05:35:16.385 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-08T05:35:16.385 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-08T05:35:16.386 INFO:teuthology.orchestra.run.smithi151.stdout:Upgraded: 2024-05-08T05:35:16.386 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-1:1.47.5-1.el9.x86_64 2024-05-08T05:35:16.386 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 2024-05-08T05:35:16.386 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-team-1:1.47.5-1.el9.x86_64 2024-05-08T05:35:16.386 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-tui-1:1.47.5-1.el9.x86_64 2024-05-08T05:35:16.386 INFO:teuthology.orchestra.run.smithi151.stdout: librados2-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:16.386 INFO:teuthology.orchestra.run.smithi151.stdout: librbd1-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:16.386 INFO:teuthology.orchestra.run.smithi151.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-08T05:35:16.386 INFO:teuthology.orchestra.run.smithi151.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-08T05:35:16.386 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2024-05-08T05:35:16.386 INFO:teuthology.orchestra.run.smithi151.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-08T05:35:16.387 INFO:teuthology.orchestra.run.smithi151.stdout: automake-1.16.2-8.el9.noarch 2024-05-08T05:35:16.387 INFO:teuthology.orchestra.run.smithi151.stdout: bison-3.7.4-5.el9.x86_64 2024-05-08T05:35:16.387 INFO:teuthology.orchestra.run.smithi151.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-08T05:35:16.387 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:16.387 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-base-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:16.387 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-common-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:16.387 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-fuse-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:16.387 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-grafana-dashboards-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:35:16.387 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-immutable-object-cache-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:16.387 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mds-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:16.387 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:16.387 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-cephadm-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:35:16.387 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-dashboard-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:35:16.387 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:35:16.387 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-modules-core-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:35:16.388 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-rook-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:35:16.388 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mon-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:16.388 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-osd-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:16.388 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-prometheus-alerts-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:35:16.388 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-radosgw-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:16.388 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-selinux-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:16.388 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-test-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:16.388 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-volume-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:35:16.388 INFO:teuthology.orchestra.run.smithi151.stdout: cephadm-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:35:16.388 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:16.388 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-shell-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:16.388 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-top-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:35:16.388 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-08T05:35:16.388 INFO:teuthology.orchestra.run.smithi151.stdout: flex-2.6.4-9.el9.x86_64 2024-05-08T05:35:16.389 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-08T05:35:16.389 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-08T05:35:16.389 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-08T05:35:16.389 INFO:teuthology.orchestra.run.smithi151.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-08T05:35:16.389 INFO:teuthology.orchestra.run.smithi151.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-08T05:35:16.389 INFO:teuthology.orchestra.run.smithi151.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-08T05:35:16.389 INFO:teuthology.orchestra.run.smithi151.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-08T05:35:16.389 INFO:teuthology.orchestra.run.smithi151.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-08T05:35:16.389 INFO:teuthology.orchestra.run.smithi151.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-08T05:35:16.389 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs-devel-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:16.389 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs2-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:16.389 INFO:teuthology.orchestra.run.smithi151.stdout: libcephsqlite-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:16.389 INFO:teuthology.orchestra.run.smithi151.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-08T05:35:16.389 INFO:teuthology.orchestra.run.smithi151.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-08T05:35:16.390 INFO:teuthology.orchestra.run.smithi151.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-08T05:35:16.390 INFO:teuthology.orchestra.run.smithi151.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-08T05:35:16.390 INFO:teuthology.orchestra.run.smithi151.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-08T05:35:16.390 INFO:teuthology.orchestra.run.smithi151.stdout: librados-devel-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:16.390 INFO:teuthology.orchestra.run.smithi151.stdout: libradosstriper1-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:16.390 INFO:teuthology.orchestra.run.smithi151.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-08T05:35:16.390 INFO:teuthology.orchestra.run.smithi151.stdout: librgw2-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:16.390 INFO:teuthology.orchestra.run.smithi151.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-08T05:35:16.390 INFO:teuthology.orchestra.run.smithi151.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-08T05:35:16.390 INFO:teuthology.orchestra.run.smithi151.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-08T05:35:16.390 INFO:teuthology.orchestra.run.smithi151.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-08T05:35:16.390 INFO:teuthology.orchestra.run.smithi151.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-08T05:35:16.390 INFO:teuthology.orchestra.run.smithi151.stdout: lua-5.4.4-4.el9.x86_64 2024-05-08T05:35:16.390 INFO:teuthology.orchestra.run.smithi151.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-08T05:35:16.391 INFO:teuthology.orchestra.run.smithi151.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-08T05:35:16.391 INFO:teuthology.orchestra.run.smithi151.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-08T05:35:16.391 INFO:teuthology.orchestra.run.smithi151.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-08T05:35:16.391 INFO:teuthology.orchestra.run.smithi151.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-08T05:35:16.391 INFO:teuthology.orchestra.run.smithi151.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-08T05:35:16.391 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-13.14-1.el9.x86_64 2024-05-08T05:35:16.391 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-08T05:35:16.391 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-08T05:35:16.391 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-08T05:35:16.391 INFO:teuthology.orchestra.run.smithi151.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-08T05:35:16.391 INFO:teuthology.orchestra.run.smithi151.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-08T05:35:16.391 INFO:teuthology.orchestra.run.smithi151.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-08T05:35:16.391 INFO:teuthology.orchestra.run.smithi151.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-08T05:35:16.391 INFO:teuthology.orchestra.run.smithi151.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-08T05:35:16.392 INFO:teuthology.orchestra.run.smithi151.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-08T05:35:16.392 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-08T05:35:16.392 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-argparse-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:16.392 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-common-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:16.392 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cephfs-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:16.392 INFO:teuthology.orchestra.run.smithi151.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-08T05:35:16.392 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-08T05:35:16.392 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-08T05:35:16.392 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-08T05:35:16.392 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-08T05:35:16.392 INFO:teuthology.orchestra.run.smithi151.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-08T05:35:16.392 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-08T05:35:16.392 INFO:teuthology.orchestra.run.smithi151.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-08T05:35:16.392 INFO:teuthology.orchestra.run.smithi151.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-08T05:35:16.392 INFO:teuthology.orchestra.run.smithi151.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-08T05:35:16.393 INFO:teuthology.orchestra.run.smithi151.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-08T05:35:16.393 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-08T05:35:16.393 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-08T05:35:16.393 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-08T05:35:16.393 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-08T05:35:16.393 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-08T05:35:16.393 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-08T05:35:16.393 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-08T05:35:16.393 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-08T05:35:16.393 INFO:teuthology.orchestra.run.smithi151.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-08T05:35:16.393 INFO:teuthology.orchestra.run.smithi151.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-08T05:35:16.393 INFO:teuthology.orchestra.run.smithi151.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-08T05:35:16.393 INFO:teuthology.orchestra.run.smithi151.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-08T05:35:16.393 INFO:teuthology.orchestra.run.smithi151.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-08T05:35:16.393 INFO:teuthology.orchestra.run.smithi151.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-08T05:35:16.394 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-08T05:35:16.394 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-08T05:35:16.394 INFO:teuthology.orchestra.run.smithi151.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-08T05:35:16.394 INFO:teuthology.orchestra.run.smithi151.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-08T05:35:16.394 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-08T05:35:16.394 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ply-3.11-14.el9.noarch 2024-05-08T05:35:16.394 INFO:teuthology.orchestra.run.smithi151.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-08T05:35:16.394 INFO:teuthology.orchestra.run.smithi151.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-08T05:35:16.394 INFO:teuthology.orchestra.run.smithi151.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-08T05:35:16.394 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-08T05:35:16.394 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-08T05:35:16.394 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-08T05:35:16.394 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-08T05:35:16.395 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-08T05:35:16.395 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-08T05:35:16.395 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rados-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:16.395 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rbd-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:16.395 INFO:teuthology.orchestra.run.smithi151.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-08T05:35:16.395 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-08T05:35:16.395 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-08T05:35:16.395 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rgw-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:16.395 INFO:teuthology.orchestra.run.smithi151.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-08T05:35:16.395 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-08T05:35:16.395 INFO:teuthology.orchestra.run.smithi151.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-08T05:35:16.395 INFO:teuthology.orchestra.run.smithi151.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-08T05:35:16.395 INFO:teuthology.orchestra.run.smithi151.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-08T05:35:16.395 INFO:teuthology.orchestra.run.smithi151.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-08T05:35:16.395 INFO:teuthology.orchestra.run.smithi151.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-08T05:35:16.396 INFO:teuthology.orchestra.run.smithi151.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-08T05:35:16.396 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-08T05:35:16.396 INFO:teuthology.orchestra.run.smithi151.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-08T05:35:16.396 INFO:teuthology.orchestra.run.smithi151.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-08T05:35:16.396 INFO:teuthology.orchestra.run.smithi151.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-08T05:35:16.396 INFO:teuthology.orchestra.run.smithi151.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-08T05:35:16.396 INFO:teuthology.orchestra.run.smithi151.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-08T05:35:16.396 INFO:teuthology.orchestra.run.smithi151.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-08T05:35:16.396 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-fuse-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:16.396 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:16.396 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-nbd-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:16.396 INFO:teuthology.orchestra.run.smithi151.stdout: re2-1:20211101-3.el9.x86_64 2024-05-08T05:35:16.396 INFO:teuthology.orchestra.run.smithi151.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-08T05:35:16.396 INFO:teuthology.orchestra.run.smithi151.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-08T05:35:16.397 INFO:teuthology.orchestra.run.smithi151.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-08T05:35:16.397 INFO:teuthology.orchestra.run.smithi151.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-08T05:35:16.397 INFO:teuthology.orchestra.run.smithi151.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-08T05:35:16.397 INFO:teuthology.orchestra.run.smithi151.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-08T05:35:16.397 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-08T05:35:16.397 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-05-08T05:35:16.419 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-08T05:35:16.483 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-08T05:35:16.621 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-08T05:35:16.662 INFO:teuthology.orchestra.run.smithi082.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-08T05:35:16.699 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-08T05:35:16.699 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-08T05:35:16.792 DEBUG:teuthology.parallel:result is None 2024-05-08T05:35:16.815 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-08T05:35:16.849 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-08T05:35:16.849 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-08T05:35:16.987 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-08T05:35:17.025 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-08T05:35:17.058 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-08T05:35:17.058 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-08T05:35:17.397 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-08T05:35:17.397 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-08T05:35:17.549 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-08T05:35:17.681 INFO:teuthology.orchestra.run.smithi082.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-08T05:35:17.940 INFO:teuthology.orchestra.run.smithi082.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-08T05:35:17.940 INFO:teuthology.orchestra.run.smithi082.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-05-08T05:35:17.940 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:35:23.610 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-2:19.0.0-3538.gbee299f4.el9.x86_64 1/164 2024-05-08T05:35:23.610 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-base-2:19.0.0-3538.gbee299f4.el9.x86_64 2/164 2024-05-08T05:35:23.611 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-common-2:19.0.0-3538.gbee299f4.el9.x86_64 3/164 2024-05-08T05:35:23.611 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-fuse-2:19.0.0-3538.gbee299f4.el9.x86_64 4/164 2024-05-08T05:35:23.611 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3538.gbee29 5/164 2024-05-08T05:35:23.611 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mds-2:19.0.0-3538.gbee299f4.el9.x86_64 6/164 2024-05-08T05:35:23.611 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-2:19.0.0-3538.gbee299f4.el9.x86_64 7/164 2024-05-08T05:35:23.611 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mon-2:19.0.0-3538.gbee299f4.el9.x86_64 8/164 2024-05-08T05:35:23.611 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-osd-2:19.0.0-3538.gbee299f4.el9.x86_64 9/164 2024-05-08T05:35:23.611 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-radosgw-2:19.0.0-3538.gbee299f4.el9.x86_64 10/164 2024-05-08T05:35:23.611 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-selinux-2:19.0.0-3538.gbee299f4.el9.x86_64 11/164 2024-05-08T05:35:23.611 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-test-2:19.0.0-3538.gbee299f4.el9.x86_64 12/164 2024-05-08T05:35:23.611 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephfs-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 13/164 2024-05-08T05:35:23.611 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephfs-shell-2:19.0.0-3538.gbee299f4.el9.x86_64 14/164 2024-05-08T05:35:23.611 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephfs-devel-2:19.0.0-3538.gbee299f4.el9.x86_ 15/164 2024-05-08T05:35:23.612 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephfs2-2:19.0.0-3538.gbee299f4.el9.x86_64 16/164 2024-05-08T05:35:23.612 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libcephsqlite-2:19.0.0-3538.gbee299f4.el9.x86_64 17/164 2024-05-08T05:35:23.612 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados-devel-2:19.0.0-3538.gbee299f4.el9.x86_6 18/164 2024-05-08T05:35:23.612 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libradosstriper1-2:19.0.0-3538.gbee299f4.el9.x86 19/164 2024-05-08T05:35:23.612 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librgw2-2:19.0.0-3538.gbee299f4.el9.x86_64 20/164 2024-05-08T05:35:23.612 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3538.gbee299f4.el 21/164 2024-05-08T05:35:23.612 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ceph-common-2:19.0.0-3538.gbee299f4.el9. 22/164 2024-05-08T05:35:23.612 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cephfs-2:19.0.0-3538.gbee299f4.el9.x86_6 23/164 2024-05-08T05:35:23.612 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rados-2:19.0.0-3538.gbee299f4.el9.x86_64 24/164 2024-05-08T05:35:23.612 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rbd-2:19.0.0-3538.gbee299f4.el9.x86_64 25/164 2024-05-08T05:35:23.612 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rgw-2:19.0.0-3538.gbee299f4.el9.x86_64 26/164 2024-05-08T05:35:23.612 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-fuse-2:19.0.0-3538.gbee299f4.el9.x86_64 27/164 2024-05-08T05:35:23.612 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 28/164 2024-05-08T05:35:23.625 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : rbd-nbd-2:19.0.0-3538.gbee299f4.el9.x86_64 29/164 2024-05-08T05:35:23.626 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3538.gbee299f4. 30/164 2024-05-08T05:35:23.626 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3538.gbee299f4.el9.noa 31/164 2024-05-08T05:35:23.626 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3538.gbee299f4.el9.n 32/164 2024-05-08T05:35:23.626 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3538.gbee 33/164 2024-05-08T05:35:23.626 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3538.gbee299f4.el 34/164 2024-05-08T05:35:23.626 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3538.gbee299f4.el9.noarch 35/164 2024-05-08T05:35:23.626 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3538.gbee299f4.e 36/164 2024-05-08T05:35:23.626 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : ceph-volume-2:19.0.0-3538.gbee299f4.el9.noarch 37/164 2024-05-08T05:35:23.626 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephadm-2:19.0.0-3538.gbee299f4.el9.noarch 38/164 2024-05-08T05:35:23.626 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : cephfs-top-2:19.0.0-3538.gbee299f4.el9.noarch 39/164 2024-05-08T05:35:23.626 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-08T05:35:23.627 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-08T05:35:23.627 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-08T05:35:23.627 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-08T05:35:23.627 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-08T05:35:23.627 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-08T05:35:23.627 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-08T05:35:23.627 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-08T05:35:23.627 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-08T05:35:23.627 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-08T05:35:23.627 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-08T05:35:23.627 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-08T05:35:23.627 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-08T05:35:23.627 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-08T05:35:23.627 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-08T05:35:23.628 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-08T05:35:23.628 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-08T05:35:23.628 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-08T05:35:23.628 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-08T05:35:23.628 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-08T05:35:23.628 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-08T05:35:23.628 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-08T05:35:23.628 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-08T05:35:23.628 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-08T05:35:23.628 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-08T05:35:23.628 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-08T05:35:23.628 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-08T05:35:23.628 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-08T05:35:23.628 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-08T05:35:23.629 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-08T05:35:23.629 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-08T05:35:23.629 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-08T05:35:23.629 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-08T05:35:23.629 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-08T05:35:23.629 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-08T05:35:23.629 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-08T05:35:23.629 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-08T05:35:23.629 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-08T05:35:23.629 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-08T05:35:23.629 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-08T05:35:23.629 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-08T05:35:23.629 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-08T05:35:23.630 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-08T05:35:23.630 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-08T05:35:23.630 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-08T05:35:23.630 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-08T05:35:23.630 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-08T05:35:23.630 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-08T05:35:23.630 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-08T05:35:23.630 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-08T05:35:23.630 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-08T05:35:23.630 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-08T05:35:23.630 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-08T05:35:23.630 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-08T05:35:23.630 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-08T05:35:23.630 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-08T05:35:23.631 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-08T05:35:23.631 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-08T05:35:23.631 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-08T05:35:23.631 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-08T05:35:23.631 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-08T05:35:23.631 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-08T05:35:23.631 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-08T05:35:23.631 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-08T05:35:23.631 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-08T05:35:23.631 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-08T05:35:23.631 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-08T05:35:23.631 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-08T05:35:23.631 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-08T05:35:23.631 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-08T05:35:23.632 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-08T05:35:23.632 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-08T05:35:23.632 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-08T05:35:23.632 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-08T05:35:23.632 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-08T05:35:23.632 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-08T05:35:23.632 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-08T05:35:23.632 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-08T05:35:23.632 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-08T05:35:23.632 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-08T05:35:23.632 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-08T05:35:23.632 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-08T05:35:23.632 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-08T05:35:23.632 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-08T05:35:23.633 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-08T05:35:23.633 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-08T05:35:23.633 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-08T05:35:23.633 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-08T05:35:23.633 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-08T05:35:23.633 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-08T05:35:23.633 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-08T05:35:23.633 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-08T05:35:23.633 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-08T05:35:23.633 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-08T05:35:23.633 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-08T05:35:23.633 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-08T05:35:23.633 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-08T05:35:23.633 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-08T05:35:23.634 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-08T05:35:23.634 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-08T05:35:23.634 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-08T05:35:23.634 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-08T05:35:23.634 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-08T05:35:23.634 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-08T05:35:23.634 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-08T05:35:23.634 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-08T05:35:23.634 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-08T05:35:23.634 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-08T05:35:23.634 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-08T05:35:23.634 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados2-2:19.0.0-3538.gbee299f4.el9.x86_64 149/164 2024-05-08T05:35:23.634 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-08T05:35:23.634 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librbd1-2:19.0.0-3538.gbee299f4.el9.x86_64 151/164 2024-05-08T05:35:23.635 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-08T05:35:23.635 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-1:1.47.5-1.el9.x86_64 153/164 2024-05-08T05:35:23.635 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-08T05:35:23.635 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-libnm-1:1.47.5-1.el9.x86_64 155/164 2024-05-08T05:35:23.635 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-08T05:35:23.635 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-team-1:1.47.5-1.el9.x86_64 157/164 2024-05-08T05:35:23.635 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-08T05:35:23.635 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-tui-1:1.47.5-1.el9.x86_64 159/164 2024-05-08T05:35:23.635 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-08T05:35:23.635 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-08T05:35:23.635 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-08T05:35:23.635 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-08T05:35:25.915 INFO:teuthology.orchestra.run.smithi082.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-08T05:35:25.915 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:35:25.915 INFO:teuthology.orchestra.run.smithi082.stdout:Upgraded: 2024-05-08T05:35:25.915 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-1:1.47.5-1.el9.x86_64 2024-05-08T05:35:25.915 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-libnm-1:1.47.5-1.el9.x86_64 2024-05-08T05:35:25.915 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-team-1:1.47.5-1.el9.x86_64 2024-05-08T05:35:25.916 INFO:teuthology.orchestra.run.smithi082.stdout: NetworkManager-tui-1:1.47.5-1.el9.x86_64 2024-05-08T05:35:25.916 INFO:teuthology.orchestra.run.smithi082.stdout: librados2-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:25.916 INFO:teuthology.orchestra.run.smithi082.stdout: librbd1-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:25.916 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-08T05:35:25.916 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-08T05:35:25.916 INFO:teuthology.orchestra.run.smithi082.stdout:Installed: 2024-05-08T05:35:25.916 INFO:teuthology.orchestra.run.smithi082.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-08T05:35:25.916 INFO:teuthology.orchestra.run.smithi082.stdout: automake-1.16.2-8.el9.noarch 2024-05-08T05:35:25.916 INFO:teuthology.orchestra.run.smithi082.stdout: bison-3.7.4-5.el9.x86_64 2024-05-08T05:35:25.916 INFO:teuthology.orchestra.run.smithi082.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-08T05:35:25.916 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:25.916 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-base-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:25.916 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-common-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:25.917 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-fuse-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:25.917 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-grafana-dashboards-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:35:25.917 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-immutable-object-cache-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:25.917 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mds-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:25.917 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:25.917 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-cephadm-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:35:25.917 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-dashboard-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:35:25.917 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:35:25.917 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-modules-core-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:35:25.917 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mgr-rook-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:35:25.917 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-mon-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:25.917 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-osd-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:25.917 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-prometheus-alerts-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:35:25.917 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-radosgw-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:25.917 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-selinux-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:25.918 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-test-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:25.918 INFO:teuthology.orchestra.run.smithi082.stdout: ceph-volume-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:35:25.918 INFO:teuthology.orchestra.run.smithi082.stdout: cephadm-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:35:25.918 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:25.918 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-shell-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:25.918 INFO:teuthology.orchestra.run.smithi082.stdout: cephfs-top-2:19.0.0-3538.gbee299f4.el9.noarch 2024-05-08T05:35:25.918 INFO:teuthology.orchestra.run.smithi082.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-08T05:35:25.918 INFO:teuthology.orchestra.run.smithi082.stdout: flex-2.6.4-9.el9.x86_64 2024-05-08T05:35:25.918 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-08T05:35:25.918 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-08T05:35:25.918 INFO:teuthology.orchestra.run.smithi082.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-08T05:35:25.918 INFO:teuthology.orchestra.run.smithi082.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-08T05:35:25.918 INFO:teuthology.orchestra.run.smithi082.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-08T05:35:25.919 INFO:teuthology.orchestra.run.smithi082.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-08T05:35:25.919 INFO:teuthology.orchestra.run.smithi082.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-08T05:35:25.919 INFO:teuthology.orchestra.run.smithi082.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-08T05:35:25.919 INFO:teuthology.orchestra.run.smithi082.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-08T05:35:25.919 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs-devel-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:25.919 INFO:teuthology.orchestra.run.smithi082.stdout: libcephfs2-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:25.919 INFO:teuthology.orchestra.run.smithi082.stdout: libcephsqlite-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:25.919 INFO:teuthology.orchestra.run.smithi082.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-08T05:35:25.919 INFO:teuthology.orchestra.run.smithi082.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-08T05:35:25.919 INFO:teuthology.orchestra.run.smithi082.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-08T05:35:25.919 INFO:teuthology.orchestra.run.smithi082.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-08T05:35:25.919 INFO:teuthology.orchestra.run.smithi082.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-08T05:35:25.919 INFO:teuthology.orchestra.run.smithi082.stdout: librados-devel-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:25.920 INFO:teuthology.orchestra.run.smithi082.stdout: libradosstriper1-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:25.920 INFO:teuthology.orchestra.run.smithi082.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-08T05:35:25.920 INFO:teuthology.orchestra.run.smithi082.stdout: librgw2-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:25.920 INFO:teuthology.orchestra.run.smithi082.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-08T05:35:25.920 INFO:teuthology.orchestra.run.smithi082.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-08T05:35:25.920 INFO:teuthology.orchestra.run.smithi082.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-08T05:35:25.920 INFO:teuthology.orchestra.run.smithi082.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-08T05:35:25.920 INFO:teuthology.orchestra.run.smithi082.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-08T05:35:25.920 INFO:teuthology.orchestra.run.smithi082.stdout: lua-5.4.4-4.el9.x86_64 2024-05-08T05:35:25.920 INFO:teuthology.orchestra.run.smithi082.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-08T05:35:25.920 INFO:teuthology.orchestra.run.smithi082.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-08T05:35:25.920 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-08T05:35:25.920 INFO:teuthology.orchestra.run.smithi082.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-08T05:35:25.920 INFO:teuthology.orchestra.run.smithi082.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-08T05:35:25.920 INFO:teuthology.orchestra.run.smithi082.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-08T05:35:25.921 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-13.14-1.el9.x86_64 2024-05-08T05:35:25.921 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-08T05:35:25.921 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-08T05:35:25.921 INFO:teuthology.orchestra.run.smithi082.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-08T05:35:25.921 INFO:teuthology.orchestra.run.smithi082.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-08T05:35:25.921 INFO:teuthology.orchestra.run.smithi082.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-08T05:35:25.921 INFO:teuthology.orchestra.run.smithi082.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-08T05:35:25.921 INFO:teuthology.orchestra.run.smithi082.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-08T05:35:25.921 INFO:teuthology.orchestra.run.smithi082.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-08T05:35:25.921 INFO:teuthology.orchestra.run.smithi082.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-08T05:35:25.921 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-08T05:35:25.921 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-argparse-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:25.921 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ceph-common-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:25.921 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cephfs-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:25.922 INFO:teuthology.orchestra.run.smithi082.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-08T05:35:25.922 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-08T05:35:25.922 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-08T05:35:25.922 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-08T05:35:25.922 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-08T05:35:25.922 INFO:teuthology.orchestra.run.smithi082.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-08T05:35:25.922 INFO:teuthology.orchestra.run.smithi082.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-08T05:35:25.922 INFO:teuthology.orchestra.run.smithi082.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-08T05:35:25.922 INFO:teuthology.orchestra.run.smithi082.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-08T05:35:25.922 INFO:teuthology.orchestra.run.smithi082.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-08T05:35:25.922 INFO:teuthology.orchestra.run.smithi082.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-08T05:35:25.922 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-08T05:35:25.922 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-08T05:35:25.922 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-08T05:35:25.923 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-08T05:35:25.923 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-08T05:35:25.923 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-08T05:35:25.923 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-08T05:35:25.923 INFO:teuthology.orchestra.run.smithi082.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-08T05:35:25.923 INFO:teuthology.orchestra.run.smithi082.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-08T05:35:25.923 INFO:teuthology.orchestra.run.smithi082.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-08T05:35:25.923 INFO:teuthology.orchestra.run.smithi082.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-08T05:35:25.923 INFO:teuthology.orchestra.run.smithi082.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-08T05:35:25.923 INFO:teuthology.orchestra.run.smithi082.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-08T05:35:25.923 INFO:teuthology.orchestra.run.smithi082.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-08T05:35:25.923 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-08T05:35:25.923 INFO:teuthology.orchestra.run.smithi082.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-08T05:35:25.923 INFO:teuthology.orchestra.run.smithi082.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-08T05:35:25.924 INFO:teuthology.orchestra.run.smithi082.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-08T05:35:25.924 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-08T05:35:25.924 INFO:teuthology.orchestra.run.smithi082.stdout: python3-ply-3.11-14.el9.noarch 2024-05-08T05:35:25.924 INFO:teuthology.orchestra.run.smithi082.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-08T05:35:25.924 INFO:teuthology.orchestra.run.smithi082.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-08T05:35:25.924 INFO:teuthology.orchestra.run.smithi082.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-08T05:35:25.924 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-08T05:35:25.924 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-08T05:35:25.924 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-08T05:35:25.924 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-08T05:35:25.924 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-08T05:35:25.924 INFO:teuthology.orchestra.run.smithi082.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-08T05:35:25.924 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rados-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:25.924 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rbd-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:25.924 INFO:teuthology.orchestra.run.smithi082.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-08T05:35:25.925 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-08T05:35:25.925 INFO:teuthology.orchestra.run.smithi082.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-08T05:35:25.925 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rgw-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:25.925 INFO:teuthology.orchestra.run.smithi082.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-08T05:35:25.925 INFO:teuthology.orchestra.run.smithi082.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-08T05:35:25.925 INFO:teuthology.orchestra.run.smithi082.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-08T05:35:25.925 INFO:teuthology.orchestra.run.smithi082.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-08T05:35:25.925 INFO:teuthology.orchestra.run.smithi082.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-08T05:35:25.925 INFO:teuthology.orchestra.run.smithi082.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-08T05:35:25.925 INFO:teuthology.orchestra.run.smithi082.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-08T05:35:25.925 INFO:teuthology.orchestra.run.smithi082.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-08T05:35:25.925 INFO:teuthology.orchestra.run.smithi082.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-08T05:35:25.925 INFO:teuthology.orchestra.run.smithi082.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-08T05:35:25.925 INFO:teuthology.orchestra.run.smithi082.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-08T05:35:25.926 INFO:teuthology.orchestra.run.smithi082.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-08T05:35:25.926 INFO:teuthology.orchestra.run.smithi082.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-08T05:35:25.926 INFO:teuthology.orchestra.run.smithi082.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-08T05:35:25.926 INFO:teuthology.orchestra.run.smithi082.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-08T05:35:25.926 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-fuse-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:25.926 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-mirror-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:25.926 INFO:teuthology.orchestra.run.smithi082.stdout: rbd-nbd-2:19.0.0-3538.gbee299f4.el9.x86_64 2024-05-08T05:35:25.926 INFO:teuthology.orchestra.run.smithi082.stdout: re2-1:20211101-3.el9.x86_64 2024-05-08T05:35:25.926 INFO:teuthology.orchestra.run.smithi082.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-08T05:35:25.926 INFO:teuthology.orchestra.run.smithi082.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-08T05:35:25.926 INFO:teuthology.orchestra.run.smithi082.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-08T05:35:25.926 INFO:teuthology.orchestra.run.smithi082.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-08T05:35:25.926 INFO:teuthology.orchestra.run.smithi082.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-08T05:35:25.927 INFO:teuthology.orchestra.run.smithi082.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-08T05:35:25.927 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:35:25.927 INFO:teuthology.orchestra.run.smithi082.stdout:Complete! 2024-05-08T05:35:26.547 DEBUG:teuthology.parallel:result is None 2024-05-08T05:35:26.547 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bee299f4ac344e4c45e550d7a80abcadd7bc3d5a 2024-05-08T05:35:26.773 DEBUG:teuthology.orchestra.run.smithi082:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-08T05:35:26.823 INFO:teuthology.orchestra.run.smithi082.stdout:19.0.0-3538.gbee299f4.el9 2024-05-08T05:35:26.824 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3538.gbee299f4.el9 2024-05-08T05:35:26.824 INFO:teuthology.task.install:The correct ceph version 19.0.0-3538.gbee299f4 is installed. 2024-05-08T05:35:26.826 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bee299f4ac344e4c45e550d7a80abcadd7bc3d5a 2024-05-08T05:35:26.962 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-08T05:35:26.988 INFO:teuthology.orchestra.run.smithi134.stdout:19.0.0-3538.gbee299f4.el9 2024-05-08T05:35:26.989 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3538.gbee299f4.el9 2024-05-08T05:35:26.989 INFO:teuthology.task.install:The correct ceph version 19.0.0-3538.gbee299f4 is installed. 2024-05-08T05:35:26.990 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bee299f4ac344e4c45e550d7a80abcadd7bc3d5a 2024-05-08T05:35:27.203 DEBUG:teuthology.orchestra.run.smithi151:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-08T05:35:27.229 INFO:teuthology.orchestra.run.smithi151.stdout:19.0.0-3538.gbee299f4.el9 2024-05-08T05:35:27.230 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3538.gbee299f4.el9 2024-05-08T05:35:27.230 INFO:teuthology.task.install:The correct ceph version 19.0.0-3538.gbee299f4 is installed. 2024-05-08T05:35:27.232 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-08T05:35:27.232 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-08T05:35:27.232 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-08T05:35:27.295 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-05-08T05:35:27.295 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-08T05:35:27.327 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-05-08T05:35:27.328 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-08T05:35:27.357 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-08T05:35:27.358 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-08T05:35:27.358 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/daemon-helper 2024-05-08T05:35:27.416 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-08T05:35:27.521 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-05-08T05:35:27.521 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/daemon-helper 2024-05-08T05:35:27.549 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-08T05:35:27.616 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-05-08T05:35:27.616 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/daemon-helper 2024-05-08T05:35:27.645 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-08T05:35:27.712 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-08T05:35:27.712 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-08T05:35:27.712 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-08T05:35:27.773 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-08T05:35:27.875 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-05-08T05:35:27.875 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-08T05:35:27.904 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-08T05:35:27.971 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-05-08T05:35:27.971 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-08T05:35:28.000 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-08T05:35:28.067 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-08T05:35:28.067 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-08T05:35:28.067 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/usr/bin/stdin-killer 2024-05-08T05:35:28.142 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-08T05:35:28.254 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-05-08T05:35:28.254 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/stdin-killer 2024-05-08T05:35:28.282 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-08T05:35:28.350 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-05-08T05:35:28.350 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/stdin-killer 2024-05-08T05:35:28.379 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-08T05:35:28.446 INFO:teuthology.run_tasks:Running task cephadm... 2024-05-08T05:35:28.550 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_export_ephemeral_random_max': 0.1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': 'bee299f4ac344e4c45e550d7a80abcadd7bc3d5a', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-05-08T05:35:28.550 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a 2024-05-08T05:35:28.551 INFO:tasks.cephadm:Cluster fsid is c739a5c8-0cfc-11ef-bc97-c7b262605968 2024-05-08T05:35:28.551 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-05-08T05:35:28.551 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.82', 'mon.b': '172.21.15.134', 'mon.c': '172.21.15.151'} 2024-05-08T05:35:28.551 INFO:tasks.cephadm:First mon is mon.a on smithi082 2024-05-08T05:35:28.551 INFO:tasks.cephadm:First mgr is x 2024-05-08T05:35:28.551 INFO:tasks.cephadm:Normalizing hostnames... 2024-05-08T05:35:28.552 DEBUG:teuthology.orchestra.run.smithi082:> sudo hostname $(hostname -s) 2024-05-08T05:35:28.627 DEBUG:teuthology.orchestra.run.smithi134:> sudo hostname $(hostname -s) 2024-05-08T05:35:28.656 DEBUG:teuthology.orchestra.run.smithi151:> sudo hostname $(hostname -s) 2024-05-08T05:35:28.684 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-05-08T05:35:28.685 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bee299f4ac344e4c45e550d7a80abcadd7bc3d5a 2024-05-08T05:35:28.897 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'bee299f4ac344e4c45e550d7a80abcadd7bc3d5a', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/79166/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-3538-gbee299f4', 'node_name': '172.21.5.39+adami09', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-3538.gbee299f4'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-57676-3/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-05-07 17:50:48.409840', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-57676-3', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-57676-3/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-05-08T05:35:29.115 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref wip-57676-3, sha1 bee299f4ac344e4c45e550d7a80abcadd7bc3d5a from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=bee299f4ac344e4c45e550d7a80abcadd7bc3d5a 2024-05-08T05:35:29.116 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/wip-57676-3/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/centos/9/x86_64/flavors/default/cephadm 2024-05-08T05:35:29.117 DEBUG:teuthology.orchestra.run.smithi082:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-57676-3/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-08T05:35:30.736 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-r--r--. 1 ubuntu ubuntu 782795 May 8 05:35 /home/ubuntu/cephtest/cephadm 2024-05-08T05:35:30.737 DEBUG:teuthology.orchestra.run.smithi134:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-57676-3/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-08T05:35:32.274 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r--. 1 ubuntu ubuntu 782795 May 8 05:35 /home/ubuntu/cephtest/cephadm 2024-05-08T05:35:32.275 DEBUG:teuthology.orchestra.run.smithi151:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-57676-3/bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-08T05:35:34.314 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-r--r--. 1 ubuntu ubuntu 782795 May 8 05:35 /home/ubuntu/cephtest/cephadm 2024-05-08T05:35:34.314 DEBUG:teuthology.orchestra.run.smithi082:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-08T05:35:34.372 DEBUG:teuthology.orchestra.run.smithi134:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-08T05:35:34.391 DEBUG:teuthology.orchestra.run.smithi151:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-08T05:35:34.428 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a on all hosts... 2024-05-08T05:35:34.429 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a pull 2024-05-08T05:35:34.437 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a pull 2024-05-08T05:35:34.439 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a pull 2024-05-08T05:35:35.961 INFO:teuthology.orchestra.run.smithi134.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a... 2024-05-08T05:35:36.018 INFO:teuthology.orchestra.run.smithi151.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a... 2024-05-08T05:35:36.343 INFO:teuthology.orchestra.run.smithi082.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a... 2024-05-08T05:36:03.575 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T05:36:03.576 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_version": "ceph version 19.0.0-3538-gbee299f4 (bee299f4ac344e4c45e550d7a80abcadd7bc3d5a) squid (dev)", 2024-05-08T05:36:03.576 INFO:teuthology.orchestra.run.smithi151.stdout: "image_id": "352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce", 2024-05-08T05:36:03.576 INFO:teuthology.orchestra.run.smithi151.stdout: "repo_digests": [ 2024-05-08T05:36:03.576 INFO:teuthology.orchestra.run.smithi151.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c" 2024-05-08T05:36:03.576 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-05-08T05:36:03.577 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T05:36:11.858 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-05-08T05:36:11.858 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_version": "ceph version 19.0.0-3538-gbee299f4 (bee299f4ac344e4c45e550d7a80abcadd7bc3d5a) squid (dev)", 2024-05-08T05:36:11.858 INFO:teuthology.orchestra.run.smithi134.stdout: "image_id": "352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce", 2024-05-08T05:36:11.858 INFO:teuthology.orchestra.run.smithi134.stdout: "repo_digests": [ 2024-05-08T05:36:11.858 INFO:teuthology.orchestra.run.smithi134.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c" 2024-05-08T05:36:11.858 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-05-08T05:36:11.858 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-05-08T05:36:15.506 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T05:36:15.506 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_version": "ceph version 19.0.0-3538-gbee299f4 (bee299f4ac344e4c45e550d7a80abcadd7bc3d5a) squid (dev)", 2024-05-08T05:36:15.506 INFO:teuthology.orchestra.run.smithi082.stdout: "image_id": "352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce", 2024-05-08T05:36:15.506 INFO:teuthology.orchestra.run.smithi082.stdout: "repo_digests": [ 2024-05-08T05:36:15.506 INFO:teuthology.orchestra.run.smithi082.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c" 2024-05-08T05:36:15.506 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-05-08T05:36:15.506 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T05:36:15.570 DEBUG:teuthology.orchestra.run.smithi082:> sudo mkdir -p /etc/ceph 2024-05-08T05:36:15.660 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /etc/ceph 2024-05-08T05:36:15.691 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /etc/ceph 2024-05-08T05:36:15.724 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 777 /etc/ceph 2024-05-08T05:36:15.812 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 777 /etc/ceph 2024-05-08T05:36:15.841 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 777 /etc/ceph 2024-05-08T05:36:15.869 INFO:tasks.cephadm:Writing seed config... 2024-05-08T05:36:15.872 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-05-08T05:36:15.872 INFO:tasks.cephadm: override: [client] debug client = 20 2024-05-08T05:36:15.872 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-05-08T05:36:15.872 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-05-08T05:36:15.872 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-05-08T05:36:15.873 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-05-08T05:36:15.873 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-05-08T05:36:15.873 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-05-08T05:36:15.873 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-05-08T05:36:15.873 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-05-08T05:36:15.873 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-05-08T05:36:15.874 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-05-08T05:36:15.874 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-05-08T05:36:15.874 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-05-08T05:36:15.874 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-05-08T05:36:15.874 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-05-08T05:36:15.875 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-05-08T05:36:15.875 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-05-08T05:36:15.875 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-05-08T05:36:15.875 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-05-08T05:36:15.875 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-05-08T05:36:15.875 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-05-08T05:36:15.876 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-05-08T05:36:15.876 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-05-08T05:36:15.876 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-05-08T05:36:15.876 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-05-08T05:36:15.876 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-05-08T05:36:15.877 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-05-08T05:36:15.877 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-05-08T05:36:15.877 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-05-08T05:36:15.877 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-05-08T05:36:15.877 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-05-08T05:36:15.878 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-05-08T05:36:15.878 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-05-08T05:36:15.878 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-05-08T05:36:15.878 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-05-08T05:36:15.878 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-05-08T05:36:15.878 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-05-08T05:36:15.879 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-05-08T05:36:15.879 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-05-08T05:36:15.879 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-05-08T05:36:15.879 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-05-08T05:36:15.879 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-05-08T05:36:15.880 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-05-08T05:36:15.880 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-05-08T05:36:15.880 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-05-08T05:36:15.881 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-08T05:36:15.882 DEBUG:teuthology.orchestra.run.smithi082:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-05-08T05:36:15.940 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = c739a5c8-0cfc-11ef-bc97-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_export_ephemeral_random_max = 0.1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-05-08T05:36:15.940 DEBUG:teuthology.orchestra.run.smithi082:mon.a> sudo journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mon.a.service 2024-05-08T05:36:15.986 DEBUG:teuthology.orchestra.run.smithi082:mgr.x> sudo journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mgr.x.service 2024-05-08T05:36:16.032 INFO:tasks.cephadm:Bootstrapping... 2024-05-08T05:36:16.032 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a -v bootstrap --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.82 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-05-08T05:36:16.309 INFO:teuthology.orchestra.run.smithi082.stdout:-------------------------------------------------------------------------------- 2024-05-08T05:36:16.309 INFO:teuthology.orchestra.run.smithi082.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a', '-v', 'bootstrap', '--fsid', 'c739a5c8-0cfc-11ef-bc97-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.82', '--skip-admin-label'] 2024-05-08T05:36:16.309 INFO:teuthology.orchestra.run.smithi082.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-05-08T05:36:16.309 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying podman|docker is present... 2024-05-08T05:36:16.410 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stdout 4.9.4-dev 2024-05-08T05:36:16.410 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying lvm2 is present... 2024-05-08T05:36:16.411 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying time synchronization is in place... 2024-05-08T05:36:16.426 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-05-08T05:36:16.426 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-05-08T05:36:16.440 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-05-08T05:36:16.440 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout inactive 2024-05-08T05:36:16.456 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout enabled 2024-05-08T05:36:16.472 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout active 2024-05-08T05:36:16.472 INFO:teuthology.orchestra.run.smithi082.stdout:Unit chronyd.service is enabled and running 2024-05-08T05:36:16.473 INFO:teuthology.orchestra.run.smithi082.stdout:Repeating the final host check... 2024-05-08T05:36:16.782 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stdout 4.9.4-dev 2024-05-08T05:36:16.782 INFO:teuthology.orchestra.run.smithi082.stdout:podman (/bin/podman) version 4.9.4 is present 2024-05-08T05:36:16.782 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl is present 2024-05-08T05:36:16.782 INFO:teuthology.orchestra.run.smithi082.stdout:lvcreate is present 2024-05-08T05:36:16.798 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-05-08T05:36:16.798 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-05-08T05:36:16.815 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-05-08T05:36:16.815 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout inactive 2024-05-08T05:36:16.836 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout enabled 2024-05-08T05:36:16.853 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout active 2024-05-08T05:36:16.853 INFO:teuthology.orchestra.run.smithi082.stdout:Unit chronyd.service is enabled and running 2024-05-08T05:36:16.853 INFO:teuthology.orchestra.run.smithi082.stdout:Host looks OK 2024-05-08T05:36:16.854 INFO:teuthology.orchestra.run.smithi082.stdout:Cluster fsid: c739a5c8-0cfc-11ef-bc97-c7b262605968 2024-05-08T05:36:16.854 INFO:teuthology.orchestra.run.smithi082.stdout:Acquiring lock 140465837964736 on /run/cephadm/c739a5c8-0cfc-11ef-bc97-c7b262605968.lock 2024-05-08T05:36:16.854 INFO:teuthology.orchestra.run.smithi082.stdout:Lock 140465837964736 acquired on /run/cephadm/c739a5c8-0cfc-11ef-bc97-c7b262605968.lock 2024-05-08T05:36:16.855 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying IP 172.21.15.82 port 3300 ... 2024-05-08T05:36:16.856 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying IP 172.21.15.82 port 6789 ... 2024-05-08T05:36:16.856 INFO:teuthology.orchestra.run.smithi082.stdout:Base mon IP(s) is [172.21.15.82:3300, 172.21.15.82:6789], mon addrv is [v2:172.21.15.82:3300,v1:172.21.15.82:6789] 2024-05-08T05:36:16.865 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.82 metric 100 2024-05-08T05:36:16.865 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.82 metric 100 2024-05-08T05:36:16.874 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-05-08T05:36:16.874 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2024-05-08T05:36:16.874 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1798sec hoplimit 64 pref medium 2024-05-08T05:36:16.882 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-05-08T05:36:16.882 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-05-08T05:36:16.883 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-05-08T05:36:16.883 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-05-08T05:36:16.883 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link 2024-05-08T05:36:16.883 INFO:teuthology.orchestra.run.smithi082.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-05-08T05:36:16.885 INFO:teuthology.orchestra.run.smithi082.stdout:Mon IP `172.21.15.82` is in CIDR network `172.21.0.0/20` 2024-05-08T05:36:16.885 INFO:teuthology.orchestra.run.smithi082.stdout:Mon IP `172.21.15.82` is in CIDR network `172.21.0.0/20` 2024-05-08T05:36:16.885 INFO:teuthology.orchestra.run.smithi082.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-05-08T05:36:16.887 INFO:teuthology.orchestra.run.smithi082.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-05-08T05:36:16.889 INFO:teuthology.orchestra.run.smithi082.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a... 2024-05-08T05:36:26.552 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stdout 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce 2024-05-08T05:36:26.553 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a... 2024-05-08T05:36:26.553 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stderr Getting image source signatures 2024-05-08T05:36:26.553 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stderr Copying blob sha256:bf5b95bd68251da39c6cd2eb96c6ba4138bb37a62bdc39287908b25e92047d7e 2024-05-08T05:36:26.553 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stderr Copying blob sha256:f08a3efca46759c0efc03dda6bb4c9adf7daf77004822005f2f0da3e8d1877bb 2024-05-08T05:36:26.553 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stderr Copying config sha256:352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce 2024-05-08T05:36:26.553 INFO:teuthology.orchestra.run.smithi082.stdout:/bin/podman: stderr Writing manifest to image destination 2024-05-08T05:36:28.053 INFO:teuthology.orchestra.run.smithi082.stdout:ceph: stdout ceph version 19.0.0-3538-gbee299f4 (bee299f4ac344e4c45e550d7a80abcadd7bc3d5a) squid (dev) 2024-05-08T05:36:28.054 INFO:teuthology.orchestra.run.smithi082.stdout:Ceph version: ceph version 19.0.0-3538-gbee299f4 (bee299f4ac344e4c45e550d7a80abcadd7bc3d5a) squid (dev) 2024-05-08T05:36:28.054 INFO:teuthology.orchestra.run.smithi082.stdout:Extracting ceph user uid/gid from container image... 2024-05-08T05:36:29.216 INFO:teuthology.orchestra.run.smithi082.stdout:stat: stdout 167 167 2024-05-08T05:36:29.217 INFO:teuthology.orchestra.run.smithi082.stdout:Creating initial keys... 2024-05-08T05:36:30.389 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph-authtool: stdout AQBdDztmPddgKxAAVMVQGZmO/FU8FWLXU9LjzQ== 2024-05-08T05:36:31.761 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph-authtool: stdout AQBeDztmq7giNBAAJf2ty6UPnMHj+c6ek5xTRg== 2024-05-08T05:36:32.901 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph-authtool: stdout AQBgDztmkEZqDhAA+L/rpuDl7WA6rRnRjsJYRg== 2024-05-08T05:36:32.903 INFO:teuthology.orchestra.run.smithi082.stdout:Creating initial monmap... 2024-05-08T05:36:34.038 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-05-08T05:36:34.038 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-05-08T05:36:34.038 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to c739a5c8-0cfc-11ef-bc97-c7b262605968 2024-05-08T05:36:34.039 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-05-08T05:36:34.039 INFO:teuthology.orchestra.run.smithi082.stdout:monmaptool for a [v2:172.21.15.82:3300,v1:172.21.15.82:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-05-08T05:36:34.039 INFO:teuthology.orchestra.run.smithi082.stdout:setting min_mon_release = quincy 2024-05-08T05:36:34.039 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/monmaptool: set fsid to c739a5c8-0cfc-11ef-bc97-c7b262605968 2024-05-08T05:36:34.039 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-05-08T05:36:34.039 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:36:34.039 INFO:teuthology.orchestra.run.smithi082.stdout:Creating mon... 2024-05-08T05:36:35.174 INFO:teuthology.orchestra.run.smithi082.stdout:create mon.a on 2024-05-08T05:36:35.545 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-05-08T05:36:35.782 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-05-08T05:36:36.063 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968.target → /etc/systemd/system/ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968.target. 2024-05-08T05:36:36.063 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968.target → /etc/systemd/system/ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968.target. 2024-05-08T05:36:36.410 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mon.a 2024-05-08T05:36:36.410 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Failed to reset failed state of unit ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mon.a.service: Unit ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mon.a.service not loaded. 2024-05-08T05:36:36.687 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968.target.wants/ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mon.a.service → /etc/systemd/system/ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@.service. 2024-05-08T05:36:37.355 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:37 smithi082 podman[29713]: 2024-05-08 05:36:36.984934296 +0000 UTC m=+0.035235544 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a 2024-05-08T05:36:37.356 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:37 smithi082 podman[29713]: 2024-05-08 05:36:37.354192154 +0000 UTC m=+0.404493421 container init 098a385f6cb56b5d6484dcf08319a2a758b3d0838546095bbf788dffe4eceea6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mon-a, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-57676-3-bee299f) 2024-05-08T05:36:37.495 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-08T05:36:37.495 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout disabled 2024-05-08T05:36:37.511 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-08T05:36:37.511 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout inactive 2024-05-08T05:36:37.511 INFO:teuthology.orchestra.run.smithi082.stdout:firewalld.service is not enabled 2024-05-08T05:36:37.511 INFO:teuthology.orchestra.run.smithi082.stdout:Not possible to enable service . firewalld.service is not available 2024-05-08T05:36:37.511 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for mon to start... 2024-05-08T05:36:37.512 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for mon... 2024-05-08T05:36:37.665 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:37 smithi082 podman[29713]: 2024-05-08 05:36:37.364891594 +0000 UTC m=+0.415192823 container start 098a385f6cb56b5d6484dcf08319a2a758b3d0838546095bbf788dffe4eceea6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mon-a, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, RELEASE=wip-57676-3-bee299f, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-08T05:36:37.665 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:37 smithi082 ceph-mon[29732]: mkfs c739a5c8-0cfc-11ef-bc97-c7b262605968 2024-05-08T05:36:37.665 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:37 smithi082 ceph-mon[29732]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-08T05:36:37.665 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:37 smithi082 bash[29713]: 098a385f6cb56b5d6484dcf08319a2a758b3d0838546095bbf788dffe4eceea6 2024-05-08T05:36:37.665 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:37 smithi082 systemd[1]: Started Ceph mon.a for c739a5c8-0cfc-11ef-bc97-c7b262605968. 2024-05-08T05:36:38.595 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:38 smithi082 ceph-mon[29732]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-08T05:36:38.595 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:38 smithi082 ceph-mon[29732]: monmap epoch 1 2024-05-08T05:36:38.595 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:38 smithi082 ceph-mon[29732]: fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 2024-05-08T05:36:38.595 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:38 smithi082 ceph-mon[29732]: last_changed 2024-05-08T05:36:33.349539+0000 2024-05-08T05:36:38.595 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:38 smithi082 ceph-mon[29732]: created 2024-05-08T05:36:33.349539+0000 2024-05-08T05:36:38.595 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:38 smithi082 ceph-mon[29732]: min_mon_release 19 (squid) 2024-05-08T05:36:38.595 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:38 smithi082 ceph-mon[29732]: election_strategy: 1 2024-05-08T05:36:38.596 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:38 smithi082 ceph-mon[29732]: 0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.a 2024-05-08T05:36:38.596 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:38 smithi082 ceph-mon[29732]: fsmap 2024-05-08T05:36:38.596 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:38 smithi082 ceph-mon[29732]: osdmap e1: 0 total, 0 up, 0 in 2024-05-08T05:36:38.596 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:38 smithi082 ceph-mon[29732]: mgrmap e1: no daemons active 2024-05-08T05:36:38.596 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:38 smithi082 ceph-mon[29732]: from='client.? 172.21.15.82:0/164519240' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-05-08T05:36:38.877 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout cluster: 2024-05-08T05:36:38.878 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout id: c739a5c8-0cfc-11ef-bc97-c7b262605968 2024-05-08T05:36:38.878 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-05-08T05:36:38.878 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-05-08T05:36:38.878 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout services: 2024-05-08T05:36:38.878 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.794277s) 2024-05-08T05:36:38.878 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-05-08T05:36:38.879 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-05-08T05:36:38.879 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-05-08T05:36:38.880 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout data: 2024-05-08T05:36:38.880 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-05-08T05:36:38.880 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-05-08T05:36:38.880 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-05-08T05:36:38.880 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout pgs: 2024-05-08T05:36:38.883 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-05-08T05:36:38.883 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:38.143+0000 7fb79fc00700 1 Processor -- start 2024-05-08T05:36:38.883 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:38.143+0000 7fb79fc00700 1 -- start start 2024-05-08T05:36:38.883 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:38.144+0000 7fb79fc00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb79810b160 0x7fb79810b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:36:38.884 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:38.144+0000 7fb79fc00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb79810bb50 con 0x7fb79810b160 2024-05-08T05:36:38.884 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:38.145+0000 7fb79d200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb79810b160 0x7fb79810b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:36:38.884 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:38.146+0000 7fb79d200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb79810b160 0x7fb79810b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55694/0 (socket says 172.21.15.82:55694) 2024-05-08T05:36:38.884 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:38.146+0000 7fb79d200700 1 -- 172.21.15.82:0/4194964764 learned_addr learned my addr 172.21.15.82:0/4194964764 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:36:38.884 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:38.146+0000 7fb79d200700 1 -- 172.21.15.82:0/4194964764 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb79810c1f0 con 0x7fb79810b160 2024-05-08T05:36:38.884 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:38.146+0000 7fb79d200700 1 --2- 172.21.15.82:0/4194964764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb79810b160 0x7fb79810b580 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fb78c0098a0 tx=0x7fb78c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16ba45916371e986 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:36:38.884 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:38.147+0000 7fb797400700 1 -- 172.21.15.82:0/4194964764 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb78c004160 con 0x7fb79810b160 2024-05-08T05:36:38.884 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:38.147+0000 7fb797400700 1 -- 172.21.15.82:0/4194964764 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb78c004300 con 0x7fb79810b160 2024-05-08T05:36:38.884 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:38.147+0000 7fb797400700 1 -- 172.21.15.82:0/4194964764 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb78c0036a0 con 0x7fb79810b160 2024-05-08T05:36:38.884 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:38.147+0000 7fb79fc00700 1 -- 172.21.15.82:0/4194964764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb79810b160 msgr2=0x7fb79810b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:36:38.884 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:38.147+0000 7fb79fc00700 1 --2- 172.21.15.82:0/4194964764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb79810b160 0x7fb79810b580 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fb78c0098a0 tx=0x7fb78c009bb0 comp rx=0 tx=0).stop 2024-05-08T05:36:38.884 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:38.147+0000 7fb79fc00700 1 -- 172.21.15.82:0/4194964764 shutdown_connections 2024-05-08T05:36:38.884 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:38.147+0000 7fb79fc00700 1 --2- 172.21.15.82:0/4194964764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb79810b160 0x7fb79810b580 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:36:38.885 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:38.147+0000 7fb79fc00700 1 -- 172.21.15.82:0/4194964764 >> 172.21.15.82:0/4194964764 conn(0x7fb79807e3a0 msgr2=0x7fb79807e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:36:38.885 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:38.148+0000 7fb79fc00700 1 -- 172.21.15.82:0/4194964764 shutdown_connections 2024-05-08T05:36:38.885 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:38.148+0000 7fb79fc00700 1 -- 172.21.15.82:0/4194964764 wait complete. 2024-05-08T05:36:38.885 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:38.149+0000 7fb79fc00700 1 Processor -- start 2024-05-08T05:36:38.885 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:38.149+0000 7fb79fc00700 1 -- start start 2024-05-08T05:36:38.885 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:38.149+0000 7fb79fc00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb79810b160 0x7fb79819e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:36:38.885 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:38.149+0000 7fb79fc00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb79810c720 con 0x7fb79810b160 2024-05-08T05:36:38.885 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:38.149+0000 7fb79d200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb79810b160 0x7fb79819e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:36:38.885 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:38.149+0000 7fb79d200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb79810b160 0x7fb79819e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55710/0 (socket says 172.21.15.82:55710) 2024-05-08T05:36:38.885 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:38.149+0000 7fb79d200700 1 -- 172.21.15.82:0/164519240 learned_addr learned my addr 172.21.15.82:0/164519240 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:36:38.885 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:38.150+0000 7fb79d200700 1 -- 172.21.15.82:0/164519240 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb79819ec50 con 0x7fb79810b160 2024-05-08T05:36:38.888 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:38.150+0000 7fb79d200700 1 --2- 172.21.15.82:0/164519240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb79810b160 0x7fb79819e710 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fb78c000c00 tx=0x7fb78c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:36:38.888 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:38.150+0000 7fb795600700 1 -- 172.21.15.82:0/164519240 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb78c003db0 con 0x7fb79810b160 2024-05-08T05:36:38.888 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:38.150+0000 7fb795600700 1 -- 172.21.15.82:0/164519240 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb78c011630 con 0x7fb79810b160 2024-05-08T05:36:38.888 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:38.150+0000 7fb79fc00700 1 -- 172.21.15.82:0/164519240 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb79819eee0 con 0x7fb79810b160 2024-05-08T05:36:38.888 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:38.150+0000 7fb795600700 1 -- 172.21.15.82:0/164519240 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb78c011950 con 0x7fb79810b160 2024-05-08T05:36:38.888 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:38.151+0000 7fb79fc00700 1 -- 172.21.15.82:0/164519240 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7981a1bd0 con 0x7fb79810b160 2024-05-08T05:36:38.888 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:38.151+0000 7fb795600700 1 -- 172.21.15.82:0/164519240 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb78c011af0 con 0x7fb79810b160 2024-05-08T05:36:38.888 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:38.151+0000 7fb795600700 1 -- 172.21.15.82:0/164519240 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb78c01c450 con 0x7fb79810b160 2024-05-08T05:36:38.888 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:38.152+0000 7fb79fc00700 1 -- 172.21.15.82:0/164519240 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb79806a5c0 con 0x7fb79810b160 2024-05-08T05:36:38.888 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:38.155+0000 7fb795600700 1 -- 172.21.15.82:0/164519240 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fb78c032020 con 0x7fb79810b160 2024-05-08T05:36:38.888 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:38.233+0000 7fb79fc00700 1 -- 172.21.15.82:0/164519240 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7fb79802e690 con 0x7fb79810b160 2024-05-08T05:36:38.888 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:38.234+0000 7fb795600700 1 -- 172.21.15.82:0/164519240 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7fb78c004260 con 0x7fb79810b160 2024-05-08T05:36:38.888 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:38.235+0000 7fb79fc00700 1 -- 172.21.15.82:0/164519240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb79810b160 msgr2=0x7fb79819e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:36:38.889 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:38.235+0000 7fb79fc00700 1 --2- 172.21.15.82:0/164519240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb79810b160 0x7fb79819e710 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fb78c000c00 tx=0x7fb78c004750 comp rx=0 tx=0).stop 2024-05-08T05:36:38.889 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:38.235+0000 7fb79fc00700 1 -- 172.21.15.82:0/164519240 shutdown_connections 2024-05-08T05:36:38.889 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:38.235+0000 7fb79fc00700 1 --2- 172.21.15.82:0/164519240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb79810b160 0x7fb79819e710 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:36:38.889 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:38.235+0000 7fb79fc00700 1 -- 172.21.15.82:0/164519240 >> 172.21.15.82:0/164519240 conn(0x7fb79807e3a0 msgr2=0x7fb7981953a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:36:38.889 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:38.235+0000 7fb79fc00700 1 -- 172.21.15.82:0/164519240 shutdown_connections 2024-05-08T05:36:38.889 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:38.235+0000 7fb79fc00700 1 -- 172.21.15.82:0/164519240 wait complete. 2024-05-08T05:36:38.889 INFO:teuthology.orchestra.run.smithi082.stdout:mon is available 2024-05-08T05:36:38.889 INFO:teuthology.orchestra.run.smithi082.stdout:Assimilating anything we can from ceph.conf... 2024-05-08T05:36:39.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:39 smithi082 ceph-mon[29732]: from='client.? 172.21.15.82:0/1235911324' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-05-08T05:36:39.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:39 smithi082 ceph-mon[29732]: from='client.? 172.21.15.82:0/1235911324' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-05-08T05:36:40.183 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-05-08T05:36:40.183 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout [global] 2024-05-08T05:36:40.183 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout fsid = c739a5c8-0cfc-11ef-bc97-c7b262605968 2024-05-08T05:36:40.183 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-05-08T05:36:40.190 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.82:3300,v1:172.21.15.82:6789] 2024-05-08T05:36:40.190 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-05-08T05:36:40.190 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-05-08T05:36:40.190 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-05-08T05:36:40.190 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-05-08T05:36:40.190 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-05-08T05:36:40.190 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout [mgr] 2024-05-08T05:36:40.190 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-05-08T05:36:40.190 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-05-08T05:36:40.190 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout [osd] 2024-05-08T05:36:40.190 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-05-08T05:36:40.190 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-05-08T05:36:40.191 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-05-08T05:36:40.191 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-05-08T05:36:40.191 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-05-08T05:36:40.191 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:39.450+0000 7f4478400700 1 Processor -- start 2024-05-08T05:36:40.191 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:39.450+0000 7f4478400700 1 -- start start 2024-05-08T05:36:40.191 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:39.451+0000 7f4478400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f447010b020 0x7f447010b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:36:40.191 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:39.451+0000 7f4478400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f447010ba10 con 0x7f447010b020 2024-05-08T05:36:40.191 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:39.451+0000 7f4475a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f447010b020 0x7f447010b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:36:40.191 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:39.451+0000 7f4475a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f447010b020 0x7f447010b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55722/0 (socket says 172.21.15.82:55722) 2024-05-08T05:36:40.191 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:39.451+0000 7f4475a00700 1 -- 172.21.15.82:0/2232777690 learned_addr learned my addr 172.21.15.82:0/2232777690 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:36:40.191 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:39.452+0000 7f4475a00700 1 -- 172.21.15.82:0/2232777690 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f447010c220 con 0x7f447010b020 2024-05-08T05:36:40.191 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:39.452+0000 7f4475a00700 1 --2- 172.21.15.82:0/2232777690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f447010b020 0x7f447010b440 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f44640098a0 tx=0x7f4464009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1255749f0792e5a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:36:40.191 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:39.452+0000 7f446fe00700 1 -- 172.21.15.82:0/2232777690 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4464004160 con 0x7f447010b020 2024-05-08T05:36:40.192 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:39.452+0000 7f446fe00700 1 -- 172.21.15.82:0/2232777690 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4464004300 con 0x7f447010b020 2024-05-08T05:36:40.192 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:39.452+0000 7f446fe00700 1 -- 172.21.15.82:0/2232777690 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f44640036a0 con 0x7f447010b020 2024-05-08T05:36:40.192 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:39.453+0000 7f4478400700 1 -- 172.21.15.82:0/2232777690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f447010b020 msgr2=0x7f447010b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:36:40.192 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:39.453+0000 7f4478400700 1 --2- 172.21.15.82:0/2232777690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f447010b020 0x7f447010b440 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f44640098a0 tx=0x7f4464009bb0 comp rx=0 tx=0).stop 2024-05-08T05:36:40.192 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:39.453+0000 7f4478400700 1 -- 172.21.15.82:0/2232777690 shutdown_connections 2024-05-08T05:36:40.192 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:39.453+0000 7f4478400700 1 --2- 172.21.15.82:0/2232777690 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f447010b020 0x7f447010b440 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:36:40.192 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:39.453+0000 7f4478400700 1 -- 172.21.15.82:0/2232777690 >> 172.21.15.82:0/2232777690 conn(0x7f447007e3e0 msgr2=0x7f447007e810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:36:40.192 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:39.454+0000 7f4478400700 1 -- 172.21.15.82:0/2232777690 shutdown_connections 2024-05-08T05:36:40.192 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:39.454+0000 7f4478400700 1 -- 172.21.15.82:0/2232777690 wait complete. 2024-05-08T05:36:40.192 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:39.455+0000 7f4478400700 1 Processor -- start 2024-05-08T05:36:40.192 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:39.455+0000 7f4478400700 1 -- start start 2024-05-08T05:36:40.192 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:39.455+0000 7f4478400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f447010b020 0x7f447019e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:36:40.192 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:39.455+0000 7f4478400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f447010c750 con 0x7f447010b020 2024-05-08T05:36:40.192 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:39.455+0000 7f4475a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f447010b020 0x7f447019e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:36:40.192 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:39.455+0000 7f4475a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f447010b020 0x7f447019e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55736/0 (socket says 172.21.15.82:55736) 2024-05-08T05:36:40.193 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:39.455+0000 7f4475a00700 1 -- 172.21.15.82:0/1235911324 learned_addr learned my addr 172.21.15.82:0/1235911324 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:36:40.193 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:39.456+0000 7f4475a00700 1 -- 172.21.15.82:0/1235911324 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f447019ecf0 con 0x7f447010b020 2024-05-08T05:36:40.193 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:39.456+0000 7f4475a00700 1 --2- 172.21.15.82:0/1235911324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f447010b020 0x7f447019e7b0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f4464000c00 tx=0x7f4464004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:36:40.193 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:39.456+0000 7f446e000700 1 -- 172.21.15.82:0/1235911324 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4464003db0 con 0x7f447010b020 2024-05-08T05:36:40.193 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:39.456+0000 7f446e000700 1 -- 172.21.15.82:0/1235911324 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4464011630 con 0x7f447010b020 2024-05-08T05:36:40.193 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:39.456+0000 7f446e000700 1 -- 172.21.15.82:0/1235911324 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4464011950 con 0x7f447010b020 2024-05-08T05:36:40.193 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:39.456+0000 7f4478400700 1 -- 172.21.15.82:0/1235911324 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f447019ef80 con 0x7f447010b020 2024-05-08T05:36:40.193 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:39.457+0000 7f4478400700 1 -- 172.21.15.82:0/1235911324 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44701a1c70 con 0x7f447010b020 2024-05-08T05:36:40.193 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:39.457+0000 7f446e000700 1 -- 172.21.15.82:0/1235911324 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f446401a460 con 0x7f447010b020 2024-05-08T05:36:40.193 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:39.457+0000 7f446e000700 1 -- 172.21.15.82:0/1235911324 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f446401b780 con 0x7f447010b020 2024-05-08T05:36:40.193 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:39.458+0000 7f4478400700 1 -- 172.21.15.82:0/1235911324 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f447006a5c0 con 0x7f447010b020 2024-05-08T05:36:40.193 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:39.460+0000 7f446e000700 1 -- 172.21.15.82:0/1235911324 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f4464031020 con 0x7f447010b020 2024-05-08T05:36:40.193 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:39.536+0000 7f4478400700 1 -- 172.21.15.82:0/1235911324 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f447002e810 con 0x7f447010b020 2024-05-08T05:36:40.193 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:39.544+0000 7f446e000700 1 -- 172.21.15.82:0/1235911324 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+465 (secure 0 0 0) 0x7f446401b9d0 con 0x7f447010b020 2024-05-08T05:36:40.193 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:39.545+0000 7f4478400700 1 -- 172.21.15.82:0/1235911324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f447010b020 msgr2=0x7f447019e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:36:40.194 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:39.545+0000 7f4478400700 1 --2- 172.21.15.82:0/1235911324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f447010b020 0x7f447019e7b0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f4464000c00 tx=0x7f4464004750 comp rx=0 tx=0).stop 2024-05-08T05:36:40.194 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:39.545+0000 7f4478400700 1 -- 172.21.15.82:0/1235911324 shutdown_connections 2024-05-08T05:36:40.194 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:39.545+0000 7f4478400700 1 --2- 172.21.15.82:0/1235911324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f447010b020 0x7f447019e7b0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:36:40.194 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:39.545+0000 7f4478400700 1 -- 172.21.15.82:0/1235911324 >> 172.21.15.82:0/1235911324 conn(0x7f447007e3e0 msgr2=0x7f44701953d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:36:40.194 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:39.546+0000 7f4478400700 1 -- 172.21.15.82:0/1235911324 shutdown_connections 2024-05-08T05:36:40.194 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:39.546+0000 7f4478400700 1 -- 172.21.15.82:0/1235911324 wait complete. 2024-05-08T05:36:40.194 INFO:teuthology.orchestra.run.smithi082.stdout:Generating new minimal ceph.conf... 2024-05-08T05:36:41.191 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:40 smithi082 ceph-mon[29732]: from='client.? 172.21.15.82:0/151304648' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:36:41.485 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:40.760+0000 7f53e2a00700 1 Processor -- start 2024-05-08T05:36:41.485 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:40.760+0000 7f53e2a00700 1 -- start start 2024-05-08T05:36:41.485 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:40.760+0000 7f53e2a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53dc1076d0 0x7f53dc107af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:36:41.485 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:40.761+0000 7f53e2a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f53dc07d6d0 con 0x7f53dc1076d0 2024-05-08T05:36:41.486 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:40.761+0000 7f53dbe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53dc1076d0 0x7f53dc107af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:36:41.486 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:40.761+0000 7f53dbe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53dc1076d0 0x7f53dc107af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55748/0 (socket says 172.21.15.82:55748) 2024-05-08T05:36:41.486 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:40.761+0000 7f53dbe00700 1 -- 172.21.15.82:0/1512378558 learned_addr learned my addr 172.21.15.82:0/1512378558 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:36:41.486 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:40.762+0000 7f53dbe00700 1 -- 172.21.15.82:0/1512378558 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53dc108030 con 0x7f53dc1076d0 2024-05-08T05:36:41.486 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:40.762+0000 7f53dbe00700 1 --2- 172.21.15.82:0/1512378558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53dc1076d0 0x7f53dc107af0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f53cc0098a0 tx=0x7f53cc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9168d592adcc57b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:36:41.486 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:40.762+0000 7f53daa00700 1 -- 172.21.15.82:0/1512378558 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53cc004160 con 0x7f53dc1076d0 2024-05-08T05:36:41.486 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:40.762+0000 7f53daa00700 1 -- 172.21.15.82:0/1512378558 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f53cc004300 con 0x7f53dc1076d0 2024-05-08T05:36:41.486 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:40.762+0000 7f53daa00700 1 -- 172.21.15.82:0/1512378558 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53cc011af0 con 0x7f53dc1076d0 2024-05-08T05:36:41.486 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:40.763+0000 7f53e2a00700 1 -- 172.21.15.82:0/1512378558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53dc1076d0 msgr2=0x7f53dc107af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:36:41.486 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:40.763+0000 7f53e2a00700 1 --2- 172.21.15.82:0/1512378558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53dc1076d0 0x7f53dc107af0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f53cc0098a0 tx=0x7f53cc009bb0 comp rx=0 tx=0).stop 2024-05-08T05:36:41.486 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:40.763+0000 7f53e2a00700 1 -- 172.21.15.82:0/1512378558 shutdown_connections 2024-05-08T05:36:41.486 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:40.763+0000 7f53e2a00700 1 --2- 172.21.15.82:0/1512378558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53dc1076d0 0x7f53dc107af0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:36:41.486 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:40.763+0000 7f53e2a00700 1 -- 172.21.15.82:0/1512378558 >> 172.21.15.82:0/1512378558 conn(0x7f53dc103290 msgr2=0x7f53dc1056d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:36:41.487 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:40.763+0000 7f53e2a00700 1 -- 172.21.15.82:0/1512378558 shutdown_connections 2024-05-08T05:36:41.487 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:40.763+0000 7f53e2a00700 1 -- 172.21.15.82:0/1512378558 wait complete. 2024-05-08T05:36:41.487 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:40.765+0000 7f53e2a00700 1 Processor -- start 2024-05-08T05:36:41.487 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:40.765+0000 7f53e2a00700 1 -- start start 2024-05-08T05:36:41.487 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:40.765+0000 7f53e2a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53dc1076d0 0x7f53dc19ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:36:41.487 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:40.765+0000 7f53e2a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f53dc109060 con 0x7f53dc1076d0 2024-05-08T05:36:41.487 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:40.765+0000 7f53dbe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53dc1076d0 0x7f53dc19ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:36:41.487 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:40.766+0000 7f53dbe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53dc1076d0 0x7f53dc19ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55762/0 (socket says 172.21.15.82:55762) 2024-05-08T05:36:41.487 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:40.766+0000 7f53dbe00700 1 -- 172.21.15.82:0/151304648 learned_addr learned my addr 172.21.15.82:0/151304648 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:36:41.487 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:40.766+0000 7f53dbe00700 1 -- 172.21.15.82:0/151304648 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53dc19f4b0 con 0x7f53dc1076d0 2024-05-08T05:36:41.487 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:40.766+0000 7f53dbe00700 1 --2- 172.21.15.82:0/151304648 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53dc1076d0 0x7f53dc19ef70 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f53cc011ac0 tx=0x7f53cc011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:36:41.487 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:40.767+0000 7f53d8c00700 1 -- 172.21.15.82:0/151304648 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53cc003970 con 0x7f53dc1076d0 2024-05-08T05:36:41.487 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:40.767+0000 7f53d8c00700 1 -- 172.21.15.82:0/151304648 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f53cc003b10 con 0x7f53dc1076d0 2024-05-08T05:36:41.487 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:40.767+0000 7f53d8c00700 1 -- 172.21.15.82:0/151304648 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f53cc024610 con 0x7f53dc1076d0 2024-05-08T05:36:41.487 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:40.767+0000 7f53e2a00700 1 -- 172.21.15.82:0/151304648 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53dc19f740 con 0x7f53dc1076d0 2024-05-08T05:36:41.488 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:40.767+0000 7f53e2a00700 1 -- 172.21.15.82:0/151304648 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53dc1a2430 con 0x7f53dc1076d0 2024-05-08T05:36:41.488 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:40.767+0000 7f53d8c00700 1 -- 172.21.15.82:0/151304648 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f53cc024bd0 con 0x7f53dc1076d0 2024-05-08T05:36:41.488 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:40.767+0000 7f53d8c00700 1 -- 172.21.15.82:0/151304648 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f53cc019700 con 0x7f53dc1076d0 2024-05-08T05:36:41.488 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:40.768+0000 7f53e2a00700 1 -- 172.21.15.82:0/151304648 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53dc06a5c0 con 0x7f53dc1076d0 2024-05-08T05:36:41.488 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:40.771+0000 7f53d8c00700 1 -- 172.21.15.82:0/151304648 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f53cc01a9e0 con 0x7f53dc1076d0 2024-05-08T05:36:41.488 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:40.848+0000 7f53e2a00700 1 -- 172.21.15.82:0/151304648 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f53dc02e720 con 0x7f53dc1076d0 2024-05-08T05:36:41.488 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:40.849+0000 7f53d8c00700 1 -- 172.21.15.82:0/151304648 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7f53cc01a430 con 0x7f53dc1076d0 2024-05-08T05:36:41.488 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:40.851+0000 7f53e2a00700 1 -- 172.21.15.82:0/151304648 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53dc1076d0 msgr2=0x7f53dc19ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:36:41.488 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:40.851+0000 7f53e2a00700 1 --2- 172.21.15.82:0/151304648 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53dc1076d0 0x7f53dc19ef70 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f53cc011ac0 tx=0x7f53cc011ba0 comp rx=0 tx=0).stop 2024-05-08T05:36:41.488 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:40.851+0000 7f53e2a00700 1 -- 172.21.15.82:0/151304648 shutdown_connections 2024-05-08T05:36:41.488 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:40.851+0000 7f53e2a00700 1 --2- 172.21.15.82:0/151304648 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f53dc1076d0 0x7f53dc19ef70 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:36:41.488 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:40.851+0000 7f53e2a00700 1 -- 172.21.15.82:0/151304648 >> 172.21.15.82:0/151304648 conn(0x7f53dc103290 msgr2=0x7f53dc195b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:36:41.488 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:40.851+0000 7f53e2a00700 1 -- 172.21.15.82:0/151304648 shutdown_connections 2024-05-08T05:36:41.488 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:40.852+0000 7f53e2a00700 1 -- 172.21.15.82:0/151304648 wait complete. 2024-05-08T05:36:41.489 INFO:teuthology.orchestra.run.smithi082.stdout:Restarting the monitor... 2024-05-08T05:36:41.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:41 smithi082 systemd[1]: Stopping Ceph mon.a for c739a5c8-0cfc-11ef-bc97-c7b262605968... 2024-05-08T05:36:42.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:41 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mon-a[29728]: 2024-05-08T05:36:41.989+0000 7fefc9a00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T05:36:42.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:41 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mon-a[29728]: 2024-05-08T05:36:41.989+0000 7fefc9a00700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-05-08T05:36:42.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:42 smithi082 podman[29975]: 2024-05-08 05:36:42.103851991 +0000 UTC m=+0.274635753 container died 098a385f6cb56b5d6484dcf08319a2a758b3d0838546095bbf788dffe4eceea6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, RELEASE=wip-57676-3-bee299f, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-05-08T05:36:43.328 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:43 smithi082 podman[29975]: 2024-05-08 05:36:43.123883218 +0000 UTC m=+1.294666973 container cleanup 098a385f6cb56b5d6484dcf08319a2a758b3d0838546095bbf788dffe4eceea6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-57676-3-bee299f) 2024-05-08T05:36:43.328 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:43 smithi082 bash[29975]: ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mon-a 2024-05-08T05:36:43.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:43 smithi082 podman[29989]: 2024-05-08 05:36:43.324754341 +0000 UTC m=+1.202605312 container remove 098a385f6cb56b5d6484dcf08319a2a758b3d0838546095bbf788dffe4eceea6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mon-a, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-57676-3-bee299f, org.label-schema.vendor=CentOS) 2024-05-08T05:36:44.163 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:43 smithi082 systemd[1]: ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mon.a.service: Deactivated successfully. 2024-05-08T05:36:44.163 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:43 smithi082 systemd[1]: Stopped Ceph mon.a for c739a5c8-0cfc-11ef-bc97-c7b262605968. 2024-05-08T05:36:44.163 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:43 smithi082 systemd[1]: ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mon.a.service: Consumed 1.891s CPU time. 2024-05-08T05:36:44.163 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:43 smithi082 systemd[1]: Starting Ceph mon.a for c739a5c8-0cfc-11ef-bc97-c7b262605968... 2024-05-08T05:36:44.429 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 podman[30079]: 2024-05-08 05:36:44.071817695 +0000 UTC m=+0.059024719 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a 2024-05-08T05:36:44.430 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 podman[30079]: 2024-05-08 05:36:44.212553463 +0000 UTC m=+0.199760537 container create e91a456d9489419ab70d73b89a2e6a4ba883d4dcb0f02ca25293da3efb4f943b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mon-a, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, RELEASE=wip-57676-3-bee299f, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-05-08T05:36:44.529 INFO:teuthology.orchestra.run.smithi082.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-05-08T05:36:44.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 podman[30079]: 2024-05-08 05:36:44.429309142 +0000 UTC m=+0.416516193 container init e91a456d9489419ab70d73b89a2e6a4ba883d4dcb0f02ca25293da3efb4f943b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-57676-3-bee299f, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-08T05:36:44.688 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 podman[30079]: 2024-05-08 05:36:44.441811465 +0000 UTC m=+0.429018481 container start e91a456d9489419ab70d73b89a2e6a4ba883d4dcb0f02ca25293da3efb4f943b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mon-a, maintainer=Guillaume Abrioux , RELEASE=wip-57676-3-bee299f, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, io.buildah.version=1.33.5) 2024-05-08T05:36:44.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: set uid:gid to 167:167 (ceph:ceph) 2024-05-08T05:36:44.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: ceph version 19.0.0-3538-gbee299f4 (bee299f4ac344e4c45e550d7a80abcadd7bc3d5a) squid (dev), process ceph-mon, pid 2 2024-05-08T05:36:44.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: pidfile_write: ignore empty --pid-file 2024-05-08T05:36:44.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: load: jerasure load: lrc 2024-05-08T05:36:44.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: RocksDB version: 7.9.2 2024-05-08T05:36:44.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Git sha 0 2024-05-08T05:36:44.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Compile date 2024-05-07 11:18:56 2024-05-08T05:36:44.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: DB SUMMARY 2024-05-08T05:36:44.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: DB Session ID: UOBV5GQARP9S6RY820AD 2024-05-08T05:36:44.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: CURRENT file: CURRENT 2024-05-08T05:36:44.690 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: IDENTITY file: IDENTITY 2024-05-08T05:36:44.690 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-05-08T05:36:44.690 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-05-08T05:36:44.690 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 104676 ; 2024-05-08T05:36:44.690 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.error_if_exists: 0 2024-05-08T05:36:44.690 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.create_if_missing: 0 2024-05-08T05:36:44.690 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.paranoid_checks: 1 2024-05-08T05:36:44.690 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-08T05:36:44.690 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-08T05:36:44.690 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-08T05:36:44.690 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.env: 0x55b489489cc0 2024-05-08T05:36:44.690 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.fs: PosixFileSystem 2024-05-08T05:36:44.691 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.info_log: 0x55b4c1d6dde0 2024-05-08T05:36:44.691 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.max_file_opening_threads: 16 2024-05-08T05:36:44.691 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.statistics: (nil) 2024-05-08T05:36:44.692 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.use_fsync: 0 2024-05-08T05:36:44.692 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.max_log_file_size: 0 2024-05-08T05:36:44.692 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-08T05:36:44.692 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-08T05:36:44.692 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.keep_log_file_num: 1000 2024-05-08T05:36:44.692 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.recycle_log_file_num: 0 2024-05-08T05:36:44.692 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.allow_fallocate: 1 2024-05-08T05:36:44.692 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.allow_mmap_reads: 0 2024-05-08T05:36:44.692 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.allow_mmap_writes: 0 2024-05-08T05:36:44.692 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.use_direct_reads: 0 2024-05-08T05:36:44.693 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-08T05:36:44.693 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.create_missing_column_families: 0 2024-05-08T05:36:44.693 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.db_log_dir: 2024-05-08T05:36:44.693 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.wal_dir: 2024-05-08T05:36:44.693 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-08T05:36:44.693 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-08T05:36:44.693 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-08T05:36:44.693 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-08T05:36:44.693 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-08T05:36:44.693 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-08T05:36:44.693 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.advise_random_on_open: 1 2024-05-08T05:36:44.694 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.db_write_buffer_size: 0 2024-05-08T05:36:44.694 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.write_buffer_manager: 0x55b4c1d3f0e0 2024-05-08T05:36:44.694 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-08T05:36:44.694 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-08T05:36:44.694 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-08T05:36:44.694 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.rate_limiter: (nil) 2024-05-08T05:36:44.694 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-08T05:36:44.694 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.wal_recovery_mode: 2 2024-05-08T05:36:44.694 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.enable_thread_tracking: 0 2024-05-08T05:36:44.694 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.enable_pipelined_write: 0 2024-05-08T05:36:44.694 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.unordered_write: 0 2024-05-08T05:36:44.695 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-08T05:36:44.695 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-08T05:36:44.695 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-08T05:36:44.695 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-08T05:36:44.695 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.row_cache: None 2024-05-08T05:36:44.695 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.wal_filter: None 2024-05-08T05:36:44.695 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-08T05:36:44.695 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.allow_ingest_behind: 0 2024-05-08T05:36:44.695 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.two_write_queues: 0 2024-05-08T05:36:44.695 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.manual_wal_flush: 0 2024-05-08T05:36:44.696 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.wal_compression: 0 2024-05-08T05:36:44.696 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.atomic_flush: 0 2024-05-08T05:36:44.696 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-08T05:36:44.696 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-08T05:36:44.696 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-08T05:36:44.696 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.log_readahead_size: 0 2024-05-08T05:36:44.696 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-08T05:36:44.696 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.best_efforts_recovery: 0 2024-05-08T05:36:44.696 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-08T05:36:44.696 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-08T05:36:44.696 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.allow_data_in_errors: 0 2024-05-08T05:36:44.696 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.db_host_id: __hostname__ 2024-05-08T05:36:44.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-08T05:36:44.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.max_background_jobs: 2 2024-05-08T05:36:44.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.max_background_compactions: -1 2024-05-08T05:36:44.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.max_subcompactions: 1 2024-05-08T05:36:44.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-08T05:36:44.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-08T05:36:44.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-08T05:36:44.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.max_total_wal_size: 0 2024-05-08T05:36:44.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-08T05:36:44.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-08T05:36:44.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-08T05:36:44.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-08T05:36:44.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.max_open_files: -1 2024-05-08T05:36:44.698 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.bytes_per_sync: 0 2024-05-08T05:36:44.698 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-08T05:36:44.698 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-08T05:36:44.698 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.compaction_readahead_size: 0 2024-05-08T05:36:44.698 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.max_background_flushes: -1 2024-05-08T05:36:44.698 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Compression algorithms supported: 2024-05-08T05:36:44.698 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-08T05:36:44.698 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: kZSTD supported: 0 2024-05-08T05:36:44.698 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: kXpressCompression supported: 0 2024-05-08T05:36:44.698 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: kLZ4HCCompression supported: 1 2024-05-08T05:36:44.698 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: kZlibCompression supported: 1 2024-05-08T05:36:44.698 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: kSnappyCompression supported: 1 2024-05-08T05:36:44.698 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: kLZ4Compression supported: 1 2024-05-08T05:36:44.699 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: kBZip2Compression supported: 0 2024-05-08T05:36:44.700 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-08T05:36:44.700 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-08T05:36:44.700 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-05-08T05:36:44.700 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-08T05:36:44.700 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-08T05:36:44.700 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.merge_operator: 2024-05-08T05:36:44.700 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.compaction_filter: None 2024-05-08T05:36:44.700 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.compaction_filter_factory: None 2024-05-08T05:36:44.700 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.sst_partitioner_factory: None 2024-05-08T05:36:44.700 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-08T05:36:44.700 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-08T05:36:44.700 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55b4c1d6dfa0) 2024-05-08T05:36:44.700 INFO:journalctl@ceph.mon.a.smithi082.stdout: cache_index_and_filter_blocks: 1 2024-05-08T05:36:44.700 INFO:journalctl@ceph.mon.a.smithi082.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-08T05:36:44.700 INFO:journalctl@ceph.mon.a.smithi082.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-08T05:36:44.701 INFO:journalctl@ceph.mon.a.smithi082.stdout: pin_top_level_index_and_filter: 1 2024-05-08T05:36:44.701 INFO:journalctl@ceph.mon.a.smithi082.stdout: index_type: 0 2024-05-08T05:36:44.701 INFO:journalctl@ceph.mon.a.smithi082.stdout: data_block_index_type: 0 2024-05-08T05:36:44.701 INFO:journalctl@ceph.mon.a.smithi082.stdout: index_shortening: 1 2024-05-08T05:36:44.701 INFO:journalctl@ceph.mon.a.smithi082.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-08T05:36:44.701 INFO:journalctl@ceph.mon.a.smithi082.stdout: checksum: 4 2024-05-08T05:36:44.701 INFO:journalctl@ceph.mon.a.smithi082.stdout: no_block_cache: 0 2024-05-08T05:36:44.701 INFO:journalctl@ceph.mon.a.smithi082.stdout: block_cache: 0x55b4c1d711f0 2024-05-08T05:36:44.701 INFO:journalctl@ceph.mon.a.smithi082.stdout: block_cache_name: BinnedLRUCache 2024-05-08T05:36:44.701 INFO:journalctl@ceph.mon.a.smithi082.stdout: block_cache_options: 2024-05-08T05:36:44.701 INFO:journalctl@ceph.mon.a.smithi082.stdout: capacity : 536870912 2024-05-08T05:36:44.701 INFO:journalctl@ceph.mon.a.smithi082.stdout: num_shard_bits : 4 2024-05-08T05:36:44.701 INFO:journalctl@ceph.mon.a.smithi082.stdout: strict_capacity_limit : 0 2024-05-08T05:36:44.701 INFO:journalctl@ceph.mon.a.smithi082.stdout: high_pri_pool_ratio: 0.000 2024-05-08T05:36:44.702 INFO:journalctl@ceph.mon.a.smithi082.stdout: block_cache_compressed: (nil) 2024-05-08T05:36:44.702 INFO:journalctl@ceph.mon.a.smithi082.stdout: persistent_cache: (nil) 2024-05-08T05:36:44.702 INFO:journalctl@ceph.mon.a.smithi082.stdout: block_size: 4096 2024-05-08T05:36:44.702 INFO:journalctl@ceph.mon.a.smithi082.stdout: block_size_deviation: 10 2024-05-08T05:36:44.702 INFO:journalctl@ceph.mon.a.smithi082.stdout: block_restart_interval: 16 2024-05-08T05:36:44.702 INFO:journalctl@ceph.mon.a.smithi082.stdout: index_block_restart_interval: 1 2024-05-08T05:36:44.702 INFO:journalctl@ceph.mon.a.smithi082.stdout: metadata_block_size: 4096 2024-05-08T05:36:44.702 INFO:journalctl@ceph.mon.a.smithi082.stdout: partition_filters: 0 2024-05-08T05:36:44.702 INFO:journalctl@ceph.mon.a.smithi082.stdout: use_delta_encoding: 1 2024-05-08T05:36:44.702 INFO:journalctl@ceph.mon.a.smithi082.stdout: filter_policy: bloomfilter 2024-05-08T05:36:44.702 INFO:journalctl@ceph.mon.a.smithi082.stdout: whole_key_filtering: 1 2024-05-08T05:36:44.702 INFO:journalctl@ceph.mon.a.smithi082.stdout: verify_compression: 0 2024-05-08T05:36:44.702 INFO:journalctl@ceph.mon.a.smithi082.stdout: read_amp_bytes_per_bit: 0 2024-05-08T05:36:44.702 INFO:journalctl@ceph.mon.a.smithi082.stdout: format_version: 5 2024-05-08T05:36:44.702 INFO:journalctl@ceph.mon.a.smithi082.stdout: enable_index_compression: 1 2024-05-08T05:36:44.703 INFO:journalctl@ceph.mon.a.smithi082.stdout: block_align: 0 2024-05-08T05:36:44.703 INFO:journalctl@ceph.mon.a.smithi082.stdout: max_auto_readahead_size: 262144 2024-05-08T05:36:44.703 INFO:journalctl@ceph.mon.a.smithi082.stdout: prepopulate_block_cache: 0 2024-05-08T05:36:44.703 INFO:journalctl@ceph.mon.a.smithi082.stdout: initial_auto_readahead_size: 8192 2024-05-08T05:36:44.703 INFO:journalctl@ceph.mon.a.smithi082.stdout: num_file_reads_for_auto_readahead: 2 2024-05-08T05:36:44.703 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.write_buffer_size: 33554432 2024-05-08T05:36:44.703 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.max_write_buffer_number: 2 2024-05-08T05:36:44.703 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.compression: NoCompression 2024-05-08T05:36:44.703 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.bottommost_compression: Disabled 2024-05-08T05:36:44.703 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.prefix_extractor: nullptr 2024-05-08T05:36:44.703 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-08T05:36:44.703 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.num_levels: 7 2024-05-08T05:36:44.703 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-08T05:36:44.703 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-08T05:36:44.703 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-08T05:36:44.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-08T05:36:44.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-08T05:36:44.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-08T05:36:44.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-08T05:36:44.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-08T05:36:44.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-08T05:36:44.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-08T05:36:44.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-08T05:36:44.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-08T05:36:44.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-08T05:36:44.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.compression_opts.level: 32767 2024-05-08T05:36:44.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.compression_opts.strategy: 0 2024-05-08T05:36:44.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-08T05:36:44.704 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-08T05:36:44.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-08T05:36:44.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-08T05:36:44.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.compression_opts.enabled: false 2024-05-08T05:36:44.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-08T05:36:44.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-08T05:36:44.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-08T05:36:44.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-08T05:36:44.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.target_file_size_base: 67108864 2024-05-08T05:36:44.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-08T05:36:44.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-08T05:36:44.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-08T05:36:44.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-08T05:36:44.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-08T05:36:44.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-08T05:36:44.705 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-08T05:36:44.706 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-08T05:36:44.706 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-08T05:36:44.706 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-08T05:36:44.706 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-08T05:36:44.706 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-08T05:36:44.706 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-08T05:36:44.706 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-08T05:36:44.706 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.arena_block_size: 1048576 2024-05-08T05:36:44.706 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-08T05:36:44.706 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-08T05:36:44.706 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.disable_auto_compactions: 0 2024-05-08T05:36:44.706 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-08T05:36:44.706 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-08T05:36:44.707 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-08T05:36:44.707 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-08T05:36:44.707 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-08T05:36:44.707 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-08T05:36:44.707 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-08T05:36:44.707 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-08T05:36:44.707 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-08T05:36:44.707 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-08T05:36:44.707 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-05-08T05:36:44.707 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.inplace_update_support: 0 2024-05-08T05:36:44.707 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-08T05:36:44.707 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-08T05:36:44.707 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-08T05:36:44.707 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-08T05:36:44.707 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.bloom_locality: 0 2024-05-08T05:36:44.708 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.max_successive_merges: 0 2024-05-08T05:36:44.708 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-08T05:36:44.708 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.paranoid_file_checks: 0 2024-05-08T05:36:44.708 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.force_consistency_checks: 1 2024-05-08T05:36:44.708 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.report_bg_io_stats: 0 2024-05-08T05:36:44.708 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.ttl: 2592000 2024-05-08T05:36:44.708 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-08T05:36:44.708 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-08T05:36:44.708 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-08T05:36:44.708 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.enable_blob_files: false 2024-05-08T05:36:44.708 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.min_blob_size: 0 2024-05-08T05:36:44.708 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.blob_file_size: 268435456 2024-05-08T05:36:44.708 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-08T05:36:44.708 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-08T05:36:44.708 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-08T05:36:44.709 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-08T05:36:44.709 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-08T05:36:44.709 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.blob_file_starting_level: 0 2024-05-08T05:36:44.709 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-08T05:36:44.709 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-05-08T05:36:44.709 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-05-08T05:36:44.709 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 8c28c7fe-20fc-4a27-8e24-8bb7d06b4245 2024-05-08T05:36:44.709 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715146604499418, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-05-08T05:36:44.709 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-05-08T05:36:44.709 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715146604501219, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 99876, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 324, "table_properties": {"data_size": 97762, "index_size": 306, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14058, "raw_average_key_size": 49, "raw_value_size": 90113, "raw_average_value_size": 318, "num_data_blocks": 12, "num_entries": 283, "num_filter_entries": 283, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1715146604, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "8c28c7fe-20fc-4a27-8e24-8bb7d06b4245", "db_session_id": "UOBV5GQARP9S6RY820AD", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-05-08T05:36:44.709 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715146604501440, "job": 1, "event": "recovery_finished"} 2024-05-08T05:36:44.709 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-05-08T05:36:44.709 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-08T05:36:44.709 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55b4c1e8e000 2024-05-08T05:36:44.710 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: DB pointer 0x55b4c1e7a000 2024-05-08T05:36:44.710 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-08T05:36:44.710 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-08T05:36:44.710 INFO:journalctl@ceph.mon.a.smithi082.stdout: ** DB Stats ** 2024-05-08T05:36:44.710 INFO:journalctl@ceph.mon.a.smithi082.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-08T05:36:44.710 INFO:journalctl@ceph.mon.a.smithi082.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-08T05:36:44.710 INFO:journalctl@ceph.mon.a.smithi082.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-08T05:36:44.710 INFO:journalctl@ceph.mon.a.smithi082.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-08T05:36:44.710 INFO:journalctl@ceph.mon.a.smithi082.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-08T05:36:44.710 INFO:journalctl@ceph.mon.a.smithi082.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-08T05:36:44.710 INFO:journalctl@ceph.mon.a.smithi082.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-08T05:36:44.710 INFO:journalctl@ceph.mon.a.smithi082.stdout: 2024-05-08T05:36:44.710 INFO:journalctl@ceph.mon.a.smithi082.stdout: ** Compaction Stats [default] ** 2024-05-08T05:36:44.710 INFO:journalctl@ceph.mon.a.smithi082.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-08T05:36:44.711 INFO:journalctl@ceph.mon.a.smithi082.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-08T05:36:44.711 INFO:journalctl@ceph.mon.a.smithi082.stdout: L0 2/0 99.40 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 74.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-08T05:36:44.711 INFO:journalctl@ceph.mon.a.smithi082.stdout: Sum 2/0 99.40 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 74.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-08T05:36:44.711 INFO:journalctl@ceph.mon.a.smithi082.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 74.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-08T05:36:44.711 INFO:journalctl@ceph.mon.a.smithi082.stdout: 2024-05-08T05:36:44.711 INFO:journalctl@ceph.mon.a.smithi082.stdout: ** Compaction Stats [default] ** 2024-05-08T05:36:44.711 INFO:journalctl@ceph.mon.a.smithi082.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-08T05:36:44.711 INFO:journalctl@ceph.mon.a.smithi082.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-08T05:36:44.711 INFO:journalctl@ceph.mon.a.smithi082.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 74.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-08T05:36:44.711 INFO:journalctl@ceph.mon.a.smithi082.stdout: 2024-05-08T05:36:44.711 INFO:journalctl@ceph.mon.a.smithi082.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-08T05:36:44.711 INFO:journalctl@ceph.mon.a.smithi082.stdout: 2024-05-08T05:36:44.711 INFO:journalctl@ceph.mon.a.smithi082.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-08T05:36:44.711 INFO:journalctl@ceph.mon.a.smithi082.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-08T05:36:44.711 INFO:journalctl@ceph.mon.a.smithi082.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-08T05:36:44.712 INFO:journalctl@ceph.mon.a.smithi082.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-08T05:36:44.712 INFO:journalctl@ceph.mon.a.smithi082.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-08T05:36:44.712 INFO:journalctl@ceph.mon.a.smithi082.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-08T05:36:44.712 INFO:journalctl@ceph.mon.a.smithi082.stdout: Cumulative compaction: 0.00 GB write, 13.53 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-08T05:36:44.712 INFO:journalctl@ceph.mon.a.smithi082.stdout: Interval compaction: 0.00 GB write, 13.53 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-08T05:36:44.712 INFO:journalctl@ceph.mon.a.smithi082.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-08T05:36:44.712 INFO:journalctl@ceph.mon.a.smithi082.stdout: Block cache BinnedLRUCache@0x55b4c1d711f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-05-08T05:36:44.712 INFO:journalctl@ceph.mon.a.smithi082.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-05-08T05:36:44.712 INFO:journalctl@ceph.mon.a.smithi082.stdout: 2024-05-08T05:36:44.712 INFO:journalctl@ceph.mon.a.smithi082.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-08T05:36:44.712 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: starting mon.a rank 0 at public addrs [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] at bind addrs [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 2024-05-08T05:36:44.712 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: mon.a@-1(???) e1 preinit fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 2024-05-08T05:36:44.712 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: mon.a@-1(???).mds e1 new map 2024-05-08T05:36:44.713 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: mon.a@-1(???).mds e1 print_map 2024-05-08T05:36:44.713 INFO:journalctl@ceph.mon.a.smithi082.stdout: e1 2024-05-08T05:36:44.713 INFO:journalctl@ceph.mon.a.smithi082.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-08T05:36:44.713 INFO:journalctl@ceph.mon.a.smithi082.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-08T05:36:44.713 INFO:journalctl@ceph.mon.a.smithi082.stdout: legacy client fscid: -1 2024-05-08T05:36:44.713 INFO:journalctl@ceph.mon.a.smithi082.stdout: 2024-05-08T05:36:44.713 INFO:journalctl@ceph.mon.a.smithi082.stdout: No filesystems configured 2024-05-08T05:36:44.713 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-08T05:36:44.713 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-08T05:36:44.713 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-08T05:36:44.713 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-08T05:36:44.713 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-05-08T05:36:44.714 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 bash[30079]: e91a456d9489419ab70d73b89a2e6a4ba883d4dcb0f02ca25293da3efb4f943b 2024-05-08T05:36:44.714 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 systemd[1]: Started Ceph mon.a for c739a5c8-0cfc-11ef-bc97-c7b262605968. 2024-05-08T05:36:44.714 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-08T05:36:44.714 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: monmap epoch 1 2024-05-08T05:36:44.714 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 2024-05-08T05:36:44.714 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: last_changed 2024-05-08T05:36:33.349539+0000 2024-05-08T05:36:44.714 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: created 2024-05-08T05:36:33.349539+0000 2024-05-08T05:36:44.714 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: min_mon_release 19 (squid) 2024-05-08T05:36:44.714 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: election_strategy: 1 2024-05-08T05:36:44.714 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: 0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.a 2024-05-08T05:36:44.714 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: fsmap 2024-05-08T05:36:44.714 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: osdmap e1: 0 total, 0 up, 0 in 2024-05-08T05:36:44.714 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:44 smithi082 ceph-mon[30098]: mgrmap e1: no daemons active 2024-05-08T05:36:45.957 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:45.258+0000 7f60c6800700 1 Processor -- start 2024-05-08T05:36:45.957 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:45.259+0000 7f60c6800700 1 -- start start 2024-05-08T05:36:45.957 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:45.259+0000 7f60c6800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60c007edd0 0x7f60c007d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:36:45.957 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:45.259+0000 7f60c6800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f60c007d810 con 0x7f60c007edd0 2024-05-08T05:36:45.957 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:45.260+0000 7f60bf400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60c007edd0 0x7f60c007d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:36:45.958 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:45.260+0000 7f60bf400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60c007edd0 0x7f60c007d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44006/0 (socket says 172.21.15.82:44006) 2024-05-08T05:36:45.958 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:45.260+0000 7f60bf400700 1 -- 172.21.15.82:0/3976302619 learned_addr learned my addr 172.21.15.82:0/3976302619 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:36:45.958 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:45.260+0000 7f60bf400700 1 -- 172.21.15.82:0/3976302619 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60c007d990 con 0x7f60c007edd0 2024-05-08T05:36:45.958 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:45.261+0000 7f60bf400700 1 --2- 172.21.15.82:0/3976302619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60c007edd0 0x7f60c007d2d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f60b00098a0 tx=0x7f60b0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d29c0ec2bcad75e4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:36:45.958 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:45.261+0000 7f60be000700 1 -- 172.21.15.82:0/3976302619 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60b0004160 con 0x7f60c007edd0 2024-05-08T05:36:45.958 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:45.261+0000 7f60be000700 1 -- 172.21.15.82:0/3976302619 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f60b0004300 con 0x7f60c007edd0 2024-05-08T05:36:45.958 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:45.261+0000 7f60be000700 1 -- 172.21.15.82:0/3976302619 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60b0011af0 con 0x7f60c007edd0 2024-05-08T05:36:45.958 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:45.262+0000 7f60c6800700 1 -- 172.21.15.82:0/3976302619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60c007edd0 msgr2=0x7f60c007d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:36:45.958 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:45.262+0000 7f60c6800700 1 --2- 172.21.15.82:0/3976302619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60c007edd0 0x7f60c007d2d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f60b00098a0 tx=0x7f60b0009bb0 comp rx=0 tx=0).stop 2024-05-08T05:36:45.958 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:45.262+0000 7f60c6800700 1 -- 172.21.15.82:0/3976302619 shutdown_connections 2024-05-08T05:36:45.958 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:45.262+0000 7f60c6800700 1 --2- 172.21.15.82:0/3976302619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60c007edd0 0x7f60c007d2d0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:36:45.958 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:45.262+0000 7f60c6800700 1 -- 172.21.15.82:0/3976302619 >> 172.21.15.82:0/3976302619 conn(0x7f60c0104450 msgr2=0x7f60c0106870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:36:45.958 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:45.262+0000 7f60c6800700 1 -- 172.21.15.82:0/3976302619 shutdown_connections 2024-05-08T05:36:45.958 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:45.262+0000 7f60c6800700 1 -- 172.21.15.82:0/3976302619 wait complete. 2024-05-08T05:36:45.959 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:45.263+0000 7f60c6800700 1 Processor -- start 2024-05-08T05:36:45.959 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:45.263+0000 7f60c6800700 1 -- start start 2024-05-08T05:36:45.959 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:45.264+0000 7f60c6800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60c007edd0 0x7f60c019ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:36:45.959 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:45.264+0000 7f60c6800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f60c010f3c0 con 0x7f60c007edd0 2024-05-08T05:36:45.959 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:45.264+0000 7f60bf400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60c007edd0 0x7f60c019ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:36:45.959 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:45.264+0000 7f60bf400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60c007edd0 0x7f60c019ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44010/0 (socket says 172.21.15.82:44010) 2024-05-08T05:36:45.959 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:45.264+0000 7f60bf400700 1 -- 172.21.15.82:0/516189832 learned_addr learned my addr 172.21.15.82:0/516189832 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:36:45.959 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:45.264+0000 7f60bf400700 1 -- 172.21.15.82:0/516189832 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60c019f4c0 con 0x7f60c007edd0 2024-05-08T05:36:45.959 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:45.265+0000 7f60bf400700 1 --2- 172.21.15.82:0/516189832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60c007edd0 0x7f60c019ef80 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f60b0011ac0 tx=0x7f60b0011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:36:45.959 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:45.265+0000 7f60b7e00700 1 -- 172.21.15.82:0/516189832 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60b0003970 con 0x7f60c007edd0 2024-05-08T05:36:45.959 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:45.265+0000 7f60b7e00700 1 -- 172.21.15.82:0/516189832 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f60b0003b10 con 0x7f60c007edd0 2024-05-08T05:36:45.960 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:45.265+0000 7f60b7e00700 1 -- 172.21.15.82:0/516189832 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f60b0024610 con 0x7f60c007edd0 2024-05-08T05:36:45.960 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:45.265+0000 7f60c6800700 1 -- 172.21.15.82:0/516189832 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60c019f750 con 0x7f60c007edd0 2024-05-08T05:36:45.960 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:45.265+0000 7f60c6800700 1 -- 172.21.15.82:0/516189832 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60c01a2440 con 0x7f60c007edd0 2024-05-08T05:36:45.960 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:45.266+0000 7f60b7e00700 1 -- 172.21.15.82:0/516189832 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f60b00247b0 con 0x7f60c007edd0 2024-05-08T05:36:45.960 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:45.266+0000 7f60b7e00700 1 -- 172.21.15.82:0/516189832 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f60b002dc70 con 0x7f60c007edd0 2024-05-08T05:36:45.960 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:45.267+0000 7f60c6800700 1 -- 172.21.15.82:0/516189832 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60c006a5c0 con 0x7f60c007edd0 2024-05-08T05:36:45.960 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:45.270+0000 7f60b7e00700 1 -- 172.21.15.82:0/516189832 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f60b002d3f0 con 0x7f60c007edd0 2024-05-08T05:36:45.960 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:45.346+0000 7f60c6800700 1 -- 172.21.15.82:0/516189832 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f60c01a2610 con 0x7f60c007edd0 2024-05-08T05:36:45.960 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:45.351+0000 7f60b7e00700 1 -- 172.21.15.82:0/516189832 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f60b0024c30 con 0x7f60c007edd0 2024-05-08T05:36:45.960 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:45.352+0000 7f60c6800700 1 -- 172.21.15.82:0/516189832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60c007edd0 msgr2=0x7f60c019ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:36:45.960 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:45.352+0000 7f60c6800700 1 --2- 172.21.15.82:0/516189832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60c007edd0 0x7f60c019ef80 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f60b0011ac0 tx=0x7f60b0011ba0 comp rx=0 tx=0).stop 2024-05-08T05:36:45.960 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:45.352+0000 7f60c6800700 1 -- 172.21.15.82:0/516189832 shutdown_connections 2024-05-08T05:36:45.960 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:45.352+0000 7f60c6800700 1 --2- 172.21.15.82:0/516189832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60c007edd0 0x7f60c019ef80 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:36:45.960 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:45.352+0000 7f60c6800700 1 -- 172.21.15.82:0/516189832 >> 172.21.15.82:0/516189832 conn(0x7f60c0104450 msgr2=0x7f60c0104fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:36:45.960 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:45.352+0000 7f60c6800700 1 -- 172.21.15.82:0/516189832 shutdown_connections 2024-05-08T05:36:45.961 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:45.352+0000 7f60c6800700 1 -- 172.21.15.82:0/516189832 wait complete. 2024-05-08T05:36:45.961 INFO:teuthology.orchestra.run.smithi082.stdout:Wrote config to /etc/ceph/ceph.conf 2024-05-08T05:36:45.985 INFO:teuthology.orchestra.run.smithi082.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-05-08T05:36:45.985 INFO:teuthology.orchestra.run.smithi082.stdout:Creating mgr... 2024-05-08T05:36:45.986 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying port 0.0.0.0:9283 ... 2024-05-08T05:36:45.987 INFO:teuthology.orchestra.run.smithi082.stdout:Verifying port 0.0.0.0:8765 ... 2024-05-08T05:36:46.395 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mgr.x 2024-05-08T05:36:46.395 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Failed to reset failed state of unit ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mgr.x.service: Unit ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mgr.x.service not loaded. 2024-05-08T05:36:46.663 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968.target.wants/ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@.service. 2024-05-08T05:36:46.707 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:46 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/516189832' entity='client.admin' 2024-05-08T05:36:47.407 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:36:47 smithi082 podman[30318]: 2024-05-08 05:36:47.301654741 +0000 UTC m=+0.373582447 container start 5805a3b3e699ee60a8bd8838ba1a91105ce7a6f288715f7262b4013d722e2d23 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, RELEASE=wip-57676-3-bee299f, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507) 2024-05-08T05:36:47.407 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:36:47 smithi082 bash[30318]: 5805a3b3e699ee60a8bd8838ba1a91105ce7a6f288715f7262b4013d722e2d23 2024-05-08T05:36:47.447 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-08T05:36:47.447 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout disabled 2024-05-08T05:36:47.466 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-08T05:36:47.467 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout inactive 2024-05-08T05:36:47.467 INFO:teuthology.orchestra.run.smithi082.stdout:firewalld.service is not enabled 2024-05-08T05:36:47.467 INFO:teuthology.orchestra.run.smithi082.stdout:Not possible to enable service . firewalld.service is not available 2024-05-08T05:36:47.490 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-08T05:36:47.490 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout disabled 2024-05-08T05:36:47.509 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-08T05:36:47.509 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout inactive 2024-05-08T05:36:47.509 INFO:teuthology.orchestra.run.smithi082.stdout:firewalld.service is not enabled 2024-05-08T05:36:47.510 INFO:teuthology.orchestra.run.smithi082.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-05-08T05:36:47.510 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for mgr to start... 2024-05-08T05:36:47.510 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for mgr... 2024-05-08T05:36:47.657 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:36:47 smithi082 systemd[1]: Started Ceph mgr.x for c739a5c8-0cfc-11ef-bc97-c7b262605968. 2024-05-08T05:36:47.658 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:36:47 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:36:47.547+0000 7ff85ded2200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T05:36:47.928 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:36:47 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:36:47.812+0000 7ff85ded2200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T05:36:48.190 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:36:47 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:36:47.943+0000 7ff85ded2200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T05:36:48.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:48 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/1891499063' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-08T05:36:48.471 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:36:48 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:36:48.358+0000 7ff85ded2200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T05:36:48.905 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:36:48 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:36:48.470+0000 7ff85ded2200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T05:36:48.915 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-05-08T05:36:48.915 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-05-08T05:36:48.915 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsid": "c739a5c8-0cfc-11ef-bc97-c7b262605968", 2024-05-08T05:36:48.915 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "health": { 2024-05-08T05:36:48.915 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-08T05:36:48.916 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-08T05:36:48.916 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-08T05:36:48.916 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-05-08T05:36:48.916 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-08T05:36:48.916 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-08T05:36:48.916 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 0 2024-05-08T05:36:48.916 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-05-08T05:36:48.916 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-08T05:36:48.916 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "a" 2024-05-08T05:36:48.916 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-05-08T05:36:48.916 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-05-08T05:36:48.916 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-08T05:36:48.916 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T05:36:48.916 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-08T05:36:48.916 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-08T05:36:48.916 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-05-08T05:36:48.917 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-08T05:36:48.917 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T05:36:48.917 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-08T05:36:48.917 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-08T05:36:48.925 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-08T05:36:48.925 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-08T05:36:48.925 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-08T05:36:48.925 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-08T05:36:48.925 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-05-08T05:36:48.925 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-08T05:36:48.925 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-08T05:36:48.926 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-08T05:36:48.926 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-08T05:36:48.926 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-08T05:36:48.926 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-08T05:36:48.926 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-08T05:36:48.926 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-08T05:36:48.926 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-08T05:36:48.926 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-05-08T05:36:48.926 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-08T05:36:48.926 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T05:36:48.926 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-08T05:36:48.926 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-08T05:36:48.926 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-05-08T05:36:48.927 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-08T05:36:48.927 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-08T05:36:48.927 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-08T05:36:48.927 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-08T05:36:48.927 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-08T05:36:48.927 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-08T05:36:48.927 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "restful" 2024-05-08T05:36:48.927 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-05-08T05:36:48.927 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-08T05:36:48.927 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-05-08T05:36:48.927 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-08T05:36:48.927 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T05:36:48.927 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modified": "2024-05-08T05:36:37.441983+0000", 2024-05-08T05:36:48.927 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-08T05:36:48.927 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-05-08T05:36:48.927 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-08T05:36:48.928 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-05-08T05:36:48.928 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:48.081+0000 7ff422200700 1 Processor -- start 2024-05-08T05:36:48.928 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:48.081+0000 7ff422200700 1 -- start start 2024-05-08T05:36:48.928 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:48.081+0000 7ff422200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff41c07ee40 0x7ff41c07d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:36:48.928 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:48.081+0000 7ff422200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff41c07d830 con 0x7ff41c07ee40 2024-05-08T05:36:48.928 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:48.082+0000 7ff420e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff41c07ee40 0x7ff41c07d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:36:48.928 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:48.082+0000 7ff420e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff41c07ee40 0x7ff41c07d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44042/0 (socket says 172.21.15.82:44042) 2024-05-08T05:36:48.928 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:48.082+0000 7ff420e00700 1 -- 172.21.15.82:0/2715072552 learned_addr learned my addr 172.21.15.82:0/2715072552 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:36:48.928 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:48.082+0000 7ff420e00700 1 -- 172.21.15.82:0/2715072552 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff41c07d9b0 con 0x7ff41c07ee40 2024-05-08T05:36:48.928 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:48.083+0000 7ff420e00700 1 --2- 172.21.15.82:0/2715072552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff41c07ee40 0x7ff41c07d2f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff4100098a0 tx=0x7ff410009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5710eef8d564b28 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:36:48.928 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:48.083+0000 7ff41b400700 1 -- 172.21.15.82:0/2715072552 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff410004160 con 0x7ff41c07ee40 2024-05-08T05:36:48.928 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:48.083+0000 7ff41b400700 1 -- 172.21.15.82:0/2715072552 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7ff410004300 con 0x7ff41c07ee40 2024-05-08T05:36:48.928 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:48.083+0000 7ff41b400700 1 -- 172.21.15.82:0/2715072552 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff410011af0 con 0x7ff41c07ee40 2024-05-08T05:36:48.928 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:48.084+0000 7ff422200700 1 -- 172.21.15.82:0/2715072552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff41c07ee40 msgr2=0x7ff41c07d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:36:48.929 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:48.084+0000 7ff422200700 1 --2- 172.21.15.82:0/2715072552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff41c07ee40 0x7ff41c07d2f0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ff4100098a0 tx=0x7ff410009bb0 comp rx=0 tx=0).stop 2024-05-08T05:36:48.929 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:48.084+0000 7ff422200700 1 -- 172.21.15.82:0/2715072552 shutdown_connections 2024-05-08T05:36:48.929 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:48.084+0000 7ff422200700 1 --2- 172.21.15.82:0/2715072552 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff41c07ee40 0x7ff41c07d2f0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:36:48.929 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:48.084+0000 7ff422200700 1 -- 172.21.15.82:0/2715072552 >> 172.21.15.82:0/2715072552 conn(0x7ff41c104180 msgr2=0x7ff41c1065e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:36:48.929 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:48.084+0000 7ff422200700 1 -- 172.21.15.82:0/2715072552 shutdown_connections 2024-05-08T05:36:48.929 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:48.084+0000 7ff422200700 1 -- 172.21.15.82:0/2715072552 wait complete. 2024-05-08T05:36:48.929 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:48.086+0000 7ff422200700 1 Processor -- start 2024-05-08T05:36:48.929 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:48.086+0000 7ff422200700 1 -- start start 2024-05-08T05:36:48.929 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:48.086+0000 7ff422200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff41c07ee40 0x7ff41c19eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:36:48.929 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:48.086+0000 7ff422200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff41c10f170 con 0x7ff41c07ee40 2024-05-08T05:36:48.929 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:48.087+0000 7ff420e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff41c07ee40 0x7ff41c19eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:36:48.929 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:48.087+0000 7ff420e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff41c07ee40 0x7ff41c19eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44052/0 (socket says 172.21.15.82:44052) 2024-05-08T05:36:48.929 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:48.087+0000 7ff420e00700 1 -- 172.21.15.82:0/1891499063 learned_addr learned my addr 172.21.15.82:0/1891499063 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:36:48.929 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:48.087+0000 7ff420e00700 1 -- 172.21.15.82:0/1891499063 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff41c19f2e0 con 0x7ff41c07ee40 2024-05-08T05:36:48.929 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:48.087+0000 7ff420e00700 1 --2- 172.21.15.82:0/1891499063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff41c07ee40 0x7ff41c19eda0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff410011ac0 tx=0x7ff410011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:36:48.930 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:48.087+0000 7ff419600700 1 -- 172.21.15.82:0/1891499063 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff410003970 con 0x7ff41c07ee40 2024-05-08T05:36:48.930 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:48.088+0000 7ff419600700 1 -- 172.21.15.82:0/1891499063 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7ff410003b10 con 0x7ff41c07ee40 2024-05-08T05:36:48.930 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:48.088+0000 7ff422200700 1 -- 172.21.15.82:0/1891499063 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff41c19f570 con 0x7ff41c07ee40 2024-05-08T05:36:48.930 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:48.088+0000 7ff422200700 1 -- 172.21.15.82:0/1891499063 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff41c1a2220 con 0x7ff41c07ee40 2024-05-08T05:36:48.930 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:48.088+0000 7ff419600700 1 -- 172.21.15.82:0/1891499063 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff410024610 con 0x7ff41c07ee40 2024-05-08T05:36:48.930 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:48.088+0000 7ff419600700 1 -- 172.21.15.82:0/1891499063 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff410024bf0 con 0x7ff41c07ee40 2024-05-08T05:36:48.930 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:48.088+0000 7ff419600700 1 -- 172.21.15.82:0/1891499063 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff410019700 con 0x7ff41c07ee40 2024-05-08T05:36:48.930 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:48.089+0000 7ff422200700 1 -- 172.21.15.82:0/1891499063 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3fc005360 con 0x7ff41c07ee40 2024-05-08T05:36:48.930 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:48.092+0000 7ff419600700 1 -- 172.21.15.82:0/1891499063 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7ff41001a9e0 con 0x7ff41c07ee40 2024-05-08T05:36:48.930 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:48.171+0000 7ff422200700 1 -- 172.21.15.82:0/1891499063 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7ff3fc005920 con 0x7ff41c07ee40 2024-05-08T05:36:48.930 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:48.172+0000 7ff419600700 1 -- 172.21.15.82:0/1891499063 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7ff41001a430 con 0x7ff41c07ee40 2024-05-08T05:36:48.930 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:48.173+0000 7ff422200700 1 -- 172.21.15.82:0/1891499063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff41c07ee40 msgr2=0x7ff41c19eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:36:48.930 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:48.173+0000 7ff422200700 1 --2- 172.21.15.82:0/1891499063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff41c07ee40 0x7ff41c19eda0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff410011ac0 tx=0x7ff410011ba0 comp rx=0 tx=0).stop 2024-05-08T05:36:48.931 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:48.173+0000 7ff422200700 1 -- 172.21.15.82:0/1891499063 shutdown_connections 2024-05-08T05:36:48.931 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:48.173+0000 7ff422200700 1 --2- 172.21.15.82:0/1891499063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff41c07ee40 0x7ff41c19eda0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:36:48.931 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:48.173+0000 7ff422200700 1 -- 172.21.15.82:0/1891499063 >> 172.21.15.82:0/1891499063 conn(0x7ff41c104180 msgr2=0x7ff41c104d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:36:48.931 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:48.173+0000 7ff422200700 1 -- 172.21.15.82:0/1891499063 shutdown_connections 2024-05-08T05:36:48.931 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:48.173+0000 7ff422200700 1 -- 172.21.15.82:0/1891499063 wait complete. 2024-05-08T05:36:48.931 INFO:teuthology.orchestra.run.smithi082.stdout:mgr not available, waiting (1/15)... 2024-05-08T05:36:50.471 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:36:50 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:36:50.051+0000 7ff85ded2200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T05:36:50.471 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:36:50 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:36:50.275+0000 7ff85ded2200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T05:36:50.862 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:36:50 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:36:50.485+0000 7ff85ded2200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T05:36:50.862 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:36:50 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:36:50.860+0000 7ff85ded2200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T05:36:51.220 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:36:50 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:36:50.986+0000 7ff85ded2200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T05:36:51.498 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:36:51 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:36:51.241+0000 7ff85ded2200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T05:36:51.499 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:36:51 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:36:51.497+0000 7ff85ded2200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T05:36:51.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:51 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/2098294593' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-08T05:36:52.355 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-05-08T05:36:52.355 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-05-08T05:36:52.355 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsid": "c739a5c8-0cfc-11ef-bc97-c7b262605968", 2024-05-08T05:36:52.355 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "health": { 2024-05-08T05:36:52.356 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-08T05:36:52.356 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-08T05:36:52.356 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-08T05:36:52.359 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-05-08T05:36:52.359 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-08T05:36:52.359 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-08T05:36:52.359 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 0 2024-05-08T05:36:52.359 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-05-08T05:36:52.359 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-08T05:36:52.359 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "a" 2024-05-08T05:36:52.359 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-05-08T05:36:52.360 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2024-05-08T05:36:52.360 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-08T05:36:52.360 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T05:36:52.360 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-08T05:36:52.360 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-08T05:36:52.360 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-05-08T05:36:52.360 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-08T05:36:52.360 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T05:36:52.360 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-08T05:36:52.360 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-08T05:36:52.360 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-08T05:36:52.360 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-08T05:36:52.360 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-08T05:36:52.360 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-08T05:36:52.360 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-05-08T05:36:52.361 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-08T05:36:52.361 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-08T05:36:52.361 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-08T05:36:52.361 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-08T05:36:52.361 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-08T05:36:52.361 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-08T05:36:52.361 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-08T05:36:52.361 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-08T05:36:52.369 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-08T05:36:52.369 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-05-08T05:36:52.369 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-08T05:36:52.369 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T05:36:52.369 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-08T05:36:52.369 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-08T05:36:52.369 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-05-08T05:36:52.370 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-08T05:36:52.370 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-08T05:36:52.370 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-08T05:36:52.370 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-08T05:36:52.370 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-08T05:36:52.370 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-08T05:36:52.370 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "restful" 2024-05-08T05:36:52.370 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-05-08T05:36:52.370 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-08T05:36:52.370 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-05-08T05:36:52.370 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-08T05:36:52.370 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T05:36:52.370 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modified": "2024-05-08T05:36:37.441983+0000", 2024-05-08T05:36:52.370 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-08T05:36:52.371 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-05-08T05:36:52.371 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-08T05:36:52.371 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-05-08T05:36:52.371 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:51.516+0000 7ff65b200700 1 Processor -- start 2024-05-08T05:36:52.371 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:51.516+0000 7ff65b200700 1 -- start start 2024-05-08T05:36:52.371 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:51.517+0000 7ff65b200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff65407ee60 0x7ff65407d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:36:52.371 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:51.517+0000 7ff65b200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff65407d8e0 con 0x7ff65407ee60 2024-05-08T05:36:52.371 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:51.517+0000 7ff659e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff65407ee60 0x7ff65407d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:36:52.371 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:51.517+0000 7ff659e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff65407ee60 0x7ff65407d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44056/0 (socket says 172.21.15.82:44056) 2024-05-08T05:36:52.371 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:51.517+0000 7ff659e00700 1 -- 172.21.15.82:0/2466110747 learned_addr learned my addr 172.21.15.82:0/2466110747 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:36:52.371 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:51.518+0000 7ff659e00700 1 -- 172.21.15.82:0/2466110747 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff65407da60 con 0x7ff65407ee60 2024-05-08T05:36:52.371 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:51.518+0000 7ff659e00700 1 --2- 172.21.15.82:0/2466110747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff65407ee60 0x7ff65407d310 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff6480098a0 tx=0x7ff648009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4157fd0269e87233 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:36:52.371 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:51.518+0000 7ff658a00700 1 -- 172.21.15.82:0/2466110747 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff648004160 con 0x7ff65407ee60 2024-05-08T05:36:52.371 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:51.518+0000 7ff658a00700 1 -- 172.21.15.82:0/2466110747 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7ff648004300 con 0x7ff65407ee60 2024-05-08T05:36:52.372 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:51.518+0000 7ff658a00700 1 -- 172.21.15.82:0/2466110747 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff648011af0 con 0x7ff65407ee60 2024-05-08T05:36:52.372 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:51.519+0000 7ff65b200700 1 -- 172.21.15.82:0/2466110747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff65407ee60 msgr2=0x7ff65407d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:36:52.372 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:51.519+0000 7ff65b200700 1 --2- 172.21.15.82:0/2466110747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff65407ee60 0x7ff65407d310 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff6480098a0 tx=0x7ff648009bb0 comp rx=0 tx=0).stop 2024-05-08T05:36:52.372 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:51.519+0000 7ff65b200700 1 -- 172.21.15.82:0/2466110747 shutdown_connections 2024-05-08T05:36:52.372 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:51.519+0000 7ff65b200700 1 --2- 172.21.15.82:0/2466110747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff65407ee60 0x7ff65407d310 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:36:52.372 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:51.519+0000 7ff65b200700 1 -- 172.21.15.82:0/2466110747 >> 172.21.15.82:0/2466110747 conn(0x7ff654104180 msgr2=0x7ff6541065e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:36:52.372 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:51.519+0000 7ff65b200700 1 -- 172.21.15.82:0/2466110747 shutdown_connections 2024-05-08T05:36:52.372 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:51.519+0000 7ff65b200700 1 -- 172.21.15.82:0/2466110747 wait complete. 2024-05-08T05:36:52.372 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:51.520+0000 7ff65b200700 1 Processor -- start 2024-05-08T05:36:52.372 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:51.521+0000 7ff65b200700 1 -- start start 2024-05-08T05:36:52.372 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:51.521+0000 7ff65b200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff65407ee60 0x7ff65419ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:36:52.372 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:51.521+0000 7ff65b200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff65410f150 con 0x7ff65407ee60 2024-05-08T05:36:52.372 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:51.521+0000 7ff659e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff65407ee60 0x7ff65419ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:36:52.372 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:51.521+0000 7ff659e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff65407ee60 0x7ff65419ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44072/0 (socket says 172.21.15.82:44072) 2024-05-08T05:36:52.372 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:51.521+0000 7ff659e00700 1 -- 172.21.15.82:0/2098294593 learned_addr learned my addr 172.21.15.82:0/2098294593 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:36:52.373 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:51.522+0000 7ff659e00700 1 -- 172.21.15.82:0/2098294593 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff65419f2d0 con 0x7ff65407ee60 2024-05-08T05:36:52.373 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:51.522+0000 7ff659e00700 1 --2- 172.21.15.82:0/2098294593 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff65407ee60 0x7ff65419ed90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff648009fb0 tx=0x7ff648011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:36:52.373 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:51.522+0000 7ff64ea00700 1 -- 172.21.15.82:0/2098294593 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6480036a0 con 0x7ff65407ee60 2024-05-08T05:36:52.373 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:51.522+0000 7ff64ea00700 1 -- 172.21.15.82:0/2098294593 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7ff64801a430 con 0x7ff65407ee60 2024-05-08T05:36:52.373 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:51.522+0000 7ff65b200700 1 -- 172.21.15.82:0/2098294593 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff65419f560 con 0x7ff65407ee60 2024-05-08T05:36:52.373 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:51.522+0000 7ff64ea00700 1 -- 172.21.15.82:0/2098294593 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff648019550 con 0x7ff65407ee60 2024-05-08T05:36:52.373 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:51.522+0000 7ff65b200700 1 -- 172.21.15.82:0/2098294593 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6541a2210 con 0x7ff65407ee60 2024-05-08T05:36:52.373 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:51.523+0000 7ff64ea00700 1 -- 172.21.15.82:0/2098294593 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff648019b90 con 0x7ff65407ee60 2024-05-08T05:36:52.373 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:51.523+0000 7ff64ea00700 1 -- 172.21.15.82:0/2098294593 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff648024730 con 0x7ff65407ee60 2024-05-08T05:36:52.373 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:51.523+0000 7ff65b200700 1 -- 172.21.15.82:0/2098294593 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff65406a5c0 con 0x7ff65407ee60 2024-05-08T05:36:52.373 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:51.526+0000 7ff64ea00700 1 -- 172.21.15.82:0/2098294593 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7ff648043ec0 con 0x7ff65407ee60 2024-05-08T05:36:52.373 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:51.604+0000 7ff65b200700 1 -- 172.21.15.82:0/2098294593 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7ff6541a27c0 con 0x7ff65407ee60 2024-05-08T05:36:52.373 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:51.605+0000 7ff64ea00700 1 -- 172.21.15.82:0/2098294593 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7ff648032030 con 0x7ff65407ee60 2024-05-08T05:36:52.373 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:51.606+0000 7ff65b200700 1 -- 172.21.15.82:0/2098294593 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff65407ee60 msgr2=0x7ff65419ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:36:52.374 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:51.606+0000 7ff65b200700 1 --2- 172.21.15.82:0/2098294593 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff65407ee60 0x7ff65419ed90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff648009fb0 tx=0x7ff648011940 comp rx=0 tx=0).stop 2024-05-08T05:36:52.374 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:51.606+0000 7ff65b200700 1 -- 172.21.15.82:0/2098294593 shutdown_connections 2024-05-08T05:36:52.374 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:51.606+0000 7ff65b200700 1 --2- 172.21.15.82:0/2098294593 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff65407ee60 0x7ff65419ed90 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:36:52.374 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:51.606+0000 7ff65b200700 1 -- 172.21.15.82:0/2098294593 >> 172.21.15.82:0/2098294593 conn(0x7ff654104180 msgr2=0x7ff654104d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:36:52.374 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:51.606+0000 7ff65b200700 1 -- 172.21.15.82:0/2098294593 shutdown_connections 2024-05-08T05:36:52.374 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:51.606+0000 7ff65b200700 1 -- 172.21.15.82:0/2098294593 wait complete. 2024-05-08T05:36:52.374 INFO:teuthology.orchestra.run.smithi082.stdout:mgr not available, waiting (2/15)... 2024-05-08T05:36:52.606 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:36:52 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:36:52.322+0000 7ff85ded2200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-08T05:36:52.970 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:36:52 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:36:52.605+0000 7ff85ded2200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-08T05:36:53.471 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:36:53 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:36:53.153+0000 7ff85ded2200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T05:36:53.471 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:36:53 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:36:53.277+0000 7ff85ded2200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T05:36:54.179 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:36:53 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:36:53.735+0000 7ff85ded2200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-08T05:36:54.179 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:36:54 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:36:54.177+0000 7ff85ded2200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T05:36:54.470 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:36:54 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:36:54.299+0000 7ff85ded2200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T05:36:54.798 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:36:54 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:36:54.625+0000 7ff85ded2200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T05:36:55.058 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:36:54 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:36:54.815+0000 7ff85ded2200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T05:36:55.058 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:36:54 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:36:54.945+0000 7ff85ded2200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T05:36:55.357 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:55 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/1196910589' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-08T05:36:55.697 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:36:55 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:36:55.356+0000 7ff85ded2200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T05:36:55.697 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:36:55 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:36:55.479+0000 7ff85ded2200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T05:36:55.704 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-05-08T05:36:55.705 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-05-08T05:36:55.705 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsid": "c739a5c8-0cfc-11ef-bc97-c7b262605968", 2024-05-08T05:36:55.705 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "health": { 2024-05-08T05:36:55.705 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-08T05:36:55.705 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-08T05:36:55.706 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-08T05:36:55.706 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-05-08T05:36:55.706 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-08T05:36:55.706 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-08T05:36:55.707 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 0 2024-05-08T05:36:55.707 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-05-08T05:36:55.707 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-08T05:36:55.707 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "a" 2024-05-08T05:36:55.707 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-05-08T05:36:55.708 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-05-08T05:36:55.708 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-08T05:36:55.708 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T05:36:55.708 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-08T05:36:55.708 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-08T05:36:55.709 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-05-08T05:36:55.709 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-08T05:36:55.710 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T05:36:55.710 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-08T05:36:55.710 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-08T05:36:55.710 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-08T05:36:55.710 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-08T05:36:55.710 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-08T05:36:55.711 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-08T05:36:55.711 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-05-08T05:36:55.711 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-08T05:36:55.711 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-08T05:36:55.711 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-08T05:36:55.711 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-08T05:36:55.711 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-08T05:36:55.712 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-08T05:36:55.712 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-08T05:36:55.713 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-08T05:36:55.713 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-08T05:36:55.713 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-05-08T05:36:55.713 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-08T05:36:55.713 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T05:36:55.713 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-08T05:36:55.713 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-08T05:36:55.713 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-05-08T05:36:55.714 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-08T05:36:55.714 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-08T05:36:55.714 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-08T05:36:55.714 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-08T05:36:55.715 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-08T05:36:55.715 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-08T05:36:55.715 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "restful" 2024-05-08T05:36:55.715 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-05-08T05:36:55.715 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-08T05:36:55.716 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-05-08T05:36:55.716 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-08T05:36:55.716 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T05:36:55.716 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modified": "2024-05-08T05:36:37.441983+0000", 2024-05-08T05:36:55.716 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-08T05:36:55.716 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-05-08T05:36:55.716 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-08T05:36:55.716 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-05-08T05:36:55.717 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:54.947+0000 7f8ab8e00700 1 Processor -- start 2024-05-08T05:36:55.718 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:54.947+0000 7f8ab8e00700 1 -- start start 2024-05-08T05:36:55.718 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:54.947+0000 7f8ab8e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ab4107d00 0x7f8ab4108120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:36:55.718 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:54.947+0000 7f8ab8e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab41086f0 con 0x7f8ab4107d00 2024-05-08T05:36:55.718 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:54.948+0000 7f8ab1e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ab4107d00 0x7f8ab4108120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:36:55.718 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:54.948+0000 7f8ab1e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ab4107d00 0x7f8ab4108120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57420/0 (socket says 172.21.15.82:57420) 2024-05-08T05:36:55.718 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:54.948+0000 7f8ab1e00700 1 -- 172.21.15.82:0/3413534401 learned_addr learned my addr 172.21.15.82:0/3413534401 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:36:55.718 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:54.948+0000 7f8ab1e00700 1 -- 172.21.15.82:0/3413534401 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ab4108f00 con 0x7f8ab4107d00 2024-05-08T05:36:55.718 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:54.949+0000 7f8ab1e00700 1 --2- 172.21.15.82:0/3413534401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ab4107d00 0x7f8ab4108120 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8aa40098a0 tx=0x7f8aa4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53fed206ad236622 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:36:55.719 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:54.949+0000 7f8ab0a00700 1 -- 172.21.15.82:0/3413534401 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8aa4004160 con 0x7f8ab4107d00 2024-05-08T05:36:55.719 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:54.949+0000 7f8ab0a00700 1 -- 172.21.15.82:0/3413534401 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f8aa4004300 con 0x7f8ab4107d00 2024-05-08T05:36:55.719 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:54.949+0000 7f8ab0a00700 1 -- 172.21.15.82:0/3413534401 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8aa4011af0 con 0x7f8ab4107d00 2024-05-08T05:36:55.719 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:54.950+0000 7f8ab8e00700 1 -- 172.21.15.82:0/3413534401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ab4107d00 msgr2=0x7f8ab4108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:36:55.719 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:54.950+0000 7f8ab8e00700 1 --2- 172.21.15.82:0/3413534401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ab4107d00 0x7f8ab4108120 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8aa40098a0 tx=0x7f8aa4009bb0 comp rx=0 tx=0).stop 2024-05-08T05:36:55.720 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:54.950+0000 7f8ab8e00700 1 -- 172.21.15.82:0/3413534401 shutdown_connections 2024-05-08T05:36:55.720 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:54.950+0000 7f8ab8e00700 1 --2- 172.21.15.82:0/3413534401 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ab4107d00 0x7f8ab4108120 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:36:55.720 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:54.950+0000 7f8ab8e00700 1 -- 172.21.15.82:0/3413534401 >> 172.21.15.82:0/3413534401 conn(0x7f8ab41032c0 msgr2=0x7f8ab41056e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:36:55.720 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:54.950+0000 7f8ab8e00700 1 -- 172.21.15.82:0/3413534401 shutdown_connections 2024-05-08T05:36:55.721 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:54.950+0000 7f8ab8e00700 1 -- 172.21.15.82:0/3413534401 wait complete. 2024-05-08T05:36:55.721 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:54.951+0000 7f8ab8e00700 1 Processor -- start 2024-05-08T05:36:55.721 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:54.951+0000 7f8ab8e00700 1 -- start start 2024-05-08T05:36:55.721 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:54.951+0000 7f8ab8e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ab4107d00 0x7f8ab419ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:36:55.721 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:54.951+0000 7f8ab8e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8ab410c2b0 con 0x7f8ab4107d00 2024-05-08T05:36:55.721 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:54.952+0000 7f8ab1e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ab4107d00 0x7f8ab419ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:36:55.722 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:54.952+0000 7f8ab1e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ab4107d00 0x7f8ab419ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57432/0 (socket says 172.21.15.82:57432) 2024-05-08T05:36:55.722 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:54.952+0000 7f8ab1e00700 1 -- 172.21.15.82:0/1196910589 learned_addr learned my addr 172.21.15.82:0/1196910589 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:36:55.722 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:54.952+0000 7f8ab1e00700 1 -- 172.21.15.82:0/1196910589 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ab419d3a0 con 0x7f8ab4107d00 2024-05-08T05:36:55.722 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:54.952+0000 7f8ab1e00700 1 --2- 172.21.15.82:0/1196910589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ab4107d00 0x7f8ab419ce60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4009fb0 tx=0x7f8aa4011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:36:55.723 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:54.953+0000 7f8aaaa00700 1 -- 172.21.15.82:0/1196910589 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8aa40036a0 con 0x7f8ab4107d00 2024-05-08T05:36:55.723 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:54.953+0000 7f8aaaa00700 1 -- 172.21.15.82:0/1196910589 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f8aa401a430 con 0x7f8ab4107d00 2024-05-08T05:36:55.723 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:54.953+0000 7f8ab8e00700 1 -- 172.21.15.82:0/1196910589 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ab419d630 con 0x7f8ab4107d00 2024-05-08T05:36:55.723 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:54.953+0000 7f8aaaa00700 1 -- 172.21.15.82:0/1196910589 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8aa4019550 con 0x7f8ab4107d00 2024-05-08T05:36:55.723 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:54.953+0000 7f8ab8e00700 1 -- 172.21.15.82:0/1196910589 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ab41a02d0 con 0x7f8ab4107d00 2024-05-08T05:36:55.724 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:54.953+0000 7f8aaaa00700 1 -- 172.21.15.82:0/1196910589 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8aa4019b90 con 0x7f8ab4107d00 2024-05-08T05:36:55.724 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:54.953+0000 7f8aaaa00700 1 -- 172.21.15.82:0/1196910589 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f8aa4024730 con 0x7f8ab4107d00 2024-05-08T05:36:55.724 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:54.954+0000 7f8ab8e00700 1 -- 172.21.15.82:0/1196910589 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ab406a5c0 con 0x7f8ab4107d00 2024-05-08T05:36:55.724 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:54.958+0000 7f8aaaa00700 1 -- 172.21.15.82:0/1196910589 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f8aa4043ec0 con 0x7f8ab4107d00 2024-05-08T05:36:55.724 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:55.036+0000 7f8ab8e00700 1 -- 172.21.15.82:0/1196910589 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f8ab402e720 con 0x7f8ab4107d00 2024-05-08T05:36:55.724 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:55.037+0000 7f8aaaa00700 1 -- 172.21.15.82:0/1196910589 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1240 (secure 0 0 0) 0x7f8aa4032020 con 0x7f8ab4107d00 2024-05-08T05:36:55.725 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:55.039+0000 7f8ab8e00700 1 -- 172.21.15.82:0/1196910589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ab4107d00 msgr2=0x7f8ab419ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:36:55.725 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:55.039+0000 7f8ab8e00700 1 --2- 172.21.15.82:0/1196910589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ab4107d00 0x7f8ab419ce60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4009fb0 tx=0x7f8aa4011940 comp rx=0 tx=0).stop 2024-05-08T05:36:55.725 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:55.039+0000 7f8ab8e00700 1 -- 172.21.15.82:0/1196910589 shutdown_connections 2024-05-08T05:36:55.725 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:55.039+0000 7f8ab8e00700 1 --2- 172.21.15.82:0/1196910589 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ab4107d00 0x7f8ab419ce60 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:36:55.725 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:55.039+0000 7f8ab8e00700 1 -- 172.21.15.82:0/1196910589 >> 172.21.15.82:0/1196910589 conn(0x7f8ab41032c0 msgr2=0x7f8ab41041e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:36:55.725 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:55.039+0000 7f8ab8e00700 1 -- 172.21.15.82:0/1196910589 shutdown_connections 2024-05-08T05:36:55.725 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:55.039+0000 7f8ab8e00700 1 -- 172.21.15.82:0/1196910589 wait complete. 2024-05-08T05:36:55.726 INFO:teuthology.orchestra.run.smithi082.stdout:mgr not available, waiting (3/15)... 2024-05-08T05:36:56.522 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:36:56 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:36:56.236+0000 7ff85ded2200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T05:36:56.970 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:36:56 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:36:56.520+0000 7ff85ded2200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T05:36:56.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:56 smithi082 ceph-mon[30098]: Activating manager daemon x 2024-05-08T05:36:56.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:56 smithi082 ceph-mon[30098]: mgrmap e2: x(active, starting, since 0.0126223s) 2024-05-08T05:36:56.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:56 smithi082 ceph-mon[30098]: from='mgr.14100 172.21.15.82:0/3511447758' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-08T05:36:56.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:56 smithi082 ceph-mon[30098]: from='mgr.14100 172.21.15.82:0/3511447758' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-08T05:36:56.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:56 smithi082 ceph-mon[30098]: from='mgr.14100 172.21.15.82:0/3511447758' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-08T05:36:56.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:56 smithi082 ceph-mon[30098]: from='mgr.14100 172.21.15.82:0/3511447758' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-08T05:36:56.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:56 smithi082 ceph-mon[30098]: from='mgr.14100 172.21.15.82:0/3511447758' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-08T05:36:56.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:56 smithi082 ceph-mon[30098]: from='mgr.14100 172.21.15.82:0/3511447758' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-08T05:36:56.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:56 smithi082 ceph-mon[30098]: from='mgr.14100 172.21.15.82:0/3511447758' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T05:36:56.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:56 smithi082 ceph-mon[30098]: from='mgr.14100 172.21.15.82:0/3511447758' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-08T05:36:56.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:56 smithi082 ceph-mon[30098]: Manager daemon x is now available 2024-05-08T05:36:56.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:56 smithi082 ceph-mon[30098]: from='mgr.14100 172.21.15.82:0/3511447758' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-08T05:36:56.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:56 smithi082 ceph-mon[30098]: from='mgr.14100 172.21.15.82:0/3511447758' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-08T05:36:56.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:56 smithi082 ceph-mon[30098]: from='mgr.14100 172.21.15.82:0/3511447758' entity='mgr.x' 2024-05-08T05:36:56.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:56 smithi082 ceph-mon[30098]: from='mgr.14100 172.21.15.82:0/3511447758' entity='mgr.x' 2024-05-08T05:36:57.884 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:57 smithi082 ceph-mon[30098]: from='mgr.14100 172.21.15.82:0/3511447758' entity='mgr.x' 2024-05-08T05:36:57.884 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:57 smithi082 ceph-mon[30098]: mgrmap e3: x(active, since 1.02243s) 2024-05-08T05:36:59.517 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-05-08T05:36:59.529 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-05-08T05:36:59.529 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsid": "c739a5c8-0cfc-11ef-bc97-c7b262605968", 2024-05-08T05:36:59.529 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "health": { 2024-05-08T05:36:59.529 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-08T05:36:59.529 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-08T05:36:59.529 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-08T05:36:59.529 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-05-08T05:36:59.529 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-08T05:36:59.529 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-08T05:36:59.529 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 0 2024-05-08T05:36:59.529 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-05-08T05:36:59.529 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-08T05:36:59.529 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "a" 2024-05-08T05:36:59.530 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-05-08T05:36:59.530 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "quorum_age": 14, 2024-05-08T05:36:59.530 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-08T05:36:59.530 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T05:36:59.530 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-08T05:36:59.530 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-08T05:36:59.530 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-05-08T05:36:59.530 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-08T05:36:59.530 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T05:36:59.530 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-08T05:36:59.530 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-08T05:36:59.530 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-08T05:36:59.530 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-08T05:36:59.530 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-08T05:36:59.531 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-08T05:36:59.531 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-05-08T05:36:59.531 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-08T05:36:59.531 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-08T05:36:59.531 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-08T05:36:59.531 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-08T05:36:59.531 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-08T05:36:59.531 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-08T05:36:59.531 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-08T05:36:59.531 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-08T05:36:59.531 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-08T05:36:59.531 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-05-08T05:36:59.531 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-08T05:36:59.531 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T05:36:59.532 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-08T05:36:59.532 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-08T05:36:59.532 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-05-08T05:36:59.532 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-08T05:36:59.532 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-08T05:36:59.532 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-08T05:36:59.532 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-08T05:36:59.532 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-08T05:36:59.532 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-08T05:36:59.532 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "restful" 2024-05-08T05:36:59.532 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ], 2024-05-08T05:36:59.532 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-08T05:36:59.532 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-05-08T05:36:59.532 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-08T05:36:59.532 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-08T05:36:59.533 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "modified": "2024-05-08T05:36:37.441983+0000", 2024-05-08T05:36:59.533 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-08T05:36:59.533 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout }, 2024-05-08T05:36:59.533 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-08T05:36:59.533 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-05-08T05:36:59.533 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:58.321+0000 7f6480200700 1 Processor -- start 2024-05-08T05:36:59.533 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:58.321+0000 7f6480200700 1 -- start start 2024-05-08T05:36:59.533 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:58.322+0000 7f6480200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f647810b160 0x7f647810b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:36:59.533 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:58.322+0000 7f6480200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f647810bb50 con 0x7f647810b160 2024-05-08T05:36:59.533 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:58.322+0000 7f647d800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f647810b160 0x7f647810b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:36:59.533 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:58.322+0000 7f647d800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f647810b160 0x7f647810b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57484/0 (socket says 172.21.15.82:57484) 2024-05-08T05:36:59.533 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:58.322+0000 7f647d800700 1 -- 172.21.15.82:0/750829795 learned_addr learned my addr 172.21.15.82:0/750829795 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:36:59.533 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:58.323+0000 7f647d800700 1 -- 172.21.15.82:0/750829795 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f647810c1f0 con 0x7f647810b160 2024-05-08T05:36:59.533 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:58.323+0000 7f647d800700 1 --2- 172.21.15.82:0/750829795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f647810b160 0x7f647810b580 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f646c0098a0 tx=0x7f646c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd25f354187f6323 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:36:59.533 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:58.324+0000 7f6477e00700 1 -- 172.21.15.82:0/750829795 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f646c004160 con 0x7f647810b160 2024-05-08T05:36:59.534 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:58.324+0000 7f6477e00700 1 -- 172.21.15.82:0/750829795 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f646c004300 con 0x7f647810b160 2024-05-08T05:36:59.534 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:58.324+0000 7f6477e00700 1 -- 172.21.15.82:0/750829795 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f646c011af0 con 0x7f647810b160 2024-05-08T05:36:59.534 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:58.324+0000 7f6480200700 1 -- 172.21.15.82:0/750829795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f647810b160 msgr2=0x7f647810b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:36:59.534 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:58.324+0000 7f6480200700 1 --2- 172.21.15.82:0/750829795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f647810b160 0x7f647810b580 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f646c0098a0 tx=0x7f646c009bb0 comp rx=0 tx=0).stop 2024-05-08T05:36:59.534 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:58.324+0000 7f6480200700 1 -- 172.21.15.82:0/750829795 shutdown_connections 2024-05-08T05:36:59.534 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:58.324+0000 7f6480200700 1 --2- 172.21.15.82:0/750829795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f647810b160 0x7f647810b580 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:36:59.534 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:58.324+0000 7f6480200700 1 -- 172.21.15.82:0/750829795 >> 172.21.15.82:0/750829795 conn(0x7f647807e3a0 msgr2=0x7f647807e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:36:59.534 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:58.324+0000 7f6480200700 1 -- 172.21.15.82:0/750829795 shutdown_connections 2024-05-08T05:36:59.534 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:58.325+0000 7f6480200700 1 -- 172.21.15.82:0/750829795 wait complete. 2024-05-08T05:36:59.534 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:58.325+0000 7f6480200700 1 Processor -- start 2024-05-08T05:36:59.534 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:58.326+0000 7f6480200700 1 -- start start 2024-05-08T05:36:59.534 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:58.326+0000 7f6480200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f647810b160 0x7f647819efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:36:59.534 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:58.326+0000 7f6480200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f647810f5a0 con 0x7f647810b160 2024-05-08T05:36:59.534 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:58.326+0000 7f647d800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f647810b160 0x7f647819efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:36:59.535 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:58.326+0000 7f647d800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f647810b160 0x7f647819efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57498/0 (socket says 172.21.15.82:57498) 2024-05-08T05:36:59.535 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:58.326+0000 7f647d800700 1 -- 172.21.15.82:0/1306856607 learned_addr learned my addr 172.21.15.82:0/1306856607 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:36:59.535 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:58.327+0000 7f647d800700 1 -- 172.21.15.82:0/1306856607 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f647819f4e0 con 0x7f647810b160 2024-05-08T05:36:59.535 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:58.327+0000 7f647d800700 1 --2- 172.21.15.82:0/1306856607 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f647810b160 0x7f647819efa0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f646c0117b0 tx=0x7f646c011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:36:59.535 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:58.327+0000 7f6476000700 1 -- 172.21.15.82:0/1306856607 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f646c003af0 con 0x7f647810b160 2024-05-08T05:36:59.535 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:58.327+0000 7f6476000700 1 -- 172.21.15.82:0/1306856607 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f646c020070 con 0x7f647810b160 2024-05-08T05:36:59.535 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:58.327+0000 7f6480200700 1 -- 172.21.15.82:0/1306856607 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f647819f770 con 0x7f647810b160 2024-05-08T05:36:59.535 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:58.327+0000 7f6476000700 1 -- 172.21.15.82:0/1306856607 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f646c019630 con 0x7f647810b160 2024-05-08T05:36:59.535 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:58.327+0000 7f6480200700 1 -- 172.21.15.82:0/1306856607 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64781a2460 con 0x7f647810b160 2024-05-08T05:36:59.535 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:58.328+0000 7f6476000700 1 -- 172.21.15.82:0/1306856607 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 3) ==== 50105+0+0 (secure 0 0 0) 0x7f646c01a430 con 0x7f647810b160 2024-05-08T05:36:59.535 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:58.328+0000 7f6480200700 1 -- 172.21.15.82:0/1306856607 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f647806a5c0 con 0x7f647810b160 2024-05-08T05:36:59.535 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:58.329+0000 7f6476000700 1 --2- 172.21.15.82:0/1306856607 >> [v2:172.21.15.82:6800/3546670887,v1:172.21.15.82:6801/3546670887] conn(0x7f646003e350 0x7f6460040810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:36:59.535 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:58.329+0000 7f6476000700 1 -- 172.21.15.82:0/1306856607 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f646c053810 con 0x7f647810b160 2024-05-08T05:36:59.536 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:58.329+0000 7f647ce00700 1 --2- 172.21.15.82:0/1306856607 >> [v2:172.21.15.82:6800/3546670887,v1:172.21.15.82:6801/3546670887] conn(0x7f646003e350 0x7f6460040810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:36:59.536 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:58.330+0000 7f647ce00700 1 --2- 172.21.15.82:0/1306856607 >> [v2:172.21.15.82:6800/3546670887,v1:172.21.15.82:6801/3546670887] conn(0x7f646003e350 0x7f6460040810 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6464006fd0 tx=0x7f6464006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:36:59.536 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:58.335+0000 7f6476000700 1 -- 172.21.15.82:0/1306856607 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f646c0042a0 con 0x7f647810b160 2024-05-08T05:36:59.536 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:58.589+0000 7f6476000700 1 -- 172.21.15.82:0/1306856607 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 4) ==== 50211+0+0 (secure 0 0 0) 0x7f646c02a060 con 0x7f647810b160 2024-05-08T05:36:59.536 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:58.656+0000 7f6480200700 1 -- 172.21.15.82:0/1306856607 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f64781a2630 con 0x7f647810b160 2024-05-08T05:36:59.536 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:58.657+0000 7f6476000700 1 -- 172.21.15.82:0/1306856607 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f64781a2630 con 0x7f647810b160 2024-05-08T05:36:59.536 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:58.659+0000 7f6480200700 1 -- 172.21.15.82:0/1306856607 >> [v2:172.21.15.82:6800/3546670887,v1:172.21.15.82:6801/3546670887] conn(0x7f646003e350 msgr2=0x7f6460040810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:36:59.536 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:58.659+0000 7f6480200700 1 --2- 172.21.15.82:0/1306856607 >> [v2:172.21.15.82:6800/3546670887,v1:172.21.15.82:6801/3546670887] conn(0x7f646003e350 0x7f6460040810 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6464006fd0 tx=0x7f6464006e40 comp rx=0 tx=0).stop 2024-05-08T05:36:59.536 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:58.659+0000 7f6480200700 1 -- 172.21.15.82:0/1306856607 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f647810b160 msgr2=0x7f647819efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:36:59.536 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:58.659+0000 7f6480200700 1 --2- 172.21.15.82:0/1306856607 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f647810b160 0x7f647819efa0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f646c0117b0 tx=0x7f646c011b70 comp rx=0 tx=0).stop 2024-05-08T05:36:59.536 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:58.660+0000 7f6480200700 1 -- 172.21.15.82:0/1306856607 shutdown_connections 2024-05-08T05:36:59.536 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:58.660+0000 7f6480200700 1 --2- 172.21.15.82:0/1306856607 >> [v2:172.21.15.82:6800/3546670887,v1:172.21.15.82:6801/3546670887] conn(0x7f646003e350 0x7f6460040810 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:36:59.536 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:58.660+0000 7f6480200700 1 --2- 172.21.15.82:0/1306856607 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f647810b160 0x7f647819efa0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:36:59.536 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:58.660+0000 7f6480200700 1 -- 172.21.15.82:0/1306856607 >> 172.21.15.82:0/1306856607 conn(0x7f647807e3a0 msgr2=0x7f6478108e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:36:59.536 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:58.660+0000 7f6480200700 1 -- 172.21.15.82:0/1306856607 shutdown_connections 2024-05-08T05:36:59.537 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:36:58.660+0000 7f6480200700 1 -- 172.21.15.82:0/1306856607 wait complete. 2024-05-08T05:36:59.537 INFO:teuthology.orchestra.run.smithi082.stdout:mgr is available 2024-05-08T05:36:59.802 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:59 smithi082 ceph-mon[30098]: mgrmap e4: x(active, since 2s) 2024-05-08T05:36:59.803 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:36:59 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/1306856607' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-08T05:37:00.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:00 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/457256014' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-05-08T05:37:01.013 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-05-08T05:37:01.013 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout [global] 2024-05-08T05:37:01.013 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout fsid = c739a5c8-0cfc-11ef-bc97-c7b262605968 2024-05-08T05:37:01.013 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-05-08T05:37:01.013 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-05-08T05:37:01.013 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-05-08T05:37:01.013 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-05-08T05:37:01.013 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-05-08T05:37:01.014 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-05-08T05:37:01.014 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout [mgr] 2024-05-08T05:37:01.014 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-05-08T05:37:01.014 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 2024-05-08T05:37:01.014 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout [osd] 2024-05-08T05:37:01.014 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-05-08T05:37:01.014 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-05-08T05:37:01.014 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-05-08T05:37:01.014 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-05-08T05:37:01.014 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-05-08T05:37:01.014 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:00.076+0000 7f0d57200700 1 Processor -- start 2024-05-08T05:37:01.014 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:00.076+0000 7f0d57200700 1 -- start start 2024-05-08T05:37:01.014 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:00.077+0000 7f0d57200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d5007f6d0 0x7f0d5007db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:01.015 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:00.077+0000 7f0d57200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0d5007e0c0 con 0x7f0d5007f6d0 2024-05-08T05:37:01.015 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:00.077+0000 7f0d4fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d5007f6d0 0x7f0d5007db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:01.015 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:00.077+0000 7f0d4fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d5007f6d0 0x7f0d5007db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57504/0 (socket says 172.21.15.82:57504) 2024-05-08T05:37:01.015 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:00.077+0000 7f0d4fe00700 1 -- 172.21.15.82:0/848979965 learned_addr learned my addr 172.21.15.82:0/848979965 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:37:01.015 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:00.078+0000 7f0d4fe00700 1 -- 172.21.15.82:0/848979965 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d5007e240 con 0x7f0d5007f6d0 2024-05-08T05:37:01.015 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:00.078+0000 7f0d4fe00700 1 --2- 172.21.15.82:0/848979965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d5007f6d0 0x7f0d5007db80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0d400098a0 tx=0x7f0d40009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=157e9ebb01d3eac1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:01.015 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:00.078+0000 7f0d4ea00700 1 -- 172.21.15.82:0/848979965 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d40004160 con 0x7f0d5007f6d0 2024-05-08T05:37:01.015 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:00.078+0000 7f0d4ea00700 1 -- 172.21.15.82:0/848979965 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f0d40004300 con 0x7f0d5007f6d0 2024-05-08T05:37:01.015 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:00.078+0000 7f0d4ea00700 1 -- 172.21.15.82:0/848979965 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d40011af0 con 0x7f0d5007f6d0 2024-05-08T05:37:01.015 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:00.079+0000 7f0d57200700 1 -- 172.21.15.82:0/848979965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d5007f6d0 msgr2=0x7f0d5007db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:01.015 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:00.079+0000 7f0d57200700 1 --2- 172.21.15.82:0/848979965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d5007f6d0 0x7f0d5007db80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f0d400098a0 tx=0x7f0d40009bb0 comp rx=0 tx=0).stop 2024-05-08T05:37:01.015 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:00.079+0000 7f0d57200700 1 -- 172.21.15.82:0/848979965 shutdown_connections 2024-05-08T05:37:01.015 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:00.079+0000 7f0d57200700 1 --2- 172.21.15.82:0/848979965 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d5007f6d0 0x7f0d5007db80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:01.016 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:00.079+0000 7f0d57200700 1 -- 172.21.15.82:0/848979965 >> 172.21.15.82:0/848979965 conn(0x7f0d50104410 msgr2=0x7f0d50106830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:37:01.016 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:00.079+0000 7f0d57200700 1 -- 172.21.15.82:0/848979965 shutdown_connections 2024-05-08T05:37:01.016 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:00.079+0000 7f0d57200700 1 -- 172.21.15.82:0/848979965 wait complete. 2024-05-08T05:37:01.016 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:00.080+0000 7f0d57200700 1 Processor -- start 2024-05-08T05:37:01.016 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:00.080+0000 7f0d57200700 1 -- start start 2024-05-08T05:37:01.016 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:00.081+0000 7f0d57200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d5007f6d0 0x7f0d5019ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:01.016 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:00.081+0000 7f0d57200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0d5010f3a0 con 0x7f0d5007f6d0 2024-05-08T05:37:01.016 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:00.081+0000 7f0d4fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d5007f6d0 0x7f0d5019ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:01.016 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:00.081+0000 7f0d4fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d5007f6d0 0x7f0d5019ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57518/0 (socket says 172.21.15.82:57518) 2024-05-08T05:37:01.016 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:00.081+0000 7f0d4fe00700 1 -- 172.21.15.82:0/457256014 learned_addr learned my addr 172.21.15.82:0/457256014 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:37:01.016 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:00.081+0000 7f0d4fe00700 1 -- 172.21.15.82:0/457256014 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d5019f490 con 0x7f0d5007f6d0 2024-05-08T05:37:01.016 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:00.082+0000 7f0d4fe00700 1 --2- 172.21.15.82:0/457256014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d5007f6d0 0x7f0d5019ef50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0d40009fb0 tx=0x7f0d40011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:01.016 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:00.082+0000 7f0d4cc00700 1 -- 172.21.15.82:0/457256014 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d400036a0 con 0x7f0d5007f6d0 2024-05-08T05:37:01.017 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:00.082+0000 7f0d4cc00700 1 -- 172.21.15.82:0/457256014 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f0d4001a430 con 0x7f0d5007f6d0 2024-05-08T05:37:01.017 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:00.082+0000 7f0d4cc00700 1 -- 172.21.15.82:0/457256014 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0d40019550 con 0x7f0d5007f6d0 2024-05-08T05:37:01.017 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:00.082+0000 7f0d57200700 1 -- 172.21.15.82:0/457256014 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d5019f720 con 0x7f0d5007f6d0 2024-05-08T05:37:01.017 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:00.082+0000 7f0d57200700 1 -- 172.21.15.82:0/457256014 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d501a2410 con 0x7f0d5007f6d0 2024-05-08T05:37:01.017 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:00.083+0000 7f0d57200700 1 -- 172.21.15.82:0/457256014 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d5006a5c0 con 0x7f0d5007f6d0 2024-05-08T05:37:01.017 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:00.083+0000 7f0d4cc00700 1 -- 172.21.15.82:0/457256014 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) ==== 50211+0+0 (secure 0 0 0) 0x7f0d4001a8e0 con 0x7f0d5007f6d0 2024-05-08T05:37:01.017 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:00.084+0000 7f0d4cc00700 1 --2- 172.21.15.82:0/457256014 >> [v2:172.21.15.82:6800/3546670887,v1:172.21.15.82:6801/3546670887] conn(0x7f0d3403e3d0 0x7f0d34040890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:01.017 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:00.084+0000 7f0d4cc00700 1 -- 172.21.15.82:0/457256014 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0d40053800 con 0x7f0d5007f6d0 2024-05-08T05:37:01.017 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:00.084+0000 7f0d4f400700 1 --2- 172.21.15.82:0/457256014 >> [v2:172.21.15.82:6800/3546670887,v1:172.21.15.82:6801/3546670887] conn(0x7f0d3403e3d0 0x7f0d34040890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:01.017 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:00.085+0000 7f0d4f400700 1 --2- 172.21.15.82:0/457256014 >> [v2:172.21.15.82:6800/3546670887,v1:172.21.15.82:6801/3546670887] conn(0x7f0d3403e3d0 0x7f0d34040890 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c006fd0 tx=0x7f0d3c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:01.017 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:00.090+0000 7f0d4cc00700 1 -- 172.21.15.82:0/457256014 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0d4000b3e0 con 0x7f0d5007f6d0 2024-05-08T05:37:01.017 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:00.303+0000 7f0d57200700 1 -- 172.21.15.82:0/457256014 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f0d501a25e0 con 0x7f0d5007f6d0 2024-05-08T05:37:01.017 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:00.305+0000 7f0d4cc00700 1 -- 172.21.15.82:0/457256014 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+409 (secure 0 0 0) 0x7f0d501a25e0 con 0x7f0d5007f6d0 2024-05-08T05:37:01.017 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:00.307+0000 7f0d57200700 1 -- 172.21.15.82:0/457256014 >> [v2:172.21.15.82:6800/3546670887,v1:172.21.15.82:6801/3546670887] conn(0x7f0d3403e3d0 msgr2=0x7f0d34040890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:01.018 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:00.307+0000 7f0d57200700 1 --2- 172.21.15.82:0/457256014 >> [v2:172.21.15.82:6800/3546670887,v1:172.21.15.82:6801/3546670887] conn(0x7f0d3403e3d0 0x7f0d34040890 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c006fd0 tx=0x7f0d3c006e40 comp rx=0 tx=0).stop 2024-05-08T05:37:01.018 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:00.308+0000 7f0d57200700 1 -- 172.21.15.82:0/457256014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d5007f6d0 msgr2=0x7f0d5019ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:01.018 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:00.308+0000 7f0d57200700 1 --2- 172.21.15.82:0/457256014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d5007f6d0 0x7f0d5019ef50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f0d40009fb0 tx=0x7f0d40011940 comp rx=0 tx=0).stop 2024-05-08T05:37:01.018 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:00.308+0000 7f0d57200700 1 -- 172.21.15.82:0/457256014 shutdown_connections 2024-05-08T05:37:01.018 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:00.308+0000 7f0d57200700 1 --2- 172.21.15.82:0/457256014 >> [v2:172.21.15.82:6800/3546670887,v1:172.21.15.82:6801/3546670887] conn(0x7f0d3403e3d0 0x7f0d34040890 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:01.018 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:00.308+0000 7f0d57200700 1 --2- 172.21.15.82:0/457256014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0d5007f6d0 0x7f0d5019ef50 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:01.018 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:00.308+0000 7f0d57200700 1 -- 172.21.15.82:0/457256014 >> 172.21.15.82:0/457256014 conn(0x7f0d50104410 msgr2=0x7f0d50104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:37:01.018 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:00.308+0000 7f0d57200700 1 -- 172.21.15.82:0/457256014 shutdown_connections 2024-05-08T05:37:01.018 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:00.308+0000 7f0d57200700 1 -- 172.21.15.82:0/457256014 wait complete. 2024-05-08T05:37:01.018 INFO:teuthology.orchestra.run.smithi082.stdout:Enabling cephadm module... 2024-05-08T05:37:02.217 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:01 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/2507533083' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-05-08T05:37:02.218 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:02 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: ignoring --setuser ceph since I am not root 2024-05-08T05:37:02.218 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:02 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: ignoring --setgroup ceph since I am not root 2024-05-08T05:37:02.470 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:02 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:37:02.215+0000 7f92221cf200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T05:37:02.470 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:02 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:37:02.457+0000 7f92221cf200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T05:37:02.672 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:01.578+0000 7fb940800700 1 Processor -- start 2024-05-08T05:37:02.672 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:01.578+0000 7fb940800700 1 -- start start 2024-05-08T05:37:02.672 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:01.579+0000 7fb940800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb93807edf0 0x7fb93807d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:02.672 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:01.579+0000 7fb940800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb93807d830 con 0x7fb93807edf0 2024-05-08T05:37:02.672 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:01.579+0000 7fb93de00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb93807edf0 0x7fb93807d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:02.672 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:01.579+0000 7fb93de00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb93807edf0 0x7fb93807d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57522/0 (socket says 172.21.15.82:57522) 2024-05-08T05:37:02.672 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:01.579+0000 7fb93de00700 1 -- 172.21.15.82:0/842067243 learned_addr learned my addr 172.21.15.82:0/842067243 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:37:02.672 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:01.580+0000 7fb93de00700 1 -- 172.21.15.82:0/842067243 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb93807d9b0 con 0x7fb93807edf0 2024-05-08T05:37:02.675 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:01.580+0000 7fb93de00700 1 --2- 172.21.15.82:0/842067243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb93807edf0 0x7fb93807d2f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb92c0098a0 tx=0x7fb92c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eee660dbf22c5ac8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:02.676 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:01.580+0000 7fb93ca00700 1 -- 172.21.15.82:0/842067243 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb92c004160 con 0x7fb93807edf0 2024-05-08T05:37:02.676 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:01.580+0000 7fb93ca00700 1 -- 172.21.15.82:0/842067243 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fb92c004300 con 0x7fb93807edf0 2024-05-08T05:37:02.676 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:01.580+0000 7fb93ca00700 1 -- 172.21.15.82:0/842067243 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb92c011af0 con 0x7fb93807edf0 2024-05-08T05:37:02.676 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:01.581+0000 7fb940800700 1 -- 172.21.15.82:0/842067243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb93807edf0 msgr2=0x7fb93807d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:02.676 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:01.581+0000 7fb940800700 1 --2- 172.21.15.82:0/842067243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb93807edf0 0x7fb93807d2f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb92c0098a0 tx=0x7fb92c009bb0 comp rx=0 tx=0).stop 2024-05-08T05:37:02.676 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:01.581+0000 7fb940800700 1 -- 172.21.15.82:0/842067243 shutdown_connections 2024-05-08T05:37:02.676 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:01.581+0000 7fb940800700 1 --2- 172.21.15.82:0/842067243 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb93807edf0 0x7fb93807d2f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:02.676 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:01.581+0000 7fb940800700 1 -- 172.21.15.82:0/842067243 >> 172.21.15.82:0/842067243 conn(0x7fb938104450 msgr2=0x7fb938106870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:37:02.676 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:01.581+0000 7fb940800700 1 -- 172.21.15.82:0/842067243 shutdown_connections 2024-05-08T05:37:02.676 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:01.581+0000 7fb940800700 1 -- 172.21.15.82:0/842067243 wait complete. 2024-05-08T05:37:02.676 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:01.582+0000 7fb940800700 1 Processor -- start 2024-05-08T05:37:02.676 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:01.582+0000 7fb940800700 1 -- start start 2024-05-08T05:37:02.676 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:01.583+0000 7fb940800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb93807edf0 0x7fb93819efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:02.677 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:01.583+0000 7fb940800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb93810f3a0 con 0x7fb93807edf0 2024-05-08T05:37:02.677 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:01.583+0000 7fb93de00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb93807edf0 0x7fb93819efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:02.677 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:01.583+0000 7fb93de00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb93807edf0 0x7fb93819efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57532/0 (socket says 172.21.15.82:57532) 2024-05-08T05:37:02.677 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:01.583+0000 7fb93de00700 1 -- 172.21.15.82:0/2507533083 learned_addr learned my addr 172.21.15.82:0/2507533083 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:37:02.677 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:01.583+0000 7fb93de00700 1 -- 172.21.15.82:0/2507533083 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb93819f4e0 con 0x7fb93807edf0 2024-05-08T05:37:02.677 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:01.584+0000 7fb93de00700 1 --2- 172.21.15.82:0/2507533083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb93807edf0 0x7fb93819efa0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb92c011ac0 tx=0x7fb92c011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:02.677 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:01.584+0000 7fb932a00700 1 -- 172.21.15.82:0/2507533083 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb92c003970 con 0x7fb93807edf0 2024-05-08T05:37:02.677 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:01.584+0000 7fb932a00700 1 -- 172.21.15.82:0/2507533083 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fb92c003b10 con 0x7fb93807edf0 2024-05-08T05:37:02.677 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:01.584+0000 7fb940800700 1 -- 172.21.15.82:0/2507533083 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb93819f770 con 0x7fb93807edf0 2024-05-08T05:37:02.677 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:01.584+0000 7fb932a00700 1 -- 172.21.15.82:0/2507533083 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb92c024610 con 0x7fb93807edf0 2024-05-08T05:37:02.677 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:01.584+0000 7fb940800700 1 -- 172.21.15.82:0/2507533083 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9381a2460 con 0x7fb93807edf0 2024-05-08T05:37:02.677 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:01.585+0000 7fb932a00700 1 -- 172.21.15.82:0/2507533083 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 4) ==== 50211+0+0 (secure 0 0 0) 0x7fb92c01a430 con 0x7fb93807edf0 2024-05-08T05:37:02.677 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:01.585+0000 7fb940800700 1 -- 172.21.15.82:0/2507533083 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb93806a5c0 con 0x7fb93807edf0 2024-05-08T05:37:02.677 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:01.586+0000 7fb932a00700 1 --2- 172.21.15.82:0/2507533083 >> [v2:172.21.15.82:6800/3546670887,v1:172.21.15.82:6801/3546670887] conn(0x7fb92003e470 0x7fb920040930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:02.677 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:01.586+0000 7fb932a00700 1 -- 172.21.15.82:0/2507533083 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb92c0537a0 con 0x7fb93807edf0 2024-05-08T05:37:02.678 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:01.586+0000 7fb93d400700 1 --2- 172.21.15.82:0/2507533083 >> [v2:172.21.15.82:6800/3546670887,v1:172.21.15.82:6801/3546670887] conn(0x7fb92003e470 0x7fb920040930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:02.679 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:01.587+0000 7fb93d400700 1 --2- 172.21.15.82:0/2507533083 >> [v2:172.21.15.82:6800/3546670887,v1:172.21.15.82:6801/3546670887] conn(0x7fb92003e470 0x7fb920040930 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb928006fd0 tx=0x7fb928006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:02.679 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:01.591+0000 7fb932a00700 1 -- 172.21.15.82:0/2507533083 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb92c00b3e0 con 0x7fb93807edf0 2024-05-08T05:37:02.679 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:01.884+0000 7fb940800700 1 -- 172.21.15.82:0/2507533083 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7fb9381a2630 con 0x7fb93807edf0 2024-05-08T05:37:02.680 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:01.938+0000 7fb932a00700 1 -- 172.21.15.82:0/2507533083 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7fb9381a2630 con 0x7fb93807edf0 2024-05-08T05:37:02.680 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:01.941+0000 7fb932a00700 1 -- 172.21.15.82:0/2507533083 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mgrmap(e 5) ==== 50222+0+0 (secure 0 0 0) 0x7fb92c01a9e0 con 0x7fb93807edf0 2024-05-08T05:37:02.680 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:01.942+0000 7fb940800700 1 -- 172.21.15.82:0/2507533083 >> [v2:172.21.15.82:6800/3546670887,v1:172.21.15.82:6801/3546670887] conn(0x7fb92003e470 msgr2=0x7fb920040930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:02.680 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:01.943+0000 7fb940800700 1 --2- 172.21.15.82:0/2507533083 >> [v2:172.21.15.82:6800/3546670887,v1:172.21.15.82:6801/3546670887] conn(0x7fb92003e470 0x7fb920040930 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb928006fd0 tx=0x7fb928006e40 comp rx=0 tx=0).stop 2024-05-08T05:37:02.680 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:01.943+0000 7fb940800700 1 -- 172.21.15.82:0/2507533083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb93807edf0 msgr2=0x7fb93819efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:02.680 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:01.943+0000 7fb940800700 1 --2- 172.21.15.82:0/2507533083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb93807edf0 0x7fb93819efa0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fb92c011ac0 tx=0x7fb92c011ba0 comp rx=0 tx=0).stop 2024-05-08T05:37:02.680 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:01.943+0000 7fb940800700 1 -- 172.21.15.82:0/2507533083 shutdown_connections 2024-05-08T05:37:02.680 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:01.943+0000 7fb940800700 1 --2- 172.21.15.82:0/2507533083 >> [v2:172.21.15.82:6800/3546670887,v1:172.21.15.82:6801/3546670887] conn(0x7fb92003e470 0x7fb920040930 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:02.680 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:01.943+0000 7fb940800700 1 --2- 172.21.15.82:0/2507533083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb93807edf0 0x7fb93819efa0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:02.680 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:01.943+0000 7fb940800700 1 -- 172.21.15.82:0/2507533083 >> 172.21.15.82:0/2507533083 conn(0x7fb938104450 msgr2=0x7fb938104fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:37:02.680 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:01.944+0000 7fb940800700 1 -- 172.21.15.82:0/2507533083 shutdown_connections 2024-05-08T05:37:02.680 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:01.944+0000 7fb940800700 1 -- 172.21.15.82:0/2507533083 wait complete. 2024-05-08T05:37:02.936 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:02 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:37:02.587+0000 7f92221cf200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T05:37:03.210 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:03 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:37:03.007+0000 7f92221cf200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T05:37:03.210 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:03 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:37:03.124+0000 7f92221cf200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T05:37:03.211 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:02 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/2507533083' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-05-08T05:37:03.211 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:02 smithi082 ceph-mon[30098]: mgrmap e5: x(active, since 5s) 2024-05-08T05:37:04.100 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:03 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/1156685124' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-05-08T05:37:04.114 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-05-08T05:37:04.114 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-05-08T05:37:04.114 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-08T05:37:04.114 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-05-08T05:37:04.114 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-05-08T05:37:04.115 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-05-08T05:37:04.115 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:03.209+0000 7ff0ce200700 1 Processor -- start 2024-05-08T05:37:04.115 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:03.209+0000 7ff0ce200700 1 -- start start 2024-05-08T05:37:04.115 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:03.210+0000 7ff0ce200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0c807f780 0x7ff0c807dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:04.115 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:03.210+0000 7ff0ce200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c807e1b0 con 0x7ff0c807f780 2024-05-08T05:37:04.115 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:03.210+0000 7ff0c7400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0c807f780 0x7ff0c807dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:04.115 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:03.210+0000 7ff0c7400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0c807f780 0x7ff0c807dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43206/0 (socket says 172.21.15.82:43206) 2024-05-08T05:37:04.115 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:03.210+0000 7ff0c7400700 1 -- 172.21.15.82:0/132001519 learned_addr learned my addr 172.21.15.82:0/132001519 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:37:04.115 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:03.211+0000 7ff0c7400700 1 -- 172.21.15.82:0/132001519 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0c807e330 con 0x7ff0c807f780 2024-05-08T05:37:04.115 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:03.211+0000 7ff0c7400700 1 --2- 172.21.15.82:0/132001519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0c807f780 0x7ff0c807dbe0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff0b80098a0 tx=0x7ff0b8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78c9754601407c60 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:04.115 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:03.211+0000 7ff0c6000700 1 -- 172.21.15.82:0/132001519 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0b8004160 con 0x7ff0c807f780 2024-05-08T05:37:04.115 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:03.211+0000 7ff0c6000700 1 -- 172.21.15.82:0/132001519 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7ff0b8004300 con 0x7ff0c807f780 2024-05-08T05:37:04.115 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:03.211+0000 7ff0c6000700 1 -- 172.21.15.82:0/132001519 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0b8011af0 con 0x7ff0c807f780 2024-05-08T05:37:04.115 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:03.212+0000 7ff0ce200700 1 -- 172.21.15.82:0/132001519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0c807f780 msgr2=0x7ff0c807dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:04.116 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:03.212+0000 7ff0ce200700 1 --2- 172.21.15.82:0/132001519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0c807f780 0x7ff0c807dbe0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff0b80098a0 tx=0x7ff0b8009bb0 comp rx=0 tx=0).stop 2024-05-08T05:37:04.116 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:03.212+0000 7ff0ce200700 1 -- 172.21.15.82:0/132001519 shutdown_connections 2024-05-08T05:37:04.116 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:03.212+0000 7ff0ce200700 1 --2- 172.21.15.82:0/132001519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0c807f780 0x7ff0c807dbe0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:04.116 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:03.212+0000 7ff0ce200700 1 -- 172.21.15.82:0/132001519 >> 172.21.15.82:0/132001519 conn(0x7ff0c81043d0 msgr2=0x7ff0c81067f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:37:04.116 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:03.212+0000 7ff0ce200700 1 -- 172.21.15.82:0/132001519 shutdown_connections 2024-05-08T05:37:04.116 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:03.212+0000 7ff0ce200700 1 -- 172.21.15.82:0/132001519 wait complete. 2024-05-08T05:37:04.116 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:03.213+0000 7ff0ce200700 1 Processor -- start 2024-05-08T05:37:04.116 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:03.213+0000 7ff0ce200700 1 -- start start 2024-05-08T05:37:04.116 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:03.214+0000 7ff0ce200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0c807f780 0x7ff0c819efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:04.116 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:03.214+0000 7ff0ce200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c810f3d0 con 0x7ff0c807f780 2024-05-08T05:37:04.116 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:03.214+0000 7ff0c7400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0c807f780 0x7ff0c819efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:04.116 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:03.214+0000 7ff0c7400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0c807f780 0x7ff0c819efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43208/0 (socket says 172.21.15.82:43208) 2024-05-08T05:37:04.116 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:03.214+0000 7ff0c7400700 1 -- 172.21.15.82:0/1156685124 learned_addr learned my addr 172.21.15.82:0/1156685124 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:37:04.117 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:03.214+0000 7ff0c7400700 1 -- 172.21.15.82:0/1156685124 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0c819f4f0 con 0x7ff0c807f780 2024-05-08T05:37:04.117 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:03.215+0000 7ff0c7400700 1 --2- 172.21.15.82:0/1156685124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0c807f780 0x7ff0c819efb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff0b80117b0 tx=0x7ff0b8011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:04.117 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:03.215+0000 7ff0bfe00700 1 -- 172.21.15.82:0/1156685124 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0b8003af0 con 0x7ff0c807f780 2024-05-08T05:37:04.117 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:03.215+0000 7ff0bfe00700 1 -- 172.21.15.82:0/1156685124 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7ff0b8020070 con 0x7ff0c807f780 2024-05-08T05:37:04.117 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:03.215+0000 7ff0ce200700 1 -- 172.21.15.82:0/1156685124 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0c819f780 con 0x7ff0c807f780 2024-05-08T05:37:04.117 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:03.215+0000 7ff0bfe00700 1 -- 172.21.15.82:0/1156685124 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0b8019630 con 0x7ff0c807f780 2024-05-08T05:37:04.117 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:03.215+0000 7ff0ce200700 1 -- 172.21.15.82:0/1156685124 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0c81a2470 con 0x7ff0c807f780 2024-05-08T05:37:04.117 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:03.216+0000 7ff0ce200700 1 -- 172.21.15.82:0/1156685124 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0c806a5c0 con 0x7ff0c807f780 2024-05-08T05:37:04.117 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:03.216+0000 7ff0bfe00700 1 -- 172.21.15.82:0/1156685124 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 50222+0+0 (secure 0 0 0) 0x7ff0b801a430 con 0x7ff0c807f780 2024-05-08T05:37:04.117 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:03.217+0000 7ff0bfe00700 1 --2- 172.21.15.82:0/1156685124 >> [v2:172.21.15.82:6800/3546670887,v1:172.21.15.82:6801/3546670887] conn(0x7ff0ac03e4c0 0x7ff0ac040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:04.117 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:03.217+0000 7ff0bfe00700 1 -- 172.21.15.82:0/1156685124 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff0b8053a70 con 0x7ff0c807f780 2024-05-08T05:37:04.117 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:03.217+0000 7ff0c6a00700 1 -- 172.21.15.82:0/1156685124 >> [v2:172.21.15.82:6800/3546670887,v1:172.21.15.82:6801/3546670887] conn(0x7ff0ac03e4c0 msgr2=0x7ff0ac040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3546670887 2024-05-08T05:37:04.117 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:03.217+0000 7ff0c6a00700 1 --2- 172.21.15.82:0/1156685124 >> [v2:172.21.15.82:6800/3546670887,v1:172.21.15.82:6801/3546670887] conn(0x7ff0ac03e4c0 0x7ff0ac040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T05:37:04.117 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:03.222+0000 7ff0bfe00700 1 -- 172.21.15.82:0/1156685124 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff0b800be00 con 0x7ff0c807f780 2024-05-08T05:37:04.118 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:03.418+0000 7ff0c6a00700 1 -- 172.21.15.82:0/1156685124 >> [v2:172.21.15.82:6800/3546670887,v1:172.21.15.82:6801/3546670887] conn(0x7ff0ac03e4c0 msgr2=0x7ff0ac040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3546670887 2024-05-08T05:37:04.118 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:03.418+0000 7ff0c6a00700 1 --2- 172.21.15.82:0/1156685124 >> [v2:172.21.15.82:6800/3546670887,v1:172.21.15.82:6801/3546670887] conn(0x7ff0ac03e4c0 0x7ff0ac040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T05:37:04.118 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:03.517+0000 7ff0ce200700 1 -- 172.21.15.82:0/1156685124 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7ff0c81a2640 con 0x7ff0c807f780 2024-05-08T05:37:04.118 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:03.517+0000 7ff0bfe00700 1 -- 172.21.15.82:0/1156685124 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7ff0c81a2640 con 0x7ff0c807f780 2024-05-08T05:37:04.118 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:03.520+0000 7ff0ce200700 1 -- 172.21.15.82:0/1156685124 >> [v2:172.21.15.82:6800/3546670887,v1:172.21.15.82:6801/3546670887] conn(0x7ff0ac03e4c0 msgr2=0x7ff0ac040980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T05:37:04.118 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:03.520+0000 7ff0ce200700 1 --2- 172.21.15.82:0/1156685124 >> [v2:172.21.15.82:6800/3546670887,v1:172.21.15.82:6801/3546670887] conn(0x7ff0ac03e4c0 0x7ff0ac040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:04.118 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:03.520+0000 7ff0ce200700 1 -- 172.21.15.82:0/1156685124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0c807f780 msgr2=0x7ff0c819efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:04.118 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:03.520+0000 7ff0ce200700 1 --2- 172.21.15.82:0/1156685124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0c807f780 0x7ff0c819efb0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff0b80117b0 tx=0x7ff0b8011b70 comp rx=0 tx=0).stop 2024-05-08T05:37:04.118 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:03.520+0000 7ff0ce200700 1 -- 172.21.15.82:0/1156685124 shutdown_connections 2024-05-08T05:37:04.118 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:03.520+0000 7ff0ce200700 1 --2- 172.21.15.82:0/1156685124 >> [v2:172.21.15.82:6800/3546670887,v1:172.21.15.82:6801/3546670887] conn(0x7ff0ac03e4c0 0x7ff0ac040980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:04.118 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:03.520+0000 7ff0ce200700 1 --2- 172.21.15.82:0/1156685124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0c807f780 0x7ff0c819efb0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:04.118 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:03.520+0000 7ff0ce200700 1 -- 172.21.15.82:0/1156685124 >> 172.21.15.82:0/1156685124 conn(0x7ff0c81043d0 msgr2=0x7ff0c8104f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:37:04.118 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:03.520+0000 7ff0ce200700 1 -- 172.21.15.82:0/1156685124 shutdown_connections 2024-05-08T05:37:04.119 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:03.520+0000 7ff0ce200700 1 -- 172.21.15.82:0/1156685124 wait complete. 2024-05-08T05:37:04.119 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for the mgr to restart... 2024-05-08T05:37:04.119 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for mgr epoch 5... 2024-05-08T05:37:04.925 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:04 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:37:04.697+0000 7f92221cf200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T05:37:05.220 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:04 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:37:04.924+0000 7f92221cf200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T05:37:05.221 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:05 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:37:05.136+0000 7f92221cf200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T05:37:05.900 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:05 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:37:05.510+0000 7f92221cf200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T05:37:05.900 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:05 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:37:05.632+0000 7f92221cf200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T05:37:06.221 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:05 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:37:05.898+0000 7f92221cf200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T05:37:06.221 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:06 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:37:06.148+0000 7f92221cf200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T05:37:07.220 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:06 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:37:06.946+0000 7f92221cf200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-08T05:37:07.632 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:07 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:37:07.231+0000 7f92221cf200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-08T05:37:07.909 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:07 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:37:07.780+0000 7f92221cf200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T05:37:07.909 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:07 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:37:07.907+0000 7f92221cf200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T05:37:08.720 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:08 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:37:08.363+0000 7f92221cf200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-08T05:37:09.220 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:08 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:37:08.807+0000 7f92221cf200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T05:37:09.221 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:08 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:37:08.930+0000 7f92221cf200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T05:37:09.557 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:09 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:37:09.251+0000 7f92221cf200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T05:37:09.557 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:09 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:37:09.427+0000 7f92221cf200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T05:37:09.557 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:09 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:37:09.555+0000 7f92221cf200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T05:37:10.221 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:09 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:37:09.950+0000 7f92221cf200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T05:37:10.221 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:10 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:37:10.073+0000 7f92221cf200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T05:37:11.111 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:10 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:37:10.825+0000 7f92221cf200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T05:37:11.111 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:11 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:37:11.109+0000 7f92221cf200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T05:37:11.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:11 smithi082 ceph-mon[30098]: Active manager daemon x restarted 2024-05-08T05:37:11.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:11 smithi082 ceph-mon[30098]: Activating manager daemon x 2024-05-08T05:37:11.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:11 smithi082 ceph-mon[30098]: osdmap e2: 0 total, 0 up, 0 in 2024-05-08T05:37:11.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:11 smithi082 ceph-mon[30098]: mgrmap e6: x(active, starting, since 0.00953007s) 2024-05-08T05:37:11.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:11 smithi082 ceph-mon[30098]: from='mgr.14120 172.21.15.82:0/3868606737' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T05:37:11.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:11 smithi082 ceph-mon[30098]: from='mgr.14120 172.21.15.82:0/3868606737' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-08T05:37:11.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:11 smithi082 ceph-mon[30098]: from='mgr.14120 172.21.15.82:0/3868606737' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-08T05:37:11.472 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:11 smithi082 ceph-mon[30098]: from='mgr.14120 172.21.15.82:0/3868606737' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-08T05:37:11.472 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:11 smithi082 ceph-mon[30098]: from='mgr.14120 172.21.15.82:0/3868606737' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-08T05:37:11.472 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:11 smithi082 ceph-mon[30098]: Manager daemon x is now available 2024-05-08T05:37:11.472 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:11 smithi082 ceph-mon[30098]: from='mgr.14120 172.21.15.82:0/3868606737' entity='mgr.x' 2024-05-08T05:37:12.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:12 smithi082 ceph-mon[30098]: Found migration_current of "None". Setting to last migration. 2024-05-08T05:37:12.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:12 smithi082 ceph-mon[30098]: from='mgr.14120 172.21.15.82:0/3868606737' entity='mgr.x' 2024-05-08T05:37:12.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:12 smithi082 ceph-mon[30098]: from='mgr.14120 172.21.15.82:0/3868606737' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:37:12.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:12 smithi082 ceph-mon[30098]: from='mgr.14120 172.21.15.82:0/3868606737' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:37:12.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:12 smithi082 ceph-mon[30098]: from='mgr.14120 172.21.15.82:0/3868606737' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-08T05:37:12.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:12 smithi082 ceph-mon[30098]: from='mgr.14120 172.21.15.82:0/3868606737' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-08T05:37:12.472 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:12 smithi082 ceph-mon[30098]: from='mgr.14120 172.21.15.82:0/3868606737' entity='mgr.x' 2024-05-08T05:37:12.472 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:12 smithi082 ceph-mon[30098]: from='mgr.14120 172.21.15.82:0/3868606737' entity='mgr.x' 2024-05-08T05:37:12.472 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:12 smithi082 ceph-mon[30098]: [08/May/2024:05:37:12] ENGINE Bus STARTING 2024-05-08T05:37:12.472 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:12 smithi082 ceph-mon[30098]: mgrmap e7: x(active, since 1.01613s) 2024-05-08T05:37:12.768 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-05-08T05:37:12.768 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-05-08T05:37:12.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "initialized": true 2024-05-08T05:37:12.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-05-08T05:37:12.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:04.617+0000 7fceab000700 1 Processor -- start 2024-05-08T05:37:12.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:04.617+0000 7fceab000700 1 -- start start 2024-05-08T05:37:12.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:04.618+0000 7fceab000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcea407ee40 0x7fcea407d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:12.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:04.618+0000 7fceab000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcea407d830 con 0x7fcea407ee40 2024-05-08T05:37:12.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:04.618+0000 7fcea9c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcea407ee40 0x7fcea407d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:12.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:04.618+0000 7fcea9c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcea407ee40 0x7fcea407d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43212/0 (socket says 172.21.15.82:43212) 2024-05-08T05:37:12.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:04.618+0000 7fcea9c00700 1 -- 172.21.15.82:0/3731887305 learned_addr learned my addr 172.21.15.82:0/3731887305 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:37:12.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:04.619+0000 7fcea9c00700 1 -- 172.21.15.82:0/3731887305 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcea407d9b0 con 0x7fcea407ee40 2024-05-08T05:37:12.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:04.619+0000 7fcea9c00700 1 --2- 172.21.15.82:0/3731887305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcea407ee40 0x7fcea407d2f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fce980098a0 tx=0x7fce98009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f8cb6ffa0534e9c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:12.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:04.619+0000 7fcea3e00700 1 -- 172.21.15.82:0/3731887305 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce98004160 con 0x7fcea407ee40 2024-05-08T05:37:12.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:04.619+0000 7fcea3e00700 1 -- 172.21.15.82:0/3731887305 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fce98004300 con 0x7fcea407ee40 2024-05-08T05:37:12.769 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:04.619+0000 7fcea3e00700 1 -- 172.21.15.82:0/3731887305 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce98011af0 con 0x7fcea407ee40 2024-05-08T05:37:12.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:04.620+0000 7fceab000700 1 -- 172.21.15.82:0/3731887305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcea407ee40 msgr2=0x7fcea407d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:12.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:04.620+0000 7fceab000700 1 --2- 172.21.15.82:0/3731887305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcea407ee40 0x7fcea407d2f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fce980098a0 tx=0x7fce98009bb0 comp rx=0 tx=0).stop 2024-05-08T05:37:12.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:04.620+0000 7fceab000700 1 -- 172.21.15.82:0/3731887305 shutdown_connections 2024-05-08T05:37:12.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:04.620+0000 7fceab000700 1 --2- 172.21.15.82:0/3731887305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcea407ee40 0x7fcea407d2f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:12.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:04.620+0000 7fceab000700 1 -- 172.21.15.82:0/3731887305 >> 172.21.15.82:0/3731887305 conn(0x7fcea4104180 msgr2=0x7fcea41065e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:37:12.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:04.620+0000 7fceab000700 1 -- 172.21.15.82:0/3731887305 shutdown_connections 2024-05-08T05:37:12.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:04.620+0000 7fceab000700 1 -- 172.21.15.82:0/3731887305 wait complete. 2024-05-08T05:37:12.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:04.621+0000 7fceab000700 1 Processor -- start 2024-05-08T05:37:12.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:04.621+0000 7fceab000700 1 -- start start 2024-05-08T05:37:12.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:04.622+0000 7fceab000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcea407ee40 0x7fcea419eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:12.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:04.622+0000 7fceab000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcea410f170 con 0x7fcea407ee40 2024-05-08T05:37:12.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:04.622+0000 7fcea9c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcea407ee40 0x7fcea419eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:12.770 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:04.622+0000 7fcea9c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcea407ee40 0x7fcea419eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43222/0 (socket says 172.21.15.82:43222) 2024-05-08T05:37:12.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:04.622+0000 7fcea9c00700 1 -- 172.21.15.82:0/3055472746 learned_addr learned my addr 172.21.15.82:0/3055472746 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:37:12.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:04.622+0000 7fcea9c00700 1 -- 172.21.15.82:0/3055472746 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcea419f2e0 con 0x7fcea407ee40 2024-05-08T05:37:12.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:04.623+0000 7fcea9c00700 1 --2- 172.21.15.82:0/3055472746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcea407ee40 0x7fcea419eda0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fce98011ac0 tx=0x7fce98011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:12.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:04.623+0000 7fcea2000700 1 -- 172.21.15.82:0/3055472746 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce98003970 con 0x7fcea407ee40 2024-05-08T05:37:12.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:04.623+0000 7fcea2000700 1 -- 172.21.15.82:0/3055472746 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fce98003b10 con 0x7fcea407ee40 2024-05-08T05:37:12.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:04.623+0000 7fceab000700 1 -- 172.21.15.82:0/3055472746 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcea419f570 con 0x7fcea407ee40 2024-05-08T05:37:12.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:04.623+0000 7fcea2000700 1 -- 172.21.15.82:0/3055472746 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fce98024610 con 0x7fcea407ee40 2024-05-08T05:37:12.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:04.623+0000 7fceab000700 1 -- 172.21.15.82:0/3055472746 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcea41a2220 con 0x7fcea407ee40 2024-05-08T05:37:12.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:04.624+0000 7fcea2000700 1 -- 172.21.15.82:0/3055472746 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 5) ==== 50222+0+0 (secure 0 0 0) 0x7fce9801a430 con 0x7fcea407ee40 2024-05-08T05:37:12.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:04.625+0000 7fcea2000700 1 --2- 172.21.15.82:0/3055472746 >> [v2:172.21.15.82:6800/3546670887,v1:172.21.15.82:6801/3546670887] conn(0x7fce8c03e4c0 0x7fce8c040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:12.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:04.625+0000 7fcea2000700 1 -- 172.21.15.82:0/3055472746 --> [v2:172.21.15.82:6800/3546670887,v1:172.21.15.82:6801/3546670887] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fce8c041090 con 0x7fce8c03e4c0 2024-05-08T05:37:12.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:04.625+0000 7fcea2000700 1 -- 172.21.15.82:0/3055472746 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fce98053810 con 0x7fcea407ee40 2024-05-08T05:37:12.771 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:04.625+0000 7fcea9200700 1 -- 172.21.15.82:0/3055472746 >> [v2:172.21.15.82:6800/3546670887,v1:172.21.15.82:6801/3546670887] conn(0x7fce8c03e4c0 msgr2=0x7fce8c040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3546670887 2024-05-08T05:37:12.772 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:04.625+0000 7fcea9200700 1 --2- 172.21.15.82:0/3055472746 >> [v2:172.21.15.82:6800/3546670887,v1:172.21.15.82:6801/3546670887] conn(0x7fce8c03e4c0 0x7fce8c040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T05:37:12.772 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:04.826+0000 7fcea9200700 1 -- 172.21.15.82:0/3055472746 >> [v2:172.21.15.82:6800/3546670887,v1:172.21.15.82:6801/3546670887] conn(0x7fce8c03e4c0 msgr2=0x7fce8c040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3546670887 2024-05-08T05:37:12.772 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:04.826+0000 7fcea9200700 1 --2- 172.21.15.82:0/3055472746 >> [v2:172.21.15.82:6800/3546670887,v1:172.21.15.82:6801/3546670887] conn(0x7fce8c03e4c0 0x7fce8c040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T05:37:12.772 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:05.227+0000 7fcea9200700 1 -- 172.21.15.82:0/3055472746 >> [v2:172.21.15.82:6800/3546670887,v1:172.21.15.82:6801/3546670887] conn(0x7fce8c03e4c0 msgr2=0x7fce8c040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3546670887 2024-05-08T05:37:12.772 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:05.227+0000 7fcea9200700 1 --2- 172.21.15.82:0/3055472746 >> [v2:172.21.15.82:6800/3546670887,v1:172.21.15.82:6801/3546670887] conn(0x7fce8c03e4c0 0x7fce8c040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T05:37:12.772 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:06.028+0000 7fcea9200700 1 -- 172.21.15.82:0/3055472746 >> [v2:172.21.15.82:6800/3546670887,v1:172.21.15.82:6801/3546670887] conn(0x7fce8c03e4c0 msgr2=0x7fce8c040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3546670887 2024-05-08T05:37:12.772 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:06.028+0000 7fcea9200700 1 --2- 172.21.15.82:0/3055472746 >> [v2:172.21.15.82:6800/3546670887,v1:172.21.15.82:6801/3546670887] conn(0x7fce8c03e4c0 0x7fce8c040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T05:37:12.772 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:07.630+0000 7fcea9200700 1 -- 172.21.15.82:0/3055472746 >> [v2:172.21.15.82:6800/3546670887,v1:172.21.15.82:6801/3546670887] conn(0x7fce8c03e4c0 msgr2=0x7fce8c040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3546670887 2024-05-08T05:37:12.772 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:07.630+0000 7fcea9200700 1 --2- 172.21.15.82:0/3055472746 >> [v2:172.21.15.82:6800/3546670887,v1:172.21.15.82:6801/3546670887] conn(0x7fce8c03e4c0 0x7fce8c040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-08T05:37:12.772 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:10.832+0000 7fcea9200700 1 -- 172.21.15.82:0/3055472746 >> [v2:172.21.15.82:6800/3546670887,v1:172.21.15.82:6801/3546670887] conn(0x7fce8c03e4c0 msgr2=0x7fce8c040980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/3546670887 2024-05-08T05:37:12.772 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:10.832+0000 7fcea9200700 1 --2- 172.21.15.82:0/3055472746 >> [v2:172.21.15.82:6800/3546670887,v1:172.21.15.82:6801/3546670887] conn(0x7fce8c03e4c0 0x7fce8c040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-05-08T05:37:12.772 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:11.119+0000 7fcea2000700 1 -- 172.21.15.82:0/3055472746 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mgrmap(e 6) ==== 49989+0+0 (secure 0 0 0) 0x7fce9801a9e0 con 0x7fcea407ee40 2024-05-08T05:37:12.772 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:11.120+0000 7fcea2000700 1 -- 172.21.15.82:0/3055472746 >> [v2:172.21.15.82:6800/3546670887,v1:172.21.15.82:6801/3546670887] conn(0x7fce8c03e4c0 msgr2=0x7fce8c040980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T05:37:12.772 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:11.120+0000 7fcea2000700 1 --2- 172.21.15.82:0/3055472746 >> [v2:172.21.15.82:6800/3546670887,v1:172.21.15.82:6801/3546670887] conn(0x7fce8c03e4c0 0x7fce8c040980 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:12.773 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:12.123+0000 7fcea2000700 1 -- 172.21.15.82:0/3055472746 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 7) ==== 50116+0+0 (secure 0 0 0) 0x7fce98054cf0 con 0x7fcea407ee40 2024-05-08T05:37:12.773 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:12.124+0000 7fcea2000700 1 --2- 172.21.15.82:0/3055472746 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7fce8c041db0 0x7fce8c0441a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:12.773 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:12.124+0000 7fcea2000700 1 -- 172.21.15.82:0/3055472746 --> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fce9801bec0 con 0x7fce8c041db0 2024-05-08T05:37:12.773 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:12.126+0000 7fcea9200700 1 --2- 172.21.15.82:0/3055472746 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7fce8c041db0 0x7fce8c0441a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:12.773 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:12.128+0000 7fcea9200700 1 --2- 172.21.15.82:0/3055472746 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7fce8c041db0 0x7fce8c0441a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fce90003a10 tx=0x7fce900092b0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:12.773 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:12.129+0000 7fcea2000700 1 -- 172.21.15.82:0/3055472746 <== mgr.14120 v2:172.21.15.82:6800/765895649 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7fce9801bec0 con 0x7fce8c041db0 2024-05-08T05:37:12.773 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:12.138+0000 7fceab000700 1 -- 172.21.15.82:0/3055472746 --> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fcea406a5c0 con 0x7fce8c041db0 2024-05-08T05:37:12.773 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:12.139+0000 7fcea2000700 1 -- 172.21.15.82:0/3055472746 <== mgr.14120 v2:172.21.15.82:6800/765895649 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7fcea406a5c0 con 0x7fce8c041db0 2024-05-08T05:37:12.773 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:12.139+0000 7fceab000700 1 -- 172.21.15.82:0/3055472746 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7fce8c041db0 msgr2=0x7fce8c0441a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:12.773 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:12.139+0000 7fceab000700 1 --2- 172.21.15.82:0/3055472746 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7fce8c041db0 0x7fce8c0441a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fce90003a10 tx=0x7fce900092b0 comp rx=0 tx=0).stop 2024-05-08T05:37:12.773 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:12.139+0000 7fceab000700 1 -- 172.21.15.82:0/3055472746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcea407ee40 msgr2=0x7fcea419eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:12.773 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:12.139+0000 7fceab000700 1 --2- 172.21.15.82:0/3055472746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcea407ee40 0x7fcea419eda0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fce98011ac0 tx=0x7fce98011ba0 comp rx=0 tx=0).stop 2024-05-08T05:37:12.773 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:12.139+0000 7fceab000700 1 -- 172.21.15.82:0/3055472746 shutdown_connections 2024-05-08T05:37:12.773 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:12.139+0000 7fceab000700 1 --2- 172.21.15.82:0/3055472746 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7fce8c041db0 0x7fce8c0441a0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:12.774 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:12.139+0000 7fceab000700 1 --2- 172.21.15.82:0/3055472746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcea407ee40 0x7fcea419eda0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:12.774 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:12.139+0000 7fceab000700 1 --2- 172.21.15.82:0/3055472746 >> [v2:172.21.15.82:6800/3546670887,v1:172.21.15.82:6801/3546670887] conn(0x7fce8c03e4c0 0x7fce8c040980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:12.774 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:12.139+0000 7fceab000700 1 -- 172.21.15.82:0/3055472746 >> 172.21.15.82:0/3055472746 conn(0x7fcea4104180 msgr2=0x7fcea4104d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:37:12.774 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:12.139+0000 7fceab000700 1 -- 172.21.15.82:0/3055472746 shutdown_connections 2024-05-08T05:37:12.774 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:12.140+0000 7fceab000700 1 -- 172.21.15.82:0/3055472746 wait complete. 2024-05-08T05:37:12.774 INFO:teuthology.orchestra.run.smithi082.stdout:mgr epoch 5 is available 2024-05-08T05:37:12.774 INFO:teuthology.orchestra.run.smithi082.stdout:Setting orchestrator backend to cephadm... 2024-05-08T05:37:13.361 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:13 smithi082 ceph-mon[30098]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-05-08T05:37:13.361 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:13 smithi082 ceph-mon[30098]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-05-08T05:37:13.361 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:13 smithi082 ceph-mon[30098]: [08/May/2024:05:37:12] ENGINE Serving on http://172.21.15.82:8765 2024-05-08T05:37:13.361 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:13 smithi082 ceph-mon[30098]: [08/May/2024:05:37:12] ENGINE Serving on https://172.21.15.82:7150 2024-05-08T05:37:13.362 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:13 smithi082 ceph-mon[30098]: [08/May/2024:05:37:12] ENGINE Bus STARTED 2024-05-08T05:37:13.362 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:13 smithi082 ceph-mon[30098]: from='mgr.14120 172.21.15.82:0/3868606737' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:37:14.285 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:13.359+0000 7fe83cc00700 1 Processor -- start 2024-05-08T05:37:14.285 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:13.360+0000 7fe83cc00700 1 -- start start 2024-05-08T05:37:14.285 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:13.360+0000 7fe83cc00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe838082dd0 0x7fe8380831f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:14.285 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:13.360+0000 7fe83cc00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe8380837c0 con 0x7fe838082dd0 2024-05-08T05:37:14.285 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:13.360+0000 7fe835e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe838082dd0 0x7fe8380831f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:14.285 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:13.361+0000 7fe835e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe838082dd0 0x7fe8380831f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51814/0 (socket says 172.21.15.82:51814) 2024-05-08T05:37:14.285 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:13.361+0000 7fe835e00700 1 -- 172.21.15.82:0/2193207357 learned_addr learned my addr 172.21.15.82:0/2193207357 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:37:14.286 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:13.361+0000 7fe835e00700 1 -- 172.21.15.82:0/2193207357 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe838110610 con 0x7fe838082dd0 2024-05-08T05:37:14.286 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:13.361+0000 7fe835e00700 1 --2- 172.21.15.82:0/2193207357 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe838082dd0 0x7fe8380831f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe8280098a0 tx=0x7fe828009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d16f99f92610544b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:14.286 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:13.362+0000 7fe834a00700 1 -- 172.21.15.82:0/2193207357 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe828004160 con 0x7fe838082dd0 2024-05-08T05:37:14.286 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:13.362+0000 7fe834a00700 1 -- 172.21.15.82:0/2193207357 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fe828004300 con 0x7fe838082dd0 2024-05-08T05:37:14.286 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:13.362+0000 7fe834a00700 1 -- 172.21.15.82:0/2193207357 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe828011af0 con 0x7fe838082dd0 2024-05-08T05:37:14.286 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:13.363+0000 7fe83cc00700 1 -- 172.21.15.82:0/2193207357 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe838082dd0 msgr2=0x7fe8380831f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:14.286 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:13.363+0000 7fe83cc00700 1 --2- 172.21.15.82:0/2193207357 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe838082dd0 0x7fe8380831f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe8280098a0 tx=0x7fe828009bb0 comp rx=0 tx=0).stop 2024-05-08T05:37:14.286 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:13.363+0000 7fe83cc00700 1 -- 172.21.15.82:0/2193207357 shutdown_connections 2024-05-08T05:37:14.286 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:13.363+0000 7fe83cc00700 1 --2- 172.21.15.82:0/2193207357 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe838082dd0 0x7fe8380831f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:14.286 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:13.363+0000 7fe83cc00700 1 -- 172.21.15.82:0/2193207357 >> 172.21.15.82:0/2193207357 conn(0x7fe83807e3a0 msgr2=0x7fe838080800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:37:14.286 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:13.363+0000 7fe83cc00700 1 -- 172.21.15.82:0/2193207357 shutdown_connections 2024-05-08T05:37:14.286 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:13.363+0000 7fe83cc00700 1 -- 172.21.15.82:0/2193207357 wait complete. 2024-05-08T05:37:14.286 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:13.364+0000 7fe83cc00700 1 Processor -- start 2024-05-08T05:37:14.286 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:13.364+0000 7fe83cc00700 1 -- start start 2024-05-08T05:37:14.287 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:13.365+0000 7fe83cc00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe838082dd0 0x7fe8381a3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:14.287 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:13.365+0000 7fe83cc00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe8381139c0 con 0x7fe838082dd0 2024-05-08T05:37:14.290 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:13.365+0000 7fe835e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe838082dd0 0x7fe8381a3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:14.290 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:13.365+0000 7fe835e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe838082dd0 0x7fe8381a3370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51820/0 (socket says 172.21.15.82:51820) 2024-05-08T05:37:14.290 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:13.365+0000 7fe835e00700 1 -- 172.21.15.82:0/2395070519 learned_addr learned my addr 172.21.15.82:0/2395070519 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:37:14.290 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:13.365+0000 7fe835e00700 1 -- 172.21.15.82:0/2395070519 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8381a38b0 con 0x7fe838082dd0 2024-05-08T05:37:14.290 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:13.366+0000 7fe835e00700 1 --2- 172.21.15.82:0/2395070519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe838082dd0 0x7fe8381a3370 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe828011ac0 tx=0x7fe828011ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:14.290 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:13.366+0000 7fe82ea00700 1 -- 172.21.15.82:0/2395070519 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe828003970 con 0x7fe838082dd0 2024-05-08T05:37:14.290 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:13.366+0000 7fe82ea00700 1 -- 172.21.15.82:0/2395070519 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fe828003b10 con 0x7fe838082dd0 2024-05-08T05:37:14.290 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:13.366+0000 7fe83cc00700 1 -- 172.21.15.82:0/2395070519 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8381a3b40 con 0x7fe838082dd0 2024-05-08T05:37:14.290 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:13.366+0000 7fe82ea00700 1 -- 172.21.15.82:0/2395070519 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe828024610 con 0x7fe838082dd0 2024-05-08T05:37:14.293 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:13.366+0000 7fe83cc00700 1 -- 172.21.15.82:0/2395070519 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8381a6830 con 0x7fe838082dd0 2024-05-08T05:37:14.293 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:13.367+0000 7fe82ea00700 1 -- 172.21.15.82:0/2395070519 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7fe82801a430 con 0x7fe838082dd0 2024-05-08T05:37:14.293 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:13.367+0000 7fe83cc00700 1 -- 172.21.15.82:0/2395070519 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe83806a5c0 con 0x7fe838082dd0 2024-05-08T05:37:14.293 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:13.368+0000 7fe82ea00700 1 --2- 172.21.15.82:0/2395070519 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7fe81c03e4c0 0x7fe81c040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:14.293 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:13.368+0000 7fe82ea00700 1 -- 172.21.15.82:0/2395070519 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe8280538e0 con 0x7fe838082dd0 2024-05-08T05:37:14.293 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:13.368+0000 7fe835400700 1 --2- 172.21.15.82:0/2395070519 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7fe81c03e4c0 0x7fe81c040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:14.293 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:13.369+0000 7fe835400700 1 --2- 172.21.15.82:0/2395070519 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7fe81c03e4c0 0x7fe81c040980 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe824006fd0 tx=0x7fe824006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:14.293 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:13.374+0000 7fe82ea00700 1 -- 172.21.15.82:0/2395070519 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe82800b3e0 con 0x7fe838082dd0 2024-05-08T05:37:14.293 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:13.624+0000 7fe83cc00700 1 -- 172.21.15.82:0/2395070519 --> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7fe83807f630 con 0x7fe81c03e4c0 2024-05-08T05:37:14.293 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:13.636+0000 7fe82ea00700 1 -- 172.21.15.82:0/2395070519 <== mgr.14120 v2:172.21.15.82:6800/765895649 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe83807f630 con 0x7fe81c03e4c0 2024-05-08T05:37:14.294 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:13.639+0000 7fe83cc00700 1 -- 172.21.15.82:0/2395070519 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7fe81c03e4c0 msgr2=0x7fe81c040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:14.294 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:13.639+0000 7fe83cc00700 1 --2- 172.21.15.82:0/2395070519 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7fe81c03e4c0 0x7fe81c040980 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe824006fd0 tx=0x7fe824006e40 comp rx=0 tx=0).stop 2024-05-08T05:37:14.294 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:13.639+0000 7fe83cc00700 1 -- 172.21.15.82:0/2395070519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe838082dd0 msgr2=0x7fe8381a3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:14.294 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:13.639+0000 7fe83cc00700 1 --2- 172.21.15.82:0/2395070519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe838082dd0 0x7fe8381a3370 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fe828011ac0 tx=0x7fe828011ba0 comp rx=0 tx=0).stop 2024-05-08T05:37:14.294 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:13.640+0000 7fe83cc00700 1 -- 172.21.15.82:0/2395070519 shutdown_connections 2024-05-08T05:37:14.294 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:13.640+0000 7fe83cc00700 1 --2- 172.21.15.82:0/2395070519 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7fe81c03e4c0 0x7fe81c040980 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:14.294 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:13.640+0000 7fe83cc00700 1 --2- 172.21.15.82:0/2395070519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe838082dd0 0x7fe8381a3370 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:14.294 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:13.640+0000 7fe83cc00700 1 -- 172.21.15.82:0/2395070519 >> 172.21.15.82:0/2395070519 conn(0x7fe83807e3a0 msgr2=0x7fe83807ef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:37:14.294 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:13.640+0000 7fe83cc00700 1 -- 172.21.15.82:0/2395070519 shutdown_connections 2024-05-08T05:37:14.294 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:13.640+0000 7fe83cc00700 1 -- 172.21.15.82:0/2395070519 wait complete. 2024-05-08T05:37:14.444 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:14 smithi082 ceph-mon[30098]: mgrmap e8: x(active, since 2s) 2024-05-08T05:37:14.444 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:14 smithi082 ceph-mon[30098]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:37:14.445 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:14 smithi082 ceph-mon[30098]: from='mgr.14120 172.21.15.82:0/3868606737' entity='mgr.x' 2024-05-08T05:37:14.445 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:14 smithi082 ceph-mon[30098]: from='mgr.14120 172.21.15.82:0/3868606737' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:37:15.730 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout value unchanged 2024-05-08T05:37:15.731 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:14.851+0000 7f082bc00700 1 Processor -- start 2024-05-08T05:37:15.731 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:14.851+0000 7f082bc00700 1 -- start start 2024-05-08T05:37:15.734 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:14.851+0000 7f082bc00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0824107d10 0x7f0824108130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:15.734 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:14.851+0000 7f082bc00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0824108700 con 0x7f0824107d10 2024-05-08T05:37:15.734 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:14.852+0000 7f0829200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0824107d10 0x7f0824108130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:15.734 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:14.852+0000 7f0829200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0824107d10 0x7f0824108130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51828/0 (socket says 172.21.15.82:51828) 2024-05-08T05:37:15.734 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:14.852+0000 7f0829200700 1 -- 172.21.15.82:0/1237688051 learned_addr learned my addr 172.21.15.82:0/1237688051 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:37:15.734 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:14.852+0000 7f0829200700 1 -- 172.21.15.82:0/1237688051 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0824108f10 con 0x7f0824107d10 2024-05-08T05:37:15.734 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:14.853+0000 7f0829200700 1 --2- 172.21.15.82:0/1237688051 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0824107d10 0x7f0824108130 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f08180098a0 tx=0x7f0818009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3757ac755c98b688 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:15.734 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:14.853+0000 7f0823400700 1 -- 172.21.15.82:0/1237688051 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0818004160 con 0x7f0824107d10 2024-05-08T05:37:15.735 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:14.853+0000 7f0823400700 1 -- 172.21.15.82:0/1237688051 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f0818004300 con 0x7f0824107d10 2024-05-08T05:37:15.735 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:14.853+0000 7f0823400700 1 -- 172.21.15.82:0/1237688051 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0818011af0 con 0x7f0824107d10 2024-05-08T05:37:15.735 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:14.854+0000 7f082bc00700 1 -- 172.21.15.82:0/1237688051 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0824107d10 msgr2=0x7f0824108130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:15.735 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:14.854+0000 7f082bc00700 1 --2- 172.21.15.82:0/1237688051 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0824107d10 0x7f0824108130 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f08180098a0 tx=0x7f0818009bb0 comp rx=0 tx=0).stop 2024-05-08T05:37:15.735 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:14.854+0000 7f082bc00700 1 -- 172.21.15.82:0/1237688051 shutdown_connections 2024-05-08T05:37:15.735 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:14.854+0000 7f082bc00700 1 --2- 172.21.15.82:0/1237688051 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0824107d10 0x7f0824108130 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:15.735 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:14.854+0000 7f082bc00700 1 -- 172.21.15.82:0/1237688051 >> 172.21.15.82:0/1237688051 conn(0x7f0824103330 msgr2=0x7f0824105750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:37:15.735 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:14.854+0000 7f082bc00700 1 -- 172.21.15.82:0/1237688051 shutdown_connections 2024-05-08T05:37:15.735 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:14.854+0000 7f082bc00700 1 -- 172.21.15.82:0/1237688051 wait complete. 2024-05-08T05:37:15.735 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:14.855+0000 7f082bc00700 1 Processor -- start 2024-05-08T05:37:15.735 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:14.855+0000 7f082bc00700 1 -- start start 2024-05-08T05:37:15.735 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:14.856+0000 7f082bc00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0824107d10 0x7f082419efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:15.735 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:14.856+0000 7f082bc00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f082407c870 con 0x7f0824107d10 2024-05-08T05:37:15.735 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:14.856+0000 7f0829200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0824107d10 0x7f082419efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:15.735 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:14.856+0000 7f0829200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0824107d10 0x7f082419efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51838/0 (socket says 172.21.15.82:51838) 2024-05-08T05:37:15.736 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:14.856+0000 7f0829200700 1 -- 172.21.15.82:0/1490194112 learned_addr learned my addr 172.21.15.82:0/1490194112 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:37:15.736 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:14.856+0000 7f0829200700 1 -- 172.21.15.82:0/1490194112 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f082419f520 con 0x7f0824107d10 2024-05-08T05:37:15.736 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:14.856+0000 7f0829200700 1 --2- 172.21.15.82:0/1490194112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0824107d10 0x7f082419efe0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f08180117b0 tx=0x7f0818011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:15.736 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:14.857+0000 7f0821600700 1 -- 172.21.15.82:0/1490194112 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0818003af0 con 0x7f0824107d10 2024-05-08T05:37:15.738 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:14.857+0000 7f0821600700 1 -- 172.21.15.82:0/1490194112 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f0818020070 con 0x7f0824107d10 2024-05-08T05:37:15.738 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:14.857+0000 7f082bc00700 1 -- 172.21.15.82:0/1490194112 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f082419f7b0 con 0x7f0824107d10 2024-05-08T05:37:15.739 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:14.857+0000 7f0821600700 1 -- 172.21.15.82:0/1490194112 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0818019630 con 0x7f0824107d10 2024-05-08T05:37:15.739 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:14.857+0000 7f082bc00700 1 -- 172.21.15.82:0/1490194112 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08241a2450 con 0x7f0824107d10 2024-05-08T05:37:15.739 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:14.858+0000 7f082bc00700 1 -- 172.21.15.82:0/1490194112 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f082406a5c0 con 0x7f0824107d10 2024-05-08T05:37:15.739 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:14.858+0000 7f0821600700 1 -- 172.21.15.82:0/1490194112 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f081801a9c0 con 0x7f0824107d10 2024-05-08T05:37:15.739 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:14.859+0000 7f0821600700 1 --2- 172.21.15.82:0/1490194112 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f080c03e4c0 0x7f080c040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:15.739 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:14.859+0000 7f0821600700 1 -- 172.21.15.82:0/1490194112 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f0818053a60 con 0x7f0824107d10 2024-05-08T05:37:15.740 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:14.859+0000 7f0823e00700 1 --2- 172.21.15.82:0/1490194112 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f080c03e4c0 0x7f080c040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:15.740 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:14.860+0000 7f0823e00700 1 --2- 172.21.15.82:0/1490194112 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f080c03e4c0 0x7f080c040980 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0810006fd0 tx=0x7f0810006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:15.740 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:14.865+0000 7f0821600700 1 -- 172.21.15.82:0/1490194112 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f081800bdd0 con 0x7f0824107d10 2024-05-08T05:37:15.740 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:15.100+0000 7f082bc00700 1 -- 172.21.15.82:0/1490194112 --> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f08240638e0 con 0x7f080c03e4c0 2024-05-08T05:37:15.740 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:15.102+0000 7f0821600700 1 -- 172.21.15.82:0/1490194112 <== mgr.14120 v2:172.21.15.82:6800/765895649 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f08240638e0 con 0x7f080c03e4c0 2024-05-08T05:37:15.740 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:15.105+0000 7f082bc00700 1 -- 172.21.15.82:0/1490194112 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f080c03e4c0 msgr2=0x7f080c040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:15.740 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:15.105+0000 7f082bc00700 1 --2- 172.21.15.82:0/1490194112 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f080c03e4c0 0x7f080c040980 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0810006fd0 tx=0x7f0810006e40 comp rx=0 tx=0).stop 2024-05-08T05:37:15.740 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:15.105+0000 7f082bc00700 1 -- 172.21.15.82:0/1490194112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0824107d10 msgr2=0x7f082419efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:15.740 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:15.105+0000 7f082bc00700 1 --2- 172.21.15.82:0/1490194112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0824107d10 0x7f082419efe0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f08180117b0 tx=0x7f0818011b70 comp rx=0 tx=0).stop 2024-05-08T05:37:15.740 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:15.105+0000 7f082bc00700 1 -- 172.21.15.82:0/1490194112 shutdown_connections 2024-05-08T05:37:15.740 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:15.105+0000 7f082bc00700 1 --2- 172.21.15.82:0/1490194112 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f080c03e4c0 0x7f080c040980 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:15.740 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:15.105+0000 7f082bc00700 1 --2- 172.21.15.82:0/1490194112 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0824107d10 0x7f082419efe0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:15.740 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:15.105+0000 7f082bc00700 1 -- 172.21.15.82:0/1490194112 >> 172.21.15.82:0/1490194112 conn(0x7f0824103330 msgr2=0x7f08241911f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:37:15.740 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:15.105+0000 7f082bc00700 1 -- 172.21.15.82:0/1490194112 shutdown_connections 2024-05-08T05:37:15.741 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:15.105+0000 7f082bc00700 1 -- 172.21.15.82:0/1490194112 wait complete. 2024-05-08T05:37:15.741 INFO:teuthology.orchestra.run.smithi082.stdout:Generating ssh key... 2024-05-08T05:37:16.310 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:16 smithi082 ceph-mon[30098]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:37:17.222 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:16 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: Generating public/private rsa key pair. 2024-05-08T05:37:17.222 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:16 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: Your identification has been saved in /tmp/tmpu0rkm6tu/key. 2024-05-08T05:37:17.222 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:16 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: Your public key has been saved in /tmp/tmpu0rkm6tu/key.pub. 2024-05-08T05:37:17.222 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:16 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: The key fingerprint is: 2024-05-08T05:37:17.222 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:16 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: SHA256:5++sPwsP3gZf2FM7jKLHVUzdftsRKTRoZsuR8ZwLGLs ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968 2024-05-08T05:37:17.222 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:16 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: The key's randomart image is: 2024-05-08T05:37:17.223 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:16 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: +---[RSA 3072]----+ 2024-05-08T05:37:17.223 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:16 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: | . .=o +| 2024-05-08T05:37:17.223 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:16 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: | +Bo.o+o| 2024-05-08T05:37:17.223 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:16 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: | o=.o++..| 2024-05-08T05:37:17.223 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:16 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: | .o. .++| 2024-05-08T05:37:17.223 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:16 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: | SE. ++.*| 2024-05-08T05:37:17.223 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:16 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: | o...o+=.| 2024-05-08T05:37:17.223 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:16 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: | *oo. ..| 2024-05-08T05:37:17.223 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:16 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: | o X+ | 2024-05-08T05:37:17.223 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:16 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: | +=Oo | 2024-05-08T05:37:17.223 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:16 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: +----[SHA256]-----+ 2024-05-08T05:37:17.590 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:16.386+0000 7f7000400700 1 Processor -- start 2024-05-08T05:37:17.590 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:16.386+0000 7f7000400700 1 -- start start 2024-05-08T05:37:17.590 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:16.387+0000 7f7000400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ff807ee30 0x7f6ff807d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:17.591 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:16.387+0000 7f7000400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff807d870 con 0x7f6ff807ee30 2024-05-08T05:37:17.591 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:16.387+0000 7f6ffda00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ff807ee30 0x7f6ff807d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:17.591 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:16.387+0000 7f6ffda00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ff807ee30 0x7f6ff807d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51850/0 (socket says 172.21.15.82:51850) 2024-05-08T05:37:17.591 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:16.387+0000 7f6ffda00700 1 -- 172.21.15.82:0/2444205771 learned_addr learned my addr 172.21.15.82:0/2444205771 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:37:17.591 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:16.388+0000 7f6ffda00700 1 -- 172.21.15.82:0/2444205771 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ff807d9f0 con 0x7f6ff807ee30 2024-05-08T05:37:17.591 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:16.388+0000 7f6ffda00700 1 --2- 172.21.15.82:0/2444205771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ff807ee30 0x7f6ff807d330 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6fec009e80 tx=0x7f6fec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=739dec75bba87af3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:17.591 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:16.388+0000 7f6ff7e00700 1 -- 172.21.15.82:0/2444205771 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fec017070 con 0x7f6ff807ee30 2024-05-08T05:37:17.591 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:16.388+0000 7f6ff7e00700 1 -- 172.21.15.82:0/2444205771 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f6fec00b8c0 con 0x7f6ff807ee30 2024-05-08T05:37:17.591 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:16.388+0000 7f6ff7e00700 1 -- 172.21.15.82:0/2444205771 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fec004490 con 0x7f6ff807ee30 2024-05-08T05:37:17.591 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:16.389+0000 7f7000400700 1 -- 172.21.15.82:0/2444205771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ff807ee30 msgr2=0x7f6ff807d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:17.591 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:16.389+0000 7f7000400700 1 --2- 172.21.15.82:0/2444205771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ff807ee30 0x7f6ff807d330 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6fec009e80 tx=0x7f6fec00b330 comp rx=0 tx=0).stop 2024-05-08T05:37:17.591 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:16.389+0000 7f7000400700 1 -- 172.21.15.82:0/2444205771 shutdown_connections 2024-05-08T05:37:17.591 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:16.389+0000 7f7000400700 1 --2- 172.21.15.82:0/2444205771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ff807ee30 0x7f6ff807d330 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:17.591 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:16.389+0000 7f7000400700 1 -- 172.21.15.82:0/2444205771 >> 172.21.15.82:0/2444205771 conn(0x7f6ff8104450 msgr2=0x7f6ff8106870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:37:17.592 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:16.389+0000 7f7000400700 1 -- 172.21.15.82:0/2444205771 shutdown_connections 2024-05-08T05:37:17.592 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:16.389+0000 7f7000400700 1 -- 172.21.15.82:0/2444205771 wait complete. 2024-05-08T05:37:17.592 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:16.390+0000 7f7000400700 1 Processor -- start 2024-05-08T05:37:17.592 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:16.391+0000 7f7000400700 1 -- start start 2024-05-08T05:37:17.592 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:16.391+0000 7f7000400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ff807ee30 0x7f6ff819ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:17.592 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:16.391+0000 7f7000400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff810f3c0 con 0x7f6ff807ee30 2024-05-08T05:37:17.592 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:16.391+0000 7f6ffda00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ff807ee30 0x7f6ff819ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:17.592 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:16.391+0000 7f6ffda00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ff807ee30 0x7f6ff819ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51864/0 (socket says 172.21.15.82:51864) 2024-05-08T05:37:17.592 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:16.391+0000 7f6ffda00700 1 -- 172.21.15.82:0/466039694 learned_addr learned my addr 172.21.15.82:0/466039694 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:37:17.592 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:16.392+0000 7f6ffda00700 1 -- 172.21.15.82:0/466039694 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ff819f470 con 0x7f6ff807ee30 2024-05-08T05:37:17.592 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:16.392+0000 7f6ffda00700 1 --2- 172.21.15.82:0/466039694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ff807ee30 0x7f6ff819ef30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6fec00b7b0 tx=0x7f6fec00be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:17.592 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:16.392+0000 7f6ff6000700 1 -- 172.21.15.82:0/466039694 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fec020020 con 0x7f6ff807ee30 2024-05-08T05:37:17.592 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:16.392+0000 7f6ff6000700 1 -- 172.21.15.82:0/466039694 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f6fec003d10 con 0x7f6ff807ee30 2024-05-08T05:37:17.592 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:16.392+0000 7f6ff6000700 1 -- 172.21.15.82:0/466039694 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6fec017040 con 0x7f6ff807ee30 2024-05-08T05:37:17.592 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:16.392+0000 7f7000400700 1 -- 172.21.15.82:0/466039694 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ff819f700 con 0x7f6ff807ee30 2024-05-08T05:37:17.593 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:16.392+0000 7f7000400700 1 -- 172.21.15.82:0/466039694 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ff81a23f0 con 0x7f6ff807ee30 2024-05-08T05:37:17.593 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:16.393+0000 7f7000400700 1 -- 172.21.15.82:0/466039694 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ff806a5c0 con 0x7f6ff807ee30 2024-05-08T05:37:17.593 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:16.393+0000 7f6ff6000700 1 -- 172.21.15.82:0/466039694 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f6fec023020 con 0x7f6ff807ee30 2024-05-08T05:37:17.593 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:16.394+0000 7f6ff6000700 1 --2- 172.21.15.82:0/466039694 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f6fe003e4c0 0x7f6fe0040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:17.593 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:16.394+0000 7f6ff6000700 1 -- 172.21.15.82:0/466039694 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f6fec00f050 con 0x7f6ff807ee30 2024-05-08T05:37:17.593 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:16.394+0000 7f6ffd000700 1 --2- 172.21.15.82:0/466039694 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f6fe003e4c0 0x7f6fe0040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:17.593 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:16.395+0000 7f6ffd000700 1 --2- 172.21.15.82:0/466039694 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f6fe003e4c0 0x7f6fe0040980 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4006fd0 tx=0x7f6fe4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:17.593 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:16.399+0000 7f6ff6000700 1 -- 172.21.15.82:0/466039694 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6fec02a020 con 0x7f6ff807ee30 2024-05-08T05:37:17.593 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:16.631+0000 7f7000400700 1 -- 172.21.15.82:0/466039694 --> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f6ff8105680 con 0x7f6fe003e4c0 2024-05-08T05:37:17.593 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:16.915+0000 7f6ff6000700 1 -- 172.21.15.82:0/466039694 <== mgr.14120 v2:172.21.15.82:6800/765895649 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6ff8105680 con 0x7f6fe003e4c0 2024-05-08T05:37:17.593 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:16.918+0000 7f7000400700 1 -- 172.21.15.82:0/466039694 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f6fe003e4c0 msgr2=0x7f6fe0040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:17.593 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:16.918+0000 7f7000400700 1 --2- 172.21.15.82:0/466039694 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f6fe003e4c0 0x7f6fe0040980 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4006fd0 tx=0x7f6fe4006e40 comp rx=0 tx=0).stop 2024-05-08T05:37:17.593 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:16.918+0000 7f7000400700 1 -- 172.21.15.82:0/466039694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ff807ee30 msgr2=0x7f6ff819ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:17.593 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:16.918+0000 7f7000400700 1 --2- 172.21.15.82:0/466039694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ff807ee30 0x7f6ff819ef30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6fec00b7b0 tx=0x7f6fec00be90 comp rx=0 tx=0).stop 2024-05-08T05:37:17.593 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:16.918+0000 7f7000400700 1 -- 172.21.15.82:0/466039694 shutdown_connections 2024-05-08T05:37:17.594 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:16.918+0000 7f7000400700 1 --2- 172.21.15.82:0/466039694 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f6fe003e4c0 0x7f6fe0040980 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:17.594 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:16.918+0000 7f7000400700 1 --2- 172.21.15.82:0/466039694 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6ff807ee30 0x7f6ff819ef30 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:17.594 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:16.918+0000 7f7000400700 1 -- 172.21.15.82:0/466039694 >> 172.21.15.82:0/466039694 conn(0x7f6ff8104450 msgr2=0x7f6ff8104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:37:17.594 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:16.918+0000 7f7000400700 1 -- 172.21.15.82:0/466039694 shutdown_connections 2024-05-08T05:37:17.594 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:16.918+0000 7f7000400700 1 -- 172.21.15.82:0/466039694 wait complete. 2024-05-08T05:37:18.161 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:17 smithi082 ceph-mon[30098]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:37:18.161 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:17 smithi082 ceph-mon[30098]: Generating ssh key... 2024-05-08T05:37:18.161 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:17 smithi082 ceph-mon[30098]: from='mgr.14120 172.21.15.82:0/3868606737' entity='mgr.x' 2024-05-08T05:37:18.161 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:17 smithi082 ceph-mon[30098]: from='mgr.14120 172.21.15.82:0/3868606737' entity='mgr.x' 2024-05-08T05:37:19.018 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDbQNrY/faZ5LGie6GjjKQXQAxvFHK94ke+3ASL/nZHs8YkB3oR3Jva2LZPr/3S6VrkiD7uGy42Q5PFRM0D/EiidqRDdnKNkSCZFOql8GLRDuWnLjFcMg05IXjH/eX4hXTlft0LULSuSEd8hqC5YCrx7aGm3ivbVDlDwQqB8O1LZiI6MuzZs8rIKH2TBLk7TLLKFGVc5TP0rNT209F5fkMWM5fsx6I67fHeGjo6cKe5lysgQ/oLpn4Yd0P6rpv0FK1sunkOTXLiVXR4OpM8c4JOYkHKLOmTidrCKhVyChoj9EtiL+ilCPQAr+FeULOmlUF9yAbC+yB2hou9/1IGTpeuSlUJAzKsXfcXgMf1U666XeiEN++8GX9/8ezYGuI32HKbFDH1jJAncuJrbfjJUyt8WFMl1ezr6sKfoPuNBiLMQfnF9DBdtZrvnk+TUGQV3xdWF/gGzMipJif8DS1LV+QO4jdq0BBKtglJqS+nL8JywgUT/HlfGiBDbOSIOrhTk7c= ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968 2024-05-08T05:37:19.018 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:18.159+0000 7f0e6e600700 1 Processor -- start 2024-05-08T05:37:19.018 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:18.159+0000 7f0e6e600700 1 -- start start 2024-05-08T05:37:19.019 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:18.159+0000 7f0e6e600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e68108e90 0x7f0e681092b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:19.019 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:18.160+0000 7f0e6e600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0e68109880 con 0x7f0e68108e90 2024-05-08T05:37:19.019 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:18.160+0000 7f0e67400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e68108e90 0x7f0e681092b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:19.019 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:18.160+0000 7f0e67400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e68108e90 0x7f0e681092b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51870/0 (socket says 172.21.15.82:51870) 2024-05-08T05:37:19.019 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:18.160+0000 7f0e67400700 1 -- 172.21.15.82:0/2884442573 learned_addr learned my addr 172.21.15.82:0/2884442573 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:37:19.019 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:18.161+0000 7f0e67400700 1 -- 172.21.15.82:0/2884442573 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e68109ff0 con 0x7f0e68108e90 2024-05-08T05:37:19.019 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:18.161+0000 7f0e67400700 1 --2- 172.21.15.82:0/2884442573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e68108e90 0x7f0e681092b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0e580098a0 tx=0x7f0e58009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e537ee9de14bdfd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:19.019 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:18.161+0000 7f0e66000700 1 -- 172.21.15.82:0/2884442573 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e58004160 con 0x7f0e68108e90 2024-05-08T05:37:19.019 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:18.161+0000 7f0e66000700 1 -- 172.21.15.82:0/2884442573 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f0e58004300 con 0x7f0e68108e90 2024-05-08T05:37:19.020 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:18.161+0000 7f0e66000700 1 -- 172.21.15.82:0/2884442573 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e58011af0 con 0x7f0e68108e90 2024-05-08T05:37:19.020 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:18.162+0000 7f0e6e600700 1 -- 172.21.15.82:0/2884442573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e68108e90 msgr2=0x7f0e681092b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:19.020 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:18.162+0000 7f0e6e600700 1 --2- 172.21.15.82:0/2884442573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e68108e90 0x7f0e681092b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0e580098a0 tx=0x7f0e58009bb0 comp rx=0 tx=0).stop 2024-05-08T05:37:19.020 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:18.162+0000 7f0e6e600700 1 -- 172.21.15.82:0/2884442573 shutdown_connections 2024-05-08T05:37:19.020 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:18.162+0000 7f0e6e600700 1 --2- 172.21.15.82:0/2884442573 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e68108e90 0x7f0e681092b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:19.020 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:18.162+0000 7f0e6e600700 1 -- 172.21.15.82:0/2884442573 >> 172.21.15.82:0/2884442573 conn(0x7f0e68104450 msgr2=0x7f0e68106870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:37:19.020 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:18.162+0000 7f0e6e600700 1 -- 172.21.15.82:0/2884442573 shutdown_connections 2024-05-08T05:37:19.020 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:18.162+0000 7f0e6e600700 1 -- 172.21.15.82:0/2884442573 wait complete. 2024-05-08T05:37:19.020 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:18.164+0000 7f0e6e600700 1 Processor -- start 2024-05-08T05:37:19.020 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:18.164+0000 7f0e6e600700 1 -- start start 2024-05-08T05:37:19.020 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:18.164+0000 7f0e6e600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e68108e90 0x7f0e6819eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:19.020 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:18.164+0000 7f0e6e600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0e6810d3a0 con 0x7f0e68108e90 2024-05-08T05:37:19.020 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:18.165+0000 7f0e67400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e68108e90 0x7f0e6819eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:19.020 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:18.165+0000 7f0e67400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e68108e90 0x7f0e6819eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51872/0 (socket says 172.21.15.82:51872) 2024-05-08T05:37:19.021 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:18.165+0000 7f0e67400700 1 -- 172.21.15.82:0/2986410627 learned_addr learned my addr 172.21.15.82:0/2986410627 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:37:19.021 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:18.165+0000 7f0e67400700 1 -- 172.21.15.82:0/2986410627 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e6819f530 con 0x7f0e68108e90 2024-05-08T05:37:19.021 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:18.165+0000 7f0e67400700 1 --2- 172.21.15.82:0/2986410627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e68108e90 0x7f0e6819eff0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0e58009fb0 tx=0x7f0e58011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:19.021 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:18.166+0000 7f0e5fe00700 1 -- 172.21.15.82:0/2986410627 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e580036a0 con 0x7f0e68108e90 2024-05-08T05:37:19.021 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:18.166+0000 7f0e5fe00700 1 -- 172.21.15.82:0/2986410627 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f0e5801a430 con 0x7f0e68108e90 2024-05-08T05:37:19.021 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:18.166+0000 7f0e5fe00700 1 -- 172.21.15.82:0/2986410627 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0e58019550 con 0x7f0e68108e90 2024-05-08T05:37:19.021 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:18.166+0000 7f0e6e600700 1 -- 172.21.15.82:0/2986410627 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e6819f7c0 con 0x7f0e68108e90 2024-05-08T05:37:19.021 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:18.166+0000 7f0e6e600700 1 -- 172.21.15.82:0/2986410627 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e681a24b0 con 0x7f0e68108e90 2024-05-08T05:37:19.021 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:18.167+0000 7f0e5fe00700 1 -- 172.21.15.82:0/2986410627 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f0e5801a8e0 con 0x7f0e68108e90 2024-05-08T05:37:19.021 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:18.167+0000 7f0e6e600700 1 -- 172.21.15.82:0/2986410627 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e6806a5c0 con 0x7f0e68108e90 2024-05-08T05:37:19.021 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:18.168+0000 7f0e5fe00700 1 --2- 172.21.15.82:0/2986410627 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f0e4c03e470 0x7f0e4c040930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:19.022 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:18.168+0000 7f0e5fe00700 1 -- 172.21.15.82:0/2986410627 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f0e58053810 con 0x7f0e68108e90 2024-05-08T05:37:19.022 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:18.168+0000 7f0e66a00700 1 --2- 172.21.15.82:0/2986410627 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f0e4c03e470 0x7f0e4c040930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:19.022 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:18.169+0000 7f0e66a00700 1 --2- 172.21.15.82:0/2986410627 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f0e4c03e470 0x7f0e4c040930 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0e54006fd0 tx=0x7f0e54006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:19.022 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:18.174+0000 7f0e5fe00700 1 -- 172.21.15.82:0/2986410627 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0e5800b3e0 con 0x7f0e68108e90 2024-05-08T05:37:19.022 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:18.409+0000 7f0e6e600700 1 -- 172.21.15.82:0/2986410627 --> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f0e68105620 con 0x7f0e4c03e470 2024-05-08T05:37:19.022 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:18.410+0000 7f0e5fe00700 1 -- 172.21.15.82:0/2986410627 <== mgr.14120 v2:172.21.15.82:6800/765895649 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f0e68105620 con 0x7f0e4c03e470 2024-05-08T05:37:19.022 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:18.413+0000 7f0e6e600700 1 -- 172.21.15.82:0/2986410627 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f0e4c03e470 msgr2=0x7f0e4c040930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:19.022 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:18.413+0000 7f0e6e600700 1 --2- 172.21.15.82:0/2986410627 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f0e4c03e470 0x7f0e4c040930 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0e54006fd0 tx=0x7f0e54006e40 comp rx=0 tx=0).stop 2024-05-08T05:37:19.023 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:18.413+0000 7f0e6e600700 1 -- 172.21.15.82:0/2986410627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e68108e90 msgr2=0x7f0e6819eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:19.023 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:18.413+0000 7f0e6e600700 1 --2- 172.21.15.82:0/2986410627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e68108e90 0x7f0e6819eff0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0e58009fb0 tx=0x7f0e58011940 comp rx=0 tx=0).stop 2024-05-08T05:37:19.023 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:18.413+0000 7f0e6e600700 1 -- 172.21.15.82:0/2986410627 shutdown_connections 2024-05-08T05:37:19.023 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:18.413+0000 7f0e6e600700 1 --2- 172.21.15.82:0/2986410627 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f0e4c03e470 0x7f0e4c040930 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:19.023 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:18.413+0000 7f0e6e600700 1 --2- 172.21.15.82:0/2986410627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e68108e90 0x7f0e6819eff0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:19.023 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:18.413+0000 7f0e6e600700 1 -- 172.21.15.82:0/2986410627 >> 172.21.15.82:0/2986410627 conn(0x7f0e68104450 msgr2=0x7f0e68104f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:37:19.023 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:18.413+0000 7f0e6e600700 1 -- 172.21.15.82:0/2986410627 shutdown_connections 2024-05-08T05:37:19.023 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:18.413+0000 7f0e6e600700 1 -- 172.21.15.82:0/2986410627 wait complete. 2024-05-08T05:37:19.023 INFO:teuthology.orchestra.run.smithi082.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-05-08T05:37:19.023 INFO:teuthology.orchestra.run.smithi082.stdout:Adding key to root@localhost authorized_keys... 2024-05-08T05:37:19.023 INFO:teuthology.orchestra.run.smithi082.stdout:Adding host smithi082... 2024-05-08T05:37:19.319 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:19 smithi082 ceph-mon[30098]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:37:20.159 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:20 smithi082 ceph-mon[30098]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi082", "addr": "172.21.15.82", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:37:21.349 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:21 smithi082 ceph-mon[30098]: Deploying cephadm binary to smithi082 2024-05-08T05:37:26.508 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout Added host 'smithi082' with addr '172.21.15.82' 2024-05-08T05:37:26.509 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:19.610+0000 7fe14a000700 1 Processor -- start 2024-05-08T05:37:26.509 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:19.611+0000 7fe14a000700 1 -- start start 2024-05-08T05:37:26.509 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:19.611+0000 7fe14a000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe14410b160 0x7fe14410b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:26.509 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:19.611+0000 7fe14a000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe14410bb50 con 0x7fe14410b160 2024-05-08T05:37:26.509 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:19.612+0000 7fe143400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe14410b160 0x7fe14410b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:26.509 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:19.612+0000 7fe143400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe14410b160 0x7fe14410b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51876/0 (socket says 172.21.15.82:51876) 2024-05-08T05:37:26.509 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:19.612+0000 7fe143400700 1 -- 172.21.15.82:0/1460797502 learned_addr learned my addr 172.21.15.82:0/1460797502 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:37:26.509 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:19.612+0000 7fe143400700 1 -- 172.21.15.82:0/1460797502 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe14410c1f0 con 0x7fe14410b160 2024-05-08T05:37:26.509 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:19.612+0000 7fe143400700 1 --2- 172.21.15.82:0/1460797502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe14410b160 0x7fe14410b580 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe1340098a0 tx=0x7fe134009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f968b9fdaf768f64 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:26.509 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:19.613+0000 7fe142000700 1 -- 172.21.15.82:0/1460797502 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe134004160 con 0x7fe14410b160 2024-05-08T05:37:26.510 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:19.613+0000 7fe142000700 1 -- 172.21.15.82:0/1460797502 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fe134004300 con 0x7fe14410b160 2024-05-08T05:37:26.510 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:19.613+0000 7fe142000700 1 -- 172.21.15.82:0/1460797502 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe134011af0 con 0x7fe14410b160 2024-05-08T05:37:26.510 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:19.613+0000 7fe14a000700 1 -- 172.21.15.82:0/1460797502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe14410b160 msgr2=0x7fe14410b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:26.510 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:19.613+0000 7fe14a000700 1 --2- 172.21.15.82:0/1460797502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe14410b160 0x7fe14410b580 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe1340098a0 tx=0x7fe134009bb0 comp rx=0 tx=0).stop 2024-05-08T05:37:26.510 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:19.614+0000 7fe14a000700 1 -- 172.21.15.82:0/1460797502 shutdown_connections 2024-05-08T05:37:26.510 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:19.614+0000 7fe14a000700 1 --2- 172.21.15.82:0/1460797502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe14410b160 0x7fe14410b580 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:26.510 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:19.614+0000 7fe14a000700 1 -- 172.21.15.82:0/1460797502 >> 172.21.15.82:0/1460797502 conn(0x7fe14407e3a0 msgr2=0x7fe14407e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:37:26.510 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:19.614+0000 7fe14a000700 1 -- 172.21.15.82:0/1460797502 shutdown_connections 2024-05-08T05:37:26.511 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:19.614+0000 7fe14a000700 1 -- 172.21.15.82:0/1460797502 wait complete. 2024-05-08T05:37:26.511 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:19.615+0000 7fe14a000700 1 Processor -- start 2024-05-08T05:37:26.511 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:19.615+0000 7fe14a000700 1 -- start start 2024-05-08T05:37:26.511 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:19.615+0000 7fe14a000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe14410b160 0x7fe14419efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:26.511 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:19.615+0000 7fe14a000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe14410f5a0 con 0x7fe14410b160 2024-05-08T05:37:26.511 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:19.616+0000 7fe143400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe14410b160 0x7fe14419efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:26.511 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:19.616+0000 7fe143400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe14410b160 0x7fe14419efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51890/0 (socket says 172.21.15.82:51890) 2024-05-08T05:37:26.511 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:19.616+0000 7fe143400700 1 -- 172.21.15.82:0/1297845650 learned_addr learned my addr 172.21.15.82:0/1297845650 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:37:26.511 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:19.616+0000 7fe143400700 1 -- 172.21.15.82:0/1297845650 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe14419f4e0 con 0x7fe14410b160 2024-05-08T05:37:26.511 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:19.616+0000 7fe143400700 1 --2- 172.21.15.82:0/1297845650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe14410b160 0x7fe14419efa0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe1340117b0 tx=0x7fe134011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:26.511 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:19.616+0000 7fe13be00700 1 -- 172.21.15.82:0/1297845650 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe134003af0 con 0x7fe14410b160 2024-05-08T05:37:26.511 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:19.617+0000 7fe13be00700 1 -- 172.21.15.82:0/1297845650 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fe134020070 con 0x7fe14410b160 2024-05-08T05:37:26.511 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:19.617+0000 7fe14a000700 1 -- 172.21.15.82:0/1297845650 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe14419f770 con 0x7fe14410b160 2024-05-08T05:37:26.511 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:19.617+0000 7fe13be00700 1 -- 172.21.15.82:0/1297845650 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe134019630 con 0x7fe14410b160 2024-05-08T05:37:26.512 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:19.617+0000 7fe14a000700 1 -- 172.21.15.82:0/1297845650 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1441a2460 con 0x7fe14410b160 2024-05-08T05:37:26.512 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:19.618+0000 7fe13be00700 1 -- 172.21.15.82:0/1297845650 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7fe13401a9c0 con 0x7fe14410b160 2024-05-08T05:37:26.512 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:19.618+0000 7fe14a000700 1 -- 172.21.15.82:0/1297845650 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe14406a5c0 con 0x7fe14410b160 2024-05-08T05:37:26.512 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:19.618+0000 7fe13be00700 1 --2- 172.21.15.82:0/1297845650 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7fe12803e470 0x7fe128040930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:26.512 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:19.618+0000 7fe13be00700 1 -- 172.21.15.82:0/1297845650 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe134053ae0 con 0x7fe14410b160 2024-05-08T05:37:26.512 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:19.619+0000 7fe142a00700 1 --2- 172.21.15.82:0/1297845650 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7fe12803e470 0x7fe128040930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:26.512 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:19.619+0000 7fe142a00700 1 --2- 172.21.15.82:0/1297845650 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7fe12803e470 0x7fe128040930 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe130006fd0 tx=0x7fe130006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:26.512 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:19.624+0000 7fe13be00700 1 -- 172.21.15.82:0/1297845650 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe1340172b0 con 0x7fe14410b160 2024-05-08T05:37:26.512 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:19.837+0000 7fe14a000700 1 -- 172.21.15.82:0/1297845650 --> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi082", "addr": "172.21.15.82", "target": ["mon-mgr", ""]}) -- 0x7fe144109520 con 0x7fe12803e470 2024-05-08T05:37:26.512 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:25.783+0000 7fe13be00700 1 -- 172.21.15.82:0/1297845650 <== mgr.14120 v2:172.21.15.82:6800/765895649 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7fe144109520 con 0x7fe12803e470 2024-05-08T05:37:26.512 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:25.787+0000 7fe14a000700 1 -- 172.21.15.82:0/1297845650 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7fe12803e470 msgr2=0x7fe128040930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:26.512 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:25.787+0000 7fe14a000700 1 --2- 172.21.15.82:0/1297845650 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7fe12803e470 0x7fe128040930 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe130006fd0 tx=0x7fe130006e40 comp rx=0 tx=0).stop 2024-05-08T05:37:26.512 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:25.787+0000 7fe14a000700 1 -- 172.21.15.82:0/1297845650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe14410b160 msgr2=0x7fe14419efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:26.512 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:25.787+0000 7fe14a000700 1 --2- 172.21.15.82:0/1297845650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe14410b160 0x7fe14419efa0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe1340117b0 tx=0x7fe134011b70 comp rx=0 tx=0).stop 2024-05-08T05:37:26.513 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:25.787+0000 7fe14a000700 1 -- 172.21.15.82:0/1297845650 shutdown_connections 2024-05-08T05:37:26.513 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:25.787+0000 7fe14a000700 1 --2- 172.21.15.82:0/1297845650 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7fe12803e470 0x7fe128040930 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:26.513 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:25.787+0000 7fe14a000700 1 --2- 172.21.15.82:0/1297845650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe14410b160 0x7fe14419efa0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:26.513 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:25.787+0000 7fe14a000700 1 -- 172.21.15.82:0/1297845650 >> 172.21.15.82:0/1297845650 conn(0x7fe14407e3a0 msgr2=0x7fe144108e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:37:26.513 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:25.787+0000 7fe14a000700 1 -- 172.21.15.82:0/1297845650 shutdown_connections 2024-05-08T05:37:26.513 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:25.787+0000 7fe14a000700 1 -- 172.21.15.82:0/1297845650 wait complete. 2024-05-08T05:37:26.513 INFO:teuthology.orchestra.run.smithi082.stdout:Deploying unmanaged mon service... 2024-05-08T05:37:27.114 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:26 smithi082 ceph-mon[30098]: from='mgr.14120 172.21.15.82:0/3868606737' entity='mgr.x' 2024-05-08T05:37:27.114 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:26 smithi082 ceph-mon[30098]: Added host smithi082 2024-05-08T05:37:27.114 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:26 smithi082 ceph-mon[30098]: from='mgr.14120 172.21.15.82:0/3868606737' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:37:28.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:28 smithi082 ceph-mon[30098]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:37:28.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:28 smithi082 ceph-mon[30098]: Saving service mon spec with placement count:5 2024-05-08T05:37:28.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:28 smithi082 ceph-mon[30098]: from='mgr.14120 172.21.15.82:0/3868606737' entity='mgr.x' 2024-05-08T05:37:28.578 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-05-08T05:37:28.578 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:27.122+0000 7f4a69800700 1 Processor -- start 2024-05-08T05:37:28.578 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:27.123+0000 7f4a69800700 1 -- start start 2024-05-08T05:37:28.579 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:27.123+0000 7f4a69800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a64108e90 0x7f4a641092b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:28.579 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:27.123+0000 7f4a69800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4a64109880 con 0x7f4a64108e90 2024-05-08T05:37:28.579 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:27.123+0000 7f4a62a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a64108e90 0x7f4a641092b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:28.579 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:27.124+0000 7f4a62a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a64108e90 0x7f4a641092b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35528/0 (socket says 172.21.15.82:35528) 2024-05-08T05:37:28.579 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:27.124+0000 7f4a62a00700 1 -- 172.21.15.82:0/998438409 learned_addr learned my addr 172.21.15.82:0/998438409 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:37:28.579 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:27.124+0000 7f4a62a00700 1 -- 172.21.15.82:0/998438409 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a64109ff0 con 0x7f4a64108e90 2024-05-08T05:37:28.579 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:27.124+0000 7f4a62a00700 1 --2- 172.21.15.82:0/998438409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a64108e90 0x7f4a641092b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4a540098a0 tx=0x7f4a54009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d98c07978a798b2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:28.579 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:27.125+0000 7f4a62000700 1 -- 172.21.15.82:0/998438409 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a54004160 con 0x7f4a64108e90 2024-05-08T05:37:28.579 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:27.125+0000 7f4a62000700 1 -- 172.21.15.82:0/998438409 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f4a54004300 con 0x7f4a64108e90 2024-05-08T05:37:28.579 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:27.125+0000 7f4a62000700 1 -- 172.21.15.82:0/998438409 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a54011af0 con 0x7f4a64108e90 2024-05-08T05:37:28.579 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:27.126+0000 7f4a69800700 1 -- 172.21.15.82:0/998438409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a64108e90 msgr2=0x7f4a641092b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:28.579 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:27.126+0000 7f4a69800700 1 --2- 172.21.15.82:0/998438409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a64108e90 0x7f4a641092b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4a540098a0 tx=0x7f4a54009bb0 comp rx=0 tx=0).stop 2024-05-08T05:37:28.579 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:27.126+0000 7f4a69800700 1 -- 172.21.15.82:0/998438409 shutdown_connections 2024-05-08T05:37:28.580 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:27.126+0000 7f4a69800700 1 --2- 172.21.15.82:0/998438409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a64108e90 0x7f4a641092b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:28.580 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:27.126+0000 7f4a69800700 1 -- 172.21.15.82:0/998438409 >> 172.21.15.82:0/998438409 conn(0x7f4a64104450 msgr2=0x7f4a64106870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:37:28.580 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:27.126+0000 7f4a69800700 1 -- 172.21.15.82:0/998438409 shutdown_connections 2024-05-08T05:37:28.580 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:27.126+0000 7f4a69800700 1 -- 172.21.15.82:0/998438409 wait complete. 2024-05-08T05:37:28.580 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:27.127+0000 7f4a69800700 1 Processor -- start 2024-05-08T05:37:28.580 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:27.127+0000 7f4a69800700 1 -- start start 2024-05-08T05:37:28.580 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:27.127+0000 7f4a69800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a64108e90 0x7f4a6419cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:28.580 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:27.127+0000 7f4a69800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4a6410d3a0 con 0x7f4a64108e90 2024-05-08T05:37:28.580 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:27.127+0000 7f4a62a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a64108e90 0x7f4a6419cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:28.580 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:27.128+0000 7f4a62a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a64108e90 0x7f4a6419cdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35540/0 (socket says 172.21.15.82:35540) 2024-05-08T05:37:28.580 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:27.128+0000 7f4a62a00700 1 -- 172.21.15.82:0/2460730337 learned_addr learned my addr 172.21.15.82:0/2460730337 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:37:28.580 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:27.128+0000 7f4a62a00700 1 -- 172.21.15.82:0/2460730337 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a6419d310 con 0x7f4a64108e90 2024-05-08T05:37:28.580 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:27.128+0000 7f4a62a00700 1 --2- 172.21.15.82:0/2460730337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a64108e90 0x7f4a6419cdd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4a540117b0 tx=0x7f4a54011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:28.580 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:27.128+0000 7f4a5be00700 1 -- 172.21.15.82:0/2460730337 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a54003af0 con 0x7f4a64108e90 2024-05-08T05:37:28.581 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:27.128+0000 7f4a69800700 1 -- 172.21.15.82:0/2460730337 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a6419d5a0 con 0x7f4a64108e90 2024-05-08T05:37:28.581 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:27.128+0000 7f4a69800700 1 -- 172.21.15.82:0/2460730337 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a641a0290 con 0x7f4a64108e90 2024-05-08T05:37:28.581 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:27.129+0000 7f4a5be00700 1 -- 172.21.15.82:0/2460730337 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7f4a54020070 con 0x7f4a64108e90 2024-05-08T05:37:28.581 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:27.129+0000 7f4a5be00700 1 -- 172.21.15.82:0/2460730337 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4a5402a060 con 0x7f4a64108e90 2024-05-08T05:37:28.581 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:27.129+0000 7f4a69800700 1 -- 172.21.15.82:0/2460730337 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a6406a5c0 con 0x7f4a64108e90 2024-05-08T05:37:28.581 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:27.130+0000 7f4a5be00700 1 -- 172.21.15.82:0/2460730337 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f4a540196f0 con 0x7f4a64108e90 2024-05-08T05:37:28.581 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:27.130+0000 7f4a5be00700 1 --2- 172.21.15.82:0/2460730337 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f4a4803e470 0x7f4a48040930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:28.581 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:27.130+0000 7f4a5be00700 1 -- 172.21.15.82:0/2460730337 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f4a54053c10 con 0x7f4a64108e90 2024-05-08T05:37:28.581 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:27.131+0000 7f4a5a000700 1 --2- 172.21.15.82:0/2460730337 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f4a4803e470 0x7f4a48040930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:28.581 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:27.132+0000 7f4a5a000700 1 --2- 172.21.15.82:0/2460730337 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f4a4803e470 0x7f4a48040930 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c00ad30 tx=0x7f4a4c0093f0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:28.581 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:27.136+0000 7f4a5be00700 1 -- 172.21.15.82:0/2460730337 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4a5400e260 con 0x7f4a64108e90 2024-05-08T05:37:28.581 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:27.398+0000 7f4a69800700 1 -- 172.21.15.82:0/2460730337 --> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f4a641056a0 con 0x7f4a4803e470 2024-05-08T05:37:28.581 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:27.407+0000 7f4a5be00700 1 -- 172.21.15.82:0/2460730337 <== mgr.14120 v2:172.21.15.82:6800/765895649 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f4a641056a0 con 0x7f4a4803e470 2024-05-08T05:37:28.581 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:27.410+0000 7f4a69800700 1 -- 172.21.15.82:0/2460730337 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f4a4803e470 msgr2=0x7f4a48040930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:28.581 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:27.410+0000 7f4a69800700 1 --2- 172.21.15.82:0/2460730337 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f4a4803e470 0x7f4a48040930 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c00ad30 tx=0x7f4a4c0093f0 comp rx=0 tx=0).stop 2024-05-08T05:37:28.582 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:27.410+0000 7f4a69800700 1 -- 172.21.15.82:0/2460730337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a64108e90 msgr2=0x7f4a6419cdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:28.582 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:27.410+0000 7f4a69800700 1 --2- 172.21.15.82:0/2460730337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a64108e90 0x7f4a6419cdd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4a540117b0 tx=0x7f4a54011b70 comp rx=0 tx=0).stop 2024-05-08T05:37:28.582 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:27.410+0000 7f4a69800700 1 -- 172.21.15.82:0/2460730337 shutdown_connections 2024-05-08T05:37:28.582 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:27.410+0000 7f4a69800700 1 --2- 172.21.15.82:0/2460730337 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f4a4803e470 0x7f4a48040930 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:28.582 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:27.410+0000 7f4a69800700 1 --2- 172.21.15.82:0/2460730337 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4a64108e90 0x7f4a6419cdd0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:28.582 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:27.410+0000 7f4a69800700 1 -- 172.21.15.82:0/2460730337 >> 172.21.15.82:0/2460730337 conn(0x7f4a64104450 msgr2=0x7f4a64104f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:37:28.582 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:27.411+0000 7f4a69800700 1 -- 172.21.15.82:0/2460730337 shutdown_connections 2024-05-08T05:37:28.582 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:27.411+0000 7f4a69800700 1 -- 172.21.15.82:0/2460730337 wait complete. 2024-05-08T05:37:28.582 INFO:teuthology.orchestra.run.smithi082.stdout:Deploying unmanaged mgr service... 2024-05-08T05:37:30.163 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-05-08T05:37:30.164 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:29.257+0000 7fe22be00700 1 Processor -- start 2024-05-08T05:37:30.164 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:29.257+0000 7fe22be00700 1 -- start start 2024-05-08T05:37:30.164 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:29.258+0000 7fe22be00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe22c07ee80 0x7fe22c07d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:30.164 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:29.258+0000 7fe22be00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe22c07d900 con 0x7fe22c07ee80 2024-05-08T05:37:30.164 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:29.258+0000 7fe22aa00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe22c07ee80 0x7fe22c07d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:30.164 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:29.258+0000 7fe22aa00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe22c07ee80 0x7fe22c07d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35556/0 (socket says 172.21.15.82:35556) 2024-05-08T05:37:30.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:29.258+0000 7fe22aa00700 1 -- 172.21.15.82:0/2531468699 learned_addr learned my addr 172.21.15.82:0/2531468699 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:37:30.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:29.259+0000 7fe22aa00700 1 -- 172.21.15.82:0/2531468699 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe22c07da80 con 0x7fe22c07ee80 2024-05-08T05:37:30.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:29.259+0000 7fe22aa00700 1 --2- 172.21.15.82:0/2531468699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe22c07ee80 0x7fe22c07d330 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe21c0098a0 tx=0x7fe21c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad1adf65ca184297 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:30.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:29.259+0000 7fe229600700 1 -- 172.21.15.82:0/2531468699 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe21c004160 con 0x7fe22c07ee80 2024-05-08T05:37:30.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:29.259+0000 7fe229600700 1 -- 172.21.15.82:0/2531468699 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fe21c004300 con 0x7fe22c07ee80 2024-05-08T05:37:30.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:29.259+0000 7fe229600700 1 -- 172.21.15.82:0/2531468699 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe21c011af0 con 0x7fe22c07ee80 2024-05-08T05:37:30.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:29.260+0000 7fe22be00700 1 -- 172.21.15.82:0/2531468699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe22c07ee80 msgr2=0x7fe22c07d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:30.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:29.260+0000 7fe22be00700 1 --2- 172.21.15.82:0/2531468699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe22c07ee80 0x7fe22c07d330 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe21c0098a0 tx=0x7fe21c009bb0 comp rx=0 tx=0).stop 2024-05-08T05:37:30.165 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:29.260+0000 7fe22be00700 1 -- 172.21.15.82:0/2531468699 shutdown_connections 2024-05-08T05:37:30.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:29.260+0000 7fe22be00700 1 --2- 172.21.15.82:0/2531468699 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe22c07ee80 0x7fe22c07d330 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:30.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:29.260+0000 7fe22be00700 1 -- 172.21.15.82:0/2531468699 >> 172.21.15.82:0/2531468699 conn(0x7fe22c104180 msgr2=0x7fe22c1065e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:37:30.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:29.260+0000 7fe22be00700 1 -- 172.21.15.82:0/2531468699 shutdown_connections 2024-05-08T05:37:30.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:29.260+0000 7fe22be00700 1 -- 172.21.15.82:0/2531468699 wait complete. 2024-05-08T05:37:30.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:29.261+0000 7fe22be00700 1 Processor -- start 2024-05-08T05:37:30.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:29.261+0000 7fe22be00700 1 -- start start 2024-05-08T05:37:30.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:29.262+0000 7fe22be00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe22c07ee80 0x7fe22c19ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:30.166 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:29.262+0000 7fe22be00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe22c10f130 con 0x7fe22c07ee80 2024-05-08T05:37:30.167 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:29.262+0000 7fe22aa00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe22c07ee80 0x7fe22c19ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:30.167 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:29.262+0000 7fe22aa00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe22c07ee80 0x7fe22c19ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35566/0 (socket says 172.21.15.82:35566) 2024-05-08T05:37:30.167 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:29.262+0000 7fe22aa00700 1 -- 172.21.15.82:0/2942266450 learned_addr learned my addr 172.21.15.82:0/2942266450 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:37:30.167 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:29.262+0000 7fe22aa00700 1 -- 172.21.15.82:0/2942266450 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe22c19f2a0 con 0x7fe22c07ee80 2024-05-08T05:37:30.167 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:29.263+0000 7fe22aa00700 1 --2- 172.21.15.82:0/2942266450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe22c07ee80 0x7fe22c19ed60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe21c009fb0 tx=0x7fe21c011940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:30.167 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:29.263+0000 7fe223400700 1 -- 172.21.15.82:0/2942266450 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe21c0036a0 con 0x7fe22c07ee80 2024-05-08T05:37:30.168 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:29.263+0000 7fe223400700 1 -- 172.21.15.82:0/2942266450 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1070+0+0 (secure 0 0 0) 0x7fe21c01a430 con 0x7fe22c07ee80 2024-05-08T05:37:30.168 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:29.263+0000 7fe223400700 1 -- 172.21.15.82:0/2942266450 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe21c019550 con 0x7fe22c07ee80 2024-05-08T05:37:30.168 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:29.263+0000 7fe22be00700 1 -- 172.21.15.82:0/2942266450 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe22c19f530 con 0x7fe22c07ee80 2024-05-08T05:37:30.168 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:29.263+0000 7fe22be00700 1 -- 172.21.15.82:0/2942266450 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe22c1a2220 con 0x7fe22c07ee80 2024-05-08T05:37:30.168 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:29.264+0000 7fe223400700 1 -- 172.21.15.82:0/2942266450 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7fe21c01a8e0 con 0x7fe22c07ee80 2024-05-08T05:37:30.168 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:29.264+0000 7fe22be00700 1 -- 172.21.15.82:0/2942266450 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe22c06a5c0 con 0x7fe22c07ee80 2024-05-08T05:37:30.168 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:29.265+0000 7fe223400700 1 --2- 172.21.15.82:0/2942266450 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7fe21003e470 0x7fe210040930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:30.169 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:29.265+0000 7fe223400700 1 -- 172.21.15.82:0/2942266450 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe21c0538c0 con 0x7fe22c07ee80 2024-05-08T05:37:30.169 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:29.265+0000 7fe22a000700 1 --2- 172.21.15.82:0/2942266450 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7fe21003e470 0x7fe210040930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:30.169 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:29.266+0000 7fe22a000700 1 --2- 172.21.15.82:0/2942266450 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7fe21003e470 0x7fe210040930 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe218006fd0 tx=0x7fe218006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:30.169 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:29.270+0000 7fe223400700 1 -- 172.21.15.82:0/2942266450 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe21c00b3e0 con 0x7fe22c07ee80 2024-05-08T05:37:30.169 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:29.518+0000 7fe22be00700 1 -- 172.21.15.82:0/2942266450 --> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fe22c105490 con 0x7fe21003e470 2024-05-08T05:37:30.169 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:29.527+0000 7fe223400700 1 -- 172.21.15.82:0/2942266450 <== mgr.14120 v2:172.21.15.82:6800/765895649 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fe22c105490 con 0x7fe21003e470 2024-05-08T05:37:30.169 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:29.530+0000 7fe22be00700 1 -- 172.21.15.82:0/2942266450 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7fe21003e470 msgr2=0x7fe210040930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:30.169 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:29.530+0000 7fe22be00700 1 --2- 172.21.15.82:0/2942266450 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7fe21003e470 0x7fe210040930 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe218006fd0 tx=0x7fe218006e40 comp rx=0 tx=0).stop 2024-05-08T05:37:30.169 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:29.530+0000 7fe22be00700 1 -- 172.21.15.82:0/2942266450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe22c07ee80 msgr2=0x7fe22c19ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:30.169 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:29.530+0000 7fe22be00700 1 --2- 172.21.15.82:0/2942266450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe22c07ee80 0x7fe22c19ed60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe21c009fb0 tx=0x7fe21c011940 comp rx=0 tx=0).stop 2024-05-08T05:37:30.169 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:29.530+0000 7fe22be00700 1 -- 172.21.15.82:0/2942266450 shutdown_connections 2024-05-08T05:37:30.169 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:29.530+0000 7fe22be00700 1 --2- 172.21.15.82:0/2942266450 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7fe21003e470 0x7fe210040930 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:30.169 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:29.530+0000 7fe22be00700 1 --2- 172.21.15.82:0/2942266450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe22c07ee80 0x7fe22c19ed60 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:30.169 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:29.530+0000 7fe22be00700 1 -- 172.21.15.82:0/2942266450 >> 172.21.15.82:0/2942266450 conn(0x7fe22c104180 msgr2=0x7fe22c104d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:37:30.169 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:29.531+0000 7fe22be00700 1 -- 172.21.15.82:0/2942266450 shutdown_connections 2024-05-08T05:37:30.170 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:29.531+0000 7fe22be00700 1 -- 172.21.15.82:0/2942266450 wait complete. 2024-05-08T05:37:30.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:30 smithi082 ceph-mon[30098]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:37:30.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:30 smithi082 ceph-mon[30098]: Saving service mgr spec with placement count:2 2024-05-08T05:37:30.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:30 smithi082 ceph-mon[30098]: from='mgr.14120 172.21.15.82:0/3868606737' entity='mgr.x' 2024-05-08T05:37:30.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:30 smithi082 ceph-mon[30098]: from='mgr.14120 172.21.15.82:0/3868606737' entity='mgr.x' 2024-05-08T05:37:31.739 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:30.772+0000 7fdf01a00700 1 Processor -- start 2024-05-08T05:37:31.739 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:30.772+0000 7fdf01a00700 1 -- start start 2024-05-08T05:37:31.739 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:30.772+0000 7fdf01a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdefc109980 0x7fdefc10bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:31.739 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:30.772+0000 7fdf01a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdefc07ce00 con 0x7fdefc109980 2024-05-08T05:37:31.739 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:30.773+0000 7fdefaa00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdefc109980 0x7fdefc10bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:31.739 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:30.773+0000 7fdefaa00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdefc109980 0x7fdefc10bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35570/0 (socket says 172.21.15.82:35570) 2024-05-08T05:37:31.740 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:30.773+0000 7fdefaa00700 1 -- 172.21.15.82:0/2803099780 learned_addr learned my addr 172.21.15.82:0/2803099780 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:37:31.740 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:30.773+0000 7fdefaa00700 1 -- 172.21.15.82:0/2803099780 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdefc10c2b0 con 0x7fdefc109980 2024-05-08T05:37:31.741 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:30.774+0000 7fdefaa00700 1 --2- 172.21.15.82:0/2803099780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdefc109980 0x7fdefc10bd70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdeec0098a0 tx=0x7fdeec009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36fb3c97f4a207a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:31.741 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:30.774+0000 7fdef9600700 1 -- 172.21.15.82:0/2803099780 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdeec004160 con 0x7fdefc109980 2024-05-08T05:37:31.742 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:30.774+0000 7fdef9600700 1 -- 172.21.15.82:0/2803099780 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdeec004300 con 0x7fdefc109980 2024-05-08T05:37:31.742 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:30.774+0000 7fdef9600700 1 -- 172.21.15.82:0/2803099780 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdeec011a20 con 0x7fdefc109980 2024-05-08T05:37:31.742 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:30.775+0000 7fdf01a00700 1 -- 172.21.15.82:0/2803099780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdefc109980 msgr2=0x7fdefc10bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:31.742 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:30.775+0000 7fdf01a00700 1 --2- 172.21.15.82:0/2803099780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdefc109980 0x7fdefc10bd70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fdeec0098a0 tx=0x7fdeec009bb0 comp rx=0 tx=0).stop 2024-05-08T05:37:31.742 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:30.775+0000 7fdf01a00700 1 -- 172.21.15.82:0/2803099780 shutdown_connections 2024-05-08T05:37:31.742 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:30.775+0000 7fdf01a00700 1 --2- 172.21.15.82:0/2803099780 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdefc109980 0x7fdefc10bd70 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:31.742 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:30.775+0000 7fdf01a00700 1 -- 172.21.15.82:0/2803099780 >> 172.21.15.82:0/2803099780 conn(0x7fdefc1032f0 msgr2=0x7fdefc105730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:37:31.742 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:30.775+0000 7fdf01a00700 1 -- 172.21.15.82:0/2803099780 shutdown_connections 2024-05-08T05:37:31.742 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:30.775+0000 7fdf01a00700 1 -- 172.21.15.82:0/2803099780 wait complete. 2024-05-08T05:37:31.742 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:30.776+0000 7fdf01a00700 1 Processor -- start 2024-05-08T05:37:31.744 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:30.776+0000 7fdf01a00700 1 -- start start 2024-05-08T05:37:31.744 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:30.777+0000 7fdf01a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdefc109980 0x7fdefc19ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:31.744 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:30.777+0000 7fdf01a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdefc10d200 con 0x7fdefc109980 2024-05-08T05:37:31.744 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:30.777+0000 7fdefaa00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdefc109980 0x7fdefc19ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:31.745 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:30.777+0000 7fdefaa00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdefc109980 0x7fdefc19ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35580/0 (socket says 172.21.15.82:35580) 2024-05-08T05:37:31.745 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:30.777+0000 7fdefaa00700 1 -- 172.21.15.82:0/3551050923 learned_addr learned my addr 172.21.15.82:0/3551050923 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:37:31.745 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:30.777+0000 7fdefaa00700 1 -- 172.21.15.82:0/3551050923 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdefc19f4c0 con 0x7fdefc109980 2024-05-08T05:37:31.745 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:30.778+0000 7fdefaa00700 1 --2- 172.21.15.82:0/3551050923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdefc109980 0x7fdefc19ef80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdeec004660 tx=0x7fdeec011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:31.745 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:30.778+0000 7fdef3400700 1 -- 172.21.15.82:0/3551050923 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdeec003aa0 con 0x7fdefc109980 2024-05-08T05:37:31.745 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:30.778+0000 7fdf01a00700 1 -- 172.21.15.82:0/3551050923 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdefc19f750 con 0x7fdefc109980 2024-05-08T05:37:31.745 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:30.778+0000 7fdef3400700 1 -- 172.21.15.82:0/3551050923 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdeec01b8f0 con 0x7fdefc109980 2024-05-08T05:37:31.745 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:30.778+0000 7fdef3400700 1 -- 172.21.15.82:0/3551050923 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdeec023900 con 0x7fdefc109980 2024-05-08T05:37:31.746 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:30.778+0000 7fdf01a00700 1 -- 172.21.15.82:0/3551050923 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdefc1a2440 con 0x7fdefc109980 2024-05-08T05:37:31.746 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:30.779+0000 7fdf01a00700 1 -- 172.21.15.82:0/3551050923 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdefc06a5c0 con 0x7fdefc109980 2024-05-08T05:37:31.748 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:30.780+0000 7fdef3400700 1 -- 172.21.15.82:0/3551050923 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7fdeec023bc0 con 0x7fdefc109980 2024-05-08T05:37:31.748 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:30.780+0000 7fdef3400700 1 --2- 172.21.15.82:0/3551050923 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7fdee003e470 0x7fdee0040930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:31.748 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:30.780+0000 7fdef3400700 1 -- 172.21.15.82:0/3551050923 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fdeec053f40 con 0x7fdefc109980 2024-05-08T05:37:31.748 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:30.780+0000 7fdefa000700 1 --2- 172.21.15.82:0/3551050923 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7fdee003e470 0x7fdee0040930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:31.748 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:30.781+0000 7fdefa000700 1 --2- 172.21.15.82:0/3551050923 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7fdee003e470 0x7fdee0040930 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fdee8006fd0 tx=0x7fdee8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:31.748 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:30.786+0000 7fdef3400700 1 -- 172.21.15.82:0/3551050923 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fdeec01f030 con 0x7fdefc109980 2024-05-08T05:37:31.749 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:31.018+0000 7fdf01a00700 1 -- 172.21.15.82:0/3551050923 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7fdefc1a2a40 con 0x7fdefc109980 2024-05-08T05:37:31.749 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:31.023+0000 7fdef3400700 1 -- 172.21.15.82:0/3551050923 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7fdeec016260 con 0x7fdefc109980 2024-05-08T05:37:31.749 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:31.027+0000 7fdf01a00700 1 -- 172.21.15.82:0/3551050923 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7fdee003e470 msgr2=0x7fdee0040930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:31.749 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:31.027+0000 7fdf01a00700 1 --2- 172.21.15.82:0/3551050923 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7fdee003e470 0x7fdee0040930 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fdee8006fd0 tx=0x7fdee8006e40 comp rx=0 tx=0).stop 2024-05-08T05:37:31.749 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:31.027+0000 7fdf01a00700 1 -- 172.21.15.82:0/3551050923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdefc109980 msgr2=0x7fdefc19ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:31.749 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:31.027+0000 7fdf01a00700 1 --2- 172.21.15.82:0/3551050923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdefc109980 0x7fdefc19ef80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fdeec004660 tx=0x7fdeec011aa0 comp rx=0 tx=0).stop 2024-05-08T05:37:31.749 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:31.027+0000 7fdf01a00700 1 -- 172.21.15.82:0/3551050923 shutdown_connections 2024-05-08T05:37:31.749 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:31.027+0000 7fdf01a00700 1 --2- 172.21.15.82:0/3551050923 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7fdee003e470 0x7fdee0040930 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:31.749 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:31.027+0000 7fdf01a00700 1 --2- 172.21.15.82:0/3551050923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdefc109980 0x7fdefc19ef80 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:31.749 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:31.027+0000 7fdf01a00700 1 -- 172.21.15.82:0/3551050923 >> 172.21.15.82:0/3551050923 conn(0x7fdefc1032f0 msgr2=0x7fdefc103d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:37:31.749 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:31.027+0000 7fdf01a00700 1 -- 172.21.15.82:0/3551050923 shutdown_connections 2024-05-08T05:37:31.749 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:31.028+0000 7fdf01a00700 1 -- 172.21.15.82:0/3551050923 wait complete. 2024-05-08T05:37:31.923 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:31 smithi082 ceph-mon[30098]: from='mgr.14120 172.21.15.82:0/3868606737' entity='mgr.x' 2024-05-08T05:37:31.923 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:31 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/3551050923' entity='client.admin' 2024-05-08T05:37:32.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:32 smithi082 ceph-mon[30098]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:37:33.671 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:32.373+0000 7f4c64600700 1 Processor -- start 2024-05-08T05:37:33.672 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:32.373+0000 7f4c64600700 1 -- start start 2024-05-08T05:37:33.672 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:32.374+0000 7f4c64600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c5c10b0d0 0x7f4c5c10b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:33.672 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:32.374+0000 7f4c64600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4c5c10bac0 con 0x7f4c5c10b0d0 2024-05-08T05:37:33.672 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:32.374+0000 7f4c61c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c5c10b0d0 0x7f4c5c10b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:33.672 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:32.374+0000 7f4c61c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c5c10b0d0 0x7f4c5c10b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35590/0 (socket says 172.21.15.82:35590) 2024-05-08T05:37:33.672 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:32.374+0000 7f4c61c00700 1 -- 172.21.15.82:0/3991816113 learned_addr learned my addr 172.21.15.82:0/3991816113 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:37:33.672 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:32.375+0000 7f4c61c00700 1 -- 172.21.15.82:0/3991816113 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c5c10c220 con 0x7f4c5c10b0d0 2024-05-08T05:37:33.674 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:32.375+0000 7f4c61c00700 1 --2- 172.21.15.82:0/3991816113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c5c10b0d0 0x7f4c5c10b4f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4c500098a0 tx=0x7f4c50009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b1876f799f40b9b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:33.675 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:32.376+0000 7f4c5be00700 1 -- 172.21.15.82:0/3991816113 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c50004160 con 0x7f4c5c10b0d0 2024-05-08T05:37:33.675 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:32.376+0000 7f4c5be00700 1 -- 172.21.15.82:0/3991816113 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c50004300 con 0x7f4c5c10b0d0 2024-05-08T05:37:33.675 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:32.376+0000 7f4c5be00700 1 -- 172.21.15.82:0/3991816113 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c50011a20 con 0x7f4c5c10b0d0 2024-05-08T05:37:33.675 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:32.376+0000 7f4c64600700 1 -- 172.21.15.82:0/3991816113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c5c10b0d0 msgr2=0x7f4c5c10b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:33.675 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:32.376+0000 7f4c64600700 1 --2- 172.21.15.82:0/3991816113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c5c10b0d0 0x7f4c5c10b4f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4c500098a0 tx=0x7f4c50009bb0 comp rx=0 tx=0).stop 2024-05-08T05:37:33.675 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:32.377+0000 7f4c64600700 1 -- 172.21.15.82:0/3991816113 shutdown_connections 2024-05-08T05:37:33.675 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:32.377+0000 7f4c64600700 1 --2- 172.21.15.82:0/3991816113 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c5c10b0d0 0x7f4c5c10b4f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:33.675 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:32.377+0000 7f4c64600700 1 -- 172.21.15.82:0/3991816113 >> 172.21.15.82:0/3991816113 conn(0x7f4c5c07e3e0 msgr2=0x7f4c5c07e810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:37:33.675 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:32.377+0000 7f4c64600700 1 -- 172.21.15.82:0/3991816113 shutdown_connections 2024-05-08T05:37:33.675 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:32.377+0000 7f4c64600700 1 -- 172.21.15.82:0/3991816113 wait complete. 2024-05-08T05:37:33.675 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:32.378+0000 7f4c64600700 1 Processor -- start 2024-05-08T05:37:33.675 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:32.378+0000 7f4c64600700 1 -- start start 2024-05-08T05:37:33.675 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:32.378+0000 7f4c64600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c5c10b0d0 0x7f4c5c19ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:33.676 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:32.378+0000 7f4c64600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4c5c10f5d0 con 0x7f4c5c10b0d0 2024-05-08T05:37:33.676 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:32.378+0000 7f4c61c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c5c10b0d0 0x7f4c5c19ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:33.676 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:32.379+0000 7f4c61c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c5c10b0d0 0x7f4c5c19ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35602/0 (socket says 172.21.15.82:35602) 2024-05-08T05:37:33.676 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:32.379+0000 7f4c61c00700 1 -- 172.21.15.82:0/347565053 learned_addr learned my addr 172.21.15.82:0/347565053 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:37:33.676 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:32.379+0000 7f4c61c00700 1 -- 172.21.15.82:0/347565053 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c5c19f460 con 0x7f4c5c10b0d0 2024-05-08T05:37:33.676 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:32.379+0000 7f4c61c00700 1 --2- 172.21.15.82:0/347565053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c5c10b0d0 0x7f4c5c19ef20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4c50000c00 tx=0x7f4c50011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:33.680 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:32.379+0000 7f4c5a000700 1 -- 172.21.15.82:0/347565053 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c50003aa0 con 0x7f4c5c10b0d0 2024-05-08T05:37:33.680 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:32.380+0000 7f4c5a000700 1 -- 172.21.15.82:0/347565053 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c5001b8f0 con 0x7f4c5c10b0d0 2024-05-08T05:37:33.680 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:32.380+0000 7f4c5a000700 1 -- 172.21.15.82:0/347565053 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c50023890 con 0x7f4c5c10b0d0 2024-05-08T05:37:33.680 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:32.380+0000 7f4c64600700 1 -- 172.21.15.82:0/347565053 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c5c19f6f0 con 0x7f4c5c10b0d0 2024-05-08T05:37:33.681 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:32.380+0000 7f4c64600700 1 -- 172.21.15.82:0/347565053 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c5c1a23e0 con 0x7f4c5c10b0d0 2024-05-08T05:37:33.681 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:32.381+0000 7f4c5a000700 1 -- 172.21.15.82:0/347565053 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f4c5001b440 con 0x7f4c5c10b0d0 2024-05-08T05:37:33.681 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:32.381+0000 7f4c64600700 1 -- 172.21.15.82:0/347565053 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c5c06a5c0 con 0x7f4c5c10b0d0 2024-05-08T05:37:33.681 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:32.382+0000 7f4c5a000700 1 --2- 172.21.15.82:0/347565053 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f4c4403e4c0 0x7f4c44040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:33.681 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:32.382+0000 7f4c5a000700 1 -- 172.21.15.82:0/347565053 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f4c50053de0 con 0x7f4c5c10b0d0 2024-05-08T05:37:33.681 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:32.382+0000 7f4c61200700 1 --2- 172.21.15.82:0/347565053 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f4c4403e4c0 0x7f4c44040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:33.681 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:32.383+0000 7f4c61200700 1 --2- 172.21.15.82:0/347565053 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f4c4403e4c0 0x7f4c44040980 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4c48006fd0 tx=0x7f4c48006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:33.681 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:32.387+0000 7f4c5a000700 1 -- 172.21.15.82:0/347565053 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4c5001f030 con 0x7f4c5c10b0d0 2024-05-08T05:37:33.681 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:32.652+0000 7f4c64600700 1 -- 172.21.15.82:0/347565053 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f4c5c1a2a40 con 0x7f4c5c10b0d0 2024-05-08T05:37:33.681 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:32.657+0000 7f4c5a000700 1 -- 172.21.15.82:0/347565053 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f4c5001bda0 con 0x7f4c5c10b0d0 2024-05-08T05:37:33.681 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:32.661+0000 7f4c64600700 1 -- 172.21.15.82:0/347565053 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f4c4403e4c0 msgr2=0x7f4c44040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:33.681 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:32.661+0000 7f4c64600700 1 --2- 172.21.15.82:0/347565053 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f4c4403e4c0 0x7f4c44040980 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4c48006fd0 tx=0x7f4c48006e40 comp rx=0 tx=0).stop 2024-05-08T05:37:33.681 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:32.661+0000 7f4c64600700 1 -- 172.21.15.82:0/347565053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c5c10b0d0 msgr2=0x7f4c5c19ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:33.682 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:32.661+0000 7f4c64600700 1 --2- 172.21.15.82:0/347565053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c5c10b0d0 0x7f4c5c19ef20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4c50000c00 tx=0x7f4c50011aa0 comp rx=0 tx=0).stop 2024-05-08T05:37:33.682 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:32.661+0000 7f4c64600700 1 -- 172.21.15.82:0/347565053 shutdown_connections 2024-05-08T05:37:33.682 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:32.661+0000 7f4c64600700 1 --2- 172.21.15.82:0/347565053 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f4c4403e4c0 0x7f4c44040980 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:33.682 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:32.661+0000 7f4c64600700 1 --2- 172.21.15.82:0/347565053 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c5c10b0d0 0x7f4c5c19ef20 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:33.682 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:32.661+0000 7f4c64600700 1 -- 172.21.15.82:0/347565053 >> 172.21.15.82:0/347565053 conn(0x7f4c5c07e3e0 msgr2=0x7f4c5c108cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:37:33.682 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:32.662+0000 7f4c64600700 1 -- 172.21.15.82:0/347565053 shutdown_connections 2024-05-08T05:37:33.682 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:32.662+0000 7f4c64600700 1 -- 172.21.15.82:0/347565053 wait complete. 2024-05-08T05:37:33.682 INFO:teuthology.orchestra.run.smithi082.stdout:Enabling the dashboard module... 2024-05-08T05:37:33.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:33 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/347565053' entity='client.admin' 2024-05-08T05:37:33.958 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:33 smithi082 ceph-mon[30098]: from='mgr.14120 172.21.15.82:0/3868606737' entity='mgr.x' 2024-05-08T05:37:34.861 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:34 smithi082 ceph-mon[30098]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:37:34.861 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:34 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/1284786168' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-05-08T05:37:34.861 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:34 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: ignoring --setuser ceph since I am not root 2024-05-08T05:37:34.861 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:34 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: ignoring --setgroup ceph since I am not root 2024-05-08T05:37:35.114 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:34 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:37:34.980+0000 7f6ece8be200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T05:37:35.370 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:35 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:37:35.238+0000 7f6ece8be200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T05:37:35.371 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:35 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:37:35.370+0000 7f6ece8be200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T05:37:35.480 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:34.253+0000 7f1a7d200700 1 Processor -- start 2024-05-08T05:37:35.481 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:34.254+0000 7f1a7d200700 1 -- start start 2024-05-08T05:37:35.481 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:34.254+0000 7f1a7d200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a78109670 0x7f1a7810ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:35.481 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:34.254+0000 7f1a7d200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1a7807cec0 con 0x7f1a78109670 2024-05-08T05:37:35.481 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:34.254+0000 7f1a77400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a78109670 0x7f1a7810ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:35.481 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:34.255+0000 7f1a77400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a78109670 0x7f1a7810ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34994/0 (socket says 172.21.15.82:34994) 2024-05-08T05:37:35.481 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:34.255+0000 7f1a77400700 1 -- 172.21.15.82:0/1530365628 learned_addr learned my addr 172.21.15.82:0/1530365628 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:37:35.481 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:34.255+0000 7f1a77400700 1 -- 172.21.15.82:0/1530365628 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a7810bfa0 con 0x7f1a78109670 2024-05-08T05:37:35.481 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:34.255+0000 7f1a77400700 1 --2- 172.21.15.82:0/1530365628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a78109670 0x7f1a7810ba60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1a680098a0 tx=0x7f1a68009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eb5cacd47551f3d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:35.481 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:34.255+0000 7f1a76000700 1 -- 172.21.15.82:0/1530365628 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a68004160 con 0x7f1a78109670 2024-05-08T05:37:35.482 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:34.256+0000 7f1a76000700 1 -- 172.21.15.82:0/1530365628 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a68004300 con 0x7f1a78109670 2024-05-08T05:37:35.482 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:34.256+0000 7f1a76000700 1 -- 172.21.15.82:0/1530365628 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a68011a20 con 0x7f1a78109670 2024-05-08T05:37:35.482 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:34.256+0000 7f1a7d200700 1 -- 172.21.15.82:0/1530365628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a78109670 msgr2=0x7f1a7810ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:35.482 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:34.256+0000 7f1a7d200700 1 --2- 172.21.15.82:0/1530365628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a78109670 0x7f1a7810ba60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1a680098a0 tx=0x7f1a68009bb0 comp rx=0 tx=0).stop 2024-05-08T05:37:35.482 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:34.256+0000 7f1a7d200700 1 -- 172.21.15.82:0/1530365628 shutdown_connections 2024-05-08T05:37:35.482 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:34.256+0000 7f1a7d200700 1 --2- 172.21.15.82:0/1530365628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a78109670 0x7f1a7810ba60 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:35.482 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:34.256+0000 7f1a7d200700 1 -- 172.21.15.82:0/1530365628 >> 172.21.15.82:0/1530365628 conn(0x7f1a781030c0 msgr2=0x7f1a781054e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:37:35.483 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:34.257+0000 7f1a7d200700 1 -- 172.21.15.82:0/1530365628 shutdown_connections 2024-05-08T05:37:35.483 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:34.257+0000 7f1a7d200700 1 -- 172.21.15.82:0/1530365628 wait complete. 2024-05-08T05:37:35.483 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:34.257+0000 7f1a7d200700 1 Processor -- start 2024-05-08T05:37:35.483 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:34.258+0000 7f1a7d200700 1 -- start start 2024-05-08T05:37:35.483 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:34.258+0000 7f1a7d200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a78109670 0x7f1a7819ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:35.483 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:34.258+0000 7f1a7d200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1a7810cfb0 con 0x7f1a78109670 2024-05-08T05:37:35.483 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:34.258+0000 7f1a77400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a78109670 0x7f1a7819ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:35.483 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:34.258+0000 7f1a77400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a78109670 0x7f1a7819ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35006/0 (socket says 172.21.15.82:35006) 2024-05-08T05:37:35.483 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:34.258+0000 7f1a77400700 1 -- 172.21.15.82:0/1284786168 learned_addr learned my addr 172.21.15.82:0/1284786168 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:37:35.483 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:34.259+0000 7f1a77400700 1 -- 172.21.15.82:0/1284786168 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a7819f270 con 0x7f1a78109670 2024-05-08T05:37:35.483 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:34.259+0000 7f1a77400700 1 --2- 172.21.15.82:0/1284786168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a78109670 0x7f1a7819ed30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1a68004660 tx=0x7f1a68011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:35.484 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:34.259+0000 7f1a6fe00700 1 -- 172.21.15.82:0/1284786168 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a68003aa0 con 0x7f1a78109670 2024-05-08T05:37:35.484 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:34.259+0000 7f1a6fe00700 1 -- 172.21.15.82:0/1284786168 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1a6801b8f0 con 0x7f1a78109670 2024-05-08T05:37:35.484 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:34.259+0000 7f1a7d200700 1 -- 172.21.15.82:0/1284786168 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a7819f500 con 0x7f1a78109670 2024-05-08T05:37:35.484 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:34.259+0000 7f1a6fe00700 1 -- 172.21.15.82:0/1284786168 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1a68023900 con 0x7f1a78109670 2024-05-08T05:37:35.484 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:34.259+0000 7f1a7d200700 1 -- 172.21.15.82:0/1284786168 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a781a21f0 con 0x7f1a78109670 2024-05-08T05:37:35.484 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:34.260+0000 7f1a7d200700 1 -- 172.21.15.82:0/1284786168 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a7806a5c0 con 0x7f1a78109670 2024-05-08T05:37:35.484 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:34.261+0000 7f1a6fe00700 1 -- 172.21.15.82:0/1284786168 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f1a6801baa0 con 0x7f1a78109670 2024-05-08T05:37:35.484 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:34.261+0000 7f1a6fe00700 1 --2- 172.21.15.82:0/1284786168 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f1a5c03e4c0 0x7f1a5c040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:35.484 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:34.261+0000 7f1a6fe00700 1 -- 172.21.15.82:0/1284786168 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f1a68053d40 con 0x7f1a78109670 2024-05-08T05:37:35.484 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:34.261+0000 7f1a76a00700 1 --2- 172.21.15.82:0/1284786168 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f1a5c03e4c0 0x7f1a5c040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:35.484 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:34.262+0000 7f1a76a00700 1 --2- 172.21.15.82:0/1284786168 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f1a5c03e4c0 0x7f1a5c040980 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1a64006fd0 tx=0x7f1a64006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:35.484 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:34.267+0000 7f1a6fe00700 1 -- 172.21.15.82:0/1284786168 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1a6801f030 con 0x7f1a78109670 2024-05-08T05:37:35.484 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:34.558+0000 7f1a7d200700 1 -- 172.21.15.82:0/1284786168 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f1a781a27e0 con 0x7f1a78109670 2024-05-08T05:37:35.484 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:34.673+0000 7f1a6fe00700 1 -- 172.21.15.82:0/1284786168 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f1a680202b0 con 0x7f1a78109670 2024-05-08T05:37:35.485 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:34.677+0000 7f1a6fe00700 1 -- 172.21.15.82:0/1284786168 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mgrmap(e 9) ==== 50235+0+0 (secure 0 0 0) 0x7f1a68023b20 con 0x7f1a78109670 2024-05-08T05:37:35.485 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:34.678+0000 7f1a7d200700 1 -- 172.21.15.82:0/1284786168 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f1a5c03e4c0 msgr2=0x7f1a5c040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:35.485 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:34.678+0000 7f1a7d200700 1 --2- 172.21.15.82:0/1284786168 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f1a5c03e4c0 0x7f1a5c040980 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f1a64006fd0 tx=0x7f1a64006e40 comp rx=0 tx=0).stop 2024-05-08T05:37:35.485 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:34.678+0000 7f1a7d200700 1 -- 172.21.15.82:0/1284786168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a78109670 msgr2=0x7f1a7819ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:35.485 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:34.678+0000 7f1a7d200700 1 --2- 172.21.15.82:0/1284786168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a78109670 0x7f1a7819ed30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1a68004660 tx=0x7f1a68011aa0 comp rx=0 tx=0).stop 2024-05-08T05:37:35.485 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:34.678+0000 7f1a7d200700 1 -- 172.21.15.82:0/1284786168 shutdown_connections 2024-05-08T05:37:35.485 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:34.678+0000 7f1a7d200700 1 --2- 172.21.15.82:0/1284786168 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f1a5c03e4c0 0x7f1a5c040980 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:35.485 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:34.678+0000 7f1a7d200700 1 --2- 172.21.15.82:0/1284786168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1a78109670 0x7f1a7819ed30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:35.485 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:34.678+0000 7f1a7d200700 1 -- 172.21.15.82:0/1284786168 >> 172.21.15.82:0/1284786168 conn(0x7f1a781030c0 msgr2=0x7f1a78103b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:37:35.485 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:34.679+0000 7f1a7d200700 1 -- 172.21.15.82:0/1284786168 shutdown_connections 2024-05-08T05:37:35.485 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:34.679+0000 7f1a7d200700 1 -- 172.21.15.82:0/1284786168 wait complete. 2024-05-08T05:37:35.889 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:35 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:37:35.780+0000 7f6ece8be200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T05:37:35.889 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:35 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/1284786168' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-05-08T05:37:35.889 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:35 smithi082 ceph-mon[30098]: mgrmap e9: x(active, since 23s) 2024-05-08T05:37:36.220 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:35 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:37:35.902+0000 7f6ece8be200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T05:37:36.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:36 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/3540897700' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-05-08T05:37:36.998 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-05-08T05:37:36.999 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-05-08T05:37:36.999 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-08T05:37:36.999 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-05-08T05:37:36.999 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-05-08T05:37:37.000 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-05-08T05:37:37.000 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:36.045+0000 7f71cfe00700 1 Processor -- start 2024-05-08T05:37:37.000 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:36.045+0000 7f71cfe00700 1 -- start start 2024-05-08T05:37:37.000 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:36.045+0000 7f71cfe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71d0109670 0x7f71d010ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:37.000 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:36.045+0000 7f71cfe00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f71d007cec0 con 0x7f71d0109670 2024-05-08T05:37:37.000 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:36.046+0000 7f71cea00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71d0109670 0x7f71d010ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:37.000 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:36.046+0000 7f71cea00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71d0109670 0x7f71d010ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35034/0 (socket says 172.21.15.82:35034) 2024-05-08T05:37:37.001 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:36.046+0000 7f71cea00700 1 -- 172.21.15.82:0/2739803333 learned_addr learned my addr 172.21.15.82:0/2739803333 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:37:37.001 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:36.047+0000 7f71cea00700 1 -- 172.21.15.82:0/2739803333 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71d010bfa0 con 0x7f71d0109670 2024-05-08T05:37:37.005 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:36.047+0000 7f71cea00700 1 --2- 172.21.15.82:0/2739803333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71d0109670 0x7f71d010ba60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f71c00098a0 tx=0x7f71c0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=157bf7d1a5a62ebf server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:37.005 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:36.047+0000 7f71cd600700 1 -- 172.21.15.82:0/2739803333 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71c0004160 con 0x7f71d0109670 2024-05-08T05:37:37.005 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:36.047+0000 7f71cd600700 1 -- 172.21.15.82:0/2739803333 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71c0004300 con 0x7f71d0109670 2024-05-08T05:37:37.005 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:36.047+0000 7f71cd600700 1 -- 172.21.15.82:0/2739803333 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71c0011a20 con 0x7f71d0109670 2024-05-08T05:37:37.005 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:36.048+0000 7f71cfe00700 1 -- 172.21.15.82:0/2739803333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71d0109670 msgr2=0x7f71d010ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:37.005 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:36.048+0000 7f71cfe00700 1 --2- 172.21.15.82:0/2739803333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71d0109670 0x7f71d010ba60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f71c00098a0 tx=0x7f71c0009bb0 comp rx=0 tx=0).stop 2024-05-08T05:37:37.006 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:36.048+0000 7f71cfe00700 1 -- 172.21.15.82:0/2739803333 shutdown_connections 2024-05-08T05:37:37.006 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:36.048+0000 7f71cfe00700 1 --2- 172.21.15.82:0/2739803333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71d0109670 0x7f71d010ba60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:37.006 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:36.048+0000 7f71cfe00700 1 -- 172.21.15.82:0/2739803333 >> 172.21.15.82:0/2739803333 conn(0x7f71d01030c0 msgr2=0x7f71d01054e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:37:37.006 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:36.048+0000 7f71cfe00700 1 -- 172.21.15.82:0/2739803333 shutdown_connections 2024-05-08T05:37:37.006 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:36.048+0000 7f71cfe00700 1 -- 172.21.15.82:0/2739803333 wait complete. 2024-05-08T05:37:37.006 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:36.049+0000 7f71cfe00700 1 Processor -- start 2024-05-08T05:37:37.006 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:36.049+0000 7f71cfe00700 1 -- start start 2024-05-08T05:37:37.006 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:36.050+0000 7f71cfe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71d0109670 0x7f71d019ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:37.006 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:36.050+0000 7f71cfe00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f71d010cfb0 con 0x7f71d0109670 2024-05-08T05:37:37.006 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:36.050+0000 7f71cea00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71d0109670 0x7f71d019ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:37.006 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:36.050+0000 7f71cea00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71d0109670 0x7f71d019ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35044/0 (socket says 172.21.15.82:35044) 2024-05-08T05:37:37.006 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:36.050+0000 7f71cea00700 1 -- 172.21.15.82:0/3540897700 learned_addr learned my addr 172.21.15.82:0/3540897700 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:37:37.006 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:36.050+0000 7f71cea00700 1 -- 172.21.15.82:0/3540897700 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71d019f270 con 0x7f71d0109670 2024-05-08T05:37:37.007 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:36.051+0000 7f71cea00700 1 --2- 172.21.15.82:0/3540897700 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71d0109670 0x7f71d019ed30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f71c0004660 tx=0x7f71c0011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:37.007 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:36.051+0000 7f71c7400700 1 -- 172.21.15.82:0/3540897700 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71c0003aa0 con 0x7f71d0109670 2024-05-08T05:37:37.007 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:36.051+0000 7f71c7400700 1 -- 172.21.15.82:0/3540897700 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f71c001b8f0 con 0x7f71d0109670 2024-05-08T05:37:37.007 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:36.051+0000 7f71cfe00700 1 -- 172.21.15.82:0/3540897700 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71d019f500 con 0x7f71d0109670 2024-05-08T05:37:37.007 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:36.051+0000 7f71c7400700 1 -- 172.21.15.82:0/3540897700 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71c0023900 con 0x7f71d0109670 2024-05-08T05:37:37.007 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:36.051+0000 7f71cfe00700 1 -- 172.21.15.82:0/3540897700 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71d01a21f0 con 0x7f71d0109670 2024-05-08T05:37:37.007 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:36.052+0000 7f71c7400700 1 -- 172.21.15.82:0/3540897700 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 9) ==== 50235+0+0 (secure 0 0 0) 0x7f71c0023b70 con 0x7f71d0109670 2024-05-08T05:37:37.007 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:36.053+0000 7f71cfe00700 1 -- 172.21.15.82:0/3540897700 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71d006a5c0 con 0x7f71d0109670 2024-05-08T05:37:37.007 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:36.053+0000 7f71c7400700 1 --2- 172.21.15.82:0/3540897700 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f71b403e520 0x7f71b40409e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:37.007 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:36.053+0000 7f71c7400700 1 -- 172.21.15.82:0/3540897700 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f71c0053ea0 con 0x7f71d0109670 2024-05-08T05:37:37.007 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:36.053+0000 7f71ce000700 1 -- 172.21.15.82:0/3540897700 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f71b403e520 msgr2=0x7f71b40409e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/765895649 2024-05-08T05:37:37.007 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:36.053+0000 7f71ce000700 1 --2- 172.21.15.82:0/3540897700 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f71b403e520 0x7f71b40409e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T05:37:37.007 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:36.059+0000 7f71c7400700 1 -- 172.21.15.82:0/3540897700 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f71c001f030 con 0x7f71d0109670 2024-05-08T05:37:37.007 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:36.254+0000 7f71ce000700 1 -- 172.21.15.82:0/3540897700 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f71b403e520 msgr2=0x7f71b40409e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/765895649 2024-05-08T05:37:37.008 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:36.254+0000 7f71ce000700 1 --2- 172.21.15.82:0/3540897700 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f71b403e520 0x7f71b40409e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T05:37:37.008 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:36.354+0000 7f71cfe00700 1 -- 172.21.15.82:0/3540897700 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f71d01a27e0 con 0x7f71d0109670 2024-05-08T05:37:37.008 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:36.355+0000 7f71c7400700 1 -- 172.21.15.82:0/3540897700 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f71c001baa0 con 0x7f71d0109670 2024-05-08T05:37:37.008 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:36.357+0000 7f71cfe00700 1 -- 172.21.15.82:0/3540897700 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f71b403e520 msgr2=0x7f71b40409e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T05:37:37.008 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:36.357+0000 7f71cfe00700 1 --2- 172.21.15.82:0/3540897700 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f71b403e520 0x7f71b40409e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:37.008 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:36.357+0000 7f71cfe00700 1 -- 172.21.15.82:0/3540897700 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71d0109670 msgr2=0x7f71d019ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:37.008 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:36.357+0000 7f71cfe00700 1 --2- 172.21.15.82:0/3540897700 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71d0109670 0x7f71d019ed30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f71c0004660 tx=0x7f71c0011aa0 comp rx=0 tx=0).stop 2024-05-08T05:37:37.008 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:36.357+0000 7f71cfe00700 1 -- 172.21.15.82:0/3540897700 shutdown_connections 2024-05-08T05:37:37.009 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:36.357+0000 7f71cfe00700 1 --2- 172.21.15.82:0/3540897700 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f71b403e520 0x7f71b40409e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:37.009 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:36.357+0000 7f71cfe00700 1 --2- 172.21.15.82:0/3540897700 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f71d0109670 0x7f71d019ed30 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:37.009 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:36.357+0000 7f71cfe00700 1 -- 172.21.15.82:0/3540897700 >> 172.21.15.82:0/3540897700 conn(0x7f71d01030c0 msgr2=0x7f71d0103b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:37:37.009 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:36.358+0000 7f71cfe00700 1 -- 172.21.15.82:0/3540897700 shutdown_connections 2024-05-08T05:37:37.009 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:36.358+0000 7f71cfe00700 1 -- 172.21.15.82:0/3540897700 wait complete. 2024-05-08T05:37:37.009 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for the mgr to restart... 2024-05-08T05:37:37.009 INFO:teuthology.orchestra.run.smithi082.stdout:Waiting for mgr epoch 9... 2024-05-08T05:37:37.576 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:37 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:37:37.494+0000 7f6ece8be200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T05:37:37.967 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:37 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:37:37.733+0000 7f6ece8be200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T05:37:37.968 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:37 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:37:37.967+0000 7f6ece8be200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T05:37:38.716 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:38 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:37:38.343+0000 7f6ece8be200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T05:37:38.716 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:38 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:37:38.465+0000 7f6ece8be200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T05:37:38.966 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:38 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:37:38.714+0000 7f6ece8be200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T05:37:38.966 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:38 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:37:38.964+0000 7f6ece8be200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T05:37:40.038 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:39 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:37:39.750+0000 7f6ece8be200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-08T05:37:40.038 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:40 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:37:40.036+0000 7f6ece8be200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-08T05:37:40.971 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:40 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:37:40.582+0000 7f6ece8be200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T05:37:40.971 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:40 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:37:40.710+0000 7f6ece8be200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T05:37:41.470 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:41 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:37:41.173+0000 7f6ece8be200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-08T05:37:41.971 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:41 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:37:41.624+0000 7f6ece8be200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T05:37:41.971 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:41 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:37:41.751+0000 7f6ece8be200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T05:37:42.380 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:42 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:37:42.073+0000 7f6ece8be200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T05:37:42.380 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:42 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:37:42.252+0000 7f6ece8be200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T05:37:42.381 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:42 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:37:42.379+0000 7f6ece8be200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T05:37:43.220 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:42 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:37:42.776+0000 7f6ece8be200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T05:37:43.220 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:42 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:37:42.900+0000 7f6ece8be200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T05:37:43.948 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:43 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:37:43.657+0000 7f6ece8be200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T05:37:43.948 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:37:43 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:37:43.946+0000 7f6ece8be200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T05:37:44.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:44 smithi082 ceph-mon[30098]: Active manager daemon x restarted 2024-05-08T05:37:44.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:44 smithi082 ceph-mon[30098]: Activating manager daemon x 2024-05-08T05:37:44.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:44 smithi082 ceph-mon[30098]: osdmap e3: 0 total, 0 up, 0 in 2024-05-08T05:37:44.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:44 smithi082 ceph-mon[30098]: mgrmap e10: x(active, starting, since 0.00765848s) 2024-05-08T05:37:44.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:44 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T05:37:44.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:44 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-08T05:37:44.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:44 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-08T05:37:44.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:44 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-08T05:37:44.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:44 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-08T05:37:44.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:44 smithi082 ceph-mon[30098]: Manager daemon x is now available 2024-05-08T05:37:45.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:45 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:37:45.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:45 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-08T05:37:45.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:45 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-08T05:37:45.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:45 smithi082 ceph-mon[30098]: [08/May/2024:05:37:44] ENGINE Bus STARTING 2024-05-08T05:37:45.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:45 smithi082 ceph-mon[30098]: [08/May/2024:05:37:44] ENGINE Serving on http://172.21.15.82:8765 2024-05-08T05:37:45.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:45 smithi082 ceph-mon[30098]: [08/May/2024:05:37:44] ENGINE Serving on https://172.21.15.82:7150 2024-05-08T05:37:45.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:45 smithi082 ceph-mon[30098]: [08/May/2024:05:37:44] ENGINE Bus STARTED 2024-05-08T05:37:45.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:45 smithi082 ceph-mon[30098]: mgrmap e11: x(active, since 1.00948s) 2024-05-08T05:37:45.938 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout { 2024-05-08T05:37:45.938 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-05-08T05:37:45.938 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout "initialized": true 2024-05-08T05:37:45.938 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout } 2024-05-08T05:37:45.938 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:37.576+0000 7f025e000700 1 Processor -- start 2024-05-08T05:37:45.938 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:37.576+0000 7f025e000700 1 -- start start 2024-05-08T05:37:45.938 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:37.576+0000 7f025e000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f025807eed0 0x7f025807d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:45.938 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:37.576+0000 7f025e000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f025807d900 con 0x7f025807eed0 2024-05-08T05:37:45.938 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:37.577+0000 7f0257400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f025807eed0 0x7f025807d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:45.938 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:37.577+0000 7f0257400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f025807eed0 0x7f025807d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35048/0 (socket says 172.21.15.82:35048) 2024-05-08T05:37:45.938 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:37.577+0000 7f0257400700 1 -- 172.21.15.82:0/3621221290 learned_addr learned my addr 172.21.15.82:0/3621221290 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:37:45.939 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:37.577+0000 7f0257400700 1 -- 172.21.15.82:0/3621221290 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f025807da80 con 0x7f025807eed0 2024-05-08T05:37:45.939 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:37.578+0000 7f0257400700 1 --2- 172.21.15.82:0/3621221290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f025807eed0 0x7f025807d330 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f02480098a0 tx=0x7f0248009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f44966a82ce58c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:45.939 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:37.578+0000 7f0256000700 1 -- 172.21.15.82:0/3621221290 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0248004160 con 0x7f025807eed0 2024-05-08T05:37:45.939 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:37.578+0000 7f0256000700 1 -- 172.21.15.82:0/3621221290 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0248004300 con 0x7f025807eed0 2024-05-08T05:37:45.939 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:37.578+0000 7f0256000700 1 -- 172.21.15.82:0/3621221290 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0248011a20 con 0x7f025807eed0 2024-05-08T05:37:45.939 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:37.579+0000 7f025e000700 1 -- 172.21.15.82:0/3621221290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f025807eed0 msgr2=0x7f025807d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:45.939 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:37.579+0000 7f025e000700 1 --2- 172.21.15.82:0/3621221290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f025807eed0 0x7f025807d330 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f02480098a0 tx=0x7f0248009bb0 comp rx=0 tx=0).stop 2024-05-08T05:37:45.939 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:37.579+0000 7f025e000700 1 -- 172.21.15.82:0/3621221290 shutdown_connections 2024-05-08T05:37:45.939 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:37.579+0000 7f025e000700 1 --2- 172.21.15.82:0/3621221290 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f025807eed0 0x7f025807d330 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:45.939 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:37.579+0000 7f025e000700 1 -- 172.21.15.82:0/3621221290 >> 172.21.15.82:0/3621221290 conn(0x7f02581043e0 msgr2=0x7f0258106800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:37:45.939 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:37.579+0000 7f025e000700 1 -- 172.21.15.82:0/3621221290 shutdown_connections 2024-05-08T05:37:45.939 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:37.579+0000 7f025e000700 1 -- 172.21.15.82:0/3621221290 wait complete. 2024-05-08T05:37:45.939 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:37.580+0000 7f025e000700 1 Processor -- start 2024-05-08T05:37:45.939 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:37.580+0000 7f025e000700 1 -- start start 2024-05-08T05:37:45.940 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:37.581+0000 7f025e000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f025807eed0 0x7f025819ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:45.940 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:37.581+0000 7f025e000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f025810f400 con 0x7f025807eed0 2024-05-08T05:37:45.940 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:37.581+0000 7f0257400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f025807eed0 0x7f025819ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:45.940 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:37.581+0000 7f0257400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f025807eed0 0x7f025819ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35054/0 (socket says 172.21.15.82:35054) 2024-05-08T05:37:45.940 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:37.581+0000 7f0257400700 1 -- 172.21.15.82:0/2750339435 learned_addr learned my addr 172.21.15.82:0/2750339435 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:37:45.940 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:37.581+0000 7f0257400700 1 -- 172.21.15.82:0/2750339435 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f025819f460 con 0x7f025807eed0 2024-05-08T05:37:45.940 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:37.581+0000 7f0257400700 1 --2- 172.21.15.82:0/2750339435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f025807eed0 0x7f025819ef20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0248000c00 tx=0x7f0248011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:45.940 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:37.582+0000 7f024fe00700 1 -- 172.21.15.82:0/2750339435 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0248003aa0 con 0x7f025807eed0 2024-05-08T05:37:45.940 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:37.582+0000 7f024fe00700 1 -- 172.21.15.82:0/2750339435 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f024801b8f0 con 0x7f025807eed0 2024-05-08T05:37:45.940 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:37.582+0000 7f025e000700 1 -- 172.21.15.82:0/2750339435 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f025819f6f0 con 0x7f025807eed0 2024-05-08T05:37:45.940 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:37.582+0000 7f024fe00700 1 -- 172.21.15.82:0/2750339435 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0248023890 con 0x7f025807eed0 2024-05-08T05:37:45.940 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:37.582+0000 7f025e000700 1 -- 172.21.15.82:0/2750339435 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02581a23e0 con 0x7f025807eed0 2024-05-08T05:37:45.940 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:37.583+0000 7f024fe00700 1 -- 172.21.15.82:0/2750339435 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 9) ==== 50235+0+0 (secure 0 0 0) 0x7f024802c3f0 con 0x7f025807eed0 2024-05-08T05:37:45.940 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:37.584+0000 7f024fe00700 1 --2- 172.21.15.82:0/2750339435 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f023c03e520 0x7f023c0409e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:45.940 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:37.584+0000 7f024fe00700 1 -- 172.21.15.82:0/2750339435 --> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f023c0410f0 con 0x7f023c03e520 2024-05-08T05:37:45.941 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:37.584+0000 7f024fe00700 1 -- 172.21.15.82:0/2750339435 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f0248053f30 con 0x7f025807eed0 2024-05-08T05:37:45.941 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:37.584+0000 7f0256a00700 1 -- 172.21.15.82:0/2750339435 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f023c03e520 msgr2=0x7f023c0409e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/765895649 2024-05-08T05:37:45.941 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:37.584+0000 7f0256a00700 1 --2- 172.21.15.82:0/2750339435 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f023c03e520 0x7f023c0409e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T05:37:45.941 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:37.785+0000 7f0256a00700 1 -- 172.21.15.82:0/2750339435 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f023c03e520 msgr2=0x7f023c0409e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/765895649 2024-05-08T05:37:45.941 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:37.785+0000 7f0256a00700 1 --2- 172.21.15.82:0/2750339435 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f023c03e520 0x7f023c0409e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-08T05:37:45.941 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:38.186+0000 7f0256a00700 1 -- 172.21.15.82:0/2750339435 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f023c03e520 msgr2=0x7f023c0409e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/765895649 2024-05-08T05:37:45.941 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:38.186+0000 7f0256a00700 1 --2- 172.21.15.82:0/2750339435 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f023c03e520 0x7f023c0409e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-08T05:37:45.941 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:38.986+0000 7f0256a00700 1 -- 172.21.15.82:0/2750339435 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f023c03e520 msgr2=0x7f023c0409e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/765895649 2024-05-08T05:37:45.941 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:38.986+0000 7f0256a00700 1 --2- 172.21.15.82:0/2750339435 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f023c03e520 0x7f023c0409e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-08T05:37:45.941 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:40.588+0000 7f0256a00700 1 -- 172.21.15.82:0/2750339435 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f023c03e520 msgr2=0x7f023c0409e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/765895649 2024-05-08T05:37:45.941 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:40.588+0000 7f0256a00700 1 --2- 172.21.15.82:0/2750339435 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f023c03e520 0x7f023c0409e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-08T05:37:45.941 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:43.792+0000 7f0256a00700 1 -- 172.21.15.82:0/2750339435 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f023c03e520 msgr2=0x7f023c0409e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.82:6800/765895649 2024-05-08T05:37:45.941 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:43.792+0000 7f0256a00700 1 --2- 172.21.15.82:0/2750339435 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f023c03e520 0x7f023c0409e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-05-08T05:37:45.941 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:43.957+0000 7f024fe00700 1 -- 172.21.15.82:0/2750339435 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mgrmap(e 10) ==== 50002+0+0 (secure 0 0 0) 0x7f0248010380 con 0x7f025807eed0 2024-05-08T05:37:45.942 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:43.957+0000 7f024fe00700 1 -- 172.21.15.82:0/2750339435 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f023c03e520 msgr2=0x7f023c0409e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T05:37:45.942 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:43.957+0000 7f024fe00700 1 --2- 172.21.15.82:0/2750339435 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f023c03e520 0x7f023c0409e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:45.942 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:44.957+0000 7f024fe00700 1 -- 172.21.15.82:0/2750339435 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 11) ==== 50129+0+0 (secure 0 0 0) 0x7f024801b440 con 0x7f025807eed0 2024-05-08T05:37:45.942 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:44.957+0000 7f024fe00700 1 --2- 172.21.15.82:0/2750339435 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f023c041fa0 0x7f023c044390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:45.942 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:44.957+0000 7f024fe00700 1 -- 172.21.15.82:0/2750339435 --> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f023c0410f0 con 0x7f023c041fa0 2024-05-08T05:37:45.942 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:44.957+0000 7f0256a00700 1 --2- 172.21.15.82:0/2750339435 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f023c041fa0 0x7f023c044390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:45.942 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:44.958+0000 7f0256a00700 1 --2- 172.21.15.82:0/2750339435 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f023c041fa0 0x7f023c044390 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f0244003a10 tx=0x7f0244009270 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:45.942 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:44.959+0000 7f024fe00700 1 -- 172.21.15.82:0/2750339435 <== mgr.14152 v2:172.21.15.82:6800/4089180091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f023c0410f0 con 0x7f023c041fa0 2024-05-08T05:37:45.942 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:44.974+0000 7f025e000700 1 -- 172.21.15.82:0/2750339435 --> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f025806a5c0 con 0x7f023c041fa0 2024-05-08T05:37:45.942 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:44.974+0000 7f024fe00700 1 -- 172.21.15.82:0/2750339435 <== mgr.14152 v2:172.21.15.82:6800/4089180091 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f025806a5c0 con 0x7f023c041fa0 2024-05-08T05:37:45.942 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:44.975+0000 7f025e000700 1 -- 172.21.15.82:0/2750339435 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f023c041fa0 msgr2=0x7f023c044390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:45.942 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:44.975+0000 7f025e000700 1 --2- 172.21.15.82:0/2750339435 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f023c041fa0 0x7f023c044390 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f0244003a10 tx=0x7f0244009270 comp rx=0 tx=0).stop 2024-05-08T05:37:45.942 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:44.975+0000 7f025e000700 1 -- 172.21.15.82:0/2750339435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f025807eed0 msgr2=0x7f025819ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:45.942 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:44.975+0000 7f025e000700 1 --2- 172.21.15.82:0/2750339435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f025807eed0 0x7f025819ef20 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0248000c00 tx=0x7f0248011aa0 comp rx=0 tx=0).stop 2024-05-08T05:37:45.943 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:44.975+0000 7f025e000700 1 -- 172.21.15.82:0/2750339435 shutdown_connections 2024-05-08T05:37:45.943 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:44.975+0000 7f025e000700 1 --2- 172.21.15.82:0/2750339435 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f023c041fa0 0x7f023c044390 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:45.943 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:44.975+0000 7f025e000700 1 --2- 172.21.15.82:0/2750339435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f025807eed0 0x7f025819ef20 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:45.943 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:44.975+0000 7f025e000700 1 --2- 172.21.15.82:0/2750339435 >> [v2:172.21.15.82:6800/765895649,v1:172.21.15.82:6801/765895649] conn(0x7f023c03e520 0x7f023c0409e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:45.943 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:44.975+0000 7f025e000700 1 -- 172.21.15.82:0/2750339435 >> 172.21.15.82:0/2750339435 conn(0x7f02581043e0 msgr2=0x7f0258104e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:37:45.943 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:44.975+0000 7f025e000700 1 -- 172.21.15.82:0/2750339435 shutdown_connections 2024-05-08T05:37:45.943 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:44.975+0000 7f025e000700 1 -- 172.21.15.82:0/2750339435 wait complete. 2024-05-08T05:37:45.943 INFO:teuthology.orchestra.run.smithi082.stdout:mgr epoch 9 is available 2024-05-08T05:37:45.943 INFO:teuthology.orchestra.run.smithi082.stdout:Generating a dashboard self-signed certificate... 2024-05-08T05:37:46.433 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:46 smithi082 ceph-mon[30098]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-05-08T05:37:46.433 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:46 smithi082 ceph-mon[30098]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-05-08T05:37:47.268 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:47 smithi082 ceph-mon[30098]: mgrmap e12: x(active, since 2s) 2024-05-08T05:37:47.268 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:47 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:37:47.926 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-05-08T05:37:47.926 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:46.896+0000 7f7853e00700 1 Processor -- start 2024-05-08T05:37:47.926 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:46.896+0000 7f7853e00700 1 -- start start 2024-05-08T05:37:47.926 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:46.897+0000 7f7853e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7854108c00 0x7f7854109020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:47.927 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:46.897+0000 7f7853e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f78541095f0 con 0x7f7854108c00 2024-05-08T05:37:47.927 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:46.897+0000 7f7852a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7854108c00 0x7f7854109020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:47.927 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:46.897+0000 7f7852a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7854108c00 0x7f7854109020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59326/0 (socket says 172.21.15.82:59326) 2024-05-08T05:37:47.927 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:46.897+0000 7f7852a00700 1 -- 172.21.15.82:0/1003263459 learned_addr learned my addr 172.21.15.82:0/1003263459 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:37:47.927 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:46.898+0000 7f7852a00700 1 -- 172.21.15.82:0/1003263459 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7854109db0 con 0x7f7854108c00 2024-05-08T05:37:47.927 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:46.898+0000 7f7852a00700 1 --2- 172.21.15.82:0/1003263459 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7854108c00 0x7f7854109020 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f78440098a0 tx=0x7f7844009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93324b8a49341811 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:47.927 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:46.898+0000 7f7851600700 1 -- 172.21.15.82:0/1003263459 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7844004160 con 0x7f7854108c00 2024-05-08T05:37:47.927 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:46.898+0000 7f7851600700 1 -- 172.21.15.82:0/1003263459 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7844004300 con 0x7f7854108c00 2024-05-08T05:37:47.927 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:46.898+0000 7f7851600700 1 -- 172.21.15.82:0/1003263459 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7844011a20 con 0x7f7854108c00 2024-05-08T05:37:47.927 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:46.899+0000 7f7853e00700 1 -- 172.21.15.82:0/1003263459 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7854108c00 msgr2=0x7f7854109020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:47.927 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:46.899+0000 7f7853e00700 1 --2- 172.21.15.82:0/1003263459 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7854108c00 0x7f7854109020 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f78440098a0 tx=0x7f7844009bb0 comp rx=0 tx=0).stop 2024-05-08T05:37:47.927 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:46.899+0000 7f7853e00700 1 -- 172.21.15.82:0/1003263459 shutdown_connections 2024-05-08T05:37:47.927 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:46.899+0000 7f7853e00700 1 --2- 172.21.15.82:0/1003263459 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7854108c00 0x7f7854109020 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:47.928 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:46.899+0000 7f7853e00700 1 -- 172.21.15.82:0/1003263459 >> 172.21.15.82:0/1003263459 conn(0x7f7854104180 msgr2=0x7f78541065e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:37:47.928 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:46.899+0000 7f7853e00700 1 -- 172.21.15.82:0/1003263459 shutdown_connections 2024-05-08T05:37:47.928 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:46.899+0000 7f7853e00700 1 -- 172.21.15.82:0/1003263459 wait complete. 2024-05-08T05:37:47.928 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:46.900+0000 7f7853e00700 1 Processor -- start 2024-05-08T05:37:47.928 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:46.901+0000 7f7853e00700 1 -- start start 2024-05-08T05:37:47.928 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:46.901+0000 7f7853e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7854108c00 0x7f785407eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:47.928 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:46.901+0000 7f7853e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f785410d160 con 0x7f7854108c00 2024-05-08T05:37:47.928 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:46.901+0000 7f7852a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7854108c00 0x7f785407eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:47.928 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:46.901+0000 7f7852a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7854108c00 0x7f785407eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59340/0 (socket says 172.21.15.82:59340) 2024-05-08T05:37:47.928 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:46.901+0000 7f7852a00700 1 -- 172.21.15.82:0/1965462646 learned_addr learned my addr 172.21.15.82:0/1965462646 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:37:47.928 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:46.902+0000 7f7852a00700 1 -- 172.21.15.82:0/1965462646 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f785407f0c0 con 0x7f7854108c00 2024-05-08T05:37:47.928 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:46.902+0000 7f7852a00700 1 --2- 172.21.15.82:0/1965462646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7854108c00 0x7f785407eb80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7844000c00 tx=0x7f7844011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:47.928 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:46.902+0000 7f784b400700 1 -- 172.21.15.82:0/1965462646 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7844003aa0 con 0x7f7854108c00 2024-05-08T05:37:47.928 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:46.902+0000 7f784b400700 1 -- 172.21.15.82:0/1965462646 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f784401b8f0 con 0x7f7854108c00 2024-05-08T05:37:47.929 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:46.902+0000 7f7853e00700 1 -- 172.21.15.82:0/1965462646 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f785407d2b0 con 0x7f7854108c00 2024-05-08T05:37:47.929 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:46.902+0000 7f784b400700 1 -- 172.21.15.82:0/1965462646 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7844023890 con 0x7f7854108c00 2024-05-08T05:37:47.929 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:46.902+0000 7f7853e00700 1 -- 172.21.15.82:0/1965462646 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f785407d7f0 con 0x7f7854108c00 2024-05-08T05:37:47.929 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:46.904+0000 7f7853e00700 1 -- 172.21.15.82:0/1965462646 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f785406a5c0 con 0x7f7854108c00 2024-05-08T05:37:47.929 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:46.904+0000 7f784b400700 1 -- 172.21.15.82:0/1965462646 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 12) ==== 50235+0+0 (secure 0 0 0) 0x7f784402c3f0 con 0x7f7854108c00 2024-05-08T05:37:47.929 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:46.904+0000 7f784b400700 1 --2- 172.21.15.82:0/1965462646 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f783803e4c0 0x7f7838040980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:47.929 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:46.904+0000 7f784b400700 1 -- 172.21.15.82:0/1965462646 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f7844054090 con 0x7f7854108c00 2024-05-08T05:37:47.929 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:46.905+0000 7f7852000700 1 --2- 172.21.15.82:0/1965462646 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f783803e4c0 0x7f7838040980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:47.929 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:46.906+0000 7f7852000700 1 --2- 172.21.15.82:0/1965462646 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f783803e4c0 0x7f7838040980 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7840006fd0 tx=0x7f7840006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:47.929 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:46.911+0000 7f784b400700 1 -- 172.21.15.82:0/1965462646 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f784401f030 con 0x7f7854108c00 2024-05-08T05:37:47.929 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:47.153+0000 7f7853e00700 1 -- 172.21.15.82:0/1965462646 --> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7f785407e140 con 0x7f783803e4c0 2024-05-08T05:37:47.930 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:47.247+0000 7f784b400700 1 -- 172.21.15.82:0/1965462646 <== mgr.14152 v2:172.21.15.82:6800/4089180091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7f785407e140 con 0x7f783803e4c0 2024-05-08T05:37:47.930 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:47.250+0000 7f7853e00700 1 -- 172.21.15.82:0/1965462646 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f783803e4c0 msgr2=0x7f7838040980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:47.930 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:47.250+0000 7f7853e00700 1 --2- 172.21.15.82:0/1965462646 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f783803e4c0 0x7f7838040980 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7840006fd0 tx=0x7f7840006e40 comp rx=0 tx=0).stop 2024-05-08T05:37:47.930 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:47.250+0000 7f7853e00700 1 -- 172.21.15.82:0/1965462646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7854108c00 msgr2=0x7f785407eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:47.930 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:47.250+0000 7f7853e00700 1 --2- 172.21.15.82:0/1965462646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7854108c00 0x7f785407eb80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7844000c00 tx=0x7f7844011aa0 comp rx=0 tx=0).stop 2024-05-08T05:37:47.930 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:47.250+0000 7f7853e00700 1 -- 172.21.15.82:0/1965462646 shutdown_connections 2024-05-08T05:37:47.930 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:47.250+0000 7f7853e00700 1 --2- 172.21.15.82:0/1965462646 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f783803e4c0 0x7f7838040980 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:47.930 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:47.250+0000 7f7853e00700 1 --2- 172.21.15.82:0/1965462646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7854108c00 0x7f785407eb80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:47.930 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:47.250+0000 7f7853e00700 1 -- 172.21.15.82:0/1965462646 >> 172.21.15.82:0/1965462646 conn(0x7f7854104180 msgr2=0x7f7854104cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:37:47.931 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:47.250+0000 7f7853e00700 1 -- 172.21.15.82:0/1965462646 shutdown_connections 2024-05-08T05:37:47.931 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:47.250+0000 7f7853e00700 1 -- 172.21.15.82:0/1965462646 wait complete. 2024-05-08T05:37:47.931 INFO:teuthology.orchestra.run.smithi082.stdout:Creating initial admin user... 2024-05-08T05:37:48.521 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:48 smithi082 ceph-mon[30098]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:37:48.521 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:48 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:37:48.521 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:48 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:37:49.699 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$dLSOA0AAZ0fISXk.6eLpZO/eAtnJ3wZr.ehks46Bu2U2CTCiE4tda", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1715146669, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-05-08T05:37:49.699 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:48.519+0000 7f857cc00700 1 Processor -- start 2024-05-08T05:37:49.699 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:48.519+0000 7f857cc00700 1 -- start start 2024-05-08T05:37:49.699 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:48.520+0000 7f857cc00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8578109940 0x7f857810bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:49.700 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:48.520+0000 7f857cc00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f857807ce40 con 0x7f8578109940 2024-05-08T05:37:49.700 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:48.520+0000 7f8575e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8578109940 0x7f857810bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:49.700 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:48.520+0000 7f8575e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8578109940 0x7f857810bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59354/0 (socket says 172.21.15.82:59354) 2024-05-08T05:37:49.700 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:48.520+0000 7f8575e00700 1 -- 172.21.15.82:0/400035897 learned_addr learned my addr 172.21.15.82:0/400035897 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:37:49.700 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:48.521+0000 7f8575e00700 1 -- 172.21.15.82:0/400035897 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f857810c270 con 0x7f8578109940 2024-05-08T05:37:49.700 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:48.521+0000 7f8575e00700 1 --2- 172.21.15.82:0/400035897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8578109940 0x7f857810bd30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f85680098a0 tx=0x7f8568009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94b36320c796ee9d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:49.700 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:48.522+0000 7f8574a00700 1 -- 172.21.15.82:0/400035897 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8568004160 con 0x7f8578109940 2024-05-08T05:37:49.700 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:48.522+0000 7f8574a00700 1 -- 172.21.15.82:0/400035897 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8568004300 con 0x7f8578109940 2024-05-08T05:37:49.700 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:48.522+0000 7f8574a00700 1 -- 172.21.15.82:0/400035897 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8568011a20 con 0x7f8578109940 2024-05-08T05:37:49.700 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:48.522+0000 7f857cc00700 1 -- 172.21.15.82:0/400035897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8578109940 msgr2=0x7f857810bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:49.700 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:48.522+0000 7f857cc00700 1 --2- 172.21.15.82:0/400035897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8578109940 0x7f857810bd30 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f85680098a0 tx=0x7f8568009bb0 comp rx=0 tx=0).stop 2024-05-08T05:37:49.700 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:48.523+0000 7f857cc00700 1 -- 172.21.15.82:0/400035897 shutdown_connections 2024-05-08T05:37:49.700 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:48.523+0000 7f857cc00700 1 --2- 172.21.15.82:0/400035897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8578109940 0x7f857810bd30 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:49.700 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:48.523+0000 7f857cc00700 1 -- 172.21.15.82:0/400035897 >> 172.21.15.82:0/400035897 conn(0x7f85781032f0 msgr2=0x7f8578105730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:37:49.700 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:48.523+0000 7f857cc00700 1 -- 172.21.15.82:0/400035897 shutdown_connections 2024-05-08T05:37:49.701 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:48.523+0000 7f857cc00700 1 -- 172.21.15.82:0/400035897 wait complete. 2024-05-08T05:37:49.701 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:48.524+0000 7f857cc00700 1 Processor -- start 2024-05-08T05:37:49.701 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:48.524+0000 7f857cc00700 1 -- start start 2024-05-08T05:37:49.701 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:48.525+0000 7f857cc00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8578109940 0x7f857819cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:49.701 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:48.525+0000 7f857cc00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f857810d210 con 0x7f8578109940 2024-05-08T05:37:49.701 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:48.525+0000 7f8575e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8578109940 0x7f857819cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:49.701 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:48.525+0000 7f8575e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8578109940 0x7f857819cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59362/0 (socket says 172.21.15.82:59362) 2024-05-08T05:37:49.701 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:48.525+0000 7f8575e00700 1 -- 172.21.15.82:0/1684518357 learned_addr learned my addr 172.21.15.82:0/1684518357 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:37:49.701 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:48.526+0000 7f8575e00700 1 -- 172.21.15.82:0/1684518357 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f857819d2d0 con 0x7f8578109940 2024-05-08T05:37:49.701 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:48.526+0000 7f8575e00700 1 --2- 172.21.15.82:0/1684518357 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8578109940 0x7f857819cd90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f85680116e0 tx=0x7f8568011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:49.701 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:48.526+0000 7f856ea00700 1 -- 172.21.15.82:0/1684518357 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8568003b20 con 0x7f8578109940 2024-05-08T05:37:49.701 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:48.526+0000 7f856ea00700 1 -- 172.21.15.82:0/1684518357 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f856801b8f0 con 0x7f8578109940 2024-05-08T05:37:49.701 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:48.526+0000 7f857cc00700 1 -- 172.21.15.82:0/1684518357 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f857819d560 con 0x7f8578109940 2024-05-08T05:37:49.701 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:48.526+0000 7f856ea00700 1 -- 172.21.15.82:0/1684518357 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f85680238c0 con 0x7f8578109940 2024-05-08T05:37:49.701 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:48.527+0000 7f857cc00700 1 -- 172.21.15.82:0/1684518357 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85781a0210 con 0x7f8578109940 2024-05-08T05:37:49.702 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:48.528+0000 7f856ea00700 1 -- 172.21.15.82:0/1684518357 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 12) ==== 50235+0+0 (secure 0 0 0) 0x7f8568023a60 con 0x7f8578109940 2024-05-08T05:37:49.702 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:48.528+0000 7f857cc00700 1 -- 172.21.15.82:0/1684518357 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f857806a5c0 con 0x7f8578109940 2024-05-08T05:37:49.702 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:48.528+0000 7f856ea00700 1 --2- 172.21.15.82:0/1684518357 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f855c03e520 0x7f855c0409e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:49.702 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:48.528+0000 7f856ea00700 1 -- 172.21.15.82:0/1684518357 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f8568054160 con 0x7f8578109940 2024-05-08T05:37:49.702 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:48.529+0000 7f8575400700 1 --2- 172.21.15.82:0/1684518357 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f855c03e520 0x7f855c0409e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:49.702 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:48.529+0000 7f8575400700 1 --2- 172.21.15.82:0/1684518357 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f855c03e520 0x7f855c0409e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8564006fd0 tx=0x7f8564006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:49.702 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:48.534+0000 7f856ea00700 1 -- 172.21.15.82:0/1684518357 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f856801f030 con 0x7f8578109940 2024-05-08T05:37:49.702 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:48.787+0000 7f857cc00700 1 -- 172.21.15.82:0/1684518357 --> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f85781044a0 con 0x7f855c03e520 2024-05-08T05:37:49.702 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:49.024+0000 7f856ea00700 1 -- 172.21.15.82:0/1684518357 <== mgr.14152 v2:172.21.15.82:6800/4089180091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f85781044a0 con 0x7f855c03e520 2024-05-08T05:37:49.702 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:49.027+0000 7f857cc00700 1 -- 172.21.15.82:0/1684518357 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f855c03e520 msgr2=0x7f855c0409e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:49.702 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:49.027+0000 7f857cc00700 1 --2- 172.21.15.82:0/1684518357 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f855c03e520 0x7f855c0409e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8564006fd0 tx=0x7f8564006e40 comp rx=0 tx=0).stop 2024-05-08T05:37:49.702 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:49.027+0000 7f857cc00700 1 -- 172.21.15.82:0/1684518357 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8578109940 msgr2=0x7f857819cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:49.702 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:49.027+0000 7f857cc00700 1 --2- 172.21.15.82:0/1684518357 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8578109940 0x7f857819cd90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f85680116e0 tx=0x7f8568011aa0 comp rx=0 tx=0).stop 2024-05-08T05:37:49.703 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:49.028+0000 7f857cc00700 1 -- 172.21.15.82:0/1684518357 shutdown_connections 2024-05-08T05:37:49.703 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:49.028+0000 7f857cc00700 1 --2- 172.21.15.82:0/1684518357 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f855c03e520 0x7f855c0409e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:49.703 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:49.028+0000 7f857cc00700 1 --2- 172.21.15.82:0/1684518357 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8578109940 0x7f857819cd90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:49.703 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:49.028+0000 7f857cc00700 1 -- 172.21.15.82:0/1684518357 >> 172.21.15.82:0/1684518357 conn(0x7f85781032f0 msgr2=0x7f8578103d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:37:49.703 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:49.028+0000 7f857cc00700 1 -- 172.21.15.82:0/1684518357 shutdown_connections 2024-05-08T05:37:49.703 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:49.028+0000 7f857cc00700 1 -- 172.21.15.82:0/1684518357 wait complete. 2024-05-08T05:37:49.703 INFO:teuthology.orchestra.run.smithi082.stdout:Fetching dashboard port number... 2024-05-08T05:37:49.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:49 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:37:49.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:49 smithi082 ceph-mon[30098]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:37:49.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:49 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:37:51.515 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stdout 8443 2024-05-08T05:37:51.516 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:50.536+0000 7f9947e00700 1 Processor -- start 2024-05-08T05:37:51.516 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:50.536+0000 7f9947e00700 1 -- start start 2024-05-08T05:37:51.516 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:50.537+0000 7f9947e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9940108e30 0x7f9940109250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:51.517 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:50.537+0000 7f9947e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9940109820 con 0x7f9940108e30 2024-05-08T05:37:51.517 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:50.537+0000 7f9945400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9940108e30 0x7f9940109250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:51.517 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:50.537+0000 7f9945400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9940108e30 0x7f9940109250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59374/0 (socket says 172.21.15.82:59374) 2024-05-08T05:37:51.517 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:50.537+0000 7f9945400700 1 -- 172.21.15.82:0/461721837 learned_addr learned my addr 172.21.15.82:0/461721837 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:37:51.517 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:50.537+0000 7f9945400700 1 -- 172.21.15.82:0/461721837 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9940109fe0 con 0x7f9940108e30 2024-05-08T05:37:51.517 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:50.538+0000 7f9945400700 1 --2- 172.21.15.82:0/461721837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9940108e30 0x7f9940109250 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f99340098a0 tx=0x7f9934009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86f4f9125e468b2d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:51.518 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:50.538+0000 7f993fe00700 1 -- 172.21.15.82:0/461721837 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9934004160 con 0x7f9940108e30 2024-05-08T05:37:51.518 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:50.538+0000 7f993fe00700 1 -- 172.21.15.82:0/461721837 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9934004300 con 0x7f9940108e30 2024-05-08T05:37:51.518 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:50.538+0000 7f993fe00700 1 -- 172.21.15.82:0/461721837 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9934011a20 con 0x7f9940108e30 2024-05-08T05:37:51.518 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:50.539+0000 7f9947e00700 1 -- 172.21.15.82:0/461721837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9940108e30 msgr2=0x7f9940109250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:51.519 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:50.539+0000 7f9947e00700 1 --2- 172.21.15.82:0/461721837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9940108e30 0x7f9940109250 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f99340098a0 tx=0x7f9934009bb0 comp rx=0 tx=0).stop 2024-05-08T05:37:51.519 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:50.539+0000 7f9947e00700 1 -- 172.21.15.82:0/461721837 shutdown_connections 2024-05-08T05:37:51.522 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:50.539+0000 7f9947e00700 1 --2- 172.21.15.82:0/461721837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9940108e30 0x7f9940109250 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:51.522 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:50.539+0000 7f9947e00700 1 -- 172.21.15.82:0/461721837 >> 172.21.15.82:0/461721837 conn(0x7f9940104410 msgr2=0x7f9940106830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:37:51.522 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:50.539+0000 7f9947e00700 1 -- 172.21.15.82:0/461721837 shutdown_connections 2024-05-08T05:37:51.522 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:50.539+0000 7f9947e00700 1 -- 172.21.15.82:0/461721837 wait complete. 2024-05-08T05:37:51.522 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:50.540+0000 7f9947e00700 1 Processor -- start 2024-05-08T05:37:51.522 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:50.540+0000 7f9947e00700 1 -- start start 2024-05-08T05:37:51.522 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:50.541+0000 7f9947e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9940108e30 0x7f994019cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:51.522 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:50.541+0000 7f9947e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f994010d390 con 0x7f9940108e30 2024-05-08T05:37:51.522 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:50.541+0000 7f9945400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9940108e30 0x7f994019cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:51.523 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:50.541+0000 7f9945400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9940108e30 0x7f994019cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59384/0 (socket says 172.21.15.82:59384) 2024-05-08T05:37:51.523 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:50.541+0000 7f9945400700 1 -- 172.21.15.82:0/4031332942 learned_addr learned my addr 172.21.15.82:0/4031332942 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:37:51.523 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:50.541+0000 7f9945400700 1 -- 172.21.15.82:0/4031332942 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f994019d250 con 0x7f9940108e30 2024-05-08T05:37:51.523 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:50.542+0000 7f9945400700 1 --2- 172.21.15.82:0/4031332942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9940108e30 0x7f994019cd10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9934000c00 tx=0x7f9934011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:51.523 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:50.542+0000 7f993e000700 1 -- 172.21.15.82:0/4031332942 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9934003aa0 con 0x7f9940108e30 2024-05-08T05:37:51.523 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:50.542+0000 7f993e000700 1 -- 172.21.15.82:0/4031332942 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f993401b8f0 con 0x7f9940108e30 2024-05-08T05:37:51.523 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:50.542+0000 7f9947e00700 1 -- 172.21.15.82:0/4031332942 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f994019d4e0 con 0x7f9940108e30 2024-05-08T05:37:51.523 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:50.542+0000 7f993e000700 1 -- 172.21.15.82:0/4031332942 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9934023890 con 0x7f9940108e30 2024-05-08T05:37:51.523 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:50.542+0000 7f9947e00700 1 -- 172.21.15.82:0/4031332942 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99401a01c0 con 0x7f9940108e30 2024-05-08T05:37:51.523 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:50.543+0000 7f993e000700 1 -- 172.21.15.82:0/4031332942 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 12) ==== 50235+0+0 (secure 0 0 0) 0x7f993401b440 con 0x7f9940108e30 2024-05-08T05:37:51.523 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:50.543+0000 7f9947e00700 1 -- 172.21.15.82:0/4031332942 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f994006a5c0 con 0x7f9940108e30 2024-05-08T05:37:51.523 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:50.544+0000 7f993e000700 1 --2- 172.21.15.82:0/4031332942 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f992803e520 0x7f99280409e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:51.524 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:50.544+0000 7f993e000700 1 -- 172.21.15.82:0/4031332942 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f9934053f20 con 0x7f9940108e30 2024-05-08T05:37:51.524 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:50.544+0000 7f9944a00700 1 --2- 172.21.15.82:0/4031332942 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f992803e520 0x7f99280409e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:51.524 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:50.545+0000 7f9944a00700 1 --2- 172.21.15.82:0/4031332942 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f992803e520 0x7f99280409e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f992c006fd0 tx=0x7f992c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:51.524 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:50.550+0000 7f993e000700 1 -- 172.21.15.82:0/4031332942 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f993401f030 con 0x7f9940108e30 2024-05-08T05:37:51.524 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:50.648+0000 7f993e000700 1 -- 172.21.15.82:0/4031332942 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f993400b3e0 con 0x7f9940108e30 2024-05-08T05:37:51.524 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:50.781+0000 7f9947e00700 1 -- 172.21.15.82:0/4031332942 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f99401a07b0 con 0x7f9940108e30 2024-05-08T05:37:51.525 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:50.782+0000 7f993e000700 1 -- 172.21.15.82:0/4031332942 <== mon.0 v2:172.21.15.82:3300/0 8 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f9934016260 con 0x7f9940108e30 2024-05-08T05:37:51.525 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:50.785+0000 7f9947e00700 1 -- 172.21.15.82:0/4031332942 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f992803e520 msgr2=0x7f99280409e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:51.526 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:50.785+0000 7f9947e00700 1 --2- 172.21.15.82:0/4031332942 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f992803e520 0x7f99280409e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f992c006fd0 tx=0x7f992c006e40 comp rx=0 tx=0).stop 2024-05-08T05:37:51.526 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:50.785+0000 7f9947e00700 1 -- 172.21.15.82:0/4031332942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9940108e30 msgr2=0x7f994019cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:51.526 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:50.785+0000 7f9947e00700 1 --2- 172.21.15.82:0/4031332942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9940108e30 0x7f994019cd10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9934000c00 tx=0x7f9934011aa0 comp rx=0 tx=0).stop 2024-05-08T05:37:51.526 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:50.786+0000 7f9947e00700 1 -- 172.21.15.82:0/4031332942 shutdown_connections 2024-05-08T05:37:51.526 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:50.786+0000 7f9947e00700 1 --2- 172.21.15.82:0/4031332942 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f992803e520 0x7f99280409e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:51.526 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:50.786+0000 7f9947e00700 1 --2- 172.21.15.82:0/4031332942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9940108e30 0x7f994019cd10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:51.526 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:50.786+0000 7f9947e00700 1 -- 172.21.15.82:0/4031332942 >> 172.21.15.82:0/4031332942 conn(0x7f9940104410 msgr2=0x7f9940104ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:37:51.526 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:50.786+0000 7f9947e00700 1 -- 172.21.15.82:0/4031332942 shutdown_connections 2024-05-08T05:37:51.526 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:50.786+0000 7f9947e00700 1 -- 172.21.15.82:0/4031332942 wait complete. 2024-05-08T05:37:51.554 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-08T05:37:51.554 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout disabled 2024-05-08T05:37:51.576 INFO:teuthology.orchestra.run.smithi082.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-08T05:37:51.576 INFO:teuthology.orchestra.run.smithi082.stdout:systemctl: stdout inactive 2024-05-08T05:37:51.576 INFO:teuthology.orchestra.run.smithi082.stdout:firewalld.service is not enabled 2024-05-08T05:37:51.576 INFO:teuthology.orchestra.run.smithi082.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-05-08T05:37:51.579 INFO:teuthology.orchestra.run.smithi082.stdout:Ceph Dashboard is now available at: 2024-05-08T05:37:51.579 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:37:51.579 INFO:teuthology.orchestra.run.smithi082.stdout: URL: https://smithi082.front.sepia.ceph.com:8443/ 2024-05-08T05:37:51.580 INFO:teuthology.orchestra.run.smithi082.stdout: User: admin 2024-05-08T05:37:51.580 INFO:teuthology.orchestra.run.smithi082.stdout: Password: og8aztzz09 2024-05-08T05:37:51.580 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:37:51.580 INFO:teuthology.orchestra.run.smithi082.stdout:Saving cluster configuration to /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/config directory 2024-05-08T05:37:51.582 INFO:teuthology.orchestra.run.smithi082.stdout:Enabling autotune for osd_memory_target 2024-05-08T05:37:51.785 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:51 smithi082 ceph-mon[30098]: mgrmap e13: x(active, since 6s) 2024-05-08T05:37:51.786 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:51 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/4031332942' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-05-08T05:37:53.414 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:52.606+0000 7f2acfe00700 1 Processor -- start 2024-05-08T05:37:53.415 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:52.607+0000 7f2acfe00700 1 -- start start 2024-05-08T05:37:53.415 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:52.607+0000 7f2acfe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ad0082b40 0x7f2ad0082f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:53.415 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:52.607+0000 7f2acfe00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad0083530 con 0x7f2ad0082b40 2024-05-08T05:37:53.415 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:52.607+0000 7f2acea00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ad0082b40 0x7f2ad0082f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:53.415 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:52.607+0000 7f2acea00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ad0082b40 0x7f2ad0082f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59388/0 (socket says 172.21.15.82:59388) 2024-05-08T05:37:53.415 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:52.607+0000 7f2acea00700 1 -- 172.21.15.82:0/3673621034 learned_addr learned my addr 172.21.15.82:0/3673621034 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:37:53.415 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:52.608+0000 7f2acea00700 1 -- 172.21.15.82:0/3673621034 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ad00836b0 con 0x7f2ad0082b40 2024-05-08T05:37:53.415 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:52.608+0000 7f2acea00700 1 --2- 172.21.15.82:0/3673621034 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ad0082b40 0x7f2ad0082f60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2ac00098a0 tx=0x7f2ac0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de814631f84d552d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:53.415 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:52.608+0000 7f2acd600700 1 -- 172.21.15.82:0/3673621034 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ac0004160 con 0x7f2ad0082b40 2024-05-08T05:37:53.415 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:52.608+0000 7f2acd600700 1 -- 172.21.15.82:0/3673621034 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ac0004300 con 0x7f2ad0082b40 2024-05-08T05:37:53.415 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:52.608+0000 7f2acd600700 1 -- 172.21.15.82:0/3673621034 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ac0011a20 con 0x7f2ad0082b40 2024-05-08T05:37:53.415 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:52.609+0000 7f2acfe00700 1 -- 172.21.15.82:0/3673621034 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ad0082b40 msgr2=0x7f2ad0082f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:53.415 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:52.609+0000 7f2acfe00700 1 --2- 172.21.15.82:0/3673621034 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ad0082b40 0x7f2ad0082f60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2ac00098a0 tx=0x7f2ac0009bb0 comp rx=0 tx=0).stop 2024-05-08T05:37:53.415 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:52.609+0000 7f2acfe00700 1 -- 172.21.15.82:0/3673621034 shutdown_connections 2024-05-08T05:37:53.416 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:52.609+0000 7f2acfe00700 1 --2- 172.21.15.82:0/3673621034 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ad0082b40 0x7f2ad0082f60 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:53.416 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:52.609+0000 7f2acfe00700 1 -- 172.21.15.82:0/3673621034 >> 172.21.15.82:0/3673621034 conn(0x7f2ad007e240 msgr2=0x7f2ad0080660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:37:53.416 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:52.609+0000 7f2acfe00700 1 -- 172.21.15.82:0/3673621034 shutdown_connections 2024-05-08T05:37:53.416 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:52.609+0000 7f2acfe00700 1 -- 172.21.15.82:0/3673621034 wait complete. 2024-05-08T05:37:53.416 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:52.610+0000 7f2acfe00700 1 Processor -- start 2024-05-08T05:37:53.416 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:52.610+0000 7f2acfe00700 1 -- start start 2024-05-08T05:37:53.416 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:52.611+0000 7f2acfe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ad0082b40 0x7f2ad01a3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:53.416 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:52.611+0000 7f2acfe00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad0111400 con 0x7f2ad0082b40 2024-05-08T05:37:53.416 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:52.611+0000 7f2acea00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ad0082b40 0x7f2ad01a3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:53.416 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:52.611+0000 7f2acea00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ad0082b40 0x7f2ad01a3190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59396/0 (socket says 172.21.15.82:59396) 2024-05-08T05:37:53.416 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:52.611+0000 7f2acea00700 1 -- 172.21.15.82:0/1565051425 learned_addr learned my addr 172.21.15.82:0/1565051425 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:37:53.416 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:52.611+0000 7f2acea00700 1 -- 172.21.15.82:0/1565051425 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ad01a36d0 con 0x7f2ad0082b40 2024-05-08T05:37:53.416 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:52.612+0000 7f2acea00700 1 --2- 172.21.15.82:0/1565051425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ad0082b40 0x7f2ad01a3190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2ac00119f0 tx=0x7f2ac0011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:53.416 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:52.612+0000 7f2ad4a00700 1 -- 172.21.15.82:0/1565051425 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ac00039e0 con 0x7f2ad0082b40 2024-05-08T05:37:53.417 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:52.612+0000 7f2ad4a00700 1 -- 172.21.15.82:0/1565051425 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ac001b8f0 con 0x7f2ad0082b40 2024-05-08T05:37:53.417 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:52.612+0000 7f2acfe00700 1 -- 172.21.15.82:0/1565051425 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ad01a3960 con 0x7f2ad0082b40 2024-05-08T05:37:53.417 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:52.612+0000 7f2ad4a00700 1 -- 172.21.15.82:0/1565051425 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2ac00237a0 con 0x7f2ad0082b40 2024-05-08T05:37:53.417 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:52.612+0000 7f2acfe00700 1 -- 172.21.15.82:0/1565051425 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ad01a6650 con 0x7f2ad0082b40 2024-05-08T05:37:53.417 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:52.613+0000 7f2ad4a00700 1 -- 172.21.15.82:0/1565051425 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f2ac001b440 con 0x7f2ad0082b40 2024-05-08T05:37:53.417 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:52.613+0000 7f2acfe00700 1 -- 172.21.15.82:0/1565051425 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ad006a5c0 con 0x7f2ad0082b40 2024-05-08T05:37:53.417 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:52.614+0000 7f2ad4a00700 1 --2- 172.21.15.82:0/1565051425 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2ab403e570 0x7f2ab4040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:53.417 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:52.614+0000 7f2ad4a00700 1 -- 172.21.15.82:0/1565051425 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f2ac0053ff0 con 0x7f2ad0082b40 2024-05-08T05:37:53.417 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:52.614+0000 7f2ace000700 1 --2- 172.21.15.82:0/1565051425 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2ab403e570 0x7f2ab4040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:53.417 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:52.615+0000 7f2ace000700 1 --2- 172.21.15.82:0/1565051425 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2ab403e570 0x7f2ab4040a30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2abc006fd0 tx=0x7f2abc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:53.417 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:52.619+0000 7f2ad4a00700 1 -- 172.21.15.82:0/1565051425 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2ac001f030 con 0x7f2ad0082b40 2024-05-08T05:37:53.417 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:52.851+0000 7f2acfe00700 1 -- 172.21.15.82:0/1565051425 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) -- 0x7f2ad01a6c70 con 0x7f2ad0082b40 2024-05-08T05:37:53.417 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:52.852+0000 7f2ad4a00700 1 -- 172.21.15.82:0/1565051425 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) ==== 127+0+0 (secure 0 0 0) 0x7f2ac00202b0 con 0x7f2ad0082b40 2024-05-08T05:37:53.417 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:52.856+0000 7f2acfe00700 1 -- 172.21.15.82:0/1565051425 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2ab403e570 msgr2=0x7f2ab4040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:53.417 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:52.856+0000 7f2acfe00700 1 --2- 172.21.15.82:0/1565051425 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2ab403e570 0x7f2ab4040a30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f2abc006fd0 tx=0x7f2abc006e40 comp rx=0 tx=0).stop 2024-05-08T05:37:53.418 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:52.856+0000 7f2acfe00700 1 -- 172.21.15.82:0/1565051425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ad0082b40 msgr2=0x7f2ad01a3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:53.418 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:52.856+0000 7f2acfe00700 1 --2- 172.21.15.82:0/1565051425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ad0082b40 0x7f2ad01a3190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2ac00119f0 tx=0x7f2ac0011ad0 comp rx=0 tx=0).stop 2024-05-08T05:37:53.418 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:52.856+0000 7f2acfe00700 1 -- 172.21.15.82:0/1565051425 shutdown_connections 2024-05-08T05:37:53.418 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:52.856+0000 7f2acfe00700 1 --2- 172.21.15.82:0/1565051425 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2ab403e570 0x7f2ab4040a30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:53.418 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:52.856+0000 7f2acfe00700 1 --2- 172.21.15.82:0/1565051425 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2ad0082b40 0x7f2ad01a3190 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:53.418 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:52.856+0000 7f2acfe00700 1 -- 172.21.15.82:0/1565051425 >> 172.21.15.82:0/1565051425 conn(0x7f2ad007e240 msgr2=0x7f2ad007eda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:37:53.418 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:52.856+0000 7f2acfe00700 1 -- 172.21.15.82:0/1565051425 shutdown_connections 2024-05-08T05:37:53.418 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:52.856+0000 7f2acfe00700 1 -- 172.21.15.82:0/1565051425 wait complete. 2024-05-08T05:37:55.019 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:54.004+0000 7eff1f800700 1 Processor -- start 2024-05-08T05:37:55.019 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:54.004+0000 7eff1f800700 1 -- start start 2024-05-08T05:37:55.019 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:54.004+0000 7eff1f800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff1807f740 0x7eff1807dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:55.019 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:54.004+0000 7eff1f800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7eff1807e170 con 0x7eff1807f740 2024-05-08T05:37:55.020 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:54.005+0000 7eff1ce00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff1807f740 0x7eff1807dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:55.020 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:54.005+0000 7eff1ce00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff1807f740 0x7eff1807dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60178/0 (socket says 172.21.15.82:60178) 2024-05-08T05:37:55.020 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:54.005+0000 7eff1ce00700 1 -- 172.21.15.82:0/1410067587 learned_addr learned my addr 172.21.15.82:0/1410067587 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:37:55.020 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:54.005+0000 7eff1ce00700 1 -- 172.21.15.82:0/1410067587 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff1807e2f0 con 0x7eff1807f740 2024-05-08T05:37:55.020 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:54.006+0000 7eff1ce00700 1 --2- 172.21.15.82:0/1410067587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff1807f740 0x7eff1807dba0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7eff0c0098a0 tx=0x7eff0c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=834d0452dd7bc992 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:55.021 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:54.006+0000 7eff17400700 1 -- 172.21.15.82:0/1410067587 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff0c004160 con 0x7eff1807f740 2024-05-08T05:37:55.021 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:54.006+0000 7eff17400700 1 -- 172.21.15.82:0/1410067587 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff0c004300 con 0x7eff1807f740 2024-05-08T05:37:55.021 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:54.006+0000 7eff17400700 1 -- 172.21.15.82:0/1410067587 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff0c011a20 con 0x7eff1807f740 2024-05-08T05:37:55.021 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:54.007+0000 7eff1f800700 1 -- 172.21.15.82:0/1410067587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff1807f740 msgr2=0x7eff1807dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:55.021 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:54.007+0000 7eff1f800700 1 --2- 172.21.15.82:0/1410067587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff1807f740 0x7eff1807dba0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7eff0c0098a0 tx=0x7eff0c009bb0 comp rx=0 tx=0).stop 2024-05-08T05:37:55.021 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:54.007+0000 7eff1f800700 1 -- 172.21.15.82:0/1410067587 shutdown_connections 2024-05-08T05:37:55.022 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:54.007+0000 7eff1f800700 1 --2- 172.21.15.82:0/1410067587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff1807f740 0x7eff1807dba0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:55.022 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:54.007+0000 7eff1f800700 1 -- 172.21.15.82:0/1410067587 >> 172.21.15.82:0/1410067587 conn(0x7eff18104370 msgr2=0x7eff181067d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:37:55.022 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:54.007+0000 7eff1f800700 1 -- 172.21.15.82:0/1410067587 shutdown_connections 2024-05-08T05:37:55.022 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:54.007+0000 7eff1f800700 1 -- 172.21.15.82:0/1410067587 wait complete. 2024-05-08T05:37:55.022 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:54.008+0000 7eff1f800700 1 Processor -- start 2024-05-08T05:37:55.022 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:54.008+0000 7eff1f800700 1 -- start start 2024-05-08T05:37:55.023 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:54.008+0000 7eff1f800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff1807f740 0x7eff1819ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:55.023 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:54.008+0000 7eff1f800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7eff1810f3f0 con 0x7eff1807f740 2024-05-08T05:37:55.023 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:54.009+0000 7eff1ce00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff1807f740 0x7eff1819ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:55.023 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:54.009+0000 7eff1ce00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff1807f740 0x7eff1819ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60186/0 (socket says 172.21.15.82:60186) 2024-05-08T05:37:55.023 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:54.009+0000 7eff1ce00700 1 -- 172.21.15.82:0/2271668792 learned_addr learned my addr 172.21.15.82:0/2271668792 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:37:55.023 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:54.009+0000 7eff1ce00700 1 -- 172.21.15.82:0/2271668792 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff1819f4c0 con 0x7eff1807f740 2024-05-08T05:37:55.024 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:54.009+0000 7eff1ce00700 1 --2- 172.21.15.82:0/2271668792 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff1807f740 0x7eff1819ef80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7eff0c000c00 tx=0x7eff0c011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:55.024 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:54.010+0000 7eff15600700 1 -- 172.21.15.82:0/2271668792 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff0c003aa0 con 0x7eff1807f740 2024-05-08T05:37:55.024 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:54.010+0000 7eff15600700 1 -- 172.21.15.82:0/2271668792 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7eff0c01b8f0 con 0x7eff1807f740 2024-05-08T05:37:55.024 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:54.010+0000 7eff15600700 1 -- 172.21.15.82:0/2271668792 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff0c023890 con 0x7eff1807f740 2024-05-08T05:37:55.024 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:54.010+0000 7eff1f800700 1 -- 172.21.15.82:0/2271668792 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff1819f750 con 0x7eff1807f740 2024-05-08T05:37:55.024 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:54.010+0000 7eff1f800700 1 -- 172.21.15.82:0/2271668792 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff181a2440 con 0x7eff1807f740 2024-05-08T05:37:55.025 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:54.011+0000 7eff1f800700 1 -- 172.21.15.82:0/2271668792 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff1806a5c0 con 0x7eff1807f740 2024-05-08T05:37:55.025 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:54.011+0000 7eff15600700 1 -- 172.21.15.82:0/2271668792 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7eff0c01b440 con 0x7eff1807f740 2024-05-08T05:37:55.025 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:54.012+0000 7eff15600700 1 --2- 172.21.15.82:0/2271668792 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7eff0003e5c0 0x7eff00040a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:55.025 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:54.012+0000 7eff15600700 1 -- 172.21.15.82:0/2271668792 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7eff0c054000 con 0x7eff1807f740 2024-05-08T05:37:55.025 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:54.012+0000 7eff17e00700 1 --2- 172.21.15.82:0/2271668792 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7eff0003e5c0 0x7eff00040a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:55.026 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:54.013+0000 7eff17e00700 1 --2- 172.21.15.82:0/2271668792 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7eff0003e5c0 0x7eff00040a80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7eff04006fd0 tx=0x7eff04006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:55.026 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:54.017+0000 7eff15600700 1 -- 172.21.15.82:0/2271668792 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7eff0c01f030 con 0x7eff1807f740 2024-05-08T05:37:55.026 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:54.369+0000 7eff1f800700 1 -- 172.21.15.82:0/2271668792 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7eff1819fc30 con 0x7eff1807f740 2024-05-08T05:37:55.026 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:54.372+0000 7eff15600700 1 -- 172.21.15.82:0/2271668792 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v27)=0 set mgr/dashboard/cluster/status v27) ==== 153+0+0 (secure 0 0 0) 0x7eff1819fc30 con 0x7eff1807f740 2024-05-08T05:37:55.026 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:54.375+0000 7eff1f800700 1 -- 172.21.15.82:0/2271668792 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7eff0003e5c0 msgr2=0x7eff00040a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:55.026 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:54.375+0000 7eff1f800700 1 --2- 172.21.15.82:0/2271668792 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7eff0003e5c0 0x7eff00040a80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7eff04006fd0 tx=0x7eff04006e40 comp rx=0 tx=0).stop 2024-05-08T05:37:55.027 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:54.375+0000 7eff1f800700 1 -- 172.21.15.82:0/2271668792 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff1807f740 msgr2=0x7eff1819ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:55.027 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:54.375+0000 7eff1f800700 1 --2- 172.21.15.82:0/2271668792 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff1807f740 0x7eff1819ef80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7eff0c000c00 tx=0x7eff0c011aa0 comp rx=0 tx=0).stop 2024-05-08T05:37:55.027 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:54.375+0000 7eff1f800700 1 -- 172.21.15.82:0/2271668792 shutdown_connections 2024-05-08T05:37:55.027 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:54.375+0000 7eff1f800700 1 --2- 172.21.15.82:0/2271668792 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7eff0003e5c0 0x7eff00040a80 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:55.027 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:54.375+0000 7eff1f800700 1 --2- 172.21.15.82:0/2271668792 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7eff1807f740 0x7eff1819ef80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:55.027 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:54.375+0000 7eff1f800700 1 -- 172.21.15.82:0/2271668792 >> 172.21.15.82:0/2271668792 conn(0x7eff18104370 msgr2=0x7eff18104ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:37:55.028 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:54.376+0000 7eff1f800700 1 -- 172.21.15.82:0/2271668792 shutdown_connections 2024-05-08T05:37:55.028 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr 2024-05-08T05:37:54.376+0000 7eff1f800700 1 -- 172.21.15.82:0/2271668792 wait complete. 2024-05-08T05:37:55.028 INFO:teuthology.orchestra.run.smithi082.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-05-08T05:37:55.028 INFO:teuthology.orchestra.run.smithi082.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-05-08T05:37:55.028 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:37:55.028 INFO:teuthology.orchestra.run.smithi082.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-05-08T05:37:55.029 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:37:55.029 INFO:teuthology.orchestra.run.smithi082.stdout:Or, if you are only running a single cluster on this host: 2024-05-08T05:37:55.029 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:37:55.029 INFO:teuthology.orchestra.run.smithi082.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-05-08T05:37:55.029 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:37:55.029 INFO:teuthology.orchestra.run.smithi082.stdout:Please consider enabling telemetry to help improve Ceph: 2024-05-08T05:37:55.030 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:37:55.030 INFO:teuthology.orchestra.run.smithi082.stdout: ceph telemetry on 2024-05-08T05:37:55.030 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:37:55.030 INFO:teuthology.orchestra.run.smithi082.stdout:For more information see: 2024-05-08T05:37:55.030 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:37:55.030 INFO:teuthology.orchestra.run.smithi082.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-05-08T05:37:55.031 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:37:55.031 INFO:teuthology.orchestra.run.smithi082.stdout:Bootstrap complete. 2024-05-08T05:37:55.118 INFO:tasks.cephadm:Fetching config... 2024-05-08T05:37:55.119 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-08T05:37:55.119 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-05-08T05:37:55.170 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-05-08T05:37:55.170 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-08T05:37:55.170 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-05-08T05:37:55.214 INFO:tasks.cephadm:Fetching mon keyring... 2024-05-08T05:37:55.215 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-08T05:37:55.215 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/keyring of=/dev/stdout 2024-05-08T05:37:55.328 INFO:tasks.cephadm:Fetching pub ssh key... 2024-05-08T05:37:55.328 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-08T05:37:55.329 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-05-08T05:37:55.418 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-05-08T05:37:55.418 DEBUG:teuthology.orchestra.run.smithi082:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDbQNrY/faZ5LGie6GjjKQXQAxvFHK94ke+3ASL/nZHs8YkB3oR3Jva2LZPr/3S6VrkiD7uGy42Q5PFRM0D/EiidqRDdnKNkSCZFOql8GLRDuWnLjFcMg05IXjH/eX4hXTlft0LULSuSEd8hqC5YCrx7aGm3ivbVDlDwQqB8O1LZiI6MuzZs8rIKH2TBLk7TLLKFGVc5TP0rNT209F5fkMWM5fsx6I67fHeGjo6cKe5lysgQ/oLpn4Yd0P6rpv0FK1sunkOTXLiVXR4OpM8c4JOYkHKLOmTidrCKhVyChoj9EtiL+ilCPQAr+FeULOmlUF9yAbC+yB2hou9/1IGTpeuSlUJAzKsXfcXgMf1U666XeiEN++8GX9/8ezYGuI32HKbFDH1jJAncuJrbfjJUyt8WFMl1ezr6sKfoPuNBiLMQfnF9DBdtZrvnk+TUGQV3xdWF/gGzMipJif8DS1LV+QO4jdq0BBKtglJqS+nL8JywgUT/HlfGiBDbOSIOrhTk7c= ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-08T05:37:55.568 INFO:teuthology.orchestra.run.smithi082.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDbQNrY/faZ5LGie6GjjKQXQAxvFHK94ke+3ASL/nZHs8YkB3oR3Jva2LZPr/3S6VrkiD7uGy42Q5PFRM0D/EiidqRDdnKNkSCZFOql8GLRDuWnLjFcMg05IXjH/eX4hXTlft0LULSuSEd8hqC5YCrx7aGm3ivbVDlDwQqB8O1LZiI6MuzZs8rIKH2TBLk7TLLKFGVc5TP0rNT209F5fkMWM5fsx6I67fHeGjo6cKe5lysgQ/oLpn4Yd0P6rpv0FK1sunkOTXLiVXR4OpM8c4JOYkHKLOmTidrCKhVyChoj9EtiL+ilCPQAr+FeULOmlUF9yAbC+yB2hou9/1IGTpeuSlUJAzKsXfcXgMf1U666XeiEN++8GX9/8ezYGuI32HKbFDH1jJAncuJrbfjJUyt8WFMl1ezr6sKfoPuNBiLMQfnF9DBdtZrvnk+TUGQV3xdWF/gGzMipJif8DS1LV+QO4jdq0BBKtglJqS+nL8JywgUT/HlfGiBDbOSIOrhTk7c= ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968 2024-05-08T05:37:55.570 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:55 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/2271668792' entity='client.admin' 2024-05-08T05:37:55.600 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDbQNrY/faZ5LGie6GjjKQXQAxvFHK94ke+3ASL/nZHs8YkB3oR3Jva2LZPr/3S6VrkiD7uGy42Q5PFRM0D/EiidqRDdnKNkSCZFOql8GLRDuWnLjFcMg05IXjH/eX4hXTlft0LULSuSEd8hqC5YCrx7aGm3ivbVDlDwQqB8O1LZiI6MuzZs8rIKH2TBLk7TLLKFGVc5TP0rNT209F5fkMWM5fsx6I67fHeGjo6cKe5lysgQ/oLpn4Yd0P6rpv0FK1sunkOTXLiVXR4OpM8c4JOYkHKLOmTidrCKhVyChoj9EtiL+ilCPQAr+FeULOmlUF9yAbC+yB2hou9/1IGTpeuSlUJAzKsXfcXgMf1U666XeiEN++8GX9/8ezYGuI32HKbFDH1jJAncuJrbfjJUyt8WFMl1ezr6sKfoPuNBiLMQfnF9DBdtZrvnk+TUGQV3xdWF/gGzMipJif8DS1LV+QO4jdq0BBKtglJqS+nL8JywgUT/HlfGiBDbOSIOrhTk7c= ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-08T05:37:55.645 INFO:teuthology.orchestra.run.smithi134.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDbQNrY/faZ5LGie6GjjKQXQAxvFHK94ke+3ASL/nZHs8YkB3oR3Jva2LZPr/3S6VrkiD7uGy42Q5PFRM0D/EiidqRDdnKNkSCZFOql8GLRDuWnLjFcMg05IXjH/eX4hXTlft0LULSuSEd8hqC5YCrx7aGm3ivbVDlDwQqB8O1LZiI6MuzZs8rIKH2TBLk7TLLKFGVc5TP0rNT209F5fkMWM5fsx6I67fHeGjo6cKe5lysgQ/oLpn4Yd0P6rpv0FK1sunkOTXLiVXR4OpM8c4JOYkHKLOmTidrCKhVyChoj9EtiL+ilCPQAr+FeULOmlUF9yAbC+yB2hou9/1IGTpeuSlUJAzKsXfcXgMf1U666XeiEN++8GX9/8ezYGuI32HKbFDH1jJAncuJrbfjJUyt8WFMl1ezr6sKfoPuNBiLMQfnF9DBdtZrvnk+TUGQV3xdWF/gGzMipJif8DS1LV+QO4jdq0BBKtglJqS+nL8JywgUT/HlfGiBDbOSIOrhTk7c= ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968 2024-05-08T05:37:55.656 DEBUG:teuthology.orchestra.run.smithi151:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDbQNrY/faZ5LGie6GjjKQXQAxvFHK94ke+3ASL/nZHs8YkB3oR3Jva2LZPr/3S6VrkiD7uGy42Q5PFRM0D/EiidqRDdnKNkSCZFOql8GLRDuWnLjFcMg05IXjH/eX4hXTlft0LULSuSEd8hqC5YCrx7aGm3ivbVDlDwQqB8O1LZiI6MuzZs8rIKH2TBLk7TLLKFGVc5TP0rNT209F5fkMWM5fsx6I67fHeGjo6cKe5lysgQ/oLpn4Yd0P6rpv0FK1sunkOTXLiVXR4OpM8c4JOYkHKLOmTidrCKhVyChoj9EtiL+ilCPQAr+FeULOmlUF9yAbC+yB2hou9/1IGTpeuSlUJAzKsXfcXgMf1U666XeiEN++8GX9/8ezYGuI32HKbFDH1jJAncuJrbfjJUyt8WFMl1ezr6sKfoPuNBiLMQfnF9DBdtZrvnk+TUGQV3xdWF/gGzMipJif8DS1LV+QO4jdq0BBKtglJqS+nL8JywgUT/HlfGiBDbOSIOrhTk7c= ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-08T05:37:55.699 INFO:teuthology.orchestra.run.smithi151.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDbQNrY/faZ5LGie6GjjKQXQAxvFHK94ke+3ASL/nZHs8YkB3oR3Jva2LZPr/3S6VrkiD7uGy42Q5PFRM0D/EiidqRDdnKNkSCZFOql8GLRDuWnLjFcMg05IXjH/eX4hXTlft0LULSuSEd8hqC5YCrx7aGm3ivbVDlDwQqB8O1LZiI6MuzZs8rIKH2TBLk7TLLKFGVc5TP0rNT209F5fkMWM5fsx6I67fHeGjo6cKe5lysgQ/oLpn4Yd0P6rpv0FK1sunkOTXLiVXR4OpM8c4JOYkHKLOmTidrCKhVyChoj9EtiL+ilCPQAr+FeULOmlUF9yAbC+yB2hou9/1IGTpeuSlUJAzKsXfcXgMf1U666XeiEN++8GX9/8ezYGuI32HKbFDH1jJAncuJrbfjJUyt8WFMl1ezr6sKfoPuNBiLMQfnF9DBdtZrvnk+TUGQV3xdWF/gGzMipJif8DS1LV+QO4jdq0BBKtglJqS+nL8JywgUT/HlfGiBDbOSIOrhTk7c= ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968 2024-05-08T05:37:55.711 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-05-08T05:37:56.126 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:37:58.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:37:58.699+0000 7fc20dc00700 1 -- 172.21.15.82:0/2391751108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc208104570 msgr2=0x7fc208104990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:58.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:37:58.699+0000 7fc20dc00700 1 --2- 172.21.15.82:0/2391751108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc208104570 0x7fc208104990 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8009910 tx=0x7fc1f8009c20 comp rx=0 tx=0).stop 2024-05-08T05:37:58.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:37:58.699+0000 7fc20dc00700 1 -- 172.21.15.82:0/2391751108 shutdown_connections 2024-05-08T05:37:58.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:37:58.699+0000 7fc20dc00700 1 --2- 172.21.15.82:0/2391751108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc208104570 0x7fc208104990 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:58.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:37:58.699+0000 7fc20dc00700 1 -- 172.21.15.82:0/2391751108 >> 172.21.15.82:0/2391751108 conn(0x7fc2080fe4f0 msgr2=0x7fc208100910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:37:58.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:37:58.699+0000 7fc20dc00700 1 -- 172.21.15.82:0/2391751108 shutdown_connections 2024-05-08T05:37:58.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:37:58.700+0000 7fc20dc00700 1 -- 172.21.15.82:0/2391751108 wait complete. 2024-05-08T05:37:58.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:37:58.701+0000 7fc20dc00700 1 Processor -- start 2024-05-08T05:37:58.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:37:58.701+0000 7fc20dc00700 1 -- start start 2024-05-08T05:37:58.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:37:58.701+0000 7fc20dc00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc208104570 0x7fc208077160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:58.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:37:58.701+0000 7fc20dc00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc208108ef0 con 0x7fc208104570 2024-05-08T05:37:58.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:37:58.701+0000 7fc206a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc208104570 0x7fc208077160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:58.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:37:58.701+0000 7fc206a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc208104570 0x7fc208077160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60214/0 (socket says 172.21.15.82:60214) 2024-05-08T05:37:58.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:37:58.701+0000 7fc206a00700 1 -- 172.21.15.82:0/2703701604 learned_addr learned my addr 172.21.15.82:0/2703701604 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:37:58.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:37:58.702+0000 7fc206a00700 1 -- 172.21.15.82:0/2703701604 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2080776a0 con 0x7fc208104570 2024-05-08T05:37:58.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:37:58.702+0000 7fc206a00700 1 --2- 172.21.15.82:0/2703701604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc208104570 0x7fc208077160 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8005190 tx=0x7fc1f8004f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:58.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:37:58.702+0000 7fc1ff400700 1 -- 172.21.15.82:0/2703701604 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1f8027070 con 0x7fc208104570 2024-05-08T05:37:58.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:37:58.702+0000 7fc1ff400700 1 -- 172.21.15.82:0/2703701604 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc1f8022470 con 0x7fc208104570 2024-05-08T05:37:58.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:37:58.702+0000 7fc1ff400700 1 -- 172.21.15.82:0/2703701604 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1f800f5f0 con 0x7fc208104570 2024-05-08T05:37:58.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:37:58.702+0000 7fc20dc00700 1 -- 172.21.15.82:0/2703701604 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc208075890 con 0x7fc208104570 2024-05-08T05:37:58.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:37:58.703+0000 7fc20dc00700 1 -- 172.21.15.82:0/2703701604 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc208075dd0 con 0x7fc208104570 2024-05-08T05:37:58.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:37:58.704+0000 7fc20dc00700 1 -- 172.21.15.82:0/2703701604 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc208109670 con 0x7fc208104570 2024-05-08T05:37:58.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:37:58.704+0000 7fc1ff400700 1 -- 172.21.15.82:0/2703701604 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fc1f802a070 con 0x7fc208104570 2024-05-08T05:37:58.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:37:58.704+0000 7fc1ff400700 1 --2- 172.21.15.82:0/2703701604 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc1ec03e570 0x7fc1ec040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:37:58.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:37:58.704+0000 7fc1ff400700 1 -- 172.21.15.82:0/2703701604 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fc1f801e030 con 0x7fc208104570 2024-05-08T05:37:58.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:37:58.705+0000 7fc206000700 1 --2- 172.21.15.82:0/2703701604 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc1ec03e570 0x7fc1ec040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:37:58.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:37:58.705+0000 7fc206000700 1 --2- 172.21.15.82:0/2703701604 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc1ec03e570 0x7fc1ec040a30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc1f4006fd0 tx=0x7fc1f4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:37:58.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:37:58.710+0000 7fc1ff400700 1 -- 172.21.15.82:0/2703701604 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc1f8013070 con 0x7fc208104570 2024-05-08T05:37:58.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:37:58.941+0000 7fc20dc00700 1 -- 172.21.15.82:0/2703701604 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7fc208191860 con 0x7fc208104570 2024-05-08T05:37:58.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:37:58.947+0000 7fc1ff400700 1 -- 172.21.15.82:0/2703701604 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7fc1f80310c0 con 0x7fc208104570 2024-05-08T05:37:58.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:37:58.950+0000 7fc20dc00700 1 -- 172.21.15.82:0/2703701604 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc1ec03e570 msgr2=0x7fc1ec040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:58.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:37:58.950+0000 7fc20dc00700 1 --2- 172.21.15.82:0/2703701604 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc1ec03e570 0x7fc1ec040a30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc1f4006fd0 tx=0x7fc1f4006e40 comp rx=0 tx=0).stop 2024-05-08T05:37:58.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:37:58.950+0000 7fc20dc00700 1 -- 172.21.15.82:0/2703701604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc208104570 msgr2=0x7fc208077160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:37:58.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:37:58.950+0000 7fc20dc00700 1 --2- 172.21.15.82:0/2703701604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc208104570 0x7fc208077160 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8005190 tx=0x7fc1f8004f80 comp rx=0 tx=0).stop 2024-05-08T05:37:58.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:37:58.950+0000 7fc20dc00700 1 -- 172.21.15.82:0/2703701604 shutdown_connections 2024-05-08T05:37:58.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:37:58.950+0000 7fc20dc00700 1 --2- 172.21.15.82:0/2703701604 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc1ec03e570 0x7fc1ec040a30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:58.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:37:58.950+0000 7fc20dc00700 1 --2- 172.21.15.82:0/2703701604 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc208104570 0x7fc208077160 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:37:58.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:37:58.950+0000 7fc20dc00700 1 -- 172.21.15.82:0/2703701604 >> 172.21.15.82:0/2703701604 conn(0x7fc2080fe4f0 msgr2=0x7fc2080fef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:37:58.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:37:58.950+0000 7fc20dc00700 1 -- 172.21.15.82:0/2703701604 shutdown_connections 2024-05-08T05:37:58.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:37:58.951+0000 7fc20dc00700 1 -- 172.21.15.82:0/2703701604 wait complete. 2024-05-08T05:37:59.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:59 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:37:59.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:59 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:37:59.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:59 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi082", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:37:59.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:59 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:37:59.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:59 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:37:59.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:59 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:37:59.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:59 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/2703701604' entity='client.admin' 2024-05-08T05:37:59.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:59 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:37:59.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:37:59 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:37:59.783 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-05-08T05:37:59.784 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-05-08T05:38:00.213 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:38:02.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:02.160+0000 7f3bc3200700 1 -- 172.21.15.82:0/363963446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bc4109660 msgr2=0x7f3bc4109a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:38:02.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:02.160+0000 7f3bc3200700 1 --2- 172.21.15.82:0/363963446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bc4109660 0x7f3bc4109a80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4009910 tx=0x7f3bb4009c20 comp rx=0 tx=0).stop 2024-05-08T05:38:02.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:02.160+0000 7f3bc3200700 1 -- 172.21.15.82:0/363963446 shutdown_connections 2024-05-08T05:38:02.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:02.160+0000 7f3bc3200700 1 --2- 172.21.15.82:0/363963446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bc4109660 0x7f3bc4109a80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:38:02.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:02.160+0000 7f3bc3200700 1 -- 172.21.15.82:0/363963446 >> 172.21.15.82:0/363963446 conn(0x7f3bc40784c0 msgr2=0x7f3bc407a920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:38:02.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:02.161+0000 7f3bc3200700 1 -- 172.21.15.82:0/363963446 shutdown_connections 2024-05-08T05:38:02.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:02.161+0000 7f3bc3200700 1 -- 172.21.15.82:0/363963446 wait complete. 2024-05-08T05:38:02.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:02.162+0000 7f3bc3200700 1 Processor -- start 2024-05-08T05:38:02.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:02.162+0000 7f3bc3200700 1 -- start start 2024-05-08T05:38:02.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:02.162+0000 7f3bc3200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bc4109660 0x7f3bc419e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:38:02.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:02.162+0000 7f3bc3200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc410f230 con 0x7f3bc4109660 2024-05-08T05:38:02.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:02.162+0000 7f3bc1e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bc4109660 0x7f3bc419e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:38:02.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:02.162+0000 7f3bc1e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bc4109660 0x7f3bc419e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60236/0 (socket says 172.21.15.82:60236) 2024-05-08T05:38:02.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:02.162+0000 7f3bc1e00700 1 -- 172.21.15.82:0/2895694118 learned_addr learned my addr 172.21.15.82:0/2895694118 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:38:02.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:02.163+0000 7f3bc1e00700 1 -- 172.21.15.82:0/2895694118 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bc419ee80 con 0x7f3bc4109660 2024-05-08T05:38:02.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:02.163+0000 7f3bc1e00700 1 --2- 172.21.15.82:0/2895694118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bc4109660 0x7f3bc419e940 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4005190 tx=0x7f3bb4004f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:38:02.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:02.163+0000 7f3bbaa00700 1 -- 172.21.15.82:0/2895694118 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bb4027070 con 0x7f3bc4109660 2024-05-08T05:38:02.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:02.163+0000 7f3bbaa00700 1 -- 172.21.15.82:0/2895694118 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3bb4022470 con 0x7f3bc4109660 2024-05-08T05:38:02.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:02.163+0000 7f3bbaa00700 1 -- 172.21.15.82:0/2895694118 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bb400f5f0 con 0x7f3bc4109660 2024-05-08T05:38:02.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:02.163+0000 7f3bc3200700 1 -- 172.21.15.82:0/2895694118 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bc419f110 con 0x7f3bc4109660 2024-05-08T05:38:02.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:02.164+0000 7f3bc3200700 1 -- 172.21.15.82:0/2895694118 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bc41a1e00 con 0x7f3bc4109660 2024-05-08T05:38:02.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:02.165+0000 7f3bbaa00700 1 -- 172.21.15.82:0/2895694118 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f3bb402a070 con 0x7f3bc4109660 2024-05-08T05:38:02.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:02.165+0000 7f3bc3200700 1 -- 172.21.15.82:0/2895694118 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bc410f9b0 con 0x7f3bc4109660 2024-05-08T05:38:02.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:02.165+0000 7f3bbaa00700 1 --2- 172.21.15.82:0/2895694118 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3ba803e570 0x7f3ba8040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:38:02.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:02.165+0000 7f3bbaa00700 1 -- 172.21.15.82:0/2895694118 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f3bb401e030 con 0x7f3bc4109660 2024-05-08T05:38:02.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:02.166+0000 7f3bc1400700 1 --2- 172.21.15.82:0/2895694118 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3ba803e570 0x7f3ba8040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:38:02.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:02.166+0000 7f3bc1400700 1 --2- 172.21.15.82:0/2895694118 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3ba803e570 0x7f3ba8040a30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0006fd0 tx=0x7f3bb0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:38:02.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:02.171+0000 7f3bbaa00700 1 -- 172.21.15.82:0/2895694118 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f3bb4013070 con 0x7f3bc4109660 2024-05-08T05:38:02.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:02.408+0000 7f3bc3200700 1 -- 172.21.15.82:0/2895694118 --> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f3bc402e620 con 0x7f3ba803e570 2024-05-08T05:38:02.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:02.415+0000 7f3bbaa00700 1 -- 172.21.15.82:0/2895694118 <== mgr.14152 v2:172.21.15.82:6800/4089180091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3bc402e620 con 0x7f3ba803e570 2024-05-08T05:38:02.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:02.418+0000 7f3bc3200700 1 -- 172.21.15.82:0/2895694118 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3ba803e570 msgr2=0x7f3ba8040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:38:02.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:02.418+0000 7f3bc3200700 1 --2- 172.21.15.82:0/2895694118 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3ba803e570 0x7f3ba8040a30 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0006fd0 tx=0x7f3bb0006e40 comp rx=0 tx=0).stop 2024-05-08T05:38:02.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:02.418+0000 7f3bc3200700 1 -- 172.21.15.82:0/2895694118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bc4109660 msgr2=0x7f3bc419e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:38:02.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:02.418+0000 7f3bc3200700 1 --2- 172.21.15.82:0/2895694118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bc4109660 0x7f3bc419e940 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4005190 tx=0x7f3bb4004f80 comp rx=0 tx=0).stop 2024-05-08T05:38:02.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:02.418+0000 7f3bc3200700 1 -- 172.21.15.82:0/2895694118 shutdown_connections 2024-05-08T05:38:02.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:02.418+0000 7f3bc3200700 1 --2- 172.21.15.82:0/2895694118 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3ba803e570 0x7f3ba8040a30 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:38:02.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:02.418+0000 7f3bc3200700 1 --2- 172.21.15.82:0/2895694118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3bc4109660 0x7f3bc419e940 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:38:02.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:02.419+0000 7f3bc3200700 1 -- 172.21.15.82:0/2895694118 >> 172.21.15.82:0/2895694118 conn(0x7f3bc40784c0 msgr2=0x7f3bc4078f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:38:02.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:02.419+0000 7f3bc3200700 1 -- 172.21.15.82:0/2895694118 shutdown_connections 2024-05-08T05:38:02.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:02.419+0000 7f3bc3200700 1 -- 172.21.15.82:0/2895694118 wait complete. 2024-05-08T05:38:03.204 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi134 2024-05-08T05:38:03.204 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-05-08T05:38:03.204 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/etc/ceph/ceph.conf 2024-05-08T05:38:03.223 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-05-08T05:38:03.223 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-08T05:38:03.280 INFO:tasks.cephadm:Adding host smithi134 to orchestrator... 2024-05-08T05:38:03.281 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph orch host add smithi134 2024-05-08T05:38:03.690 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:38:03.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:03 smithi082 ceph-mon[30098]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:38:03.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:03 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:03.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:03 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:38:03.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:03 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:38:03.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:03 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:38:03.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:03 smithi082 ceph-mon[30098]: Updating smithi082:/etc/ceph/ceph.conf 2024-05-08T05:38:04.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:04 smithi082 ceph-mon[30098]: Updating smithi082:/var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T05:38:04.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:04 smithi082 ceph-mon[30098]: Updating smithi082:/etc/ceph/ceph.client.admin.keyring 2024-05-08T05:38:05.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:05.755+0000 7efd8f400700 1 -- 172.21.15.82:0/4276336411 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd88108f40 msgr2=0x7efd88109320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:38:05.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:05.755+0000 7efd8f400700 1 --2- 172.21.15.82:0/4276336411 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd88108f40 0x7efd88109320 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7efd7c009910 tx=0x7efd7c009c20 comp rx=0 tx=0).stop 2024-05-08T05:38:05.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:05.755+0000 7efd8f400700 1 -- 172.21.15.82:0/4276336411 shutdown_connections 2024-05-08T05:38:05.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:05.755+0000 7efd8f400700 1 --2- 172.21.15.82:0/4276336411 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd88108f40 0x7efd88109320 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:38:05.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:05.756+0000 7efd8f400700 1 -- 172.21.15.82:0/4276336411 >> 172.21.15.82:0/4276336411 conn(0x7efd88077900 msgr2=0x7efd88077d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:38:05.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:05.756+0000 7efd8f400700 1 -- 172.21.15.82:0/4276336411 shutdown_connections 2024-05-08T05:38:05.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:05.756+0000 7efd8f400700 1 -- 172.21.15.82:0/4276336411 wait complete. 2024-05-08T05:38:05.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:05.757+0000 7efd8f400700 1 Processor -- start 2024-05-08T05:38:05.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:05.757+0000 7efd8f400700 1 -- start start 2024-05-08T05:38:05.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:05.758+0000 7efd8f400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd88108f40 0x7efd8819e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:38:05.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:05.758+0000 7efd8f400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efd8810d380 con 0x7efd88108f40 2024-05-08T05:38:05.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:05.758+0000 7efd8ca00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd88108f40 0x7efd8819e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:38:05.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:05.758+0000 7efd8ca00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd88108f40 0x7efd8819e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47372/0 (socket says 172.21.15.82:47372) 2024-05-08T05:38:05.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:05.758+0000 7efd8ca00700 1 -- 172.21.15.82:0/1295285818 learned_addr learned my addr 172.21.15.82:0/1295285818 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:38:05.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:05.759+0000 7efd8ca00700 1 -- 172.21.15.82:0/1295285818 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd8819ebe0 con 0x7efd88108f40 2024-05-08T05:38:05.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:05.759+0000 7efd8ca00700 1 --2- 172.21.15.82:0/1295285818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd88108f40 0x7efd8819e6a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efd7c006010 tx=0x7efd7c005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:38:05.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:05.759+0000 7efd85600700 1 -- 172.21.15.82:0/1295285818 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd7c026070 con 0x7efd88108f40 2024-05-08T05:38:05.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:05.759+0000 7efd85600700 1 -- 172.21.15.82:0/1295285818 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd7c00bba0 con 0x7efd88108f40 2024-05-08T05:38:05.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:05.759+0000 7efd8f400700 1 -- 172.21.15.82:0/1295285818 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd8819eed0 con 0x7efd88108f40 2024-05-08T05:38:05.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:05.759+0000 7efd85600700 1 -- 172.21.15.82:0/1295285818 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efd7c003910 con 0x7efd88108f40 2024-05-08T05:38:05.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:05.759+0000 7efd8f400700 1 -- 172.21.15.82:0/1295285818 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd88198820 con 0x7efd88108f40 2024-05-08T05:38:05.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:05.760+0000 7efd8f400700 1 -- 172.21.15.82:0/1295285818 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd881045f0 con 0x7efd88108f40 2024-05-08T05:38:05.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:05.761+0000 7efd85600700 1 -- 172.21.15.82:0/1295285818 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7efd7c029070 con 0x7efd88108f40 2024-05-08T05:38:05.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:05.761+0000 7efd85600700 1 --2- 172.21.15.82:0/1295285818 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7efd7003e510 0x7efd700409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:38:05.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:05.761+0000 7efd85600700 1 -- 172.21.15.82:0/1295285818 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7efd7c01e070 con 0x7efd88108f40 2024-05-08T05:38:05.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:05.762+0000 7efd87e00700 1 --2- 172.21.15.82:0/1295285818 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7efd7003e510 0x7efd700409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:38:05.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:05.762+0000 7efd87e00700 1 --2- 172.21.15.82:0/1295285818 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7efd7003e510 0x7efd700409d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7efd78006fd0 tx=0x7efd78006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:38:05.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:05.767+0000 7efd85600700 1 -- 172.21.15.82:0/1295285818 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7efd7c013070 con 0x7efd88108f40 2024-05-08T05:38:05.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:05 smithi082 ceph-mon[30098]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:38:05.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:05 smithi082 ceph-mon[30098]: Updating smithi082:/var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-08T05:38:05.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:05 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:05.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:05 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:05.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:05 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:06.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:06.005+0000 7efd8f400700 1 -- 172.21.15.82:0/1295285818 --> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi134", "target": ["mon-mgr", ""]}) -- 0x7efd88064b60 con 0x7efd7003e510 2024-05-08T05:38:08.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:07 smithi082 ceph-mon[30098]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:38:08.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:07 smithi082 ceph-mon[30098]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi134", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:38:08.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:07 smithi082 ceph-mon[30098]: Deploying cephadm binary to smithi134 2024-05-08T05:38:10.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:09 smithi082 ceph-mon[30098]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:38:10.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:10.687+0000 7efd85600700 1 -- 172.21.15.82:0/1295285818 <== mgr.14152 v2:172.21.15.82:6800/4089180091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7efd88064b60 con 0x7efd7003e510 2024-05-08T05:38:10.689 INFO:teuthology.orchestra.run.smithi082.stdout:Added host 'smithi134' with addr '172.21.15.134' 2024-05-08T05:38:10.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:10.691+0000 7efd8f400700 1 -- 172.21.15.82:0/1295285818 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7efd7003e510 msgr2=0x7efd700409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:38:10.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:10.691+0000 7efd8f400700 1 --2- 172.21.15.82:0/1295285818 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7efd7003e510 0x7efd700409d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7efd78006fd0 tx=0x7efd78006e40 comp rx=0 tx=0).stop 2024-05-08T05:38:10.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:10.691+0000 7efd8f400700 1 -- 172.21.15.82:0/1295285818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd88108f40 msgr2=0x7efd8819e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:38:10.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:10.691+0000 7efd8f400700 1 --2- 172.21.15.82:0/1295285818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd88108f40 0x7efd8819e6a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efd7c006010 tx=0x7efd7c005780 comp rx=0 tx=0).stop 2024-05-08T05:38:10.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:10.691+0000 7efd8f400700 1 -- 172.21.15.82:0/1295285818 shutdown_connections 2024-05-08T05:38:10.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:10.691+0000 7efd8f400700 1 --2- 172.21.15.82:0/1295285818 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7efd7003e510 0x7efd700409d0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:38:10.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:10.691+0000 7efd8f400700 1 --2- 172.21.15.82:0/1295285818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd88108f40 0x7efd8819e6a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:38:10.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:10.691+0000 7efd8f400700 1 -- 172.21.15.82:0/1295285818 >> 172.21.15.82:0/1295285818 conn(0x7efd88077900 msgr2=0x7efd880ff330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:38:10.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:10.692+0000 7efd8f400700 1 -- 172.21.15.82:0/1295285818 shutdown_connections 2024-05-08T05:38:10.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:10.692+0000 7efd8f400700 1 -- 172.21.15.82:0/1295285818 wait complete. 2024-05-08T05:38:11.419 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph orch host ls --format=json 2024-05-08T05:38:11.854 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:38:11.974 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:11 smithi082 ceph-mon[30098]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:38:11.974 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:11 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:11.974 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:11 smithi082 ceph-mon[30098]: Added host smithi134 2024-05-08T05:38:11.975 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:11 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:38:11.975 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:11 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:13.001 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:12 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:13.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:13.839+0000 7f5ae7600700 1 -- 172.21.15.82:0/3033398609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ae0075840 msgr2=0x7f5ae0075c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:38:13.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:13.839+0000 7f5ae7600700 1 --2- 172.21.15.82:0/3033398609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ae0075840 0x7f5ae0075c20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4009910 tx=0x7f5ad4009c20 comp rx=0 tx=0).stop 2024-05-08T05:38:13.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:13.839+0000 7f5ae7600700 1 -- 172.21.15.82:0/3033398609 shutdown_connections 2024-05-08T05:38:13.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:13.839+0000 7f5ae7600700 1 --2- 172.21.15.82:0/3033398609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ae0075840 0x7f5ae0075c20 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:38:13.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:13.839+0000 7f5ae7600700 1 -- 172.21.15.82:0/3033398609 >> 172.21.15.82:0/3033398609 conn(0x7f5ae00fe9e0 msgr2=0x7f5ae0100e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:38:13.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:13.839+0000 7f5ae7600700 1 -- 172.21.15.82:0/3033398609 shutdown_connections 2024-05-08T05:38:13.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:13.839+0000 7f5ae7600700 1 -- 172.21.15.82:0/3033398609 wait complete. 2024-05-08T05:38:13.841 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:13 smithi082 ceph-mon[30098]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:38:13.841 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:13 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:13.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:13.840+0000 7f5ae7600700 1 Processor -- start 2024-05-08T05:38:13.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:13.840+0000 7f5ae7600700 1 -- start start 2024-05-08T05:38:13.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:13.841+0000 7f5ae7600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ae0075840 0x7f5ae019ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:38:13.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:13.841+0000 7f5ae7600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5ae0113a00 con 0x7f5ae0075840 2024-05-08T05:38:13.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:13.841+0000 7f5ae4c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ae0075840 0x7f5ae019ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:38:13.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:13.841+0000 7f5ae4c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ae0075840 0x7f5ae019ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52134/0 (socket says 172.21.15.82:52134) 2024-05-08T05:38:13.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:13.841+0000 7f5ae4c00700 1 -- 172.21.15.82:0/21847135 learned_addr learned my addr 172.21.15.82:0/21847135 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:38:13.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:13.841+0000 7f5ae4c00700 1 -- 172.21.15.82:0/21847135 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ae019f470 con 0x7f5ae0075840 2024-05-08T05:38:13.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:13.842+0000 7f5ae4c00700 1 --2- 172.21.15.82:0/21847135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ae0075840 0x7f5ae019ef30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5ad40056d0 tx=0x7f5ad40057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:38:13.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:13.842+0000 7f5add600700 1 -- 172.21.15.82:0/21847135 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ad4026070 con 0x7f5ae0075840 2024-05-08T05:38:13.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:13.842+0000 7f5add600700 1 -- 172.21.15.82:0/21847135 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5ad4004370 con 0x7f5ae0075840 2024-05-08T05:38:13.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:13.842+0000 7f5ae7600700 1 -- 172.21.15.82:0/21847135 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ae019f700 con 0x7f5ae0075840 2024-05-08T05:38:13.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:13.842+0000 7f5add600700 1 -- 172.21.15.82:0/21847135 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5ad40039b0 con 0x7f5ae0075840 2024-05-08T05:38:13.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:13.842+0000 7f5ae7600700 1 -- 172.21.15.82:0/21847135 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ae019fb60 con 0x7f5ae0075840 2024-05-08T05:38:13.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:13.843+0000 7f5ae7600700 1 -- 172.21.15.82:0/21847135 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ae0076f80 con 0x7f5ae0075840 2024-05-08T05:38:13.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:13.843+0000 7f5add600700 1 -- 172.21.15.82:0/21847135 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f5ad4029070 con 0x7f5ae0075840 2024-05-08T05:38:13.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:13.844+0000 7f5add600700 1 --2- 172.21.15.82:0/21847135 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f5ac803e570 0x7f5ac8040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:38:13.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:13.844+0000 7f5add600700 1 -- 172.21.15.82:0/21847135 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f5ad401e070 con 0x7f5ae0075840 2024-05-08T05:38:13.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:13.844+0000 7f5adfe00700 1 --2- 172.21.15.82:0/21847135 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f5ac803e570 0x7f5ac8040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:38:13.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:13.845+0000 7f5adfe00700 1 --2- 172.21.15.82:0/21847135 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f5ac803e570 0x7f5ac8040a30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5acc006fd0 tx=0x7f5acc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:38:13.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:13.850+0000 7f5add600700 1 -- 172.21.15.82:0/21847135 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5ad4013070 con 0x7f5ae0075840 2024-05-08T05:38:14.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:14.092+0000 7f5ae7600700 1 -- 172.21.15.82:0/21847135 --> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5ae01a0300 con 0x7f5ac803e570 2024-05-08T05:38:14.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:14.094+0000 7f5add600700 1 -- 172.21.15.82:0/21847135 <== mgr.14152 v2:172.21.15.82:6800/4089180091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+160 (secure 0 0 0) 0x7f5ae01a0300 con 0x7f5ac803e570 2024-05-08T05:38:14.094 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:38:14.094 INFO:teuthology.orchestra.run.smithi082.stdout:[{"addr": "172.21.15.82", "hostname": "smithi082", "labels": [], "status": ""}, {"addr": "172.21.15.134", "hostname": "smithi134", "labels": [], "status": ""}] 2024-05-08T05:38:14.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:14.097+0000 7f5ae7600700 1 -- 172.21.15.82:0/21847135 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f5ac803e570 msgr2=0x7f5ac8040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:38:14.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:14.097+0000 7f5ae7600700 1 --2- 172.21.15.82:0/21847135 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f5ac803e570 0x7f5ac8040a30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5acc006fd0 tx=0x7f5acc006e40 comp rx=0 tx=0).stop 2024-05-08T05:38:14.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:14.097+0000 7f5ae7600700 1 -- 172.21.15.82:0/21847135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ae0075840 msgr2=0x7f5ae019ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:38:14.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:14.097+0000 7f5ae7600700 1 --2- 172.21.15.82:0/21847135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ae0075840 0x7f5ae019ef30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5ad40056d0 tx=0x7f5ad40057b0 comp rx=0 tx=0).stop 2024-05-08T05:38:14.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:14.097+0000 7f5ae7600700 1 -- 172.21.15.82:0/21847135 shutdown_connections 2024-05-08T05:38:14.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:14.097+0000 7f5ae7600700 1 --2- 172.21.15.82:0/21847135 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f5ac803e570 0x7f5ac8040a30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:38:14.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:14.097+0000 7f5ae7600700 1 --2- 172.21.15.82:0/21847135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ae0075840 0x7f5ae019ef30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:38:14.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:14.097+0000 7f5ae7600700 1 -- 172.21.15.82:0/21847135 >> 172.21.15.82:0/21847135 conn(0x7f5ae00fe9e0 msgr2=0x7f5ae00fedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:38:14.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:14.097+0000 7f5ae7600700 1 -- 172.21.15.82:0/21847135 shutdown_connections 2024-05-08T05:38:14.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:14.097+0000 7f5ae7600700 1 -- 172.21.15.82:0/21847135 wait complete. 2024-05-08T05:38:14.772 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi151 2024-05-08T05:38:14.772 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-05-08T05:38:14.772 DEBUG:teuthology.orchestra.run.smithi151:> dd of=/etc/ceph/ceph.conf 2024-05-08T05:38:14.790 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-05-08T05:38:14.791 DEBUG:teuthology.orchestra.run.smithi151:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-08T05:38:14.848 INFO:tasks.cephadm:Adding host smithi151 to orchestrator... 2024-05-08T05:38:14.848 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph orch host add smithi151 2024-05-08T05:38:15.275 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:38:16.057 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:15 smithi082 ceph-mon[30098]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:38:16.058 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:15 smithi082 ceph-mon[30098]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T05:38:17.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:17.167+0000 7f9d65000700 1 -- 172.21.15.82:0/66635549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d6006a8c0 msgr2=0x7f9d6006aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:38:17.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:17.167+0000 7f9d65000700 1 --2- 172.21.15.82:0/66635549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d6006a8c0 0x7f9d6006aca0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9d50009910 tx=0x7f9d50009c20 comp rx=0 tx=0).stop 2024-05-08T05:38:17.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:17.167+0000 7f9d65000700 1 -- 172.21.15.82:0/66635549 shutdown_connections 2024-05-08T05:38:17.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:17.167+0000 7f9d65000700 1 --2- 172.21.15.82:0/66635549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d6006a8c0 0x7f9d6006aca0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:38:17.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:17.167+0000 7f9d65000700 1 -- 172.21.15.82:0/66635549 >> 172.21.15.82:0/66635549 conn(0x7f9d60077900 msgr2=0x7f9d60077d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:38:17.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:17.167+0000 7f9d65000700 1 -- 172.21.15.82:0/66635549 shutdown_connections 2024-05-08T05:38:17.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:17.167+0000 7f9d65000700 1 -- 172.21.15.82:0/66635549 wait complete. 2024-05-08T05:38:17.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:17.168+0000 7f9d65000700 1 Processor -- start 2024-05-08T05:38:17.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:17.169+0000 7f9d65000700 1 -- start start 2024-05-08T05:38:17.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:17.169+0000 7f9d65000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d6006a8c0 0x7f9d601a07d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:38:17.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:17.169+0000 7f9d65000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9d6010f5f0 con 0x7f9d6006a8c0 2024-05-08T05:38:17.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:17.169+0000 7f9d5de00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d6006a8c0 0x7f9d601a07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:38:17.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:17.169+0000 7f9d5de00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d6006a8c0 0x7f9d601a07d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52152/0 (socket says 172.21.15.82:52152) 2024-05-08T05:38:17.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:17.169+0000 7f9d5de00700 1 -- 172.21.15.82:0/4162158303 learned_addr learned my addr 172.21.15.82:0/4162158303 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:38:17.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:17.170+0000 7f9d5de00700 1 -- 172.21.15.82:0/4162158303 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d601a0d10 con 0x7f9d6006a8c0 2024-05-08T05:38:17.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:17.170+0000 7f9d5de00700 1 --2- 172.21.15.82:0/4162158303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d6006a8c0 0x7f9d601a07d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9d50006010 tx=0x7f9d50005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:38:17.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:17.170+0000 7f9d56a00700 1 -- 172.21.15.82:0/4162158303 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d50026070 con 0x7f9d6006a8c0 2024-05-08T05:38:17.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:17.170+0000 7f9d56a00700 1 -- 172.21.15.82:0/4162158303 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d5000bc00 con 0x7f9d6006a8c0 2024-05-08T05:38:17.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:17.170+0000 7f9d65000700 1 -- 172.21.15.82:0/4162158303 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d601a0fa0 con 0x7f9d6006a8c0 2024-05-08T05:38:17.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:17.171+0000 7f9d56a00700 1 -- 172.21.15.82:0/4162158303 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d50003910 con 0x7f9d6006a8c0 2024-05-08T05:38:17.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:17.171+0000 7f9d65000700 1 -- 172.21.15.82:0/4162158303 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d6019a990 con 0x7f9d6006a8c0 2024-05-08T05:38:17.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:17.172+0000 7f9d56a00700 1 -- 172.21.15.82:0/4162158303 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f9d50029070 con 0x7f9d6006a8c0 2024-05-08T05:38:17.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:17.172+0000 7f9d65000700 1 -- 172.21.15.82:0/4162158303 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d601023d0 con 0x7f9d6006a8c0 2024-05-08T05:38:17.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:17.173+0000 7f9d56a00700 1 --2- 172.21.15.82:0/4162158303 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9d4403e570 0x7f9d44040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:38:17.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:17.173+0000 7f9d56a00700 1 -- 172.21.15.82:0/4162158303 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f9d5001e070 con 0x7f9d6006a8c0 2024-05-08T05:38:17.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:17.173+0000 7f9d5d400700 1 --2- 172.21.15.82:0/4162158303 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9d4403e570 0x7f9d44040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:38:17.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:17.174+0000 7f9d5d400700 1 --2- 172.21.15.82:0/4162158303 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9d4403e570 0x7f9d44040a30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c006fd0 tx=0x7f9d4c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:38:17.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:17.179+0000 7f9d56a00700 1 -- 172.21.15.82:0/4162158303 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9d50013070 con 0x7f9d6006a8c0 2024-05-08T05:38:17.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:17.416+0000 7f9d65000700 1 -- 172.21.15.82:0/4162158303 --> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi151", "target": ["mon-mgr", ""]}) -- 0x7f9d6019bec0 con 0x7f9d4403e570 2024-05-08T05:38:17.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:17 smithi082 ceph-mon[30098]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:38:17.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:17 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:17.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:17 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:17.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:17 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:17.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:17 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:17.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:17 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi134", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:38:17.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:17 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:38:17.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:17 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:38:17.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:17 smithi082 ceph-mon[30098]: Updating smithi134:/etc/ceph/ceph.conf 2024-05-08T05:38:18.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:18 smithi082 ceph-mon[30098]: Updating smithi134:/var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T05:38:18.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:18 smithi082 ceph-mon[30098]: Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2024-05-08T05:38:18.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:18 smithi082 ceph-mon[30098]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi151", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:38:18.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:18 smithi082 ceph-mon[30098]: Updating smithi134:/var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-08T05:38:18.722 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:18 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:18.722 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:18 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:18.722 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:18 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:19.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:19 smithi082 ceph-mon[30098]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:38:19.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:19 smithi082 ceph-mon[30098]: Deploying cephadm binary to smithi151 2024-05-08T05:38:21.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:21 smithi082 ceph-mon[30098]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:38:22.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:22.123+0000 7f9d56a00700 1 -- 172.21.15.82:0/4162158303 <== mgr.14152 v2:172.21.15.82:6800/4089180091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f9d6019bec0 con 0x7f9d4403e570 2024-05-08T05:38:22.125 INFO:teuthology.orchestra.run.smithi082.stdout:Added host 'smithi151' with addr '172.21.15.151' 2024-05-08T05:38:22.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:22.128+0000 7f9d65000700 1 -- 172.21.15.82:0/4162158303 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9d4403e570 msgr2=0x7f9d44040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:38:22.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:22.128+0000 7f9d65000700 1 --2- 172.21.15.82:0/4162158303 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9d4403e570 0x7f9d44040a30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c006fd0 tx=0x7f9d4c006e40 comp rx=0 tx=0).stop 2024-05-08T05:38:22.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:22.128+0000 7f9d65000700 1 -- 172.21.15.82:0/4162158303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d6006a8c0 msgr2=0x7f9d601a07d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:38:22.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:22.128+0000 7f9d65000700 1 --2- 172.21.15.82:0/4162158303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d6006a8c0 0x7f9d601a07d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9d50006010 tx=0x7f9d50005780 comp rx=0 tx=0).stop 2024-05-08T05:38:22.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:22.128+0000 7f9d65000700 1 -- 172.21.15.82:0/4162158303 shutdown_connections 2024-05-08T05:38:22.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:22.128+0000 7f9d65000700 1 --2- 172.21.15.82:0/4162158303 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9d4403e570 0x7f9d44040a30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:38:22.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:22.128+0000 7f9d65000700 1 --2- 172.21.15.82:0/4162158303 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d6006a8c0 0x7f9d601a07d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:38:22.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:22.128+0000 7f9d65000700 1 -- 172.21.15.82:0/4162158303 >> 172.21.15.82:0/4162158303 conn(0x7f9d60077900 msgr2=0x7f9d6010a420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:38:22.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:22.129+0000 7f9d65000700 1 -- 172.21.15.82:0/4162158303 shutdown_connections 2024-05-08T05:38:22.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:22.129+0000 7f9d65000700 1 -- 172.21.15.82:0/4162158303 wait complete. 2024-05-08T05:38:22.795 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph orch host ls --format=json 2024-05-08T05:38:23.227 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:38:23.373 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:23 smithi082 ceph-mon[30098]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:38:23.373 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:23 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:23.373 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:23 smithi082 ceph-mon[30098]: Added host smithi151 2024-05-08T05:38:23.374 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:23 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:38:23.374 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:23 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:24.424 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:24 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:25.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:25.206+0000 7fba8e000700 1 -- 172.21.15.82:0/927657866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba8810e4e0 msgr2=0x7fba8810e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:38:25.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:25.206+0000 7fba8e000700 1 --2- 172.21.15.82:0/927657866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba8810e4e0 0x7fba8810e8c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fba78009910 tx=0x7fba78009c20 comp rx=0 tx=0).stop 2024-05-08T05:38:25.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:25.206+0000 7fba8e000700 1 -- 172.21.15.82:0/927657866 shutdown_connections 2024-05-08T05:38:25.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:25.206+0000 7fba8e000700 1 --2- 172.21.15.82:0/927657866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba8810e4e0 0x7fba8810e8c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:38:25.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:25.206+0000 7fba8e000700 1 -- 172.21.15.82:0/927657866 >> 172.21.15.82:0/927657866 conn(0x7fba88078c40 msgr2=0x7fba8807b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:38:25.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:25.207+0000 7fba8e000700 1 -- 172.21.15.82:0/927657866 shutdown_connections 2024-05-08T05:38:25.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:25.207+0000 7fba8e000700 1 -- 172.21.15.82:0/927657866 wait complete. 2024-05-08T05:38:25.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:25.208+0000 7fba8e000700 1 Processor -- start 2024-05-08T05:38:25.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:25.208+0000 7fba8e000700 1 -- start start 2024-05-08T05:38:25.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:25.208+0000 7fba8e000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba8810e4e0 0x7fba8819eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:38:25.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:25.208+0000 7fba8e000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fba88113a00 con 0x7fba8810e4e0 2024-05-08T05:38:25.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:25.209+0000 7fba87400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba8810e4e0 0x7fba8819eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:38:25.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:25.209+0000 7fba87400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba8810e4e0 0x7fba8819eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50550/0 (socket says 172.21.15.82:50550) 2024-05-08T05:38:25.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:25.209+0000 7fba87400700 1 -- 172.21.15.82:0/2511769338 learned_addr learned my addr 172.21.15.82:0/2511769338 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:38:25.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:25.209+0000 7fba87400700 1 -- 172.21.15.82:0/2511769338 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba8819f430 con 0x7fba8810e4e0 2024-05-08T05:38:25.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:25.210+0000 7fba87400700 1 --2- 172.21.15.82:0/2511769338 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba8810e4e0 0x7fba8819eef0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fba780092e0 tx=0x7fba78005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:38:25.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:25.210+0000 7fba7fe00700 1 -- 172.21.15.82:0/2511769338 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba78026070 con 0x7fba8810e4e0 2024-05-08T05:38:25.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:25.210+0000 7fba7fe00700 1 -- 172.21.15.82:0/2511769338 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba7800b750 con 0x7fba8810e4e0 2024-05-08T05:38:25.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:25.210+0000 7fba8e000700 1 -- 172.21.15.82:0/2511769338 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba8819f6c0 con 0x7fba8810e4e0 2024-05-08T05:38:25.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:25.210+0000 7fba7fe00700 1 -- 172.21.15.82:0/2511769338 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fba780038a0 con 0x7fba8810e4e0 2024-05-08T05:38:25.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:25.210+0000 7fba8e000700 1 -- 172.21.15.82:0/2511769338 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba881a3770 con 0x7fba8810e4e0 2024-05-08T05:38:25.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:25.211+0000 7fba7fe00700 1 -- 172.21.15.82:0/2511769338 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fba78029070 con 0x7fba8810e4e0 2024-05-08T05:38:25.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:25.211+0000 7fba8e000700 1 -- 172.21.15.82:0/2511769338 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba8810abe0 con 0x7fba8810e4e0 2024-05-08T05:38:25.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:25.212+0000 7fba7fe00700 1 --2- 172.21.15.82:0/2511769338 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fba6c03e570 0x7fba6c040a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:38:25.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:25.212+0000 7fba7fe00700 1 -- 172.21.15.82:0/2511769338 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fba7801e070 con 0x7fba8810e4e0 2024-05-08T05:38:25.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:25.212+0000 7fba86a00700 1 --2- 172.21.15.82:0/2511769338 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fba6c03e570 0x7fba6c040a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:38:25.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:25.213+0000 7fba86a00700 1 --2- 172.21.15.82:0/2511769338 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fba6c03e570 0x7fba6c040a30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fba74006fd0 tx=0x7fba74006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:38:25.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:25.218+0000 7fba7fe00700 1 -- 172.21.15.82:0/2511769338 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fba78013070 con 0x7fba8810e4e0 2024-05-08T05:38:25.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:25.455+0000 7fba8e000700 1 -- 172.21.15.82:0/2511769338 --> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fba881a0200 con 0x7fba6c03e570 2024-05-08T05:38:25.455 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:25 smithi082 ceph-mon[30098]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:38:25.455 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:25 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:25.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:25.457+0000 7fba7fe00700 1 -- 172.21.15.82:0/2511769338 <== mgr.14152 v2:172.21.15.82:6800/4089180091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+240 (secure 0 0 0) 0x7fba881a0200 con 0x7fba6c03e570 2024-05-08T05:38:25.458 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:38:25.458 INFO:teuthology.orchestra.run.smithi082.stdout:[{"addr": "172.21.15.82", "hostname": "smithi082", "labels": [], "status": ""}, {"addr": "172.21.15.134", "hostname": "smithi134", "labels": [], "status": ""}, {"addr": "172.21.15.151", "hostname": "smithi151", "labels": [], "status": ""}] 2024-05-08T05:38:25.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:25.461+0000 7fba8e000700 1 -- 172.21.15.82:0/2511769338 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fba6c03e570 msgr2=0x7fba6c040a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:38:25.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:25.461+0000 7fba8e000700 1 --2- 172.21.15.82:0/2511769338 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fba6c03e570 0x7fba6c040a30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fba74006fd0 tx=0x7fba74006e40 comp rx=0 tx=0).stop 2024-05-08T05:38:25.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:25.461+0000 7fba8e000700 1 -- 172.21.15.82:0/2511769338 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba8810e4e0 msgr2=0x7fba8819eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:38:25.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:25.461+0000 7fba8e000700 1 --2- 172.21.15.82:0/2511769338 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba8810e4e0 0x7fba8819eef0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fba780092e0 tx=0x7fba78005780 comp rx=0 tx=0).stop 2024-05-08T05:38:25.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:25.461+0000 7fba8e000700 1 -- 172.21.15.82:0/2511769338 shutdown_connections 2024-05-08T05:38:25.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:25.461+0000 7fba8e000700 1 --2- 172.21.15.82:0/2511769338 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fba6c03e570 0x7fba6c040a30 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:38:25.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:25.461+0000 7fba8e000700 1 --2- 172.21.15.82:0/2511769338 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba8810e4e0 0x7fba8819eef0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:38:25.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:25.461+0000 7fba8e000700 1 -- 172.21.15.82:0/2511769338 >> 172.21.15.82:0/2511769338 conn(0x7fba88078c40 msgr2=0x7fba88111040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:38:25.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:25.461+0000 7fba8e000700 1 -- 172.21.15.82:0/2511769338 shutdown_connections 2024-05-08T05:38:25.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:25.461+0000 7fba8e000700 1 -- 172.21.15.82:0/2511769338 wait complete. 2024-05-08T05:38:26.119 INFO:tasks.cephadm:Setting crush tunables to default 2024-05-08T05:38:26.119 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph osd crush tunables default 2024-05-08T05:38:26.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:26 smithi082 ceph-mon[30098]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T05:38:26.556 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:38:27.593 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:27 smithi082 ceph-mon[30098]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:38:28.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:28.377+0000 7fe641e00700 1 -- 172.21.15.82:0/2213925432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe63c103110 msgr2=0x7fe63c1034f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:38:28.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:28.377+0000 7fe641e00700 1 --2- 172.21.15.82:0/2213925432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe63c103110 0x7fe63c1034f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe62c009910 tx=0x7fe62c009c20 comp rx=0 tx=0).stop 2024-05-08T05:38:28.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:28.377+0000 7fe641e00700 1 -- 172.21.15.82:0/2213925432 shutdown_connections 2024-05-08T05:38:28.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:28.377+0000 7fe641e00700 1 --2- 172.21.15.82:0/2213925432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe63c103110 0x7fe63c1034f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:38:28.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:28.377+0000 7fe641e00700 1 -- 172.21.15.82:0/2213925432 >> 172.21.15.82:0/2213925432 conn(0x7fe63c0fe9e0 msgr2=0x7fe63c100e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:38:28.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:28.377+0000 7fe641e00700 1 -- 172.21.15.82:0/2213925432 shutdown_connections 2024-05-08T05:38:28.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:28.377+0000 7fe641e00700 1 -- 172.21.15.82:0/2213925432 wait complete. 2024-05-08T05:38:28.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:28.378+0000 7fe641e00700 1 Processor -- start 2024-05-08T05:38:28.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:28.379+0000 7fe641e00700 1 -- start start 2024-05-08T05:38:28.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:28.379+0000 7fe641e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe63c103110 0x7fe63c19e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:38:28.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:28.379+0000 7fe641e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe63c10d390 con 0x7fe63c103110 2024-05-08T05:38:28.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:28.379+0000 7fe63aa00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe63c103110 0x7fe63c19e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:38:28.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:28.379+0000 7fe63aa00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe63c103110 0x7fe63c19e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50572/0 (socket says 172.21.15.82:50572) 2024-05-08T05:38:28.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:28.379+0000 7fe63aa00700 1 -- 172.21.15.82:0/2436957050 learned_addr learned my addr 172.21.15.82:0/2436957050 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:38:28.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:28.380+0000 7fe63aa00700 1 -- 172.21.15.82:0/2436957050 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe63c19eb80 con 0x7fe63c103110 2024-05-08T05:38:28.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:28.380+0000 7fe63aa00700 1 --2- 172.21.15.82:0/2436957050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe63c103110 0x7fe63c19e640 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe62c006010 tx=0x7fe62c005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:38:28.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:28.380+0000 7fe640a00700 1 -- 172.21.15.82:0/2436957050 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe62c026070 con 0x7fe63c103110 2024-05-08T05:38:28.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:28.380+0000 7fe640a00700 1 -- 172.21.15.82:0/2436957050 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe62c00bba0 con 0x7fe63c103110 2024-05-08T05:38:28.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:28.380+0000 7fe641e00700 1 -- 172.21.15.82:0/2436957050 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe63c19ee70 con 0x7fe63c103110 2024-05-08T05:38:28.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:28.380+0000 7fe640a00700 1 -- 172.21.15.82:0/2436957050 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe62c003910 con 0x7fe63c103110 2024-05-08T05:38:28.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:28.381+0000 7fe641e00700 1 -- 172.21.15.82:0/2436957050 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe63c1988e0 con 0x7fe63c103110 2024-05-08T05:38:28.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:28.382+0000 7fe640a00700 1 -- 172.21.15.82:0/2436957050 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fe62c029070 con 0x7fe63c103110 2024-05-08T05:38:28.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:28.382+0000 7fe641e00700 1 -- 172.21.15.82:0/2436957050 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe63c1045f0 con 0x7fe63c103110 2024-05-08T05:38:28.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:28.382+0000 7fe640a00700 1 --2- 172.21.15.82:0/2436957050 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fe62003e510 0x7fe6200409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:38:28.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:28.382+0000 7fe640a00700 1 -- 172.21.15.82:0/2436957050 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fe62c01e070 con 0x7fe63c103110 2024-05-08T05:38:28.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:28.383+0000 7fe63a000700 1 --2- 172.21.15.82:0/2436957050 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fe62003e510 0x7fe6200409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:38:28.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:28.383+0000 7fe63a000700 1 --2- 172.21.15.82:0/2436957050 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fe62003e510 0x7fe6200409d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe628006fd0 tx=0x7fe628006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:38:28.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:28.388+0000 7fe640a00700 1 -- 172.21.15.82:0/2436957050 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe62c013070 con 0x7fe63c103110 2024-05-08T05:38:28.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:28.632+0000 7fe641e00700 1 -- 172.21.15.82:0/2436957050 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fe63c0008d0 con 0x7fe63c103110 2024-05-08T05:38:29.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:29.259+0000 7fe640a00700 1 -- 172.21.15.82:0/2436957050 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7fe62c00d340 con 0x7fe63c103110 2024-05-08T05:38:29.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:29.264+0000 7fe641e00700 1 -- 172.21.15.82:0/2436957050 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fe62003e510 msgr2=0x7fe6200409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:38:29.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:29.264+0000 7fe641e00700 1 --2- 172.21.15.82:0/2436957050 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fe62003e510 0x7fe6200409d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe628006fd0 tx=0x7fe628006e40 comp rx=0 tx=0).stop 2024-05-08T05:38:29.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:29.264+0000 7fe641e00700 1 -- 172.21.15.82:0/2436957050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe63c103110 msgr2=0x7fe63c19e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:38:29.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:29.264+0000 7fe641e00700 1 --2- 172.21.15.82:0/2436957050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe63c103110 0x7fe63c19e640 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe62c006010 tx=0x7fe62c005780 comp rx=0 tx=0).stop 2024-05-08T05:38:29.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:29.264+0000 7fe641e00700 1 -- 172.21.15.82:0/2436957050 shutdown_connections 2024-05-08T05:38:29.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:29.264+0000 7fe641e00700 1 --2- 172.21.15.82:0/2436957050 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fe62003e510 0x7fe6200409d0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:38:29.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:29.264+0000 7fe641e00700 1 --2- 172.21.15.82:0/2436957050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe63c103110 0x7fe63c19e640 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:38:29.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:29.264+0000 7fe641e00700 1 -- 172.21.15.82:0/2436957050 >> 172.21.15.82:0/2436957050 conn(0x7fe63c0fe9e0 msgr2=0x7fe63c104ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:38:29.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:29.266+0000 7fe641e00700 1 -- 172.21.15.82:0/2436957050 shutdown_connections 2024-05-08T05:38:29.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:29.266+0000 7fe641e00700 1 -- 172.21.15.82:0/2436957050 wait complete. 2024-05-08T05:38:29.267 INFO:teuthology.orchestra.run.smithi082.stderr:adjusted tunables profile to default 2024-05-08T05:38:29.641 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:29 smithi082 ceph-mon[30098]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:38:29.642 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:29 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:29.642 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:29 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:29.642 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:29 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:29.642 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:29 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:29.642 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:29 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi151", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:38:29.642 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:29 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:38:29.642 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:29 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:38:29.642 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:29 smithi082 ceph-mon[30098]: Updating smithi151:/etc/ceph/ceph.conf 2024-05-08T05:38:29.642 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:29 smithi082 ceph-mon[30098]: Updating smithi151:/var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T05:38:29.642 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:29 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/2436957050' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-05-08T05:38:30.057 INFO:tasks.cephadm:Adding mon.a on smithi082 2024-05-08T05:38:30.057 INFO:tasks.cephadm:Adding mon.b on smithi134 2024-05-08T05:38:30.057 INFO:tasks.cephadm:Adding mon.c on smithi151 2024-05-08T05:38:30.057 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph orch apply mon '3;smithi082:172.21.15.82=a;smithi134:172.21.15.134=b;smithi151:172.21.15.151=c' 2024-05-08T05:38:30.300 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T05:38:30.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:30 smithi082 ceph-mon[30098]: Updating smithi151:/etc/ceph/ceph.client.admin.keyring 2024-05-08T05:38:30.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:30 smithi082 ceph-mon[30098]: Updating smithi151:/var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/config/ceph.client.admin.keyring 2024-05-08T05:38:30.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:30 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/2436957050' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-08T05:38:30.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:30 smithi082 ceph-mon[30098]: osdmap e4: 0 total, 0 up, 0 in 2024-05-08T05:38:30.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:30 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:30.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:30 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:30.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:30 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:31.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:31 smithi082 ceph-mon[30098]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:38:31.722 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:31.720+0000 7f6e257cb700 1 -- 172.21.15.151:0/2715968061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e20104070 msgr2=0x7f6e20104450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:38:31.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:31.720+0000 7f6e257cb700 1 --2- 172.21.15.151:0/2715968061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e20104070 0x7f6e20104450 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6e10009910 tx=0x7f6e10009c20 comp rx=0 tx=0).stop 2024-05-08T05:38:31.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:31.720+0000 7f6e257cb700 1 -- 172.21.15.151:0/2715968061 shutdown_connections 2024-05-08T05:38:31.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:31.720+0000 7f6e257cb700 1 --2- 172.21.15.151:0/2715968061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e20104070 0x7f6e20104450 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:38:31.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:31.720+0000 7f6e257cb700 1 -- 172.21.15.151:0/2715968061 >> 172.21.15.151:0/2715968061 conn(0x7f6e200fd8a0 msgr2=0x7f6e200ffcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:38:31.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:31.720+0000 7f6e257cb700 1 -- 172.21.15.151:0/2715968061 shutdown_connections 2024-05-08T05:38:31.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:31.720+0000 7f6e257cb700 1 -- 172.21.15.151:0/2715968061 wait complete. 2024-05-08T05:38:31.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:31.721+0000 7f6e257cb700 1 Processor -- start 2024-05-08T05:38:31.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:31.721+0000 7f6e257cb700 1 -- start start 2024-05-08T05:38:31.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:31.721+0000 7f6e257cb700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e20104070 0x7f6e20101cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:38:31.723 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:31.721+0000 7f6e257cb700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6e2010d410 con 0x7f6e20104070 2024-05-08T05:38:31.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:31.722+0000 7f6e1effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e20104070 0x7f6e20101cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:38:31.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:31.722+0000 7f6e1effd700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e20104070 0x7f6e20101cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.151:37390/0 (socket says 172.21.15.151:37390) 2024-05-08T05:38:31.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:31.722+0000 7f6e1effd700 1 -- 172.21.15.151:0/1007695598 learned_addr learned my addr 172.21.15.151:0/1007695598 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-05-08T05:38:31.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:31.722+0000 7f6e1effd700 1 -- 172.21.15.151:0/1007695598 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e20103b70 con 0x7f6e20104070 2024-05-08T05:38:31.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:31.723+0000 7f6e1effd700 1 --2- 172.21.15.151:0/1007695598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e20104070 0x7f6e20101cd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6e100056d0 tx=0x7f6e100057b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:38:31.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:31.723+0000 7f6e1cff9700 1 -- 172.21.15.151:0/1007695598 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e10026070 con 0x7f6e20104070 2024-05-08T05:38:31.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:31.723+0000 7f6e257cb700 1 -- 172.21.15.151:0/1007695598 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e20102210 con 0x7f6e20104070 2024-05-08T05:38:31.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:31.723+0000 7f6e257cb700 1 -- 172.21.15.151:0/1007695598 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e201026d0 con 0x7f6e20104070 2024-05-08T05:38:31.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:31.723+0000 7f6e1cff9700 1 -- 172.21.15.151:0/1007695598 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e100047d0 con 0x7f6e20104070 2024-05-08T05:38:31.725 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:31.723+0000 7f6e1cff9700 1 -- 172.21.15.151:0/1007695598 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e10030060 con 0x7f6e20104070 2024-05-08T05:38:31.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:31.724+0000 7f6e257cb700 1 -- 172.21.15.151:0/1007695598 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e00005330 con 0x7f6e20104070 2024-05-08T05:38:31.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:31.725+0000 7f6e1cff9700 1 -- 172.21.15.151:0/1007695598 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f6e10029070 con 0x7f6e20104070 2024-05-08T05:38:31.726 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:31.725+0000 7f6e1cff9700 1 --2- 172.21.15.151:0/1007695598 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f6e0c03e510 0x7f6e0c0409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:38:31.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:31.725+0000 7f6e1cff9700 1 -- 172.21.15.151:0/1007695598 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f6e1001e070 con 0x7f6e20104070 2024-05-08T05:38:31.727 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:31.726+0000 7f6e167fc700 1 --2- 172.21.15.151:0/1007695598 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f6e0c03e510 0x7f6e0c0409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:38:31.728 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:31.727+0000 7f6e167fc700 1 --2- 172.21.15.151:0/1007695598 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f6e0c03e510 0x7f6e0c0409d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6e08006fd0 tx=0x7f6e08006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:38:31.742 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:31.741+0000 7f6e1cff9700 1 -- 172.21.15.151:0/1007695598 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6e10013070 con 0x7f6e20104070 2024-05-08T05:38:31.956 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:31.955+0000 7f6e257cb700 1 -- 172.21.15.151:0/1007695598 --> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi082:172.21.15.82=a;smithi134:172.21.15.134=b;smithi151:172.21.15.151=c", "target": ["mon-mgr", ""]}) -- 0x7f6e00000c80 con 0x7f6e0c03e510 2024-05-08T05:38:31.971 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:31.971+0000 7f6e1cff9700 1 -- 172.21.15.151:0/1007695598 <== mgr.14152 v2:172.21.15.82:6800/4089180091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f6e00000c80 con 0x7f6e0c03e510 2024-05-08T05:38:31.971 INFO:teuthology.orchestra.run.smithi151.stdout:Scheduled mon update... 2024-05-08T05:38:31.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:31.973+0000 7f6e257cb700 1 -- 172.21.15.151:0/1007695598 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f6e0c03e510 msgr2=0x7f6e0c0409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:38:31.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:31.973+0000 7f6e257cb700 1 --2- 172.21.15.151:0/1007695598 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f6e0c03e510 0x7f6e0c0409d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6e08006fd0 tx=0x7f6e08006e40 comp rx=0 tx=0).stop 2024-05-08T05:38:31.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:31.973+0000 7f6e257cb700 1 -- 172.21.15.151:0/1007695598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e20104070 msgr2=0x7f6e20101cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:38:31.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:31.973+0000 7f6e257cb700 1 --2- 172.21.15.151:0/1007695598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e20104070 0x7f6e20101cd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6e100056d0 tx=0x7f6e100057b0 comp rx=0 tx=0).stop 2024-05-08T05:38:31.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:31.973+0000 7f6e257cb700 1 -- 172.21.15.151:0/1007695598 shutdown_connections 2024-05-08T05:38:31.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:31.973+0000 7f6e257cb700 1 --2- 172.21.15.151:0/1007695598 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f6e0c03e510 0x7f6e0c0409d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:38:31.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:31.973+0000 7f6e257cb700 1 --2- 172.21.15.151:0/1007695598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e20104070 0x7f6e20101cd0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:38:31.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:31.973+0000 7f6e257cb700 1 -- 172.21.15.151:0/1007695598 >> 172.21.15.151:0/1007695598 conn(0x7f6e200fd8a0 msgr2=0x7f6e20104e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:38:31.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:31.973+0000 7f6e257cb700 1 -- 172.21.15.151:0/1007695598 shutdown_connections 2024-05-08T05:38:31.974 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:31.973+0000 7f6e257cb700 1 -- 172.21.15.151:0/1007695598 wait complete. 2024-05-08T05:38:32.538 DEBUG:teuthology.orchestra.run.smithi134:mon.b> sudo journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mon.b.service 2024-05-08T05:38:32.541 DEBUG:teuthology.orchestra.run.smithi151:mon.c> sudo journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mon.c.service 2024-05-08T05:38:32.543 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-08T05:38:32.544 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-08T05:38:33.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:32 smithi082 ceph-mon[30098]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi082:172.21.15.82=a;smithi134:172.21.15.134=b;smithi151:172.21.15.151=c", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:38:33.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:32 smithi082 ceph-mon[30098]: Saving service mon spec with placement smithi082:172.21.15.82=a;smithi134:172.21.15.134=b;smithi151:172.21.15.151=c;count:3 2024-05-08T05:38:33.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:32 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:33.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:32 smithi082 ceph-mon[30098]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:38:33.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:32 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:38:33.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:32 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:38:33.472 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:32 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:38:33.472 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:32 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:33.472 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:32 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T05:38:33.472 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:32 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:38:33.472 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:32 smithi082 ceph-mon[30098]: Deploying daemon mon.c on smithi151 2024-05-08T05:38:34.154 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T05:38:35.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:35 smithi082 ceph-mon[30098]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:38:35.564 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:35.563+0000 7f7ce66a0700 1 -- 172.21.15.151:0/343018351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ce0104070 msgr2=0x7f7ce0104450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:38:35.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:35.563+0000 7f7ce66a0700 1 --2- 172.21.15.151:0/343018351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ce0104070 0x7f7ce0104450 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7cd0009910 tx=0x7f7cd0009c20 comp rx=0 tx=0).stop 2024-05-08T05:38:35.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:35.563+0000 7f7ce66a0700 1 -- 172.21.15.151:0/343018351 shutdown_connections 2024-05-08T05:38:35.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:35.563+0000 7f7ce66a0700 1 --2- 172.21.15.151:0/343018351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ce0104070 0x7f7ce0104450 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:38:35.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:35.563+0000 7f7ce66a0700 1 -- 172.21.15.151:0/343018351 >> 172.21.15.151:0/343018351 conn(0x7f7ce00fd8c0 msgr2=0x7f7ce00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:38:35.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:35.563+0000 7f7ce66a0700 1 -- 172.21.15.151:0/343018351 shutdown_connections 2024-05-08T05:38:35.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:35.563+0000 7f7ce66a0700 1 -- 172.21.15.151:0/343018351 wait complete. 2024-05-08T05:38:35.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:35.564+0000 7f7ce66a0700 1 Processor -- start 2024-05-08T05:38:35.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:35.564+0000 7f7ce66a0700 1 -- start start 2024-05-08T05:38:35.565 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:35.564+0000 7f7ce66a0700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ce0104070 0x7f7ce019e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:38:35.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:35.564+0000 7f7ce66a0700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7ce010d410 con 0x7f7ce0104070 2024-05-08T05:38:35.566 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:35.565+0000 7f7cdffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ce0104070 0x7f7ce019e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:38:35.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:35.565+0000 7f7cdffff700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ce0104070 0x7f7ce019e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.151:37416/0 (socket says 172.21.15.151:37416) 2024-05-08T05:38:35.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:35.565+0000 7f7cdffff700 1 -- 172.21.15.151:0/4016994170 learned_addr learned my addr 172.21.15.151:0/4016994170 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-05-08T05:38:35.567 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:35.566+0000 7f7cdffff700 1 -- 172.21.15.151:0/4016994170 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ce019eb60 con 0x7f7ce0104070 2024-05-08T05:38:35.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:35.566+0000 7f7cdffff700 1 --2- 172.21.15.151:0/4016994170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ce0104070 0x7f7ce019e620 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7cd0006010 tx=0x7f7cd0005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:38:35.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:35.566+0000 7f7cdd7fa700 1 -- 172.21.15.151:0/4016994170 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7cd0026070 con 0x7f7ce0104070 2024-05-08T05:38:35.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:35.566+0000 7f7ce66a0700 1 -- 172.21.15.151:0/4016994170 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ce019edf0 con 0x7f7ce0104070 2024-05-08T05:38:35.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:35.566+0000 7f7ce66a0700 1 -- 172.21.15.151:0/4016994170 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ce01987a0 con 0x7f7ce0104070 2024-05-08T05:38:35.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:35.566+0000 7f7cdd7fa700 1 -- 172.21.15.151:0/4016994170 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7cd000bc00 con 0x7f7ce0104070 2024-05-08T05:38:35.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:35.566+0000 7f7cdd7fa700 1 -- 172.21.15.151:0/4016994170 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7cd0003910 con 0x7f7ce0104070 2024-05-08T05:38:35.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:35.567+0000 7f7ce66a0700 1 -- 172.21.15.151:0/4016994170 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ccc005330 con 0x7f7ce0104070 2024-05-08T05:38:35.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:35.568+0000 7f7cdd7fa700 1 -- 172.21.15.151:0/4016994170 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f7cd0029070 con 0x7f7ce0104070 2024-05-08T05:38:35.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:35.568+0000 7f7cdd7fa700 1 --2- 172.21.15.151:0/4016994170 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7cc803e510 0x7f7cc80409d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:38:35.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:35.568+0000 7f7cdd7fa700 1 -- 172.21.15.151:0/4016994170 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f7cd001e070 con 0x7f7ce0104070 2024-05-08T05:38:35.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:35.569+0000 7f7cdf7fe700 1 --2- 172.21.15.151:0/4016994170 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7cc803e510 0x7f7cc80409d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:38:35.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:35.570+0000 7f7cdf7fe700 1 --2- 172.21.15.151:0/4016994170 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7cc803e510 0x7f7cc80409d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7cd4006fd0 tx=0x7f7cd4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:38:35.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:35.584+0000 7f7cdd7fa700 1 -- 172.21.15.151:0/4016994170 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f7cd0013070 con 0x7f7ce0104070 2024-05-08T05:38:35.875 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:35.875+0000 7f7ce66a0700 1 -- 172.21.15.151:0/4016994170 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f7ccc0058f0 con 0x7f7ce0104070 2024-05-08T05:38:35.876 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:35.876+0000 7f7cdd7fa700 1 -- 172.21.15.151:0/4016994170 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7f7cd0017440 con 0x7f7ce0104070 2024-05-08T05:38:35.877 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-08T05:38:35.877 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":1,"fsid":"c739a5c8-0cfc-11ef-bc97-c7b262605968","modified":"2024-05-08T05:36:33.349539Z","created":"2024-05-08T05:36:33.349539Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-08T05:38:35.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:35.878+0000 7f7ce66a0700 1 -- 172.21.15.151:0/4016994170 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7cc803e510 msgr2=0x7f7cc80409d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:38:35.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:35.878+0000 7f7ce66a0700 1 --2- 172.21.15.151:0/4016994170 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7cc803e510 0x7f7cc80409d0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7cd4006fd0 tx=0x7f7cd4006e40 comp rx=0 tx=0).stop 2024-05-08T05:38:35.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:35.878+0000 7f7ce66a0700 1 -- 172.21.15.151:0/4016994170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ce0104070 msgr2=0x7f7ce019e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:38:35.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:35.878+0000 7f7ce66a0700 1 --2- 172.21.15.151:0/4016994170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ce0104070 0x7f7ce019e620 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7cd0006010 tx=0x7f7cd0005780 comp rx=0 tx=0).stop 2024-05-08T05:38:35.879 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:35.878+0000 7f7ce66a0700 1 -- 172.21.15.151:0/4016994170 shutdown_connections 2024-05-08T05:38:35.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:35.878+0000 7f7ce66a0700 1 --2- 172.21.15.151:0/4016994170 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7cc803e510 0x7f7cc80409d0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:38:35.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:35.878+0000 7f7ce66a0700 1 --2- 172.21.15.151:0/4016994170 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7ce0104070 0x7f7ce019e620 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:38:35.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:35.878+0000 7f7ce66a0700 1 -- 172.21.15.151:0/4016994170 >> 172.21.15.151:0/4016994170 conn(0x7f7ce00fd8c0 msgr2=0x7f7ce0104e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:38:35.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:35.878+0000 7f7ce66a0700 1 -- 172.21.15.151:0/4016994170 shutdown_connections 2024-05-08T05:38:35.880 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:35.878+0000 7f7ce66a0700 1 -- 172.21.15.151:0/4016994170 wait complete. 2024-05-08T05:38:35.881 INFO:teuthology.orchestra.run.smithi151.stderr:dumped monmap epoch 1 2024-05-08T05:38:36.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:36 smithi082 ceph-mon[30098]: from='client.? 172.21.15.151:0/4016994170' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-08T05:38:37.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:37 smithi082 ceph-mon[30098]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:38:37.715 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-08T05:38:37.715 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-08T05:38:37.737 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:37 smithi151 systemd[1]: Started Ceph mon.c for c739a5c8-0cfc-11ef-bc97-c7b262605968. 2024-05-08T05:38:37.950 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T05:38:42.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:42.567+0000 7f0995140700 1 -- 172.21.15.151:0/3204480002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09780057d0 msgr2=0x7f0978007c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:38:42.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:42.567+0000 7f0995140700 1 --2- 172.21.15.151:0/3204480002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09780057d0 0x7f0978007c60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0990101dc0 tx=0x7f0988013e90 comp rx=0 tx=0).stop 2024-05-08T05:38:42.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:42.567+0000 7f0995140700 1 -- 172.21.15.151:0/3204480002 shutdown_connections 2024-05-08T05:38:42.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:42.567+0000 7f0995140700 1 --2- 172.21.15.151:0/3204480002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09780057d0 0x7f0978007c60 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:38:42.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:42.567+0000 7f0995140700 1 -- 172.21.15.151:0/3204480002 >> 172.21.15.151:0/3204480002 conn(0x7f09900fd9c0 msgr2=0x7f09900ffde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:38:42.568 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:42.567+0000 7f0995140700 1 -- 172.21.15.151:0/3204480002 shutdown_connections 2024-05-08T05:38:42.569 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:42.567+0000 7f0995140700 1 -- 172.21.15.151:0/3204480002 wait complete. 2024-05-08T05:38:42.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:42.568+0000 7f0995140700 1 Processor -- start 2024-05-08T05:38:42.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:42.569+0000 7f0995140700 1 -- start start 2024-05-08T05:38:42.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:42.569+0000 7f0995140700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09780057d0 0x7f099019c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:38:42.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:42.569+0000 7f0995140700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f099019c990 0x7f0990196610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:38:42.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:42.569+0000 7f0995140700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0990108d70 con 0x7f09780057d0 2024-05-08T05:38:42.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:42.569+0000 7f0995140700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f099006c5a0 con 0x7f099019c990 2024-05-08T05:38:42.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:42.569+0000 7f098e59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f099019c990 0x7f0990196610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:38:42.570 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:42.569+0000 7f098e59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f099019c990 0x7f0990196610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:34920/0 (socket says 172.21.15.151:34920) 2024-05-08T05:38:42.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:42.569+0000 7f098e59c700 1 -- 172.21.15.151:0/333754373 learned_addr learned my addr 172.21.15.151:0/333754373 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-05-08T05:38:42.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:42.569+0000 7f098e59c700 1 -- 172.21.15.151:0/333754373 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f099019c990 msgr2=0x7f0990196610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-05-08T05:38:42.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:42.569+0000 7f098e59c700 1 -- 172.21.15.151:0/333754373 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f099019c990 msgr2=0x7f0990196610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T05:38:42.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:42.569+0000 7f098e59c700 1 --2- 172.21.15.151:0/333754373 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f099019c990 0x7f0990196610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T05:38:42.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:42.569+0000 7f098e59c700 1 --2- 172.21.15.151:0/333754373 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f099019c990 0x7f0990196610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T05:38:42.571 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:42.569+0000 7f098ed9d700 1 --2- 172.21.15.151:0/333754373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09780057d0 0x7f099019c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:38:42.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:42.570+0000 7f098ed9d700 1 -- 172.21.15.151:0/333754373 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f099019c990 msgr2=0x7f0990196610 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T05:38:42.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:42.570+0000 7f098ed9d700 1 --2- 172.21.15.151:0/333754373 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f099019c990 0x7f0990196610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:38:42.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:42.570+0000 7f098ed9d700 1 -- 172.21.15.151:0/333754373 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f099019cfd0 con 0x7f09780057d0 2024-05-08T05:38:42.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:42.571+0000 7f098ed9d700 1 --2- 172.21.15.151:0/333754373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09780057d0 0x7f099019c450 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f098801c000 tx=0x7f0988005500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:38:42.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:42.571+0000 7f0977fff700 1 -- 172.21.15.151:0/333754373 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f0988021040 con 0x7f09780057d0 2024-05-08T05:38:42.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:42.571+0000 7f0995140700 1 -- 172.21.15.151:0/333754373 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0990196b50 con 0x7f09780057d0 2024-05-08T05:38:42.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:42.571+0000 7f0977fff700 1 -- 172.21.15.151:0/333754373 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0988026410 con 0x7f09780057d0 2024-05-08T05:38:42.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:42.571+0000 7f0977fff700 1 -- 172.21.15.151:0/333754373 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f098801c610 con 0x7f09780057d0 2024-05-08T05:38:42.572 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:42.571+0000 7f0995140700 1 -- 172.21.15.151:0/333754373 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09901970e0 con 0x7f09780057d0 2024-05-08T05:38:42.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:42.572+0000 7f0995140700 1 -- 172.21.15.151:0/333754373 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09901035d0 con 0x7f09780057d0 2024-05-08T05:38:42.573 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:42.573+0000 7f0977fff700 1 -- 172.21.15.151:0/333754373 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f098802d020 con 0x7f09780057d0 2024-05-08T05:38:42.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:42.573+0000 7f0977fff700 1 --2- 172.21.15.151:0/333754373 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f097c03e300 0x7f097c0407c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:38:42.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:42.573+0000 7f0977fff700 1 -- 172.21.15.151:0/333754373 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f0988019070 con 0x7f09780057d0 2024-05-08T05:38:42.574 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:42.574+0000 7f098e59c700 1 --2- 172.21.15.151:0/333754373 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f097c03e300 0x7f097c0407c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:38:42.575 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:42.575+0000 7f098e59c700 1 --2- 172.21.15.151:0/333754373 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f097c03e300 0x7f097c0407c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0984009400 tx=0x7f0984007040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:38:42.590 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:42.589+0000 7f0977fff700 1 -- 172.21.15.151:0/333754373 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0988034020 con 0x7f09780057d0 2024-05-08T05:38:42.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:42 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T05:38:42.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:42 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T05:38:42.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:42 smithi151 ceph-mon[34815]: mon.a calling monitor election 2024-05-08T05:38:42.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:42 smithi151 ceph-mon[34815]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:38:42.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:42 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T05:38:42.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:42 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T05:38:42.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:42 smithi151 ceph-mon[34815]: mon.c calling monitor election 2024-05-08T05:38:42.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:42 smithi151 ceph-mon[34815]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:38:42.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:42 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T05:38:42.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:42 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T05:38:42.881 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:42 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T05:38:42.881 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:42 smithi151 ceph-mon[34815]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-08T05:38:42.881 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:42 smithi151 ceph-mon[34815]: monmap epoch 2 2024-05-08T05:38:42.881 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:42 smithi151 ceph-mon[34815]: fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 2024-05-08T05:38:42.881 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:42 smithi151 ceph-mon[34815]: last_changed 2024-05-08T05:38:37.509214+0000 2024-05-08T05:38:42.881 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:42 smithi151 ceph-mon[34815]: created 2024-05-08T05:36:33.349539+0000 2024-05-08T05:38:42.881 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:42 smithi151 ceph-mon[34815]: min_mon_release 19 (squid) 2024-05-08T05:38:42.881 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:42 smithi151 ceph-mon[34815]: election_strategy: 1 2024-05-08T05:38:42.881 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:42 smithi151 ceph-mon[34815]: 0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.a 2024-05-08T05:38:42.881 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:42 smithi151 ceph-mon[34815]: 1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.c 2024-05-08T05:38:42.881 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:42 smithi151 ceph-mon[34815]: fsmap 2024-05-08T05:38:42.881 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:42 smithi151 ceph-mon[34815]: osdmap e4: 0 total, 0 up, 0 in 2024-05-08T05:38:42.881 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:42 smithi151 ceph-mon[34815]: mgrmap e13: x(active, since 58s) 2024-05-08T05:38:42.881 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:42 smithi151 ceph-mon[34815]: overall HEALTH_OK 2024-05-08T05:38:42.882 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:42 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:42.882 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:42 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:42.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:42.881+0000 7f0995140700 1 -- 172.21.15.151:0/333754373 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f0990197390 con 0x7f09780057d0 2024-05-08T05:38:42.882 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:42.882+0000 7f0977fff700 1 -- 172.21.15.151:0/333754373 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f09880265c0 con 0x7f09780057d0 2024-05-08T05:38:42.883 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-08T05:38:42.883 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":2,"fsid":"c739a5c8-0cfc-11ef-bc97-c7b262605968","modified":"2024-05-08T05:38:37.509214Z","created":"2024-05-08T05:36:33.349539Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:3300","nonce":0},{"type":"v1","addr":"172.21.15.151:6789","nonce":0}]},"addr":"172.21.15.151:6789/0","public_addr":"172.21.15.151:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-05-08T05:38:42.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:42.885+0000 7f0995140700 1 -- 172.21.15.151:0/333754373 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f097c03e300 msgr2=0x7f097c0407c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:38:42.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:42.885+0000 7f0995140700 1 --2- 172.21.15.151:0/333754373 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f097c03e300 0x7f097c0407c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0984009400 tx=0x7f0984007040 comp rx=0 tx=0).stop 2024-05-08T05:38:42.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:42.885+0000 7f0995140700 1 -- 172.21.15.151:0/333754373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09780057d0 msgr2=0x7f099019c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:38:42.885 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:42.885+0000 7f0995140700 1 --2- 172.21.15.151:0/333754373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09780057d0 0x7f099019c450 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f098801c000 tx=0x7f0988005500 comp rx=0 tx=0).stop 2024-05-08T05:38:42.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:42.885+0000 7f0995140700 1 -- 172.21.15.151:0/333754373 shutdown_connections 2024-05-08T05:38:42.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:42.885+0000 7f0995140700 1 --2- 172.21.15.151:0/333754373 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f097c03e300 0x7f097c0407c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:38:42.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:42.885+0000 7f0995140700 1 --2- 172.21.15.151:0/333754373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f09780057d0 0x7f099019c450 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:38:42.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:42.885+0000 7f0995140700 1 --2- 172.21.15.151:0/333754373 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f099019c990 0x7f0990196610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:38:42.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:42.885+0000 7f0995140700 1 -- 172.21.15.151:0/333754373 >> 172.21.15.151:0/333754373 conn(0x7f09900fd9c0 msgr2=0x7f09900fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:38:42.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:42.885+0000 7f0995140700 1 -- 172.21.15.151:0/333754373 shutdown_connections 2024-05-08T05:38:42.886 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:42.885+0000 7f0995140700 1 -- 172.21.15.151:0/333754373 wait complete. 2024-05-08T05:38:42.886 INFO:teuthology.orchestra.run.smithi151.stderr:dumped monmap epoch 2 2024-05-08T05:38:42.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:42 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T05:38:42.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:42 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T05:38:42.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:42 smithi082 ceph-mon[30098]: mon.a calling monitor election 2024-05-08T05:38:42.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:42 smithi082 ceph-mon[30098]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:38:42.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:42 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T05:38:42.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:42 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T05:38:42.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:42 smithi082 ceph-mon[30098]: mon.c calling monitor election 2024-05-08T05:38:42.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:42 smithi082 ceph-mon[30098]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:38:42.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:42 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T05:38:42.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:42 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T05:38:42.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:42 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T05:38:42.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:42 smithi082 ceph-mon[30098]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-08T05:38:42.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:42 smithi082 ceph-mon[30098]: monmap epoch 2 2024-05-08T05:38:42.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:42 smithi082 ceph-mon[30098]: fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 2024-05-08T05:38:42.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:42 smithi082 ceph-mon[30098]: last_changed 2024-05-08T05:38:37.509214+0000 2024-05-08T05:38:42.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:42 smithi082 ceph-mon[30098]: created 2024-05-08T05:36:33.349539+0000 2024-05-08T05:38:42.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:42 smithi082 ceph-mon[30098]: min_mon_release 19 (squid) 2024-05-08T05:38:42.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:42 smithi082 ceph-mon[30098]: election_strategy: 1 2024-05-08T05:38:42.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:42 smithi082 ceph-mon[30098]: 0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.a 2024-05-08T05:38:42.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:42 smithi082 ceph-mon[30098]: 1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.c 2024-05-08T05:38:42.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:42 smithi082 ceph-mon[30098]: fsmap 2024-05-08T05:38:42.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:42 smithi082 ceph-mon[30098]: osdmap e4: 0 total, 0 up, 0 in 2024-05-08T05:38:42.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:42 smithi082 ceph-mon[30098]: mgrmap e13: x(active, since 58s) 2024-05-08T05:38:42.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:42 smithi082 ceph-mon[30098]: overall HEALTH_OK 2024-05-08T05:38:42.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:42 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:42.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:42 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:43.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:43 smithi151 ceph-mon[34815]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:38:43.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:43 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:43.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:43 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T05:38:43.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:43 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:38:43.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:43 smithi151 ceph-mon[34815]: Deploying daemon mon.b on smithi134 2024-05-08T05:38:43.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:43 smithi151 ceph-mon[34815]: from='client.? 172.21.15.151:0/333754373' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-08T05:38:43.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:43 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T05:38:43.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:43 smithi082 ceph-mon[30098]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:38:43.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:43 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:43.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:43 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T05:38:43.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:43 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:38:43.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:43 smithi082 ceph-mon[30098]: Deploying daemon mon.b on smithi134 2024-05-08T05:38:43.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:43 smithi082 ceph-mon[30098]: from='client.? 172.21.15.151:0/333754373' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-08T05:38:43.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:43 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T05:38:44.426 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-08T05:38:44.426 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-08T05:38:44.672 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T05:38:45.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:45 smithi151 ceph-mon[34815]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:38:45.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:45 smithi082 ceph-mon[30098]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:38:46.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:46.116+0000 7f28cb0f8700 1 -- 172.21.15.151:0/3652004496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28c4103210 msgr2=0x7f28c41035f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:38:46.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:46.116+0000 7f28cb0f8700 1 --2- 172.21.15.151:0/3652004496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28c4103210 0x7f28c41035f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f28b8009910 tx=0x7f28b8009c20 comp rx=0 tx=0).stop 2024-05-08T05:38:46.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:46.116+0000 7f28cb0f8700 1 -- 172.21.15.151:0/3652004496 shutdown_connections 2024-05-08T05:38:46.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:46.116+0000 7f28cb0f8700 1 --2- 172.21.15.151:0/3652004496 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28c4103210 0x7f28c41035f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:38:46.133 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:46.116+0000 7f28cb0f8700 1 -- 172.21.15.151:0/3652004496 >> 172.21.15.151:0/3652004496 conn(0x7f28c40feaa0 msgr2=0x7f28c4100ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:38:46.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:46.116+0000 7f28cb0f8700 1 -- 172.21.15.151:0/3652004496 shutdown_connections 2024-05-08T05:38:46.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:46.116+0000 7f28cb0f8700 1 -- 172.21.15.151:0/3652004496 wait complete. 2024-05-08T05:38:46.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:46.117+0000 7f28cb0f8700 1 Processor -- start 2024-05-08T05:38:46.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:46.117+0000 7f28cb0f8700 1 -- start start 2024-05-08T05:38:46.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:46.117+0000 7f28cb0f8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28c4103210 0x7f28c40757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:38:46.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:46.117+0000 7f28cb0f8700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28c4075ce0 0x7f28c4076160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:38:46.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:46.117+0000 7f28cb0f8700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f28c410d490 con 0x7f28c4103210 2024-05-08T05:38:46.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:46.117+0000 7f28cb0f8700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f28c410d310 con 0x7f28c4075ce0 2024-05-08T05:38:46.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:46.117+0000 7f28c3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28c4075ce0 0x7f28c4076160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:38:46.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:46.117+0000 7f28c3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28c4075ce0 0x7f28c4076160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:34932/0 (socket says 172.21.15.151:34932) 2024-05-08T05:38:46.135 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:46.117+0000 7f28c3fff700 1 -- 172.21.15.151:0/1649492463 learned_addr learned my addr 172.21.15.151:0/1649492463 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-05-08T05:38:46.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:46.117+0000 7f28c3fff700 1 -- 172.21.15.151:0/1649492463 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28c4075ce0 msgr2=0x7f28c4076160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-05-08T05:38:46.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:46.117+0000 7f28c3fff700 1 -- 172.21.15.151:0/1649492463 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28c4075ce0 msgr2=0x7f28c4076160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-08T05:38:46.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:46.117+0000 7f28c3fff700 1 --2- 172.21.15.151:0/1649492463 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28c4075ce0 0x7f28c4076160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-08T05:38:46.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:46.117+0000 7f28c3fff700 1 --2- 172.21.15.151:0/1649492463 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28c4075ce0 0x7f28c4076160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-08T05:38:46.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:46.118+0000 7f28c8e94700 1 --2- 172.21.15.151:0/1649492463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28c4103210 0x7f28c40757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:38:46.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:46.118+0000 7f28c8e94700 1 -- 172.21.15.151:0/1649492463 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28c4075ce0 msgr2=0x7f28c4076160 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T05:38:46.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:46.118+0000 7f28c8e94700 1 --2- 172.21.15.151:0/1649492463 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28c4075ce0 0x7f28c4076160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:38:46.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:46.118+0000 7f28c8e94700 1 -- 172.21.15.151:0/1649492463 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28c40776c0 con 0x7f28c4103210 2024-05-08T05:38:46.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:46.119+0000 7f28c8e94700 1 --2- 172.21.15.151:0/1649492463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28c4103210 0x7f28c40757a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f28b8014000 tx=0x7f28b8005030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:38:46.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:46.119+0000 7f28c1ffb700 1 -- 172.21.15.151:0/1649492463 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f28b8005dc0 con 0x7f28c4103210 2024-05-08T05:38:46.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:46.119+0000 7f28cb0f8700 1 -- 172.21.15.151:0/1649492463 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28c41a4e30 con 0x7f28c4103210 2024-05-08T05:38:46.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:46.119+0000 7f28cb0f8700 1 -- 172.21.15.151:0/1649492463 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28c41a52e0 con 0x7f28c4103210 2024-05-08T05:38:46.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:46.119+0000 7f28c1ffb700 1 -- 172.21.15.151:0/1649492463 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f28b800b6f0 con 0x7f28c4103210 2024-05-08T05:38:46.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:46.119+0000 7f28c1ffb700 1 -- 172.21.15.151:0/1649492463 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f28b8003910 con 0x7f28c4103210 2024-05-08T05:38:46.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:46.120+0000 7f28cb0f8700 1 -- 172.21.15.151:0/1649492463 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28a8005330 con 0x7f28c4103210 2024-05-08T05:38:46.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:46.121+0000 7f28c1ffb700 1 -- 172.21.15.151:0/1649492463 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f28b8029070 con 0x7f28c4103210 2024-05-08T05:38:46.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:46.121+0000 7f28c1ffb700 1 --2- 172.21.15.151:0/1649492463 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f28b403e300 0x7f28b40407c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:38:46.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:46.121+0000 7f28c1ffb700 1 -- 172.21.15.151:0/1649492463 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f28b801e070 con 0x7f28c4103210 2024-05-08T05:38:46.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:46.121+0000 7f28c3fff700 1 --2- 172.21.15.151:0/1649492463 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f28b403e300 0x7f28b40407c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:38:46.139 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:46.122+0000 7f28c3fff700 1 --2- 172.21.15.151:0/1649492463 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f28b403e300 0x7f28b40407c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f28b0009180 tx=0x7f28b0008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:38:46.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:46.137+0000 7f28c1ffb700 1 -- 172.21.15.151:0/1649492463 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f28b8013070 con 0x7f28c4103210 2024-05-08T05:38:46.427 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:46.427+0000 7f28cb0f8700 1 -- 172.21.15.151:0/1649492463 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f28a80058f0 con 0x7f28c4103210 2024-05-08T05:38:46.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:46.428+0000 7f28c1ffb700 1 -- 172.21.15.151:0/1649492463 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f28b8034090 con 0x7f28c4103210 2024-05-08T05:38:46.428 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-08T05:38:46.429 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":2,"fsid":"c739a5c8-0cfc-11ef-bc97-c7b262605968","modified":"2024-05-08T05:38:37.509214Z","created":"2024-05-08T05:36:33.349539Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:3300","nonce":0},{"type":"v1","addr":"172.21.15.151:6789","nonce":0}]},"addr":"172.21.15.151:6789/0","public_addr":"172.21.15.151:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-05-08T05:38:46.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:46.430+0000 7f28cb0f8700 1 -- 172.21.15.151:0/1649492463 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f28b403e300 msgr2=0x7f28b40407c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:38:46.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:46.430+0000 7f28cb0f8700 1 --2- 172.21.15.151:0/1649492463 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f28b403e300 0x7f28b40407c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f28b0009180 tx=0x7f28b0008040 comp rx=0 tx=0).stop 2024-05-08T05:38:46.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:46.430+0000 7f28cb0f8700 1 -- 172.21.15.151:0/1649492463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28c4103210 msgr2=0x7f28c40757a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:38:46.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:46.430+0000 7f28cb0f8700 1 --2- 172.21.15.151:0/1649492463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28c4103210 0x7f28c40757a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f28b8014000 tx=0x7f28b8005030 comp rx=0 tx=0).stop 2024-05-08T05:38:46.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:46.430+0000 7f28cb0f8700 1 -- 172.21.15.151:0/1649492463 shutdown_connections 2024-05-08T05:38:46.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:46.430+0000 7f28cb0f8700 1 --2- 172.21.15.151:0/1649492463 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f28b403e300 0x7f28b40407c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:38:46.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:46.430+0000 7f28cb0f8700 1 --2- 172.21.15.151:0/1649492463 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28c4103210 0x7f28c40757a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:38:46.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:46.430+0000 7f28cb0f8700 1 --2- 172.21.15.151:0/1649492463 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28c4075ce0 0x7f28c4076160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:38:46.431 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:46.430+0000 7f28cb0f8700 1 -- 172.21.15.151:0/1649492463 >> 172.21.15.151:0/1649492463 conn(0x7f28c40feaa0 msgr2=0x7f28c4104be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:38:46.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:46.430+0000 7f28cb0f8700 1 -- 172.21.15.151:0/1649492463 shutdown_connections 2024-05-08T05:38:46.432 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:46.430+0000 7f28cb0f8700 1 -- 172.21.15.151:0/1649492463 wait complete. 2024-05-08T05:38:46.432 INFO:teuthology.orchestra.run.smithi151.stderr:dumped monmap epoch 2 2024-05-08T05:38:46.786 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:46 smithi151 ceph-mon[34815]: from='client.? 172.21.15.151:0/1649492463' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-08T05:38:46.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:46 smithi082 ceph-mon[30098]: from='client.? 172.21.15.151:0/1649492463' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-08T05:38:47.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:46 smithi134 systemd[1]: Started Ceph mon.b for c739a5c8-0cfc-11ef-bc97-c7b262605968. 2024-05-08T05:38:48.024 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-08T05:38:48.025 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph mon dump -f json 2024-05-08T05:38:48.280 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T05:38:52.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:51 smithi151 ceph-mon[34815]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:38:52.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:51 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T05:38:52.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:51 smithi151 ceph-mon[34815]: mon.a calling monitor election 2024-05-08T05:38:52.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:51 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:38:52.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:51 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T05:38:52.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:51 smithi151 ceph-mon[34815]: mon.c calling monitor election 2024-05-08T05:38:52.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:51 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:38:52.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:51 smithi151 ceph-mon[34815]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:38:52.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:51 smithi151 ceph-mon[34815]: mon.b calling monitor election 2024-05-08T05:38:52.131 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:51 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:38:52.131 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:51 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:38:52.131 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:51 smithi151 ceph-mon[34815]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:38:52.131 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:51 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:38:52.131 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:51 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:38:52.131 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:51 smithi151 ceph-mon[34815]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-08T05:38:52.131 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:51 smithi151 ceph-mon[34815]: monmap epoch 3 2024-05-08T05:38:52.131 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:51 smithi151 ceph-mon[34815]: fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 2024-05-08T05:38:52.131 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:51 smithi151 ceph-mon[34815]: last_changed 2024-05-08T05:38:46.694524+0000 2024-05-08T05:38:52.131 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:51 smithi151 ceph-mon[34815]: created 2024-05-08T05:36:33.349539+0000 2024-05-08T05:38:52.131 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:51 smithi151 ceph-mon[34815]: min_mon_release 19 (squid) 2024-05-08T05:38:52.131 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:51 smithi151 ceph-mon[34815]: election_strategy: 1 2024-05-08T05:38:52.131 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:51 smithi151 ceph-mon[34815]: 0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.a 2024-05-08T05:38:52.131 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:51 smithi151 ceph-mon[34815]: 1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.c 2024-05-08T05:38:52.131 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:51 smithi151 ceph-mon[34815]: 2: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.b 2024-05-08T05:38:52.132 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:51 smithi151 ceph-mon[34815]: fsmap 2024-05-08T05:38:52.132 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:51 smithi151 ceph-mon[34815]: osdmap e4: 0 total, 0 up, 0 in 2024-05-08T05:38:52.132 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:51 smithi151 ceph-mon[34815]: mgrmap e13: x(active, since 67s) 2024-05-08T05:38:52.132 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:51 smithi151 ceph-mon[34815]: overall HEALTH_OK 2024-05-08T05:38:52.132 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:51 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:52.132 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:51 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:52.132 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:51 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:52.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:51 smithi082 ceph-mon[30098]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:38:52.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:51 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T05:38:52.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:51 smithi082 ceph-mon[30098]: mon.a calling monitor election 2024-05-08T05:38:52.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:51 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:38:52.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:51 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T05:38:52.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:51 smithi082 ceph-mon[30098]: mon.c calling monitor election 2024-05-08T05:38:52.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:51 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:38:52.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:51 smithi082 ceph-mon[30098]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:38:52.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:51 smithi082 ceph-mon[30098]: mon.b calling monitor election 2024-05-08T05:38:52.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:51 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:38:52.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:51 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:38:52.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:51 smithi082 ceph-mon[30098]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:38:52.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:51 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:38:52.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:51 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:38:52.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:51 smithi082 ceph-mon[30098]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-08T05:38:52.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:51 smithi082 ceph-mon[30098]: monmap epoch 3 2024-05-08T05:38:52.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:51 smithi082 ceph-mon[30098]: fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 2024-05-08T05:38:52.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:51 smithi082 ceph-mon[30098]: last_changed 2024-05-08T05:38:46.694524+0000 2024-05-08T05:38:52.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:51 smithi082 ceph-mon[30098]: created 2024-05-08T05:36:33.349539+0000 2024-05-08T05:38:52.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:51 smithi082 ceph-mon[30098]: min_mon_release 19 (squid) 2024-05-08T05:38:52.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:51 smithi082 ceph-mon[30098]: election_strategy: 1 2024-05-08T05:38:52.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:51 smithi082 ceph-mon[30098]: 0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.a 2024-05-08T05:38:52.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:51 smithi082 ceph-mon[30098]: 1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.c 2024-05-08T05:38:52.223 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:51 smithi082 ceph-mon[30098]: 2: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.b 2024-05-08T05:38:52.223 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:51 smithi082 ceph-mon[30098]: fsmap 2024-05-08T05:38:52.223 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:51 smithi082 ceph-mon[30098]: osdmap e4: 0 total, 0 up, 0 in 2024-05-08T05:38:52.223 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:51 smithi082 ceph-mon[30098]: mgrmap e13: x(active, since 67s) 2024-05-08T05:38:52.223 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:51 smithi082 ceph-mon[30098]: overall HEALTH_OK 2024-05-08T05:38:52.223 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:51 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:52.223 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:51 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:52.223 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:51 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:52.254 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:51 smithi134 ceph-mon[34132]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:38:52.254 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:51 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T05:38:52.254 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:51 smithi134 ceph-mon[34132]: mon.a calling monitor election 2024-05-08T05:38:52.254 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:51 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:38:52.254 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:51 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T05:38:52.254 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:51 smithi134 ceph-mon[34132]: mon.c calling monitor election 2024-05-08T05:38:52.254 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:51 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:38:52.254 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:51 smithi134 ceph-mon[34132]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:38:52.254 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:51 smithi134 ceph-mon[34132]: mon.b calling monitor election 2024-05-08T05:38:52.255 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:51 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:38:52.255 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:51 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:38:52.255 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:51 smithi134 ceph-mon[34132]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:38:52.255 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:51 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:38:52.255 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:51 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:38:52.255 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:51 smithi134 ceph-mon[34132]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-08T05:38:52.255 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:51 smithi134 ceph-mon[34132]: monmap epoch 3 2024-05-08T05:38:52.255 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:51 smithi134 ceph-mon[34132]: fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 2024-05-08T05:38:52.255 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:51 smithi134 ceph-mon[34132]: last_changed 2024-05-08T05:38:46.694524+0000 2024-05-08T05:38:52.255 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:51 smithi134 ceph-mon[34132]: created 2024-05-08T05:36:33.349539+0000 2024-05-08T05:38:52.255 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:51 smithi134 ceph-mon[34132]: min_mon_release 19 (squid) 2024-05-08T05:38:52.255 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:51 smithi134 ceph-mon[34132]: election_strategy: 1 2024-05-08T05:38:52.256 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:51 smithi134 ceph-mon[34132]: 0: [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] mon.a 2024-05-08T05:38:52.256 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:51 smithi134 ceph-mon[34132]: 1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.c 2024-05-08T05:38:52.256 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:51 smithi134 ceph-mon[34132]: 2: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.b 2024-05-08T05:38:52.256 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:51 smithi134 ceph-mon[34132]: fsmap 2024-05-08T05:38:52.256 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:51 smithi134 ceph-mon[34132]: osdmap e4: 0 total, 0 up, 0 in 2024-05-08T05:38:52.256 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:51 smithi134 ceph-mon[34132]: mgrmap e13: x(active, since 67s) 2024-05-08T05:38:52.256 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:51 smithi134 ceph-mon[34132]: overall HEALTH_OK 2024-05-08T05:38:52.256 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:51 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:52.256 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:51 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:52.256 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:51 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:52.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:52.829+0000 7f6e77019700 1 -- 172.21.15.151:0/2047616532 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e5c0035c0 msgr2=0x7f6e5c005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:38:52.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:52.829+0000 7f6e77019700 1 --2- 172.21.15.151:0/2047616532 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e5c0035c0 0x7f6e5c005a50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f6e70102ef0 tx=0x7f6e68009e80 comp rx=0 tx=0).stop 2024-05-08T05:38:52.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:52.829+0000 7f6e77019700 1 -- 172.21.15.151:0/2047616532 shutdown_connections 2024-05-08T05:38:52.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:52.829+0000 7f6e77019700 1 --2- 172.21.15.151:0/2047616532 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e5c0035c0 0x7f6e5c005a50 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:38:52.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:52.829+0000 7f6e77019700 1 -- 172.21.15.151:0/2047616532 >> 172.21.15.151:0/2047616532 conn(0x7f6e700feab0 msgr2=0x7f6e70100ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:38:52.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:52.829+0000 7f6e77019700 1 -- 172.21.15.151:0/2047616532 shutdown_connections 2024-05-08T05:38:52.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:52.829+0000 7f6e77019700 1 -- 172.21.15.151:0/2047616532 wait complete. 2024-05-08T05:38:52.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:52.830+0000 7f6e77019700 1 Processor -- start 2024-05-08T05:38:52.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:52.830+0000 7f6e77019700 1 -- start start 2024-05-08T05:38:52.832 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:52.830+0000 7f6e77019700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e5c0035c0 0x7f6e7019e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:38:52.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:52.830+0000 7f6e77019700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e7019ed60 0x7f6e70198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:38:52.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:52.830+0000 7f6e77019700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e70198f70 0x7f6e70199420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:38:52.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:52.830+0000 7f6e77019700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6e7010af10 con 0x7f6e7019ed60 2024-05-08T05:38:52.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:52.830+0000 7f6e77019700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6e7010ad90 con 0x7f6e5c0035c0 2024-05-08T05:38:52.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:52.830+0000 7f6e77019700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6e7010b090 con 0x7f6e70198f70 2024-05-08T05:38:52.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:52.830+0000 7f6e755b6700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e70198f70 0x7f6e70199420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:38:52.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:52.830+0000 7f6e755b6700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e70198f70 0x7f6e70199420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:43718/0 (socket says 172.21.15.151:43718) 2024-05-08T05:38:52.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:52.830+0000 7f6e755b6700 1 -- 172.21.15.151:0/2974020623 learned_addr learned my addr 172.21.15.151:0/2974020623 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-05-08T05:38:52.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:52.831+0000 7f6e74db5700 1 --2- 172.21.15.151:0/2974020623 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e5c0035c0 0x7f6e7019e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:38:52.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:52.831+0000 7f6e6ffff700 1 --2- 172.21.15.151:0/2974020623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e7019ed60 0x7f6e70198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:38:52.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:52.831+0000 7f6e755b6700 1 -- 172.21.15.151:0/2974020623 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e5c0035c0 msgr2=0x7f6e7019e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:38:52.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:52.831+0000 7f6e755b6700 1 --2- 172.21.15.151:0/2974020623 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e5c0035c0 0x7f6e7019e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:38:52.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:52.831+0000 7f6e755b6700 1 -- 172.21.15.151:0/2974020623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e7019ed60 msgr2=0x7f6e70198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:38:52.833 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:52.831+0000 7f6e755b6700 1 --2- 172.21.15.151:0/2974020623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e7019ed60 0x7f6e70198a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:38:52.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:52.831+0000 7f6e755b6700 1 -- 172.21.15.151:0/2974020623 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e701a56f0 con 0x7f6e70198f70 2024-05-08T05:38:52.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:52.831+0000 7f6e755b6700 1 --2- 172.21.15.151:0/2974020623 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e70198f70 0x7f6e70199420 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f6e5800b550 tx=0x7f6e5800b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:38:52.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:52.831+0000 7f6e6dffb700 1 -- 172.21.15.151:0/2974020623 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e58015020 con 0x7f6e70198f70 2024-05-08T05:38:52.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:52.831+0000 7f6e6dffb700 1 -- 172.21.15.151:0/2974020623 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6e58011ce0 con 0x7f6e70198f70 2024-05-08T05:38:52.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:52.831+0000 7f6e77019700 1 -- 172.21.15.151:0/2974020623 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e701a5920 con 0x7f6e70198f70 2024-05-08T05:38:52.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:52.831+0000 7f6e6dffb700 1 -- 172.21.15.151:0/2974020623 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e58010db0 con 0x7f6e70198f70 2024-05-08T05:38:52.834 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:52.831+0000 7f6e77019700 1 -- 172.21.15.151:0/2974020623 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e701a5e60 con 0x7f6e70198f70 2024-05-08T05:38:52.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:52.832+0000 7f6e6dffb700 1 -- 172.21.15.151:0/2974020623 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f6e58018020 con 0x7f6e70198f70 2024-05-08T05:38:52.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:52.832+0000 7f6e6dffb700 1 --2- 172.21.15.151:0/2974020623 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f6e5003e9a0 0x7f6e50040e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:38:52.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:52.832+0000 7f6e6dffb700 1 -- 172.21.15.151:0/2974020623 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f6e580520a0 con 0x7f6e70198f70 2024-05-08T05:38:52.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:52.832+0000 7f6e77019700 1 -- 172.21.15.151:0/2974020623 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e70064b00 con 0x7f6e70198f70 2024-05-08T05:38:52.835 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:52.833+0000 7f6e74db5700 1 --2- 172.21.15.151:0/2974020623 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f6e5003e9a0 0x7f6e50040e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:38:52.837 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:52.837+0000 7f6e74db5700 1 --2- 172.21.15.151:0/2974020623 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f6e5003e9a0 0x7f6e50040e60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6e68009a30 tx=0x7f6e68022040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:38:52.838 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:52.838+0000 7f6e6dffb700 1 -- 172.21.15.151:0/2974020623 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6e5801f020 con 0x7f6e70198f70 2024-05-08T05:38:53.037 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:52 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:53.038 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:52 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:38:53.038 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:52 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:38:53.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:53.133+0000 7f6e77019700 1 -- 172.21.15.151:0/2974020623 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f6e7002e510 con 0x7f6e70198f70 2024-05-08T05:38:53.134 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:53.134+0000 7f6e6dffb700 1 -- 172.21.15.151:0/2974020623 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1285 (secure 0 0 0) 0x7f6e580187b0 con 0x7f6e70198f70 2024-05-08T05:38:53.135 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-05-08T05:38:53.135 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":3,"fsid":"c739a5c8-0cfc-11ef-bc97-c7b262605968","modified":"2024-05-08T05:38:46.694524Z","created":"2024-05-08T05:36:33.349539Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:3300","nonce":0},{"type":"v1","addr":"172.21.15.82:6789","nonce":0}]},"addr":"172.21.15.82:6789/0","public_addr":"172.21.15.82:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:3300","nonce":0},{"type":"v1","addr":"172.21.15.151:6789","nonce":0}]},"addr":"172.21.15.151:6789/0","public_addr":"172.21.15.151:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-05-08T05:38:53.136 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:53.136+0000 7f6e77019700 1 -- 172.21.15.151:0/2974020623 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f6e5003e9a0 msgr2=0x7f6e50040e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:38:53.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:53.136+0000 7f6e77019700 1 --2- 172.21.15.151:0/2974020623 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f6e5003e9a0 0x7f6e50040e60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6e68009a30 tx=0x7f6e68022040 comp rx=0 tx=0).stop 2024-05-08T05:38:53.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:53.136+0000 7f6e77019700 1 -- 172.21.15.151:0/2974020623 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e70198f70 msgr2=0x7f6e70199420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:38:53.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:53.136+0000 7f6e77019700 1 --2- 172.21.15.151:0/2974020623 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e70198f70 0x7f6e70199420 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f6e5800b550 tx=0x7f6e5800b860 comp rx=0 tx=0).stop 2024-05-08T05:38:53.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:53.136+0000 7f6e77019700 1 -- 172.21.15.151:0/2974020623 shutdown_connections 2024-05-08T05:38:53.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:53.136+0000 7f6e77019700 1 --2- 172.21.15.151:0/2974020623 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6e5c0035c0 0x7f6e7019e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:38:53.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:53.136+0000 7f6e77019700 1 --2- 172.21.15.151:0/2974020623 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f6e5003e9a0 0x7f6e50040e60 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:38:53.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:53.136+0000 7f6e77019700 1 --2- 172.21.15.151:0/2974020623 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e70198f70 0x7f6e70199420 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:38:53.137 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:53.136+0000 7f6e77019700 1 --2- 172.21.15.151:0/2974020623 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6e7019ed60 0x7f6e70198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:38:53.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:53.136+0000 7f6e77019700 1 -- 172.21.15.151:0/2974020623 >> 172.21.15.151:0/2974020623 conn(0x7f6e700feab0 msgr2=0x7f6e700ffff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:38:53.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:53.136+0000 7f6e77019700 1 -- 172.21.15.151:0/2974020623 shutdown_connections 2024-05-08T05:38:53.138 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:38:53.136+0000 7f6e77019700 1 -- 172.21.15.151:0/2974020623 wait complete. 2024-05-08T05:38:53.138 INFO:teuthology.orchestra.run.smithi151.stderr:dumped monmap epoch 3 2024-05-08T05:38:53.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:52 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:53.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:52 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:38:53.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:52 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:38:53.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:52 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:53.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:52 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:38:53.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:52 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:38:53.984 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:53 smithi151 ceph-mon[34815]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:38:53.985 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:53 smithi151 ceph-mon[34815]: from='client.? 172.21.15.151:0/2974020623' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-08T05:38:53.985 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:53 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:53.985 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:53 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:53.985 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:53 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:53.985 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:53 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:53.985 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:53 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:38:53.985 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:53 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:38:54.010 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-05-08T05:38:54.010 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph config generate-minimal-conf 2024-05-08T05:38:54.069 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:53 smithi082 ceph-mon[30098]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:38:54.069 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:53 smithi082 ceph-mon[30098]: from='client.? 172.21.15.151:0/2974020623' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-08T05:38:54.069 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:53 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:54.069 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:53 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:54.069 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:53 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:54.070 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:53 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:54.070 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:53 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:38:54.070 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:53 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:38:54.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:53 smithi134 ceph-mon[34132]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:38:54.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:53 smithi134 ceph-mon[34132]: from='client.? 172.21.15.151:0/2974020623' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-08T05:38:54.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:53 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:54.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:53 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:54.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:53 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:54.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:53 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:54.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:53 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:38:54.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:53 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:38:54.420 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:38:54.842 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:54 smithi082 ceph-mon[30098]: Updating smithi082:/etc/ceph/ceph.conf 2024-05-08T05:38:54.843 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:54 smithi082 ceph-mon[30098]: Updating smithi134:/etc/ceph/ceph.conf 2024-05-08T05:38:54.843 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:54 smithi082 ceph-mon[30098]: Updating smithi151:/etc/ceph/ceph.conf 2024-05-08T05:38:54.843 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:54 smithi082 ceph-mon[30098]: Updating smithi134:/var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T05:38:54.843 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:54 smithi082 ceph-mon[30098]: Updating smithi151:/var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T05:38:54.843 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:54 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:54.843 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:54 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:54.843 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:54 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:54.843 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:54 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:54.843 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:54 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:54.843 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:54 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:54.843 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:54 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:54.843 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:54 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:55.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:54 smithi151 ceph-mon[34815]: Updating smithi082:/etc/ceph/ceph.conf 2024-05-08T05:38:55.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:54 smithi151 ceph-mon[34815]: Updating smithi134:/etc/ceph/ceph.conf 2024-05-08T05:38:55.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:54 smithi151 ceph-mon[34815]: Updating smithi151:/etc/ceph/ceph.conf 2024-05-08T05:38:55.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:54 smithi151 ceph-mon[34815]: Updating smithi134:/var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T05:38:55.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:54 smithi151 ceph-mon[34815]: Updating smithi151:/var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T05:38:55.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:54 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:55.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:54 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:55.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:54 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:55.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:54 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:55.131 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:54 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:55.131 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:54 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:55.131 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:54 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:55.131 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:54 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:55.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:54 smithi134 ceph-mon[34132]: Updating smithi082:/etc/ceph/ceph.conf 2024-05-08T05:38:55.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:54 smithi134 ceph-mon[34132]: Updating smithi134:/etc/ceph/ceph.conf 2024-05-08T05:38:55.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:54 smithi134 ceph-mon[34132]: Updating smithi151:/etc/ceph/ceph.conf 2024-05-08T05:38:55.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:54 smithi134 ceph-mon[34132]: Updating smithi134:/var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T05:38:55.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:54 smithi134 ceph-mon[34132]: Updating smithi151:/var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T05:38:55.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:54 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:55.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:54 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:55.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:54 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:55.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:54 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:55.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:54 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:55.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:54 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:55.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:54 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:55.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:54 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:55.905 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:55 smithi082 ceph-mon[30098]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:38:55.905 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:55 smithi082 ceph-mon[30098]: Updating smithi082:/var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T05:38:55.905 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:55 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:55.905 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:55 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:55.905 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:55 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:55.905 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:55 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:55.905 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:55 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T05:38:55.905 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:55 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-08T05:38:55.905 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:55 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:38:56.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:55 smithi151 ceph-mon[34815]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:38:56.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:55 smithi151 ceph-mon[34815]: Updating smithi082:/var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T05:38:56.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:55 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:56.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:55 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:56.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:55 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:56.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:55 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:56.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:55 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T05:38:56.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:55 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-08T05:38:56.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:55 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:38:56.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:55 smithi134 ceph-mon[34132]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:38:56.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:55 smithi134 ceph-mon[34132]: Updating smithi082:/var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/config/ceph.conf 2024-05-08T05:38:56.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:55 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:56.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:55 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:56.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:55 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:56.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:55 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:56.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:55 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T05:38:56.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:55 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-08T05:38:56.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:55 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:38:56.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:56.883+0000 7f45bf400700 1 -- 172.21.15.82:0/507266185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45b8105330 msgr2=0x7f45b8105710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:38:56.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:56.883+0000 7f45bf400700 1 --2- 172.21.15.82:0/507266185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45b8105330 0x7f45b8105710 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f45ac009910 tx=0x7f45ac009c20 comp rx=0 tx=0).stop 2024-05-08T05:38:56.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:56.883+0000 7f45bf400700 1 -- 172.21.15.82:0/507266185 shutdown_connections 2024-05-08T05:38:56.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:56.883+0000 7f45bf400700 1 --2- 172.21.15.82:0/507266185 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45b8105330 0x7f45b8105710 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:38:56.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:56.883+0000 7f45bf400700 1 -- 172.21.15.82:0/507266185 >> 172.21.15.82:0/507266185 conn(0x7f45b8100bc0 msgr2=0x7f45b8102fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:38:56.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:56.883+0000 7f45bf400700 1 -- 172.21.15.82:0/507266185 shutdown_connections 2024-05-08T05:38:56.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:56.884+0000 7f45bf400700 1 -- 172.21.15.82:0/507266185 wait complete. 2024-05-08T05:38:56.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:56.885+0000 7f45bf400700 1 Processor -- start 2024-05-08T05:38:56.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:56.885+0000 7f45bf400700 1 -- start start 2024-05-08T05:38:56.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:56.885+0000 7f45bf400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f45b8105330 0x7f45b819ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:38:56.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:56.885+0000 7f45bf400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45b819b2a0 0x7f45b819f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:38:56.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:56.885+0000 7f45bf400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45b819fb70 0x7f45b81a0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:38:56.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:56.885+0000 7f45bf400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f45b810f5b0 con 0x7f45b819b2a0 2024-05-08T05:38:56.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:56.885+0000 7f45bf400700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f45b810f430 con 0x7f45b819fb70 2024-05-08T05:38:56.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:56.885+0000 7f45bf400700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f45b810f730 con 0x7f45b8105330 2024-05-08T05:38:56.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:56.886+0000 7f45b7e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45b819b2a0 0x7f45b819f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:38:56.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:56.886+0000 7f45b7e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45b819b2a0 0x7f45b819f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34420/0 (socket says 172.21.15.82:34420) 2024-05-08T05:38:56.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:56.886+0000 7f45bd400700 1 --2- 172.21.15.82:0/858918329 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45b819fb70 0x7f45b81a0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:38:56.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:56.886+0000 7f45bca00700 1 --2- 172.21.15.82:0/858918329 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f45b8105330 0x7f45b819ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:38:56.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:56.886+0000 7f45b7e00700 1 -- 172.21.15.82:0/858918329 learned_addr learned my addr 172.21.15.82:0/858918329 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:38:56.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:56.886+0000 7f45bca00700 1 -- 172.21.15.82:0/858918329 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45b819fb70 msgr2=0x7f45b81a0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:38:56.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:56.886+0000 7f45bca00700 1 --2- 172.21.15.82:0/858918329 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45b819fb70 0x7f45b81a0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:38:56.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:56.886+0000 7f45bca00700 1 -- 172.21.15.82:0/858918329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45b819b2a0 msgr2=0x7f45b819f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:38:56.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:56.886+0000 7f45bca00700 1 --2- 172.21.15.82:0/858918329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45b819b2a0 0x7f45b819f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:38:56.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:56.886+0000 7f45bca00700 1 -- 172.21.15.82:0/858918329 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45b81a78e0 con 0x7f45b8105330 2024-05-08T05:38:56.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:56.886+0000 7f45bd400700 1 --2- 172.21.15.82:0/858918329 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45b819fb70 0x7f45b81a0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:38:56.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:56.887+0000 7f45bca00700 1 --2- 172.21.15.82:0/858918329 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f45b8105330 0x7f45b819ad60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f45ac009910 tx=0x7f45ac004f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:38:56.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:56.887+0000 7f45b5600700 1 -- 172.21.15.82:0/858918329 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45ac026070 con 0x7f45b8105330 2024-05-08T05:38:56.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:56.887+0000 7f45b5600700 1 -- 172.21.15.82:0/858918329 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f45ac00b6f0 con 0x7f45b8105330 2024-05-08T05:38:56.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:56.887+0000 7f45bf400700 1 -- 172.21.15.82:0/858918329 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45b81a7b10 con 0x7f45b8105330 2024-05-08T05:38:56.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:56.887+0000 7f45b5600700 1 -- 172.21.15.82:0/858918329 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45ac009e60 con 0x7f45b8105330 2024-05-08T05:38:56.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:56.887+0000 7f45bf400700 1 -- 172.21.15.82:0/858918329 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45b81a80a0 con 0x7f45b8105330 2024-05-08T05:38:56.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:56.888+0000 7f45b5600700 1 -- 172.21.15.82:0/858918329 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f45ac029070 con 0x7f45b8105330 2024-05-08T05:38:56.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:56.888+0000 7f45bf400700 1 -- 172.21.15.82:0/858918329 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45b8064b00 con 0x7f45b8105330 2024-05-08T05:38:56.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:56.889+0000 7f45b5600700 1 --2- 172.21.15.82:0/858918329 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f45a003e9a0 0x7f45a0040e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:38:56.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:56.889+0000 7f45b5600700 1 -- 172.21.15.82:0/858918329 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f45ac053350 con 0x7f45b8105330 2024-05-08T05:38:56.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:56.889+0000 7f45b7e00700 1 --2- 172.21.15.82:0/858918329 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f45a003e9a0 0x7f45a0040e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:38:56.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:56.890+0000 7f45b7e00700 1 --2- 172.21.15.82:0/858918329 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f45a003e9a0 0x7f45a0040e60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f45a8009b80 tx=0x7f45a80092c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:38:56.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:56.894+0000 7f45b5600700 1 -- 172.21.15.82:0/858918329 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f45ac013070 con 0x7f45b8105330 2024-05-08T05:38:56.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:56 smithi082 ceph-mon[30098]: Reconfiguring mon.a (unknown last config time)... 2024-05-08T05:38:56.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:56 smithi082 ceph-mon[30098]: Reconfiguring daemon mon.a on smithi082 2024-05-08T05:38:57.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:57.127+0000 7f45bf400700 1 -- 172.21.15.82:0/858918329 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f45b81a8270 con 0x7f45b8105330 2024-05-08T05:38:57.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:57.128+0000 7f45b5600700 1 -- 172.21.15.82:0/858918329 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+275 (secure 0 0 0) 0x7f45ac030090 con 0x7f45b8105330 2024-05-08T05:38:57.129 INFO:teuthology.orchestra.run.smithi082.stdout:# minimal ceph.conf for c739a5c8-0cfc-11ef-bc97-c7b262605968 2024-05-08T05:38:57.129 INFO:teuthology.orchestra.run.smithi082.stdout:[global] 2024-05-08T05:38:57.129 INFO:teuthology.orchestra.run.smithi082.stdout: fsid = c739a5c8-0cfc-11ef-bc97-c7b262605968 2024-05-08T05:38:57.129 INFO:teuthology.orchestra.run.smithi082.stdout: mon_host = [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-05-08T05:38:57.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:56 smithi151 ceph-mon[34815]: Reconfiguring mon.a (unknown last config time)... 2024-05-08T05:38:57.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:56 smithi151 ceph-mon[34815]: Reconfiguring daemon mon.a on smithi082 2024-05-08T05:38:57.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:57.131+0000 7f45bf400700 1 -- 172.21.15.82:0/858918329 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f45a003e9a0 msgr2=0x7f45a0040e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:38:57.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:57.131+0000 7f45bf400700 1 --2- 172.21.15.82:0/858918329 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f45a003e9a0 0x7f45a0040e60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f45a8009b80 tx=0x7f45a80092c0 comp rx=0 tx=0).stop 2024-05-08T05:38:57.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:57.131+0000 7f45bf400700 1 -- 172.21.15.82:0/858918329 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f45b8105330 msgr2=0x7f45b819ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:38:57.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:57.131+0000 7f45bf400700 1 --2- 172.21.15.82:0/858918329 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f45b8105330 0x7f45b819ad60 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f45ac009910 tx=0x7f45ac004f80 comp rx=0 tx=0).stop 2024-05-08T05:38:57.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:57.131+0000 7f45bf400700 1 -- 172.21.15.82:0/858918329 shutdown_connections 2024-05-08T05:38:57.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:57.131+0000 7f45bf400700 1 --2- 172.21.15.82:0/858918329 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45b819fb70 0x7f45b81a0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:38:57.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:57.131+0000 7f45bf400700 1 --2- 172.21.15.82:0/858918329 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f45a003e9a0 0x7f45a0040e60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:38:57.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:57.131+0000 7f45bf400700 1 --2- 172.21.15.82:0/858918329 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f45b8105330 0x7f45b819ad60 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:38:57.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:57.131+0000 7f45bf400700 1 --2- 172.21.15.82:0/858918329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f45b819b2a0 0x7f45b819f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:38:57.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:57.131+0000 7f45bf400700 1 -- 172.21.15.82:0/858918329 >> 172.21.15.82:0/858918329 conn(0x7f45b8100bc0 msgr2=0x7f45b8106d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:38:57.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:57.131+0000 7f45bf400700 1 -- 172.21.15.82:0/858918329 shutdown_connections 2024-05-08T05:38:57.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:38:57.132+0000 7f45bf400700 1 -- 172.21.15.82:0/858918329 wait complete. 2024-05-08T05:38:57.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:56 smithi134 ceph-mon[34132]: Reconfiguring mon.a (unknown last config time)... 2024-05-08T05:38:57.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:56 smithi134 ceph-mon[34132]: Reconfiguring daemon mon.a on smithi082 2024-05-08T05:38:58.010 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-05-08T05:38:58.011 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-08T05:38:58.011 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/ceph/ceph.conf 2024-05-08T05:38:58.086 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:57 smithi082 ceph-mon[30098]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:38:58.086 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:57 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/858918329' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:38:58.086 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:57 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:58.086 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:57 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:58.086 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:57 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T05:38:58.086 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:57 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-08T05:38:58.087 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:57 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:38:58.101 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-08T05:38:58.102 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-08T05:38:58.125 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:57 smithi134 ceph-mon[34132]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:38:58.126 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:57 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/858918329' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:38:58.126 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:57 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:58.126 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:57 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:58.126 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:57 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T05:38:58.126 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:57 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-08T05:38:58.126 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:57 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:38:58.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:57 smithi151 ceph-mon[34815]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:38:58.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:57 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/858918329' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:38:58.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:57 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:58.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:57 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:38:58.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:57 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T05:38:58.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:57 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-08T05:38:58.131 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:57 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:38:58.232 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-05-08T05:38:58.232 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.conf 2024-05-08T05:38:58.260 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-05-08T05:38:58.261 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-08T05:38:58.326 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-05-08T05:38:58.326 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/ceph/ceph.conf 2024-05-08T05:38:58.359 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-05-08T05:38:58.359 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-08T05:38:58.429 INFO:tasks.cephadm:Adding mgr.x on smithi082 2024-05-08T05:38:58.429 INFO:tasks.cephadm:Adding mgr.y on smithi134 2024-05-08T05:38:58.429 INFO:tasks.cephadm:Adding mgr.z on smithi151 2024-05-08T05:38:58.430 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph orch apply mgr '3;smithi082=x;smithi134=y;smithi151=z' 2024-05-08T05:38:58.718 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T05:38:58.917 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:58 smithi134 ceph-mon[34132]: Reconfiguring mon.b (monmap changed)... 2024-05-08T05:38:58.917 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:58 smithi134 ceph-mon[34132]: Reconfiguring daemon mon.b on smithi134 2024-05-08T05:38:59.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:58 smithi151 ceph-mon[34815]: Reconfiguring mon.b (monmap changed)... 2024-05-08T05:38:59.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:58 smithi151 ceph-mon[34815]: Reconfiguring daemon mon.b on smithi134 2024-05-08T05:38:59.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:58 smithi082 ceph-mon[30098]: Reconfiguring mon.b (monmap changed)... 2024-05-08T05:38:59.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:58 smithi082 ceph-mon[30098]: Reconfiguring daemon mon.b on smithi134 2024-05-08T05:39:00.059 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:59 smithi151 ceph-mon[34815]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:00.059 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:59 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:00.059 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:59 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:00.059 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:59 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T05:39:00.059 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:59 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-08T05:39:00.059 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:38:59 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:39:00.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:59 smithi082 ceph-mon[30098]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:00.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:59 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:00.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:59 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:00.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:59 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T05:39:00.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:59 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-08T05:39:00.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:38:59 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:39:00.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:39:00.231+0000 7fd9ea4d9700 1 -- 172.21.15.151:0/530517097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9e4104670 msgr2=0x7fd9e4104a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:39:00.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:39:00.231+0000 7fd9ea4d9700 1 --2- 172.21.15.151:0/530517097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9e4104670 0x7fd9e4104a90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd9d4009910 tx=0x7fd9d4009c20 comp rx=0 tx=0).stop 2024-05-08T05:39:00.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:39:00.231+0000 7fd9ea4d9700 1 -- 172.21.15.151:0/530517097 shutdown_connections 2024-05-08T05:39:00.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:39:00.231+0000 7fd9ea4d9700 1 --2- 172.21.15.151:0/530517097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9e4104670 0x7fd9e4104a90 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:39:00.232 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:39:00.231+0000 7fd9ea4d9700 1 -- 172.21.15.151:0/530517097 >> 172.21.15.151:0/530517097 conn(0x7fd9e40fcc50 msgr2=0x7fd9e40ff0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:39:00.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:39:00.231+0000 7fd9ea4d9700 1 -- 172.21.15.151:0/530517097 shutdown_connections 2024-05-08T05:39:00.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:39:00.231+0000 7fd9ea4d9700 1 -- 172.21.15.151:0/530517097 wait complete. 2024-05-08T05:39:00.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:39:00.232+0000 7fd9ea4d9700 1 Processor -- start 2024-05-08T05:39:00.233 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:39:00.232+0000 7fd9ea4d9700 1 -- start start 2024-05-08T05:39:00.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:39:00.232+0000 7fd9ea4d9700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9e4104670 0x7fd9e41987a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:39:00.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:39:00.232+0000 7fd9ea4d9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9e4198ce0 0x7fd9e419dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:39:00.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:39:00.232+0000 7fd9ea4d9700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9e4199160 0x7fd9e41a02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:39:00.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:39:00.232+0000 7fd9ea4d9700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e4108f30 con 0x7fd9e4199160 2024-05-08T05:39:00.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:39:00.232+0000 7fd9ea4d9700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e4108db0 con 0x7fd9e4198ce0 2024-05-08T05:39:00.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:39:00.232+0000 7fd9ea4d9700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e41090b0 con 0x7fd9e4104670 2024-05-08T05:39:00.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:39:00.232+0000 7fd9e3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9e4104670 0x7fd9e41987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:39:00.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:39:00.232+0000 7fd9e3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9e4104670 0x7fd9e41987a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:43720/0 (socket says 172.21.15.151:43720) 2024-05-08T05:39:00.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:39:00.232+0000 7fd9e3fff700 1 -- 172.21.15.151:0/2122498171 learned_addr learned my addr 172.21.15.151:0/2122498171 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-05-08T05:39:00.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:39:00.233+0000 7fd9e3fff700 1 -- 172.21.15.151:0/2122498171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9e4198ce0 msgr2=0x7fd9e419dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:39:00.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:39:00.233+0000 7fd9e3fff700 1 --2- 172.21.15.151:0/2122498171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9e4198ce0 0x7fd9e419dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:39:00.235 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:39:00.233+0000 7fd9e3fff700 1 -- 172.21.15.151:0/2122498171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9e4199160 msgr2=0x7fd9e41a02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:39:00.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:39:00.233+0000 7fd9e3fff700 1 --2- 172.21.15.151:0/2122498171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9e4199160 0x7fd9e41a02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:39:00.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:39:00.233+0000 7fd9e3fff700 1 -- 172.21.15.151:0/2122498171 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9e41a0bb0 con 0x7fd9e4104670 2024-05-08T05:39:00.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:39:00.233+0000 7fd9e3fff700 1 --2- 172.21.15.151:0/2122498171 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9e4104670 0x7fd9e41987a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd9d40059d0 tx=0x7fd9d40050d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:39:00.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:39:00.233+0000 7fd9e17fa700 1 -- 172.21.15.151:0/2122498171 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d4027070 con 0x7fd9e4104670 2024-05-08T05:39:00.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:39:00.233+0000 7fd9e17fa700 1 -- 172.21.15.151:0/2122498171 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9d400be10 con 0x7fd9e4104670 2024-05-08T05:39:00.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:39:00.233+0000 7fd9e17fa700 1 -- 172.21.15.151:0/2122498171 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d4022e20 con 0x7fd9e4104670 2024-05-08T05:39:00.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:39:00.233+0000 7fd9ea4d9700 1 -- 172.21.15.151:0/2122498171 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9e41a0ea0 con 0x7fd9e4104670 2024-05-08T05:39:00.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:39:00.233+0000 7fd9ea4d9700 1 -- 172.21.15.151:0/2122498171 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9e41a1430 con 0x7fd9e4104670 2024-05-08T05:39:00.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:39:00.234+0000 7fd9e17fa700 1 -- 172.21.15.151:0/2122498171 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fd9d402a070 con 0x7fd9e4104670 2024-05-08T05:39:00.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:39:00.234+0000 7fd9e17fa700 1 --2- 172.21.15.151:0/2122498171 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd9cc03e9a0 0x7fd9cc040e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:39:00.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:39:00.234+0000 7fd9e17fa700 1 -- 172.21.15.151:0/2122498171 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fd9d4053af0 con 0x7fd9e4104670 2024-05-08T05:39:00.236 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:39:00.234+0000 7fd9ea4d9700 1 -- 172.21.15.151:0/2122498171 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9e4064b00 con 0x7fd9e4104670 2024-05-08T05:39:00.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:39:00.235+0000 7fd9e37fe700 1 --2- 172.21.15.151:0/2122498171 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd9cc03e9a0 0x7fd9cc040e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:39:00.237 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:39:00.236+0000 7fd9e37fe700 1 --2- 172.21.15.151:0/2122498171 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd9cc03e9a0 0x7fd9cc040e60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd9d80098e0 tx=0x7fd9d8006dd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:39:00.240 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:39:00.240+0000 7fd9e17fa700 1 -- 172.21.15.151:0/2122498171 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd9d4013070 con 0x7fd9e4104670 2024-05-08T05:39:00.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:59 smithi134 ceph-mon[34132]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:00.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:59 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:00.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:59 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:00.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:59 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-08T05:39:00.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:59 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-08T05:39:00.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:38:59 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:39:00.474 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:39:00.474+0000 7fd9ea4d9700 1 -- 172.21.15.151:0/2122498171 --> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi082=x;smithi134=y;smithi151=z", "target": ["mon-mgr", ""]}) -- 0x7fd9e40febe0 con 0x7fd9cc03e9a0 2024-05-08T05:39:00.488 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:39:00.488+0000 7fd9e17fa700 1 -- 172.21.15.151:0/2122498171 <== mgr.14152 v2:172.21.15.82:6800/4089180091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fd9e40febe0 con 0x7fd9cc03e9a0 2024-05-08T05:39:00.488 INFO:teuthology.orchestra.run.smithi151.stdout:Scheduled mgr update... 2024-05-08T05:39:00.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:39:00.490+0000 7fd9ea4d9700 1 -- 172.21.15.151:0/2122498171 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd9cc03e9a0 msgr2=0x7fd9cc040e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:39:00.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:39:00.490+0000 7fd9ea4d9700 1 --2- 172.21.15.151:0/2122498171 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd9cc03e9a0 0x7fd9cc040e60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd9d80098e0 tx=0x7fd9d8006dd0 comp rx=0 tx=0).stop 2024-05-08T05:39:00.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:39:00.490+0000 7fd9ea4d9700 1 -- 172.21.15.151:0/2122498171 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9e4104670 msgr2=0x7fd9e41987a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:39:00.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:39:00.490+0000 7fd9ea4d9700 1 --2- 172.21.15.151:0/2122498171 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9e4104670 0x7fd9e41987a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd9d40059d0 tx=0x7fd9d40050d0 comp rx=0 tx=0).stop 2024-05-08T05:39:00.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:39:00.490+0000 7fd9ea4d9700 1 -- 172.21.15.151:0/2122498171 shutdown_connections 2024-05-08T05:39:00.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:39:00.490+0000 7fd9ea4d9700 1 --2- 172.21.15.151:0/2122498171 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd9cc03e9a0 0x7fd9cc040e60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:39:00.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:39:00.490+0000 7fd9ea4d9700 1 --2- 172.21.15.151:0/2122498171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9e4199160 0x7fd9e41a02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:39:00.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:39:00.490+0000 7fd9ea4d9700 1 --2- 172.21.15.151:0/2122498171 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9e4104670 0x7fd9e41987a0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:39:00.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:39:00.490+0000 7fd9ea4d9700 1 --2- 172.21.15.151:0/2122498171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd9e4198ce0 0x7fd9e419dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:39:00.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:39:00.490+0000 7fd9ea4d9700 1 -- 172.21.15.151:0/2122498171 >> 172.21.15.151:0/2122498171 conn(0x7fd9e40fcc50 msgr2=0x7fd9e40fe4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:39:00.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:39:00.490+0000 7fd9ea4d9700 1 -- 172.21.15.151:0/2122498171 shutdown_connections 2024-05-08T05:39:00.491 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:39:00.490+0000 7fd9ea4d9700 1 -- 172.21.15.151:0/2122498171 wait complete. 2024-05-08T05:39:01.115 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:00 smithi151 ceph-mon[34815]: Reconfiguring mon.c (monmap changed)... 2024-05-08T05:39:01.115 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:00 smithi151 ceph-mon[34815]: Reconfiguring daemon mon.c on smithi151 2024-05-08T05:39:01.115 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:00 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:01.142 DEBUG:teuthology.orchestra.run.smithi134:mgr.y> sudo journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mgr.y.service 2024-05-08T05:39:01.144 DEBUG:teuthology.orchestra.run.smithi151:mgr.z> sudo journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mgr.z.service 2024-05-08T05:39:01.146 INFO:tasks.cephadm:Deploying OSDs... 2024-05-08T05:39:01.147 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-08T05:39:01.147 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/scratch_devs of=/dev/stdout 2024-05-08T05:39:01.166 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:00 smithi134 ceph-mon[34132]: Reconfiguring mon.c (monmap changed)... 2024-05-08T05:39:01.167 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:00 smithi134 ceph-mon[34132]: Reconfiguring daemon mon.c on smithi151 2024-05-08T05:39:01.167 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:00 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:01.205 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-08T05:39:01.205 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_1 2024-05-08T05:39:01.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:00 smithi082 ceph-mon[30098]: Reconfiguring mon.c (monmap changed)... 2024-05-08T05:39:01.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:00 smithi082 ceph-mon[30098]: Reconfiguring daemon mon.c on smithi151 2024-05-08T05:39:01.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:00 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:01.259 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-08T05:39:01.260 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T05:39:01.260 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 6h/6d Inode: 633 Links: 1 2024-05-08T05:39:01.260 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T05:39:01.260 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T05:39:01.260 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-05-08 05:37:56.650643576 +0000 2024-05-08T05:39:01.260 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-05-08 05:32:34.431753799 +0000 2024-05-08T05:39:01.260 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-05-08 05:32:34.431753799 +0000 2024-05-08T05:39:01.260 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-05-08 05:32:34.431753799 +0000 2024-05-08T05:39:01.260 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-08T05:39:01.386 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-05-08T05:39:01.386 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-05-08T05:39:01.386 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000393108 s, 1.3 MB/s 2024-05-08T05:39:01.389 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-08T05:39:01.442 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_2 2024-05-08T05:39:01.493 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-08T05:39:01.494 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T05:39:01.494 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 6h/6d Inode: 652 Links: 1 2024-05-08T05:39:01.494 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T05:39:01.494 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T05:39:01.494 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-05-08 05:37:56.728642064 +0000 2024-05-08T05:39:01.494 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-05-08 05:32:35.062741637 +0000 2024-05-08T05:39:01.494 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-05-08 05:32:35.062741637 +0000 2024-05-08T05:39:01.494 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-05-08 05:32:35.062741637 +0000 2024-05-08T05:39:01.494 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-08T05:39:01.572 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-05-08T05:39:01.573 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-05-08T05:39:01.573 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000383146 s, 1.3 MB/s 2024-05-08T05:39:01.577 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-08T05:39:01.632 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_3 2024-05-08T05:39:01.682 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-08T05:39:01.682 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T05:39:01.682 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 6h/6d Inode: 672 Links: 1 2024-05-08T05:39:01.683 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T05:39:01.683 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T05:39:01.683 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-05-08 05:37:56.802640629 +0000 2024-05-08T05:39:01.683 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-05-08 05:32:35.655730208 +0000 2024-05-08T05:39:01.683 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-05-08 05:32:35.655730208 +0000 2024-05-08T05:39:01.683 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-05-08 05:32:35.655730208 +0000 2024-05-08T05:39:01.683 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-08T05:39:01.762 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-05-08T05:39:01.762 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-05-08T05:39:01.762 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000346997 s, 1.5 MB/s 2024-05-08T05:39:01.766 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-08T05:39:01.820 DEBUG:teuthology.orchestra.run.smithi082:> stat /dev/vg_nvme/lv_4 2024-05-08T05:39:01.863 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:01 smithi151 ceph-mon[34815]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:01.863 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:01 smithi151 ceph-mon[34815]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi082=x;smithi134=y;smithi151=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:39:01.863 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:01 smithi151 ceph-mon[34815]: Saving service mgr spec with placement smithi082=x;smithi134=y;smithi151=z;count:3 2024-05-08T05:39:01.869 INFO:teuthology.orchestra.run.smithi082.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-08T05:39:01.869 INFO:teuthology.orchestra.run.smithi082.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T05:39:01.870 INFO:teuthology.orchestra.run.smithi082.stdout:Device: 6h/6d Inode: 691 Links: 1 2024-05-08T05:39:01.870 INFO:teuthology.orchestra.run.smithi082.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T05:39:01.870 INFO:teuthology.orchestra.run.smithi082.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T05:39:01.870 INFO:teuthology.orchestra.run.smithi082.stdout:Access: 2024-05-08 05:37:56.874639233 +0000 2024-05-08T05:39:01.870 INFO:teuthology.orchestra.run.smithi082.stdout:Modify: 2024-05-08 05:32:36.246718818 +0000 2024-05-08T05:39:01.870 INFO:teuthology.orchestra.run.smithi082.stdout:Change: 2024-05-08 05:32:36.246718818 +0000 2024-05-08T05:39:01.870 INFO:teuthology.orchestra.run.smithi082.stdout: Birth: 2024-05-08 05:32:36.246718818 +0000 2024-05-08T05:39:01.870 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-08T05:39:01.943 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records in 2024-05-08T05:39:01.943 INFO:teuthology.orchestra.run.smithi082.stderr:1+0 records out 2024-05-08T05:39:01.943 INFO:teuthology.orchestra.run.smithi082.stderr:512 bytes copied, 0.000339234 s, 1.5 MB/s 2024-05-08T05:39:01.947 DEBUG:teuthology.orchestra.run.smithi082:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-08T05:39:01.997 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-05-08T05:39:01.998 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/scratch_devs of=/dev/stdout 2024-05-08T05:39:02.017 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-08T05:39:02.017 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_1 2024-05-08T05:39:02.076 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-08T05:39:02.076 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T05:39:02.076 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-05-08T05:39:02.076 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T05:39:02.076 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T05:39:02.076 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-05-08 05:38:46.038156173 +0000 2024-05-08T05:39:02.076 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-05-08 05:31:29.004181259 +0000 2024-05-08T05:39:02.076 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-05-08 05:31:29.004181259 +0000 2024-05-08T05:39:02.076 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-05-08 05:31:29.004181259 +0000 2024-05-08T05:39:02.077 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-08T05:39:02.139 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:01 smithi134 ceph-mon[34132]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:02.140 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:01 smithi134 ceph-mon[34132]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi082=x;smithi134=y;smithi151=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:39:02.140 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:01 smithi134 ceph-mon[34132]: Saving service mgr spec with placement smithi082=x;smithi134=y;smithi151=z;count:3 2024-05-08T05:39:02.142 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-05-08T05:39:02.142 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-05-08T05:39:02.142 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.00024278 s, 2.1 MB/s 2024-05-08T05:39:02.143 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-08T05:39:02.201 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_2 2024-05-08T05:39:02.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:01 smithi082 ceph-mon[30098]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:02.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:01 smithi082 ceph-mon[30098]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi082=x;smithi134=y;smithi151=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:39:02.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:01 smithi082 ceph-mon[30098]: Saving service mgr spec with placement smithi082=x;smithi134=y;smithi151=z;count:3 2024-05-08T05:39:02.258 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-08T05:39:02.258 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T05:39:02.259 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-05-08T05:39:02.259 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T05:39:02.259 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T05:39:02.259 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-05-08 05:38:46.038156173 +0000 2024-05-08T05:39:02.259 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-05-08 05:31:29.345173334 +0000 2024-05-08T05:39:02.259 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-05-08 05:31:29.345173334 +0000 2024-05-08T05:39:02.259 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-05-08 05:31:29.345173334 +0000 2024-05-08T05:39:02.259 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-08T05:39:02.323 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-05-08T05:39:02.323 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-05-08T05:39:02.323 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000224875 s, 2.3 MB/s 2024-05-08T05:39:02.324 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-08T05:39:02.382 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_3 2024-05-08T05:39:02.438 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-08T05:39:02.438 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T05:39:02.438 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-05-08T05:39:02.438 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T05:39:02.439 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T05:39:02.439 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-05-08 05:38:46.038156173 +0000 2024-05-08T05:39:02.439 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-05-08 05:31:29.680165549 +0000 2024-05-08T05:39:02.439 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-05-08 05:31:29.680165549 +0000 2024-05-08T05:39:02.439 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-05-08 05:31:29.680165549 +0000 2024-05-08T05:39:02.439 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-08T05:39:02.502 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-05-08T05:39:02.502 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-05-08T05:39:02.502 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000242755 s, 2.1 MB/s 2024-05-08T05:39:02.503 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-08T05:39:02.561 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_4 2024-05-08T05:39:02.617 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-08T05:39:02.618 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T05:39:02.618 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-05-08T05:39:02.618 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T05:39:02.618 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T05:39:02.618 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-05-08 05:38:46.039156151 +0000 2024-05-08T05:39:02.618 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-05-08 05:31:30.015157764 +0000 2024-05-08T05:39:02.618 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-05-08 05:31:30.015157764 +0000 2024-05-08T05:39:02.618 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-05-08 05:31:30.015157764 +0000 2024-05-08T05:39:02.618 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-08T05:39:02.682 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-05-08T05:39:02.682 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-05-08T05:39:02.682 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000204335 s, 2.5 MB/s 2024-05-08T05:39:02.683 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-08T05:39:02.741 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-05-08T05:39:02.741 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/scratch_devs of=/dev/stdout 2024-05-08T05:39:02.757 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-08T05:39:02.757 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_1 2024-05-08T05:39:02.813 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-08T05:39:02.813 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T05:39:02.813 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 663 Links: 1 2024-05-08T05:39:02.813 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T05:39:02.813 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T05:39:02.813 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2024-05-08 05:38:36.924917574 +0000 2024-05-08T05:39:02.813 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2024-05-08 05:31:41.779423325 +0000 2024-05-08T05:39:02.813 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2024-05-08 05:31:41.779423325 +0000 2024-05-08T05:39:02.813 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2024-05-08 05:31:41.779423325 +0000 2024-05-08T05:39:02.814 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-08T05:39:02.877 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2024-05-08T05:39:02.877 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2024-05-08T05:39:02.877 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000362961 s, 1.4 MB/s 2024-05-08T05:39:02.878 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-08T05:39:02.935 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_2 2024-05-08T05:39:02.990 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-08T05:39:02.990 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T05:39:02.990 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-05-08T05:39:02.990 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T05:39:02.990 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T05:39:02.990 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2024-05-08 05:38:36.925917562 +0000 2024-05-08T05:39:02.990 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2024-05-08 05:31:42.127418957 +0000 2024-05-08T05:39:02.990 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2024-05-08 05:31:42.127418957 +0000 2024-05-08T05:39:02.991 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2024-05-08 05:31:42.127418957 +0000 2024-05-08T05:39:02.991 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-08T05:39:03.052 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2024-05-08T05:39:03.052 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2024-05-08T05:39:03.052 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.00027378 s, 1.9 MB/s 2024-05-08T05:39:03.054 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-08T05:39:03.109 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_3 2024-05-08T05:39:03.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:02 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:03.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:02 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:03.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:02 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:39:03.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:02 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:39:03.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:02 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:39:03.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:02 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:03.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:02 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-08T05:39:03.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:02 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-08T05:39:03.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:02 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-08T05:39:03.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:02 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:39:03.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:02 smithi151 ceph-mon[34815]: Deploying daemon mgr.z on smithi151 2024-05-08T05:39:03.131 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:02 smithi151 ceph-mon[34815]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:03.145 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-08T05:39:03.145 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T05:39:03.145 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-05-08T05:39:03.145 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T05:39:03.145 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T05:39:03.145 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2024-05-08 05:38:36.925917562 +0000 2024-05-08T05:39:03.145 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2024-05-08 05:31:42.466414702 +0000 2024-05-08T05:39:03.145 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2024-05-08 05:31:42.466414702 +0000 2024-05-08T05:39:03.145 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2024-05-08 05:31:42.466414702 +0000 2024-05-08T05:39:03.146 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-08T05:39:03.207 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2024-05-08T05:39:03.207 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2024-05-08T05:39:03.207 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000238585 s, 2.1 MB/s 2024-05-08T05:39:03.209 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-08T05:39:03.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:02 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:03.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:02 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:03.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:02 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:39:03.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:02 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:39:03.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:02 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:39:03.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:02 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:03.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:02 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-08T05:39:03.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:02 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-08T05:39:03.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:02 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-08T05:39:03.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:02 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:39:03.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:02 smithi082 ceph-mon[30098]: Deploying daemon mgr.z on smithi151 2024-05-08T05:39:03.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:02 smithi082 ceph-mon[30098]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:03.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:02 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:03.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:02 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:03.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:02 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:39:03.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:02 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:39:03.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:02 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:39:03.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:02 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:03.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:02 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-08T05:39:03.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:02 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-08T05:39:03.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:02 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-08T05:39:03.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:02 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:39:03.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:02 smithi134 ceph-mon[34132]: Deploying daemon mgr.z on smithi151 2024-05-08T05:39:03.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:02 smithi134 ceph-mon[34132]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:03.266 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_4 2024-05-08T05:39:03.321 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-08T05:39:03.321 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-08T05:39:03.321 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-05-08T05:39:03.321 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-08T05:39:03.321 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2024-05-08T05:39:03.321 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2024-05-08 05:38:36.925917562 +0000 2024-05-08T05:39:03.321 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2024-05-08 05:31:42.807410422 +0000 2024-05-08T05:39:03.321 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2024-05-08 05:31:42.807410422 +0000 2024-05-08T05:39:03.321 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2024-05-08 05:31:42.807410422 +0000 2024-05-08T05:39:03.321 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-08T05:39:03.383 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2024-05-08T05:39:03.383 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2024-05-08T05:39:03.383 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000187378 s, 2.7 MB/s 2024-05-08T05:39:03.384 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-08T05:39:03.439 INFO:tasks.cephadm:Deploying osd.0 on smithi082 with /dev/vg_nvme/lv_4... 2024-05-08T05:39:03.440 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-08T05:39:03.871 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:39:04.130 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 08 05:39:03 smithi151 systemd[1]: Starting Ceph mgr.z for c739a5c8-0cfc-11ef-bc97-c7b262605968... 2024-05-08T05:39:04.463 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 08 05:39:04 smithi151 podman[36823]: 2024-05-08 05:39:04.17758749 +0000 UTC m=+0.109145020 container create f1002fec0153a3f7ea6bbf271b69d5f924215dc1ef6609036bbca1091588cdd0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-05-08T05:39:04.463 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 08 05:39:04 smithi151 podman[36823]: 2024-05-08 05:39:04.086311567 +0000 UTC m=+0.017869110 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T05:39:04.463 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 08 05:39:04 smithi151 podman[36823]: 2024-05-08 05:39:04.379650821 +0000 UTC m=+0.311208350 container init f1002fec0153a3f7ea6bbf271b69d5f924215dc1ef6609036bbca1091588cdd0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-z, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=wip-57676-3-bee299f, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-05-08T05:39:04.463 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 08 05:39:04 smithi151 podman[36823]: 2024-05-08 05:39:04.382328059 +0000 UTC m=+0.313885595 container start f1002fec0153a3f7ea6bbf271b69d5f924215dc1ef6609036bbca1091588cdd0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-z, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-57676-3-bee299f, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-08T05:39:04.463 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 08 05:39:04 smithi151 ceph-mgr[36842]: -- 172.21.15.151:0/1939654064 <== mon.1 v2:172.21.15.151:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55df7634a5a0 con 0x55df7631e800 2024-05-08T05:39:04.463 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 08 05:39:04 smithi151 bash[36823]: f1002fec0153a3f7ea6bbf271b69d5f924215dc1ef6609036bbca1091588cdd0 2024-05-08T05:39:04.738 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 08 05:39:04 smithi151 systemd[1]: Started Ceph mgr.z for c739a5c8-0cfc-11ef-bc97-c7b262605968. 2024-05-08T05:39:04.738 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 08 05:39:04 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-z[36838]: 2024-05-08T05:39:04.549+0000 7f947793d200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T05:39:05.129 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 08 05:39:04 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-z[36838]: 2024-05-08T05:39:04.737+0000 7f947793d200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T05:39:05.130 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 08 05:39:04 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-z[36838]: 2024-05-08T05:39:04.840+0000 7f947793d200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T05:39:05.548 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 08 05:39:05 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-z[36838]: 2024-05-08T05:39:05.154+0000 7f947793d200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T05:39:05.548 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 08 05:39:05 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-z[36838]: 2024-05-08T05:39:05.239+0000 7f947793d200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T05:39:05.665 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:05 smithi082 ceph-mon[30098]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:05.665 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:05 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:05.665 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:05 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:05.666 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:05 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:05.666 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:05 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-08T05:39:05.666 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:05 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-08T05:39:05.666 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:05 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-08T05:39:05.666 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:05 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:39:05.666 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:05 smithi082 ceph-mon[30098]: Deploying daemon mgr.y on smithi134 2024-05-08T05:39:05.845 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:05 smithi151 ceph-mon[34815]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:05.845 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:05 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:05.845 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:05 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:05.845 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:05 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:05.845 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:05 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-08T05:39:05.845 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:05 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-08T05:39:05.845 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:05 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-08T05:39:05.845 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:05 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:39:05.845 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:05 smithi151 ceph-mon[34815]: Deploying daemon mgr.y on smithi134 2024-05-08T05:39:06.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:05 smithi134 ceph-mon[34132]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:06.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:05 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:06.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:05 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:06.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:05 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:06.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:05 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-08T05:39:06.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:05 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-08T05:39:06.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:05 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-08T05:39:06.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:05 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:39:06.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:05 smithi134 ceph-mon[34132]: Deploying daemon mgr.y on smithi134 2024-05-08T05:39:06.554 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-08T05:39:06.554 INFO:teuthology.orchestra.run.smithi082.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-08T05:39:06.554 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10+0 records in 2024-05-08T05:39:06.554 INFO:teuthology.orchestra.run.smithi082.stderr:10+0 records out 2024-05-08T05:39:06.554 INFO:teuthology.orchestra.run.smithi082.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0348036 s, 301 MB/s 2024-05-08T05:39:06.554 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping successful for: 2024-05-08T05:39:06.750 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 08 05:39:06 smithi134 systemd[1]: Starting Ceph mgr.y for c739a5c8-0cfc-11ef-bc97-c7b262605968... 2024-05-08T05:39:06.798 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 08 05:39:06 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-z[36838]: 2024-05-08T05:39:06.489+0000 7f947793d200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T05:39:06.798 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 08 05:39:06 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-z[36838]: 2024-05-08T05:39:06.663+0000 7f947793d200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T05:39:07.084 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 08 05:39:06 smithi134 podman[35503]: 2024-05-08 05:39:06.694883997 +0000 UTC m=+0.018075661 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T05:39:07.084 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 08 05:39:06 smithi134 podman[35503]: 2024-05-08 05:39:06.807808943 +0000 UTC m=+0.131000586 container create d872a9d9122cff8fe38313329e4039873021c355f6951570effddca160e5590e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-y, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-57676-3-bee299f) 2024-05-08T05:39:07.085 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 08 05:39:07 smithi134 podman[35503]: 2024-05-08 05:39:07.084971202 +0000 UTC m=+0.408162846 container init d872a9d9122cff8fe38313329e4039873021c355f6951570effddca160e5590e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-y, RELEASE=wip-57676-3-bee299f, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True) 2024-05-08T05:39:07.129 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 08 05:39:06 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-z[36838]: 2024-05-08T05:39:06.839+0000 7f947793d200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T05:39:07.304 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi082:vg_nvme/lv_4 2024-05-08T05:39:07.428 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 08 05:39:07 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-z[36838]: 2024-05-08T05:39:07.129+0000 7f947793d200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T05:39:07.428 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 08 05:39:07 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-z[36838]: 2024-05-08T05:39:07.222+0000 7f947793d200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T05:39:07.428 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 08 05:39:07 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-z[36838]: 2024-05-08T05:39:07.427+0000 7f947793d200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T05:39:07.431 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 08 05:39:07 smithi134 podman[35503]: 2024-05-08 05:39:07.087784976 +0000 UTC m=+0.410976617 container start d872a9d9122cff8fe38313329e4039873021c355f6951570effddca160e5590e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-y, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-57676-3-bee299f, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux ) 2024-05-08T05:39:07.431 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 08 05:39:07 smithi134 ceph-mgr[35522]: -- 172.21.15.134:0/3305825696 <== mon.2 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559aa2aca5a0 con 0x559aa2a9ec00 2024-05-08T05:39:07.431 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 08 05:39:07 smithi134 bash[35503]: d872a9d9122cff8fe38313329e4039873021c355f6951570effddca160e5590e 2024-05-08T05:39:07.431 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 08 05:39:07 smithi134 systemd[1]: Started Ceph mgr.y for c739a5c8-0cfc-11ef-bc97-c7b262605968. 2024-05-08T05:39:07.431 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 08 05:39:07 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-y[35518]: 2024-05-08T05:39:07.242+0000 7fca68836200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-08T05:39:07.431 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 08 05:39:07 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-y[35518]: 2024-05-08T05:39:07.430+0000 7fca68836200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-08T05:39:07.716 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:39:07.750 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 08 05:39:07 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-y[35518]: 2024-05-08T05:39:07.536+0000 7fca68836200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-08T05:39:07.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:07 smithi134 ceph-mon[34132]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:07.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:07 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:07.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:07 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:07.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:07 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:07.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:07 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:07.751 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:07 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:39:07.867 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:07 smithi082 ceph-mon[30098]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:07.867 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:07 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:07.867 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:07 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:07.867 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:07 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:07.867 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:07 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:07.867 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:07 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:39:07.879 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 08 05:39:07 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-z[36838]: 2024-05-08T05:39:07.630+0000 7f947793d200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T05:39:07.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:07 smithi151 ceph-mon[34815]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:07.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:07 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:07.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:07 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:07.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:07 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:07.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:07 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:07.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:07 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:39:08.250 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 08 05:39:07 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-y[35518]: 2024-05-08T05:39:07.868+0000 7fca68836200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-08T05:39:08.250 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 08 05:39:07 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-y[35518]: 2024-05-08T05:39:07.957+0000 7fca68836200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-08T05:39:08.629 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 08 05:39:08 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-z[36838]: 2024-05-08T05:39:08.287+0000 7f947793d200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-08T05:39:08.630 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 08 05:39:08 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-z[36838]: 2024-05-08T05:39:08.518+0000 7f947793d200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-08T05:39:09.379 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 08 05:39:08 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-z[36838]: 2024-05-08T05:39:08.966+0000 7f947793d200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T05:39:09.380 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 08 05:39:09 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-z[36838]: 2024-05-08T05:39:09.065+0000 7f947793d200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T05:39:09.500 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 08 05:39:09 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-y[35518]: 2024-05-08T05:39:09.201+0000 7fca68836200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-08T05:39:09.500 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 08 05:39:09 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-y[35518]: 2024-05-08T05:39:09.368+0000 7fca68836200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-08T05:39:09.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:39:09.702+0000 7f8ac1200700 1 -- 172.21.15.82:0/3040133857 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8abc1091f0 msgr2=0x7f8abc10b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:39:09.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:39:09.702+0000 7f8ac1200700 1 --2- 172.21.15.82:0/3040133857 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8abc1091f0 0x7f8abc10b660 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4009f90 tx=0x7f8ab400b330 comp rx=0 tx=0).stop 2024-05-08T05:39:09.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:39:09.703+0000 7f8ac1200700 1 -- 172.21.15.82:0/3040133857 shutdown_connections 2024-05-08T05:39:09.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:39:09.703+0000 7f8ac1200700 1 --2- 172.21.15.82:0/3040133857 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8abc103f90 0x7f8abc106380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:39:09.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:39:09.703+0000 7f8ac1200700 1 --2- 172.21.15.82:0/3040133857 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8abc1091f0 0x7f8abc10b660 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:39:09.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:39:09.703+0000 7f8ac1200700 1 --2- 172.21.15.82:0/3040133857 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8abc1068c0 0x7f8abc108cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:39:09.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:39:09.703+0000 7f8ac1200700 1 -- 172.21.15.82:0/3040133857 >> 172.21.15.82:0/3040133857 conn(0x7f8abc0fd9c0 msgr2=0x7f8abc0ffde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:39:09.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:39:09.703+0000 7f8ac1200700 1 -- 172.21.15.82:0/3040133857 shutdown_connections 2024-05-08T05:39:09.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:39:09.703+0000 7f8ac1200700 1 -- 172.21.15.82:0/3040133857 wait complete. 2024-05-08T05:39:09.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:39:09.704+0000 7f8ac1200700 1 Processor -- start 2024-05-08T05:39:09.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:39:09.704+0000 7f8ac1200700 1 -- start start 2024-05-08T05:39:09.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:39:09.704+0000 7f8ac1200700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8abc103f90 0x7f8abc19b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:39:09.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:39:09.704+0000 7f8ac1200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8abc1068c0 0x7f8abc19bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:39:09.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:39:09.704+0000 7f8ac1200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8abc1091f0 0x7f8abc1a2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:39:09.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:39:09.704+0000 7f8ac1200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8abc10f010 con 0x7f8abc1091f0 2024-05-08T05:39:09.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:39:09.704+0000 7f8ac1200700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8abc10ee90 con 0x7f8abc1068c0 2024-05-08T05:39:09.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:39:09.704+0000 7f8ac1200700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8abc10f190 con 0x7f8abc103f90 2024-05-08T05:39:09.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:39:09.705+0000 7f8ab9e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8abc103f90 0x7f8abc19b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:39:09.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:39:09.705+0000 7f8ab9400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8abc1068c0 0x7f8abc19bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:39:09.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:39:09.705+0000 7f8ab9e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8abc103f90 0x7f8abc19b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:41570/0 (socket says 172.21.15.82:41570) 2024-05-08T05:39:09.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:39:09.705+0000 7f8ab9e00700 1 -- 172.21.15.82:0/626116555 learned_addr learned my addr 172.21.15.82:0/626116555 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:39:09.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:39:09.705+0000 7f8aba800700 1 --2- 172.21.15.82:0/626116555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8abc1091f0 0x7f8abc1a2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:39:09.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:39:09.705+0000 7f8ab9e00700 1 -- 172.21.15.82:0/626116555 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8abc1068c0 msgr2=0x7f8abc19bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:39:09.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:39:09.705+0000 7f8ab9e00700 1 --2- 172.21.15.82:0/626116555 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8abc1068c0 0x7f8abc19bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:39:09.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:39:09.705+0000 7f8ab9e00700 1 -- 172.21.15.82:0/626116555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8abc1091f0 msgr2=0x7f8abc1a2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:39:09.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:39:09.705+0000 7f8ab9e00700 1 --2- 172.21.15.82:0/626116555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8abc1091f0 0x7f8abc1a2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:39:09.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:39:09.705+0000 7f8ab9e00700 1 -- 172.21.15.82:0/626116555 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8abc1a3490 con 0x7f8abc103f90 2024-05-08T05:39:09.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:39:09.705+0000 7f8ab9e00700 1 --2- 172.21.15.82:0/626116555 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8abc103f90 0x7f8abc19b830 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8aac00e9d0 tx=0x7f8aac00ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:39:09.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:39:09.706+0000 7f8ab2a00700 1 -- 172.21.15.82:0/626116555 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aac00cbd0 con 0x7f8abc103f90 2024-05-08T05:39:09.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:39:09.706+0000 7f8ab2a00700 1 -- 172.21.15.82:0/626116555 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8aac00ee60 con 0x7f8abc103f90 2024-05-08T05:39:09.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:39:09.706+0000 7f8ac1200700 1 -- 172.21.15.82:0/626116555 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8abc1a3780 con 0x7f8abc103f90 2024-05-08T05:39:09.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:39:09.706+0000 7f8ab2a00700 1 -- 172.21.15.82:0/626116555 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aac018680 con 0x7f8abc103f90 2024-05-08T05:39:09.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:39:09.706+0000 7f8ac1200700 1 -- 172.21.15.82:0/626116555 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8abc1a3d10 con 0x7f8abc103f90 2024-05-08T05:39:09.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:39:09.707+0000 7f8ac1200700 1 -- 172.21.15.82:0/626116555 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8abc06a190 con 0x7f8abc103f90 2024-05-08T05:39:09.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:39:09.707+0000 7f8ab2a00700 1 -- 172.21.15.82:0/626116555 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f8aac018820 con 0x7f8abc103f90 2024-05-08T05:39:09.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:39:09.707+0000 7f8ab2a00700 1 --2- 172.21.15.82:0/626116555 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f8aa003e750 0x7f8aa0040c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:39:09.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:39:09.708+0000 7f8ab2a00700 1 -- 172.21.15.82:0/626116555 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f8aac052b30 con 0x7f8abc103f90 2024-05-08T05:39:09.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:39:09.708+0000 7f8ab9400700 1 --2- 172.21.15.82:0/626116555 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f8aa003e750 0x7f8aa0040c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:39:09.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:39:09.708+0000 7f8ab9400700 1 --2- 172.21.15.82:0/626116555 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f8aa003e750 0x7f8aa0040c10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8005fd0 tx=0x7f8aa8009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:39:09.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:39:09.713+0000 7f8ab2a00700 1 -- 172.21.15.82:0/626116555 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f8aac020360 con 0x7f8abc103f90 2024-05-08T05:39:09.774 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 08 05:39:09 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-z[36838]: 2024-05-08T05:39:09.438+0000 7f947793d200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-08T05:39:09.831 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 08 05:39:09 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-y[35518]: 2024-05-08T05:39:09.540+0000 7fca68836200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-08T05:39:09.831 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 08 05:39:09 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-y[35518]: 2024-05-08T05:39:09.831+0000 7fca68836200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-08T05:39:09.832 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:09 smithi134 ceph-mon[34132]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:09.832 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:09 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:09.832 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:09 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:09.832 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:09 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:09.832 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:09 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:09.832 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:09 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:39:09.832 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:09 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:39:09.832 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:09 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:09.832 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:09 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:09.833 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:09 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-08T05:39:09.833 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:09 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-08T05:39:09.833 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:09 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:39:09.919 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:09 smithi082 ceph-mon[30098]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:09.919 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:09 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:09.919 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:09 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:09.919 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:09 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:09.919 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:09 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:09.919 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:09 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:39:09.919 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:09 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:39:09.920 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:09 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:09.920 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:09 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:09.920 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:09 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-08T05:39:09.920 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:09 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-08T05:39:09.920 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:09 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:39:09.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:39:09.967+0000 7f8ac1200700 1 -- 172.21.15.82:0/626116555 --> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f8abc0638e0 con 0x7f8aa003e750 2024-05-08T05:39:10.127 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 08 05:39:09 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-y[35518]: 2024-05-08T05:39:09.923+0000 7fca68836200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-08T05:39:10.127 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 08 05:39:10 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-y[35518]: 2024-05-08T05:39:10.127+0000 7fca68836200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-08T05:39:10.129 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 08 05:39:09 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-z[36838]: 2024-05-08T05:39:09.798+0000 7f947793d200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T05:39:10.129 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 08 05:39:09 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-z[36838]: 2024-05-08T05:39:09.892+0000 7f947793d200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T05:39:10.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:09 smithi151 ceph-mon[34815]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:10.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:09 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:10.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:09 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:10.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:09 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:10.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:09 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:10.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:09 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:39:10.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:09 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:39:10.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:09 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:10.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:09 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:10.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:09 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-08T05:39:10.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:09 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-08T05:39:10.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:09 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:39:10.500 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 08 05:39:10 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-y[35518]: 2024-05-08T05:39:10.321+0000 7fca68836200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-08T05:39:10.629 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 08 05:39:10 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-z[36838]: 2024-05-08T05:39:10.138+0000 7f947793d200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T05:39:10.630 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 08 05:39:10 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-z[36838]: 2024-05-08T05:39:10.274+0000 7f947793d200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T05:39:10.630 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 08 05:39:10 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-z[36838]: 2024-05-08T05:39:10.372+0000 7f947793d200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T05:39:10.941 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:10 smithi082 ceph-mon[30098]: Reconfiguring mgr.x (unknown last config time)... 2024-05-08T05:39:10.941 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:10 smithi082 ceph-mon[30098]: Reconfiguring daemon mgr.x on smithi082 2024-05-08T05:39:10.941 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:10 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:39:10.941 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:10 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:39:10.941 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:10 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:39:11.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:10 smithi151 ceph-mon[34815]: Reconfiguring mgr.x (unknown last config time)... 2024-05-08T05:39:11.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:10 smithi151 ceph-mon[34815]: Reconfiguring daemon mgr.x on smithi082 2024-05-08T05:39:11.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:10 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:39:11.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:10 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:39:11.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:10 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:39:11.130 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 08 05:39:10 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-z[36838]: 2024-05-08T05:39:10.701+0000 7f947793d200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T05:39:11.130 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 08 05:39:10 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-z[36838]: 2024-05-08T05:39:10.794+0000 7f947793d200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T05:39:11.144 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:10 smithi134 ceph-mon[34132]: Reconfiguring mgr.x (unknown last config time)... 2024-05-08T05:39:11.144 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:10 smithi134 ceph-mon[34132]: Reconfiguring daemon mgr.x on smithi082 2024-05-08T05:39:11.144 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:10 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:39:11.144 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:10 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:39:11.144 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:10 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:39:11.144 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 08 05:39:10 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-y[35518]: 2024-05-08T05:39:10.923+0000 7fca68836200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-08T05:39:11.145 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 08 05:39:11 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-y[35518]: 2024-05-08T05:39:11.143+0000 7fca68836200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-08T05:39:11.785 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 08 05:39:11 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-z[36838]: 2024-05-08T05:39:11.407+0000 7f947793d200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T05:39:11.785 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 08 05:39:11 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-z[36838]: 2024-05-08T05:39:11.626+0000 7f947793d200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T05:39:12.000 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 08 05:39:11 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-y[35518]: 2024-05-08T05:39:11.567+0000 7fca68836200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-08T05:39:12.000 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 08 05:39:11 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-y[35518]: 2024-05-08T05:39:11.661+0000 7fca68836200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-08T05:39:12.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:11 smithi134 ceph-mon[34132]: from='client.24124 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:39:12.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:11 smithi134 ceph-mon[34132]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:12.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:11 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:12.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:11 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:12.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:11 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:39:12.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:11 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:39:12.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:11 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:39:12.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:11 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:12.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:11 smithi134 ceph-mon[34132]: from='mgr.? 172.21.15.151:0/1377709058' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-08T05:39:12.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:11 smithi134 ceph-mon[34132]: from='mgr.? 172.21.15.151:0/1377709058' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-08T05:39:12.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:11 smithi134 ceph-mon[34132]: Standby manager daemon z started 2024-05-08T05:39:12.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:11 smithi134 ceph-mon[34132]: from='mgr.? 172.21.15.151:0/1377709058' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-08T05:39:12.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:11 smithi134 ceph-mon[34132]: from='mgr.? 172.21.15.151:0/1377709058' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-08T05:39:12.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:11 smithi151 ceph-mon[34815]: from='client.24124 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:39:12.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:11 smithi151 ceph-mon[34815]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:12.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:11 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:12.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:11 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:12.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:11 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:39:12.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:11 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:39:12.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:11 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:39:12.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:11 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:12.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:11 smithi151 ceph-mon[34815]: from='mgr.? 172.21.15.151:0/1377709058' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-08T05:39:12.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:11 smithi151 ceph-mon[34815]: from='mgr.? 172.21.15.151:0/1377709058' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-08T05:39:12.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:11 smithi151 ceph-mon[34815]: Standby manager daemon z started 2024-05-08T05:39:12.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:11 smithi151 ceph-mon[34815]: from='mgr.? 172.21.15.151:0/1377709058' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-08T05:39:12.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:11 smithi151 ceph-mon[34815]: from='mgr.? 172.21.15.151:0/1377709058' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-08T05:39:12.131 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:11 smithi082 ceph-mon[30098]: from='client.24124 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:39:12.131 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:11 smithi082 ceph-mon[30098]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:12.131 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:11 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:12.131 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:11 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:12.131 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:11 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:39:12.131 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:11 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:39:12.131 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:11 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:39:12.131 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:11 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:12.131 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:11 smithi082 ceph-mon[30098]: from='mgr.? 172.21.15.151:0/1377709058' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-08T05:39:12.132 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:11 smithi082 ceph-mon[30098]: from='mgr.? 172.21.15.151:0/1377709058' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-08T05:39:12.132 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:11 smithi082 ceph-mon[30098]: Standby manager daemon z started 2024-05-08T05:39:12.132 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:11 smithi082 ceph-mon[30098]: from='mgr.? 172.21.15.151:0/1377709058' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-08T05:39:12.132 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:11 smithi082 ceph-mon[30098]: from='mgr.? 172.21.15.151:0/1377709058' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-08T05:39:12.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:39:12.135+0000 7f8ab2a00700 1 -- 172.21.15.82:0/626116555 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mgrmap(e 14) ==== 99937+0+0 (secure 0 0 0) 0x7f8aac016330 con 0x7f8abc103f90 2024-05-08T05:39:12.378 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 08 05:39:12 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-y[35518]: 2024-05-08T05:39:12.029+0000 7fca68836200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-08T05:39:12.378 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 08 05:39:12 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-y[35518]: 2024-05-08T05:39:12.378+0000 7fca68836200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-08T05:39:12.707 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 08 05:39:12 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-y[35518]: 2024-05-08T05:39:12.469+0000 7fca68836200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-08T05:39:13.000 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 08 05:39:12 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-y[35518]: 2024-05-08T05:39:12.706+0000 7fca68836200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-08T05:39:13.000 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 08 05:39:12 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-y[35518]: 2024-05-08T05:39:12.838+0000 7fca68836200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-08T05:39:13.000 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 08 05:39:12 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-y[35518]: 2024-05-08T05:39:12.931+0000 7fca68836200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-08T05:39:13.268 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 08 05:39:13 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-y[35518]: 2024-05-08T05:39:13.267+0000 7fca68836200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-08T05:39:13.268 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:13 smithi134 ceph-mon[34132]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:13.268 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:13 smithi134 ceph-mon[34132]: mgrmap e14: x(active, since 88s), standbys: z 2024-05-08T05:39:13.268 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:13 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-08T05:39:13.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:13 smithi082 ceph-mon[30098]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:13.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:13 smithi082 ceph-mon[30098]: mgrmap e14: x(active, since 88s), standbys: z 2024-05-08T05:39:13.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:13 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-08T05:39:13.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:13 smithi151 ceph-mon[34815]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:13.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:13 smithi151 ceph-mon[34815]: mgrmap e14: x(active, since 88s), standbys: z 2024-05-08T05:39:13.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:13 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-08T05:39:13.750 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 08 05:39:13 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-y[35518]: 2024-05-08T05:39:13.363+0000 7fca68836200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-08T05:39:14.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:14 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/3135636168' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc9bd472-b765-4893-84ed-c66b5c1c61b1"}]: dispatch 2024-05-08T05:39:14.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:14 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/3135636168' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bc9bd472-b765-4893-84ed-c66b5c1c61b1"}]': finished 2024-05-08T05:39:14.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:14 smithi134 ceph-mon[34132]: osdmap e5: 1 total, 0 up, 1 in 2024-05-08T05:39:14.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:14 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T05:39:14.251 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 08 05:39:13 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-y[35518]: 2024-05-08T05:39:13.980+0000 7fca68836200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-08T05:39:14.251 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 08 05:39:14 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-y[35518]: 2024-05-08T05:39:14.198+0000 7fca68836200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-08T05:39:14.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:14 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/3135636168' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc9bd472-b765-4893-84ed-c66b5c1c61b1"}]: dispatch 2024-05-08T05:39:14.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:14 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/3135636168' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bc9bd472-b765-4893-84ed-c66b5c1c61b1"}]': finished 2024-05-08T05:39:14.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:14 smithi082 ceph-mon[30098]: osdmap e5: 1 total, 0 up, 1 in 2024-05-08T05:39:14.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:14 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T05:39:14.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:14 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/3135636168' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bc9bd472-b765-4893-84ed-c66b5c1c61b1"}]: dispatch 2024-05-08T05:39:14.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:14 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/3135636168' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bc9bd472-b765-4893-84ed-c66b5c1c61b1"}]': finished 2024-05-08T05:39:14.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:14 smithi151 ceph-mon[34815]: osdmap e5: 1 total, 0 up, 1 in 2024-05-08T05:39:14.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:14 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T05:39:15.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:39:15.161+0000 7f8ab2a00700 1 -- 172.21.15.82:0/626116555 <== mon.1 v2:172.21.15.151:3300/0 8 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7f8aac025170 con 0x7f8abc103f90 2024-05-08T05:39:15.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:15 smithi082 ceph-mon[30098]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:15.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:15 smithi082 ceph-mon[30098]: from='mgr.? 172.21.15.134:0/3892572101' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-08T05:39:15.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:15 smithi082 ceph-mon[30098]: Standby manager daemon y started 2024-05-08T05:39:15.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:15 smithi082 ceph-mon[30098]: from='mgr.? 172.21.15.134:0/3892572101' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-08T05:39:15.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:15 smithi082 ceph-mon[30098]: from='mgr.? 172.21.15.134:0/3892572101' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-08T05:39:15.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:15 smithi082 ceph-mon[30098]: from='mgr.? 172.21.15.134:0/3892572101' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-08T05:39:15.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:15 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/3279486926' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:39:15.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:15 smithi134 ceph-mon[34132]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:15.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:15 smithi134 ceph-mon[34132]: from='mgr.? 172.21.15.134:0/3892572101' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-08T05:39:15.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:15 smithi134 ceph-mon[34132]: Standby manager daemon y started 2024-05-08T05:39:15.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:15 smithi134 ceph-mon[34132]: from='mgr.? 172.21.15.134:0/3892572101' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-08T05:39:15.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:15 smithi134 ceph-mon[34132]: from='mgr.? 172.21.15.134:0/3892572101' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-08T05:39:15.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:15 smithi134 ceph-mon[34132]: from='mgr.? 172.21.15.134:0/3892572101' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-08T05:39:15.501 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:15 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/3279486926' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:39:15.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:15 smithi151 ceph-mon[34815]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:15.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:15 smithi151 ceph-mon[34815]: from='mgr.? 172.21.15.134:0/3892572101' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-08T05:39:15.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:15 smithi151 ceph-mon[34815]: Standby manager daemon y started 2024-05-08T05:39:15.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:15 smithi151 ceph-mon[34815]: from='mgr.? 172.21.15.134:0/3892572101' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-08T05:39:15.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:15 smithi151 ceph-mon[34815]: from='mgr.? 172.21.15.134:0/3892572101' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-08T05:39:15.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:15 smithi151 ceph-mon[34815]: from='mgr.? 172.21.15.134:0/3892572101' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-08T05:39:15.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:15 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/3279486926' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:39:16.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:16 smithi082 ceph-mon[30098]: mgrmap e15: x(active, since 91s), standbys: z, y 2024-05-08T05:39:16.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:16 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-08T05:39:16.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:16 smithi134 ceph-mon[34132]: mgrmap e15: x(active, since 91s), standbys: z, y 2024-05-08T05:39:16.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:16 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-08T05:39:16.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:16 smithi151 ceph-mon[34815]: mgrmap e15: x(active, since 91s), standbys: z, y 2024-05-08T05:39:16.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:16 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-08T05:39:17.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:17 smithi082 ceph-mon[30098]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:17.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:17 smithi134 ceph-mon[34132]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:17.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:17 smithi151 ceph-mon[34815]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:19.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:19 smithi082 ceph-mon[30098]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:19.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:19 smithi134 ceph-mon[34132]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:19.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:19 smithi151 ceph-mon[34815]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:21.447 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:21 smithi082 ceph-mon[30098]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:21.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:21 smithi134 ceph-mon[34132]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:21.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:21 smithi151 ceph-mon[34815]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:23.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:23 smithi082 ceph-mon[30098]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:23.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:23 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-08T05:39:23.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:23 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:39:23.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:23 smithi082 ceph-mon[30098]: Deploying daemon osd.0 on smithi082 2024-05-08T05:39:23.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:23 smithi134 ceph-mon[34132]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:23.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:23 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-08T05:39:23.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:23 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:39:23.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:23 smithi134 ceph-mon[34132]: Deploying daemon osd.0 on smithi082 2024-05-08T05:39:23.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:23 smithi151 ceph-mon[34815]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:23.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:23 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-08T05:39:23.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:23 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:39:23.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:23 smithi151 ceph-mon[34815]: Deploying daemon osd.0 on smithi082 2024-05-08T05:39:25.445 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:25 smithi082 ceph-mon[30098]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:25.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:25 smithi134 ceph-mon[34132]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:25.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:25 smithi151 ceph-mon[34815]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:27.253 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:27 smithi082 ceph-mon[30098]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:27.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:27 smithi134 ceph-mon[34132]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:27.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:27 smithi151 ceph-mon[34815]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:29.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:29 smithi082 ceph-mon[30098]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:29.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:29 smithi134 ceph-mon[34132]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:29.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:29 smithi151 ceph-mon[34815]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:31.791 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:31 smithi082 ceph-mon[30098]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:31.792 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:31 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:31.792 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:31 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:31.792 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:31 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:39:31.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:31 smithi151 ceph-mon[34815]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:31.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:31 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:31.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:31 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:31.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:31 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:39:32.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:31 smithi134 ceph-mon[34132]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:32.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:31 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:32.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:31 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:32.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:31 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:39:33.652 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:33 smithi082 ceph-mon[30098]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:33.652 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:33 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:33.652 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:33 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:33.652 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:33 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:39:33.652 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:33 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:39:33.652 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:33 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:33.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:33 smithi151 ceph-mon[34815]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:33.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:33 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:33.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:33 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:33.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:33 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:39:33.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:33 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:39:33.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:33 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:34.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:33 smithi134 ceph-mon[34132]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:34.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:33 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:34.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:33 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:34.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:33 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:39:34.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:33 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:39:34.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:33 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:34.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:34 smithi082 ceph-mon[30098]: from='osd.0 [v2:172.21.15.82:6802/4051651615,v1:172.21.15.82:6803/4051651615]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-08T05:39:34.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:34 smithi151 ceph-mon[34815]: from='osd.0 [v2:172.21.15.82:6802/4051651615,v1:172.21.15.82:6803/4051651615]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-08T05:39:35.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:34 smithi134 ceph-mon[34132]: from='osd.0 [v2:172.21.15.82:6802/4051651615,v1:172.21.15.82:6803/4051651615]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-08T05:39:35.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:39:35.315+0000 7f8ab2a00700 1 -- 172.21.15.82:0/626116555 <== mgr.14152 v2:172.21.15.82:6800/4089180091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8abc0638e0 con 0x7f8aa003e750 2024-05-08T05:39:35.316 INFO:teuthology.orchestra.run.smithi082.stdout:Created osd(s) 0 on host 'smithi082' 2024-05-08T05:39:35.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:39:35.319+0000 7f8ac1200700 1 -- 172.21.15.82:0/626116555 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f8aa003e750 msgr2=0x7f8aa0040c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:39:35.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:39:35.319+0000 7f8ac1200700 1 --2- 172.21.15.82:0/626116555 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f8aa003e750 0x7f8aa0040c10 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8005fd0 tx=0x7f8aa8009310 comp rx=0 tx=0).stop 2024-05-08T05:39:35.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:39:35.319+0000 7f8ac1200700 1 -- 172.21.15.82:0/626116555 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8abc103f90 msgr2=0x7f8abc19b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:39:35.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:39:35.319+0000 7f8ac1200700 1 --2- 172.21.15.82:0/626116555 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8abc103f90 0x7f8abc19b830 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f8aac00e9d0 tx=0x7f8aac00ece0 comp rx=0 tx=0).stop 2024-05-08T05:39:35.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:39:35.319+0000 7f8ac1200700 1 -- 172.21.15.82:0/626116555 shutdown_connections 2024-05-08T05:39:35.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:39:35.319+0000 7f8ac1200700 1 --2- 172.21.15.82:0/626116555 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f8aa003e750 0x7f8aa0040c10 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:39:35.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:39:35.319+0000 7f8ac1200700 1 --2- 172.21.15.82:0/626116555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8abc1091f0 0x7f8abc1a2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:39:35.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:39:35.319+0000 7f8ac1200700 1 --2- 172.21.15.82:0/626116555 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8abc103f90 0x7f8abc19b830 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:39:35.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:39:35.319+0000 7f8ac1200700 1 --2- 172.21.15.82:0/626116555 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8abc1068c0 0x7f8abc19bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:39:35.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:39:35.319+0000 7f8ac1200700 1 -- 172.21.15.82:0/626116555 >> 172.21.15.82:0/626116555 conn(0x7f8abc0fd9c0 msgr2=0x7f8abc1036f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:39:35.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:39:35.320+0000 7f8ac1200700 1 -- 172.21.15.82:0/626116555 shutdown_connections 2024-05-08T05:39:35.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:39:35.320+0000 7f8ac1200700 1 -- 172.21.15.82:0/626116555 wait complete. 2024-05-08T05:39:35.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:35 smithi151 ceph-mon[34815]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:35.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:35 smithi151 ceph-mon[34815]: from='osd.0 [v2:172.21.15.82:6802/4051651615,v1:172.21.15.82:6803/4051651615]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-08T05:39:35.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:35 smithi151 ceph-mon[34815]: osdmap e6: 1 total, 0 up, 1 in 2024-05-08T05:39:35.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:35 smithi151 ceph-mon[34815]: from='osd.0 [v2:172.21.15.82:6802/4051651615,v1:172.21.15.82:6803/4051651615]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-05-08T05:39:35.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:35 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T05:39:35.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:35 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:35.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:35 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:35.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:35 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:39:35.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:35 smithi082 ceph-mon[30098]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:35.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:35 smithi082 ceph-mon[30098]: from='osd.0 [v2:172.21.15.82:6802/4051651615,v1:172.21.15.82:6803/4051651615]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-08T05:39:35.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:35 smithi082 ceph-mon[30098]: osdmap e6: 1 total, 0 up, 1 in 2024-05-08T05:39:35.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:35 smithi082 ceph-mon[30098]: from='osd.0 [v2:172.21.15.82:6802/4051651615,v1:172.21.15.82:6803/4051651615]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-05-08T05:39:35.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:35 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T05:39:35.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:35 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:35.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:35 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:35.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:35 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:39:36.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:35 smithi134 ceph-mon[34132]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:36.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:35 smithi134 ceph-mon[34132]: from='osd.0 [v2:172.21.15.82:6802/4051651615,v1:172.21.15.82:6803/4051651615]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-08T05:39:36.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:35 smithi134 ceph-mon[34132]: osdmap e6: 1 total, 0 up, 1 in 2024-05-08T05:39:36.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:35 smithi134 ceph-mon[34132]: from='osd.0 [v2:172.21.15.82:6802/4051651615,v1:172.21.15.82:6803/4051651615]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-05-08T05:39:36.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:35 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T05:39:36.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:35 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:36.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:35 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:36.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:35 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:39:36.271 DEBUG:teuthology.orchestra.run.smithi082:osd.0> sudo journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@osd.0.service 2024-05-08T05:39:36.276 INFO:tasks.cephadm:Deploying osd.1 on smithi134 with /dev/vg_nvme/lv_4... 2024-05-08T05:39:36.276 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-08T05:39:36.526 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T05:39:36.821 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:36 smithi082 ceph-mon[30098]: from='osd.0 [v2:172.21.15.82:6802/4051651615,v1:172.21.15.82:6803/4051651615]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-05-08T05:39:36.821 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:36 smithi082 ceph-mon[30098]: osdmap e7: 1 total, 0 up, 1 in 2024-05-08T05:39:36.821 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:36 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T05:39:36.821 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:36 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T05:39:36.821 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:36 smithi082 ceph-mon[30098]: from='osd.0 [v2:172.21.15.82:6802/4051651615,v1:172.21.15.82:6803/4051651615]' entity='osd.0' 2024-05-08T05:39:36.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:36 smithi151 ceph-mon[34815]: from='osd.0 [v2:172.21.15.82:6802/4051651615,v1:172.21.15.82:6803/4051651615]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-05-08T05:39:36.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:36 smithi151 ceph-mon[34815]: osdmap e7: 1 total, 0 up, 1 in 2024-05-08T05:39:36.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:36 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T05:39:36.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:36 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T05:39:36.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:36 smithi151 ceph-mon[34815]: from='osd.0 [v2:172.21.15.82:6802/4051651615,v1:172.21.15.82:6803/4051651615]' entity='osd.0' 2024-05-08T05:39:36.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:36 smithi134 ceph-mon[34132]: from='osd.0 [v2:172.21.15.82:6802/4051651615,v1:172.21.15.82:6803/4051651615]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-05-08T05:39:36.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:36 smithi134 ceph-mon[34132]: osdmap e7: 1 total, 0 up, 1 in 2024-05-08T05:39:36.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:36 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T05:39:36.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:36 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T05:39:36.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:36 smithi134 ceph-mon[34132]: from='osd.0 [v2:172.21.15.82:6802/4051651615,v1:172.21.15.82:6803/4051651615]' entity='osd.0' 2024-05-08T05:39:37.737 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:37 smithi134 ceph-mon[34132]: purged_snaps scrub starts 2024-05-08T05:39:37.737 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:37 smithi134 ceph-mon[34132]: purged_snaps scrub ok 2024-05-08T05:39:37.737 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:37 smithi134 ceph-mon[34132]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:37.738 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:37 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T05:39:37.738 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:37 smithi134 ceph-mon[34132]: osd.0 [v2:172.21.15.82:6802/4051651615,v1:172.21.15.82:6803/4051651615] boot 2024-05-08T05:39:37.738 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:37 smithi134 ceph-mon[34132]: osdmap e8: 1 total, 1 up, 1 in 2024-05-08T05:39:37.738 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:37 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T05:39:37.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:37 smithi151 ceph-mon[34815]: purged_snaps scrub starts 2024-05-08T05:39:37.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:37 smithi151 ceph-mon[34815]: purged_snaps scrub ok 2024-05-08T05:39:37.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:37 smithi151 ceph-mon[34815]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:37.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:37 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T05:39:37.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:37 smithi151 ceph-mon[34815]: osd.0 [v2:172.21.15.82:6802/4051651615,v1:172.21.15.82:6803/4051651615] boot 2024-05-08T05:39:37.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:37 smithi151 ceph-mon[34815]: osdmap e8: 1 total, 1 up, 1 in 2024-05-08T05:39:37.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:37 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T05:39:37.939 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:37 smithi082 ceph-mon[30098]: purged_snaps scrub starts 2024-05-08T05:39:37.940 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:37 smithi082 ceph-mon[30098]: purged_snaps scrub ok 2024-05-08T05:39:37.940 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:37 smithi082 ceph-mon[30098]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-08T05:39:37.940 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:37 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T05:39:37.940 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:37 smithi082 ceph-mon[30098]: osd.0 [v2:172.21.15.82:6802/4051651615,v1:172.21.15.82:6803/4051651615] boot 2024-05-08T05:39:37.940 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:37 smithi082 ceph-mon[30098]: osdmap e8: 1 total, 1 up, 1 in 2024-05-08T05:39:37.940 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:37 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-08T05:39:38.287 INFO:teuthology.orchestra.run.smithi134.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-08T05:39:38.287 INFO:teuthology.orchestra.run.smithi134.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-08T05:39:38.287 INFO:teuthology.orchestra.run.smithi134.stderr: stderr: 10+0 records in 2024-05-08T05:39:38.287 INFO:teuthology.orchestra.run.smithi134.stderr:10+0 records out 2024-05-08T05:39:38.287 INFO:teuthology.orchestra.run.smithi134.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111753 s, 938 MB/s 2024-05-08T05:39:38.287 INFO:teuthology.orchestra.run.smithi134.stderr:--> Zapping successful for: 2024-05-08T05:39:38.908 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi134:vg_nvme/lv_4 2024-05-08T05:39:39.152 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T05:39:39.483 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:39 smithi134 ceph-mon[34132]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:39:39.483 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:39 smithi134 ceph-mon[34132]: osdmap e9: 1 total, 1 up, 1 in 2024-05-08T05:39:39.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:39 smithi151 ceph-mon[34815]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:39:39.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:39 smithi151 ceph-mon[34815]: osdmap e9: 1 total, 1 up, 1 in 2024-05-08T05:39:39.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:39 smithi082 ceph-mon[30098]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:39:39.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:39 smithi082 ceph-mon[30098]: osdmap e9: 1 total, 1 up, 1 in 2024-05-08T05:39:40.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:39:40.658+0000 7fe7019e6700 1 -- 172.21.15.134:0/139318890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6fc104030 msgr2=0x7fe6fc106420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:39:40.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:39:40.658+0000 7fe7019e6700 1 --2- 172.21.15.134:0/139318890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6fc104030 0x7fe6fc106420 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe6f0009990 tx=0x7fe6f0009ca0 comp rx=0 tx=0).stop 2024-05-08T05:39:40.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:39:40.658+0000 7fe7019e6700 1 -- 172.21.15.134:0/139318890 shutdown_connections 2024-05-08T05:39:40.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:39:40.658+0000 7fe7019e6700 1 --2- 172.21.15.134:0/139318890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6fc104030 0x7fe6fc106420 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:39:40.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:39:40.658+0000 7fe7019e6700 1 --2- 172.21.15.134:0/139318890 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6fc109290 0x7fe6fc10b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:39:40.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:39:40.658+0000 7fe7019e6700 1 --2- 172.21.15.134:0/139318890 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6fc106960 0x7fe6fc108d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:39:40.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:39:40.658+0000 7fe7019e6700 1 -- 172.21.15.134:0/139318890 >> 172.21.15.134:0/139318890 conn(0x7fe6fc0fd9a0 msgr2=0x7fe6fc0ffde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:39:40.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:39:40.658+0000 7fe7019e6700 1 -- 172.21.15.134:0/139318890 shutdown_connections 2024-05-08T05:39:40.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:39:40.658+0000 7fe7019e6700 1 -- 172.21.15.134:0/139318890 wait complete. 2024-05-08T05:39:40.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:39:40.658+0000 7fe7019e6700 1 Processor -- start 2024-05-08T05:39:40.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:39:40.658+0000 7fe7019e6700 1 -- start start 2024-05-08T05:39:40.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:39:40.659+0000 7fe7019e6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6fc104030 0x7fe6fc1996c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:39:40.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:39:40.659+0000 7fe7019e6700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6fc106960 0x7fe6fc199c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:39:40.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:39:40.659+0000 7fe7019e6700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6fc109290 0x7fe6fc1a0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:39:40.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:39:40.659+0000 7fe7019e6700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe6fc10f020 con 0x7fe6fc106960 2024-05-08T05:39:40.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:39:40.659+0000 7fe7019e6700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe6fc10eea0 con 0x7fe6fc104030 2024-05-08T05:39:40.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:39:40.659+0000 7fe7019e6700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe6fc10f1a0 con 0x7fe6fc109290 2024-05-08T05:39:40.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:39:40.659+0000 7fe6faffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6fc104030 0x7fe6fc1996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:39:40.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:39:40.659+0000 7fe6faffd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6fc104030 0x7fe6fc1996c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33432/0 (socket says 172.21.15.134:33432) 2024-05-08T05:39:40.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:39:40.659+0000 7fe6faffd700 1 -- 172.21.15.134:0/3461448691 learned_addr learned my addr 172.21.15.134:0/3461448691 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-05-08T05:39:40.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:39:40.659+0000 7fe6fb7fe700 1 --2- 172.21.15.134:0/3461448691 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6fc109290 0x7fe6fc1a0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:39:40.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:39:40.659+0000 7fe6faffd700 1 -- 172.21.15.134:0/3461448691 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6fc109290 msgr2=0x7fe6fc1a0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:39:40.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:39:40.659+0000 7fe6faffd700 1 --2- 172.21.15.134:0/3461448691 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6fc109290 0x7fe6fc1a0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:39:40.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:39:40.659+0000 7fe6faffd700 1 -- 172.21.15.134:0/3461448691 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6fc106960 msgr2=0x7fe6fc199c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:39:40.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:39:40.659+0000 7fe6faffd700 1 --2- 172.21.15.134:0/3461448691 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6fc106960 0x7fe6fc199c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:39:40.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:39:40.659+0000 7fe6faffd700 1 -- 172.21.15.134:0/3461448691 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6fc1a1320 con 0x7fe6fc104030 2024-05-08T05:39:40.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:39:40.659+0000 7fe6fb7fe700 1 --2- 172.21.15.134:0/3461448691 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6fc109290 0x7fe6fc1a0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:39:40.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:39:40.659+0000 7fe6faffd700 1 --2- 172.21.15.134:0/3461448691 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6fc104030 0x7fe6fc1996c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe6f0006010 tx=0x7fe6f00047b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:39:40.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:39:40.659+0000 7fe7009e4700 1 -- 172.21.15.134:0/3461448691 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f0027070 con 0x7fe6fc104030 2024-05-08T05:39:40.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:39:40.659+0000 7fe7009e4700 1 -- 172.21.15.134:0/3461448691 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe6f0004180 con 0x7fe6fc104030 2024-05-08T05:39:40.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:39:40.659+0000 7fe7019e6700 1 -- 172.21.15.134:0/3461448691 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6fc1a15b0 con 0x7fe6fc104030 2024-05-08T05:39:40.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:39:40.659+0000 7fe7009e4700 1 -- 172.21.15.134:0/3461448691 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f000f460 con 0x7fe6fc104030 2024-05-08T05:39:40.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:39:40.659+0000 7fe7019e6700 1 -- 172.21.15.134:0/3461448691 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6fc1a1a80 con 0x7fe6fc104030 2024-05-08T05:39:40.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:39:40.660+0000 7fe7019e6700 1 -- 172.21.15.134:0/3461448691 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6fc06a190 con 0x7fe6fc104030 2024-05-08T05:39:40.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:39:40.662+0000 7fe7009e4700 1 -- 172.21.15.134:0/3461448691 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7fe6f002a070 con 0x7fe6fc104030 2024-05-08T05:39:40.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:39:40.663+0000 7fe7009e4700 1 --2- 172.21.15.134:0/3461448691 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fe6e40b27f0 0x7fe6e40b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:39:40.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:39:40.663+0000 7fe7009e4700 1 -- 172.21.15.134:0/3461448691 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1767+0+0 (secure 0 0 0) 0x7fe6f00e2020 con 0x7fe6fc104030 2024-05-08T05:39:40.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:39:40.663+0000 7fe6fa7fc700 1 --2- 172.21.15.134:0/3461448691 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fe6e40b27f0 0x7fe6e40b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:39:40.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:39:40.664+0000 7fe6fa7fc700 1 --2- 172.21.15.134:0/3461448691 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fe6e40b27f0 0x7fe6e40b4cb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec005950 tx=0x7fe6ec0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:39:40.668 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:39:40.667+0000 7fe7009e4700 1 -- 172.21.15.134:0/3461448691 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe6f0031070 con 0x7fe6fc104030 2024-05-08T05:39:40.890 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:39:40.888+0000 7fe7019e6700 1 -- 172.21.15.134:0/3461448691 --> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fe6fc0638e0 con 0x7fe6e40b27f0 2024-05-08T05:39:42.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:41 smithi151 ceph-mon[34815]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:39:42.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:41 smithi151 ceph-mon[34815]: Detected new or changed devices on smithi082 2024-05-08T05:39:42.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:41 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:42.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:41 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:42.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:41 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:39:42.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:41 smithi151 ceph-mon[34815]: Adjusting osd_memory_target on smithi082 to 17089M 2024-05-08T05:39:42.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:41 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:42.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:41 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:39:42.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:41 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:39:42.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:41 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:42.131 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:41 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:39:42.131 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:41 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:39:42.131 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:41 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:39:42.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:41 smithi082 ceph-mon[30098]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:39:42.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:41 smithi082 ceph-mon[30098]: Detected new or changed devices on smithi082 2024-05-08T05:39:42.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:41 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:42.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:41 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:42.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:41 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:39:42.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:41 smithi082 ceph-mon[30098]: Adjusting osd_memory_target on smithi082 to 17089M 2024-05-08T05:39:42.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:41 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:42.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:41 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:39:42.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:41 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:39:42.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:41 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:42.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:41 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:39:42.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:41 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:39:42.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:41 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:39:42.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:41 smithi134 ceph-mon[34132]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:39:42.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:41 smithi134 ceph-mon[34132]: Detected new or changed devices on smithi082 2024-05-08T05:39:42.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:41 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:42.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:41 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:42.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:41 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:39:42.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:41 smithi134 ceph-mon[34132]: Adjusting osd_memory_target on smithi082 to 17089M 2024-05-08T05:39:42.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:41 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:42.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:41 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:39:42.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:41 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:39:42.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:41 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:42.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:41 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:39:42.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:41 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:39:42.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:41 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:39:43.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:42 smithi134 ceph-mon[34132]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:39:43.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:42 smithi151 ceph-mon[34815]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:39:43.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:42 smithi082 ceph-mon[30098]: from='client.24146 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:39:44.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:43 smithi151 ceph-mon[34815]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:39:44.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:43 smithi151 ceph-mon[34815]: from='client.? 172.21.15.134:0/3470994445' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ad2d3a6b-8bc5-4177-8757-07e8607ca240"}]: dispatch 2024-05-08T05:39:44.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:43 smithi151 ceph-mon[34815]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ad2d3a6b-8bc5-4177-8757-07e8607ca240"}]: dispatch 2024-05-08T05:39:44.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:43 smithi151 ceph-mon[34815]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ad2d3a6b-8bc5-4177-8757-07e8607ca240"}]': finished 2024-05-08T05:39:44.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:43 smithi151 ceph-mon[34815]: osdmap e10: 2 total, 1 up, 2 in 2024-05-08T05:39:44.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:43 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T05:39:44.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:43 smithi082 ceph-mon[30098]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:39:44.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:43 smithi082 ceph-mon[30098]: from='client.? 172.21.15.134:0/3470994445' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ad2d3a6b-8bc5-4177-8757-07e8607ca240"}]: dispatch 2024-05-08T05:39:44.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:43 smithi082 ceph-mon[30098]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ad2d3a6b-8bc5-4177-8757-07e8607ca240"}]: dispatch 2024-05-08T05:39:44.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:43 smithi082 ceph-mon[30098]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ad2d3a6b-8bc5-4177-8757-07e8607ca240"}]': finished 2024-05-08T05:39:44.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:43 smithi082 ceph-mon[30098]: osdmap e10: 2 total, 1 up, 2 in 2024-05-08T05:39:44.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:43 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T05:39:44.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:43 smithi134 ceph-mon[34132]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:39:44.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:43 smithi134 ceph-mon[34132]: from='client.? 172.21.15.134:0/3470994445' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ad2d3a6b-8bc5-4177-8757-07e8607ca240"}]: dispatch 2024-05-08T05:39:44.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:43 smithi134 ceph-mon[34132]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ad2d3a6b-8bc5-4177-8757-07e8607ca240"}]: dispatch 2024-05-08T05:39:44.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:43 smithi134 ceph-mon[34132]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ad2d3a6b-8bc5-4177-8757-07e8607ca240"}]': finished 2024-05-08T05:39:44.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:43 smithi134 ceph-mon[34132]: osdmap e10: 2 total, 1 up, 2 in 2024-05-08T05:39:44.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:43 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T05:39:45.122 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:44 smithi082 ceph-mon[30098]: from='client.? 172.21.15.134:0/1440020807' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:39:45.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:44 smithi151 ceph-mon[34815]: from='client.? 172.21.15.134:0/1440020807' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:39:45.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:44 smithi134 ceph-mon[34132]: from='client.? 172.21.15.134:0/1440020807' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:39:46.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:45 smithi151 ceph-mon[34815]: pgmap v60: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:39:46.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:45 smithi082 ceph-mon[30098]: pgmap v60: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:39:46.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:45 smithi134 ceph-mon[34132]: pgmap v60: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:39:48.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:47 smithi151 ceph-mon[34815]: pgmap v61: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:39:48.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:47 smithi082 ceph-mon[30098]: pgmap v61: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:39:48.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:47 smithi134 ceph-mon[34132]: pgmap v61: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:39:50.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:49 smithi151 ceph-mon[34815]: pgmap v62: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:39:50.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:49 smithi082 ceph-mon[30098]: pgmap v62: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:39:50.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:49 smithi134 ceph-mon[34132]: pgmap v62: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:39:51.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:50 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-08T05:39:51.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:50 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:39:51.141 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:50 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-08T05:39:51.141 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:50 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:39:51.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:50 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-08T05:39:51.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:50 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:39:52.060 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:51 smithi134 ceph-mon[34132]: pgmap v63: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:39:52.061 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:51 smithi134 ceph-mon[34132]: Deploying daemon osd.1 on smithi134 2024-05-08T05:39:52.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:51 smithi151 ceph-mon[34815]: pgmap v63: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:39:52.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:51 smithi151 ceph-mon[34815]: Deploying daemon osd.1 on smithi134 2024-05-08T05:39:52.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:51 smithi082 ceph-mon[30098]: pgmap v63: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:39:52.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:51 smithi082 ceph-mon[30098]: Deploying daemon osd.1 on smithi134 2024-05-08T05:39:54.117 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:53 smithi134 ceph-mon[34132]: pgmap v64: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:39:54.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:53 smithi151 ceph-mon[34815]: pgmap v64: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:39:54.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:53 smithi082 ceph-mon[30098]: pgmap v64: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:39:55.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:54 smithi134 ceph-mon[34132]: pgmap v65: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:39:55.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:54 smithi151 ceph-mon[34815]: pgmap v65: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:39:55.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:54 smithi082 ceph-mon[30098]: pgmap v65: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:39:57.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:56 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:57.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:56 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:57.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:56 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:39:57.140 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:56 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:57.140 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:56 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:57.140 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:56 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:39:57.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:56 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:57.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:56 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:57.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:56 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:39:58.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:57 smithi134 ceph-mon[34132]: pgmap v66: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:39:58.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:57 smithi151 ceph-mon[34815]: pgmap v66: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:39:58.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:57 smithi082 ceph-mon[30098]: pgmap v66: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:39:59.476 INFO:teuthology.orchestra.run.smithi134.stdout:Created osd(s) 1 on host 'smithi134' 2024-05-08T05:39:59.476 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:39:59.475+0000 7fe7009e4700 1 -- 172.21.15.134:0/3461448691 <== mgr.14152 v2:172.21.15.82:6800/4089180091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe6fc0638e0 con 0x7fe6e40b27f0 2024-05-08T05:39:59.478 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:39:59.478+0000 7fe7019e6700 1 -- 172.21.15.134:0/3461448691 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fe6e40b27f0 msgr2=0x7fe6e40b4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:39:59.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:39:59.478+0000 7fe7019e6700 1 --2- 172.21.15.134:0/3461448691 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fe6e40b27f0 0x7fe6e40b4cb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe6ec005950 tx=0x7fe6ec0058e0 comp rx=0 tx=0).stop 2024-05-08T05:39:59.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:39:59.478+0000 7fe7019e6700 1 -- 172.21.15.134:0/3461448691 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6fc104030 msgr2=0x7fe6fc1996c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:39:59.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:39:59.478+0000 7fe7019e6700 1 --2- 172.21.15.134:0/3461448691 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6fc104030 0x7fe6fc1996c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe6f0006010 tx=0x7fe6f00047b0 comp rx=0 tx=0).stop 2024-05-08T05:39:59.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:39:59.478+0000 7fe7019e6700 1 -- 172.21.15.134:0/3461448691 shutdown_connections 2024-05-08T05:39:59.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:39:59.478+0000 7fe7019e6700 1 --2- 172.21.15.134:0/3461448691 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6fc104030 0x7fe6fc1996c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:39:59.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:39:59.478+0000 7fe7019e6700 1 --2- 172.21.15.134:0/3461448691 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fe6e40b27f0 0x7fe6e40b4cb0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:39:59.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:39:59.478+0000 7fe7019e6700 1 --2- 172.21.15.134:0/3461448691 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6fc109290 0x7fe6fc1a0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:39:59.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:39:59.478+0000 7fe7019e6700 1 --2- 172.21.15.134:0/3461448691 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe6fc106960 0x7fe6fc199c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:39:59.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:39:59.478+0000 7fe7019e6700 1 -- 172.21.15.134:0/3461448691 >> 172.21.15.134:0/3461448691 conn(0x7fe6fc0fd9a0 msgr2=0x7fe6fc104ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:39:59.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:39:59.478+0000 7fe7019e6700 1 -- 172.21.15.134:0/3461448691 shutdown_connections 2024-05-08T05:39:59.479 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:39:59.478+0000 7fe7019e6700 1 -- 172.21.15.134:0/3461448691 wait complete. 2024-05-08T05:39:59.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:59 smithi134 ceph-mon[34132]: pgmap v67: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:39:59.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:59 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:59.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:59 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:59.751 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:59 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:39:59.751 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:59 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:39:59.751 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:59 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:59.751 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:59 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:59.751 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:59 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:59.751 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:39:59 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:39:59.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:59 smithi151 ceph-mon[34815]: pgmap v67: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:39:59.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:59 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:59.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:59 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:59.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:59 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:39:59.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:59 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:39:59.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:59 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:59.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:59 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:59.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:59 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:59.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:39:59 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:39:59.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:59 smithi082 ceph-mon[30098]: pgmap v67: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:39:59.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:59 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:59.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:59 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:59.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:59 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:39:59.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:59 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:39:59.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:59 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:59.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:59 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:59.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:59 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:39:59.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:39:59 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:40:00.126 DEBUG:teuthology.orchestra.run.smithi134:osd.1> sudo journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@osd.1.service 2024-05-08T05:40:00.129 INFO:tasks.cephadm:Deploying osd.2 on smithi151 with /dev/vg_nvme/lv_4... 2024-05-08T05:40:00.129 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-08T05:40:00.378 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T05:40:00.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:00 smithi134 ceph-mon[34132]: from='osd.1 [v2:172.21.15.134:6800/2763858634,v1:172.21.15.134:6801/2763858634]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-08T05:40:00.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:00 smithi134 ceph-mon[34132]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-08T05:40:00.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:00 smithi134 ceph-mon[34132]: overall HEALTH_OK 2024-05-08T05:40:00.763 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:00 smithi151 ceph-mon[34815]: from='osd.1 [v2:172.21.15.134:6800/2763858634,v1:172.21.15.134:6801/2763858634]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-08T05:40:00.764 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:00 smithi151 ceph-mon[34815]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-08T05:40:00.764 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:00 smithi151 ceph-mon[34815]: overall HEALTH_OK 2024-05-08T05:40:00.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:00 smithi082 ceph-mon[30098]: from='osd.1 [v2:172.21.15.134:6800/2763858634,v1:172.21.15.134:6801/2763858634]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-08T05:40:00.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:00 smithi082 ceph-mon[30098]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-08T05:40:00.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:00 smithi082 ceph-mon[30098]: overall HEALTH_OK 2024-05-08T05:40:01.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:01 smithi151 ceph-mon[34815]: pgmap v68: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:40:01.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:01 smithi151 ceph-mon[34815]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-08T05:40:01.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:01 smithi151 ceph-mon[34815]: from='osd.1 [v2:172.21.15.134:6800/2763858634,v1:172.21.15.134:6801/2763858634]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-05-08T05:40:01.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:01 smithi151 ceph-mon[34815]: osdmap e11: 2 total, 1 up, 2 in 2024-05-08T05:40:01.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:01 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T05:40:01.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:01 smithi151 ceph-mon[34815]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-05-08T05:40:01.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:01 smithi082 ceph-mon[30098]: pgmap v68: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:40:01.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:01 smithi082 ceph-mon[30098]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-08T05:40:01.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:01 smithi082 ceph-mon[30098]: from='osd.1 [v2:172.21.15.134:6800/2763858634,v1:172.21.15.134:6801/2763858634]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-05-08T05:40:01.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:01 smithi082 ceph-mon[30098]: osdmap e11: 2 total, 1 up, 2 in 2024-05-08T05:40:01.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:01 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T05:40:01.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:01 smithi082 ceph-mon[30098]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-05-08T05:40:02.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:01 smithi134 ceph-mon[34132]: pgmap v68: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:40:02.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:01 smithi134 ceph-mon[34132]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-08T05:40:02.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:01 smithi134 ceph-mon[34132]: from='osd.1 [v2:172.21.15.134:6800/2763858634,v1:172.21.15.134:6801/2763858634]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-05-08T05:40:02.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:01 smithi134 ceph-mon[34132]: osdmap e11: 2 total, 1 up, 2 in 2024-05-08T05:40:02.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:01 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T05:40:02.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:01 smithi134 ceph-mon[34132]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-05-08T05:40:02.001 INFO:journalctl@ceph.osd.1.smithi134.stdout:May 08 05:40:01 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-1[38728]: 2024-05-08T05:40:01.621+0000 7f301d573700 -1 osd.1 0 waiting for initial osdmap 2024-05-08T05:40:02.001 INFO:journalctl@ceph.osd.1.smithi134.stdout:May 08 05:40:01 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-1[38728]: 2024-05-08T05:40:01.627+0000 7f3019366700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T05:40:02.146 INFO:teuthology.orchestra.run.smithi151.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-08T05:40:02.146 INFO:teuthology.orchestra.run.smithi151.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-08T05:40:02.146 INFO:teuthology.orchestra.run.smithi151.stderr: stderr: 10+0 records in 2024-05-08T05:40:02.146 INFO:teuthology.orchestra.run.smithi151.stderr:10+0 records out 2024-05-08T05:40:02.146 INFO:teuthology.orchestra.run.smithi151.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0112278 s, 934 MB/s 2024-05-08T05:40:02.146 INFO:teuthology.orchestra.run.smithi151.stderr: stderr: 2024-05-08T05:40:02.146 INFO:teuthology.orchestra.run.smithi151.stderr:--> Zapping successful for: 2024-05-08T05:40:02.684 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi151:vg_nvme/lv_4 2024-05-08T05:40:02.706 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:02 smithi151 ceph-mon[34815]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-05-08T05:40:02.706 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:02 smithi151 ceph-mon[34815]: osdmap e12: 2 total, 1 up, 2 in 2024-05-08T05:40:02.706 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:02 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T05:40:02.706 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:02 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T05:40:02.928 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T05:40:02.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:02 smithi082 ceph-mon[30098]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-05-08T05:40:02.974 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:02 smithi082 ceph-mon[30098]: osdmap e12: 2 total, 1 up, 2 in 2024-05-08T05:40:02.974 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:02 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T05:40:02.974 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:02 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T05:40:02.996 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:02 smithi134 ceph-mon[34132]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-05-08T05:40:02.996 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:02 smithi134 ceph-mon[34132]: osdmap e12: 2 total, 1 up, 2 in 2024-05-08T05:40:02.996 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:02 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T05:40:02.996 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:02 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T05:40:03.937 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:03 smithi151 ceph-mon[34815]: purged_snaps scrub starts 2024-05-08T05:40:03.937 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:03 smithi151 ceph-mon[34815]: purged_snaps scrub ok 2024-05-08T05:40:03.937 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:03 smithi151 ceph-mon[34815]: pgmap v71: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:40:03.937 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:03 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T05:40:03.937 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:03 smithi151 ceph-mon[34815]: osd.1 [v2:172.21.15.134:6800/2763858634,v1:172.21.15.134:6801/2763858634] boot 2024-05-08T05:40:03.938 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:03 smithi151 ceph-mon[34815]: osdmap e13: 2 total, 2 up, 2 in 2024-05-08T05:40:03.938 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:03 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T05:40:03.938 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:03 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:03.938 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:03 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:03.938 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:03 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:40:03.938 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:03 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:03.938 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:03 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:40:03.938 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:03 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:40:03.938 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:03 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:03.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:03 smithi082 ceph-mon[30098]: purged_snaps scrub starts 2024-05-08T05:40:03.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:03 smithi082 ceph-mon[30098]: purged_snaps scrub ok 2024-05-08T05:40:03.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:03 smithi082 ceph-mon[30098]: pgmap v71: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:40:03.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:03 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T05:40:03.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:03 smithi082 ceph-mon[30098]: osd.1 [v2:172.21.15.134:6800/2763858634,v1:172.21.15.134:6801/2763858634] boot 2024-05-08T05:40:03.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:03 smithi082 ceph-mon[30098]: osdmap e13: 2 total, 2 up, 2 in 2024-05-08T05:40:03.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:03 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T05:40:03.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:03 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:03.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:03 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:03.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:03 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:40:03.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:03 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:03.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:03 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:40:03.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:03 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:40:03.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:03 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:04.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:03 smithi134 ceph-mon[34132]: purged_snaps scrub starts 2024-05-08T05:40:04.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:03 smithi134 ceph-mon[34132]: purged_snaps scrub ok 2024-05-08T05:40:04.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:03 smithi134 ceph-mon[34132]: pgmap v71: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-08T05:40:04.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:03 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T05:40:04.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:03 smithi134 ceph-mon[34132]: osd.1 [v2:172.21.15.134:6800/2763858634,v1:172.21.15.134:6801/2763858634] boot 2024-05-08T05:40:04.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:03 smithi134 ceph-mon[34132]: osdmap e13: 2 total, 2 up, 2 in 2024-05-08T05:40:04.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:03 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-08T05:40:04.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:03 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:04.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:03 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:04.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:03 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:40:04.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:03 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:04.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:03 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:40:04.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:03 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:40:04.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:03 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:04.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:40:04.368+0000 7fc23536f700 1 -- 172.21.15.151:0/1755173848 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2301091f0 msgr2=0x7fc23010b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:40:04.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:40:04.368+0000 7fc23536f700 1 --2- 172.21.15.151:0/1755173848 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2301091f0 0x7fc23010b660 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc22800b0a0 tx=0x7fc22800b3b0 comp rx=0 tx=0).stop 2024-05-08T05:40:04.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:40:04.368+0000 7fc23536f700 1 -- 172.21.15.151:0/1755173848 shutdown_connections 2024-05-08T05:40:04.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:40:04.368+0000 7fc23536f700 1 --2- 172.21.15.151:0/1755173848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc230103f90 0x7fc230106380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:40:04.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:40:04.368+0000 7fc23536f700 1 --2- 172.21.15.151:0/1755173848 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2301091f0 0x7fc23010b660 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:40:04.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:40:04.368+0000 7fc23536f700 1 --2- 172.21.15.151:0/1755173848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2301068c0 0x7fc230108cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:40:04.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:40:04.368+0000 7fc23536f700 1 -- 172.21.15.151:0/1755173848 >> 172.21.15.151:0/1755173848 conn(0x7fc2300fd9a0 msgr2=0x7fc2300ffde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:40:04.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:40:04.368+0000 7fc23536f700 1 -- 172.21.15.151:0/1755173848 shutdown_connections 2024-05-08T05:40:04.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:40:04.368+0000 7fc23536f700 1 -- 172.21.15.151:0/1755173848 wait complete. 2024-05-08T05:40:04.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:40:04.369+0000 7fc23536f700 1 Processor -- start 2024-05-08T05:40:04.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:40:04.369+0000 7fc23536f700 1 -- start start 2024-05-08T05:40:04.372 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:40:04.369+0000 7fc23536f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc230103f90 0x7fc2301038f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:40:04.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:40:04.369+0000 7fc23536f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2301068c0 0x7fc230101f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:40:04.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:40:04.369+0000 7fc23536f700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2301091f0 0x7fc230102480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:40:04.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:40:04.369+0000 7fc23536f700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc23010f060 con 0x7fc2301091f0 2024-05-08T05:40:04.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:40:04.369+0000 7fc23536f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc23010eee0 con 0x7fc230103f90 2024-05-08T05:40:04.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:40:04.369+0000 7fc23536f700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc23010f1e0 con 0x7fc2301068c0 2024-05-08T05:40:04.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:40:04.369+0000 7fc2267fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2301068c0 0x7fc230101f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:40:04.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:40:04.369+0000 7fc2267fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2301068c0 0x7fc230101f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:57424/0 (socket says 172.21.15.151:57424) 2024-05-08T05:40:04.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:40:04.369+0000 7fc2267fc700 1 -- 172.21.15.151:0/1271861027 learned_addr learned my addr 172.21.15.151:0/1271861027 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-05-08T05:40:04.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:40:04.369+0000 7fc22effd700 1 --2- 172.21.15.151:0/1271861027 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc230103f90 0x7fc2301038f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:40:04.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:40:04.370+0000 7fc2267fc700 1 -- 172.21.15.151:0/1271861027 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc230103f90 msgr2=0x7fc2301038f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:40:04.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:40:04.370+0000 7fc2267fc700 1 --2- 172.21.15.151:0/1271861027 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc230103f90 0x7fc2301038f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:40:04.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:40:04.370+0000 7fc2267fc700 1 -- 172.21.15.151:0/1271861027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2301091f0 msgr2=0x7fc230102480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:40:04.373 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:40:04.370+0000 7fc2267fc700 1 --2- 172.21.15.151:0/1271861027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2301091f0 0x7fc230102480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:40:04.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:40:04.370+0000 7fc2267fc700 1 -- 172.21.15.151:0/1271861027 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc230102d30 con 0x7fc2301068c0 2024-05-08T05:40:04.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:40:04.370+0000 7fc2267fc700 1 --2- 172.21.15.151:0/1271861027 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2301068c0 0x7fc230101f40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc21800b530 tx=0x7fc21800b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:40:04.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:40:04.370+0000 7fc22cff9700 1 -- 172.21.15.151:0/1271861027 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc218015020 con 0x7fc2301068c0 2024-05-08T05:40:04.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:40:04.370+0000 7fc22cff9700 1 -- 172.21.15.151:0/1271861027 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc218011ce0 con 0x7fc2301068c0 2024-05-08T05:40:04.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:40:04.370+0000 7fc22cff9700 1 -- 172.21.15.151:0/1271861027 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc218010e40 con 0x7fc2301068c0 2024-05-08T05:40:04.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:40:04.370+0000 7fc23536f700 1 -- 172.21.15.151:0/1271861027 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2301a3950 con 0x7fc2301068c0 2024-05-08T05:40:04.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:40:04.370+0000 7fc23536f700 1 -- 172.21.15.151:0/1271861027 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2301a3f10 con 0x7fc2301068c0 2024-05-08T05:40:04.374 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:40:04.371+0000 7fc23536f700 1 -- 172.21.15.151:0/1271861027 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc23006a190 con 0x7fc2301068c0 2024-05-08T05:40:04.375 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:40:04.372+0000 7fc22cff9700 1 -- 172.21.15.151:0/1271861027 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7fc218018020 con 0x7fc2301068c0 2024-05-08T05:40:04.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:40:04.373+0000 7fc22cff9700 1 --2- 172.21.15.151:0/1271861027 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc21c0b2870 0x7fc21c0b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:40:04.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:40:04.373+0000 7fc22cff9700 1 -- 172.21.15.151:0/1271861027 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2309+0+0 (secure 0 0 0) 0x7fc2180e06b0 con 0x7fc2301068c0 2024-05-08T05:40:04.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:40:04.373+0000 7fc22effd700 1 --2- 172.21.15.151:0/1271861027 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc21c0b2870 0x7fc21c0b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:40:04.376 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:40:04.374+0000 7fc22effd700 1 --2- 172.21.15.151:0/1271861027 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc21c0b2870 0x7fc21c0b4d30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc220009a10 tx=0x7fc220009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:40:04.377 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:40:04.377+0000 7fc22cff9700 1 -- 172.21.15.151:0/1271861027 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc21801f020 con 0x7fc2301068c0 2024-05-08T05:40:04.592 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:40:04.592+0000 7fc23536f700 1 -- 172.21.15.151:0/1271861027 --> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fc2300638e0 con 0x7fc21c0b2870 2024-05-08T05:40:04.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:04 smithi151 ceph-mon[34815]: Detected new or changed devices on smithi134 2024-05-08T05:40:04.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:04 smithi151 ceph-mon[34815]: Adjusting osd_memory_target on smithi134 to 17088M 2024-05-08T05:40:04.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:04 smithi151 ceph-mon[34815]: osdmap e14: 2 total, 2 up, 2 in 2024-05-08T05:40:04.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:04 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:40:04.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:04 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:40:04.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:04 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:40:04.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:04 smithi082 ceph-mon[30098]: Detected new or changed devices on smithi134 2024-05-08T05:40:04.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:04 smithi082 ceph-mon[30098]: Adjusting osd_memory_target on smithi134 to 17088M 2024-05-08T05:40:04.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:04 smithi082 ceph-mon[30098]: osdmap e14: 2 total, 2 up, 2 in 2024-05-08T05:40:04.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:04 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:40:04.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:04 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:40:04.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:04 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:40:05.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:04 smithi134 ceph-mon[34132]: Detected new or changed devices on smithi134 2024-05-08T05:40:05.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:04 smithi134 ceph-mon[34132]: Adjusting osd_memory_target on smithi134 to 17088M 2024-05-08T05:40:05.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:04 smithi134 ceph-mon[34132]: osdmap e14: 2 total, 2 up, 2 in 2024-05-08T05:40:05.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:04 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:40:05.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:04 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:40:05.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:04 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:40:05.853 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:05 smithi151 ceph-mon[34815]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:40:05.854 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:05 smithi151 ceph-mon[34815]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:40:05.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:05 smithi082 ceph-mon[30098]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:40:05.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:05 smithi082 ceph-mon[30098]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:40:06.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:05 smithi134 ceph-mon[34132]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:40:06.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:05 smithi134 ceph-mon[34132]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:40:07.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:07 smithi151 ceph-mon[34815]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:40:07.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:07 smithi151 ceph-mon[34815]: from='client.? 172.21.15.151:0/2781376657' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a06dc8fc-7324-4e42-9487-8cfe372401b6"}]: dispatch 2024-05-08T05:40:07.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:07 smithi151 ceph-mon[34815]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a06dc8fc-7324-4e42-9487-8cfe372401b6"}]: dispatch 2024-05-08T05:40:07.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:07 smithi151 ceph-mon[34815]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a06dc8fc-7324-4e42-9487-8cfe372401b6"}]': finished 2024-05-08T05:40:07.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:07 smithi151 ceph-mon[34815]: osdmap e15: 3 total, 2 up, 3 in 2024-05-08T05:40:07.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:07 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T05:40:07.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:07 smithi082 ceph-mon[30098]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:40:07.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:07 smithi082 ceph-mon[30098]: from='client.? 172.21.15.151:0/2781376657' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a06dc8fc-7324-4e42-9487-8cfe372401b6"}]: dispatch 2024-05-08T05:40:07.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:07 smithi082 ceph-mon[30098]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a06dc8fc-7324-4e42-9487-8cfe372401b6"}]: dispatch 2024-05-08T05:40:07.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:07 smithi082 ceph-mon[30098]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a06dc8fc-7324-4e42-9487-8cfe372401b6"}]': finished 2024-05-08T05:40:07.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:07 smithi082 ceph-mon[30098]: osdmap e15: 3 total, 2 up, 3 in 2024-05-08T05:40:07.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:07 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T05:40:08.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:07 smithi134 ceph-mon[34132]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:40:08.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:07 smithi134 ceph-mon[34132]: from='client.? 172.21.15.151:0/2781376657' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a06dc8fc-7324-4e42-9487-8cfe372401b6"}]: dispatch 2024-05-08T05:40:08.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:07 smithi134 ceph-mon[34132]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a06dc8fc-7324-4e42-9487-8cfe372401b6"}]: dispatch 2024-05-08T05:40:08.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:07 smithi134 ceph-mon[34132]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a06dc8fc-7324-4e42-9487-8cfe372401b6"}]': finished 2024-05-08T05:40:08.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:07 smithi134 ceph-mon[34132]: osdmap e15: 3 total, 2 up, 3 in 2024-05-08T05:40:08.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:07 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T05:40:08.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:08 smithi082 ceph-mon[30098]: from='client.? 172.21.15.151:0/4222569663' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:40:09.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:08 smithi134 ceph-mon[34132]: from='client.? 172.21.15.151:0/4222569663' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:40:09.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:08 smithi151 ceph-mon[34815]: from='client.? 172.21.15.151:0/4222569663' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:40:09.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:09 smithi082 ceph-mon[30098]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:40:10.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:09 smithi134 ceph-mon[34132]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:40:10.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:09 smithi151 ceph-mon[34815]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:40:11.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:11 smithi151 ceph-mon[34815]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:40:11.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:11 smithi082 ceph-mon[30098]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:40:12.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:11 smithi134 ceph-mon[34132]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:40:13.748 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:13 smithi151 ceph-mon[34815]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:40:13.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:13 smithi082 ceph-mon[30098]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:40:14.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:13 smithi134 ceph-mon[34132]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:40:14.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:14 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-08T05:40:14.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:14 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:40:14.976 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:14 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-08T05:40:14.977 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:14 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:40:14.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:14 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-08T05:40:14.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:14 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:40:15.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:15 smithi151 ceph-mon[34815]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:40:15.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:15 smithi151 ceph-mon[34815]: Deploying daemon osd.2 on smithi151 2024-05-08T05:40:15.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:15 smithi082 ceph-mon[30098]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:40:15.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:15 smithi082 ceph-mon[30098]: Deploying daemon osd.2 on smithi151 2024-05-08T05:40:16.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:15 smithi134 ceph-mon[34132]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:40:16.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:15 smithi134 ceph-mon[34132]: Deploying daemon osd.2 on smithi151 2024-05-08T05:40:17.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:17 smithi082 ceph-mon[30098]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:40:18.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:17 smithi134 ceph-mon[34132]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:40:18.047 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:17 smithi151 ceph-mon[34815]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:40:19.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:19 smithi082 ceph-mon[30098]: pgmap v82: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:40:19.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:19 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:19.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:19 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:40:19.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:19 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:20.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:19 smithi134 ceph-mon[34132]: pgmap v82: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:40:20.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:19 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:20.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:19 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:40:20.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:19 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:20.066 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:19 smithi151 ceph-mon[34815]: pgmap v82: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:40:20.066 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:19 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:20.066 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:19 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:40:20.066 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:19 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:21.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:21 smithi151 ceph-mon[34815]: pgmap v83: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:40:21.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:21 smithi082 ceph-mon[30098]: pgmap v83: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:40:22.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:21 smithi134 ceph-mon[34132]: pgmap v83: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:40:23.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:40:23.028+0000 7fc22cff9700 1 -- 172.21.15.151:0/1271861027 <== mgr.14152 v2:172.21.15.82:6800/4089180091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc2300638e0 con 0x7fc21c0b2870 2024-05-08T05:40:23.029 INFO:teuthology.orchestra.run.smithi151.stdout:Created osd(s) 2 on host 'smithi151' 2024-05-08T05:40:23.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:40:23.031+0000 7fc23536f700 1 -- 172.21.15.151:0/1271861027 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc21c0b2870 msgr2=0x7fc21c0b4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:40:23.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:40:23.031+0000 7fc23536f700 1 --2- 172.21.15.151:0/1271861027 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc21c0b2870 0x7fc21c0b4d30 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc220009a10 tx=0x7fc220009190 comp rx=0 tx=0).stop 2024-05-08T05:40:23.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:40:23.031+0000 7fc23536f700 1 -- 172.21.15.151:0/1271861027 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2301068c0 msgr2=0x7fc230101f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:40:23.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:40:23.031+0000 7fc23536f700 1 --2- 172.21.15.151:0/1271861027 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2301068c0 0x7fc230101f40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc21800b530 tx=0x7fc21800b840 comp rx=0 tx=0).stop 2024-05-08T05:40:23.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:40:23.031+0000 7fc23536f700 1 -- 172.21.15.151:0/1271861027 shutdown_connections 2024-05-08T05:40:23.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:40:23.031+0000 7fc23536f700 1 --2- 172.21.15.151:0/1271861027 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc230103f90 0x7fc2301038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:40:23.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:40:23.031+0000 7fc23536f700 1 --2- 172.21.15.151:0/1271861027 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc21c0b2870 0x7fc21c0b4d30 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:40:23.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:40:23.031+0000 7fc23536f700 1 --2- 172.21.15.151:0/1271861027 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2301091f0 0x7fc230102480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:40:23.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:40:23.031+0000 7fc23536f700 1 --2- 172.21.15.151:0/1271861027 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2301068c0 0x7fc230101f40 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:40:23.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:40:23.031+0000 7fc23536f700 1 -- 172.21.15.151:0/1271861027 >> 172.21.15.151:0/1271861027 conn(0x7fc2300fd9a0 msgr2=0x7fc230104a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:40:23.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:40:23.031+0000 7fc23536f700 1 -- 172.21.15.151:0/1271861027 shutdown_connections 2024-05-08T05:40:23.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:40:23.031+0000 7fc23536f700 1 -- 172.21.15.151:0/1271861027 wait complete. 2024-05-08T05:40:23.670 DEBUG:teuthology.orchestra.run.smithi151:osd.2> sudo journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@osd.2.service 2024-05-08T05:40:23.713 INFO:tasks.cephadm:Deploying osd.3 on smithi082 with /dev/vg_nvme/lv_3... 2024-05-08T05:40:23.713 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-08T05:40:23.964 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:23 smithi151 ceph-mon[34815]: pgmap v84: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:40:23.965 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:23 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:23.965 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:23 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:23.965 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:23 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:23.965 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:23 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:23.965 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:23 smithi151 ceph-mon[34815]: from='osd.2 [v2:172.21.15.151:6800/4193933269,v1:172.21.15.151:6801/4193933269]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-08T05:40:23.965 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:23 smithi151 ceph-mon[34815]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-08T05:40:24.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:23 smithi134 ceph-mon[34132]: pgmap v84: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:40:24.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:23 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:24.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:23 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:24.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:23 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:24.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:23 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:24.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:23 smithi134 ceph-mon[34132]: from='osd.2 [v2:172.21.15.151:6800/4193933269,v1:172.21.15.151:6801/4193933269]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-08T05:40:24.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:23 smithi134 ceph-mon[34132]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-08T05:40:24.146 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:40:24.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:23 smithi082 ceph-mon[30098]: pgmap v84: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:40:24.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:23 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:24.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:23 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:24.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:23 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:24.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:23 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:24.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:23 smithi082 ceph-mon[30098]: from='osd.2 [v2:172.21.15.151:6800/4193933269,v1:172.21.15.151:6801/4193933269]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-08T05:40:24.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:23 smithi082 ceph-mon[30098]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-08T05:40:25.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:25 smithi151 ceph-mon[34815]: pgmap v85: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:40:25.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:25 smithi151 ceph-mon[34815]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-08T05:40:25.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:25 smithi151 ceph-mon[34815]: from='osd.2 [v2:172.21.15.151:6800/4193933269,v1:172.21.15.151:6801/4193933269]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-05-08T05:40:25.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:25 smithi151 ceph-mon[34815]: osdmap e16: 3 total, 2 up, 3 in 2024-05-08T05:40:25.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:25 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T05:40:25.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:25 smithi151 ceph-mon[34815]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-05-08T05:40:25.130 INFO:journalctl@ceph.osd.2.smithi151.stdout:May 08 05:40:25 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-2[40174]: 2024-05-08T05:40:25.095+0000 7fdcbe41b700 -1 osd.2 0 waiting for initial osdmap 2024-05-08T05:40:25.131 INFO:journalctl@ceph.osd.2.smithi151.stdout:May 08 05:40:25 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-2[40174]: 2024-05-08T05:40:25.101+0000 7fdcba20e700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T05:40:25.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:25 smithi082 ceph-mon[30098]: pgmap v85: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:40:25.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:25 smithi082 ceph-mon[30098]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-08T05:40:25.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:25 smithi082 ceph-mon[30098]: from='osd.2 [v2:172.21.15.151:6800/4193933269,v1:172.21.15.151:6801/4193933269]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-05-08T05:40:25.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:25 smithi082 ceph-mon[30098]: osdmap e16: 3 total, 2 up, 3 in 2024-05-08T05:40:25.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:25 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T05:40:25.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:25 smithi082 ceph-mon[30098]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-05-08T05:40:25.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:25 smithi134 ceph-mon[34132]: pgmap v85: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:40:25.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:25 smithi134 ceph-mon[34132]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-08T05:40:25.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:25 smithi134 ceph-mon[34132]: from='osd.2 [v2:172.21.15.151:6800/4193933269,v1:172.21.15.151:6801/4193933269]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-05-08T05:40:25.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:25 smithi134 ceph-mon[34132]: osdmap e16: 3 total, 2 up, 3 in 2024-05-08T05:40:25.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:25 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T05:40:25.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:25 smithi134 ceph-mon[34132]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-05-08T05:40:26.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:26 smithi151 ceph-mon[34815]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2024-05-08T05:40:26.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:26 smithi151 ceph-mon[34815]: osdmap e17: 3 total, 2 up, 3 in 2024-05-08T05:40:26.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:26 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T05:40:26.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:26 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T05:40:26.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:26 smithi082 ceph-mon[30098]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2024-05-08T05:40:26.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:26 smithi082 ceph-mon[30098]: osdmap e17: 3 total, 2 up, 3 in 2024-05-08T05:40:26.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:26 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T05:40:26.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:26 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T05:40:26.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:26 smithi134 ceph-mon[34132]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2024-05-08T05:40:26.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:26 smithi134 ceph-mon[34132]: osdmap e17: 3 total, 2 up, 3 in 2024-05-08T05:40:26.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:26 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T05:40:26.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:26 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T05:40:26.927 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-08T05:40:26.927 INFO:teuthology.orchestra.run.smithi082.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-08T05:40:26.927 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10+0 records in 2024-05-08T05:40:26.927 INFO:teuthology.orchestra.run.smithi082.stderr:10+0 records out 2024-05-08T05:40:26.927 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0351894 s, 298 MB/s 2024-05-08T05:40:26.927 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping successful for: 2024-05-08T05:40:27.197 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:27 smithi082 ceph-mon[30098]: purged_snaps scrub starts 2024-05-08T05:40:27.197 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:27 smithi082 ceph-mon[30098]: purged_snaps scrub ok 2024-05-08T05:40:27.198 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:27 smithi082 ceph-mon[30098]: pgmap v88: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:40:27.198 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:27 smithi082 ceph-mon[30098]: osd.2 [v2:172.21.15.151:6800/4193933269,v1:172.21.15.151:6801/4193933269] boot 2024-05-08T05:40:27.198 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:27 smithi082 ceph-mon[30098]: osdmap e18: 3 total, 3 up, 3 in 2024-05-08T05:40:27.198 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:27 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T05:40:27.198 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:27 smithi082 ceph-mon[30098]: Detected new or changed devices on smithi151 2024-05-08T05:40:27.198 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:27 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:27.198 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:27 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:27.198 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:27 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:40:27.198 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:27 smithi082 ceph-mon[30098]: Adjusting osd_memory_target on smithi151 to 17088M 2024-05-08T05:40:27.199 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:27 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:27.199 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:27 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:40:27.199 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:27 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:40:27.199 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:27 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:27.199 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:27 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:40:27.199 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:27 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:40:27.199 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:27 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:40:27.199 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:27 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:27.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:27 smithi151 ceph-mon[34815]: purged_snaps scrub starts 2024-05-08T05:40:27.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:27 smithi151 ceph-mon[34815]: purged_snaps scrub ok 2024-05-08T05:40:27.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:27 smithi151 ceph-mon[34815]: pgmap v88: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:40:27.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:27 smithi151 ceph-mon[34815]: osd.2 [v2:172.21.15.151:6800/4193933269,v1:172.21.15.151:6801/4193933269] boot 2024-05-08T05:40:27.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:27 smithi151 ceph-mon[34815]: osdmap e18: 3 total, 3 up, 3 in 2024-05-08T05:40:27.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:27 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T05:40:27.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:27 smithi151 ceph-mon[34815]: Detected new or changed devices on smithi151 2024-05-08T05:40:27.381 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:27 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:27.381 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:27 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:27.381 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:27 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:40:27.381 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:27 smithi151 ceph-mon[34815]: Adjusting osd_memory_target on smithi151 to 17088M 2024-05-08T05:40:27.381 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:27 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:27.381 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:27 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:40:27.381 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:27 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:40:27.381 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:27 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:27.381 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:27 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:40:27.381 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:27 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:40:27.381 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:27 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:40:27.381 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:27 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:27.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:27 smithi134 ceph-mon[34132]: purged_snaps scrub starts 2024-05-08T05:40:27.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:27 smithi134 ceph-mon[34132]: purged_snaps scrub ok 2024-05-08T05:40:27.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:27 smithi134 ceph-mon[34132]: pgmap v88: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-05-08T05:40:27.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:27 smithi134 ceph-mon[34132]: osd.2 [v2:172.21.15.151:6800/4193933269,v1:172.21.15.151:6801/4193933269] boot 2024-05-08T05:40:27.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:27 smithi134 ceph-mon[34132]: osdmap e18: 3 total, 3 up, 3 in 2024-05-08T05:40:27.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:27 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-08T05:40:27.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:27 smithi134 ceph-mon[34132]: Detected new or changed devices on smithi151 2024-05-08T05:40:27.501 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:27 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:27.501 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:27 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:27.501 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:27 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:40:27.501 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:27 smithi134 ceph-mon[34132]: Adjusting osd_memory_target on smithi151 to 17088M 2024-05-08T05:40:27.501 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:27 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:27.501 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:27 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:40:27.501 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:27 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:40:27.501 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:27 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:27.501 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:27 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:40:27.501 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:27 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:40:27.501 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:27 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:40:27.501 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:27 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:27.747 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi082:vg_nvme/lv_3 2024-05-08T05:40:28.184 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:40:28.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:28 smithi151 ceph-mon[34815]: osdmap e19: 3 total, 3 up, 3 in 2024-05-08T05:40:28.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:28 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-08T05:40:28.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:28 smithi082 ceph-mon[30098]: osdmap e19: 3 total, 3 up, 3 in 2024-05-08T05:40:28.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:28 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-08T05:40:29.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:28 smithi134 ceph-mon[34132]: osdmap e19: 3 total, 3 up, 3 in 2024-05-08T05:40:29.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:28 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-08T05:40:29.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:29 smithi151 ceph-mon[34815]: pgmap v91: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:40:29.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:29 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-08T05:40:29.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:29 smithi151 ceph-mon[34815]: osdmap e20: 3 total, 3 up, 3 in 2024-05-08T05:40:29.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:29 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-08T05:40:29.777 INFO:journalctl@ceph.osd.1.smithi134.stdout:May 08 05:40:29 smithi134 sudo[42716]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-08T05:40:29.777 INFO:journalctl@ceph.osd.1.smithi134.stdout:May 08 05:40:29 smithi134 sudo[42716]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T05:40:29.777 INFO:journalctl@ceph.osd.1.smithi134.stdout:May 08 05:40:29 smithi134 sudo[42716]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T05:40:29.777 INFO:journalctl@ceph.osd.1.smithi134.stdout:May 08 05:40:29 smithi134 sudo[42716]: pam_unix(sudo:session): session closed for user root 2024-05-08T05:40:29.777 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:29 smithi134 ceph-mon[34132]: pgmap v91: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:40:29.777 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:29 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-08T05:40:29.777 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:29 smithi134 ceph-mon[34132]: osdmap e20: 3 total, 3 up, 3 in 2024-05-08T05:40:29.777 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:29 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-08T05:40:29.815 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:29 smithi082 ceph-mon[30098]: pgmap v91: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:40:29.815 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:29 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-08T05:40:29.815 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:29 smithi082 ceph-mon[30098]: osdmap e20: 3 total, 3 up, 3 in 2024-05-08T05:40:29.815 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:29 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-08T05:40:29.816 INFO:journalctl@ceph.osd.0.smithi082.stdout:May 08 05:40:29 smithi082 sudo[46415]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-08T05:40:29.816 INFO:journalctl@ceph.osd.0.smithi082.stdout:May 08 05:40:29 smithi082 sudo[46415]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T05:40:29.816 INFO:journalctl@ceph.osd.0.smithi082.stdout:May 08 05:40:29 smithi082 sudo[46415]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T05:40:29.816 INFO:journalctl@ceph.osd.0.smithi082.stdout:May 08 05:40:29 smithi082 sudo[46415]: pam_unix(sudo:session): session closed for user root 2024-05-08T05:40:29.816 INFO:journalctl@ceph.osd.0.smithi082.stdout:May 08 05:40:29 smithi082 sudo[46424]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-08T05:40:29.816 INFO:journalctl@ceph.osd.0.smithi082.stdout:May 08 05:40:29 smithi082 sudo[46424]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T05:40:29.816 INFO:journalctl@ceph.osd.0.smithi082.stdout:May 08 05:40:29 smithi082 sudo[46424]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T05:40:29.816 INFO:journalctl@ceph.osd.0.smithi082.stdout:May 08 05:40:29 smithi082 sudo[46424]: pam_unix(sudo:session): session closed for user root 2024-05-08T05:40:30.065 INFO:journalctl@ceph.osd.1.smithi134.stdout:May 08 05:40:29 smithi134 sudo[42719]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-08T05:40:30.065 INFO:journalctl@ceph.osd.1.smithi134.stdout:May 08 05:40:29 smithi134 sudo[42719]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T05:40:30.065 INFO:journalctl@ceph.osd.1.smithi134.stdout:May 08 05:40:29 smithi134 sudo[42719]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T05:40:30.065 INFO:journalctl@ceph.osd.1.smithi134.stdout:May 08 05:40:29 smithi134 sudo[42719]: pam_unix(sudo:session): session closed for user root 2024-05-08T05:40:30.117 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:29 smithi082 sudo[46439]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-08T05:40:30.117 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:29 smithi082 sudo[46439]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T05:40:30.117 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:29 smithi082 sudo[46439]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T05:40:30.117 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:29 smithi082 sudo[46439]: pam_unix(sudo:session): session closed for user root 2024-05-08T05:40:30.117 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:29 smithi082 sudo[46445]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-08T05:40:30.118 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:30 smithi082 sudo[46445]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T05:40:30.118 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:30 smithi082 sudo[46445]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T05:40:30.118 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:30 smithi082 sudo[46445]: pam_unix(sudo:session): session closed for user root 2024-05-08T05:40:30.129 INFO:journalctl@ceph.osd.2.smithi151.stdout:May 08 05:40:29 smithi151 sudo[44093]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-08T05:40:30.129 INFO:journalctl@ceph.osd.2.smithi151.stdout:May 08 05:40:29 smithi151 sudo[44093]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T05:40:30.130 INFO:journalctl@ceph.osd.2.smithi151.stdout:May 08 05:40:29 smithi151 sudo[44093]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T05:40:30.130 INFO:journalctl@ceph.osd.2.smithi151.stdout:May 08 05:40:29 smithi151 sudo[44093]: pam_unix(sudo:session): session closed for user root 2024-05-08T05:40:30.130 INFO:journalctl@ceph.osd.2.smithi151.stdout:May 08 05:40:29 smithi151 sudo[44096]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-08T05:40:30.130 INFO:journalctl@ceph.osd.2.smithi151.stdout:May 08 05:40:29 smithi151 sudo[44096]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T05:40:30.130 INFO:journalctl@ceph.osd.2.smithi151.stdout:May 08 05:40:29 smithi151 sudo[44096]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T05:40:30.130 INFO:journalctl@ceph.osd.2.smithi151.stdout:May 08 05:40:29 smithi151 sudo[44096]: pam_unix(sudo:session): session closed for user root 2024-05-08T05:40:30.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:30 smithi151 sudo[44099]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-08T05:40:30.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:30 smithi151 sudo[44099]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T05:40:30.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:30 smithi151 sudo[44099]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T05:40:30.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:30 smithi151 sudo[44099]: pam_unix(sudo:session): session closed for user root 2024-05-08T05:40:30.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:30 smithi151 sudo[44102]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-08T05:40:30.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:30 smithi151 sudo[44102]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T05:40:30.131 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:30 smithi151 sudo[44102]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T05:40:30.131 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:30 smithi151 sudo[44102]: pam_unix(sudo:session): session closed for user root 2024-05-08T05:40:30.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:40:30.286+0000 7f8747000700 1 -- 172.21.15.82:0/285530024 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8740105740 msgr2=0x7f8740105b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:40:30.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:40:30.286+0000 7f8747000700 1 --2- 172.21.15.82:0/285530024 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8740105740 0x7f8740105b60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8730009920 tx=0x7f8730009c30 comp rx=0 tx=0).stop 2024-05-08T05:40:30.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:40:30.286+0000 7f8747000700 1 -- 172.21.15.82:0/285530024 shutdown_connections 2024-05-08T05:40:30.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:40:30.286+0000 7f8747000700 1 --2- 172.21.15.82:0/285530024 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8740105740 0x7f8740105b60 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:40:30.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:40:30.286+0000 7f8747000700 1 --2- 172.21.15.82:0/285530024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87401072e0 0x7f874010db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:40:30.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:40:30.286+0000 7f8747000700 1 --2- 172.21.15.82:0/285530024 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8740106940 0x7f8740106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:40:30.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:40:30.286+0000 7f8747000700 1 -- 172.21.15.82:0/285530024 >> 172.21.15.82:0/285530024 conn(0x7f8740100d00 msgr2=0x7f8740103120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:40:30.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:40:30.286+0000 7f8747000700 1 -- 172.21.15.82:0/285530024 shutdown_connections 2024-05-08T05:40:30.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:40:30.286+0000 7f8747000700 1 -- 172.21.15.82:0/285530024 wait complete. 2024-05-08T05:40:30.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:40:30.287+0000 7f8747000700 1 Processor -- start 2024-05-08T05:40:30.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:40:30.287+0000 7f8747000700 1 -- start start 2024-05-08T05:40:30.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:40:30.288+0000 7f8747000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8740105740 0x7f874019b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:40:30.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:40:30.288+0000 7f8747000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8740106940 0x7f874019be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:40:30.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:40:30.288+0000 7f8747000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87401072e0 0x7f87401a2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:40:30.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:40:30.288+0000 7f8747000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8740111220 con 0x7f8740106940 2024-05-08T05:40:30.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:40:30.288+0000 7f8747000700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f87401110a0 con 0x7f87401072e0 2024-05-08T05:40:30.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:40:30.288+0000 7f8747000700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f87401113a0 con 0x7f8740105740 2024-05-08T05:40:30.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:40:30.288+0000 7f873f400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8740106940 0x7f874019be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:40:30.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:40:30.288+0000 7f873fe00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8740105740 0x7f874019b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:40:30.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:40:30.288+0000 7f873fe00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8740105740 0x7f874019b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:36976/0 (socket says 172.21.15.82:36976) 2024-05-08T05:40:30.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:40:30.288+0000 7f873fe00700 1 -- 172.21.15.82:0/2630285978 learned_addr learned my addr 172.21.15.82:0/2630285978 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:40:30.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:40:30.288+0000 7f873f400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8740106940 0x7f874019be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55392/0 (socket says 172.21.15.82:55392) 2024-05-08T05:40:30.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:40:30.288+0000 7f8745000700 1 --2- 172.21.15.82:0/2630285978 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87401072e0 0x7f87401a2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:40:30.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:40:30.289+0000 7f873fe00700 1 -- 172.21.15.82:0/2630285978 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87401072e0 msgr2=0x7f87401a2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:40:30.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:40:30.289+0000 7f873fe00700 1 --2- 172.21.15.82:0/2630285978 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87401072e0 0x7f87401a2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:40:30.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:40:30.289+0000 7f873fe00700 1 -- 172.21.15.82:0/2630285978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8740106940 msgr2=0x7f874019be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:40:30.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:40:30.289+0000 7f873fe00700 1 --2- 172.21.15.82:0/2630285978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8740106940 0x7f874019be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:40:30.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:40:30.289+0000 7f873fe00700 1 -- 172.21.15.82:0/2630285978 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87401a3590 con 0x7f8740105740 2024-05-08T05:40:30.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:40:30.289+0000 7f873fe00700 1 --2- 172.21.15.82:0/2630285978 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8740105740 0x7f874019b930 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8730011040 tx=0x7f8730005270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:40:30.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:40:30.289+0000 7f873cc00700 1 -- 172.21.15.82:0/2630285978 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8730027070 con 0x7f8740105740 2024-05-08T05:40:30.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:40:30.289+0000 7f873cc00700 1 -- 172.21.15.82:0/2630285978 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f873000ba10 con 0x7f8740105740 2024-05-08T05:40:30.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:40:30.289+0000 7f8747000700 1 -- 172.21.15.82:0/2630285978 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87401a3820 con 0x7f8740105740 2024-05-08T05:40:30.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:40:30.289+0000 7f873cc00700 1 -- 172.21.15.82:0/2630285978 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8730004910 con 0x7f8740105740 2024-05-08T05:40:30.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:40:30.290+0000 7f8747000700 1 -- 172.21.15.82:0/2630285978 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87401a3c70 con 0x7f8740105740 2024-05-08T05:40:30.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:40:30.291+0000 7f8747000700 1 -- 172.21.15.82:0/2630285978 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f874006a190 con 0x7f8740105740 2024-05-08T05:40:30.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:40:30.293+0000 7f873cc00700 1 -- 172.21.15.82:0/2630285978 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7f873002a070 con 0x7f8740105740 2024-05-08T05:40:30.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:40:30.294+0000 7f873cc00700 1 --2- 172.21.15.82:0/2630285978 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f87240b2870 0x7f87240b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:40:30.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:40:30.295+0000 7f873cc00700 1 -- 172.21.15.82:0/2630285978 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3237+0+0 (secure 0 0 0) 0x7f87300e1c90 con 0x7f8740105740 2024-05-08T05:40:30.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:40:30.295+0000 7f873f400700 1 --2- 172.21.15.82:0/2630285978 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f87240b2870 0x7f87240b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:40:30.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:40:30.295+0000 7f873f400700 1 --2- 172.21.15.82:0/2630285978 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f87240b2870 0x7f87240b4d30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f872c009c60 tx=0x7f872c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:40:30.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:40:30.296+0000 7f873cc00700 1 -- 172.21.15.82:0/2630285978 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f8730031020 con 0x7f8740105740 2024-05-08T05:40:30.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:30 smithi134 sudo[42722]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-08T05:40:30.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:30 smithi134 sudo[42722]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T05:40:30.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:30 smithi134 sudo[42722]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T05:40:30.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:30 smithi134 sudo[42722]: pam_unix(sudo:session): session closed for user root 2024-05-08T05:40:30.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:30 smithi134 sudo[42725]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-08T05:40:30.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:30 smithi134 sudo[42725]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-08T05:40:30.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:30 smithi134 sudo[42725]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-08T05:40:30.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:30 smithi134 sudo[42725]: pam_unix(sudo:session): session closed for user root 2024-05-08T05:40:30.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:40:30.545+0000 7f8747000700 1 -- 172.21.15.82:0/2630285978 --> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f87400638e0 con 0x7f87240b2870 2024-05-08T05:40:30.875 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:30 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-08T05:40:30.876 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:30 smithi082 ceph-mon[30098]: osdmap e21: 3 total, 3 up, 3 in 2024-05-08T05:40:30.876 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:30 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:30.876 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:30 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:30.876 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:30 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:30.876 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:30 smithi082 ceph-mon[30098]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-08T05:40:30.876 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:30 smithi082 ceph-mon[30098]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-08T05:40:30.876 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:30 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T05:40:30.876 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:30 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:40:30.876 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:30 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T05:40:30.876 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:30 smithi082 ceph-mon[30098]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-08T05:40:30.876 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:30 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T05:40:30.876 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:30 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:40:30.876 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:30 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T05:40:30.876 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:30 smithi082 ceph-mon[30098]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-08T05:40:30.877 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:30 smithi082 ceph-mon[30098]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-08T05:40:30.877 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:30 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T05:40:30.877 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:30 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:40:30.877 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:30 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T05:40:30.877 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:30 smithi082 ceph-mon[30098]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-08T05:40:30.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:30 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-08T05:40:30.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:30 smithi151 ceph-mon[34815]: osdmap e21: 3 total, 3 up, 3 in 2024-05-08T05:40:30.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:30 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:30.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:30 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:30.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:30 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:30.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:30 smithi151 ceph-mon[34815]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-08T05:40:30.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:30 smithi151 ceph-mon[34815]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-08T05:40:30.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:30 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T05:40:30.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:30 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:40:30.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:30 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T05:40:30.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:30 smithi151 ceph-mon[34815]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-08T05:40:30.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:30 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T05:40:30.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:30 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:40:30.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:30 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T05:40:30.881 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:30 smithi151 ceph-mon[34815]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-08T05:40:30.881 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:30 smithi151 ceph-mon[34815]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-08T05:40:30.881 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:30 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T05:40:30.881 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:30 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:40:30.881 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:30 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T05:40:30.881 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:30 smithi151 ceph-mon[34815]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-08T05:40:30.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:40:30.928+0000 7f873cc00700 1 -- 172.21.15.82:0/2630285978 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f87300a69e0 con 0x7f8740105740 2024-05-08T05:40:31.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:30 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-08T05:40:31.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:30 smithi134 ceph-mon[34132]: osdmap e21: 3 total, 3 up, 3 in 2024-05-08T05:40:31.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:30 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:31.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:30 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:31.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:30 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:31.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:30 smithi134 ceph-mon[34132]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-08T05:40:31.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:30 smithi134 ceph-mon[34132]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-08T05:40:31.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:30 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T05:40:31.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:30 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:40:31.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:30 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T05:40:31.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:30 smithi134 ceph-mon[34132]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-08T05:40:31.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:30 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T05:40:31.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:30 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:40:31.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:30 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T05:40:31.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:30 smithi134 ceph-mon[34132]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-08T05:40:31.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:30 smithi134 ceph-mon[34132]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-08T05:40:31.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:30 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-08T05:40:31.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:30 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-08T05:40:31.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:30 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-08T05:40:31.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:30 smithi134 ceph-mon[34132]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-08T05:40:31.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:31 smithi082 ceph-mon[30098]: pgmap v94: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:40:31.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:31 smithi082 ceph-mon[30098]: osdmap e22: 3 total, 3 up, 3 in 2024-05-08T05:40:31.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:31 smithi082 ceph-mon[30098]: from='client.24205 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:40:31.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:31 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:40:31.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:31 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:40:31.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:31 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:40:31.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:31 smithi082 ceph-mon[30098]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-05-08T05:40:31.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:31 smithi151 ceph-mon[34815]: pgmap v94: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:40:31.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:31 smithi151 ceph-mon[34815]: osdmap e22: 3 total, 3 up, 3 in 2024-05-08T05:40:31.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:31 smithi151 ceph-mon[34815]: from='client.24205 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:40:31.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:31 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:40:31.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:31 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:40:31.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:31 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:40:31.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:31 smithi151 ceph-mon[34815]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-05-08T05:40:32.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:31 smithi134 ceph-mon[34132]: pgmap v94: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:40:32.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:31 smithi134 ceph-mon[34132]: osdmap e22: 3 total, 3 up, 3 in 2024-05-08T05:40:32.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:31 smithi134 ceph-mon[34132]: from='client.24205 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:40:32.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:31 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:40:32.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:31 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:40:32.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:31 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:40:32.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:31 smithi134 ceph-mon[34132]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-05-08T05:40:33.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:33 smithi151 ceph-mon[34815]: pgmap v96: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:40:33.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:33 smithi082 ceph-mon[30098]: pgmap v96: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:40:34.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:33 smithi134 ceph-mon[34132]: pgmap v96: 1 pgs: 1 creating+peering; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:40:34.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:34 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/1802274673' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b8c8bdcd-fbd7-4494-976e-7285408e010e"}]: dispatch 2024-05-08T05:40:34.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:34 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/1802274673' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b8c8bdcd-fbd7-4494-976e-7285408e010e"}]': finished 2024-05-08T05:40:34.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:34 smithi151 ceph-mon[34815]: osdmap e23: 4 total, 3 up, 4 in 2024-05-08T05:40:34.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:34 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T05:40:34.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:34 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/1802274673' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b8c8bdcd-fbd7-4494-976e-7285408e010e"}]: dispatch 2024-05-08T05:40:34.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:34 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/1802274673' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b8c8bdcd-fbd7-4494-976e-7285408e010e"}]': finished 2024-05-08T05:40:34.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:34 smithi082 ceph-mon[30098]: osdmap e23: 4 total, 3 up, 4 in 2024-05-08T05:40:34.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:34 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T05:40:35.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:34 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/1802274673' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b8c8bdcd-fbd7-4494-976e-7285408e010e"}]: dispatch 2024-05-08T05:40:35.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:34 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/1802274673' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b8c8bdcd-fbd7-4494-976e-7285408e010e"}]': finished 2024-05-08T05:40:35.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:34 smithi134 ceph-mon[34132]: osdmap e23: 4 total, 3 up, 4 in 2024-05-08T05:40:35.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:34 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T05:40:35.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:35 smithi151 ceph-mon[34815]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:40:35.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:35 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/1598599753' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:40:35.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:35 smithi082 ceph-mon[30098]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:40:35.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:35 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/1598599753' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:40:36.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:35 smithi134 ceph-mon[34132]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:40:36.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:35 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/1598599753' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:40:37.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:37 smithi151 ceph-mon[34815]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:40:37.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:37 smithi082 ceph-mon[30098]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:40:38.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:37 smithi134 ceph-mon[34132]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:40:39.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:39 smithi151 ceph-mon[34815]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:40:39.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:39 smithi082 ceph-mon[30098]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:40:40.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:39 smithi134 ceph-mon[34132]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:40:41.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:41 smithi151 ceph-mon[34815]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:40:41.885 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:41 smithi082 ceph-mon[30098]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:40:42.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:41 smithi134 ceph-mon[34132]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:40:43.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:43 smithi082 ceph-mon[30098]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:40:43.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:43 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-08T05:40:43.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:43 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:40:43.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:43 smithi151 ceph-mon[34815]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:40:43.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:43 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-08T05:40:43.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:43 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:40:44.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:43 smithi134 ceph-mon[34132]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:40:44.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:43 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-08T05:40:44.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:43 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:40:44.803 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:44 smithi082 ceph-mon[30098]: Deploying daemon osd.3 on smithi082 2024-05-08T05:40:44.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:44 smithi151 ceph-mon[34815]: Deploying daemon osd.3 on smithi082 2024-05-08T05:40:45.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:44 smithi134 ceph-mon[34132]: Deploying daemon osd.3 on smithi082 2024-05-08T05:40:45.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:45 smithi151 ceph-mon[34815]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:40:45.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:45 smithi082 ceph-mon[30098]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:40:45.990 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:45 smithi134 ceph-mon[34132]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:40:47.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:47 smithi082 ceph-mon[30098]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:40:47.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:47 smithi151 ceph-mon[34815]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:40:48.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:47 smithi134 ceph-mon[34132]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:40:49.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:49 smithi151 ceph-mon[34815]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:40:49.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:49 smithi082 ceph-mon[30098]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:40:50.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:49 smithi134 ceph-mon[34132]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:40:51.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:51 smithi151 ceph-mon[34815]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:40:51.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:51 smithi082 ceph-mon[30098]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:40:52.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:51 smithi134 ceph-mon[34132]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:40:53.024 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:52 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:53.024 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:52 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:53.024 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:52 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:40:53.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:52 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:53.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:52 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:53.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:52 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:40:53.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:52 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:53.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:52 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:53.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:52 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:40:53.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:53 smithi082 ceph-mon[30098]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:40:54.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:53 smithi151 ceph-mon[34815]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:40:54.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:53 smithi134 ceph-mon[34132]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:40:56.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:55 smithi151 ceph-mon[34815]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:40:56.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:55 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:56.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:55 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:56.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:55 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:40:56.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:55 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:40:56.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:55 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:56.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:55 smithi151 ceph-mon[34815]: from='osd.3 [v2:172.21.15.82:6810/2775272422,v1:172.21.15.82:6811/2775272422]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-08T05:40:56.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:55 smithi082 ceph-mon[30098]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:40:56.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:55 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:56.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:55 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:56.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:55 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:40:56.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:55 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:40:56.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:55 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:56.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:55 smithi082 ceph-mon[30098]: from='osd.3 [v2:172.21.15.82:6810/2775272422,v1:172.21.15.82:6811/2775272422]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-08T05:40:56.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:55 smithi134 ceph-mon[34132]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:40:56.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:55 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:56.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:55 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:56.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:55 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:40:56.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:55 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:40:56.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:55 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:56.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:55 smithi134 ceph-mon[34132]: from='osd.3 [v2:172.21.15.82:6810/2775272422,v1:172.21.15.82:6811/2775272422]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-08T05:40:56.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:40:56.734+0000 7f873cc00700 1 -- 172.21.15.82:0/2630285978 <== mgr.14152 v2:172.21.15.82:6800/4089180091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f87400638e0 con 0x7f87240b2870 2024-05-08T05:40:56.736 INFO:teuthology.orchestra.run.smithi082.stdout:Created osd(s) 3 on host 'smithi082' 2024-05-08T05:40:56.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:40:56.738+0000 7f8747000700 1 -- 172.21.15.82:0/2630285978 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f87240b2870 msgr2=0x7f87240b4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:40:56.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:40:56.738+0000 7f8747000700 1 --2- 172.21.15.82:0/2630285978 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f87240b2870 0x7f87240b4d30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f872c009c60 tx=0x7f872c009260 comp rx=0 tx=0).stop 2024-05-08T05:40:56.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:40:56.739+0000 7f8747000700 1 -- 172.21.15.82:0/2630285978 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8740105740 msgr2=0x7f874019b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:40:56.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:40:56.739+0000 7f8747000700 1 --2- 172.21.15.82:0/2630285978 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8740105740 0x7f874019b930 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8730011040 tx=0x7f8730005270 comp rx=0 tx=0).stop 2024-05-08T05:40:56.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:40:56.739+0000 7f8747000700 1 -- 172.21.15.82:0/2630285978 shutdown_connections 2024-05-08T05:40:56.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:40:56.739+0000 7f8747000700 1 --2- 172.21.15.82:0/2630285978 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87401072e0 0x7f87401a2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:40:56.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:40:56.739+0000 7f8747000700 1 --2- 172.21.15.82:0/2630285978 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f87240b2870 0x7f87240b4d30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:40:56.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:40:56.739+0000 7f8747000700 1 --2- 172.21.15.82:0/2630285978 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8740105740 0x7f874019b930 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:40:56.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:40:56.739+0000 7f8747000700 1 --2- 172.21.15.82:0/2630285978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8740106940 0x7f874019be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:40:56.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:40:56.739+0000 7f8747000700 1 -- 172.21.15.82:0/2630285978 >> 172.21.15.82:0/2630285978 conn(0x7f8740100d00 msgr2=0x7f8740109d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:40:56.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:40:56.739+0000 7f8747000700 1 -- 172.21.15.82:0/2630285978 shutdown_connections 2024-05-08T05:40:56.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:40:56.739+0000 7f8747000700 1 -- 172.21.15.82:0/2630285978 wait complete. 2024-05-08T05:40:57.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:57 smithi151 ceph-mon[34815]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:40:57.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:57 smithi151 ceph-mon[34815]: from='osd.3 [v2:172.21.15.82:6810/2775272422,v1:172.21.15.82:6811/2775272422]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-08T05:40:57.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:57 smithi151 ceph-mon[34815]: osdmap e24: 4 total, 3 up, 4 in 2024-05-08T05:40:57.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:57 smithi151 ceph-mon[34815]: from='osd.3 [v2:172.21.15.82:6810/2775272422,v1:172.21.15.82:6811/2775272422]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-05-08T05:40:57.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:57 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T05:40:57.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:57 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:57.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:57 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:57.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:57 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:40:57.409 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:57 smithi082 ceph-mon[30098]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:40:57.409 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:57 smithi082 ceph-mon[30098]: from='osd.3 [v2:172.21.15.82:6810/2775272422,v1:172.21.15.82:6811/2775272422]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-08T05:40:57.409 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:57 smithi082 ceph-mon[30098]: osdmap e24: 4 total, 3 up, 4 in 2024-05-08T05:40:57.409 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:57 smithi082 ceph-mon[30098]: from='osd.3 [v2:172.21.15.82:6810/2775272422,v1:172.21.15.82:6811/2775272422]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-05-08T05:40:57.409 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:57 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T05:40:57.410 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:57 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:57.410 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:57 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:57.410 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:57 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:40:57.455 DEBUG:teuthology.orchestra.run.smithi082:osd.3> sudo journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@osd.3.service 2024-05-08T05:40:57.460 INFO:tasks.cephadm:Deploying osd.4 on smithi134 with /dev/vg_nvme/lv_3... 2024-05-08T05:40:57.460 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-08T05:40:57.487 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:57 smithi134 ceph-mon[34132]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:40:57.487 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:57 smithi134 ceph-mon[34132]: from='osd.3 [v2:172.21.15.82:6810/2775272422,v1:172.21.15.82:6811/2775272422]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-08T05:40:57.487 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:57 smithi134 ceph-mon[34132]: osdmap e24: 4 total, 3 up, 4 in 2024-05-08T05:40:57.487 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:57 smithi134 ceph-mon[34132]: from='osd.3 [v2:172.21.15.82:6810/2775272422,v1:172.21.15.82:6811/2775272422]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-05-08T05:40:57.487 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:57 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T05:40:57.487 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:57 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:57.487 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:57 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:40:57.487 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:57 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:40:57.706 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T05:40:58.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:58 smithi151 ceph-mon[34815]: from='osd.3 [v2:172.21.15.82:6810/2775272422,v1:172.21.15.82:6811/2775272422]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-05-08T05:40:58.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:58 smithi151 ceph-mon[34815]: osdmap e25: 4 total, 3 up, 4 in 2024-05-08T05:40:58.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:58 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T05:40:58.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:58 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T05:40:58.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:58 smithi082 ceph-mon[30098]: from='osd.3 [v2:172.21.15.82:6810/2775272422,v1:172.21.15.82:6811/2775272422]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-05-08T05:40:58.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:58 smithi082 ceph-mon[30098]: osdmap e25: 4 total, 3 up, 4 in 2024-05-08T05:40:58.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:58 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T05:40:58.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:58 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T05:40:58.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:58 smithi134 ceph-mon[34132]: from='osd.3 [v2:172.21.15.82:6810/2775272422,v1:172.21.15.82:6811/2775272422]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-05-08T05:40:58.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:58 smithi134 ceph-mon[34132]: osdmap e25: 4 total, 3 up, 4 in 2024-05-08T05:40:58.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:58 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T05:40:58.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:58 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T05:40:59.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:59 smithi134 ceph-mon[34132]: purged_snaps scrub starts 2024-05-08T05:40:59.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:59 smithi134 ceph-mon[34132]: purged_snaps scrub ok 2024-05-08T05:40:59.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:59 smithi134 ceph-mon[34132]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:40:59.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:59 smithi134 ceph-mon[34132]: osd.3 [v2:172.21.15.82:6810/2775272422,v1:172.21.15.82:6811/2775272422] boot 2024-05-08T05:40:59.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:59 smithi134 ceph-mon[34132]: osdmap e26: 4 total, 4 up, 4 in 2024-05-08T05:40:59.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:40:59 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T05:40:59.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:59 smithi151 ceph-mon[34815]: purged_snaps scrub starts 2024-05-08T05:40:59.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:59 smithi151 ceph-mon[34815]: purged_snaps scrub ok 2024-05-08T05:40:59.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:59 smithi151 ceph-mon[34815]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:40:59.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:59 smithi151 ceph-mon[34815]: osd.3 [v2:172.21.15.82:6810/2775272422,v1:172.21.15.82:6811/2775272422] boot 2024-05-08T05:40:59.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:59 smithi151 ceph-mon[34815]: osdmap e26: 4 total, 4 up, 4 in 2024-05-08T05:40:59.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:40:59 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T05:40:59.394 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:59 smithi082 ceph-mon[30098]: purged_snaps scrub starts 2024-05-08T05:40:59.395 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:59 smithi082 ceph-mon[30098]: purged_snaps scrub ok 2024-05-08T05:40:59.395 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:59 smithi082 ceph-mon[30098]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 84 MiB used, 268 GiB / 268 GiB avail 2024-05-08T05:40:59.395 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:59 smithi082 ceph-mon[30098]: osd.3 [v2:172.21.15.82:6810/2775272422,v1:172.21.15.82:6811/2775272422] boot 2024-05-08T05:40:59.395 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:59 smithi082 ceph-mon[30098]: osdmap e26: 4 total, 4 up, 4 in 2024-05-08T05:40:59.395 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:40:59 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-08T05:40:59.553 INFO:teuthology.orchestra.run.smithi134.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-08T05:40:59.553 INFO:teuthology.orchestra.run.smithi134.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-08T05:40:59.553 INFO:teuthology.orchestra.run.smithi134.stderr: stderr: 10+0 records in 2024-05-08T05:40:59.553 INFO:teuthology.orchestra.run.smithi134.stderr:10+0 records out 2024-05-08T05:40:59.553 INFO:teuthology.orchestra.run.smithi134.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0112139 s, 935 MB/s 2024-05-08T05:40:59.553 INFO:teuthology.orchestra.run.smithi134.stderr:--> Zapping successful for: 2024-05-08T05:41:00.175 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi134:vg_nvme/lv_3 2024-05-08T05:41:00.454 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:00 smithi134 ceph-mon[34132]: osdmap e27: 4 total, 4 up, 4 in 2024-05-08T05:41:00.455 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:00 smithi134 ceph-mon[34132]: osdmap e28: 4 total, 4 up, 4 in 2024-05-08T05:41:00.460 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T05:41:00.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:00 smithi082 ceph-mon[30098]: osdmap e27: 4 total, 4 up, 4 in 2024-05-08T05:41:00.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:00 smithi082 ceph-mon[30098]: osdmap e28: 4 total, 4 up, 4 in 2024-05-08T05:41:00.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:00 smithi151 ceph-mon[34815]: osdmap e27: 4 total, 4 up, 4 in 2024-05-08T05:41:00.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:00 smithi151 ceph-mon[34815]: osdmap e28: 4 total, 4 up, 4 in 2024-05-08T05:41:01.406 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:01 smithi134 ceph-mon[34132]: pgmap v115: 1 pgs: 1 remapped+peering; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-05-08T05:41:01.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:01 smithi082 ceph-mon[30098]: pgmap v115: 1 pgs: 1 remapped+peering; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-05-08T05:41:01.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:01 smithi151 ceph-mon[34815]: pgmap v115: 1 pgs: 1 remapped+peering; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-05-08T05:41:02.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:41:02.062+0000 7f06ba6f9700 1 -- 172.21.15.134:0/2468737389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06b41068e0 msgr2=0x7f06b4108cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:41:02.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:41:02.062+0000 7f06ba6f9700 1 --2- 172.21.15.134:0/2468737389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06b41068e0 0x7f06b4108cd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f06a8009990 tx=0x7f06a8009ca0 comp rx=0 tx=0).stop 2024-05-08T05:41:02.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:41:02.063+0000 7f06ba6f9700 1 -- 172.21.15.134:0/2468737389 shutdown_connections 2024-05-08T05:41:02.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:41:02.063+0000 7f06ba6f9700 1 --2- 172.21.15.134:0/2468737389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06b4109210 0x7f06b410b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:41:02.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:41:02.063+0000 7f06ba6f9700 1 --2- 172.21.15.134:0/2468737389 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06b4103fb0 0x7f06b41063a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:41:02.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:41:02.063+0000 7f06ba6f9700 1 --2- 172.21.15.134:0/2468737389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06b41068e0 0x7f06b4108cd0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:41:02.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:41:02.063+0000 7f06ba6f9700 1 -- 172.21.15.134:0/2468737389 >> 172.21.15.134:0/2468737389 conn(0x7f06b40fda00 msgr2=0x7f06b40ffe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:41:02.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:41:02.063+0000 7f06ba6f9700 1 -- 172.21.15.134:0/2468737389 shutdown_connections 2024-05-08T05:41:02.065 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:41:02.063+0000 7f06ba6f9700 1 -- 172.21.15.134:0/2468737389 wait complete. 2024-05-08T05:41:02.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:41:02.063+0000 7f06ba6f9700 1 Processor -- start 2024-05-08T05:41:02.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:41:02.063+0000 7f06ba6f9700 1 -- start start 2024-05-08T05:41:02.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:41:02.063+0000 7f06ba6f9700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06b4103fb0 0x7f06b4199700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:41:02.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:41:02.064+0000 7f06ba6f9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06b41068e0 0x7f06b4199c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:41:02.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:41:02.064+0000 7f06ba6f9700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06b4109210 0x7f06b41a0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:41:02.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:41:02.064+0000 7f06ba6f9700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f06b410f040 con 0x7f06b4103fb0 2024-05-08T05:41:02.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:41:02.064+0000 7f06ba6f9700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f06b410eec0 con 0x7f06b41068e0 2024-05-08T05:41:02.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:41:02.064+0000 7f06ba6f9700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f06b410f1c0 con 0x7f06b4109210 2024-05-08T05:41:02.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:41:02.064+0000 7f06b37fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06b41068e0 0x7f06b4199c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:41:02.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:41:02.064+0000 7f06b37fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06b41068e0 0x7f06b4199c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:46222/0 (socket says 172.21.15.134:46222) 2024-05-08T05:41:02.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:41:02.064+0000 7f06b37fe700 1 -- 172.21.15.134:0/4089434004 learned_addr learned my addr 172.21.15.134:0/4089434004 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-05-08T05:41:02.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:41:02.064+0000 7f06b8c96700 1 --2- 172.21.15.134:0/4089434004 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06b4109210 0x7f06b41a0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:41:02.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:41:02.064+0000 7f06b37fe700 1 -- 172.21.15.134:0/4089434004 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06b4109210 msgr2=0x7f06b41a0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:41:02.066 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:41:02.064+0000 7f06b37fe700 1 --2- 172.21.15.134:0/4089434004 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06b4109210 0x7f06b41a0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:41:02.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:41:02.064+0000 7f06b37fe700 1 -- 172.21.15.134:0/4089434004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06b4103fb0 msgr2=0x7f06b4199700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:41:02.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:41:02.064+0000 7f06b37fe700 1 --2- 172.21.15.134:0/4089434004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06b4103fb0 0x7f06b4199700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:41:02.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:41:02.064+0000 7f06b37fe700 1 -- 172.21.15.134:0/4089434004 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06b4101da0 con 0x7f06b41068e0 2024-05-08T05:41:02.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:41:02.064+0000 7f06b37fe700 1 --2- 172.21.15.134:0/4089434004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06b41068e0 0x7f06b4199c40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f06a80036f0 tx=0x7f06a80047b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:41:02.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:41:02.064+0000 7f06b17fa700 1 -- 172.21.15.134:0/4089434004 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06a8027070 con 0x7f06b41068e0 2024-05-08T05:41:02.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:41:02.064+0000 7f06ba6f9700 1 -- 172.21.15.134:0/4089434004 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06b4102030 con 0x7f06b41068e0 2024-05-08T05:41:02.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:41:02.064+0000 7f06b17fa700 1 -- 172.21.15.134:0/4089434004 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06a8022470 con 0x7f06b41068e0 2024-05-08T05:41:02.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:41:02.064+0000 7f06b17fa700 1 -- 172.21.15.134:0/4089434004 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06a800f6c0 con 0x7f06b41068e0 2024-05-08T05:41:02.067 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:41:02.064+0000 7f06ba6f9700 1 -- 172.21.15.134:0/4089434004 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06b41025e0 con 0x7f06b41068e0 2024-05-08T05:41:02.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:41:02.065+0000 7f06ba6f9700 1 -- 172.21.15.134:0/4089434004 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06b406a190 con 0x7f06b41068e0 2024-05-08T05:41:02.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:41:02.066+0000 7f06b17fa700 1 -- 172.21.15.134:0/4089434004 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f06a802a070 con 0x7f06b41068e0 2024-05-08T05:41:02.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:41:02.067+0000 7f06b17fa700 1 --2- 172.21.15.134:0/4089434004 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f069c0b2880 0x7f069c0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:41:02.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:41:02.067+0000 7f06b17fa700 1 -- 172.21.15.134:0/4089434004 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 3669+0+0 (secure 0 0 0) 0x7f06a80e2380 con 0x7f06b41068e0 2024-05-08T05:41:02.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:41:02.067+0000 7f06b3fff700 1 --2- 172.21.15.134:0/4089434004 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f069c0b2880 0x7f069c0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:41:02.068 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:41:02.068+0000 7f06b3fff700 1 --2- 172.21.15.134:0/4089434004 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f069c0b2880 0x7f069c0b4d40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f06a400a990 tx=0x7f06a4005c80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:41:02.071 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:41:02.071+0000 7f06b17fa700 1 -- 172.21.15.134:0/4089434004 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f06a8013070 con 0x7f06b41068e0 2024-05-08T05:41:02.289 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:41:02.286+0000 7f06ba6f9700 1 -- 172.21.15.134:0/4089434004 --> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f06b40ff070 con 0x7f069c0b2880 2024-05-08T05:41:03.204 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:02 smithi134 ceph-mon[34132]: Detected new or changed devices on smithi082 2024-05-08T05:41:03.204 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:02 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:03.204 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:02 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:03.204 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:02 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:41:03.204 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:02 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:41:03.204 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:02 smithi134 ceph-mon[34132]: Adjusting osd_memory_target on smithi082 to 8544M 2024-05-08T05:41:03.204 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:02 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:03.204 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:02 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:41:03.204 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:02 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:41:03.204 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:02 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:03.204 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:02 smithi134 ceph-mon[34132]: pgmap v117: 1 pgs: 1 remapped+peering; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-05-08T05:41:03.205 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:02 smithi134 ceph-mon[34132]: from='client.24227 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:41:03.205 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:02 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:41:03.205 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:02 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:41:03.205 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:02 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:41:03.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:02 smithi082 ceph-mon[30098]: Detected new or changed devices on smithi082 2024-05-08T05:41:03.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:02 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:03.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:02 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:03.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:02 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:41:03.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:02 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:41:03.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:02 smithi082 ceph-mon[30098]: Adjusting osd_memory_target on smithi082 to 8544M 2024-05-08T05:41:03.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:02 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:03.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:02 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:41:03.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:02 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:41:03.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:02 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:03.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:02 smithi082 ceph-mon[30098]: pgmap v117: 1 pgs: 1 remapped+peering; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-05-08T05:41:03.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:02 smithi082 ceph-mon[30098]: from='client.24227 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:41:03.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:02 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:41:03.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:02 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:41:03.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:02 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:41:03.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:02 smithi151 ceph-mon[34815]: Detected new or changed devices on smithi082 2024-05-08T05:41:03.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:02 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:03.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:02 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:03.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:02 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:41:03.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:02 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:41:03.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:02 smithi151 ceph-mon[34815]: Adjusting osd_memory_target on smithi082 to 8544M 2024-05-08T05:41:03.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:02 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:03.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:02 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:41:03.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:02 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:41:03.381 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:02 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:03.381 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:02 smithi151 ceph-mon[34815]: pgmap v117: 1 pgs: 1 remapped+peering; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-05-08T05:41:03.381 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:02 smithi151 ceph-mon[34815]: from='client.24227 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:41:03.381 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:02 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:41:03.381 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:02 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:41:03.381 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:02 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:41:05.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:05 smithi151 ceph-mon[34815]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-08T05:41:05.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:05 smithi151 ceph-mon[34815]: from='client.? 172.21.15.134:0/4070744119' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "391a6040-03d1-483c-9058-308b5998e7c5"}]: dispatch 2024-05-08T05:41:05.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:05 smithi151 ceph-mon[34815]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "391a6040-03d1-483c-9058-308b5998e7c5"}]: dispatch 2024-05-08T05:41:05.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:05 smithi151 ceph-mon[34815]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "391a6040-03d1-483c-9058-308b5998e7c5"}]': finished 2024-05-08T05:41:05.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:05 smithi151 ceph-mon[34815]: osdmap e29: 5 total, 4 up, 5 in 2024-05-08T05:41:05.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:05 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T05:41:05.391 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:05 smithi134 ceph-mon[34132]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-08T05:41:05.391 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:05 smithi134 ceph-mon[34132]: from='client.? 172.21.15.134:0/4070744119' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "391a6040-03d1-483c-9058-308b5998e7c5"}]: dispatch 2024-05-08T05:41:05.391 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:05 smithi134 ceph-mon[34132]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "391a6040-03d1-483c-9058-308b5998e7c5"}]: dispatch 2024-05-08T05:41:05.391 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:05 smithi134 ceph-mon[34132]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "391a6040-03d1-483c-9058-308b5998e7c5"}]': finished 2024-05-08T05:41:05.391 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:05 smithi134 ceph-mon[34132]: osdmap e29: 5 total, 4 up, 5 in 2024-05-08T05:41:05.391 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:05 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T05:41:05.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:05 smithi082 ceph-mon[30098]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-08T05:41:05.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:05 smithi082 ceph-mon[30098]: from='client.? 172.21.15.134:0/4070744119' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "391a6040-03d1-483c-9058-308b5998e7c5"}]: dispatch 2024-05-08T05:41:05.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:05 smithi082 ceph-mon[30098]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "391a6040-03d1-483c-9058-308b5998e7c5"}]: dispatch 2024-05-08T05:41:05.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:05 smithi082 ceph-mon[30098]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "391a6040-03d1-483c-9058-308b5998e7c5"}]': finished 2024-05-08T05:41:05.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:05 smithi082 ceph-mon[30098]: osdmap e29: 5 total, 4 up, 5 in 2024-05-08T05:41:05.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:05 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T05:41:06.381 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:06 smithi151 ceph-mon[34815]: from='client.? 172.21.15.134:0/2715127539' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:41:06.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:06 smithi082 ceph-mon[30098]: from='client.? 172.21.15.134:0/2715127539' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:41:06.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:06 smithi134 ceph-mon[34132]: from='client.? 172.21.15.134:0/2715127539' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:41:07.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:07 smithi151 ceph-mon[34815]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-05-08T05:41:07.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:07 smithi082 ceph-mon[30098]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-05-08T05:41:07.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:07 smithi134 ceph-mon[34132]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 84 KiB/s, 0 objects/s recovering 2024-05-08T05:41:09.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:09 smithi151 ceph-mon[34815]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-08T05:41:09.392 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:09 smithi134 ceph-mon[34132]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-08T05:41:09.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:09 smithi082 ceph-mon[30098]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-08T05:41:11.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:11 smithi134 ceph-mon[34132]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T05:41:11.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:11 smithi151 ceph-mon[34815]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T05:41:11.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:11 smithi082 ceph-mon[30098]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T05:41:13.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:13 smithi151 ceph-mon[34815]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T05:41:13.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:13 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-08T05:41:13.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:13 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:41:13.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:13 smithi151 ceph-mon[34815]: Deploying daemon osd.4 on smithi134 2024-05-08T05:41:13.392 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:13 smithi134 ceph-mon[34132]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T05:41:13.392 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:13 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-08T05:41:13.392 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:13 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:41:13.393 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:13 smithi134 ceph-mon[34132]: Deploying daemon osd.4 on smithi134 2024-05-08T05:41:13.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:13 smithi082 ceph-mon[30098]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T05:41:13.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:13 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-08T05:41:13.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:13 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:41:13.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:13 smithi082 ceph-mon[30098]: Deploying daemon osd.4 on smithi134 2024-05-08T05:41:15.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:15 smithi151 ceph-mon[34815]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-05-08T05:41:15.429 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:15 smithi134 ceph-mon[34132]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-05-08T05:41:15.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:15 smithi082 ceph-mon[30098]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-05-08T05:41:17.195 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:17 smithi134 ceph-mon[34132]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-05-08T05:41:17.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:17 smithi082 ceph-mon[30098]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-05-08T05:41:17.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:17 smithi151 ceph-mon[34815]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-05-08T05:41:19.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:19 smithi151 ceph-mon[34815]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-05-08T05:41:19.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:19 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:19.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:19 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:19.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:19 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:41:19.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:19 smithi082 ceph-mon[30098]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-05-08T05:41:19.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:19 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:19.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:19 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:19.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:19 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:41:19.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:19 smithi134 ceph-mon[34132]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-05-08T05:41:19.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:19 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:19.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:19 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:19.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:19 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:41:21.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:21 smithi134 ceph-mon[34132]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-05-08T05:41:21.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:21 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:21.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:21 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:21.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:21 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:41:21.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:21 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:41:21.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:21 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:21.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:21 smithi151 ceph-mon[34815]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-05-08T05:41:21.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:21 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:21.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:21 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:21.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:21 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:41:21.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:21 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:41:21.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:21 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:21.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:21 smithi082 ceph-mon[30098]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-05-08T05:41:21.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:21 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:21.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:21 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:21.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:21 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:41:21.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:21 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:41:21.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:21 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:22.083 INFO:teuthology.orchestra.run.smithi134.stdout:Created osd(s) 4 on host 'smithi134' 2024-05-08T05:41:22.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:41:22.082+0000 7f06b17fa700 1 -- 172.21.15.134:0/4089434004 <== mgr.14152 v2:172.21.15.82:6800/4089180091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f06b40ff070 con 0x7f069c0b2880 2024-05-08T05:41:22.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:41:22.084+0000 7f06ba6f9700 1 -- 172.21.15.134:0/4089434004 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f069c0b2880 msgr2=0x7f069c0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:41:22.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:41:22.085+0000 7f06ba6f9700 1 --2- 172.21.15.134:0/4089434004 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f069c0b2880 0x7f069c0b4d40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f06a400a990 tx=0x7f06a4005c80 comp rx=0 tx=0).stop 2024-05-08T05:41:22.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:41:22.085+0000 7f06ba6f9700 1 -- 172.21.15.134:0/4089434004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06b41068e0 msgr2=0x7f06b4199c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:41:22.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:41:22.085+0000 7f06ba6f9700 1 --2- 172.21.15.134:0/4089434004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06b41068e0 0x7f06b4199c40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f06a80036f0 tx=0x7f06a80047b0 comp rx=0 tx=0).stop 2024-05-08T05:41:22.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:41:22.085+0000 7f06ba6f9700 1 -- 172.21.15.134:0/4089434004 shutdown_connections 2024-05-08T05:41:22.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:41:22.085+0000 7f06ba6f9700 1 --2- 172.21.15.134:0/4089434004 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f069c0b2880 0x7f069c0b4d40 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:41:22.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:41:22.085+0000 7f06ba6f9700 1 --2- 172.21.15.134:0/4089434004 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06b4109210 0x7f06b41a0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:41:22.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:41:22.085+0000 7f06ba6f9700 1 --2- 172.21.15.134:0/4089434004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06b4103fb0 0x7f06b4199700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:41:22.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:41:22.085+0000 7f06ba6f9700 1 --2- 172.21.15.134:0/4089434004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06b41068e0 0x7f06b4199c40 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:41:22.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:41:22.085+0000 7f06ba6f9700 1 -- 172.21.15.134:0/4089434004 >> 172.21.15.134:0/4089434004 conn(0x7f06b40fda00 msgr2=0x7f06b41048f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:41:22.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:41:22.085+0000 7f06ba6f9700 1 -- 172.21.15.134:0/4089434004 shutdown_connections 2024-05-08T05:41:22.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:41:22.085+0000 7f06ba6f9700 1 -- 172.21.15.134:0/4089434004 wait complete. 2024-05-08T05:41:22.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:22 smithi134 ceph-mon[34132]: from='osd.4 [v2:172.21.15.134:6808/3565208751,v1:172.21.15.134:6809/3565208751]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-08T05:41:22.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:22 smithi134 ceph-mon[34132]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-08T05:41:22.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:22 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:22.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:22 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:22.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:22 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:41:22.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:22 smithi151 ceph-mon[34815]: from='osd.4 [v2:172.21.15.134:6808/3565208751,v1:172.21.15.134:6809/3565208751]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-08T05:41:22.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:22 smithi151 ceph-mon[34815]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-08T05:41:22.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:22 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:22.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:22 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:22.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:22 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:41:22.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:22 smithi082 ceph-mon[30098]: from='osd.4 [v2:172.21.15.134:6808/3565208751,v1:172.21.15.134:6809/3565208751]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-08T05:41:22.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:22 smithi082 ceph-mon[30098]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-08T05:41:22.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:22 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:22.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:22 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:22.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:22 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:41:22.757 DEBUG:teuthology.orchestra.run.smithi134:osd.4> sudo journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@osd.4.service 2024-05-08T05:41:22.759 INFO:tasks.cephadm:Deploying osd.5 on smithi151 with /dev/vg_nvme/lv_3... 2024-05-08T05:41:22.759 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-08T05:41:23.004 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T05:41:23.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:23 smithi151 ceph-mon[34815]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-05-08T05:41:23.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:23 smithi151 ceph-mon[34815]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-08T05:41:23.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:23 smithi151 ceph-mon[34815]: from='osd.4 [v2:172.21.15.134:6808/3565208751,v1:172.21.15.134:6809/3565208751]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-05-08T05:41:23.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:23 smithi151 ceph-mon[34815]: osdmap e30: 5 total, 4 up, 5 in 2024-05-08T05:41:23.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:23 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T05:41:23.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:23 smithi151 ceph-mon[34815]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-05-08T05:41:23.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:23 smithi082 ceph-mon[30098]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-05-08T05:41:23.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:23 smithi082 ceph-mon[30098]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-08T05:41:23.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:23 smithi082 ceph-mon[30098]: from='osd.4 [v2:172.21.15.134:6808/3565208751,v1:172.21.15.134:6809/3565208751]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-05-08T05:41:23.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:23 smithi082 ceph-mon[30098]: osdmap e30: 5 total, 4 up, 5 in 2024-05-08T05:41:23.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:23 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T05:41:23.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:23 smithi082 ceph-mon[30098]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-05-08T05:41:23.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:23 smithi134 ceph-mon[34132]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-05-08T05:41:23.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:23 smithi134 ceph-mon[34132]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-08T05:41:23.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:23 smithi134 ceph-mon[34132]: from='osd.4 [v2:172.21.15.134:6808/3565208751,v1:172.21.15.134:6809/3565208751]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-05-08T05:41:23.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:23 smithi134 ceph-mon[34132]: osdmap e30: 5 total, 4 up, 5 in 2024-05-08T05:41:23.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:23 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T05:41:23.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:23 smithi134 ceph-mon[34132]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-05-08T05:41:23.922 INFO:journalctl@ceph.osd.4.smithi134.stdout:May 08 05:41:23 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-4[45547]: 2024-05-08T05:41:23.564+0000 7f3f33e75700 -1 osd.4 0 waiting for initial osdmap 2024-05-08T05:41:23.922 INFO:journalctl@ceph.osd.4.smithi134.stdout:May 08 05:41:23 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-4[45547]: 2024-05-08T05:41:23.570+0000 7f3f2bc60700 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T05:41:24.174 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:24 smithi134 ceph-mon[34132]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-05-08T05:41:24.174 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:24 smithi134 ceph-mon[34132]: osdmap e31: 5 total, 4 up, 5 in 2024-05-08T05:41:24.175 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:24 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T05:41:24.175 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:24 smithi134 ceph-mon[34132]: from='osd.4 ' entity='osd.4' 2024-05-08T05:41:24.175 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:24 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T05:41:24.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:24 smithi151 ceph-mon[34815]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-05-08T05:41:24.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:24 smithi151 ceph-mon[34815]: osdmap e31: 5 total, 4 up, 5 in 2024-05-08T05:41:24.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:24 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T05:41:24.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:24 smithi151 ceph-mon[34815]: from='osd.4 ' entity='osd.4' 2024-05-08T05:41:24.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:24 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T05:41:24.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:24 smithi082 ceph-mon[30098]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-05-08T05:41:24.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:24 smithi082 ceph-mon[30098]: osdmap e31: 5 total, 4 up, 5 in 2024-05-08T05:41:24.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:24 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T05:41:24.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:24 smithi082 ceph-mon[30098]: from='osd.4 ' entity='osd.4' 2024-05-08T05:41:24.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:24 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T05:41:24.953 INFO:teuthology.orchestra.run.smithi151.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-08T05:41:24.954 INFO:teuthology.orchestra.run.smithi151.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-08T05:41:24.954 INFO:teuthology.orchestra.run.smithi151.stderr: stderr: 10+0 records in 2024-05-08T05:41:24.954 INFO:teuthology.orchestra.run.smithi151.stderr:10+0 records out 2024-05-08T05:41:24.954 INFO:teuthology.orchestra.run.smithi151.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114898 s, 913 MB/s 2024-05-08T05:41:24.954 INFO:teuthology.orchestra.run.smithi151.stderr:--> Zapping successful for: 2024-05-08T05:41:25.537 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi151:vg_nvme/lv_3 2024-05-08T05:41:25.790 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T05:41:25.827 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:25 smithi151 ceph-mon[34815]: purged_snaps scrub starts 2024-05-08T05:41:25.827 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:25 smithi151 ceph-mon[34815]: purged_snaps scrub ok 2024-05-08T05:41:25.827 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:25 smithi151 ceph-mon[34815]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-05-08T05:41:25.827 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:25 smithi151 ceph-mon[34815]: osd.4 [v2:172.21.15.134:6808/3565208751,v1:172.21.15.134:6809/3565208751] boot 2024-05-08T05:41:25.827 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:25 smithi151 ceph-mon[34815]: osdmap e32: 5 total, 5 up, 5 in 2024-05-08T05:41:25.827 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:25 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T05:41:25.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:25 smithi082 ceph-mon[30098]: purged_snaps scrub starts 2024-05-08T05:41:25.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:25 smithi082 ceph-mon[30098]: purged_snaps scrub ok 2024-05-08T05:41:25.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:25 smithi082 ceph-mon[30098]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-05-08T05:41:25.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:25 smithi082 ceph-mon[30098]: osd.4 [v2:172.21.15.134:6808/3565208751,v1:172.21.15.134:6809/3565208751] boot 2024-05-08T05:41:25.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:25 smithi082 ceph-mon[30098]: osdmap e32: 5 total, 5 up, 5 in 2024-05-08T05:41:25.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:25 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T05:41:25.979 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:25 smithi134 ceph-mon[34132]: purged_snaps scrub starts 2024-05-08T05:41:25.979 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:25 smithi134 ceph-mon[34132]: purged_snaps scrub ok 2024-05-08T05:41:25.979 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:25 smithi134 ceph-mon[34132]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 111 MiB used, 358 GiB / 358 GiB avail 2024-05-08T05:41:25.979 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:25 smithi134 ceph-mon[34132]: osd.4 [v2:172.21.15.134:6808/3565208751,v1:172.21.15.134:6809/3565208751] boot 2024-05-08T05:41:25.979 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:25 smithi134 ceph-mon[34132]: osdmap e32: 5 total, 5 up, 5 in 2024-05-08T05:41:25.979 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:25 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-08T05:41:26.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:26 smithi082 ceph-mon[30098]: osdmap e33: 5 total, 5 up, 5 in 2024-05-08T05:41:26.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:26 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:26.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:26 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:26.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:26 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:41:26.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:26 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:41:26.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:26 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:26.722 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:26 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:41:26.722 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:26 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:41:26.722 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:26 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:26.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:26 smithi151 ceph-mon[34815]: osdmap e33: 5 total, 5 up, 5 in 2024-05-08T05:41:26.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:26 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:26.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:26 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:26.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:26 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:41:26.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:26 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:41:26.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:26 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:26.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:26 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:41:26.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:26 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:41:26.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:26 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:27.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:26 smithi134 ceph-mon[34132]: osdmap e33: 5 total, 5 up, 5 in 2024-05-08T05:41:27.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:26 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:27.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:26 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:27.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:26 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:41:27.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:26 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:41:27.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:26 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:27.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:26 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:41:27.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:26 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:41:27.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:26 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:27.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:41:27.415+0000 7fc6902a3700 1 -- 172.21.15.151:0/3341059764 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc688103610 msgr2=0x7fc688103a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:41:27.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:41:27.415+0000 7fc6902a3700 1 --2- 172.21.15.151:0/3341059764 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc688103610 0x7fc688103a70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc67c009990 tx=0x7fc67c009ca0 comp rx=0 tx=0).stop 2024-05-08T05:41:27.417 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:41:27.415+0000 7fc6902a3700 1 -- 172.21.15.151:0/3341059764 shutdown_connections 2024-05-08T05:41:27.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:41:27.415+0000 7fc6902a3700 1 --2- 172.21.15.151:0/3341059764 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc688103fb0 0x7fc68810a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:41:27.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:41:27.415+0000 7fc6902a3700 1 --2- 172.21.15.151:0/3341059764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc688102410 0x7fc688102830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:41:27.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:41:27.415+0000 7fc6902a3700 1 --2- 172.21.15.151:0/3341059764 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc688103610 0x7fc688103a70 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:41:27.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:41:27.415+0000 7fc6902a3700 1 -- 172.21.15.151:0/3341059764 >> 172.21.15.151:0/3341059764 conn(0x7fc6880fd9d0 msgr2=0x7fc6880ffdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:41:27.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:41:27.415+0000 7fc6902a3700 1 -- 172.21.15.151:0/3341059764 shutdown_connections 2024-05-08T05:41:27.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:41:27.415+0000 7fc6902a3700 1 -- 172.21.15.151:0/3341059764 wait complete. 2024-05-08T05:41:27.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:41:27.416+0000 7fc6902a3700 1 Processor -- start 2024-05-08T05:41:27.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:41:27.416+0000 7fc6902a3700 1 -- start start 2024-05-08T05:41:27.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:41:27.416+0000 7fc6902a3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc688102410 0x7fc688106350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:41:27.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:41:27.416+0000 7fc6902a3700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc688103610 0x7fc6881049f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:41:27.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:41:27.416+0000 7fc6902a3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc688103fb0 0x7fc688104f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:41:27.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:41:27.416+0000 7fc6902a3700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc68810df20 con 0x7fc688103610 2024-05-08T05:41:27.418 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:41:27.416+0000 7fc6902a3700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc68810dda0 con 0x7fc688103fb0 2024-05-08T05:41:27.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:41:27.416+0000 7fc6902a3700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc68810e0a0 con 0x7fc688102410 2024-05-08T05:41:27.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:41:27.416+0000 7fc68e03f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc688102410 0x7fc688106350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:41:27.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:41:27.416+0000 7fc68e03f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc688102410 0x7fc688106350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:36394/0 (socket says 172.21.15.151:36394) 2024-05-08T05:41:27.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:41:27.416+0000 7fc68e03f700 1 -- 172.21.15.151:0/345410777 learned_addr learned my addr 172.21.15.151:0/345410777 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-05-08T05:41:27.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:41:27.416+0000 7fc68e840700 1 --2- 172.21.15.151:0/345410777 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc688103fb0 0x7fc688104f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:41:27.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:41:27.416+0000 7fc68e03f700 1 -- 172.21.15.151:0/345410777 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc688103fb0 msgr2=0x7fc688104f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:41:27.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:41:27.416+0000 7fc68e03f700 1 --2- 172.21.15.151:0/345410777 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc688103fb0 0x7fc688104f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:41:27.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:41:27.416+0000 7fc68e03f700 1 -- 172.21.15.151:0/345410777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc688103610 msgr2=0x7fc6881049f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:41:27.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:41:27.416+0000 7fc68e03f700 1 --2- 172.21.15.151:0/345410777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc688103610 0x7fc6881049f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:41:27.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:41:27.416+0000 7fc68e03f700 1 -- 172.21.15.151:0/345410777 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc688105800 con 0x7fc688102410 2024-05-08T05:41:27.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:41:27.416+0000 7fc68e840700 1 --2- 172.21.15.151:0/345410777 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc688103fb0 0x7fc688104f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:41:27.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:41:27.416+0000 7fc68e03f700 1 --2- 172.21.15.151:0/345410777 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc688102410 0x7fc688106350 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc68000b9c0 tx=0x7fc68000bd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:41:27.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:41:27.416+0000 7fc6877fe700 1 -- 172.21.15.151:0/345410777 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc680019070 con 0x7fc688102410 2024-05-08T05:41:27.419 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:41:27.417+0000 7fc6902a3700 1 -- 172.21.15.151:0/345410777 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6881a38c0 con 0x7fc688102410 2024-05-08T05:41:27.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:41:27.417+0000 7fc6877fe700 1 -- 172.21.15.151:0/345410777 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc680014440 con 0x7fc688102410 2024-05-08T05:41:27.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:41:27.417+0000 7fc6877fe700 1 -- 172.21.15.151:0/345410777 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6800125a0 con 0x7fc688102410 2024-05-08T05:41:27.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:41:27.417+0000 7fc6902a3700 1 -- 172.21.15.151:0/345410777 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6881a3dd0 con 0x7fc688102410 2024-05-08T05:41:27.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:41:27.418+0000 7fc6902a3700 1 -- 172.21.15.151:0/345410777 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc68806a190 con 0x7fc688102410 2024-05-08T05:41:27.420 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:41:27.420+0000 7fc6877fe700 1 -- 172.21.15.151:0/345410777 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fc68001c070 con 0x7fc688102410 2024-05-08T05:41:27.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:41:27.420+0000 7fc6877fe700 1 --2- 172.21.15.151:0/345410777 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc6700b2880 0x7fc6700b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:41:27.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:41:27.420+0000 7fc6877fe700 1 -- 172.21.15.151:0/345410777 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 4101+0+0 (secure 0 0 0) 0x7fc6800e0b40 con 0x7fc688102410 2024-05-08T05:41:27.421 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:41:27.421+0000 7fc68d83e700 1 --2- 172.21.15.151:0/345410777 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc6700b2880 0x7fc6700b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:41:27.422 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:41:27.422+0000 7fc68d83e700 1 --2- 172.21.15.151:0/345410777 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc6700b2880 0x7fc6700b4d40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc67c006010 tx=0x7fc67c003860 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:41:27.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:41:27.424+0000 7fc6877fe700 1 -- 172.21.15.151:0/345410777 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc6800a98d0 con 0x7fc688102410 2024-05-08T05:41:27.637 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:41:27.637+0000 7fc6902a3700 1 -- 172.21.15.151:0/345410777 --> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fc68806c330 con 0x7fc6700b2880 2024-05-08T05:41:27.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:27 smithi151 ceph-mon[34815]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:41:27.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:27 smithi151 ceph-mon[34815]: Detected new or changed devices on smithi134 2024-05-08T05:41:27.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:27 smithi151 ceph-mon[34815]: Adjusting osd_memory_target on smithi134 to 8544M 2024-05-08T05:41:27.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:27 smithi082 ceph-mon[30098]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:41:27.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:27 smithi082 ceph-mon[30098]: Detected new or changed devices on smithi134 2024-05-08T05:41:27.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:27 smithi082 ceph-mon[30098]: Adjusting osd_memory_target on smithi134 to 8544M 2024-05-08T05:41:28.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:27 smithi134 ceph-mon[34132]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 141 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:41:28.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:27 smithi134 ceph-mon[34132]: Detected new or changed devices on smithi134 2024-05-08T05:41:28.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:27 smithi134 ceph-mon[34132]: Adjusting osd_memory_target on smithi134 to 8544M 2024-05-08T05:41:28.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:28 smithi151 ceph-mon[34815]: from='client.24244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:41:28.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:28 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:41:28.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:28 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:41:28.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:28 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:41:28.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:28 smithi082 ceph-mon[30098]: from='client.24244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:41:28.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:28 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:41:28.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:28 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:41:28.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:28 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:41:29.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:28 smithi134 ceph-mon[34132]: from='client.24244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:41:29.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:28 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:41:29.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:28 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:41:29.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:28 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:41:29.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:29 smithi151 ceph-mon[34815]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:41:29.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:29 smithi082 ceph-mon[30098]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:41:30.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:29 smithi134 ceph-mon[34132]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:41:30.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:30 smithi151 ceph-mon[34815]: from='client.? 172.21.15.151:0/1970436167' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dacce079-4aad-474e-b747-1ed60c3c71cf"}]: dispatch 2024-05-08T05:41:30.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:30 smithi151 ceph-mon[34815]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dacce079-4aad-474e-b747-1ed60c3c71cf"}]: dispatch 2024-05-08T05:41:30.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:30 smithi151 ceph-mon[34815]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dacce079-4aad-474e-b747-1ed60c3c71cf"}]': finished 2024-05-08T05:41:30.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:30 smithi151 ceph-mon[34815]: osdmap e34: 6 total, 5 up, 6 in 2024-05-08T05:41:30.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:30 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T05:41:30.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:30 smithi082 ceph-mon[30098]: from='client.? 172.21.15.151:0/1970436167' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dacce079-4aad-474e-b747-1ed60c3c71cf"}]: dispatch 2024-05-08T05:41:30.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:30 smithi082 ceph-mon[30098]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dacce079-4aad-474e-b747-1ed60c3c71cf"}]: dispatch 2024-05-08T05:41:30.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:30 smithi082 ceph-mon[30098]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dacce079-4aad-474e-b747-1ed60c3c71cf"}]': finished 2024-05-08T05:41:30.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:30 smithi082 ceph-mon[30098]: osdmap e34: 6 total, 5 up, 6 in 2024-05-08T05:41:30.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:30 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T05:41:31.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:30 smithi134 ceph-mon[34132]: from='client.? 172.21.15.151:0/1970436167' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dacce079-4aad-474e-b747-1ed60c3c71cf"}]: dispatch 2024-05-08T05:41:31.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:30 smithi134 ceph-mon[34132]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dacce079-4aad-474e-b747-1ed60c3c71cf"}]: dispatch 2024-05-08T05:41:31.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:30 smithi134 ceph-mon[34132]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dacce079-4aad-474e-b747-1ed60c3c71cf"}]': finished 2024-05-08T05:41:31.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:30 smithi134 ceph-mon[34132]: osdmap e34: 6 total, 5 up, 6 in 2024-05-08T05:41:31.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:30 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T05:41:31.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:31 smithi151 ceph-mon[34815]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:41:31.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:31 smithi151 ceph-mon[34815]: from='client.? 172.21.15.151:0/4110635995' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:41:31.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:31 smithi082 ceph-mon[30098]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:41:31.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:31 smithi082 ceph-mon[30098]: from='client.? 172.21.15.151:0/4110635995' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:41:32.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:31 smithi134 ceph-mon[34132]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:41:32.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:31 smithi134 ceph-mon[34132]: from='client.? 172.21.15.151:0/4110635995' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:41:33.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:33 smithi151 ceph-mon[34815]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:41:33.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:33 smithi082 ceph-mon[30098]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:41:34.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:33 smithi134 ceph-mon[34132]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:41:35.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:35 smithi151 ceph-mon[34815]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:41:35.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:35 smithi082 ceph-mon[30098]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:41:36.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:35 smithi134 ceph-mon[34132]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:41:37.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:37 smithi082 ceph-mon[30098]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:41:38.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:37 smithi134 ceph-mon[34132]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:41:38.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:37 smithi151 ceph-mon[34815]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:41:38.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:38 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-08T05:41:38.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:38 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:41:38.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:38 smithi082 ceph-mon[30098]: Deploying daemon osd.5 on smithi151 2024-05-08T05:41:38.996 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:38 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-08T05:41:38.996 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:38 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:41:38.996 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:38 smithi151 ceph-mon[34815]: Deploying daemon osd.5 on smithi151 2024-05-08T05:41:39.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:38 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-08T05:41:39.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:38 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:41:39.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:38 smithi134 ceph-mon[34132]: Deploying daemon osd.5 on smithi151 2024-05-08T05:41:39.833 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:39 smithi151 ceph-mon[34815]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:41:39.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:39 smithi082 ceph-mon[30098]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:41:40.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:39 smithi134 ceph-mon[34132]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:41:41.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:41 smithi151 ceph-mon[34815]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:41:41.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:41 smithi082 ceph-mon[30098]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:41:42.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:41 smithi134 ceph-mon[34132]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:41:43.766 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:43 smithi151 ceph-mon[34815]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:41:43.766 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:43 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:43.766 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:43 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:41:43.766 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:43 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:43.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:43 smithi082 ceph-mon[30098]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:41:43.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:43 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:43.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:43 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:41:43.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:43 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:44.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:43 smithi134 ceph-mon[34132]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:41:44.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:43 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:44.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:43 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:41:44.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:43 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:45.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:45 smithi082 ceph-mon[30098]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:41:46.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:45 smithi134 ceph-mon[34132]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:41:46.091 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:45 smithi151 ceph-mon[34815]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:41:46.820 INFO:teuthology.orchestra.run.smithi151.stdout:Created osd(s) 5 on host 'smithi151' 2024-05-08T05:41:46.820 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:41:46.819+0000 7fc6877fe700 1 -- 172.21.15.151:0/345410777 <== mgr.14152 v2:172.21.15.82:6800/4089180091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc68806c330 con 0x7fc6700b2880 2024-05-08T05:41:46.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:41:46.821+0000 7fc6902a3700 1 -- 172.21.15.151:0/345410777 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc6700b2880 msgr2=0x7fc6700b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:41:46.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:41:46.821+0000 7fc6902a3700 1 --2- 172.21.15.151:0/345410777 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc6700b2880 0x7fc6700b4d40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc67c006010 tx=0x7fc67c003860 comp rx=0 tx=0).stop 2024-05-08T05:41:46.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:41:46.822+0000 7fc6902a3700 1 -- 172.21.15.151:0/345410777 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc688102410 msgr2=0x7fc688106350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:41:46.822 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:41:46.822+0000 7fc6902a3700 1 --2- 172.21.15.151:0/345410777 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc688102410 0x7fc688106350 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc68000b9c0 tx=0x7fc68000bd80 comp rx=0 tx=0).stop 2024-05-08T05:41:46.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:41:46.822+0000 7fc6902a3700 1 -- 172.21.15.151:0/345410777 shutdown_connections 2024-05-08T05:41:46.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:41:46.822+0000 7fc6902a3700 1 --2- 172.21.15.151:0/345410777 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc688103fb0 0x7fc688104f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:41:46.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:41:46.822+0000 7fc6902a3700 1 --2- 172.21.15.151:0/345410777 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc6700b2880 0x7fc6700b4d40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:41:46.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:41:46.822+0000 7fc6902a3700 1 --2- 172.21.15.151:0/345410777 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc688102410 0x7fc688106350 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:41:46.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:41:46.822+0000 7fc6902a3700 1 --2- 172.21.15.151:0/345410777 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc688103610 0x7fc6881049f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:41:46.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:41:46.822+0000 7fc6902a3700 1 -- 172.21.15.151:0/345410777 >> 172.21.15.151:0/345410777 conn(0x7fc6880fd9d0 msgr2=0x7fc68806bc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:41:46.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:41:46.822+0000 7fc6902a3700 1 -- 172.21.15.151:0/345410777 shutdown_connections 2024-05-08T05:41:46.823 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:41:46.822+0000 7fc6902a3700 1 -- 172.21.15.151:0/345410777 wait complete. 2024-05-08T05:41:47.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:46 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:47.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:46 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:47.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:46 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:41:47.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:46 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:41:47.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:46 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:47.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:46 smithi151 ceph-mon[34815]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:41:47.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:46 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:47.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:46 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:41:47.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:46 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:47.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:46 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:47.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:46 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:47.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:46 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:41:47.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:46 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:41:47.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:46 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:47.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:46 smithi082 ceph-mon[30098]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:41:47.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:46 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:47.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:46 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:41:47.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:46 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:47.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:46 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:47.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:46 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:47.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:46 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:41:47.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:46 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:41:47.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:46 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:47.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:46 smithi134 ceph-mon[34132]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:41:47.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:46 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:47.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:46 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:41:47.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:46 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:47.471 DEBUG:teuthology.orchestra.run.smithi151:osd.5> sudo journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@osd.5.service 2024-05-08T05:41:47.474 INFO:tasks.cephadm:Deploying osd.6 on smithi082 with /dev/vg_nvme/lv_2... 2024-05-08T05:41:47.474 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-08T05:41:47.890 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:41:48.015 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:47 smithi151 ceph-mon[34815]: from='osd.5 [v2:172.21.15.151:6808/1925634069,v1:172.21.15.151:6809/1925634069]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-08T05:41:48.016 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:47 smithi151 ceph-mon[34815]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-08T05:41:48.205 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:47 smithi082 ceph-mon[30098]: from='osd.5 [v2:172.21.15.151:6808/1925634069,v1:172.21.15.151:6809/1925634069]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-08T05:41:48.205 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:47 smithi082 ceph-mon[30098]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-08T05:41:48.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:47 smithi134 ceph-mon[34132]: from='osd.5 [v2:172.21.15.151:6808/1925634069,v1:172.21.15.151:6809/1925634069]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-08T05:41:48.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:47 smithi134 ceph-mon[34132]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-08T05:41:48.963 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:48 smithi151 ceph-mon[34815]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-08T05:41:48.963 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:48 smithi151 ceph-mon[34815]: from='osd.5 [v2:172.21.15.151:6808/1925634069,v1:172.21.15.151:6809/1925634069]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-05-08T05:41:48.963 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:48 smithi151 ceph-mon[34815]: osdmap e35: 6 total, 5 up, 6 in 2024-05-08T05:41:48.963 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:48 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T05:41:48.963 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:48 smithi151 ceph-mon[34815]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-05-08T05:41:48.963 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:48 smithi151 ceph-mon[34815]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:41:48.964 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 08 05:41:48 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-5[46993]: 2024-05-08T05:41:48.954+0000 7f5a968ab700 -1 osd.5 0 waiting for initial osdmap 2024-05-08T05:41:48.964 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 08 05:41:48 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-5[46993]: 2024-05-08T05:41:48.962+0000 7f5a9269e700 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T05:41:49.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:48 smithi082 ceph-mon[30098]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-08T05:41:49.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:48 smithi082 ceph-mon[30098]: from='osd.5 [v2:172.21.15.151:6808/1925634069,v1:172.21.15.151:6809/1925634069]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-05-08T05:41:49.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:48 smithi082 ceph-mon[30098]: osdmap e35: 6 total, 5 up, 6 in 2024-05-08T05:41:49.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:48 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T05:41:49.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:48 smithi082 ceph-mon[30098]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-05-08T05:41:49.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:48 smithi082 ceph-mon[30098]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:41:49.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:48 smithi134 ceph-mon[34132]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-08T05:41:49.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:48 smithi134 ceph-mon[34132]: from='osd.5 [v2:172.21.15.151:6808/1925634069,v1:172.21.15.151:6809/1925634069]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-05-08T05:41:49.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:48 smithi134 ceph-mon[34132]: osdmap e35: 6 total, 5 up, 6 in 2024-05-08T05:41:49.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:48 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T05:41:49.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:48 smithi134 ceph-mon[34132]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-05-08T05:41:49.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:48 smithi134 ceph-mon[34132]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 142 MiB used, 447 GiB / 447 GiB avail 2024-05-08T05:41:50.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:49 smithi151 ceph-mon[34815]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2024-05-08T05:41:50.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:49 smithi151 ceph-mon[34815]: osdmap e36: 6 total, 5 up, 6 in 2024-05-08T05:41:50.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:49 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T05:41:50.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:49 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T05:41:50.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:49 smithi151 ceph-mon[34815]: osd.5 [v2:172.21.15.151:6808/1925634069,v1:172.21.15.151:6809/1925634069] boot 2024-05-08T05:41:50.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:49 smithi151 ceph-mon[34815]: osdmap e37: 6 total, 6 up, 6 in 2024-05-08T05:41:50.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:49 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T05:41:50.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:49 smithi082 ceph-mon[30098]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2024-05-08T05:41:50.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:49 smithi082 ceph-mon[30098]: osdmap e36: 6 total, 5 up, 6 in 2024-05-08T05:41:50.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:49 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T05:41:50.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:49 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T05:41:50.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:49 smithi082 ceph-mon[30098]: osd.5 [v2:172.21.15.151:6808/1925634069,v1:172.21.15.151:6809/1925634069] boot 2024-05-08T05:41:50.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:49 smithi082 ceph-mon[30098]: osdmap e37: 6 total, 6 up, 6 in 2024-05-08T05:41:50.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:49 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T05:41:50.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:49 smithi134 ceph-mon[34132]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2024-05-08T05:41:50.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:49 smithi134 ceph-mon[34132]: osdmap e36: 6 total, 5 up, 6 in 2024-05-08T05:41:50.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:49 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T05:41:50.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:49 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T05:41:50.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:49 smithi134 ceph-mon[34132]: osd.5 [v2:172.21.15.151:6808/1925634069,v1:172.21.15.151:6809/1925634069] boot 2024-05-08T05:41:50.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:49 smithi134 ceph-mon[34132]: osdmap e37: 6 total, 6 up, 6 in 2024-05-08T05:41:50.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:49 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-08T05:41:50.751 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-08T05:41:50.751 INFO:teuthology.orchestra.run.smithi082.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-08T05:41:50.751 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10+0 records in 2024-05-08T05:41:50.751 INFO:teuthology.orchestra.run.smithi082.stderr:10+0 records out 2024-05-08T05:41:50.751 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0332886 s, 315 MB/s 2024-05-08T05:41:50.751 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping successful for: 2024-05-08T05:41:51.141 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:50 smithi082 ceph-mon[30098]: purged_snaps scrub starts 2024-05-08T05:41:51.141 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:50 smithi082 ceph-mon[30098]: purged_snaps scrub ok 2024-05-08T05:41:51.141 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:50 smithi082 ceph-mon[30098]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:41:51.141 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:50 smithi082 ceph-mon[30098]: Detected new or changed devices on smithi151 2024-05-08T05:41:51.141 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:50 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:51.141 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:50 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:51.141 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:50 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:41:51.141 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:50 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:41:51.141 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:50 smithi082 ceph-mon[30098]: Adjusting osd_memory_target on smithi151 to 8544M 2024-05-08T05:41:51.141 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:50 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:51.141 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:50 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:41:51.142 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:50 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:41:51.142 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:50 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:51.142 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:50 smithi082 ceph-mon[30098]: osdmap e38: 6 total, 6 up, 6 in 2024-05-08T05:41:51.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:50 smithi134 ceph-mon[34132]: purged_snaps scrub starts 2024-05-08T05:41:51.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:50 smithi134 ceph-mon[34132]: purged_snaps scrub ok 2024-05-08T05:41:51.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:50 smithi134 ceph-mon[34132]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:41:51.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:50 smithi134 ceph-mon[34132]: Detected new or changed devices on smithi151 2024-05-08T05:41:51.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:50 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:51.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:50 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:51.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:50 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:41:51.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:50 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:41:51.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:50 smithi134 ceph-mon[34132]: Adjusting osd_memory_target on smithi151 to 8544M 2024-05-08T05:41:51.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:50 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:51.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:50 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:41:51.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:50 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:41:51.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:50 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:51.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:50 smithi134 ceph-mon[34132]: osdmap e38: 6 total, 6 up, 6 in 2024-05-08T05:41:51.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:50 smithi151 ceph-mon[34815]: purged_snaps scrub starts 2024-05-08T05:41:51.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:50 smithi151 ceph-mon[34815]: purged_snaps scrub ok 2024-05-08T05:41:51.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:50 smithi151 ceph-mon[34815]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:41:51.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:50 smithi151 ceph-mon[34815]: Detected new or changed devices on smithi151 2024-05-08T05:41:51.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:50 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:51.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:50 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:51.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:50 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:41:51.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:50 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:41:51.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:50 smithi151 ceph-mon[34815]: Adjusting osd_memory_target on smithi151 to 8544M 2024-05-08T05:41:51.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:50 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:51.381 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:50 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:41:51.381 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:50 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:41:51.381 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:50 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:41:51.381 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:50 smithi151 ceph-mon[34815]: osdmap e38: 6 total, 6 up, 6 in 2024-05-08T05:41:51.737 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi082:vg_nvme/lv_2 2024-05-08T05:41:52.173 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:41:52.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:52 smithi151 ceph-mon[34815]: osdmap e39: 6 total, 6 up, 6 in 2024-05-08T05:41:52.974 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:52 smithi082 ceph-mon[30098]: osdmap e39: 6 total, 6 up, 6 in 2024-05-08T05:41:53.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:52 smithi134 ceph-mon[34132]: osdmap e39: 6 total, 6 up, 6 in 2024-05-08T05:41:53.791 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:53 smithi082 ceph-mon[30098]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:41:53.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:53 smithi151 ceph-mon[34815]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:41:54.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:53 smithi134 ceph-mon[34132]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 168 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:41:54.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:41:54.299+0000 7f44e9600700 1 -- 172.21.15.82:0/888144867 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44e41071e0 msgr2=0x7f44e410da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:41:54.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:41:54.299+0000 7f44e9600700 1 --2- 172.21.15.82:0/888144867 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44e41071e0 0x7f44e410da90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f44dc009f90 tx=0x7f44dc00b330 comp rx=0 tx=0).stop 2024-05-08T05:41:54.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:41:54.300+0000 7f44e9600700 1 -- 172.21.15.82:0/888144867 shutdown_connections 2024-05-08T05:41:54.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:41:54.300+0000 7f44e9600700 1 --2- 172.21.15.82:0/888144867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44e4105640 0x7f44e4105a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:41:54.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:41:54.300+0000 7f44e9600700 1 --2- 172.21.15.82:0/888144867 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44e41071e0 0x7f44e410da90 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:41:54.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:41:54.300+0000 7f44e9600700 1 --2- 172.21.15.82:0/888144867 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e4106840 0x7f44e4106ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:41:54.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:41:54.300+0000 7f44e9600700 1 -- 172.21.15.82:0/888144867 >> 172.21.15.82:0/888144867 conn(0x7f44e4100be0 msgr2=0x7f44e4103020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:41:54.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:41:54.300+0000 7f44e9600700 1 -- 172.21.15.82:0/888144867 shutdown_connections 2024-05-08T05:41:54.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:41:54.300+0000 7f44e9600700 1 -- 172.21.15.82:0/888144867 wait complete. 2024-05-08T05:41:54.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:41:54.301+0000 7f44e9600700 1 Processor -- start 2024-05-08T05:41:54.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:41:54.301+0000 7f44e9600700 1 -- start start 2024-05-08T05:41:54.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:41:54.301+0000 7f44e9600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e4105640 0x7f44e419b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:41:54.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:41:54.301+0000 7f44e9600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44e4106840 0x7f44e419bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:41:54.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:41:54.301+0000 7f44e9600700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44e41071e0 0x7f44e41a2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:41:54.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:41:54.301+0000 7f44e9600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f44e41110d0 con 0x7f44e4105640 2024-05-08T05:41:54.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:41:54.302+0000 7f44e9600700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f44e4110f50 con 0x7f44e4106840 2024-05-08T05:41:54.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:41:54.302+0000 7f44e9600700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f44e4111250 con 0x7f44e41071e0 2024-05-08T05:41:54.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:41:54.302+0000 7f44e3e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e4105640 0x7f44e419b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:41:54.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:41:54.302+0000 7f44e3e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e4105640 0x7f44e419b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45912/0 (socket says 172.21.15.82:45912) 2024-05-08T05:41:54.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:41:54.302+0000 7f44e3e00700 1 -- 172.21.15.82:0/1256174929 learned_addr learned my addr 172.21.15.82:0/1256174929 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:41:54.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:41:54.302+0000 7f44e3400700 1 --2- 172.21.15.82:0/1256174929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44e4106840 0x7f44e419bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:41:54.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:41:54.302+0000 7f44e8c00700 1 --2- 172.21.15.82:0/1256174929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44e41071e0 0x7f44e41a2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:41:54.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:41:54.302+0000 7f44e3e00700 1 -- 172.21.15.82:0/1256174929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44e41071e0 msgr2=0x7f44e41a2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:41:54.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:41:54.302+0000 7f44e3e00700 1 --2- 172.21.15.82:0/1256174929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44e41071e0 0x7f44e41a2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:41:54.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:41:54.302+0000 7f44e3e00700 1 -- 172.21.15.82:0/1256174929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44e4106840 msgr2=0x7f44e419bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:41:54.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:41:54.302+0000 7f44e3e00700 1 --2- 172.21.15.82:0/1256174929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44e4106840 0x7f44e419bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:41:54.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:41:54.302+0000 7f44e3e00700 1 -- 172.21.15.82:0/1256174929 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44e41a3320 con 0x7f44e4105640 2024-05-08T05:41:54.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:41:54.302+0000 7f44e8c00700 1 --2- 172.21.15.82:0/1256174929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44e41071e0 0x7f44e41a2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:41:54.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:41:54.303+0000 7f44e3e00700 1 --2- 172.21.15.82:0/1256174929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e4105640 0x7f44e419b6c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f44d400ea20 tx=0x7f44d400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:41:54.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:41:54.303+0000 7f44e0c00700 1 -- 172.21.15.82:0/1256174929 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d400cbd0 con 0x7f44e4105640 2024-05-08T05:41:54.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:41:54.303+0000 7f44e0c00700 1 -- 172.21.15.82:0/1256174929 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44d400ee50 con 0x7f44e4105640 2024-05-08T05:41:54.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:41:54.303+0000 7f44e9600700 1 -- 172.21.15.82:0/1256174929 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44e41a3610 con 0x7f44e4105640 2024-05-08T05:41:54.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:41:54.303+0000 7f44e0c00700 1 -- 172.21.15.82:0/1256174929 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44d4003d40 con 0x7f44e4105640 2024-05-08T05:41:54.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:41:54.303+0000 7f44e9600700 1 -- 172.21.15.82:0/1256174929 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44e41a3b00 con 0x7f44e4105640 2024-05-08T05:41:54.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:41:54.304+0000 7f44e9600700 1 -- 172.21.15.82:0/1256174929 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44e406a190 con 0x7f44e4105640 2024-05-08T05:41:54.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:41:54.307+0000 7f44e0c00700 1 -- 172.21.15.82:0/1256174929 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f44d4003ee0 con 0x7f44e4105640 2024-05-08T05:41:54.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:41:54.308+0000 7f44e0c00700 1 --2- 172.21.15.82:0/1256174929 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f44c80b2900 0x7f44c80b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:41:54.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:41:54.309+0000 7f44e0c00700 1 -- 172.21.15.82:0/1256174929 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4533+0+0 (secure 0 0 0) 0x7f44d40e1710 con 0x7f44e4105640 2024-05-08T05:41:54.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:41:54.309+0000 7f44e3400700 1 --2- 172.21.15.82:0/1256174929 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f44c80b2900 0x7f44c80b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:41:54.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:41:54.310+0000 7f44e3400700 1 --2- 172.21.15.82:0/1256174929 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f44c80b2900 0x7f44c80b4dc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f44d0009c60 tx=0x7f44d0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:41:54.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:41:54.311+0000 7f44e0c00700 1 -- 172.21.15.82:0/1256174929 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f44d40aa250 con 0x7f44e4105640 2024-05-08T05:41:54.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:41:54.555+0000 7f44e9600700 1 -- 172.21.15.82:0/1256174929 --> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f44e40638e0 con 0x7f44c80b2900 2024-05-08T05:41:54.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:54 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:41:54.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:54 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:41:54.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:54 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:41:54.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:54 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:41:54.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:54 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:41:54.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:54 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:41:55.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:54 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:41:55.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:54 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:41:55.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:54 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:41:55.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:55 smithi082 ceph-mon[30098]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 114 KiB/s, 0 objects/s recovering 2024-05-08T05:41:55.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:55 smithi082 ceph-mon[30098]: from='client.14277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:41:56.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:55 smithi134 ceph-mon[34132]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 114 KiB/s, 0 objects/s recovering 2024-05-08T05:41:56.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:55 smithi134 ceph-mon[34132]: from='client.14277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:41:56.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:55 smithi151 ceph-mon[34815]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 114 KiB/s, 0 objects/s recovering 2024-05-08T05:41:56.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:55 smithi151 ceph-mon[34815]: from='client.14277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:41:57.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:57 smithi082 ceph-mon[30098]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-05-08T05:41:58.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:57 smithi134 ceph-mon[34132]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-05-08T05:41:58.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:57 smithi151 ceph-mon[34815]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-05-08T05:41:58.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:58 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/532428335' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6a445bf4-09c4-4e9b-be6e-68ef3c05b365"}]: dispatch 2024-05-08T05:41:58.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:58 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/532428335' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6a445bf4-09c4-4e9b-be6e-68ef3c05b365"}]': finished 2024-05-08T05:41:59.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:58 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/532428335' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6a445bf4-09c4-4e9b-be6e-68ef3c05b365"}]: dispatch 2024-05-08T05:41:59.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:58 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/532428335' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6a445bf4-09c4-4e9b-be6e-68ef3c05b365"}]': finished 2024-05-08T05:41:59.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:58 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/532428335' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6a445bf4-09c4-4e9b-be6e-68ef3c05b365"}]: dispatch 2024-05-08T05:41:59.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:58 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/532428335' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6a445bf4-09c4-4e9b-be6e-68ef3c05b365"}]': finished 2024-05-08T05:41:59.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:59 smithi082 ceph-mon[30098]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-08T05:41:59.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:59 smithi082 ceph-mon[30098]: osdmap e40: 7 total, 6 up, 7 in 2024-05-08T05:41:59.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:59 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T05:41:59.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:41:59 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/1209150555' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:42:00.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:59 smithi134 ceph-mon[34132]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-08T05:42:00.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:59 smithi134 ceph-mon[34132]: osdmap e40: 7 total, 6 up, 7 in 2024-05-08T05:42:00.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:59 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T05:42:00.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:41:59 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/1209150555' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:42:00.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:59 smithi151 ceph-mon[34815]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-08T05:42:00.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:59 smithi151 ceph-mon[34815]: osdmap e40: 7 total, 6 up, 7 in 2024-05-08T05:42:00.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:59 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T05:42:00.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:41:59 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/1209150555' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:42:01.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:01 smithi082 ceph-mon[30098]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-05-08T05:42:02.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:01 smithi134 ceph-mon[34132]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-05-08T05:42:02.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:01 smithi151 ceph-mon[34815]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-05-08T05:42:03.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:03 smithi082 ceph-mon[30098]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T05:42:04.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:03 smithi134 ceph-mon[34132]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T05:42:04.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:03 smithi151 ceph-mon[34815]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T05:42:05.783 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:05 smithi082 ceph-mon[30098]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:42:06.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:05 smithi134 ceph-mon[34132]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:42:06.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:05 smithi151 ceph-mon[34815]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:42:07.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:07 smithi082 ceph-mon[30098]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:42:08.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:07 smithi134 ceph-mon[34132]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:42:08.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:07 smithi151 ceph-mon[34815]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:42:08.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:08 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-08T05:42:08.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:08 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:42:08.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:08 smithi082 ceph-mon[30098]: Deploying daemon osd.6 on smithi082 2024-05-08T05:42:09.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:08 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-08T05:42:09.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:08 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:42:09.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:08 smithi134 ceph-mon[34132]: Deploying daemon osd.6 on smithi082 2024-05-08T05:42:09.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:08 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-08T05:42:09.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:08 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:42:09.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:08 smithi151 ceph-mon[34815]: Deploying daemon osd.6 on smithi082 2024-05-08T05:42:09.924 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:09 smithi082 ceph-mon[30098]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:42:10.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:09 smithi134 ceph-mon[34132]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:42:10.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:09 smithi151 ceph-mon[34815]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:42:11.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:11 smithi082 ceph-mon[30098]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:42:12.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:11 smithi134 ceph-mon[34132]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:42:12.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:11 smithi151 ceph-mon[34815]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:42:13.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:13 smithi082 ceph-mon[30098]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:42:14.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:13 smithi134 ceph-mon[34132]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:42:14.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:13 smithi151 ceph-mon[34815]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:42:15.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:15 smithi082 ceph-mon[30098]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:42:16.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:15 smithi134 ceph-mon[34132]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:42:16.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:15 smithi151 ceph-mon[34815]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:42:17.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:17 smithi082 ceph-mon[30098]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:42:17.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:17 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:17.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:17 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:17.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:17 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:42:17.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:17 smithi134 ceph-mon[34132]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:42:17.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:17 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:17.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:17 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:17.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:17 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:42:17.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:17 smithi151 ceph-mon[34815]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:42:17.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:17 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:17.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:17 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:17.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:17 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:42:19.504 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:19 smithi082 ceph-mon[30098]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:42:19.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:19 smithi151 ceph-mon[34815]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:42:19.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:19 smithi134 ceph-mon[34132]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:42:21.179 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:21 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:21.180 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:21 smithi082 ceph-mon[30098]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:42:21.180 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:21 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:21.180 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:21 smithi082 ceph-mon[30098]: from='osd.6 [v2:172.21.15.82:6818/762647976,v1:172.21.15.82:6819/762647976]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-08T05:42:21.250 INFO:teuthology.orchestra.run.smithi082.stdout:Created osd(s) 6 on host 'smithi082' 2024-05-08T05:42:21.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:42:21.248+0000 7f44e0c00700 1 -- 172.21.15.82:0/1256174929 <== mgr.14152 v2:172.21.15.82:6800/4089180091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f44e40638e0 con 0x7f44c80b2900 2024-05-08T05:42:21.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:42:21.252+0000 7f44e9600700 1 -- 172.21.15.82:0/1256174929 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f44c80b2900 msgr2=0x7f44c80b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:42:21.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:42:21.252+0000 7f44e9600700 1 --2- 172.21.15.82:0/1256174929 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f44c80b2900 0x7f44c80b4dc0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f44d0009c60 tx=0x7f44d0009260 comp rx=0 tx=0).stop 2024-05-08T05:42:21.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:42:21.252+0000 7f44e9600700 1 -- 172.21.15.82:0/1256174929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e4105640 msgr2=0x7f44e419b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:42:21.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:42:21.252+0000 7f44e9600700 1 --2- 172.21.15.82:0/1256174929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e4105640 0x7f44e419b6c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f44d400ea20 tx=0x7f44d400ed30 comp rx=0 tx=0).stop 2024-05-08T05:42:21.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:42:21.252+0000 7f44e9600700 1 -- 172.21.15.82:0/1256174929 shutdown_connections 2024-05-08T05:42:21.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:42:21.252+0000 7f44e9600700 1 --2- 172.21.15.82:0/1256174929 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f44c80b2900 0x7f44c80b4dc0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:42:21.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:42:21.252+0000 7f44e9600700 1 --2- 172.21.15.82:0/1256174929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44e41071e0 0x7f44e41a2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:42:21.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:42:21.252+0000 7f44e9600700 1 --2- 172.21.15.82:0/1256174929 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44e4105640 0x7f44e419b6c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:42:21.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:42:21.252+0000 7f44e9600700 1 --2- 172.21.15.82:0/1256174929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44e4106840 0x7f44e419bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:42:21.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:42:21.252+0000 7f44e9600700 1 -- 172.21.15.82:0/1256174929 >> 172.21.15.82:0/1256174929 conn(0x7f44e4100be0 msgr2=0x7f44e4109b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:42:21.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:42:21.252+0000 7f44e9600700 1 -- 172.21.15.82:0/1256174929 shutdown_connections 2024-05-08T05:42:21.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:42:21.252+0000 7f44e9600700 1 -- 172.21.15.82:0/1256174929 wait complete. 2024-05-08T05:42:21.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:21 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:21.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:21 smithi151 ceph-mon[34815]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:42:21.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:21 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:21.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:21 smithi151 ceph-mon[34815]: from='osd.6 [v2:172.21.15.82:6818/762647976,v1:172.21.15.82:6819/762647976]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-08T05:42:21.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:21 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:21.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:21 smithi134 ceph-mon[34132]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:42:21.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:21 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:21.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:21 smithi134 ceph-mon[34132]: from='osd.6 [v2:172.21.15.82:6818/762647976,v1:172.21.15.82:6819/762647976]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-08T05:42:22.005 DEBUG:teuthology.orchestra.run.smithi082:osd.6> sudo journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@osd.6.service 2024-05-08T05:42:22.010 INFO:tasks.cephadm:Deploying osd.7 on smithi134 with /dev/vg_nvme/lv_2... 2024-05-08T05:42:22.011 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-08T05:42:22.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:22 smithi082 ceph-mon[30098]: from='osd.6 [v2:172.21.15.82:6818/762647976,v1:172.21.15.82:6819/762647976]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-08T05:42:22.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:22 smithi082 ceph-mon[30098]: osdmap e41: 7 total, 6 up, 7 in 2024-05-08T05:42:22.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:22 smithi082 ceph-mon[30098]: from='osd.6 [v2:172.21.15.82:6818/762647976,v1:172.21.15.82:6819/762647976]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-05-08T05:42:22.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:22 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T05:42:22.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:22 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:42:22.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:22 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:42:22.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:22 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:22.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:22 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:22.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:22 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:22.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:22 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:42:22.257 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T05:42:22.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:22 smithi151 ceph-mon[34815]: from='osd.6 [v2:172.21.15.82:6818/762647976,v1:172.21.15.82:6819/762647976]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-08T05:42:22.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:22 smithi151 ceph-mon[34815]: osdmap e41: 7 total, 6 up, 7 in 2024-05-08T05:42:22.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:22 smithi151 ceph-mon[34815]: from='osd.6 [v2:172.21.15.82:6818/762647976,v1:172.21.15.82:6819/762647976]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-05-08T05:42:22.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:22 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T05:42:22.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:22 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:42:22.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:22 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:42:22.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:22 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:22.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:22 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:22.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:22 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:22.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:22 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:42:22.381 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:22 smithi134 ceph-mon[34132]: from='osd.6 [v2:172.21.15.82:6818/762647976,v1:172.21.15.82:6819/762647976]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-08T05:42:22.381 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:22 smithi134 ceph-mon[34132]: osdmap e41: 7 total, 6 up, 7 in 2024-05-08T05:42:22.381 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:22 smithi134 ceph-mon[34132]: from='osd.6 [v2:172.21.15.82:6818/762647976,v1:172.21.15.82:6819/762647976]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-05-08T05:42:22.381 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:22 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T05:42:22.381 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:22 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:42:22.381 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:22 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:42:22.381 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:22 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:22.381 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:22 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:22.381 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:22 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:22.381 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:22 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:42:22.664 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 05:42:22 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T05:42:22.624+0000 7fe6a2200700 -1 osd.6 0 waiting for initial osdmap 2024-05-08T05:42:22.664 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 05:42:22 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T05:42:22.662+0000 7fe698000700 -1 osd.6 42 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T05:42:23.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:23 smithi151 ceph-mon[34815]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:42:23.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:23 smithi151 ceph-mon[34815]: from='osd.6 [v2:172.21.15.82:6818/762647976,v1:172.21.15.82:6819/762647976]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-05-08T05:42:23.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:23 smithi151 ceph-mon[34815]: osdmap e42: 7 total, 6 up, 7 in 2024-05-08T05:42:23.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:23 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T05:42:23.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:23 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T05:42:23.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:23 smithi151 ceph-mon[34815]: from='osd.6 [v2:172.21.15.82:6818/762647976,v1:172.21.15.82:6819/762647976]' entity='osd.6' 2024-05-08T05:42:23.382 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:23 smithi134 ceph-mon[34132]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:42:23.382 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:23 smithi134 ceph-mon[34132]: from='osd.6 [v2:172.21.15.82:6818/762647976,v1:172.21.15.82:6819/762647976]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-05-08T05:42:23.383 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:23 smithi134 ceph-mon[34132]: osdmap e42: 7 total, 6 up, 7 in 2024-05-08T05:42:23.383 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:23 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T05:42:23.383 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:23 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T05:42:23.383 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:23 smithi134 ceph-mon[34132]: from='osd.6 [v2:172.21.15.82:6818/762647976,v1:172.21.15.82:6819/762647976]' entity='osd.6' 2024-05-08T05:42:23.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:23 smithi082 ceph-mon[30098]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:42:23.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:23 smithi082 ceph-mon[30098]: from='osd.6 [v2:172.21.15.82:6818/762647976,v1:172.21.15.82:6819/762647976]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-05-08T05:42:23.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:23 smithi082 ceph-mon[30098]: osdmap e42: 7 total, 6 up, 7 in 2024-05-08T05:42:23.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:23 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T05:42:23.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:23 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T05:42:23.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:23 smithi082 ceph-mon[30098]: from='osd.6 [v2:172.21.15.82:6818/762647976,v1:172.21.15.82:6819/762647976]' entity='osd.6' 2024-05-08T05:42:24.197 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:24 smithi082 ceph-mon[30098]: purged_snaps scrub starts 2024-05-08T05:42:24.198 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:24 smithi082 ceph-mon[30098]: purged_snaps scrub ok 2024-05-08T05:42:24.198 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:24 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T05:42:24.198 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:24 smithi082 ceph-mon[30098]: osd.6 [v2:172.21.15.82:6818/762647976,v1:172.21.15.82:6819/762647976] boot 2024-05-08T05:42:24.198 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:24 smithi082 ceph-mon[30098]: osdmap e43: 7 total, 7 up, 7 in 2024-05-08T05:42:24.198 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:24 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T05:42:24.231 INFO:teuthology.orchestra.run.smithi134.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-08T05:42:24.231 INFO:teuthology.orchestra.run.smithi134.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-08T05:42:24.231 INFO:teuthology.orchestra.run.smithi134.stderr: stderr: 10+0 records in 2024-05-08T05:42:24.231 INFO:teuthology.orchestra.run.smithi134.stderr:10+0 records out 2024-05-08T05:42:24.231 INFO:teuthology.orchestra.run.smithi134.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0113224 s, 926 MB/s 2024-05-08T05:42:24.231 INFO:teuthology.orchestra.run.smithi134.stderr:--> Zapping successful for: 2024-05-08T05:42:24.255 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:24 smithi134 ceph-mon[34132]: purged_snaps scrub starts 2024-05-08T05:42:24.255 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:24 smithi134 ceph-mon[34132]: purged_snaps scrub ok 2024-05-08T05:42:24.255 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:24 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T05:42:24.255 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:24 smithi134 ceph-mon[34132]: osd.6 [v2:172.21.15.82:6818/762647976,v1:172.21.15.82:6819/762647976] boot 2024-05-08T05:42:24.255 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:24 smithi134 ceph-mon[34132]: osdmap e43: 7 total, 7 up, 7 in 2024-05-08T05:42:24.256 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:24 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T05:42:24.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:24 smithi151 ceph-mon[34815]: purged_snaps scrub starts 2024-05-08T05:42:24.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:24 smithi151 ceph-mon[34815]: purged_snaps scrub ok 2024-05-08T05:42:24.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:24 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T05:42:24.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:24 smithi151 ceph-mon[34815]: osd.6 [v2:172.21.15.82:6818/762647976,v1:172.21.15.82:6819/762647976] boot 2024-05-08T05:42:24.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:24 smithi151 ceph-mon[34815]: osdmap e43: 7 total, 7 up, 7 in 2024-05-08T05:42:24.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:24 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-08T05:42:24.967 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi134:vg_nvme/lv_2 2024-05-08T05:42:25.203 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T05:42:25.967 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:25 smithi082 ceph-mon[30098]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:42:25.967 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:25 smithi082 ceph-mon[30098]: osdmap e44: 7 total, 7 up, 7 in 2024-05-08T05:42:26.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:25 smithi134 ceph-mon[34132]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:42:26.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:25 smithi134 ceph-mon[34132]: osdmap e44: 7 total, 7 up, 7 in 2024-05-08T05:42:26.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:25 smithi151 ceph-mon[34815]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 169 MiB used, 536 GiB / 536 GiB avail 2024-05-08T05:42:26.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:25 smithi151 ceph-mon[34815]: osdmap e44: 7 total, 7 up, 7 in 2024-05-08T05:42:26.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:42:26.839+0000 7fd73ea21700 1 -- 172.21.15.134:0/2601629525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd738103fe0 msgr2=0x7fd73810a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:42:26.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:42:26.839+0000 7fd73ea21700 1 --2- 172.21.15.134:0/2601629525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd738103fe0 0x7fd73810a890 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd73000b0d0 tx=0x7fd73000b3e0 comp rx=0 tx=0).stop 2024-05-08T05:42:26.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:42:26.839+0000 7fd73ea21700 1 -- 172.21.15.134:0/2601629525 shutdown_connections 2024-05-08T05:42:26.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:42:26.839+0000 7fd73ea21700 1 --2- 172.21.15.134:0/2601629525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd738103fe0 0x7fd73810a890 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:42:26.841 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:42:26.839+0000 7fd73ea21700 1 --2- 172.21.15.134:0/2601629525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd738102440 0x7fd738102860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:42:26.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:42:26.839+0000 7fd73ea21700 1 --2- 172.21.15.134:0/2601629525 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd738103640 0x7fd738103aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:42:26.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:42:26.839+0000 7fd73ea21700 1 -- 172.21.15.134:0/2601629525 >> 172.21.15.134:0/2601629525 conn(0x7fd7380fd9c0 msgr2=0x7fd7380ffe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:42:26.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:42:26.839+0000 7fd73ea21700 1 -- 172.21.15.134:0/2601629525 shutdown_connections 2024-05-08T05:42:26.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:42:26.839+0000 7fd73ea21700 1 -- 172.21.15.134:0/2601629525 wait complete. 2024-05-08T05:42:26.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:42:26.839+0000 7fd73ea21700 1 Processor -- start 2024-05-08T05:42:26.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:42:26.839+0000 7fd73ea21700 1 -- start start 2024-05-08T05:42:26.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:42:26.840+0000 7fd73ea21700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd738102440 0x7fd738199690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:42:26.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:42:26.840+0000 7fd73ea21700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd738103640 0x7fd738199bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:42:26.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:42:26.840+0000 7fd73ea21700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd738103fe0 0x7fd7381a0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:42:26.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:42:26.840+0000 7fd73ea21700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd73810df80 con 0x7fd738103640 2024-05-08T05:42:26.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:42:26.840+0000 7fd73ea21700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd73810de00 con 0x7fd738103fe0 2024-05-08T05:42:26.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:42:26.840+0000 7fd73ea21700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd73810e100 con 0x7fd738102440 2024-05-08T05:42:26.842 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:42:26.840+0000 7fd73cfbe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd738103fe0 0x7fd7381a0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:42:26.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:42:26.840+0000 7fd73cfbe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd738103fe0 0x7fd7381a0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60346/0 (socket says 172.21.15.134:60346) 2024-05-08T05:42:26.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:42:26.840+0000 7fd73cfbe700 1 -- 172.21.15.134:0/1962119373 learned_addr learned my addr 172.21.15.134:0/1962119373 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-05-08T05:42:26.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:42:26.840+0000 7fd737fff700 1 --2- 172.21.15.134:0/1962119373 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd738102440 0x7fd738199690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:42:26.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:42:26.840+0000 7fd73cfbe700 1 -- 172.21.15.134:0/1962119373 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd738102440 msgr2=0x7fd738199690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:42:26.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:42:26.840+0000 7fd73cfbe700 1 --2- 172.21.15.134:0/1962119373 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd738102440 0x7fd738199690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:42:26.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:42:26.840+0000 7fd73cfbe700 1 -- 172.21.15.134:0/1962119373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd738103640 msgr2=0x7fd738199bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:42:26.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:42:26.840+0000 7fd73cfbe700 1 --2- 172.21.15.134:0/1962119373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd738103640 0x7fd738199bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:42:26.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:42:26.840+0000 7fd73cfbe700 1 -- 172.21.15.134:0/1962119373 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7381a12f0 con 0x7fd738103fe0 2024-05-08T05:42:26.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:42:26.840+0000 7fd73cfbe700 1 --2- 172.21.15.134:0/1962119373 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd738103fe0 0x7fd7381a0c50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd730009fd0 tx=0x7fd730004ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:42:26.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:42:26.840+0000 7fd7357fa700 1 -- 172.21.15.134:0/1962119373 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd73001f030 con 0x7fd738103fe0 2024-05-08T05:42:26.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:42:26.841+0000 7fd73ea21700 1 -- 172.21.15.134:0/1962119373 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7381a1580 con 0x7fd738103fe0 2024-05-08T05:42:26.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:42:26.841+0000 7fd7357fa700 1 -- 172.21.15.134:0/1962119373 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd730007bb0 con 0x7fd738103fe0 2024-05-08T05:42:26.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:42:26.841+0000 7fd7357fa700 1 -- 172.21.15.134:0/1962119373 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd730004810 con 0x7fd738103fe0 2024-05-08T05:42:26.843 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:42:26.841+0000 7fd73ea21700 1 -- 172.21.15.134:0/1962119373 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7381a1ab0 con 0x7fd738103fe0 2024-05-08T05:42:26.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:42:26.841+0000 7fd73ea21700 1 -- 172.21.15.134:0/1962119373 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd73806a190 con 0x7fd738103fe0 2024-05-08T05:42:26.844 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:42:26.844+0000 7fd7357fa700 1 -- 172.21.15.134:0/1962119373 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fd730003a00 con 0x7fd738103fe0 2024-05-08T05:42:26.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:42:26.844+0000 7fd7357fa700 1 --2- 172.21.15.134:0/1962119373 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd7200b2880 0x7fd7200b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:42:26.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:42:26.844+0000 7fd7357fa700 1 -- 172.21.15.134:0/1962119373 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 4965+0+0 (secure 0 0 0) 0x7fd73000f020 con 0x7fd738103fe0 2024-05-08T05:42:26.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:42:26.845+0000 7fd737fff700 1 --2- 172.21.15.134:0/1962119373 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd7200b2880 0x7fd7200b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:42:26.845 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:42:26.845+0000 7fd737fff700 1 --2- 172.21.15.134:0/1962119373 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd7200b2880 0x7fd7200b4d40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd728006fd0 tx=0x7fd728008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:42:26.848 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:42:26.848+0000 7fd7357fa700 1 -- 172.21.15.134:0/1962119373 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd730029070 con 0x7fd738103fe0 2024-05-08T05:42:27.062 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:42:27.061+0000 7fd73ea21700 1 -- 172.21.15.134:0/1962119373 --> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fd7381a1e90 con 0x7fd7200b2880 2024-05-08T05:42:27.955 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:27 smithi134 ceph-mon[34132]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:42:27.956 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:27 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:27.956 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:27 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:27.956 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:27 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:42:27.956 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:27 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:42:27.956 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:27 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:42:27.956 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:27 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:27.956 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:27 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:42:27.956 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:27 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:42:27.956 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:27 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:27.956 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:27 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:42:27.956 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:27 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:42:27.956 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:27 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:42:27.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:27 smithi082 ceph-mon[30098]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:42:27.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:27 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:27.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:27 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:27.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:27 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:42:27.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:27 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:42:27.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:27 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:42:27.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:27 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:27.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:27 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:42:27.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:27 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:42:27.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:27 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:27.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:27 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:42:27.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:27 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:42:27.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:27 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:42:28.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:27 smithi151 ceph-mon[34815]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:42:28.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:27 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:28.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:27 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:28.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:27 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:42:28.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:27 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:42:28.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:27 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:42:28.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:27 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:28.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:27 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:42:28.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:27 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:42:28.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:27 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:28.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:27 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:42:28.131 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:27 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:42:28.131 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:27 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:42:28.904 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:28 smithi151 ceph-mon[34815]: Detected new or changed devices on smithi082 2024-05-08T05:42:28.904 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:28 smithi151 ceph-mon[34815]: Adjusting osd_memory_target on smithi082 to 5696M 2024-05-08T05:42:28.905 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:28 smithi151 ceph-mon[34815]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:42:28.923 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:28 smithi134 ceph-mon[34132]: Detected new or changed devices on smithi082 2024-05-08T05:42:28.923 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:28 smithi134 ceph-mon[34132]: Adjusting osd_memory_target on smithi082 to 5696M 2024-05-08T05:42:28.923 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:28 smithi134 ceph-mon[34132]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:42:28.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:28 smithi082 ceph-mon[30098]: Detected new or changed devices on smithi082 2024-05-08T05:42:28.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:28 smithi082 ceph-mon[30098]: Adjusting osd_memory_target on smithi082 to 5696M 2024-05-08T05:42:28.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:28 smithi082 ceph-mon[30098]: from='client.24287 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:42:29.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:29 smithi082 ceph-mon[30098]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:42:30.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:29 smithi134 ceph-mon[34132]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:42:30.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:29 smithi151 ceph-mon[34815]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:42:30.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:30 smithi082 ceph-mon[30098]: from='client.? 172.21.15.134:0/2642935077' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "72b0c735-ef30-4823-8ab8-2e5bf7cc3c93"}]: dispatch 2024-05-08T05:42:30.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:30 smithi082 ceph-mon[30098]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "72b0c735-ef30-4823-8ab8-2e5bf7cc3c93"}]: dispatch 2024-05-08T05:42:30.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:30 smithi082 ceph-mon[30098]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "72b0c735-ef30-4823-8ab8-2e5bf7cc3c93"}]': finished 2024-05-08T05:42:30.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:30 smithi082 ceph-mon[30098]: osdmap e45: 8 total, 7 up, 8 in 2024-05-08T05:42:30.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:30 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T05:42:30.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:30 smithi082 ceph-mon[30098]: from='client.? 172.21.15.134:0/480878506' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:42:31.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:30 smithi134 ceph-mon[34132]: from='client.? 172.21.15.134:0/2642935077' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "72b0c735-ef30-4823-8ab8-2e5bf7cc3c93"}]: dispatch 2024-05-08T05:42:31.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:30 smithi134 ceph-mon[34132]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "72b0c735-ef30-4823-8ab8-2e5bf7cc3c93"}]: dispatch 2024-05-08T05:42:31.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:30 smithi134 ceph-mon[34132]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "72b0c735-ef30-4823-8ab8-2e5bf7cc3c93"}]': finished 2024-05-08T05:42:31.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:30 smithi134 ceph-mon[34132]: osdmap e45: 8 total, 7 up, 8 in 2024-05-08T05:42:31.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:30 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T05:42:31.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:30 smithi134 ceph-mon[34132]: from='client.? 172.21.15.134:0/480878506' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:42:31.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:30 smithi151 ceph-mon[34815]: from='client.? 172.21.15.134:0/2642935077' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "72b0c735-ef30-4823-8ab8-2e5bf7cc3c93"}]: dispatch 2024-05-08T05:42:31.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:30 smithi151 ceph-mon[34815]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "72b0c735-ef30-4823-8ab8-2e5bf7cc3c93"}]: dispatch 2024-05-08T05:42:31.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:30 smithi151 ceph-mon[34815]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "72b0c735-ef30-4823-8ab8-2e5bf7cc3c93"}]': finished 2024-05-08T05:42:31.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:30 smithi151 ceph-mon[34815]: osdmap e45: 8 total, 7 up, 8 in 2024-05-08T05:42:31.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:30 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T05:42:31.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:30 smithi151 ceph-mon[34815]: from='client.? 172.21.15.134:0/480878506' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:42:32.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:31 smithi151 ceph-mon[34815]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:42:32.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:31 smithi082 ceph-mon[30098]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:42:32.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:31 smithi134 ceph-mon[34132]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:42:34.047 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:33 smithi134 ceph-mon[34132]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:42:34.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:33 smithi151 ceph-mon[34815]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:42:34.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:33 smithi082 ceph-mon[30098]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:42:36.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:35 smithi134 ceph-mon[34132]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:42:36.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:35 smithi151 ceph-mon[34815]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:42:36.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:35 smithi082 ceph-mon[30098]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:42:38.079 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:37 smithi134 ceph-mon[34132]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:42:38.080 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:37 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-08T05:42:38.080 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:37 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:42:38.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:37 smithi151 ceph-mon[34815]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:42:38.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:37 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-08T05:42:38.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:37 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:42:38.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:37 smithi082 ceph-mon[30098]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:42:38.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:37 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-08T05:42:38.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:37 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:42:39.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:38 smithi134 ceph-mon[34132]: Deploying daemon osd.7 on smithi134 2024-05-08T05:42:39.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:38 smithi151 ceph-mon[34815]: Deploying daemon osd.7 on smithi134 2024-05-08T05:42:39.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:38 smithi082 ceph-mon[30098]: Deploying daemon osd.7 on smithi134 2024-05-08T05:42:40.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:39 smithi151 ceph-mon[34815]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:42:40.182 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:39 smithi134 ceph-mon[34132]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:42:40.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:39 smithi082 ceph-mon[30098]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:42:42.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:41 smithi151 ceph-mon[34815]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:42:42.142 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:41 smithi134 ceph-mon[34132]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:42:42.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:41 smithi082 ceph-mon[30098]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:42:43.995 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:43 smithi134 ceph-mon[34132]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:42:43.996 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:43 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:43.996 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:43 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:43.996 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:43 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:42:44.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:43 smithi151 ceph-mon[34815]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:42:44.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:43 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:44.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:43 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:44.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:43 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:42:44.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:43 smithi082 ceph-mon[30098]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:42:44.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:43 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:44.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:43 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:44.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:43 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:42:45.939 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:45 smithi134 ceph-mon[34132]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:42:46.023 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:45 smithi082 ceph-mon[30098]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:42:46.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:45 smithi151 ceph-mon[34815]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:42:46.642 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:42:46.642+0000 7fd7357fa700 1 -- 172.21.15.134:0/1962119373 <== mgr.14152 v2:172.21.15.82:6800/4089180091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd7381a1e90 con 0x7fd7200b2880 2024-05-08T05:42:46.642 INFO:teuthology.orchestra.run.smithi134.stdout:Created osd(s) 7 on host 'smithi134' 2024-05-08T05:42:46.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:42:46.644+0000 7fd73ea21700 1 -- 172.21.15.134:0/1962119373 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd7200b2880 msgr2=0x7fd7200b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:42:46.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:42:46.644+0000 7fd73ea21700 1 --2- 172.21.15.134:0/1962119373 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd7200b2880 0x7fd7200b4d40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd728006fd0 tx=0x7fd728008040 comp rx=0 tx=0).stop 2024-05-08T05:42:46.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:42:46.644+0000 7fd73ea21700 1 -- 172.21.15.134:0/1962119373 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd738103fe0 msgr2=0x7fd7381a0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:42:46.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:42:46.644+0000 7fd73ea21700 1 --2- 172.21.15.134:0/1962119373 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd738103fe0 0x7fd7381a0c50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd730009fd0 tx=0x7fd730004ef0 comp rx=0 tx=0).stop 2024-05-08T05:42:46.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:42:46.644+0000 7fd73ea21700 1 -- 172.21.15.134:0/1962119373 shutdown_connections 2024-05-08T05:42:46.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:42:46.644+0000 7fd73ea21700 1 --2- 172.21.15.134:0/1962119373 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd738103fe0 0x7fd7381a0c50 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:42:46.645 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:42:46.644+0000 7fd73ea21700 1 --2- 172.21.15.134:0/1962119373 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd7200b2880 0x7fd7200b4d40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:42:46.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:42:46.644+0000 7fd73ea21700 1 --2- 172.21.15.134:0/1962119373 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd738102440 0x7fd738199690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:42:46.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:42:46.644+0000 7fd73ea21700 1 --2- 172.21.15.134:0/1962119373 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd738103640 0x7fd738199bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:42:46.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:42:46.644+0000 7fd73ea21700 1 -- 172.21.15.134:0/1962119373 >> 172.21.15.134:0/1962119373 conn(0x7fd7380fd9c0 msgr2=0x7fd7380ff420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:42:46.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:42:46.644+0000 7fd73ea21700 1 -- 172.21.15.134:0/1962119373 shutdown_connections 2024-05-08T05:42:46.646 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:42:46.645+0000 7fd73ea21700 1 -- 172.21.15.134:0/1962119373 wait complete. 2024-05-08T05:42:47.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:46 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:47.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:46 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:47.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:46 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:42:47.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:46 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:42:47.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:46 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:47.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:46 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:47.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:46 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:47.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:46 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:42:47.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:46 smithi151 ceph-mon[34815]: from='osd.7 [v2:172.21.15.134:6816/3006846927,v1:172.21.15.134:6817/3006846927]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-08T05:42:47.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:46 smithi151 ceph-mon[34815]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-08T05:42:47.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:46 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:47.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:46 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:47.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:46 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:42:47.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:46 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:42:47.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:46 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:47.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:46 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:47.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:46 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:47.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:46 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:42:47.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:46 smithi082 ceph-mon[30098]: from='osd.7 [v2:172.21.15.134:6816/3006846927,v1:172.21.15.134:6817/3006846927]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-08T05:42:47.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:46 smithi082 ceph-mon[30098]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-08T05:42:47.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:46 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:47.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:46 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:47.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:46 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:42:47.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:46 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:42:47.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:46 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:47.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:46 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:47.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:46 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:47.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:46 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:42:47.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:46 smithi134 ceph-mon[34132]: from='osd.7 [v2:172.21.15.134:6816/3006846927,v1:172.21.15.134:6817/3006846927]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-08T05:42:47.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:46 smithi134 ceph-mon[34132]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-08T05:42:47.322 DEBUG:teuthology.orchestra.run.smithi134:osd.7> sudo journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@osd.7.service 2024-05-08T05:42:47.324 INFO:tasks.cephadm:Deploying osd.8 on smithi151 with /dev/vg_nvme/lv_2... 2024-05-08T05:42:47.324 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-08T05:42:47.569 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T05:42:47.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:47 smithi082 ceph-mon[30098]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:42:47.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:47 smithi082 ceph-mon[30098]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-08T05:42:47.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:47 smithi082 ceph-mon[30098]: osdmap e46: 8 total, 7 up, 8 in 2024-05-08T05:42:47.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:47 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T05:42:47.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:47 smithi082 ceph-mon[30098]: from='osd.7 [v2:172.21.15.134:6816/3006846927,v1:172.21.15.134:6817/3006846927]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-05-08T05:42:47.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:47 smithi082 ceph-mon[30098]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-05-08T05:42:47.984 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:47 smithi151 ceph-mon[34815]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:42:47.984 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:47 smithi151 ceph-mon[34815]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-08T05:42:47.984 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:47 smithi151 ceph-mon[34815]: osdmap e46: 8 total, 7 up, 8 in 2024-05-08T05:42:47.984 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:47 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T05:42:47.984 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:47 smithi151 ceph-mon[34815]: from='osd.7 [v2:172.21.15.134:6816/3006846927,v1:172.21.15.134:6817/3006846927]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-05-08T05:42:47.984 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:47 smithi151 ceph-mon[34815]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-05-08T05:42:48.246 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:47 smithi134 ceph-mon[34132]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:42:48.247 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:47 smithi134 ceph-mon[34132]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-08T05:42:48.247 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:47 smithi134 ceph-mon[34132]: osdmap e46: 8 total, 7 up, 8 in 2024-05-08T05:42:48.247 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:47 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T05:42:48.247 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:47 smithi134 ceph-mon[34132]: from='osd.7 [v2:172.21.15.134:6816/3006846927,v1:172.21.15.134:6817/3006846927]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-05-08T05:42:48.247 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:47 smithi134 ceph-mon[34132]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-05-08T05:42:48.859 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 05:42:48 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T05:42:48.615+0000 7f8ed6755700 -1 osd.7 0 waiting for initial osdmap 2024-05-08T05:42:48.859 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 05:42:48 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T05:42:48.623+0000 7f8ed2548700 -1 osd.7 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T05:42:49.543 INFO:teuthology.orchestra.run.smithi151.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-08T05:42:49.543 INFO:teuthology.orchestra.run.smithi151.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-08T05:42:49.543 INFO:teuthology.orchestra.run.smithi151.stderr: stderr: 10+0 records in 2024-05-08T05:42:49.543 INFO:teuthology.orchestra.run.smithi151.stderr:10+0 records out 2024-05-08T05:42:49.544 INFO:teuthology.orchestra.run.smithi151.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.011499 s, 912 MB/s 2024-05-08T05:42:49.544 INFO:teuthology.orchestra.run.smithi151.stderr:--> Zapping successful for: 2024-05-08T05:42:49.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:49 smithi151 ceph-mon[34815]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:42:49.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:49 smithi151 ceph-mon[34815]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-05-08T05:42:49.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:49 smithi151 ceph-mon[34815]: osdmap e47: 8 total, 7 up, 8 in 2024-05-08T05:42:49.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:49 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T05:42:49.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:49 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T05:42:49.956 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:49 smithi134 ceph-mon[34132]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:42:49.956 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:49 smithi134 ceph-mon[34132]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-05-08T05:42:49.956 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:49 smithi134 ceph-mon[34132]: osdmap e47: 8 total, 7 up, 8 in 2024-05-08T05:42:49.956 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:49 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T05:42:49.956 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:49 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T05:42:49.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:49 smithi082 ceph-mon[30098]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 200 MiB used, 626 GiB / 626 GiB avail 2024-05-08T05:42:49.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:49 smithi082 ceph-mon[30098]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-05-08T05:42:49.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:49 smithi082 ceph-mon[30098]: osdmap e47: 8 total, 7 up, 8 in 2024-05-08T05:42:49.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:49 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T05:42:49.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:49 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T05:42:50.206 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi151:vg_nvme/lv_2 2024-05-08T05:42:50.443 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T05:42:50.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:50 smithi151 ceph-mon[34815]: purged_snaps scrub starts 2024-05-08T05:42:50.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:50 smithi151 ceph-mon[34815]: purged_snaps scrub ok 2024-05-08T05:42:50.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:50 smithi151 ceph-mon[34815]: osd.7 [v2:172.21.15.134:6816/3006846927,v1:172.21.15.134:6817/3006846927] boot 2024-05-08T05:42:50.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:50 smithi151 ceph-mon[34815]: osdmap e48: 8 total, 8 up, 8 in 2024-05-08T05:42:50.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:50 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T05:42:50.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:50 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:50.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:50 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:50.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:50 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:42:50.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:50 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:42:50.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:50 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:42:50.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:50 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:50.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:50 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:42:50.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:50 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:42:50.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:50 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:50.881 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:50 smithi151 ceph-mon[34815]: osdmap e49: 8 total, 8 up, 8 in 2024-05-08T05:42:50.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:50 smithi082 ceph-mon[30098]: purged_snaps scrub starts 2024-05-08T05:42:50.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:50 smithi082 ceph-mon[30098]: purged_snaps scrub ok 2024-05-08T05:42:50.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:50 smithi082 ceph-mon[30098]: osd.7 [v2:172.21.15.134:6816/3006846927,v1:172.21.15.134:6817/3006846927] boot 2024-05-08T05:42:50.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:50 smithi082 ceph-mon[30098]: osdmap e48: 8 total, 8 up, 8 in 2024-05-08T05:42:50.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:50 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T05:42:50.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:50 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:50.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:50 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:50.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:50 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:42:50.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:50 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:42:50.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:50 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:42:50.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:50 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:50.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:50 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:42:50.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:50 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:42:50.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:50 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:50.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:50 smithi082 ceph-mon[30098]: osdmap e49: 8 total, 8 up, 8 in 2024-05-08T05:42:51.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:50 smithi134 ceph-mon[34132]: purged_snaps scrub starts 2024-05-08T05:42:51.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:50 smithi134 ceph-mon[34132]: purged_snaps scrub ok 2024-05-08T05:42:51.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:50 smithi134 ceph-mon[34132]: osd.7 [v2:172.21.15.134:6816/3006846927,v1:172.21.15.134:6817/3006846927] boot 2024-05-08T05:42:51.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:50 smithi134 ceph-mon[34132]: osdmap e48: 8 total, 8 up, 8 in 2024-05-08T05:42:51.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:50 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-08T05:42:51.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:50 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:51.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:50 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:51.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:50 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:42:51.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:50 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:42:51.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:50 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:42:51.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:50 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:51.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:50 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:42:51.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:50 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:42:51.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:50 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:42:51.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:50 smithi134 ceph-mon[34132]: osdmap e49: 8 total, 8 up, 8 in 2024-05-08T05:42:51.806 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:51 smithi151 ceph-mon[34815]: pgmap v191: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T05:42:51.807 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:51 smithi151 ceph-mon[34815]: Detected new or changed devices on smithi134 2024-05-08T05:42:51.807 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:51 smithi151 ceph-mon[34815]: Adjusting osd_memory_target on smithi134 to 5696M 2024-05-08T05:42:51.807 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:51 smithi151 ceph-mon[34815]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-05-08T05:42:51.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:51 smithi082 ceph-mon[30098]: pgmap v191: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T05:42:51.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:51 smithi082 ceph-mon[30098]: Detected new or changed devices on smithi134 2024-05-08T05:42:51.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:51 smithi082 ceph-mon[30098]: Adjusting osd_memory_target on smithi134 to 5696M 2024-05-08T05:42:51.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:51 smithi082 ceph-mon[30098]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-05-08T05:42:52.002 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:51 smithi134 ceph-mon[34132]: pgmap v191: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T05:42:52.002 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:51 smithi134 ceph-mon[34132]: Detected new or changed devices on smithi134 2024-05-08T05:42:52.002 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:51 smithi134 ceph-mon[34132]: Adjusting osd_memory_target on smithi134 to 5696M 2024-05-08T05:42:52.002 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:51 smithi134 ceph-mon[34132]: Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-05-08T05:42:52.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:42:52.027+0000 7f7c7422b700 1 -- 172.21.15.151:0/2145274768 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c6c103610 msgr2=0x7f7c6c103a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:42:52.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:42:52.027+0000 7f7c7422b700 1 --2- 172.21.15.151:0/2145274768 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c6c103610 0x7f7c6c103a70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c009990 tx=0x7f7c5c009ca0 comp rx=0 tx=0).stop 2024-05-08T05:42:52.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:42:52.027+0000 7f7c7422b700 1 -- 172.21.15.151:0/2145274768 shutdown_connections 2024-05-08T05:42:52.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:42:52.027+0000 7f7c7422b700 1 --2- 172.21.15.151:0/2145274768 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c6c102410 0x7f7c6c102830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:42:52.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:42:52.027+0000 7f7c7422b700 1 --2- 172.21.15.151:0/2145274768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c6c103fb0 0x7f7c6c10a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:42:52.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:42:52.027+0000 7f7c7422b700 1 --2- 172.21.15.151:0/2145274768 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c6c103610 0x7f7c6c103a70 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:42:52.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:42:52.027+0000 7f7c7422b700 1 -- 172.21.15.151:0/2145274768 >> 172.21.15.151:0/2145274768 conn(0x7f7c6c0fd9d0 msgr2=0x7f7c6c0ffdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:42:52.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:42:52.028+0000 7f7c7422b700 1 -- 172.21.15.151:0/2145274768 shutdown_connections 2024-05-08T05:42:52.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:42:52.028+0000 7f7c7422b700 1 -- 172.21.15.151:0/2145274768 wait complete. 2024-05-08T05:42:52.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:42:52.028+0000 7f7c7422b700 1 Processor -- start 2024-05-08T05:42:52.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:42:52.028+0000 7f7c7422b700 1 -- start start 2024-05-08T05:42:52.029 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:42:52.028+0000 7f7c7422b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c6c102410 0x7f7c6c19b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:42:52.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:42:52.028+0000 7f7c7422b700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c6c103610 0x7f7c6c19bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:42:52.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:42:52.028+0000 7f7c7422b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c6c103fb0 0x7f7c6c1a2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:42:52.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:42:52.028+0000 7f7c7422b700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7c6c10dfa0 con 0x7f7c6c103610 2024-05-08T05:42:52.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:42:52.028+0000 7f7c7422b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7c6c10de20 con 0x7f7c6c102410 2024-05-08T05:42:52.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:42:52.028+0000 7f7c7422b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7c6c10e120 con 0x7f7c6c103fb0 2024-05-08T05:42:52.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:42:52.028+0000 7f7c727c8700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c6c103fb0 0x7f7c6c1a2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:42:52.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:42:52.028+0000 7f7c727c8700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c6c103fb0 0x7f7c6c1a2f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:48128/0 (socket says 172.21.15.151:48128) 2024-05-08T05:42:52.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:42:52.028+0000 7f7c727c8700 1 -- 172.21.15.151:0/2013127043 learned_addr learned my addr 172.21.15.151:0/2013127043 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-05-08T05:42:52.030 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:42:52.029+0000 7f7c71fc7700 1 --2- 172.21.15.151:0/2013127043 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c6c102410 0x7f7c6c19b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:42:52.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:42:52.029+0000 7f7c727c8700 1 -- 172.21.15.151:0/2013127043 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c6c102410 msgr2=0x7f7c6c19b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:42:52.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:42:52.029+0000 7f7c727c8700 1 --2- 172.21.15.151:0/2013127043 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c6c102410 0x7f7c6c19b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:42:52.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:42:52.029+0000 7f7c727c8700 1 -- 172.21.15.151:0/2013127043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c6c103610 msgr2=0x7f7c6c19bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:42:52.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:42:52.029+0000 7f7c727c8700 1 --2- 172.21.15.151:0/2013127043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c6c103610 0x7f7c6c19bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:42:52.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:42:52.029+0000 7f7c727c8700 1 -- 172.21.15.151:0/2013127043 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c6c1a3600 con 0x7f7c6c103fb0 2024-05-08T05:42:52.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:42:52.029+0000 7f7c727c8700 1 --2- 172.21.15.151:0/2013127043 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c6c103fb0 0x7f7c6c1a2f60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7c6400b9a0 tx=0x7f7c6400bcb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:42:52.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:42:52.029+0000 7f7c62ffd700 1 -- 172.21.15.151:0/2013127043 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c64019070 con 0x7f7c6c103fb0 2024-05-08T05:42:52.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:42:52.029+0000 7f7c7422b700 1 -- 172.21.15.151:0/2013127043 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c6c1a38f0 con 0x7f7c6c103fb0 2024-05-08T05:42:52.031 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:42:52.029+0000 7f7c62ffd700 1 -- 172.21.15.151:0/2013127043 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c6400cde0 con 0x7f7c6c103fb0 2024-05-08T05:42:52.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:42:52.029+0000 7f7c62ffd700 1 -- 172.21.15.151:0/2013127043 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c64007370 con 0x7f7c6c103fb0 2024-05-08T05:42:52.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:42:52.029+0000 7f7c7422b700 1 -- 172.21.15.151:0/2013127043 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c6c1a3e60 con 0x7f7c6c103fb0 2024-05-08T05:42:52.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:42:52.030+0000 7f7c7422b700 1 -- 172.21.15.151:0/2013127043 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c6c06a190 con 0x7f7c6c103fb0 2024-05-08T05:42:52.032 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:42:52.032+0000 7f7c62ffd700 1 -- 172.21.15.151:0/2013127043 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f7c6401c070 con 0x7f7c6c103fb0 2024-05-08T05:42:52.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:42:52.033+0000 7f7c62ffd700 1 --2- 172.21.15.151:0/2013127043 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7c580b2880 0x7f7c580b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:42:52.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:42:52.033+0000 7f7c62ffd700 1 -- 172.21.15.151:0/2013127043 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5397+0+0 (secure 0 0 0) 0x7f7c640e1370 con 0x7f7c6c103fb0 2024-05-08T05:42:52.033 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:42:52.033+0000 7f7c71fc7700 1 --2- 172.21.15.151:0/2013127043 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7c580b2880 0x7f7c580b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:42:52.035 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:42:52.034+0000 7f7c71fc7700 1 --2- 172.21.15.151:0/2013127043 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7c580b2880 0x7f7c580b4d40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c103470 tx=0x7f7c68009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:42:52.037 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:42:52.037+0000 7f7c62ffd700 1 -- 172.21.15.151:0/2013127043 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f7c64023070 con 0x7f7c6c103fb0 2024-05-08T05:42:52.248 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:42:52.248+0000 7f7c7422b700 1 -- 172.21.15.151:0/2013127043 --> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f7c6c06c300 con 0x7f7c580b2880 2024-05-08T05:42:52.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:52 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:42:52.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:52 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:42:52.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:52 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:42:52.972 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:52 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:42:52.972 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:52 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:42:52.972 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:52 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:42:53.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:52 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:42:53.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:52 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:42:53.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:52 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:42:53.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:53 smithi082 ceph-mon[30098]: pgmap v193: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T05:42:53.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:53 smithi082 ceph-mon[30098]: from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:42:53.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:53 smithi082 ceph-mon[30098]: osdmap e50: 8 total, 8 up, 8 in 2024-05-08T05:42:53.984 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:53 smithi151 ceph-mon[34815]: pgmap v193: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T05:42:53.984 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:53 smithi151 ceph-mon[34815]: from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:42:53.985 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:53 smithi151 ceph-mon[34815]: osdmap e50: 8 total, 8 up, 8 in 2024-05-08T05:42:54.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:53 smithi134 ceph-mon[34132]: pgmap v193: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T05:42:54.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:53 smithi134 ceph-mon[34132]: from='client.24307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:42:54.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:53 smithi134 ceph-mon[34132]: osdmap e50: 8 total, 8 up, 8 in 2024-05-08T05:42:55.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:55 smithi082 ceph-mon[30098]: pgmap v195: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T05:42:55.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:55 smithi082 ceph-mon[30098]: from='client.? 172.21.15.151:0/3056684384' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "93e4da0f-48ea-4ab7-b612-26b545b76de6"}]: dispatch 2024-05-08T05:42:55.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:55 smithi082 ceph-mon[30098]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "93e4da0f-48ea-4ab7-b612-26b545b76de6"}]: dispatch 2024-05-08T05:42:55.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:55 smithi082 ceph-mon[30098]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "93e4da0f-48ea-4ab7-b612-26b545b76de6"}]': finished 2024-05-08T05:42:55.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:55 smithi082 ceph-mon[30098]: osdmap e51: 9 total, 8 up, 9 in 2024-05-08T05:42:55.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:55 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T05:42:55.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:55 smithi082 ceph-mon[30098]: from='client.? 172.21.15.151:0/1016546088' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:42:56.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:55 smithi134 ceph-mon[34132]: pgmap v195: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T05:42:56.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:55 smithi134 ceph-mon[34132]: from='client.? 172.21.15.151:0/3056684384' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "93e4da0f-48ea-4ab7-b612-26b545b76de6"}]: dispatch 2024-05-08T05:42:56.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:55 smithi134 ceph-mon[34132]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "93e4da0f-48ea-4ab7-b612-26b545b76de6"}]: dispatch 2024-05-08T05:42:56.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:55 smithi134 ceph-mon[34132]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "93e4da0f-48ea-4ab7-b612-26b545b76de6"}]': finished 2024-05-08T05:42:56.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:55 smithi134 ceph-mon[34132]: osdmap e51: 9 total, 8 up, 9 in 2024-05-08T05:42:56.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:55 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T05:42:56.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:55 smithi134 ceph-mon[34132]: from='client.? 172.21.15.151:0/1016546088' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:42:56.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:55 smithi151 ceph-mon[34815]: pgmap v195: 1 pgs: 1 remapped; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T05:42:56.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:55 smithi151 ceph-mon[34815]: from='client.? 172.21.15.151:0/3056684384' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "93e4da0f-48ea-4ab7-b612-26b545b76de6"}]: dispatch 2024-05-08T05:42:56.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:55 smithi151 ceph-mon[34815]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "93e4da0f-48ea-4ab7-b612-26b545b76de6"}]: dispatch 2024-05-08T05:42:56.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:55 smithi151 ceph-mon[34815]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "93e4da0f-48ea-4ab7-b612-26b545b76de6"}]': finished 2024-05-08T05:42:56.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:55 smithi151 ceph-mon[34815]: osdmap e51: 9 total, 8 up, 9 in 2024-05-08T05:42:56.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:55 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T05:42:56.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:55 smithi151 ceph-mon[34815]: from='client.? 172.21.15.151:0/1016546088' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:42:56.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:56 smithi082 ceph-mon[30098]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-05-08T05:42:56.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:56 smithi082 ceph-mon[30098]: Cluster is now healthy 2024-05-08T05:42:57.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:56 smithi134 ceph-mon[34132]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-05-08T05:42:57.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:56 smithi134 ceph-mon[34132]: Cluster is now healthy 2024-05-08T05:42:57.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:56 smithi151 ceph-mon[34815]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-05-08T05:42:57.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:56 smithi151 ceph-mon[34815]: Cluster is now healthy 2024-05-08T05:42:57.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:57 smithi082 ceph-mon[30098]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 192 KiB/s, 0 objects/s recovering 2024-05-08T05:42:58.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:57 smithi134 ceph-mon[34132]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 192 KiB/s, 0 objects/s recovering 2024-05-08T05:42:58.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:57 smithi151 ceph-mon[34815]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 192 KiB/s, 0 objects/s recovering 2024-05-08T05:42:59.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:42:59 smithi082 ceph-mon[30098]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 155 KiB/s, 0 objects/s recovering 2024-05-08T05:43:00.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:42:59 smithi134 ceph-mon[34132]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 155 KiB/s, 0 objects/s recovering 2024-05-08T05:43:00.068 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:42:59 smithi151 ceph-mon[34815]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 155 KiB/s, 0 objects/s recovering 2024-05-08T05:43:01.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:01 smithi082 ceph-mon[30098]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-05-08T05:43:01.984 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:01 smithi151 ceph-mon[34815]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-05-08T05:43:02.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:01 smithi134 ceph-mon[34132]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-05-08T05:43:02.978 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:02 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-08T05:43:02.978 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:02 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:43:03.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:02 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-08T05:43:03.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:02 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:43:03.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:02 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-08T05:43:03.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:02 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:43:03.981 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:03 smithi151 ceph-mon[34815]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 123 KiB/s, 0 objects/s recovering 2024-05-08T05:43:03.981 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:03 smithi151 ceph-mon[34815]: Deploying daemon osd.8 on smithi151 2024-05-08T05:43:04.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:03 smithi134 ceph-mon[34132]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 123 KiB/s, 0 objects/s recovering 2024-05-08T05:43:04.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:03 smithi134 ceph-mon[34132]: Deploying daemon osd.8 on smithi151 2024-05-08T05:43:04.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:03 smithi082 ceph-mon[30098]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 123 KiB/s, 0 objects/s recovering 2024-05-08T05:43:04.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:03 smithi082 ceph-mon[30098]: Deploying daemon osd.8 on smithi151 2024-05-08T05:43:06.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:05 smithi134 ceph-mon[34132]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-05-08T05:43:06.094 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:05 smithi151 ceph-mon[34815]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-05-08T05:43:06.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:05 smithi082 ceph-mon[30098]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail; 115 KiB/s, 0 objects/s recovering 2024-05-08T05:43:08.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:07 smithi134 ceph-mon[34132]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T05:43:08.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:07 smithi151 ceph-mon[34815]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T05:43:08.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:07 smithi082 ceph-mon[30098]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T05:43:08.967 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:08 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:43:08.967 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:08 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:08.967 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:08 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:09.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:08 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:43:09.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:08 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:09.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:08 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:09.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:08 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:43:09.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:08 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:09.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:08 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:09.997 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:09 smithi151 ceph-mon[34815]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T05:43:10.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:09 smithi134 ceph-mon[34132]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T05:43:10.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:09 smithi082 ceph-mon[30098]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T05:43:11.282 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:43:11.281+0000 7f7c62ffd700 1 -- 172.21.15.151:0/2013127043 <== mgr.14152 v2:172.21.15.82:6800/4089180091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7c6c06c300 con 0x7f7c580b2880 2024-05-08T05:43:11.282 INFO:teuthology.orchestra.run.smithi151.stdout:Created osd(s) 8 on host 'smithi151' 2024-05-08T05:43:11.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:43:11.283+0000 7f7c7422b700 1 -- 172.21.15.151:0/2013127043 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7c580b2880 msgr2=0x7f7c580b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:43:11.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:43:11.283+0000 7f7c7422b700 1 --2- 172.21.15.151:0/2013127043 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7c580b2880 0x7f7c580b4d40 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c103470 tx=0x7f7c68009190 comp rx=0 tx=0).stop 2024-05-08T05:43:11.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:43:11.283+0000 7f7c7422b700 1 -- 172.21.15.151:0/2013127043 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c6c103fb0 msgr2=0x7f7c6c1a2f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:43:11.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:43:11.283+0000 7f7c7422b700 1 --2- 172.21.15.151:0/2013127043 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c6c103fb0 0x7f7c6c1a2f60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7c6400b9a0 tx=0x7f7c6400bcb0 comp rx=0 tx=0).stop 2024-05-08T05:43:11.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:43:11.283+0000 7f7c7422b700 1 -- 172.21.15.151:0/2013127043 shutdown_connections 2024-05-08T05:43:11.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:43:11.283+0000 7f7c7422b700 1 --2- 172.21.15.151:0/2013127043 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c6c102410 0x7f7c6c19b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:43:11.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:43:11.283+0000 7f7c7422b700 1 --2- 172.21.15.151:0/2013127043 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7c580b2880 0x7f7c580b4d40 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:43:11.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:43:11.283+0000 7f7c7422b700 1 --2- 172.21.15.151:0/2013127043 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c6c103fb0 0x7f7c6c1a2f60 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:43:11.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:43:11.283+0000 7f7c7422b700 1 --2- 172.21.15.151:0/2013127043 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c6c103610 0x7f7c6c19bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:43:11.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:43:11.283+0000 7f7c7422b700 1 -- 172.21.15.151:0/2013127043 >> 172.21.15.151:0/2013127043 conn(0x7f7c6c0fd9d0 msgr2=0x7f7c6c06bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:43:11.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:43:11.283+0000 7f7c7422b700 1 -- 172.21.15.151:0/2013127043 shutdown_connections 2024-05-08T05:43:11.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:43:11.284+0000 7f7c7422b700 1 -- 172.21.15.151:0/2013127043 wait complete. 2024-05-08T05:43:11.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:11 smithi151 ceph-mon[34815]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T05:43:11.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:11 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:11.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:11 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:12.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:11 smithi134 ceph-mon[34132]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T05:43:12.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:11 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:12.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:11 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:12.195 DEBUG:teuthology.orchestra.run.smithi151:osd.8> sudo journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@osd.8.service 2024-05-08T05:43:12.197 INFO:tasks.cephadm:Deploying osd.9 on smithi082 with /dev/vg_nvme/lv_1... 2024-05-08T05:43:12.197 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-08T05:43:12.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:11 smithi082 ceph-mon[30098]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T05:43:12.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:11 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:12.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:11 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:12.631 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:43:13.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:12 smithi134 ceph-mon[34132]: from='osd.8 [v2:172.21.15.151:6816/787870717,v1:172.21.15.151:6817/787870717]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-08T05:43:13.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:12 smithi134 ceph-mon[34132]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-08T05:43:13.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:12 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:13.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:12 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:13.003 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:12 smithi082 ceph-mon[30098]: from='osd.8 [v2:172.21.15.151:6816/787870717,v1:172.21.15.151:6817/787870717]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-08T05:43:13.003 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:12 smithi082 ceph-mon[30098]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-08T05:43:13.003 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:12 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:13.003 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:12 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:13.063 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:12 smithi151 ceph-mon[34815]: from='osd.8 [v2:172.21.15.151:6816/787870717,v1:172.21.15.151:6817/787870717]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-08T05:43:13.063 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:12 smithi151 ceph-mon[34815]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-08T05:43:13.063 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:12 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:13.063 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:12 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:13.947 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:13 smithi151 ceph-mon[34815]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T05:43:13.947 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:13 smithi151 ceph-mon[34815]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-08T05:43:13.948 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:13 smithi151 ceph-mon[34815]: from='osd.8 [v2:172.21.15.151:6816/787870717,v1:172.21.15.151:6817/787870717]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-05-08T05:43:13.948 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:13 smithi151 ceph-mon[34815]: osdmap e52: 9 total, 8 up, 9 in 2024-05-08T05:43:13.948 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:13 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T05:43:13.948 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:13 smithi151 ceph-mon[34815]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-05-08T05:43:13.948 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 05:43:13 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T05:43:13.769+0000 7f42b6dc2700 -1 osd.8 0 waiting for initial osdmap 2024-05-08T05:43:13.948 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 05:43:13 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T05:43:13.778+0000 7f42b2bb5700 -1 osd.8 53 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T05:43:13.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:13 smithi082 ceph-mon[30098]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T05:43:13.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:13 smithi082 ceph-mon[30098]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-08T05:43:13.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:13 smithi082 ceph-mon[30098]: from='osd.8 [v2:172.21.15.151:6816/787870717,v1:172.21.15.151:6817/787870717]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-05-08T05:43:13.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:13 smithi082 ceph-mon[30098]: osdmap e52: 9 total, 8 up, 9 in 2024-05-08T05:43:13.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:13 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T05:43:13.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:13 smithi082 ceph-mon[30098]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-05-08T05:43:14.185 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:13 smithi134 ceph-mon[34132]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T05:43:14.186 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:13 smithi134 ceph-mon[34132]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-08T05:43:14.186 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:13 smithi134 ceph-mon[34132]: from='osd.8 [v2:172.21.15.151:6816/787870717,v1:172.21.15.151:6817/787870717]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-05-08T05:43:14.186 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:13 smithi134 ceph-mon[34132]: osdmap e52: 9 total, 8 up, 9 in 2024-05-08T05:43:14.186 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:13 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T05:43:14.186 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:13 smithi134 ceph-mon[34132]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-05-08T05:43:14.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:14 smithi082 ceph-mon[30098]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2024-05-08T05:43:14.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:14 smithi082 ceph-mon[30098]: osdmap e53: 9 total, 8 up, 9 in 2024-05-08T05:43:14.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:14 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T05:43:14.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:14 smithi082 ceph-mon[30098]: osd.8 [v2:172.21.15.151:6816/787870717,v1:172.21.15.151:6817/787870717] boot 2024-05-08T05:43:14.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:14 smithi082 ceph-mon[30098]: osdmap e54: 9 total, 9 up, 9 in 2024-05-08T05:43:14.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:14 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T05:43:15.066 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:14 smithi151 ceph-mon[34815]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2024-05-08T05:43:15.067 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:14 smithi151 ceph-mon[34815]: osdmap e53: 9 total, 8 up, 9 in 2024-05-08T05:43:15.067 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:14 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T05:43:15.067 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:14 smithi151 ceph-mon[34815]: osd.8 [v2:172.21.15.151:6816/787870717,v1:172.21.15.151:6817/787870717] boot 2024-05-08T05:43:15.067 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:14 smithi151 ceph-mon[34815]: osdmap e54: 9 total, 9 up, 9 in 2024-05-08T05:43:15.067 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:14 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T05:43:15.126 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:14 smithi134 ceph-mon[34132]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2024-05-08T05:43:15.126 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:14 smithi134 ceph-mon[34132]: osdmap e53: 9 total, 8 up, 9 in 2024-05-08T05:43:15.127 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:14 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T05:43:15.127 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:14 smithi134 ceph-mon[34132]: osd.8 [v2:172.21.15.151:6816/787870717,v1:172.21.15.151:6817/787870717] boot 2024-05-08T05:43:15.127 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:14 smithi134 ceph-mon[34132]: osdmap e54: 9 total, 9 up, 9 in 2024-05-08T05:43:15.127 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:14 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-08T05:43:15.530 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-08T05:43:15.530 INFO:teuthology.orchestra.run.smithi082.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-08T05:43:15.530 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10+0 records in 2024-05-08T05:43:15.530 INFO:teuthology.orchestra.run.smithi082.stderr:10+0 records out 2024-05-08T05:43:15.530 INFO:teuthology.orchestra.run.smithi082.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0338456 s, 310 MB/s 2024-05-08T05:43:15.530 INFO:teuthology.orchestra.run.smithi082.stderr:--> Zapping successful for: 2024-05-08T05:43:16.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:15 smithi151 ceph-mon[34815]: purged_snaps scrub starts 2024-05-08T05:43:16.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:15 smithi151 ceph-mon[34815]: purged_snaps scrub ok 2024-05-08T05:43:16.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:15 smithi151 ceph-mon[34815]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T05:43:16.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:15 smithi151 ceph-mon[34815]: osdmap e55: 9 total, 9 up, 9 in 2024-05-08T05:43:16.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:15 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:16.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:15 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:16.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:15 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:43:16.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:15 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:43:16.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:15 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:43:16.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:15 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:16.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:15 smithi082 ceph-mon[30098]: purged_snaps scrub starts 2024-05-08T05:43:16.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:15 smithi082 ceph-mon[30098]: purged_snaps scrub ok 2024-05-08T05:43:16.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:15 smithi082 ceph-mon[30098]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T05:43:16.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:15 smithi082 ceph-mon[30098]: osdmap e55: 9 total, 9 up, 9 in 2024-05-08T05:43:16.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:15 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:16.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:15 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:16.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:15 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:43:16.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:15 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:43:16.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:15 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:43:16.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:15 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:16.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:15 smithi134 ceph-mon[34132]: purged_snaps scrub starts 2024-05-08T05:43:16.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:15 smithi134 ceph-mon[34132]: purged_snaps scrub ok 2024-05-08T05:43:16.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:15 smithi134 ceph-mon[34132]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 227 MiB used, 715 GiB / 715 GiB avail 2024-05-08T05:43:16.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:15 smithi134 ceph-mon[34132]: osdmap e55: 9 total, 9 up, 9 in 2024-05-08T05:43:16.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:15 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:16.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:15 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:16.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:15 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:43:16.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:15 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:43:16.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:15 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:43:16.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:15 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:16.453 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi082:vg_nvme/lv_1 2024-05-08T05:43:16.904 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:43:17.051 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:16 smithi082 ceph-mon[30098]: Detected new or changed devices on smithi151 2024-05-08T05:43:17.051 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:16 smithi082 ceph-mon[30098]: Adjusting osd_memory_target on smithi151 to 5696M 2024-05-08T05:43:17.051 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:16 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:43:17.051 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:16 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:43:17.051 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:16 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:17.051 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:16 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:43:17.051 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:16 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:43:17.051 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:16 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:43:17.051 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:16 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:17.051 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:16 smithi082 ceph-mon[30098]: osdmap e56: 9 total, 9 up, 9 in 2024-05-08T05:43:17.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:16 smithi151 ceph-mon[34815]: Detected new or changed devices on smithi151 2024-05-08T05:43:17.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:16 smithi151 ceph-mon[34815]: Adjusting osd_memory_target on smithi151 to 5696M 2024-05-08T05:43:17.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:16 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:43:17.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:16 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:43:17.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:16 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:17.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:16 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:43:17.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:16 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:43:17.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:16 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:43:17.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:16 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:17.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:16 smithi151 ceph-mon[34815]: osdmap e56: 9 total, 9 up, 9 in 2024-05-08T05:43:17.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:16 smithi134 ceph-mon[34132]: Detected new or changed devices on smithi151 2024-05-08T05:43:17.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:16 smithi134 ceph-mon[34132]: Adjusting osd_memory_target on smithi151 to 5696M 2024-05-08T05:43:17.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:16 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:43:17.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:16 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:43:17.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:16 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:17.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:16 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:43:17.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:16 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:43:17.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:16 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:43:17.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:16 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:17.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:16 smithi134 ceph-mon[34132]: osdmap e56: 9 total, 9 up, 9 in 2024-05-08T05:43:17.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:17 smithi082 ceph-mon[30098]: pgmap v211: 1 pgs: 1 peering; 577 KiB data, 254 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:43:18.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:17 smithi151 ceph-mon[34815]: pgmap v211: 1 pgs: 1 peering; 577 KiB data, 254 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:43:18.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:17 smithi134 ceph-mon[34132]: pgmap v211: 1 pgs: 1 peering; 577 KiB data, 254 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:43:19.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:43:19.189+0000 7f41af600700 1 -- 172.21.15.82:0/3952412361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41a8106940 msgr2=0x7f41a8106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:43:19.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:43:19.189+0000 7f41af600700 1 --2- 172.21.15.82:0/3952412361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41a8106940 0x7f41a8106da0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4194009990 tx=0x7f4194009ca0 comp rx=0 tx=0).stop 2024-05-08T05:43:19.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:43:19.189+0000 7f41af600700 1 -- 172.21.15.82:0/3952412361 shutdown_connections 2024-05-08T05:43:19.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:43:19.189+0000 7f41af600700 1 --2- 172.21.15.82:0/3952412361 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41a81072e0 0x7f41a810db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:43:19.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:43:19.189+0000 7f41af600700 1 --2- 172.21.15.82:0/3952412361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41a8105740 0x7f41a8105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:43:19.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:43:19.189+0000 7f41af600700 1 --2- 172.21.15.82:0/3952412361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41a8106940 0x7f41a8106da0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:43:19.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:43:19.189+0000 7f41af600700 1 -- 172.21.15.82:0/3952412361 >> 172.21.15.82:0/3952412361 conn(0x7f41a8100d00 msgr2=0x7f41a8103120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:43:19.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:43:19.189+0000 7f41af600700 1 -- 172.21.15.82:0/3952412361 shutdown_connections 2024-05-08T05:43:19.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:43:19.189+0000 7f41af600700 1 -- 172.21.15.82:0/3952412361 wait complete. 2024-05-08T05:43:19.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:43:19.190+0000 7f41af600700 1 Processor -- start 2024-05-08T05:43:19.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:43:19.191+0000 7f41af600700 1 -- start start 2024-05-08T05:43:19.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:43:19.191+0000 7f41af600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41a8105740 0x7f41a819b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:43:19.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:43:19.191+0000 7f41af600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41a8106940 0x7f41a819be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:43:19.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:43:19.191+0000 7f41af600700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41a81072e0 0x7f41a81a2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:43:19.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:43:19.191+0000 7f41af600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f41a8111230 con 0x7f41a8106940 2024-05-08T05:43:19.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:43:19.191+0000 7f41af600700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f41a81110b0 con 0x7f41a8105740 2024-05-08T05:43:19.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:43:19.191+0000 7f41af600700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f41a81113b0 con 0x7f41a81072e0 2024-05-08T05:43:19.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:43:19.191+0000 7f41a7e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41a8106940 0x7f41a819be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:43:19.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:43:19.191+0000 7f41a7e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41a8106940 0x7f41a819be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52020/0 (socket says 172.21.15.82:52020) 2024-05-08T05:43:19.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:43:19.191+0000 7f41acc00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41a8105740 0x7f41a819b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:43:19.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:43:19.191+0000 7f41a7e00700 1 -- 172.21.15.82:0/183346939 learned_addr learned my addr 172.21.15.82:0/183346939 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:43:19.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:43:19.191+0000 7f41ad600700 1 --2- 172.21.15.82:0/183346939 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41a81072e0 0x7f41a81a2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:43:19.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:43:19.192+0000 7f41a7e00700 1 -- 172.21.15.82:0/183346939 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41a81072e0 msgr2=0x7f41a81a2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:43:19.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:43:19.192+0000 7f41a7e00700 1 --2- 172.21.15.82:0/183346939 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41a81072e0 0x7f41a81a2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:43:19.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:43:19.192+0000 7f41a7e00700 1 -- 172.21.15.82:0/183346939 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41a8105740 msgr2=0x7f41a819b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:43:19.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:43:19.192+0000 7f41a7e00700 1 --2- 172.21.15.82:0/183346939 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41a8105740 0x7f41a819b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:43:19.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:43:19.192+0000 7f41a7e00700 1 -- 172.21.15.82:0/183346939 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41a81a3490 con 0x7f41a8106940 2024-05-08T05:43:19.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:43:19.192+0000 7f41a7e00700 1 --2- 172.21.15.82:0/183346939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41a8106940 0x7f41a819be10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4194000c00 tx=0x7f41940057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:43:19.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:43:19.192+0000 7f41a5600700 1 -- 172.21.15.82:0/183346939 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4194026070 con 0x7f41a8106940 2024-05-08T05:43:19.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:43:19.192+0000 7f41a5600700 1 -- 172.21.15.82:0/183346939 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4194021410 con 0x7f41a8106940 2024-05-08T05:43:19.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:43:19.192+0000 7f41af600700 1 -- 172.21.15.82:0/183346939 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41a81a3720 con 0x7f41a8106940 2024-05-08T05:43:19.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:43:19.192+0000 7f41a5600700 1 -- 172.21.15.82:0/183346939 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4194017650 con 0x7f41a8106940 2024-05-08T05:43:19.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:43:19.193+0000 7f41af600700 1 -- 172.21.15.82:0/183346939 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41a81a3bd0 con 0x7f41a8106940 2024-05-08T05:43:19.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:43:19.194+0000 7f41af600700 1 -- 172.21.15.82:0/183346939 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41a806a190 con 0x7f41a8106940 2024-05-08T05:43:19.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:43:19.196+0000 7f41a5600700 1 -- 172.21.15.82:0/183346939 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f4194029070 con 0x7f41a8106940 2024-05-08T05:43:19.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:43:19.197+0000 7f41a5600700 1 --2- 172.21.15.82:0/183346939 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f41900b2900 0x7f41900b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:43:19.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:43:19.198+0000 7f41a5600700 1 -- 172.21.15.82:0/183346939 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5829+0+0 (secure 0 0 0) 0x7f41940e2780 con 0x7f41a8106940 2024-05-08T05:43:19.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:43:19.198+0000 7f41acc00700 1 --2- 172.21.15.82:0/183346939 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f41900b2900 0x7f41900b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:43:19.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:43:19.198+0000 7f41acc00700 1 --2- 172.21.15.82:0/183346939 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f41900b2900 0x7f41900b4dc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f41a81067a0 tx=0x7f419c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:43:19.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:43:19.202+0000 7f41a5600700 1 -- 172.21.15.82:0/183346939 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4194013070 con 0x7f41a8106940 2024-05-08T05:43:19.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:43:19.443+0000 7f41af600700 1 -- 172.21.15.82:0/183346939 --> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f41a80639a0 con 0x7f41900b2900 2024-05-08T05:43:20.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:19 smithi151 ceph-mon[34815]: pgmap v213: 1 pgs: 1 peering; 577 KiB data, 254 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:43:20.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:19 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:43:20.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:19 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:43:20.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:19 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:43:20.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:19 smithi082 ceph-mon[30098]: pgmap v213: 1 pgs: 1 peering; 577 KiB data, 254 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:43:20.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:19 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:43:20.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:19 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:43:20.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:19 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:43:20.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:19 smithi134 ceph-mon[34132]: pgmap v213: 1 pgs: 1 peering; 577 KiB data, 254 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:43:20.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:19 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:43:20.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:19 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:43:20.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:19 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:43:21.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:20 smithi151 ceph-mon[34815]: from='client.14307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:43:21.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:20 smithi082 ceph-mon[30098]: from='client.14307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:43:21.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:20 smithi134 ceph-mon[34132]: from='client.14307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi082:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:43:22.114 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:21 smithi082 ceph-mon[30098]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-08T05:43:22.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:21 smithi151 ceph-mon[34815]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-08T05:43:22.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:21 smithi134 ceph-mon[34132]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-08T05:43:24.022 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:23 smithi082 ceph-mon[30098]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-05-08T05:43:24.022 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:23 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/450509382' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea0070c1-286a-47d3-90cf-d1fada6e3cda"}]: dispatch 2024-05-08T05:43:24.022 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:23 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/450509382' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ea0070c1-286a-47d3-90cf-d1fada6e3cda"}]': finished 2024-05-08T05:43:24.022 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:23 smithi082 ceph-mon[30098]: osdmap e57: 10 total, 9 up, 10 in 2024-05-08T05:43:24.022 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:23 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T05:43:24.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:23 smithi151 ceph-mon[34815]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-05-08T05:43:24.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:23 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/450509382' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea0070c1-286a-47d3-90cf-d1fada6e3cda"}]: dispatch 2024-05-08T05:43:24.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:23 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/450509382' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ea0070c1-286a-47d3-90cf-d1fada6e3cda"}]': finished 2024-05-08T05:43:24.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:23 smithi151 ceph-mon[34815]: osdmap e57: 10 total, 9 up, 10 in 2024-05-08T05:43:24.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:23 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T05:43:24.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:23 smithi134 ceph-mon[34132]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-05-08T05:43:24.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:23 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/450509382' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea0070c1-286a-47d3-90cf-d1fada6e3cda"}]: dispatch 2024-05-08T05:43:24.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:23 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/450509382' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ea0070c1-286a-47d3-90cf-d1fada6e3cda"}]': finished 2024-05-08T05:43:24.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:23 smithi134 ceph-mon[34132]: osdmap e57: 10 total, 9 up, 10 in 2024-05-08T05:43:24.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:23 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T05:43:25.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:24 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/1109411333' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:43:25.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:24 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/1109411333' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:43:25.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:24 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/1109411333' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:43:26.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:25 smithi151 ceph-mon[34815]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-08T05:43:26.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:25 smithi082 ceph-mon[30098]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-08T05:43:26.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:25 smithi134 ceph-mon[34132]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-08T05:43:27.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:27 smithi082 ceph-mon[30098]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-05-08T05:43:28.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:27 smithi151 ceph-mon[34815]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-05-08T05:43:28.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:27 smithi134 ceph-mon[34132]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-05-08T05:43:30.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:29 smithi151 ceph-mon[34815]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T05:43:30.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:29 smithi082 ceph-mon[30098]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T05:43:30.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:29 smithi134 ceph-mon[34132]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T05:43:32.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:31 smithi151 ceph-mon[34815]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:43:32.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:31 smithi082 ceph-mon[30098]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:43:32.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:31 smithi134 ceph-mon[34132]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:43:33.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:32 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-08T05:43:33.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:32 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:43:33.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:32 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-08T05:43:33.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:32 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:43:33.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:32 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-08T05:43:33.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:32 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:43:34.108 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:33 smithi082 ceph-mon[30098]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:43:34.108 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:33 smithi082 ceph-mon[30098]: Deploying daemon osd.9 on smithi082 2024-05-08T05:43:34.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:33 smithi151 ceph-mon[34815]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:43:34.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:33 smithi151 ceph-mon[34815]: Deploying daemon osd.9 on smithi082 2024-05-08T05:43:34.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:33 smithi134 ceph-mon[34132]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:43:34.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:33 smithi134 ceph-mon[34132]: Deploying daemon osd.9 on smithi082 2024-05-08T05:43:35.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:35 smithi082 ceph-mon[30098]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:43:36.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:35 smithi151 ceph-mon[34815]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:43:36.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:35 smithi134 ceph-mon[34132]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:43:38.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:37 smithi151 ceph-mon[34815]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:43:38.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:37 smithi082 ceph-mon[30098]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:43:38.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:37 smithi134 ceph-mon[34132]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:43:40.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:39 smithi082 ceph-mon[30098]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:43:40.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:39 smithi134 ceph-mon[34132]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:43:40.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:39 smithi151 ceph-mon[34815]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:43:41.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:41 smithi082 ceph-mon[30098]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:43:41.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:41 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:41.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:41 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:41.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:41 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:43:42.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:41 smithi134 ceph-mon[34132]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:43:42.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:41 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:42.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:41 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:42.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:41 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:43:42.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:41 smithi151 ceph-mon[34815]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:43:42.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:41 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:42.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:41 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:42.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:41 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:43:43.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:42 smithi082 ceph-mon[30098]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:43:43.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:42 smithi134 ceph-mon[34132]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:43:43.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:42 smithi151 ceph-mon[34815]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:43:45.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:45 smithi082 ceph-mon[30098]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:43:45.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:45 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:45.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:45 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:45.364 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:45 smithi134 ceph-mon[34132]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:43:45.364 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:45 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:45.364 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:45 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:45.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:45 smithi151 ceph-mon[34815]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:43:45.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:45 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:45.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:45 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:46.192 INFO:teuthology.orchestra.run.smithi082.stdout:Created osd(s) 9 on host 'smithi082' 2024-05-08T05:43:46.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:43:46.191+0000 7f41a5600700 1 -- 172.21.15.82:0/183346939 <== mgr.14152 v2:172.21.15.82:6800/4089180091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f41a80639a0 con 0x7f41900b2900 2024-05-08T05:43:46.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:43:46.194+0000 7f41af600700 1 -- 172.21.15.82:0/183346939 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f41900b2900 msgr2=0x7f41900b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:43:46.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:43:46.194+0000 7f41af600700 1 --2- 172.21.15.82:0/183346939 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f41900b2900 0x7f41900b4dc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f41a81067a0 tx=0x7f419c009260 comp rx=0 tx=0).stop 2024-05-08T05:43:46.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:43:46.194+0000 7f41af600700 1 -- 172.21.15.82:0/183346939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41a8106940 msgr2=0x7f41a819be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:43:46.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:43:46.194+0000 7f41af600700 1 --2- 172.21.15.82:0/183346939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41a8106940 0x7f41a819be10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4194000c00 tx=0x7f41940057c0 comp rx=0 tx=0).stop 2024-05-08T05:43:46.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:43:46.194+0000 7f41af600700 1 -- 172.21.15.82:0/183346939 shutdown_connections 2024-05-08T05:43:46.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:43:46.194+0000 7f41af600700 1 --2- 172.21.15.82:0/183346939 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41a8105740 0x7f41a819b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:43:46.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:43:46.194+0000 7f41af600700 1 --2- 172.21.15.82:0/183346939 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f41900b2900 0x7f41900b4dc0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:43:46.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:43:46.194+0000 7f41af600700 1 --2- 172.21.15.82:0/183346939 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41a81072e0 0x7f41a81a2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:43:46.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:43:46.194+0000 7f41af600700 1 --2- 172.21.15.82:0/183346939 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f41a8106940 0x7f41a819be10 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:43:46.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:43:46.194+0000 7f41af600700 1 -- 172.21.15.82:0/183346939 >> 172.21.15.82:0/183346939 conn(0x7f41a8100d00 msgr2=0x7f41a8109c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:43:46.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:43:46.194+0000 7f41af600700 1 -- 172.21.15.82:0/183346939 shutdown_connections 2024-05-08T05:43:46.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:43:46.194+0000 7f41af600700 1 -- 172.21.15.82:0/183346939 wait complete. 2024-05-08T05:43:46.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:46 smithi151 ceph-mon[34815]: from='osd.9 [v2:172.21.15.82:6826/533124002,v1:172.21.15.82:6827/533124002]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-08T05:43:46.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:46 smithi151 ceph-mon[34815]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-08T05:43:46.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:46 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:43:46.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:46 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:43:46.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:46 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:46.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:46 smithi082 ceph-mon[30098]: from='osd.9 [v2:172.21.15.82:6826/533124002,v1:172.21.15.82:6827/533124002]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-08T05:43:46.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:46 smithi082 ceph-mon[30098]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-08T05:43:46.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:46 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:43:46.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:46 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:43:46.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:46 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:46.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:46 smithi134 ceph-mon[34132]: from='osd.9 [v2:172.21.15.82:6826/533124002,v1:172.21.15.82:6827/533124002]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-08T05:43:46.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:46 smithi134 ceph-mon[34132]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-08T05:43:46.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:46 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:43:46.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:46 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:43:46.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:46 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:47.005 DEBUG:teuthology.orchestra.run.smithi082:osd.9> sudo journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@osd.9.service 2024-05-08T05:43:47.009 INFO:tasks.cephadm:Deploying osd.10 on smithi134 with /dev/vg_nvme/lv_1... 2024-05-08T05:43:47.009 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-08T05:43:47.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:47 smithi082 ceph-mon[30098]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:43:47.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:47 smithi082 ceph-mon[30098]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-08T05:43:47.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:47 smithi082 ceph-mon[30098]: osdmap e58: 10 total, 9 up, 10 in 2024-05-08T05:43:47.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:47 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T05:43:47.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:47 smithi082 ceph-mon[30098]: from='osd.9 [v2:172.21.15.82:6826/533124002,v1:172.21.15.82:6827/533124002]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-05-08T05:43:47.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:47 smithi082 ceph-mon[30098]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-05-08T05:43:47.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:47 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:47.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:47 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:47.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:47 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:43:47.222 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 05:43:47 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T05:43:47.134+0000 7fee2ec00700 -1 osd.9 0 waiting for initial osdmap 2024-05-08T05:43:47.222 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 05:43:47 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T05:43:47.158+0000 7fee29a00700 -1 osd.9 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T05:43:47.258 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T05:43:47.380 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:47 smithi134 ceph-mon[34132]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:43:47.381 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:47 smithi134 ceph-mon[34132]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-08T05:43:47.381 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:47 smithi134 ceph-mon[34132]: osdmap e58: 10 total, 9 up, 10 in 2024-05-08T05:43:47.381 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:47 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T05:43:47.381 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:47 smithi134 ceph-mon[34132]: from='osd.9 [v2:172.21.15.82:6826/533124002,v1:172.21.15.82:6827/533124002]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-05-08T05:43:47.381 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:47 smithi134 ceph-mon[34132]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-05-08T05:43:47.381 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:47 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:47.381 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:47 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:47.381 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:47 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:43:47.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:47 smithi151 ceph-mon[34815]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:43:47.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:47 smithi151 ceph-mon[34815]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-08T05:43:47.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:47 smithi151 ceph-mon[34815]: osdmap e58: 10 total, 9 up, 10 in 2024-05-08T05:43:47.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:47 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T05:43:47.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:47 smithi151 ceph-mon[34815]: from='osd.9 [v2:172.21.15.82:6826/533124002,v1:172.21.15.82:6827/533124002]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-05-08T05:43:47.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:47 smithi151 ceph-mon[34815]: from='osd.9 ' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]: dispatch 2024-05-08T05:43:47.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:47 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:47.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:47 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:47.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:47 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:43:48.457 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:48 smithi082 ceph-mon[30098]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-05-08T05:43:48.457 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:48 smithi082 ceph-mon[30098]: osdmap e59: 10 total, 9 up, 10 in 2024-05-08T05:43:48.457 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:48 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T05:43:48.457 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:48 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T05:43:48.477 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:48 smithi134 ceph-mon[34132]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-05-08T05:43:48.477 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:48 smithi134 ceph-mon[34132]: osdmap e59: 10 total, 9 up, 10 in 2024-05-08T05:43:48.477 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:48 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T05:43:48.477 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:48 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T05:43:48.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:48 smithi151 ceph-mon[34815]: from='osd.9 ' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi082", "root=default"]}]': finished 2024-05-08T05:43:48.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:48 smithi151 ceph-mon[34815]: osdmap e59: 10 total, 9 up, 10 in 2024-05-08T05:43:48.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:48 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T05:43:48.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:48 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T05:43:49.359 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:49 smithi134 ceph-mon[34132]: purged_snaps scrub starts 2024-05-08T05:43:49.359 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:49 smithi134 ceph-mon[34132]: purged_snaps scrub ok 2024-05-08T05:43:49.359 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:49 smithi134 ceph-mon[34132]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:43:49.360 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:49 smithi134 ceph-mon[34132]: osd.9 [v2:172.21.15.82:6826/533124002,v1:172.21.15.82:6827/533124002] boot 2024-05-08T05:43:49.360 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:49 smithi134 ceph-mon[34132]: osdmap e60: 10 total, 10 up, 10 in 2024-05-08T05:43:49.360 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:49 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T05:43:49.360 INFO:teuthology.orchestra.run.smithi134.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-08T05:43:49.360 INFO:teuthology.orchestra.run.smithi134.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-08T05:43:49.360 INFO:teuthology.orchestra.run.smithi134.stderr: stderr: 10+0 records in 2024-05-08T05:43:49.360 INFO:teuthology.orchestra.run.smithi134.stderr:10+0 records out 2024-05-08T05:43:49.360 INFO:teuthology.orchestra.run.smithi134.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0112366 s, 933 MB/s 2024-05-08T05:43:49.360 INFO:teuthology.orchestra.run.smithi134.stderr:--> Zapping successful for: 2024-05-08T05:43:49.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:49 smithi082 ceph-mon[30098]: purged_snaps scrub starts 2024-05-08T05:43:49.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:49 smithi082 ceph-mon[30098]: purged_snaps scrub ok 2024-05-08T05:43:49.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:49 smithi082 ceph-mon[30098]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:43:49.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:49 smithi082 ceph-mon[30098]: osd.9 [v2:172.21.15.82:6826/533124002,v1:172.21.15.82:6827/533124002] boot 2024-05-08T05:43:49.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:49 smithi082 ceph-mon[30098]: osdmap e60: 10 total, 10 up, 10 in 2024-05-08T05:43:49.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:49 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T05:43:49.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:49 smithi151 ceph-mon[34815]: purged_snaps scrub starts 2024-05-08T05:43:49.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:49 smithi151 ceph-mon[34815]: purged_snaps scrub ok 2024-05-08T05:43:49.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:49 smithi151 ceph-mon[34815]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 804 GiB / 805 GiB avail 2024-05-08T05:43:49.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:49 smithi151 ceph-mon[34815]: osd.9 [v2:172.21.15.82:6826/533124002,v1:172.21.15.82:6827/533124002] boot 2024-05-08T05:43:49.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:49 smithi151 ceph-mon[34815]: osdmap e60: 10 total, 10 up, 10 in 2024-05-08T05:43:49.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:49 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-08T05:43:50.021 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi134:vg_nvme/lv_1 2024-05-08T05:43:50.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:50 smithi134 ceph-mon[34132]: osdmap e61: 10 total, 10 up, 10 in 2024-05-08T05:43:50.261 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T05:43:50.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:50 smithi082 ceph-mon[30098]: osdmap e61: 10 total, 10 up, 10 in 2024-05-08T05:43:50.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:50 smithi151 ceph-mon[34815]: osdmap e61: 10 total, 10 up, 10 in 2024-05-08T05:43:51.384 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:51 smithi134 ceph-mon[34132]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:43:51.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:51 smithi082 ceph-mon[30098]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:43:51.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:51 smithi151 ceph-mon[34815]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:43:51.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:43:51.929+0000 7fb0db23a700 1 -- 172.21.15.134:0/1946878431 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0d41050a0 msgr2=0x7fb0d410b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:43:51.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:43:51.929+0000 7fb0db23a700 1 --2- 172.21.15.134:0/1946878431 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0d41050a0 0x7fb0d410b950 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc00b0d0 tx=0x7fb0cc00b3e0 comp rx=0 tx=0).stop 2024-05-08T05:43:51.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:43:51.929+0000 7fb0db23a700 1 -- 172.21.15.134:0/1946878431 shutdown_connections 2024-05-08T05:43:51.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:43:51.929+0000 7fb0db23a700 1 --2- 172.21.15.134:0/1946878431 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0d41050a0 0x7fb0d410b950 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:43:51.931 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:43:51.929+0000 7fb0db23a700 1 --2- 172.21.15.134:0/1946878431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0d4103500 0x7fb0d4103920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:43:51.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:43:51.929+0000 7fb0db23a700 1 --2- 172.21.15.134:0/1946878431 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0d4104700 0x7fb0d4104b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:43:51.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:43:51.929+0000 7fb0db23a700 1 -- 172.21.15.134:0/1946878431 >> 172.21.15.134:0/1946878431 conn(0x7fb0d40feaa0 msgr2=0x7fb0d4100ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:43:51.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:43:51.929+0000 7fb0db23a700 1 -- 172.21.15.134:0/1946878431 shutdown_connections 2024-05-08T05:43:51.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:43:51.929+0000 7fb0db23a700 1 -- 172.21.15.134:0/1946878431 wait complete. 2024-05-08T05:43:51.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:43:51.929+0000 7fb0db23a700 1 Processor -- start 2024-05-08T05:43:51.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:43:51.929+0000 7fb0db23a700 1 -- start start 2024-05-08T05:43:51.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:43:51.929+0000 7fb0db23a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0d4103500 0x7fb0d4199760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:43:51.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:43:51.929+0000 7fb0db23a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0d4104700 0x7fb0d4199ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:43:51.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:43:51.929+0000 7fb0db23a700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0d41050a0 0x7fb0d41a0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:43:51.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:43:51.929+0000 7fb0db23a700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d410f090 con 0x7fb0d41050a0 2024-05-08T05:43:51.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:43:51.929+0000 7fb0db23a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d410ef10 con 0x7fb0d4104700 2024-05-08T05:43:51.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:43:51.929+0000 7fb0db23a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d410f210 con 0x7fb0d4103500 2024-05-08T05:43:51.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:43:51.930+0000 7fb0d3fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0d4104700 0x7fb0d4199ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:43:51.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:43:51.930+0000 7fb0d3fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0d4104700 0x7fb0d4199ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:52456/0 (socket says 172.21.15.134:52456) 2024-05-08T05:43:51.932 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:43:51.930+0000 7fb0d3fff700 1 -- 172.21.15.134:0/1281368786 learned_addr learned my addr 172.21.15.134:0/1281368786 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-05-08T05:43:51.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:43:51.930+0000 7fb0d8fd6700 1 --2- 172.21.15.134:0/1281368786 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0d4103500 0x7fb0d4199760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:43:51.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:43:51.930+0000 7fb0d97d7700 1 --2- 172.21.15.134:0/1281368786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0d41050a0 0x7fb0d41a0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:43:51.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:43:51.930+0000 7fb0d3fff700 1 -- 172.21.15.134:0/1281368786 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0d4103500 msgr2=0x7fb0d4199760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:43:51.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:43:51.930+0000 7fb0d3fff700 1 --2- 172.21.15.134:0/1281368786 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0d4103500 0x7fb0d4199760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:43:51.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:43:51.930+0000 7fb0d3fff700 1 -- 172.21.15.134:0/1281368786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0d41050a0 msgr2=0x7fb0d41a0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:43:51.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:43:51.930+0000 7fb0d3fff700 1 --2- 172.21.15.134:0/1281368786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0d41050a0 0x7fb0d41a0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:43:51.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:43:51.930+0000 7fb0d3fff700 1 -- 172.21.15.134:0/1281368786 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0d41a13c0 con 0x7fb0d4104700 2024-05-08T05:43:51.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:43:51.930+0000 7fb0d97d7700 1 --2- 172.21.15.134:0/1281368786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0d41050a0 0x7fb0d41a0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:43:51.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:43:51.930+0000 7fb0d3fff700 1 --2- 172.21.15.134:0/1281368786 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0d4104700 0x7fb0d4199ca0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb0c000b530 tx=0x7fb0c000b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:43:51.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:43:51.930+0000 7fb0d1ffb700 1 -- 172.21.15.134:0/1281368786 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c0015020 con 0x7fb0d4104700 2024-05-08T05:43:51.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:43:51.930+0000 7fb0d1ffb700 1 -- 172.21.15.134:0/1281368786 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb0c0011ce0 con 0x7fb0d4104700 2024-05-08T05:43:51.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:43:51.930+0000 7fb0db23a700 1 -- 172.21.15.134:0/1281368786 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0d41a16b0 con 0x7fb0d4104700 2024-05-08T05:43:51.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:43:51.930+0000 7fb0d1ffb700 1 -- 172.21.15.134:0/1281368786 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c0010d50 con 0x7fb0d4104700 2024-05-08T05:43:51.933 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:43:51.931+0000 7fb0db23a700 1 -- 172.21.15.134:0/1281368786 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0d41a1c70 con 0x7fb0d4104700 2024-05-08T05:43:51.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:43:51.931+0000 7fb0db23a700 1 -- 172.21.15.134:0/1281368786 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0d406a190 con 0x7fb0d4104700 2024-05-08T05:43:51.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:43:51.932+0000 7fb0d1ffb700 1 -- 172.21.15.134:0/1281368786 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fb0c0018020 con 0x7fb0d4104700 2024-05-08T05:43:51.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:43:51.933+0000 7fb0d1ffb700 1 --2- 172.21.15.134:0/1281368786 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb0c40b2880 0x7fb0c40b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:43:51.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:43:51.933+0000 7fb0d1ffb700 1 -- 172.21.15.134:0/1281368786 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6261+0+0 (secure 0 0 0) 0x7fb0c00e1230 con 0x7fb0d4104700 2024-05-08T05:43:51.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:43:51.933+0000 7fb0d8fd6700 1 --2- 172.21.15.134:0/1281368786 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb0c40b2880 0x7fb0c40b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:43:51.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:43:51.934+0000 7fb0d8fd6700 1 --2- 172.21.15.134:0/1281368786 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb0c40b2880 0x7fb0c40b4d40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8006fd0 tx=0x7fb0c8008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:43:51.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:43:51.938+0000 7fb0d1ffb700 1 -- 172.21.15.134:0/1281368786 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb0c001f020 con 0x7fb0d4104700 2024-05-08T05:43:52.152 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:43:52.152+0000 7fb0db23a700 1 -- 172.21.15.134:0/1281368786 --> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fb0d40638e0 con 0x7fb0c40b2880 2024-05-08T05:43:53.071 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:52 smithi134 ceph-mon[34132]: Detected new or changed devices on smithi082 2024-05-08T05:43:53.071 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:52 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:53.071 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:52 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:53.071 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:52 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:43:53.071 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:52 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:43:53.072 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:52 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:43:53.072 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:52 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:43:53.072 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:52 smithi134 ceph-mon[34132]: Adjusting osd_memory_target on smithi082 to 4272M 2024-05-08T05:43:53.072 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:52 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:53.072 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:52 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:43:53.072 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:52 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:43:53.072 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:52 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:53.072 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:52 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:43:53.072 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:52 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:43:53.072 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:52 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:43:53.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:52 smithi151 ceph-mon[34815]: Detected new or changed devices on smithi082 2024-05-08T05:43:53.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:52 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:53.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:52 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:53.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:52 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:43:53.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:52 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:43:53.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:52 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:43:53.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:52 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:43:53.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:52 smithi151 ceph-mon[34815]: Adjusting osd_memory_target on smithi082 to 4272M 2024-05-08T05:43:53.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:52 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:53.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:52 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:43:53.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:52 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:43:53.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:52 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:53.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:52 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:43:53.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:52 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:43:53.131 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:52 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:43:53.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:52 smithi082 ceph-mon[30098]: Detected new or changed devices on smithi082 2024-05-08T05:43:53.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:52 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:53.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:52 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:53.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:52 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:43:53.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:52 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:43:53.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:52 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:43:53.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:52 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:43:53.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:52 smithi082 ceph-mon[30098]: Adjusting osd_memory_target on smithi082 to 4272M 2024-05-08T05:43:53.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:52 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:53.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:52 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:43:53.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:52 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:43:53.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:52 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:43:53.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:52 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:43:53.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:52 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:43:53.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:52 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:43:54.119 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:53 smithi134 ceph-mon[34132]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:43:54.119 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:53 smithi134 ceph-mon[34132]: from='client.24353 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:43:54.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:53 smithi082 ceph-mon[30098]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:43:54.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:53 smithi082 ceph-mon[30098]: from='client.24353 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:43:54.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:53 smithi151 ceph-mon[34815]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:43:54.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:53 smithi151 ceph-mon[34815]: from='client.24353 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:43:55.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:54 smithi082 ceph-mon[30098]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:43:55.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:54 smithi134 ceph-mon[34132]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:43:55.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:54 smithi151 ceph-mon[34815]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:43:56.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:55 smithi082 ceph-mon[30098]: from='client.? 172.21.15.134:0/4026337123' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "26ca0a0b-ab9e-472f-bb29-428e8c31e5bd"}]: dispatch 2024-05-08T05:43:56.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:55 smithi082 ceph-mon[30098]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "26ca0a0b-ab9e-472f-bb29-428e8c31e5bd"}]: dispatch 2024-05-08T05:43:56.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:55 smithi082 ceph-mon[30098]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "26ca0a0b-ab9e-472f-bb29-428e8c31e5bd"}]': finished 2024-05-08T05:43:56.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:55 smithi082 ceph-mon[30098]: osdmap e62: 11 total, 10 up, 11 in 2024-05-08T05:43:56.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:55 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T05:43:56.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:55 smithi082 ceph-mon[30098]: from='client.? 172.21.15.134:0/1221445215' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:43:56.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:55 smithi134 ceph-mon[34132]: from='client.? 172.21.15.134:0/4026337123' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "26ca0a0b-ab9e-472f-bb29-428e8c31e5bd"}]: dispatch 2024-05-08T05:43:56.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:55 smithi134 ceph-mon[34132]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "26ca0a0b-ab9e-472f-bb29-428e8c31e5bd"}]: dispatch 2024-05-08T05:43:56.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:55 smithi134 ceph-mon[34132]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "26ca0a0b-ab9e-472f-bb29-428e8c31e5bd"}]': finished 2024-05-08T05:43:56.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:55 smithi134 ceph-mon[34132]: osdmap e62: 11 total, 10 up, 11 in 2024-05-08T05:43:56.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:55 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T05:43:56.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:55 smithi134 ceph-mon[34132]: from='client.? 172.21.15.134:0/1221445215' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:43:56.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:55 smithi151 ceph-mon[34815]: from='client.? 172.21.15.134:0/4026337123' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "26ca0a0b-ab9e-472f-bb29-428e8c31e5bd"}]: dispatch 2024-05-08T05:43:56.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:55 smithi151 ceph-mon[34815]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "26ca0a0b-ab9e-472f-bb29-428e8c31e5bd"}]: dispatch 2024-05-08T05:43:56.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:55 smithi151 ceph-mon[34815]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "26ca0a0b-ab9e-472f-bb29-428e8c31e5bd"}]': finished 2024-05-08T05:43:56.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:55 smithi151 ceph-mon[34815]: osdmap e62: 11 total, 10 up, 11 in 2024-05-08T05:43:56.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:55 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T05:43:56.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:55 smithi151 ceph-mon[34815]: from='client.? 172.21.15.134:0/1221445215' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:43:57.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:56 smithi082 ceph-mon[30098]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:43:57.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:56 smithi134 ceph-mon[34132]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:43:57.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:56 smithi151 ceph-mon[34815]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:43:59.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:43:59 smithi134 ceph-mon[34132]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:43:59.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:43:59 smithi151 ceph-mon[34815]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:43:59.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:43:59 smithi082 ceph-mon[30098]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:44:01.362 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:01 smithi134 ceph-mon[34132]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:44:01.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:01 smithi151 ceph-mon[34815]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:44:01.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:01 smithi082 ceph-mon[30098]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:44:03.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:03 smithi151 ceph-mon[34815]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:44:03.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:03 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-08T05:44:03.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:03 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:44:03.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:03 smithi151 ceph-mon[34815]: Deploying daemon osd.10 on smithi134 2024-05-08T05:44:03.447 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:03 smithi134 ceph-mon[34132]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:44:03.447 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:03 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-08T05:44:03.447 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:03 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:44:03.447 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:03 smithi134 ceph-mon[34132]: Deploying daemon osd.10 on smithi134 2024-05-08T05:44:03.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:03 smithi082 ceph-mon[30098]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:44:03.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:03 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-08T05:44:03.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:03 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:44:03.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:03 smithi082 ceph-mon[30098]: Deploying daemon osd.10 on smithi134 2024-05-08T05:44:05.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:05 smithi082 ceph-mon[30098]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:44:05.499 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:05 smithi134 ceph-mon[34132]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:44:05.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:05 smithi151 ceph-mon[34815]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:44:07.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:07 smithi082 ceph-mon[30098]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:44:07.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:07 smithi134 ceph-mon[34132]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:44:07.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:07 smithi151 ceph-mon[34815]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:44:09.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:09 smithi151 ceph-mon[34815]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:44:09.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:09 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:09.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:09 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:09.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:09 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:44:09.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:09 smithi082 ceph-mon[30098]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:44:09.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:09 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:09.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:09 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:09.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:09 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:44:10.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:09 smithi134 ceph-mon[34132]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:44:10.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:09 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:10.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:09 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:10.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:09 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:44:11.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:11 smithi134 ceph-mon[34132]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:44:11.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:11 smithi151 ceph-mon[34815]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:44:11.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:11 smithi082 ceph-mon[30098]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:44:12.341 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:44:12.340+0000 7fb0d1ffb700 1 -- 172.21.15.134:0/1281368786 <== mgr.14152 v2:172.21.15.82:6800/4089180091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fb0d40638e0 con 0x7fb0c40b2880 2024-05-08T05:44:12.342 INFO:teuthology.orchestra.run.smithi134.stdout:Created osd(s) 10 on host 'smithi134' 2024-05-08T05:44:12.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:44:12.343+0000 7fb0db23a700 1 -- 172.21.15.134:0/1281368786 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb0c40b2880 msgr2=0x7fb0c40b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:44:12.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:44:12.343+0000 7fb0db23a700 1 --2- 172.21.15.134:0/1281368786 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb0c40b2880 0x7fb0c40b4d40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8006fd0 tx=0x7fb0c8008040 comp rx=0 tx=0).stop 2024-05-08T05:44:12.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:44:12.343+0000 7fb0db23a700 1 -- 172.21.15.134:0/1281368786 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0d4104700 msgr2=0x7fb0d4199ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:44:12.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:44:12.343+0000 7fb0db23a700 1 --2- 172.21.15.134:0/1281368786 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0d4104700 0x7fb0d4199ca0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb0c000b530 tx=0x7fb0c000b8f0 comp rx=0 tx=0).stop 2024-05-08T05:44:12.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:44:12.343+0000 7fb0db23a700 1 -- 172.21.15.134:0/1281368786 shutdown_connections 2024-05-08T05:44:12.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:44:12.343+0000 7fb0db23a700 1 --2- 172.21.15.134:0/1281368786 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb0c40b2880 0x7fb0c40b4d40 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:12.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:44:12.343+0000 7fb0db23a700 1 --2- 172.21.15.134:0/1281368786 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0d41050a0 0x7fb0d41a0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:12.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:44:12.343+0000 7fb0db23a700 1 --2- 172.21.15.134:0/1281368786 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0d4103500 0x7fb0d4199760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:12.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:44:12.343+0000 7fb0db23a700 1 --2- 172.21.15.134:0/1281368786 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0d4104700 0x7fb0d4199ca0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:12.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:44:12.343+0000 7fb0db23a700 1 -- 172.21.15.134:0/1281368786 >> 172.21.15.134:0/1281368786 conn(0x7fb0d40feaa0 msgr2=0x7fb0d4107b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:44:12.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:44:12.343+0000 7fb0db23a700 1 -- 172.21.15.134:0/1281368786 shutdown_connections 2024-05-08T05:44:12.344 INFO:teuthology.orchestra.run.smithi134.stderr:2024-05-08T05:44:12.343+0000 7fb0db23a700 1 -- 172.21.15.134:0/1281368786 wait complete. 2024-05-08T05:44:13.012 DEBUG:teuthology.orchestra.run.smithi134:osd.10> sudo journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@osd.10.service 2024-05-08T05:44:13.014 INFO:tasks.cephadm:Deploying osd.11 on smithi151 with /dev/vg_nvme/lv_1... 2024-05-08T05:44:13.014 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-08T05:44:13.260 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T05:44:13.534 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:13 smithi134 ceph-mon[34132]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:44:13.534 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:13 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:13.534 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:13 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:13.534 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:13 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:13.534 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:13 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:13.534 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:13 smithi134 ceph-mon[34132]: from='osd.10 [v2:172.21.15.134:6824/99154842,v1:172.21.15.134:6825/99154842]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-08T05:44:13.534 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:13 smithi134 ceph-mon[34132]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-08T05:44:13.613 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:13 smithi151 ceph-mon[34815]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:44:13.613 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:13 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:13.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:13 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:13.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:13 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:13.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:13 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:13.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:13 smithi151 ceph-mon[34815]: from='osd.10 [v2:172.21.15.134:6824/99154842,v1:172.21.15.134:6825/99154842]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-08T05:44:13.614 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:13 smithi151 ceph-mon[34815]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-08T05:44:13.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:13 smithi082 ceph-mon[30098]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:44:13.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:13 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:13.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:13 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:13.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:13 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:13.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:13 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:13.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:13 smithi082 ceph-mon[30098]: from='osd.10 [v2:172.21.15.134:6824/99154842,v1:172.21.15.134:6825/99154842]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-08T05:44:13.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:13 smithi082 ceph-mon[30098]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-08T05:44:14.467 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:14 smithi134 ceph-mon[34132]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-08T05:44:14.468 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:14 smithi134 ceph-mon[34132]: from='osd.10 [v2:172.21.15.134:6824/99154842,v1:172.21.15.134:6825/99154842]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-05-08T05:44:14.468 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:14 smithi134 ceph-mon[34132]: osdmap e63: 11 total, 10 up, 11 in 2024-05-08T05:44:14.468 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:14 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T05:44:14.468 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:14 smithi134 ceph-mon[34132]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-05-08T05:44:14.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:14 smithi151 ceph-mon[34815]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-08T05:44:14.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:14 smithi151 ceph-mon[34815]: from='osd.10 [v2:172.21.15.134:6824/99154842,v1:172.21.15.134:6825/99154842]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-05-08T05:44:14.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:14 smithi151 ceph-mon[34815]: osdmap e63: 11 total, 10 up, 11 in 2024-05-08T05:44:14.662 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:14 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T05:44:14.663 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:14 smithi151 ceph-mon[34815]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-05-08T05:44:14.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:14 smithi082 ceph-mon[30098]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-08T05:44:14.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:14 smithi082 ceph-mon[30098]: from='osd.10 [v2:172.21.15.134:6824/99154842,v1:172.21.15.134:6825/99154842]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-05-08T05:44:14.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:14 smithi082 ceph-mon[30098]: osdmap e63: 11 total, 10 up, 11 in 2024-05-08T05:44:14.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:14 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T05:44:14.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:14 smithi082 ceph-mon[30098]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-05-08T05:44:15.219 INFO:teuthology.orchestra.run.smithi151.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-08T05:44:15.219 INFO:teuthology.orchestra.run.smithi151.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-08T05:44:15.219 INFO:teuthology.orchestra.run.smithi151.stderr: stderr: 10+0 records in 2024-05-08T05:44:15.219 INFO:teuthology.orchestra.run.smithi151.stderr:10+0 records out 2024-05-08T05:44:15.219 INFO:teuthology.orchestra.run.smithi151.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0114996 s, 912 MB/s 2024-05-08T05:44:15.219 INFO:teuthology.orchestra.run.smithi151.stderr:--> Zapping successful for: 2024-05-08T05:44:15.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 05:44:14 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T05:44:14.886+0000 7fa4e61cf700 -1 osd.10 0 waiting for initial osdmap 2024-05-08T05:44:15.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 05:44:14 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T05:44:14.900+0000 7fa4ddfba700 -1 osd.10 65 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T05:44:15.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:15 smithi082 ceph-mon[30098]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:44:15.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:15 smithi082 ceph-mon[30098]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-05-08T05:44:15.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:15 smithi082 ceph-mon[30098]: osdmap e64: 11 total, 10 up, 11 in 2024-05-08T05:44:15.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:15 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T05:44:15.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:15 smithi082 ceph-mon[30098]: osdmap e65: 11 total, 10 up, 11 in 2024-05-08T05:44:15.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:15 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T05:44:15.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:15 smithi082 ceph-mon[30098]: from='osd.10 ' entity='osd.10' 2024-05-08T05:44:15.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:15 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T05:44:15.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:15 smithi134 ceph-mon[34132]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:44:15.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:15 smithi134 ceph-mon[34132]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-05-08T05:44:15.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:15 smithi134 ceph-mon[34132]: osdmap e64: 11 total, 10 up, 11 in 2024-05-08T05:44:15.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:15 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T05:44:15.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:15 smithi134 ceph-mon[34132]: osdmap e65: 11 total, 10 up, 11 in 2024-05-08T05:44:15.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:15 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T05:44:15.751 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:15 smithi134 ceph-mon[34132]: from='osd.10 ' entity='osd.10' 2024-05-08T05:44:15.751 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:15 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T05:44:15.818 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:15 smithi151 ceph-mon[34815]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:44:15.818 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:15 smithi151 ceph-mon[34815]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-05-08T05:44:15.818 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:15 smithi151 ceph-mon[34815]: osdmap e64: 11 total, 10 up, 11 in 2024-05-08T05:44:15.818 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:15 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T05:44:15.818 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:15 smithi151 ceph-mon[34815]: osdmap e65: 11 total, 10 up, 11 in 2024-05-08T05:44:15.818 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:15 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T05:44:15.818 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:15 smithi151 ceph-mon[34815]: from='osd.10 ' entity='osd.10' 2024-05-08T05:44:15.818 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:15 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T05:44:15.845 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph orch daemon add osd smithi151:vg_nvme/lv_1 2024-05-08T05:44:16.091 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T05:44:16.467 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:16 smithi151 ceph-mon[34815]: purged_snaps scrub starts 2024-05-08T05:44:16.467 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:16 smithi151 ceph-mon[34815]: purged_snaps scrub ok 2024-05-08T05:44:16.467 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:16 smithi151 ceph-mon[34815]: osd.10 [v2:172.21.15.134:6824/99154842,v1:172.21.15.134:6825/99154842] boot 2024-05-08T05:44:16.467 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:16 smithi151 ceph-mon[34815]: osdmap e66: 11 total, 11 up, 11 in 2024-05-08T05:44:16.468 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:16 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T05:44:16.468 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:16 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:16.468 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:16 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:16.468 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:16 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:44:16.468 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:16 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:44:16.468 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:16 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:44:16.468 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:16 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:44:16.468 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:16 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:16.468 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:16 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:44:16.468 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:16 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:44:16.468 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:16 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:16.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:16 smithi082 ceph-mon[30098]: purged_snaps scrub starts 2024-05-08T05:44:16.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:16 smithi082 ceph-mon[30098]: purged_snaps scrub ok 2024-05-08T05:44:16.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:16 smithi082 ceph-mon[30098]: osd.10 [v2:172.21.15.134:6824/99154842,v1:172.21.15.134:6825/99154842] boot 2024-05-08T05:44:16.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:16 smithi082 ceph-mon[30098]: osdmap e66: 11 total, 11 up, 11 in 2024-05-08T05:44:16.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:16 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T05:44:16.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:16 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:16.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:16 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:16.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:16 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:44:16.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:16 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:44:16.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:16 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:44:16.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:16 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:44:16.722 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:16 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:16.722 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:16 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:44:16.722 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:16 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:44:16.722 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:16 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:16.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:16 smithi134 ceph-mon[34132]: purged_snaps scrub starts 2024-05-08T05:44:16.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:16 smithi134 ceph-mon[34132]: purged_snaps scrub ok 2024-05-08T05:44:16.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:16 smithi134 ceph-mon[34132]: osd.10 [v2:172.21.15.134:6824/99154842,v1:172.21.15.134:6825/99154842] boot 2024-05-08T05:44:16.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:16 smithi134 ceph-mon[34132]: osdmap e66: 11 total, 11 up, 11 in 2024-05-08T05:44:16.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:16 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-08T05:44:16.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:16 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:16.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:16 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:16.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:16 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:44:16.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:16 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:44:16.751 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:16 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:44:16.751 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:16 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:44:16.751 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:16 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:16.751 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:16 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:44:16.751 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:16 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:44:16.751 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:16 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:17.479 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:17 smithi151 ceph-mon[34815]: pgmap v252: 1 pgs: 1 peering; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:44:17.479 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:17 smithi151 ceph-mon[34815]: Detected new or changed devices on smithi134 2024-05-08T05:44:17.480 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:17 smithi151 ceph-mon[34815]: Adjusting osd_memory_target on smithi134 to 4272M 2024-05-08T05:44:17.480 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:17 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:44:17.480 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:17 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:44:17.480 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:17 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:44:17.480 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:17 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:17.480 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:17 smithi151 ceph-mon[34815]: osdmap e67: 11 total, 11 up, 11 in 2024-05-08T05:44:17.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:17.693+0000 7fbb60ba8700 1 -- 172.21.15.151:0/2735802389 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbb5c1035f0 msgr2=0x7fbb5c103a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:44:17.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:17.693+0000 7fbb60ba8700 1 --2- 172.21.15.151:0/2735802389 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbb5c1035f0 0x7fbb5c103a50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbb50009990 tx=0x7fbb50009ca0 comp rx=0 tx=0).stop 2024-05-08T05:44:17.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:17.693+0000 7fbb60ba8700 1 -- 172.21.15.151:0/2735802389 shutdown_connections 2024-05-08T05:44:17.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:17.693+0000 7fbb60ba8700 1 --2- 172.21.15.151:0/2735802389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb5c103f90 0x7fbb5c10a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:17.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:17.693+0000 7fbb60ba8700 1 --2- 172.21.15.151:0/2735802389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb5c1023f0 0x7fbb5c102810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:17.694 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:17.693+0000 7fbb60ba8700 1 --2- 172.21.15.151:0/2735802389 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbb5c1035f0 0x7fbb5c103a50 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:17.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:17.693+0000 7fbb60ba8700 1 -- 172.21.15.151:0/2735802389 >> 172.21.15.151:0/2735802389 conn(0x7fbb5c0fd990 msgr2=0x7fbb5c0ffdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:44:17.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:17.693+0000 7fbb60ba8700 1 -- 172.21.15.151:0/2735802389 shutdown_connections 2024-05-08T05:44:17.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:17.693+0000 7fbb60ba8700 1 -- 172.21.15.151:0/2735802389 wait complete. 2024-05-08T05:44:17.696 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:17.694+0000 7fbb60ba8700 1 Processor -- start 2024-05-08T05:44:17.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:17.694+0000 7fbb60ba8700 1 -- start start 2024-05-08T05:44:17.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:17.694+0000 7fbb60ba8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb5c1023f0 0x7fbb5c106380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:44:17.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:17.694+0000 7fbb60ba8700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbb5c1035f0 0x7fbb5c1049d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:44:17.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:17.694+0000 7fbb60ba8700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb5c103f90 0x7fbb5c104f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:44:17.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:17.694+0000 7fbb60ba8700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5c10df30 con 0x7fbb5c103f90 2024-05-08T05:44:17.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:17.694+0000 7fbb60ba8700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5c10ddb0 con 0x7fbb5c1023f0 2024-05-08T05:44:17.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:17.694+0000 7fbb60ba8700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fbb5c10e0b0 con 0x7fbb5c1035f0 2024-05-08T05:44:17.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:17.695+0000 7fbb59d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbb5c1035f0 0x7fbb5c1049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:44:17.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:17.695+0000 7fbb59d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbb5c1035f0 0x7fbb5c1049d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:55028/0 (socket says 172.21.15.151:55028) 2024-05-08T05:44:17.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:17.695+0000 7fbb59d9b700 1 -- 172.21.15.151:0/2723453365 learned_addr learned my addr 172.21.15.151:0/2723453365 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-05-08T05:44:17.697 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:17.695+0000 7fbb5a59c700 1 --2- 172.21.15.151:0/2723453365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb5c1023f0 0x7fbb5c106380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:44:17.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:17.695+0000 7fbb59d9b700 1 -- 172.21.15.151:0/2723453365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb5c1023f0 msgr2=0x7fbb5c106380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:44:17.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:17.695+0000 7fbb59d9b700 1 --2- 172.21.15.151:0/2723453365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb5c1023f0 0x7fbb5c106380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:17.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:17.695+0000 7fbb59d9b700 1 -- 172.21.15.151:0/2723453365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb5c103f90 msgr2=0x7fbb5c104f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:44:17.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:17.695+0000 7fbb59d9b700 1 --2- 172.21.15.151:0/2723453365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb5c103f90 0x7fbb5c104f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:17.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:17.695+0000 7fbb59d9b700 1 -- 172.21.15.151:0/2723453365 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb5c1057c0 con 0x7fbb5c1035f0 2024-05-08T05:44:17.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:17.695+0000 7fbb59d9b700 1 --2- 172.21.15.151:0/2723453365 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbb5c1035f0 0x7fbb5c1049d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbb50006010 tx=0x7fbb500047b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:44:17.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:17.695+0000 7fbb4b7fe700 1 -- 172.21.15.151:0/2723453365 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb50027070 con 0x7fbb5c1035f0 2024-05-08T05:44:17.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:17.695+0000 7fbb60ba8700 1 -- 172.21.15.151:0/2723453365 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb5c1a37f0 con 0x7fbb5c1035f0 2024-05-08T05:44:17.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:17.695+0000 7fbb4b7fe700 1 -- 172.21.15.151:0/2723453365 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbb50004100 con 0x7fbb5c1035f0 2024-05-08T05:44:17.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:17.695+0000 7fbb4b7fe700 1 -- 172.21.15.151:0/2723453365 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb50022d70 con 0x7fbb5c1035f0 2024-05-08T05:44:17.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:17.695+0000 7fbb60ba8700 1 -- 172.21.15.151:0/2723453365 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb5c1a3c40 con 0x7fbb5c1035f0 2024-05-08T05:44:17.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:17.696+0000 7fbb60ba8700 1 -- 172.21.15.151:0/2723453365 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb5c06a190 con 0x7fbb5c1035f0 2024-05-08T05:44:17.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:17.698+0000 7fbb4b7fe700 1 -- 172.21.15.151:0/2723453365 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fbb5002a070 con 0x7fbb5c1035f0 2024-05-08T05:44:17.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:17.698+0000 7fbb4b7fe700 1 --2- 172.21.15.151:0/2723453365 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fbb440b2880 0x7fbb440b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:44:17.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:17.698+0000 7fbb4b7fe700 1 -- 172.21.15.151:0/2723453365 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6694+0+0 (secure 0 0 0) 0x7fbb500e2a60 con 0x7fbb5c1035f0 2024-05-08T05:44:17.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:17.699+0000 7fbb5a59c700 1 --2- 172.21.15.151:0/2723453365 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fbb440b2880 0x7fbb440b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:44:17.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:17.700+0000 7fbb5a59c700 1 --2- 172.21.15.151:0/2723453365 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fbb440b2880 0x7fbb440b4d40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c103450 tx=0x7fbb4c009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:44:17.702 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:17.702+0000 7fbb4b7fe700 1 -- 172.21.15.151:0/2723453365 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fbb50013070 con 0x7fbb5c1035f0 2024-05-08T05:44:17.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:17 smithi082 ceph-mon[30098]: pgmap v252: 1 pgs: 1 peering; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:44:17.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:17 smithi082 ceph-mon[30098]: Detected new or changed devices on smithi134 2024-05-08T05:44:17.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:17 smithi082 ceph-mon[30098]: Adjusting osd_memory_target on smithi134 to 4272M 2024-05-08T05:44:17.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:17 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:44:17.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:17 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:44:17.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:17 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:44:17.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:17 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:17.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:17 smithi082 ceph-mon[30098]: osdmap e67: 11 total, 11 up, 11 in 2024-05-08T05:44:17.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:17 smithi134 ceph-mon[34132]: pgmap v252: 1 pgs: 1 peering; 577 KiB data, 282 MiB used, 894 GiB / 894 GiB avail 2024-05-08T05:44:17.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:17 smithi134 ceph-mon[34132]: Detected new or changed devices on smithi134 2024-05-08T05:44:17.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:17 smithi134 ceph-mon[34132]: Adjusting osd_memory_target on smithi134 to 4272M 2024-05-08T05:44:17.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:17 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:44:17.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:17 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:44:17.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:17 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:44:17.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:17 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:17.751 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:17 smithi134 ceph-mon[34132]: osdmap e67: 11 total, 11 up, 11 in 2024-05-08T05:44:17.914 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:17.914+0000 7fbb60ba8700 1 -- 172.21.15.151:0/2723453365 --> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fbb5c0ffbb0 con 0x7fbb440b2880 2024-05-08T05:44:18.859 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:18 smithi151 ceph-mon[34815]: osdmap e68: 11 total, 11 up, 11 in 2024-05-08T05:44:18.859 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:18 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:44:18.859 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:18 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:44:18.859 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:18 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:44:18.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:18 smithi082 ceph-mon[30098]: osdmap e68: 11 total, 11 up, 11 in 2024-05-08T05:44:18.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:18 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:44:18.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:18 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:44:18.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:18 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:44:19.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:18 smithi134 ceph-mon[34132]: osdmap e68: 11 total, 11 up, 11 in 2024-05-08T05:44:19.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:18 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-08T05:44:19.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:18 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-08T05:44:19.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:18 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:44:19.787 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:19 smithi151 ceph-mon[34815]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:44:19.787 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:19 smithi151 ceph-mon[34815]: pgmap v255: 1 pgs: 1 peering; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-05-08T05:44:19.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:19 smithi082 ceph-mon[30098]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:44:19.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:19 smithi082 ceph-mon[30098]: pgmap v255: 1 pgs: 1 peering; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-05-08T05:44:20.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:19 smithi134 ceph-mon[34132]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:44:20.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:19 smithi134 ceph-mon[34132]: pgmap v255: 1 pgs: 1 peering; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-05-08T05:44:20.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:20 smithi082 ceph-mon[30098]: from='client.? 172.21.15.151:0/2803517925' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9ae5dca4-acfb-4a46-8601-9d642efde794"}]: dispatch 2024-05-08T05:44:20.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:20 smithi082 ceph-mon[30098]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9ae5dca4-acfb-4a46-8601-9d642efde794"}]: dispatch 2024-05-08T05:44:20.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:20 smithi082 ceph-mon[30098]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9ae5dca4-acfb-4a46-8601-9d642efde794"}]': finished 2024-05-08T05:44:20.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:20 smithi082 ceph-mon[30098]: osdmap e69: 12 total, 11 up, 12 in 2024-05-08T05:44:20.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:20 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T05:44:21.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:20 smithi134 ceph-mon[34132]: from='client.? 172.21.15.151:0/2803517925' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9ae5dca4-acfb-4a46-8601-9d642efde794"}]: dispatch 2024-05-08T05:44:21.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:20 smithi134 ceph-mon[34132]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9ae5dca4-acfb-4a46-8601-9d642efde794"}]: dispatch 2024-05-08T05:44:21.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:20 smithi134 ceph-mon[34132]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9ae5dca4-acfb-4a46-8601-9d642efde794"}]': finished 2024-05-08T05:44:21.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:20 smithi134 ceph-mon[34132]: osdmap e69: 12 total, 11 up, 12 in 2024-05-08T05:44:21.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:20 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T05:44:21.018 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:20 smithi151 ceph-mon[34815]: from='client.? 172.21.15.151:0/2803517925' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9ae5dca4-acfb-4a46-8601-9d642efde794"}]: dispatch 2024-05-08T05:44:21.018 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:20 smithi151 ceph-mon[34815]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9ae5dca4-acfb-4a46-8601-9d642efde794"}]: dispatch 2024-05-08T05:44:21.018 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:20 smithi151 ceph-mon[34815]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9ae5dca4-acfb-4a46-8601-9d642efde794"}]': finished 2024-05-08T05:44:21.018 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:20 smithi151 ceph-mon[34815]: osdmap e69: 12 total, 11 up, 12 in 2024-05-08T05:44:21.018 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:20 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T05:44:21.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:21 smithi082 ceph-mon[30098]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-05-08T05:44:21.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:21 smithi082 ceph-mon[30098]: from='client.? 172.21.15.151:0/3634919823' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:44:22.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:21 smithi134 ceph-mon[34132]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-05-08T05:44:22.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:21 smithi134 ceph-mon[34132]: from='client.? 172.21.15.151:0/3634919823' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:44:22.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:21 smithi151 ceph-mon[34815]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 107 KiB/s, 0 objects/s recovering 2024-05-08T05:44:22.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:21 smithi151 ceph-mon[34815]: from='client.? 172.21.15.151:0/3634919823' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-08T05:44:23.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:23 smithi082 ceph-mon[30098]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-08T05:44:24.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:23 smithi134 ceph-mon[34132]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-08T05:44:24.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:23 smithi151 ceph-mon[34815]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-08T05:44:25.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:25 smithi151 ceph-mon[34815]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-05-08T05:44:25.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:25 smithi082 ceph-mon[30098]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-05-08T05:44:26.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:25 smithi134 ceph-mon[34132]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-05-08T05:44:27.956 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:27 smithi151 ceph-mon[34815]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-05-08T05:44:27.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:27 smithi082 ceph-mon[30098]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-05-08T05:44:28.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:27 smithi134 ceph-mon[34132]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 69 KiB/s, 0 objects/s recovering 2024-05-08T05:44:28.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:28 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-08T05:44:28.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:28 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:44:29.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:28 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-08T05:44:29.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:28 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:44:29.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:28 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-08T05:44:29.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:28 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:44:29.994 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:29 smithi151 ceph-mon[34815]: Deploying daemon osd.11 on smithi151 2024-05-08T05:44:29.994 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:29 smithi151 ceph-mon[34815]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T05:44:30.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:29 smithi134 ceph-mon[34132]: Deploying daemon osd.11 on smithi151 2024-05-08T05:44:30.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:29 smithi134 ceph-mon[34132]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T05:44:30.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:29 smithi082 ceph-mon[30098]: Deploying daemon osd.11 on smithi151 2024-05-08T05:44:30.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:29 smithi082 ceph-mon[30098]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-08T05:44:31.864 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:31 smithi151 ceph-mon[34815]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-05-08T05:44:32.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:31 smithi134 ceph-mon[34132]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-05-08T05:44:32.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:31 smithi082 ceph-mon[30098]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-05-08T05:44:33.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:33 smithi151 ceph-mon[34815]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-05-08T05:44:34.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:33 smithi134 ceph-mon[34132]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-05-08T05:44:34.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:33 smithi082 ceph-mon[30098]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-05-08T05:44:35.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:34 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:44:35.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:34 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:35.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:34 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:35.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:34 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:44:35.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:34 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:35.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:34 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:35.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:34 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:44:35.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:34 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:35.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:34 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:36.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:35 smithi151 ceph-mon[34815]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-05-08T05:44:36.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:35 smithi082 ceph-mon[30098]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-05-08T05:44:36.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:35 smithi134 ceph-mon[34132]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-05-08T05:44:37.708 INFO:teuthology.orchestra.run.smithi151.stdout:Created osd(s) 11 on host 'smithi151' 2024-05-08T05:44:37.709 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:37.707+0000 7fbb4b7fe700 1 -- 172.21.15.151:0/2723453365 <== mgr.14152 v2:172.21.15.82:6800/4089180091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fbb5c0ffbb0 con 0x7fbb440b2880 2024-05-08T05:44:37.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:37.710+0000 7fbb60ba8700 1 -- 172.21.15.151:0/2723453365 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fbb440b2880 msgr2=0x7fbb440b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:44:37.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:37.710+0000 7fbb60ba8700 1 --2- 172.21.15.151:0/2723453365 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fbb440b2880 0x7fbb440b4d40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c103450 tx=0x7fbb4c009190 comp rx=0 tx=0).stop 2024-05-08T05:44:37.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:37.710+0000 7fbb60ba8700 1 -- 172.21.15.151:0/2723453365 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbb5c1035f0 msgr2=0x7fbb5c1049d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:44:37.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:37.710+0000 7fbb60ba8700 1 --2- 172.21.15.151:0/2723453365 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbb5c1035f0 0x7fbb5c1049d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fbb50006010 tx=0x7fbb500047b0 comp rx=0 tx=0).stop 2024-05-08T05:44:37.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:37.710+0000 7fbb60ba8700 1 -- 172.21.15.151:0/2723453365 shutdown_connections 2024-05-08T05:44:37.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:37.710+0000 7fbb60ba8700 1 --2- 172.21.15.151:0/2723453365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb5c1023f0 0x7fbb5c106380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:37.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:37.710+0000 7fbb60ba8700 1 --2- 172.21.15.151:0/2723453365 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fbb440b2880 0x7fbb440b4d40 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:37.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:37.710+0000 7fbb60ba8700 1 --2- 172.21.15.151:0/2723453365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbb5c103f90 0x7fbb5c104f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:37.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:37.710+0000 7fbb60ba8700 1 --2- 172.21.15.151:0/2723453365 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbb5c1035f0 0x7fbb5c1049d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:37.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:37.710+0000 7fbb60ba8700 1 -- 172.21.15.151:0/2723453365 >> 172.21.15.151:0/2723453365 conn(0x7fbb5c0fd990 msgr2=0x7fbb5c0ff4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:44:37.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:37.710+0000 7fbb60ba8700 1 -- 172.21.15.151:0/2723453365 shutdown_connections 2024-05-08T05:44:37.711 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:37.710+0000 7fbb60ba8700 1 -- 172.21.15.151:0/2723453365 wait complete. 2024-05-08T05:44:37.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:37 smithi151 ceph-mon[34815]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-05-08T05:44:37.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:37 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:37.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:37 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:37.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:37 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:44:37.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:37 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:44:37.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:37 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:37.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:37 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:37.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:37 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:37.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:37 smithi151 ceph-mon[34815]: from='osd.11 [v2:172.21.15.151:6824/2242771269,v1:172.21.15.151:6825/2242771269]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-08T05:44:37.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:37 smithi151 ceph-mon[34815]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-08T05:44:37.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:37 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:44:38.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:37 smithi082 ceph-mon[30098]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-05-08T05:44:38.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:37 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:38.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:37 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:38.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:37 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:44:38.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:37 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:44:38.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:37 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:38.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:37 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:38.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:37 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:38.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:37 smithi082 ceph-mon[30098]: from='osd.11 [v2:172.21.15.151:6824/2242771269,v1:172.21.15.151:6825/2242771269]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-08T05:44:38.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:37 smithi082 ceph-mon[30098]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-08T05:44:38.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:37 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:44:38.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:37 smithi134 ceph-mon[34132]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-05-08T05:44:38.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:37 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:38.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:37 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:38.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:37 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:44:38.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:37 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:44:38.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:37 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:38.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:37 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:38.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:37 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:38.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:37 smithi134 ceph-mon[34132]: from='osd.11 [v2:172.21.15.151:6824/2242771269,v1:172.21.15.151:6825/2242771269]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-08T05:44:38.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:37 smithi134 ceph-mon[34132]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-08T05:44:38.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:37 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:44:38.309 DEBUG:teuthology.orchestra.run.smithi151:osd.11> sudo journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@osd.11.service 2024-05-08T05:44:38.311 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-05-08T05:44:38.311 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph osd stat -f json 2024-05-08T05:44:38.755 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:44:39.703 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:39 smithi151 ceph-mon[34815]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-05-08T05:44:39.703 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:39 smithi151 ceph-mon[34815]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-08T05:44:39.703 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:39 smithi151 ceph-mon[34815]: from='osd.11 [v2:172.21.15.151:6824/2242771269,v1:172.21.15.151:6825/2242771269]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-05-08T05:44:39.703 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:39 smithi151 ceph-mon[34815]: osdmap e70: 12 total, 11 up, 12 in 2024-05-08T05:44:39.703 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:39 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T05:44:39.703 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:39 smithi151 ceph-mon[34815]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-05-08T05:44:39.704 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 05:44:39 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T05:44:39.689+0000 7fc1c7d86700 -1 osd.11 0 waiting for initial osdmap 2024-05-08T05:44:39.704 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 05:44:39 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T05:44:39.702+0000 7fc1c3b79700 -1 osd.11 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-08T05:44:39.947 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:39 smithi082 ceph-mon[30098]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-05-08T05:44:39.947 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:39 smithi082 ceph-mon[30098]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-08T05:44:39.947 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:39 smithi082 ceph-mon[30098]: from='osd.11 [v2:172.21.15.151:6824/2242771269,v1:172.21.15.151:6825/2242771269]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-05-08T05:44:39.947 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:39 smithi082 ceph-mon[30098]: osdmap e70: 12 total, 11 up, 12 in 2024-05-08T05:44:39.947 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:39 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T05:44:39.947 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:39 smithi082 ceph-mon[30098]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-05-08T05:44:40.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:39 smithi134 ceph-mon[34132]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-05-08T05:44:40.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:39 smithi134 ceph-mon[34132]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-08T05:44:40.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:39 smithi134 ceph-mon[34132]: from='osd.11 [v2:172.21.15.151:6824/2242771269,v1:172.21.15.151:6825/2242771269]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-05-08T05:44:40.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:39 smithi134 ceph-mon[34132]: osdmap e70: 12 total, 11 up, 12 in 2024-05-08T05:44:40.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:39 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T05:44:40.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:39 smithi134 ceph-mon[34132]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-05-08T05:44:40.820 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:40 smithi082 ceph-mon[30098]: purged_snaps scrub starts 2024-05-08T05:44:40.820 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:40 smithi082 ceph-mon[30098]: purged_snaps scrub ok 2024-05-08T05:44:40.820 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:40 smithi082 ceph-mon[30098]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2024-05-08T05:44:40.820 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:40 smithi082 ceph-mon[30098]: osdmap e71: 12 total, 11 up, 12 in 2024-05-08T05:44:40.820 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:40 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T05:44:40.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:40 smithi151 ceph-mon[34815]: purged_snaps scrub starts 2024-05-08T05:44:40.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:40 smithi151 ceph-mon[34815]: purged_snaps scrub ok 2024-05-08T05:44:40.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:40 smithi151 ceph-mon[34815]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2024-05-08T05:44:40.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:40 smithi151 ceph-mon[34815]: osdmap e71: 12 total, 11 up, 12 in 2024-05-08T05:44:40.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:40 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T05:44:41.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:40 smithi134 ceph-mon[34132]: purged_snaps scrub starts 2024-05-08T05:44:41.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:40 smithi134 ceph-mon[34132]: purged_snaps scrub ok 2024-05-08T05:44:41.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:40 smithi134 ceph-mon[34132]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2024-05-08T05:44:41.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:40 smithi134 ceph-mon[34132]: osdmap e71: 12 total, 11 up, 12 in 2024-05-08T05:44:41.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:40 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T05:44:41.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:41.093+0000 7fe35e800700 1 -- 172.21.15.82:0/2116341220 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe3581091f0 msgr2=0x7fe35810b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:44:41.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:41.093+0000 7fe35e800700 1 --2- 172.21.15.82:0/2116341220 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe3581091f0 0x7fe35810b660 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe35000b0a0 tx=0x7fe35000b3b0 comp rx=0 tx=0).stop 2024-05-08T05:44:41.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:41.093+0000 7fe35e800700 1 -- 172.21.15.82:0/2116341220 shutdown_connections 2024-05-08T05:44:41.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:41.093+0000 7fe35e800700 1 --2- 172.21.15.82:0/2116341220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe358103f90 0x7fe358106380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:41.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:41.093+0000 7fe35e800700 1 --2- 172.21.15.82:0/2116341220 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe3581091f0 0x7fe35810b660 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:41.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:41.093+0000 7fe35e800700 1 --2- 172.21.15.82:0/2116341220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3581068c0 0x7fe358108cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:41.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:41.093+0000 7fe35e800700 1 -- 172.21.15.82:0/2116341220 >> 172.21.15.82:0/2116341220 conn(0x7fe3580fd9a0 msgr2=0x7fe3580ffde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:44:41.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:41.093+0000 7fe35e800700 1 -- 172.21.15.82:0/2116341220 shutdown_connections 2024-05-08T05:44:41.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:41.093+0000 7fe35e800700 1 -- 172.21.15.82:0/2116341220 wait complete. 2024-05-08T05:44:41.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:41.095+0000 7fe35e800700 1 Processor -- start 2024-05-08T05:44:41.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:41.095+0000 7fe35e800700 1 -- start start 2024-05-08T05:44:41.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:41.095+0000 7fe35e800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe358103f90 0x7fe3581038f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:44:41.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:41.095+0000 7fe35e800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3581068c0 0x7fe358101f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:44:41.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:41.095+0000 7fe35e800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe3581091f0 0x7fe358102480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:44:41.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:41.095+0000 7fe35e800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe35810f010 con 0x7fe3581068c0 2024-05-08T05:44:41.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:41.095+0000 7fe35e800700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe35810ee90 con 0x7fe358103f90 2024-05-08T05:44:41.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:41.095+0000 7fe35e800700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe35810f190 con 0x7fe3581091f0 2024-05-08T05:44:41.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:41.096+0000 7fe34ea00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3581068c0 0x7fe358101f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:44:41.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:41.096+0000 7fe357e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe3581091f0 0x7fe358102480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:44:41.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:41.096+0000 7fe357e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe3581091f0 0x7fe358102480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:37444/0 (socket says 172.21.15.82:37444) 2024-05-08T05:44:41.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:41.096+0000 7fe357400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe358103f90 0x7fe3581038f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:44:41.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:41.096+0000 7fe357e00700 1 -- 172.21.15.82:0/1294069654 learned_addr learned my addr 172.21.15.82:0/1294069654 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:44:41.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:41.096+0000 7fe34ea00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3581068c0 0x7fe358101f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60560/0 (socket says 172.21.15.82:60560) 2024-05-08T05:44:41.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:41.096+0000 7fe34ea00700 1 -- 172.21.15.82:0/1294069654 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe3581091f0 msgr2=0x7fe358102480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:44:41.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:41.096+0000 7fe34ea00700 1 --2- 172.21.15.82:0/1294069654 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe3581091f0 0x7fe358102480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:41.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:41.096+0000 7fe34ea00700 1 -- 172.21.15.82:0/1294069654 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe358103f90 msgr2=0x7fe3581038f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:44:41.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:41.096+0000 7fe34ea00700 1 --2- 172.21.15.82:0/1294069654 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe358103f90 0x7fe3581038f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:41.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:41.096+0000 7fe34ea00700 1 -- 172.21.15.82:0/1294069654 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe358102d30 con 0x7fe3581068c0 2024-05-08T05:44:41.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:41.097+0000 7fe34ea00700 1 --2- 172.21.15.82:0/1294069654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3581068c0 0x7fe358101f40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe34000d750 tx=0x7fe34000da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:44:41.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:41.097+0000 7fe354c00700 1 -- 172.21.15.82:0/1294069654 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe340016070 con 0x7fe3581068c0 2024-05-08T05:44:41.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:41.097+0000 7fe35e800700 1 -- 172.21.15.82:0/1294069654 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3581a3800 con 0x7fe3581068c0 2024-05-08T05:44:41.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:41.097+0000 7fe354c00700 1 -- 172.21.15.82:0/1294069654 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe340004830 con 0x7fe3581068c0 2024-05-08T05:44:41.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:41.097+0000 7fe35e800700 1 -- 172.21.15.82:0/1294069654 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3581a3d40 con 0x7fe3581068c0 2024-05-08T05:44:41.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:41.097+0000 7fe354c00700 1 -- 172.21.15.82:0/1294069654 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe340005560 con 0x7fe3581068c0 2024-05-08T05:44:41.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:41.098+0000 7fe35e800700 1 -- 172.21.15.82:0/1294069654 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe35806a190 con 0x7fe3581068c0 2024-05-08T05:44:41.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:41.102+0000 7fe354c00700 1 -- 172.21.15.82:0/1294069654 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fe340004cc0 con 0x7fe3581068c0 2024-05-08T05:44:41.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:41.104+0000 7fe354c00700 1 --2- 172.21.15.82:0/1294069654 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fe33c0b2900 0x7fe33c0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:44:41.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:41.104+0000 7fe354c00700 1 -- 172.21.15.82:0/1294069654 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 7127+0+0 (secure 0 0 0) 0x7fe3400e1f10 con 0x7fe3581068c0 2024-05-08T05:44:41.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:41.104+0000 7fe357400700 1 --2- 172.21.15.82:0/1294069654 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fe33c0b2900 0x7fe33c0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:44:41.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:41.105+0000 7fe357400700 1 --2- 172.21.15.82:0/1294069654 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fe33c0b2900 0x7fe33c0b4dc0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe348009c60 tx=0x7fe348009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:44:41.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:41.106+0000 7fe354c00700 1 -- 172.21.15.82:0/1294069654 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe34001f020 con 0x7fe3581068c0 2024-05-08T05:44:41.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:41.336+0000 7fe35e800700 1 -- 172.21.15.82:0/1294069654 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fe35802e510 con 0x7fe3581068c0 2024-05-08T05:44:41.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:41.337+0000 7fe354c00700 1 -- 172.21.15.82:0/1294069654 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v72) ==== 74+0+133 (secure 0 0 0) 0x7fe3400aa030 con 0x7fe3581068c0 2024-05-08T05:44:41.338 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:44:41.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:41.340+0000 7fe35e800700 1 -- 172.21.15.82:0/1294069654 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fe33c0b2900 msgr2=0x7fe33c0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:44:41.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:41.340+0000 7fe35e800700 1 --2- 172.21.15.82:0/1294069654 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fe33c0b2900 0x7fe33c0b4dc0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe348009c60 tx=0x7fe348009260 comp rx=0 tx=0).stop 2024-05-08T05:44:41.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:41.340+0000 7fe35e800700 1 -- 172.21.15.82:0/1294069654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3581068c0 msgr2=0x7fe358101f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:44:41.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:41.340+0000 7fe35e800700 1 --2- 172.21.15.82:0/1294069654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3581068c0 0x7fe358101f40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe34000d750 tx=0x7fe34000da60 comp rx=0 tx=0).stop 2024-05-08T05:44:41.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:41.340+0000 7fe35e800700 1 -- 172.21.15.82:0/1294069654 shutdown_connections 2024-05-08T05:44:41.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:41.340+0000 7fe35e800700 1 --2- 172.21.15.82:0/1294069654 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe358103f90 0x7fe3581038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:41.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:41.340+0000 7fe35e800700 1 --2- 172.21.15.82:0/1294069654 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fe33c0b2900 0x7fe33c0b4dc0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:41.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:41.340+0000 7fe35e800700 1 --2- 172.21.15.82:0/1294069654 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe3581091f0 0x7fe358102480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:41.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:41.340+0000 7fe35e800700 1 --2- 172.21.15.82:0/1294069654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe3581068c0 0x7fe358101f40 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:41.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:41.340+0000 7fe35e800700 1 -- 172.21.15.82:0/1294069654 >> 172.21.15.82:0/1294069654 conn(0x7fe3580fd9a0 msgr2=0x7fe3581048d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:44:41.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:41.340+0000 7fe35e800700 1 -- 172.21.15.82:0/1294069654 shutdown_connections 2024-05-08T05:44:41.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:41.340+0000 7fe35e800700 1 -- 172.21.15.82:0/1294069654 wait complete. 2024-05-08T05:44:41.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:41 smithi082 ceph-mon[30098]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-05-08T05:44:41.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:41 smithi082 ceph-mon[30098]: osd.11 [v2:172.21.15.151:6824/2242771269,v1:172.21.15.151:6825/2242771269] boot 2024-05-08T05:44:41.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:41 smithi082 ceph-mon[30098]: osdmap e72: 12 total, 12 up, 12 in 2024-05-08T05:44:41.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:41 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T05:44:41.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:41 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/1294069654' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-08T05:44:41.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:41 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:41.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:41 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:41.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:41 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:44:41.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:41 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:44:41.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:41 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:44:41.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:41 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:44:41.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:41 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:41.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:41 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:44:41.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:41 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:44:41.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:41 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:42.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:41 smithi134 ceph-mon[34132]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-05-08T05:44:42.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:41 smithi134 ceph-mon[34132]: osd.11 [v2:172.21.15.151:6824/2242771269,v1:172.21.15.151:6825/2242771269] boot 2024-05-08T05:44:42.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:41 smithi134 ceph-mon[34132]: osdmap e72: 12 total, 12 up, 12 in 2024-05-08T05:44:42.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:41 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T05:44:42.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:41 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/1294069654' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-08T05:44:42.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:41 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:42.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:41 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:42.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:41 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:44:42.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:41 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:44:42.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:41 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:44:42.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:41 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:44:42.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:41 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:42.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:41 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:44:42.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:41 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:44:42.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:41 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:42.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:41 smithi151 ceph-mon[34815]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 314 MiB used, 983 GiB / 983 GiB avail 2024-05-08T05:44:42.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:41 smithi151 ceph-mon[34815]: osd.11 [v2:172.21.15.151:6824/2242771269,v1:172.21.15.151:6825/2242771269] boot 2024-05-08T05:44:42.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:41 smithi151 ceph-mon[34815]: osdmap e72: 12 total, 12 up, 12 in 2024-05-08T05:44:42.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:41 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-08T05:44:42.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:41 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/1294069654' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-08T05:44:42.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:41 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:42.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:41 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:42.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:41 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:44:42.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:41 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:44:42.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:41 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:44:42.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:41 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:44:42.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:41 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:42.131 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:41 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:44:42.131 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:41 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:44:42.131 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:41 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:42.163 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":72,"num_osds":12,"num_up_osds":12,"osd_up_since":1715147080,"num_in_osds":12,"osd_in_since":1715147060,"num_remapped_pgs":0} 2024-05-08T05:44:42.163 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-08T05:44:42.586 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:44:42.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:42 smithi082 ceph-mon[30098]: Detected new or changed devices on smithi151 2024-05-08T05:44:42.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:42 smithi082 ceph-mon[30098]: Adjusting osd_memory_target on smithi151 to 4272M 2024-05-08T05:44:42.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:42 smithi082 ceph-mon[30098]: osdmap e73: 12 total, 12 up, 12 in 2024-05-08T05:44:43.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:42 smithi134 ceph-mon[34132]: Detected new or changed devices on smithi151 2024-05-08T05:44:43.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:42 smithi134 ceph-mon[34132]: Adjusting osd_memory_target on smithi151 to 4272M 2024-05-08T05:44:43.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:42 smithi134 ceph-mon[34132]: osdmap e73: 12 total, 12 up, 12 in 2024-05-08T05:44:43.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:42 smithi151 ceph-mon[34815]: Detected new or changed devices on smithi151 2024-05-08T05:44:43.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:42 smithi151 ceph-mon[34815]: Adjusting osd_memory_target on smithi151 to 4272M 2024-05-08T05:44:43.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:42 smithi151 ceph-mon[34815]: osdmap e73: 12 total, 12 up, 12 in 2024-05-08T05:44:43.912 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:43 smithi082 ceph-mon[30098]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:44:44.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:43 smithi134 ceph-mon[34132]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:44:44.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:43 smithi151 ceph-mon[34815]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:44:44.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:44.742+0000 7fc8eae00700 1 -- 172.21.15.82:0/3692321713 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8e410a490 msgr2=0x7fc8e41169a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:44:44.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:44.742+0000 7fc8eae00700 1 --2- 172.21.15.82:0/3692321713 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8e410a490 0x7fc8e41169a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc009f90 tx=0x7fc8dc00b330 comp rx=0 tx=0).stop 2024-05-08T05:44:44.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:44.742+0000 7fc8eae00700 1 -- 172.21.15.82:0/3692321713 shutdown_connections 2024-05-08T05:44:44.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:44.742+0000 7fc8eae00700 1 --2- 172.21.15.82:0/3692321713 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8e410a490 0x7fc8e41169a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:44.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:44.742+0000 7fc8eae00700 1 --2- 172.21.15.82:0/3692321713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8e410fb60 0x7fc8e410ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:44.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:44.742+0000 7fc8eae00700 1 --2- 172.21.15.82:0/3692321713 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8e4109ad0 0x7fc8e4109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:44.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:44.742+0000 7fc8eae00700 1 -- 172.21.15.82:0/3692321713 >> 172.21.15.82:0/3692321713 conn(0x7fc8e4076c70 msgr2=0x7fc8e41082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:44:44.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:44.742+0000 7fc8eae00700 1 -- 172.21.15.82:0/3692321713 shutdown_connections 2024-05-08T05:44:44.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:44.742+0000 7fc8eae00700 1 -- 172.21.15.82:0/3692321713 wait complete. 2024-05-08T05:44:44.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:44.743+0000 7fc8eae00700 1 Processor -- start 2024-05-08T05:44:44.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:44.743+0000 7fc8eae00700 1 -- start start 2024-05-08T05:44:44.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:44.743+0000 7fc8eae00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8e4109ad0 0x7fc8e41a0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:44:44.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:44.743+0000 7fc8eae00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8e410a490 0x7fc8e41a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:44:44.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:44.743+0000 7fc8eae00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8e410fb60 0x7fc8e41a4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:44:44.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:44.743+0000 7fc8eae00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc8e4119d20 con 0x7fc8e410a490 2024-05-08T05:44:44.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:44.743+0000 7fc8eae00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc8e4119ba0 con 0x7fc8e4109ad0 2024-05-08T05:44:44.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:44.743+0000 7fc8eae00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc8e4119ea0 con 0x7fc8e410fb60 2024-05-08T05:44:44.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:44.744+0000 7fc8e3400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8e410a490 0x7fc8e41a06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:44:44.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:44.744+0000 7fc8e3e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8e4109ad0 0x7fc8e41a0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:44:44.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:44.744+0000 7fc8e3e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8e4109ad0 0x7fc8e41a0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:59142/0 (socket says 172.21.15.82:59142) 2024-05-08T05:44:44.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:44.744+0000 7fc8e3400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8e410a490 0x7fc8e41a06b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44278/0 (socket says 172.21.15.82:44278) 2024-05-08T05:44:44.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:44.744+0000 7fc8e3e00700 1 -- 172.21.15.82:0/1238369462 learned_addr learned my addr 172.21.15.82:0/1238369462 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:44:44.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:44.744+0000 7fc8e8e00700 1 --2- 172.21.15.82:0/1238369462 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8e410fb60 0x7fc8e41a4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:44:44.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:44.744+0000 7fc8e3e00700 1 -- 172.21.15.82:0/1238369462 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8e410fb60 msgr2=0x7fc8e41a4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:44:44.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:44.744+0000 7fc8e3e00700 1 --2- 172.21.15.82:0/1238369462 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8e410fb60 0x7fc8e41a4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:44.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:44.744+0000 7fc8e3e00700 1 -- 172.21.15.82:0/1238369462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8e410a490 msgr2=0x7fc8e41a06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:44:44.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:44.744+0000 7fc8e3e00700 1 --2- 172.21.15.82:0/1238369462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8e410a490 0x7fc8e41a06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:44.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:44.744+0000 7fc8e3e00700 1 -- 172.21.15.82:0/1238369462 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8e41a5180 con 0x7fc8e4109ad0 2024-05-08T05:44:44.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:44.744+0000 7fc8e3e00700 1 --2- 172.21.15.82:0/1238369462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8e4109ad0 0x7fc8e41a0170 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc8d400ec10 tx=0x7fc8d400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:44:44.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:44.745+0000 7fc8e0c00700 1 -- 172.21.15.82:0/1238369462 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8d400cc90 con 0x7fc8e4109ad0 2024-05-08T05:44:44.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:44.745+0000 7fc8e0c00700 1 -- 172.21.15.82:0/1238369462 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc8d400ce30 con 0x7fc8e4109ad0 2024-05-08T05:44:44.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:44.745+0000 7fc8e0c00700 1 -- 172.21.15.82:0/1238369462 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8d4010430 con 0x7fc8e4109ad0 2024-05-08T05:44:44.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:44.745+0000 7fc8eae00700 1 -- 172.21.15.82:0/1238369462 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8e41a5470 con 0x7fc8e4109ad0 2024-05-08T05:44:44.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:44.745+0000 7fc8eae00700 1 -- 172.21.15.82:0/1238369462 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8e41accf0 con 0x7fc8e4109ad0 2024-05-08T05:44:44.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:44.746+0000 7fc8eae00700 1 -- 172.21.15.82:0/1238369462 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8e406a190 con 0x7fc8e4109ad0 2024-05-08T05:44:44.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:44.748+0000 7fc8e0c00700 1 -- 172.21.15.82:0/1238369462 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fc8d4004000 con 0x7fc8e4109ad0 2024-05-08T05:44:44.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:44.749+0000 7fc8e0c00700 1 --2- 172.21.15.82:0/1238369462 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc8c80b2900 0x7fc8c80b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:44:44.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:44.750+0000 7fc8e0c00700 1 -- 172.21.15.82:0/1238369462 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fc8d40e1fb0 con 0x7fc8e4109ad0 2024-05-08T05:44:44.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:44.750+0000 7fc8e3400700 1 --2- 172.21.15.82:0/1238369462 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc8c80b2900 0x7fc8c80b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:44:44.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:44.750+0000 7fc8e3400700 1 --2- 172.21.15.82:0/1238369462 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc8c80b2900 0x7fc8c80b4dc0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc8e4078b80 tx=0x7fc8d0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:44:44.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:44.753+0000 7fc8e0c00700 1 -- 172.21.15.82:0/1238369462 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc8d40aa0d0 con 0x7fc8e4109ad0 2024-05-08T05:44:44.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:44.995+0000 7fc8eae00700 1 -- 172.21.15.82:0/1238369462 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc8e41a14d0 con 0x7fc8e4109ad0 2024-05-08T05:44:44.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:44.996+0000 7fc8e0c00700 1 -- 172.21.15.82:0/1238369462 <== mon.2 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+18432 (secure 0 0 0) 0x7fc8d40a99d0 con 0x7fc8e4109ad0 2024-05-08T05:44:44.997 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:44:44.998 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":73,"fsid":"c739a5c8-0cfc-11ef-bc97-c7b262605968","created":"2024-05-08T05:36:37.441393+0000","modified":"2024-05-08T05:44:42.394057+0000","last_up_change":"2024-05-08T05:44:40.677995+0000","last_in_change":"2024-05-08T05:44:20.654220+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T05:40:28.102836+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bc9bd472-b765-4893-84ed-c66b5c1c61b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":4051651615},{"type":"v1","addr":"172.21.15.82:6803","nonce":4051651615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":4051651615},{"type":"v1","addr":"172.21.15.82:6805","nonce":4051651615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4051651615},{"type":"v1","addr":"172.21.15.82:6809","nonce":4051651615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":4051651615},{"type":"v1","addr":"172.21.15.82:6807","nonce":4051651615}]},"public_addr":"172.21.15.82:6803/4051651615","cluster_addr":"172.21.15.82:6805/4051651615","heartbeat_back_addr":"172.21.15.82:6809/4051651615","heartbeat_front_addr":"172.21.15.82:6807/4051651615","state":["exists","up"]},{"osd":1,"uuid":"ad2d3a6b-8bc5-4177-8757-07e8607ca240","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":2763858634},{"type":"v1","addr":"172.21.15.134:6801","nonce":2763858634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":2763858634},{"type":"v1","addr":"172.21.15.134:6803","nonce":2763858634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":2763858634},{"type":"v1","addr":"172.21.15.134:6807","nonce":2763858634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2763858634},{"type":"v1","addr":"172.21.15.134:6805","nonce":2763858634}]},"public_addr":"172.21.15.134:6801/2763858634","cluster_addr":"172.21.15.134:6803/2763858634","heartbeat_back_addr":"172.21.15.134:6807/2763858634","heartbeat_front_addr":"172.21.15.134:6805/2763858634","state":["exists","up"]},{"osd":2,"uuid":"a06dc8fc-7324-4e42-9487-8cfe372401b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":4193933269},{"type":"v1","addr":"172.21.15.151:6801","nonce":4193933269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":4193933269},{"type":"v1","addr":"172.21.15.151:6803","nonce":4193933269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":4193933269},{"type":"v1","addr":"172.21.15.151:6807","nonce":4193933269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":4193933269},{"type":"v1","addr":"172.21.15.151:6805","nonce":4193933269}]},"public_addr":"172.21.15.151:6801/4193933269","cluster_addr":"172.21.15.151:6803/4193933269","heartbeat_back_addr":"172.21.15.151:6807/4193933269","heartbeat_front_addr":"172.21.15.151:6805/4193933269","state":["exists","up"]},{"osd":3,"uuid":"b8c8bdcd-fbd7-4494-976e-7285408e010e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":2775272422},{"type":"v1","addr":"172.21.15.82:6811","nonce":2775272422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":2775272422},{"type":"v1","addr":"172.21.15.82:6813","nonce":2775272422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":2775272422},{"type":"v1","addr":"172.21.15.82:6817","nonce":2775272422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":2775272422},{"type":"v1","addr":"172.21.15.82:6815","nonce":2775272422}]},"public_addr":"172.21.15.82:6811/2775272422","cluster_addr":"172.21.15.82:6813/2775272422","heartbeat_back_addr":"172.21.15.82:6817/2775272422","heartbeat_front_addr":"172.21.15.82:6815/2775272422","state":["exists","up"]},{"osd":4,"uuid":"391a6040-03d1-483c-9058-308b5998e7c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3565208751},{"type":"v1","addr":"172.21.15.134:6809","nonce":3565208751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3565208751},{"type":"v1","addr":"172.21.15.134:6811","nonce":3565208751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3565208751},{"type":"v1","addr":"172.21.15.134:6815","nonce":3565208751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3565208751},{"type":"v1","addr":"172.21.15.134:6813","nonce":3565208751}]},"public_addr":"172.21.15.134:6809/3565208751","cluster_addr":"172.21.15.134:6811/3565208751","heartbeat_back_addr":"172.21.15.134:6815/3565208751","heartbeat_front_addr":"172.21.15.134:6813/3565208751","state":["exists","up"]},{"osd":5,"uuid":"dacce079-4aad-474e-b747-1ed60c3c71cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":1925634069},{"type":"v1","addr":"172.21.15.151:6809","nonce":1925634069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":1925634069},{"type":"v1","addr":"172.21.15.151:6811","nonce":1925634069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1925634069},{"type":"v1","addr":"172.21.15.151:6815","nonce":1925634069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1925634069},{"type":"v1","addr":"172.21.15.151:6813","nonce":1925634069}]},"public_addr":"172.21.15.151:6809/1925634069","cluster_addr":"172.21.15.151:6811/1925634069","heartbeat_back_addr":"172.21.15.151:6815/1925634069","heartbeat_front_addr":"172.21.15.151:6813/1925634069","state":["exists","up"]},{"osd":6,"uuid":"6a445bf4-09c4-4e9b-be6e-68ef3c05b365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":762647976},{"type":"v1","addr":"172.21.15.82:6819","nonce":762647976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":762647976},{"type":"v1","addr":"172.21.15.82:6821","nonce":762647976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":762647976},{"type":"v1","addr":"172.21.15.82:6825","nonce":762647976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":762647976},{"type":"v1","addr":"172.21.15.82:6823","nonce":762647976}]},"public_addr":"172.21.15.82:6819/762647976","cluster_addr":"172.21.15.82:6821/762647976","heartbeat_back_addr":"172.21.15.82:6825/762647976","heartbeat_front_addr":"172.21.15.82:6823/762647976","state":["exists","up"]},{"osd":7,"uuid":"72b0c735-ef30-4823-8ab8-2e5bf7cc3c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3006846927},{"type":"v1","addr":"172.21.15.134:6817","nonce":3006846927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3006846927},{"type":"v1","addr":"172.21.15.134:6819","nonce":3006846927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3006846927},{"type":"v1","addr":"172.21.15.134:6823","nonce":3006846927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3006846927},{"type":"v1","addr":"172.21.15.134:6821","nonce":3006846927}]},"public_addr":"172.21.15.134:6817/3006846927","cluster_addr":"172.21.15.134:6819/3006846927","heartbeat_back_addr":"172.21.15.134:6823/3006846927","heartbeat_front_addr":"172.21.15.134:6821/3006846927","state":["exists","up"]},{"osd":8,"uuid":"93e4da0f-48ea-4ab7-b612-26b545b76de6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":787870717},{"type":"v1","addr":"172.21.15.151:6817","nonce":787870717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":787870717},{"type":"v1","addr":"172.21.15.151:6819","nonce":787870717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":787870717},{"type":"v1","addr":"172.21.15.151:6823","nonce":787870717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":787870717},{"type":"v1","addr":"172.21.15.151:6821","nonce":787870717}]},"public_addr":"172.21.15.151:6817/787870717","cluster_addr":"172.21.15.151:6819/787870717","heartbeat_back_addr":"172.21.15.151:6823/787870717","heartbeat_front_addr":"172.21.15.151:6821/787870717","state":["exists","up"]},{"osd":9,"uuid":"ea0070c1-286a-47d3-90cf-d1fada6e3cda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":533124002},{"type":"v1","addr":"172.21.15.82:6827","nonce":533124002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":533124002},{"type":"v1","addr":"172.21.15.82:6829","nonce":533124002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":533124002},{"type":"v1","addr":"172.21.15.82:6833","nonce":533124002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":533124002},{"type":"v1","addr":"172.21.15.82:6831","nonce":533124002}]},"public_addr":"172.21.15.82:6827/533124002","cluster_addr":"172.21.15.82:6829/533124002","heartbeat_back_addr":"172.21.15.82:6833/533124002","heartbeat_front_addr":"172.21.15.82:6831/533124002","state":["exists","up"]},{"osd":10,"uuid":"26ca0a0b-ab9e-472f-bb29-428e8c31e5bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":99154842},{"type":"v1","addr":"172.21.15.134:6825","nonce":99154842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":99154842},{"type":"v1","addr":"172.21.15.134:6827","nonce":99154842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":99154842},{"type":"v1","addr":"172.21.15.134:6831","nonce":99154842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":99154842},{"type":"v1","addr":"172.21.15.134:6829","nonce":99154842}]},"public_addr":"172.21.15.134:6825/99154842","cluster_addr":"172.21.15.134:6827/99154842","heartbeat_back_addr":"172.21.15.134:6831/99154842","heartbeat_front_addr":"172.21.15.134:6829/99154842","state":["exists","up"]},{"osd":11,"uuid":"9ae5dca4-acfb-4a46-8601-9d642efde794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2242771269},{"type":"v1","addr":"172.21.15.151:6825","nonce":2242771269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2242771269},{"type":"v1","addr":"172.21.15.151:6827","nonce":2242771269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2242771269},{"type":"v1","addr":"172.21.15.151:6831","nonce":2242771269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2242771269},{"type":"v1","addr":"172.21.15.151:6829","nonce":2242771269}]},"public_addr":"172.21.15.151:6825/2242771269","cluster_addr":"172.21.15.151:6827/2242771269","heartbeat_back_addr":"172.21.15.151:6831/2242771269","heartbeat_front_addr":"172.21.15.151:6829/2242771269","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:39:35.575525+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:40:00.672367+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:40:24.558682+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:40:56.791194+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:41:23.031785+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:41:47.926448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:42:21.231894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:42:47.599982+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:43:12.950581+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:43:46.333027+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:44:13.457489+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:44:38.637273+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/2761274596":"2024-05-09T05:37:43.951218+0000","172.21.15.82:0/2195734928":"2024-05-09T05:37:43.951218+0000","172.21.15.82:6801/765895649":"2024-05-09T05:37:43.951218+0000","172.21.15.82:6800/3546670887":"2024-05-09T05:37:11.114057+0000","172.21.15.82:6800/765895649":"2024-05-09T05:37:43.951218+0000","172.21.15.82:0/3986150437":"2024-05-09T05:37:11.114057+0000","172.21.15.82:0/3457457714":"2024-05-09T05:37:11.114057+0000","172.21.15.82:0/2356749286":"2024-05-09T05:37:11.114057+0000","172.21.15.82:6801/3546670887":"2024-05-09T05:37:11.114057+0000","172.21.15.82:0/1694643083":"2024-05-09T05:37:43.951218+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T05:44:45.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:44.999+0000 7fc8eae00700 1 -- 172.21.15.82:0/1238369462 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc8c80b2900 msgr2=0x7fc8c80b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:44:45.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:44.999+0000 7fc8eae00700 1 --2- 172.21.15.82:0/1238369462 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc8c80b2900 0x7fc8c80b4dc0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc8e4078b80 tx=0x7fc8d0009260 comp rx=0 tx=0).stop 2024-05-08T05:44:45.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:44.999+0000 7fc8eae00700 1 -- 172.21.15.82:0/1238369462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8e4109ad0 msgr2=0x7fc8e41a0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:44:45.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:44.999+0000 7fc8eae00700 1 --2- 172.21.15.82:0/1238369462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8e4109ad0 0x7fc8e41a0170 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc8d400ec10 tx=0x7fc8d400ef20 comp rx=0 tx=0).stop 2024-05-08T05:44:45.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:44.999+0000 7fc8eae00700 1 -- 172.21.15.82:0/1238369462 shutdown_connections 2024-05-08T05:44:45.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:44.999+0000 7fc8eae00700 1 --2- 172.21.15.82:0/1238369462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8e4109ad0 0x7fc8e41a0170 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:45.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:44.999+0000 7fc8eae00700 1 --2- 172.21.15.82:0/1238369462 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc8c80b2900 0x7fc8c80b4dc0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:45.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:44.999+0000 7fc8eae00700 1 --2- 172.21.15.82:0/1238369462 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8e410fb60 0x7fc8e41a4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:45.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:44.999+0000 7fc8eae00700 1 --2- 172.21.15.82:0/1238369462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc8e410a490 0x7fc8e41a06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:45.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:44.999+0000 7fc8eae00700 1 -- 172.21.15.82:0/1238369462 >> 172.21.15.82:0/1238369462 conn(0x7fc8e4076c70 msgr2=0x7fc8e4077230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:44:45.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:44.999+0000 7fc8eae00700 1 -- 172.21.15.82:0/1238369462 shutdown_connections 2024-05-08T05:44:45.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:44.999+0000 7fc8eae00700 1 -- 172.21.15.82:0/1238369462 wait complete. 2024-05-08T05:44:45.797 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T05:40:28.102836+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T05:44:45.798 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-05-08T05:44:45.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:45 smithi082 ceph-mon[30098]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:44:45.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:45 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/1238369462' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:44:46.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:45 smithi134 ceph-mon[34132]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:44:46.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:45 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/1238369462' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:44:46.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:45 smithi151 ceph-mon[34815]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 341 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:44:46.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:45 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/1238369462' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:44:46.244 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:44:47.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:47 smithi082 ceph-mon[30098]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:44:48.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:47 smithi134 ceph-mon[34132]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:44:48.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:47 smithi151 ceph-mon[34815]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:44:48.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:48.315+0000 7f8211a00700 1 -- 172.21.15.82:0/129159698 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f820c1033d0 msgr2=0x7f820c103850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:44:48.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:48.315+0000 7f8211a00700 1 --2- 172.21.15.82:0/129159698 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f820c1033d0 0x7f820c103850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f81f4009990 tx=0x7f81f4009ca0 comp rx=0 tx=0).stop 2024-05-08T05:44:48.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:48.315+0000 7f8211a00700 1 -- 172.21.15.82:0/129159698 shutdown_connections 2024-05-08T05:44:48.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:48.315+0000 7f8211a00700 1 --2- 172.21.15.82:0/129159698 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f820c103d90 0x7f820c1102a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:48.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:48.315+0000 7f8211a00700 1 --2- 172.21.15.82:0/129159698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f820c109460 0x7f820c109840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:48.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:48.315+0000 7f8211a00700 1 --2- 172.21.15.82:0/129159698 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f820c1033d0 0x7f820c103850 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:48.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:48.315+0000 7f8211a00700 1 -- 172.21.15.82:0/129159698 >> 172.21.15.82:0/129159698 conn(0x7f820c0fef20 msgr2=0x7f820c101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:44:48.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:48.316+0000 7f8211a00700 1 -- 172.21.15.82:0/129159698 shutdown_connections 2024-05-08T05:44:48.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:48.316+0000 7f8211a00700 1 -- 172.21.15.82:0/129159698 wait complete. 2024-05-08T05:44:48.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:48.317+0000 7f8211a00700 1 Processor -- start 2024-05-08T05:44:48.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:48.317+0000 7f8211a00700 1 -- start start 2024-05-08T05:44:48.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:48.317+0000 7f8211a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f820c1033d0 0x7f820c0757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:44:48.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:48.317+0000 7f8211a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f820c103d90 0x7f820c075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:44:48.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:48.317+0000 7f8211a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f820c109460 0x7f820c076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:44:48.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:48.317+0000 7f8211a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f820c1135c0 con 0x7f820c1033d0 2024-05-08T05:44:48.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:48.317+0000 7f8211a00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f820c113440 con 0x7f820c109460 2024-05-08T05:44:48.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:48.317+0000 7f8211a00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f820c113740 con 0x7f820c103d90 2024-05-08T05:44:48.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:48.318+0000 7f820be00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f820c1033d0 0x7f820c0757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:44:48.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:48.318+0000 7f8203e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f820c103d90 0x7f820c075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:44:48.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:48.318+0000 7f820be00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f820c1033d0 0x7f820c0757a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44292/0 (socket says 172.21.15.82:44292) 2024-05-08T05:44:48.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:48.318+0000 7f820be00700 1 -- 172.21.15.82:0/856918999 learned_addr learned my addr 172.21.15.82:0/856918999 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:44:48.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:48.318+0000 7f8211000700 1 --2- 172.21.15.82:0/856918999 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f820c109460 0x7f820c076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:44:48.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:48.318+0000 7f8203e00700 1 -- 172.21.15.82:0/856918999 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f820c109460 msgr2=0x7f820c076220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:44:48.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:48.318+0000 7f8203e00700 1 --2- 172.21.15.82:0/856918999 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f820c109460 0x7f820c076220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:48.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:48.318+0000 7f8203e00700 1 -- 172.21.15.82:0/856918999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f820c1033d0 msgr2=0x7f820c0757a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:44:48.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:48.318+0000 7f8203e00700 1 --2- 172.21.15.82:0/856918999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f820c1033d0 0x7f820c0757a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:48.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:48.318+0000 7f8203e00700 1 -- 172.21.15.82:0/856918999 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f820c1a8000 con 0x7f820c103d90 2024-05-08T05:44:48.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:48.318+0000 7f820be00700 1 --2- 172.21.15.82:0/856918999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f820c1033d0 0x7f820c0757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:44:48.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:48.318+0000 7f8203e00700 1 --2- 172.21.15.82:0/856918999 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f820c103d90 0x7f820c075ce0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f81f40098e0 tx=0x7f81f40057c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:44:48.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:48.319+0000 7f8209600700 1 -- 172.21.15.82:0/856918999 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f4027070 con 0x7f820c103d90 2024-05-08T05:44:48.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:48.319+0000 7f8209600700 1 -- 172.21.15.82:0/856918999 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81f4022470 con 0x7f820c103d90 2024-05-08T05:44:48.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:48.319+0000 7f8209600700 1 -- 172.21.15.82:0/856918999 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f4017650 con 0x7f820c103d90 2024-05-08T05:44:48.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:48.319+0000 7f8211a00700 1 -- 172.21.15.82:0/856918999 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f820c1a8290 con 0x7f820c103d90 2024-05-08T05:44:48.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:48.319+0000 7f8211a00700 1 -- 172.21.15.82:0/856918999 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f820c1a8740 con 0x7f820c103d90 2024-05-08T05:44:48.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:48.320+0000 7f8211a00700 1 -- 172.21.15.82:0/856918999 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f820c06a190 con 0x7f820c103d90 2024-05-08T05:44:48.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:48.322+0000 7f8209600700 1 -- 172.21.15.82:0/856918999 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f81f402a070 con 0x7f820c103d90 2024-05-08T05:44:48.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:48.323+0000 7f8209600700 1 --2- 172.21.15.82:0/856918999 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f81f00b2900 0x7f81f00b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:44:48.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:48.324+0000 7f8209600700 1 -- 172.21.15.82:0/856918999 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f81f40e2b40 con 0x7f820c103d90 2024-05-08T05:44:48.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:48.324+0000 7f820be00700 1 --2- 172.21.15.82:0/856918999 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f81f00b2900 0x7f81f00b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:44:48.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:48.324+0000 7f820be00700 1 --2- 172.21.15.82:0/856918999 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f81f00b2900 0x7f81f00b4dc0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f81fc011550 tx=0x7f81fc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:44:48.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:48.332+0000 7f8209600700 1 -- 172.21.15.82:0/856918999 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f81f4013070 con 0x7f820c103d90 2024-05-08T05:44:48.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:48.562+0000 7f8211a00700 1 -- 172.21.15.82:0/856918999 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f820c02e510 con 0x7f820c103d90 2024-05-08T05:44:48.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:48.562+0000 7f8209600700 1 -- 172.21.15.82:0/856918999 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v73) ==== 93+0+10 (secure 0 0 0) 0x7f81f40aacf0 con 0x7f820c103d90 2024-05-08T05:44:48.563 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-05-08T05:44:48.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:48.566+0000 7f8211a00700 1 -- 172.21.15.82:0/856918999 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f81f00b2900 msgr2=0x7f81f00b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:44:48.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:48.566+0000 7f8211a00700 1 --2- 172.21.15.82:0/856918999 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f81f00b2900 0x7f81f00b4dc0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f81fc011550 tx=0x7f81fc009260 comp rx=0 tx=0).stop 2024-05-08T05:44:48.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:48.566+0000 7f8211a00700 1 -- 172.21.15.82:0/856918999 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f820c103d90 msgr2=0x7f820c075ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:44:48.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:48.566+0000 7f8211a00700 1 --2- 172.21.15.82:0/856918999 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f820c103d90 0x7f820c075ce0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f81f40098e0 tx=0x7f81f40057c0 comp rx=0 tx=0).stop 2024-05-08T05:44:48.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:48.566+0000 7f8211a00700 1 -- 172.21.15.82:0/856918999 shutdown_connections 2024-05-08T05:44:48.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:48.566+0000 7f8211a00700 1 --2- 172.21.15.82:0/856918999 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f820c109460 0x7f820c076220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:48.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:48.566+0000 7f8211a00700 1 --2- 172.21.15.82:0/856918999 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f81f00b2900 0x7f81f00b4dc0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:48.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:48.566+0000 7f8211a00700 1 --2- 172.21.15.82:0/856918999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f820c1033d0 0x7f820c0757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:48.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:48.566+0000 7f8211a00700 1 --2- 172.21.15.82:0/856918999 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f820c103d90 0x7f820c075ce0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:48.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:48.566+0000 7f8211a00700 1 -- 172.21.15.82:0/856918999 >> 172.21.15.82:0/856918999 conn(0x7f820c0fef20 msgr2=0x7f820c0ff620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:44:48.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:48.567+0000 7f8211a00700 1 -- 172.21.15.82:0/856918999 shutdown_connections 2024-05-08T05:44:48.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:48.567+0000 7f8211a00700 1 -- 172.21.15.82:0/856918999 wait complete. 2024-05-08T05:44:48.957 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:48 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/856918999' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T05:44:48.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:48 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/856918999' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T05:44:49.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:48 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/856918999' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T05:44:49.357 INFO:tasks.cephadm:Adding mds.a on smithi082 2024-05-08T05:44:49.357 INFO:tasks.cephadm:Adding mds.d on smithi082 2024-05-08T05:44:49.357 INFO:tasks.cephadm:Adding mds.g on smithi082 2024-05-08T05:44:49.358 INFO:tasks.cephadm:Adding mds.j on smithi082 2024-05-08T05:44:49.358 INFO:tasks.cephadm:Adding mds.b on smithi134 2024-05-08T05:44:49.358 INFO:tasks.cephadm:Adding mds.e on smithi134 2024-05-08T05:44:49.358 INFO:tasks.cephadm:Adding mds.h on smithi134 2024-05-08T05:44:49.358 INFO:tasks.cephadm:Adding mds.k on smithi134 2024-05-08T05:44:49.358 INFO:tasks.cephadm:Adding mds.c on smithi151 2024-05-08T05:44:49.358 INFO:tasks.cephadm:Adding mds.f on smithi151 2024-05-08T05:44:49.358 INFO:tasks.cephadm:Adding mds.i on smithi151 2024-05-08T05:44:49.358 INFO:tasks.cephadm:Adding mds.l on smithi151 2024-05-08T05:44:49.358 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph orch apply mds all '12;smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi134=b;smithi134=e;smithi134=h;smithi134=k;smithi151=c;smithi151=f;smithi151=i;smithi151=l' 2024-05-08T05:44:49.598 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T05:44:50.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:49 smithi134 ceph-mon[34132]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:44:50.048 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:49 smithi151 ceph-mon[34815]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:44:50.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:49 smithi082 ceph-mon[30098]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:44:51.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:51.209+0000 7f7429c60700 1 -- 172.21.15.151:0/3870075541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7424104700 msgr2=0x7f7424104b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:44:51.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:51.209+0000 7f7429c60700 1 --2- 172.21.15.151:0/3870075541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7424104700 0x7f7424104b60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7418009990 tx=0x7f7418009ca0 comp rx=0 tx=0).stop 2024-05-08T05:44:51.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:51.209+0000 7f7429c60700 1 -- 172.21.15.151:0/3870075541 shutdown_connections 2024-05-08T05:44:51.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:51.209+0000 7f7429c60700 1 --2- 172.21.15.151:0/3870075541 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7424103500 0x7f7424103920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:51.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:51.209+0000 7f7429c60700 1 --2- 172.21.15.151:0/3870075541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f74241050a0 0x7f742410b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:51.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:51.209+0000 7f7429c60700 1 --2- 172.21.15.151:0/3870075541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7424104700 0x7f7424104b60 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:51.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:51.209+0000 7f7429c60700 1 -- 172.21.15.151:0/3870075541 >> 172.21.15.151:0/3870075541 conn(0x7f74240feaa0 msgr2=0x7f7424100ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:44:51.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:51.209+0000 7f7429c60700 1 -- 172.21.15.151:0/3870075541 shutdown_connections 2024-05-08T05:44:51.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:51.209+0000 7f7429c60700 1 -- 172.21.15.151:0/3870075541 wait complete. 2024-05-08T05:44:51.210 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:51.210+0000 7f7429c60700 1 Processor -- start 2024-05-08T05:44:51.211 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:51.210+0000 7f7429c60700 1 -- start start 2024-05-08T05:44:51.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:51.210+0000 7f7429c60700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7424103500 0x7f7424199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:44:51.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:51.210+0000 7f7429c60700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7424104700 0x7f7424199b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:44:51.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:51.210+0000 7f7429c60700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74241050a0 0x7f74241a0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:44:51.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:51.210+0000 7f7429c60700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f742410f040 con 0x7f7424104700 2024-05-08T05:44:51.212 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:51.210+0000 7f7429c60700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f742410eec0 con 0x7f74241050a0 2024-05-08T05:44:51.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:51.210+0000 7f7429c60700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f742410f1c0 con 0x7f7424103500 2024-05-08T05:44:51.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:51.210+0000 7f74237fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7424103500 0x7f7424199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:44:51.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:51.210+0000 7f74237fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7424103500 0x7f7424199630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:54298/0 (socket says 172.21.15.151:54298) 2024-05-08T05:44:51.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:51.210+0000 7f74237fe700 1 -- 172.21.15.151:0/2776349189 learned_addr learned my addr 172.21.15.151:0/2776349189 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-05-08T05:44:51.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:51.210+0000 7f7423fff700 1 --2- 172.21.15.151:0/2776349189 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74241050a0 0x7f74241a0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:44:51.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:51.210+0000 7f74237fe700 1 -- 172.21.15.151:0/2776349189 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74241050a0 msgr2=0x7f74241a0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:44:51.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:51.210+0000 7f74237fe700 1 --2- 172.21.15.151:0/2776349189 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74241050a0 0x7f74241a0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:51.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:51.210+0000 7f74237fe700 1 -- 172.21.15.151:0/2776349189 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7424104700 msgr2=0x7f7424199b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:44:51.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:51.210+0000 7f74237fe700 1 --2- 172.21.15.151:0/2776349189 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7424104700 0x7f7424199b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:51.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:51.210+0000 7f74237fe700 1 -- 172.21.15.151:0/2776349189 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74241a1290 con 0x7f7424103500 2024-05-08T05:44:51.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:51.210+0000 7f7423fff700 1 --2- 172.21.15.151:0/2776349189 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74241050a0 0x7f74241a0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:44:51.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:51.210+0000 7f74237fe700 1 --2- 172.21.15.151:0/2776349189 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7424103500 0x7f7424199630 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f741400c9c0 tx=0x7f741400cd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:44:51.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:51.211+0000 7f7420ff9700 1 -- 172.21.15.151:0/2776349189 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7414007ac0 con 0x7f7424103500 2024-05-08T05:44:51.213 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:51.211+0000 7f7429c60700 1 -- 172.21.15.151:0/2776349189 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74241a1580 con 0x7f7424103500 2024-05-08T05:44:51.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:51.211+0000 7f7420ff9700 1 -- 172.21.15.151:0/2776349189 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7414007c60 con 0x7f7424103500 2024-05-08T05:44:51.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:51.211+0000 7f7420ff9700 1 -- 172.21.15.151:0/2776349189 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7414018660 con 0x7f7424103500 2024-05-08T05:44:51.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:51.211+0000 7f7429c60700 1 -- 172.21.15.151:0/2776349189 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74241a1b10 con 0x7f7424103500 2024-05-08T05:44:51.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:51.212+0000 7f7429c60700 1 -- 172.21.15.151:0/2776349189 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f742406a190 con 0x7f7424103500 2024-05-08T05:44:51.214 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:51.213+0000 7f7420ff9700 1 -- 172.21.15.151:0/2776349189 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f7414004020 con 0x7f7424103500 2024-05-08T05:44:51.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:51.213+0000 7f7420ff9700 1 --2- 172.21.15.151:0/2776349189 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f740c0b2880 0x7f740c0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:44:51.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:51.214+0000 7f7420ff9700 1 -- 172.21.15.151:0/2776349189 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f74140e1f10 con 0x7f7424103500 2024-05-08T05:44:51.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:51.214+0000 7f7422ffd700 1 --2- 172.21.15.151:0/2776349189 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f740c0b2880 0x7f740c0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:44:51.215 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:51.215+0000 7f7422ffd700 1 --2- 172.21.15.151:0/2776349189 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f740c0b2880 0x7f740c0b4d40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f74180098e0 tx=0x7f7418003860 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:44:51.217 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:51.217+0000 7f7420ff9700 1 -- 172.21.15.151:0/2776349189 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f7414053df0 con 0x7f7424103500 2024-05-08T05:44:51.433 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:51.433+0000 7f7429c60700 1 -- 172.21.15.151:0/2776349189 --> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi134=b;smithi134=e;smithi134=h;smithi134=k;smithi151=c;smithi151=f;smithi151=i;smithi151=l", "target": ["mon-mgr", ""]}) -- 0x7f7424063ae0 con 0x7f740c0b2880 2024-05-08T05:44:51.450 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:51.449+0000 7f7420ff9700 1 -- 172.21.15.151:0/2776349189 <== mgr.14152 v2:172.21.15.82:6800/4089180091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f7424063ae0 con 0x7f740c0b2880 2024-05-08T05:44:51.450 INFO:teuthology.orchestra.run.smithi151.stdout:Scheduled mds.all update... 2024-05-08T05:44:51.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:51.452+0000 7f7429c60700 1 -- 172.21.15.151:0/2776349189 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f740c0b2880 msgr2=0x7f740c0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:44:51.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:51.452+0000 7f7429c60700 1 --2- 172.21.15.151:0/2776349189 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f740c0b2880 0x7f740c0b4d40 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f74180098e0 tx=0x7f7418003860 comp rx=0 tx=0).stop 2024-05-08T05:44:51.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:51.452+0000 7f7429c60700 1 -- 172.21.15.151:0/2776349189 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7424103500 msgr2=0x7f7424199630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:44:51.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:51.452+0000 7f7429c60700 1 --2- 172.21.15.151:0/2776349189 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7424103500 0x7f7424199630 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f741400c9c0 tx=0x7f741400cd80 comp rx=0 tx=0).stop 2024-05-08T05:44:51.452 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:51.452+0000 7f7429c60700 1 -- 172.21.15.151:0/2776349189 shutdown_connections 2024-05-08T05:44:51.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:51.452+0000 7f7429c60700 1 --2- 172.21.15.151:0/2776349189 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74241050a0 0x7f74241a0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:51.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:51.452+0000 7f7429c60700 1 --2- 172.21.15.151:0/2776349189 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f740c0b2880 0x7f740c0b4d40 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:51.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:51.452+0000 7f7429c60700 1 --2- 172.21.15.151:0/2776349189 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7424103500 0x7f7424199630 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:51.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:51.452+0000 7f7429c60700 1 --2- 172.21.15.151:0/2776349189 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7424104700 0x7f7424199b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:51.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:51.452+0000 7f7429c60700 1 -- 172.21.15.151:0/2776349189 >> 172.21.15.151:0/2776349189 conn(0x7f74240feaa0 msgr2=0x7f7424107a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:44:51.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:51.452+0000 7f7429c60700 1 -- 172.21.15.151:0/2776349189 shutdown_connections 2024-05-08T05:44:51.453 INFO:teuthology.orchestra.run.smithi151.stderr:2024-05-08T05:44:51.452+0000 7f7429c60700 1 -- 172.21.15.151:0/2776349189 wait complete. 2024-05-08T05:44:52.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:51 smithi134 ceph-mon[34132]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:44:52.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:51 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:52.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:51 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:44:52.127 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:51 smithi151 ceph-mon[34815]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:44:52.127 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:51 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:52.127 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:51 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:44:52.155 DEBUG:teuthology.orchestra.run.smithi082:mds.a> sudo journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mds.a.service 2024-05-08T05:44:52.160 DEBUG:teuthology.orchestra.run.smithi082:mds.d> sudo journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mds.d.service 2024-05-08T05:44:52.206 DEBUG:teuthology.orchestra.run.smithi082:mds.g> sudo journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mds.g.service 2024-05-08T05:44:52.210 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:51 smithi082 ceph-mon[30098]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:44:52.210 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:51 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:52.210 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:51 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:44:52.213 DEBUG:teuthology.orchestra.run.smithi082:mds.j> sudo journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mds.j.service 2024-05-08T05:44:52.260 DEBUG:teuthology.orchestra.run.smithi134:mds.b> sudo journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mds.b.service 2024-05-08T05:44:52.262 DEBUG:teuthology.orchestra.run.smithi134:mds.e> sudo journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mds.e.service 2024-05-08T05:44:52.305 DEBUG:teuthology.orchestra.run.smithi134:mds.h> sudo journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mds.h.service 2024-05-08T05:44:52.348 DEBUG:teuthology.orchestra.run.smithi134:mds.k> sudo journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mds.k.service 2024-05-08T05:44:52.391 DEBUG:teuthology.orchestra.run.smithi151:mds.c> sudo journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mds.c.service 2024-05-08T05:44:52.396 DEBUG:teuthology.orchestra.run.smithi151:mds.f> sudo journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mds.f.service 2024-05-08T05:44:52.439 DEBUG:teuthology.orchestra.run.smithi151:mds.i> sudo journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mds.i.service 2024-05-08T05:44:52.482 DEBUG:teuthology.orchestra.run.smithi151:mds.l> sudo journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mds.l.service 2024-05-08T05:44:52.525 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-05-08T05:44:52.525 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T05:44:52.960 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:44:52.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:52 smithi082 ceph-mon[30098]: from='client.24424 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi134=b;smithi134=e;smithi134=h;smithi134=k;smithi151=c;smithi151=f;smithi151=i;smithi151=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:44:52.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:52 smithi082 ceph-mon[30098]: Saving service mds.all spec with placement smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi134=b;smithi134=e;smithi134=h;smithi134=k;smithi151=c;smithi151=f;smithi151=i;smithi151=l;count:12 2024-05-08T05:44:52.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:52 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:44:52.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:52 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:44:52.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:52 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:52.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:52 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:44:52.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:52 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:44:52.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:52 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:44:53.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:52 smithi134 ceph-mon[34132]: from='client.24424 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi134=b;smithi134=e;smithi134=h;smithi134=k;smithi151=c;smithi151=f;smithi151=i;smithi151=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:44:53.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:52 smithi134 ceph-mon[34132]: Saving service mds.all spec with placement smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi134=b;smithi134=e;smithi134=h;smithi134=k;smithi151=c;smithi151=f;smithi151=i;smithi151=l;count:12 2024-05-08T05:44:53.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:52 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:44:53.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:52 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:44:53.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:52 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:53.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:52 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:44:53.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:52 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:44:53.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:52 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:44:53.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:52 smithi151 ceph-mon[34815]: from='client.24424 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi134=b;smithi134=e;smithi134=h;smithi134=k;smithi151=c;smithi151=f;smithi151=i;smithi151=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:44:53.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:52 smithi151 ceph-mon[34815]: Saving service mds.all spec with placement smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi134=b;smithi134=e;smithi134=h;smithi134=k;smithi151=c;smithi151=f;smithi151=i;smithi151=l;count:12 2024-05-08T05:44:53.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:52 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:44:53.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:52 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:44:53.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:52 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:53.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:52 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:44:53.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:52 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:44:53.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:52 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:44:53.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:53 smithi151 ceph-mon[34815]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:44:53.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:53 smithi151 ceph-mon[34815]: Deploying daemon mds.l on smithi151 2024-05-08T05:44:54.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:53 smithi134 ceph-mon[34132]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:44:54.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:53 smithi134 ceph-mon[34132]: Deploying daemon mds.l on smithi151 2024-05-08T05:44:54.042 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:53 smithi082 ceph-mon[30098]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:44:54.042 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:53 smithi082 ceph-mon[30098]: Deploying daemon mds.l on smithi151 2024-05-08T05:44:54.880 INFO:journalctl@ceph.mds.l.smithi151.stdout:May 08 05:44:54 smithi151 systemd[1]: Starting Ceph mds.l for c739a5c8-0cfc-11ef-bc97-c7b262605968... 2024-05-08T05:44:55.190 INFO:journalctl@ceph.mds.l.smithi151.stdout:May 08 05:44:54 smithi151 podman[65131]: 2024-05-08 05:44:54.839583648 +0000 UTC m=+0.017892776 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T05:44:55.190 INFO:journalctl@ceph.mds.l.smithi151.stdout:May 08 05:44:54 smithi151 podman[65131]: 2024-05-08 05:44:54.962685496 +0000 UTC m=+0.140994623 container create bf3a64bfb1378e0eb95c4fa8704d64687bc276876afcc1a2771c7a5670962c26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-l, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=wip-57676-3-bee299f) 2024-05-08T05:44:55.190 INFO:journalctl@ceph.mds.l.smithi151.stdout:May 08 05:44:55 smithi151 podman[65131]: 2024-05-08 05:44:55.190679489 +0000 UTC m=+0.368988617 container init bf3a64bfb1378e0eb95c4fa8704d64687bc276876afcc1a2771c7a5670962c26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-l, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-57676-3-bee299f, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2) 2024-05-08T05:44:55.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:55.283+0000 7f2beb400700 1 -- 172.21.15.82:0/1854697265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2be4104100 msgr2=0x7f2be4108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:44:55.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:55.283+0000 7f2beb400700 1 --2- 172.21.15.82:0/1854697265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2be4104100 0x7f2be4108120 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0009920 tx=0x7f2bd0009c30 comp rx=0 tx=0).stop 2024-05-08T05:44:55.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:55.283+0000 7f2beb400700 1 -- 172.21.15.82:0/1854697265 shutdown_connections 2024-05-08T05:44:55.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:55.283+0000 7f2beb400700 1 --2- 172.21.15.82:0/1854697265 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2be4103750 0x7f2be4103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:55.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:55.283+0000 7f2beb400700 1 --2- 172.21.15.82:0/1854697265 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2be4108850 0x7f2be41103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:55.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:55.283+0000 7f2beb400700 1 --2- 172.21.15.82:0/1854697265 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2be4104100 0x7f2be4108120 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:55.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:55.283+0000 7f2beb400700 1 -- 172.21.15.82:0/1854697265 >> 172.21.15.82:0/1854697265 conn(0x7f2be407a600 msgr2=0x7f2be407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:44:55.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:55.284+0000 7f2beb400700 1 -- 172.21.15.82:0/1854697265 shutdown_connections 2024-05-08T05:44:55.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:55.284+0000 7f2beb400700 1 -- 172.21.15.82:0/1854697265 wait complete. 2024-05-08T05:44:55.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:55.285+0000 7f2beb400700 1 Processor -- start 2024-05-08T05:44:55.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:55.285+0000 7f2beb400700 1 -- start start 2024-05-08T05:44:55.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:55.285+0000 7f2beb400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2be4103750 0x7f2be419f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:44:55.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:55.285+0000 7f2beb400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2be4104100 0x7f2be419fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:44:55.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:55.285+0000 7f2beb400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2be4108850 0x7f2be4199a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:44:55.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:55.285+0000 7f2beb400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2be4113660 con 0x7f2be4103750 2024-05-08T05:44:55.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:55.285+0000 7f2beb400700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2be41134e0 con 0x7f2be4104100 2024-05-08T05:44:55.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:55.285+0000 7f2beb400700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2be41137e0 con 0x7f2be4108850 2024-05-08T05:44:55.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:55.286+0000 7f2be8a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2be4103750 0x7f2be419f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:44:55.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:55.286+0000 7f2be8a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2be4103750 0x7f2be419f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41874/0 (socket says 172.21.15.82:41874) 2024-05-08T05:44:55.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:55.286+0000 7f2be8a00700 1 -- 172.21.15.82:0/3589954296 learned_addr learned my addr 172.21.15.82:0/3589954296 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:44:55.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:55.286+0000 7f2be9400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2be4108850 0x7f2be4199a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:44:55.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:55.286+0000 7f2be3e00700 1 --2- 172.21.15.82:0/3589954296 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2be4104100 0x7f2be419fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:44:55.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:55.286+0000 7f2be3e00700 1 -- 172.21.15.82:0/3589954296 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2be4108850 msgr2=0x7f2be4199a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:44:55.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:55.286+0000 7f2be3e00700 1 --2- 172.21.15.82:0/3589954296 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2be4108850 0x7f2be4199a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:55.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:55.286+0000 7f2be3e00700 1 -- 172.21.15.82:0/3589954296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2be4103750 msgr2=0x7f2be419f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:44:55.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:55.286+0000 7f2be3e00700 1 --2- 172.21.15.82:0/3589954296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2be4103750 0x7f2be419f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:55.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:55.286+0000 7f2be3e00700 1 -- 172.21.15.82:0/3589954296 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2be419a160 con 0x7f2be4104100 2024-05-08T05:44:55.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:55.286+0000 7f2be9400700 1 --2- 172.21.15.82:0/3589954296 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2be4108850 0x7f2be4199a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:44:55.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:55.286+0000 7f2be8a00700 1 --2- 172.21.15.82:0/3589954296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2be4103750 0x7f2be419f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:44:55.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:55.286+0000 7f2be3e00700 1 --2- 172.21.15.82:0/3589954296 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2be4104100 0x7f2be419fd80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0000c00 tx=0x7f2bd000f950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:44:55.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:55.287+0000 7f2be1600700 1 -- 172.21.15.82:0/3589954296 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd0027070 con 0x7f2be4104100 2024-05-08T05:44:55.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:55.287+0000 7f2be1600700 1 -- 172.21.15.82:0/3589954296 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2bd00054f0 con 0x7f2be4104100 2024-05-08T05:44:55.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:55.287+0000 7f2beb400700 1 -- 172.21.15.82:0/3589954296 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2be419a3f0 con 0x7f2be4104100 2024-05-08T05:44:55.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:55.287+0000 7f2be1600700 1 -- 172.21.15.82:0/3589954296 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd0004930 con 0x7f2be4104100 2024-05-08T05:44:55.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:55.287+0000 7f2beb400700 1 -- 172.21.15.82:0/3589954296 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2be41a6710 con 0x7f2be4104100 2024-05-08T05:44:55.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:55.288+0000 7f2beb400700 1 -- 172.21.15.82:0/3589954296 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2be4104be0 con 0x7f2be4104100 2024-05-08T05:44:55.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:55.290+0000 7f2be1600700 1 -- 172.21.15.82:0/3589954296 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f2bd002a070 con 0x7f2be4104100 2024-05-08T05:44:55.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:55.291+0000 7f2be1600700 1 --2- 172.21.15.82:0/3589954296 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2bcc0b2880 0x7f2bcc0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:44:55.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:55.292+0000 7f2be1600700 1 -- 172.21.15.82:0/3589954296 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f2bd00e26e0 con 0x7f2be4104100 2024-05-08T05:44:55.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:55.292+0000 7f2be8a00700 1 --2- 172.21.15.82:0/3589954296 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2bcc0b2880 0x7f2bcc0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:44:55.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:55.292+0000 7f2be8a00700 1 --2- 172.21.15.82:0/3589954296 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2bcc0b2880 0x7f2bcc0b4d40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2bd8009fd0 tx=0x7f2bd800b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:44:55.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:55.296+0000 7f2be1600700 1 -- 172.21.15.82:0/3589954296 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2bd0013030 con 0x7f2be4104100 2024-05-08T05:44:55.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:55.584+0000 7f2beb400700 1 -- 172.21.15.82:0/3589954296 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2be402e510 con 0x7f2be4104100 2024-05-08T05:44:55.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:55.585+0000 7f2be1600700 1 -- 172.21.15.82:0/3589954296 <== mon.2 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1396 (secure 0 0 0) 0x7f2bd00aa890 con 0x7f2be4104100 2024-05-08T05:44:55.586 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:44:55.586 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/3625067797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3625067797},{"type":"v1","addr":"172.21.15.151:6833","nonce":3625067797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-08T05:44:55.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:55.588+0000 7f2beb400700 1 -- 172.21.15.82:0/3589954296 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2bcc0b2880 msgr2=0x7f2bcc0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:44:55.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:55.588+0000 7f2beb400700 1 --2- 172.21.15.82:0/3589954296 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2bcc0b2880 0x7f2bcc0b4d40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2bd8009fd0 tx=0x7f2bd800b040 comp rx=0 tx=0).stop 2024-05-08T05:44:55.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:55.588+0000 7f2beb400700 1 -- 172.21.15.82:0/3589954296 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2be4104100 msgr2=0x7f2be419fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:44:55.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:55.588+0000 7f2beb400700 1 --2- 172.21.15.82:0/3589954296 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2be4104100 0x7f2be419fd80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0000c00 tx=0x7f2bd000f950 comp rx=0 tx=0).stop 2024-05-08T05:44:55.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:55.588+0000 7f2beb400700 1 -- 172.21.15.82:0/3589954296 shutdown_connections 2024-05-08T05:44:55.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:55.588+0000 7f2beb400700 1 --2- 172.21.15.82:0/3589954296 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2bcc0b2880 0x7f2bcc0b4d40 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:55.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:55.588+0000 7f2beb400700 1 --2- 172.21.15.82:0/3589954296 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2be4108850 0x7f2be4199a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:55.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:55.588+0000 7f2beb400700 1 --2- 172.21.15.82:0/3589954296 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2be4103750 0x7f2be419f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:55.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:55.588+0000 7f2beb400700 1 --2- 172.21.15.82:0/3589954296 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2be4104100 0x7f2be419fd80 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:44:55.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:55.588+0000 7f2beb400700 1 -- 172.21.15.82:0/3589954296 >> 172.21.15.82:0/3589954296 conn(0x7f2be407a600 msgr2=0x7f2be4101920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:44:55.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:55.588+0000 7f2beb400700 1 -- 172.21.15.82:0/3589954296 shutdown_connections 2024-05-08T05:44:55.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:44:55.589+0000 7f2beb400700 1 -- 172.21.15.82:0/3589954296 wait complete. 2024-05-08T05:44:55.591 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 2 2024-05-08T05:44:55.629 INFO:journalctl@ceph.mds.l.smithi151.stdout:May 08 05:44:55 smithi151 podman[65131]: 2024-05-08 05:44:55.193283374 +0000 UTC m=+0.371592503 container start bf3a64bfb1378e0eb95c4fa8704d64687bc276876afcc1a2771c7a5670962c26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-l, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=wip-57676-3-bee299f, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2) 2024-05-08T05:44:55.630 INFO:journalctl@ceph.mds.l.smithi151.stdout:May 08 05:44:55 smithi151 ceph-mds[65150]: -- 172.21.15.151:0/3881197107 <== mon.1 v2:172.21.15.151:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555d5bd5ba40 con 0x555d5bd2ec00 2024-05-08T05:44:55.630 INFO:journalctl@ceph.mds.l.smithi151.stdout:May 08 05:44:55 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-l[65146]: starting mds.l at 2024-05-08T05:44:55.630 INFO:journalctl@ceph.mds.l.smithi151.stdout:May 08 05:44:55 smithi151 bash[65131]: bf3a64bfb1378e0eb95c4fa8704d64687bc276876afcc1a2771c7a5670962c26 2024-05-08T05:44:55.630 INFO:journalctl@ceph.mds.l.smithi151.stdout:May 08 05:44:55 smithi151 systemd[1]: Started Ceph mds.l for c739a5c8-0cfc-11ef-bc97-c7b262605968. 2024-05-08T05:44:55.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:55 smithi082 ceph-mon[30098]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:44:55.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:55 smithi082 ceph-mon[30098]: mds.? [v2:172.21.15.151:6832/3625067797,v1:172.21.15.151:6833/3625067797] up:boot 2024-05-08T05:44:55.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:55 smithi082 ceph-mon[30098]: fsmap 1 up:standby 2024-05-08T05:44:55.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:55 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-08T05:44:55.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:55 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:55.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:55 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:55.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:55 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:55.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:55 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:44:55.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:55 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:44:55.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:55 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:44:55.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:55 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/3589954296' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:44:56.041 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:55 smithi134 ceph-mon[34132]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:44:56.041 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:55 smithi134 ceph-mon[34132]: mds.? [v2:172.21.15.151:6832/3625067797,v1:172.21.15.151:6833/3625067797] up:boot 2024-05-08T05:44:56.041 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:55 smithi134 ceph-mon[34132]: fsmap 1 up:standby 2024-05-08T05:44:56.041 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:55 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-08T05:44:56.041 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:55 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:56.041 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:55 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:56.041 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:55 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:56.042 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:55 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:44:56.042 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:55 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:44:56.042 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:55 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:44:56.042 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:55 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/3589954296' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:44:56.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:55 smithi151 ceph-mon[34815]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:44:56.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:55 smithi151 ceph-mon[34815]: mds.? [v2:172.21.15.151:6832/3625067797,v1:172.21.15.151:6833/3625067797] up:boot 2024-05-08T05:44:56.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:55 smithi151 ceph-mon[34815]: fsmap 1 up:standby 2024-05-08T05:44:56.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:55 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-08T05:44:56.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:55 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:56.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:55 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:56.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:55 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:56.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:55 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:44:56.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:55 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:44:56.131 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:55 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:44:56.131 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:55 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/3589954296' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:44:57.064 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:56 smithi134 ceph-mon[34132]: Deploying daemon mds.k on smithi134 2024-05-08T05:44:57.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:56 smithi151 ceph-mon[34815]: Deploying daemon mds.k on smithi134 2024-05-08T05:44:57.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:56 smithi082 ceph-mon[30098]: Deploying daemon mds.k on smithi134 2024-05-08T05:44:58.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:57 smithi134 ceph-mon[34132]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:44:58.000 INFO:journalctl@ceph.mds.k.smithi134.stdout:May 08 05:44:57 smithi134 podman[64037]: 2024-05-08 05:44:57.973339522 +0000 UTC m=+0.136673889 container create acaa1f3403b1955794ccce046e04d74d0c0cd3b6006be5173622cda659323ac0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-k, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-57676-3-bee299f, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-05-08T05:44:58.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:57 smithi151 ceph-mon[34815]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:44:58.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:57 smithi082 ceph-mon[30098]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:44:58.416 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T05:44:58.500 INFO:journalctl@ceph.mds.k.smithi134.stdout:May 08 05:44:58 smithi134 podman[64037]: 2024-05-08 05:44:58.242662375 +0000 UTC m=+0.405996740 container init acaa1f3403b1955794ccce046e04d74d0c0cd3b6006be5173622cda659323ac0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-k, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=wip-57676-3-bee299f, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0) 2024-05-08T05:44:58.501 INFO:journalctl@ceph.mds.k.smithi134.stdout:May 08 05:44:58 smithi134 podman[64037]: 2024-05-08 05:44:58.24525799 +0000 UTC m=+0.408592364 container start acaa1f3403b1955794ccce046e04d74d0c0cd3b6006be5173622cda659323ac0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-k, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, RELEASE=wip-57676-3-bee299f, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True) 2024-05-08T05:44:58.501 INFO:journalctl@ceph.mds.k.smithi134.stdout:May 08 05:44:58 smithi134 ceph-mds[64056]: -- 172.21.15.134:0/1641592227 <== mon.2 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55acf34a1a40 con 0x55acf3475000 2024-05-08T05:44:58.501 INFO:journalctl@ceph.mds.k.smithi134.stdout:May 08 05:44:58 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-k[64052]: starting mds.k at 2024-05-08T05:44:58.501 INFO:journalctl@ceph.mds.k.smithi134.stdout:May 08 05:44:58 smithi134 bash[64037]: acaa1f3403b1955794ccce046e04d74d0c0cd3b6006be5173622cda659323ac0 2024-05-08T05:44:58.501 INFO:journalctl@ceph.mds.k.smithi134.stdout:May 08 05:44:58 smithi134 systemd[1]: Started Ceph mds.k for c739a5c8-0cfc-11ef-bc97-c7b262605968. 2024-05-08T05:44:58.858 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:44:59.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:59 smithi082 ceph-mon[30098]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:44:59.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:59 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:59.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:59 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:59.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:59 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:59.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:59 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:44:59.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:59 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:44:59.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:59 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:44:59.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:59 smithi082 ceph-mon[30098]: Deploying daemon mds.j on smithi082 2024-05-08T05:44:59.722 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:59 smithi082 ceph-mon[30098]: mds.? [v2:172.21.15.134:6832/3827691638,v1:172.21.15.134:6833/3827691638] up:boot 2024-05-08T05:44:59.722 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:59 smithi082 ceph-mon[30098]: fsmap 2 up:standby 2024-05-08T05:44:59.722 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:44:59 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-08T05:44:59.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:59 smithi134 ceph-mon[34132]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:44:59.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:59 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:59.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:59 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:59.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:59 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:59.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:59 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:44:59.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:59 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:44:59.751 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:59 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:44:59.751 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:59 smithi134 ceph-mon[34132]: Deploying daemon mds.j on smithi082 2024-05-08T05:44:59.751 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:59 smithi134 ceph-mon[34132]: mds.? [v2:172.21.15.134:6832/3827691638,v1:172.21.15.134:6833/3827691638] up:boot 2024-05-08T05:44:59.751 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:59 smithi134 ceph-mon[34132]: fsmap 2 up:standby 2024-05-08T05:44:59.751 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:44:59 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-08T05:44:59.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:59 smithi151 ceph-mon[34815]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:44:59.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:59 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:59.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:59 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:59.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:59 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:44:59.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:59 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:44:59.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:59 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:44:59.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:59 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:44:59.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:59 smithi151 ceph-mon[34815]: Deploying daemon mds.j on smithi082 2024-05-08T05:44:59.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:59 smithi151 ceph-mon[34815]: mds.? [v2:172.21.15.134:6832/3827691638,v1:172.21.15.134:6833/3827691638] up:boot 2024-05-08T05:44:59.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:59 smithi151 ceph-mon[34815]: fsmap 2 up:standby 2024-05-08T05:44:59.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:44:59 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-08T05:45:01.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:01.196+0000 7ff705e00700 1 -- 172.21.15.82:0/993986871 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff700108850 msgr2=0x7ff7001103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:45:01.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:01.196+0000 7ff705e00700 1 --2- 172.21.15.82:0/993986871 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff700108850 0x7ff7001103d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff6f800b0a0 tx=0x7ff6f800b3b0 comp rx=0 tx=0).stop 2024-05-08T05:45:01.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:01.196+0000 7ff705e00700 1 -- 172.21.15.82:0/993986871 shutdown_connections 2024-05-08T05:45:01.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:01.196+0000 7ff705e00700 1 --2- 172.21.15.82:0/993986871 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff700108850 0x7ff7001103d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:01.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:01.196+0000 7ff705e00700 1 --2- 172.21.15.82:0/993986871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff700103750 0x7ff700103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:01.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:01.196+0000 7ff705e00700 1 --2- 172.21.15.82:0/993986871 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff700104100 0x7ff700108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:01.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:01.196+0000 7ff705e00700 1 -- 172.21.15.82:0/993986871 >> 172.21.15.82:0/993986871 conn(0x7ff70007a600 msgr2=0x7ff70007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:45:01.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:01.196+0000 7ff705e00700 1 -- 172.21.15.82:0/993986871 shutdown_connections 2024-05-08T05:45:01.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:01.196+0000 7ff705e00700 1 -- 172.21.15.82:0/993986871 wait complete. 2024-05-08T05:45:01.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:01.198+0000 7ff705e00700 1 Processor -- start 2024-05-08T05:45:01.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:01.199+0000 7ff705e00700 1 -- start start 2024-05-08T05:45:01.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:01.199+0000 7ff705e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff700103750 0x7ff7000757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:45:01.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:01.199+0000 7ff705e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff700104100 0x7ff700075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:45:01.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:01.199+0000 7ff705e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff700108850 0x7ff700076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:45:01.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:01.199+0000 7ff705e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff700113620 con 0x7ff700104100 2024-05-08T05:45:01.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:01.199+0000 7ff705e00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff7001134a0 con 0x7ff700103750 2024-05-08T05:45:01.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:01.199+0000 7ff705e00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff7001137a0 con 0x7ff700108850 2024-05-08T05:45:01.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:01.199+0000 7ff6ff400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff700108850 0x7ff700076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:45:01.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:01.199+0000 7ff6fe000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff700104100 0x7ff700075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:45:01.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:01.199+0000 7ff6ff400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff700108850 0x7ff700076220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:33260/0 (socket says 172.21.15.82:33260) 2024-05-08T05:45:01.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:01.199+0000 7ff6ff400700 1 -- 172.21.15.82:0/780684848 learned_addr learned my addr 172.21.15.82:0/780684848 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:45:01.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:01.200+0000 7ff6fea00700 1 --2- 172.21.15.82:0/780684848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff700103750 0x7ff7000757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:45:01.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:01.200+0000 7ff6ff400700 1 -- 172.21.15.82:0/780684848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff700103750 msgr2=0x7ff7000757a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:45:01.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:01.200+0000 7ff6ff400700 1 --2- 172.21.15.82:0/780684848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff700103750 0x7ff7000757a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:01.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:01.200+0000 7ff6ff400700 1 -- 172.21.15.82:0/780684848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff700104100 msgr2=0x7ff700075ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:45:01.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:01.200+0000 7ff6ff400700 1 --2- 172.21.15.82:0/780684848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff700104100 0x7ff700075ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:01.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:01.200+0000 7ff6ff400700 1 -- 172.21.15.82:0/780684848 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7001a7fa0 con 0x7ff700108850 2024-05-08T05:45:01.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:01.200+0000 7ff6ff400700 1 --2- 172.21.15.82:0/780684848 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff700108850 0x7ff700076220 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff6f800b780 tx=0x7ff6f8004d00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:45:01.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:01.200+0000 7ff704a00700 1 -- 172.21.15.82:0/780684848 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6f8021070 con 0x7ff700108850 2024-05-08T05:45:01.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:01.201+0000 7ff704a00700 1 -- 172.21.15.82:0/780684848 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff6f8007b80 con 0x7ff700108850 2024-05-08T05:45:01.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:01.201+0000 7ff704a00700 1 -- 172.21.15.82:0/780684848 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6f80052a0 con 0x7ff700108850 2024-05-08T05:45:01.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:01.201+0000 7ff705e00700 1 -- 172.21.15.82:0/780684848 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7001a8230 con 0x7ff700108850 2024-05-08T05:45:01.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:01.201+0000 7ff705e00700 1 -- 172.21.15.82:0/780684848 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7001a8690 con 0x7ff700108850 2024-05-08T05:45:01.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:01.202+0000 7ff705e00700 1 -- 172.21.15.82:0/780684848 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff70006a190 con 0x7ff700108850 2024-05-08T05:45:01.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:01.204+0000 7ff704a00700 1 -- 172.21.15.82:0/780684848 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7ff6f8024070 con 0x7ff700108850 2024-05-08T05:45:01.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:01.205+0000 7ff704a00700 1 --2- 172.21.15.82:0/780684848 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff6e40b2900 0x7ff6e40b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:45:01.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:01.206+0000 7ff704a00700 1 -- 172.21.15.82:0/780684848 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7ff6f80e2d90 con 0x7ff700108850 2024-05-08T05:45:01.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:01.206+0000 7ff6fea00700 1 --2- 172.21.15.82:0/780684848 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff6e40b2900 0x7ff6e40b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:45:01.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:01.206+0000 7ff6fea00700 1 --2- 172.21.15.82:0/780684848 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff6e40b2900 0x7ff6e40b4dc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0005950 tx=0x7ff6f000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:45:01.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:01.210+0000 7ff704a00700 1 -- 172.21.15.82:0/780684848 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff6f80aaf40 con 0x7ff700108850 2024-05-08T05:45:01.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:01.496+0000 7ff705e00700 1 -- 172.21.15.82:0/780684848 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff70002e5b0 con 0x7ff700108850 2024-05-08T05:45:01.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:01.496+0000 7ff704a00700 1 -- 172.21.15.82:0/780684848 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2224 (secure 0 0 0) 0x7ff6f80aa840 con 0x7ff700108850 2024-05-08T05:45:01.497 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:45:01.498 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3827691638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3827691638},{"type":"v1","addr":"172.21.15.134:6833","nonce":3827691638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/3625067797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3625067797},{"type":"v1","addr":"172.21.15.151:6833","nonce":3625067797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-08T05:45:01.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:01.500+0000 7ff705e00700 1 -- 172.21.15.82:0/780684848 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff6e40b2900 msgr2=0x7ff6e40b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:45:01.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:01.500+0000 7ff705e00700 1 --2- 172.21.15.82:0/780684848 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff6e40b2900 0x7ff6e40b4dc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0005950 tx=0x7ff6f000b410 comp rx=0 tx=0).stop 2024-05-08T05:45:01.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:01.500+0000 7ff705e00700 1 -- 172.21.15.82:0/780684848 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff700108850 msgr2=0x7ff700076220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:45:01.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:01.500+0000 7ff705e00700 1 --2- 172.21.15.82:0/780684848 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff700108850 0x7ff700076220 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff6f800b780 tx=0x7ff6f8004d00 comp rx=0 tx=0).stop 2024-05-08T05:45:01.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:01.500+0000 7ff705e00700 1 -- 172.21.15.82:0/780684848 shutdown_connections 2024-05-08T05:45:01.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:01.500+0000 7ff705e00700 1 --2- 172.21.15.82:0/780684848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff700103750 0x7ff7000757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:01.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:01.500+0000 7ff705e00700 1 --2- 172.21.15.82:0/780684848 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff6e40b2900 0x7ff6e40b4dc0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:01.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:01.500+0000 7ff705e00700 1 --2- 172.21.15.82:0/780684848 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff700108850 0x7ff700076220 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:01.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:01.500+0000 7ff705e00700 1 --2- 172.21.15.82:0/780684848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff700104100 0x7ff700075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:01.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:01.500+0000 7ff705e00700 1 -- 172.21.15.82:0/780684848 >> 172.21.15.82:0/780684848 conn(0x7ff70007a600 msgr2=0x7ff7001016e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:45:01.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:01.500+0000 7ff705e00700 1 -- 172.21.15.82:0/780684848 shutdown_connections 2024-05-08T05:45:01.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:01.500+0000 7ff705e00700 1 -- 172.21.15.82:0/780684848 wait complete. 2024-05-08T05:45:01.502 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 3 2024-05-08T05:45:01.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:01 smithi082 ceph-mon[30098]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:01.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:01 smithi134 ceph-mon[34132]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:01.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:01 smithi151 ceph-mon[34815]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:02.427 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:02 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/780684848' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:45:02.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:02 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/780684848' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:45:02.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:02 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/780684848' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:45:03.377 INFO:journalctl@ceph.mds.j.smithi082.stdout:May 08 05:45:03 smithi082 systemd[1]: Starting Ceph mds.j for c739a5c8-0cfc-11ef-bc97-c7b262605968... 2024-05-08T05:45:03.662 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:03 smithi082 ceph-mon[30098]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:03.663 INFO:journalctl@ceph.mds.j.smithi082.stdout:May 08 05:45:03 smithi082 podman[67772]: 2024-05-08 05:45:03.281226073 +0000 UTC m=+0.032360569 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T05:45:03.663 INFO:journalctl@ceph.mds.j.smithi082.stdout:May 08 05:45:03 smithi082 podman[67772]: 2024-05-08 05:45:03.391732364 +0000 UTC m=+0.142866904 container create 3379a8a642ed58da3e0951feb5c637cc07afe8a8d05645677bb4aa78fb0448e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-j, RELEASE=wip-57676-3-bee299f, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-08T05:45:03.663 INFO:journalctl@ceph.mds.j.smithi082.stdout:May 08 05:45:03 smithi082 podman[67772]: 2024-05-08 05:45:03.662523668 +0000 UTC m=+0.413658208 container init 3379a8a642ed58da3e0951feb5c637cc07afe8a8d05645677bb4aa78fb0448e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-j, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-57676-3-bee299f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-05-08T05:45:03.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:03 smithi134 ceph-mon[34132]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:03.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:03 smithi151 ceph-mon[34815]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:03.970 INFO:journalctl@ceph.mds.j.smithi082.stdout:May 08 05:45:03 smithi082 podman[67772]: 2024-05-08 05:45:03.672690259 +0000 UTC m=+0.423824822 container start 3379a8a642ed58da3e0951feb5c637cc07afe8a8d05645677bb4aa78fb0448e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-j, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-57676-3-bee299f, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=) 2024-05-08T05:45:03.970 INFO:journalctl@ceph.mds.j.smithi082.stdout:May 08 05:45:03 smithi082 ceph-mds[67790]: -- 172.21.15.82:0/3765817752 <== mon.0 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5558a2679a40 con 0x5558a264c800 2024-05-08T05:45:03.971 INFO:journalctl@ceph.mds.j.smithi082.stdout:May 08 05:45:03 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-j[67786]: starting mds.j at 2024-05-08T05:45:03.971 INFO:journalctl@ceph.mds.j.smithi082.stdout:May 08 05:45:03 smithi082 bash[67772]: 3379a8a642ed58da3e0951feb5c637cc07afe8a8d05645677bb4aa78fb0448e9 2024-05-08T05:45:03.971 INFO:journalctl@ceph.mds.j.smithi082.stdout:May 08 05:45:03 smithi082 systemd[1]: Started Ceph mds.j for c739a5c8-0cfc-11ef-bc97-c7b262605968. 2024-05-08T05:45:04.826 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T05:45:05.111 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:04 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:05.111 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:04 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:05.111 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:04 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:05.111 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:04 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:45:05.111 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:04 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:45:05.112 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:04 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:45:05.112 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:04 smithi082 ceph-mon[30098]: Deploying daemon mds.d on smithi082 2024-05-08T05:45:05.112 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:04 smithi082 ceph-mon[30098]: mds.? [v2:172.21.15.82:6834/3876883250,v1:172.21.15.82:6835/3876883250] up:boot 2024-05-08T05:45:05.112 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:04 smithi082 ceph-mon[30098]: fsmap 3 up:standby 2024-05-08T05:45:05.112 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:04 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-08T05:45:05.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:04 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:05.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:04 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:05.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:04 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:05.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:04 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:45:05.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:04 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:45:05.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:04 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:45:05.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:04 smithi151 ceph-mon[34815]: Deploying daemon mds.d on smithi082 2024-05-08T05:45:05.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:04 smithi151 ceph-mon[34815]: mds.? [v2:172.21.15.82:6834/3876883250,v1:172.21.15.82:6835/3876883250] up:boot 2024-05-08T05:45:05.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:04 smithi151 ceph-mon[34815]: fsmap 3 up:standby 2024-05-08T05:45:05.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:04 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-08T05:45:05.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:04 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:05.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:04 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:05.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:04 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:05.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:04 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:45:05.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:04 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:45:05.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:04 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:45:05.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:04 smithi134 ceph-mon[34132]: Deploying daemon mds.d on smithi082 2024-05-08T05:45:05.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:04 smithi134 ceph-mon[34132]: mds.? [v2:172.21.15.82:6834/3876883250,v1:172.21.15.82:6835/3876883250] up:boot 2024-05-08T05:45:05.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:04 smithi134 ceph-mon[34132]: fsmap 3 up:standby 2024-05-08T05:45:05.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:04 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-08T05:45:06.155 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:05 smithi082 ceph-mon[30098]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:06.173 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:45:06.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:05 smithi134 ceph-mon[34132]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:06.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:05 smithi151 ceph-mon[34815]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:07.221 INFO:journalctl@ceph.mds.d.smithi082.stdout:May 08 05:45:06 smithi082 systemd[1]: Starting Ceph mds.d for c739a5c8-0cfc-11ef-bc97-c7b262605968... 2024-05-08T05:45:07.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:07 smithi082 ceph-mon[30098]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:07.954 INFO:journalctl@ceph.mds.d.smithi082.stdout:May 08 05:45:07 smithi082 podman[68167]: 2024-05-08 05:45:07.8254032 +0000 UTC m=+0.046393717 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T05:45:07.954 INFO:journalctl@ceph.mds.d.smithi082.stdout:May 08 05:45:07 smithi082 podman[68167]: 2024-05-08 05:45:07.953230734 +0000 UTC m=+0.174221284 container create fe7abbc85d644b1846e3c20f758738711e61b369acbd5fb6faf03323f9c96cd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, RELEASE=wip-57676-3-bee299f, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-05-08T05:45:08.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:07 smithi134 ceph-mon[34132]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:08.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:07 smithi151 ceph-mon[34815]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:08.493 INFO:journalctl@ceph.mds.d.smithi082.stdout:May 08 05:45:08 smithi082 podman[68167]: 2024-05-08 05:45:08.24022333 +0000 UTC m=+0.461213886 container init fe7abbc85d644b1846e3c20f758738711e61b369acbd5fb6faf03323f9c96cd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-d, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, RELEASE=wip-57676-3-bee299f, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-05-08T05:45:08.493 INFO:journalctl@ceph.mds.d.smithi082.stdout:May 08 05:45:08 smithi082 podman[68167]: 2024-05-08 05:45:08.250382888 +0000 UTC m=+0.471373444 container start fe7abbc85d644b1846e3c20f758738711e61b369acbd5fb6faf03323f9c96cd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-d, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=wip-57676-3-bee299f, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-05-08T05:45:08.493 INFO:journalctl@ceph.mds.d.smithi082.stdout:May 08 05:45:08 smithi082 ceph-mds[68203]: -- 172.21.15.82:0/2007674767 <== mon.1 v2:172.21.15.151:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563002a49a40 con 0x563002a1d000 2024-05-08T05:45:08.493 INFO:journalctl@ceph.mds.d.smithi082.stdout:May 08 05:45:08 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-d[68198]: starting mds.d at 2024-05-08T05:45:08.493 INFO:journalctl@ceph.mds.d.smithi082.stdout:May 08 05:45:08 smithi082 bash[68167]: fe7abbc85d644b1846e3c20f758738711e61b369acbd5fb6faf03323f9c96cd8 2024-05-08T05:45:08.493 INFO:journalctl@ceph.mds.d.smithi082.stdout:May 08 05:45:08 smithi082 systemd[1]: Started Ceph mds.d for c739a5c8-0cfc-11ef-bc97-c7b262605968. 2024-05-08T05:45:09.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:09.016+0000 7f2257200700 1 -- 172.21.15.82:0/2011330193 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f225010a490 msgr2=0x7f22501169a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:45:09.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:09.016+0000 7f2257200700 1 --2- 172.21.15.82:0/2011330193 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f225010a490 0x7f22501169a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f224800b0a0 tx=0x7f224800b3b0 comp rx=0 tx=0).stop 2024-05-08T05:45:09.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:09.016+0000 7f2257200700 1 -- 172.21.15.82:0/2011330193 shutdown_connections 2024-05-08T05:45:09.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:09.016+0000 7f2257200700 1 --2- 172.21.15.82:0/2011330193 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f225010a490 0x7f22501169a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:09.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:09.016+0000 7f2257200700 1 --2- 172.21.15.82:0/2011330193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f225010fb60 0x7f225010ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:09.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:09.016+0000 7f2257200700 1 --2- 172.21.15.82:0/2011330193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2250109ad0 0x7f2250109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:09.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:09.016+0000 7f2257200700 1 -- 172.21.15.82:0/2011330193 >> 172.21.15.82:0/2011330193 conn(0x7f2250076c70 msgr2=0x7f22501082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:45:09.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:09.016+0000 7f2257200700 1 -- 172.21.15.82:0/2011330193 shutdown_connections 2024-05-08T05:45:09.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:09.016+0000 7f2257200700 1 -- 172.21.15.82:0/2011330193 wait complete. 2024-05-08T05:45:09.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:09.017+0000 7f2257200700 1 Processor -- start 2024-05-08T05:45:09.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:09.017+0000 7f2257200700 1 -- start start 2024-05-08T05:45:09.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:09.018+0000 7f2257200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2250109ad0 0x7f22501a0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:45:09.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:09.018+0000 7f2257200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f225010a490 0x7f22501a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:45:09.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:09.018+0000 7f2257200700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f225010fb60 0x7f22501a4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:45:09.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:09.018+0000 7f2257200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2250119d60 con 0x7f225010a490 2024-05-08T05:45:09.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:09.018+0000 7f2257200700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2250119be0 con 0x7f2250109ad0 2024-05-08T05:45:09.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:09.018+0000 7f2257200700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2250119ee0 con 0x7f225010fb60 2024-05-08T05:45:09.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:09.018+0000 7f224fe00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2250109ad0 0x7f22501a0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:45:09.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:09.018+0000 7f224f400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f225010a490 0x7f22501a06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:45:09.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:09.018+0000 7f224fe00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2250109ad0 0x7f22501a0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:37830/0 (socket says 172.21.15.82:37830) 2024-05-08T05:45:09.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:09.018+0000 7f224fe00700 1 -- 172.21.15.82:0/2406519068 learned_addr learned my addr 172.21.15.82:0/2406519068 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:45:09.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:09.018+0000 7f2255200700 1 --2- 172.21.15.82:0/2406519068 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f225010fb60 0x7f22501a4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:45:09.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:09.018+0000 7f224fe00700 1 -- 172.21.15.82:0/2406519068 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f225010fb60 msgr2=0x7f22501a4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:45:09.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:09.018+0000 7f224fe00700 1 --2- 172.21.15.82:0/2406519068 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f225010fb60 0x7f22501a4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:09.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:09.019+0000 7f224fe00700 1 -- 172.21.15.82:0/2406519068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f225010a490 msgr2=0x7f22501a06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:45:09.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:09.019+0000 7f224fe00700 1 --2- 172.21.15.82:0/2406519068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f225010a490 0x7f22501a06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:09.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:09.019+0000 7f224fe00700 1 -- 172.21.15.82:0/2406519068 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22501a5180 con 0x7f2250109ad0 2024-05-08T05:45:09.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:09.019+0000 7f2255200700 1 --2- 172.21.15.82:0/2406519068 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f225010fb60 0x7f22501a4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:45:09.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:09.019+0000 7f224fe00700 1 --2- 172.21.15.82:0/2406519068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2250109ad0 0x7f22501a0170 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f224000e9c0 tx=0x7f224000ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:45:09.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:09.019+0000 7f224cc00700 1 -- 172.21.15.82:0/2406519068 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224000cbd0 con 0x7f2250109ad0 2024-05-08T05:45:09.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:09.019+0000 7f2257200700 1 -- 172.21.15.82:0/2406519068 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22501a5470 con 0x7f2250109ad0 2024-05-08T05:45:09.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:09.019+0000 7f224cc00700 1 -- 172.21.15.82:0/2406519068 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f224000cd70 con 0x7f2250109ad0 2024-05-08T05:45:09.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:09.019+0000 7f224cc00700 1 -- 172.21.15.82:0/2406519068 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2240005610 con 0x7f2250109ad0 2024-05-08T05:45:09.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:09.019+0000 7f2257200700 1 -- 172.21.15.82:0/2406519068 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22501accf0 con 0x7f2250109ad0 2024-05-08T05:45:09.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:09.020+0000 7f2257200700 1 -- 172.21.15.82:0/2406519068 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2250112060 con 0x7f2250109ad0 2024-05-08T05:45:09.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:09.022+0000 7f224cc00700 1 -- 172.21.15.82:0/2406519068 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f2240047960 con 0x7f2250109ad0 2024-05-08T05:45:09.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:09.024+0000 7f224cc00700 1 --2- 172.21.15.82:0/2406519068 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f22340b2880 0x7f22340b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:45:09.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:09.024+0000 7f224cc00700 1 -- 172.21.15.82:0/2406519068 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f22400e20d0 con 0x7f2250109ad0 2024-05-08T05:45:09.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:09.024+0000 7f224f400700 1 --2- 172.21.15.82:0/2406519068 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f22340b2880 0x7f22340b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:45:09.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:09.025+0000 7f224f400700 1 --2- 172.21.15.82:0/2406519068 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f22340b2880 0x7f22340b4d40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f223c009680 tx=0x7f223c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:45:09.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:09.026+0000 7f224cc00700 1 -- 172.21.15.82:0/2406519068 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f22400aa1f0 con 0x7f2250109ad0 2024-05-08T05:45:09.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:09.310+0000 7f2257200700 1 -- 172.21.15.82:0/2406519068 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f225006a190 con 0x7f2250109ad0 2024-05-08T05:45:09.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:09.312+0000 7f224cc00700 1 -- 172.21.15.82:0/2406519068 <== mon.2 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3874 (secure 0 0 0) 0x7f22400aae20 con 0x7f2250109ad0 2024-05-08T05:45:09.313 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:45:09.313 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14364,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3876883250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3876883250},{"type":"v1","addr":"172.21.15.82:6835","nonce":3876883250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1965070586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1965070586},{"type":"v1","addr":"172.21.15.82:6837","nonce":1965070586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3827691638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3827691638},{"type":"v1","addr":"172.21.15.134:6833","nonce":3827691638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/3625067797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3625067797},{"type":"v1","addr":"172.21.15.151:6833","nonce":3625067797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-08T05:45:09.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:09.315+0000 7f2257200700 1 -- 172.21.15.82:0/2406519068 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f22340b2880 msgr2=0x7f22340b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:45:09.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:09.315+0000 7f2257200700 1 --2- 172.21.15.82:0/2406519068 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f22340b2880 0x7f22340b4d40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f223c009680 tx=0x7f223c009260 comp rx=0 tx=0).stop 2024-05-08T05:45:09.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:09.315+0000 7f2257200700 1 -- 172.21.15.82:0/2406519068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2250109ad0 msgr2=0x7f22501a0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:45:09.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:09.315+0000 7f2257200700 1 --2- 172.21.15.82:0/2406519068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2250109ad0 0x7f22501a0170 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f224000e9c0 tx=0x7f224000ecd0 comp rx=0 tx=0).stop 2024-05-08T05:45:09.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:09.315+0000 7f2257200700 1 -- 172.21.15.82:0/2406519068 shutdown_connections 2024-05-08T05:45:09.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:09.315+0000 7f2257200700 1 --2- 172.21.15.82:0/2406519068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2250109ad0 0x7f22501a0170 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:09.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:09.315+0000 7f2257200700 1 --2- 172.21.15.82:0/2406519068 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f22340b2880 0x7f22340b4d40 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:09.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:09.315+0000 7f2257200700 1 --2- 172.21.15.82:0/2406519068 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f225010fb60 0x7f22501a4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:09.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:09.315+0000 7f2257200700 1 --2- 172.21.15.82:0/2406519068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f225010a490 0x7f22501a06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:09.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:09.315+0000 7f2257200700 1 -- 172.21.15.82:0/2406519068 >> 172.21.15.82:0/2406519068 conn(0x7f2250076c70 msgr2=0x7f2250077290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:45:09.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:09.315+0000 7f2257200700 1 -- 172.21.15.82:0/2406519068 shutdown_connections 2024-05-08T05:45:09.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:09.315+0000 7f2257200700 1 -- 172.21.15.82:0/2406519068 wait complete. 2024-05-08T05:45:09.318 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 5 2024-05-08T05:45:09.679 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:09 smithi082 ceph-mon[30098]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:09.679 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:09 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:09.679 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:09 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:09.679 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:09 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:09.679 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:09 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:45:09.680 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:09 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:45:09.680 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:09 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:45:09.680 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:09 smithi082 ceph-mon[30098]: Deploying daemon mds.e on smithi134 2024-05-08T05:45:09.680 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:09 smithi082 ceph-mon[30098]: mds.? [v2:172.21.15.82:6836/1965070586,v1:172.21.15.82:6837/1965070586] up:boot 2024-05-08T05:45:09.680 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:09 smithi082 ceph-mon[30098]: fsmap 4 up:standby 2024-05-08T05:45:09.680 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:09 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-08T05:45:09.680 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:09 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/2406519068' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:45:09.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:09 smithi134 ceph-mon[34132]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:09.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:09 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:09.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:09 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:09.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:09 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:09.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:09 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:45:09.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:09 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:45:09.751 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:09 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:45:09.751 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:09 smithi134 ceph-mon[34132]: Deploying daemon mds.e on smithi134 2024-05-08T05:45:09.751 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:09 smithi134 ceph-mon[34132]: mds.? [v2:172.21.15.82:6836/1965070586,v1:172.21.15.82:6837/1965070586] up:boot 2024-05-08T05:45:09.751 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:09 smithi134 ceph-mon[34132]: fsmap 4 up:standby 2024-05-08T05:45:09.751 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:09 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-08T05:45:09.751 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:09 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/2406519068' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:45:09.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:09 smithi151 ceph-mon[34815]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:09.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:09 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:09.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:09 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:09.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:09 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:09.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:09 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:45:09.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:09 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:45:09.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:09 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:45:09.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:09 smithi151 ceph-mon[34815]: Deploying daemon mds.e on smithi134 2024-05-08T05:45:09.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:09 smithi151 ceph-mon[34815]: mds.? [v2:172.21.15.82:6836/1965070586,v1:172.21.15.82:6837/1965070586] up:boot 2024-05-08T05:45:09.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:09 smithi151 ceph-mon[34815]: fsmap 4 up:standby 2024-05-08T05:45:09.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:09 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-08T05:45:09.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:09 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/2406519068' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:45:11.182 INFO:journalctl@ceph.mds.e.smithi134.stdout:May 08 05:45:11 smithi134 podman[64357]: 2024-05-08 05:45:11.180660772 +0000 UTC m=+0.364538003 container init b62b7fbb937a44b8a3b4654fb89cbc7aacd51b5f3ed5929650661e4cdef98c18 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-e, RELEASE=wip-57676-3-bee299f, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-08T05:45:11.183 INFO:journalctl@ceph.mds.e.smithi134.stdout:May 08 05:45:11 smithi134 podman[64357]: 2024-05-08 05:45:11.183139327 +0000 UTC m=+0.367016564 container start b62b7fbb937a44b8a3b4654fb89cbc7aacd51b5f3ed5929650661e4cdef98c18 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-e, RELEASE=wip-57676-3-bee299f, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507) 2024-05-08T05:45:11.461 INFO:journalctl@ceph.mds.e.smithi134.stdout:May 08 05:45:11 smithi134 ceph-mds[64375]: -- 172.21.15.134:0/2414255703 <== mon.2 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559419d0da40 con 0x559419ce0c00 2024-05-08T05:45:11.461 INFO:journalctl@ceph.mds.e.smithi134.stdout:May 08 05:45:11 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-e[64371]: starting mds.e at 2024-05-08T05:45:11.462 INFO:journalctl@ceph.mds.e.smithi134.stdout:May 08 05:45:11 smithi134 bash[64357]: b62b7fbb937a44b8a3b4654fb89cbc7aacd51b5f3ed5929650661e4cdef98c18 2024-05-08T05:45:11.462 INFO:journalctl@ceph.mds.e.smithi134.stdout:May 08 05:45:11 smithi134 systemd[1]: Started Ceph mds.e for c739a5c8-0cfc-11ef-bc97-c7b262605968. 2024-05-08T05:45:11.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:11 smithi082 ceph-mon[30098]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:11.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:11 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:11.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:11 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:11.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:11 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:11.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:11 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:45:11.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:11 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:45:11.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:11 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:45:11.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:11 smithi134 ceph-mon[34132]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:11.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:11 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:11.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:11 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:11.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:11 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:11.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:11 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:45:11.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:11 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:45:11.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:11 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:45:11.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:11 smithi151 ceph-mon[34815]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:11.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:11 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:11.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:11 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:11.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:11 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:11.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:11 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:45:11.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:11 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:45:11.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:11 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:45:12.097 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T05:45:12.512 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:45:12.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:12 smithi151 ceph-mon[34815]: Deploying daemon mds.f on smithi151 2024-05-08T05:45:12.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:12 smithi151 ceph-mon[34815]: mds.? [v2:172.21.15.134:6834/4074163402,v1:172.21.15.134:6835/4074163402] up:boot 2024-05-08T05:45:12.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:12 smithi151 ceph-mon[34815]: fsmap 5 up:standby 2024-05-08T05:45:12.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:12 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-08T05:45:12.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:12 smithi134 ceph-mon[34132]: Deploying daemon mds.f on smithi151 2024-05-08T05:45:12.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:12 smithi134 ceph-mon[34132]: mds.? [v2:172.21.15.134:6834/4074163402,v1:172.21.15.134:6835/4074163402] up:boot 2024-05-08T05:45:12.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:12 smithi134 ceph-mon[34132]: fsmap 5 up:standby 2024-05-08T05:45:12.751 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:12 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-08T05:45:12.831 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:12 smithi082 ceph-mon[30098]: Deploying daemon mds.f on smithi151 2024-05-08T05:45:12.831 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:12 smithi082 ceph-mon[30098]: mds.? [v2:172.21.15.134:6834/4074163402,v1:172.21.15.134:6835/4074163402] up:boot 2024-05-08T05:45:12.831 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:12 smithi082 ceph-mon[30098]: fsmap 5 up:standby 2024-05-08T05:45:12.831 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:12 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-08T05:45:13.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:13 smithi151 ceph-mon[34815]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:13.630 INFO:journalctl@ceph.mds.f.smithi151.stdout:May 08 05:45:13 smithi151 systemd[1]: Starting Ceph mds.f for c739a5c8-0cfc-11ef-bc97-c7b262605968... 2024-05-08T05:45:13.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:13 smithi134 ceph-mon[34132]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:13.891 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:13 smithi082 ceph-mon[30098]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:14.019 INFO:journalctl@ceph.mds.f.smithi151.stdout:May 08 05:45:13 smithi151 podman[65444]: 2024-05-08 05:45:13.669348705 +0000 UTC m=+0.018058706 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T05:45:14.019 INFO:journalctl@ceph.mds.f.smithi151.stdout:May 08 05:45:13 smithi151 podman[65444]: 2024-05-08 05:45:13.783432023 +0000 UTC m=+0.132141999 container create ea9fd08b107f6eedbe13d2a4a39249cc98ce89f15d1afa9b297c497932232aee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-f, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-57676-3-bee299f, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-08T05:45:14.019 INFO:journalctl@ceph.mds.f.smithi151.stdout:May 08 05:45:14 smithi151 podman[65444]: 2024-05-08 05:45:14.019485457 +0000 UTC m=+0.368195433 container init ea9fd08b107f6eedbe13d2a4a39249cc98ce89f15d1afa9b297c497932232aee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-f, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-57676-3-bee299f, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-05-08T05:45:14.379 INFO:journalctl@ceph.mds.f.smithi151.stdout:May 08 05:45:14 smithi151 podman[65444]: 2024-05-08 05:45:14.022275465 +0000 UTC m=+0.370985441 container start ea9fd08b107f6eedbe13d2a4a39249cc98ce89f15d1afa9b297c497932232aee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-f, RELEASE=wip-57676-3-bee299f, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-05-08T05:45:14.380 INFO:journalctl@ceph.mds.f.smithi151.stdout:May 08 05:45:14 smithi151 ceph-mds[65464]: -- 172.21.15.151:0/1065323748 <== mon.1 v2:172.21.15.151:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560b6bee9a40 con 0x560b6bebd000 2024-05-08T05:45:14.380 INFO:journalctl@ceph.mds.f.smithi151.stdout:May 08 05:45:14 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-f[65460]: starting mds.f at 2024-05-08T05:45:14.380 INFO:journalctl@ceph.mds.f.smithi151.stdout:May 08 05:45:14 smithi151 bash[65444]: ea9fd08b107f6eedbe13d2a4a39249cc98ce89f15d1afa9b297c497932232aee 2024-05-08T05:45:14.380 INFO:journalctl@ceph.mds.f.smithi151.stdout:May 08 05:45:14 smithi151 systemd[1]: Started Ceph mds.f for c739a5c8-0cfc-11ef-bc97-c7b262605968. 2024-05-08T05:45:14.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:14.717+0000 7f3b69400700 1 -- 172.21.15.82:0/697049570 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b64104100 msgr2=0x7f3b64108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:45:14.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:14.717+0000 7f3b69400700 1 --2- 172.21.15.82:0/697049570 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b64104100 0x7f3b64108120 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c0098f0 tx=0x7f3b4c009c00 comp rx=0 tx=0).stop 2024-05-08T05:45:14.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:14.717+0000 7f3b69400700 1 -- 172.21.15.82:0/697049570 shutdown_connections 2024-05-08T05:45:14.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:14.717+0000 7f3b69400700 1 --2- 172.21.15.82:0/697049570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b64103750 0x7f3b64103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:14.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:14.717+0000 7f3b69400700 1 --2- 172.21.15.82:0/697049570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b64108850 0x7f3b641103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:14.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:14.717+0000 7f3b69400700 1 --2- 172.21.15.82:0/697049570 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b64104100 0x7f3b64108120 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:14.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:14.717+0000 7f3b69400700 1 -- 172.21.15.82:0/697049570 >> 172.21.15.82:0/697049570 conn(0x7f3b6407a600 msgr2=0x7f3b6407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:45:14.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:14.717+0000 7f3b69400700 1 -- 172.21.15.82:0/697049570 shutdown_connections 2024-05-08T05:45:14.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:14.718+0000 7f3b69400700 1 -- 172.21.15.82:0/697049570 wait complete. 2024-05-08T05:45:14.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:14.719+0000 7f3b69400700 1 Processor -- start 2024-05-08T05:45:14.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:14.719+0000 7f3b69400700 1 -- start start 2024-05-08T05:45:14.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:14.719+0000 7f3b69400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b64103750 0x7f3b6419bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:45:14.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:14.719+0000 7f3b69400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b64104100 0x7f3b6419c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:45:14.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:14.719+0000 7f3b69400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b64108850 0x7f3b641a0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:45:14.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:14.719+0000 7f3b69400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3b64113610 con 0x7f3b64104100 2024-05-08T05:45:14.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:14.719+0000 7f3b69400700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3b64113490 con 0x7f3b64103750 2024-05-08T05:45:14.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:14.719+0000 7f3b69400700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3b64113790 con 0x7f3b64108850 2024-05-08T05:45:14.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:14.719+0000 7f3b62800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b64103750 0x7f3b6419bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:45:14.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:14.720+0000 7f3b62800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b64103750 0x7f3b6419bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:49030/0 (socket says 172.21.15.82:49030) 2024-05-08T05:45:14.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:14.720+0000 7f3b62800700 1 -- 172.21.15.82:0/2941421555 learned_addr learned my addr 172.21.15.82:0/2941421555 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:45:14.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:14.720+0000 7f3b5be00700 1 --2- 172.21.15.82:0/2941421555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b64104100 0x7f3b6419c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:45:14.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:14.720+0000 7f3b63200700 1 --2- 172.21.15.82:0/2941421555 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b64108850 0x7f3b641a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:45:14.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:14.720+0000 7f3b62800700 1 -- 172.21.15.82:0/2941421555 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b64108850 msgr2=0x7f3b641a0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:45:14.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:14.720+0000 7f3b62800700 1 --2- 172.21.15.82:0/2941421555 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b64108850 0x7f3b641a0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:14.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:14.720+0000 7f3b62800700 1 -- 172.21.15.82:0/2941421555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b64104100 msgr2=0x7f3b6419c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:45:14.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:14.720+0000 7f3b62800700 1 --2- 172.21.15.82:0/2941421555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b64104100 0x7f3b6419c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:14.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:14.720+0000 7f3b62800700 1 -- 172.21.15.82:0/2941421555 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b641a0d70 con 0x7f3b64103750 2024-05-08T05:45:14.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:14.720+0000 7f3b62800700 1 --2- 172.21.15.82:0/2941421555 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b64103750 0x7f3b6419bd60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3b5400e9c0 tx=0x7f3b5400ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:45:14.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:14.720+0000 7f3b5b400700 1 -- 172.21.15.82:0/2941421555 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b54004a30 con 0x7f3b64103750 2024-05-08T05:45:14.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:14.720+0000 7f3b5b400700 1 -- 172.21.15.82:0/2941421555 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3b5400cc70 con 0x7f3b64103750 2024-05-08T05:45:14.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:14.720+0000 7f3b69400700 1 -- 172.21.15.82:0/2941421555 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b641a1060 con 0x7f3b64103750 2024-05-08T05:45:14.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:14.721+0000 7f3b5b400700 1 -- 172.21.15.82:0/2941421555 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b54005490 con 0x7f3b64103750 2024-05-08T05:45:14.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:14.721+0000 7f3b69400700 1 -- 172.21.15.82:0/2941421555 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b641a88e0 con 0x7f3b64103750 2024-05-08T05:45:14.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:14.722+0000 7f3b69400700 1 -- 172.21.15.82:0/2941421555 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b6406a190 con 0x7f3b64103750 2024-05-08T05:45:14.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:14.724+0000 7f3b5b400700 1 -- 172.21.15.82:0/2941421555 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f3b54004bd0 con 0x7f3b64103750 2024-05-08T05:45:14.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:14.725+0000 7f3b5b400700 1 --2- 172.21.15.82:0/2941421555 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3b480b2880 0x7f3b480b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:45:14.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:14.726+0000 7f3b5b400700 1 -- 172.21.15.82:0/2941421555 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f3b540e1ee0 con 0x7f3b64103750 2024-05-08T05:45:14.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:14.726+0000 7f3b5be00700 1 --2- 172.21.15.82:0/2941421555 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3b480b2880 0x7f3b480b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:45:14.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:14.726+0000 7f3b5be00700 1 --2- 172.21.15.82:0/2941421555 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3b480b2880 0x7f3b480b4d40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c009fd0 tx=0x7f3b4c019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:45:14.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:14.729+0000 7f3b5b400700 1 -- 172.21.15.82:0/2941421555 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f3b540aa000 con 0x7f3b64103750 2024-05-08T05:45:15.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:15.016+0000 7f3b69400700 1 -- 172.21.15.82:0/2941421555 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3b6419d0c0 con 0x7f3b64103750 2024-05-08T05:45:15.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:15.017+0000 7f3b5b400700 1 -- 172.21.15.82:0/2941421555 <== mon.2 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5530 (secure 0 0 0) 0x7f3b540a9900 con 0x7f3b64103750 2024-05-08T05:45:15.017 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:45:15.017 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14364,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3876883250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3876883250},{"type":"v1","addr":"172.21.15.82:6835","nonce":3876883250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1965070586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1965070586},{"type":"v1","addr":"172.21.15.82:6837","nonce":1965070586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3827691638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3827691638},{"type":"v1","addr":"172.21.15.134:6833","nonce":3827691638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/3625067797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3625067797},{"type":"v1","addr":"172.21.15.151:6833","nonce":3625067797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24455,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/4074163402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4074163402},{"type":"v1","addr":"172.21.15.134:6835","nonce":4074163402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24475,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2093655929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2093655929},{"type":"v1","addr":"172.21.15.151:6835","nonce":2093655929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[]} 2024-05-08T05:45:15.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:15.020+0000 7f3b69400700 1 -- 172.21.15.82:0/2941421555 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3b480b2880 msgr2=0x7f3b480b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:45:15.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:15.020+0000 7f3b69400700 1 --2- 172.21.15.82:0/2941421555 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3b480b2880 0x7f3b480b4d40 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c009fd0 tx=0x7f3b4c019040 comp rx=0 tx=0).stop 2024-05-08T05:45:15.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:15.020+0000 7f3b69400700 1 -- 172.21.15.82:0/2941421555 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b64103750 msgr2=0x7f3b6419bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:45:15.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:15.020+0000 7f3b69400700 1 --2- 172.21.15.82:0/2941421555 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b64103750 0x7f3b6419bd60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3b5400e9c0 tx=0x7f3b5400ecd0 comp rx=0 tx=0).stop 2024-05-08T05:45:15.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:15.020+0000 7f3b69400700 1 -- 172.21.15.82:0/2941421555 shutdown_connections 2024-05-08T05:45:15.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:15.020+0000 7f3b69400700 1 --2- 172.21.15.82:0/2941421555 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b64103750 0x7f3b6419bd60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:15.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:15.020+0000 7f3b69400700 1 --2- 172.21.15.82:0/2941421555 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3b480b2880 0x7f3b480b4d40 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:15.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:15.020+0000 7f3b69400700 1 --2- 172.21.15.82:0/2941421555 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b64108850 0x7f3b641a0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:15.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:15.020+0000 7f3b69400700 1 --2- 172.21.15.82:0/2941421555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3b64104100 0x7f3b6419c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:15.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:15.020+0000 7f3b69400700 1 -- 172.21.15.82:0/2941421555 >> 172.21.15.82:0/2941421555 conn(0x7f3b6407a600 msgr2=0x7f3b64101aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:45:15.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:15.020+0000 7f3b69400700 1 -- 172.21.15.82:0/2941421555 shutdown_connections 2024-05-08T05:45:15.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:15.020+0000 7f3b69400700 1 -- 172.21.15.82:0/2941421555 wait complete. 2024-05-08T05:45:15.021 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 7 2024-05-08T05:45:15.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:15 smithi134 ceph-mon[34132]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:15.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:15 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:15.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:15 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:15.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:15 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:15.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:15 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:45:15.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:15 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:45:15.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:15 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:45:15.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:15 smithi134 ceph-mon[34132]: Deploying daemon mds.c on smithi151 2024-05-08T05:45:15.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:15 smithi134 ceph-mon[34132]: mds.? [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] up:boot 2024-05-08T05:45:15.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:15 smithi134 ceph-mon[34132]: fsmap 6 up:standby 2024-05-08T05:45:15.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:15 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-08T05:45:15.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:15 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/2941421555' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:45:15.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:15 smithi082 ceph-mon[30098]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:15.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:15 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:15.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:15 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:15.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:15 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:15.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:15 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:45:15.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:15 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:45:15.438 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:15 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:45:15.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:15 smithi082 ceph-mon[30098]: Deploying daemon mds.c on smithi151 2024-05-08T05:45:15.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:15 smithi082 ceph-mon[30098]: mds.? [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] up:boot 2024-05-08T05:45:15.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:15 smithi082 ceph-mon[30098]: fsmap 6 up:standby 2024-05-08T05:45:15.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:15 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-08T05:45:15.439 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:15 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/2941421555' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:45:15.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:15 smithi151 ceph-mon[34815]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:15.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:15 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:15.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:15 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:15.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:15 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:15.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:15 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:45:15.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:15 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:45:15.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:15 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:45:15.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:15 smithi151 ceph-mon[34815]: Deploying daemon mds.c on smithi151 2024-05-08T05:45:15.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:15 smithi151 ceph-mon[34815]: mds.? [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] up:boot 2024-05-08T05:45:15.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:15 smithi151 ceph-mon[34815]: fsmap 6 up:standby 2024-05-08T05:45:15.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:15 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-08T05:45:15.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:15 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/2941421555' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:45:16.629 INFO:journalctl@ceph.mds.c.smithi151.stdout:May 08 05:45:16 smithi151 systemd[1]: Starting Ceph mds.c for c739a5c8-0cfc-11ef-bc97-c7b262605968... 2024-05-08T05:45:16.968 INFO:journalctl@ceph.mds.c.smithi151.stdout:May 08 05:45:16 smithi151 podman[65754]: 2024-05-08 05:45:16.606602211 +0000 UTC m=+0.017901443 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T05:45:16.968 INFO:journalctl@ceph.mds.c.smithi151.stdout:May 08 05:45:16 smithi151 podman[65754]: 2024-05-08 05:45:16.705414614 +0000 UTC m=+0.116713831 container create 774d1f9f7bcba410b8b6460fcfc30070072a1ba1dfe9cd1246577363f6d3ec51 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-c, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-57676-3-bee299f, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD) 2024-05-08T05:45:16.968 INFO:journalctl@ceph.mds.c.smithi151.stdout:May 08 05:45:16 smithi151 podman[65754]: 2024-05-08 05:45:16.941618475 +0000 UTC m=+0.352917694 container init 774d1f9f7bcba410b8b6460fcfc30070072a1ba1dfe9cd1246577363f6d3ec51 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-c, RELEASE=wip-57676-3-bee299f, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, GIT_CLEAN=True) 2024-05-08T05:45:16.968 INFO:journalctl@ceph.mds.c.smithi151.stdout:May 08 05:45:16 smithi151 podman[65754]: 2024-05-08 05:45:16.944192953 +0000 UTC m=+0.355492180 container start 774d1f9f7bcba410b8b6460fcfc30070072a1ba1dfe9cd1246577363f6d3ec51 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-05-08T05:45:16.968 INFO:journalctl@ceph.mds.c.smithi151.stdout:May 08 05:45:16 smithi151 ceph-mds[65773]: -- 172.21.15.151:0/3384475167 <== mon.1 v2:172.21.15.151:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561897615a40 con 0x5618975e8800 2024-05-08T05:45:17.379 INFO:journalctl@ceph.mds.c.smithi151.stdout:May 08 05:45:16 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-c[65769]: starting mds.c at 2024-05-08T05:45:17.379 INFO:journalctl@ceph.mds.c.smithi151.stdout:May 08 05:45:17 smithi151 bash[65754]: 774d1f9f7bcba410b8b6460fcfc30070072a1ba1dfe9cd1246577363f6d3ec51 2024-05-08T05:45:17.380 INFO:journalctl@ceph.mds.c.smithi151.stdout:May 08 05:45:17 smithi151 systemd[1]: Started Ceph mds.c for c739a5c8-0cfc-11ef-bc97-c7b262605968. 2024-05-08T05:45:17.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:17 smithi151 ceph-mon[34815]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:17.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:17 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:17.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:17 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:17.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:17 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:17.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:17 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:45:17.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:17 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:45:17.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:17 smithi082 ceph-mon[30098]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:17.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:17 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:17.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:17 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:17.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:17 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:17.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:17 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:45:17.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:17 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:45:17.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:17 smithi134 ceph-mon[34132]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:17.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:17 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:17.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:17 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:17.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:17 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:17.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:17 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:45:17.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:17 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:45:17.853 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T05:45:18.295 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:45:18.445 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:18 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:45:18.445 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:18 smithi082 ceph-mon[30098]: Deploying daemon mds.h on smithi134 2024-05-08T05:45:18.445 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:18 smithi082 ceph-mon[30098]: mds.? [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] up:boot 2024-05-08T05:45:18.445 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:18 smithi082 ceph-mon[30098]: fsmap 7 up:standby 2024-05-08T05:45:18.445 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:18 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-08T05:45:18.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:18 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:45:18.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:18 smithi134 ceph-mon[34132]: Deploying daemon mds.h on smithi134 2024-05-08T05:45:18.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:18 smithi134 ceph-mon[34132]: mds.? [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] up:boot 2024-05-08T05:45:18.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:18 smithi134 ceph-mon[34132]: fsmap 7 up:standby 2024-05-08T05:45:18.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:18 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-08T05:45:18.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:18 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:45:18.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:18 smithi151 ceph-mon[34815]: Deploying daemon mds.h on smithi134 2024-05-08T05:45:18.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:18 smithi151 ceph-mon[34815]: mds.? [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] up:boot 2024-05-08T05:45:18.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:18 smithi151 ceph-mon[34815]: fsmap 7 up:standby 2024-05-08T05:45:18.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:18 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-08T05:45:19.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:19 smithi082 ceph-mon[30098]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:19.487 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:19 smithi134 ceph-mon[34132]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:19.487 INFO:journalctl@ceph.mds.h.smithi134.stdout:May 08 05:45:19 smithi134 systemd[1]: Starting Ceph mds.h for c739a5c8-0cfc-11ef-bc97-c7b262605968... 2024-05-08T05:45:19.487 INFO:journalctl@ceph.mds.h.smithi134.stdout:May 08 05:45:19 smithi134 podman[64676]: 2024-05-08 05:45:19.390256592 +0000 UTC m=+0.018038283 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T05:45:19.596 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:19 smithi151 ceph-mon[34815]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:19.750 INFO:journalctl@ceph.mds.h.smithi134.stdout:May 08 05:45:19 smithi134 podman[64676]: 2024-05-08 05:45:19.490539501 +0000 UTC m=+0.118321170 container create 7ecfb2a1cf8117b4253b1642274d003f81a38430b59ca1c9c0626129a909f398 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-h, ceph=True, RELEASE=wip-57676-3-bee299f, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-05-08T05:45:20.250 INFO:journalctl@ceph.mds.h.smithi134.stdout:May 08 05:45:19 smithi134 podman[64676]: 2024-05-08 05:45:19.773255172 +0000 UTC m=+0.401036840 container init 7ecfb2a1cf8117b4253b1642274d003f81a38430b59ca1c9c0626129a909f398 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-h, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-57676-3-bee299f, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-05-08T05:45:20.250 INFO:journalctl@ceph.mds.h.smithi134.stdout:May 08 05:45:19 smithi134 podman[64676]: 2024-05-08 05:45:19.77590711 +0000 UTC m=+0.403688778 container start 7ecfb2a1cf8117b4253b1642274d003f81a38430b59ca1c9c0626129a909f398 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-h, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=wip-57676-3-bee299f, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507) 2024-05-08T05:45:20.250 INFO:journalctl@ceph.mds.h.smithi134.stdout:May 08 05:45:19 smithi134 ceph-mds[64695]: -- 172.21.15.134:0/1341295957 <== mon.2 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55834909ba40 con 0x55834906ec00 2024-05-08T05:45:20.251 INFO:journalctl@ceph.mds.h.smithi134.stdout:May 08 05:45:19 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-h[64691]: starting mds.h at 2024-05-08T05:45:20.251 INFO:journalctl@ceph.mds.h.smithi134.stdout:May 08 05:45:19 smithi134 bash[64676]: 7ecfb2a1cf8117b4253b1642274d003f81a38430b59ca1c9c0626129a909f398 2024-05-08T05:45:20.251 INFO:journalctl@ceph.mds.h.smithi134.stdout:May 08 05:45:19 smithi134 systemd[1]: Started Ceph mds.h for c739a5c8-0cfc-11ef-bc97-c7b262605968. 2024-05-08T05:45:20.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:20.499+0000 7f7c32800700 1 -- 172.21.15.82:0/306610772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c2c114670 msgr2=0x7f7c2c116a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:45:20.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:20.499+0000 7f7c32800700 1 --2- 172.21.15.82:0/306610772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c2c114670 0x7f7c2c116a60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7c2400b0a0 tx=0x7f7c2400b3b0 comp rx=0 tx=0).stop 2024-05-08T05:45:20.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:20.499+0000 7f7c32800700 1 -- 172.21.15.82:0/306610772 shutdown_connections 2024-05-08T05:45:20.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:20.499+0000 7f7c32800700 1 --2- 172.21.15.82:0/306610772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c2c114670 0x7f7c2c116a60 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:20.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:20.499+0000 7f7c32800700 1 --2- 172.21.15.82:0/306610772 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c2c0756d0 0x7f7c2c075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:20.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:20.499+0000 7f7c32800700 1 --2- 172.21.15.82:0/306610772 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c2c075ff0 0x7f7c2c114130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:20.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:20.499+0000 7f7c32800700 1 -- 172.21.15.82:0/306610772 >> 172.21.15.82:0/306610772 conn(0x7f7c2c07a600 msgr2=0x7f7c2c07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:45:20.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:20.499+0000 7f7c32800700 1 -- 172.21.15.82:0/306610772 shutdown_connections 2024-05-08T05:45:20.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:20.499+0000 7f7c32800700 1 -- 172.21.15.82:0/306610772 wait complete. 2024-05-08T05:45:20.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:20.500+0000 7f7c32800700 1 Processor -- start 2024-05-08T05:45:20.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:20.501+0000 7f7c32800700 1 -- start start 2024-05-08T05:45:20.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:20.501+0000 7f7c32800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c2c0756d0 0x7f7c2c1a01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:45:20.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:20.501+0000 7f7c32800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c2c075ff0 0x7f7c2c1a0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:45:20.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:20.501+0000 7f7c32800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c2c114670 0x7f7c2c1a4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:45:20.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:20.501+0000 7f7c32800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7c2c119c80 con 0x7f7c2c0756d0 2024-05-08T05:45:20.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:20.501+0000 7f7c32800700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7c2c119b00 con 0x7f7c2c075ff0 2024-05-08T05:45:20.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:20.501+0000 7f7c32800700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7c2c119e00 con 0x7f7c2c114670 2024-05-08T05:45:20.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:20.501+0000 7f7c2b400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c2c0756d0 0x7f7c2c1a01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:45:20.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:20.501+0000 7f7c2b400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c2c0756d0 0x7f7c2c1a01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42776/0 (socket says 172.21.15.82:42776) 2024-05-08T05:45:20.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:20.501+0000 7f7c2b400700 1 -- 172.21.15.82:0/1260687505 learned_addr learned my addr 172.21.15.82:0/1260687505 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:45:20.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:20.501+0000 7f7c2be00700 1 --2- 172.21.15.82:0/1260687505 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c2c114670 0x7f7c2c1a4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:45:20.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:20.501+0000 7f7c2aa00700 1 --2- 172.21.15.82:0/1260687505 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c2c075ff0 0x7f7c2c1a0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:45:20.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:20.502+0000 7f7c2be00700 1 -- 172.21.15.82:0/1260687505 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c2c075ff0 msgr2=0x7f7c2c1a0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:45:20.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:20.502+0000 7f7c2be00700 1 --2- 172.21.15.82:0/1260687505 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c2c075ff0 0x7f7c2c1a0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:20.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:20.502+0000 7f7c2be00700 1 -- 172.21.15.82:0/1260687505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c2c0756d0 msgr2=0x7f7c2c1a01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:45:20.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:20.502+0000 7f7c2be00700 1 --2- 172.21.15.82:0/1260687505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c2c0756d0 0x7f7c2c1a01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:20.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:20.502+0000 7f7c2be00700 1 -- 172.21.15.82:0/1260687505 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c2c1a51e0 con 0x7f7c2c114670 2024-05-08T05:45:20.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:20.502+0000 7f7c2b400700 1 --2- 172.21.15.82:0/1260687505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c2c0756d0 0x7f7c2c1a01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:45:20.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:20.502+0000 7f7c2be00700 1 --2- 172.21.15.82:0/1260687505 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c2c114670 0x7f7c2c1a4aa0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7c2400b070 tx=0x7f7c24004c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:45:20.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:20.502+0000 7f7c23e00700 1 -- 172.21.15.82:0/1260687505 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c24021070 con 0x7f7c2c114670 2024-05-08T05:45:20.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:20.502+0000 7f7c23e00700 1 -- 172.21.15.82:0/1260687505 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c24007e30 con 0x7f7c2c114670 2024-05-08T05:45:20.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:20.502+0000 7f7c32800700 1 -- 172.21.15.82:0/1260687505 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c2c1a5470 con 0x7f7c2c114670 2024-05-08T05:45:20.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:20.503+0000 7f7c23e00700 1 -- 172.21.15.82:0/1260687505 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c240045f0 con 0x7f7c2c114670 2024-05-08T05:45:20.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:20.503+0000 7f7c32800700 1 -- 172.21.15.82:0/1260687505 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c2c1acd50 con 0x7f7c2c114670 2024-05-08T05:45:20.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:20.504+0000 7f7c32800700 1 -- 172.21.15.82:0/1260687505 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c2c06a190 con 0x7f7c2c114670 2024-05-08T05:45:20.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:20.506+0000 7f7c23e00700 1 -- 172.21.15.82:0/1260687505 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f7c24007980 con 0x7f7c2c114670 2024-05-08T05:45:20.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:20.507+0000 7f7c23e00700 1 --2- 172.21.15.82:0/1260687505 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7c100b2900 0x7f7c100b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:45:20.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:20.508+0000 7f7c23e00700 1 -- 172.21.15.82:0/1260687505 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f7c2400f020 con 0x7f7c2c114670 2024-05-08T05:45:20.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:20.508+0000 7f7c2b400700 1 --2- 172.21.15.82:0/1260687505 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7c100b2900 0x7f7c100b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:45:20.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:20.508+0000 7f7c2b400700 1 --2- 172.21.15.82:0/1260687505 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7c100b2900 0x7f7c100b4dc0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c011550 tx=0x7f7c1c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:45:20.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:20.509+0000 7f7c23e00700 1 -- 172.21.15.82:0/1260687505 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f7c2402a020 con 0x7f7c2c114670 2024-05-08T05:45:20.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:20.791+0000 7f7c32800700 1 -- 172.21.15.82:0/1260687505 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7c2c1acf20 con 0x7f7c2c114670 2024-05-08T05:45:20.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:20.792+0000 7f7c23e00700 1 -- 172.21.15.82:0/1260687505 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7186 (secure 0 0 0) 0x7f7c240ab5f0 con 0x7f7c2c114670 2024-05-08T05:45:20.792 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:45:20.793 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14364,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3876883250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3876883250},{"type":"v1","addr":"172.21.15.82:6835","nonce":3876883250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1965070586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1965070586},{"type":"v1","addr":"172.21.15.82:6837","nonce":1965070586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3827691638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3827691638},{"type":"v1","addr":"172.21.15.134:6833","nonce":3827691638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/3625067797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3625067797},{"type":"v1","addr":"172.21.15.151:6833","nonce":3625067797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24455,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/4074163402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4074163402},{"type":"v1","addr":"172.21.15.134:6835","nonce":4074163402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24467,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/2212411710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2212411710},{"type":"v1","addr":"172.21.15.134:6837","nonce":2212411710}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24475,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2093655929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2093655929},{"type":"v1","addr":"172.21.15.151:6835","nonce":2093655929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24487,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/4192404464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":4192404464},{"type":"v1","addr":"172.21.15.151:6837","nonce":4192404464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-05-08T05:45:20.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:20.795+0000 7f7c32800700 1 -- 172.21.15.82:0/1260687505 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7c100b2900 msgr2=0x7f7c100b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:45:20.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:20.795+0000 7f7c32800700 1 --2- 172.21.15.82:0/1260687505 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7c100b2900 0x7f7c100b4dc0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c011550 tx=0x7f7c1c009260 comp rx=0 tx=0).stop 2024-05-08T05:45:20.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:20.795+0000 7f7c32800700 1 -- 172.21.15.82:0/1260687505 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c2c114670 msgr2=0x7f7c2c1a4aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:45:20.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:20.795+0000 7f7c32800700 1 --2- 172.21.15.82:0/1260687505 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c2c114670 0x7f7c2c1a4aa0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7c2400b070 tx=0x7f7c24004c80 comp rx=0 tx=0).stop 2024-05-08T05:45:20.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:20.795+0000 7f7c32800700 1 -- 172.21.15.82:0/1260687505 shutdown_connections 2024-05-08T05:45:20.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:20.795+0000 7f7c32800700 1 --2- 172.21.15.82:0/1260687505 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7c100b2900 0x7f7c100b4dc0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:20.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:20.795+0000 7f7c32800700 1 --2- 172.21.15.82:0/1260687505 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c2c114670 0x7f7c2c1a4aa0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:20.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:20.795+0000 7f7c32800700 1 --2- 172.21.15.82:0/1260687505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c2c0756d0 0x7f7c2c1a01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:20.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:20.795+0000 7f7c32800700 1 --2- 172.21.15.82:0/1260687505 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c2c075ff0 0x7f7c2c1a0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:20.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:20.795+0000 7f7c32800700 1 -- 172.21.15.82:0/1260687505 >> 172.21.15.82:0/1260687505 conn(0x7f7c2c07a600 msgr2=0x7f7c2c110110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:45:20.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:20.796+0000 7f7c32800700 1 -- 172.21.15.82:0/1260687505 shutdown_connections 2024-05-08T05:45:20.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:20.796+0000 7f7c32800700 1 -- 172.21.15.82:0/1260687505 wait complete. 2024-05-08T05:45:20.796 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 9 2024-05-08T05:45:21.172 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:20 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:21.172 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:20 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:21.172 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:20 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:21.172 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:20 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:45:21.172 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:20 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:45:21.172 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:20 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:45:21.172 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:20 smithi082 ceph-mon[30098]: Deploying daemon mds.i on smithi151 2024-05-08T05:45:21.172 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:20 smithi082 ceph-mon[30098]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:21.172 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:20 smithi082 ceph-mon[30098]: mds.? [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] up:boot 2024-05-08T05:45:21.172 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:20 smithi082 ceph-mon[30098]: fsmap 8 up:standby 2024-05-08T05:45:21.172 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:20 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-08T05:45:21.172 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:20 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/1260687505' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:45:21.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:20 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:21.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:20 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:21.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:20 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:21.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:20 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:45:21.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:20 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:45:21.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:20 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:45:21.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:20 smithi134 ceph-mon[34132]: Deploying daemon mds.i on smithi151 2024-05-08T05:45:21.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:20 smithi134 ceph-mon[34132]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:21.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:20 smithi134 ceph-mon[34132]: mds.? [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] up:boot 2024-05-08T05:45:21.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:20 smithi134 ceph-mon[34132]: fsmap 8 up:standby 2024-05-08T05:45:21.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:20 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-08T05:45:21.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:20 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/1260687505' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:45:21.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:20 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:21.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:20 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:21.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:20 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:21.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:20 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:45:21.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:20 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:45:21.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:20 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:45:21.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:20 smithi151 ceph-mon[34815]: Deploying daemon mds.i on smithi151 2024-05-08T05:45:21.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:20 smithi151 ceph-mon[34815]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:21.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:20 smithi151 ceph-mon[34815]: mds.? [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] up:boot 2024-05-08T05:45:21.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:20 smithi151 ceph-mon[34815]: fsmap 8 up:standby 2024-05-08T05:45:21.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:20 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-08T05:45:21.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:20 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/1260687505' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:45:22.379 INFO:journalctl@ceph.mds.i.smithi151.stdout:May 08 05:45:22 smithi151 systemd[1]: Starting Ceph mds.i for c739a5c8-0cfc-11ef-bc97-c7b262605968... 2024-05-08T05:45:22.696 INFO:journalctl@ceph.mds.i.smithi151.stdout:May 08 05:45:22 smithi151 podman[66075]: 2024-05-08 05:45:22.297268231 +0000 UTC m=+0.017930937 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T05:45:22.696 INFO:journalctl@ceph.mds.i.smithi151.stdout:May 08 05:45:22 smithi151 podman[66075]: 2024-05-08 05:45:22.427057131 +0000 UTC m=+0.147719813 container create 6884b7a6179ea498ca9ee49d316d15a97bf12c6fd840f65128f8b38e617dcebd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-i, RELEASE=wip-57676-3-bee299f, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-05-08T05:45:22.696 INFO:journalctl@ceph.mds.i.smithi151.stdout:May 08 05:45:22 smithi151 podman[66075]: 2024-05-08 05:45:22.696475613 +0000 UTC m=+0.417138296 container init 6884b7a6179ea498ca9ee49d316d15a97bf12c6fd840f65128f8b38e617dcebd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-i, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240507, RELEASE=wip-57676-3-bee299f, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-05-08T05:45:23.129 INFO:journalctl@ceph.mds.i.smithi151.stdout:May 08 05:45:22 smithi151 podman[66075]: 2024-05-08 05:45:22.699276523 +0000 UTC m=+0.419939217 container start 6884b7a6179ea498ca9ee49d316d15a97bf12c6fd840f65128f8b38e617dcebd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-i, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-57676-3-bee299f, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=) 2024-05-08T05:45:23.129 INFO:journalctl@ceph.mds.i.smithi151.stdout:May 08 05:45:22 smithi151 ceph-mds[66094]: -- 172.21.15.151:0/2191054392 <== mon.1 v2:172.21.15.151:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55937935da40 con 0x559379330800 2024-05-08T05:45:23.130 INFO:journalctl@ceph.mds.i.smithi151.stdout:May 08 05:45:22 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-i[66090]: starting mds.i at 2024-05-08T05:45:23.130 INFO:journalctl@ceph.mds.i.smithi151.stdout:May 08 05:45:22 smithi151 bash[66075]: 6884b7a6179ea498ca9ee49d316d15a97bf12c6fd840f65128f8b38e617dcebd 2024-05-08T05:45:23.130 INFO:journalctl@ceph.mds.i.smithi151.stdout:May 08 05:45:22 smithi151 systemd[1]: Started Ceph mds.i for c739a5c8-0cfc-11ef-bc97-c7b262605968. 2024-05-08T05:45:23.605 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T05:45:23.948 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:23 smithi082 ceph-mon[30098]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:23.948 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:23 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:23.948 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:23 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:23.948 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:23 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:23.948 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:23 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:45:23.948 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:23 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:45:23.948 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:23 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:45:23.948 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:23 smithi082 ceph-mon[30098]: mds.? [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] up:boot 2024-05-08T05:45:23.948 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:23 smithi082 ceph-mon[30098]: fsmap 9 up:standby 2024-05-08T05:45:23.948 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:23 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-08T05:45:24.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:23 smithi151 ceph-mon[34815]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:24.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:23 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:24.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:23 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:24.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:23 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:24.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:23 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:45:24.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:23 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:45:24.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:23 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:45:24.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:23 smithi151 ceph-mon[34815]: mds.? [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] up:boot 2024-05-08T05:45:24.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:23 smithi151 ceph-mon[34815]: fsmap 9 up:standby 2024-05-08T05:45:24.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:23 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-08T05:45:24.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:23 smithi134 ceph-mon[34132]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:24.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:23 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:24.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:23 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:24.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:23 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:24.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:23 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:45:24.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:23 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:45:24.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:23 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:45:24.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:23 smithi134 ceph-mon[34132]: mds.? [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] up:boot 2024-05-08T05:45:24.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:23 smithi134 ceph-mon[34132]: fsmap 9 up:standby 2024-05-08T05:45:24.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:23 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-08T05:45:25.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:24 smithi151 ceph-mon[34815]: Deploying daemon mds.g on smithi082 2024-05-08T05:45:25.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:24 smithi082 ceph-mon[30098]: Deploying daemon mds.g on smithi082 2024-05-08T05:45:25.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:24 smithi134 ceph-mon[34132]: Deploying daemon mds.g on smithi082 2024-05-08T05:45:25.498 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:45:26.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:25 smithi151 ceph-mon[34815]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:26.182 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:25 smithi082 ceph-mon[30098]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:26.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:25 smithi134 ceph-mon[34132]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:26.471 INFO:journalctl@ceph.mds.g.smithi082.stdout:May 08 05:45:26 smithi082 systemd[1]: Starting Ceph mds.g for c739a5c8-0cfc-11ef-bc97-c7b262605968... 2024-05-08T05:45:27.385 INFO:journalctl@ceph.mds.g.smithi082.stdout:May 08 05:45:27 smithi082 podman[68948]: 2024-05-08 05:45:27.123214905 +0000 UTC m=+0.040006231 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T05:45:27.385 INFO:journalctl@ceph.mds.g.smithi082.stdout:May 08 05:45:27 smithi082 podman[68948]: 2024-05-08 05:45:27.271117306 +0000 UTC m=+0.187908637 container create 3141edc501dd8fe12d8725a918f6b921bfae7a53728fd54dc26da8406d2a2496 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-g, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-57676-3-bee299f, org.label-schema.build-date=20240507) 2024-05-08T05:45:27.670 INFO:journalctl@ceph.mds.g.smithi082.stdout:May 08 05:45:27 smithi082 podman[68948]: 2024-05-08 05:45:27.611082802 +0000 UTC m=+0.527874189 container init 3141edc501dd8fe12d8725a918f6b921bfae7a53728fd54dc26da8406d2a2496 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-g, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-57676-3-bee299f, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-08T05:45:27.671 INFO:journalctl@ceph.mds.g.smithi082.stdout:May 08 05:45:27 smithi082 podman[68948]: 2024-05-08 05:45:27.623729056 +0000 UTC m=+0.540520379 container start 3141edc501dd8fe12d8725a918f6b921bfae7a53728fd54dc26da8406d2a2496 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-g, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-57676-3-bee299f, org.label-schema.build-date=20240507, ceph=True) 2024-05-08T05:45:27.932 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:27 smithi082 ceph-mon[30098]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:28.295 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:27 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:28.295 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:27 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:28.296 INFO:journalctl@ceph.mds.g.smithi082.stdout:May 08 05:45:27 smithi082 ceph-mds[68986]: -- 172.21.15.82:0/1359731764 <== mon.0 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5558b86fba40 con 0x5558b86ce800 2024-05-08T05:45:28.296 INFO:journalctl@ceph.mds.g.smithi082.stdout:May 08 05:45:27 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-g[68982]: starting mds.g at 2024-05-08T05:45:28.296 INFO:journalctl@ceph.mds.g.smithi082.stdout:May 08 05:45:27 smithi082 bash[68948]: 3141edc501dd8fe12d8725a918f6b921bfae7a53728fd54dc26da8406d2a2496 2024-05-08T05:45:28.296 INFO:journalctl@ceph.mds.g.smithi082.stdout:May 08 05:45:27 smithi082 systemd[1]: Started Ceph mds.g for c739a5c8-0cfc-11ef-bc97-c7b262605968. 2024-05-08T05:45:28.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:28.200+0000 7f9d7a400700 1 -- 172.21.15.82:0/892326654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d74075ff0 msgr2=0x7f9d7410f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:45:28.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:28.200+0000 7f9d7a400700 1 --2- 172.21.15.82:0/892326654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d74075ff0 0x7f9d7410f960 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9d60009990 tx=0x7f9d60009ca0 comp rx=0 tx=0).stop 2024-05-08T05:45:28.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:28.200+0000 7f9d7a400700 1 -- 172.21.15.82:0/892326654 shutdown_connections 2024-05-08T05:45:28.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:28.200+0000 7f9d7a400700 1 --2- 172.21.15.82:0/892326654 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d740756d0 0x7f9d74075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:28.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:28.200+0000 7f9d7a400700 1 --2- 172.21.15.82:0/892326654 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d7410fea0 0x7f9d74112290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:28.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:28.200+0000 7f9d7a400700 1 --2- 172.21.15.82:0/892326654 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d74075ff0 0x7f9d7410f960 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:28.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:28.200+0000 7f9d7a400700 1 -- 172.21.15.82:0/892326654 >> 172.21.15.82:0/892326654 conn(0x7f9d7407a650 msgr2=0x7f9d7407aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:45:28.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:28.200+0000 7f9d7a400700 1 -- 172.21.15.82:0/892326654 shutdown_connections 2024-05-08T05:45:28.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:28.200+0000 7f9d7a400700 1 -- 172.21.15.82:0/892326654 wait complete. 2024-05-08T05:45:28.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:28.201+0000 7f9d7a400700 1 Processor -- start 2024-05-08T05:45:28.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:28.202+0000 7f9d7a400700 1 -- start start 2024-05-08T05:45:28.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:28.202+0000 7f9d7a400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d740756d0 0x7f9d7419be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:45:28.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:28.202+0000 7f9d7a400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d74075ff0 0x7f9d7419c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:45:28.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:28.202+0000 7f9d7a400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d7410fea0 0x7f9d741a06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:45:28.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:28.202+0000 7f9d7a400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9d74115930 con 0x7f9d7410fea0 2024-05-08T05:45:28.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:28.202+0000 7f9d7a400700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9d741157b0 con 0x7f9d740756d0 2024-05-08T05:45:28.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:28.202+0000 7f9d7a400700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9d74115ab0 con 0x7f9d74075ff0 2024-05-08T05:45:28.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:28.203+0000 7f9d72a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d74075ff0 0x7f9d7419c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:45:28.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:28.203+0000 7f9d73e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d7410fea0 0x7f9d741a06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:45:28.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:28.203+0000 7f9d73400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d740756d0 0x7f9d7419be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:45:28.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:28.203+0000 7f9d72a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d74075ff0 0x7f9d7419c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:43294/0 (socket says 172.21.15.82:43294) 2024-05-08T05:45:28.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:28.203+0000 7f9d72a00700 1 -- 172.21.15.82:0/3408544868 learned_addr learned my addr 172.21.15.82:0/3408544868 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:45:28.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:28.203+0000 7f9d73400700 1 -- 172.21.15.82:0/3408544868 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d74075ff0 msgr2=0x7f9d7419c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:45:28.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:28.203+0000 7f9d73400700 1 --2- 172.21.15.82:0/3408544868 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d74075ff0 0x7f9d7419c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:28.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:28.203+0000 7f9d73400700 1 -- 172.21.15.82:0/3408544868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d7410fea0 msgr2=0x7f9d741a06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:45:28.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:28.203+0000 7f9d73400700 1 --2- 172.21.15.82:0/3408544868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d7410fea0 0x7f9d741a06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:28.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:28.203+0000 7f9d73400700 1 -- 172.21.15.82:0/3408544868 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d741a0e30 con 0x7f9d740756d0 2024-05-08T05:45:28.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:28.203+0000 7f9d73400700 1 --2- 172.21.15.82:0/3408544868 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d740756d0 0x7f9d7419be20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9d6400e9f0 tx=0x7f9d6400ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:45:28.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:28.204+0000 7f9d6be00700 1 -- 172.21.15.82:0/3408544868 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d6400c9c0 con 0x7f9d740756d0 2024-05-08T05:45:28.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:28.204+0000 7f9d6be00700 1 -- 172.21.15.82:0/3408544868 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d6400cb60 con 0x7f9d740756d0 2024-05-08T05:45:28.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:28.204+0000 7f9d7a400700 1 -- 172.21.15.82:0/3408544868 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d741a1120 con 0x7f9d740756d0 2024-05-08T05:45:28.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:28.204+0000 7f9d6be00700 1 -- 172.21.15.82:0/3408544868 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d64018680 con 0x7f9d740756d0 2024-05-08T05:45:28.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:28.204+0000 7f9d7a400700 1 -- 172.21.15.82:0/3408544868 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d741a89a0 con 0x7f9d740756d0 2024-05-08T05:45:28.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:28.205+0000 7f9d7a400700 1 -- 172.21.15.82:0/3408544868 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d7406a190 con 0x7f9d740756d0 2024-05-08T05:45:28.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:28.207+0000 7f9d6be00700 1 -- 172.21.15.82:0/3408544868 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f9d64010430 con 0x7f9d740756d0 2024-05-08T05:45:28.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:28.208+0000 7f9d6be00700 1 --2- 172.21.15.82:0/3408544868 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9d580b2880 0x7f9d580b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:45:28.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:28.209+0000 7f9d6be00700 1 -- 172.21.15.82:0/3408544868 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f9d640e1f60 con 0x7f9d740756d0 2024-05-08T05:45:28.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:28.209+0000 7f9d72a00700 1 --2- 172.21.15.82:0/3408544868 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9d580b2880 0x7f9d580b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:45:28.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:28.209+0000 7f9d72a00700 1 --2- 172.21.15.82:0/3408544868 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9d580b2880 0x7f9d580b4d40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9d74111c40 tx=0x7f9d6000b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:45:28.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:28.213+0000 7f9d6be00700 1 -- 172.21.15.82:0/3408544868 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9d640aa080 con 0x7f9d740756d0 2024-05-08T05:45:28.302 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:27 smithi134 ceph-mon[34132]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:28.302 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:27 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:28.302 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:27 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:28.302 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:27 smithi151 ceph-mon[34815]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:28.302 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:27 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:28.302 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:27 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:28.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:28.501+0000 7f9d7a400700 1 -- 172.21.15.82:0/3408544868 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9d7402e510 con 0x7f9d740756d0 2024-05-08T05:45:28.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:28.502+0000 7f9d6be00700 1 -- 172.21.15.82:0/3408544868 <== mon.2 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8842 (secure 0 0 0) 0x7f9d640b2100 con 0x7f9d740756d0 2024-05-08T05:45:28.504 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:45:28.504 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14364,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3876883250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3876883250},{"type":"v1","addr":"172.21.15.82:6835","nonce":3876883250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1965070586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1965070586},{"type":"v1","addr":"172.21.15.82:6837","nonce":1965070586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14397,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6839/1890720973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1890720973},{"type":"v1","addr":"172.21.15.82:6839","nonce":1890720973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3827691638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3827691638},{"type":"v1","addr":"172.21.15.134:6833","nonce":3827691638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/3625067797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3625067797},{"type":"v1","addr":"172.21.15.151:6833","nonce":3625067797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24455,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/4074163402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4074163402},{"type":"v1","addr":"172.21.15.134:6835","nonce":4074163402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24467,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/2212411710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2212411710},{"type":"v1","addr":"172.21.15.134:6837","nonce":2212411710}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24475,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2093655929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2093655929},{"type":"v1","addr":"172.21.15.151:6835","nonce":2093655929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24487,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/4192404464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":4192404464},{"type":"v1","addr":"172.21.15.151:6837","nonce":4192404464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24505,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6839/2963754236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":2963754236},{"type":"v1","addr":"172.21.15.151:6839","nonce":2963754236}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-05-08T05:45:28.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:28.505+0000 7f9d7a400700 1 -- 172.21.15.82:0/3408544868 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9d580b2880 msgr2=0x7f9d580b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:45:28.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:28.505+0000 7f9d7a400700 1 --2- 172.21.15.82:0/3408544868 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9d580b2880 0x7f9d580b4d40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9d74111c40 tx=0x7f9d6000b260 comp rx=0 tx=0).stop 2024-05-08T05:45:28.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:28.505+0000 7f9d7a400700 1 -- 172.21.15.82:0/3408544868 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d740756d0 msgr2=0x7f9d7419be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:45:28.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:28.505+0000 7f9d7a400700 1 --2- 172.21.15.82:0/3408544868 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d740756d0 0x7f9d7419be20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9d6400e9f0 tx=0x7f9d6400ed00 comp rx=0 tx=0).stop 2024-05-08T05:45:28.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:28.505+0000 7f9d7a400700 1 -- 172.21.15.82:0/3408544868 shutdown_connections 2024-05-08T05:45:28.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:28.505+0000 7f9d7a400700 1 --2- 172.21.15.82:0/3408544868 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d740756d0 0x7f9d7419be20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:28.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:28.505+0000 7f9d7a400700 1 --2- 172.21.15.82:0/3408544868 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9d580b2880 0x7f9d580b4d40 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:28.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:28.505+0000 7f9d7a400700 1 --2- 172.21.15.82:0/3408544868 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d7410fea0 0x7f9d741a06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:28.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:28.505+0000 7f9d7a400700 1 --2- 172.21.15.82:0/3408544868 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d74075ff0 0x7f9d7419c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:28.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:28.505+0000 7f9d7a400700 1 -- 172.21.15.82:0/3408544868 >> 172.21.15.82:0/3408544868 conn(0x7f9d7407a650 msgr2=0x7f9d74100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:45:28.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:28.506+0000 7f9d7a400700 1 -- 172.21.15.82:0/3408544868 shutdown_connections 2024-05-08T05:45:28.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:28.506+0000 7f9d7a400700 1 -- 172.21.15.82:0/3408544868 wait complete. 2024-05-08T05:45:28.508 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 11 2024-05-08T05:45:29.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:28 smithi151 ceph-mon[34815]: mds.? [v2:172.21.15.82:6838/1890720973,v1:172.21.15.82:6839/1890720973] up:boot 2024-05-08T05:45:29.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:28 smithi151 ceph-mon[34815]: fsmap 10 up:standby 2024-05-08T05:45:29.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:28 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-08T05:45:29.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:28 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:29.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:28 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:45:29.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:28 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:45:29.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:28 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:45:29.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:28 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/3408544868' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:45:29.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:28 smithi082 ceph-mon[30098]: mds.? [v2:172.21.15.82:6838/1890720973,v1:172.21.15.82:6839/1890720973] up:boot 2024-05-08T05:45:29.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:28 smithi082 ceph-mon[30098]: fsmap 10 up:standby 2024-05-08T05:45:29.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:28 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-08T05:45:29.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:28 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:29.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:28 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:45:29.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:28 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:45:29.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:28 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:45:29.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:28 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/3408544868' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:45:29.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:28 smithi134 ceph-mon[34132]: mds.? [v2:172.21.15.82:6838/1890720973,v1:172.21.15.82:6839/1890720973] up:boot 2024-05-08T05:45:29.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:28 smithi134 ceph-mon[34132]: fsmap 10 up:standby 2024-05-08T05:45:29.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:28 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-08T05:45:29.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:28 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:29.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:28 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:45:29.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:28 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:45:29.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:28 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:45:29.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:28 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/3408544868' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:45:30.017 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:29 smithi082 ceph-mon[30098]: Deploying daemon mds.a on smithi082 2024-05-08T05:45:30.017 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:29 smithi082 ceph-mon[30098]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:30.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:29 smithi134 ceph-mon[34132]: Deploying daemon mds.a on smithi082 2024-05-08T05:45:30.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:29 smithi134 ceph-mon[34132]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:30.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:29 smithi151 ceph-mon[34815]: Deploying daemon mds.a on smithi082 2024-05-08T05:45:30.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:29 smithi151 ceph-mon[34815]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:31.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:30 smithi082 ceph-mon[30098]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:31.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:30 smithi134 ceph-mon[34132]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:31.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:30 smithi151 ceph-mon[34815]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:31.430 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T05:45:31.958 INFO:journalctl@ceph.mds.a.smithi082.stdout:May 08 05:45:31 smithi082 systemd[1]: Starting Ceph mds.a for c739a5c8-0cfc-11ef-bc97-c7b262605968... 2024-05-08T05:45:32.221 INFO:journalctl@ceph.mds.a.smithi082.stdout:May 08 05:45:31 smithi082 podman[69355]: 2024-05-08 05:45:31.862803997 +0000 UTC m=+0.041521946 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T05:45:32.221 INFO:journalctl@ceph.mds.a.smithi082.stdout:May 08 05:45:31 smithi082 podman[69355]: 2024-05-08 05:45:31.97324613 +0000 UTC m=+0.151964116 container create b779b6736622d09514fbeb08f1a05146b1e1b98435a226c8d78c53db32da9c2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-a, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-57676-3-bee299f, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-08T05:45:32.369 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:45:32.524 INFO:journalctl@ceph.mds.a.smithi082.stdout:May 08 05:45:32 smithi082 podman[69355]: 2024-05-08 05:45:32.244155951 +0000 UTC m=+0.422873944 container init b779b6736622d09514fbeb08f1a05146b1e1b98435a226c8d78c53db32da9c2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-a, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-57676-3-bee299f, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-05-08T05:45:32.525 INFO:journalctl@ceph.mds.a.smithi082.stdout:May 08 05:45:32 smithi082 podman[69355]: 2024-05-08 05:45:32.254561571 +0000 UTC m=+0.433279527 container start b779b6736622d09514fbeb08f1a05146b1e1b98435a226c8d78c53db32da9c2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-a, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-57676-3-bee299f, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-05-08T05:45:32.525 INFO:journalctl@ceph.mds.a.smithi082.stdout:May 08 05:45:32 smithi082 ceph-mds[69394]: -- 172.21.15.82:0/1855854551 <== mon.0 v2:172.21.15.82:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561151aeda40 con 0x561151ac0c00 2024-05-08T05:45:32.525 INFO:journalctl@ceph.mds.a.smithi082.stdout:May 08 05:45:32 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-a[69390]: starting mds.a at 2024-05-08T05:45:32.525 INFO:journalctl@ceph.mds.a.smithi082.stdout:May 08 05:45:32 smithi082 bash[69355]: b779b6736622d09514fbeb08f1a05146b1e1b98435a226c8d78c53db32da9c2e 2024-05-08T05:45:32.525 INFO:journalctl@ceph.mds.a.smithi082.stdout:May 08 05:45:32 smithi082 systemd[1]: Started Ceph mds.a for c739a5c8-0cfc-11ef-bc97-c7b262605968. 2024-05-08T05:45:33.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:33 smithi082 ceph-mon[30098]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:33.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:33 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:33.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:33 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:33.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:33 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:33.722 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:33 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:45:33.722 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:33 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:45:33.722 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:33 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:45:33.722 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:33 smithi082 ceph-mon[30098]: Deploying daemon mds.b on smithi134 2024-05-08T05:45:33.722 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:33 smithi082 ceph-mon[30098]: mds.? [v2:172.21.15.82:6840/2957083305,v1:172.21.15.82:6841/2957083305] up:boot 2024-05-08T05:45:33.722 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:33 smithi082 ceph-mon[30098]: fsmap 11 up:standby 2024-05-08T05:45:33.722 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:33 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-08T05:45:33.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:33 smithi134 ceph-mon[34132]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:33.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:33 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:33.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:33 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:33.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:33 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:33.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:33 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:45:33.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:33 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:45:33.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:33 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:45:33.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:33 smithi134 ceph-mon[34132]: Deploying daemon mds.b on smithi134 2024-05-08T05:45:33.751 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:33 smithi134 ceph-mon[34132]: mds.? [v2:172.21.15.82:6840/2957083305,v1:172.21.15.82:6841/2957083305] up:boot 2024-05-08T05:45:33.751 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:33 smithi134 ceph-mon[34132]: fsmap 11 up:standby 2024-05-08T05:45:33.751 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:33 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-08T05:45:33.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:33 smithi151 ceph-mon[34815]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:33.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:33 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:33.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:33 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:33.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:33 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:33.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:33 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-08T05:45:33.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:33 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-08T05:45:33.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:33 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:45:33.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:33 smithi151 ceph-mon[34815]: Deploying daemon mds.b on smithi134 2024-05-08T05:45:33.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:33 smithi151 ceph-mon[34815]: mds.? [v2:172.21.15.82:6840/2957083305,v1:172.21.15.82:6841/2957083305] up:boot 2024-05-08T05:45:33.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:33 smithi151 ceph-mon[34815]: fsmap 11 up:standby 2024-05-08T05:45:33.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:33 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-08T05:45:34.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:34.674+0000 7fd900a00700 1 -- 172.21.15.82:0/890371983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8fc0782f0 msgr2=0x7fd8fc113e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:45:34.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:34.674+0000 7fd900a00700 1 --2- 172.21.15.82:0/890371983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8fc0782f0 0x7fd8fc113e10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8009990 tx=0x7fd8e8009ca0 comp rx=0 tx=0).stop 2024-05-08T05:45:34.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:34.674+0000 7fd900a00700 1 -- 172.21.15.82:0/890371983 shutdown_connections 2024-05-08T05:45:34.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:34.674+0000 7fd900a00700 1 --2- 172.21.15.82:0/890371983 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8fc0779d0 0x7fd8fc077db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:34.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:34.674+0000 7fd900a00700 1 --2- 172.21.15.82:0/890371983 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8fc114350 0x7fd8fc116740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:34.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:34.674+0000 7fd900a00700 1 --2- 172.21.15.82:0/890371983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8fc0782f0 0x7fd8fc113e10 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:34.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:34.674+0000 7fd900a00700 1 -- 172.21.15.82:0/890371983 >> 172.21.15.82:0/890371983 conn(0x7fd8fc1011e0 msgr2=0x7fd8fc103600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:45:34.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:34.674+0000 7fd900a00700 1 -- 172.21.15.82:0/890371983 shutdown_connections 2024-05-08T05:45:34.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:34.674+0000 7fd900a00700 1 -- 172.21.15.82:0/890371983 wait complete. 2024-05-08T05:45:34.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:34.675+0000 7fd900a00700 1 Processor -- start 2024-05-08T05:45:34.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:34.676+0000 7fd900a00700 1 -- start start 2024-05-08T05:45:34.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:34.676+0000 7fd900a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8fc0779d0 0x7fd8fc1a0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:45:34.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:34.676+0000 7fd900a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8fc0782f0 0x7fd8fc1a06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:45:34.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:34.676+0000 7fd900a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8fc114350 0x7fd8fc1a4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:45:34.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:34.676+0000 7fd900a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd8fc119ce0 con 0x7fd8fc0782f0 2024-05-08T05:45:34.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:34.676+0000 7fd900a00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd8fc119b60 con 0x7fd8fc0779d0 2024-05-08T05:45:34.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:34.676+0000 7fd900a00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd8fc119e60 con 0x7fd8fc114350 2024-05-08T05:45:34.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:34.677+0000 7fd8f9e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8fc0779d0 0x7fd8fc1a0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:45:34.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:34.677+0000 7fd8f9e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8fc0779d0 0x7fd8fc1a0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:33706/0 (socket says 172.21.15.82:33706) 2024-05-08T05:45:34.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:34.677+0000 7fd8f9e00700 1 -- 172.21.15.82:0/3814977015 learned_addr learned my addr 172.21.15.82:0/3814977015 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:45:34.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:34.677+0000 7fd8f9400700 1 --2- 172.21.15.82:0/3814977015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8fc0782f0 0x7fd8fc1a06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:45:34.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:34.677+0000 7fd8fa800700 1 --2- 172.21.15.82:0/3814977015 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8fc114350 0x7fd8fc1a4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:45:34.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:34.677+0000 7fd8f9e00700 1 -- 172.21.15.82:0/3814977015 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8fc114350 msgr2=0x7fd8fc1a4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:45:34.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:34.677+0000 7fd8f9e00700 1 --2- 172.21.15.82:0/3814977015 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8fc114350 0x7fd8fc1a4a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:34.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:34.677+0000 7fd8f9e00700 1 -- 172.21.15.82:0/3814977015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8fc0782f0 msgr2=0x7fd8fc1a06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:45:34.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:34.677+0000 7fd8f9e00700 1 --2- 172.21.15.82:0/3814977015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8fc0782f0 0x7fd8fc1a06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:34.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:34.677+0000 7fd8f9e00700 1 -- 172.21.15.82:0/3814977015 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8fc1a51a0 con 0x7fd8fc0779d0 2024-05-08T05:45:34.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:34.678+0000 7fd8f9e00700 1 --2- 172.21.15.82:0/3814977015 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8fc0779d0 0x7fd8fc1a0190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec00eb30 tx=0x7fd8ec00ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:45:34.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:34.678+0000 7fd8f2a00700 1 -- 172.21.15.82:0/3814977015 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec00cbd0 con 0x7fd8fc0779d0 2024-05-08T05:45:34.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:34.678+0000 7fd900a00700 1 -- 172.21.15.82:0/3814977015 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8fc1a5490 con 0x7fd8fc0779d0 2024-05-08T05:45:34.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:34.678+0000 7fd8f2a00700 1 -- 172.21.15.82:0/3814977015 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8ec0044d0 con 0x7fd8fc0779d0 2024-05-08T05:45:34.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:34.678+0000 7fd8f2a00700 1 -- 172.21.15.82:0/3814977015 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec003e30 con 0x7fd8fc0779d0 2024-05-08T05:45:34.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:34.678+0000 7fd900a00700 1 -- 172.21.15.82:0/3814977015 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8fc1acd10 con 0x7fd8fc0779d0 2024-05-08T05:45:34.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:34.679+0000 7fd900a00700 1 -- 172.21.15.82:0/3814977015 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8fc06a190 con 0x7fd8fc0779d0 2024-05-08T05:45:34.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:34.681+0000 7fd8f2a00700 1 -- 172.21.15.82:0/3814977015 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fd8ec004000 con 0x7fd8fc0779d0 2024-05-08T05:45:34.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:34.683+0000 7fd8f2a00700 1 --2- 172.21.15.82:0/3814977015 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd8e00b2900 0x7fd8e00b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:45:34.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:34.683+0000 7fd8f2a00700 1 -- 172.21.15.82:0/3814977015 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fd8ec0e2210 con 0x7fd8fc0779d0 2024-05-08T05:45:34.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:34.683+0000 7fd8f9400700 1 --2- 172.21.15.82:0/3814977015 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd8e00b2900 0x7fd8e00b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:45:34.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:34.684+0000 7fd8f9400700 1 --2- 172.21.15.82:0/3814977015 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd8e00b2900 0x7fd8e00b4dc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd8e800b2e0 tx=0x7fd8e8005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:45:34.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:34.690+0000 7fd8f2a00700 1 -- 172.21.15.82:0/3814977015 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd8ec0042f0 con 0x7fd8fc0779d0 2024-05-08T05:45:34.750 INFO:journalctl@ceph.mds.b.smithi134.stdout:May 08 05:45:34 smithi134 systemd[1]: Starting Ceph mds.b for c739a5c8-0cfc-11ef-bc97-c7b262605968... 2024-05-08T05:45:34.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:34.968+0000 7fd900a00700 1 -- 172.21.15.82:0/3814977015 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd8fc1a14f0 con 0x7fd8fc0779d0 2024-05-08T05:45:34.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:34.969+0000 7fd8f2a00700 1 -- 172.21.15.82:0/3814977015 <== mon.2 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9668 (secure 0 0 0) 0x7fd8ec0aa330 con 0x7fd8fc0779d0 2024-05-08T05:45:34.970 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:45:34.970 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14364,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3876883250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3876883250},{"type":"v1","addr":"172.21.15.82:6835","nonce":3876883250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1965070586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1965070586},{"type":"v1","addr":"172.21.15.82:6837","nonce":1965070586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14397,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6839/1890720973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1890720973},{"type":"v1","addr":"172.21.15.82:6839","nonce":1890720973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14409,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6841/2957083305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":2957083305},{"type":"v1","addr":"172.21.15.82:6841","nonce":2957083305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3827691638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3827691638},{"type":"v1","addr":"172.21.15.134:6833","nonce":3827691638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/3625067797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3625067797},{"type":"v1","addr":"172.21.15.151:6833","nonce":3625067797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24455,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/4074163402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4074163402},{"type":"v1","addr":"172.21.15.134:6835","nonce":4074163402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24467,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/2212411710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2212411710},{"type":"v1","addr":"172.21.15.134:6837","nonce":2212411710}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24475,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2093655929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2093655929},{"type":"v1","addr":"172.21.15.151:6835","nonce":2093655929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24487,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/4192404464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":4192404464},{"type":"v1","addr":"172.21.15.151:6837","nonce":4192404464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24505,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6839/2963754236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":2963754236},{"type":"v1","addr":"172.21.15.151:6839","nonce":2963754236}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-05-08T05:45:34.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:34.972+0000 7fd900a00700 1 -- 172.21.15.82:0/3814977015 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd8e00b2900 msgr2=0x7fd8e00b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:45:34.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:34.972+0000 7fd900a00700 1 --2- 172.21.15.82:0/3814977015 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd8e00b2900 0x7fd8e00b4dc0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd8e800b2e0 tx=0x7fd8e8005960 comp rx=0 tx=0).stop 2024-05-08T05:45:34.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:34.973+0000 7fd900a00700 1 -- 172.21.15.82:0/3814977015 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8fc0779d0 msgr2=0x7fd8fc1a0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:45:34.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:34.973+0000 7fd900a00700 1 --2- 172.21.15.82:0/3814977015 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8fc0779d0 0x7fd8fc1a0190 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec00eb30 tx=0x7fd8ec00ee40 comp rx=0 tx=0).stop 2024-05-08T05:45:34.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:34.973+0000 7fd900a00700 1 -- 172.21.15.82:0/3814977015 shutdown_connections 2024-05-08T05:45:34.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:34.973+0000 7fd900a00700 1 --2- 172.21.15.82:0/3814977015 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8fc0779d0 0x7fd8fc1a0190 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:34.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:34.973+0000 7fd900a00700 1 --2- 172.21.15.82:0/3814977015 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd8e00b2900 0x7fd8e00b4dc0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:34.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:34.973+0000 7fd900a00700 1 --2- 172.21.15.82:0/3814977015 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8fc114350 0x7fd8fc1a4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:34.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:34.973+0000 7fd900a00700 1 --2- 172.21.15.82:0/3814977015 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8fc0782f0 0x7fd8fc1a06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:34.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:34.973+0000 7fd900a00700 1 -- 172.21.15.82:0/3814977015 >> 172.21.15.82:0/3814977015 conn(0x7fd8fc1011e0 msgr2=0x7fd8fc1035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:45:34.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:34.973+0000 7fd900a00700 1 -- 172.21.15.82:0/3814977015 shutdown_connections 2024-05-08T05:45:34.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:34.973+0000 7fd900a00700 1 -- 172.21.15.82:0/3814977015 wait complete. 2024-05-08T05:45:34.975 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 12 2024-05-08T05:45:35.125 INFO:journalctl@ceph.mds.b.smithi134.stdout:May 08 05:45:34 smithi134 podman[64994]: 2024-05-08 05:45:34.760203393 +0000 UTC m=+0.018130030 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T05:45:35.126 INFO:journalctl@ceph.mds.b.smithi134.stdout:May 08 05:45:34 smithi134 podman[64994]: 2024-05-08 05:45:34.889079827 +0000 UTC m=+0.147006448 container create c991dcbc68f4c51d767279f651496faaaec6be183baadd8f1a06a4f190d0fee5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-b, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, RELEASE=wip-57676-3-bee299f, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-05-08T05:45:35.126 INFO:journalctl@ceph.mds.b.smithi134.stdout:May 08 05:45:35 smithi134 podman[64994]: 2024-05-08 05:45:35.125838359 +0000 UTC m=+0.383764980 container init c991dcbc68f4c51d767279f651496faaaec6be183baadd8f1a06a4f190d0fee5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-b, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-57676-3-bee299f, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-08T05:45:35.466 INFO:journalctl@ceph.mds.b.smithi134.stdout:May 08 05:45:35 smithi134 podman[64994]: 2024-05-08 05:45:35.128639768 +0000 UTC m=+0.386566399 container start c991dcbc68f4c51d767279f651496faaaec6be183baadd8f1a06a4f190d0fee5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-b, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-57676-3-bee299f, ceph=True, org.label-schema.vendor=CentOS) 2024-05-08T05:45:35.466 INFO:journalctl@ceph.mds.b.smithi134.stdout:May 08 05:45:35 smithi134 ceph-mds[65014]: -- 172.21.15.134:0/648863069 <== mon.2 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5600ef311a40 con 0x5600ef2e4800 2024-05-08T05:45:35.466 INFO:journalctl@ceph.mds.b.smithi134.stdout:May 08 05:45:35 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-b[65010]: starting mds.b at 2024-05-08T05:45:35.466 INFO:journalctl@ceph.mds.b.smithi134.stdout:May 08 05:45:35 smithi134 bash[64994]: c991dcbc68f4c51d767279f651496faaaec6be183baadd8f1a06a4f190d0fee5 2024-05-08T05:45:35.467 INFO:journalctl@ceph.mds.b.smithi134.stdout:May 08 05:45:35 smithi134 systemd[1]: Started Ceph mds.b for c739a5c8-0cfc-11ef-bc97-c7b262605968. 2024-05-08T05:45:35.671 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:35 smithi082 ceph-mon[30098]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:35.671 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:35 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/3814977015' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:45:35.671 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:35 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:35.671 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:35 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:35.671 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:35 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:35.671 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:35 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:35.671 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:35 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:35.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:35 smithi134 ceph-mon[34132]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:35.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:35 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/3814977015' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:45:35.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:35 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:35.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:35 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:35.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:35 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:35.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:35 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:35.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:35 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:35.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:35 smithi151 ceph-mon[34815]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:35.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:35 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/3814977015' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:45:35.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:35 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:35.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:35 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:35.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:35 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:35.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:35 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:35.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:35 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:36.747 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:36 smithi134 ceph-mon[34132]: mds.? [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] up:boot 2024-05-08T05:45:36.747 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:36 smithi134 ceph-mon[34132]: fsmap 12 up:standby 2024-05-08T05:45:36.747 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:36 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-08T05:45:36.747 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:36 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:45:36.748 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:36 smithi151 ceph-mon[34815]: mds.? [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] up:boot 2024-05-08T05:45:36.749 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:36 smithi151 ceph-mon[34815]: fsmap 12 up:standby 2024-05-08T05:45:36.749 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:36 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-08T05:45:36.749 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:36 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:45:36.969 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:36 smithi082 ceph-mon[30098]: mds.? [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] up:boot 2024-05-08T05:45:36.969 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:36 smithi082 ceph-mon[30098]: fsmap 12 up:standby 2024-05-08T05:45:36.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:36 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-08T05:45:36.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:36 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:45:37.482 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:37 smithi134 ceph-mon[34132]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:37.482 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:37 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:37.735 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T05:45:37.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:37 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:37.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:37 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:37.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:37 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:37.794 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:37 smithi082 ceph-mon[30098]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:37.794 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:37 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:37.794 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:37 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:37.794 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:37 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:37.794 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:37 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:37.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:37 smithi151 ceph-mon[34815]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:37.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:37 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:37.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:37 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:37.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:37 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:37.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:37 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:38.163 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:45:39.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:39 smithi082 ceph-mon[30098]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:39.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:39 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:39.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:39 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:39.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:39 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:45:39.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:39 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:45:39.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:39 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:39.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:39 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:45:39.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:39 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:39.823 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:39 smithi151 ceph-mon[34815]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:39.823 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:39 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:39.823 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:39 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:39.823 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:39 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:45:39.823 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:39 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:45:39.824 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:39 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:39.824 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:39 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:45:39.824 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:39 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:39.858 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:39 smithi134 ceph-mon[34132]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:39.858 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:39 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:39.858 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:39 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:39.858 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:39 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:45:39.858 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:39 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:45:39.858 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:39 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:39.858 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:39 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:45:39.858 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:39 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:40.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:40.304+0000 7f2e8b600700 1 -- 172.21.15.82:0/4277609124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e8406b180 msgr2=0x7f2e8406b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:45:40.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:40.304+0000 7f2e8b600700 1 --2- 172.21.15.82:0/4277609124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e8406b180 0x7f2e8406b600 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2e700098f0 tx=0x7f2e70009c00 comp rx=0 tx=0).stop 2024-05-08T05:45:40.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:40.304+0000 7f2e8b600700 1 -- 172.21.15.82:0/4277609124 shutdown_connections 2024-05-08T05:45:40.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:40.304+0000 7f2e8b600700 1 --2- 172.21.15.82:0/4277609124 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e8406bb40 0x7f2e84110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:40.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:40.304+0000 7f2e8b600700 1 --2- 172.21.15.82:0/4277609124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e84109510 0x7f2e841098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:40.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:40.304+0000 7f2e8b600700 1 --2- 172.21.15.82:0/4277609124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e8406b180 0x7f2e8406b600 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:40.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:40.304+0000 7f2e8b600700 1 -- 172.21.15.82:0/4277609124 >> 172.21.15.82:0/4277609124 conn(0x7f2e84079350 msgr2=0x7f2e84079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:45:40.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:40.304+0000 7f2e8b600700 1 -- 172.21.15.82:0/4277609124 shutdown_connections 2024-05-08T05:45:40.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:40.304+0000 7f2e8b600700 1 -- 172.21.15.82:0/4277609124 wait complete. 2024-05-08T05:45:40.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:40.306+0000 7f2e8b600700 1 Processor -- start 2024-05-08T05:45:40.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:40.306+0000 7f2e8b600700 1 -- start start 2024-05-08T05:45:40.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:40.306+0000 7f2e8b600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e8406b180 0x7f2e8419bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:45:40.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:40.306+0000 7f2e8b600700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e8406bb40 0x7f2e8419c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:45:40.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:40.306+0000 7f2e8b600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e84109510 0x7f2e841a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:45:40.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:40.306+0000 7f2e8b600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2e84113690 con 0x7f2e8406b180 2024-05-08T05:45:40.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:40.306+0000 7f2e8b600700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2e84113510 con 0x7f2e84109510 2024-05-08T05:45:40.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:40.306+0000 7f2e8b600700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2e84113810 con 0x7f2e8406bb40 2024-05-08T05:45:40.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:40.307+0000 7f2e83e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e8406bb40 0x7f2e8419c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:45:40.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:40.307+0000 7f2e88c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e8406b180 0x7f2e8419bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:45:40.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:40.307+0000 7f2e83e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e8406bb40 0x7f2e8419c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:54216/0 (socket says 172.21.15.82:54216) 2024-05-08T05:45:40.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:40.307+0000 7f2e83e00700 1 -- 172.21.15.82:0/65184747 learned_addr learned my addr 172.21.15.82:0/65184747 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:45:40.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:40.307+0000 7f2e89600700 1 --2- 172.21.15.82:0/65184747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e84109510 0x7f2e841a06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:45:40.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:40.307+0000 7f2e83e00700 1 -- 172.21.15.82:0/65184747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e84109510 msgr2=0x7f2e841a06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:45:40.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:40.307+0000 7f2e83e00700 1 --2- 172.21.15.82:0/65184747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e84109510 0x7f2e841a06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:40.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:40.307+0000 7f2e83e00700 1 -- 172.21.15.82:0/65184747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e8406b180 msgr2=0x7f2e8419bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:45:40.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:40.307+0000 7f2e83e00700 1 --2- 172.21.15.82:0/65184747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e8406b180 0x7f2e8419bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:40.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:40.307+0000 7f2e83e00700 1 -- 172.21.15.82:0/65184747 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e841a0df0 con 0x7f2e8406bb40 2024-05-08T05:45:40.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:40.307+0000 7f2e89600700 1 --2- 172.21.15.82:0/65184747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e84109510 0x7f2e841a06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:45:40.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:40.307+0000 7f2e83e00700 1 --2- 172.21.15.82:0/65184747 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e8406bb40 0x7f2e8419c320 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2e70009230 tx=0x7f2e7000fa70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:45:40.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:40.308+0000 7f2e81600700 1 -- 172.21.15.82:0/65184747 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e70005140 con 0x7f2e8406bb40 2024-05-08T05:45:40.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:40.308+0000 7f2e8b600700 1 -- 172.21.15.82:0/65184747 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e841a1080 con 0x7f2e8406bb40 2024-05-08T05:45:40.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:40.308+0000 7f2e81600700 1 -- 172.21.15.82:0/65184747 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2e7000b560 con 0x7f2e8406bb40 2024-05-08T05:45:40.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:40.308+0000 7f2e81600700 1 -- 172.21.15.82:0/65184747 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e70003ae0 con 0x7f2e8406bb40 2024-05-08T05:45:40.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:40.308+0000 7f2e8b600700 1 -- 172.21.15.82:0/65184747 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e841a8960 con 0x7f2e8406bb40 2024-05-08T05:45:40.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:40.309+0000 7f2e8b600700 1 -- 172.21.15.82:0/65184747 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e84104bd0 con 0x7f2e8406bb40 2024-05-08T05:45:40.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:40.311+0000 7f2e81600700 1 -- 172.21.15.82:0/65184747 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f2e70003c80 con 0x7f2e8406bb40 2024-05-08T05:45:40.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:40.312+0000 7f2e81600700 1 --2- 172.21.15.82:0/65184747 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2e6c0b2880 0x7f2e6c0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:45:40.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:40.313+0000 7f2e81600700 1 -- 172.21.15.82:0/65184747 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f2e700e2dc0 con 0x7f2e8406bb40 2024-05-08T05:45:40.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:40.313+0000 7f2e88c00700 1 --2- 172.21.15.82:0/65184747 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2e6c0b2880 0x7f2e6c0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:45:40.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:40.313+0000 7f2e88c00700 1 --2- 172.21.15.82:0/65184747 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2e6c0b2880 0x7f2e6c0b4d40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2e78009750 tx=0x7f2e78009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:45:40.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:40.317+0000 7f2e81600700 1 -- 172.21.15.82:0/65184747 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2e70013030 con 0x7f2e8406bb40 2024-05-08T05:45:40.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:40.622+0000 7f2e8b600700 1 -- 172.21.15.82:0/65184747 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2e841a8b30 con 0x7f2e8406bb40 2024-05-08T05:45:40.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:40.623+0000 7f2e81600700 1 -- 172.21.15.82:0/65184747 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10497 (secure 0 0 0) 0x7f2e70022e50 con 0x7f2e8406bb40 2024-05-08T05:45:40.624 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:45:40.624 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14364,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3876883250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3876883250},{"type":"v1","addr":"172.21.15.82:6835","nonce":3876883250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1965070586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1965070586},{"type":"v1","addr":"172.21.15.82:6837","nonce":1965070586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14397,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6839/1890720973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1890720973},{"type":"v1","addr":"172.21.15.82:6839","nonce":1890720973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14409,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6841/2957083305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":2957083305},{"type":"v1","addr":"172.21.15.82:6841","nonce":2957083305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24425,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/3827691638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3827691638},{"type":"v1","addr":"172.21.15.134:6833","nonce":3827691638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24430,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/3625067797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3625067797},{"type":"v1","addr":"172.21.15.151:6833","nonce":3625067797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24455,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/4074163402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4074163402},{"type":"v1","addr":"172.21.15.134:6835","nonce":4074163402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24467,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/2212411710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2212411710},{"type":"v1","addr":"172.21.15.134:6837","nonce":2212411710}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24475,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2093655929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2093655929},{"type":"v1","addr":"172.21.15.151:6835","nonce":2093655929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24487,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/4192404464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":4192404464},{"type":"v1","addr":"172.21.15.151:6837","nonce":4192404464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24505,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6839/2963754236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":2963754236},{"type":"v1","addr":"172.21.15.151:6839","nonce":2963754236}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24506,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6839/1145270893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1145270893},{"type":"v1","addr":"172.21.15.134:6839","nonce":1145270893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-05-08T05:45:40.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:40.625+0000 7f2e8b600700 1 -- 172.21.15.82:0/65184747 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2e6c0b2880 msgr2=0x7f2e6c0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:45:40.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:40.625+0000 7f2e8b600700 1 --2- 172.21.15.82:0/65184747 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2e6c0b2880 0x7f2e6c0b4d40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2e78009750 tx=0x7f2e78009310 comp rx=0 tx=0).stop 2024-05-08T05:45:40.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:40.625+0000 7f2e8b600700 1 -- 172.21.15.82:0/65184747 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e8406bb40 msgr2=0x7f2e8419c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:45:40.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:40.625+0000 7f2e8b600700 1 --2- 172.21.15.82:0/65184747 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e8406bb40 0x7f2e8419c320 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2e70009230 tx=0x7f2e7000fa70 comp rx=0 tx=0).stop 2024-05-08T05:45:40.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:40.625+0000 7f2e8b600700 1 -- 172.21.15.82:0/65184747 shutdown_connections 2024-05-08T05:45:40.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:40.625+0000 7f2e8b600700 1 --2- 172.21.15.82:0/65184747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2e84109510 0x7f2e841a06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:40.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:40.625+0000 7f2e8b600700 1 --2- 172.21.15.82:0/65184747 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2e6c0b2880 0x7f2e6c0b4d40 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:40.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:40.625+0000 7f2e8b600700 1 --2- 172.21.15.82:0/65184747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2e8406b180 0x7f2e8419bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:40.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:40.625+0000 7f2e8b600700 1 --2- 172.21.15.82:0/65184747 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e8406bb40 0x7f2e8419c320 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:40.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:40.625+0000 7f2e8b600700 1 -- 172.21.15.82:0/65184747 >> 172.21.15.82:0/65184747 conn(0x7f2e84079350 msgr2=0x7f2e8410e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:45:40.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:40.626+0000 7f2e8b600700 1 -- 172.21.15.82:0/65184747 shutdown_connections 2024-05-08T05:45:40.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:40.626+0000 7f2e8b600700 1 -- 172.21.15.82:0/65184747 wait complete. 2024-05-08T05:45:40.627 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 13 2024-05-08T05:45:41.627 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:41 smithi082 ceph-mon[30098]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:41.627 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:41 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:41.627 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:41 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:41.627 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:41 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:41.627 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:41 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:41.627 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:41 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/65184747' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:45:41.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:41 smithi151 ceph-mon[34815]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:41.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:41 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:41.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:41 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:41.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:41 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:41.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:41 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:41.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:41 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/65184747' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:45:41.894 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-05-08T05:45:42.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:41 smithi134 ceph-mon[34132]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:42.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:41 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:42.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:41 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:42.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:41 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:42.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:41 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:42.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:41 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/65184747' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:45:42.331 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:45:43.802 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:43 smithi134 ceph-mon[34132]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:43.802 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:43 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:43.803 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:43 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:43.803 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:43 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:45:43.803 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:43 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:45:43.803 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:43 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:43.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:43 smithi151 ceph-mon[34815]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:43.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:43 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:43.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:43 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:43.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:43 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:45:43.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:43 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:45:43.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:43 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:43.967 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:43 smithi082 ceph-mon[30098]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:43.968 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:43 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:43.968 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:43 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:43.968 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:43 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:45:43.968 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:43 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:45:43.968 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:43 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:45:44.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:44.472+0000 7fdbb6800700 1 -- 172.21.15.82:0/2589487402 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdbb0108850 msgr2=0x7fdbb01103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:45:44.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:44.472+0000 7fdbb6800700 1 --2- 172.21.15.82:0/2589487402 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdbb0108850 0x7fdbb01103d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdba8009f90 tx=0x7fdba800b330 comp rx=0 tx=0).stop 2024-05-08T05:45:44.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:44.473+0000 7fdbb6800700 1 -- 172.21.15.82:0/2589487402 shutdown_connections 2024-05-08T05:45:44.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:44.473+0000 7fdbb6800700 1 --2- 172.21.15.82:0/2589487402 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbb0103750 0x7fdbb0103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:44.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:44.473+0000 7fdbb6800700 1 --2- 172.21.15.82:0/2589487402 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdbb0108850 0x7fdbb01103d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:44.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:44.473+0000 7fdbb6800700 1 --2- 172.21.15.82:0/2589487402 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbb0104100 0x7fdbb0108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:44.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:44.473+0000 7fdbb6800700 1 -- 172.21.15.82:0/2589487402 >> 172.21.15.82:0/2589487402 conn(0x7fdbb007a600 msgr2=0x7fdbb007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:45:44.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:44.473+0000 7fdbb6800700 1 -- 172.21.15.82:0/2589487402 shutdown_connections 2024-05-08T05:45:44.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:44.473+0000 7fdbb6800700 1 -- 172.21.15.82:0/2589487402 wait complete. 2024-05-08T05:45:44.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:44.474+0000 7fdbb6800700 1 Processor -- start 2024-05-08T05:45:44.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:44.474+0000 7fdbb6800700 1 -- start start 2024-05-08T05:45:44.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:44.474+0000 7fdbb6800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdbb0103750 0x7fdbb00757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:45:44.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:44.474+0000 7fdbb6800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbb0104100 0x7fdbb0075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:45:44.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:44.474+0000 7fdbb6800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbb0108850 0x7fdbb0076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:45:44.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:44.474+0000 7fdbb6800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdbb0113620 con 0x7fdbb0108850 2024-05-08T05:45:44.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:44.474+0000 7fdbb6800700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdbb01134a0 con 0x7fdbb0104100 2024-05-08T05:45:44.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:44.474+0000 7fdbb6800700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fdbb01137a0 con 0x7fdbb0103750 2024-05-08T05:45:44.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:44.475+0000 7fdbafe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbb0108850 0x7fdbb0076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:45:44.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:44.475+0000 7fdbafe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbb0108850 0x7fdbb0076220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59554/0 (socket says 172.21.15.82:59554) 2024-05-08T05:45:44.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:44.475+0000 7fdbafe00700 1 -- 172.21.15.82:0/1328228035 learned_addr learned my addr 172.21.15.82:0/1328228035 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:45:44.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:44.475+0000 7fdbaf400700 1 --2- 172.21.15.82:0/1328228035 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdbb0103750 0x7fdbb00757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:45:44.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:44.475+0000 7fdbaea00700 1 --2- 172.21.15.82:0/1328228035 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbb0104100 0x7fdbb0075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:45:44.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:44.475+0000 7fdbafe00700 1 -- 172.21.15.82:0/1328228035 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdbb0103750 msgr2=0x7fdbb00757a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:45:44.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:44.475+0000 7fdbafe00700 1 --2- 172.21.15.82:0/1328228035 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdbb0103750 0x7fdbb00757a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:44.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:44.475+0000 7fdbafe00700 1 -- 172.21.15.82:0/1328228035 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbb0104100 msgr2=0x7fdbb0075ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:45:44.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:44.475+0000 7fdbafe00700 1 --2- 172.21.15.82:0/1328228035 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbb0104100 0x7fdbb0075ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:44.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:44.475+0000 7fdbafe00700 1 -- 172.21.15.82:0/1328228035 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbb01a7fb0 con 0x7fdbb0108850 2024-05-08T05:45:44.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:44.476+0000 7fdbafe00700 1 --2- 172.21.15.82:0/1328228035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbb0108850 0x7fdbb0076220 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdba8009790 tx=0x7fdba800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:45:44.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:44.476+0000 7fdba7e00700 1 -- 172.21.15.82:0/1328228035 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdba8021070 con 0x7fdbb0108850 2024-05-08T05:45:44.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:44.476+0000 7fdbb6800700 1 -- 172.21.15.82:0/1328228035 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbb01a8240 con 0x7fdbb0108850 2024-05-08T05:45:44.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:44.476+0000 7fdba7e00700 1 -- 172.21.15.82:0/1328228035 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdba800ce50 con 0x7fdbb0108850 2024-05-08T05:45:44.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:44.476+0000 7fdba7e00700 1 -- 172.21.15.82:0/1328228035 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdba8005040 con 0x7fdbb0108850 2024-05-08T05:45:44.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:44.476+0000 7fdbb6800700 1 -- 172.21.15.82:0/1328228035 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbb01a86a0 con 0x7fdbb0108850 2024-05-08T05:45:44.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:44.477+0000 7fdbb6800700 1 -- 172.21.15.82:0/1328228035 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbb006a190 con 0x7fdbb0108850 2024-05-08T05:45:44.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:44.479+0000 7fdba7e00700 1 -- 172.21.15.82:0/1328228035 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fdba8024070 con 0x7fdbb0108850 2024-05-08T05:45:44.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:44.482+0000 7fdba7e00700 1 --2- 172.21.15.82:0/1328228035 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fdb940b2880 0x7fdb940b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:45:44.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:44.482+0000 7fdba7e00700 1 -- 172.21.15.82:0/1328228035 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fdba80e3060 con 0x7fdbb0108850 2024-05-08T05:45:44.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:44.482+0000 7fdbaf400700 1 --2- 172.21.15.82:0/1328228035 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fdb940b2880 0x7fdb940b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:45:44.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:44.483+0000 7fdbaf400700 1 --2- 172.21.15.82:0/1328228035 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fdb940b2880 0x7fdb940b4d40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdba0009c60 tx=0x7fdba0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:45:44.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:44.485+0000 7fdba7e00700 1 -- 172.21.15.82:0/1328228035 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fdba80ab210 con 0x7fdbb0108850 2024-05-08T05:45:44.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:44.732+0000 7fdbb6800700 1 -- 172.21.15.82:0/1328228035 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fdbb002e6d0 con 0x7fdbb0108850 2024-05-08T05:45:44.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:44.733+0000 7fdba7e00700 1 -- 172.21.15.82:0/1328228035 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v73) ==== 84+0+65 (secure 0 0 0) 0x7fdba80b3070 con 0x7fdbb0108850 2024-05-08T05:45:44.734 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:45:44.734 INFO:teuthology.orchestra.run.smithi082.stdout:[ 2024-05-08T05:45:44.734 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T05:45:44.734 INFO:teuthology.orchestra.run.smithi082.stdout: "poolnum": 1, 2024-05-08T05:45:44.734 INFO:teuthology.orchestra.run.smithi082.stdout: "poolname": ".mgr" 2024-05-08T05:45:44.734 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T05:45:44.734 INFO:teuthology.orchestra.run.smithi082.stdout:] 2024-05-08T05:45:44.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:44.736+0000 7fdbb6800700 1 -- 172.21.15.82:0/1328228035 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fdb940b2880 msgr2=0x7fdb940b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:45:44.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:44.736+0000 7fdbb6800700 1 --2- 172.21.15.82:0/1328228035 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fdb940b2880 0x7fdb940b4d40 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fdba0009c60 tx=0x7fdba0009260 comp rx=0 tx=0).stop 2024-05-08T05:45:44.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:44.736+0000 7fdbb6800700 1 -- 172.21.15.82:0/1328228035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbb0108850 msgr2=0x7fdbb0076220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:45:44.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:44.736+0000 7fdbb6800700 1 --2- 172.21.15.82:0/1328228035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbb0108850 0x7fdbb0076220 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdba8009790 tx=0x7fdba800cc30 comp rx=0 tx=0).stop 2024-05-08T05:45:44.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:44.736+0000 7fdbb6800700 1 -- 172.21.15.82:0/1328228035 shutdown_connections 2024-05-08T05:45:44.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:44.736+0000 7fdbb6800700 1 --2- 172.21.15.82:0/1328228035 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fdb940b2880 0x7fdb940b4d40 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:44.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:44.736+0000 7fdbb6800700 1 --2- 172.21.15.82:0/1328228035 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbb0108850 0x7fdbb0076220 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:44.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:44.736+0000 7fdbb6800700 1 --2- 172.21.15.82:0/1328228035 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdbb0103750 0x7fdbb00757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:44.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:44.736+0000 7fdbb6800700 1 --2- 172.21.15.82:0/1328228035 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbb0104100 0x7fdbb0075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:44.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:44.736+0000 7fdbb6800700 1 -- 172.21.15.82:0/1328228035 >> 172.21.15.82:0/1328228035 conn(0x7fdbb007a600 msgr2=0x7fdbb0101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:45:44.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:44.737+0000 7fdbb6800700 1 -- 172.21.15.82:0/1328228035 shutdown_connections 2024-05-08T05:45:44.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:44.737+0000 7fdbb6800700 1 -- 172.21.15.82:0/1328228035 wait complete. 2024-05-08T05:45:45.762 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-08T05:45:45.763 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-08T05:45:45.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:45 smithi082 ceph-mon[30098]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:45.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:45 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/1328228035' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-08T05:45:46.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:45 smithi134 ceph-mon[34132]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:46.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:45 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/1328228035' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-08T05:45:46.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:45 smithi151 ceph-mon[34815]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:46.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:45 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/1328228035' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-08T05:45:46.200 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:45:47.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:47 smithi082 ceph-mon[30098]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:48.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:47 smithi134 ceph-mon[34132]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:48.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:47 smithi151 ceph-mon[34815]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:48.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:48.468+0000 7ffa1d800700 1 -- 172.21.15.82:0/2244904832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa18106050 msgr2=0x7ffa18112560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:45:48.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:48.468+0000 7ffa1d800700 1 --2- 172.21.15.82:0/2244904832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa18106050 0x7ffa18112560 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ffa1000b0a0 tx=0x7ffa1000b3b0 comp rx=0 tx=0).stop 2024-05-08T05:45:48.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:48.468+0000 7ffa1d800700 1 -- 172.21.15.82:0/2244904832 shutdown_connections 2024-05-08T05:45:48.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:48.468+0000 7ffa1d800700 1 --2- 172.21.15.82:0/2244904832 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa1810b690 0x7ffa1810ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:48.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:48.468+0000 7ffa1d800700 1 --2- 172.21.15.82:0/2244904832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa18106050 0x7ffa18112560 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:48.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:48.468+0000 7ffa1d800700 1 --2- 172.21.15.82:0/2244904832 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa18105690 0x7ffa18105b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:48.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:48.468+0000 7ffa1d800700 1 -- 172.21.15.82:0/2244904832 >> 172.21.15.82:0/2244904832 conn(0x7ffa18101180 msgr2=0x7ffa181035a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:45:48.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:48.468+0000 7ffa1d800700 1 -- 172.21.15.82:0/2244904832 shutdown_connections 2024-05-08T05:45:48.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:48.469+0000 7ffa1d800700 1 -- 172.21.15.82:0/2244904832 wait complete. 2024-05-08T05:45:48.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:48.470+0000 7ffa1d800700 1 Processor -- start 2024-05-08T05:45:48.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:48.470+0000 7ffa1d800700 1 -- start start 2024-05-08T05:45:48.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:48.470+0000 7ffa1d800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa18105690 0x7ffa181a1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:45:48.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:48.470+0000 7ffa1d800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa18106050 0x7ffa181a1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:45:48.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:48.470+0000 7ffa1d800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa1810b690 0x7ffa1819bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:45:48.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:48.470+0000 7ffa1d800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ffa181158d0 con 0x7ffa18106050 2024-05-08T05:45:48.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:48.470+0000 7ffa1d800700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ffa18115750 con 0x7ffa1810b690 2024-05-08T05:45:48.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:48.470+0000 7ffa1d800700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ffa18115a50 con 0x7ffa18105690 2024-05-08T05:45:48.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:48.470+0000 7ffa0fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa18106050 0x7ffa181a1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:45:48.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:48.470+0000 7ffa16a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa18105690 0x7ffa181a1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:45:48.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:48.470+0000 7ffa16a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa18105690 0x7ffa181a1a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:59838/0 (socket says 172.21.15.82:59838) 2024-05-08T05:45:48.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:48.470+0000 7ffa16a00700 1 -- 172.21.15.82:0/2892477950 learned_addr learned my addr 172.21.15.82:0/2892477950 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:45:48.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:48.470+0000 7ffa0fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa18106050 0x7ffa181a1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59580/0 (socket says 172.21.15.82:59580) 2024-05-08T05:45:48.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:48.471+0000 7ffa17400700 1 --2- 172.21.15.82:0/2892477950 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa1810b690 0x7ffa1819bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:45:48.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:48.471+0000 7ffa16a00700 1 -- 172.21.15.82:0/2892477950 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa1810b690 msgr2=0x7ffa1819bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:45:48.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:48.471+0000 7ffa16a00700 1 --2- 172.21.15.82:0/2892477950 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa1810b690 0x7ffa1819bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:48.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:48.471+0000 7ffa16a00700 1 -- 172.21.15.82:0/2892477950 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa18106050 msgr2=0x7ffa181a1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:45:48.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:48.471+0000 7ffa16a00700 1 --2- 172.21.15.82:0/2892477950 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa18106050 0x7ffa181a1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:48.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:48.471+0000 7ffa16a00700 1 -- 172.21.15.82:0/2892477950 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa1819c410 con 0x7ffa18105690 2024-05-08T05:45:48.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:48.471+0000 7ffa17400700 1 --2- 172.21.15.82:0/2892477950 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa1810b690 0x7ffa1819bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:45:48.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:48.471+0000 7ffa0fe00700 1 --2- 172.21.15.82:0/2892477950 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa18106050 0x7ffa181a1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:45:48.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:48.471+0000 7ffa16a00700 1 --2- 172.21.15.82:0/2892477950 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa18105690 0x7ffa181a1a60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ffa0800e9a0 tx=0x7ffa0800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:45:48.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:48.472+0000 7ffa0f400700 1 -- 172.21.15.82:0/2892477950 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0800ca10 con 0x7ffa18105690 2024-05-08T05:45:48.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:48.472+0000 7ffa1d800700 1 -- 172.21.15.82:0/2892477950 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa1819c700 con 0x7ffa18105690 2024-05-08T05:45:48.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:48.472+0000 7ffa0f400700 1 -- 172.21.15.82:0/2892477950 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa0800cbb0 con 0x7ffa18105690 2024-05-08T05:45:48.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:48.472+0000 7ffa0f400700 1 -- 172.21.15.82:0/2892477950 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa08018680 con 0x7ffa18105690 2024-05-08T05:45:48.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:48.472+0000 7ffa1d800700 1 -- 172.21.15.82:0/2892477950 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa181a89e0 con 0x7ffa18105690 2024-05-08T05:45:48.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:48.473+0000 7ffa1d800700 1 -- 172.21.15.82:0/2892477950 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa18106dd0 con 0x7ffa18105690 2024-05-08T05:45:48.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:48.475+0000 7ffa0f400700 1 -- 172.21.15.82:0/2892477950 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7ffa08010430 con 0x7ffa18105690 2024-05-08T05:45:48.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:48.477+0000 7ffa0f400700 1 --2- 172.21.15.82:0/2892477950 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff9fc0b2880 0x7ff9fc0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:45:48.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:48.477+0000 7ffa0f400700 1 -- 172.21.15.82:0/2892477950 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7ffa080e2220 con 0x7ffa18105690 2024-05-08T05:45:48.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:48.477+0000 7ffa0fe00700 1 --2- 172.21.15.82:0/2892477950 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff9fc0b2880 0x7ff9fc0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:45:48.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:48.478+0000 7ffa0fe00700 1 --2- 172.21.15.82:0/2892477950 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff9fc0b2880 0x7ff9fc0b4d40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ffa1819d280 tx=0x7ffa00009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:45:48.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:48.479+0000 7ffa0f400700 1 -- 172.21.15.82:0/2892477950 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ffa080aa340 con 0x7ffa18105690 2024-05-08T05:45:48.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:48.712+0000 7ffa1d800700 1 -- 172.21.15.82:0/2892477950 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7ffa1819cff0 con 0x7ffa18105690 2024-05-08T05:45:49.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:49.727+0000 7ffa0f400700 1 -- 172.21.15.82:0/2892477950 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v74) ==== 138+0+0 (secure 0 0 0) 0x7ffa080b23c0 con 0x7ffa18105690 2024-05-08T05:45:49.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:49.734+0000 7ffa1d800700 1 -- 172.21.15.82:0/2892477950 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff9fc0b2880 msgr2=0x7ff9fc0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:45:49.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:49.734+0000 7ffa1d800700 1 --2- 172.21.15.82:0/2892477950 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff9fc0b2880 0x7ff9fc0b4d40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ffa1819d280 tx=0x7ffa00009260 comp rx=0 tx=0).stop 2024-05-08T05:45:49.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:49.734+0000 7ffa1d800700 1 -- 172.21.15.82:0/2892477950 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa18105690 msgr2=0x7ffa181a1a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:45:49.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:49.734+0000 7ffa1d800700 1 --2- 172.21.15.82:0/2892477950 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa18105690 0x7ffa181a1a60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ffa0800e9a0 tx=0x7ffa0800ecb0 comp rx=0 tx=0).stop 2024-05-08T05:45:49.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:49.735+0000 7ffa1d800700 1 -- 172.21.15.82:0/2892477950 shutdown_connections 2024-05-08T05:45:49.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:49.735+0000 7ffa1d800700 1 --2- 172.21.15.82:0/2892477950 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa1810b690 0x7ffa1819bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:49.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:49.735+0000 7ffa1d800700 1 --2- 172.21.15.82:0/2892477950 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff9fc0b2880 0x7ff9fc0b4d40 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:49.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:49.735+0000 7ffa1d800700 1 --2- 172.21.15.82:0/2892477950 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa18105690 0x7ffa181a1a60 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:49.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:49.735+0000 7ffa1d800700 1 --2- 172.21.15.82:0/2892477950 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa18106050 0x7ffa181a1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:49.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:49.735+0000 7ffa1d800700 1 -- 172.21.15.82:0/2892477950 >> 172.21.15.82:0/2892477950 conn(0x7ffa18101180 msgr2=0x7ffa18101830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:45:49.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:49.736+0000 7ffa1d800700 1 -- 172.21.15.82:0/2892477950 shutdown_connections 2024-05-08T05:45:49.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:49.736+0000 7ffa1d800700 1 -- 172.21.15.82:0/2892477950 wait complete. 2024-05-08T05:45:49.741 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' created 2024-05-08T05:45:49.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:49 smithi082 ceph-mon[30098]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:49.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:49 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/2892477950' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-08T05:45:49.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:49 smithi082 ceph-mon[30098]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-08T05:45:50.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:49 smithi134 ceph-mon[34132]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:50.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:49 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/2892477950' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-08T05:45:50.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:49 smithi134 ceph-mon[34132]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-08T05:45:50.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:49 smithi151 ceph-mon[34815]: pgmap v305: 1 pgs: 1 active+clean; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:50.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:49 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/2892477950' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-08T05:45:50.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:49 smithi151 ceph-mon[34815]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-08T05:45:50.638 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-05-08T05:45:50.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:50 smithi082 ceph-mon[30098]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-08T05:45:50.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:50 smithi082 ceph-mon[30098]: osdmap e74: 12 total, 12 up, 12 in 2024-05-08T05:45:51.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:50 smithi134 ceph-mon[34132]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-08T05:45:51.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:50 smithi134 ceph-mon[34132]: osdmap e74: 12 total, 12 up, 12 in 2024-05-08T05:45:51.101 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:45:51.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:50 smithi151 ceph-mon[34815]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-08T05:45:51.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:50 smithi151 ceph-mon[34815]: osdmap e74: 12 total, 12 up, 12 in 2024-05-08T05:45:51.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:51 smithi082 ceph-mon[30098]: pgmap v307: 33 pgs: 11 creating+peering, 1 active+clean, 21 unknown; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:51.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:51 smithi082 ceph-mon[30098]: osdmap e75: 12 total, 12 up, 12 in 2024-05-08T05:45:51.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:51 smithi082 ceph-mon[30098]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-08T05:45:51.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:51 smithi082 ceph-mon[30098]: osdmap e76: 12 total, 12 up, 12 in 2024-05-08T05:45:52.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:51 smithi134 ceph-mon[34132]: pgmap v307: 33 pgs: 11 creating+peering, 1 active+clean, 21 unknown; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:52.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:51 smithi134 ceph-mon[34132]: osdmap e75: 12 total, 12 up, 12 in 2024-05-08T05:45:52.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:51 smithi134 ceph-mon[34132]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-08T05:45:52.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:51 smithi134 ceph-mon[34132]: osdmap e76: 12 total, 12 up, 12 in 2024-05-08T05:45:52.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:51 smithi151 ceph-mon[34815]: pgmap v307: 33 pgs: 11 creating+peering, 1 active+clean, 21 unknown; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:52.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:51 smithi151 ceph-mon[34815]: osdmap e75: 12 total, 12 up, 12 in 2024-05-08T05:45:52.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:51 smithi151 ceph-mon[34815]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-08T05:45:52.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:51 smithi151 ceph-mon[34815]: osdmap e76: 12 total, 12 up, 12 in 2024-05-08T05:45:53.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:53.311+0000 7f60cf200700 1 -- 172.21.15.82:0/3416216156 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60c81095d0 msgr2=0x7f60c81099b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:45:53.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:53.311+0000 7f60cf200700 1 --2- 172.21.15.82:0/3416216156 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60c81095d0 0x7f60c81099b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f60b80099c0 tx=0x7f60b8009cd0 comp rx=0 tx=0).stop 2024-05-08T05:45:53.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:53.311+0000 7f60cf200700 1 -- 172.21.15.82:0/3416216156 shutdown_connections 2024-05-08T05:45:53.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:53.311+0000 7f60cf200700 1 --2- 172.21.15.82:0/3416216156 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60c8103f10 0x7f60c81103a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:53.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:53.311+0000 7f60cf200700 1 --2- 172.21.15.82:0/3416216156 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60c81095d0 0x7f60c81099b0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:53.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:53.311+0000 7f60cf200700 1 --2- 172.21.15.82:0/3416216156 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f60c8103550 0x7f60c81039d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:53.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:53.311+0000 7f60cf200700 1 -- 172.21.15.82:0/3416216156 >> 172.21.15.82:0/3416216156 conn(0x7f60c807a5f0 msgr2=0x7f60c807aa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:45:53.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:53.311+0000 7f60cf200700 1 -- 172.21.15.82:0/3416216156 shutdown_connections 2024-05-08T05:45:53.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:53.311+0000 7f60cf200700 1 -- 172.21.15.82:0/3416216156 wait complete. 2024-05-08T05:45:53.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:53.312+0000 7f60cf200700 1 Processor -- start 2024-05-08T05:45:53.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:53.312+0000 7f60cf200700 1 -- start start 2024-05-08T05:45:53.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:53.313+0000 7f60cf200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60c8103550 0x7f60c80757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:45:53.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:53.313+0000 7f60cf200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60c8103f10 0x7f60c8075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:45:53.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:53.313+0000 7f60cf200700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f60c81095d0 0x7f60c8076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:45:53.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:53.313+0000 7f60cf200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f60c8113700 con 0x7f60c8103550 2024-05-08T05:45:53.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:53.313+0000 7f60cf200700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f60c8113580 con 0x7f60c8103f10 2024-05-08T05:45:53.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:53.313+0000 7f60cf200700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f60c8113880 con 0x7f60c81095d0 2024-05-08T05:45:53.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:53.313+0000 7f60c7e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60c8103550 0x7f60c80757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:45:53.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:53.313+0000 7f60c7e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60c8103550 0x7f60c80757a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36778/0 (socket says 172.21.15.82:36778) 2024-05-08T05:45:53.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:53.313+0000 7f60bfe00700 1 --2- 172.21.15.82:0/1061503115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60c8103f10 0x7f60c8075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:45:53.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:53.313+0000 7f60c7e00700 1 -- 172.21.15.82:0/1061503115 learned_addr learned my addr 172.21.15.82:0/1061503115 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:45:53.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:53.314+0000 7f60cd200700 1 --2- 172.21.15.82:0/1061503115 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f60c81095d0 0x7f60c8076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:45:53.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:53.314+0000 7f60bfe00700 1 -- 172.21.15.82:0/1061503115 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f60c81095d0 msgr2=0x7f60c8076220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:45:53.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:53.314+0000 7f60bfe00700 1 --2- 172.21.15.82:0/1061503115 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f60c81095d0 0x7f60c8076220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:53.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:53.314+0000 7f60bfe00700 1 -- 172.21.15.82:0/1061503115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60c8103550 msgr2=0x7f60c80757a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:45:53.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:53.314+0000 7f60bfe00700 1 --2- 172.21.15.82:0/1061503115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60c8103550 0x7f60c80757a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:53.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:53.314+0000 7f60bfe00700 1 -- 172.21.15.82:0/1061503115 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60c81a8090 con 0x7f60c8103f10 2024-05-08T05:45:53.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:53.314+0000 7f60bfe00700 1 --2- 172.21.15.82:0/1061503115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60c8103f10 0x7f60c8075ce0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f60b000d950 tx=0x7f60b000dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:45:53.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:53.314+0000 7f60c5600700 1 -- 172.21.15.82:0/1061503115 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b0016070 con 0x7f60c8103f10 2024-05-08T05:45:53.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:53.315+0000 7f60cf200700 1 -- 172.21.15.82:0/1061503115 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60c81a8380 con 0x7f60c8103f10 2024-05-08T05:45:53.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:53.315+0000 7f60c5600700 1 -- 172.21.15.82:0/1061503115 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f60b000fd40 con 0x7f60c8103f10 2024-05-08T05:45:53.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:53.315+0000 7f60c5600700 1 -- 172.21.15.82:0/1061503115 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b000e3b0 con 0x7f60c8103f10 2024-05-08T05:45:53.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:53.315+0000 7f60cf200700 1 -- 172.21.15.82:0/1061503115 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60c81a88c0 con 0x7f60c8103f10 2024-05-08T05:45:53.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:53.316+0000 7f60cf200700 1 -- 172.21.15.82:0/1061503115 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60c8104c40 con 0x7f60c8103f10 2024-05-08T05:45:53.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:53.318+0000 7f60c5600700 1 -- 172.21.15.82:0/1061503115 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f60b0019070 con 0x7f60c8103f10 2024-05-08T05:45:53.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:53.320+0000 7f60c5600700 1 --2- 172.21.15.82:0/1061503115 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f60ac0b2880 0x7f60ac0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:45:53.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:53.320+0000 7f60c5600700 1 -- 172.21.15.82:0/1061503115 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7497+0+0 (secure 0 0 0) 0x7f60b00e1b00 con 0x7f60c8103f10 2024-05-08T05:45:53.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:53.320+0000 7f60c7e00700 1 --2- 172.21.15.82:0/1061503115 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f60ac0b2880 0x7f60ac0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:45:53.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:53.320+0000 7f60c7e00700 1 --2- 172.21.15.82:0/1061503115 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f60ac0b2880 0x7f60ac0b4d40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f60b8009990 tx=0x7f60b8005ab0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:45:53.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:53.322+0000 7f60c5600700 1 -- 172.21.15.82:0/1061503115 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f60b00a9ab0 con 0x7f60c8103f10 2024-05-08T05:45:53.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:53.558+0000 7f60cf200700 1 -- 172.21.15.82:0/1061503115 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f60c8076c80 con 0x7f60c8103f10 2024-05-08T05:45:53.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:53.759+0000 7f60c5600700 1 -- 172.21.15.82:0/1061503115 <== mon.2 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v77) ==== 170+0+0 (secure 0 0 0) 0x7f60b00a93b0 con 0x7f60c8103f10 2024-05-08T05:45:53.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:53.767+0000 7f60cf200700 1 -- 172.21.15.82:0/1061503115 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f60ac0b2880 msgr2=0x7f60ac0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:45:53.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:53.767+0000 7f60cf200700 1 --2- 172.21.15.82:0/1061503115 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f60ac0b2880 0x7f60ac0b4d40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f60b8009990 tx=0x7f60b8005ab0 comp rx=0 tx=0).stop 2024-05-08T05:45:53.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:53.767+0000 7f60cf200700 1 -- 172.21.15.82:0/1061503115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60c8103f10 msgr2=0x7f60c8075ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:45:53.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:53.767+0000 7f60cf200700 1 --2- 172.21.15.82:0/1061503115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60c8103f10 0x7f60c8075ce0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f60b000d950 tx=0x7f60b000dc60 comp rx=0 tx=0).stop 2024-05-08T05:45:53.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:53.767+0000 7f60cf200700 1 -- 172.21.15.82:0/1061503115 shutdown_connections 2024-05-08T05:45:53.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:53.767+0000 7f60cf200700 1 --2- 172.21.15.82:0/1061503115 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f60ac0b2880 0x7f60ac0b4d40 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:53.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:53.767+0000 7f60cf200700 1 --2- 172.21.15.82:0/1061503115 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f60c81095d0 0x7f60c8076220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:53.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:53.767+0000 7f60cf200700 1 --2- 172.21.15.82:0/1061503115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f60c8103550 0x7f60c80757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:53.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:53.767+0000 7f60cf200700 1 --2- 172.21.15.82:0/1061503115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60c8103f10 0x7f60c8075ce0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:53.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:53.767+0000 7f60cf200700 1 -- 172.21.15.82:0/1061503115 >> 172.21.15.82:0/1061503115 conn(0x7f60c807a5f0 msgr2=0x7f60c81021b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:45:53.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:53.767+0000 7f60cf200700 1 -- 172.21.15.82:0/1061503115 shutdown_connections 2024-05-08T05:45:53.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:53.767+0000 7f60cf200700 1 -- 172.21.15.82:0/1061503115 wait complete. 2024-05-08T05:45:53.772 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' created 2024-05-08T05:45:54.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:53 smithi151 ceph-mon[34815]: pgmap v310: 33 pgs: 14 creating+peering, 4 active+clean, 15 unknown; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:54.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:53 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/1061503115' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-08T05:45:54.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:53 smithi151 ceph-mon[34815]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-08T05:45:54.166 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:53 smithi082 ceph-mon[30098]: pgmap v310: 33 pgs: 14 creating+peering, 4 active+clean, 15 unknown; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:54.167 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:53 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/1061503115' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-08T05:45:54.167 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:53 smithi082 ceph-mon[30098]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-08T05:45:54.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:53 smithi134 ceph-mon[34132]: pgmap v310: 33 pgs: 14 creating+peering, 4 active+clean, 15 unknown; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:54.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:53 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/1061503115' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-08T05:45:54.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:53 smithi134 ceph-mon[34132]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-08T05:45:54.626 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-08T05:45:54.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:54 smithi082 ceph-mon[30098]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-08T05:45:54.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:54 smithi082 ceph-mon[30098]: osdmap e77: 12 total, 12 up, 12 in 2024-05-08T05:45:54.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:54 smithi082 ceph-mon[30098]: osdmap e78: 12 total, 12 up, 12 in 2024-05-08T05:45:55.079 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:45:55.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:54 smithi151 ceph-mon[34815]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-08T05:45:55.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:54 smithi151 ceph-mon[34815]: osdmap e77: 12 total, 12 up, 12 in 2024-05-08T05:45:55.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:54 smithi151 ceph-mon[34815]: osdmap e78: 12 total, 12 up, 12 in 2024-05-08T05:45:55.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:54 smithi134 ceph-mon[34132]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-08T05:45:55.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:54 smithi134 ceph-mon[34132]: osdmap e77: 12 total, 12 up, 12 in 2024-05-08T05:45:55.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:54 smithi134 ceph-mon[34132]: osdmap e78: 12 total, 12 up, 12 in 2024-05-08T05:45:56.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:55 smithi151 ceph-mon[34815]: pgmap v312: 97 pgs: 20 creating+peering, 11 active+clean, 66 unknown; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:56.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:55 smithi151 ceph-mon[34815]: osdmap e79: 12 total, 12 up, 12 in 2024-05-08T05:45:56.143 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:55 smithi082 ceph-mon[30098]: pgmap v312: 97 pgs: 20 creating+peering, 11 active+clean, 66 unknown; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:56.143 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:55 smithi082 ceph-mon[30098]: osdmap e79: 12 total, 12 up, 12 in 2024-05-08T05:45:56.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:55 smithi134 ceph-mon[34132]: pgmap v312: 97 pgs: 20 creating+peering, 11 active+clean, 66 unknown; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:56.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:55 smithi134 ceph-mon[34132]: osdmap e79: 12 total, 12 up, 12 in 2024-05-08T05:45:57.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:57.354+0000 7f4abd400700 1 -- 172.21.15.82:0/489991961 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ab80756d0 msgr2=0x7f4ab8075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:45:57.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:57.354+0000 7f4abd400700 1 --2- 172.21.15.82:0/489991961 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ab80756d0 0x7f4ab8075ab0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4aa80098f0 tx=0x7f4aa8009c00 comp rx=0 tx=0).stop 2024-05-08T05:45:57.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:57.355+0000 7f4abd400700 1 -- 172.21.15.82:0/489991961 shutdown_connections 2024-05-08T05:45:57.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:57.355+0000 7f4abd400700 1 --2- 172.21.15.82:0/489991961 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ab810ff00 0x7f4ab81122f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:57.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:57.355+0000 7f4abd400700 1 --2- 172.21.15.82:0/489991961 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ab80756d0 0x7f4ab8075ab0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:57.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:57.355+0000 7f4abd400700 1 --2- 172.21.15.82:0/489991961 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ab8075ff0 0x7f4ab810f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:57.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:57.355+0000 7f4abd400700 1 -- 172.21.15.82:0/489991961 >> 172.21.15.82:0/489991961 conn(0x7f4ab807a600 msgr2=0x7f4ab807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:45:57.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:57.355+0000 7f4abd400700 1 -- 172.21.15.82:0/489991961 shutdown_connections 2024-05-08T05:45:57.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:57.355+0000 7f4abd400700 1 -- 172.21.15.82:0/489991961 wait complete. 2024-05-08T05:45:57.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:57.356+0000 7f4abd400700 1 Processor -- start 2024-05-08T05:45:57.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:57.356+0000 7f4abd400700 1 -- start start 2024-05-08T05:45:57.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:57.356+0000 7f4abd400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ab80756d0 0x7f4ab819be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:45:57.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:57.356+0000 7f4abd400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ab8075ff0 0x7f4ab819c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:45:57.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:57.356+0000 7f4abd400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ab810ff00 0x7f4ab81a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:45:57.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:57.356+0000 7f4abd400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab8115920 con 0x7f4ab8075ff0 2024-05-08T05:45:57.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:57.356+0000 7f4abd400700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab81157a0 con 0x7f4ab80756d0 2024-05-08T05:45:57.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:57.356+0000 7f4abd400700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab8115aa0 con 0x7f4ab810ff00 2024-05-08T05:45:57.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:57.357+0000 7f4ab5e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ab8075ff0 0x7f4ab819c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:45:57.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:57.357+0000 7f4ab6800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ab80756d0 0x7f4ab819be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:45:57.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:57.357+0000 7f4ab5e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ab8075ff0 0x7f4ab819c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36798/0 (socket says 172.21.15.82:36798) 2024-05-08T05:45:57.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:57.357+0000 7f4ab5e00700 1 -- 172.21.15.82:0/3836167184 learned_addr learned my addr 172.21.15.82:0/3836167184 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:45:57.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:57.357+0000 7f4ab6800700 1 -- 172.21.15.82:0/3836167184 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ab810ff00 msgr2=0x7f4ab81a06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:45:57.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:57.357+0000 7f4ab6800700 1 --2- 172.21.15.82:0/3836167184 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ab810ff00 0x7f4ab81a06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:57.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:57.357+0000 7f4ab6800700 1 -- 172.21.15.82:0/3836167184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ab8075ff0 msgr2=0x7f4ab819c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:45:57.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:57.357+0000 7f4ab6800700 1 --2- 172.21.15.82:0/3836167184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ab8075ff0 0x7f4ab819c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:57.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:57.357+0000 7f4ab6800700 1 -- 172.21.15.82:0/3836167184 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ab81a0df0 con 0x7f4ab80756d0 2024-05-08T05:45:57.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:57.357+0000 7f4ab5e00700 1 --2- 172.21.15.82:0/3836167184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ab8075ff0 0x7f4ab819c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:45:57.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:57.358+0000 7f4ab6800700 1 --2- 172.21.15.82:0/3836167184 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ab80756d0 0x7f4ab819be30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4aa800c010 tx=0x7f4aa800fa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:45:57.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:57.358+0000 7f4aaf400700 1 -- 172.21.15.82:0/3836167184 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa8005140 con 0x7f4ab80756d0 2024-05-08T05:45:57.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:57.358+0000 7f4abd400700 1 -- 172.21.15.82:0/3836167184 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ab81a1080 con 0x7f4ab80756d0 2024-05-08T05:45:57.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:57.358+0000 7f4aaf400700 1 -- 172.21.15.82:0/3836167184 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4aa800b560 con 0x7f4ab80756d0 2024-05-08T05:45:57.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:57.358+0000 7f4aaf400700 1 -- 172.21.15.82:0/3836167184 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa8003a00 con 0x7f4ab80756d0 2024-05-08T05:45:57.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:57.358+0000 7f4abd400700 1 -- 172.21.15.82:0/3836167184 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ab81a8960 con 0x7f4ab80756d0 2024-05-08T05:45:57.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:57.359+0000 7f4abd400700 1 -- 172.21.15.82:0/3836167184 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ab806a190 con 0x7f4ab80756d0 2024-05-08T05:45:57.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:57.361+0000 7f4aaf400700 1 -- 172.21.15.82:0/3836167184 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f4aa800b9a0 con 0x7f4ab80756d0 2024-05-08T05:45:57.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:57.363+0000 7f4aaf400700 1 --2- 172.21.15.82:0/3836167184 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f4a9c0b2900 0x7f4a9c0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:45:57.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:57.363+0000 7f4aaf400700 1 -- 172.21.15.82:0/3836167184 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7879+0+0 (secure 0 0 0) 0x7f4aa80e2fe0 con 0x7f4ab80756d0 2024-05-08T05:45:57.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:57.363+0000 7f4ab5e00700 1 --2- 172.21.15.82:0/3836167184 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f4a9c0b2900 0x7f4a9c0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:45:57.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:57.364+0000 7f4ab5e00700 1 --2- 172.21.15.82:0/3836167184 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f4a9c0b2900 0x7f4a9c0b4dc0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4ab8103050 tx=0x7f4aa4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:45:57.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:57.367+0000 7f4aaf400700 1 -- 172.21.15.82:0/3836167184 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4aa8013030 con 0x7f4ab80756d0 2024-05-08T05:45:57.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:57.651+0000 7f4abd400700 1 -- 172.21.15.82:0/3836167184 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f4ab802e510 con 0x7f4ab80756d0 2024-05-08T05:45:57.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:57.819+0000 7f4aaf400700 1 -- 172.21.15.82:0/3836167184 <== mon.2 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f4aa80aaec0 con 0x7f4ab80756d0 2024-05-08T05:45:57.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:57.825+0000 7f4abd400700 1 -- 172.21.15.82:0/3836167184 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f4a9c0b2900 msgr2=0x7f4a9c0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:45:57.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:57.825+0000 7f4abd400700 1 --2- 172.21.15.82:0/3836167184 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f4a9c0b2900 0x7f4a9c0b4dc0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f4ab8103050 tx=0x7f4aa4009260 comp rx=0 tx=0).stop 2024-05-08T05:45:57.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:57.825+0000 7f4abd400700 1 -- 172.21.15.82:0/3836167184 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ab80756d0 msgr2=0x7f4ab819be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:45:57.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:57.825+0000 7f4abd400700 1 --2- 172.21.15.82:0/3836167184 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ab80756d0 0x7f4ab819be30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4aa800c010 tx=0x7f4aa800fa00 comp rx=0 tx=0).stop 2024-05-08T05:45:57.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:57.825+0000 7f4abd400700 1 -- 172.21.15.82:0/3836167184 shutdown_connections 2024-05-08T05:45:57.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:57.825+0000 7f4abd400700 1 --2- 172.21.15.82:0/3836167184 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ab80756d0 0x7f4ab819be30 secure :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4aa800c010 tx=0x7f4aa800fa00 comp rx=0 tx=0).stop 2024-05-08T05:45:57.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:57.825+0000 7f4abd400700 1 --2- 172.21.15.82:0/3836167184 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f4a9c0b2900 0x7f4a9c0b4dc0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:57.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:57.825+0000 7f4abd400700 1 --2- 172.21.15.82:0/3836167184 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ab810ff00 0x7f4ab81a06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:57.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:57.825+0000 7f4abd400700 1 --2- 172.21.15.82:0/3836167184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4ab8075ff0 0x7f4ab819c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:45:57.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:57.826+0000 7f4abd400700 1 -- 172.21.15.82:0/3836167184 >> 172.21.15.82:0/3836167184 conn(0x7f4ab807a600 msgr2=0x7f4ab8100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:45:57.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:57.826+0000 7f4abd400700 1 -- 172.21.15.82:0/3836167184 shutdown_connections 2024-05-08T05:45:57.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:45:57.827+0000 7f4abd400700 1 -- 172.21.15.82:0/3836167184 wait complete. 2024-05-08T05:45:57.831 INFO:teuthology.orchestra.run.smithi082.stderr:new fs with metadata pool 2 and data pool 3 2024-05-08T05:45:57.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:57 smithi082 ceph-mon[30098]: pgmap v315: 97 pgs: 2 creating+activating, 24 creating+peering, 49 active+clean, 22 unknown; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:57.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:57 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/3836167184' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-08T05:45:57.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:57 smithi082 ceph-mon[30098]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-08T05:45:57.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:57 smithi082 ceph-mon[30098]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-05-08T05:45:58.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:57 smithi151 ceph-mon[34815]: pgmap v315: 97 pgs: 2 creating+activating, 24 creating+peering, 49 active+clean, 22 unknown; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:58.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:57 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/3836167184' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-08T05:45:58.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:57 smithi151 ceph-mon[34815]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-08T05:45:58.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:57 smithi151 ceph-mon[34815]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-05-08T05:45:58.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:57 smithi134 ceph-mon[34132]: pgmap v315: 97 pgs: 2 creating+activating, 24 creating+peering, 49 active+clean, 22 unknown; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:58.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:57 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/3836167184' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-08T05:45:58.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:57 smithi134 ceph-mon[34132]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-08T05:45:58.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:57 smithi134 ceph-mon[34132]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-05-08T05:45:58.771 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-08T05:45:58.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:58 smithi082 ceph-mon[30098]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-08T05:45:58.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:58 smithi082 ceph-mon[30098]: osdmap e80: 12 total, 12 up, 12 in 2024-05-08T05:45:58.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:58 smithi082 ceph-mon[30098]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-05-08T05:45:58.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:58 smithi082 ceph-mon[30098]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-05-08T05:45:59.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:58 smithi151 ceph-mon[34815]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-08T05:45:59.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:58 smithi151 ceph-mon[34815]: osdmap e80: 12 total, 12 up, 12 in 2024-05-08T05:45:59.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:58 smithi151 ceph-mon[34815]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-05-08T05:45:59.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:58 smithi151 ceph-mon[34815]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-05-08T05:45:59.220 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:45:59.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:58 smithi134 ceph-mon[34132]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-08T05:45:59.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:58 smithi134 ceph-mon[34132]: osdmap e80: 12 total, 12 up, 12 in 2024-05-08T05:45:59.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:58 smithi134 ceph-mon[34132]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-05-08T05:45:59.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:58 smithi134 ceph-mon[34132]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-05-08T05:45:59.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:59 smithi082 ceph-mon[30098]: pgmap v317: 97 pgs: 2 creating+activating, 24 creating+peering, 65 active+clean, 6 unknown; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:45:59.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:59 smithi082 ceph-mon[30098]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-05-08T05:45:59.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:59 smithi082 ceph-mon[30098]: Cluster is now healthy 2024-05-08T05:45:59.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:59 smithi082 ceph-mon[30098]: mds.? [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] up:active 2024-05-08T05:45:59.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:59 smithi082 ceph-mon[30098]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-08T05:45:59.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:45:59 smithi082 ceph-mon[30098]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-08T05:46:00.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:59 smithi151 ceph-mon[34815]: pgmap v317: 97 pgs: 2 creating+activating, 24 creating+peering, 65 active+clean, 6 unknown; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:46:00.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:59 smithi151 ceph-mon[34815]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-05-08T05:46:00.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:59 smithi151 ceph-mon[34815]: Cluster is now healthy 2024-05-08T05:46:00.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:59 smithi151 ceph-mon[34815]: mds.? [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] up:active 2024-05-08T05:46:00.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:59 smithi151 ceph-mon[34815]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-08T05:46:00.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:45:59 smithi151 ceph-mon[34815]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-08T05:46:00.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:59 smithi134 ceph-mon[34132]: pgmap v317: 97 pgs: 2 creating+activating, 24 creating+peering, 65 active+clean, 6 unknown; 577 KiB data, 342 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T05:46:00.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:59 smithi134 ceph-mon[34132]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-05-08T05:46:00.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:59 smithi134 ceph-mon[34132]: Cluster is now healthy 2024-05-08T05:46:00.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:59 smithi134 ceph-mon[34132]: mds.? [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] up:active 2024-05-08T05:46:00.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:59 smithi134 ceph-mon[34132]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-08T05:46:00.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:45:59 smithi134 ceph-mon[34132]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-08T05:46:00.750 INFO:journalctl@ceph.mds.b.smithi134.stdout:May 08 05:46:00 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-b[65010]: 2024-05-08T05:46:00.480+0000 7f36f2e89700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-08T05:46:01.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:01.424+0000 7f3e2f600700 1 -- 172.21.15.82:0/338023678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e2806b1b0 msgr2=0x7f3e2806b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:01.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:01.424+0000 7f3e2f600700 1 --2- 172.21.15.82:0/338023678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e2806b1b0 0x7f3e2806b590 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c0098f0 tx=0x7f3e1c009c00 comp rx=0 tx=0).stop 2024-05-08T05:46:01.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:01.426+0000 7f3e2f600700 1 -- 172.21.15.82:0/338023678 shutdown_connections 2024-05-08T05:46:01.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:01.426+0000 7f3e2f600700 1 --2- 172.21.15.82:0/338023678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e2806b1b0 0x7f3e2806b590 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:01.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:01.426+0000 7f3e2f600700 1 --2- 172.21.15.82:0/338023678 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e2810ff50 0x7f3e28112340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:01.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:01.426+0000 7f3e2f600700 1 --2- 172.21.15.82:0/338023678 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e2806bad0 0x7f3e2810fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:01.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:01.426+0000 7f3e2f600700 1 -- 172.21.15.82:0/338023678 >> 172.21.15.82:0/338023678 conn(0x7f3e28079350 msgr2=0x7f3e28079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:46:01.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:01.426+0000 7f3e2f600700 1 -- 172.21.15.82:0/338023678 shutdown_connections 2024-05-08T05:46:01.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:01.426+0000 7f3e2f600700 1 -- 172.21.15.82:0/338023678 wait complete. 2024-05-08T05:46:01.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:01.426+0000 7f3e2f600700 1 Processor -- start 2024-05-08T05:46:01.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:01.426+0000 7f3e2f600700 1 -- start start 2024-05-08T05:46:01.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:01.426+0000 7f3e2f600700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e2806b1b0 0x7f3e2819bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:01.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:01.426+0000 7f3e2f600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e2806bad0 0x7f3e2819c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:01.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:01.426+0000 7f3e2f600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e2810ff50 0x7f3e281a06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:01.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:01.426+0000 7f3e2f600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3e281158c0 con 0x7f3e2810ff50 2024-05-08T05:46:01.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:01.426+0000 7f3e2f600700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3e28115740 con 0x7f3e2806bad0 2024-05-08T05:46:01.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:01.426+0000 7f3e2f600700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3e28115a40 con 0x7f3e2806b1b0 2024-05-08T05:46:01.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:01.427+0000 7f3e2cc00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e2806b1b0 0x7f3e2819bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:01.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:01.427+0000 7f3e27e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e2806bad0 0x7f3e2819c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:01.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:01.427+0000 7f3e2d600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e2810ff50 0x7f3e281a06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:01.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:01.427+0000 7f3e2cc00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e2806b1b0 0x7f3e2819bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:54108/0 (socket says 172.21.15.82:54108) 2024-05-08T05:46:01.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:01.427+0000 7f3e2cc00700 1 -- 172.21.15.82:0/3416878923 learned_addr learned my addr 172.21.15.82:0/3416878923 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:46:01.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:01.427+0000 7f3e27e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e2806bad0 0x7f3e2819c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:48562/0 (socket says 172.21.15.82:48562) 2024-05-08T05:46:01.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:01.427+0000 7f3e2cc00700 1 -- 172.21.15.82:0/3416878923 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e2806bad0 msgr2=0x7f3e2819c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:01.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:01.427+0000 7f3e2cc00700 1 --2- 172.21.15.82:0/3416878923 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e2806bad0 0x7f3e2819c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:01.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:01.427+0000 7f3e2cc00700 1 -- 172.21.15.82:0/3416878923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e2810ff50 msgr2=0x7f3e281a06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:01.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:01.427+0000 7f3e2cc00700 1 --2- 172.21.15.82:0/3416878923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e2810ff50 0x7f3e281a06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:01.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:01.427+0000 7f3e2cc00700 1 -- 172.21.15.82:0/3416878923 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e281a0de0 con 0x7f3e2806b1b0 2024-05-08T05:46:01.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:01.427+0000 7f3e2cc00700 1 --2- 172.21.15.82:0/3416878923 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e2806b1b0 0x7f3e2819bdd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c009230 tx=0x7f3e1c00fa70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:46:01.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:01.428+0000 7f3e25600700 1 -- 172.21.15.82:0/3416878923 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c0050c0 con 0x7f3e2806b1b0 2024-05-08T05:46:01.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:01.428+0000 7f3e2f600700 1 -- 172.21.15.82:0/3416878923 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e281a1070 con 0x7f3e2806b1b0 2024-05-08T05:46:01.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:01.428+0000 7f3e25600700 1 -- 172.21.15.82:0/3416878923 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3e1c00b560 con 0x7f3e2806b1b0 2024-05-08T05:46:01.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:01.428+0000 7f3e25600700 1 -- 172.21.15.82:0/3416878923 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c003a00 con 0x7f3e2806b1b0 2024-05-08T05:46:01.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:01.428+0000 7f3e2f600700 1 -- 172.21.15.82:0/3416878923 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e281a8950 con 0x7f3e2806b1b0 2024-05-08T05:46:01.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:01.429+0000 7f3e2f600700 1 -- 172.21.15.82:0/3416878923 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e2806a190 con 0x7f3e2806b1b0 2024-05-08T05:46:01.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:01.431+0000 7f3e25600700 1 -- 172.21.15.82:0/3416878923 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f3e1c00b710 con 0x7f3e2806b1b0 2024-05-08T05:46:01.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:01.433+0000 7f3e25600700 1 --2- 172.21.15.82:0/3416878923 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3e100b2880 0x7f3e100b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:01.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:01.433+0000 7f3e25600700 1 -- 172.21.15.82:0/3416878923 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f3e1c0e30a0 con 0x7f3e2806b1b0 2024-05-08T05:46:01.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:01.433+0000 7f3e27e00700 1 --2- 172.21.15.82:0/3416878923 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3e100b2880 0x7f3e100b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:01.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:01.434+0000 7f3e27e00700 1 --2- 172.21.15.82:0/3416878923 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3e100b2880 0x7f3e100b4d40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3e14009750 tx=0x7f3e14009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:46:01.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:01.438+0000 7f3e25600700 1 -- 172.21.15.82:0/3416878923 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f3e1c013030 con 0x7f3e2806b1b0 2024-05-08T05:46:01.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:01.666+0000 7f3e2f600700 1 -- 172.21.15.82:0/3416878923 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3e2802e510 con 0x7f3e2806b1b0 2024-05-08T05:46:01.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:01.669+0000 7f3e25600700 1 -- 172.21.15.82:0/3416878923 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22195 (secure 0 0 0) 0x7f3e1c0aaf00 con 0x7f3e2806b1b0 2024-05-08T05:46:01.669 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:46:01.669 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":80,"fsid":"c739a5c8-0cfc-11ef-bc97-c7b262605968","created":"2024-05-08T05:36:37.441393+0000","modified":"2024-05-08T05:45:57.654123+0000","last_up_change":"2024-05-08T05:44:40.677995+0000","last_in_change":"2024-05-08T05:44:20.654220+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T05:40:28.102836+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T05:45:48.727521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T05:45:53.574048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bc9bd472-b765-4893-84ed-c66b5c1c61b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":4051651615},{"type":"v1","addr":"172.21.15.82:6803","nonce":4051651615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":4051651615},{"type":"v1","addr":"172.21.15.82:6805","nonce":4051651615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4051651615},{"type":"v1","addr":"172.21.15.82:6809","nonce":4051651615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":4051651615},{"type":"v1","addr":"172.21.15.82:6807","nonce":4051651615}]},"public_addr":"172.21.15.82:6803/4051651615","cluster_addr":"172.21.15.82:6805/4051651615","heartbeat_back_addr":"172.21.15.82:6809/4051651615","heartbeat_front_addr":"172.21.15.82:6807/4051651615","state":["exists","up"]},{"osd":1,"uuid":"ad2d3a6b-8bc5-4177-8757-07e8607ca240","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":2763858634},{"type":"v1","addr":"172.21.15.134:6801","nonce":2763858634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":2763858634},{"type":"v1","addr":"172.21.15.134:6803","nonce":2763858634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":2763858634},{"type":"v1","addr":"172.21.15.134:6807","nonce":2763858634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2763858634},{"type":"v1","addr":"172.21.15.134:6805","nonce":2763858634}]},"public_addr":"172.21.15.134:6801/2763858634","cluster_addr":"172.21.15.134:6803/2763858634","heartbeat_back_addr":"172.21.15.134:6807/2763858634","heartbeat_front_addr":"172.21.15.134:6805/2763858634","state":["exists","up"]},{"osd":2,"uuid":"a06dc8fc-7324-4e42-9487-8cfe372401b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":4193933269},{"type":"v1","addr":"172.21.15.151:6801","nonce":4193933269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":4193933269},{"type":"v1","addr":"172.21.15.151:6803","nonce":4193933269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":4193933269},{"type":"v1","addr":"172.21.15.151:6807","nonce":4193933269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":4193933269},{"type":"v1","addr":"172.21.15.151:6805","nonce":4193933269}]},"public_addr":"172.21.15.151:6801/4193933269","cluster_addr":"172.21.15.151:6803/4193933269","heartbeat_back_addr":"172.21.15.151:6807/4193933269","heartbeat_front_addr":"172.21.15.151:6805/4193933269","state":["exists","up"]},{"osd":3,"uuid":"b8c8bdcd-fbd7-4494-976e-7285408e010e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":2775272422},{"type":"v1","addr":"172.21.15.82:6811","nonce":2775272422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":2775272422},{"type":"v1","addr":"172.21.15.82:6813","nonce":2775272422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":2775272422},{"type":"v1","addr":"172.21.15.82:6817","nonce":2775272422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":2775272422},{"type":"v1","addr":"172.21.15.82:6815","nonce":2775272422}]},"public_addr":"172.21.15.82:6811/2775272422","cluster_addr":"172.21.15.82:6813/2775272422","heartbeat_back_addr":"172.21.15.82:6817/2775272422","heartbeat_front_addr":"172.21.15.82:6815/2775272422","state":["exists","up"]},{"osd":4,"uuid":"391a6040-03d1-483c-9058-308b5998e7c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3565208751},{"type":"v1","addr":"172.21.15.134:6809","nonce":3565208751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3565208751},{"type":"v1","addr":"172.21.15.134:6811","nonce":3565208751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3565208751},{"type":"v1","addr":"172.21.15.134:6815","nonce":3565208751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3565208751},{"type":"v1","addr":"172.21.15.134:6813","nonce":3565208751}]},"public_addr":"172.21.15.134:6809/3565208751","cluster_addr":"172.21.15.134:6811/3565208751","heartbeat_back_addr":"172.21.15.134:6815/3565208751","heartbeat_front_addr":"172.21.15.134:6813/3565208751","state":["exists","up"]},{"osd":5,"uuid":"dacce079-4aad-474e-b747-1ed60c3c71cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":1925634069},{"type":"v1","addr":"172.21.15.151:6809","nonce":1925634069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":1925634069},{"type":"v1","addr":"172.21.15.151:6811","nonce":1925634069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1925634069},{"type":"v1","addr":"172.21.15.151:6815","nonce":1925634069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1925634069},{"type":"v1","addr":"172.21.15.151:6813","nonce":1925634069}]},"public_addr":"172.21.15.151:6809/1925634069","cluster_addr":"172.21.15.151:6811/1925634069","heartbeat_back_addr":"172.21.15.151:6815/1925634069","heartbeat_front_addr":"172.21.15.151:6813/1925634069","state":["exists","up"]},{"osd":6,"uuid":"6a445bf4-09c4-4e9b-be6e-68ef3c05b365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":762647976},{"type":"v1","addr":"172.21.15.82:6819","nonce":762647976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":762647976},{"type":"v1","addr":"172.21.15.82:6821","nonce":762647976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":762647976},{"type":"v1","addr":"172.21.15.82:6825","nonce":762647976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":762647976},{"type":"v1","addr":"172.21.15.82:6823","nonce":762647976}]},"public_addr":"172.21.15.82:6819/762647976","cluster_addr":"172.21.15.82:6821/762647976","heartbeat_back_addr":"172.21.15.82:6825/762647976","heartbeat_front_addr":"172.21.15.82:6823/762647976","state":["exists","up"]},{"osd":7,"uuid":"72b0c735-ef30-4823-8ab8-2e5bf7cc3c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3006846927},{"type":"v1","addr":"172.21.15.134:6817","nonce":3006846927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3006846927},{"type":"v1","addr":"172.21.15.134:6819","nonce":3006846927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3006846927},{"type":"v1","addr":"172.21.15.134:6823","nonce":3006846927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3006846927},{"type":"v1","addr":"172.21.15.134:6821","nonce":3006846927}]},"public_addr":"172.21.15.134:6817/3006846927","cluster_addr":"172.21.15.134:6819/3006846927","heartbeat_back_addr":"172.21.15.134:6823/3006846927","heartbeat_front_addr":"172.21.15.134:6821/3006846927","state":["exists","up"]},{"osd":8,"uuid":"93e4da0f-48ea-4ab7-b612-26b545b76de6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":787870717},{"type":"v1","addr":"172.21.15.151:6817","nonce":787870717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":787870717},{"type":"v1","addr":"172.21.15.151:6819","nonce":787870717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":787870717},{"type":"v1","addr":"172.21.15.151:6823","nonce":787870717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":787870717},{"type":"v1","addr":"172.21.15.151:6821","nonce":787870717}]},"public_addr":"172.21.15.151:6817/787870717","cluster_addr":"172.21.15.151:6819/787870717","heartbeat_back_addr":"172.21.15.151:6823/787870717","heartbeat_front_addr":"172.21.15.151:6821/787870717","state":["exists","up"]},{"osd":9,"uuid":"ea0070c1-286a-47d3-90cf-d1fada6e3cda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":533124002},{"type":"v1","addr":"172.21.15.82:6827","nonce":533124002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":533124002},{"type":"v1","addr":"172.21.15.82:6829","nonce":533124002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":533124002},{"type":"v1","addr":"172.21.15.82:6833","nonce":533124002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":533124002},{"type":"v1","addr":"172.21.15.82:6831","nonce":533124002}]},"public_addr":"172.21.15.82:6827/533124002","cluster_addr":"172.21.15.82:6829/533124002","heartbeat_back_addr":"172.21.15.82:6833/533124002","heartbeat_front_addr":"172.21.15.82:6831/533124002","state":["exists","up"]},{"osd":10,"uuid":"26ca0a0b-ab9e-472f-bb29-428e8c31e5bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":99154842},{"type":"v1","addr":"172.21.15.134:6825","nonce":99154842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":99154842},{"type":"v1","addr":"172.21.15.134:6827","nonce":99154842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":99154842},{"type":"v1","addr":"172.21.15.134:6831","nonce":99154842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":99154842},{"type":"v1","addr":"172.21.15.134:6829","nonce":99154842}]},"public_addr":"172.21.15.134:6825/99154842","cluster_addr":"172.21.15.134:6827/99154842","heartbeat_back_addr":"172.21.15.134:6831/99154842","heartbeat_front_addr":"172.21.15.134:6829/99154842","state":["exists","up"]},{"osd":11,"uuid":"9ae5dca4-acfb-4a46-8601-9d642efde794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2242771269},{"type":"v1","addr":"172.21.15.151:6825","nonce":2242771269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2242771269},{"type":"v1","addr":"172.21.15.151:6827","nonce":2242771269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2242771269},{"type":"v1","addr":"172.21.15.151:6831","nonce":2242771269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2242771269},{"type":"v1","addr":"172.21.15.151:6829","nonce":2242771269}]},"public_addr":"172.21.15.151:6825/2242771269","cluster_addr":"172.21.15.151:6827/2242771269","heartbeat_back_addr":"172.21.15.151:6831/2242771269","heartbeat_front_addr":"172.21.15.151:6829/2242771269","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:39:35.575525+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:40:00.672367+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:40:24.558682+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:40:56.791194+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:41:23.031785+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:41:47.926448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:42:21.231894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:42:47.599982+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:43:12.950581+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:43:46.333027+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:44:13.457489+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:44:38.637273+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/2761274596":"2024-05-09T05:37:43.951218+0000","172.21.15.82:0/2195734928":"2024-05-09T05:37:43.951218+0000","172.21.15.82:6801/765895649":"2024-05-09T05:37:43.951218+0000","172.21.15.82:6800/3546670887":"2024-05-09T05:37:11.114057+0000","172.21.15.82:6800/765895649":"2024-05-09T05:37:43.951218+0000","172.21.15.82:0/3986150437":"2024-05-09T05:37:11.114057+0000","172.21.15.82:0/3457457714":"2024-05-09T05:37:11.114057+0000","172.21.15.82:0/2356749286":"2024-05-09T05:37:11.114057+0000","172.21.15.82:6801/3546670887":"2024-05-09T05:37:11.114057+0000","172.21.15.82:0/1694643083":"2024-05-09T05:37:43.951218+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T05:46:01.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:01.673+0000 7f3e2f600700 1 -- 172.21.15.82:0/3416878923 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3e100b2880 msgr2=0x7f3e100b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:01.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:01.673+0000 7f3e2f600700 1 --2- 172.21.15.82:0/3416878923 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3e100b2880 0x7f3e100b4d40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3e14009750 tx=0x7f3e14009310 comp rx=0 tx=0).stop 2024-05-08T05:46:01.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:01.673+0000 7f3e2f600700 1 -- 172.21.15.82:0/3416878923 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e2806b1b0 msgr2=0x7f3e2819bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:01.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:01.673+0000 7f3e2f600700 1 --2- 172.21.15.82:0/3416878923 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e2806b1b0 0x7f3e2819bdd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c009230 tx=0x7f3e1c00fa70 comp rx=0 tx=0).stop 2024-05-08T05:46:01.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:01.673+0000 7f3e2f600700 1 -- 172.21.15.82:0/3416878923 shutdown_connections 2024-05-08T05:46:01.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:01.673+0000 7f3e2f600700 1 --2- 172.21.15.82:0/3416878923 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3e100b2880 0x7f3e100b4d40 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:01.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:01.673+0000 7f3e2f600700 1 --2- 172.21.15.82:0/3416878923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3e2810ff50 0x7f3e281a06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:01.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:01.673+0000 7f3e2f600700 1 --2- 172.21.15.82:0/3416878923 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e2806b1b0 0x7f3e2819bdd0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:01.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:01.673+0000 7f3e2f600700 1 --2- 172.21.15.82:0/3416878923 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e2806bad0 0x7f3e2819c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:01.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:01.673+0000 7f3e2f600700 1 -- 172.21.15.82:0/3416878923 >> 172.21.15.82:0/3416878923 conn(0x7f3e28079350 msgr2=0x7f3e28111460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:46:01.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:01.673+0000 7f3e2f600700 1 -- 172.21.15.82:0/3416878923 shutdown_connections 2024-05-08T05:46:01.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:01.674+0000 7f3e2f600700 1 -- 172.21.15.82:0/3416878923 wait complete. 2024-05-08T05:46:01.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:01 smithi082 ceph-mon[30098]: pgmap v318: 97 pgs: 97 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s wr, 5 op/s 2024-05-08T05:46:01.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:01 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/3416878923' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:46:02.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:01 smithi151 ceph-mon[34815]: pgmap v318: 97 pgs: 97 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s wr, 5 op/s 2024-05-08T05:46:02.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:01 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/3416878923' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:46:02.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:01 smithi134 ceph-mon[34132]: pgmap v318: 97 pgs: 97 active+clean; 577 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s wr, 5 op/s 2024-05-08T05:46:02.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:01 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/3416878923' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:46:02.570 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-08T05:46:03.038 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:46:04.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:03 smithi151 ceph-mon[34815]: pgmap v319: 97 pgs: 97 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 976 B/s wr, 5 op/s 2024-05-08T05:46:04.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:03 smithi082 ceph-mon[30098]: pgmap v319: 97 pgs: 97 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 976 B/s wr, 5 op/s 2024-05-08T05:46:04.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:03 smithi134 ceph-mon[34132]: pgmap v319: 97 pgs: 97 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 976 B/s wr, 5 op/s 2024-05-08T05:46:05.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:05.112+0000 7fe868a00700 1 -- 172.21.15.82:0/2289747931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe86410a490 msgr2=0x7fe8641169a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:05.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:05.112+0000 7fe868a00700 1 --2- 172.21.15.82:0/2289747931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe86410a490 0x7fe8641169a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe85c00b0a0 tx=0x7fe85c00b3b0 comp rx=0 tx=0).stop 2024-05-08T05:46:05.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:05.113+0000 7fe868a00700 1 -- 172.21.15.82:0/2289747931 shutdown_connections 2024-05-08T05:46:05.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:05.113+0000 7fe868a00700 1 --2- 172.21.15.82:0/2289747931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe86410a490 0x7fe8641169a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:05.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:05.113+0000 7fe868a00700 1 --2- 172.21.15.82:0/2289747931 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe86410fb60 0x7fe86410ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:05.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:05.113+0000 7fe868a00700 1 --2- 172.21.15.82:0/2289747931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe864109ad0 0x7fe864109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:05.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:05.113+0000 7fe868a00700 1 -- 172.21.15.82:0/2289747931 >> 172.21.15.82:0/2289747931 conn(0x7fe864076c70 msgr2=0x7fe8641082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:46:05.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:05.113+0000 7fe868a00700 1 -- 172.21.15.82:0/2289747931 shutdown_connections 2024-05-08T05:46:05.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:05.113+0000 7fe868a00700 1 -- 172.21.15.82:0/2289747931 wait complete. 2024-05-08T05:46:05.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:05.115+0000 7fe868a00700 1 Processor -- start 2024-05-08T05:46:05.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:05.115+0000 7fe868a00700 1 -- start start 2024-05-08T05:46:05.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:05.115+0000 7fe868a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe864109ad0 0x7fe8641a0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:05.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:05.116+0000 7fe868a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe86410a490 0x7fe8641a0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:05.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:05.116+0000 7fe868a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe86410fb60 0x7fe8641a49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:05.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:05.116+0000 7fe868a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe864119cc0 con 0x7fe86410a490 2024-05-08T05:46:05.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:05.116+0000 7fe868a00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe864119b40 con 0x7fe86410fb60 2024-05-08T05:46:05.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:05.116+0000 7fe868a00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe864119e40 con 0x7fe864109ad0 2024-05-08T05:46:05.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:05.116+0000 7fe861400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe86410a490 0x7fe8641a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:05.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:05.116+0000 7fe861400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe86410a490 0x7fe8641a0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:36964/0 (socket says 172.21.15.82:36964) 2024-05-08T05:46:05.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:05.116+0000 7fe861400700 1 -- 172.21.15.82:0/1845608563 learned_addr learned my addr 172.21.15.82:0/1845608563 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:46:05.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:05.116+0000 7fe861e00700 1 --2- 172.21.15.82:0/1845608563 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe864109ad0 0x7fe8641a0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:05.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:05.116+0000 7fe862800700 1 --2- 172.21.15.82:0/1845608563 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe86410fb60 0x7fe8641a49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:05.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:05.116+0000 7fe861400700 1 -- 172.21.15.82:0/1845608563 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe864109ad0 msgr2=0x7fe8641a0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:05.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:05.116+0000 7fe861400700 1 --2- 172.21.15.82:0/1845608563 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe864109ad0 0x7fe8641a0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:05.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:05.116+0000 7fe861400700 1 -- 172.21.15.82:0/1845608563 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe86410fb60 msgr2=0x7fe8641a49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:05.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:05.116+0000 7fe861400700 1 --2- 172.21.15.82:0/1845608563 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe86410fb60 0x7fe8641a49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:05.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:05.116+0000 7fe861400700 1 -- 172.21.15.82:0/1845608563 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8641a50f0 con 0x7fe86410a490 2024-05-08T05:46:05.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:05.116+0000 7fe862800700 1 --2- 172.21.15.82:0/1845608563 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe86410fb60 0x7fe8641a49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:46:05.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:05.117+0000 7fe861400700 1 --2- 172.21.15.82:0/1845608563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe86410a490 0x7fe8641a0670 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe85000e9a0 tx=0x7fe85000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:46:05.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:05.117+0000 7fe85aa00700 1 -- 172.21.15.82:0/1845608563 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe85000ca10 con 0x7fe86410a490 2024-05-08T05:46:05.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:05.117+0000 7fe85aa00700 1 -- 172.21.15.82:0/1845608563 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe85000cbb0 con 0x7fe86410a490 2024-05-08T05:46:05.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:05.117+0000 7fe868a00700 1 -- 172.21.15.82:0/1845608563 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8641a53e0 con 0x7fe86410a490 2024-05-08T05:46:05.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:05.117+0000 7fe85aa00700 1 -- 172.21.15.82:0/1845608563 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe850018680 con 0x7fe86410a490 2024-05-08T05:46:05.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:05.117+0000 7fe868a00700 1 -- 172.21.15.82:0/1845608563 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8641acc60 con 0x7fe86410a490 2024-05-08T05:46:05.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:05.118+0000 7fe868a00700 1 -- 172.21.15.82:0/1845608563 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe86406a190 con 0x7fe86410a490 2024-05-08T05:46:05.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:05.122+0000 7fe85aa00700 1 -- 172.21.15.82:0/1845608563 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fe850010430 con 0x7fe86410a490 2024-05-08T05:46:05.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:05.123+0000 7fe85aa00700 1 --2- 172.21.15.82:0/1845608563 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fe8480b2900 0x7fe8480b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:05.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:05.123+0000 7fe85aa00700 1 -- 172.21.15.82:0/1845608563 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fe8500e2590 con 0x7fe86410a490 2024-05-08T05:46:05.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:05.123+0000 7fe861e00700 1 --2- 172.21.15.82:0/1845608563 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fe8480b2900 0x7fe8480b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:05.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:05.124+0000 7fe861e00700 1 --2- 172.21.15.82:0/1845608563 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fe8480b2900 0x7fe8480b4dc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe854007b60 tx=0x7fe8540073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:46:05.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:05.125+0000 7fe85aa00700 1 -- 172.21.15.82:0/1845608563 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe8500aa360 con 0x7fe86410a490 2024-05-08T05:46:05.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:05.357+0000 7fe868a00700 1 -- 172.21.15.82:0/1845608563 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe86402e510 con 0x7fe86410a490 2024-05-08T05:46:05.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:05.360+0000 7fe85aa00700 1 -- 172.21.15.82:0/1845608563 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) ==== 74+0+22195 (secure 0 0 0) 0x7fe8500b23e0 con 0x7fe86410a490 2024-05-08T05:46:05.360 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:46:05.360 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":80,"fsid":"c739a5c8-0cfc-11ef-bc97-c7b262605968","created":"2024-05-08T05:36:37.441393+0000","modified":"2024-05-08T05:45:57.654123+0000","last_up_change":"2024-05-08T05:44:40.677995+0000","last_in_change":"2024-05-08T05:44:20.654220+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T05:40:28.102836+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T05:45:48.727521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T05:45:53.574048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bc9bd472-b765-4893-84ed-c66b5c1c61b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":4051651615},{"type":"v1","addr":"172.21.15.82:6803","nonce":4051651615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":4051651615},{"type":"v1","addr":"172.21.15.82:6805","nonce":4051651615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4051651615},{"type":"v1","addr":"172.21.15.82:6809","nonce":4051651615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":4051651615},{"type":"v1","addr":"172.21.15.82:6807","nonce":4051651615}]},"public_addr":"172.21.15.82:6803/4051651615","cluster_addr":"172.21.15.82:6805/4051651615","heartbeat_back_addr":"172.21.15.82:6809/4051651615","heartbeat_front_addr":"172.21.15.82:6807/4051651615","state":["exists","up"]},{"osd":1,"uuid":"ad2d3a6b-8bc5-4177-8757-07e8607ca240","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":2763858634},{"type":"v1","addr":"172.21.15.134:6801","nonce":2763858634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":2763858634},{"type":"v1","addr":"172.21.15.134:6803","nonce":2763858634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":2763858634},{"type":"v1","addr":"172.21.15.134:6807","nonce":2763858634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2763858634},{"type":"v1","addr":"172.21.15.134:6805","nonce":2763858634}]},"public_addr":"172.21.15.134:6801/2763858634","cluster_addr":"172.21.15.134:6803/2763858634","heartbeat_back_addr":"172.21.15.134:6807/2763858634","heartbeat_front_addr":"172.21.15.134:6805/2763858634","state":["exists","up"]},{"osd":2,"uuid":"a06dc8fc-7324-4e42-9487-8cfe372401b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":4193933269},{"type":"v1","addr":"172.21.15.151:6801","nonce":4193933269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":4193933269},{"type":"v1","addr":"172.21.15.151:6803","nonce":4193933269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":4193933269},{"type":"v1","addr":"172.21.15.151:6807","nonce":4193933269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":4193933269},{"type":"v1","addr":"172.21.15.151:6805","nonce":4193933269}]},"public_addr":"172.21.15.151:6801/4193933269","cluster_addr":"172.21.15.151:6803/4193933269","heartbeat_back_addr":"172.21.15.151:6807/4193933269","heartbeat_front_addr":"172.21.15.151:6805/4193933269","state":["exists","up"]},{"osd":3,"uuid":"b8c8bdcd-fbd7-4494-976e-7285408e010e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":2775272422},{"type":"v1","addr":"172.21.15.82:6811","nonce":2775272422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":2775272422},{"type":"v1","addr":"172.21.15.82:6813","nonce":2775272422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":2775272422},{"type":"v1","addr":"172.21.15.82:6817","nonce":2775272422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":2775272422},{"type":"v1","addr":"172.21.15.82:6815","nonce":2775272422}]},"public_addr":"172.21.15.82:6811/2775272422","cluster_addr":"172.21.15.82:6813/2775272422","heartbeat_back_addr":"172.21.15.82:6817/2775272422","heartbeat_front_addr":"172.21.15.82:6815/2775272422","state":["exists","up"]},{"osd":4,"uuid":"391a6040-03d1-483c-9058-308b5998e7c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3565208751},{"type":"v1","addr":"172.21.15.134:6809","nonce":3565208751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3565208751},{"type":"v1","addr":"172.21.15.134:6811","nonce":3565208751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3565208751},{"type":"v1","addr":"172.21.15.134:6815","nonce":3565208751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3565208751},{"type":"v1","addr":"172.21.15.134:6813","nonce":3565208751}]},"public_addr":"172.21.15.134:6809/3565208751","cluster_addr":"172.21.15.134:6811/3565208751","heartbeat_back_addr":"172.21.15.134:6815/3565208751","heartbeat_front_addr":"172.21.15.134:6813/3565208751","state":["exists","up"]},{"osd":5,"uuid":"dacce079-4aad-474e-b747-1ed60c3c71cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":1925634069},{"type":"v1","addr":"172.21.15.151:6809","nonce":1925634069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":1925634069},{"type":"v1","addr":"172.21.15.151:6811","nonce":1925634069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1925634069},{"type":"v1","addr":"172.21.15.151:6815","nonce":1925634069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1925634069},{"type":"v1","addr":"172.21.15.151:6813","nonce":1925634069}]},"public_addr":"172.21.15.151:6809/1925634069","cluster_addr":"172.21.15.151:6811/1925634069","heartbeat_back_addr":"172.21.15.151:6815/1925634069","heartbeat_front_addr":"172.21.15.151:6813/1925634069","state":["exists","up"]},{"osd":6,"uuid":"6a445bf4-09c4-4e9b-be6e-68ef3c05b365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":762647976},{"type":"v1","addr":"172.21.15.82:6819","nonce":762647976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":762647976},{"type":"v1","addr":"172.21.15.82:6821","nonce":762647976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":762647976},{"type":"v1","addr":"172.21.15.82:6825","nonce":762647976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":762647976},{"type":"v1","addr":"172.21.15.82:6823","nonce":762647976}]},"public_addr":"172.21.15.82:6819/762647976","cluster_addr":"172.21.15.82:6821/762647976","heartbeat_back_addr":"172.21.15.82:6825/762647976","heartbeat_front_addr":"172.21.15.82:6823/762647976","state":["exists","up"]},{"osd":7,"uuid":"72b0c735-ef30-4823-8ab8-2e5bf7cc3c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3006846927},{"type":"v1","addr":"172.21.15.134:6817","nonce":3006846927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3006846927},{"type":"v1","addr":"172.21.15.134:6819","nonce":3006846927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3006846927},{"type":"v1","addr":"172.21.15.134:6823","nonce":3006846927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3006846927},{"type":"v1","addr":"172.21.15.134:6821","nonce":3006846927}]},"public_addr":"172.21.15.134:6817/3006846927","cluster_addr":"172.21.15.134:6819/3006846927","heartbeat_back_addr":"172.21.15.134:6823/3006846927","heartbeat_front_addr":"172.21.15.134:6821/3006846927","state":["exists","up"]},{"osd":8,"uuid":"93e4da0f-48ea-4ab7-b612-26b545b76de6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":787870717},{"type":"v1","addr":"172.21.15.151:6817","nonce":787870717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":787870717},{"type":"v1","addr":"172.21.15.151:6819","nonce":787870717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":787870717},{"type":"v1","addr":"172.21.15.151:6823","nonce":787870717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":787870717},{"type":"v1","addr":"172.21.15.151:6821","nonce":787870717}]},"public_addr":"172.21.15.151:6817/787870717","cluster_addr":"172.21.15.151:6819/787870717","heartbeat_back_addr":"172.21.15.151:6823/787870717","heartbeat_front_addr":"172.21.15.151:6821/787870717","state":["exists","up"]},{"osd":9,"uuid":"ea0070c1-286a-47d3-90cf-d1fada6e3cda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":533124002},{"type":"v1","addr":"172.21.15.82:6827","nonce":533124002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":533124002},{"type":"v1","addr":"172.21.15.82:6829","nonce":533124002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":533124002},{"type":"v1","addr":"172.21.15.82:6833","nonce":533124002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":533124002},{"type":"v1","addr":"172.21.15.82:6831","nonce":533124002}]},"public_addr":"172.21.15.82:6827/533124002","cluster_addr":"172.21.15.82:6829/533124002","heartbeat_back_addr":"172.21.15.82:6833/533124002","heartbeat_front_addr":"172.21.15.82:6831/533124002","state":["exists","up"]},{"osd":10,"uuid":"26ca0a0b-ab9e-472f-bb29-428e8c31e5bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":99154842},{"type":"v1","addr":"172.21.15.134:6825","nonce":99154842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":99154842},{"type":"v1","addr":"172.21.15.134:6827","nonce":99154842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":99154842},{"type":"v1","addr":"172.21.15.134:6831","nonce":99154842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":99154842},{"type":"v1","addr":"172.21.15.134:6829","nonce":99154842}]},"public_addr":"172.21.15.134:6825/99154842","cluster_addr":"172.21.15.134:6827/99154842","heartbeat_back_addr":"172.21.15.134:6831/99154842","heartbeat_front_addr":"172.21.15.134:6829/99154842","state":["exists","up"]},{"osd":11,"uuid":"9ae5dca4-acfb-4a46-8601-9d642efde794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2242771269},{"type":"v1","addr":"172.21.15.151:6825","nonce":2242771269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2242771269},{"type":"v1","addr":"172.21.15.151:6827","nonce":2242771269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2242771269},{"type":"v1","addr":"172.21.15.151:6831","nonce":2242771269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2242771269},{"type":"v1","addr":"172.21.15.151:6829","nonce":2242771269}]},"public_addr":"172.21.15.151:6825/2242771269","cluster_addr":"172.21.15.151:6827/2242771269","heartbeat_back_addr":"172.21.15.151:6831/2242771269","heartbeat_front_addr":"172.21.15.151:6829/2242771269","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:39:35.575525+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:40:00.672367+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:40:24.558682+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:40:56.791194+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:41:23.031785+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:41:47.926448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:42:21.231894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:42:47.599982+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:43:12.950581+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:43:46.333027+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:44:13.457489+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:44:38.637273+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/2761274596":"2024-05-09T05:37:43.951218+0000","172.21.15.82:0/2195734928":"2024-05-09T05:37:43.951218+0000","172.21.15.82:6801/765895649":"2024-05-09T05:37:43.951218+0000","172.21.15.82:6800/3546670887":"2024-05-09T05:37:11.114057+0000","172.21.15.82:6800/765895649":"2024-05-09T05:37:43.951218+0000","172.21.15.82:0/3986150437":"2024-05-09T05:37:11.114057+0000","172.21.15.82:0/3457457714":"2024-05-09T05:37:11.114057+0000","172.21.15.82:0/2356749286":"2024-05-09T05:37:11.114057+0000","172.21.15.82:6801/3546670887":"2024-05-09T05:37:11.114057+0000","172.21.15.82:0/1694643083":"2024-05-09T05:37:43.951218+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T05:46:05.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:05.363+0000 7fe868a00700 1 -- 172.21.15.82:0/1845608563 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fe8480b2900 msgr2=0x7fe8480b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:05.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:05.363+0000 7fe868a00700 1 --2- 172.21.15.82:0/1845608563 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fe8480b2900 0x7fe8480b4dc0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe854007b60 tx=0x7fe8540073d0 comp rx=0 tx=0).stop 2024-05-08T05:46:05.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:05.363+0000 7fe868a00700 1 -- 172.21.15.82:0/1845608563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe86410a490 msgr2=0x7fe8641a0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:05.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:05.363+0000 7fe868a00700 1 --2- 172.21.15.82:0/1845608563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe86410a490 0x7fe8641a0670 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe85000e9a0 tx=0x7fe85000ecb0 comp rx=0 tx=0).stop 2024-05-08T05:46:05.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:05.363+0000 7fe868a00700 1 -- 172.21.15.82:0/1845608563 shutdown_connections 2024-05-08T05:46:05.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:05.363+0000 7fe868a00700 1 --2- 172.21.15.82:0/1845608563 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe86410fb60 0x7fe8641a49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:05.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:05.363+0000 7fe868a00700 1 --2- 172.21.15.82:0/1845608563 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fe8480b2900 0x7fe8480b4dc0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:05.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:05.363+0000 7fe868a00700 1 --2- 172.21.15.82:0/1845608563 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe864109ad0 0x7fe8641a0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:05.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:05.363+0000 7fe868a00700 1 --2- 172.21.15.82:0/1845608563 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe86410a490 0x7fe8641a0670 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:05.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:05.363+0000 7fe868a00700 1 -- 172.21.15.82:0/1845608563 >> 172.21.15.82:0/1845608563 conn(0x7fe864076c70 msgr2=0x7fe864077230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:46:05.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:05.363+0000 7fe868a00700 1 -- 172.21.15.82:0/1845608563 shutdown_connections 2024-05-08T05:46:05.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:05.363+0000 7fe868a00700 1 -- 172.21.15.82:0/1845608563 wait complete. 2024-05-08T05:46:05.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:05 smithi082 ceph-mon[30098]: pgmap v320: 97 pgs: 97 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-05-08T05:46:05.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:05 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/1845608563' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:46:06.111 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-05-08T05:46:06.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:05 smithi151 ceph-mon[34815]: pgmap v320: 97 pgs: 97 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-05-08T05:46:06.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:05 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/1845608563' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:46:06.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:05 smithi134 ceph-mon[34132]: pgmap v320: 97 pgs: 97 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-05-08T05:46:06.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:05 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/1845608563' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:46:06.567 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:46:08.093 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:07 smithi082 ceph-mon[30098]: pgmap v321: 97 pgs: 97 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-05-08T05:46:08.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:07 smithi151 ceph-mon[34815]: pgmap v321: 97 pgs: 97 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-05-08T05:46:08.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:07 smithi134 ceph-mon[34132]: pgmap v321: 97 pgs: 97 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-05-08T05:46:08.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:08.628+0000 7ff0aee00700 1 -- 172.21.15.82:0/454892996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0a810a490 msgr2=0x7ff0a81169a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:08.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:08.628+0000 7ff0aee00700 1 --2- 172.21.15.82:0/454892996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0a810a490 0x7ff0a81169a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff0a000b0a0 tx=0x7ff0a000b3b0 comp rx=0 tx=0).stop 2024-05-08T05:46:08.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:08.628+0000 7ff0aee00700 1 -- 172.21.15.82:0/454892996 shutdown_connections 2024-05-08T05:46:08.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:08.628+0000 7ff0aee00700 1 --2- 172.21.15.82:0/454892996 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0a810a490 0x7ff0a81169a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:08.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:08.628+0000 7ff0aee00700 1 --2- 172.21.15.82:0/454892996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0a810fb60 0x7ff0a810ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:08.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:08.628+0000 7ff0aee00700 1 --2- 172.21.15.82:0/454892996 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0a8109ad0 0x7ff0a8109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:08.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:08.628+0000 7ff0aee00700 1 -- 172.21.15.82:0/454892996 >> 172.21.15.82:0/454892996 conn(0x7ff0a8076c70 msgr2=0x7ff0a81082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:46:08.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:08.628+0000 7ff0aee00700 1 -- 172.21.15.82:0/454892996 shutdown_connections 2024-05-08T05:46:08.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:08.628+0000 7ff0aee00700 1 -- 172.21.15.82:0/454892996 wait complete. 2024-05-08T05:46:08.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:08.630+0000 7ff0aee00700 1 Processor -- start 2024-05-08T05:46:08.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:08.630+0000 7ff0aee00700 1 -- start start 2024-05-08T05:46:08.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:08.630+0000 7ff0aee00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0a8109ad0 0x7ff0a81a0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:08.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:08.630+0000 7ff0aee00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0a810a490 0x7ff0a81a06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:08.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:08.630+0000 7ff0aee00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0a810fb60 0x7ff0a81a4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:08.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:08.630+0000 7ff0aee00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a8119d20 con 0x7ff0a810a490 2024-05-08T05:46:08.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:08.630+0000 7ff0aee00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a8119ba0 con 0x7ff0a810fb60 2024-05-08T05:46:08.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:08.630+0000 7ff0aee00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff0a8119ea0 con 0x7ff0a8109ad0 2024-05-08T05:46:08.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:08.631+0000 7ff0a7e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0a8109ad0 0x7ff0a81a0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:08.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:08.631+0000 7ff0a7400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0a810a490 0x7ff0a81a06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:08.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:08.631+0000 7ff0a7e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0a8109ad0 0x7ff0a81a0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:43136/0 (socket says 172.21.15.82:43136) 2024-05-08T05:46:08.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:08.631+0000 7ff0a7e00700 1 -- 172.21.15.82:0/1063402587 learned_addr learned my addr 172.21.15.82:0/1063402587 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:46:08.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:08.631+0000 7ff0ace00700 1 --2- 172.21.15.82:0/1063402587 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0a810fb60 0x7ff0a81a4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:08.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:08.631+0000 7ff0a7400700 1 -- 172.21.15.82:0/1063402587 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0a8109ad0 msgr2=0x7ff0a81a0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:08.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:08.631+0000 7ff0a7400700 1 --2- 172.21.15.82:0/1063402587 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0a8109ad0 0x7ff0a81a0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:08.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:08.631+0000 7ff0a7400700 1 -- 172.21.15.82:0/1063402587 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0a810fb60 msgr2=0x7ff0a81a4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:08.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:08.631+0000 7ff0a7400700 1 --2- 172.21.15.82:0/1063402587 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0a810fb60 0x7ff0a81a4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:08.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:08.631+0000 7ff0a7400700 1 -- 172.21.15.82:0/1063402587 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0a81a5150 con 0x7ff0a810a490 2024-05-08T05:46:08.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:08.631+0000 7ff0a7400700 1 --2- 172.21.15.82:0/1063402587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0a810a490 0x7ff0a81a06d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff09400e9f0 tx=0x7ff09400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:46:08.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:08.632+0000 7ff0a4c00700 1 -- 172.21.15.82:0/1063402587 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff09400cb70 con 0x7ff0a810a490 2024-05-08T05:46:08.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:08.632+0000 7ff0a4c00700 1 -- 172.21.15.82:0/1063402587 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff0940044d0 con 0x7ff0a810a490 2024-05-08T05:46:08.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:08.632+0000 7ff0a4c00700 1 -- 172.21.15.82:0/1063402587 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff094003e00 con 0x7ff0a810a490 2024-05-08T05:46:08.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:08.632+0000 7ff0aee00700 1 -- 172.21.15.82:0/1063402587 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0a81a5440 con 0x7ff0a810a490 2024-05-08T05:46:08.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:08.632+0000 7ff0aee00700 1 -- 172.21.15.82:0/1063402587 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0a81accc0 con 0x7ff0a810a490 2024-05-08T05:46:08.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:08.633+0000 7ff0aee00700 1 -- 172.21.15.82:0/1063402587 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0a806a190 con 0x7ff0a810a490 2024-05-08T05:46:08.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:08.638+0000 7ff0a4c00700 1 -- 172.21.15.82:0/1063402587 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7ff094003fa0 con 0x7ff0a810a490 2024-05-08T05:46:08.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:08.640+0000 7ff0a4c00700 1 --2- 172.21.15.82:0/1063402587 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff08c0b2880 0x7ff08c0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:08.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:08.640+0000 7ff0a4c00700 1 -- 172.21.15.82:0/1063402587 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7ff0940e2510 con 0x7ff0a810a490 2024-05-08T05:46:08.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:08.640+0000 7ff0a7e00700 1 --2- 172.21.15.82:0/1063402587 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff08c0b2880 0x7ff08c0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:08.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:08.641+0000 7ff0a7e00700 1 --2- 172.21.15.82:0/1063402587 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff08c0b2880 0x7ff08c0b4d40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff098007c10 tx=0x7ff098007480 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:46:08.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:08.642+0000 7ff0a4c00700 1 -- 172.21.15.82:0/1063402587 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff094054df0 con 0x7ff0a810a490 2024-05-08T05:46:08.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:08.923+0000 7ff0aee00700 1 -- 172.21.15.82:0/1063402587 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7ff0a802e510 con 0x7ff0a810a490 2024-05-08T05:46:09.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:09.856+0000 7ff0a4c00700 1 -- 172.21.15.82:0/1063402587 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7ff0940aa2e0 con 0x7ff0a810a490 2024-05-08T05:46:09.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:09.860+0000 7ff0aee00700 1 -- 172.21.15.82:0/1063402587 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff08c0b2880 msgr2=0x7ff08c0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:09.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:09.860+0000 7ff0aee00700 1 --2- 172.21.15.82:0/1063402587 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff08c0b2880 0x7ff08c0b4d40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff098007c10 tx=0x7ff098007480 comp rx=0 tx=0).stop 2024-05-08T05:46:09.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:09.860+0000 7ff0aee00700 1 -- 172.21.15.82:0/1063402587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0a810a490 msgr2=0x7ff0a81a06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:09.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:09.860+0000 7ff0aee00700 1 --2- 172.21.15.82:0/1063402587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0a810a490 0x7ff0a81a06d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff09400e9f0 tx=0x7ff09400ed00 comp rx=0 tx=0).stop 2024-05-08T05:46:09.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:09.861+0000 7ff0aee00700 1 -- 172.21.15.82:0/1063402587 shutdown_connections 2024-05-08T05:46:09.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:09.861+0000 7ff0aee00700 1 --2- 172.21.15.82:0/1063402587 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0a810fb60 0x7ff0a81a4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:09.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:09.861+0000 7ff0aee00700 1 --2- 172.21.15.82:0/1063402587 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff08c0b2880 0x7ff08c0b4d40 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:09.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:09.861+0000 7ff0aee00700 1 --2- 172.21.15.82:0/1063402587 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0a8109ad0 0x7ff0a81a0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:09.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:09.861+0000 7ff0aee00700 1 --2- 172.21.15.82:0/1063402587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff0a810a490 0x7ff0a81a06d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:09.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:09.861+0000 7ff0aee00700 1 -- 172.21.15.82:0/1063402587 >> 172.21.15.82:0/1063402587 conn(0x7ff0a8076c70 msgr2=0x7ff0a8077230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:46:09.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:09.861+0000 7ff0aee00700 1 -- 172.21.15.82:0/1063402587 shutdown_connections 2024-05-08T05:46:09.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:09.861+0000 7ff0aee00700 1 -- 172.21.15.82:0/1063402587 wait complete. 2024-05-08T05:46:10.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:09 smithi151 ceph-mon[34815]: pgmap v322: 97 pgs: 97 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-05-08T05:46:10.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:09 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/1063402587' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-08T05:46:10.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:09 smithi082 ceph-mon[30098]: pgmap v322: 97 pgs: 97 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-05-08T05:46:10.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:09 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/1063402587' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-08T05:46:10.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:09 smithi134 ceph-mon[34132]: pgmap v322: 97 pgs: 97 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s wr, 4 op/s 2024-05-08T05:46:10.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:09 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/1063402587' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-08T05:46:10.627 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-05-08T05:46:10.627 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph fs set cephfs max_mds 5 2024-05-08T05:46:11.077 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:46:11.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:10 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/1063402587' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-08T05:46:11.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:10 smithi151 ceph-mon[34815]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-08T05:46:11.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:10 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/1063402587' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-08T05:46:11.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:10 smithi082 ceph-mon[30098]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-08T05:46:11.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:10 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/1063402587' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-08T05:46:11.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:10 smithi134 ceph-mon[34132]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-08T05:46:12.139 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:11 smithi082 ceph-mon[30098]: pgmap v323: 97 pgs: 97 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 3 op/s 2024-05-08T05:46:12.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:11 smithi134 ceph-mon[34132]: pgmap v323: 97 pgs: 97 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 3 op/s 2024-05-08T05:46:12.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:11 smithi151 ceph-mon[34815]: pgmap v323: 97 pgs: 97 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 3 op/s 2024-05-08T05:46:13.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:13.215+0000 7fdbe7000700 1 -- 172.21.15.82:0/3870507986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbe0105f90 msgr2=0x7fdbe01124a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:13.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:13.215+0000 7fdbe7000700 1 --2- 172.21.15.82:0/3870507986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbe0105f90 0x7fdbe01124a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdbd800b0a0 tx=0x7fdbd800b3b0 comp rx=0 tx=0).stop 2024-05-08T05:46:13.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:13.215+0000 7fdbe7000700 1 -- 172.21.15.82:0/3870507986 shutdown_connections 2024-05-08T05:46:13.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:13.215+0000 7fdbe7000700 1 --2- 172.21.15.82:0/3870507986 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbe010b660 0x7fdbe010ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:13.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:13.215+0000 7fdbe7000700 1 --2- 172.21.15.82:0/3870507986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbe0105f90 0x7fdbe01124a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:13.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:13.215+0000 7fdbe7000700 1 --2- 172.21.15.82:0/3870507986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdbe01055d0 0x7fdbe0105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:13.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:13.215+0000 7fdbe7000700 1 -- 172.21.15.82:0/3870507986 >> 172.21.15.82:0/3870507986 conn(0x7fdbe01010c0 msgr2=0x7fdbe01034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:46:13.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:13.215+0000 7fdbe7000700 1 -- 172.21.15.82:0/3870507986 shutdown_connections 2024-05-08T05:46:13.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:13.215+0000 7fdbe7000700 1 -- 172.21.15.82:0/3870507986 wait complete. 2024-05-08T05:46:13.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:13.217+0000 7fdbe7000700 1 Processor -- start 2024-05-08T05:46:13.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:13.217+0000 7fdbe7000700 1 -- start start 2024-05-08T05:46:13.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:13.218+0000 7fdbe7000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbe01055d0 0x7fdbe01a1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:13.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:13.218+0000 7fdbe7000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdbe0105f90 0x7fdbe01a1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:13.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:13.218+0000 7fdbe7000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbe010b660 0x7fdbe019ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:13.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:13.218+0000 7fdbe7000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe0115820 con 0x7fdbe01055d0 2024-05-08T05:46:13.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:13.218+0000 7fdbe7000700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe01156a0 con 0x7fdbe010b660 2024-05-08T05:46:13.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:13.218+0000 7fdbe7000700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe01159a0 con 0x7fdbe0105f90 2024-05-08T05:46:13.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:13.218+0000 7fdbe5200700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdbe0105f90 0x7fdbe01a1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:13.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:13.218+0000 7fdbe5c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbe01055d0 0x7fdbe01a1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:13.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:13.218+0000 7fdbe5200700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdbe0105f90 0x7fdbe01a1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:40416/0 (socket says 172.21.15.82:40416) 2024-05-08T05:46:13.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:13.218+0000 7fdbe5200700 1 -- 172.21.15.82:0/3188277129 learned_addr learned my addr 172.21.15.82:0/3188277129 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:46:13.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:13.219+0000 7fdbe6600700 1 --2- 172.21.15.82:0/3188277129 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbe010b660 0x7fdbe019ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:13.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:13.219+0000 7fdbe5200700 1 -- 172.21.15.82:0/3188277129 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbe010b660 msgr2=0x7fdbe019ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:13.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:13.219+0000 7fdbe5200700 1 --2- 172.21.15.82:0/3188277129 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbe010b660 0x7fdbe019ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:13.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:13.219+0000 7fdbe5200700 1 -- 172.21.15.82:0/3188277129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbe01055d0 msgr2=0x7fdbe01a1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:13.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:13.219+0000 7fdbe5200700 1 --2- 172.21.15.82:0/3188277129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbe01055d0 0x7fdbe01a1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:13.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:13.219+0000 7fdbe5200700 1 -- 172.21.15.82:0/3188277129 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbe019c180 con 0x7fdbe0105f90 2024-05-08T05:46:13.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:13.219+0000 7fdbe5200700 1 --2- 172.21.15.82:0/3188277129 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdbe0105f90 0x7fdbe01a1d50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc00e9c0 tx=0x7fdbcc00ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:46:13.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:13.219+0000 7fdbde000700 1 -- 172.21.15.82:0/3188277129 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc00cbd0 con 0x7fdbe0105f90 2024-05-08T05:46:13.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:13.219+0000 7fdbe7000700 1 -- 172.21.15.82:0/3188277129 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbe019c470 con 0x7fdbe0105f90 2024-05-08T05:46:13.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:13.220+0000 7fdbde000700 1 -- 172.21.15.82:0/3188277129 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdbcc00ee60 con 0x7fdbe0105f90 2024-05-08T05:46:13.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:13.220+0000 7fdbde000700 1 -- 172.21.15.82:0/3188277129 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbcc0055c0 con 0x7fdbe0105f90 2024-05-08T05:46:13.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:13.220+0000 7fdbe7000700 1 -- 172.21.15.82:0/3188277129 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbe01a86e0 con 0x7fdbe0105f90 2024-05-08T05:46:13.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:13.221+0000 7fdbe7000700 1 -- 172.21.15.82:0/3188277129 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbe006a190 con 0x7fdbe0105f90 2024-05-08T05:46:13.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:13.223+0000 7fdbde000700 1 -- 172.21.15.82:0/3188277129 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fdbcc004750 con 0x7fdbe0105f90 2024-05-08T05:46:13.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:13.224+0000 7fdbde000700 1 --2- 172.21.15.82:0/3188277129 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fdbc80b2880 0x7fdbc80b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:13.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:13.225+0000 7fdbde000700 1 -- 172.21.15.82:0/3188277129 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fdbcc0e2650 con 0x7fdbe0105f90 2024-05-08T05:46:13.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:13.225+0000 7fdbe5c00700 1 --2- 172.21.15.82:0/3188277129 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fdbc80b2880 0x7fdbc80b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:13.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:13.226+0000 7fdbe5c00700 1 --2- 172.21.15.82:0/3188277129 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fdbc80b2880 0x7fdbc80b4d40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fdbe010a670 tx=0x7fdbd4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:46:13.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:13.226+0000 7fdbde000700 1 -- 172.21.15.82:0/3188277129 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fdbcc054df0 con 0x7fdbe0105f90 2024-05-08T05:46:13.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:13.493+0000 7fdbe7000700 1 -- 172.21.15.82:0/3188277129 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7fdbe019cf00 con 0x7fdbe0105f90 2024-05-08T05:46:13.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:13.892+0000 7fdbde000700 1 -- 172.21.15.82:0/3188277129 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7fdbcc0aa420 con 0x7fdbe0105f90 2024-05-08T05:46:13.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:13.896+0000 7fdbe7000700 1 -- 172.21.15.82:0/3188277129 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fdbc80b2880 msgr2=0x7fdbc80b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:13.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:13.896+0000 7fdbe7000700 1 --2- 172.21.15.82:0/3188277129 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fdbc80b2880 0x7fdbc80b4d40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fdbe010a670 tx=0x7fdbd4009260 comp rx=0 tx=0).stop 2024-05-08T05:46:13.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:13.896+0000 7fdbe7000700 1 -- 172.21.15.82:0/3188277129 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdbe0105f90 msgr2=0x7fdbe01a1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:13.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:13.896+0000 7fdbe7000700 1 --2- 172.21.15.82:0/3188277129 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdbe0105f90 0x7fdbe01a1d50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdbcc00e9c0 tx=0x7fdbcc00ecd0 comp rx=0 tx=0).stop 2024-05-08T05:46:13.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:13.896+0000 7fdbe7000700 1 -- 172.21.15.82:0/3188277129 shutdown_connections 2024-05-08T05:46:13.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:13.896+0000 7fdbe7000700 1 --2- 172.21.15.82:0/3188277129 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdbe010b660 0x7fdbe019ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:13.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:13.896+0000 7fdbe7000700 1 --2- 172.21.15.82:0/3188277129 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fdbc80b2880 0x7fdbc80b4d40 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:13.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:13.896+0000 7fdbe7000700 1 --2- 172.21.15.82:0/3188277129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdbe01055d0 0x7fdbe01a1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:13.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:13.896+0000 7fdbe7000700 1 --2- 172.21.15.82:0/3188277129 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdbe0105f90 0x7fdbe01a1d50 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:13.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:13.896+0000 7fdbe7000700 1 -- 172.21.15.82:0/3188277129 >> 172.21.15.82:0/3188277129 conn(0x7fdbe01010c0 msgr2=0x7fdbe0102660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:46:13.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:13.896+0000 7fdbe7000700 1 -- 172.21.15.82:0/3188277129 shutdown_connections 2024-05-08T05:46:13.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:13.897+0000 7fdbe7000700 1 -- 172.21.15.82:0/3188277129 wait complete. 2024-05-08T05:46:14.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:13 smithi082 ceph-mon[30098]: pgmap v324: 97 pgs: 97 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s wr, 1 op/s 2024-05-08T05:46:14.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:13 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/3188277129' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-05-08T05:46:14.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:13 smithi082 ceph-mon[30098]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-05-08T05:46:14.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:13 smithi134 ceph-mon[34132]: pgmap v324: 97 pgs: 97 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s wr, 1 op/s 2024-05-08T05:46:14.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:13 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/3188277129' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-05-08T05:46:14.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:13 smithi134 ceph-mon[34132]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-05-08T05:46:14.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:13 smithi151 ceph-mon[34815]: pgmap v324: 97 pgs: 97 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 852 B/s wr, 1 op/s 2024-05-08T05:46:14.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:13 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/3188277129' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-05-08T05:46:14.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:13 smithi151 ceph-mon[34815]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-05-08T05:46:14.793 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-05-08T05:46:14.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:14 smithi082 ceph-mon[30098]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-08T05:46:14.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:14 smithi082 ceph-mon[30098]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-05-08T05:46:14.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:14 smithi082 ceph-mon[30098]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-08T05:46:14.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:14 smithi082 ceph-mon[30098]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-08T05:46:14.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:14 smithi082 ceph-mon[30098]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-05-08T05:46:14.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:14 smithi082 ceph-mon[30098]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-05-08T05:46:15.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:14 smithi134 ceph-mon[34132]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-08T05:46:15.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:14 smithi134 ceph-mon[34132]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-05-08T05:46:15.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:14 smithi134 ceph-mon[34132]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-08T05:46:15.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:14 smithi134 ceph-mon[34132]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-08T05:46:15.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:14 smithi134 ceph-mon[34132]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-05-08T05:46:15.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:14 smithi134 ceph-mon[34132]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-05-08T05:46:15.260 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:46:15.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:14 smithi151 ceph-mon[34815]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-08T05:46:15.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:14 smithi151 ceph-mon[34815]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-05-08T05:46:15.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:14 smithi151 ceph-mon[34815]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-08T05:46:15.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:14 smithi151 ceph-mon[34815]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-08T05:46:15.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:14 smithi151 ceph-mon[34815]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-05-08T05:46:15.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:14 smithi151 ceph-mon[34815]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-05-08T05:46:15.750 INFO:journalctl@ceph.mds.b.smithi134.stdout:May 08 05:46:15 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-b[65010]: 2024-05-08T05:46:15.480+0000 7f36f2e89700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-05-08T05:46:16.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:15 smithi082 ceph-mon[30098]: pgmap v325: 97 pgs: 97 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s wr, 0 op/s 2024-05-08T05:46:16.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:15 smithi082 ceph-mon[30098]: mds.? [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] up:active 2024-05-08T05:46:16.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:15 smithi082 ceph-mon[30098]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-08T05:46:16.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:15 smithi082 ceph-mon[30098]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-05-08T05:46:16.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:15 smithi082 ceph-mon[30098]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-05-08T05:46:16.193 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:15 smithi082 ceph-mon[30098]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-05-08T05:46:16.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:15 smithi134 ceph-mon[34132]: pgmap v325: 97 pgs: 97 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s wr, 0 op/s 2024-05-08T05:46:16.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:15 smithi134 ceph-mon[34132]: mds.? [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] up:active 2024-05-08T05:46:16.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:15 smithi134 ceph-mon[34132]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-08T05:46:16.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:15 smithi134 ceph-mon[34132]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-05-08T05:46:16.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:15 smithi134 ceph-mon[34132]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-05-08T05:46:16.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:15 smithi134 ceph-mon[34132]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-05-08T05:46:16.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:15 smithi151 ceph-mon[34815]: pgmap v325: 97 pgs: 97 active+clean; 579 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 597 B/s wr, 0 op/s 2024-05-08T05:46:16.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:15 smithi151 ceph-mon[34815]: mds.? [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] up:active 2024-05-08T05:46:16.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:15 smithi151 ceph-mon[34815]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-08T05:46:16.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:15 smithi151 ceph-mon[34815]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-05-08T05:46:16.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:15 smithi151 ceph-mon[34815]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-05-08T05:46:16.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:15 smithi151 ceph-mon[34815]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-05-08T05:46:17.184 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:16 smithi082 ceph-mon[30098]: mds.? [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] up:active 2024-05-08T05:46:17.184 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:16 smithi082 ceph-mon[30098]: daemon mds.f assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-05-08T05:46:17.184 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:16 smithi082 ceph-mon[30098]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-05-08T05:46:17.184 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:16 smithi082 ceph-mon[30098]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=f=up:creating} 8 up:standby 2024-05-08T05:46:17.184 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:16 smithi082 ceph-mon[30098]: daemon mds.f is now active in filesystem cephfs as rank 3 2024-05-08T05:46:17.184 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:16 smithi082 ceph-mon[30098]: pgmap v326: 97 pgs: 97 active+clean; 581 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 2 op/s 2024-05-08T05:46:17.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:16 smithi134 ceph-mon[34132]: mds.? [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] up:active 2024-05-08T05:46:17.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:16 smithi134 ceph-mon[34132]: daemon mds.f assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-05-08T05:46:17.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:16 smithi134 ceph-mon[34132]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-05-08T05:46:17.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:16 smithi134 ceph-mon[34132]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=f=up:creating} 8 up:standby 2024-05-08T05:46:17.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:16 smithi134 ceph-mon[34132]: daemon mds.f is now active in filesystem cephfs as rank 3 2024-05-08T05:46:17.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:16 smithi134 ceph-mon[34132]: pgmap v326: 97 pgs: 97 active+clean; 581 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 2 op/s 2024-05-08T05:46:17.281 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:16 smithi151 ceph-mon[34815]: mds.? [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] up:active 2024-05-08T05:46:17.281 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:16 smithi151 ceph-mon[34815]: daemon mds.f assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-05-08T05:46:17.281 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:16 smithi151 ceph-mon[34815]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-05-08T05:46:17.281 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:16 smithi151 ceph-mon[34815]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=f=up:creating} 8 up:standby 2024-05-08T05:46:17.281 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:16 smithi151 ceph-mon[34815]: daemon mds.f is now active in filesystem cephfs as rank 3 2024-05-08T05:46:17.281 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:16 smithi151 ceph-mon[34815]: pgmap v326: 97 pgs: 97 active+clean; 581 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 KiB/s wr, 2 op/s 2024-05-08T05:46:17.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:17.356+0000 7f7c5ba00700 1 -- 172.21.15.82:0/2994800641 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c5406c360 msgr2=0x7f7c5410fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:17.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:17.356+0000 7f7c5ba00700 1 --2- 172.21.15.82:0/2994800641 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c5406c360 0x7f7c5410fa00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7c40009990 tx=0x7f7c40009ca0 comp rx=0 tx=0).stop 2024-05-08T05:46:17.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:17.356+0000 7f7c5ba00700 1 -- 172.21.15.82:0/2994800641 shutdown_connections 2024-05-08T05:46:17.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:17.356+0000 7f7c5ba00700 1 --2- 172.21.15.82:0/2994800641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c5410ff40 0x7f7c54112330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:17.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:17.356+0000 7f7c5ba00700 1 --2- 172.21.15.82:0/2994800641 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c5406ba40 0x7f7c5406be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:17.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:17.356+0000 7f7c5ba00700 1 --2- 172.21.15.82:0/2994800641 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c5406c360 0x7f7c5410fa00 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:17.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:17.356+0000 7f7c5ba00700 1 -- 172.21.15.82:0/2994800641 >> 172.21.15.82:0/2994800641 conn(0x7f7c54079310 msgr2=0x7f7c54079720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:46:17.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:17.356+0000 7f7c5ba00700 1 -- 172.21.15.82:0/2994800641 shutdown_connections 2024-05-08T05:46:17.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:17.356+0000 7f7c5ba00700 1 -- 172.21.15.82:0/2994800641 wait complete. 2024-05-08T05:46:17.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:17.358+0000 7f7c5ba00700 1 Processor -- start 2024-05-08T05:46:17.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:17.358+0000 7f7c5ba00700 1 -- start start 2024-05-08T05:46:17.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:17.358+0000 7f7c5ba00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c5406ba40 0x7f7c5419bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:17.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:17.358+0000 7f7c5ba00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c5406c360 0x7f7c5419c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:17.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:17.358+0000 7f7c5ba00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c5410ff40 0x7f7c541a0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:17.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:17.358+0000 7f7c5ba00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7c54115870 con 0x7f7c5406ba40 2024-05-08T05:46:17.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:17.358+0000 7f7c5ba00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7c541156f0 con 0x7f7c5406c360 2024-05-08T05:46:17.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:17.358+0000 7f7c5ba00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7c541159f0 con 0x7f7c5410ff40 2024-05-08T05:46:17.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:17.359+0000 7f7c53e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c5406c360 0x7f7c5419c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:17.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:17.359+0000 7f7c59000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c5406ba40 0x7f7c5419bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:17.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:17.359+0000 7f7c53e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c5406c360 0x7f7c5419c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:60532/0 (socket says 172.21.15.82:60532) 2024-05-08T05:46:17.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:17.359+0000 7f7c53e00700 1 -- 172.21.15.82:0/4264647129 learned_addr learned my addr 172.21.15.82:0/4264647129 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:46:17.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:17.359+0000 7f7c59a00700 1 --2- 172.21.15.82:0/4264647129 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c5410ff40 0x7f7c541a0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:17.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:17.359+0000 7f7c53e00700 1 -- 172.21.15.82:0/4264647129 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c5410ff40 msgr2=0x7f7c541a0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:17.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:17.359+0000 7f7c53e00700 1 --2- 172.21.15.82:0/4264647129 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c5410ff40 0x7f7c541a0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:17.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:17.359+0000 7f7c53e00700 1 -- 172.21.15.82:0/4264647129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c5406ba40 msgr2=0x7f7c5419bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:17.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:17.359+0000 7f7c53e00700 1 --2- 172.21.15.82:0/4264647129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c5406ba40 0x7f7c5419bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:17.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:17.359+0000 7f7c53e00700 1 -- 172.21.15.82:0/4264647129 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c541a0d90 con 0x7f7c5406c360 2024-05-08T05:46:17.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:17.359+0000 7f7c59a00700 1 --2- 172.21.15.82:0/4264647129 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c5410ff40 0x7f7c541a0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:46:17.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:17.359+0000 7f7c53e00700 1 --2- 172.21.15.82:0/4264647129 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c5406c360 0x7f7c5419c2c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7c400057c0 tx=0x7f7c40009580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:46:17.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:17.359+0000 7f7c51600700 1 -- 172.21.15.82:0/4264647129 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c40026070 con 0x7f7c5406c360 2024-05-08T05:46:17.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:17.360+0000 7f7c51600700 1 -- 172.21.15.82:0/4264647129 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7c40021410 con 0x7f7c5406c360 2024-05-08T05:46:17.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:17.360+0000 7f7c5ba00700 1 -- 172.21.15.82:0/4264647129 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c541a1020 con 0x7f7c5406c360 2024-05-08T05:46:17.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:17.360+0000 7f7c51600700 1 -- 172.21.15.82:0/4264647129 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c40017650 con 0x7f7c5406c360 2024-05-08T05:46:17.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:17.360+0000 7f7c5ba00700 1 -- 172.21.15.82:0/4264647129 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c541a8900 con 0x7f7c5406c360 2024-05-08T05:46:17.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:17.361+0000 7f7c5ba00700 1 -- 172.21.15.82:0/4264647129 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c5406a190 con 0x7f7c5406c360 2024-05-08T05:46:17.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:17.363+0000 7f7c51600700 1 -- 172.21.15.82:0/4264647129 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f7c40029070 con 0x7f7c5406c360 2024-05-08T05:46:17.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:17.364+0000 7f7c51600700 1 --2- 172.21.15.82:0/4264647129 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7c3c0b2880 0x7f7c3c0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:17.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:17.365+0000 7f7c51600700 1 -- 172.21.15.82:0/4264647129 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f7c400e2e90 con 0x7f7c5406c360 2024-05-08T05:46:17.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:17.365+0000 7f7c59000700 1 --2- 172.21.15.82:0/4264647129 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7c3c0b2880 0x7f7c3c0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:17.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:17.365+0000 7f7c59000700 1 --2- 172.21.15.82:0/4264647129 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7c3c0b2880 0x7f7c3c0b4d40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7c48004630 tx=0x7f7c4800b3c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:46:17.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:17.369+0000 7f7c51600700 1 -- 172.21.15.82:0/4264647129 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f7c40013070 con 0x7f7c5406c360 2024-05-08T05:46:17.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:17.654+0000 7f7c5ba00700 1 -- 172.21.15.82:0/4264647129 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f7c5402e510 con 0x7f7c5406c360 2024-05-08T05:46:17.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:17.965+0000 7f7c51600700 1 -- 172.21.15.82:0/4264647129 <== mon.2 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v26) ==== 121+0+0 (secure 0 0 0) 0x7f7c400aad80 con 0x7f7c5406c360 2024-05-08T05:46:17.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:17.970+0000 7f7c5ba00700 1 -- 172.21.15.82:0/4264647129 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7c3c0b2880 msgr2=0x7f7c3c0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:17.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:17.970+0000 7f7c5ba00700 1 --2- 172.21.15.82:0/4264647129 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7c3c0b2880 0x7f7c3c0b4d40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7c48004630 tx=0x7f7c4800b3c0 comp rx=0 tx=0).stop 2024-05-08T05:46:17.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:17.970+0000 7f7c5ba00700 1 -- 172.21.15.82:0/4264647129 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c5406c360 msgr2=0x7f7c5419c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:17.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:17.970+0000 7f7c5ba00700 1 --2- 172.21.15.82:0/4264647129 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c5406c360 0x7f7c5419c2c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7c400057c0 tx=0x7f7c40009580 comp rx=0 tx=0).stop 2024-05-08T05:46:17.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:17.970+0000 7f7c5ba00700 1 -- 172.21.15.82:0/4264647129 shutdown_connections 2024-05-08T05:46:17.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:17.970+0000 7f7c5ba00700 1 --2- 172.21.15.82:0/4264647129 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7c3c0b2880 0x7f7c3c0b4d40 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:17.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:17.970+0000 7f7c5ba00700 1 --2- 172.21.15.82:0/4264647129 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c5410ff40 0x7f7c541a0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:17.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:17.970+0000 7f7c5ba00700 1 --2- 172.21.15.82:0/4264647129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7c5406ba40 0x7f7c5419bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:17.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:17.970+0000 7f7c5ba00700 1 --2- 172.21.15.82:0/4264647129 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c5406c360 0x7f7c5419c2c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:17.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:17.970+0000 7f7c5ba00700 1 -- 172.21.15.82:0/4264647129 >> 172.21.15.82:0/4264647129 conn(0x7f7c54079310 msgr2=0x7f7c541113f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:46:17.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:17.970+0000 7f7c5ba00700 1 -- 172.21.15.82:0/4264647129 shutdown_connections 2024-05-08T05:46:17.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:17.970+0000 7f7c5ba00700 1 -- 172.21.15.82:0/4264647129 wait complete. 2024-05-08T05:46:18.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:17 smithi082 ceph-mon[30098]: mds.? [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] up:active 2024-05-08T05:46:18.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:17 smithi082 ceph-mon[30098]: daemon mds.h assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-05-08T05:46:18.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:17 smithi082 ceph-mon[30098]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-08T05:46:18.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:17 smithi082 ceph-mon[30098]: Cluster is now healthy 2024-05-08T05:46:18.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:17 smithi082 ceph-mon[30098]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=f=up:active} 8 up:standby 2024-05-08T05:46:18.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:17 smithi082 ceph-mon[30098]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-05-08T05:46:18.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:17 smithi082 ceph-mon[30098]: daemon mds.h is now active in filesystem cephfs as rank 4 2024-05-08T05:46:18.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:17 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/4264647129' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-08T05:46:18.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:17 smithi082 ceph-mon[30098]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-08T05:46:18.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:17 smithi134 ceph-mon[34132]: mds.? [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] up:active 2024-05-08T05:46:18.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:17 smithi134 ceph-mon[34132]: daemon mds.h assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-05-08T05:46:18.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:17 smithi134 ceph-mon[34132]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-08T05:46:18.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:17 smithi134 ceph-mon[34132]: Cluster is now healthy 2024-05-08T05:46:18.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:17 smithi134 ceph-mon[34132]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=f=up:active} 8 up:standby 2024-05-08T05:46:18.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:17 smithi134 ceph-mon[34132]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-05-08T05:46:18.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:17 smithi134 ceph-mon[34132]: daemon mds.h is now active in filesystem cephfs as rank 4 2024-05-08T05:46:18.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:17 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/4264647129' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-08T05:46:18.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:17 smithi134 ceph-mon[34132]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-08T05:46:18.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:17 smithi151 ceph-mon[34815]: mds.? [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] up:active 2024-05-08T05:46:18.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:17 smithi151 ceph-mon[34815]: daemon mds.h assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-05-08T05:46:18.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:17 smithi151 ceph-mon[34815]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-08T05:46:18.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:17 smithi151 ceph-mon[34815]: Cluster is now healthy 2024-05-08T05:46:18.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:17 smithi151 ceph-mon[34815]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=c=up:active,3=f=up:active} 8 up:standby 2024-05-08T05:46:18.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:17 smithi151 ceph-mon[34815]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-05-08T05:46:18.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:17 smithi151 ceph-mon[34815]: daemon mds.h is now active in filesystem cephfs as rank 4 2024-05-08T05:46:18.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:17 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/4264647129' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-08T05:46:18.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:17 smithi151 ceph-mon[34815]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-08T05:46:18.849 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-05-08T05:46:19.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:18 smithi082 ceph-mon[30098]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-08T05:46:19.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:18 smithi082 ceph-mon[30098]: mds.? [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] up:active 2024-05-08T05:46:19.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:18 smithi082 ceph-mon[30098]: fsmap cephfs:5 7 up:standby 5 up:active 2024-05-08T05:46:19.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:18 smithi082 ceph-mon[30098]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-08T05:46:19.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:18 smithi082 ceph-mon[30098]: pgmap v327: 97 pgs: 97 active+clean; 582 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 5 op/s 2024-05-08T05:46:19.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:18 smithi134 ceph-mon[34132]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-08T05:46:19.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:18 smithi134 ceph-mon[34132]: mds.? [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] up:active 2024-05-08T05:46:19.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:18 smithi134 ceph-mon[34132]: fsmap cephfs:5 7 up:standby 5 up:active 2024-05-08T05:46:19.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:18 smithi134 ceph-mon[34132]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-08T05:46:19.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:18 smithi134 ceph-mon[34132]: pgmap v327: 97 pgs: 97 active+clean; 582 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 5 op/s 2024-05-08T05:46:19.292 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:46:19.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:18 smithi151 ceph-mon[34815]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-08T05:46:19.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:18 smithi151 ceph-mon[34815]: mds.? [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] up:active 2024-05-08T05:46:19.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:18 smithi151 ceph-mon[34815]: fsmap cephfs:5 7 up:standby 5 up:active 2024-05-08T05:46:19.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:18 smithi151 ceph-mon[34815]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-08T05:46:19.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:18 smithi151 ceph-mon[34815]: pgmap v327: 97 pgs: 97 active+clean; 582 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 5 op/s 2024-05-08T05:46:21.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:21.411+0000 7f4e73200700 1 -- 172.21.15.82:0/3127223435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e6c1056c0 msgr2=0x7f4e6c105b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:21.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:21.411+0000 7f4e73200700 1 --2- 172.21.15.82:0/3127223435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e6c1056c0 0x7f4e6c105b40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4e54009990 tx=0x7f4e54009ca0 comp rx=0 tx=0).stop 2024-05-08T05:46:21.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:21.411+0000 7f4e73200700 1 -- 172.21.15.82:0/3127223435 shutdown_connections 2024-05-08T05:46:21.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:21.411+0000 7f4e73200700 1 --2- 172.21.15.82:0/3127223435 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e6c10b6c0 0x7f4e6c10baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:21.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:21.411+0000 7f4e73200700 1 --2- 172.21.15.82:0/3127223435 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e6c106080 0x7f4e6c112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:21.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:21.411+0000 7f4e73200700 1 --2- 172.21.15.82:0/3127223435 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e6c1056c0 0x7f4e6c105b40 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:21.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:21.411+0000 7f4e73200700 1 -- 172.21.15.82:0/3127223435 >> 172.21.15.82:0/3127223435 conn(0x7f4e6c1011b0 msgr2=0x7f4e6c1035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:46:21.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:21.411+0000 7f4e73200700 1 -- 172.21.15.82:0/3127223435 shutdown_connections 2024-05-08T05:46:21.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:21.412+0000 7f4e73200700 1 -- 172.21.15.82:0/3127223435 wait complete. 2024-05-08T05:46:21.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:21.413+0000 7f4e73200700 1 Processor -- start 2024-05-08T05:46:21.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:21.413+0000 7f4e73200700 1 -- start start 2024-05-08T05:46:21.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:21.413+0000 7f4e73200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e6c1056c0 0x7f4e6c19bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:21.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:21.413+0000 7f4e73200700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e6c106080 0x7f4e6c19c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:21.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:21.413+0000 7f4e73200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e6c10b6c0 0x7f4e6c1a0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:21.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:21.413+0000 7f4e73200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4e6c115900 con 0x7f4e6c1056c0 2024-05-08T05:46:21.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:21.413+0000 7f4e73200700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4e6c115780 con 0x7f4e6c10b6c0 2024-05-08T05:46:21.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:21.413+0000 7f4e73200700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f4e6c115a80 con 0x7f4e6c106080 2024-05-08T05:46:21.415 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:21 smithi082 ceph-mon[30098]: pgmap v328: 97 pgs: 97 active+clean; 584 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3.8 KiB/s wr, 14 op/s 2024-05-08T05:46:21.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:21.413+0000 7f4e6be00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e6c1056c0 0x7f4e6c19bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:21.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:21.413+0000 7f4e63e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e6c106080 0x7f4e6c19c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:21.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:21.414+0000 7f4e6be00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e6c1056c0 0x7f4e6c19bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40162/0 (socket says 172.21.15.82:40162) 2024-05-08T05:46:21.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:21.414+0000 7f4e6be00700 1 -- 172.21.15.82:0/4106455990 learned_addr learned my addr 172.21.15.82:0/4106455990 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:46:21.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:21.414+0000 7f4e71200700 1 --2- 172.21.15.82:0/4106455990 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e6c10b6c0 0x7f4e6c1a0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:21.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:21.414+0000 7f4e63e00700 1 -- 172.21.15.82:0/4106455990 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e6c10b6c0 msgr2=0x7f4e6c1a0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:21.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:21.414+0000 7f4e63e00700 1 --2- 172.21.15.82:0/4106455990 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e6c10b6c0 0x7f4e6c1a0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:21.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:21.414+0000 7f4e63e00700 1 -- 172.21.15.82:0/4106455990 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e6c1056c0 msgr2=0x7f4e6c19bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:21.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:21.414+0000 7f4e63e00700 1 --2- 172.21.15.82:0/4106455990 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e6c1056c0 0x7f4e6c19bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:21.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:21.414+0000 7f4e63e00700 1 -- 172.21.15.82:0/4106455990 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e6c1a0dc0 con 0x7f4e6c106080 2024-05-08T05:46:21.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:21.414+0000 7f4e6be00700 1 --2- 172.21.15.82:0/4106455990 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e6c1056c0 0x7f4e6c19bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:46:21.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:21.414+0000 7f4e63e00700 1 --2- 172.21.15.82:0/4106455990 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e6c106080 0x7f4e6c19c2f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4e54000c00 tx=0x7f4e540047b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:46:21.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:21.415+0000 7f4e69600700 1 -- 172.21.15.82:0/4106455990 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e5400fb10 con 0x7f4e6c106080 2024-05-08T05:46:21.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:21.415+0000 7f4e69600700 1 -- 172.21.15.82:0/4106455990 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4e54004ce0 con 0x7f4e6c106080 2024-05-08T05:46:21.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:21.415+0000 7f4e73200700 1 -- 172.21.15.82:0/4106455990 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e6c1a1050 con 0x7f4e6c106080 2024-05-08T05:46:21.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:21.415+0000 7f4e69600700 1 -- 172.21.15.82:0/4106455990 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e54005390 con 0x7f4e6c106080 2024-05-08T05:46:21.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:21.415+0000 7f4e73200700 1 -- 172.21.15.82:0/4106455990 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e6c1a8930 con 0x7f4e6c106080 2024-05-08T05:46:21.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:21.416+0000 7f4e73200700 1 -- 172.21.15.82:0/4106455990 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e6c06a190 con 0x7f4e6c106080 2024-05-08T05:46:21.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:21.418+0000 7f4e69600700 1 -- 172.21.15.82:0/4106455990 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f4e54009d10 con 0x7f4e6c106080 2024-05-08T05:46:21.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:21.420+0000 7f4e69600700 1 --2- 172.21.15.82:0/4106455990 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f4e500b2880 0x7f4e500b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:21.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:21.420+0000 7f4e69600700 1 -- 172.21.15.82:0/4106455990 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f4e540e2c20 con 0x7f4e6c106080 2024-05-08T05:46:21.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:21.420+0000 7f4e6be00700 1 --2- 172.21.15.82:0/4106455990 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f4e500b2880 0x7f4e500b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:21.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:21.420+0000 7f4e6be00700 1 --2- 172.21.15.82:0/4106455990 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f4e500b2880 0x7f4e500b4d40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c011550 tx=0x7f4e5c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:46:21.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:21.424+0000 7f4e69600700 1 -- 172.21.15.82:0/4106455990 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4e54013070 con 0x7f4e6c106080 2024-05-08T05:46:21.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:21 smithi134 ceph-mon[34132]: pgmap v328: 97 pgs: 97 active+clean; 584 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3.8 KiB/s wr, 14 op/s 2024-05-08T05:46:21.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:21 smithi151 ceph-mon[34815]: pgmap v328: 97 pgs: 97 active+clean; 584 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 3.8 KiB/s wr, 14 op/s 2024-05-08T05:46:21.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:21.710+0000 7f4e73200700 1 -- 172.21.15.82:0/4106455990 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f4e6c02e510 con 0x7f4e6c106080 2024-05-08T05:46:22.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:22.181+0000 7f4e69600700 1 -- 172.21.15.82:0/4106455990 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v28) ==== 115+0+0 (secure 0 0 0) 0x7f4e540aaa80 con 0x7f4e6c106080 2024-05-08T05:46:22.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:22.185+0000 7f4e73200700 1 -- 172.21.15.82:0/4106455990 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f4e500b2880 msgr2=0x7f4e500b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:22.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:22.185+0000 7f4e73200700 1 --2- 172.21.15.82:0/4106455990 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f4e500b2880 0x7f4e500b4d40 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c011550 tx=0x7f4e5c009260 comp rx=0 tx=0).stop 2024-05-08T05:46:22.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:22.185+0000 7f4e73200700 1 -- 172.21.15.82:0/4106455990 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e6c106080 msgr2=0x7f4e6c19c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:22.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:22.185+0000 7f4e73200700 1 --2- 172.21.15.82:0/4106455990 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e6c106080 0x7f4e6c19c2f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4e54000c00 tx=0x7f4e540047b0 comp rx=0 tx=0).stop 2024-05-08T05:46:22.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:22.185+0000 7f4e73200700 1 -- 172.21.15.82:0/4106455990 shutdown_connections 2024-05-08T05:46:22.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:22.185+0000 7f4e73200700 1 --2- 172.21.15.82:0/4106455990 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e6c10b6c0 0x7f4e6c1a0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:22.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:22.185+0000 7f4e73200700 1 --2- 172.21.15.82:0/4106455990 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f4e500b2880 0x7f4e500b4d40 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:22.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:22.185+0000 7f4e73200700 1 --2- 172.21.15.82:0/4106455990 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4e6c1056c0 0x7f4e6c19bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:22.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:22.185+0000 7f4e73200700 1 --2- 172.21.15.82:0/4106455990 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e6c106080 0x7f4e6c19c2f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:22.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:22.185+0000 7f4e73200700 1 -- 172.21.15.82:0/4106455990 >> 172.21.15.82:0/4106455990 conn(0x7f4e6c1011b0 msgr2=0x7f4e6c1018e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:46:22.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:22.185+0000 7f4e73200700 1 -- 172.21.15.82:0/4106455990 shutdown_connections 2024-05-08T05:46:22.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:22.185+0000 7f4e73200700 1 -- 172.21.15.82:0/4106455990 wait complete. 2024-05-08T05:46:22.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:22 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/4106455990' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-08T05:46:22.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:22 smithi082 ceph-mon[30098]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-08T05:46:22.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:22 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/4106455990' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-08T05:46:22.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:22 smithi134 ceph-mon[34132]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-08T05:46:22.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:22 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/4106455990' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-08T05:46:22.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:22 smithi151 ceph-mon[34815]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-08T05:46:22.983 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2024-05-08T05:46:22.983 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-05-08T05:46:23.430 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:46:23.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:23 smithi082 ceph-mon[30098]: pgmap v329: 97 pgs: 97 active+clean; 584 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 4.0 KiB/s wr, 17 op/s 2024-05-08T05:46:23.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:23 smithi082 ceph-mon[30098]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-08T05:46:23.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:23 smithi082 ceph-mon[30098]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-08T05:46:23.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:23 smithi134 ceph-mon[34132]: pgmap v329: 97 pgs: 97 active+clean; 584 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 4.0 KiB/s wr, 17 op/s 2024-05-08T05:46:23.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:23 smithi134 ceph-mon[34132]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-08T05:46:23.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:23 smithi134 ceph-mon[34132]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-08T05:46:23.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:23 smithi151 ceph-mon[34815]: pgmap v329: 97 pgs: 97 active+clean; 584 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 4.0 KiB/s wr, 17 op/s 2024-05-08T05:46:23.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:23 smithi151 ceph-mon[34815]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-08T05:46:23.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:23 smithi151 ceph-mon[34815]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-08T05:46:25.374 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:25 smithi082 ceph-mon[30098]: pgmap v330: 97 pgs: 97 active+clean; 584 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 4.0 KiB/s wr, 19 op/s 2024-05-08T05:46:25.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:25 smithi134 ceph-mon[34132]: pgmap v330: 97 pgs: 97 active+clean; 584 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 4.0 KiB/s wr, 19 op/s 2024-05-08T05:46:25.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:25.542+0000 7f9f3b800700 1 -- 172.21.15.82:0/150307975 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f341043b0 msgr2=0x7f9f3406bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:25.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:25.542+0000 7f9f3b800700 1 --2- 172.21.15.82:0/150307975 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f341043b0 0x7f9f3406bb70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9f28009990 tx=0x7f9f28009ca0 comp rx=0 tx=0).stop 2024-05-08T05:46:25.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:25.542+0000 7f9f3b800700 1 -- 172.21.15.82:0/150307975 shutdown_connections 2024-05-08T05:46:25.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:25.542+0000 7f9f3b800700 1 --2- 172.21.15.82:0/150307975 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f341043b0 0x7f9f3406bb70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:25.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:25.542+0000 7f9f3b800700 1 --2- 172.21.15.82:0/150307975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f3410fdf0 0x7f9f341121e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:25.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:25.542+0000 7f9f3b800700 1 --2- 172.21.15.82:0/150307975 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f3406c0b0 0x7f9f3406c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:25.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:25.542+0000 7f9f3b800700 1 -- 172.21.15.82:0/150307975 >> 172.21.15.82:0/150307975 conn(0x7f9f34079350 msgr2=0x7f9f34079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:46:25.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:25.543+0000 7f9f3b800700 1 -- 172.21.15.82:0/150307975 shutdown_connections 2024-05-08T05:46:25.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:25.543+0000 7f9f3b800700 1 -- 172.21.15.82:0/150307975 wait complete. 2024-05-08T05:46:25.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:25.544+0000 7f9f3b800700 1 Processor -- start 2024-05-08T05:46:25.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:25.544+0000 7f9f3b800700 1 -- start start 2024-05-08T05:46:25.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:25.544+0000 7f9f3b800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f3406c0b0 0x7f9f3419bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:25.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:25.544+0000 7f9f3b800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f341043b0 0x7f9f3419c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:25.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:25.544+0000 7f9f3b800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f3410fdf0 0x7f9f341a06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:25.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:25.544+0000 7f9f3b800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9f341158c0 con 0x7f9f3406c0b0 2024-05-08T05:46:25.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:25.544+0000 7f9f3b800700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9f34115740 con 0x7f9f3410fdf0 2024-05-08T05:46:25.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:25.544+0000 7f9f3b800700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9f34115a40 con 0x7f9f341043b0 2024-05-08T05:46:25.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:25.545+0000 7f9f38e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f3406c0b0 0x7f9f3419bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:25.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:25.545+0000 7f9f38e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f3406c0b0 0x7f9f3419bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33480/0 (socket says 172.21.15.82:33480) 2024-05-08T05:46:25.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:25.545+0000 7f9f33e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f341043b0 0x7f9f3419c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:25.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:25.545+0000 7f9f38e00700 1 -- 172.21.15.82:0/307146160 learned_addr learned my addr 172.21.15.82:0/307146160 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:46:25.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:25.545+0000 7f9f39800700 1 --2- 172.21.15.82:0/307146160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f3410fdf0 0x7f9f341a06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:25.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:25.545+0000 7f9f38e00700 1 -- 172.21.15.82:0/307146160 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f341043b0 msgr2=0x7f9f3419c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:25.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:25.545+0000 7f9f38e00700 1 --2- 172.21.15.82:0/307146160 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f341043b0 0x7f9f3419c310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:25.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:25.545+0000 7f9f38e00700 1 -- 172.21.15.82:0/307146160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f3410fdf0 msgr2=0x7f9f341a06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:25.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:25.545+0000 7f9f38e00700 1 --2- 172.21.15.82:0/307146160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f3410fdf0 0x7f9f341a06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:25.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:25.545+0000 7f9f38e00700 1 -- 172.21.15.82:0/307146160 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f341a0de0 con 0x7f9f3406c0b0 2024-05-08T05:46:25.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:25.546+0000 7f9f38e00700 1 --2- 172.21.15.82:0/307146160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f3406c0b0 0x7f9f3419bdd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9f28000c00 tx=0x7f9f280057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:46:25.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:25.546+0000 7f9f31600700 1 -- 172.21.15.82:0/307146160 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f28027070 con 0x7f9f3406c0b0 2024-05-08T05:46:25.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:25.546+0000 7f9f31600700 1 -- 172.21.15.82:0/307146160 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f28022470 con 0x7f9f3406c0b0 2024-05-08T05:46:25.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:25.546+0000 7f9f31600700 1 -- 172.21.15.82:0/307146160 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f28017650 con 0x7f9f3406c0b0 2024-05-08T05:46:25.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:25.546+0000 7f9f3b800700 1 -- 172.21.15.82:0/307146160 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f341a1070 con 0x7f9f3406c0b0 2024-05-08T05:46:25.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:25.546+0000 7f9f3b800700 1 -- 172.21.15.82:0/307146160 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f341a8950 con 0x7f9f3406c0b0 2024-05-08T05:46:25.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:25.547+0000 7f9f3b800700 1 -- 172.21.15.82:0/307146160 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f341029e0 con 0x7f9f3406c0b0 2024-05-08T05:46:25.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:25.550+0000 7f9f31600700 1 -- 172.21.15.82:0/307146160 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f9f2802a070 con 0x7f9f3406c0b0 2024-05-08T05:46:25.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:25.551+0000 7f9f31600700 1 --2- 172.21.15.82:0/307146160 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9f1c0b2900 0x7f9f1c0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:25.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:25.551+0000 7f9f31600700 1 -- 172.21.15.82:0/307146160 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f9f280e2e40 con 0x7f9f3406c0b0 2024-05-08T05:46:25.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:25.551+0000 7f9f33e00700 1 --2- 172.21.15.82:0/307146160 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9f1c0b2900 0x7f9f1c0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:25.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:25.552+0000 7f9f33e00700 1 --2- 172.21.15.82:0/307146160 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9f1c0b2900 0x7f9f1c0b4dc0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9f34079c50 tx=0x7f9f24009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:46:25.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:25.554+0000 7f9f31600700 1 -- 172.21.15.82:0/307146160 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9f28013070 con 0x7f9f3406c0b0 2024-05-08T05:46:25.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:25 smithi151 ceph-mon[34815]: pgmap v330: 97 pgs: 97 active+clean; 584 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 4.0 KiB/s wr, 19 op/s 2024-05-08T05:46:25.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:25.818+0000 7f9f3b800700 1 -- 172.21.15.82:0/307146160 --> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f9f34101e80 con 0x7f9f1c0b2900 2024-05-08T05:46:25.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:25.853+0000 7f9f31600700 1 -- 172.21.15.82:0/307146160 <== mgr.14152 v2:172.21.15.82:6800/4089180091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f9f34101e80 con 0x7f9f1c0b2900 2024-05-08T05:46:25.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:25.856+0000 7f9f3b800700 1 -- 172.21.15.82:0/307146160 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9f1c0b2900 msgr2=0x7f9f1c0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:25.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:25.856+0000 7f9f3b800700 1 --2- 172.21.15.82:0/307146160 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9f1c0b2900 0x7f9f1c0b4dc0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9f34079c50 tx=0x7f9f24009260 comp rx=0 tx=0).stop 2024-05-08T05:46:25.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:25.856+0000 7f9f3b800700 1 -- 172.21.15.82:0/307146160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f3406c0b0 msgr2=0x7f9f3419bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:25.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:25.856+0000 7f9f3b800700 1 --2- 172.21.15.82:0/307146160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f3406c0b0 0x7f9f3419bdd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f9f28000c00 tx=0x7f9f280057c0 comp rx=0 tx=0).stop 2024-05-08T05:46:25.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:25.856+0000 7f9f3b800700 1 -- 172.21.15.82:0/307146160 shutdown_connections 2024-05-08T05:46:25.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:25.856+0000 7f9f3b800700 1 --2- 172.21.15.82:0/307146160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9f3410fdf0 0x7f9f341a06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:25.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:25.856+0000 7f9f3b800700 1 --2- 172.21.15.82:0/307146160 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9f1c0b2900 0x7f9f1c0b4dc0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:25.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:25.856+0000 7f9f3b800700 1 --2- 172.21.15.82:0/307146160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9f3406c0b0 0x7f9f3419bdd0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:25.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:25.856+0000 7f9f3b800700 1 --2- 172.21.15.82:0/307146160 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f341043b0 0x7f9f3419c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:25.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:25.856+0000 7f9f3b800700 1 -- 172.21.15.82:0/307146160 >> 172.21.15.82:0/307146160 conn(0x7f9f34079350 msgr2=0x7f9f34101770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:46:25.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:25.857+0000 7f9f3b800700 1 -- 172.21.15.82:0/307146160 shutdown_connections 2024-05-08T05:46:25.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:25.857+0000 7f9f3b800700 1 -- 172.21.15.82:0/307146160 wait complete. 2024-05-08T05:46:26.199 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:46:25 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:46:25.829+0000 7f6e23000700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T05:46:26.199 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:46:25 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:46:25.829+0000 7f6e23000700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T05:46:26.199 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:46:25 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:46:25.829+0000 7f6e23000700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T05:46:26.199 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:46:25 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:46:25.829+0000 7f6e23000700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T05:46:26.199 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:46:25 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:46:25.829+0000 7f6e23000700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T05:46:26.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:26 smithi082 ceph-mon[30098]: from='client.14487 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:46:26.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:26 smithi134 ceph-mon[34132]: from='client.14487 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:46:26.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:26 smithi151 ceph-mon[34815]: from='client.14487 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:46:26.648 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-05-08T05:46:27.131 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:46:27.460 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:27 smithi082 ceph-mon[30098]: pgmap v331: 97 pgs: 97 active+clean; 584 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 4.0 KiB/s wr, 20 op/s 2024-05-08T05:46:27.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:27 smithi134 ceph-mon[34132]: pgmap v331: 97 pgs: 97 active+clean; 584 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 4.0 KiB/s wr, 20 op/s 2024-05-08T05:46:27.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:27 smithi151 ceph-mon[34815]: pgmap v331: 97 pgs: 97 active+clean; 584 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 4.0 KiB/s wr, 20 op/s 2024-05-08T05:46:28.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:28 smithi082 ceph-mon[30098]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-05-08T05:46:28.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:28 smithi134 ceph-mon[34132]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-05-08T05:46:28.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:28 smithi151 ceph-mon[34815]: mgrmap e17: x(active, since 8m), standbys: z, y 2024-05-08T05:46:29.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:29.297+0000 7f8291600700 1 -- 172.21.15.82:0/2900910018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f828c10a3a0 msgr2=0x7f828c116840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:29.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:29.297+0000 7f8291600700 1 --2- 172.21.15.82:0/2900910018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f828c10a3a0 0x7f828c116840 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f828400b0a0 tx=0x7f828400b3b0 comp rx=0 tx=0).stop 2024-05-08T05:46:29.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:29.297+0000 7f8291600700 1 -- 172.21.15.82:0/2900910018 shutdown_connections 2024-05-08T05:46:29.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:29.297+0000 7f8291600700 1 --2- 172.21.15.82:0/2900910018 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f828c10a3a0 0x7f828c116840 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:29.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:29.297+0000 7f8291600700 1 --2- 172.21.15.82:0/2900910018 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f828c10e8b0 0x7f828c10ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:29.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:29.297+0000 7f8291600700 1 --2- 172.21.15.82:0/2900910018 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f828c1099e0 0x7f828c109e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:29.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:29.297+0000 7f8291600700 1 -- 172.21.15.82:0/2900910018 >> 172.21.15.82:0/2900910018 conn(0x7f828c079230 msgr2=0x7f828c1082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:46:29.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:29.297+0000 7f8291600700 1 -- 172.21.15.82:0/2900910018 shutdown_connections 2024-05-08T05:46:29.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:29.297+0000 7f8291600700 1 -- 172.21.15.82:0/2900910018 wait complete. 2024-05-08T05:46:29.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:29.298+0000 7f8291600700 1 Processor -- start 2024-05-08T05:46:29.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:29.298+0000 7f8291600700 1 -- start start 2024-05-08T05:46:29.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:29.299+0000 7f8291600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f828c1099e0 0x7f828c1a0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:29.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:29.299+0000 7f8291600700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f828c10a3a0 0x7f828c1a05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:29.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:29.299+0000 7f8291600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f828c10e8b0 0x7f828c1a4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:29.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:29.299+0000 7f8291600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f828c119b70 con 0x7f828c1099e0 2024-05-08T05:46:29.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:29.299+0000 7f8291600700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f828c1199f0 con 0x7f828c10e8b0 2024-05-08T05:46:29.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:29.299+0000 7f8291600700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f828c119cf0 con 0x7f828c10a3a0 2024-05-08T05:46:29.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:29.299+0000 7f828be00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f828c1099e0 0x7f828c1a0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:29.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:29.299+0000 7f8283e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f828c10a3a0 0x7f828c1a05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:29.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:29.299+0000 7f828be00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f828c1099e0 0x7f828c1a0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33522/0 (socket says 172.21.15.82:33522) 2024-05-08T05:46:29.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:29.299+0000 7f8283e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f828c10a3a0 0x7f828c1a05a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:58480/0 (socket says 172.21.15.82:58480) 2024-05-08T05:46:29.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:29.299+0000 7f828be00700 1 -- 172.21.15.82:0/2644014363 learned_addr learned my addr 172.21.15.82:0/2644014363 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:46:29.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:29.299+0000 7f8290c00700 1 --2- 172.21.15.82:0/2644014363 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f828c10e8b0 0x7f828c1a4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:29.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:29.299+0000 7f828be00700 1 -- 172.21.15.82:0/2644014363 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f828c10a3a0 msgr2=0x7f828c1a05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:29.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:29.299+0000 7f828be00700 1 --2- 172.21.15.82:0/2644014363 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f828c10a3a0 0x7f828c1a05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:29.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:29.299+0000 7f828be00700 1 -- 172.21.15.82:0/2644014363 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f828c10e8b0 msgr2=0x7f828c1a4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:29.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:29.299+0000 7f828be00700 1 --2- 172.21.15.82:0/2644014363 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f828c10e8b0 0x7f828c1a4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:29.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:29.299+0000 7f828be00700 1 -- 172.21.15.82:0/2644014363 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f828c1a5070 con 0x7f828c1099e0 2024-05-08T05:46:29.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:29.299+0000 7f8290c00700 1 --2- 172.21.15.82:0/2644014363 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f828c10e8b0 0x7f828c1a4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:46:29.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:29.300+0000 7f828be00700 1 --2- 172.21.15.82:0/2644014363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f828c1099e0 0x7f828c1a0060 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f827c00e9a0 tx=0x7f827c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:46:29.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:29.300+0000 7f8289600700 1 -- 172.21.15.82:0/2644014363 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f827c00ca10 con 0x7f828c1099e0 2024-05-08T05:46:29.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:29.300+0000 7f8289600700 1 -- 172.21.15.82:0/2644014363 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f827c00cbb0 con 0x7f828c1099e0 2024-05-08T05:46:29.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:29.300+0000 7f8291600700 1 -- 172.21.15.82:0/2644014363 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f828c1a5360 con 0x7f828c1099e0 2024-05-08T05:46:29.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:29.300+0000 7f8289600700 1 -- 172.21.15.82:0/2644014363 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f827c018680 con 0x7f828c1099e0 2024-05-08T05:46:29.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:29.300+0000 7f8291600700 1 -- 172.21.15.82:0/2644014363 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f828c1acbe0 con 0x7f828c1099e0 2024-05-08T05:46:29.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:29.301+0000 7f8291600700 1 -- 172.21.15.82:0/2644014363 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f828c06a190 con 0x7f828c1099e0 2024-05-08T05:46:29.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:29.304+0000 7f8289600700 1 -- 172.21.15.82:0/2644014363 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f827c010430 con 0x7f828c1099e0 2024-05-08T05:46:29.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:29.306+0000 7f8289600700 1 --2- 172.21.15.82:0/2644014363 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f82700b2910 0x7f82700b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:29.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:29.307+0000 7f8289600700 1 -- 172.21.15.82:0/2644014363 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f827c0e2700 con 0x7f828c1099e0 2024-05-08T05:46:29.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:29.307+0000 7f8283e00700 1 --2- 172.21.15.82:0/2644014363 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f82700b2910 0x7f82700b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:29.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:29.308+0000 7f8283e00700 1 --2- 172.21.15.82:0/2644014363 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f82700b2910 0x7f82700b4dd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f828c109590 tx=0x7f8274009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:46:29.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:29.309+0000 7f8289600700 1 -- 172.21.15.82:0/2644014363 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f827c0aa370 con 0x7f828c1099e0 2024-05-08T05:46:29.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:29 smithi082 ceph-mon[30098]: pgmap v332: 97 pgs: 97 active+clean; 591 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.7 KiB/s wr, 20 op/s 2024-05-08T05:46:29.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:29 smithi134 ceph-mon[34132]: pgmap v332: 97 pgs: 97 active+clean; 591 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.7 KiB/s wr, 20 op/s 2024-05-08T05:46:29.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:29.578+0000 7f8291600700 1 -- 172.21.15.82:0/2644014363 --> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f828c0638e0 con 0x7f82700b2910 2024-05-08T05:46:29.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:29.616+0000 7f8289600700 1 -- 172.21.15.82:0/2644014363 <== mgr.14152 v2:172.21.15.82:6800/4089180091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f828c0638e0 con 0x7f82700b2910 2024-05-08T05:46:29.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:29.620+0000 7f8291600700 1 -- 172.21.15.82:0/2644014363 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f82700b2910 msgr2=0x7f82700b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:29.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:29.620+0000 7f8291600700 1 --2- 172.21.15.82:0/2644014363 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f82700b2910 0x7f82700b4dd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f828c109590 tx=0x7f8274009260 comp rx=0 tx=0).stop 2024-05-08T05:46:29.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:29.620+0000 7f8291600700 1 -- 172.21.15.82:0/2644014363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f828c1099e0 msgr2=0x7f828c1a0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:29.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:29.620+0000 7f8291600700 1 --2- 172.21.15.82:0/2644014363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f828c1099e0 0x7f828c1a0060 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f827c00e9a0 tx=0x7f827c00ecb0 comp rx=0 tx=0).stop 2024-05-08T05:46:29.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:29.620+0000 7f8291600700 1 -- 172.21.15.82:0/2644014363 shutdown_connections 2024-05-08T05:46:29.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:29.620+0000 7f8291600700 1 --2- 172.21.15.82:0/2644014363 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f828c10e8b0 0x7f828c1a4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:29.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:29.620+0000 7f8291600700 1 --2- 172.21.15.82:0/2644014363 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f82700b2910 0x7f82700b4dd0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:29.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:29.620+0000 7f8291600700 1 --2- 172.21.15.82:0/2644014363 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f828c1099e0 0x7f828c1a0060 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:29.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:29.620+0000 7f8291600700 1 --2- 172.21.15.82:0/2644014363 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f828c10a3a0 0x7f828c1a05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:29.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:29.620+0000 7f8291600700 1 -- 172.21.15.82:0/2644014363 >> 172.21.15.82:0/2644014363 conn(0x7f828c079230 msgr2=0x7f828c0798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:46:29.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:29.620+0000 7f8291600700 1 -- 172.21.15.82:0/2644014363 shutdown_connections 2024-05-08T05:46:29.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:29.620+0000 7f8291600700 1 -- 172.21.15.82:0/2644014363 wait complete. 2024-05-08T05:46:29.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:29 smithi151 ceph-mon[34815]: pgmap v332: 97 pgs: 97 active+clean; 591 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 3.7 KiB/s wr, 20 op/s 2024-05-08T05:46:30.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:30 smithi082 ceph-mon[30098]: from='client.14499 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:46:30.446 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-05-08T05:46:30.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:30 smithi134 ceph-mon[34132]: from='client.14499 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:46:30.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:30 smithi151 ceph-mon[34815]: from='client.14499 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:46:30.889 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:46:31.374 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:31 smithi082 ceph-mon[30098]: pgmap v333: 97 pgs: 97 active+clean; 591 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.4 KiB/s wr, 20 op/s 2024-05-08T05:46:31.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:31 smithi134 ceph-mon[34132]: pgmap v333: 97 pgs: 97 active+clean; 591 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.4 KiB/s wr, 20 op/s 2024-05-08T05:46:31.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:31 smithi151 ceph-mon[34815]: pgmap v333: 97 pgs: 97 active+clean; 591 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.4 KiB/s wr, 20 op/s 2024-05-08T05:46:33.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:33.021+0000 7fd77e800700 1 -- 172.21.15.82:0/4169101936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd778102b80 msgr2=0x7fd77810f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:33.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:33.021+0000 7fd77e800700 1 --2- 172.21.15.82:0/4169101936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd778102b80 0x7fd77810f840 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd764009990 tx=0x7fd764009ca0 comp rx=0 tx=0).stop 2024-05-08T05:46:33.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:33.021+0000 7fd77e800700 1 -- 172.21.15.82:0/4169101936 shutdown_connections 2024-05-08T05:46:33.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:33.021+0000 7fd77e800700 1 --2- 172.21.15.82:0/4169101936 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7781021d0 0x7fd7781025b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:33.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:33.021+0000 7fd77e800700 1 --2- 172.21.15.82:0/4169101936 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd77810fd80 0x7fd778112170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:33.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:33.021+0000 7fd77e800700 1 --2- 172.21.15.82:0/4169101936 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd778102b80 0x7fd77810f840 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:33.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:33.021+0000 7fd77e800700 1 -- 172.21.15.82:0/4169101936 >> 172.21.15.82:0/4169101936 conn(0x7fd7780fde30 msgr2=0x7fd778100250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:46:33.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:33.021+0000 7fd77e800700 1 -- 172.21.15.82:0/4169101936 shutdown_connections 2024-05-08T05:46:33.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:33.022+0000 7fd77e800700 1 -- 172.21.15.82:0/4169101936 wait complete. 2024-05-08T05:46:33.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:33.023+0000 7fd77e800700 1 Processor -- start 2024-05-08T05:46:33.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:33.023+0000 7fd77e800700 1 -- start start 2024-05-08T05:46:33.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:33.024+0000 7fd77e800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7781021d0 0x7fd77819bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:33.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:33.024+0000 7fd77e800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd778102b80 0x7fd77819c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:33.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:33.024+0000 7fd77e800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd77810fd80 0x7fd7781a0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:33.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:33.024+0000 7fd77e800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd778115850 con 0x7fd7781021d0 2024-05-08T05:46:33.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:33.024+0000 7fd77e800700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd7781156d0 con 0x7fd77810fd80 2024-05-08T05:46:33.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:33.024+0000 7fd77e800700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd7781159d0 con 0x7fd778102b80 2024-05-08T05:46:33.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:33.024+0000 7fd77d400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7781021d0 0x7fd77819bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:33.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:33.024+0000 7fd77d400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7781021d0 0x7fd77819bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41294/0 (socket says 172.21.15.82:41294) 2024-05-08T05:46:33.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:33.024+0000 7fd77d400700 1 -- 172.21.15.82:0/1176719971 learned_addr learned my addr 172.21.15.82:0/1176719971 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:46:33.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:33.024+0000 7fd77de00700 1 --2- 172.21.15.82:0/1176719971 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd77810fd80 0x7fd7781a0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:33.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:33.024+0000 7fd77ca00700 1 --2- 172.21.15.82:0/1176719971 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd778102b80 0x7fd77819c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:33.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:33.025+0000 7fd77de00700 1 -- 172.21.15.82:0/1176719971 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd778102b80 msgr2=0x7fd77819c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:33.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:33.025+0000 7fd77de00700 1 --2- 172.21.15.82:0/1176719971 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd778102b80 0x7fd77819c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:33.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:33.025+0000 7fd77de00700 1 -- 172.21.15.82:0/1176719971 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7781021d0 msgr2=0x7fd77819bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:33.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:33.025+0000 7fd77de00700 1 --2- 172.21.15.82:0/1176719971 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7781021d0 0x7fd77819bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:33.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:33.025+0000 7fd77de00700 1 -- 172.21.15.82:0/1176719971 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7781a0d90 con 0x7fd77810fd80 2024-05-08T05:46:33.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:33.025+0000 7fd77d400700 1 --2- 172.21.15.82:0/1176719971 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7781021d0 0x7fd77819bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:46:33.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:33.025+0000 7fd77ca00700 1 --2- 172.21.15.82:0/1176719971 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd778102b80 0x7fd77819c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:46:33.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:33.025+0000 7fd77de00700 1 --2- 172.21.15.82:0/1176719971 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd77810fd80 0x7fd7781a0650 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd77000ef90 tx=0x7fd77000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:46:33.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:33.025+0000 7fd776000700 1 -- 172.21.15.82:0/1176719971 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7700092e0 con 0x7fd77810fd80 2024-05-08T05:46:33.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:33.025+0000 7fd77e800700 1 -- 172.21.15.82:0/1176719971 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7781a1020 con 0x7fd77810fd80 2024-05-08T05:46:33.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:33.025+0000 7fd776000700 1 -- 172.21.15.82:0/1176719971 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd770004bb0 con 0x7fd77810fd80 2024-05-08T05:46:33.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:33.025+0000 7fd776000700 1 -- 172.21.15.82:0/1176719971 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd770004020 con 0x7fd77810fd80 2024-05-08T05:46:33.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:33.026+0000 7fd77e800700 1 -- 172.21.15.82:0/1176719971 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7781a8900 con 0x7fd77810fd80 2024-05-08T05:46:33.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:33.027+0000 7fd77e800700 1 -- 172.21.15.82:0/1176719971 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd77806a190 con 0x7fd77810fd80 2024-05-08T05:46:33.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:33.029+0000 7fd776000700 1 -- 172.21.15.82:0/1176719971 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fd77001b030 con 0x7fd77810fd80 2024-05-08T05:46:33.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:33.030+0000 7fd776000700 1 --2- 172.21.15.82:0/1176719971 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd7600b2910 0x7fd7600b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:33.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:33.031+0000 7fd776000700 1 -- 172.21.15.82:0/1176719971 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fd7700e2740 con 0x7fd77810fd80 2024-05-08T05:46:33.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:33.031+0000 7fd77d400700 1 --2- 172.21.15.82:0/1176719971 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd7600b2910 0x7fd7600b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:33.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:33.031+0000 7fd77d400700 1 --2- 172.21.15.82:0/1176719971 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd7600b2910 0x7fd7600b4dd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd76c011550 tx=0x7fd76c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:46:33.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:33.032+0000 7fd776000700 1 -- 172.21.15.82:0/1176719971 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd770022020 con 0x7fd77810fd80 2024-05-08T05:46:33.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:33.300+0000 7fd77e800700 1 -- 172.21.15.82:0/1176719971 --> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7fd77819d0e0 con 0x7fd7600b2910 2024-05-08T05:46:33.301 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:33 smithi082 ceph-mon[30098]: pgmap v334: 97 pgs: 97 active+clean; 610 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 2.7 KiB/s wr, 13 op/s 2024-05-08T05:46:33.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:33.308+0000 7fd776000700 1 -- 172.21.15.82:0/1176719971 <== mgr.14152 v2:172.21.15.82:6800/4089180091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fd77819d0e0 con 0x7fd7600b2910 2024-05-08T05:46:33.309 INFO:teuthology.orchestra.run.smithi082.stdout:/volumes/qa/sv_0/f0014259-bc8a-4dfe-8583-545461782bfc 2024-05-08T05:46:33.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:33.311+0000 7fd77e800700 1 -- 172.21.15.82:0/1176719971 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd7600b2910 msgr2=0x7fd7600b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:33.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:33.311+0000 7fd77e800700 1 --2- 172.21.15.82:0/1176719971 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd7600b2910 0x7fd7600b4dd0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd76c011550 tx=0x7fd76c009260 comp rx=0 tx=0).stop 2024-05-08T05:46:33.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:33.311+0000 7fd77e800700 1 -- 172.21.15.82:0/1176719971 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd77810fd80 msgr2=0x7fd7781a0650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:33.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:33.311+0000 7fd77e800700 1 --2- 172.21.15.82:0/1176719971 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd77810fd80 0x7fd7781a0650 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fd77000ef90 tx=0x7fd77000c3a0 comp rx=0 tx=0).stop 2024-05-08T05:46:33.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:33.311+0000 7fd77e800700 1 -- 172.21.15.82:0/1176719971 shutdown_connections 2024-05-08T05:46:33.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:33.311+0000 7fd77e800700 1 --2- 172.21.15.82:0/1176719971 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd77810fd80 0x7fd7781a0650 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:33.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:33.311+0000 7fd77e800700 1 --2- 172.21.15.82:0/1176719971 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd7600b2910 0x7fd7600b4dd0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:33.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:33.311+0000 7fd77e800700 1 --2- 172.21.15.82:0/1176719971 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd7781021d0 0x7fd77819bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:33.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:33.311+0000 7fd77e800700 1 --2- 172.21.15.82:0/1176719971 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd778102b80 0x7fd77819c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:33.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:33.311+0000 7fd77e800700 1 -- 172.21.15.82:0/1176719971 >> 172.21.15.82:0/1176719971 conn(0x7fd7780fde30 msgr2=0x7fd778100220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:46:33.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:33.311+0000 7fd77e800700 1 -- 172.21.15.82:0/1176719971 shutdown_connections 2024-05-08T05:46:33.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:33.311+0000 7fd77e800700 1 -- 172.21.15.82:0/1176719971 wait complete. 2024-05-08T05:46:33.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:33 smithi151 ceph-mon[34815]: pgmap v334: 97 pgs: 97 active+clean; 610 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 2.7 KiB/s wr, 13 op/s 2024-05-08T05:46:33.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:33 smithi134 ceph-mon[34132]: pgmap v334: 97 pgs: 97 active+clean; 610 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 2.7 KiB/s wr, 13 op/s 2024-05-08T05:46:34.146 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-05-08T05:46:34.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:34 smithi082 ceph-mon[30098]: from='client.24596 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:46:34.595 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:46:34.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:34 smithi151 ceph-mon[34815]: from='client.24596 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:46:34.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:34 smithi134 ceph-mon[34132]: from='client.24596 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:46:35.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:35 smithi082 ceph-mon[30098]: pgmap v335: 97 pgs: 97 active+clean; 610 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.6 KiB/s wr, 10 op/s 2024-05-08T05:46:36.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:35 smithi134 ceph-mon[34132]: pgmap v335: 97 pgs: 97 active+clean; 610 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.6 KiB/s wr, 10 op/s 2024-05-08T05:46:36.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:35 smithi151 ceph-mon[34815]: pgmap v335: 97 pgs: 97 active+clean; 610 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.6 KiB/s wr, 10 op/s 2024-05-08T05:46:36.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:36.827+0000 7fb277000700 1 -- 172.21.15.82:0/3614911444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb27010d9c0 msgr2=0x7fb27010fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:36.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:36.827+0000 7fb277000700 1 --2- 172.21.15.82:0/3614911444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb27010d9c0 0x7fb27010fe80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb26800b0a0 tx=0x7fb26800b3b0 comp rx=0 tx=0).stop 2024-05-08T05:46:36.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:36.827+0000 7fb277000700 1 -- 172.21.15.82:0/3614911444 shutdown_connections 2024-05-08T05:46:36.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:36.827+0000 7fb277000700 1 --2- 172.21.15.82:0/3614911444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb27010d9c0 0x7fb27010fe80 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:36.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:36.827+0000 7fb277000700 1 --2- 172.21.15.82:0/3614911444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb270104590 0x7fb270104970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:36.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:36.827+0000 7fb277000700 1 --2- 172.21.15.82:0/3614911444 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb270104eb0 0x7fb27010d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:36.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:36.827+0000 7fb277000700 1 -- 172.21.15.82:0/3614911444 >> 172.21.15.82:0/3614911444 conn(0x7fb2700fddc0 msgr2=0x7fb2701001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:46:36.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:36.827+0000 7fb277000700 1 -- 172.21.15.82:0/3614911444 shutdown_connections 2024-05-08T05:46:36.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:36.828+0000 7fb277000700 1 -- 172.21.15.82:0/3614911444 wait complete. 2024-05-08T05:46:36.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:36.829+0000 7fb277000700 1 Processor -- start 2024-05-08T05:46:36.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:36.829+0000 7fb277000700 1 -- start start 2024-05-08T05:46:36.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:36.829+0000 7fb277000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb270104590 0x7fb2701a18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:36.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:36.829+0000 7fb277000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb270104eb0 0x7fb2701a1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:36.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:36.829+0000 7fb277000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb27010d9c0 0x7fb27019ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:36.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:36.829+0000 7fb277000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb270113610 con 0x7fb27010d9c0 2024-05-08T05:46:36.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:36.829+0000 7fb277000700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb270113490 con 0x7fb270104590 2024-05-08T05:46:36.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:36.829+0000 7fb277000700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb270113790 con 0x7fb270104eb0 2024-05-08T05:46:36.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:36.829+0000 7fb276600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb27010d9c0 0x7fb27019ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:36.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:36.829+0000 7fb275200700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb270104eb0 0x7fb2701a1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:36.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:36.830+0000 7fb276600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb27010d9c0 0x7fb27019ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41310/0 (socket says 172.21.15.82:41310) 2024-05-08T05:46:36.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:36.830+0000 7fb275200700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb270104eb0 0x7fb2701a1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:35078/0 (socket says 172.21.15.82:35078) 2024-05-08T05:46:36.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:36.830+0000 7fb276600700 1 -- 172.21.15.82:0/2960191347 learned_addr learned my addr 172.21.15.82:0/2960191347 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:46:36.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:36.830+0000 7fb275c00700 1 --2- 172.21.15.82:0/2960191347 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb270104590 0x7fb2701a18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:36.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:36.830+0000 7fb276600700 1 -- 172.21.15.82:0/2960191347 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb270104eb0 msgr2=0x7fb2701a1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:36.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:36.830+0000 7fb276600700 1 --2- 172.21.15.82:0/2960191347 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb270104eb0 0x7fb2701a1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:36.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:36.830+0000 7fb276600700 1 -- 172.21.15.82:0/2960191347 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb270104590 msgr2=0x7fb2701a18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:36.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:36.830+0000 7fb276600700 1 --2- 172.21.15.82:0/2960191347 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb270104590 0x7fb2701a18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:36.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:36.830+0000 7fb276600700 1 -- 172.21.15.82:0/2960191347 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb27019c1e0 con 0x7fb27010d9c0 2024-05-08T05:46:36.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:36.830+0000 7fb275200700 1 --2- 172.21.15.82:0/2960191347 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb270104eb0 0x7fb2701a1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:46:36.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:36.830+0000 7fb275c00700 1 --2- 172.21.15.82:0/2960191347 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb270104590 0x7fb2701a18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:46:36.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:36.830+0000 7fb276600700 1 --2- 172.21.15.82:0/2960191347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb27010d9c0 0x7fb27019ba80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb26800b070 tx=0x7fb268009c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:46:36.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:36.831+0000 7fb26e000700 1 -- 172.21.15.82:0/2960191347 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb268021070 con 0x7fb27010d9c0 2024-05-08T05:46:36.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:36.831+0000 7fb26e000700 1 -- 172.21.15.82:0/2960191347 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb268004e40 con 0x7fb27010d9c0 2024-05-08T05:46:36.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:36.831+0000 7fb277000700 1 -- 172.21.15.82:0/2960191347 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb27019c470 con 0x7fb27010d9c0 2024-05-08T05:46:36.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:36.831+0000 7fb26e000700 1 -- 172.21.15.82:0/2960191347 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb268004630 con 0x7fb27010d9c0 2024-05-08T05:46:36.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:36.831+0000 7fb277000700 1 -- 172.21.15.82:0/2960191347 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2701a8790 con 0x7fb27010d9c0 2024-05-08T05:46:36.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:36.832+0000 7fb277000700 1 -- 172.21.15.82:0/2960191347 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb27006a190 con 0x7fb27010d9c0 2024-05-08T05:46:36.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:36.835+0000 7fb26e000700 1 -- 172.21.15.82:0/2960191347 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fb268007980 con 0x7fb27010d9c0 2024-05-08T05:46:36.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:36.836+0000 7fb26e000700 1 --2- 172.21.15.82:0/2960191347 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb2580b2910 0x7fb2580b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:36.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:36.836+0000 7fb26e000700 1 -- 172.21.15.82:0/2960191347 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fb2680e30c0 con 0x7fb27010d9c0 2024-05-08T05:46:36.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:36.837+0000 7fb275c00700 1 --2- 172.21.15.82:0/2960191347 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb2580b2910 0x7fb2580b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:36.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:36.837+0000 7fb275c00700 1 --2- 172.21.15.82:0/2960191347 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb2580b2910 0x7fb2580b4dd0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb27019cbc0 tx=0x7fb264009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:46:36.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:36.839+0000 7fb26e000700 1 -- 172.21.15.82:0/2960191347 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb2680aadc0 con 0x7fb27010d9c0 2024-05-08T05:46:37.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:37.102+0000 7fb277000700 1 -- 172.21.15.82:0/2960191347 --> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fb2701039c0 con 0x7fb2580b2910 2024-05-08T05:46:37.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:37.144+0000 7fb26e000700 1 -- 172.21.15.82:0/2960191347 <== mgr.14152 v2:172.21.15.82:6800/4089180091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb2701039c0 con 0x7fb2580b2910 2024-05-08T05:46:37.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:37.148+0000 7fb277000700 1 -- 172.21.15.82:0/2960191347 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb2580b2910 msgr2=0x7fb2580b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:37.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:37.148+0000 7fb277000700 1 --2- 172.21.15.82:0/2960191347 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb2580b2910 0x7fb2580b4dd0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb27019cbc0 tx=0x7fb264009260 comp rx=0 tx=0).stop 2024-05-08T05:46:37.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:37.148+0000 7fb277000700 1 -- 172.21.15.82:0/2960191347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb27010d9c0 msgr2=0x7fb27019ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:37.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:37.148+0000 7fb277000700 1 --2- 172.21.15.82:0/2960191347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb27010d9c0 0x7fb27019ba80 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb26800b070 tx=0x7fb268009c90 comp rx=0 tx=0).stop 2024-05-08T05:46:37.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:37.148+0000 7fb277000700 1 -- 172.21.15.82:0/2960191347 shutdown_connections 2024-05-08T05:46:37.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:37.148+0000 7fb277000700 1 --2- 172.21.15.82:0/2960191347 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb270104590 0x7fb2701a18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:37.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:37.148+0000 7fb277000700 1 --2- 172.21.15.82:0/2960191347 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb2580b2910 0x7fb2580b4dd0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:37.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:37.148+0000 7fb277000700 1 --2- 172.21.15.82:0/2960191347 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb27010d9c0 0x7fb27019ba80 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:37.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:37.148+0000 7fb277000700 1 --2- 172.21.15.82:0/2960191347 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb270104eb0 0x7fb2701a1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:37.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:37.148+0000 7fb277000700 1 -- 172.21.15.82:0/2960191347 >> 172.21.15.82:0/2960191347 conn(0x7fb2700fddc0 msgr2=0x7fb27010fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:46:37.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:37.148+0000 7fb277000700 1 -- 172.21.15.82:0/2960191347 shutdown_connections 2024-05-08T05:46:37.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:37.148+0000 7fb277000700 1 -- 172.21.15.82:0/2960191347 wait complete. 2024-05-08T05:46:37.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:37 smithi082 ceph-mon[30098]: pgmap v336: 97 pgs: 97 active+clean; 610 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.7 KiB/s wr, 11 op/s 2024-05-08T05:46:38.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:37 smithi134 ceph-mon[34132]: pgmap v336: 97 pgs: 97 active+clean; 610 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.7 KiB/s wr, 11 op/s 2024-05-08T05:46:38.026 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-05-08T05:46:38.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:37 smithi151 ceph-mon[34815]: pgmap v336: 97 pgs: 97 active+clean; 610 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.7 KiB/s wr, 11 op/s 2024-05-08T05:46:38.510 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:46:38.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:38 smithi082 ceph-mon[30098]: from='client.14511 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:46:39.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:38 smithi134 ceph-mon[34132]: from='client.14511 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:46:39.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:38 smithi151 ceph-mon[34815]: from='client.14511 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:46:40.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:39 smithi134 ceph-mon[34132]: pgmap v337: 97 pgs: 97 active+clean; 615 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.3 KiB/s wr, 12 op/s 2024-05-08T05:46:40.101 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:39 smithi082 ceph-mon[30098]: pgmap v337: 97 pgs: 97 active+clean; 615 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.3 KiB/s wr, 12 op/s 2024-05-08T05:46:40.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:39 smithi151 ceph-mon[34815]: pgmap v337: 97 pgs: 97 active+clean; 615 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.3 KiB/s wr, 12 op/s 2024-05-08T05:46:40.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:40.613+0000 7fe73c600700 1 -- 172.21.15.82:0/2832859993 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7341056c0 msgr2=0x7fe734105b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:40.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:40.613+0000 7fe73c600700 1 --2- 172.21.15.82:0/2832859993 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7341056c0 0x7fe734105b40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe720009990 tx=0x7fe720009ca0 comp rx=0 tx=0).stop 2024-05-08T05:46:40.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:40.613+0000 7fe73c600700 1 -- 172.21.15.82:0/2832859993 shutdown_connections 2024-05-08T05:46:40.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:40.613+0000 7fe73c600700 1 --2- 172.21.15.82:0/2832859993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe734106080 0x7fe734112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:40.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:40.613+0000 7fe73c600700 1 --2- 172.21.15.82:0/2832859993 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe73410b6c0 0x7fe73410baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:40.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:40.613+0000 7fe73c600700 1 --2- 172.21.15.82:0/2832859993 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7341056c0 0x7fe734105b40 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:40.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:40.613+0000 7fe73c600700 1 -- 172.21.15.82:0/2832859993 >> 172.21.15.82:0/2832859993 conn(0x7fe7341011b0 msgr2=0x7fe7341035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:46:40.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:40.613+0000 7fe73c600700 1 -- 172.21.15.82:0/2832859993 shutdown_connections 2024-05-08T05:46:40.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:40.613+0000 7fe73c600700 1 -- 172.21.15.82:0/2832859993 wait complete. 2024-05-08T05:46:40.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:40.614+0000 7fe73c600700 1 Processor -- start 2024-05-08T05:46:40.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:40.615+0000 7fe73c600700 1 -- start start 2024-05-08T05:46:40.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:40.615+0000 7fe73c600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7341056c0 0x7fe73419bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:40.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:40.615+0000 7fe73c600700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe734106080 0x7fe73419c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:40.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:40.615+0000 7fe73c600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe73410b6c0 0x7fe7341a0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:40.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:40.615+0000 7fe73c600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe734115910 con 0x7fe7341056c0 2024-05-08T05:46:40.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:40.615+0000 7fe73c600700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe734115790 con 0x7fe73410b6c0 2024-05-08T05:46:40.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:40.615+0000 7fe73c600700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe734115a90 con 0x7fe734106080 2024-05-08T05:46:40.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:40.615+0000 7fe739c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7341056c0 0x7fe73419bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:40.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:40.615+0000 7fe739c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7341056c0 0x7fe73419bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41336/0 (socket says 172.21.15.82:41336) 2024-05-08T05:46:40.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:40.615+0000 7fe739c00700 1 -- 172.21.15.82:0/3405108976 learned_addr learned my addr 172.21.15.82:0/3405108976 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:46:40.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:40.616+0000 7fe739200700 1 --2- 172.21.15.82:0/3405108976 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe734106080 0x7fe73419c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:40.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:40.616+0000 7fe73a600700 1 --2- 172.21.15.82:0/3405108976 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe73410b6c0 0x7fe7341a0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:40.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:40.616+0000 7fe739c00700 1 -- 172.21.15.82:0/3405108976 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe734106080 msgr2=0x7fe73419c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:40.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:40.616+0000 7fe739c00700 1 --2- 172.21.15.82:0/3405108976 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe734106080 0x7fe73419c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:40.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:40.616+0000 7fe739c00700 1 -- 172.21.15.82:0/3405108976 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe73410b6c0 msgr2=0x7fe7341a0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:40.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:40.616+0000 7fe739c00700 1 --2- 172.21.15.82:0/3405108976 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe73410b6c0 0x7fe7341a0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:40.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:40.616+0000 7fe739c00700 1 -- 172.21.15.82:0/3405108976 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7341a0dd0 con 0x7fe7341056c0 2024-05-08T05:46:40.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:40.616+0000 7fe73a600700 1 --2- 172.21.15.82:0/3405108976 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe73410b6c0 0x7fe7341a0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:46:40.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:40.616+0000 7fe739c00700 1 --2- 172.21.15.82:0/3405108976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7341056c0 0x7fe73419bdc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe72800e9a0 tx=0x7fe72800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:46:40.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:40.617+0000 7fe732000700 1 -- 172.21.15.82:0/3405108976 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe72800ca10 con 0x7fe7341056c0 2024-05-08T05:46:40.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:40.617+0000 7fe732000700 1 -- 172.21.15.82:0/3405108976 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe72800cbb0 con 0x7fe7341056c0 2024-05-08T05:46:40.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:40.617+0000 7fe73c600700 1 -- 172.21.15.82:0/3405108976 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7341a10c0 con 0x7fe7341056c0 2024-05-08T05:46:40.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:40.617+0000 7fe732000700 1 -- 172.21.15.82:0/3405108976 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe728018680 con 0x7fe7341056c0 2024-05-08T05:46:40.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:40.617+0000 7fe73c600700 1 -- 172.21.15.82:0/3405108976 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7341a8940 con 0x7fe7341056c0 2024-05-08T05:46:40.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:40.618+0000 7fe73c600700 1 -- 172.21.15.82:0/3405108976 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe73406a190 con 0x7fe7341056c0 2024-05-08T05:46:40.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:40.620+0000 7fe732000700 1 -- 172.21.15.82:0/3405108976 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fe728010430 con 0x7fe7341056c0 2024-05-08T05:46:40.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:40.622+0000 7fe732000700 1 --2- 172.21.15.82:0/3405108976 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fe71c0b2990 0x7fe71c0b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:40.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:40.622+0000 7fe732000700 1 -- 172.21.15.82:0/3405108976 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fe7280e2370 con 0x7fe7341056c0 2024-05-08T05:46:40.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:40.622+0000 7fe739200700 1 --2- 172.21.15.82:0/3405108976 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fe71c0b2990 0x7fe71c0b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:40.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:40.623+0000 7fe739200700 1 --2- 172.21.15.82:0/3405108976 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fe71c0b2990 0x7fe71c0b4e50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe734103800 tx=0x7fe72000b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:46:40.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:40.627+0000 7fe732000700 1 -- 172.21.15.82:0/3405108976 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe7280a9fe0 con 0x7fe7341056c0 2024-05-08T05:46:40.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:40.895+0000 7fe73c600700 1 -- 172.21.15.82:0/3405108976 --> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7fe7340638e0 con 0x7fe71c0b2990 2024-05-08T05:46:40.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:40.902+0000 7fe732000700 1 -- 172.21.15.82:0/3405108976 <== mgr.14152 v2:172.21.15.82:6800/4089180091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7fe7340638e0 con 0x7fe71c0b2990 2024-05-08T05:46:40.903 INFO:teuthology.orchestra.run.smithi082.stdout:/volumes/qa/sv_1/5cc92dff-ab65-410c-b632-4df5dd09b865 2024-05-08T05:46:40.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:40.905+0000 7fe73c600700 1 -- 172.21.15.82:0/3405108976 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fe71c0b2990 msgr2=0x7fe71c0b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:40.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:40.905+0000 7fe73c600700 1 --2- 172.21.15.82:0/3405108976 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fe71c0b2990 0x7fe71c0b4e50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe734103800 tx=0x7fe72000b260 comp rx=0 tx=0).stop 2024-05-08T05:46:40.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:40.905+0000 7fe73c600700 1 -- 172.21.15.82:0/3405108976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7341056c0 msgr2=0x7fe73419bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:40.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:40.905+0000 7fe73c600700 1 --2- 172.21.15.82:0/3405108976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7341056c0 0x7fe73419bdc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe72800e9a0 tx=0x7fe72800ecb0 comp rx=0 tx=0).stop 2024-05-08T05:46:40.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:40.905+0000 7fe73c600700 1 -- 172.21.15.82:0/3405108976 shutdown_connections 2024-05-08T05:46:40.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:40.905+0000 7fe73c600700 1 --2- 172.21.15.82:0/3405108976 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe73410b6c0 0x7fe7341a0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:40.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:40.905+0000 7fe73c600700 1 --2- 172.21.15.82:0/3405108976 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fe71c0b2990 0x7fe71c0b4e50 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:40.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:40.905+0000 7fe73c600700 1 --2- 172.21.15.82:0/3405108976 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7341056c0 0x7fe73419bdc0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:40.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:40.905+0000 7fe73c600700 1 --2- 172.21.15.82:0/3405108976 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe734106080 0x7fe73419c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:40.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:40.905+0000 7fe73c600700 1 -- 172.21.15.82:0/3405108976 >> 172.21.15.82:0/3405108976 conn(0x7fe7341011b0 msgr2=0x7fe7341018e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:46:40.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:40.906+0000 7fe73c600700 1 -- 172.21.15.82:0/3405108976 shutdown_connections 2024-05-08T05:46:40.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:40.906+0000 7fe73c600700 1 -- 172.21.15.82:0/3405108976 wait complete. 2024-05-08T05:46:41.730 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T05:46:41.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:41 smithi082 ceph-mon[30098]: pgmap v338: 97 pgs: 97 active+clean; 615 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 2.7 KiB/s wr, 11 op/s 2024-05-08T05:46:41.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:41 smithi082 ceph-mon[30098]: from='client.14517 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:46:42.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:41 smithi134 ceph-mon[34132]: pgmap v338: 97 pgs: 97 active+clean; 615 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 2.7 KiB/s wr, 11 op/s 2024-05-08T05:46:42.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:41 smithi134 ceph-mon[34132]: from='client.14517 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:46:42.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:41 smithi151 ceph-mon[34815]: pgmap v338: 97 pgs: 97 active+clean; 615 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 2.7 KiB/s wr, 11 op/s 2024-05-08T05:46:42.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:41 smithi151 ceph-mon[34815]: from='client.14517 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:46:42.186 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:46:43.787 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:43 smithi082 ceph-mon[30098]: pgmap v339: 97 pgs: 97 active+clean; 637 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 4.5 KiB/s wr, 12 op/s 2024-05-08T05:46:43.787 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:43 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:46:44.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:43 smithi151 ceph-mon[34815]: pgmap v339: 97 pgs: 97 active+clean; 637 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 4.5 KiB/s wr, 12 op/s 2024-05-08T05:46:44.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:43 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:46:44.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:43 smithi134 ceph-mon[34132]: pgmap v339: 97 pgs: 97 active+clean; 637 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 4.5 KiB/s wr, 12 op/s 2024-05-08T05:46:44.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:43 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:46:44.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:44.273+0000 7f24ece00700 1 -- 172.21.15.82:0/766825637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24e8075ff0 msgr2=0x7f24e810f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:44.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:44.273+0000 7f24ece00700 1 --2- 172.21.15.82:0/766825637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24e8075ff0 0x7f24e810f960 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f24d4009990 tx=0x7f24d4009ca0 comp rx=0 tx=0).stop 2024-05-08T05:46:44.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:44.273+0000 7f24ece00700 1 -- 172.21.15.82:0/766825637 shutdown_connections 2024-05-08T05:46:44.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:44.273+0000 7f24ece00700 1 --2- 172.21.15.82:0/766825637 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24e80756d0 0x7f24e8075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:44.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:44.273+0000 7f24ece00700 1 --2- 172.21.15.82:0/766825637 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f24e810fea0 0x7f24e8112290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:44.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:44.273+0000 7f24ece00700 1 --2- 172.21.15.82:0/766825637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24e8075ff0 0x7f24e810f960 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:44.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:44.273+0000 7f24ece00700 1 -- 172.21.15.82:0/766825637 >> 172.21.15.82:0/766825637 conn(0x7f24e807a600 msgr2=0x7f24e807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:46:44.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:44.273+0000 7f24ece00700 1 -- 172.21.15.82:0/766825637 shutdown_connections 2024-05-08T05:46:44.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:44.273+0000 7f24ece00700 1 -- 172.21.15.82:0/766825637 wait complete. 2024-05-08T05:46:44.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:44.274+0000 7f24ece00700 1 Processor -- start 2024-05-08T05:46:44.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:44.274+0000 7f24ece00700 1 -- start start 2024-05-08T05:46:44.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:44.275+0000 7f24ece00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24e80756d0 0x7f24e819bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:44.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:44.275+0000 7f24ece00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f24e8075ff0 0x7f24e819c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:44.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:44.275+0000 7f24ece00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24e810fea0 0x7f24e81a0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:44.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:44.275+0000 7f24ece00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f24e81158d0 con 0x7f24e810fea0 2024-05-08T05:46:44.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:44.275+0000 7f24ece00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f24e8115750 con 0x7f24e80756d0 2024-05-08T05:46:44.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:44.275+0000 7f24ece00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f24e8115a50 con 0x7f24e8075ff0 2024-05-08T05:46:44.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:44.275+0000 7f24e5400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f24e8075ff0 0x7f24e819c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:44.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:44.275+0000 7f24e5400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f24e8075ff0 0x7f24e819c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:59514/0 (socket says 172.21.15.82:59514) 2024-05-08T05:46:44.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:44.275+0000 7f24e6800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24e810fea0 0x7f24e81a0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:44.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:44.275+0000 7f24e5e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24e80756d0 0x7f24e819bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:44.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:44.275+0000 7f24e5400700 1 -- 172.21.15.82:0/2102740105 learned_addr learned my addr 172.21.15.82:0/2102740105 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:46:44.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:44.276+0000 7f24e5e00700 1 -- 172.21.15.82:0/2102740105 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f24e8075ff0 msgr2=0x7f24e819c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:44.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:44.276+0000 7f24e5e00700 1 --2- 172.21.15.82:0/2102740105 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f24e8075ff0 0x7f24e819c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:44.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:44.276+0000 7f24e5e00700 1 -- 172.21.15.82:0/2102740105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24e810fea0 msgr2=0x7f24e81a0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:44.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:44.276+0000 7f24e5e00700 1 --2- 172.21.15.82:0/2102740105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24e810fea0 0x7f24e81a0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:44.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:44.276+0000 7f24e5e00700 1 -- 172.21.15.82:0/2102740105 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24e81a0d90 con 0x7f24e80756d0 2024-05-08T05:46:44.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:44.276+0000 7f24e5400700 1 --2- 172.21.15.82:0/2102740105 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f24e8075ff0 0x7f24e819c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:46:44.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:44.276+0000 7f24e6800700 1 --2- 172.21.15.82:0/2102740105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24e810fea0 0x7f24e81a0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:46:44.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:44.276+0000 7f24e5e00700 1 --2- 172.21.15.82:0/2102740105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24e80756d0 0x7f24e819bd80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f24d800e9f0 tx=0x7f24d800ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:46:44.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:44.276+0000 7f24dea00700 1 -- 172.21.15.82:0/2102740105 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d800c9c0 con 0x7f24e80756d0 2024-05-08T05:46:44.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:44.276+0000 7f24ece00700 1 -- 172.21.15.82:0/2102740105 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24e81a1080 con 0x7f24e80756d0 2024-05-08T05:46:44.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:44.277+0000 7f24dea00700 1 -- 172.21.15.82:0/2102740105 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f24d800cb60 con 0x7f24e80756d0 2024-05-08T05:46:44.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:44.277+0000 7f24dea00700 1 -- 172.21.15.82:0/2102740105 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d8018680 con 0x7f24e80756d0 2024-05-08T05:46:44.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:44.277+0000 7f24ece00700 1 -- 172.21.15.82:0/2102740105 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24e81a8900 con 0x7f24e80756d0 2024-05-08T05:46:44.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:44.278+0000 7f24ece00700 1 -- 172.21.15.82:0/2102740105 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24e806a190 con 0x7f24e80756d0 2024-05-08T05:46:44.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:44.280+0000 7f24dea00700 1 -- 172.21.15.82:0/2102740105 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f24d8010430 con 0x7f24e80756d0 2024-05-08T05:46:44.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:44.281+0000 7f24dea00700 1 --2- 172.21.15.82:0/2102740105 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f24cc0b2910 0x7f24cc0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:44.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:44.282+0000 7f24dea00700 1 -- 172.21.15.82:0/2102740105 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7f24d80e2440 con 0x7f24e80756d0 2024-05-08T05:46:44.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:44.282+0000 7f24e5400700 1 --2- 172.21.15.82:0/2102740105 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f24cc0b2910 0x7f24cc0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:44.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:44.282+0000 7f24e5400700 1 --2- 172.21.15.82:0/2102740105 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f24cc0b2910 0x7f24cc0b4dd0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f24e8103070 tx=0x7f24d400b280 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:46:44.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:44.286+0000 7f24dea00700 1 -- 172.21.15.82:0/2102740105 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f24d80aa0b0 con 0x7f24e80756d0 2024-05-08T05:46:44.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:44.613+0000 7f24ece00700 1 -- 172.21.15.82:0/2102740105 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f24e802e510 con 0x7f24e80756d0 2024-05-08T05:46:44.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:44.615+0000 7f24dea00700 1 -- 172.21.15.82:0/2102740105 <== mon.2 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11948 (secure 0 0 0) 0x7f24d80b2130 con 0x7f24e80756d0 2024-05-08T05:46:44.615 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:46:44.616 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14364,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3876883250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3876883250},{"type":"v1","addr":"172.21.15.82:6835","nonce":3876883250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1965070586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1965070586},{"type":"v1","addr":"172.21.15.82:6837","nonce":1965070586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T05:45:57.654009+0000","modified":"2024-05-08T05:46:21.713129+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24505,"mds_2":24487,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14397":{"gid":14397,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/1890720973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1890720973},{"type":"v1","addr":"172.21.15.82:6839","nonce":1890720973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14409":{"gid":14409,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/2957083305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":2957083305},{"type":"v1","addr":"172.21.15.82:6841","nonce":2957083305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6833/3827691638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3827691638},{"type":"v1","addr":"172.21.15.134:6833","nonce":3827691638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6833/3625067797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3625067797},{"type":"v1","addr":"172.21.15.151:6833","nonce":3625067797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/4074163402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4074163402},{"type":"v1","addr":"172.21.15.134:6835","nonce":4074163402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.134:6837/2212411710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2212411710},{"type":"v1","addr":"172.21.15.134:6837","nonce":2212411710}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":17,"addr":"172.21.15.151:6835/2093655929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2093655929},{"type":"v1","addr":"172.21.15.151:6835","nonce":2093655929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6837/4192404464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":4192404464},{"type":"v1","addr":"172.21.15.151:6837","nonce":4192404464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":14,"addr":"172.21.15.151:6839/2963754236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":2963754236},{"type":"v1","addr":"172.21.15.151:6839","nonce":2963754236}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.134:6839/1145270893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1145270893},{"type":"v1","addr":"172.21.15.134:6839","nonce":1145270893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24467,24475,24487,24505,24506]},"id":1}]} 2024-05-08T05:46:44.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:44.618+0000 7f24ece00700 1 -- 172.21.15.82:0/2102740105 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f24cc0b2910 msgr2=0x7f24cc0b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:44.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:44.618+0000 7f24ece00700 1 --2- 172.21.15.82:0/2102740105 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f24cc0b2910 0x7f24cc0b4dd0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f24e8103070 tx=0x7f24d400b280 comp rx=0 tx=0).stop 2024-05-08T05:46:44.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:44.618+0000 7f24ece00700 1 -- 172.21.15.82:0/2102740105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24e80756d0 msgr2=0x7f24e819bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:44.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:44.618+0000 7f24ece00700 1 --2- 172.21.15.82:0/2102740105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24e80756d0 0x7f24e819bd80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f24d800e9f0 tx=0x7f24d800ed00 comp rx=0 tx=0).stop 2024-05-08T05:46:44.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:44.618+0000 7f24ece00700 1 -- 172.21.15.82:0/2102740105 shutdown_connections 2024-05-08T05:46:44.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:44.618+0000 7f24ece00700 1 --2- 172.21.15.82:0/2102740105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24e80756d0 0x7f24e819bd80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:44.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:44.618+0000 7f24ece00700 1 --2- 172.21.15.82:0/2102740105 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f24cc0b2910 0x7f24cc0b4dd0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:44.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:44.618+0000 7f24ece00700 1 --2- 172.21.15.82:0/2102740105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f24e810fea0 0x7f24e81a0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:44.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:44.618+0000 7f24ece00700 1 --2- 172.21.15.82:0/2102740105 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f24e8075ff0 0x7f24e819c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:44.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:44.618+0000 7f24ece00700 1 -- 172.21.15.82:0/2102740105 >> 172.21.15.82:0/2102740105 conn(0x7f24e807a600 msgr2=0x7f24e8100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:46:44.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:44.618+0000 7f24ece00700 1 -- 172.21.15.82:0/2102740105 shutdown_connections 2024-05-08T05:46:44.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:44.618+0000 7f24ece00700 1 -- 172.21.15.82:0/2102740105 wait complete. 2024-05-08T05:46:44.620 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 28 2024-05-08T05:46:44.866 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:44 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2024-05-08T05:46:44.866 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:44 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-05-08T05:46:44.867 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:44 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]: dispatch 2024-05-08T05:46:44.867 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:44 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2024-05-08T05:46:44.867 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:44 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]: dispatch 2024-05-08T05:46:44.867 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:44 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]: dispatch 2024-05-08T05:46:44.867 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:44 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-05-08T05:46:44.867 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:44 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2024-05-08T05:46:44.867 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:44 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/2102740105' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:46:45.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:44 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2024-05-08T05:46:45.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:44 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-05-08T05:46:45.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:44 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]: dispatch 2024-05-08T05:46:45.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:44 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2024-05-08T05:46:45.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:44 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]: dispatch 2024-05-08T05:46:45.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:44 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]: dispatch 2024-05-08T05:46:45.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:44 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-05-08T05:46:45.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:44 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2024-05-08T05:46:45.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:44 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/2102740105' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:46:45.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:44 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2024-05-08T05:46:45.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:44 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]: dispatch 2024-05-08T05:46:45.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:44 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]: dispatch 2024-05-08T05:46:45.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:44 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2024-05-08T05:46:45.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:44 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]: dispatch 2024-05-08T05:46:45.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:44 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]: dispatch 2024-05-08T05:46:45.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:44 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-05-08T05:46:45.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:44 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2024-05-08T05:46:45.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:44 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/2102740105' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:46:45.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:45 smithi082 ceph-mon[30098]: pgmap v340: 97 pgs: 97 active+clean; 637 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.8 KiB/s wr, 10 op/s 2024-05-08T05:46:45.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:45 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-05-08T05:46:45.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:45 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-05-08T05:46:45.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:45 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-05-08T05:46:45.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:45 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-05-08T05:46:45.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:45 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2024-05-08T05:46:45.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:45 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]': finished 2024-05-08T05:46:45.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:45 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-05-08T05:46:45.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:45 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-05-08T05:46:45.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:45 smithi082 ceph-mon[30098]: osdmap e81: 12 total, 12 up, 12 in 2024-05-08T05:46:45.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:45 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:46:45.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:45 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:46:45.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:45 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:46:45.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:45 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:46:45.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:45 smithi082 ceph-mon[30098]: osdmap e82: 12 total, 12 up, 12 in 2024-05-08T05:46:46.129 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-08T05:46:46.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:45 smithi151 ceph-mon[34815]: pgmap v340: 97 pgs: 97 active+clean; 637 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.8 KiB/s wr, 10 op/s 2024-05-08T05:46:46.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:45 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-05-08T05:46:46.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:45 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-05-08T05:46:46.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:45 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-05-08T05:46:46.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:45 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-05-08T05:46:46.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:45 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2024-05-08T05:46:46.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:45 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]': finished 2024-05-08T05:46:46.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:45 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-05-08T05:46:46.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:45 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-05-08T05:46:46.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:45 smithi151 ceph-mon[34815]: osdmap e81: 12 total, 12 up, 12 in 2024-05-08T05:46:46.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:45 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:46:46.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:45 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:46:46.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:45 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:46:46.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:45 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:46:46.131 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:45 smithi151 ceph-mon[34815]: osdmap e82: 12 total, 12 up, 12 in 2024-05-08T05:46:46.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:45 smithi134 ceph-mon[34132]: pgmap v340: 97 pgs: 97 active+clean; 637 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.8 KiB/s wr, 10 op/s 2024-05-08T05:46:46.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:45 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-05-08T05:46:46.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:45 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.14", "id": [2, 4]}]': finished 2024-05-08T05:46:46.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:45 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-05-08T05:46:46.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:45 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-05-08T05:46:46.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:45 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.17", "id": [4, 8]}]': finished 2024-05-08T05:46:46.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:45 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1d", "id": [5, 9]}]': finished 2024-05-08T05:46:46.252 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:45 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-05-08T05:46:46.252 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:45 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-05-08T05:46:46.252 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:45 smithi134 ceph-mon[34132]: osdmap e81: 12 total, 12 up, 12 in 2024-05-08T05:46:46.252 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:45 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:46:46.252 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:45 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:46:46.252 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:45 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:46:46.252 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:45 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:46:46.252 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:45 smithi134 ceph-mon[34132]: osdmap e82: 12 total, 12 up, 12 in 2024-05-08T05:46:46.557 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:46:47.911 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:47 smithi082 ceph-mon[30098]: pgmap v343: 97 pgs: 3 peering, 94 active+clean; 637 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.2 KiB/s wr, 11 op/s 2024-05-08T05:46:47.911 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:47 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:46:47.911 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:47 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:46:48.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:47 smithi151 ceph-mon[34815]: pgmap v343: 97 pgs: 3 peering, 94 active+clean; 637 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.2 KiB/s wr, 11 op/s 2024-05-08T05:46:48.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:47 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:46:48.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:47 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:46:48.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:47 smithi134 ceph-mon[34132]: pgmap v343: 97 pgs: 3 peering, 94 active+clean; 637 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 3.2 KiB/s wr, 11 op/s 2024-05-08T05:46:48.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:47 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:46:48.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:47 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:46:48.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:48.693+0000 7f528ae00700 1 -- 172.21.15.82:0/1679984394 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5284108850 msgr2=0x7f52841103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:48.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:48.693+0000 7f528ae00700 1 --2- 172.21.15.82:0/1679984394 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5284108850 0x7f52841103d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f527c00b0a0 tx=0x7f527c00b3b0 comp rx=0 tx=0).stop 2024-05-08T05:46:48.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:48.694+0000 7f528ae00700 1 -- 172.21.15.82:0/1679984394 shutdown_connections 2024-05-08T05:46:48.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:48.694+0000 7f528ae00700 1 --2- 172.21.15.82:0/1679984394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5284103750 0x7f5284103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:48.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:48.694+0000 7f528ae00700 1 --2- 172.21.15.82:0/1679984394 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5284108850 0x7f52841103d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:48.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:48.694+0000 7f528ae00700 1 --2- 172.21.15.82:0/1679984394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5284104100 0x7f5284108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:48.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:48.694+0000 7f528ae00700 1 -- 172.21.15.82:0/1679984394 >> 172.21.15.82:0/1679984394 conn(0x7f528407a600 msgr2=0x7f528407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:46:48.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:48.694+0000 7f528ae00700 1 -- 172.21.15.82:0/1679984394 shutdown_connections 2024-05-08T05:46:48.696 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:48.694+0000 7f528ae00700 1 -- 172.21.15.82:0/1679984394 wait complete. 2024-05-08T05:46:48.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:48.695+0000 7f528ae00700 1 Processor -- start 2024-05-08T05:46:48.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:48.696+0000 7f528ae00700 1 -- start start 2024-05-08T05:46:48.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:48.696+0000 7f528ae00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5284103750 0x7f52840757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:48.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:48.696+0000 7f528ae00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5284104100 0x7f5284075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:48.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:48.696+0000 7f528ae00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5284108850 0x7f5284076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:48.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:48.696+0000 7f528ae00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5284113640 con 0x7f5284103750 2024-05-08T05:46:48.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:48.696+0000 7f528ae00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f52841134c0 con 0x7f5284108850 2024-05-08T05:46:48.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:48.696+0000 7f528ae00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f52841137c0 con 0x7f5284104100 2024-05-08T05:46:48.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:48.696+0000 7f5283400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5284104100 0x7f5284075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:48.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:48.696+0000 7f5283e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5284103750 0x7f52840757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:48.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:48.696+0000 7f5283400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5284104100 0x7f5284075ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:59532/0 (socket says 172.21.15.82:59532) 2024-05-08T05:46:48.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:48.696+0000 7f5283e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5284103750 0x7f52840757a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39182/0 (socket says 172.21.15.82:39182) 2024-05-08T05:46:48.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:48.696+0000 7f5283400700 1 -- 172.21.15.82:0/1717529521 learned_addr learned my addr 172.21.15.82:0/1717529521 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:46:48.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:48.697+0000 7f5288e00700 1 --2- 172.21.15.82:0/1717529521 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5284108850 0x7f5284076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:48.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:48.697+0000 7f5283400700 1 -- 172.21.15.82:0/1717529521 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5284108850 msgr2=0x7f5284076220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:48.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:48.697+0000 7f5283400700 1 --2- 172.21.15.82:0/1717529521 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5284108850 0x7f5284076220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:48.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:48.697+0000 7f5283400700 1 -- 172.21.15.82:0/1717529521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5284103750 msgr2=0x7f52840757a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:48.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:48.697+0000 7f5283400700 1 --2- 172.21.15.82:0/1717529521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5284103750 0x7f52840757a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:48.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:48.697+0000 7f5283400700 1 -- 172.21.15.82:0/1717529521 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52841a8020 con 0x7f5284104100 2024-05-08T05:46:48.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:48.697+0000 7f5283400700 1 --2- 172.21.15.82:0/1717529521 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5284104100 0x7f5284075ce0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f527000d950 tx=0x7f527000dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:46:48.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:48.697+0000 7f5280c00700 1 -- 172.21.15.82:0/1717529521 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5270016070 con 0x7f5284104100 2024-05-08T05:46:48.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:48.697+0000 7f5280c00700 1 -- 172.21.15.82:0/1717529521 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5270009df0 con 0x7f5284104100 2024-05-08T05:46:48.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:48.697+0000 7f528ae00700 1 -- 172.21.15.82:0/1717529521 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52841a8310 con 0x7f5284104100 2024-05-08T05:46:48.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:48.697+0000 7f5280c00700 1 -- 172.21.15.82:0/1717529521 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f527000f3c0 con 0x7f5284104100 2024-05-08T05:46:48.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:48.697+0000 7f528ae00700 1 -- 172.21.15.82:0/1717529521 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52841a8850 con 0x7f5284104100 2024-05-08T05:46:48.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:48.699+0000 7f528ae00700 1 -- 172.21.15.82:0/1717529521 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f528410ba20 con 0x7f5284104100 2024-05-08T05:46:48.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:48.701+0000 7f5280c00700 1 -- 172.21.15.82:0/1717529521 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f5270019070 con 0x7f5284104100 2024-05-08T05:46:48.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:48.703+0000 7f5280c00700 1 --2- 172.21.15.82:0/1717529521 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f52680b2910 0x7f52680b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:48.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:48.703+0000 7f5280c00700 1 -- 172.21.15.82:0/1717529521 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f52700e1f80 con 0x7f5284104100 2024-05-08T05:46:48.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:48.703+0000 7f5283e00700 1 --2- 172.21.15.82:0/1717529521 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f52680b2910 0x7f52680b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:48.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:48.704+0000 7f5283e00700 1 --2- 172.21.15.82:0/1717529521 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f52680b2910 0x7f52680b4dd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5274009c60 tx=0x7f5274009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:46:48.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:48.707+0000 7f5280c00700 1 -- 172.21.15.82:0/1717529521 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f52700a9af0 con 0x7f5284104100 2024-05-08T05:46:48.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:48.943+0000 7f528ae00700 1 -- 172.21.15.82:0/1717529521 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5284076cd0 con 0x7f5284104100 2024-05-08T05:46:48.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:48.945+0000 7f5280c00700 1 -- 172.21.15.82:0/1717529521 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22631 (secure 0 0 0) 0x7f52700a93f0 con 0x7f5284104100 2024-05-08T05:46:48.947 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:46:48.947 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":82,"fsid":"c739a5c8-0cfc-11ef-bc97-c7b262605968","created":"2024-05-08T05:36:37.441393+0000","modified":"2024-05-08T05:46:45.754375+0000","last_up_change":"2024-05-08T05:44:40.677995+0000","last_in_change":"2024-05-08T05:44:20.654220+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T05:40:28.102836+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T05:45:48.727521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T05:45:53.574048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bc9bd472-b765-4893-84ed-c66b5c1c61b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":4051651615},{"type":"v1","addr":"172.21.15.82:6803","nonce":4051651615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":4051651615},{"type":"v1","addr":"172.21.15.82:6805","nonce":4051651615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4051651615},{"type":"v1","addr":"172.21.15.82:6809","nonce":4051651615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":4051651615},{"type":"v1","addr":"172.21.15.82:6807","nonce":4051651615}]},"public_addr":"172.21.15.82:6803/4051651615","cluster_addr":"172.21.15.82:6805/4051651615","heartbeat_back_addr":"172.21.15.82:6809/4051651615","heartbeat_front_addr":"172.21.15.82:6807/4051651615","state":["exists","up"]},{"osd":1,"uuid":"ad2d3a6b-8bc5-4177-8757-07e8607ca240","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":2763858634},{"type":"v1","addr":"172.21.15.134:6801","nonce":2763858634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":2763858634},{"type":"v1","addr":"172.21.15.134:6803","nonce":2763858634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":2763858634},{"type":"v1","addr":"172.21.15.134:6807","nonce":2763858634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2763858634},{"type":"v1","addr":"172.21.15.134:6805","nonce":2763858634}]},"public_addr":"172.21.15.134:6801/2763858634","cluster_addr":"172.21.15.134:6803/2763858634","heartbeat_back_addr":"172.21.15.134:6807/2763858634","heartbeat_front_addr":"172.21.15.134:6805/2763858634","state":["exists","up"]},{"osd":2,"uuid":"a06dc8fc-7324-4e42-9487-8cfe372401b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":4193933269},{"type":"v1","addr":"172.21.15.151:6801","nonce":4193933269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":4193933269},{"type":"v1","addr":"172.21.15.151:6803","nonce":4193933269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":4193933269},{"type":"v1","addr":"172.21.15.151:6807","nonce":4193933269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":4193933269},{"type":"v1","addr":"172.21.15.151:6805","nonce":4193933269}]},"public_addr":"172.21.15.151:6801/4193933269","cluster_addr":"172.21.15.151:6803/4193933269","heartbeat_back_addr":"172.21.15.151:6807/4193933269","heartbeat_front_addr":"172.21.15.151:6805/4193933269","state":["exists","up"]},{"osd":3,"uuid":"b8c8bdcd-fbd7-4494-976e-7285408e010e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":2775272422},{"type":"v1","addr":"172.21.15.82:6811","nonce":2775272422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":2775272422},{"type":"v1","addr":"172.21.15.82:6813","nonce":2775272422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":2775272422},{"type":"v1","addr":"172.21.15.82:6817","nonce":2775272422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":2775272422},{"type":"v1","addr":"172.21.15.82:6815","nonce":2775272422}]},"public_addr":"172.21.15.82:6811/2775272422","cluster_addr":"172.21.15.82:6813/2775272422","heartbeat_back_addr":"172.21.15.82:6817/2775272422","heartbeat_front_addr":"172.21.15.82:6815/2775272422","state":["exists","up"]},{"osd":4,"uuid":"391a6040-03d1-483c-9058-308b5998e7c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3565208751},{"type":"v1","addr":"172.21.15.134:6809","nonce":3565208751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3565208751},{"type":"v1","addr":"172.21.15.134:6811","nonce":3565208751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3565208751},{"type":"v1","addr":"172.21.15.134:6815","nonce":3565208751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3565208751},{"type":"v1","addr":"172.21.15.134:6813","nonce":3565208751}]},"public_addr":"172.21.15.134:6809/3565208751","cluster_addr":"172.21.15.134:6811/3565208751","heartbeat_back_addr":"172.21.15.134:6815/3565208751","heartbeat_front_addr":"172.21.15.134:6813/3565208751","state":["exists","up"]},{"osd":5,"uuid":"dacce079-4aad-474e-b747-1ed60c3c71cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":1925634069},{"type":"v1","addr":"172.21.15.151:6809","nonce":1925634069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":1925634069},{"type":"v1","addr":"172.21.15.151:6811","nonce":1925634069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1925634069},{"type":"v1","addr":"172.21.15.151:6815","nonce":1925634069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1925634069},{"type":"v1","addr":"172.21.15.151:6813","nonce":1925634069}]},"public_addr":"172.21.15.151:6809/1925634069","cluster_addr":"172.21.15.151:6811/1925634069","heartbeat_back_addr":"172.21.15.151:6815/1925634069","heartbeat_front_addr":"172.21.15.151:6813/1925634069","state":["exists","up"]},{"osd":6,"uuid":"6a445bf4-09c4-4e9b-be6e-68ef3c05b365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":762647976},{"type":"v1","addr":"172.21.15.82:6819","nonce":762647976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":762647976},{"type":"v1","addr":"172.21.15.82:6821","nonce":762647976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":762647976},{"type":"v1","addr":"172.21.15.82:6825","nonce":762647976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":762647976},{"type":"v1","addr":"172.21.15.82:6823","nonce":762647976}]},"public_addr":"172.21.15.82:6819/762647976","cluster_addr":"172.21.15.82:6821/762647976","heartbeat_back_addr":"172.21.15.82:6825/762647976","heartbeat_front_addr":"172.21.15.82:6823/762647976","state":["exists","up"]},{"osd":7,"uuid":"72b0c735-ef30-4823-8ab8-2e5bf7cc3c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3006846927},{"type":"v1","addr":"172.21.15.134:6817","nonce":3006846927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3006846927},{"type":"v1","addr":"172.21.15.134:6819","nonce":3006846927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3006846927},{"type":"v1","addr":"172.21.15.134:6823","nonce":3006846927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3006846927},{"type":"v1","addr":"172.21.15.134:6821","nonce":3006846927}]},"public_addr":"172.21.15.134:6817/3006846927","cluster_addr":"172.21.15.134:6819/3006846927","heartbeat_back_addr":"172.21.15.134:6823/3006846927","heartbeat_front_addr":"172.21.15.134:6821/3006846927","state":["exists","up"]},{"osd":8,"uuid":"93e4da0f-48ea-4ab7-b612-26b545b76de6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":787870717},{"type":"v1","addr":"172.21.15.151:6817","nonce":787870717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":787870717},{"type":"v1","addr":"172.21.15.151:6819","nonce":787870717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":787870717},{"type":"v1","addr":"172.21.15.151:6823","nonce":787870717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":787870717},{"type":"v1","addr":"172.21.15.151:6821","nonce":787870717}]},"public_addr":"172.21.15.151:6817/787870717","cluster_addr":"172.21.15.151:6819/787870717","heartbeat_back_addr":"172.21.15.151:6823/787870717","heartbeat_front_addr":"172.21.15.151:6821/787870717","state":["exists","up"]},{"osd":9,"uuid":"ea0070c1-286a-47d3-90cf-d1fada6e3cda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":533124002},{"type":"v1","addr":"172.21.15.82:6827","nonce":533124002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":533124002},{"type":"v1","addr":"172.21.15.82:6829","nonce":533124002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":533124002},{"type":"v1","addr":"172.21.15.82:6833","nonce":533124002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":533124002},{"type":"v1","addr":"172.21.15.82:6831","nonce":533124002}]},"public_addr":"172.21.15.82:6827/533124002","cluster_addr":"172.21.15.82:6829/533124002","heartbeat_back_addr":"172.21.15.82:6833/533124002","heartbeat_front_addr":"172.21.15.82:6831/533124002","state":["exists","up"]},{"osd":10,"uuid":"26ca0a0b-ab9e-472f-bb29-428e8c31e5bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":99154842},{"type":"v1","addr":"172.21.15.134:6825","nonce":99154842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":99154842},{"type":"v1","addr":"172.21.15.134:6827","nonce":99154842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":99154842},{"type":"v1","addr":"172.21.15.134:6831","nonce":99154842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":99154842},{"type":"v1","addr":"172.21.15.134:6829","nonce":99154842}]},"public_addr":"172.21.15.134:6825/99154842","cluster_addr":"172.21.15.134:6827/99154842","heartbeat_back_addr":"172.21.15.134:6831/99154842","heartbeat_front_addr":"172.21.15.134:6829/99154842","state":["exists","up"]},{"osd":11,"uuid":"9ae5dca4-acfb-4a46-8601-9d642efde794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2242771269},{"type":"v1","addr":"172.21.15.151:6825","nonce":2242771269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2242771269},{"type":"v1","addr":"172.21.15.151:6827","nonce":2242771269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2242771269},{"type":"v1","addr":"172.21.15.151:6831","nonce":2242771269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2242771269},{"type":"v1","addr":"172.21.15.151:6829","nonce":2242771269}]},"public_addr":"172.21.15.151:6825/2242771269","cluster_addr":"172.21.15.151:6827/2242771269","heartbeat_back_addr":"172.21.15.151:6831/2242771269","heartbeat_front_addr":"172.21.15.151:6829/2242771269","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:39:35.575525+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:40:00.672367+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:40:24.558682+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:40:56.791194+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:41:23.031785+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:41:47.926448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:42:21.231894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:42:47.599982+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:43:12.950581+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:43:46.333027+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:44:13.457489+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:44:38.637273+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/2761274596":"2024-05-09T05:37:43.951218+0000","172.21.15.82:0/2195734928":"2024-05-09T05:37:43.951218+0000","172.21.15.82:6801/765895649":"2024-05-09T05:37:43.951218+0000","172.21.15.82:6800/3546670887":"2024-05-09T05:37:11.114057+0000","172.21.15.82:6800/765895649":"2024-05-09T05:37:43.951218+0000","172.21.15.82:0/3986150437":"2024-05-09T05:37:11.114057+0000","172.21.15.82:0/3457457714":"2024-05-09T05:37:11.114057+0000","172.21.15.82:0/2356749286":"2024-05-09T05:37:11.114057+0000","172.21.15.82:6801/3546670887":"2024-05-09T05:37:11.114057+0000","172.21.15.82:0/1694643083":"2024-05-09T05:37:43.951218+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T05:46:48.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:48.949+0000 7f528ae00700 1 -- 172.21.15.82:0/1717529521 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f52680b2910 msgr2=0x7f52680b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:48.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:48.949+0000 7f528ae00700 1 --2- 172.21.15.82:0/1717529521 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f52680b2910 0x7f52680b4dd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5274009c60 tx=0x7f5274009260 comp rx=0 tx=0).stop 2024-05-08T05:46:48.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:48.949+0000 7f528ae00700 1 -- 172.21.15.82:0/1717529521 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5284104100 msgr2=0x7f5284075ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:48.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:48.949+0000 7f528ae00700 1 --2- 172.21.15.82:0/1717529521 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5284104100 0x7f5284075ce0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f527000d950 tx=0x7f527000dc60 comp rx=0 tx=0).stop 2024-05-08T05:46:48.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:48.950+0000 7f528ae00700 1 -- 172.21.15.82:0/1717529521 shutdown_connections 2024-05-08T05:46:48.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:48.950+0000 7f528ae00700 1 --2- 172.21.15.82:0/1717529521 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5284108850 0x7f5284076220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:48.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:48.950+0000 7f528ae00700 1 --2- 172.21.15.82:0/1717529521 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f52680b2910 0x7f52680b4dd0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:48.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:48.950+0000 7f528ae00700 1 --2- 172.21.15.82:0/1717529521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5284103750 0x7f52840757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:48.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:48.950+0000 7f528ae00700 1 --2- 172.21.15.82:0/1717529521 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5284104100 0x7f5284075ce0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:48.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:48.950+0000 7f528ae00700 1 -- 172.21.15.82:0/1717529521 >> 172.21.15.82:0/1717529521 conn(0x7f528407a600 msgr2=0x7f5284101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:46:48.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:48.950+0000 7f528ae00700 1 -- 172.21.15.82:0/1717529521 shutdown_connections 2024-05-08T05:46:48.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:48.950+0000 7f528ae00700 1 -- 172.21.15.82:0/1717529521 wait complete. 2024-05-08T05:46:50.018 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-05-08T05:46:50.019 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph pg dump --format=json 2024-05-08T05:46:50.088 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:49 smithi082 ceph-mon[30098]: pgmap v344: 97 pgs: 3 peering, 94 active+clean; 643 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.0 KiB/s wr, 10 op/s; 6.7 KiB/s, 1 objects/s recovering 2024-05-08T05:46:50.088 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:49 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:46:50.088 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:49 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:46:50.088 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:49 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:46:50.088 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:49 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/1717529521' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:46:50.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:49 smithi151 ceph-mon[34815]: pgmap v344: 97 pgs: 3 peering, 94 active+clean; 643 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.0 KiB/s wr, 10 op/s; 6.7 KiB/s, 1 objects/s recovering 2024-05-08T05:46:50.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:49 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:46:50.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:49 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:46:50.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:49 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:46:50.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:49 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/1717529521' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:46:50.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:49 smithi134 ceph-mon[34132]: pgmap v344: 97 pgs: 3 peering, 94 active+clean; 643 KiB data, 343 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 4.0 KiB/s wr, 10 op/s; 6.7 KiB/s, 1 objects/s recovering 2024-05-08T05:46:50.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:49 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:46:50.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:49 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:46:50.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:49 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:46:50.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:49 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/1717529521' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:46:50.450 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:46:51.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:51 smithi082 ceph-mon[30098]: pgmap v345: 97 pgs: 3 peering, 94 active+clean; 643 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.1 KiB/s wr, 9 op/s; 6.7 KiB/s, 1 objects/s recovering 2024-05-08T05:46:52.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:51 smithi151 ceph-mon[34815]: pgmap v345: 97 pgs: 3 peering, 94 active+clean; 643 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.1 KiB/s wr, 9 op/s; 6.7 KiB/s, 1 objects/s recovering 2024-05-08T05:46:52.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:51 smithi134 ceph-mon[34132]: pgmap v345: 97 pgs: 3 peering, 94 active+clean; 643 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.1 KiB/s wr, 9 op/s; 6.7 KiB/s, 1 objects/s recovering 2024-05-08T05:46:52.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:52.617+0000 7f1cd0c00700 1 -- 172.21.15.82:0/2330883244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ccc106080 msgr2=0x7f1ccc112590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:52.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:52.617+0000 7f1cd0c00700 1 --2- 172.21.15.82:0/2330883244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ccc106080 0x7f1ccc112590 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1cc400b0a0 tx=0x7f1cc400b3b0 comp rx=0 tx=0).stop 2024-05-08T05:46:52.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:52.617+0000 7f1cd0c00700 1 -- 172.21.15.82:0/2330883244 shutdown_connections 2024-05-08T05:46:52.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:52.617+0000 7f1cd0c00700 1 --2- 172.21.15.82:0/2330883244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ccc10b6c0 0x7f1ccc10baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:52.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:52.617+0000 7f1cd0c00700 1 --2- 172.21.15.82:0/2330883244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ccc106080 0x7f1ccc112590 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:52.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:52.617+0000 7f1cd0c00700 1 --2- 172.21.15.82:0/2330883244 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ccc1056c0 0x7f1ccc105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:52.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:52.617+0000 7f1cd0c00700 1 -- 172.21.15.82:0/2330883244 >> 172.21.15.82:0/2330883244 conn(0x7f1ccc1011b0 msgr2=0x7f1ccc1035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:46:52.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:52.617+0000 7f1cd0c00700 1 -- 172.21.15.82:0/2330883244 shutdown_connections 2024-05-08T05:46:52.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:52.617+0000 7f1cd0c00700 1 -- 172.21.15.82:0/2330883244 wait complete. 2024-05-08T05:46:52.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:52.618+0000 7f1cd0c00700 1 Processor -- start 2024-05-08T05:46:52.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:52.618+0000 7f1cd0c00700 1 -- start start 2024-05-08T05:46:52.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:52.619+0000 7f1cd0c00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ccc1056c0 0x7f1ccc19bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:52.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:52.619+0000 7f1cd0c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ccc106080 0x7f1ccc19c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:52.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:52.619+0000 7f1cd0c00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ccc10b6c0 0x7f1ccc1a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:52.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:52.619+0000 7f1cd0c00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1ccc115900 con 0x7f1ccc106080 2024-05-08T05:46:52.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:52.619+0000 7f1cd0c00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1ccc115780 con 0x7f1ccc10b6c0 2024-05-08T05:46:52.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:52.619+0000 7f1cd0c00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1ccc115a80 con 0x7f1ccc1056c0 2024-05-08T05:46:52.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:52.619+0000 7f1cc9400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ccc106080 0x7f1ccc19c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:52.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:52.619+0000 7f1cc9400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ccc106080 0x7f1ccc19c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39190/0 (socket says 172.21.15.82:39190) 2024-05-08T05:46:52.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:52.619+0000 7f1cc9400700 1 -- 172.21.15.82:0/151212071 learned_addr learned my addr 172.21.15.82:0/151212071 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:46:52.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:52.619+0000 7f1cc9e00700 1 --2- 172.21.15.82:0/151212071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ccc1056c0 0x7f1ccc19bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:52.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:52.619+0000 7f1cca800700 1 --2- 172.21.15.82:0/151212071 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ccc10b6c0 0x7f1ccc1a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:52.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:52.620+0000 7f1cc9400700 1 -- 172.21.15.82:0/151212071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ccc1056c0 msgr2=0x7f1ccc19bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:52.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:52.620+0000 7f1cc9400700 1 --2- 172.21.15.82:0/151212071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ccc1056c0 0x7f1ccc19bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:52.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:52.620+0000 7f1cc9400700 1 -- 172.21.15.82:0/151212071 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ccc10b6c0 msgr2=0x7f1ccc1a05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:52.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:52.620+0000 7f1cc9400700 1 --2- 172.21.15.82:0/151212071 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ccc10b6c0 0x7f1ccc1a05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:52.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:52.620+0000 7f1cc9400700 1 -- 172.21.15.82:0/151212071 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ccc1a0d20 con 0x7f1ccc106080 2024-05-08T05:46:52.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:52.620+0000 7f1cc9400700 1 --2- 172.21.15.82:0/151212071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ccc106080 0x7f1ccc19c250 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1cb800d980 tx=0x7f1cb800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:46:52.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:52.620+0000 7f1cc2a00700 1 -- 172.21.15.82:0/151212071 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb8016070 con 0x7f1ccc106080 2024-05-08T05:46:52.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:52.620+0000 7f1cc2a00700 1 -- 172.21.15.82:0/151212071 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1cb8004830 con 0x7f1ccc106080 2024-05-08T05:46:52.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:52.620+0000 7f1cd0c00700 1 -- 172.21.15.82:0/151212071 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ccc1a1010 con 0x7f1ccc106080 2024-05-08T05:46:52.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:52.620+0000 7f1cc2a00700 1 -- 172.21.15.82:0/151212071 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cb8005540 con 0x7f1ccc106080 2024-05-08T05:46:52.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:52.621+0000 7f1cd0c00700 1 -- 172.21.15.82:0/151212071 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ccc1a8890 con 0x7f1ccc106080 2024-05-08T05:46:52.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:52.622+0000 7f1cd0c00700 1 -- 172.21.15.82:0/151212071 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ccc06a190 con 0x7f1ccc106080 2024-05-08T05:46:52.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:52.625+0000 7f1cc2a00700 1 -- 172.21.15.82:0/151212071 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f1cb8004220 con 0x7f1ccc106080 2024-05-08T05:46:52.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:52.627+0000 7f1cc2a00700 1 --2- 172.21.15.82:0/151212071 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f1cb00b2990 0x7f1cb00b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:52.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:52.627+0000 7f1cc2a00700 1 -- 172.21.15.82:0/151212071 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f1cb80e2140 con 0x7f1ccc106080 2024-05-08T05:46:52.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:52.627+0000 7f1cc9e00700 1 --2- 172.21.15.82:0/151212071 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f1cb00b2990 0x7f1cb00b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:52.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:52.628+0000 7f1cc9e00700 1 --2- 172.21.15.82:0/151212071 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f1cb00b2990 0x7f1cb00b4e50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc005950 tx=0x7f1cbc00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:46:52.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:52.632+0000 7f1cc2a00700 1 -- 172.21.15.82:0/151212071 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1cb801f020 con 0x7f1ccc106080 2024-05-08T05:46:52.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:52.864+0000 7f1cd0c00700 1 -- 172.21.15.82:0/151212071 --> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1ccc0638e0 con 0x7f1cb00b2990 2024-05-08T05:46:52.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:52.890+0000 7f1cc2a00700 1 -- 172.21.15.82:0/151212071 <== mgr.14152 v2:172.21.15.82:6800/4089180091 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258978 (secure 0 0 0) 0x7f1ccc0638e0 con 0x7f1cb00b2990 2024-05-08T05:46:52.891 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:46:52.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:52.897+0000 7f1cd0c00700 1 -- 172.21.15.82:0/151212071 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f1cb00b2990 msgr2=0x7f1cb00b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:52.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:52.897+0000 7f1cd0c00700 1 --2- 172.21.15.82:0/151212071 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f1cb00b2990 0x7f1cb00b4e50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc005950 tx=0x7f1cbc00b410 comp rx=0 tx=0).stop 2024-05-08T05:46:52.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:52.897+0000 7f1cd0c00700 1 -- 172.21.15.82:0/151212071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ccc106080 msgr2=0x7f1ccc19c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:52.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:52.897+0000 7f1cd0c00700 1 --2- 172.21.15.82:0/151212071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ccc106080 0x7f1ccc19c250 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1cb800d980 tx=0x7f1cb800dc90 comp rx=0 tx=0).stop 2024-05-08T05:46:52.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:52.897+0000 7f1cd0c00700 1 -- 172.21.15.82:0/151212071 shutdown_connections 2024-05-08T05:46:52.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:52.897+0000 7f1cd0c00700 1 --2- 172.21.15.82:0/151212071 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ccc10b6c0 0x7f1ccc1a05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:52.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:52.897+0000 7f1cd0c00700 1 --2- 172.21.15.82:0/151212071 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f1cb00b2990 0x7f1cb00b4e50 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:52.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:52.897+0000 7f1cd0c00700 1 --2- 172.21.15.82:0/151212071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ccc1056c0 0x7f1ccc19bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:52.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:52.897+0000 7f1cd0c00700 1 --2- 172.21.15.82:0/151212071 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1ccc106080 0x7f1ccc19c250 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:52.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:52.897+0000 7f1cd0c00700 1 -- 172.21.15.82:0/151212071 >> 172.21.15.82:0/151212071 conn(0x7f1ccc1011b0 msgr2=0x7f1ccc101730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:46:52.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:52.897+0000 7f1cd0c00700 1 -- 172.21.15.82:0/151212071 shutdown_connections 2024-05-08T05:46:52.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:52.897+0000 7f1cd0c00700 1 -- 172.21.15.82:0/151212071 wait complete. 2024-05-08T05:46:52.900 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-05-08T05:46:53.870 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":346,"stamp":"2024-05-08T05:46:52.120762+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":662197,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":431,"num_read_kb":313,"num_write":371,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":3007130,"num_keys_recovered":20,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":305,"ondisk_log_size":305,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":293,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":351904,"kb_used_data":11004,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124589920,"statfs":{"total":1151940427776,"available":1151580078080,"internally_reserved":0,"allocated":11268096,"data_stored":7188933,"data_compressed":116202,"data_compressed_allocated":147456,"data_compressed_original":1822720,"omap_allocated":19138,"internal_metadata":348894526},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9560,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":40,"num_write":13,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":55290,"num_keys_recovered":20,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003309"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.760116+0000","last_change":"2024-05-08T05:45:54.796792+0000","last_active":"2024-05-08T05:46:45.760116+0000","last_peered":"2024-05-08T05:46:45.760116+0000","last_clean":"2024-05-08T05:46:45.760116+0000","last_became_active":"2024-05-08T05:45:54.796445+0000","last_became_peered":"2024-05-08T05:45:54.796445+0000","last_unstale":"2024-05-08T05:46:45.760116+0000","last_undegraded":"2024-05-08T05:46:45.760116+0000","last_fullsized":"2024-05-08T05:46:45.760116+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:41:12.762659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.772958+0000","last_change":"2024-05-08T05:45:54.800291+0000","last_active":"2024-05-08T05:46:45.772958+0000","last_peered":"2024-05-08T05:46:45.772958+0000","last_clean":"2024-05-08T05:46:45.772958+0000","last_became_active":"2024-05-08T05:45:54.798182+0000","last_became_peered":"2024-05-08T05:45:54.798182+0000","last_unstale":"2024-05-08T05:46:45.772958+0000","last_undegraded":"2024-05-08T05:46:45.772958+0000","last_fullsized":"2024-05-08T05:46:45.772958+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:55:52.672307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.772834+0000","last_change":"2024-05-08T05:45:54.792574+0000","last_active":"2024-05-08T05:46:45.772834+0000","last_peered":"2024-05-08T05:46:45.772834+0000","last_clean":"2024-05-08T05:46:45.772834+0000","last_became_active":"2024-05-08T05:45:54.790856+0000","last_became_peered":"2024-05-08T05:45:54.790856+0000","last_unstale":"2024-05-08T05:46:45.772834+0000","last_undegraded":"2024-05-08T05:46:45.772834+0000","last_fullsized":"2024-05-08T05:46:45.772834+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:32:33.727532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.952768+0000","last_change":"2024-05-08T05:45:54.772883+0000","last_active":"2024-05-08T05:46:45.952768+0000","last_peered":"2024-05-08T05:46:45.952768+0000","last_clean":"2024-05-08T05:46:45.952768+0000","last_became_active":"2024-05-08T05:45:54.772457+0000","last_became_peered":"2024-05-08T05:45:54.772457+0000","last_unstale":"2024-05-08T05:46:45.952768+0000","last_undegraded":"2024-05-08T05:46:45.952768+0000","last_fullsized":"2024-05-08T05:46:45.952768+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:50:20.116563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.763157+0000","last_change":"2024-05-08T05:45:54.798868+0000","last_active":"2024-05-08T05:46:45.763157+0000","last_peered":"2024-05-08T05:46:45.763157+0000","last_clean":"2024-05-08T05:46:45.763157+0000","last_became_active":"2024-05-08T05:45:54.798459+0000","last_became_peered":"2024-05-08T05:45:54.798459+0000","last_unstale":"2024-05-08T05:46:45.763157+0000","last_undegraded":"2024-05-08T05:46:45.763157+0000","last_fullsized":"2024-05-08T05:46:45.763157+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:59:32.280051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.763364+0000","last_change":"2024-05-08T05:45:54.788172+0000","last_active":"2024-05-08T05:46:45.763364+0000","last_peered":"2024-05-08T05:46:45.763364+0000","last_clean":"2024-05-08T05:46:45.763364+0000","last_became_active":"2024-05-08T05:45:54.787609+0000","last_became_peered":"2024-05-08T05:45:54.787609+0000","last_unstale":"2024-05-08T05:46:45.763364+0000","last_undegraded":"2024-05-08T05:46:45.763364+0000","last_fullsized":"2024-05-08T05:46:45.763364+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:30:17.295770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762193+0000","last_change":"2024-05-08T05:45:54.786904+0000","last_active":"2024-05-08T05:46:45.762193+0000","last_peered":"2024-05-08T05:46:45.762193+0000","last_clean":"2024-05-08T05:46:45.762193+0000","last_became_active":"2024-05-08T05:45:54.786484+0000","last_became_peered":"2024-05-08T05:45:54.786484+0000","last_unstale":"2024-05-08T05:46:45.762193+0000","last_undegraded":"2024-05-08T05:46:45.762193+0000","last_fullsized":"2024-05-08T05:46:45.762193+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:14:15.398144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.761367+0000","last_change":"2024-05-08T05:45:54.801559+0000","last_active":"2024-05-08T05:46:45.761367+0000","last_peered":"2024-05-08T05:46:45.761367+0000","last_clean":"2024-05-08T05:46:45.761367+0000","last_became_active":"2024-05-08T05:45:54.796293+0000","last_became_peered":"2024-05-08T05:45:54.796293+0000","last_unstale":"2024-05-08T05:46:45.761367+0000","last_undegraded":"2024-05-08T05:46:45.761367+0000","last_fullsized":"2024-05-08T05:46:45.761367+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:07:05.483562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.766595+0000","last_change":"2024-05-08T05:45:54.780450+0000","last_active":"2024-05-08T05:46:45.766595+0000","last_peered":"2024-05-08T05:46:45.766595+0000","last_clean":"2024-05-08T05:46:45.766595+0000","last_became_active":"2024-05-08T05:45:54.780079+0000","last_became_peered":"2024-05-08T05:45:54.780079+0000","last_unstale":"2024-05-08T05:46:45.766595+0000","last_undegraded":"2024-05-08T05:46:45.766595+0000","last_fullsized":"2024-05-08T05:46:45.766595+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:41:26.688748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.764209+0000","last_change":"2024-05-08T05:45:54.776294+0000","last_active":"2024-05-08T05:46:45.764209+0000","last_peered":"2024-05-08T05:46:45.764209+0000","last_clean":"2024-05-08T05:46:45.764209+0000","last_became_active":"2024-05-08T05:45:54.775928+0000","last_became_peered":"2024-05-08T05:45:54.775928+0000","last_unstale":"2024-05-08T05:46:45.764209+0000","last_undegraded":"2024-05-08T05:46:45.764209+0000","last_fullsized":"2024-05-08T05:46:45.764209+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:17:53.453446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.763188+0000","last_change":"2024-05-08T05:45:54.781478+0000","last_active":"2024-05-08T05:46:45.763188+0000","last_peered":"2024-05-08T05:46:45.763188+0000","last_clean":"2024-05-08T05:46:45.763188+0000","last_became_active":"2024-05-08T05:45:54.780839+0000","last_became_peered":"2024-05-08T05:45:54.780839+0000","last_unstale":"2024-05-08T05:46:45.763188+0000","last_undegraded":"2024-05-08T05:46:45.763188+0000","last_fullsized":"2024-05-08T05:46:45.763188+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:39:14.518391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.952652+0000","last_change":"2024-05-08T05:45:54.774650+0000","last_active":"2024-05-08T05:46:45.952652+0000","last_peered":"2024-05-08T05:46:45.952652+0000","last_clean":"2024-05-08T05:46:45.952652+0000","last_became_active":"2024-05-08T05:45:54.774276+0000","last_became_peered":"2024-05-08T05:45:54.774276+0000","last_unstale":"2024-05-08T05:46:45.952652+0000","last_undegraded":"2024-05-08T05:46:45.952652+0000","last_fullsized":"2024-05-08T05:46:45.952652+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:43:53.390553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.773880+0000","last_change":"2024-05-08T05:45:54.783430+0000","last_active":"2024-05-08T05:46:45.773880+0000","last_peered":"2024-05-08T05:46:45.773880+0000","last_clean":"2024-05-08T05:46:45.773880+0000","last_became_active":"2024-05-08T05:45:54.782394+0000","last_became_peered":"2024-05-08T05:45:54.782394+0000","last_unstale":"2024-05-08T05:46:45.773880+0000","last_undegraded":"2024-05-08T05:46:45.773880+0000","last_fullsized":"2024-05-08T05:46:45.773880+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:47:01.864111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.772480+0000","last_change":"2024-05-08T05:45:54.792880+0000","last_active":"2024-05-08T05:46:45.772480+0000","last_peered":"2024-05-08T05:46:45.772480+0000","last_clean":"2024-05-08T05:46:45.772480+0000","last_became_active":"2024-05-08T05:45:54.789653+0000","last_became_peered":"2024-05-08T05:45:54.789653+0000","last_unstale":"2024-05-08T05:46:45.772480+0000","last_undegraded":"2024-05-08T05:46:45.772480+0000","last_fullsized":"2024-05-08T05:46:45.772480+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:57:10.552014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.771077+0000","last_change":"2024-05-08T05:45:54.793612+0000","last_active":"2024-05-08T05:46:45.771077+0000","last_peered":"2024-05-08T05:46:45.771077+0000","last_clean":"2024-05-08T05:46:45.771077+0000","last_became_active":"2024-05-08T05:45:54.793191+0000","last_became_peered":"2024-05-08T05:45:54.793191+0000","last_unstale":"2024-05-08T05:46:45.771077+0000","last_undegraded":"2024-05-08T05:46:45.771077+0000","last_fullsized":"2024-05-08T05:46:45.771077+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:49:35.066070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.766009+0000","last_change":"2024-05-08T05:45:54.799679+0000","last_active":"2024-05-08T05:46:45.766009+0000","last_peered":"2024-05-08T05:46:45.766009+0000","last_clean":"2024-05-08T05:46:45.766009+0000","last_became_active":"2024-05-08T05:45:54.799196+0000","last_became_peered":"2024-05-08T05:45:54.799196+0000","last_unstale":"2024-05-08T05:46:45.766009+0000","last_undegraded":"2024-05-08T05:46:45.766009+0000","last_fullsized":"2024-05-08T05:46:45.766009+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:14:00.597282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.760351+0000","last_change":"2024-05-08T05:45:54.796799+0000","last_active":"2024-05-08T05:46:45.760351+0000","last_peered":"2024-05-08T05:46:45.760351+0000","last_clean":"2024-05-08T05:46:45.760351+0000","last_became_active":"2024-05-08T05:45:54.796501+0000","last_became_peered":"2024-05-08T05:45:54.796501+0000","last_unstale":"2024-05-08T05:46:45.760351+0000","last_undegraded":"2024-05-08T05:46:45.760351+0000","last_fullsized":"2024-05-08T05:46:45.760351+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:14:59.446718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.775046+0000","last_change":"2024-05-08T05:45:54.789544+0000","last_active":"2024-05-08T05:46:45.775046+0000","last_peered":"2024-05-08T05:46:45.775046+0000","last_clean":"2024-05-08T05:46:45.775046+0000","last_became_active":"2024-05-08T05:45:54.787901+0000","last_became_peered":"2024-05-08T05:45:54.787901+0000","last_unstale":"2024-05-08T05:46:45.775046+0000","last_undegraded":"2024-05-08T05:46:45.775046+0000","last_fullsized":"2024-05-08T05:46:45.775046+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:12:23.200311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762372+0000","last_change":"2024-05-08T05:45:54.782537+0000","last_active":"2024-05-08T05:46:45.762372+0000","last_peered":"2024-05-08T05:46:45.762372+0000","last_clean":"2024-05-08T05:46:45.762372+0000","last_became_active":"2024-05-08T05:45:54.781389+0000","last_became_peered":"2024-05-08T05:45:54.781389+0000","last_unstale":"2024-05-08T05:46:45.762372+0000","last_undegraded":"2024-05-08T05:46:45.762372+0000","last_fullsized":"2024-05-08T05:46:45.762372+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:56:22.041900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"80'13","reported_seq":72,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:48.051153+0000","last_change":"2024-05-08T05:45:50.744496+0000","last_active":"2024-05-08T05:46:48.051153+0000","last_peered":"2024-05-08T05:46:48.051153+0000","last_clean":"2024-05-08T05:46:48.051153+0000","last_became_active":"2024-05-08T05:45:50.743882+0000","last_became_peered":"2024-05-08T05:45:50.743882+0000","last_unstale":"2024-05-08T05:46:48.051153+0000","last_undegraded":"2024-05-08T05:46:48.051153+0000","last_fullsized":"2024-05-08T05:46:48.051153+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:45:11.198096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.959222+0000","last_change":"2024-05-08T05:46:45.957649+0000","last_active":"2024-05-08T05:46:45.959222+0000","last_peered":"2024-05-08T05:46:45.959222+0000","last_clean":"2024-05-08T05:46:45.959222+0000","last_became_active":"2024-05-08T05:46:45.957154+0000","last_became_peered":"2024-05-08T05:46:45.957154+0000","last_unstale":"2024-05-08T05:46:45.959222+0000","last_undegraded":"2024-05-08T05:46:45.959222+0000","last_fullsized":"2024-05-08T05:46:45.959222+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:29:25.475541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.763641+0000","last_change":"2024-05-08T05:45:50.863409+0000","last_active":"2024-05-08T05:46:45.763641+0000","last_peered":"2024-05-08T05:46:45.763641+0000","last_clean":"2024-05-08T05:46:45.763641+0000","last_became_active":"2024-05-08T05:45:50.861818+0000","last_became_peered":"2024-05-08T05:45:50.861818+0000","last_unstale":"2024-05-08T05:46:45.763641+0000","last_undegraded":"2024-05-08T05:46:45.763641+0000","last_fullsized":"2024-05-08T05:46:45.763641+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:39:32.821431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.773498+0000","last_change":"2024-05-08T05:45:54.797429+0000","last_active":"2024-05-08T05:46:45.773498+0000","last_peered":"2024-05-08T05:46:45.773498+0000","last_clean":"2024-05-08T05:46:45.773498+0000","last_became_active":"2024-05-08T05:45:54.795030+0000","last_became_peered":"2024-05-08T05:45:54.795030+0000","last_unstale":"2024-05-08T05:46:45.773498+0000","last_undegraded":"2024-05-08T05:46:45.773498+0000","last_fullsized":"2024-05-08T05:46:45.773498+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:43:34.852889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"80'12","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.772846+0000","last_change":"2024-05-08T05:46:45.772846+0000","last_active":"2024-05-08T05:46:45.772846+0000","last_peered":"2024-05-08T05:46:45.772846+0000","last_clean":"2024-05-08T05:46:45.772846+0000","last_became_active":"2024-05-08T05:46:45.763937+0000","last_became_peered":"2024-05-08T05:46:45.763937+0000","last_unstale":"2024-05-08T05:46:45.772846+0000","last_undegraded":"2024-05-08T05:46:45.772846+0000","last_fullsized":"2024-05-08T05:46:45.772846+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:48:13.233059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.766197+0000","last_change":"2024-05-08T05:45:54.788852+0000","last_active":"2024-05-08T05:46:45.766197+0000","last_peered":"2024-05-08T05:46:45.766197+0000","last_clean":"2024-05-08T05:46:45.766197+0000","last_became_active":"2024-05-08T05:45:54.788496+0000","last_became_peered":"2024-05-08T05:45:54.788496+0000","last_unstale":"2024-05-08T05:46:45.766197+0000","last_undegraded":"2024-05-08T05:46:45.766197+0000","last_fullsized":"2024-05-08T05:46:45.766197+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:44:45.379728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"80'5","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762860+0000","last_change":"2024-05-08T05:45:50.741528+0000","last_active":"2024-05-08T05:46:45.762860+0000","last_peered":"2024-05-08T05:46:45.762860+0000","last_clean":"2024-05-08T05:46:45.762860+0000","last_became_active":"2024-05-08T05:45:50.741232+0000","last_became_peered":"2024-05-08T05:45:50.741232+0000","last_unstale":"2024-05-08T05:46:45.762860+0000","last_undegraded":"2024-05-08T05:46:45.762860+0000","last_fullsized":"2024-05-08T05:46:45.762860+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:36:48.540858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.956068+0000","last_change":"2024-05-08T05:46:45.954990+0000","last_active":"2024-05-08T05:46:45.956068+0000","last_peered":"2024-05-08T05:46:45.956068+0000","last_clean":"2024-05-08T05:46:45.956068+0000","last_became_active":"2024-05-08T05:46:45.953589+0000","last_became_peered":"2024-05-08T05:46:45.953589+0000","last_unstale":"2024-05-08T05:46:45.956068+0000","last_undegraded":"2024-05-08T05:46:45.956068+0000","last_fullsized":"2024-05-08T05:46:45.956068+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:29:17.410356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1b","version":"80'5","reported_seq":65,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:48.024063+0000","last_change":"2024-05-08T05:45:50.746462+0000","last_active":"2024-05-08T05:46:48.024063+0000","last_peered":"2024-05-08T05:46:48.024063+0000","last_clean":"2024-05-08T05:46:48.024063+0000","last_became_active":"2024-05-08T05:45:50.746064+0000","last_became_peered":"2024-05-08T05:45:50.746064+0000","last_unstale":"2024-05-08T05:46:48.024063+0000","last_undegraded":"2024-05-08T05:46:48.024063+0000","last_fullsized":"2024-05-08T05:46:48.024063+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:51:49.076829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762979+0000","last_change":"2024-05-08T05:45:54.788524+0000","last_active":"2024-05-08T05:46:45.762979+0000","last_peered":"2024-05-08T05:46:45.762979+0000","last_clean":"2024-05-08T05:46:45.762979+0000","last_became_active":"2024-05-08T05:45:54.788179+0000","last_became_peered":"2024-05-08T05:45:54.788179+0000","last_unstale":"2024-05-08T05:46:45.762979+0000","last_undegraded":"2024-05-08T05:46:45.762979+0000","last_fullsized":"2024-05-08T05:46:45.762979+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:44:34.257799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":47,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.780705+0000","last_change":"2024-05-08T05:46:45.780705+0000","last_active":"2024-05-08T05:46:45.780705+0000","last_peered":"2024-05-08T05:46:45.780705+0000","last_clean":"2024-05-08T05:46:45.780705+0000","last_became_active":"2024-05-08T05:46:45.773246+0000","last_became_peered":"2024-05-08T05:46:45.773246+0000","last_unstale":"2024-05-08T05:46:45.780705+0000","last_undegraded":"2024-05-08T05:46:45.780705+0000","last_fullsized":"2024-05-08T05:46:45.780705+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:10:33.491186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.956252+0000","last_change":"2024-05-08T05:45:54.792001+0000","last_active":"2024-05-08T05:46:45.956252+0000","last_peered":"2024-05-08T05:46:45.956252+0000","last_clean":"2024-05-08T05:46:45.956252+0000","last_became_active":"2024-05-08T05:45:54.791581+0000","last_became_peered":"2024-05-08T05:45:54.791581+0000","last_unstale":"2024-05-08T05:46:45.956252+0000","last_undegraded":"2024-05-08T05:46:45.956252+0000","last_fullsized":"2024-05-08T05:46:45.956252+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:43:37.437251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"80'3","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.771530+0000","last_change":"2024-05-08T05:45:50.740645+0000","last_active":"2024-05-08T05:46:45.771530+0000","last_peered":"2024-05-08T05:46:45.771530+0000","last_clean":"2024-05-08T05:46:45.771530+0000","last_became_active":"2024-05-08T05:45:50.739997+0000","last_became_peered":"2024-05-08T05:45:50.739997+0000","last_unstale":"2024-05-08T05:46:45.771530+0000","last_undegraded":"2024-05-08T05:46:45.771530+0000","last_fullsized":"2024-05-08T05:46:45.771530+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:24:48.895557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.761593+0000","last_change":"2024-05-08T05:45:54.802757+0000","last_active":"2024-05-08T05:46:45.761593+0000","last_peered":"2024-05-08T05:46:45.761593+0000","last_clean":"2024-05-08T05:46:45.761593+0000","last_became_active":"2024-05-08T05:45:54.798549+0000","last_became_peered":"2024-05-08T05:45:54.798549+0000","last_unstale":"2024-05-08T05:46:45.761593+0000","last_undegraded":"2024-05-08T05:46:45.761593+0000","last_fullsized":"2024-05-08T05:46:45.761593+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:39:37.582997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'3","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.955933+0000","last_change":"2024-05-08T05:45:50.743989+0000","last_active":"2024-05-08T05:46:45.955933+0000","last_peered":"2024-05-08T05:46:45.955933+0000","last_clean":"2024-05-08T05:46:45.955933+0000","last_became_active":"2024-05-08T05:45:50.743582+0000","last_became_peered":"2024-05-08T05:45:50.743582+0000","last_unstale":"2024-05-08T05:46:45.955933+0000","last_undegraded":"2024-05-08T05:46:45.955933+0000","last_fullsized":"2024-05-08T05:46:45.955933+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:14:46.820582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.768766+0000","last_change":"2024-05-08T05:45:54.807249+0000","last_active":"2024-05-08T05:46:45.768766+0000","last_peered":"2024-05-08T05:46:45.768766+0000","last_clean":"2024-05-08T05:46:45.768766+0000","last_became_active":"2024-05-08T05:45:54.806823+0000","last_became_peered":"2024-05-08T05:45:54.806823+0000","last_unstale":"2024-05-08T05:46:45.768766+0000","last_undegraded":"2024-05-08T05:46:45.768766+0000","last_fullsized":"2024-05-08T05:46:45.768766+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:37:25.526927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":98,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:51.027879+0000","last_change":"2024-05-08T05:45:50.747477+0000","last_active":"2024-05-08T05:46:51.027879+0000","last_peered":"2024-05-08T05:46:51.027879+0000","last_clean":"2024-05-08T05:46:51.027879+0000","last_became_active":"2024-05-08T05:45:50.747103+0000","last_became_peered":"2024-05-08T05:45:50.747103+0000","last_unstale":"2024-05-08T05:46:51.027879+0000","last_undegraded":"2024-05-08T05:46:51.027879+0000","last_fullsized":"2024-05-08T05:46:51.027879+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:08:17.108826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":68,"num_read_kb":68,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.766364+0000","last_change":"2024-05-08T05:45:54.787885+0000","last_active":"2024-05-08T05:46:45.766364+0000","last_peered":"2024-05-08T05:46:45.766364+0000","last_clean":"2024-05-08T05:46:45.766364+0000","last_became_active":"2024-05-08T05:45:54.787480+0000","last_became_peered":"2024-05-08T05:45:54.787480+0000","last_unstale":"2024-05-08T05:46:45.766364+0000","last_undegraded":"2024-05-08T05:46:45.766364+0000","last_fullsized":"2024-05-08T05:46:45.766364+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:13:42.889918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'4","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.763007+0000","last_change":"2024-05-08T05:45:50.741271+0000","last_active":"2024-05-08T05:46:45.763007+0000","last_peered":"2024-05-08T05:46:45.763007+0000","last_clean":"2024-05-08T05:46:45.763007+0000","last_became_active":"2024-05-08T05:45:50.740869+0000","last_became_peered":"2024-05-08T05:45:50.740869+0000","last_unstale":"2024-05-08T05:46:45.763007+0000","last_undegraded":"2024-05-08T05:46:45.763007+0000","last_fullsized":"2024-05-08T05:46:45.763007+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:57:40.855732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.958524+0000","last_change":"2024-05-08T05:46:45.958524+0000","last_active":"2024-05-08T05:46:45.958524+0000","last_peered":"2024-05-08T05:46:45.958524+0000","last_clean":"2024-05-08T05:46:45.958524+0000","last_became_active":"2024-05-08T05:46:45.957576+0000","last_became_peered":"2024-05-08T05:46:45.957576+0000","last_unstale":"2024-05-08T05:46:45.958524+0000","last_undegraded":"2024-05-08T05:46:45.958524+0000","last_fullsized":"2024-05-08T05:46:45.958524+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:59:34.927448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.956533+0000","last_change":"2024-05-08T05:45:50.865467+0000","last_active":"2024-05-08T05:46:45.956533+0000","last_peered":"2024-05-08T05:46:45.956533+0000","last_clean":"2024-05-08T05:46:45.956533+0000","last_became_active":"2024-05-08T05:45:50.865245+0000","last_became_peered":"2024-05-08T05:45:50.865245+0000","last_unstale":"2024-05-08T05:46:45.956533+0000","last_undegraded":"2024-05-08T05:46:45.956533+0000","last_fullsized":"2024-05-08T05:46:45.956533+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:03:40.990651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.766286+0000","last_change":"2024-05-08T05:45:54.780782+0000","last_active":"2024-05-08T05:46:45.766286+0000","last_peered":"2024-05-08T05:46:45.766286+0000","last_clean":"2024-05-08T05:46:45.766286+0000","last_became_active":"2024-05-08T05:45:54.780074+0000","last_became_peered":"2024-05-08T05:45:54.780074+0000","last_unstale":"2024-05-08T05:46:45.766286+0000","last_undegraded":"2024-05-08T05:46:45.766286+0000","last_fullsized":"2024-05-08T05:46:45.766286+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:23:09.026115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'32","reported_seq":154,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:50.968643+0000","last_change":"2024-05-08T05:46:45.965985+0000","last_active":"2024-05-08T05:46:50.968643+0000","last_peered":"2024-05-08T05:46:50.968643+0000","last_clean":"2024-05-08T05:46:50.968643+0000","last_became_active":"2024-05-08T05:46:45.953485+0000","last_became_peered":"2024-05-08T05:46:45.953485+0000","last_unstale":"2024-05-08T05:46:50.968643+0000","last_undegraded":"2024-05-08T05:46:50.968643+0000","last_fullsized":"2024-05-08T05:46:50.968643+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:51:45.723988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64782,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":88,"num_write":34,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":55222,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762571+0000","last_change":"2024-05-08T05:45:54.777524+0000","last_active":"2024-05-08T05:46:45.762571+0000","last_peered":"2024-05-08T05:46:45.762571+0000","last_clean":"2024-05-08T05:46:45.762571+0000","last_became_active":"2024-05-08T05:45:54.776756+0000","last_became_peered":"2024-05-08T05:45:54.776756+0000","last_unstale":"2024-05-08T05:46:45.762571+0000","last_undegraded":"2024-05-08T05:46:45.762571+0000","last_fullsized":"2024-05-08T05:46:45.762571+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:54:27.320411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'9","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.783284+0000","last_change":"2024-05-08T05:46:45.783284+0000","last_active":"2024-05-08T05:46:45.783284+0000","last_peered":"2024-05-08T05:46:45.783284+0000","last_clean":"2024-05-08T05:46:45.783284+0000","last_became_active":"2024-05-08T05:46:45.765201+0000","last_became_peered":"2024-05-08T05:46:45.765201+0000","last_unstale":"2024-05-08T05:46:45.783284+0000","last_undegraded":"2024-05-08T05:46:45.783284+0000","last_fullsized":"2024-05-08T05:46:45.783284+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:44:59.762324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.770085+0000","last_change":"2024-05-08T05:45:54.789165+0000","last_active":"2024-05-08T05:46:45.770085+0000","last_peered":"2024-05-08T05:46:45.770085+0000","last_clean":"2024-05-08T05:46:45.770085+0000","last_became_active":"2024-05-08T05:45:54.788673+0000","last_became_peered":"2024-05-08T05:45:54.788673+0000","last_unstale":"2024-05-08T05:46:45.770085+0000","last_undegraded":"2024-05-08T05:46:45.770085+0000","last_fullsized":"2024-05-08T05:46:45.770085+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:29:08.722409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'5","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.956172+0000","last_change":"2024-05-08T05:45:50.750836+0000","last_active":"2024-05-08T05:46:45.956172+0000","last_peered":"2024-05-08T05:46:45.956172+0000","last_clean":"2024-05-08T05:46:45.956172+0000","last_became_active":"2024-05-08T05:45:50.750587+0000","last_became_peered":"2024-05-08T05:45:50.750587+0000","last_unstale":"2024-05-08T05:46:45.956172+0000","last_undegraded":"2024-05-08T05:46:45.956172+0000","last_fullsized":"2024-05-08T05:46:45.956172+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:19:03.780050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762766+0000","last_change":"2024-05-08T05:45:54.791475+0000","last_active":"2024-05-08T05:46:45.762766+0000","last_peered":"2024-05-08T05:46:45.762766+0000","last_clean":"2024-05-08T05:46:45.762766+0000","last_became_active":"2024-05-08T05:45:54.791122+0000","last_became_peered":"2024-05-08T05:45:54.791122+0000","last_unstale":"2024-05-08T05:46:45.762766+0000","last_undegraded":"2024-05-08T05:46:45.762766+0000","last_fullsized":"2024-05-08T05:46:45.762766+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:08:01.261852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'5","reported_seq":66,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:49.035236+0000","last_change":"2024-05-08T05:45:50.742848+0000","last_active":"2024-05-08T05:46:49.035236+0000","last_peered":"2024-05-08T05:46:49.035236+0000","last_clean":"2024-05-08T05:46:49.035236+0000","last_became_active":"2024-05-08T05:45:50.742448+0000","last_became_peered":"2024-05-08T05:45:50.742448+0000","last_unstale":"2024-05-08T05:46:49.035236+0000","last_undegraded":"2024-05-08T05:46:49.035236+0000","last_fullsized":"2024-05-08T05:46:49.035236+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:17:35.970285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":36,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762192+0000","last_change":"2024-05-08T05:45:54.773009+0000","last_active":"2024-05-08T05:46:45.762192+0000","last_peered":"2024-05-08T05:46:45.762192+0000","last_clean":"2024-05-08T05:46:45.762192+0000","last_became_active":"2024-05-08T05:45:54.772597+0000","last_became_peered":"2024-05-08T05:45:54.772597+0000","last_unstale":"2024-05-08T05:46:45.762192+0000","last_undegraded":"2024-05-08T05:46:45.762192+0000","last_fullsized":"2024-05-08T05:46:45.762192+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:41:31.632363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'17","reported_seq":44,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762729+0000","last_change":"2024-05-08T05:45:50.867734+0000","last_active":"2024-05-08T05:46:45.762729+0000","last_peered":"2024-05-08T05:46:45.762729+0000","last_clean":"2024-05-08T05:46:45.762729+0000","last_became_active":"2024-05-08T05:45:50.867441+0000","last_became_peered":"2024-05-08T05:45:50.867441+0000","last_unstale":"2024-05-08T05:46:45.762729+0000","last_undegraded":"2024-05-08T05:46:45.762729+0000","last_fullsized":"2024-05-08T05:46:45.762729+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:16:45.430432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.956004+0000","last_change":"2024-05-08T05:45:54.777168+0000","last_active":"2024-05-08T05:46:45.956004+0000","last_peered":"2024-05-08T05:46:45.956004+0000","last_clean":"2024-05-08T05:46:45.956004+0000","last_became_active":"2024-05-08T05:45:54.775985+0000","last_became_peered":"2024-05-08T05:45:54.775985+0000","last_unstale":"2024-05-08T05:46:45.956004+0000","last_undegraded":"2024-05-08T05:46:45.956004+0000","last_fullsized":"2024-05-08T05:46:45.956004+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:57:49.495860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762559+0000","last_change":"2024-05-08T05:45:50.741375+0000","last_active":"2024-05-08T05:46:45.762559+0000","last_peered":"2024-05-08T05:46:45.762559+0000","last_clean":"2024-05-08T05:46:45.762559+0000","last_became_active":"2024-05-08T05:45:50.741025+0000","last_became_peered":"2024-05-08T05:45:50.741025+0000","last_unstale":"2024-05-08T05:46:45.762559+0000","last_undegraded":"2024-05-08T05:46:45.762559+0000","last_fullsized":"2024-05-08T05:46:45.762559+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:01:43.515119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.760030+0000","last_change":"2024-05-08T05:45:54.780302+0000","last_active":"2024-05-08T05:46:45.760030+0000","last_peered":"2024-05-08T05:46:45.760030+0000","last_clean":"2024-05-08T05:46:45.760030+0000","last_became_active":"2024-05-08T05:45:54.778751+0000","last_became_peered":"2024-05-08T05:45:54.778751+0000","last_unstale":"2024-05-08T05:46:45.760030+0000","last_undegraded":"2024-05-08T05:46:45.760030+0000","last_fullsized":"2024-05-08T05:46:45.760030+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:34:57.686504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.770415+0000","last_change":"2024-05-08T05:45:50.870071+0000","last_active":"2024-05-08T05:46:45.770415+0000","last_peered":"2024-05-08T05:46:45.770415+0000","last_clean":"2024-05-08T05:46:45.770415+0000","last_became_active":"2024-05-08T05:45:50.869162+0000","last_became_peered":"2024-05-08T05:45:50.869162+0000","last_unstale":"2024-05-08T05:46:45.770415+0000","last_undegraded":"2024-05-08T05:46:45.770415+0000","last_fullsized":"2024-05-08T05:46:45.770415+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:05:13.104922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'1","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.763821+0000","last_change":"2024-05-08T05:45:54.780983+0000","last_active":"2024-05-08T05:46:45.763821+0000","last_peered":"2024-05-08T05:46:45.763821+0000","last_clean":"2024-05-08T05:46:45.763821+0000","last_became_active":"2024-05-08T05:45:54.780617+0000","last_became_peered":"2024-05-08T05:45:54.780617+0000","last_unstale":"2024-05-08T05:46:45.763821+0000","last_undegraded":"2024-05-08T05:46:45.763821+0000","last_fullsized":"2024-05-08T05:46:45.763821+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:56:40.972467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"80'5","reported_seq":64,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:48.051991+0000","last_change":"2024-05-08T05:45:50.748869+0000","last_active":"2024-05-08T05:46:48.051991+0000","last_peered":"2024-05-08T05:46:48.051991+0000","last_clean":"2024-05-08T05:46:48.051991+0000","last_became_active":"2024-05-08T05:45:50.748494+0000","last_became_peered":"2024-05-08T05:45:50.748494+0000","last_unstale":"2024-05-08T05:46:48.051991+0000","last_undegraded":"2024-05-08T05:46:48.051991+0000","last_fullsized":"2024-05-08T05:46:48.051991+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:12:25.227090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.763922+0000","last_change":"2024-05-08T05:45:54.802180+0000","last_active":"2024-05-08T05:46:45.763922+0000","last_peered":"2024-05-08T05:46:45.763922+0000","last_clean":"2024-05-08T05:46:45.763922+0000","last_became_active":"2024-05-08T05:45:54.801822+0000","last_became_peered":"2024-05-08T05:45:54.801822+0000","last_unstale":"2024-05-08T05:46:45.763922+0000","last_undegraded":"2024-05-08T05:46:45.763922+0000","last_fullsized":"2024-05-08T05:46:45.763922+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:52:11.802630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.956189+0000","last_change":"2024-05-08T05:45:54.770981+0000","last_active":"2024-05-08T05:46:45.956189+0000","last_peered":"2024-05-08T05:46:45.956189+0000","last_clean":"2024-05-08T05:46:45.956189+0000","last_became_active":"2024-05-08T05:45:54.770538+0000","last_became_peered":"2024-05-08T05:45:54.770538+0000","last_unstale":"2024-05-08T05:46:45.956189+0000","last_undegraded":"2024-05-08T05:46:45.956189+0000","last_fullsized":"2024-05-08T05:46:45.956189+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:32:34.699752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"80'5","reported_seq":64,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:48.032765+0000","last_change":"2024-05-08T05:45:50.864189+0000","last_active":"2024-05-08T05:46:48.032765+0000","last_peered":"2024-05-08T05:46:48.032765+0000","last_clean":"2024-05-08T05:46:48.032765+0000","last_became_active":"2024-05-08T05:45:50.863170+0000","last_became_peered":"2024-05-08T05:45:50.863170+0000","last_unstale":"2024-05-08T05:46:48.032765+0000","last_undegraded":"2024-05-08T05:46:48.032765+0000","last_fullsized":"2024-05-08T05:46:48.032765+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:44:33.109166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762002+0000","last_change":"2024-05-08T05:45:54.792347+0000","last_active":"2024-05-08T05:46:45.762002+0000","last_peered":"2024-05-08T05:46:45.762002+0000","last_clean":"2024-05-08T05:46:45.762002+0000","last_became_active":"2024-05-08T05:45:54.791767+0000","last_became_peered":"2024-05-08T05:45:54.791767+0000","last_unstale":"2024-05-08T05:46:45.762002+0000","last_undegraded":"2024-05-08T05:46:45.762002+0000","last_fullsized":"2024-05-08T05:46:45.762002+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:03:46.354687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"80'6","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.952657+0000","last_change":"2024-05-08T05:45:50.748659+0000","last_active":"2024-05-08T05:46:45.952657+0000","last_peered":"2024-05-08T05:46:45.952657+0000","last_clean":"2024-05-08T05:46:45.952657+0000","last_became_active":"2024-05-08T05:45:50.748279+0000","last_became_peered":"2024-05-08T05:45:50.748279+0000","last_unstale":"2024-05-08T05:46:45.952657+0000","last_undegraded":"2024-05-08T05:46:45.952657+0000","last_fullsized":"2024-05-08T05:46:45.952657+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:42:25.892715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":100,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762460+0000","last_change":"2024-05-08T05:44:18.365376+0000","last_active":"2024-05-08T05:46:45.762460+0000","last_peered":"2024-05-08T05:46:45.762460+0000","last_clean":"2024-05-08T05:46:45.762460+0000","last_became_active":"2024-05-08T05:44:18.360156+0000","last_became_peered":"2024-05-08T05:44:18.360156+0000","last_unstale":"2024-05-08T05:46:45.762460+0000","last_undegraded":"2024-05-08T05:46:45.762460+0000","last_fullsized":"2024-05-08T05:46:45.762460+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:40:28.502228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:40:28.502228+0000","last_clean_scrub_stamp":"2024-05-08T05:40:28.502228+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:38:20.339163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.770872+0000","last_change":"2024-05-08T05:45:54.775625+0000","last_active":"2024-05-08T05:46:45.770872+0000","last_peered":"2024-05-08T05:46:45.770872+0000","last_clean":"2024-05-08T05:46:45.770872+0000","last_became_active":"2024-05-08T05:45:54.774661+0000","last_became_peered":"2024-05-08T05:45:54.774661+0000","last_unstale":"2024-05-08T05:46:45.770872+0000","last_undegraded":"2024-05-08T05:46:45.770872+0000","last_fullsized":"2024-05-08T05:46:45.770872+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:57:05.676092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"80'4","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762613+0000","last_change":"2024-05-08T05:45:50.747823+0000","last_active":"2024-05-08T05:46:45.762613+0000","last_peered":"2024-05-08T05:46:45.762613+0000","last_clean":"2024-05-08T05:46:45.762613+0000","last_became_active":"2024-05-08T05:45:50.747222+0000","last_became_peered":"2024-05-08T05:45:50.747222+0000","last_unstale":"2024-05-08T05:46:45.762613+0000","last_undegraded":"2024-05-08T05:46:45.762613+0000","last_fullsized":"2024-05-08T05:46:45.762613+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:49:06.238468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"80'4","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.763297+0000","last_change":"2024-05-08T05:45:50.861721+0000","last_active":"2024-05-08T05:46:45.763297+0000","last_peered":"2024-05-08T05:46:45.763297+0000","last_clean":"2024-05-08T05:46:45.763297+0000","last_became_active":"2024-05-08T05:45:50.861369+0000","last_became_peered":"2024-05-08T05:45:50.861369+0000","last_unstale":"2024-05-08T05:46:45.763297+0000","last_undegraded":"2024-05-08T05:46:45.763297+0000","last_fullsized":"2024-05-08T05:46:45.763297+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:35:19.781796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.770208+0000","last_change":"2024-05-08T05:45:54.787260+0000","last_active":"2024-05-08T05:46:45.770208+0000","last_peered":"2024-05-08T05:46:45.770208+0000","last_clean":"2024-05-08T05:46:45.770208+0000","last_became_active":"2024-05-08T05:45:54.786897+0000","last_became_peered":"2024-05-08T05:45:54.786897+0000","last_unstale":"2024-05-08T05:46:45.770208+0000","last_undegraded":"2024-05-08T05:46:45.770208+0000","last_fullsized":"2024-05-08T05:46:45.770208+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:10:06.761165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'16","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.774682+0000","last_change":"2024-05-08T05:45:50.746160+0000","last_active":"2024-05-08T05:46:45.774682+0000","last_peered":"2024-05-08T05:46:45.774682+0000","last_clean":"2024-05-08T05:46:45.774682+0000","last_became_active":"2024-05-08T05:45:50.745630+0000","last_became_peered":"2024-05-08T05:45:50.745630+0000","last_unstale":"2024-05-08T05:46:45.774682+0000","last_undegraded":"2024-05-08T05:46:45.774682+0000","last_fullsized":"2024-05-08T05:46:45.774682+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:45:27.593902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762946+0000","last_change":"2024-05-08T05:45:54.797162+0000","last_active":"2024-05-08T05:46:45.762946+0000","last_peered":"2024-05-08T05:46:45.762946+0000","last_clean":"2024-05-08T05:46:45.762946+0000","last_became_active":"2024-05-08T05:45:54.796859+0000","last_became_peered":"2024-05-08T05:45:54.796859+0000","last_unstale":"2024-05-08T05:46:45.762946+0000","last_undegraded":"2024-05-08T05:46:45.762946+0000","last_fullsized":"2024-05-08T05:46:45.762946+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:51:25.701160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'7","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.952363+0000","last_change":"2024-05-08T05:45:50.744793+0000","last_active":"2024-05-08T05:46:45.952363+0000","last_peered":"2024-05-08T05:46:45.952363+0000","last_clean":"2024-05-08T05:46:45.952363+0000","last_became_active":"2024-05-08T05:45:50.744407+0000","last_became_peered":"2024-05-08T05:45:50.744407+0000","last_unstale":"2024-05-08T05:46:45.952363+0000","last_undegraded":"2024-05-08T05:46:45.952363+0000","last_fullsized":"2024-05-08T05:46:45.952363+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:18:17.029402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.773267+0000","last_change":"2024-05-08T05:45:54.797042+0000","last_active":"2024-05-08T05:46:45.773267+0000","last_peered":"2024-05-08T05:46:45.773267+0000","last_clean":"2024-05-08T05:46:45.773267+0000","last_became_active":"2024-05-08T05:45:54.795796+0000","last_became_peered":"2024-05-08T05:45:54.795796+0000","last_unstale":"2024-05-08T05:46:45.773267+0000","last_undegraded":"2024-05-08T05:46:45.773267+0000","last_fullsized":"2024-05-08T05:46:45.773267+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:20:10.789348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.766020+0000","last_change":"2024-05-08T05:45:50.860466+0000","last_active":"2024-05-08T05:46:45.766020+0000","last_peered":"2024-05-08T05:46:45.766020+0000","last_clean":"2024-05-08T05:46:45.766020+0000","last_became_active":"2024-05-08T05:45:50.860093+0000","last_became_peered":"2024-05-08T05:45:50.860093+0000","last_unstale":"2024-05-08T05:46:45.766020+0000","last_undegraded":"2024-05-08T05:46:45.766020+0000","last_fullsized":"2024-05-08T05:46:45.766020+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:42:37.799098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762784+0000","last_change":"2024-05-08T05:45:54.774635+0000","last_active":"2024-05-08T05:46:45.762784+0000","last_peered":"2024-05-08T05:46:45.762784+0000","last_clean":"2024-05-08T05:46:45.762784+0000","last_became_active":"2024-05-08T05:45:54.774288+0000","last_became_peered":"2024-05-08T05:45:54.774288+0000","last_unstale":"2024-05-08T05:46:45.762784+0000","last_undegraded":"2024-05-08T05:46:45.762784+0000","last_fullsized":"2024-05-08T05:46:45.762784+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:55:59.787540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'7","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.761847+0000","last_change":"2024-05-08T05:45:50.750830+0000","last_active":"2024-05-08T05:46:45.761847+0000","last_peered":"2024-05-08T05:46:45.761847+0000","last_clean":"2024-05-08T05:46:45.761847+0000","last_became_active":"2024-05-08T05:45:50.750473+0000","last_became_peered":"2024-05-08T05:45:50.750473+0000","last_unstale":"2024-05-08T05:46:45.761847+0000","last_undegraded":"2024-05-08T05:46:45.761847+0000","last_fullsized":"2024-05-08T05:46:45.761847+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:04:14.314865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.759810+0000","last_change":"2024-05-08T05:45:54.800008+0000","last_active":"2024-05-08T05:46:45.759810+0000","last_peered":"2024-05-08T05:46:45.759810+0000","last_clean":"2024-05-08T05:46:45.759810+0000","last_became_active":"2024-05-08T05:45:54.799615+0000","last_became_peered":"2024-05-08T05:45:54.799615+0000","last_unstale":"2024-05-08T05:46:45.759810+0000","last_undegraded":"2024-05-08T05:46:45.759810+0000","last_fullsized":"2024-05-08T05:46:45.759810+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:58:12.907617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'3","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762162+0000","last_change":"2024-05-08T05:45:50.745088+0000","last_active":"2024-05-08T05:46:45.762162+0000","last_peered":"2024-05-08T05:46:45.762162+0000","last_clean":"2024-05-08T05:46:45.762162+0000","last_became_active":"2024-05-08T05:45:50.744735+0000","last_became_peered":"2024-05-08T05:45:50.744735+0000","last_unstale":"2024-05-08T05:46:45.762162+0000","last_undegraded":"2024-05-08T05:46:45.762162+0000","last_fullsized":"2024-05-08T05:46:45.762162+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:39:12.404233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762460+0000","last_change":"2024-05-08T05:45:54.803875+0000","last_active":"2024-05-08T05:46:45.762460+0000","last_peered":"2024-05-08T05:46:45.762460+0000","last_clean":"2024-05-08T05:46:45.762460+0000","last_became_active":"2024-05-08T05:45:54.803504+0000","last_became_peered":"2024-05-08T05:45:54.803504+0000","last_unstale":"2024-05-08T05:46:45.762460+0000","last_undegraded":"2024-05-08T05:46:45.762460+0000","last_fullsized":"2024-05-08T05:46:45.762460+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:49:33.419868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.763059+0000","last_change":"2024-05-08T05:45:50.741351+0000","last_active":"2024-05-08T05:46:45.763059+0000","last_peered":"2024-05-08T05:46:45.763059+0000","last_clean":"2024-05-08T05:46:45.763059+0000","last_became_active":"2024-05-08T05:45:50.740970+0000","last_became_peered":"2024-05-08T05:45:50.740970+0000","last_unstale":"2024-05-08T05:46:45.763059+0000","last_undegraded":"2024-05-08T05:46:45.763059+0000","last_fullsized":"2024-05-08T05:46:45.763059+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:31:02.093446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.763129+0000","last_change":"2024-05-08T05:45:54.792665+0000","last_active":"2024-05-08T05:46:45.763129+0000","last_peered":"2024-05-08T05:46:45.763129+0000","last_clean":"2024-05-08T05:46:45.763129+0000","last_became_active":"2024-05-08T05:45:54.792309+0000","last_became_peered":"2024-05-08T05:45:54.792309+0000","last_unstale":"2024-05-08T05:46:45.763129+0000","last_undegraded":"2024-05-08T05:46:45.763129+0000","last_fullsized":"2024-05-08T05:46:45.763129+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:48:29.154009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'6","reported_seq":65,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:46.044428+0000","last_change":"2024-05-08T05:45:50.861234+0000","last_active":"2024-05-08T05:46:46.044428+0000","last_peered":"2024-05-08T05:46:46.044428+0000","last_clean":"2024-05-08T05:46:46.044428+0000","last_became_active":"2024-05-08T05:45:50.860885+0000","last_became_peered":"2024-05-08T05:45:50.860885+0000","last_unstale":"2024-05-08T05:46:46.044428+0000","last_undegraded":"2024-05-08T05:46:46.044428+0000","last_fullsized":"2024-05-08T05:46:46.044428+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:59:50.300316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":33,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.763251+0000","last_change":"2024-05-08T05:45:54.781154+0000","last_active":"2024-05-08T05:46:45.763251+0000","last_peered":"2024-05-08T05:46:45.763251+0000","last_clean":"2024-05-08T05:46:45.763251+0000","last_became_active":"2024-05-08T05:45:54.780340+0000","last_became_peered":"2024-05-08T05:45:54.780340+0000","last_unstale":"2024-05-08T05:46:45.763251+0000","last_undegraded":"2024-05-08T05:46:45.763251+0000","last_fullsized":"2024-05-08T05:46:45.763251+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:22:39.614532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'3","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.956346+0000","last_change":"2024-05-08T05:45:50.748015+0000","last_active":"2024-05-08T05:46:45.956346+0000","last_peered":"2024-05-08T05:46:45.956346+0000","last_clean":"2024-05-08T05:46:45.956346+0000","last_became_active":"2024-05-08T05:45:50.747649+0000","last_became_peered":"2024-05-08T05:45:50.747649+0000","last_unstale":"2024-05-08T05:46:45.956346+0000","last_undegraded":"2024-05-08T05:46:45.956346+0000","last_fullsized":"2024-05-08T05:46:45.956346+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:31:49.177676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.763008+0000","last_change":"2024-05-08T05:45:54.779680+0000","last_active":"2024-05-08T05:46:45.763008+0000","last_peered":"2024-05-08T05:46:45.763008+0000","last_clean":"2024-05-08T05:46:45.763008+0000","last_became_active":"2024-05-08T05:45:54.779273+0000","last_became_peered":"2024-05-08T05:45:54.779273+0000","last_unstale":"2024-05-08T05:46:45.763008+0000","last_undegraded":"2024-05-08T05:46:45.763008+0000","last_fullsized":"2024-05-08T05:46:45.763008+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:40:05.192134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"80'5","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.770241+0000","last_change":"2024-05-08T05:45:50.744569+0000","last_active":"2024-05-08T05:46:45.770241+0000","last_peered":"2024-05-08T05:46:45.770241+0000","last_clean":"2024-05-08T05:46:45.770241+0000","last_became_active":"2024-05-08T05:45:50.744164+0000","last_became_peered":"2024-05-08T05:45:50.744164+0000","last_unstale":"2024-05-08T05:46:45.770241+0000","last_undegraded":"2024-05-08T05:46:45.770241+0000","last_fullsized":"2024-05-08T05:46:45.770241+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:17:56.409110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.763350+0000","last_change":"2024-05-08T05:45:54.776338+0000","last_active":"2024-05-08T05:46:45.763350+0000","last_peered":"2024-05-08T05:46:45.763350+0000","last_clean":"2024-05-08T05:46:45.763350+0000","last_became_active":"2024-05-08T05:45:54.776015+0000","last_became_peered":"2024-05-08T05:45:54.776015+0000","last_unstale":"2024-05-08T05:46:45.763350+0000","last_undegraded":"2024-05-08T05:46:45.763350+0000","last_fullsized":"2024-05-08T05:46:45.763350+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:38:10.608436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.759858+0000","last_change":"2024-05-08T05:45:54.782245+0000","last_active":"2024-05-08T05:46:45.759858+0000","last_peered":"2024-05-08T05:46:45.759858+0000","last_clean":"2024-05-08T05:46:45.759858+0000","last_became_active":"2024-05-08T05:45:54.781860+0000","last_became_peered":"2024-05-08T05:45:54.781860+0000","last_unstale":"2024-05-08T05:46:45.759858+0000","last_undegraded":"2024-05-08T05:46:45.759858+0000","last_fullsized":"2024-05-08T05:46:45.759858+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:50:14.658930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762143+0000","last_change":"2024-05-08T05:45:54.770787+0000","last_active":"2024-05-08T05:46:45.762143+0000","last_peered":"2024-05-08T05:46:45.762143+0000","last_clean":"2024-05-08T05:46:45.762143+0000","last_became_active":"2024-05-08T05:45:54.770409+0000","last_became_peered":"2024-05-08T05:45:54.770409+0000","last_unstale":"2024-05-08T05:46:45.762143+0000","last_undegraded":"2024-05-08T05:46:45.762143+0000","last_fullsized":"2024-05-08T05:46:45.762143+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:09:31.102075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762061+0000","last_change":"2024-05-08T05:45:54.788799+0000","last_active":"2024-05-08T05:46:45.762061+0000","last_peered":"2024-05-08T05:46:45.762061+0000","last_clean":"2024-05-08T05:46:45.762061+0000","last_became_active":"2024-05-08T05:45:54.788295+0000","last_became_peered":"2024-05-08T05:45:54.788295+0000","last_unstale":"2024-05-08T05:46:45.762061+0000","last_undegraded":"2024-05-08T05:46:45.762061+0000","last_fullsized":"2024-05-08T05:46:45.762061+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:55:07.912479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.772155+0000","last_change":"2024-05-08T05:45:54.801316+0000","last_active":"2024-05-08T05:46:45.772155+0000","last_peered":"2024-05-08T05:46:45.772155+0000","last_clean":"2024-05-08T05:46:45.772155+0000","last_became_active":"2024-05-08T05:45:54.798655+0000","last_became_peered":"2024-05-08T05:45:54.798655+0000","last_unstale":"2024-05-08T05:46:45.772155+0000","last_undegraded":"2024-05-08T05:46:45.772155+0000","last_fullsized":"2024-05-08T05:46:45.772155+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:30:25.786822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.769921+0000","last_change":"2024-05-08T05:45:54.793076+0000","last_active":"2024-05-08T05:46:45.769921+0000","last_peered":"2024-05-08T05:46:45.769921+0000","last_clean":"2024-05-08T05:46:45.769921+0000","last_became_active":"2024-05-08T05:45:54.792726+0000","last_became_peered":"2024-05-08T05:45:54.792726+0000","last_unstale":"2024-05-08T05:46:45.769921+0000","last_undegraded":"2024-05-08T05:46:45.769921+0000","last_fullsized":"2024-05-08T05:46:45.769921+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:46:02.659667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.760662+0000","last_change":"2024-05-08T05:45:54.779134+0000","last_active":"2024-05-08T05:46:45.760662+0000","last_peered":"2024-05-08T05:46:45.760662+0000","last_clean":"2024-05-08T05:46:45.760662+0000","last_became_active":"2024-05-08T05:45:54.778764+0000","last_became_peered":"2024-05-08T05:45:54.778764+0000","last_unstale":"2024-05-08T05:46:45.760662+0000","last_undegraded":"2024-05-08T05:46:45.760662+0000","last_fullsized":"2024-05-08T05:46:45.760662+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:10:00.531228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762356+0000","last_change":"2024-05-08T05:45:54.775628+0000","last_active":"2024-05-08T05:46:45.762356+0000","last_peered":"2024-05-08T05:46:45.762356+0000","last_clean":"2024-05-08T05:46:45.762356+0000","last_became_active":"2024-05-08T05:45:54.775293+0000","last_became_peered":"2024-05-08T05:45:54.775293+0000","last_unstale":"2024-05-08T05:46:45.762356+0000","last_undegraded":"2024-05-08T05:46:45.762356+0000","last_fullsized":"2024-05-08T05:46:45.762356+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:02:57.884691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762948+0000","last_change":"2024-05-08T05:45:54.805054+0000","last_active":"2024-05-08T05:46:45.762948+0000","last_peered":"2024-05-08T05:46:45.762948+0000","last_clean":"2024-05-08T05:46:45.762948+0000","last_became_active":"2024-05-08T05:45:54.804642+0000","last_became_peered":"2024-05-08T05:45:54.804642+0000","last_unstale":"2024-05-08T05:46:45.762948+0000","last_undegraded":"2024-05-08T05:46:45.762948+0000","last_fullsized":"2024-05-08T05:46:45.762948+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:17:22.412759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.955997+0000","last_change":"2024-05-08T05:45:54.792217+0000","last_active":"2024-05-08T05:46:45.955997+0000","last_peered":"2024-05-08T05:46:45.955997+0000","last_clean":"2024-05-08T05:46:45.955997+0000","last_became_active":"2024-05-08T05:45:54.791508+0000","last_became_peered":"2024-05-08T05:45:54.791508+0000","last_unstale":"2024-05-08T05:46:45.955997+0000","last_undegraded":"2024-05-08T05:46:45.955997+0000","last_fullsized":"2024-05-08T05:46:45.955997+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:47:19.053306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.761929+0000","last_change":"2024-05-08T05:45:54.794538+0000","last_active":"2024-05-08T05:46:45.761929+0000","last_peered":"2024-05-08T05:46:45.761929+0000","last_clean":"2024-05-08T05:46:45.761929+0000","last_became_active":"2024-05-08T05:45:54.792575+0000","last_became_peered":"2024-05-08T05:45:54.792575+0000","last_unstale":"2024-05-08T05:46:45.761929+0000","last_undegraded":"2024-05-08T05:46:45.761929+0000","last_fullsized":"2024-05-08T05:46:45.761929+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:54:31.086864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.766898+0000","last_change":"2024-05-08T05:45:54.782828+0000","last_active":"2024-05-08T05:46:45.766898+0000","last_peered":"2024-05-08T05:46:45.766898+0000","last_clean":"2024-05-08T05:46:45.766898+0000","last_became_active":"2024-05-08T05:45:54.782442+0000","last_became_peered":"2024-05-08T05:45:54.782442+0000","last_unstale":"2024-05-08T05:46:45.766898+0000","last_undegraded":"2024-05-08T05:46:45.766898+0000","last_fullsized":"2024-05-08T05:46:45.766898+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:42:53.551455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.774062+0000","last_change":"2024-05-08T05:45:54.800422+0000","last_active":"2024-05-08T05:46:45.774062+0000","last_peered":"2024-05-08T05:46:45.774062+0000","last_clean":"2024-05-08T05:46:45.774062+0000","last_became_active":"2024-05-08T05:45:54.799853+0000","last_became_peered":"2024-05-08T05:45:54.799853+0000","last_unstale":"2024-05-08T05:46:45.774062+0000","last_undegraded":"2024-05-08T05:46:45.774062+0000","last_fullsized":"2024-05-08T05:46:45.774062+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:54:22.710347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.775876+0000","last_change":"2024-05-08T05:46:45.775876+0000","last_active":"2024-05-08T05:46:45.775876+0000","last_peered":"2024-05-08T05:46:45.775876+0000","last_clean":"2024-05-08T05:46:45.775876+0000","last_became_active":"2024-05-08T05:46:45.775558+0000","last_became_peered":"2024-05-08T05:46:45.775558+0000","last_unstale":"2024-05-08T05:46:45.775876+0000","last_undegraded":"2024-05-08T05:46:45.775876+0000","last_fullsized":"2024-05-08T05:46:45.775876+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:11:38.649137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":311296,"data_stored":3542208,"data_compressed":212518,"data_compressed_allocated":270336,"data_compressed_original":3522560,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":71595,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":355,"num_read_kb":249,"num_write":246,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":55290,"num_keys_recovered":20,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":210528,"data_compressed":9129,"data_compressed_allocated":12288,"data_compressed_original":53248,"omap_allocated":0,"internal_metadata":0},"log_size":211,"ondisk_log_size":211,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645339,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":435889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841570,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32204,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712948,"statfs":{"total":95995035648,"available":95962058752,"internally_reserved":0,"allocated":1052672,"data_stored":1091241,"data_compressed":35691,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037798,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":917504,"data_stored":435360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234028,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":913408,"data_stored":435738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430257,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":1027865,"data_compressed":35691,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593784,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":435077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27964,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717188,"statfs":{"total":95995035648,"available":95966400512,"internally_reserved":0,"allocated":962560,"data_stored":496515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":921600,"data_stored":436807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411407,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":436533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149768,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":917504,"data_stored":434902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953538,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":929792,"data_stored":495463,"data_compressed":9129,"data_compressed_allocated":12288,"data_compressed_original":53248,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790013,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":978944,"data_stored":1027543,"data_compressed":35691,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34063,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35691,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35691,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35691,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35691,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35691,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":62277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":65482,"data_compressed":9129,"data_compressed_allocated":12288,"data_compressed_original":53248,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":66518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T05:46:53.875 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph pg dump --format=json 2024-05-08T05:46:54.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:53 smithi151 ceph-mon[34815]: pgmap v346: 97 pgs: 97 active+clean; 647 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.7 KiB/s wr, 11 op/s; 6.7 KiB/s, 2 keys/s, 2 objects/s recovering 2024-05-08T05:46:54.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:53 smithi151 ceph-mon[34815]: from='client.14535 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T05:46:54.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:53 smithi082 ceph-mon[30098]: pgmap v346: 97 pgs: 97 active+clean; 647 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.7 KiB/s wr, 11 op/s; 6.7 KiB/s, 2 keys/s, 2 objects/s recovering 2024-05-08T05:46:54.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:53 smithi082 ceph-mon[30098]: from='client.14535 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T05:46:54.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:53 smithi134 ceph-mon[34132]: pgmap v346: 97 pgs: 97 active+clean; 647 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.7 KiB/s wr, 11 op/s; 6.7 KiB/s, 2 keys/s, 2 objects/s recovering 2024-05-08T05:46:54.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:53 smithi134 ceph-mon[34132]: from='client.14535 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T05:46:54.362 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:46:56.063 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:55 smithi134 ceph-mon[34132]: pgmap v347: 97 pgs: 97 active+clean; 647 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.4 KiB/s wr, 9 op/s; 5.8 KiB/s, 2 keys/s, 2 objects/s recovering 2024-05-08T05:46:56.106 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:55 smithi082 ceph-mon[30098]: pgmap v347: 97 pgs: 97 active+clean; 647 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.4 KiB/s wr, 9 op/s; 5.8 KiB/s, 2 keys/s, 2 objects/s recovering 2024-05-08T05:46:56.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:55 smithi151 ceph-mon[34815]: pgmap v347: 97 pgs: 97 active+clean; 647 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 1.4 KiB/s wr, 9 op/s; 5.8 KiB/s, 2 keys/s, 2 objects/s recovering 2024-05-08T05:46:56.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:56.607+0000 7fa138400700 1 -- 172.21.15.82:0/3786048481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa13006bb70 msgr2=0x7fa13006bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:56.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:56.607+0000 7fa138400700 1 --2- 172.21.15.82:0/3786048481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa13006bb70 0x7fa13006bff0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa11c009990 tx=0x7fa11c009ca0 comp rx=0 tx=0).stop 2024-05-08T05:46:56.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:56.608+0000 7fa138400700 1 -- 172.21.15.82:0/3786048481 shutdown_connections 2024-05-08T05:46:56.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:56.608+0000 7fa138400700 1 --2- 172.21.15.82:0/3786048481 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa13006c530 0x7fa130110350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:56.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:56.608+0000 7fa138400700 1 --2- 172.21.15.82:0/3786048481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa130109530 0x7fa130109910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:56.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:56.608+0000 7fa138400700 1 --2- 172.21.15.82:0/3786048481 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa13006bb70 0x7fa13006bff0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:56.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:56.608+0000 7fa138400700 1 -- 172.21.15.82:0/3786048481 >> 172.21.15.82:0/3786048481 conn(0x7fa130079350 msgr2=0x7fa130079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:46:56.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:56.608+0000 7fa138400700 1 -- 172.21.15.82:0/3786048481 shutdown_connections 2024-05-08T05:46:56.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:56.608+0000 7fa138400700 1 -- 172.21.15.82:0/3786048481 wait complete. 2024-05-08T05:46:56.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:56.610+0000 7fa138400700 1 Processor -- start 2024-05-08T05:46:56.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:56.610+0000 7fa138400700 1 -- start start 2024-05-08T05:46:56.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:56.610+0000 7fa138400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa13006bb70 0x7fa13019f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:56.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:56.611+0000 7fa138400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa13006c530 0x7fa13019fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:56.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:56.611+0000 7fa138400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa130109530 0x7fa130199a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:56.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:56.611+0000 7fa138400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa1301136b0 con 0x7fa130109530 2024-05-08T05:46:56.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:56.611+0000 7fa138400700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa130113530 con 0x7fa13006c530 2024-05-08T05:46:56.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:56.611+0000 7fa138400700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa130113830 con 0x7fa13006bb70 2024-05-08T05:46:56.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:56.611+0000 7fa136400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa130109530 0x7fa130199a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:56.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:56.611+0000 7fa136400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa130109530 0x7fa130199a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48254/0 (socket says 172.21.15.82:48254) 2024-05-08T05:46:56.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:56.611+0000 7fa136400700 1 -- 172.21.15.82:0/2563124326 learned_addr learned my addr 172.21.15.82:0/2563124326 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:46:56.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:56.611+0000 7fa135000700 1 --2- 172.21.15.82:0/2563124326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa13006c530 0x7fa13019fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:56.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:56.611+0000 7fa135a00700 1 --2- 172.21.15.82:0/2563124326 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa13006bb70 0x7fa13019f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:56.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:56.611+0000 7fa135000700 1 -- 172.21.15.82:0/2563124326 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa13006bb70 msgr2=0x7fa13019f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:56.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:56.611+0000 7fa135000700 1 --2- 172.21.15.82:0/2563124326 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa13006bb70 0x7fa13019f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:56.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:56.611+0000 7fa135000700 1 -- 172.21.15.82:0/2563124326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa130109530 msgr2=0x7fa130199a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:56.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:56.611+0000 7fa135000700 1 --2- 172.21.15.82:0/2563124326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa130109530 0x7fa130199a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:56.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:56.611+0000 7fa135000700 1 -- 172.21.15.82:0/2563124326 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa13019a190 con 0x7fa13006c530 2024-05-08T05:46:56.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:56.612+0000 7fa135000700 1 --2- 172.21.15.82:0/2563124326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa13006c530 0x7fa13019fdb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa11c0098e0 tx=0x7fa11c0057c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:46:56.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:56.612+0000 7fa12e000700 1 -- 172.21.15.82:0/2563124326 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa11c027070 con 0x7fa13006c530 2024-05-08T05:46:56.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:56.612+0000 7fa138400700 1 -- 172.21.15.82:0/2563124326 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa13019a420 con 0x7fa13006c530 2024-05-08T05:46:56.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:56.612+0000 7fa12e000700 1 -- 172.21.15.82:0/2563124326 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa11c022470 con 0x7fa13006c530 2024-05-08T05:46:56.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:56.612+0000 7fa12e000700 1 -- 172.21.15.82:0/2563124326 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa11c017650 con 0x7fa13006c530 2024-05-08T05:46:56.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:56.612+0000 7fa138400700 1 -- 172.21.15.82:0/2563124326 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1301a6740 con 0x7fa13006c530 2024-05-08T05:46:56.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:56.614+0000 7fa138400700 1 -- 172.21.15.82:0/2563124326 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa13010ba10 con 0x7fa13006c530 2024-05-08T05:46:56.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:56.616+0000 7fa12e000700 1 -- 172.21.15.82:0/2563124326 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fa11c02a070 con 0x7fa13006c530 2024-05-08T05:46:56.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:56.617+0000 7fa12e000700 1 --2- 172.21.15.82:0/2563124326 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fa1180b2910 0x7fa1180b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:46:56.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:56.618+0000 7fa12e000700 1 -- 172.21.15.82:0/2563124326 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fa11c0e32b0 con 0x7fa13006c530 2024-05-08T05:46:56.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:56.618+0000 7fa135a00700 1 --2- 172.21.15.82:0/2563124326 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fa1180b2910 0x7fa1180b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:46:56.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:56.618+0000 7fa135a00700 1 --2- 172.21.15.82:0/2563124326 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fa1180b2910 0x7fa1180b4dd0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa13019ab70 tx=0x7fa124009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:46:56.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:56.620+0000 7fa12e000700 1 -- 172.21.15.82:0/2563124326 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa11c031080 con 0x7fa13006c530 2024-05-08T05:46:56.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:56.846+0000 7fa138400700 1 -- 172.21.15.82:0/2563124326 --> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa13019af60 con 0x7fa1180b2910 2024-05-08T05:46:56.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:56.864+0000 7fa12e000700 1 -- 172.21.15.82:0/2563124326 <== mgr.14152 v2:172.21.15.82:6800/4089180091 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258920 (secure 0 0 0) 0x7fa13019af60 con 0x7fa1180b2910 2024-05-08T05:46:56.866 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:46:56.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:56.872+0000 7fa138400700 1 -- 172.21.15.82:0/2563124326 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fa1180b2910 msgr2=0x7fa1180b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:56.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:56.872+0000 7fa138400700 1 --2- 172.21.15.82:0/2563124326 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fa1180b2910 0x7fa1180b4dd0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa13019ab70 tx=0x7fa124009260 comp rx=0 tx=0).stop 2024-05-08T05:46:56.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:56.872+0000 7fa138400700 1 -- 172.21.15.82:0/2563124326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa13006c530 msgr2=0x7fa13019fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:46:56.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:56.872+0000 7fa138400700 1 --2- 172.21.15.82:0/2563124326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa13006c530 0x7fa13019fdb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa11c0098e0 tx=0x7fa11c0057c0 comp rx=0 tx=0).stop 2024-05-08T05:46:56.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:56.872+0000 7fa138400700 1 -- 172.21.15.82:0/2563124326 shutdown_connections 2024-05-08T05:46:56.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:56.872+0000 7fa138400700 1 --2- 172.21.15.82:0/2563124326 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fa1180b2910 0x7fa1180b4dd0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:56.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:56.872+0000 7fa138400700 1 --2- 172.21.15.82:0/2563124326 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa130109530 0x7fa130199a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:56.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:56.872+0000 7fa138400700 1 --2- 172.21.15.82:0/2563124326 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa13006bb70 0x7fa13019f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:56.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:56.872+0000 7fa138400700 1 --2- 172.21.15.82:0/2563124326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa13006c530 0x7fa13019fdb0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:46:56.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:56.872+0000 7fa138400700 1 -- 172.21.15.82:0/2563124326 >> 172.21.15.82:0/2563124326 conn(0x7fa130079350 msgr2=0x7fa130101520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:46:56.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:56.873+0000 7fa138400700 1 -- 172.21.15.82:0/2563124326 shutdown_connections 2024-05-08T05:46:56.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:46:56.873+0000 7fa138400700 1 -- 172.21.15.82:0/2563124326 wait complete. 2024-05-08T05:46:56.874 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-05-08T05:46:57.667 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":348,"stamp":"2024-05-08T05:46:56.122431+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":662197,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":461,"num_read_kb":323,"num_write":371,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":3007130,"num_keys_recovered":20,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":305,"ondisk_log_size":305,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":351892,"kb_used_data":11012,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124589932,"statfs":{"total":1151940427776,"available":1151580090368,"internally_reserved":0,"allocated":11276288,"data_stored":7197447,"data_compressed":116202,"data_compressed_allocated":147456,"data_compressed_original":1822720,"omap_allocated":19138,"internal_metadata":348894526},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9560,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":-13,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":47,"num_write":7,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":55290,"num_keys_recovered":20,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.363920"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.760116+0000","last_change":"2024-05-08T05:45:54.796792+0000","last_active":"2024-05-08T05:46:45.760116+0000","last_peered":"2024-05-08T05:46:45.760116+0000","last_clean":"2024-05-08T05:46:45.760116+0000","last_became_active":"2024-05-08T05:45:54.796445+0000","last_became_peered":"2024-05-08T05:45:54.796445+0000","last_unstale":"2024-05-08T05:46:45.760116+0000","last_undegraded":"2024-05-08T05:46:45.760116+0000","last_fullsized":"2024-05-08T05:46:45.760116+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:41:12.762659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.772958+0000","last_change":"2024-05-08T05:45:54.800291+0000","last_active":"2024-05-08T05:46:45.772958+0000","last_peered":"2024-05-08T05:46:45.772958+0000","last_clean":"2024-05-08T05:46:45.772958+0000","last_became_active":"2024-05-08T05:45:54.798182+0000","last_became_peered":"2024-05-08T05:45:54.798182+0000","last_unstale":"2024-05-08T05:46:45.772958+0000","last_undegraded":"2024-05-08T05:46:45.772958+0000","last_fullsized":"2024-05-08T05:46:45.772958+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:55:52.672307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.772834+0000","last_change":"2024-05-08T05:45:54.792574+0000","last_active":"2024-05-08T05:46:45.772834+0000","last_peered":"2024-05-08T05:46:45.772834+0000","last_clean":"2024-05-08T05:46:45.772834+0000","last_became_active":"2024-05-08T05:45:54.790856+0000","last_became_peered":"2024-05-08T05:45:54.790856+0000","last_unstale":"2024-05-08T05:46:45.772834+0000","last_undegraded":"2024-05-08T05:46:45.772834+0000","last_fullsized":"2024-05-08T05:46:45.772834+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:32:33.727532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.952768+0000","last_change":"2024-05-08T05:45:54.772883+0000","last_active":"2024-05-08T05:46:45.952768+0000","last_peered":"2024-05-08T05:46:45.952768+0000","last_clean":"2024-05-08T05:46:45.952768+0000","last_became_active":"2024-05-08T05:45:54.772457+0000","last_became_peered":"2024-05-08T05:45:54.772457+0000","last_unstale":"2024-05-08T05:46:45.952768+0000","last_undegraded":"2024-05-08T05:46:45.952768+0000","last_fullsized":"2024-05-08T05:46:45.952768+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:50:20.116563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.763157+0000","last_change":"2024-05-08T05:45:54.798868+0000","last_active":"2024-05-08T05:46:45.763157+0000","last_peered":"2024-05-08T05:46:45.763157+0000","last_clean":"2024-05-08T05:46:45.763157+0000","last_became_active":"2024-05-08T05:45:54.798459+0000","last_became_peered":"2024-05-08T05:45:54.798459+0000","last_unstale":"2024-05-08T05:46:45.763157+0000","last_undegraded":"2024-05-08T05:46:45.763157+0000","last_fullsized":"2024-05-08T05:46:45.763157+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:59:32.280051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.763364+0000","last_change":"2024-05-08T05:45:54.788172+0000","last_active":"2024-05-08T05:46:45.763364+0000","last_peered":"2024-05-08T05:46:45.763364+0000","last_clean":"2024-05-08T05:46:45.763364+0000","last_became_active":"2024-05-08T05:45:54.787609+0000","last_became_peered":"2024-05-08T05:45:54.787609+0000","last_unstale":"2024-05-08T05:46:45.763364+0000","last_undegraded":"2024-05-08T05:46:45.763364+0000","last_fullsized":"2024-05-08T05:46:45.763364+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:30:17.295770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762193+0000","last_change":"2024-05-08T05:45:54.786904+0000","last_active":"2024-05-08T05:46:45.762193+0000","last_peered":"2024-05-08T05:46:45.762193+0000","last_clean":"2024-05-08T05:46:45.762193+0000","last_became_active":"2024-05-08T05:45:54.786484+0000","last_became_peered":"2024-05-08T05:45:54.786484+0000","last_unstale":"2024-05-08T05:46:45.762193+0000","last_undegraded":"2024-05-08T05:46:45.762193+0000","last_fullsized":"2024-05-08T05:46:45.762193+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:14:15.398144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.761367+0000","last_change":"2024-05-08T05:45:54.801559+0000","last_active":"2024-05-08T05:46:45.761367+0000","last_peered":"2024-05-08T05:46:45.761367+0000","last_clean":"2024-05-08T05:46:45.761367+0000","last_became_active":"2024-05-08T05:45:54.796293+0000","last_became_peered":"2024-05-08T05:45:54.796293+0000","last_unstale":"2024-05-08T05:46:45.761367+0000","last_undegraded":"2024-05-08T05:46:45.761367+0000","last_fullsized":"2024-05-08T05:46:45.761367+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:07:05.483562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.766595+0000","last_change":"2024-05-08T05:45:54.780450+0000","last_active":"2024-05-08T05:46:45.766595+0000","last_peered":"2024-05-08T05:46:45.766595+0000","last_clean":"2024-05-08T05:46:45.766595+0000","last_became_active":"2024-05-08T05:45:54.780079+0000","last_became_peered":"2024-05-08T05:45:54.780079+0000","last_unstale":"2024-05-08T05:46:45.766595+0000","last_undegraded":"2024-05-08T05:46:45.766595+0000","last_fullsized":"2024-05-08T05:46:45.766595+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:41:26.688748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.764209+0000","last_change":"2024-05-08T05:45:54.776294+0000","last_active":"2024-05-08T05:46:45.764209+0000","last_peered":"2024-05-08T05:46:45.764209+0000","last_clean":"2024-05-08T05:46:45.764209+0000","last_became_active":"2024-05-08T05:45:54.775928+0000","last_became_peered":"2024-05-08T05:45:54.775928+0000","last_unstale":"2024-05-08T05:46:45.764209+0000","last_undegraded":"2024-05-08T05:46:45.764209+0000","last_fullsized":"2024-05-08T05:46:45.764209+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:17:53.453446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.763188+0000","last_change":"2024-05-08T05:45:54.781478+0000","last_active":"2024-05-08T05:46:45.763188+0000","last_peered":"2024-05-08T05:46:45.763188+0000","last_clean":"2024-05-08T05:46:45.763188+0000","last_became_active":"2024-05-08T05:45:54.780839+0000","last_became_peered":"2024-05-08T05:45:54.780839+0000","last_unstale":"2024-05-08T05:46:45.763188+0000","last_undegraded":"2024-05-08T05:46:45.763188+0000","last_fullsized":"2024-05-08T05:46:45.763188+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:39:14.518391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.952652+0000","last_change":"2024-05-08T05:45:54.774650+0000","last_active":"2024-05-08T05:46:45.952652+0000","last_peered":"2024-05-08T05:46:45.952652+0000","last_clean":"2024-05-08T05:46:45.952652+0000","last_became_active":"2024-05-08T05:45:54.774276+0000","last_became_peered":"2024-05-08T05:45:54.774276+0000","last_unstale":"2024-05-08T05:46:45.952652+0000","last_undegraded":"2024-05-08T05:46:45.952652+0000","last_fullsized":"2024-05-08T05:46:45.952652+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:43:53.390553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.773880+0000","last_change":"2024-05-08T05:45:54.783430+0000","last_active":"2024-05-08T05:46:45.773880+0000","last_peered":"2024-05-08T05:46:45.773880+0000","last_clean":"2024-05-08T05:46:45.773880+0000","last_became_active":"2024-05-08T05:45:54.782394+0000","last_became_peered":"2024-05-08T05:45:54.782394+0000","last_unstale":"2024-05-08T05:46:45.773880+0000","last_undegraded":"2024-05-08T05:46:45.773880+0000","last_fullsized":"2024-05-08T05:46:45.773880+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:47:01.864111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.772480+0000","last_change":"2024-05-08T05:45:54.792880+0000","last_active":"2024-05-08T05:46:45.772480+0000","last_peered":"2024-05-08T05:46:45.772480+0000","last_clean":"2024-05-08T05:46:45.772480+0000","last_became_active":"2024-05-08T05:45:54.789653+0000","last_became_peered":"2024-05-08T05:45:54.789653+0000","last_unstale":"2024-05-08T05:46:45.772480+0000","last_undegraded":"2024-05-08T05:46:45.772480+0000","last_fullsized":"2024-05-08T05:46:45.772480+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:57:10.552014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.771077+0000","last_change":"2024-05-08T05:45:54.793612+0000","last_active":"2024-05-08T05:46:45.771077+0000","last_peered":"2024-05-08T05:46:45.771077+0000","last_clean":"2024-05-08T05:46:45.771077+0000","last_became_active":"2024-05-08T05:45:54.793191+0000","last_became_peered":"2024-05-08T05:45:54.793191+0000","last_unstale":"2024-05-08T05:46:45.771077+0000","last_undegraded":"2024-05-08T05:46:45.771077+0000","last_fullsized":"2024-05-08T05:46:45.771077+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:49:35.066070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.766009+0000","last_change":"2024-05-08T05:45:54.799679+0000","last_active":"2024-05-08T05:46:45.766009+0000","last_peered":"2024-05-08T05:46:45.766009+0000","last_clean":"2024-05-08T05:46:45.766009+0000","last_became_active":"2024-05-08T05:45:54.799196+0000","last_became_peered":"2024-05-08T05:45:54.799196+0000","last_unstale":"2024-05-08T05:46:45.766009+0000","last_undegraded":"2024-05-08T05:46:45.766009+0000","last_fullsized":"2024-05-08T05:46:45.766009+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:14:00.597282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.760351+0000","last_change":"2024-05-08T05:45:54.796799+0000","last_active":"2024-05-08T05:46:45.760351+0000","last_peered":"2024-05-08T05:46:45.760351+0000","last_clean":"2024-05-08T05:46:45.760351+0000","last_became_active":"2024-05-08T05:45:54.796501+0000","last_became_peered":"2024-05-08T05:45:54.796501+0000","last_unstale":"2024-05-08T05:46:45.760351+0000","last_undegraded":"2024-05-08T05:46:45.760351+0000","last_fullsized":"2024-05-08T05:46:45.760351+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:14:59.446718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.775046+0000","last_change":"2024-05-08T05:45:54.789544+0000","last_active":"2024-05-08T05:46:45.775046+0000","last_peered":"2024-05-08T05:46:45.775046+0000","last_clean":"2024-05-08T05:46:45.775046+0000","last_became_active":"2024-05-08T05:45:54.787901+0000","last_became_peered":"2024-05-08T05:45:54.787901+0000","last_unstale":"2024-05-08T05:46:45.775046+0000","last_undegraded":"2024-05-08T05:46:45.775046+0000","last_fullsized":"2024-05-08T05:46:45.775046+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:12:23.200311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762372+0000","last_change":"2024-05-08T05:45:54.782537+0000","last_active":"2024-05-08T05:46:45.762372+0000","last_peered":"2024-05-08T05:46:45.762372+0000","last_clean":"2024-05-08T05:46:45.762372+0000","last_became_active":"2024-05-08T05:45:54.781389+0000","last_became_peered":"2024-05-08T05:45:54.781389+0000","last_unstale":"2024-05-08T05:46:45.762372+0000","last_undegraded":"2024-05-08T05:46:45.762372+0000","last_fullsized":"2024-05-08T05:46:45.762372+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:56:22.041900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"80'13","reported_seq":77,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:53.061878+0000","last_change":"2024-05-08T05:45:50.744496+0000","last_active":"2024-05-08T05:46:53.061878+0000","last_peered":"2024-05-08T05:46:53.061878+0000","last_clean":"2024-05-08T05:46:53.061878+0000","last_became_active":"2024-05-08T05:45:50.743882+0000","last_became_peered":"2024-05-08T05:45:50.743882+0000","last_unstale":"2024-05-08T05:46:53.061878+0000","last_undegraded":"2024-05-08T05:46:53.061878+0000","last_fullsized":"2024-05-08T05:46:53.061878+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:45:11.198096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.959222+0000","last_change":"2024-05-08T05:46:45.957649+0000","last_active":"2024-05-08T05:46:45.959222+0000","last_peered":"2024-05-08T05:46:45.959222+0000","last_clean":"2024-05-08T05:46:45.959222+0000","last_became_active":"2024-05-08T05:46:45.957154+0000","last_became_peered":"2024-05-08T05:46:45.957154+0000","last_unstale":"2024-05-08T05:46:45.959222+0000","last_undegraded":"2024-05-08T05:46:45.959222+0000","last_fullsized":"2024-05-08T05:46:45.959222+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:29:25.475541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.763641+0000","last_change":"2024-05-08T05:45:50.863409+0000","last_active":"2024-05-08T05:46:45.763641+0000","last_peered":"2024-05-08T05:46:45.763641+0000","last_clean":"2024-05-08T05:46:45.763641+0000","last_became_active":"2024-05-08T05:45:50.861818+0000","last_became_peered":"2024-05-08T05:45:50.861818+0000","last_unstale":"2024-05-08T05:46:45.763641+0000","last_undegraded":"2024-05-08T05:46:45.763641+0000","last_fullsized":"2024-05-08T05:46:45.763641+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:39:32.821431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.773498+0000","last_change":"2024-05-08T05:45:54.797429+0000","last_active":"2024-05-08T05:46:45.773498+0000","last_peered":"2024-05-08T05:46:45.773498+0000","last_clean":"2024-05-08T05:46:45.773498+0000","last_became_active":"2024-05-08T05:45:54.795030+0000","last_became_peered":"2024-05-08T05:45:54.795030+0000","last_unstale":"2024-05-08T05:46:45.773498+0000","last_undegraded":"2024-05-08T05:46:45.773498+0000","last_fullsized":"2024-05-08T05:46:45.773498+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:43:34.852889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"80'12","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.772846+0000","last_change":"2024-05-08T05:46:45.772846+0000","last_active":"2024-05-08T05:46:45.772846+0000","last_peered":"2024-05-08T05:46:45.772846+0000","last_clean":"2024-05-08T05:46:45.772846+0000","last_became_active":"2024-05-08T05:46:45.763937+0000","last_became_peered":"2024-05-08T05:46:45.763937+0000","last_unstale":"2024-05-08T05:46:45.772846+0000","last_undegraded":"2024-05-08T05:46:45.772846+0000","last_fullsized":"2024-05-08T05:46:45.772846+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:48:13.233059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.766197+0000","last_change":"2024-05-08T05:45:54.788852+0000","last_active":"2024-05-08T05:46:45.766197+0000","last_peered":"2024-05-08T05:46:45.766197+0000","last_clean":"2024-05-08T05:46:45.766197+0000","last_became_active":"2024-05-08T05:45:54.788496+0000","last_became_peered":"2024-05-08T05:45:54.788496+0000","last_unstale":"2024-05-08T05:46:45.766197+0000","last_undegraded":"2024-05-08T05:46:45.766197+0000","last_fullsized":"2024-05-08T05:46:45.766197+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:44:45.379728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"80'5","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762860+0000","last_change":"2024-05-08T05:45:50.741528+0000","last_active":"2024-05-08T05:46:45.762860+0000","last_peered":"2024-05-08T05:46:45.762860+0000","last_clean":"2024-05-08T05:46:45.762860+0000","last_became_active":"2024-05-08T05:45:50.741232+0000","last_became_peered":"2024-05-08T05:45:50.741232+0000","last_unstale":"2024-05-08T05:46:45.762860+0000","last_undegraded":"2024-05-08T05:46:45.762860+0000","last_fullsized":"2024-05-08T05:46:45.762860+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:36:48.540858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.956068+0000","last_change":"2024-05-08T05:46:45.954990+0000","last_active":"2024-05-08T05:46:45.956068+0000","last_peered":"2024-05-08T05:46:45.956068+0000","last_clean":"2024-05-08T05:46:45.956068+0000","last_became_active":"2024-05-08T05:46:45.953589+0000","last_became_peered":"2024-05-08T05:46:45.953589+0000","last_unstale":"2024-05-08T05:46:45.956068+0000","last_undegraded":"2024-05-08T05:46:45.956068+0000","last_fullsized":"2024-05-08T05:46:45.956068+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:29:17.410356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1b","version":"80'5","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:53.031197+0000","last_change":"2024-05-08T05:45:50.746462+0000","last_active":"2024-05-08T05:46:53.031197+0000","last_peered":"2024-05-08T05:46:53.031197+0000","last_clean":"2024-05-08T05:46:53.031197+0000","last_became_active":"2024-05-08T05:45:50.746064+0000","last_became_peered":"2024-05-08T05:45:50.746064+0000","last_unstale":"2024-05-08T05:46:53.031197+0000","last_undegraded":"2024-05-08T05:46:53.031197+0000","last_fullsized":"2024-05-08T05:46:53.031197+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:51:49.076829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":39,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762979+0000","last_change":"2024-05-08T05:45:54.788524+0000","last_active":"2024-05-08T05:46:45.762979+0000","last_peered":"2024-05-08T05:46:45.762979+0000","last_clean":"2024-05-08T05:46:45.762979+0000","last_became_active":"2024-05-08T05:45:54.788179+0000","last_became_peered":"2024-05-08T05:45:54.788179+0000","last_unstale":"2024-05-08T05:46:45.762979+0000","last_undegraded":"2024-05-08T05:46:45.762979+0000","last_fullsized":"2024-05-08T05:46:45.762979+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:44:34.257799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":47,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.780705+0000","last_change":"2024-05-08T05:46:45.780705+0000","last_active":"2024-05-08T05:46:45.780705+0000","last_peered":"2024-05-08T05:46:45.780705+0000","last_clean":"2024-05-08T05:46:45.780705+0000","last_became_active":"2024-05-08T05:46:45.773246+0000","last_became_peered":"2024-05-08T05:46:45.773246+0000","last_unstale":"2024-05-08T05:46:45.780705+0000","last_undegraded":"2024-05-08T05:46:45.780705+0000","last_fullsized":"2024-05-08T05:46:45.780705+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:10:33.491186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.956252+0000","last_change":"2024-05-08T05:45:54.792001+0000","last_active":"2024-05-08T05:46:45.956252+0000","last_peered":"2024-05-08T05:46:45.956252+0000","last_clean":"2024-05-08T05:46:45.956252+0000","last_became_active":"2024-05-08T05:45:54.791581+0000","last_became_peered":"2024-05-08T05:45:54.791581+0000","last_unstale":"2024-05-08T05:46:45.956252+0000","last_undegraded":"2024-05-08T05:46:45.956252+0000","last_fullsized":"2024-05-08T05:46:45.956252+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:43:37.437251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"80'3","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.771530+0000","last_change":"2024-05-08T05:45:50.740645+0000","last_active":"2024-05-08T05:46:45.771530+0000","last_peered":"2024-05-08T05:46:45.771530+0000","last_clean":"2024-05-08T05:46:45.771530+0000","last_became_active":"2024-05-08T05:45:50.739997+0000","last_became_peered":"2024-05-08T05:45:50.739997+0000","last_unstale":"2024-05-08T05:46:45.771530+0000","last_undegraded":"2024-05-08T05:46:45.771530+0000","last_fullsized":"2024-05-08T05:46:45.771530+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:24:48.895557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.761593+0000","last_change":"2024-05-08T05:45:54.802757+0000","last_active":"2024-05-08T05:46:45.761593+0000","last_peered":"2024-05-08T05:46:45.761593+0000","last_clean":"2024-05-08T05:46:45.761593+0000","last_became_active":"2024-05-08T05:45:54.798549+0000","last_became_peered":"2024-05-08T05:45:54.798549+0000","last_unstale":"2024-05-08T05:46:45.761593+0000","last_undegraded":"2024-05-08T05:46:45.761593+0000","last_fullsized":"2024-05-08T05:46:45.761593+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:39:37.582997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'3","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.955933+0000","last_change":"2024-05-08T05:45:50.743989+0000","last_active":"2024-05-08T05:46:45.955933+0000","last_peered":"2024-05-08T05:46:45.955933+0000","last_clean":"2024-05-08T05:46:45.955933+0000","last_became_active":"2024-05-08T05:45:50.743582+0000","last_became_peered":"2024-05-08T05:45:50.743582+0000","last_unstale":"2024-05-08T05:46:45.955933+0000","last_undegraded":"2024-05-08T05:46:45.955933+0000","last_fullsized":"2024-05-08T05:46:45.955933+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:14:46.820582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.768766+0000","last_change":"2024-05-08T05:45:54.807249+0000","last_active":"2024-05-08T05:46:45.768766+0000","last_peered":"2024-05-08T05:46:45.768766+0000","last_clean":"2024-05-08T05:46:45.768766+0000","last_became_active":"2024-05-08T05:45:54.806823+0000","last_became_peered":"2024-05-08T05:45:54.806823+0000","last_unstale":"2024-05-08T05:46:45.768766+0000","last_undegraded":"2024-05-08T05:46:45.768766+0000","last_fullsized":"2024-05-08T05:46:45.768766+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:37:25.526927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"80'4","reported_seq":98,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:51.027879+0000","last_change":"2024-05-08T05:45:50.747477+0000","last_active":"2024-05-08T05:46:51.027879+0000","last_peered":"2024-05-08T05:46:51.027879+0000","last_clean":"2024-05-08T05:46:51.027879+0000","last_became_active":"2024-05-08T05:45:50.747103+0000","last_became_peered":"2024-05-08T05:45:50.747103+0000","last_unstale":"2024-05-08T05:46:51.027879+0000","last_undegraded":"2024-05-08T05:46:51.027879+0000","last_fullsized":"2024-05-08T05:46:51.027879+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:08:17.108826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":68,"num_read_kb":68,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.766364+0000","last_change":"2024-05-08T05:45:54.787885+0000","last_active":"2024-05-08T05:46:45.766364+0000","last_peered":"2024-05-08T05:46:45.766364+0000","last_clean":"2024-05-08T05:46:45.766364+0000","last_became_active":"2024-05-08T05:45:54.787480+0000","last_became_peered":"2024-05-08T05:45:54.787480+0000","last_unstale":"2024-05-08T05:46:45.766364+0000","last_undegraded":"2024-05-08T05:46:45.766364+0000","last_fullsized":"2024-05-08T05:46:45.766364+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:13:42.889918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'4","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.763007+0000","last_change":"2024-05-08T05:45:50.741271+0000","last_active":"2024-05-08T05:46:45.763007+0000","last_peered":"2024-05-08T05:46:45.763007+0000","last_clean":"2024-05-08T05:46:45.763007+0000","last_became_active":"2024-05-08T05:45:50.740869+0000","last_became_peered":"2024-05-08T05:45:50.740869+0000","last_unstale":"2024-05-08T05:46:45.763007+0000","last_undegraded":"2024-05-08T05:46:45.763007+0000","last_fullsized":"2024-05-08T05:46:45.763007+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:57:40.855732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.958524+0000","last_change":"2024-05-08T05:46:45.958524+0000","last_active":"2024-05-08T05:46:45.958524+0000","last_peered":"2024-05-08T05:46:45.958524+0000","last_clean":"2024-05-08T05:46:45.958524+0000","last_became_active":"2024-05-08T05:46:45.957576+0000","last_became_peered":"2024-05-08T05:46:45.957576+0000","last_unstale":"2024-05-08T05:46:45.958524+0000","last_undegraded":"2024-05-08T05:46:45.958524+0000","last_fullsized":"2024-05-08T05:46:45.958524+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:59:34.927448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.956533+0000","last_change":"2024-05-08T05:45:50.865467+0000","last_active":"2024-05-08T05:46:45.956533+0000","last_peered":"2024-05-08T05:46:45.956533+0000","last_clean":"2024-05-08T05:46:45.956533+0000","last_became_active":"2024-05-08T05:45:50.865245+0000","last_became_peered":"2024-05-08T05:45:50.865245+0000","last_unstale":"2024-05-08T05:46:45.956533+0000","last_undegraded":"2024-05-08T05:46:45.956533+0000","last_fullsized":"2024-05-08T05:46:45.956533+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:03:40.990651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.766286+0000","last_change":"2024-05-08T05:45:54.780782+0000","last_active":"2024-05-08T05:46:45.766286+0000","last_peered":"2024-05-08T05:46:45.766286+0000","last_clean":"2024-05-08T05:46:45.766286+0000","last_became_active":"2024-05-08T05:45:54.780074+0000","last_became_peered":"2024-05-08T05:45:54.780074+0000","last_unstale":"2024-05-08T05:46:45.766286+0000","last_undegraded":"2024-05-08T05:46:45.766286+0000","last_fullsized":"2024-05-08T05:46:45.766286+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:23:09.026115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'32","reported_seq":154,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:50.968643+0000","last_change":"2024-05-08T05:46:45.965985+0000","last_active":"2024-05-08T05:46:50.968643+0000","last_peered":"2024-05-08T05:46:50.968643+0000","last_clean":"2024-05-08T05:46:50.968643+0000","last_became_active":"2024-05-08T05:46:45.953485+0000","last_became_peered":"2024-05-08T05:46:45.953485+0000","last_unstale":"2024-05-08T05:46:50.968643+0000","last_undegraded":"2024-05-08T05:46:50.968643+0000","last_fullsized":"2024-05-08T05:46:50.968643+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:51:45.723988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64782,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":67,"num_read_kb":88,"num_write":34,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":55222,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762571+0000","last_change":"2024-05-08T05:45:54.777524+0000","last_active":"2024-05-08T05:46:45.762571+0000","last_peered":"2024-05-08T05:46:45.762571+0000","last_clean":"2024-05-08T05:46:45.762571+0000","last_became_active":"2024-05-08T05:45:54.776756+0000","last_became_peered":"2024-05-08T05:45:54.776756+0000","last_unstale":"2024-05-08T05:46:45.762571+0000","last_undegraded":"2024-05-08T05:46:45.762571+0000","last_fullsized":"2024-05-08T05:46:45.762571+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:54:27.320411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'9","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.783284+0000","last_change":"2024-05-08T05:46:45.783284+0000","last_active":"2024-05-08T05:46:45.783284+0000","last_peered":"2024-05-08T05:46:45.783284+0000","last_clean":"2024-05-08T05:46:45.783284+0000","last_became_active":"2024-05-08T05:46:45.765201+0000","last_became_peered":"2024-05-08T05:46:45.765201+0000","last_unstale":"2024-05-08T05:46:45.783284+0000","last_undegraded":"2024-05-08T05:46:45.783284+0000","last_fullsized":"2024-05-08T05:46:45.783284+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:44:59.762324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.770085+0000","last_change":"2024-05-08T05:45:54.789165+0000","last_active":"2024-05-08T05:46:45.770085+0000","last_peered":"2024-05-08T05:46:45.770085+0000","last_clean":"2024-05-08T05:46:45.770085+0000","last_became_active":"2024-05-08T05:45:54.788673+0000","last_became_peered":"2024-05-08T05:45:54.788673+0000","last_unstale":"2024-05-08T05:46:45.770085+0000","last_undegraded":"2024-05-08T05:46:45.770085+0000","last_fullsized":"2024-05-08T05:46:45.770085+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:29:08.722409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'5","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.956172+0000","last_change":"2024-05-08T05:45:50.750836+0000","last_active":"2024-05-08T05:46:45.956172+0000","last_peered":"2024-05-08T05:46:45.956172+0000","last_clean":"2024-05-08T05:46:45.956172+0000","last_became_active":"2024-05-08T05:45:50.750587+0000","last_became_peered":"2024-05-08T05:45:50.750587+0000","last_unstale":"2024-05-08T05:46:45.956172+0000","last_undegraded":"2024-05-08T05:46:45.956172+0000","last_fullsized":"2024-05-08T05:46:45.956172+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:19:03.780050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762766+0000","last_change":"2024-05-08T05:45:54.791475+0000","last_active":"2024-05-08T05:46:45.762766+0000","last_peered":"2024-05-08T05:46:45.762766+0000","last_clean":"2024-05-08T05:46:45.762766+0000","last_became_active":"2024-05-08T05:45:54.791122+0000","last_became_peered":"2024-05-08T05:45:54.791122+0000","last_unstale":"2024-05-08T05:46:45.762766+0000","last_undegraded":"2024-05-08T05:46:45.762766+0000","last_fullsized":"2024-05-08T05:46:45.762766+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:08:01.261852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'5","reported_seq":71,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:54.045316+0000","last_change":"2024-05-08T05:45:50.742848+0000","last_active":"2024-05-08T05:46:54.045316+0000","last_peered":"2024-05-08T05:46:54.045316+0000","last_clean":"2024-05-08T05:46:54.045316+0000","last_became_active":"2024-05-08T05:45:50.742448+0000","last_became_peered":"2024-05-08T05:45:50.742448+0000","last_unstale":"2024-05-08T05:46:54.045316+0000","last_undegraded":"2024-05-08T05:46:54.045316+0000","last_fullsized":"2024-05-08T05:46:54.045316+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:17:35.970285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":41,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762192+0000","last_change":"2024-05-08T05:45:54.773009+0000","last_active":"2024-05-08T05:46:45.762192+0000","last_peered":"2024-05-08T05:46:45.762192+0000","last_clean":"2024-05-08T05:46:45.762192+0000","last_became_active":"2024-05-08T05:45:54.772597+0000","last_became_peered":"2024-05-08T05:45:54.772597+0000","last_unstale":"2024-05-08T05:46:45.762192+0000","last_undegraded":"2024-05-08T05:46:45.762192+0000","last_fullsized":"2024-05-08T05:46:45.762192+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:41:31.632363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'17","reported_seq":44,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762729+0000","last_change":"2024-05-08T05:45:50.867734+0000","last_active":"2024-05-08T05:46:45.762729+0000","last_peered":"2024-05-08T05:46:45.762729+0000","last_clean":"2024-05-08T05:46:45.762729+0000","last_became_active":"2024-05-08T05:45:50.867441+0000","last_became_peered":"2024-05-08T05:45:50.867441+0000","last_unstale":"2024-05-08T05:46:45.762729+0000","last_undegraded":"2024-05-08T05:46:45.762729+0000","last_fullsized":"2024-05-08T05:46:45.762729+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:16:45.430432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.956004+0000","last_change":"2024-05-08T05:45:54.777168+0000","last_active":"2024-05-08T05:46:45.956004+0000","last_peered":"2024-05-08T05:46:45.956004+0000","last_clean":"2024-05-08T05:46:45.956004+0000","last_became_active":"2024-05-08T05:45:54.775985+0000","last_became_peered":"2024-05-08T05:45:54.775985+0000","last_unstale":"2024-05-08T05:46:45.956004+0000","last_undegraded":"2024-05-08T05:46:45.956004+0000","last_fullsized":"2024-05-08T05:46:45.956004+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:57:49.495860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762559+0000","last_change":"2024-05-08T05:45:50.741375+0000","last_active":"2024-05-08T05:46:45.762559+0000","last_peered":"2024-05-08T05:46:45.762559+0000","last_clean":"2024-05-08T05:46:45.762559+0000","last_became_active":"2024-05-08T05:45:50.741025+0000","last_became_peered":"2024-05-08T05:45:50.741025+0000","last_unstale":"2024-05-08T05:46:45.762559+0000","last_undegraded":"2024-05-08T05:46:45.762559+0000","last_fullsized":"2024-05-08T05:46:45.762559+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:01:43.515119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.760030+0000","last_change":"2024-05-08T05:45:54.780302+0000","last_active":"2024-05-08T05:46:45.760030+0000","last_peered":"2024-05-08T05:46:45.760030+0000","last_clean":"2024-05-08T05:46:45.760030+0000","last_became_active":"2024-05-08T05:45:54.778751+0000","last_became_peered":"2024-05-08T05:45:54.778751+0000","last_unstale":"2024-05-08T05:46:45.760030+0000","last_undegraded":"2024-05-08T05:46:45.760030+0000","last_fullsized":"2024-05-08T05:46:45.760030+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:34:57.686504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.770415+0000","last_change":"2024-05-08T05:45:50.870071+0000","last_active":"2024-05-08T05:46:45.770415+0000","last_peered":"2024-05-08T05:46:45.770415+0000","last_clean":"2024-05-08T05:46:45.770415+0000","last_became_active":"2024-05-08T05:45:50.869162+0000","last_became_peered":"2024-05-08T05:45:50.869162+0000","last_unstale":"2024-05-08T05:46:45.770415+0000","last_undegraded":"2024-05-08T05:46:45.770415+0000","last_fullsized":"2024-05-08T05:46:45.770415+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:05:13.104922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"80'1","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.763821+0000","last_change":"2024-05-08T05:45:54.780983+0000","last_active":"2024-05-08T05:46:45.763821+0000","last_peered":"2024-05-08T05:46:45.763821+0000","last_clean":"2024-05-08T05:46:45.763821+0000","last_became_active":"2024-05-08T05:45:54.780617+0000","last_became_peered":"2024-05-08T05:45:54.780617+0000","last_unstale":"2024-05-08T05:46:45.763821+0000","last_undegraded":"2024-05-08T05:46:45.763821+0000","last_fullsized":"2024-05-08T05:46:45.763821+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:56:40.972467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"80'5","reported_seq":69,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:53.062983+0000","last_change":"2024-05-08T05:45:50.748869+0000","last_active":"2024-05-08T05:46:53.062983+0000","last_peered":"2024-05-08T05:46:53.062983+0000","last_clean":"2024-05-08T05:46:53.062983+0000","last_became_active":"2024-05-08T05:45:50.748494+0000","last_became_peered":"2024-05-08T05:45:50.748494+0000","last_unstale":"2024-05-08T05:46:53.062983+0000","last_undegraded":"2024-05-08T05:46:53.062983+0000","last_fullsized":"2024-05-08T05:46:53.062983+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:12:25.227090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":38,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.763922+0000","last_change":"2024-05-08T05:45:54.802180+0000","last_active":"2024-05-08T05:46:45.763922+0000","last_peered":"2024-05-08T05:46:45.763922+0000","last_clean":"2024-05-08T05:46:45.763922+0000","last_became_active":"2024-05-08T05:45:54.801822+0000","last_became_peered":"2024-05-08T05:45:54.801822+0000","last_unstale":"2024-05-08T05:46:45.763922+0000","last_undegraded":"2024-05-08T05:46:45.763922+0000","last_fullsized":"2024-05-08T05:46:45.763922+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:52:11.802630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.956189+0000","last_change":"2024-05-08T05:45:54.770981+0000","last_active":"2024-05-08T05:46:45.956189+0000","last_peered":"2024-05-08T05:46:45.956189+0000","last_clean":"2024-05-08T05:46:45.956189+0000","last_became_active":"2024-05-08T05:45:54.770538+0000","last_became_peered":"2024-05-08T05:45:54.770538+0000","last_unstale":"2024-05-08T05:46:45.956189+0000","last_undegraded":"2024-05-08T05:46:45.956189+0000","last_fullsized":"2024-05-08T05:46:45.956189+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:32:34.699752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"80'5","reported_seq":69,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:53.042416+0000","last_change":"2024-05-08T05:45:50.864189+0000","last_active":"2024-05-08T05:46:53.042416+0000","last_peered":"2024-05-08T05:46:53.042416+0000","last_clean":"2024-05-08T05:46:53.042416+0000","last_became_active":"2024-05-08T05:45:50.863170+0000","last_became_peered":"2024-05-08T05:45:50.863170+0000","last_unstale":"2024-05-08T05:46:53.042416+0000","last_undegraded":"2024-05-08T05:46:53.042416+0000","last_fullsized":"2024-05-08T05:46:53.042416+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:44:33.109166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762002+0000","last_change":"2024-05-08T05:45:54.792347+0000","last_active":"2024-05-08T05:46:45.762002+0000","last_peered":"2024-05-08T05:46:45.762002+0000","last_clean":"2024-05-08T05:46:45.762002+0000","last_became_active":"2024-05-08T05:45:54.791767+0000","last_became_peered":"2024-05-08T05:45:54.791767+0000","last_unstale":"2024-05-08T05:46:45.762002+0000","last_undegraded":"2024-05-08T05:46:45.762002+0000","last_fullsized":"2024-05-08T05:46:45.762002+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:03:46.354687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"80'6","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.952657+0000","last_change":"2024-05-08T05:45:50.748659+0000","last_active":"2024-05-08T05:46:45.952657+0000","last_peered":"2024-05-08T05:46:45.952657+0000","last_clean":"2024-05-08T05:46:45.952657+0000","last_became_active":"2024-05-08T05:45:50.748279+0000","last_became_peered":"2024-05-08T05:45:50.748279+0000","last_unstale":"2024-05-08T05:46:45.952657+0000","last_undegraded":"2024-05-08T05:46:45.952657+0000","last_fullsized":"2024-05-08T05:46:45.952657+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:42:25.892715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":101,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762503+0000","last_change":"2024-05-08T05:44:18.365376+0000","last_active":"2024-05-08T05:46:45.762503+0000","last_peered":"2024-05-08T05:46:45.762503+0000","last_clean":"2024-05-08T05:46:45.762503+0000","last_became_active":"2024-05-08T05:44:18.360156+0000","last_became_peered":"2024-05-08T05:44:18.360156+0000","last_unstale":"2024-05-08T05:46:45.762503+0000","last_undegraded":"2024-05-08T05:46:45.762503+0000","last_fullsized":"2024-05-08T05:46:45.762503+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:40:28.502228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:40:28.502228+0000","last_clean_scrub_stamp":"2024-05-08T05:40:28.502228+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:38:20.339163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.770872+0000","last_change":"2024-05-08T05:45:54.775625+0000","last_active":"2024-05-08T05:46:45.770872+0000","last_peered":"2024-05-08T05:46:45.770872+0000","last_clean":"2024-05-08T05:46:45.770872+0000","last_became_active":"2024-05-08T05:45:54.774661+0000","last_became_peered":"2024-05-08T05:45:54.774661+0000","last_unstale":"2024-05-08T05:46:45.770872+0000","last_undegraded":"2024-05-08T05:46:45.770872+0000","last_fullsized":"2024-05-08T05:46:45.770872+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:57:05.676092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"80'4","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762613+0000","last_change":"2024-05-08T05:45:50.747823+0000","last_active":"2024-05-08T05:46:45.762613+0000","last_peered":"2024-05-08T05:46:45.762613+0000","last_clean":"2024-05-08T05:46:45.762613+0000","last_became_active":"2024-05-08T05:45:50.747222+0000","last_became_peered":"2024-05-08T05:45:50.747222+0000","last_unstale":"2024-05-08T05:46:45.762613+0000","last_undegraded":"2024-05-08T05:46:45.762613+0000","last_fullsized":"2024-05-08T05:46:45.762613+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:49:06.238468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"80'4","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.763297+0000","last_change":"2024-05-08T05:45:50.861721+0000","last_active":"2024-05-08T05:46:45.763297+0000","last_peered":"2024-05-08T05:46:45.763297+0000","last_clean":"2024-05-08T05:46:45.763297+0000","last_became_active":"2024-05-08T05:45:50.861369+0000","last_became_peered":"2024-05-08T05:45:50.861369+0000","last_unstale":"2024-05-08T05:46:45.763297+0000","last_undegraded":"2024-05-08T05:46:45.763297+0000","last_fullsized":"2024-05-08T05:46:45.763297+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:35:19.781796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.770208+0000","last_change":"2024-05-08T05:45:54.787260+0000","last_active":"2024-05-08T05:46:45.770208+0000","last_peered":"2024-05-08T05:46:45.770208+0000","last_clean":"2024-05-08T05:46:45.770208+0000","last_became_active":"2024-05-08T05:45:54.786897+0000","last_became_peered":"2024-05-08T05:45:54.786897+0000","last_unstale":"2024-05-08T05:46:45.770208+0000","last_undegraded":"2024-05-08T05:46:45.770208+0000","last_fullsized":"2024-05-08T05:46:45.770208+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:10:06.761165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'16","reported_seq":42,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.774682+0000","last_change":"2024-05-08T05:45:50.746160+0000","last_active":"2024-05-08T05:46:45.774682+0000","last_peered":"2024-05-08T05:46:45.774682+0000","last_clean":"2024-05-08T05:46:45.774682+0000","last_became_active":"2024-05-08T05:45:50.745630+0000","last_became_peered":"2024-05-08T05:45:50.745630+0000","last_unstale":"2024-05-08T05:46:45.774682+0000","last_undegraded":"2024-05-08T05:46:45.774682+0000","last_fullsized":"2024-05-08T05:46:45.774682+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:45:27.593902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762946+0000","last_change":"2024-05-08T05:45:54.797162+0000","last_active":"2024-05-08T05:46:45.762946+0000","last_peered":"2024-05-08T05:46:45.762946+0000","last_clean":"2024-05-08T05:46:45.762946+0000","last_became_active":"2024-05-08T05:45:54.796859+0000","last_became_peered":"2024-05-08T05:45:54.796859+0000","last_unstale":"2024-05-08T05:46:45.762946+0000","last_undegraded":"2024-05-08T05:46:45.762946+0000","last_fullsized":"2024-05-08T05:46:45.762946+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:51:25.701160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'7","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.952363+0000","last_change":"2024-05-08T05:45:50.744793+0000","last_active":"2024-05-08T05:46:45.952363+0000","last_peered":"2024-05-08T05:46:45.952363+0000","last_clean":"2024-05-08T05:46:45.952363+0000","last_became_active":"2024-05-08T05:45:50.744407+0000","last_became_peered":"2024-05-08T05:45:50.744407+0000","last_unstale":"2024-05-08T05:46:45.952363+0000","last_undegraded":"2024-05-08T05:46:45.952363+0000","last_fullsized":"2024-05-08T05:46:45.952363+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:18:17.029402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.773267+0000","last_change":"2024-05-08T05:45:54.797042+0000","last_active":"2024-05-08T05:46:45.773267+0000","last_peered":"2024-05-08T05:46:45.773267+0000","last_clean":"2024-05-08T05:46:45.773267+0000","last_became_active":"2024-05-08T05:45:54.795796+0000","last_became_peered":"2024-05-08T05:45:54.795796+0000","last_unstale":"2024-05-08T05:46:45.773267+0000","last_undegraded":"2024-05-08T05:46:45.773267+0000","last_fullsized":"2024-05-08T05:46:45.773267+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:20:10.789348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.766020+0000","last_change":"2024-05-08T05:45:50.860466+0000","last_active":"2024-05-08T05:46:45.766020+0000","last_peered":"2024-05-08T05:46:45.766020+0000","last_clean":"2024-05-08T05:46:45.766020+0000","last_became_active":"2024-05-08T05:45:50.860093+0000","last_became_peered":"2024-05-08T05:45:50.860093+0000","last_unstale":"2024-05-08T05:46:45.766020+0000","last_undegraded":"2024-05-08T05:46:45.766020+0000","last_fullsized":"2024-05-08T05:46:45.766020+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:42:37.799098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762784+0000","last_change":"2024-05-08T05:45:54.774635+0000","last_active":"2024-05-08T05:46:45.762784+0000","last_peered":"2024-05-08T05:46:45.762784+0000","last_clean":"2024-05-08T05:46:45.762784+0000","last_became_active":"2024-05-08T05:45:54.774288+0000","last_became_peered":"2024-05-08T05:45:54.774288+0000","last_unstale":"2024-05-08T05:46:45.762784+0000","last_undegraded":"2024-05-08T05:46:45.762784+0000","last_fullsized":"2024-05-08T05:46:45.762784+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:55:59.787540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'7","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.761847+0000","last_change":"2024-05-08T05:45:50.750830+0000","last_active":"2024-05-08T05:46:45.761847+0000","last_peered":"2024-05-08T05:46:45.761847+0000","last_clean":"2024-05-08T05:46:45.761847+0000","last_became_active":"2024-05-08T05:45:50.750473+0000","last_became_peered":"2024-05-08T05:45:50.750473+0000","last_unstale":"2024-05-08T05:46:45.761847+0000","last_undegraded":"2024-05-08T05:46:45.761847+0000","last_fullsized":"2024-05-08T05:46:45.761847+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:04:14.314865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.759810+0000","last_change":"2024-05-08T05:45:54.800008+0000","last_active":"2024-05-08T05:46:45.759810+0000","last_peered":"2024-05-08T05:46:45.759810+0000","last_clean":"2024-05-08T05:46:45.759810+0000","last_became_active":"2024-05-08T05:45:54.799615+0000","last_became_peered":"2024-05-08T05:45:54.799615+0000","last_unstale":"2024-05-08T05:46:45.759810+0000","last_undegraded":"2024-05-08T05:46:45.759810+0000","last_fullsized":"2024-05-08T05:46:45.759810+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:58:12.907617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'3","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762162+0000","last_change":"2024-05-08T05:45:50.745088+0000","last_active":"2024-05-08T05:46:45.762162+0000","last_peered":"2024-05-08T05:46:45.762162+0000","last_clean":"2024-05-08T05:46:45.762162+0000","last_became_active":"2024-05-08T05:45:50.744735+0000","last_became_peered":"2024-05-08T05:45:50.744735+0000","last_unstale":"2024-05-08T05:46:45.762162+0000","last_undegraded":"2024-05-08T05:46:45.762162+0000","last_fullsized":"2024-05-08T05:46:45.762162+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:39:12.404233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762460+0000","last_change":"2024-05-08T05:45:54.803875+0000","last_active":"2024-05-08T05:46:45.762460+0000","last_peered":"2024-05-08T05:46:45.762460+0000","last_clean":"2024-05-08T05:46:45.762460+0000","last_became_active":"2024-05-08T05:45:54.803504+0000","last_became_peered":"2024-05-08T05:45:54.803504+0000","last_unstale":"2024-05-08T05:46:45.762460+0000","last_undegraded":"2024-05-08T05:46:45.762460+0000","last_fullsized":"2024-05-08T05:46:45.762460+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:49:33.419868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.763059+0000","last_change":"2024-05-08T05:45:50.741351+0000","last_active":"2024-05-08T05:46:45.763059+0000","last_peered":"2024-05-08T05:46:45.763059+0000","last_clean":"2024-05-08T05:46:45.763059+0000","last_became_active":"2024-05-08T05:45:50.740970+0000","last_became_peered":"2024-05-08T05:45:50.740970+0000","last_unstale":"2024-05-08T05:46:45.763059+0000","last_undegraded":"2024-05-08T05:46:45.763059+0000","last_fullsized":"2024-05-08T05:46:45.763059+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:31:02.093446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.763129+0000","last_change":"2024-05-08T05:45:54.792665+0000","last_active":"2024-05-08T05:46:45.763129+0000","last_peered":"2024-05-08T05:46:45.763129+0000","last_clean":"2024-05-08T05:46:45.763129+0000","last_became_active":"2024-05-08T05:45:54.792309+0000","last_became_peered":"2024-05-08T05:45:54.792309+0000","last_unstale":"2024-05-08T05:46:45.763129+0000","last_undegraded":"2024-05-08T05:46:45.763129+0000","last_fullsized":"2024-05-08T05:46:45.763129+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:48:29.154009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"80'6","reported_seq":70,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:51.053241+0000","last_change":"2024-05-08T05:45:50.861234+0000","last_active":"2024-05-08T05:46:51.053241+0000","last_peered":"2024-05-08T05:46:51.053241+0000","last_clean":"2024-05-08T05:46:51.053241+0000","last_became_active":"2024-05-08T05:45:50.860885+0000","last_became_peered":"2024-05-08T05:45:50.860885+0000","last_unstale":"2024-05-08T05:46:51.053241+0000","last_undegraded":"2024-05-08T05:46:51.053241+0000","last_fullsized":"2024-05-08T05:46:51.053241+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:59:50.300316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.763251+0000","last_change":"2024-05-08T05:45:54.781154+0000","last_active":"2024-05-08T05:46:45.763251+0000","last_peered":"2024-05-08T05:46:45.763251+0000","last_clean":"2024-05-08T05:46:45.763251+0000","last_became_active":"2024-05-08T05:45:54.780340+0000","last_became_peered":"2024-05-08T05:45:54.780340+0000","last_unstale":"2024-05-08T05:46:45.763251+0000","last_undegraded":"2024-05-08T05:46:45.763251+0000","last_fullsized":"2024-05-08T05:46:45.763251+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:22:39.614532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'3","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.956346+0000","last_change":"2024-05-08T05:45:50.748015+0000","last_active":"2024-05-08T05:46:45.956346+0000","last_peered":"2024-05-08T05:46:45.956346+0000","last_clean":"2024-05-08T05:46:45.956346+0000","last_became_active":"2024-05-08T05:45:50.747649+0000","last_became_peered":"2024-05-08T05:45:50.747649+0000","last_unstale":"2024-05-08T05:46:45.956346+0000","last_undegraded":"2024-05-08T05:46:45.956346+0000","last_fullsized":"2024-05-08T05:46:45.956346+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:31:49.177676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"80'1","reported_seq":21,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.763008+0000","last_change":"2024-05-08T05:45:54.779680+0000","last_active":"2024-05-08T05:46:45.763008+0000","last_peered":"2024-05-08T05:46:45.763008+0000","last_clean":"2024-05-08T05:46:45.763008+0000","last_became_active":"2024-05-08T05:45:54.779273+0000","last_became_peered":"2024-05-08T05:45:54.779273+0000","last_unstale":"2024-05-08T05:46:45.763008+0000","last_undegraded":"2024-05-08T05:46:45.763008+0000","last_fullsized":"2024-05-08T05:46:45.763008+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:40:05.192134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"80'5","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.770241+0000","last_change":"2024-05-08T05:45:50.744569+0000","last_active":"2024-05-08T05:46:45.770241+0000","last_peered":"2024-05-08T05:46:45.770241+0000","last_clean":"2024-05-08T05:46:45.770241+0000","last_became_active":"2024-05-08T05:45:50.744164+0000","last_became_peered":"2024-05-08T05:45:50.744164+0000","last_unstale":"2024-05-08T05:46:45.770241+0000","last_undegraded":"2024-05-08T05:46:45.770241+0000","last_fullsized":"2024-05-08T05:46:45.770241+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:17:56.409110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.763350+0000","last_change":"2024-05-08T05:45:54.776338+0000","last_active":"2024-05-08T05:46:45.763350+0000","last_peered":"2024-05-08T05:46:45.763350+0000","last_clean":"2024-05-08T05:46:45.763350+0000","last_became_active":"2024-05-08T05:45:54.776015+0000","last_became_peered":"2024-05-08T05:45:54.776015+0000","last_unstale":"2024-05-08T05:46:45.763350+0000","last_undegraded":"2024-05-08T05:46:45.763350+0000","last_fullsized":"2024-05-08T05:46:45.763350+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:38:10.608436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.759858+0000","last_change":"2024-05-08T05:45:54.782245+0000","last_active":"2024-05-08T05:46:45.759858+0000","last_peered":"2024-05-08T05:46:45.759858+0000","last_clean":"2024-05-08T05:46:45.759858+0000","last_became_active":"2024-05-08T05:45:54.781860+0000","last_became_peered":"2024-05-08T05:45:54.781860+0000","last_unstale":"2024-05-08T05:46:45.759858+0000","last_undegraded":"2024-05-08T05:46:45.759858+0000","last_fullsized":"2024-05-08T05:46:45.759858+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:50:14.658930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762143+0000","last_change":"2024-05-08T05:45:54.770787+0000","last_active":"2024-05-08T05:46:45.762143+0000","last_peered":"2024-05-08T05:46:45.762143+0000","last_clean":"2024-05-08T05:46:45.762143+0000","last_became_active":"2024-05-08T05:45:54.770409+0000","last_became_peered":"2024-05-08T05:45:54.770409+0000","last_unstale":"2024-05-08T05:46:45.762143+0000","last_undegraded":"2024-05-08T05:46:45.762143+0000","last_fullsized":"2024-05-08T05:46:45.762143+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:09:31.102075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762061+0000","last_change":"2024-05-08T05:45:54.788799+0000","last_active":"2024-05-08T05:46:45.762061+0000","last_peered":"2024-05-08T05:46:45.762061+0000","last_clean":"2024-05-08T05:46:45.762061+0000","last_became_active":"2024-05-08T05:45:54.788295+0000","last_became_peered":"2024-05-08T05:45:54.788295+0000","last_unstale":"2024-05-08T05:46:45.762061+0000","last_undegraded":"2024-05-08T05:46:45.762061+0000","last_fullsized":"2024-05-08T05:46:45.762061+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:55:07.912479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.772155+0000","last_change":"2024-05-08T05:45:54.801316+0000","last_active":"2024-05-08T05:46:45.772155+0000","last_peered":"2024-05-08T05:46:45.772155+0000","last_clean":"2024-05-08T05:46:45.772155+0000","last_became_active":"2024-05-08T05:45:54.798655+0000","last_became_peered":"2024-05-08T05:45:54.798655+0000","last_unstale":"2024-05-08T05:46:45.772155+0000","last_undegraded":"2024-05-08T05:46:45.772155+0000","last_fullsized":"2024-05-08T05:46:45.772155+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:30:25.786822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.769921+0000","last_change":"2024-05-08T05:45:54.793076+0000","last_active":"2024-05-08T05:46:45.769921+0000","last_peered":"2024-05-08T05:46:45.769921+0000","last_clean":"2024-05-08T05:46:45.769921+0000","last_became_active":"2024-05-08T05:45:54.792726+0000","last_became_peered":"2024-05-08T05:45:54.792726+0000","last_unstale":"2024-05-08T05:46:45.769921+0000","last_undegraded":"2024-05-08T05:46:45.769921+0000","last_fullsized":"2024-05-08T05:46:45.769921+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:46:02.659667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.760662+0000","last_change":"2024-05-08T05:45:54.779134+0000","last_active":"2024-05-08T05:46:45.760662+0000","last_peered":"2024-05-08T05:46:45.760662+0000","last_clean":"2024-05-08T05:46:45.760662+0000","last_became_active":"2024-05-08T05:45:54.778764+0000","last_became_peered":"2024-05-08T05:45:54.778764+0000","last_unstale":"2024-05-08T05:46:45.760662+0000","last_undegraded":"2024-05-08T05:46:45.760662+0000","last_fullsized":"2024-05-08T05:46:45.760662+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:10:00.531228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762356+0000","last_change":"2024-05-08T05:45:54.775628+0000","last_active":"2024-05-08T05:46:45.762356+0000","last_peered":"2024-05-08T05:46:45.762356+0000","last_clean":"2024-05-08T05:46:45.762356+0000","last_became_active":"2024-05-08T05:45:54.775293+0000","last_became_peered":"2024-05-08T05:45:54.775293+0000","last_unstale":"2024-05-08T05:46:45.762356+0000","last_undegraded":"2024-05-08T05:46:45.762356+0000","last_fullsized":"2024-05-08T05:46:45.762356+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:02:57.884691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762948+0000","last_change":"2024-05-08T05:45:54.805054+0000","last_active":"2024-05-08T05:46:45.762948+0000","last_peered":"2024-05-08T05:46:45.762948+0000","last_clean":"2024-05-08T05:46:45.762948+0000","last_became_active":"2024-05-08T05:45:54.804642+0000","last_became_peered":"2024-05-08T05:45:54.804642+0000","last_unstale":"2024-05-08T05:46:45.762948+0000","last_undegraded":"2024-05-08T05:46:45.762948+0000","last_fullsized":"2024-05-08T05:46:45.762948+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:17:22.412759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.955997+0000","last_change":"2024-05-08T05:45:54.792217+0000","last_active":"2024-05-08T05:46:45.955997+0000","last_peered":"2024-05-08T05:46:45.955997+0000","last_clean":"2024-05-08T05:46:45.955997+0000","last_became_active":"2024-05-08T05:45:54.791508+0000","last_became_peered":"2024-05-08T05:45:54.791508+0000","last_unstale":"2024-05-08T05:46:45.955997+0000","last_undegraded":"2024-05-08T05:46:45.955997+0000","last_fullsized":"2024-05-08T05:46:45.955997+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:47:19.053306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.761929+0000","last_change":"2024-05-08T05:45:54.794538+0000","last_active":"2024-05-08T05:46:45.761929+0000","last_peered":"2024-05-08T05:46:45.761929+0000","last_clean":"2024-05-08T05:46:45.761929+0000","last_became_active":"2024-05-08T05:45:54.792575+0000","last_became_peered":"2024-05-08T05:45:54.792575+0000","last_unstale":"2024-05-08T05:46:45.761929+0000","last_undegraded":"2024-05-08T05:46:45.761929+0000","last_fullsized":"2024-05-08T05:46:45.761929+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:54:31.086864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.766898+0000","last_change":"2024-05-08T05:45:54.782828+0000","last_active":"2024-05-08T05:46:45.766898+0000","last_peered":"2024-05-08T05:46:45.766898+0000","last_clean":"2024-05-08T05:46:45.766898+0000","last_became_active":"2024-05-08T05:45:54.782442+0000","last_became_peered":"2024-05-08T05:45:54.782442+0000","last_unstale":"2024-05-08T05:46:45.766898+0000","last_undegraded":"2024-05-08T05:46:45.766898+0000","last_fullsized":"2024-05-08T05:46:45.766898+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:42:53.551455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.774062+0000","last_change":"2024-05-08T05:45:54.800422+0000","last_active":"2024-05-08T05:46:45.774062+0000","last_peered":"2024-05-08T05:46:45.774062+0000","last_clean":"2024-05-08T05:46:45.774062+0000","last_became_active":"2024-05-08T05:45:54.799853+0000","last_became_peered":"2024-05-08T05:45:54.799853+0000","last_unstale":"2024-05-08T05:46:45.774062+0000","last_undegraded":"2024-05-08T05:46:45.774062+0000","last_fullsized":"2024-05-08T05:46:45.774062+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:54:22.710347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.775876+0000","last_change":"2024-05-08T05:46:45.775876+0000","last_active":"2024-05-08T05:46:45.775876+0000","last_peered":"2024-05-08T05:46:45.775876+0000","last_clean":"2024-05-08T05:46:45.775876+0000","last_became_active":"2024-05-08T05:46:45.775558+0000","last_became_peered":"2024-05-08T05:46:45.775558+0000","last_unstale":"2024-05-08T05:46:45.775876+0000","last_undegraded":"2024-05-08T05:46:45.775876+0000","last_fullsized":"2024-05-08T05:46:45.775876+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:11:38.649137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":311296,"data_stored":3542208,"data_compressed":212518,"data_compressed_allocated":270336,"data_compressed_original":3522560,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":71595,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":385,"num_read_kb":259,"num_write":246,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":55290,"num_keys_recovered":20,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":536576,"data_stored":215923,"data_compressed":9129,"data_compressed_allocated":12288,"data_compressed_original":53248,"omap_allocated":0,"internal_metadata":0},"log_size":211,"ondisk_log_size":211,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645340,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":901120,"data_stored":435889,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841570,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32204,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712948,"statfs":{"total":95995035648,"available":95962058752,"internally_reserved":0,"allocated":1052672,"data_stored":1091241,"data_compressed":35691,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037799,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":917504,"data_stored":435360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234029,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":913408,"data_stored":435738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430258,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":1027865,"data_compressed":35691,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593785,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713088,"statfs":{"total":95995035648,"available":95962202112,"internally_reserved":0,"allocated":901120,"data_stored":435077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574932,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":500772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":921600,"data_stored":436807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411408,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":905216,"data_stored":436533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149769,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":917504,"data_stored":434902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953539,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":933888,"data_stored":499720,"data_compressed":9129,"data_compressed_allocated":12288,"data_compressed_original":53248,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790014,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":978944,"data_stored":1027543,"data_compressed":35691,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34063,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35691,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35691,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35691,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35691,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35691,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":66534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":66620,"data_compressed":9129,"data_compressed_allocated":12288,"data_compressed_original":53248,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":66518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T05:46:57.671 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-05-08T05:46:57.672 INFO:tasks.cephadm:Setting up client nodes... 2024-05-08T05:46:57.672 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-05-08T05:46:57.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:57 smithi082 ceph-mon[30098]: pgmap v348: 97 pgs: 97 active+clean; 647 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.3 KiB/s wr, 9 op/s; 5.2 KiB/s, 1 keys/s, 2 objects/s recovering 2024-05-08T05:46:57.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:57 smithi082 ceph-mon[30098]: from='client.24632 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T05:46:58.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:57 smithi151 ceph-mon[34815]: pgmap v348: 97 pgs: 97 active+clean; 647 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.3 KiB/s wr, 9 op/s; 5.2 KiB/s, 1 keys/s, 2 objects/s recovering 2024-05-08T05:46:58.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:57 smithi151 ceph-mon[34815]: from='client.24632 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T05:46:58.165 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:46:58.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:57 smithi134 ceph-mon[34132]: pgmap v348: 97 pgs: 97 active+clean; 647 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.3 KiB/s wr, 9 op/s; 5.2 KiB/s, 1 keys/s, 2 objects/s recovering 2024-05-08T05:46:58.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:57 smithi134 ceph-mon[34132]: from='client.24632 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T05:47:00.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:46:59 smithi151 ceph-mon[34815]: pgmap v349: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.2 KiB/s wr, 10 op/s; 4.5 KiB/s, 1 keys/s, 1 objects/s recovering 2024-05-08T05:47:00.164 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:46:59 smithi082 ceph-mon[30098]: pgmap v349: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.2 KiB/s wr, 10 op/s; 4.5 KiB/s, 1 keys/s, 1 objects/s recovering 2024-05-08T05:47:00.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:46:59 smithi134 ceph-mon[34132]: pgmap v349: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.2 KiB/s wr, 10 op/s; 4.5 KiB/s, 1 keys/s, 1 objects/s recovering 2024-05-08T05:47:00.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:00.342+0000 7f248dc00700 1 -- 172.21.15.82:0/3625532761 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2488106780 msgr2=0x7f2488106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:00.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:00.342+0000 7f248dc00700 1 --2- 172.21.15.82:0/3625532761 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2488106780 0x7f2488106be0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f24700098f0 tx=0x7f2470009c00 comp rx=0 tx=0).stop 2024-05-08T05:47:00.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:00.342+0000 7f248dc00700 1 -- 172.21.15.82:0/3625532761 shutdown_connections 2024-05-08T05:47:00.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:00.342+0000 7f248dc00700 1 --2- 172.21.15.82:0/3625532761 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2488107120 0x7f248810d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:00.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:00.342+0000 7f248dc00700 1 --2- 172.21.15.82:0/3625532761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2488105580 0x7f24881059a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:00.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:00.342+0000 7f248dc00700 1 --2- 172.21.15.82:0/3625532761 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2488106780 0x7f2488106be0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:00.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:00.342+0000 7f248dc00700 1 -- 172.21.15.82:0/3625532761 >> 172.21.15.82:0/3625532761 conn(0x7f2488100b20 msgr2=0x7f2488102f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:47:00.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:00.342+0000 7f248dc00700 1 -- 172.21.15.82:0/3625532761 shutdown_connections 2024-05-08T05:47:00.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:00.342+0000 7f248dc00700 1 -- 172.21.15.82:0/3625532761 wait complete. 2024-05-08T05:47:00.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:00.343+0000 7f248dc00700 1 Processor -- start 2024-05-08T05:47:00.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:00.343+0000 7f248dc00700 1 -- start start 2024-05-08T05:47:00.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:00.344+0000 7f248dc00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2488105580 0x7f248819fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:00.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:00.344+0000 7f248dc00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2488106780 0x7f248819ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:00.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:00.344+0000 7f248dc00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2488107120 0x7f24881a7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:00.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:00.344+0000 7f248dc00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2488111040 con 0x7f2488107120 2024-05-08T05:47:00.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:00.344+0000 7f248dc00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2488110ec0 con 0x7f2488106780 2024-05-08T05:47:00.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:00.344+0000 7f248dc00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f24881111c0 con 0x7f2488105580 2024-05-08T05:47:00.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:00.344+0000 7f248d200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2488107120 0x7f24881a7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:00.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:00.344+0000 7f248d200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2488107120 0x7f24881a7000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48276/0 (socket says 172.21.15.82:48276) 2024-05-08T05:47:00.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:00.344+0000 7f248d200700 1 -- 172.21.15.82:0/1010222405 learned_addr learned my addr 172.21.15.82:0/1010222405 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:47:00.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:00.344+0000 7f2487e00700 1 --2- 172.21.15.82:0/1010222405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2488105580 0x7f248819fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:00.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:00.344+0000 7f247fe00700 1 --2- 172.21.15.82:0/1010222405 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2488106780 0x7f248819ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:00.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:00.344+0000 7f248d200700 1 -- 172.21.15.82:0/1010222405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2488105580 msgr2=0x7f248819fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:00.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:00.344+0000 7f248d200700 1 --2- 172.21.15.82:0/1010222405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2488105580 0x7f248819fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:00.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:00.344+0000 7f248d200700 1 -- 172.21.15.82:0/1010222405 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2488106780 msgr2=0x7f248819ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:00.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:00.344+0000 7f248d200700 1 --2- 172.21.15.82:0/1010222405 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2488106780 0x7f248819ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:00.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:00.344+0000 7f248d200700 1 -- 172.21.15.82:0/1010222405 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24881a76a0 con 0x7f2488107120 2024-05-08T05:47:00.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:00.345+0000 7f248d200700 1 --2- 172.21.15.82:0/1010222405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2488107120 0x7f24881a7000 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f248000ef60 tx=0x7f248000ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:47:00.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:00.345+0000 7f2485600700 1 -- 172.21.15.82:0/1010222405 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24800092e0 con 0x7f2488107120 2024-05-08T05:47:00.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:00.345+0000 7f2485600700 1 -- 172.21.15.82:0/1010222405 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2480004bb0 con 0x7f2488107120 2024-05-08T05:47:00.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:00.345+0000 7f2485600700 1 -- 172.21.15.82:0/1010222405 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2480004020 con 0x7f2488107120 2024-05-08T05:47:00.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:00.345+0000 7f248dc00700 1 -- 172.21.15.82:0/1010222405 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24881a7930 con 0x7f2488107120 2024-05-08T05:47:00.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:00.345+0000 7f248dc00700 1 -- 172.21.15.82:0/1010222405 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24881a7e20 con 0x7f2488107120 2024-05-08T05:47:00.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:00.347+0000 7f248dc00700 1 -- 172.21.15.82:0/1010222405 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2488064b00 con 0x7f2488107120 2024-05-08T05:47:00.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:00.349+0000 7f2485600700 1 -- 172.21.15.82:0/1010222405 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f248001b030 con 0x7f2488107120 2024-05-08T05:47:00.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:00.351+0000 7f2485600700 1 --2- 172.21.15.82:0/1010222405 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f246c0b2a30 0x7f246c0b4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:00.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:00.352+0000 7f2485600700 1 -- 172.21.15.82:0/1010222405 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f24800e1d80 con 0x7f2488107120 2024-05-08T05:47:00.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:00.352+0000 7f2487e00700 1 --2- 172.21.15.82:0/1010222405 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f246c0b2a30 0x7f246c0b4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:00.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:00.352+0000 7f2487e00700 1 --2- 172.21.15.82:0/1010222405 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f246c0b2a30 0x7f246c0b4ef0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f24881065e0 tx=0x7f2478009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:47:00.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:00.356+0000 7f2485600700 1 -- 172.21.15.82:0/1010222405 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2480022020 con 0x7f2488107120 2024-05-08T05:47:00.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:00.680+0000 7f248dc00700 1 -- 172.21.15.82:0/1010222405 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f24881a8260 con 0x7f2488107120 2024-05-08T05:47:00.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:00.683+0000 7f2485600700 1 -- 172.21.15.82:0/1010222405 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f2480010040 con 0x7f2488107120 2024-05-08T05:47:00.683 INFO:teuthology.orchestra.run.smithi082.stdout:[client.0] 2024-05-08T05:47:00.683 INFO:teuthology.orchestra.run.smithi082.stdout: key = AQDUETtmtJKaKBAAsaK1C2d3o64bFsEaU0Tibw== 2024-05-08T05:47:00.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:00.686+0000 7f248dc00700 1 -- 172.21.15.82:0/1010222405 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f246c0b2a30 msgr2=0x7f246c0b4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:00.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:00.686+0000 7f248dc00700 1 --2- 172.21.15.82:0/1010222405 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f246c0b2a30 0x7f246c0b4ef0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f24881065e0 tx=0x7f2478009310 comp rx=0 tx=0).stop 2024-05-08T05:47:00.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:00.686+0000 7f248dc00700 1 -- 172.21.15.82:0/1010222405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2488107120 msgr2=0x7f24881a7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:00.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:00.686+0000 7f248dc00700 1 --2- 172.21.15.82:0/1010222405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2488107120 0x7f24881a7000 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f248000ef60 tx=0x7f248000ef90 comp rx=0 tx=0).stop 2024-05-08T05:47:00.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:00.686+0000 7f248dc00700 1 -- 172.21.15.82:0/1010222405 shutdown_connections 2024-05-08T05:47:00.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:00.686+0000 7f248dc00700 1 --2- 172.21.15.82:0/1010222405 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f246c0b2a30 0x7f246c0b4ef0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:00.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:00.686+0000 7f248dc00700 1 --2- 172.21.15.82:0/1010222405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2488107120 0x7f24881a7000 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:00.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:00.686+0000 7f248dc00700 1 --2- 172.21.15.82:0/1010222405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2488105580 0x7f248819fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:00.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:00.686+0000 7f248dc00700 1 --2- 172.21.15.82:0/1010222405 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2488106780 0x7f248819ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:00.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:00.686+0000 7f248dc00700 1 -- 172.21.15.82:0/1010222405 >> 172.21.15.82:0/1010222405 conn(0x7f2488100b20 msgr2=0x7f24880798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:47:00.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:00.686+0000 7f248dc00700 1 -- 172.21.15.82:0/1010222405 shutdown_connections 2024-05-08T05:47:00.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:00.686+0000 7f248dc00700 1 -- 172.21.15.82:0/1010222405 wait complete. 2024-05-08T05:47:00.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:47:00 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/1010222405' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-08T05:47:00.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:47:00 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/1010222405' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-08T05:47:01.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:47:00 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/1010222405' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-08T05:47:01.552 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:47:00 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/1010222405' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-08T05:47:01.554 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:47:00 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/1010222405' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-08T05:47:01.554 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:47:00 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/1010222405' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-08T05:47:01.555 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-08T05:47:01.555 DEBUG:teuthology.orchestra.run.smithi082:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-05-08T05:47:01.555 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-08T05:47:01.691 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-08T05:47:01.691 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-05-08T05:47:01.691 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph mgr dump --format=json 2024-05-08T05:47:02.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:47:01 smithi151 ceph-mon[34815]: pgmap v350: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 597 B/s wr, 10 op/s; 5 B/s, 1 keys/s, 1 objects/s recovering 2024-05-08T05:47:02.182 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:47:02.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:47:01 smithi082 ceph-mon[30098]: pgmap v350: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 597 B/s wr, 10 op/s; 5 B/s, 1 keys/s, 1 objects/s recovering 2024-05-08T05:47:02.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:47:01 smithi134 ceph-mon[34132]: pgmap v350: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 597 B/s wr, 10 op/s; 5 B/s, 1 keys/s, 1 objects/s recovering 2024-05-08T05:47:03.963 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:47:03 smithi082 ceph-mon[30098]: pgmap v351: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 597 B/s wr, 10 op/s; 5 B/s, 1 keys/s, 1 objects/s recovering 2024-05-08T05:47:04.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:47:03 smithi151 ceph-mon[34815]: pgmap v351: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 597 B/s wr, 10 op/s; 5 B/s, 1 keys/s, 1 objects/s recovering 2024-05-08T05:47:04.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:47:03 smithi134 ceph-mon[34132]: pgmap v351: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 597 B/s wr, 10 op/s; 5 B/s, 1 keys/s, 1 objects/s recovering 2024-05-08T05:47:04.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:04.465+0000 7f12f6a00700 1 -- 172.21.15.82:0/1147188432 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12f0105f90 msgr2=0x7f12f01124a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:04.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:04.465+0000 7f12f6a00700 1 --2- 172.21.15.82:0/1147188432 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12f0105f90 0x7f12f01124a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f12e8009f90 tx=0x7f12e800b330 comp rx=0 tx=0).stop 2024-05-08T05:47:04.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:04.465+0000 7f12f6a00700 1 -- 172.21.15.82:0/1147188432 shutdown_connections 2024-05-08T05:47:04.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:04.465+0000 7f12f6a00700 1 --2- 172.21.15.82:0/1147188432 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12f0105f90 0x7f12f01124a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:04.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:04.465+0000 7f12f6a00700 1 --2- 172.21.15.82:0/1147188432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12f010b660 0x7f12f010ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:04.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:04.465+0000 7f12f6a00700 1 --2- 172.21.15.82:0/1147188432 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12f01055d0 0x7f12f0105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:04.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:04.465+0000 7f12f6a00700 1 -- 172.21.15.82:0/1147188432 >> 172.21.15.82:0/1147188432 conn(0x7f12f01010c0 msgr2=0x7f12f01034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:47:04.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:04.465+0000 7f12f6a00700 1 -- 172.21.15.82:0/1147188432 shutdown_connections 2024-05-08T05:47:04.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:04.465+0000 7f12f6a00700 1 -- 172.21.15.82:0/1147188432 wait complete. 2024-05-08T05:47:04.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:04.467+0000 7f12f6a00700 1 Processor -- start 2024-05-08T05:47:04.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:04.467+0000 7f12f6a00700 1 -- start start 2024-05-08T05:47:04.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:04.467+0000 7f12f6a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12f01055d0 0x7f12f01a1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:04.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:04.467+0000 7f12f6a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12f0105f90 0x7f12f01a1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:04.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:04.467+0000 7f12f6a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12f010b660 0x7f12f019ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:04.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:04.467+0000 7f12f6a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f12f01157d0 con 0x7f12f0105f90 2024-05-08T05:47:04.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:04.467+0000 7f12f6a00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f12f0115650 con 0x7f12f01055d0 2024-05-08T05:47:04.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:04.467+0000 7f12f6a00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f12f0115950 con 0x7f12f010b660 2024-05-08T05:47:04.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:04.468+0000 7f12f4c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12f0105f90 0x7f12f01a1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:04.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:04.468+0000 7f12f4c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12f0105f90 0x7f12f01a1da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47716/0 (socket says 172.21.15.82:47716) 2024-05-08T05:47:04.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:04.468+0000 7f12f4c00700 1 -- 172.21.15.82:0/957123019 learned_addr learned my addr 172.21.15.82:0/957123019 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:47:04.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:04.468+0000 7f12f5600700 1 --2- 172.21.15.82:0/957123019 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12f01055d0 0x7f12f01a1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:04.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:04.468+0000 7f12f6000700 1 --2- 172.21.15.82:0/957123019 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12f010b660 0x7f12f019ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:04.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:04.468+0000 7f12f6000700 1 -- 172.21.15.82:0/957123019 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12f01055d0 msgr2=0x7f12f01a1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:04.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:04.468+0000 7f12f6000700 1 --2- 172.21.15.82:0/957123019 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12f01055d0 0x7f12f01a1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:04.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:04.468+0000 7f12f6000700 1 -- 172.21.15.82:0/957123019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12f0105f90 msgr2=0x7f12f01a1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:04.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:04.468+0000 7f12f6000700 1 --2- 172.21.15.82:0/957123019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12f0105f90 0x7f12f01a1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:04.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:04.468+0000 7f12f6000700 1 -- 172.21.15.82:0/957123019 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12f019c1d0 con 0x7f12f010b660 2024-05-08T05:47:04.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:04.468+0000 7f12f4c00700 1 --2- 172.21.15.82:0/957123019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12f0105f90 0x7f12f01a1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:47:04.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:04.468+0000 7f12f6000700 1 --2- 172.21.15.82:0/957123019 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12f010b660 0x7f12f019ba70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f12e8009790 tx=0x7f12e800ccb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:47:04.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:04.469+0000 7f12ee000700 1 -- 172.21.15.82:0/957123019 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e8021070 con 0x7f12f010b660 2024-05-08T05:47:04.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:04.469+0000 7f12f6a00700 1 -- 172.21.15.82:0/957123019 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12f019c460 con 0x7f12f010b660 2024-05-08T05:47:04.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:04.469+0000 7f12ee000700 1 -- 172.21.15.82:0/957123019 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f12e8007ac0 con 0x7f12f010b660 2024-05-08T05:47:04.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:04.469+0000 7f12ee000700 1 -- 172.21.15.82:0/957123019 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12e8005040 con 0x7f12f010b660 2024-05-08T05:47:04.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:04.469+0000 7f12f6a00700 1 -- 172.21.15.82:0/957123019 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12f01a8730 con 0x7f12f010b660 2024-05-08T05:47:04.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:04.470+0000 7f12f6a00700 1 -- 172.21.15.82:0/957123019 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12f006a190 con 0x7f12f010b660 2024-05-08T05:47:04.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:04.472+0000 7f12ee000700 1 -- 172.21.15.82:0/957123019 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f12e8024070 con 0x7f12f010b660 2024-05-08T05:47:04.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:04.474+0000 7f12ee000700 1 --2- 172.21.15.82:0/957123019 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f12d80b2910 0x7f12d80b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:04.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:04.474+0000 7f12ee000700 1 -- 172.21.15.82:0/957123019 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f12e80e36d0 con 0x7f12f010b660 2024-05-08T05:47:04.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:04.474+0000 7f12f5600700 1 --2- 172.21.15.82:0/957123019 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f12d80b2910 0x7f12d80b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:04.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:04.475+0000 7f12f5600700 1 --2- 172.21.15.82:0/957123019 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f12d80b2910 0x7f12d80b4dd0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f12f010a7e0 tx=0x7f12e4009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:47:04.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:04.476+0000 7f12ee000700 1 -- 172.21.15.82:0/957123019 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f12e80ab2d0 con 0x7f12f010b660 2024-05-08T05:47:04.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:04.772+0000 7f12f6a00700 1 -- 172.21.15.82:0/957123019 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f12f002e510 con 0x7f12f010b660 2024-05-08T05:47:04.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:04.779+0000 7f12ee000700 1 -- 172.21.15.82:0/957123019 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+288645 (secure 0 0 0) 0x7f12e80aabd0 con 0x7f12f010b660 2024-05-08T05:47:04.783 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:47:04.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:04.784+0000 7f12f6a00700 1 -- 172.21.15.82:0/957123019 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f12d80b2910 msgr2=0x7f12d80b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:04.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:04.784+0000 7f12f6a00700 1 --2- 172.21.15.82:0/957123019 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f12d80b2910 0x7f12d80b4dd0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f12f010a7e0 tx=0x7f12e4009310 comp rx=0 tx=0).stop 2024-05-08T05:47:04.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:04.784+0000 7f12f6a00700 1 -- 172.21.15.82:0/957123019 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12f010b660 msgr2=0x7f12f019ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:04.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:04.784+0000 7f12f6a00700 1 --2- 172.21.15.82:0/957123019 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12f010b660 0x7f12f019ba70 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f12e8009790 tx=0x7f12e800ccb0 comp rx=0 tx=0).stop 2024-05-08T05:47:04.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:04.784+0000 7f12f6a00700 1 -- 172.21.15.82:0/957123019 shutdown_connections 2024-05-08T05:47:04.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:04.784+0000 7f12f6a00700 1 --2- 172.21.15.82:0/957123019 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12f01055d0 0x7f12f01a1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:04.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:04.784+0000 7f12f6a00700 1 --2- 172.21.15.82:0/957123019 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f12d80b2910 0x7f12d80b4dd0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:04.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:04.784+0000 7f12f6a00700 1 --2- 172.21.15.82:0/957123019 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12f010b660 0x7f12f019ba70 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:04.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:04.784+0000 7f12f6a00700 1 --2- 172.21.15.82:0/957123019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12f0105f90 0x7f12f01a1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:04.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:04.784+0000 7f12f6a00700 1 -- 172.21.15.82:0/957123019 >> 172.21.15.82:0/957123019 conn(0x7f12f01010c0 msgr2=0x7f12f01027b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:47:04.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:04.784+0000 7f12f6a00700 1 -- 172.21.15.82:0/957123019 shutdown_connections 2024-05-08T05:47:04.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:04.784+0000 7f12f6a00700 1 -- 172.21.15.82:0/957123019 wait complete. 2024-05-08T05:47:05.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:47:04 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/957123019' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-08T05:47:05.131 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:47:04 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/957123019' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-08T05:47:05.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:47:04 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/957123019' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-08T05:47:05.639 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6800","nonce":4089180091},{"type":"v1","addr":"172.21.15.82:6801","nonce":4089180091}]},"active_addr":"172.21.15.82:6801/4089180091","active_change":"2024-05-08T05:37:43.951493+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24112,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24113,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.82:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":197249076}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":1902988802}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":3665227932}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":4179080010}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.82:0","nonce":557466848}]}]} 2024-05-08T05:47:05.646 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-05-08T05:47:05.647 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-05-08T05:47:05.647 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-08T05:47:06.110 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:47:06.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:47:05 smithi151 ceph-mon[34815]: pgmap v352: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-05-08T05:47:06.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:47:05 smithi082 ceph-mon[30098]: pgmap v352: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-05-08T05:47:06.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:47:05 smithi134 ceph-mon[34132]: pgmap v352: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 9 op/s 2024-05-08T05:47:08.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:47:07 smithi151 ceph-mon[34815]: pgmap v353: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 10 op/s 2024-05-08T05:47:08.167 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:47:07 smithi082 ceph-mon[30098]: pgmap v353: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 10 op/s 2024-05-08T05:47:08.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:47:07 smithi134 ceph-mon[34132]: pgmap v353: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 170 B/s wr, 10 op/s 2024-05-08T05:47:08.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:08.333+0000 7f6b62c00700 1 -- 172.21.15.82:0/1276418945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b5c06bad0 msgr2=0x7f6b5c10fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:08.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:08.333+0000 7f6b62c00700 1 --2- 172.21.15.82:0/1276418945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b5c06bad0 0x7f6b5c10fa10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6b48009990 tx=0x7f6b48009ca0 comp rx=0 tx=0).stop 2024-05-08T05:47:08.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:08.333+0000 7f6b62c00700 1 -- 172.21.15.82:0/1276418945 shutdown_connections 2024-05-08T05:47:08.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:08.333+0000 7f6b62c00700 1 --2- 172.21.15.82:0/1276418945 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b5c10ff50 0x7f6b5c112340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:08.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:08.333+0000 7f6b62c00700 1 --2- 172.21.15.82:0/1276418945 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b5c06b1b0 0x7f6b5c06b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:08.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:08.333+0000 7f6b62c00700 1 --2- 172.21.15.82:0/1276418945 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b5c06bad0 0x7f6b5c10fa10 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:08.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:08.333+0000 7f6b62c00700 1 -- 172.21.15.82:0/1276418945 >> 172.21.15.82:0/1276418945 conn(0x7f6b5c079350 msgr2=0x7f6b5c079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:47:08.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:08.333+0000 7f6b62c00700 1 -- 172.21.15.82:0/1276418945 shutdown_connections 2024-05-08T05:47:08.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:08.333+0000 7f6b62c00700 1 -- 172.21.15.82:0/1276418945 wait complete. 2024-05-08T05:47:08.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:08.334+0000 7f6b62c00700 1 Processor -- start 2024-05-08T05:47:08.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:08.334+0000 7f6b62c00700 1 -- start start 2024-05-08T05:47:08.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:08.335+0000 7f6b62c00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b5c06b1b0 0x7f6b5c19be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:08.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:08.335+0000 7f6b62c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b5c06bad0 0x7f6b5c19c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:08.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:08.335+0000 7f6b62c00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b5c10ff50 0x7f6b5c1a0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:08.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:08.335+0000 7f6b62c00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6b5c1158d0 con 0x7f6b5c06bad0 2024-05-08T05:47:08.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:08.335+0000 7f6b62c00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6b5c115750 con 0x7f6b5c10ff50 2024-05-08T05:47:08.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:08.335+0000 7f6b62c00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6b5c115a50 con 0x7f6b5c06b1b0 2024-05-08T05:47:08.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:08.335+0000 7f6b5b400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b5c06bad0 0x7f6b5c19c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:08.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:08.335+0000 7f6b5b400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b5c06bad0 0x7f6b5c19c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47728/0 (socket says 172.21.15.82:47728) 2024-05-08T05:47:08.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:08.335+0000 7f6b5b400700 1 -- 172.21.15.82:0/4135524005 learned_addr learned my addr 172.21.15.82:0/4135524005 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:47:08.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:08.335+0000 7f6b5be00700 1 --2- 172.21.15.82:0/4135524005 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b5c06b1b0 0x7f6b5c19be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:08.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:08.335+0000 7f6b60c00700 1 --2- 172.21.15.82:0/4135524005 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b5c10ff50 0x7f6b5c1a0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:08.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:08.336+0000 7f6b5be00700 1 -- 172.21.15.82:0/4135524005 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b5c10ff50 msgr2=0x7f6b5c1a0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:08.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:08.336+0000 7f6b5be00700 1 --2- 172.21.15.82:0/4135524005 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b5c10ff50 0x7f6b5c1a0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:08.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:08.336+0000 7f6b5be00700 1 -- 172.21.15.82:0/4135524005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b5c06bad0 msgr2=0x7f6b5c19c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:08.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:08.336+0000 7f6b5be00700 1 --2- 172.21.15.82:0/4135524005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b5c06bad0 0x7f6b5c19c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:08.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:08.336+0000 7f6b5be00700 1 -- 172.21.15.82:0/4135524005 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b5c1a0dc0 con 0x7f6b5c06b1b0 2024-05-08T05:47:08.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:08.336+0000 7f6b5b400700 1 --2- 172.21.15.82:0/4135524005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b5c06bad0 0x7f6b5c19c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:47:08.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:08.336+0000 7f6b60c00700 1 --2- 172.21.15.82:0/4135524005 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b5c10ff50 0x7f6b5c1a0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:47:08.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:08.336+0000 7f6b5be00700 1 --2- 172.21.15.82:0/4135524005 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b5c06b1b0 0x7f6b5c19be00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c00efc0 tx=0x7f6b4c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:47:08.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:08.336+0000 7f6b58c00700 1 -- 172.21.15.82:0/4135524005 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c0092e0 con 0x7f6b5c06b1b0 2024-05-08T05:47:08.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:08.336+0000 7f6b58c00700 1 -- 172.21.15.82:0/4135524005 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6b4c004bb0 con 0x7f6b5c06b1b0 2024-05-08T05:47:08.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:08.336+0000 7f6b58c00700 1 -- 172.21.15.82:0/4135524005 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c004040 con 0x7f6b5c06b1b0 2024-05-08T05:47:08.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:08.336+0000 7f6b62c00700 1 -- 172.21.15.82:0/4135524005 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b5c1a1050 con 0x7f6b5c06b1b0 2024-05-08T05:47:08.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:08.336+0000 7f6b62c00700 1 -- 172.21.15.82:0/4135524005 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b5c1a8930 con 0x7f6b5c06b1b0 2024-05-08T05:47:08.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:08.337+0000 7f6b62c00700 1 -- 172.21.15.82:0/4135524005 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b5c06a190 con 0x7f6b5c06b1b0 2024-05-08T05:47:08.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:08.340+0000 7f6b58c00700 1 -- 172.21.15.82:0/4135524005 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f6b4c01b030 con 0x7f6b5c06b1b0 2024-05-08T05:47:08.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:08.341+0000 7f6b58c00700 1 --2- 172.21.15.82:0/4135524005 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f6b400b2990 0x7f6b400b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:08.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:08.341+0000 7f6b58c00700 1 -- 172.21.15.82:0/4135524005 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f6b4c0e28d0 con 0x7f6b5c06b1b0 2024-05-08T05:47:08.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:08.341+0000 7f6b5b400700 1 --2- 172.21.15.82:0/4135524005 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f6b400b2990 0x7f6b400b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:08.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:08.342+0000 7f6b5b400700 1 --2- 172.21.15.82:0/4135524005 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f6b400b2990 0x7f6b400b4e50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c1039b0 tx=0x7f6b4800b280 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:47:08.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:08.343+0000 7f6b58c00700 1 -- 172.21.15.82:0/4135524005 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6b4c022020 con 0x7f6b5c06b1b0 2024-05-08T05:47:08.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:08.577+0000 7f6b62c00700 1 -- 172.21.15.82:0/4135524005 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6b5c02e510 con 0x7f6b5c06b1b0 2024-05-08T05:47:08.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:08.579+0000 7f6b58c00700 1 -- 172.21.15.82:0/4135524005 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22631 (secure 0 0 0) 0x7f6b4c010040 con 0x7f6b5c06b1b0 2024-05-08T05:47:08.579 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:47:08.580 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":82,"fsid":"c739a5c8-0cfc-11ef-bc97-c7b262605968","created":"2024-05-08T05:36:37.441393+0000","modified":"2024-05-08T05:46:45.754375+0000","last_up_change":"2024-05-08T05:44:40.677995+0000","last_in_change":"2024-05-08T05:44:20.654220+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T05:40:28.102836+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T05:45:48.727521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T05:45:53.574048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bc9bd472-b765-4893-84ed-c66b5c1c61b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":4051651615},{"type":"v1","addr":"172.21.15.82:6803","nonce":4051651615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":4051651615},{"type":"v1","addr":"172.21.15.82:6805","nonce":4051651615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4051651615},{"type":"v1","addr":"172.21.15.82:6809","nonce":4051651615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":4051651615},{"type":"v1","addr":"172.21.15.82:6807","nonce":4051651615}]},"public_addr":"172.21.15.82:6803/4051651615","cluster_addr":"172.21.15.82:6805/4051651615","heartbeat_back_addr":"172.21.15.82:6809/4051651615","heartbeat_front_addr":"172.21.15.82:6807/4051651615","state":["exists","up"]},{"osd":1,"uuid":"ad2d3a6b-8bc5-4177-8757-07e8607ca240","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":2763858634},{"type":"v1","addr":"172.21.15.134:6801","nonce":2763858634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":2763858634},{"type":"v1","addr":"172.21.15.134:6803","nonce":2763858634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":2763858634},{"type":"v1","addr":"172.21.15.134:6807","nonce":2763858634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2763858634},{"type":"v1","addr":"172.21.15.134:6805","nonce":2763858634}]},"public_addr":"172.21.15.134:6801/2763858634","cluster_addr":"172.21.15.134:6803/2763858634","heartbeat_back_addr":"172.21.15.134:6807/2763858634","heartbeat_front_addr":"172.21.15.134:6805/2763858634","state":["exists","up"]},{"osd":2,"uuid":"a06dc8fc-7324-4e42-9487-8cfe372401b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":4193933269},{"type":"v1","addr":"172.21.15.151:6801","nonce":4193933269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":4193933269},{"type":"v1","addr":"172.21.15.151:6803","nonce":4193933269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":4193933269},{"type":"v1","addr":"172.21.15.151:6807","nonce":4193933269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":4193933269},{"type":"v1","addr":"172.21.15.151:6805","nonce":4193933269}]},"public_addr":"172.21.15.151:6801/4193933269","cluster_addr":"172.21.15.151:6803/4193933269","heartbeat_back_addr":"172.21.15.151:6807/4193933269","heartbeat_front_addr":"172.21.15.151:6805/4193933269","state":["exists","up"]},{"osd":3,"uuid":"b8c8bdcd-fbd7-4494-976e-7285408e010e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":2775272422},{"type":"v1","addr":"172.21.15.82:6811","nonce":2775272422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":2775272422},{"type":"v1","addr":"172.21.15.82:6813","nonce":2775272422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":2775272422},{"type":"v1","addr":"172.21.15.82:6817","nonce":2775272422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":2775272422},{"type":"v1","addr":"172.21.15.82:6815","nonce":2775272422}]},"public_addr":"172.21.15.82:6811/2775272422","cluster_addr":"172.21.15.82:6813/2775272422","heartbeat_back_addr":"172.21.15.82:6817/2775272422","heartbeat_front_addr":"172.21.15.82:6815/2775272422","state":["exists","up"]},{"osd":4,"uuid":"391a6040-03d1-483c-9058-308b5998e7c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3565208751},{"type":"v1","addr":"172.21.15.134:6809","nonce":3565208751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3565208751},{"type":"v1","addr":"172.21.15.134:6811","nonce":3565208751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3565208751},{"type":"v1","addr":"172.21.15.134:6815","nonce":3565208751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3565208751},{"type":"v1","addr":"172.21.15.134:6813","nonce":3565208751}]},"public_addr":"172.21.15.134:6809/3565208751","cluster_addr":"172.21.15.134:6811/3565208751","heartbeat_back_addr":"172.21.15.134:6815/3565208751","heartbeat_front_addr":"172.21.15.134:6813/3565208751","state":["exists","up"]},{"osd":5,"uuid":"dacce079-4aad-474e-b747-1ed60c3c71cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":1925634069},{"type":"v1","addr":"172.21.15.151:6809","nonce":1925634069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":1925634069},{"type":"v1","addr":"172.21.15.151:6811","nonce":1925634069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1925634069},{"type":"v1","addr":"172.21.15.151:6815","nonce":1925634069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1925634069},{"type":"v1","addr":"172.21.15.151:6813","nonce":1925634069}]},"public_addr":"172.21.15.151:6809/1925634069","cluster_addr":"172.21.15.151:6811/1925634069","heartbeat_back_addr":"172.21.15.151:6815/1925634069","heartbeat_front_addr":"172.21.15.151:6813/1925634069","state":["exists","up"]},{"osd":6,"uuid":"6a445bf4-09c4-4e9b-be6e-68ef3c05b365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":762647976},{"type":"v1","addr":"172.21.15.82:6819","nonce":762647976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":762647976},{"type":"v1","addr":"172.21.15.82:6821","nonce":762647976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":762647976},{"type":"v1","addr":"172.21.15.82:6825","nonce":762647976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":762647976},{"type":"v1","addr":"172.21.15.82:6823","nonce":762647976}]},"public_addr":"172.21.15.82:6819/762647976","cluster_addr":"172.21.15.82:6821/762647976","heartbeat_back_addr":"172.21.15.82:6825/762647976","heartbeat_front_addr":"172.21.15.82:6823/762647976","state":["exists","up"]},{"osd":7,"uuid":"72b0c735-ef30-4823-8ab8-2e5bf7cc3c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3006846927},{"type":"v1","addr":"172.21.15.134:6817","nonce":3006846927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3006846927},{"type":"v1","addr":"172.21.15.134:6819","nonce":3006846927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3006846927},{"type":"v1","addr":"172.21.15.134:6823","nonce":3006846927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3006846927},{"type":"v1","addr":"172.21.15.134:6821","nonce":3006846927}]},"public_addr":"172.21.15.134:6817/3006846927","cluster_addr":"172.21.15.134:6819/3006846927","heartbeat_back_addr":"172.21.15.134:6823/3006846927","heartbeat_front_addr":"172.21.15.134:6821/3006846927","state":["exists","up"]},{"osd":8,"uuid":"93e4da0f-48ea-4ab7-b612-26b545b76de6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":787870717},{"type":"v1","addr":"172.21.15.151:6817","nonce":787870717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":787870717},{"type":"v1","addr":"172.21.15.151:6819","nonce":787870717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":787870717},{"type":"v1","addr":"172.21.15.151:6823","nonce":787870717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":787870717},{"type":"v1","addr":"172.21.15.151:6821","nonce":787870717}]},"public_addr":"172.21.15.151:6817/787870717","cluster_addr":"172.21.15.151:6819/787870717","heartbeat_back_addr":"172.21.15.151:6823/787870717","heartbeat_front_addr":"172.21.15.151:6821/787870717","state":["exists","up"]},{"osd":9,"uuid":"ea0070c1-286a-47d3-90cf-d1fada6e3cda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":533124002},{"type":"v1","addr":"172.21.15.82:6827","nonce":533124002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":533124002},{"type":"v1","addr":"172.21.15.82:6829","nonce":533124002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":533124002},{"type":"v1","addr":"172.21.15.82:6833","nonce":533124002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":533124002},{"type":"v1","addr":"172.21.15.82:6831","nonce":533124002}]},"public_addr":"172.21.15.82:6827/533124002","cluster_addr":"172.21.15.82:6829/533124002","heartbeat_back_addr":"172.21.15.82:6833/533124002","heartbeat_front_addr":"172.21.15.82:6831/533124002","state":["exists","up"]},{"osd":10,"uuid":"26ca0a0b-ab9e-472f-bb29-428e8c31e5bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":99154842},{"type":"v1","addr":"172.21.15.134:6825","nonce":99154842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":99154842},{"type":"v1","addr":"172.21.15.134:6827","nonce":99154842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":99154842},{"type":"v1","addr":"172.21.15.134:6831","nonce":99154842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":99154842},{"type":"v1","addr":"172.21.15.134:6829","nonce":99154842}]},"public_addr":"172.21.15.134:6825/99154842","cluster_addr":"172.21.15.134:6827/99154842","heartbeat_back_addr":"172.21.15.134:6831/99154842","heartbeat_front_addr":"172.21.15.134:6829/99154842","state":["exists","up"]},{"osd":11,"uuid":"9ae5dca4-acfb-4a46-8601-9d642efde794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2242771269},{"type":"v1","addr":"172.21.15.151:6825","nonce":2242771269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2242771269},{"type":"v1","addr":"172.21.15.151:6827","nonce":2242771269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2242771269},{"type":"v1","addr":"172.21.15.151:6831","nonce":2242771269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2242771269},{"type":"v1","addr":"172.21.15.151:6829","nonce":2242771269}]},"public_addr":"172.21.15.151:6825/2242771269","cluster_addr":"172.21.15.151:6827/2242771269","heartbeat_back_addr":"172.21.15.151:6831/2242771269","heartbeat_front_addr":"172.21.15.151:6829/2242771269","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:39:35.575525+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:40:00.672367+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:40:24.558682+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:40:56.791194+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:41:23.031785+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:41:47.926448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:42:21.231894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:42:47.599982+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:43:12.950581+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:43:46.333027+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:44:13.457489+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:44:38.637273+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/2761274596":"2024-05-09T05:37:43.951218+0000","172.21.15.82:0/2195734928":"2024-05-09T05:37:43.951218+0000","172.21.15.82:6801/765895649":"2024-05-09T05:37:43.951218+0000","172.21.15.82:6800/3546670887":"2024-05-09T05:37:11.114057+0000","172.21.15.82:6800/765895649":"2024-05-09T05:37:43.951218+0000","172.21.15.82:0/3986150437":"2024-05-09T05:37:11.114057+0000","172.21.15.82:0/3457457714":"2024-05-09T05:37:11.114057+0000","172.21.15.82:0/2356749286":"2024-05-09T05:37:11.114057+0000","172.21.15.82:6801/3546670887":"2024-05-09T05:37:11.114057+0000","172.21.15.82:0/1694643083":"2024-05-09T05:37:43.951218+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T05:47:08.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:08.582+0000 7f6b62c00700 1 -- 172.21.15.82:0/4135524005 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f6b400b2990 msgr2=0x7f6b400b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:08.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:08.582+0000 7f6b62c00700 1 --2- 172.21.15.82:0/4135524005 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f6b400b2990 0x7f6b400b4e50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c1039b0 tx=0x7f6b4800b280 comp rx=0 tx=0).stop 2024-05-08T05:47:08.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:08.582+0000 7f6b62c00700 1 -- 172.21.15.82:0/4135524005 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b5c06b1b0 msgr2=0x7f6b5c19be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:08.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:08.582+0000 7f6b62c00700 1 --2- 172.21.15.82:0/4135524005 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b5c06b1b0 0x7f6b5c19be00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c00efc0 tx=0x7f6b4c00c3a0 comp rx=0 tx=0).stop 2024-05-08T05:47:08.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:08.583+0000 7f6b62c00700 1 -- 172.21.15.82:0/4135524005 shutdown_connections 2024-05-08T05:47:08.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:08.583+0000 7f6b62c00700 1 --2- 172.21.15.82:0/4135524005 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b5c10ff50 0x7f6b5c1a0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:08.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:08.583+0000 7f6b62c00700 1 --2- 172.21.15.82:0/4135524005 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f6b400b2990 0x7f6b400b4e50 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:08.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:08.583+0000 7f6b62c00700 1 --2- 172.21.15.82:0/4135524005 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b5c06b1b0 0x7f6b5c19be00 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:08.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:08.583+0000 7f6b62c00700 1 --2- 172.21.15.82:0/4135524005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6b5c06bad0 0x7f6b5c19c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:08.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:08.583+0000 7f6b62c00700 1 -- 172.21.15.82:0/4135524005 >> 172.21.15.82:0/4135524005 conn(0x7f6b5c079350 msgr2=0x7f6b5c111440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:47:08.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:08.583+0000 7f6b62c00700 1 -- 172.21.15.82:0/4135524005 shutdown_connections 2024-05-08T05:47:08.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:08.583+0000 7f6b62c00700 1 -- 172.21.15.82:0/4135524005 wait complete. 2024-05-08T05:47:09.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:47:08 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/4135524005' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:47:09.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:47:08 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/4135524005' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:47:09.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:47:08 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/4135524005' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:47:09.501 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-05-08T05:47:09.501 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-08T05:47:09.953 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:47:10.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:47:09 smithi151 ceph-mon[34815]: pgmap v354: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 170 B/s wr, 10 op/s 2024-05-08T05:47:10.140 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:47:09 smithi082 ceph-mon[30098]: pgmap v354: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 170 B/s wr, 10 op/s 2024-05-08T05:47:10.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:47:09 smithi134 ceph-mon[34132]: pgmap v354: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 170 B/s wr, 10 op/s 2024-05-08T05:47:12.087 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:47:11 smithi082 ceph-mon[30098]: pgmap v355: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-08T05:47:12.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:47:11 smithi151 ceph-mon[34815]: pgmap v355: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-08T05:47:12.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:47:11 smithi134 ceph-mon[34132]: pgmap v355: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-08T05:47:12.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:12.251+0000 7fbac7800700 1 -- 172.21.15.82:0/1549261235 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbac0103f00 msgr2=0x7fbac01103b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:12.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:12.251+0000 7fbac7800700 1 --2- 172.21.15.82:0/1549261235 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbac0103f00 0x7fbac01103b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbab800b0d0 tx=0x7fbab800b3e0 comp rx=0 tx=0).stop 2024-05-08T05:47:12.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:12.252+0000 7fbac7800700 1 -- 172.21.15.82:0/1549261235 shutdown_connections 2024-05-08T05:47:12.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:12.252+0000 7fbac7800700 1 --2- 172.21.15.82:0/1549261235 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbac0103f00 0x7fbac01103b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:12.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:12.252+0000 7fbac7800700 1 --2- 172.21.15.82:0/1549261235 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbac01095e0 0x7fbac01099c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:12.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:12.252+0000 7fbac7800700 1 --2- 172.21.15.82:0/1549261235 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbac0103540 0x7fbac01039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:12.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:12.252+0000 7fbac7800700 1 -- 172.21.15.82:0/1549261235 >> 172.21.15.82:0/1549261235 conn(0x7fbac007a650 msgr2=0x7fbac007aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:47:12.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:12.252+0000 7fbac7800700 1 -- 172.21.15.82:0/1549261235 shutdown_connections 2024-05-08T05:47:12.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:12.252+0000 7fbac7800700 1 -- 172.21.15.82:0/1549261235 wait complete. 2024-05-08T05:47:12.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:12.253+0000 7fbac7800700 1 Processor -- start 2024-05-08T05:47:12.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:12.253+0000 7fbac7800700 1 -- start start 2024-05-08T05:47:12.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:12.253+0000 7fbac7800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbac0103540 0x7fbac00757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:12.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:12.253+0000 7fbac7800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbac0103f00 0x7fbac0075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:12.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:12.253+0000 7fbac7800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbac01095e0 0x7fbac0076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:12.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:12.253+0000 7fbac7800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbac0113790 con 0x7fbac0103540 2024-05-08T05:47:12.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:12.254+0000 7fbac7800700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbac0113610 con 0x7fbac0103f00 2024-05-08T05:47:12.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:12.254+0000 7fbac7800700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fbac0113910 con 0x7fbac01095e0 2024-05-08T05:47:12.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:12.254+0000 7fbac4e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbac0103540 0x7fbac00757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:12.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:12.254+0000 7fbac4e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbac0103540 0x7fbac00757a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47748/0 (socket says 172.21.15.82:47748) 2024-05-08T05:47:12.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:12.254+0000 7fbac4e00700 1 -- 172.21.15.82:0/2416433312 learned_addr learned my addr 172.21.15.82:0/2416433312 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:47:12.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:12.254+0000 7fbabfe00700 1 --2- 172.21.15.82:0/2416433312 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbac0103f00 0x7fbac0075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:12.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:12.254+0000 7fbac5800700 1 --2- 172.21.15.82:0/2416433312 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbac01095e0 0x7fbac0076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:12.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:12.254+0000 7fbac4e00700 1 -- 172.21.15.82:0/2416433312 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbac01095e0 msgr2=0x7fbac0076220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:12.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:12.254+0000 7fbac4e00700 1 --2- 172.21.15.82:0/2416433312 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbac01095e0 0x7fbac0076220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:12.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:12.254+0000 7fbac4e00700 1 -- 172.21.15.82:0/2416433312 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbac0103f00 msgr2=0x7fbac0075ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:12.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:12.254+0000 7fbac4e00700 1 --2- 172.21.15.82:0/2416433312 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbac0103f00 0x7fbac0075ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:12.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:12.254+0000 7fbac4e00700 1 -- 172.21.15.82:0/2416433312 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbac01a8130 con 0x7fbac0103540 2024-05-08T05:47:12.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:12.255+0000 7fbac4e00700 1 --2- 172.21.15.82:0/2416433312 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbac0103540 0x7fbac00757a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbab400e9c0 tx=0x7fbab400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:47:12.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:12.255+0000 7fbabd600700 1 -- 172.21.15.82:0/2416433312 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab400cbd0 con 0x7fbac0103540 2024-05-08T05:47:12.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:12.255+0000 7fbabd600700 1 -- 172.21.15.82:0/2416433312 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbab400ee60 con 0x7fbac0103540 2024-05-08T05:47:12.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:12.255+0000 7fbabd600700 1 -- 172.21.15.82:0/2416433312 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab40055c0 con 0x7fbac0103540 2024-05-08T05:47:12.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:12.255+0000 7fbac7800700 1 -- 172.21.15.82:0/2416433312 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbac01a8420 con 0x7fbac0103540 2024-05-08T05:47:12.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:12.255+0000 7fbac7800700 1 -- 172.21.15.82:0/2416433312 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbac01a8960 con 0x7fbac0103540 2024-05-08T05:47:12.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:12.256+0000 7fbac7800700 1 -- 172.21.15.82:0/2416433312 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbac010ba70 con 0x7fbac0103540 2024-05-08T05:47:12.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:12.258+0000 7fbabd600700 1 -- 172.21.15.82:0/2416433312 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fbab4004750 con 0x7fbac0103540 2024-05-08T05:47:12.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:12.260+0000 7fbabd600700 1 --2- 172.21.15.82:0/2416433312 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fbaa80b2990 0x7fbaa80b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:12.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:12.260+0000 7fbabd600700 1 -- 172.21.15.82:0/2416433312 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fbab40e2570 con 0x7fbac0103540 2024-05-08T05:47:12.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:12.260+0000 7fbabfe00700 1 --2- 172.21.15.82:0/2416433312 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fbaa80b2990 0x7fbaa80b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:12.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:12.261+0000 7fbabfe00700 1 --2- 172.21.15.82:0/2416433312 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fbaa80b2990 0x7fbaa80b4e50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbac0108440 tx=0x7fbaac009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:47:12.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:12.264+0000 7fbabd600700 1 -- 172.21.15.82:0/2416433312 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fbab40aa0e0 con 0x7fbac0103540 2024-05-08T05:47:12.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:12.496+0000 7fbac7800700 1 -- 172.21.15.82:0/2416433312 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbac010b450 con 0x7fbac0103540 2024-05-08T05:47:12.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:12.499+0000 7fbabd600700 1 -- 172.21.15.82:0/2416433312 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22631 (secure 0 0 0) 0x7fbab40a99e0 con 0x7fbac0103540 2024-05-08T05:47:12.501 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:47:12.501 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":82,"fsid":"c739a5c8-0cfc-11ef-bc97-c7b262605968","created":"2024-05-08T05:36:37.441393+0000","modified":"2024-05-08T05:46:45.754375+0000","last_up_change":"2024-05-08T05:44:40.677995+0000","last_in_change":"2024-05-08T05:44:20.654220+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T05:40:28.102836+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T05:45:48.727521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T05:45:53.574048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bc9bd472-b765-4893-84ed-c66b5c1c61b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":4051651615},{"type":"v1","addr":"172.21.15.82:6803","nonce":4051651615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":4051651615},{"type":"v1","addr":"172.21.15.82:6805","nonce":4051651615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4051651615},{"type":"v1","addr":"172.21.15.82:6809","nonce":4051651615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":4051651615},{"type":"v1","addr":"172.21.15.82:6807","nonce":4051651615}]},"public_addr":"172.21.15.82:6803/4051651615","cluster_addr":"172.21.15.82:6805/4051651615","heartbeat_back_addr":"172.21.15.82:6809/4051651615","heartbeat_front_addr":"172.21.15.82:6807/4051651615","state":["exists","up"]},{"osd":1,"uuid":"ad2d3a6b-8bc5-4177-8757-07e8607ca240","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":2763858634},{"type":"v1","addr":"172.21.15.134:6801","nonce":2763858634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":2763858634},{"type":"v1","addr":"172.21.15.134:6803","nonce":2763858634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":2763858634},{"type":"v1","addr":"172.21.15.134:6807","nonce":2763858634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2763858634},{"type":"v1","addr":"172.21.15.134:6805","nonce":2763858634}]},"public_addr":"172.21.15.134:6801/2763858634","cluster_addr":"172.21.15.134:6803/2763858634","heartbeat_back_addr":"172.21.15.134:6807/2763858634","heartbeat_front_addr":"172.21.15.134:6805/2763858634","state":["exists","up"]},{"osd":2,"uuid":"a06dc8fc-7324-4e42-9487-8cfe372401b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":4193933269},{"type":"v1","addr":"172.21.15.151:6801","nonce":4193933269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":4193933269},{"type":"v1","addr":"172.21.15.151:6803","nonce":4193933269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":4193933269},{"type":"v1","addr":"172.21.15.151:6807","nonce":4193933269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":4193933269},{"type":"v1","addr":"172.21.15.151:6805","nonce":4193933269}]},"public_addr":"172.21.15.151:6801/4193933269","cluster_addr":"172.21.15.151:6803/4193933269","heartbeat_back_addr":"172.21.15.151:6807/4193933269","heartbeat_front_addr":"172.21.15.151:6805/4193933269","state":["exists","up"]},{"osd":3,"uuid":"b8c8bdcd-fbd7-4494-976e-7285408e010e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":2775272422},{"type":"v1","addr":"172.21.15.82:6811","nonce":2775272422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":2775272422},{"type":"v1","addr":"172.21.15.82:6813","nonce":2775272422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":2775272422},{"type":"v1","addr":"172.21.15.82:6817","nonce":2775272422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":2775272422},{"type":"v1","addr":"172.21.15.82:6815","nonce":2775272422}]},"public_addr":"172.21.15.82:6811/2775272422","cluster_addr":"172.21.15.82:6813/2775272422","heartbeat_back_addr":"172.21.15.82:6817/2775272422","heartbeat_front_addr":"172.21.15.82:6815/2775272422","state":["exists","up"]},{"osd":4,"uuid":"391a6040-03d1-483c-9058-308b5998e7c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3565208751},{"type":"v1","addr":"172.21.15.134:6809","nonce":3565208751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3565208751},{"type":"v1","addr":"172.21.15.134:6811","nonce":3565208751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3565208751},{"type":"v1","addr":"172.21.15.134:6815","nonce":3565208751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3565208751},{"type":"v1","addr":"172.21.15.134:6813","nonce":3565208751}]},"public_addr":"172.21.15.134:6809/3565208751","cluster_addr":"172.21.15.134:6811/3565208751","heartbeat_back_addr":"172.21.15.134:6815/3565208751","heartbeat_front_addr":"172.21.15.134:6813/3565208751","state":["exists","up"]},{"osd":5,"uuid":"dacce079-4aad-474e-b747-1ed60c3c71cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":1925634069},{"type":"v1","addr":"172.21.15.151:6809","nonce":1925634069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":1925634069},{"type":"v1","addr":"172.21.15.151:6811","nonce":1925634069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1925634069},{"type":"v1","addr":"172.21.15.151:6815","nonce":1925634069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1925634069},{"type":"v1","addr":"172.21.15.151:6813","nonce":1925634069}]},"public_addr":"172.21.15.151:6809/1925634069","cluster_addr":"172.21.15.151:6811/1925634069","heartbeat_back_addr":"172.21.15.151:6815/1925634069","heartbeat_front_addr":"172.21.15.151:6813/1925634069","state":["exists","up"]},{"osd":6,"uuid":"6a445bf4-09c4-4e9b-be6e-68ef3c05b365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":762647976},{"type":"v1","addr":"172.21.15.82:6819","nonce":762647976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":762647976},{"type":"v1","addr":"172.21.15.82:6821","nonce":762647976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":762647976},{"type":"v1","addr":"172.21.15.82:6825","nonce":762647976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":762647976},{"type":"v1","addr":"172.21.15.82:6823","nonce":762647976}]},"public_addr":"172.21.15.82:6819/762647976","cluster_addr":"172.21.15.82:6821/762647976","heartbeat_back_addr":"172.21.15.82:6825/762647976","heartbeat_front_addr":"172.21.15.82:6823/762647976","state":["exists","up"]},{"osd":7,"uuid":"72b0c735-ef30-4823-8ab8-2e5bf7cc3c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3006846927},{"type":"v1","addr":"172.21.15.134:6817","nonce":3006846927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3006846927},{"type":"v1","addr":"172.21.15.134:6819","nonce":3006846927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3006846927},{"type":"v1","addr":"172.21.15.134:6823","nonce":3006846927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3006846927},{"type":"v1","addr":"172.21.15.134:6821","nonce":3006846927}]},"public_addr":"172.21.15.134:6817/3006846927","cluster_addr":"172.21.15.134:6819/3006846927","heartbeat_back_addr":"172.21.15.134:6823/3006846927","heartbeat_front_addr":"172.21.15.134:6821/3006846927","state":["exists","up"]},{"osd":8,"uuid":"93e4da0f-48ea-4ab7-b612-26b545b76de6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":787870717},{"type":"v1","addr":"172.21.15.151:6817","nonce":787870717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":787870717},{"type":"v1","addr":"172.21.15.151:6819","nonce":787870717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":787870717},{"type":"v1","addr":"172.21.15.151:6823","nonce":787870717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":787870717},{"type":"v1","addr":"172.21.15.151:6821","nonce":787870717}]},"public_addr":"172.21.15.151:6817/787870717","cluster_addr":"172.21.15.151:6819/787870717","heartbeat_back_addr":"172.21.15.151:6823/787870717","heartbeat_front_addr":"172.21.15.151:6821/787870717","state":["exists","up"]},{"osd":9,"uuid":"ea0070c1-286a-47d3-90cf-d1fada6e3cda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":533124002},{"type":"v1","addr":"172.21.15.82:6827","nonce":533124002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":533124002},{"type":"v1","addr":"172.21.15.82:6829","nonce":533124002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":533124002},{"type":"v1","addr":"172.21.15.82:6833","nonce":533124002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":533124002},{"type":"v1","addr":"172.21.15.82:6831","nonce":533124002}]},"public_addr":"172.21.15.82:6827/533124002","cluster_addr":"172.21.15.82:6829/533124002","heartbeat_back_addr":"172.21.15.82:6833/533124002","heartbeat_front_addr":"172.21.15.82:6831/533124002","state":["exists","up"]},{"osd":10,"uuid":"26ca0a0b-ab9e-472f-bb29-428e8c31e5bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":99154842},{"type":"v1","addr":"172.21.15.134:6825","nonce":99154842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":99154842},{"type":"v1","addr":"172.21.15.134:6827","nonce":99154842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":99154842},{"type":"v1","addr":"172.21.15.134:6831","nonce":99154842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":99154842},{"type":"v1","addr":"172.21.15.134:6829","nonce":99154842}]},"public_addr":"172.21.15.134:6825/99154842","cluster_addr":"172.21.15.134:6827/99154842","heartbeat_back_addr":"172.21.15.134:6831/99154842","heartbeat_front_addr":"172.21.15.134:6829/99154842","state":["exists","up"]},{"osd":11,"uuid":"9ae5dca4-acfb-4a46-8601-9d642efde794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2242771269},{"type":"v1","addr":"172.21.15.151:6825","nonce":2242771269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2242771269},{"type":"v1","addr":"172.21.15.151:6827","nonce":2242771269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2242771269},{"type":"v1","addr":"172.21.15.151:6831","nonce":2242771269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2242771269},{"type":"v1","addr":"172.21.15.151:6829","nonce":2242771269}]},"public_addr":"172.21.15.151:6825/2242771269","cluster_addr":"172.21.15.151:6827/2242771269","heartbeat_back_addr":"172.21.15.151:6831/2242771269","heartbeat_front_addr":"172.21.15.151:6829/2242771269","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:39:35.575525+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:40:00.672367+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:40:24.558682+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:40:56.791194+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:41:23.031785+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:41:47.926448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:42:21.231894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:42:47.599982+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:43:12.950581+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:43:46.333027+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:44:13.457489+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:44:38.637273+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/2761274596":"2024-05-09T05:37:43.951218+0000","172.21.15.82:0/2195734928":"2024-05-09T05:37:43.951218+0000","172.21.15.82:6801/765895649":"2024-05-09T05:37:43.951218+0000","172.21.15.82:6800/3546670887":"2024-05-09T05:37:11.114057+0000","172.21.15.82:6800/765895649":"2024-05-09T05:37:43.951218+0000","172.21.15.82:0/3986150437":"2024-05-09T05:37:11.114057+0000","172.21.15.82:0/3457457714":"2024-05-09T05:37:11.114057+0000","172.21.15.82:0/2356749286":"2024-05-09T05:37:11.114057+0000","172.21.15.82:6801/3546670887":"2024-05-09T05:37:11.114057+0000","172.21.15.82:0/1694643083":"2024-05-09T05:37:43.951218+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T05:47:12.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:12.502+0000 7fbac7800700 1 -- 172.21.15.82:0/2416433312 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fbaa80b2990 msgr2=0x7fbaa80b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:12.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:12.502+0000 7fbac7800700 1 --2- 172.21.15.82:0/2416433312 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fbaa80b2990 0x7fbaa80b4e50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbac0108440 tx=0x7fbaac009260 comp rx=0 tx=0).stop 2024-05-08T05:47:12.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:12.502+0000 7fbac7800700 1 -- 172.21.15.82:0/2416433312 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbac0103540 msgr2=0x7fbac00757a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:12.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:12.502+0000 7fbac7800700 1 --2- 172.21.15.82:0/2416433312 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbac0103540 0x7fbac00757a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fbab400e9c0 tx=0x7fbab400ecd0 comp rx=0 tx=0).stop 2024-05-08T05:47:12.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:12.502+0000 7fbac7800700 1 -- 172.21.15.82:0/2416433312 shutdown_connections 2024-05-08T05:47:12.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:12.502+0000 7fbac7800700 1 --2- 172.21.15.82:0/2416433312 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fbaa80b2990 0x7fbaa80b4e50 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:12.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:12.502+0000 7fbac7800700 1 --2- 172.21.15.82:0/2416433312 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbac01095e0 0x7fbac0076220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:12.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:12.502+0000 7fbac7800700 1 --2- 172.21.15.82:0/2416433312 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbac0103540 0x7fbac00757a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:12.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:12.502+0000 7fbac7800700 1 --2- 172.21.15.82:0/2416433312 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbac0103f00 0x7fbac0075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:12.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:12.502+0000 7fbac7800700 1 -- 172.21.15.82:0/2416433312 >> 172.21.15.82:0/2416433312 conn(0x7fbac007a650 msgr2=0x7fbac01021d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:47:12.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:12.503+0000 7fbac7800700 1 -- 172.21.15.82:0/2416433312 shutdown_connections 2024-05-08T05:47:12.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:12.503+0000 7fbac7800700 1 -- 172.21.15.82:0/2416433312 wait complete. 2024-05-08T05:47:13.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:47:12 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/2416433312' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:47:13.219 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:47:12 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/2416433312' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:47:13.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:47:12 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/2416433312' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:47:13.330 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-05-08T05:47:13.330 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-05-08T05:47:13.331 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-05-08T05:47:13.331 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-05-08T05:47:13.332 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-05-08T05:47:13.332 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-05-08T05:47:13.332 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-05-08T05:47:13.333 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-05-08T05:47:13.333 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-05-08T05:47:13.334 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-05-08T05:47:13.334 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-05-08T05:47:13.334 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-05-08T05:47:13.885 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:47:13 smithi082 ceph-mon[30098]: pgmap v356: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:47:14.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:47:13 smithi151 ceph-mon[34815]: pgmap v356: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:47:14.151 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:47:13 smithi134 ceph-mon[34132]: pgmap v356: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:47:14.599 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:47:14.648 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:47:14.656 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:47:14.664 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:47:14.665 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:47:14.686 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:47:14.690 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:47:14.691 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:47:14.692 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:47:14.698 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:47:15.943 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:47:16.187 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:47:15 smithi082 ceph-mon[30098]: pgmap v357: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-08T05:47:16.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:47:15 smithi134 ceph-mon[34132]: pgmap v357: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-08T05:47:16.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:47:15 smithi151 ceph-mon[34815]: pgmap v357: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-08T05:47:18.044 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:47:17 smithi082 ceph-mon[30098]: pgmap v358: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-08T05:47:18.182 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:47:17 smithi151 ceph-mon[34815]: pgmap v358: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-08T05:47:18.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:47:17 smithi134 ceph-mon[34132]: pgmap v358: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-08T05:47:18.763 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:47:20.127 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:47:19 smithi082 ceph-mon[30098]: pgmap v359: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:47:20.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:47:19 smithi134 ceph-mon[34132]: pgmap v359: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:47:20.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:47:19 smithi151 ceph-mon[34815]: pgmap v359: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:47:22.158 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:47:21 smithi082 ceph-mon[30098]: pgmap v360: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-08T05:47:22.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:47:21 smithi134 ceph-mon[34132]: pgmap v360: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-08T05:47:22.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:47:21 smithi151 ceph-mon[34815]: pgmap v360: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-08T05:47:23.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.331+0000 7f5510a00700 1 -- 172.21.15.82:0/1652625533 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f550c10fc60 msgr2=0x7f550c112070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:23.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.331+0000 7f5510a00700 1 --2- 172.21.15.82:0/1652625533 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f550c10fc60 0x7f550c112070 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f550400b0a0 tx=0x7f550400b3b0 comp rx=0 tx=0).stop 2024-05-08T05:47:23.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.331+0000 7f5510a00700 1 -- 172.21.15.82:0/1652625533 shutdown_connections 2024-05-08T05:47:23.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.331+0000 7f5510a00700 1 --2- 172.21.15.82:0/1652625533 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f550c10fc60 0x7f550c112070 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:23.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.331+0000 7f5510a00700 1 --2- 172.21.15.82:0/1652625533 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f550c075870 0x7f550c075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:23.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.331+0000 7f5510a00700 1 --2- 172.21.15.82:0/1652625533 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f550c076190 0x7f550c10f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:23.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.331+0000 7f5510a00700 1 -- 172.21.15.82:0/1652625533 >> 172.21.15.82:0/1652625533 conn(0x7f550c0feeb0 msgr2=0x7f550c1012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:47:23.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.331+0000 7f5510a00700 1 -- 172.21.15.82:0/1652625533 shutdown_connections 2024-05-08T05:47:23.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.331+0000 7f5510a00700 1 -- 172.21.15.82:0/1652625533 wait complete. 2024-05-08T05:47:23.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.332+0000 7f5510a00700 1 Processor -- start 2024-05-08T05:47:23.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.332+0000 7f5510a00700 1 -- start start 2024-05-08T05:47:23.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.333+0000 7f5510a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f550c075870 0x7f550c1a1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:23.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.333+0000 7f5510a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f550c076190 0x7f550c1a1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:23.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.333+0000 7f5510a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f550c10fc60 0x7f550c19bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:23.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.333+0000 7f5510a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f550c1157e0 con 0x7f550c10fc60 2024-05-08T05:47:23.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.333+0000 7f5510a00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f550c115660 con 0x7f550c076190 2024-05-08T05:47:23.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.333+0000 7f5510a00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f550c115960 con 0x7f550c075870 2024-05-08T05:47:23.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.333+0000 7f5503e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f550c076190 0x7f550c1a1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:23.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.333+0000 7f5503e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f550c076190 0x7f550c1a1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:47956/0 (socket says 172.21.15.82:47956) 2024-05-08T05:47:23.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.333+0000 7f5503e00700 1 -- 172.21.15.82:0/203843428 learned_addr learned my addr 172.21.15.82:0/203843428 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:47:23.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.333+0000 7f550be00700 1 --2- 172.21.15.82:0/203843428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f550c10fc60 0x7f550c19bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:23.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.333+0000 7f550b400700 1 --2- 172.21.15.82:0/203843428 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f550c075870 0x7f550c1a1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:23.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.333+0000 7f5503e00700 1 -- 172.21.15.82:0/203843428 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f550c075870 msgr2=0x7f550c1a1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:23.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.333+0000 7f5503e00700 1 --2- 172.21.15.82:0/203843428 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f550c075870 0x7f550c1a1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:23.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.334+0000 7f5503e00700 1 -- 172.21.15.82:0/203843428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f550c10fc60 msgr2=0x7f550c19bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:23.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.334+0000 7f5503e00700 1 --2- 172.21.15.82:0/203843428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f550c10fc60 0x7f550c19bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:23.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.334+0000 7f5503e00700 1 -- 172.21.15.82:0/203843428 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f550c19c220 con 0x7f550c076190 2024-05-08T05:47:23.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.334+0000 7f550be00700 1 --2- 172.21.15.82:0/203843428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f550c10fc60 0x7f550c19bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:47:23.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.334+0000 7f5503e00700 1 --2- 172.21.15.82:0/203843428 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f550c076190 0x7f550c1a1e40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f54f400e9a0 tx=0x7f54f400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:47:23.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.334+0000 7f5508c00700 1 -- 172.21.15.82:0/203843428 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f400ca10 con 0x7f550c076190 2024-05-08T05:47:23.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.334+0000 7f5508c00700 1 -- 172.21.15.82:0/203843428 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54f400cbb0 con 0x7f550c076190 2024-05-08T05:47:23.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.334+0000 7f5510a00700 1 -- 172.21.15.82:0/203843428 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f550c19c510 con 0x7f550c076190 2024-05-08T05:47:23.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.334+0000 7f5508c00700 1 -- 172.21.15.82:0/203843428 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54f4018680 con 0x7f550c076190 2024-05-08T05:47:23.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.334+0000 7f5510a00700 1 -- 172.21.15.82:0/203843428 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f550c1a87d0 con 0x7f550c076190 2024-05-08T05:47:23.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.335+0000 7f5510a00700 1 -- 172.21.15.82:0/203843428 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f550c063c30 con 0x7f550c076190 2024-05-08T05:47:23.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.338+0000 7f5508c00700 1 -- 172.21.15.82:0/203843428 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f54f4010430 con 0x7f550c076190 2024-05-08T05:47:23.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.339+0000 7f5508c00700 1 --2- 172.21.15.82:0/203843428 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f54f00b2990 0x7f54f00b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:23.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.339+0000 7f5508c00700 1 -- 172.21.15.82:0/203843428 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f54f40e2a90 con 0x7f550c076190 2024-05-08T05:47:23.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.340+0000 7f550b400700 1 --2- 172.21.15.82:0/203843428 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f54f00b2990 0x7f54f00b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:23.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.340+0000 7f5508c00700 1 --2- 172.21.15.82:0/203843428 >> [v2:172.21.15.151:6800/4193933269,v1:172.21.15.151:6801/4193933269] conn(0x7f54f00bc4d0 0x7f54f00be970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:23.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.340+0000 7f5508c00700 1 -- 172.21.15.82:0/203843428 --> [v2:172.21.15.151:6800/4193933269,v1:172.21.15.151:6801/4193933269] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f54f4024e70 con 0x7f54f00bc4d0 2024-05-08T05:47:23.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.340+0000 7f5508c00700 1 -- 172.21.15.82:0/203843428 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f54f40e2e40 con 0x7f550c076190 2024-05-08T05:47:23.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.340+0000 7f550be00700 1 --2- 172.21.15.82:0/203843428 >> [v2:172.21.15.151:6800/4193933269,v1:172.21.15.151:6801/4193933269] conn(0x7f54f00bc4d0 0x7f54f00be970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:23.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.340+0000 7f550b400700 1 --2- 172.21.15.82:0/203843428 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f54f00b2990 0x7f54f00b4e50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f550c19cc00 tx=0x7f54fc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:47:23.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.341+0000 7f550be00700 1 --2- 172.21.15.82:0/203843428 >> [v2:172.21.15.151:6800/4193933269,v1:172.21.15.151:6801/4193933269] conn(0x7f54f00bc4d0 0x7f54f00be970 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:47:23.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.342+0000 7f5508c00700 1 -- 172.21.15.82:0/203843428 <== osd.2 v2:172.21.15.151:6800/4193933269 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f54f4024e70 con 0x7f54f00bc4d0 2024-05-08T05:47:23.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.359+0000 7f5510a00700 1 -- 172.21.15.82:0/203843428 --> [v2:172.21.15.151:6800/4193933269,v1:172.21.15.151:6801/4193933269] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f550c064030 con 0x7f54f00bc4d0 2024-05-08T05:47:23.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.360+0000 7f5508c00700 1 -- 172.21.15.82:0/203843428 <== osd.2 v2:172.21.15.151:6800/4193933269 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f550c064030 con 0x7f54f00bc4d0 2024-05-08T05:47:23.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.361+0000 7f5510a00700 1 -- 172.21.15.82:0/203843428 >> [v2:172.21.15.151:6800/4193933269,v1:172.21.15.151:6801/4193933269] conn(0x7f54f00bc4d0 msgr2=0x7f54f00be970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:23.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.361+0000 7f5510a00700 1 --2- 172.21.15.82:0/203843428 >> [v2:172.21.15.151:6800/4193933269,v1:172.21.15.151:6801/4193933269] conn(0x7f54f00bc4d0 0x7f54f00be970 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:23.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.361+0000 7f5510a00700 1 -- 172.21.15.82:0/203843428 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f54f00b2990 msgr2=0x7f54f00b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:23.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.361+0000 7f5510a00700 1 --2- 172.21.15.82:0/203843428 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f54f00b2990 0x7f54f00b4e50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f550c19cc00 tx=0x7f54fc009260 comp rx=0 tx=0).stop 2024-05-08T05:47:23.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.361+0000 7f5510a00700 1 -- 172.21.15.82:0/203843428 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f550c076190 msgr2=0x7f550c1a1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:23.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.361+0000 7f5510a00700 1 --2- 172.21.15.82:0/203843428 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f550c076190 0x7f550c1a1e40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f54f400e9a0 tx=0x7f54f400ecb0 comp rx=0 tx=0).stop 2024-05-08T05:47:23.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.361+0000 7f550be00700 1 -- 172.21.15.82:0/203843428 reap_dead start 2024-05-08T05:47:23.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.361+0000 7f5510a00700 1 -- 172.21.15.82:0/203843428 shutdown_connections 2024-05-08T05:47:23.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.361+0000 7f5510a00700 1 -- 172.21.15.82:0/203843428 >> 172.21.15.82:0/203843428 conn(0x7f550c0feeb0 msgr2=0x7f550c0ffb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:47:23.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.361+0000 7f5510a00700 1 -- 172.21.15.82:0/203843428 shutdown_connections 2024-05-08T05:47:23.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:22.362+0000 7f5510a00700 1 -- 172.21.15.82:0/203843428 wait complete. 2024-05-08T05:47:24.106 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:47:23 smithi082 ceph-mon[30098]: pgmap v361: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:47:24.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.123+0000 7f5ec5c00700 1 -- 172.21.15.82:0/4013175798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ec0103d90 msgr2=0x7f5ec01102a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:24.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.123+0000 7f5ec5c00700 1 --2- 172.21.15.82:0/4013175798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ec0103d90 0x7f5ec01102a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5eb800b0a0 tx=0x7f5eb800b3b0 comp rx=0 tx=0).stop 2024-05-08T05:47:24.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.123+0000 7f5ec5c00700 1 -- 172.21.15.82:0/4013175798 shutdown_connections 2024-05-08T05:47:24.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.123+0000 7f5ec5c00700 1 --2- 172.21.15.82:0/4013175798 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ec0109460 0x7f5ec0109840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:24.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.123+0000 7f5ec5c00700 1 --2- 172.21.15.82:0/4013175798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ec0103d90 0x7f5ec01102a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:24.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.123+0000 7f5ec5c00700 1 --2- 172.21.15.82:0/4013175798 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ec01033d0 0x7f5ec0103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:24.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.123+0000 7f5ec5c00700 1 -- 172.21.15.82:0/4013175798 >> 172.21.15.82:0/4013175798 conn(0x7f5ec00fef20 msgr2=0x7f5ec0101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:47:24.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.123+0000 7f5ec5c00700 1 -- 172.21.15.82:0/4013175798 shutdown_connections 2024-05-08T05:47:24.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.123+0000 7f5ec5c00700 1 -- 172.21.15.82:0/4013175798 wait complete. 2024-05-08T05:47:24.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.124+0000 7f5ec5c00700 1 Processor -- start 2024-05-08T05:47:24.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.124+0000 7f5ec5c00700 1 -- start start 2024-05-08T05:47:24.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.125+0000 7f5ec5c00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ec01033d0 0x7f5ec01a18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:24.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.125+0000 7f5ec5c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ec0103d90 0x7f5ec01a1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:24.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.125+0000 7f5ec5c00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ec0109460 0x7f5ec019ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:24.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.125+0000 7f5ec5c00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec01135c0 con 0x7f5ec0103d90 2024-05-08T05:47:24.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.125+0000 7f5ec5c00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec0113440 con 0x7f5ec0109460 2024-05-08T05:47:24.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.125+0000 7f5ec5c00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5ec0113740 con 0x7f5ec01033d0 2024-05-08T05:47:24.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.125+0000 7f5ebfe00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ec01033d0 0x7f5ec01a18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:24.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.125+0000 7f5ebf400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ec0103d90 0x7f5ec01a1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:24.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.125+0000 7f5ebfe00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ec01033d0 0x7f5ec01a18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:45626/0 (socket says 172.21.15.82:45626) 2024-05-08T05:47:24.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.125+0000 7f5ebfe00700 1 -- 172.21.15.82:0/1730519039 learned_addr learned my addr 172.21.15.82:0/1730519039 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:47:24.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.125+0000 7f5ec5200700 1 --2- 172.21.15.82:0/1730519039 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ec0109460 0x7f5ec019ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:24.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.125+0000 7f5ebfe00700 1 -- 172.21.15.82:0/1730519039 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ec0109460 msgr2=0x7f5ec019ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:24.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.125+0000 7f5ebfe00700 1 --2- 172.21.15.82:0/1730519039 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5ec0109460 0x7f5ec019ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:24.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.125+0000 7f5ebfe00700 1 -- 172.21.15.82:0/1730519039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ec0103d90 msgr2=0x7f5ec01a1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:24.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.125+0000 7f5ebfe00700 1 --2- 172.21.15.82:0/1730519039 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5ec0103d90 0x7f5ec01a1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:24.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.125+0000 7f5ebfe00700 1 -- 172.21.15.82:0/1730519039 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ec019c1c0 con 0x7f5ec01033d0 2024-05-08T05:47:24.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.126+0000 7f5ebfe00700 1 --2- 172.21.15.82:0/1730519039 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ec01033d0 0x7f5ec01a18a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5eb000eb30 tx=0x7f5eb000ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:47:24.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.126+0000 7f5ebcc00700 1 -- 172.21.15.82:0/1730519039 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb000cbd0 con 0x7f5ec01033d0 2024-05-08T05:47:24.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.126+0000 7f5ec5c00700 1 -- 172.21.15.82:0/1730519039 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ec019c4b0 con 0x7f5ec01033d0 2024-05-08T05:47:24.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.126+0000 7f5ebcc00700 1 -- 172.21.15.82:0/1730519039 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5eb00044d0 con 0x7f5ec01033d0 2024-05-08T05:47:24.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.126+0000 7f5ebcc00700 1 -- 172.21.15.82:0/1730519039 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eb0003e30 con 0x7f5ec01033d0 2024-05-08T05:47:24.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.126+0000 7f5ec5c00700 1 -- 172.21.15.82:0/1730519039 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ec01a8770 con 0x7f5ec01033d0 2024-05-08T05:47:24.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.127+0000 7f5ec5c00700 1 -- 172.21.15.82:0/1730519039 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5ec00ffd60 con 0x7f5ec01033d0 2024-05-08T05:47:24.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.129+0000 7f5ebcc00700 1 -- 172.21.15.82:0/1730519039 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f5eb0004000 con 0x7f5ec01033d0 2024-05-08T05:47:24.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.131+0000 7f5ebcc00700 1 --2- 172.21.15.82:0/1730519039 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f5ea40b2910 0x7f5ea40b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:24.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.131+0000 7f5ebcc00700 1 -- 172.21.15.82:0/1730519039 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f5eb00e2700 con 0x7f5ec01033d0 2024-05-08T05:47:24.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.131+0000 7f5ebf400700 1 --2- 172.21.15.82:0/1730519039 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f5ea40b2910 0x7f5ea40b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:24.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.131+0000 7f5ebcc00700 1 --2- 172.21.15.82:0/1730519039 >> [v2:172.21.15.82:6818/762647976,v1:172.21.15.82:6819/762647976] conn(0x7f5ea40bc450 0x7f5ea40be8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:24.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.131+0000 7f5ebcc00700 1 -- 172.21.15.82:0/1730519039 --> [v2:172.21.15.82:6818/762647976,v1:172.21.15.82:6819/762647976] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5ea40befc0 con 0x7f5ea40bc450 2024-05-08T05:47:24.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.131+0000 7f5ebcc00700 1 -- 172.21.15.82:0/1730519039 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f5eb00e9050 con 0x7f5ec01033d0 2024-05-08T05:47:24.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.132+0000 7f5ec5200700 1 --2- 172.21.15.82:0/1730519039 >> [v2:172.21.15.82:6818/762647976,v1:172.21.15.82:6819/762647976] conn(0x7f5ea40bc450 0x7f5ea40be8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:24.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.132+0000 7f5ebf400700 1 --2- 172.21.15.82:0/1730519039 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f5ea40b2910 0x7f5ea40b4dd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5ec0110750 tx=0x7f5eac009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:47:24.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.132+0000 7f5ec5200700 1 --2- 172.21.15.82:0/1730519039 >> [v2:172.21.15.82:6818/762647976,v1:172.21.15.82:6819/762647976] conn(0x7f5ea40bc450 0x7f5ea40be8f0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:47:24.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.133+0000 7f5ebcc00700 1 -- 172.21.15.82:0/1730519039 <== osd.6 v2:172.21.15.82:6818/762647976 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5ea40befc0 con 0x7f5ea40bc450 2024-05-08T05:47:24.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.152+0000 7f5ec5c00700 1 -- 172.21.15.82:0/1730519039 --> [v2:172.21.15.82:6818/762647976,v1:172.21.15.82:6819/762647976] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5ec0104b10 con 0x7f5ea40bc450 2024-05-08T05:47:24.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.153+0000 7f5ebcc00700 1 -- 172.21.15.82:0/1730519039 <== osd.6 v2:172.21.15.82:6818/762647976 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5ec0104b10 con 0x7f5ea40bc450 2024-05-08T05:47:24.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.153+0000 7f5ec5c00700 1 -- 172.21.15.82:0/1730519039 >> [v2:172.21.15.82:6818/762647976,v1:172.21.15.82:6819/762647976] conn(0x7f5ea40bc450 msgr2=0x7f5ea40be8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:24.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.153+0000 7f5ec5c00700 1 --2- 172.21.15.82:0/1730519039 >> [v2:172.21.15.82:6818/762647976,v1:172.21.15.82:6819/762647976] conn(0x7f5ea40bc450 0x7f5ea40be8f0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:24.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.153+0000 7f5ec5c00700 1 -- 172.21.15.82:0/1730519039 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f5ea40b2910 msgr2=0x7f5ea40b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:24.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.153+0000 7f5ec5c00700 1 --2- 172.21.15.82:0/1730519039 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f5ea40b2910 0x7f5ea40b4dd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5ec0110750 tx=0x7f5eac009260 comp rx=0 tx=0).stop 2024-05-08T05:47:24.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.153+0000 7f5ec5c00700 1 -- 172.21.15.82:0/1730519039 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ec01033d0 msgr2=0x7f5ec01a18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:24.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.154+0000 7f5ec5c00700 1 --2- 172.21.15.82:0/1730519039 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ec01033d0 0x7f5ec01a18a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5eb000eb30 tx=0x7f5eb000ee40 comp rx=0 tx=0).stop 2024-05-08T05:47:24.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.154+0000 7f5ec5200700 1 -- 172.21.15.82:0/1730519039 reap_dead start 2024-05-08T05:47:24.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.154+0000 7f5ec5c00700 1 -- 172.21.15.82:0/1730519039 shutdown_connections 2024-05-08T05:47:24.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.154+0000 7f5ec5c00700 1 -- 172.21.15.82:0/1730519039 >> 172.21.15.82:0/1730519039 conn(0x7f5ec00fef20 msgr2=0x7f5ec00ff300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:47:24.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.154+0000 7f5ec5c00700 1 -- 172.21.15.82:0/1730519039 shutdown_connections 2024-05-08T05:47:24.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:24.154+0000 7f5ec5c00700 1 -- 172.21.15.82:0/1730519039 wait complete. 2024-05-08T05:47:24.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:47:23 smithi134 ceph-mon[34132]: pgmap v361: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:47:24.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:47:23 smithi151 ceph-mon[34815]: pgmap v361: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:47:25.928 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:47:25 smithi082 ceph-mon[30098]: pgmap v362: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-08T05:47:25.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.662+0000 7f8ebb200700 1 -- 172.21.15.82:0/1967146352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ebc103620 msgr2=0x7f8ebc103a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:25.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.662+0000 7f8ebb200700 1 --2- 172.21.15.82:0/1967146352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ebc103620 0x7f8ebc103a00 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8eac0099c0 tx=0x7f8eac009cd0 comp rx=0 tx=0).stop 2024-05-08T05:47:25.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.662+0000 7f8ebb200700 1 -- 172.21.15.82:0/1967146352 shutdown_connections 2024-05-08T05:47:25.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.662+0000 7f8ebb200700 1 --2- 172.21.15.82:0/1967146352 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ebc108700 0x7f8ebc1102d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:25.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.662+0000 7f8ebb200700 1 --2- 172.21.15.82:0/1967146352 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ebc103620 0x7f8ebc103a00 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:25.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.662+0000 7f8ebb200700 1 --2- 172.21.15.82:0/1967146352 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ebc103fd0 0x7f8ebc108020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:25.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.662+0000 7f8ebb200700 1 -- 172.21.15.82:0/1967146352 >> 172.21.15.82:0/1967146352 conn(0x7f8ebc0feeb0 msgr2=0x7f8ebc1012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:47:25.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.663+0000 7f8ebb200700 1 -- 172.21.15.82:0/1967146352 shutdown_connections 2024-05-08T05:47:25.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.663+0000 7f8ebb200700 1 -- 172.21.15.82:0/1967146352 wait complete. 2024-05-08T05:47:25.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.664+0000 7f8ebb200700 1 Processor -- start 2024-05-08T05:47:25.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.664+0000 7f8ebb200700 1 -- start start 2024-05-08T05:47:25.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.664+0000 7f8ebb200700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ebc103620 0x7f8ebc19f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:25.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.664+0000 7f8ebb200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ebc103fd0 0x7f8ebc19fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:25.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.664+0000 7f8ebb200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ebc108700 0x7f8ebc1998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:25.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.664+0000 7f8ebb200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8ebc1135b0 con 0x7f8ebc108700 2024-05-08T05:47:25.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.664+0000 7f8ebb200700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8ebc113430 con 0x7f8ebc103fd0 2024-05-08T05:47:25.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.664+0000 7f8ebb200700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8ebc113730 con 0x7f8ebc103620 2024-05-08T05:47:25.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.665+0000 7f8eba800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ebc108700 0x7f8ebc1998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:25.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.665+0000 7f8eb9e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ebc103620 0x7f8ebc19f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:25.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.665+0000 7f8eb9e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ebc103620 0x7f8ebc19f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:45648/0 (socket says 172.21.15.82:45648) 2024-05-08T05:47:25.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.665+0000 7f8eb9e00700 1 -- 172.21.15.82:0/1757730378 learned_addr learned my addr 172.21.15.82:0/1757730378 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:47:25.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.665+0000 7f8eb9400700 1 --2- 172.21.15.82:0/1757730378 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ebc103fd0 0x7f8ebc19fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:25.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.665+0000 7f8eb9e00700 1 -- 172.21.15.82:0/1757730378 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ebc103fd0 msgr2=0x7f8ebc19fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:25.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.665+0000 7f8eb9e00700 1 --2- 172.21.15.82:0/1757730378 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ebc103fd0 0x7f8ebc19fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:25.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.665+0000 7f8eb9e00700 1 -- 172.21.15.82:0/1757730378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ebc108700 msgr2=0x7f8ebc1998f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:25.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.665+0000 7f8eb9e00700 1 --2- 172.21.15.82:0/1757730378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ebc108700 0x7f8ebc1998f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:25.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.665+0000 7f8eb9e00700 1 -- 172.21.15.82:0/1757730378 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ebc19a050 con 0x7f8ebc103620 2024-05-08T05:47:25.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.665+0000 7f8eba800700 1 --2- 172.21.15.82:0/1757730378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8ebc108700 0x7f8ebc1998f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:47:25.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.665+0000 7f8eb9e00700 1 --2- 172.21.15.82:0/1757730378 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ebc103620 0x7f8ebc19f730 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8eac0098e0 tx=0x7f8eac0057c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:47:25.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.666+0000 7f8eb2a00700 1 -- 172.21.15.82:0/1757730378 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eac027070 con 0x7f8ebc103620 2024-05-08T05:47:25.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.666+0000 7f8eb2a00700 1 -- 172.21.15.82:0/1757730378 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8eac003f20 con 0x7f8ebc103620 2024-05-08T05:47:25.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.666+0000 7f8ebb200700 1 -- 172.21.15.82:0/1757730378 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ebc19a2e0 con 0x7f8ebc103620 2024-05-08T05:47:25.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.666+0000 7f8eb2a00700 1 -- 172.21.15.82:0/1757730378 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eac022ca0 con 0x7f8ebc103620 2024-05-08T05:47:25.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.666+0000 7f8ebb200700 1 -- 172.21.15.82:0/1757730378 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ebc0756d0 con 0x7f8ebc103620 2024-05-08T05:47:25.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.667+0000 7f8ebb200700 1 -- 172.21.15.82:0/1757730378 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8ebc063c30 con 0x7f8ebc103620 2024-05-08T05:47:25.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.669+0000 7f8eb2a00700 1 -- 172.21.15.82:0/1757730378 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f8eac02a070 con 0x7f8ebc103620 2024-05-08T05:47:25.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.671+0000 7f8eb2a00700 1 --2- 172.21.15.82:0/1757730378 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f8ea00b2910 0x7f8ea00b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:25.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.671+0000 7f8eb2a00700 1 -- 172.21.15.82:0/1757730378 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f8eac0e3d50 con 0x7f8ebc103620 2024-05-08T05:47:25.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.671+0000 7f8eb9400700 1 --2- 172.21.15.82:0/1757730378 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f8ea00b2910 0x7f8ea00b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:25.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.671+0000 7f8eb2a00700 1 --2- 172.21.15.82:0/1757730378 >> [v2:172.21.15.82:6826/533124002,v1:172.21.15.82:6827/533124002] conn(0x7f8ea00bc450 0x7f8ea00be8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:25.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.671+0000 7f8eb2a00700 1 -- 172.21.15.82:0/1757730378 --> [v2:172.21.15.82:6826/533124002,v1:172.21.15.82:6827/533124002] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8ea00befc0 con 0x7f8ea00bc450 2024-05-08T05:47:25.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.671+0000 7f8eb2a00700 1 -- 172.21.15.82:0/1757730378 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f8eac0e4100 con 0x7f8ebc103620 2024-05-08T05:47:25.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.671+0000 7f8eba800700 1 --2- 172.21.15.82:0/1757730378 >> [v2:172.21.15.82:6826/533124002,v1:172.21.15.82:6827/533124002] conn(0x7f8ea00bc450 0x7f8ea00be8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:25.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.672+0000 7f8eb9400700 1 --2- 172.21.15.82:0/1757730378 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f8ea00b2910 0x7f8ea00b4dd0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc109c10 tx=0x7f8ea800b3c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:47:25.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.672+0000 7f8eba800700 1 --2- 172.21.15.82:0/1757730378 >> [v2:172.21.15.82:6826/533124002,v1:172.21.15.82:6827/533124002] conn(0x7f8ea00bc450 0x7f8ea00be8f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:47:25.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.673+0000 7f8eb2a00700 1 -- 172.21.15.82:0/1757730378 <== osd.9 v2:172.21.15.82:6826/533124002 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8ea00befc0 con 0x7f8ea00bc450 2024-05-08T05:47:25.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.692+0000 7f8ebb200700 1 -- 172.21.15.82:0/1757730378 --> [v2:172.21.15.82:6826/533124002,v1:172.21.15.82:6827/533124002] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8ebc0640b0 con 0x7f8ea00bc450 2024-05-08T05:47:25.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.693+0000 7f8eb2a00700 1 -- 172.21.15.82:0/1757730378 <== osd.9 v2:172.21.15.82:6826/533124002 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f8ebc0640b0 con 0x7f8ea00bc450 2024-05-08T05:47:25.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.693+0000 7f8ebb200700 1 -- 172.21.15.82:0/1757730378 >> [v2:172.21.15.82:6826/533124002,v1:172.21.15.82:6827/533124002] conn(0x7f8ea00bc450 msgr2=0x7f8ea00be8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:25.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.693+0000 7f8ebb200700 1 --2- 172.21.15.82:0/1757730378 >> [v2:172.21.15.82:6826/533124002,v1:172.21.15.82:6827/533124002] conn(0x7f8ea00bc450 0x7f8ea00be8f0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:25.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.693+0000 7f8ebb200700 1 -- 172.21.15.82:0/1757730378 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f8ea00b2910 msgr2=0x7f8ea00b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:25.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.693+0000 7f8ebb200700 1 --2- 172.21.15.82:0/1757730378 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f8ea00b2910 0x7f8ea00b4dd0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc109c10 tx=0x7f8ea800b3c0 comp rx=0 tx=0).stop 2024-05-08T05:47:25.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.693+0000 7f8ebb200700 1 -- 172.21.15.82:0/1757730378 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ebc103620 msgr2=0x7f8ebc19f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:25.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.693+0000 7f8ebb200700 1 --2- 172.21.15.82:0/1757730378 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ebc103620 0x7f8ebc19f730 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8eac0098e0 tx=0x7f8eac0057c0 comp rx=0 tx=0).stop 2024-05-08T05:47:25.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.694+0000 7f8eba800700 1 -- 172.21.15.82:0/1757730378 reap_dead start 2024-05-08T05:47:25.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.694+0000 7f8ebb200700 1 -- 172.21.15.82:0/1757730378 shutdown_connections 2024-05-08T05:47:25.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.694+0000 7f8ebb200700 1 -- 172.21.15.82:0/1757730378 >> 172.21.15.82:0/1757730378 conn(0x7f8ebc0feeb0 msgr2=0x7f8ebc100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:47:25.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.694+0000 7f8ebb200700 1 -- 172.21.15.82:0/1757730378 shutdown_connections 2024-05-08T05:47:25.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:25.694+0000 7f8ebb200700 1 -- 172.21.15.82:0/1757730378 wait complete. 2024-05-08T05:47:26.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:47:25 smithi134 ceph-mon[34132]: pgmap v362: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-08T05:47:26.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:47:25 smithi151 ceph-mon[34815]: pgmap v362: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-08T05:47:28.159 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:47:27 smithi082 ceph-mon[30098]: pgmap v363: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 10 op/s 2024-05-08T05:47:28.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:47:27 smithi134 ceph-mon[34132]: pgmap v363: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 10 op/s 2024-05-08T05:47:28.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:47:27 smithi151 ceph-mon[34815]: pgmap v363: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 10 op/s 2024-05-08T05:47:29.371 INFO:teuthology.orchestra.run.smithi082.stdout:184683593792 2024-05-08T05:47:29.372 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-05-08T05:47:29.954 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:47:29 smithi082 ceph-mon[30098]: pgmap v364: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2024-05-08T05:47:30.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:47:29 smithi134 ceph-mon[34132]: pgmap v364: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2024-05-08T05:47:30.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:47:29 smithi151 ceph-mon[34815]: pgmap v364: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 10 op/s 2024-05-08T05:47:32.176 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:47:31 smithi082 ceph-mon[30098]: pgmap v365: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-05-08T05:47:32.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:47:31 smithi134 ceph-mon[34132]: pgmap v365: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-05-08T05:47:32.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:47:31 smithi151 ceph-mon[34815]: pgmap v365: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-05-08T05:47:33.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.026+0000 7f850ca00700 1 -- 172.21.15.82:0/3280050687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85080756d0 msgr2=0x7f8508075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:33.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.026+0000 7f850ca00700 1 --2- 172.21.15.82:0/3280050687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85080756d0 0x7f8508075ab0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f84f8009990 tx=0x7f84f8009ca0 comp rx=0 tx=0).stop 2024-05-08T05:47:33.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.026+0000 7f850ca00700 1 -- 172.21.15.82:0/3280050687 shutdown_connections 2024-05-08T05:47:33.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.026+0000 7f850ca00700 1 --2- 172.21.15.82:0/3280050687 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f850810fea0 0x7f8508112290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:33.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.026+0000 7f850ca00700 1 --2- 172.21.15.82:0/3280050687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85080756d0 0x7f8508075ab0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:33.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.026+0000 7f850ca00700 1 --2- 172.21.15.82:0/3280050687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8508075ff0 0x7f850810f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:33.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.026+0000 7f850ca00700 1 -- 172.21.15.82:0/3280050687 >> 172.21.15.82:0/3280050687 conn(0x7f850807a600 msgr2=0x7f850807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:47:33.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.027+0000 7f850ca00700 1 -- 172.21.15.82:0/3280050687 shutdown_connections 2024-05-08T05:47:33.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.027+0000 7f850ca00700 1 -- 172.21.15.82:0/3280050687 wait complete. 2024-05-08T05:47:33.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.028+0000 7f850ca00700 1 Processor -- start 2024-05-08T05:47:33.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.028+0000 7f850ca00700 1 -- start start 2024-05-08T05:47:33.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.028+0000 7f850ca00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85080756d0 0x7f850819bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:33.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.028+0000 7f850ca00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8508075ff0 0x7f850819c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:33.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.028+0000 7f850ca00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f850810fea0 0x7f85081a0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:33.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.028+0000 7f850ca00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8508115880 con 0x7f85080756d0 2024-05-08T05:47:33.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.028+0000 7f850ca00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8508115700 con 0x7f850810fea0 2024-05-08T05:47:33.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.028+0000 7f850ca00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8508115a00 con 0x7f8508075ff0 2024-05-08T05:47:33.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.028+0000 7f8505e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85080756d0 0x7f850819bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:33.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.029+0000 7f8505e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85080756d0 0x7f850819bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51212/0 (socket says 172.21.15.82:51212) 2024-05-08T05:47:33.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.029+0000 7f8505e00700 1 -- 172.21.15.82:0/200508829 learned_addr learned my addr 172.21.15.82:0/200508829 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:47:33.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.029+0000 7f8505400700 1 --2- 172.21.15.82:0/200508829 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8508075ff0 0x7f850819c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:33.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.029+0000 7f8506800700 1 --2- 172.21.15.82:0/200508829 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f850810fea0 0x7f85081a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:33.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.029+0000 7f8505e00700 1 -- 172.21.15.82:0/200508829 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8508075ff0 msgr2=0x7f850819c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:33.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.029+0000 7f8505e00700 1 --2- 172.21.15.82:0/200508829 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8508075ff0 0x7f850819c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:33.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.029+0000 7f8505e00700 1 -- 172.21.15.82:0/200508829 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f850810fea0 msgr2=0x7f85081a0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:33.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.029+0000 7f8505e00700 1 --2- 172.21.15.82:0/200508829 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f850810fea0 0x7f85081a0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:33.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.029+0000 7f8505e00700 1 -- 172.21.15.82:0/200508829 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85081a0d70 con 0x7f85080756d0 2024-05-08T05:47:33.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.029+0000 7f8505e00700 1 --2- 172.21.15.82:0/200508829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85080756d0 0x7f850819bdb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f84f80057f0 tx=0x7f84f800bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:47:33.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.029+0000 7f84fea00700 1 -- 172.21.15.82:0/200508829 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f8026070 con 0x7f85080756d0 2024-05-08T05:47:33.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.030+0000 7f850ca00700 1 -- 172.21.15.82:0/200508829 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85081a1000 con 0x7f85080756d0 2024-05-08T05:47:33.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.030+0000 7f84fea00700 1 -- 172.21.15.82:0/200508829 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f84f8021410 con 0x7f85080756d0 2024-05-08T05:47:33.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.030+0000 7f84fea00700 1 -- 172.21.15.82:0/200508829 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f8017650 con 0x7f85080756d0 2024-05-08T05:47:33.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.030+0000 7f850ca00700 1 -- 172.21.15.82:0/200508829 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85081a88e0 con 0x7f85080756d0 2024-05-08T05:47:33.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.030+0000 7f850ca00700 1 -- 172.21.15.82:0/200508829 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8508063bb0 con 0x7f85080756d0 2024-05-08T05:47:33.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.033+0000 7f84fea00700 1 -- 172.21.15.82:0/200508829 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f84f8029070 con 0x7f85080756d0 2024-05-08T05:47:33.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.034+0000 7f84fea00700 1 --2- 172.21.15.82:0/200508829 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f84ec0b2990 0x7f84ec0b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:33.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.035+0000 7f84fea00700 1 -- 172.21.15.82:0/200508829 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f84f80e3510 con 0x7f85080756d0 2024-05-08T05:47:33.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.035+0000 7f8505400700 1 --2- 172.21.15.82:0/200508829 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f84ec0b2990 0x7f84ec0b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:33.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.035+0000 7f84fea00700 1 --2- 172.21.15.82:0/200508829 >> [v2:172.21.15.82:6802/4051651615,v1:172.21.15.82:6803/4051651615] conn(0x7f84ec0bc4d0 0x7f84ec0be970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:33.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.035+0000 7f84fea00700 1 -- 172.21.15.82:0/200508829 --> [v2:172.21.15.82:6802/4051651615,v1:172.21.15.82:6803/4051651615] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f84f8001d30 con 0x7f84ec0bc4d0 2024-05-08T05:47:33.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.035+0000 7f84fea00700 1 -- 172.21.15.82:0/200508829 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f84f80e38c0 con 0x7f85080756d0 2024-05-08T05:47:33.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.035+0000 7f8506800700 1 --2- 172.21.15.82:0/200508829 >> [v2:172.21.15.82:6802/4051651615,v1:172.21.15.82:6803/4051651615] conn(0x7f84ec0bc4d0 0x7f84ec0be970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:33.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.035+0000 7f8505400700 1 --2- 172.21.15.82:0/200508829 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f84ec0b2990 0x7f84ec0b4e50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8508111c30 tx=0x7f84f4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:47:33.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.036+0000 7f8506800700 1 --2- 172.21.15.82:0/200508829 >> [v2:172.21.15.82:6802/4051651615,v1:172.21.15.82:6803/4051651615] conn(0x7f84ec0bc4d0 0x7f84ec0be970 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:47:33.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.037+0000 7f84fea00700 1 -- 172.21.15.82:0/200508829 <== osd.0 v2:172.21.15.82:6802/4051651615 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f84f8001d30 con 0x7f84ec0bc4d0 2024-05-08T05:47:33.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.055+0000 7f850ca00700 1 -- 172.21.15.82:0/200508829 --> [v2:172.21.15.82:6802/4051651615,v1:172.21.15.82:6803/4051651615] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8508063fb0 con 0x7f84ec0bc4d0 2024-05-08T05:47:33.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.055+0000 7f84fea00700 1 -- 172.21.15.82:0/200508829 <== osd.0 v2:172.21.15.82:6802/4051651615 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8508063fb0 con 0x7f84ec0bc4d0 2024-05-08T05:47:33.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.055+0000 7f850ca00700 1 -- 172.21.15.82:0/200508829 >> [v2:172.21.15.82:6802/4051651615,v1:172.21.15.82:6803/4051651615] conn(0x7f84ec0bc4d0 msgr2=0x7f84ec0be970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:33.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.055+0000 7f850ca00700 1 --2- 172.21.15.82:0/200508829 >> [v2:172.21.15.82:6802/4051651615,v1:172.21.15.82:6803/4051651615] conn(0x7f84ec0bc4d0 0x7f84ec0be970 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:33.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.056+0000 7f850ca00700 1 -- 172.21.15.82:0/200508829 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f84ec0b2990 msgr2=0x7f84ec0b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:33.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.056+0000 7f850ca00700 1 --2- 172.21.15.82:0/200508829 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f84ec0b2990 0x7f84ec0b4e50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8508111c30 tx=0x7f84f4009260 comp rx=0 tx=0).stop 2024-05-08T05:47:33.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.056+0000 7f850ca00700 1 -- 172.21.15.82:0/200508829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85080756d0 msgr2=0x7f850819bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:33.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.056+0000 7f850ca00700 1 --2- 172.21.15.82:0/200508829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f85080756d0 0x7f850819bdb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f84f80057f0 tx=0x7f84f800bfd0 comp rx=0 tx=0).stop 2024-05-08T05:47:33.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.056+0000 7f8506800700 1 -- 172.21.15.82:0/200508829 reap_dead start 2024-05-08T05:47:33.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.056+0000 7f850ca00700 1 -- 172.21.15.82:0/200508829 shutdown_connections 2024-05-08T05:47:33.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.056+0000 7f850ca00700 1 -- 172.21.15.82:0/200508829 >> 172.21.15.82:0/200508829 conn(0x7f850807a600 msgr2=0x7f8508100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:47:33.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.056+0000 7f850ca00700 1 -- 172.21.15.82:0/200508829 shutdown_connections 2024-05-08T05:47:33.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:32.056+0000 7f850ca00700 1 -- 172.21.15.82:0/200508829 wait complete. 2024-05-08T05:47:34.104 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:47:33 smithi082 ceph-mon[30098]: pgmap v366: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-05-08T05:47:34.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:47:33 smithi134 ceph-mon[34132]: pgmap v366: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-05-08T05:47:34.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:47:33 smithi151 ceph-mon[34815]: pgmap v366: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-05-08T05:47:34.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.448+0000 7f3c79200700 1 -- 172.21.15.82:0/655889506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c74104100 msgr2=0x7f3c74108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:34.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.448+0000 7f3c79200700 1 --2- 172.21.15.82:0/655889506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c74104100 0x7f3c74108120 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3c600099c0 tx=0x7f3c60009cd0 comp rx=0 tx=0).stop 2024-05-08T05:47:34.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.448+0000 7f3c79200700 1 -- 172.21.15.82:0/655889506 shutdown_connections 2024-05-08T05:47:34.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.448+0000 7f3c79200700 1 --2- 172.21.15.82:0/655889506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c74108850 0x7f3c741103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:34.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.448+0000 7f3c79200700 1 --2- 172.21.15.82:0/655889506 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c74103750 0x7f3c74103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:34.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.448+0000 7f3c79200700 1 --2- 172.21.15.82:0/655889506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c74104100 0x7f3c74108120 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:34.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.448+0000 7f3c79200700 1 -- 172.21.15.82:0/655889506 >> 172.21.15.82:0/655889506 conn(0x7f3c7407a600 msgr2=0x7f3c7407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:47:34.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.448+0000 7f3c79200700 1 -- 172.21.15.82:0/655889506 shutdown_connections 2024-05-08T05:47:34.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.449+0000 7f3c79200700 1 -- 172.21.15.82:0/655889506 wait complete. 2024-05-08T05:47:34.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.450+0000 7f3c79200700 1 Processor -- start 2024-05-08T05:47:34.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.450+0000 7f3c79200700 1 -- start start 2024-05-08T05:47:34.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.450+0000 7f3c79200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c74103750 0x7f3c741a1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:34.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.450+0000 7f3c79200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c74104100 0x7f3c741a1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:34.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.450+0000 7f3c79200700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c74108850 0x7f3c7419bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:34.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.450+0000 7f3c79200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3c74113610 con 0x7f3c74104100 2024-05-08T05:47:34.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.450+0000 7f3c79200700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3c74113490 con 0x7f3c74103750 2024-05-08T05:47:34.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.450+0000 7f3c79200700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3c74113790 con 0x7f3c74108850 2024-05-08T05:47:34.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.450+0000 7f3c71400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c74104100 0x7f3c741a1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:34.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.451+0000 7f3c71400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c74104100 0x7f3c741a1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59790/0 (socket says 172.21.15.82:59790) 2024-05-08T05:47:34.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.451+0000 7f3c71400700 1 -- 172.21.15.82:0/4234492550 learned_addr learned my addr 172.21.15.82:0/4234492550 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:47:34.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.451+0000 7f3c71e00700 1 --2- 172.21.15.82:0/4234492550 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c74103750 0x7f3c741a1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:34.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.451+0000 7f3c72800700 1 --2- 172.21.15.82:0/4234492550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c74108850 0x7f3c7419bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:34.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.451+0000 7f3c71400700 1 -- 172.21.15.82:0/4234492550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c74108850 msgr2=0x7f3c7419bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:34.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.451+0000 7f3c71400700 1 --2- 172.21.15.82:0/4234492550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c74108850 0x7f3c7419bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:34.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.451+0000 7f3c71400700 1 -- 172.21.15.82:0/4234492550 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c74103750 msgr2=0x7f3c741a1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:34.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.451+0000 7f3c71400700 1 --2- 172.21.15.82:0/4234492550 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c74103750 0x7f3c741a1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:34.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.451+0000 7f3c71400700 1 -- 172.21.15.82:0/4234492550 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c7419c240 con 0x7f3c74104100 2024-05-08T05:47:34.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.451+0000 7f3c71400700 1 --2- 172.21.15.82:0/4234492550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c74104100 0x7f3c741a1e60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3c600098e0 tx=0x7f3c600057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:47:34.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.452+0000 7f3c6aa00700 1 -- 172.21.15.82:0/4234492550 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c60027070 con 0x7f3c74104100 2024-05-08T05:47:34.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.452+0000 7f3c6aa00700 1 -- 172.21.15.82:0/4234492550 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c60003f20 con 0x7f3c74104100 2024-05-08T05:47:34.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.452+0000 7f3c79200700 1 -- 172.21.15.82:0/4234492550 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c7419c4d0 con 0x7f3c74104100 2024-05-08T05:47:34.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.452+0000 7f3c6aa00700 1 -- 172.21.15.82:0/4234492550 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c60022ca0 con 0x7f3c74104100 2024-05-08T05:47:34.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.452+0000 7f3c79200700 1 -- 172.21.15.82:0/4234492550 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c741a87f0 con 0x7f3c74104100 2024-05-08T05:47:34.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.453+0000 7f3c79200700 1 -- 172.21.15.82:0/4234492550 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3c7410fa80 con 0x7f3c74104100 2024-05-08T05:47:34.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.455+0000 7f3c6aa00700 1 -- 172.21.15.82:0/4234492550 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f3c6002a070 con 0x7f3c74104100 2024-05-08T05:47:34.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.457+0000 7f3c6aa00700 1 --2- 172.21.15.82:0/4234492550 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3c580b2990 0x7f3c580b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:34.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.457+0000 7f3c6aa00700 1 -- 172.21.15.82:0/4234492550 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f3c600e3d00 con 0x7f3c74104100 2024-05-08T05:47:34.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.457+0000 7f3c71e00700 1 --2- 172.21.15.82:0/4234492550 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3c580b2990 0x7f3c580b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:34.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.457+0000 7f3c6aa00700 1 --2- 172.21.15.82:0/4234492550 >> [v2:172.21.15.82:6810/2775272422,v1:172.21.15.82:6811/2775272422] conn(0x7f3c580bc4d0 0x7f3c580be970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:34.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.457+0000 7f3c6aa00700 1 -- 172.21.15.82:0/4234492550 --> [v2:172.21.15.82:6810/2775272422,v1:172.21.15.82:6811/2775272422] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3c580bf040 con 0x7f3c580bc4d0 2024-05-08T05:47:34.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.457+0000 7f3c6aa00700 1 -- 172.21.15.82:0/4234492550 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f3c600e40b0 con 0x7f3c74104100 2024-05-08T05:47:34.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.458+0000 7f3c72800700 1 --2- 172.21.15.82:0/4234492550 >> [v2:172.21.15.82:6810/2775272422,v1:172.21.15.82:6811/2775272422] conn(0x7f3c580bc4d0 0x7f3c580be970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:34.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.458+0000 7f3c71e00700 1 --2- 172.21.15.82:0/4234492550 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3c580b2990 0x7f3c580b4e50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3c64005950 tx=0x7f3c6400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:47:34.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.458+0000 7f3c72800700 1 --2- 172.21.15.82:0/4234492550 >> [v2:172.21.15.82:6810/2775272422,v1:172.21.15.82:6811/2775272422] conn(0x7f3c580bc4d0 0x7f3c580be970 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:47:34.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.459+0000 7f3c6aa00700 1 -- 172.21.15.82:0/4234492550 <== osd.3 v2:172.21.15.82:6810/2775272422 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3c580bf040 con 0x7f3c580bc4d0 2024-05-08T05:47:34.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.477+0000 7f3c79200700 1 -- 172.21.15.82:0/4234492550 --> [v2:172.21.15.82:6810/2775272422,v1:172.21.15.82:6811/2775272422] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3c74104be0 con 0x7f3c580bc4d0 2024-05-08T05:47:34.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.478+0000 7f3c6aa00700 1 -- 172.21.15.82:0/4234492550 <== osd.3 v2:172.21.15.82:6810/2775272422 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3c74104be0 con 0x7f3c580bc4d0 2024-05-08T05:47:34.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.478+0000 7f3c79200700 1 -- 172.21.15.82:0/4234492550 >> [v2:172.21.15.82:6810/2775272422,v1:172.21.15.82:6811/2775272422] conn(0x7f3c580bc4d0 msgr2=0x7f3c580be970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:34.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.478+0000 7f3c79200700 1 --2- 172.21.15.82:0/4234492550 >> [v2:172.21.15.82:6810/2775272422,v1:172.21.15.82:6811/2775272422] conn(0x7f3c580bc4d0 0x7f3c580be970 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:34.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.478+0000 7f3c79200700 1 -- 172.21.15.82:0/4234492550 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3c580b2990 msgr2=0x7f3c580b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:34.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.478+0000 7f3c79200700 1 --2- 172.21.15.82:0/4234492550 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3c580b2990 0x7f3c580b4e50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3c64005950 tx=0x7f3c6400b410 comp rx=0 tx=0).stop 2024-05-08T05:47:34.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.478+0000 7f3c79200700 1 -- 172.21.15.82:0/4234492550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c74104100 msgr2=0x7f3c741a1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:34.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.478+0000 7f3c79200700 1 --2- 172.21.15.82:0/4234492550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c74104100 0x7f3c741a1e60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3c600098e0 tx=0x7f3c600057c0 comp rx=0 tx=0).stop 2024-05-08T05:47:34.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.478+0000 7f3c72800700 1 -- 172.21.15.82:0/4234492550 reap_dead start 2024-05-08T05:47:34.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.478+0000 7f3c79200700 1 -- 172.21.15.82:0/4234492550 shutdown_connections 2024-05-08T05:47:34.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.478+0000 7f3c79200700 1 -- 172.21.15.82:0/4234492550 >> 172.21.15.82:0/4234492550 conn(0x7f3c7407a600 msgr2=0x7f3c741018c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:47:34.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.479+0000 7f3c79200700 1 -- 172.21.15.82:0/4234492550 shutdown_connections 2024-05-08T05:47:34.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.479+0000 7f3c79200700 1 -- 172.21.15.82:0/4234492550 wait complete. 2024-05-08T05:47:34.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.738+0000 7fa514e00700 1 -- 172.21.15.82:0/336417760 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa510109460 msgr2=0x7fa510109840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:34.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.738+0000 7fa514e00700 1 --2- 172.21.15.82:0/336417760 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa510109460 0x7fa510109840 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa500009990 tx=0x7fa500009ca0 comp rx=0 tx=0).stop 2024-05-08T05:47:34.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.738+0000 7fa514e00700 1 -- 172.21.15.82:0/336417760 shutdown_connections 2024-05-08T05:47:34.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.738+0000 7fa514e00700 1 --2- 172.21.15.82:0/336417760 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa510103d90 0x7fa5101102a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:34.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.738+0000 7fa514e00700 1 --2- 172.21.15.82:0/336417760 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa510109460 0x7fa510109840 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:34.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.738+0000 7fa514e00700 1 --2- 172.21.15.82:0/336417760 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5101033d0 0x7fa510103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:34.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.738+0000 7fa514e00700 1 -- 172.21.15.82:0/336417760 >> 172.21.15.82:0/336417760 conn(0x7fa5100fef20 msgr2=0x7fa510101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:47:34.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.738+0000 7fa514e00700 1 -- 172.21.15.82:0/336417760 shutdown_connections 2024-05-08T05:47:34.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.738+0000 7fa514e00700 1 -- 172.21.15.82:0/336417760 wait complete. 2024-05-08T05:47:34.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.740+0000 7fa514e00700 1 Processor -- start 2024-05-08T05:47:34.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.740+0000 7fa514e00700 1 -- start start 2024-05-08T05:47:34.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.740+0000 7fa514e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5101033d0 0x7fa5101a1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:34.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.741+0000 7fa514e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa510103d90 0x7fa5101a1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:34.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.741+0000 7fa514e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa510109460 0x7fa51019bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:34.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.741+0000 7fa514e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa5101135c0 con 0x7fa510109460 2024-05-08T05:47:34.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.741+0000 7fa514e00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa510113440 con 0x7fa5101033d0 2024-05-08T05:47:34.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.741+0000 7fa514e00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa510113740 con 0x7fa510103d90 2024-05-08T05:47:34.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.741+0000 7fa50f400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5101033d0 0x7fa5101a1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:34.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.741+0000 7fa50fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa510109460 0x7fa51019bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:34.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.741+0000 7fa50f400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5101033d0 0x7fa5101a1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:38070/0 (socket says 172.21.15.82:38070) 2024-05-08T05:47:34.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.741+0000 7fa50f400700 1 -- 172.21.15.82:0/2536878365 learned_addr learned my addr 172.21.15.82:0/2536878365 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:47:34.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.741+0000 7fa50ea00700 1 --2- 172.21.15.82:0/2536878365 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa510103d90 0x7fa5101a1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:34.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.741+0000 7fa50f400700 1 -- 172.21.15.82:0/2536878365 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa510103d90 msgr2=0x7fa5101a1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:34.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.741+0000 7fa50f400700 1 --2- 172.21.15.82:0/2536878365 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa510103d90 0x7fa5101a1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:34.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.741+0000 7fa50f400700 1 -- 172.21.15.82:0/2536878365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa510109460 msgr2=0x7fa51019bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:34.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.741+0000 7fa50f400700 1 --2- 172.21.15.82:0/2536878365 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa510109460 0x7fa51019bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:34.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.741+0000 7fa50f400700 1 -- 172.21.15.82:0/2536878365 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa51019c240 con 0x7fa5101033d0 2024-05-08T05:47:34.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.742+0000 7fa50f400700 1 --2- 172.21.15.82:0/2536878365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5101033d0 0x7fa5101a1920 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa500000c00 tx=0x7fa5000057c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:47:34.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.742+0000 7fa507e00700 1 -- 172.21.15.82:0/2536878365 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa500027070 con 0x7fa5101033d0 2024-05-08T05:47:34.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.742+0000 7fa507e00700 1 -- 172.21.15.82:0/2536878365 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa500022470 con 0x7fa5101033d0 2024-05-08T05:47:34.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.742+0000 7fa507e00700 1 -- 172.21.15.82:0/2536878365 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa500017650 con 0x7fa5101033d0 2024-05-08T05:47:34.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.742+0000 7fa514e00700 1 -- 172.21.15.82:0/2536878365 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa51019c4d0 con 0x7fa5101033d0 2024-05-08T05:47:34.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.742+0000 7fa514e00700 1 -- 172.21.15.82:0/2536878365 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5101a87f0 con 0x7fa5101033d0 2024-05-08T05:47:34.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.743+0000 7fa514e00700 1 -- 172.21.15.82:0/2536878365 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa510100780 con 0x7fa5101033d0 2024-05-08T05:47:34.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.746+0000 7fa507e00700 1 -- 172.21.15.82:0/2536878365 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fa50002a070 con 0x7fa5101033d0 2024-05-08T05:47:34.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.748+0000 7fa507e00700 1 --2- 172.21.15.82:0/2536878365 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fa4f40b2910 0x7fa4f40b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:34.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.748+0000 7fa507e00700 1 -- 172.21.15.82:0/2536878365 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fa5000e32a0 con 0x7fa5101033d0 2024-05-08T05:47:34.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.748+0000 7fa50ea00700 1 --2- 172.21.15.82:0/2536878365 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fa4f40b2910 0x7fa4f40b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:34.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.749+0000 7fa507e00700 1 --2- 172.21.15.82:0/2536878365 >> [v2:172.21.15.134:6800/2763858634,v1:172.21.15.134:6801/2763858634] conn(0x7fa4f40bc320 0x7fa4f40be7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:34.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.749+0000 7fa507e00700 1 -- 172.21.15.82:0/2536878365 --> [v2:172.21.15.134:6800/2763858634,v1:172.21.15.134:6801/2763858634] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa500023e50 con 0x7fa4f40bc320 2024-05-08T05:47:34.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.749+0000 7fa507e00700 1 -- 172.21.15.82:0/2536878365 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fa5000e3650 con 0x7fa5101033d0 2024-05-08T05:47:34.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.749+0000 7fa50fe00700 1 --2- 172.21.15.82:0/2536878365 >> [v2:172.21.15.134:6800/2763858634,v1:172.21.15.134:6801/2763858634] conn(0x7fa4f40bc320 0x7fa4f40be7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:34.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.749+0000 7fa50ea00700 1 --2- 172.21.15.82:0/2536878365 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fa4f40b2910 0x7fa4f40b4dd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa5101105d0 tx=0x7fa4fc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:47:34.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.750+0000 7fa50fe00700 1 --2- 172.21.15.82:0/2536878365 >> [v2:172.21.15.134:6800/2763858634,v1:172.21.15.134:6801/2763858634] conn(0x7fa4f40bc320 0x7fa4f40be7c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:47:34.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.750+0000 7fa507e00700 1 -- 172.21.15.82:0/2536878365 <== osd.1 v2:172.21.15.134:6800/2763858634 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa500023e50 con 0x7fa4f40bc320 2024-05-08T05:47:34.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.768+0000 7fa514e00700 1 -- 172.21.15.82:0/2536878365 --> [v2:172.21.15.134:6800/2763858634,v1:172.21.15.134:6801/2763858634] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa510104b10 con 0x7fa4f40bc320 2024-05-08T05:47:34.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.769+0000 7fa507e00700 1 -- 172.21.15.82:0/2536878365 <== osd.1 v2:172.21.15.134:6800/2763858634 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa510104b10 con 0x7fa4f40bc320 2024-05-08T05:47:34.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.770+0000 7fa514e00700 1 -- 172.21.15.82:0/2536878365 >> [v2:172.21.15.134:6800/2763858634,v1:172.21.15.134:6801/2763858634] conn(0x7fa4f40bc320 msgr2=0x7fa4f40be7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:34.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.770+0000 7fa514e00700 1 --2- 172.21.15.82:0/2536878365 >> [v2:172.21.15.134:6800/2763858634,v1:172.21.15.134:6801/2763858634] conn(0x7fa4f40bc320 0x7fa4f40be7c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:34.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.770+0000 7fa514e00700 1 -- 172.21.15.82:0/2536878365 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fa4f40b2910 msgr2=0x7fa4f40b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:34.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.770+0000 7fa514e00700 1 --2- 172.21.15.82:0/2536878365 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fa4f40b2910 0x7fa4f40b4dd0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa5101105d0 tx=0x7fa4fc009260 comp rx=0 tx=0).stop 2024-05-08T05:47:34.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.770+0000 7fa514e00700 1 -- 172.21.15.82:0/2536878365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5101033d0 msgr2=0x7fa5101a1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:34.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.770+0000 7fa514e00700 1 --2- 172.21.15.82:0/2536878365 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5101033d0 0x7fa5101a1920 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa500000c00 tx=0x7fa5000057c0 comp rx=0 tx=0).stop 2024-05-08T05:47:34.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.770+0000 7fa50fe00700 1 -- 172.21.15.82:0/2536878365 reap_dead start 2024-05-08T05:47:34.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.770+0000 7fa514e00700 1 -- 172.21.15.82:0/2536878365 shutdown_connections 2024-05-08T05:47:34.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.770+0000 7fa514e00700 1 -- 172.21.15.82:0/2536878365 >> 172.21.15.82:0/2536878365 conn(0x7fa5100fef20 msgr2=0x7fa51010ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:47:34.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.770+0000 7fa514e00700 1 -- 172.21.15.82:0/2536878365 shutdown_connections 2024-05-08T05:47:34.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:34.770+0000 7fa514e00700 1 -- 172.21.15.82:0/2536878365 wait complete. 2024-05-08T05:47:35.614 INFO:teuthology.orchestra.run.smithi082.stdout:77309411415 2024-05-08T05:47:35.614 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-05-08T05:47:35.976 INFO:teuthology.orchestra.run.smithi082.stdout:34359738465 2024-05-08T05:47:35.977 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-05-08T05:47:36.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.195+0000 7fd434a00700 1 -- 172.21.15.82:0/335084288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd43006bb40 msgr2=0x7fd430110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:36.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.195+0000 7fd434a00700 1 --2- 172.21.15.82:0/335084288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd43006bb40 0x7fd430110330 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd428009f90 tx=0x7fd42800b330 comp rx=0 tx=0).stop 2024-05-08T05:47:36.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.195+0000 7fd434a00700 1 -- 172.21.15.82:0/335084288 shutdown_connections 2024-05-08T05:47:36.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.195+0000 7fd434a00700 1 --2- 172.21.15.82:0/335084288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd430109510 0x7fd4301098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:36.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.195+0000 7fd434a00700 1 --2- 172.21.15.82:0/335084288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd43006bb40 0x7fd430110330 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:36.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.195+0000 7fd434a00700 1 --2- 172.21.15.82:0/335084288 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd43006b180 0x7fd43006b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:36.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.195+0000 7fd434a00700 1 -- 172.21.15.82:0/335084288 >> 172.21.15.82:0/335084288 conn(0x7fd430079350 msgr2=0x7fd430079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:47:36.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.195+0000 7fd434a00700 1 -- 172.21.15.82:0/335084288 shutdown_connections 2024-05-08T05:47:36.197 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:47:35 smithi082 ceph-mon[30098]: pgmap v367: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-08T05:47:36.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.195+0000 7fd434a00700 1 -- 172.21.15.82:0/335084288 wait complete. 2024-05-08T05:47:36.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.196+0000 7fd434a00700 1 Processor -- start 2024-05-08T05:47:36.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.196+0000 7fd434a00700 1 -- start start 2024-05-08T05:47:36.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.197+0000 7fd434a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd43006b180 0x7fd430102470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:36.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.197+0000 7fd434a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd43006bb40 0x7fd4301029b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:36.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.197+0000 7fd434a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd430109510 0x7fd430102ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:36.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.197+0000 7fd434a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd430113640 con 0x7fd430109510 2024-05-08T05:47:36.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.197+0000 7fd434a00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd4301134c0 con 0x7fd43006bb40 2024-05-08T05:47:36.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.197+0000 7fd434a00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd4301137c0 con 0x7fd43006b180 2024-05-08T05:47:36.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.197+0000 7fd42e800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd430109510 0x7fd430102ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:36.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.197+0000 7fd42e800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd430109510 0x7fd430102ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59862/0 (socket says 172.21.15.82:59862) 2024-05-08T05:47:36.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.197+0000 7fd42e800700 1 -- 172.21.15.82:0/3427996808 learned_addr learned my addr 172.21.15.82:0/3427996808 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:47:36.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.197+0000 7fd42de00700 1 --2- 172.21.15.82:0/3427996808 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd43006b180 0x7fd430102470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:36.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.197+0000 7fd42d400700 1 --2- 172.21.15.82:0/3427996808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd43006bb40 0x7fd4301029b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:36.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.198+0000 7fd42e800700 1 -- 172.21.15.82:0/3427996808 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd43006b180 msgr2=0x7fd430102470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:36.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.198+0000 7fd42e800700 1 --2- 172.21.15.82:0/3427996808 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd43006b180 0x7fd430102470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:36.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.198+0000 7fd42e800700 1 -- 172.21.15.82:0/3427996808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd43006bb40 msgr2=0x7fd4301029b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:36.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.198+0000 7fd42e800700 1 --2- 172.21.15.82:0/3427996808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd43006bb40 0x7fd4301029b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:36.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.198+0000 7fd42e800700 1 -- 172.21.15.82:0/3427996808 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4301a8040 con 0x7fd430109510 2024-05-08T05:47:36.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.198+0000 7fd42e800700 1 --2- 172.21.15.82:0/3427996808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd430109510 0x7fd430102ef0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd428009790 tx=0x7fd42800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:47:36.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.198+0000 7fd426a00700 1 -- 172.21.15.82:0/3427996808 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd428021070 con 0x7fd430109510 2024-05-08T05:47:36.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.199+0000 7fd434a00700 1 -- 172.21.15.82:0/3427996808 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4301a82d0 con 0x7fd430109510 2024-05-08T05:47:36.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.199+0000 7fd426a00700 1 -- 172.21.15.82:0/3427996808 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd42800ce50 con 0x7fd430109510 2024-05-08T05:47:36.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.199+0000 7fd426a00700 1 -- 172.21.15.82:0/3427996808 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd428005040 con 0x7fd430109510 2024-05-08T05:47:36.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.199+0000 7fd434a00700 1 -- 172.21.15.82:0/3427996808 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4301a87d0 con 0x7fd430109510 2024-05-08T05:47:36.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.200+0000 7fd434a00700 1 -- 172.21.15.82:0/3427996808 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd430063bb0 con 0x7fd430109510 2024-05-08T05:47:36.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.202+0000 7fd426a00700 1 -- 172.21.15.82:0/3427996808 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fd428024070 con 0x7fd430109510 2024-05-08T05:47:36.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.203+0000 7fd426a00700 1 --2- 172.21.15.82:0/3427996808 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd4140b2910 0x7fd4140b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:36.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.204+0000 7fd426a00700 1 -- 172.21.15.82:0/3427996808 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd42800f020 con 0x7fd430109510 2024-05-08T05:47:36.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.204+0000 7fd42de00700 1 --2- 172.21.15.82:0/3427996808 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd4140b2910 0x7fd4140b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:36.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.204+0000 7fd426a00700 1 --2- 172.21.15.82:0/3427996808 >> [v2:172.21.15.134:6824/99154842,v1:172.21.15.134:6825/99154842] conn(0x7fd4140bc450 0x7fd4140be8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:36.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.204+0000 7fd426a00700 1 -- 172.21.15.82:0/3427996808 --> [v2:172.21.15.134:6824/99154842,v1:172.21.15.134:6825/99154842] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd4140befc0 con 0x7fd4140bc450 2024-05-08T05:47:36.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.204+0000 7fd426a00700 1 -- 172.21.15.82:0/3427996808 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fd4280e3cf0 con 0x7fd430109510 2024-05-08T05:47:36.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.205+0000 7fd42d400700 1 --2- 172.21.15.82:0/3427996808 >> [v2:172.21.15.134:6824/99154842,v1:172.21.15.134:6825/99154842] conn(0x7fd4140bc450 0x7fd4140be8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:36.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.205+0000 7fd42de00700 1 --2- 172.21.15.82:0/3427996808 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd4140b2910 0x7fd4140b4dd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd420009750 tx=0x7fd420009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:47:36.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.205+0000 7fd42d400700 1 --2- 172.21.15.82:0/3427996808 >> [v2:172.21.15.134:6824/99154842,v1:172.21.15.134:6825/99154842] conn(0x7fd4140bc450 0x7fd4140be8f0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:47:36.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.206+0000 7fd426a00700 1 -- 172.21.15.82:0/3427996808 <== osd.10 v2:172.21.15.134:6824/99154842 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd4140befc0 con 0x7fd4140bc450 2024-05-08T05:47:36.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.227+0000 7fd434a00700 1 -- 172.21.15.82:0/3427996808 --> [v2:172.21.15.134:6824/99154842,v1:172.21.15.134:6825/99154842] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd430064030 con 0x7fd4140bc450 2024-05-08T05:47:36.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.227+0000 7fd426a00700 1 -- 172.21.15.82:0/3427996808 <== osd.10 v2:172.21.15.134:6824/99154842 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd430064030 con 0x7fd4140bc450 2024-05-08T05:47:36.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.228+0000 7fd434a00700 1 -- 172.21.15.82:0/3427996808 >> [v2:172.21.15.134:6824/99154842,v1:172.21.15.134:6825/99154842] conn(0x7fd4140bc450 msgr2=0x7fd4140be8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:36.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.228+0000 7fd434a00700 1 --2- 172.21.15.82:0/3427996808 >> [v2:172.21.15.134:6824/99154842,v1:172.21.15.134:6825/99154842] conn(0x7fd4140bc450 0x7fd4140be8f0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:36.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.228+0000 7fd434a00700 1 -- 172.21.15.82:0/3427996808 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd4140b2910 msgr2=0x7fd4140b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:36.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.228+0000 7fd434a00700 1 --2- 172.21.15.82:0/3427996808 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd4140b2910 0x7fd4140b4dd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd420009750 tx=0x7fd420009310 comp rx=0 tx=0).stop 2024-05-08T05:47:36.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.228+0000 7fd434a00700 1 -- 172.21.15.82:0/3427996808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd430109510 msgr2=0x7fd430102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:36.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.228+0000 7fd434a00700 1 --2- 172.21.15.82:0/3427996808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd430109510 0x7fd430102ef0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd428009790 tx=0x7fd42800cc30 comp rx=0 tx=0).stop 2024-05-08T05:47:36.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.228+0000 7fd42e800700 1 -- 172.21.15.82:0/3427996808 reap_dead start 2024-05-08T05:47:36.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.228+0000 7fd434a00700 1 -- 172.21.15.82:0/3427996808 shutdown_connections 2024-05-08T05:47:36.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.228+0000 7fd434a00700 1 -- 172.21.15.82:0/3427996808 >> 172.21.15.82:0/3427996808 conn(0x7fd430079350 msgr2=0x7fd430101040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:47:36.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.229+0000 7fd434a00700 1 -- 172.21.15.82:0/3427996808 shutdown_connections 2024-05-08T05:47:36.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:36.229+0000 7fd434a00700 1 -- 172.21.15.82:0/3427996808 wait complete. 2024-05-08T05:47:36.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:47:35 smithi134 ceph-mon[34132]: pgmap v367: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-08T05:47:36.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:47:35 smithi151 ceph-mon[34815]: pgmap v367: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-08T05:47:36.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.635+0000 7fc9cc400700 1 -- 172.21.15.82:0/3332450153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9c4103ef0 msgr2=0x7fc9c41103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:36.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.635+0000 7fc9cc400700 1 --2- 172.21.15.82:0/3332450153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9c4103ef0 0x7fc9c41103d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc00b0a0 tx=0x7fc9bc00b3b0 comp rx=0 tx=0).stop 2024-05-08T05:47:36.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.635+0000 7fc9cc400700 1 -- 172.21.15.82:0/3332450153 shutdown_connections 2024-05-08T05:47:36.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.635+0000 7fc9cc400700 1 --2- 172.21.15.82:0/3332450153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9c4103ef0 0x7fc9c41103d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:36.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.635+0000 7fc9cc400700 1 --2- 172.21.15.82:0/3332450153 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9c4108460 0x7fc9c4108840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:36.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.635+0000 7fc9cc400700 1 --2- 172.21.15.82:0/3332450153 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9c4103550 0x7fc9c41039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:36.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.635+0000 7fc9cc400700 1 -- 172.21.15.82:0/3332450153 >> 172.21.15.82:0/3332450153 conn(0x7fc9c407a600 msgr2=0x7fc9c407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:47:36.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.635+0000 7fc9cc400700 1 -- 172.21.15.82:0/3332450153 shutdown_connections 2024-05-08T05:47:36.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.635+0000 7fc9cc400700 1 -- 172.21.15.82:0/3332450153 wait complete. 2024-05-08T05:47:36.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.636+0000 7fc9cc400700 1 Processor -- start 2024-05-08T05:47:36.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.637+0000 7fc9cc400700 1 -- start start 2024-05-08T05:47:36.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.637+0000 7fc9cc400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9c4103550 0x7fc9c419c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:36.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.637+0000 7fc9cc400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9c4103ef0 0x7fc9c419c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:36.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.637+0000 7fc9cc400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9c4108460 0x7fc9c41a0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:36.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.637+0000 7fc9cc400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c4075e10 con 0x7fc9c4103ef0 2024-05-08T05:47:36.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.637+0000 7fc9cc400700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c4075c90 con 0x7fc9c4108460 2024-05-08T05:47:36.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.637+0000 7fc9cc400700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c4075f90 con 0x7fc9c4103550 2024-05-08T05:47:36.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.637+0000 7fc9c9000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9c4103ef0 0x7fc9c419c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:36.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.637+0000 7fc9c9000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9c4103ef0 0x7fc9c419c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59834/0 (socket says 172.21.15.82:59834) 2024-05-08T05:47:36.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.637+0000 7fc9c9000700 1 -- 172.21.15.82:0/858037 learned_addr learned my addr 172.21.15.82:0/858037 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:47:36.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.637+0000 7fc9ca400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9c4108460 0x7fc9c41a0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:36.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.637+0000 7fc9c9a00700 1 --2- 172.21.15.82:0/858037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9c4103550 0x7fc9c419c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:36.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.638+0000 7fc9ca400700 1 -- 172.21.15.82:0/858037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9c4103550 msgr2=0x7fc9c419c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:36.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.638+0000 7fc9ca400700 1 --2- 172.21.15.82:0/858037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc9c4103550 0x7fc9c419c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:36.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.638+0000 7fc9ca400700 1 -- 172.21.15.82:0/858037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9c4103ef0 msgr2=0x7fc9c419c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:36.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.638+0000 7fc9ca400700 1 --2- 172.21.15.82:0/858037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc9c4103ef0 0x7fc9c419c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:36.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.638+0000 7fc9ca400700 1 -- 172.21.15.82:0/858037 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9c41a0d90 con 0x7fc9c4108460 2024-05-08T05:47:36.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.638+0000 7fc9ca400700 1 --2- 172.21.15.82:0/858037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9c4108460 0x7fc9c41a0650 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc00b070 tx=0x7fc9bc004c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:47:36.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.638+0000 7fc9c2000700 1 -- 172.21.15.82:0/858037 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc021070 con 0x7fc9c4108460 2024-05-08T05:47:36.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.638+0000 7fc9c2000700 1 -- 172.21.15.82:0/858037 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc9bc007e30 con 0x7fc9c4108460 2024-05-08T05:47:36.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.639+0000 7fc9cc400700 1 -- 172.21.15.82:0/858037 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9c41a1020 con 0x7fc9c4108460 2024-05-08T05:47:36.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.639+0000 7fc9c2000700 1 -- 172.21.15.82:0/858037 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc004570 con 0x7fc9c4108460 2024-05-08T05:47:36.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.639+0000 7fc9cc400700 1 -- 172.21.15.82:0/858037 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9c41a8900 con 0x7fc9c4108460 2024-05-08T05:47:36.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.639+0000 7fc9cc400700 1 -- 172.21.15.82:0/858037 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc9c4106ac0 con 0x7fc9c4108460 2024-05-08T05:47:36.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.642+0000 7fc9c2000700 1 -- 172.21.15.82:0/858037 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fc9bc004710 con 0x7fc9c4108460 2024-05-08T05:47:36.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.644+0000 7fc9c2000700 1 --2- 172.21.15.82:0/858037 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc9ac0b2910 0x7fc9ac0b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:36.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.644+0000 7fc9c2000700 1 -- 172.21.15.82:0/858037 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fc9bc00f020 con 0x7fc9c4108460 2024-05-08T05:47:36.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.644+0000 7fc9c9a00700 1 --2- 172.21.15.82:0/858037 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc9ac0b2910 0x7fc9ac0b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:36.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.644+0000 7fc9c2000700 1 --2- 172.21.15.82:0/858037 >> [v2:172.21.15.151:6808/1925634069,v1:172.21.15.151:6809/1925634069] conn(0x7fc9ac0bc450 0x7fc9ac0be8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:36.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.644+0000 7fc9c2000700 1 -- 172.21.15.82:0/858037 --> [v2:172.21.15.151:6808/1925634069,v1:172.21.15.151:6809/1925634069] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc9ac0befc0 con 0x7fc9ac0bc450 2024-05-08T05:47:36.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.644+0000 7fc9c2000700 1 -- 172.21.15.82:0/858037 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fc9bc0e3be0 con 0x7fc9c4108460 2024-05-08T05:47:36.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.645+0000 7fc9c9000700 1 --2- 172.21.15.82:0/858037 >> [v2:172.21.15.151:6808/1925634069,v1:172.21.15.151:6809/1925634069] conn(0x7fc9ac0bc450 0x7fc9ac0be8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:36.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.645+0000 7fc9c9a00700 1 --2- 172.21.15.82:0/858037 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc9ac0b2910 0x7fc9ac0b4dd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4104730 tx=0x7fc9b8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:47:36.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.646+0000 7fc9c9000700 1 --2- 172.21.15.82:0/858037 >> [v2:172.21.15.151:6808/1925634069,v1:172.21.15.151:6809/1925634069] conn(0x7fc9ac0bc450 0x7fc9ac0be8f0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:47:36.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.647+0000 7fc9c2000700 1 -- 172.21.15.82:0/858037 <== osd.5 v2:172.21.15.151:6808/1925634069 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc9ac0befc0 con 0x7fc9ac0bc450 2024-05-08T05:47:36.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.664+0000 7fc9cc400700 1 -- 172.21.15.82:0/858037 --> [v2:172.21.15.151:6808/1925634069,v1:172.21.15.151:6809/1925634069] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc9c4104c10 con 0x7fc9ac0bc450 2024-05-08T05:47:36.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.665+0000 7fc9c2000700 1 -- 172.21.15.82:0/858037 <== osd.5 v2:172.21.15.151:6808/1925634069 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc9c4104c10 con 0x7fc9ac0bc450 2024-05-08T05:47:36.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.665+0000 7fc9cc400700 1 -- 172.21.15.82:0/858037 >> [v2:172.21.15.151:6808/1925634069,v1:172.21.15.151:6809/1925634069] conn(0x7fc9ac0bc450 msgr2=0x7fc9ac0be8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:36.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.665+0000 7fc9cc400700 1 --2- 172.21.15.82:0/858037 >> [v2:172.21.15.151:6808/1925634069,v1:172.21.15.151:6809/1925634069] conn(0x7fc9ac0bc450 0x7fc9ac0be8f0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:36.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.666+0000 7fc9cc400700 1 -- 172.21.15.82:0/858037 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc9ac0b2910 msgr2=0x7fc9ac0b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:36.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.666+0000 7fc9cc400700 1 --2- 172.21.15.82:0/858037 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc9ac0b2910 0x7fc9ac0b4dd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4104730 tx=0x7fc9b8009260 comp rx=0 tx=0).stop 2024-05-08T05:47:36.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.666+0000 7fc9cc400700 1 -- 172.21.15.82:0/858037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9c4108460 msgr2=0x7fc9c41a0650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:36.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.666+0000 7fc9cc400700 1 --2- 172.21.15.82:0/858037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9c4108460 0x7fc9c41a0650 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc00b070 tx=0x7fc9bc004c80 comp rx=0 tx=0).stop 2024-05-08T05:47:36.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.666+0000 7fc9ca400700 1 -- 172.21.15.82:0/858037 reap_dead start 2024-05-08T05:47:36.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.666+0000 7fc9cc400700 1 -- 172.21.15.82:0/858037 shutdown_connections 2024-05-08T05:47:36.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.666+0000 7fc9cc400700 1 -- 172.21.15.82:0/858037 >> 172.21.15.82:0/858037 conn(0x7fc9c407a600 msgr2=0x7fc9c4105090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:47:36.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.666+0000 7fc9cc400700 1 -- 172.21.15.82:0/858037 shutdown_connections 2024-05-08T05:47:36.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:35.666+0000 7fc9cc400700 1 -- 172.21.15.82:0/858037 wait complete. 2024-05-08T05:47:37.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:47:36 smithi082 ceph-mon[30098]: pgmap v368: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-08T05:47:37.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:47:36 smithi134 ceph-mon[34132]: pgmap v368: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-08T05:47:37.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:47:36 smithi151 ceph-mon[34815]: pgmap v368: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-08T05:47:37.961 INFO:teuthology.orchestra.run.smithi082.stdout:158913790023 2024-05-08T05:47:37.962 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-05-08T05:47:38.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.537+0000 7efd57e00700 1 -- 172.21.15.82:0/219388800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd58108700 msgr2=0x7efd581102d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:38.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.537+0000 7efd57e00700 1 --2- 172.21.15.82:0/219388800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd58108700 0x7efd581102d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7efd5000b0d0 tx=0x7efd5000b3e0 comp rx=0 tx=0).stop 2024-05-08T05:47:38.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.537+0000 7efd57e00700 1 -- 172.21.15.82:0/219388800 shutdown_connections 2024-05-08T05:47:38.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.537+0000 7efd57e00700 1 --2- 172.21.15.82:0/219388800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd58108700 0x7efd581102d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:38.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.537+0000 7efd57e00700 1 --2- 172.21.15.82:0/219388800 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd58103620 0x7efd58103a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:38.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.537+0000 7efd57e00700 1 --2- 172.21.15.82:0/219388800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd58103fd0 0x7efd58108020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:38.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.537+0000 7efd57e00700 1 -- 172.21.15.82:0/219388800 >> 172.21.15.82:0/219388800 conn(0x7efd580feeb0 msgr2=0x7efd581012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:47:38.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.537+0000 7efd57e00700 1 -- 172.21.15.82:0/219388800 shutdown_connections 2024-05-08T05:47:38.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.537+0000 7efd57e00700 1 -- 172.21.15.82:0/219388800 wait complete. 2024-05-08T05:47:38.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.539+0000 7efd57e00700 1 Processor -- start 2024-05-08T05:47:38.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.539+0000 7efd57e00700 1 -- start start 2024-05-08T05:47:38.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.539+0000 7efd57e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd58103620 0x7efd580757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:38.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.539+0000 7efd57e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd58103fd0 0x7efd58075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:38.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.539+0000 7efd57e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd58108700 0x7efd58076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:38.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.539+0000 7efd57e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efd581135c0 con 0x7efd58103fd0 2024-05-08T05:47:38.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.539+0000 7efd57e00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7efd58113440 con 0x7efd58103620 2024-05-08T05:47:38.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.539+0000 7efd57e00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7efd58113740 con 0x7efd58108700 2024-05-08T05:47:38.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.540+0000 7efd56000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd58103fd0 0x7efd58075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:38.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.540+0000 7efd56a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd58103620 0x7efd580757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:38.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.540+0000 7efd56000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd58103fd0 0x7efd58075ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59880/0 (socket says 172.21.15.82:59880) 2024-05-08T05:47:38.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.540+0000 7efd56000700 1 -- 172.21.15.82:0/1218693837 learned_addr learned my addr 172.21.15.82:0/1218693837 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:47:38.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.540+0000 7efd57400700 1 --2- 172.21.15.82:0/1218693837 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd58108700 0x7efd58076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:38.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.540+0000 7efd56a00700 1 -- 172.21.15.82:0/1218693837 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd58108700 msgr2=0x7efd58076220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:38.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.540+0000 7efd56a00700 1 --2- 172.21.15.82:0/1218693837 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd58108700 0x7efd58076220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:38.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.540+0000 7efd56a00700 1 -- 172.21.15.82:0/1218693837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd58103fd0 msgr2=0x7efd58075ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:38.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.540+0000 7efd56a00700 1 --2- 172.21.15.82:0/1218693837 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd58103fd0 0x7efd58075ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:38.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.540+0000 7efd56a00700 1 -- 172.21.15.82:0/1218693837 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd581a7f70 con 0x7efd58103620 2024-05-08T05:47:38.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.540+0000 7efd56a00700 1 --2- 172.21.15.82:0/1218693837 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd58103620 0x7efd580757a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7efd4800e9f0 tx=0x7efd4800ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:47:38.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.541+0000 7efd4f400700 1 -- 172.21.15.82:0/1218693837 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd48004220 con 0x7efd58103620 2024-05-08T05:47:38.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.541+0000 7efd4f400700 1 -- 172.21.15.82:0/1218693837 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd480043c0 con 0x7efd58103620 2024-05-08T05:47:38.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.541+0000 7efd57e00700 1 -- 172.21.15.82:0/1218693837 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd581a8260 con 0x7efd58103620 2024-05-08T05:47:38.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.541+0000 7efd4f400700 1 -- 172.21.15.82:0/1218693837 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd48005020 con 0x7efd58103620 2024-05-08T05:47:38.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.541+0000 7efd57e00700 1 -- 172.21.15.82:0/1218693837 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd581a87a0 con 0x7efd58103620 2024-05-08T05:47:38.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.542+0000 7efd57e00700 1 -- 172.21.15.82:0/1218693837 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efd58063bb0 con 0x7efd58103620 2024-05-08T05:47:38.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.545+0000 7efd4f400700 1 -- 172.21.15.82:0/1218693837 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7efd48004750 con 0x7efd58103620 2024-05-08T05:47:38.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.547+0000 7efd4f400700 1 --2- 172.21.15.82:0/1218693837 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7efd3c0b2990 0x7efd3c0b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:38.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.547+0000 7efd4f400700 1 -- 172.21.15.82:0/1218693837 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7efd480e2580 con 0x7efd58103620 2024-05-08T05:47:38.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.547+0000 7efd56000700 1 --2- 172.21.15.82:0/1218693837 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7efd3c0b2990 0x7efd3c0b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:38.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.547+0000 7efd4f400700 1 --2- 172.21.15.82:0/1218693837 >> [v2:172.21.15.134:6808/3565208751,v1:172.21.15.134:6809/3565208751] conn(0x7efd3c0bc4d0 0x7efd3c0be970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:38.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.548+0000 7efd4f400700 1 -- 172.21.15.82:0/1218693837 --> [v2:172.21.15.134:6808/3565208751,v1:172.21.15.134:6809/3565208751] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efd48023ea0 con 0x7efd3c0bc4d0 2024-05-08T05:47:38.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.548+0000 7efd4f400700 1 -- 172.21.15.82:0/1218693837 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7efd480e2930 con 0x7efd58103620 2024-05-08T05:47:38.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.548+0000 7efd57400700 1 --2- 172.21.15.82:0/1218693837 >> [v2:172.21.15.134:6808/3565208751,v1:172.21.15.134:6809/3565208751] conn(0x7efd3c0bc4d0 0x7efd3c0be970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:38.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.548+0000 7efd56000700 1 --2- 172.21.15.82:0/1218693837 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7efd3c0b2990 0x7efd3c0b4e50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7efd58109c50 tx=0x7efd44009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:47:38.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.548+0000 7efd57400700 1 --2- 172.21.15.82:0/1218693837 >> [v2:172.21.15.134:6808/3565208751,v1:172.21.15.134:6809/3565208751] conn(0x7efd3c0bc4d0 0x7efd3c0be970 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:47:38.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.550+0000 7efd4f400700 1 -- 172.21.15.82:0/1218693837 <== osd.4 v2:172.21.15.134:6808/3565208751 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efd48023ea0 con 0x7efd3c0bc4d0 2024-05-08T05:47:38.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.568+0000 7efd57e00700 1 -- 172.21.15.82:0/1218693837 --> [v2:172.21.15.134:6808/3565208751,v1:172.21.15.134:6809/3565208751] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7efd58063fb0 con 0x7efd3c0bc4d0 2024-05-08T05:47:38.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.568+0000 7efd4f400700 1 -- 172.21.15.82:0/1218693837 <== osd.4 v2:172.21.15.134:6808/3565208751 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7efd58063fb0 con 0x7efd3c0bc4d0 2024-05-08T05:47:38.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.569+0000 7efd57e00700 1 -- 172.21.15.82:0/1218693837 >> [v2:172.21.15.134:6808/3565208751,v1:172.21.15.134:6809/3565208751] conn(0x7efd3c0bc4d0 msgr2=0x7efd3c0be970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:38.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.569+0000 7efd57e00700 1 --2- 172.21.15.82:0/1218693837 >> [v2:172.21.15.134:6808/3565208751,v1:172.21.15.134:6809/3565208751] conn(0x7efd3c0bc4d0 0x7efd3c0be970 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:38.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.569+0000 7efd57e00700 1 -- 172.21.15.82:0/1218693837 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7efd3c0b2990 msgr2=0x7efd3c0b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:38.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.569+0000 7efd57e00700 1 --2- 172.21.15.82:0/1218693837 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7efd3c0b2990 0x7efd3c0b4e50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7efd58109c50 tx=0x7efd44009260 comp rx=0 tx=0).stop 2024-05-08T05:47:38.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.569+0000 7efd57e00700 1 -- 172.21.15.82:0/1218693837 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd58103620 msgr2=0x7efd580757a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:38.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.569+0000 7efd57e00700 1 --2- 172.21.15.82:0/1218693837 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd58103620 0x7efd580757a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7efd4800e9f0 tx=0x7efd4800ed00 comp rx=0 tx=0).stop 2024-05-08T05:47:38.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.569+0000 7efd57400700 1 -- 172.21.15.82:0/1218693837 reap_dead start 2024-05-08T05:47:38.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.569+0000 7efd57e00700 1 -- 172.21.15.82:0/1218693837 shutdown_connections 2024-05-08T05:47:38.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.569+0000 7efd57e00700 1 -- 172.21.15.82:0/1218693837 >> 172.21.15.82:0/1218693837 conn(0x7efd580feeb0 msgr2=0x7efd58101180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:47:38.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.569+0000 7efd57e00700 1 -- 172.21.15.82:0/1218693837 shutdown_connections 2024-05-08T05:47:38.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:37.569+0000 7efd57e00700 1 -- 172.21.15.82:0/1218693837 wait complete. 2024-05-08T05:47:39.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.063+0000 7f785be00700 1 -- 172.21.15.82:0/229184825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f785c1055d0 msgr2=0x7f785c105a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:39.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.063+0000 7f785be00700 1 --2- 172.21.15.82:0/229184825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f785c1055d0 0x7f785c105a50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f7848009990 tx=0x7f7848009ca0 comp rx=0 tx=0).stop 2024-05-08T05:47:39.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.063+0000 7f785be00700 1 -- 172.21.15.82:0/229184825 shutdown_connections 2024-05-08T05:47:39.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.063+0000 7f785be00700 1 --2- 172.21.15.82:0/229184825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f785c105f90 0x7f785c1124a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:39.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.063+0000 7f785be00700 1 --2- 172.21.15.82:0/229184825 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f785c10b660 0x7f785c10ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:39.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.063+0000 7f785be00700 1 --2- 172.21.15.82:0/229184825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f785c1055d0 0x7f785c105a50 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:39.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.063+0000 7f785be00700 1 -- 172.21.15.82:0/229184825 >> 172.21.15.82:0/229184825 conn(0x7f785c101080 msgr2=0x7f785c1034a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:47:39.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.063+0000 7f785be00700 1 -- 172.21.15.82:0/229184825 shutdown_connections 2024-05-08T05:47:39.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.063+0000 7f785be00700 1 -- 172.21.15.82:0/229184825 wait complete. 2024-05-08T05:47:39.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.064+0000 7f785be00700 1 Processor -- start 2024-05-08T05:47:39.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.064+0000 7f785be00700 1 -- start start 2024-05-08T05:47:39.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.065+0000 7f785be00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f785c1055d0 0x7f785c1a1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:39.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.065+0000 7f785be00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f785c105f90 0x7f785c1a1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:39.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.065+0000 7f785be00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f785c10b660 0x7f785c19ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:39.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.065+0000 7f785be00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f785c115820 con 0x7f785c10b660 2024-05-08T05:47:39.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.065+0000 7f785be00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f785c1156a0 con 0x7f785c105f90 2024-05-08T05:47:39.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.065+0000 7f785be00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f785c1159a0 con 0x7f785c1055d0 2024-05-08T05:47:39.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.065+0000 7f785b400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f785c10b660 0x7f785c19ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:39.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.065+0000 7f785a000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f785c105f90 0x7f785c1a1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:39.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.065+0000 7f785b400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f785c10b660 0x7f785c19ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59886/0 (socket says 172.21.15.82:59886) 2024-05-08T05:47:39.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.065+0000 7f785b400700 1 -- 172.21.15.82:0/3824092822 learned_addr learned my addr 172.21.15.82:0/3824092822 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:47:39.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.065+0000 7f785aa00700 1 --2- 172.21.15.82:0/3824092822 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f785c1055d0 0x7f785c1a1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:39.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.066+0000 7f785b400700 1 -- 172.21.15.82:0/3824092822 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f785c1055d0 msgr2=0x7f785c1a1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:39.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.066+0000 7f785b400700 1 --2- 172.21.15.82:0/3824092822 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f785c1055d0 0x7f785c1a1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:39.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.066+0000 7f785b400700 1 -- 172.21.15.82:0/3824092822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f785c105f90 msgr2=0x7f785c1a1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:39.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.066+0000 7f785b400700 1 --2- 172.21.15.82:0/3824092822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f785c105f90 0x7f785c1a1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:39.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.066+0000 7f785b400700 1 -- 172.21.15.82:0/3824092822 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f785c19c1a0 con 0x7f785c10b660 2024-05-08T05:47:39.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.066+0000 7f785b400700 1 --2- 172.21.15.82:0/3824092822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f785c10b660 0x7f785c19ba40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f785400ef30 tx=0x7f785400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:47:39.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.066+0000 7f7860a00700 1 -- 172.21.15.82:0/3824092822 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78540092e0 con 0x7f785c10b660 2024-05-08T05:47:39.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.066+0000 7f785be00700 1 -- 172.21.15.82:0/3824092822 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f785c19c430 con 0x7f785c10b660 2024-05-08T05:47:39.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.066+0000 7f7860a00700 1 -- 172.21.15.82:0/3824092822 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7854004bb0 con 0x7f785c10b660 2024-05-08T05:47:39.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.066+0000 7f7860a00700 1 -- 172.21.15.82:0/3824092822 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7854004020 con 0x7f785c10b660 2024-05-08T05:47:39.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.066+0000 7f785be00700 1 -- 172.21.15.82:0/3824092822 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f785c1a8750 con 0x7f785c10b660 2024-05-08T05:47:39.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.067+0000 7f785be00700 1 -- 172.21.15.82:0/3824092822 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f785c063c30 con 0x7f785c10b660 2024-05-08T05:47:39.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.070+0000 7f7860a00700 1 -- 172.21.15.82:0/3824092822 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f785401b030 con 0x7f785c10b660 2024-05-08T05:47:39.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.071+0000 7f7860a00700 1 --2- 172.21.15.82:0/3824092822 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f78400b2990 0x7f78400b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:39.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.072+0000 7f7860a00700 1 -- 172.21.15.82:0/3824092822 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f78540e2800 con 0x7f785c10b660 2024-05-08T05:47:39.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.072+0000 7f785aa00700 1 --2- 172.21.15.82:0/3824092822 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f78400b2990 0x7f78400b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:39.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.072+0000 7f7860a00700 1 --2- 172.21.15.82:0/3824092822 >> [v2:172.21.15.151:6824/2242771269,v1:172.21.15.151:6825/2242771269] conn(0x7f78400bc4d0 0x7f78400be970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:39.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.072+0000 7f7860a00700 1 -- 172.21.15.82:0/3824092822 --> [v2:172.21.15.151:6824/2242771269,v1:172.21.15.151:6825/2242771269] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f785400be50 con 0x7f78400bc4d0 2024-05-08T05:47:39.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.072+0000 7f7860a00700 1 -- 172.21.15.82:0/3824092822 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f78540e2bb0 con 0x7f785c10b660 2024-05-08T05:47:39.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.072+0000 7f785a000700 1 --2- 172.21.15.82:0/3824092822 >> [v2:172.21.15.151:6824/2242771269,v1:172.21.15.151:6825/2242771269] conn(0x7f78400bc4d0 0x7f78400be970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:39.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.072+0000 7f785aa00700 1 --2- 172.21.15.82:0/3824092822 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f78400b2990 0x7f78400b4e50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f785c19cb80 tx=0x7f784c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:47:39.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.073+0000 7f785a000700 1 --2- 172.21.15.82:0/3824092822 >> [v2:172.21.15.151:6824/2242771269,v1:172.21.15.151:6825/2242771269] conn(0x7f78400bc4d0 0x7f78400be970 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:47:39.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.074+0000 7f7860a00700 1 -- 172.21.15.82:0/3824092822 <== osd.11 v2:172.21.15.151:6824/2242771269 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f785400be50 con 0x7f78400bc4d0 2024-05-08T05:47:39.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.092+0000 7f785be00700 1 -- 172.21.15.82:0/3824092822 --> [v2:172.21.15.151:6824/2242771269,v1:172.21.15.151:6825/2242771269] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f785c0640b0 con 0x7f78400bc4d0 2024-05-08T05:47:39.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.093+0000 7f7860a00700 1 -- 172.21.15.82:0/3824092822 <== osd.11 v2:172.21.15.151:6824/2242771269 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f785c0640b0 con 0x7f78400bc4d0 2024-05-08T05:47:39.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.093+0000 7f785be00700 1 -- 172.21.15.82:0/3824092822 >> [v2:172.21.15.151:6824/2242771269,v1:172.21.15.151:6825/2242771269] conn(0x7f78400bc4d0 msgr2=0x7f78400be970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:39.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.093+0000 7f785be00700 1 --2- 172.21.15.82:0/3824092822 >> [v2:172.21.15.151:6824/2242771269,v1:172.21.15.151:6825/2242771269] conn(0x7f78400bc4d0 0x7f78400be970 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:39.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.094+0000 7f785be00700 1 -- 172.21.15.82:0/3824092822 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f78400b2990 msgr2=0x7f78400b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:39.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.094+0000 7f785be00700 1 --2- 172.21.15.82:0/3824092822 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f78400b2990 0x7f78400b4e50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f785c19cb80 tx=0x7f784c009260 comp rx=0 tx=0).stop 2024-05-08T05:47:39.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.094+0000 7f785be00700 1 -- 172.21.15.82:0/3824092822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f785c10b660 msgr2=0x7f785c19ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:39.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.094+0000 7f785be00700 1 --2- 172.21.15.82:0/3824092822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f785c10b660 0x7f785c19ba40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f785400ef30 tx=0x7f785400c3a0 comp rx=0 tx=0).stop 2024-05-08T05:47:39.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.094+0000 7f785b400700 1 -- 172.21.15.82:0/3824092822 reap_dead start 2024-05-08T05:47:39.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.094+0000 7f785be00700 1 -- 172.21.15.82:0/3824092822 shutdown_connections 2024-05-08T05:47:39.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.094+0000 7f785be00700 1 -- 172.21.15.82:0/3824092822 >> 172.21.15.82:0/3824092822 conn(0x7f785c101080 msgr2=0x7f785c102780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:47:39.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.094+0000 7f785be00700 1 -- 172.21.15.82:0/3824092822 shutdown_connections 2024-05-08T05:47:39.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:39.094+0000 7f785be00700 1 -- 172.21.15.82:0/3824092822 wait complete. 2024-05-08T05:47:39.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:47:39 smithi082 ceph-mon[30098]: pgmap v369: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-05-08T05:47:39.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:47:39 smithi134 ceph-mon[34132]: pgmap v369: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-05-08T05:47:39.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:47:39 smithi151 ceph-mon[34815]: pgmap v369: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s 2024-05-08T05:47:39.853 INFO:teuthology.orchestra.run.smithi082.stdout:257698037806 2024-05-08T05:47:39.853 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-05-08T05:47:40.128 INFO:teuthology.orchestra.run.smithi082.stdout:55834574941 2024-05-08T05:47:40.128 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-05-08T05:47:40.349 INFO:teuthology.orchestra.run.smithi082.stdout:309237645349 2024-05-08T05:47:40.349 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-05-08T05:47:41.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.073+0000 7fec32000700 1 -- 172.21.15.82:0/3998857250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec2c106080 msgr2=0x7fec2c112590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:41.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.073+0000 7fec32000700 1 --2- 172.21.15.82:0/3998857250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec2c106080 0x7fec2c112590 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fec2400b0a0 tx=0x7fec2400b3b0 comp rx=0 tx=0).stop 2024-05-08T05:47:41.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.073+0000 7fec32000700 1 -- 172.21.15.82:0/3998857250 shutdown_connections 2024-05-08T05:47:41.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.073+0000 7fec32000700 1 --2- 172.21.15.82:0/3998857250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec2c106080 0x7fec2c112590 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:41.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.073+0000 7fec32000700 1 --2- 172.21.15.82:0/3998857250 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec2c10b6c0 0x7fec2c10baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:41.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.073+0000 7fec32000700 1 --2- 172.21.15.82:0/3998857250 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec2c1056c0 0x7fec2c105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:41.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.073+0000 7fec32000700 1 -- 172.21.15.82:0/3998857250 >> 172.21.15.82:0/3998857250 conn(0x7fec2c1011b0 msgr2=0x7fec2c1035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:47:41.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.074+0000 7fec32000700 1 -- 172.21.15.82:0/3998857250 shutdown_connections 2024-05-08T05:47:41.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.074+0000 7fec32000700 1 -- 172.21.15.82:0/3998857250 wait complete. 2024-05-08T05:47:41.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.075+0000 7fec32000700 1 Processor -- start 2024-05-08T05:47:41.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.075+0000 7fec32000700 1 -- start start 2024-05-08T05:47:41.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.076+0000 7fec32000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec2c1056c0 0x7fec2c19bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:41.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.076+0000 7fec32000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec2c106080 0x7fec2c19c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:41.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.076+0000 7fec32000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec2c10b6c0 0x7fec2c1a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:41.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.076+0000 7fec32000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fec2c115900 con 0x7fec2c106080 2024-05-08T05:47:41.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.076+0000 7fec32000700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fec2c115780 con 0x7fec2c1056c0 2024-05-08T05:47:41.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.076+0000 7fec32000700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fec2c115a80 con 0x7fec2c10b6c0 2024-05-08T05:47:41.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.076+0000 7fec2aa00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec2c106080 0x7fec2c19c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:41.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.076+0000 7fec2aa00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec2c106080 0x7fec2c19c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59894/0 (socket says 172.21.15.82:59894) 2024-05-08T05:47:41.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.076+0000 7fec2aa00700 1 -- 172.21.15.82:0/3192311733 learned_addr learned my addr 172.21.15.82:0/3192311733 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:47:41.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.076+0000 7fec2b400700 1 --2- 172.21.15.82:0/3192311733 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec2c1056c0 0x7fec2c19bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:41.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.076+0000 7fec2be00700 1 --2- 172.21.15.82:0/3192311733 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec2c10b6c0 0x7fec2c1a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:41.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.077+0000 7fec2b400700 1 -- 172.21.15.82:0/3192311733 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec2c10b6c0 msgr2=0x7fec2c1a05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:41.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.077+0000 7fec2b400700 1 --2- 172.21.15.82:0/3192311733 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec2c10b6c0 0x7fec2c1a05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:41.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.077+0000 7fec2b400700 1 -- 172.21.15.82:0/3192311733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec2c106080 msgr2=0x7fec2c19c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:41.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.077+0000 7fec2b400700 1 --2- 172.21.15.82:0/3192311733 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fec2c106080 0x7fec2c19c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:41.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.077+0000 7fec2b400700 1 -- 172.21.15.82:0/3192311733 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec2c1a0d20 con 0x7fec2c1056c0 2024-05-08T05:47:41.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.077+0000 7fec2be00700 1 --2- 172.21.15.82:0/3192311733 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec2c10b6c0 0x7fec2c1a05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:47:41.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.077+0000 7fec2b400700 1 --2- 172.21.15.82:0/3192311733 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec2c1056c0 0x7fec2c19bd10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fec1c00d750 tx=0x7fec1c00da60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:47:41.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.077+0000 7fec23e00700 1 -- 172.21.15.82:0/3192311733 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec1c014030 con 0x7fec2c1056c0 2024-05-08T05:47:41.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.077+0000 7fec23e00700 1 -- 172.21.15.82:0/3192311733 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fec1c0044d0 con 0x7fec2c1056c0 2024-05-08T05:47:41.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.077+0000 7fec32000700 1 -- 172.21.15.82:0/3192311733 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec2c1a1010 con 0x7fec2c1056c0 2024-05-08T05:47:41.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.077+0000 7fec23e00700 1 -- 172.21.15.82:0/3192311733 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec1c005440 con 0x7fec2c1056c0 2024-05-08T05:47:41.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.077+0000 7fec32000700 1 -- 172.21.15.82:0/3192311733 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec2c1a8890 con 0x7fec2c1056c0 2024-05-08T05:47:41.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.078+0000 7fec32000700 1 -- 172.21.15.82:0/3192311733 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fec2c063c30 con 0x7fec2c1056c0 2024-05-08T05:47:41.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.081+0000 7fec23e00700 1 -- 172.21.15.82:0/3192311733 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fec1c0055e0 con 0x7fec2c1056c0 2024-05-08T05:47:41.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.082+0000 7fec23e00700 1 --2- 172.21.15.82:0/3192311733 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fec100b2990 0x7fec100b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:41.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.082+0000 7fec23e00700 1 -- 172.21.15.82:0/3192311733 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fec1c0e1f30 con 0x7fec2c1056c0 2024-05-08T05:47:41.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.082+0000 7fec2aa00700 1 --2- 172.21.15.82:0/3192311733 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fec100b2990 0x7fec100b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:41.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.083+0000 7fec23e00700 1 --2- 172.21.15.82:0/3192311733 >> [v2:172.21.15.151:6816/787870717,v1:172.21.15.151:6817/787870717] conn(0x7fec100bc4d0 0x7fec100be970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:41.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.083+0000 7fec23e00700 1 -- 172.21.15.82:0/3192311733 --> [v2:172.21.15.151:6816/787870717,v1:172.21.15.151:6817/787870717] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fec100bf040 con 0x7fec100bc4d0 2024-05-08T05:47:41.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.083+0000 7fec23e00700 1 -- 172.21.15.82:0/3192311733 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fec1c0e22e0 con 0x7fec2c1056c0 2024-05-08T05:47:41.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.083+0000 7fec2be00700 1 --2- 172.21.15.82:0/3192311733 >> [v2:172.21.15.151:6816/787870717,v1:172.21.15.151:6817/787870717] conn(0x7fec100bc4d0 0x7fec100be970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:41.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.083+0000 7fec2aa00700 1 --2- 172.21.15.82:0/3192311733 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fec100b2990 0x7fec100b4e50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fec2c10ac80 tx=0x7fec18009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:47:41.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.084+0000 7fec2be00700 1 --2- 172.21.15.82:0/3192311733 >> [v2:172.21.15.151:6816/787870717,v1:172.21.15.151:6817/787870717] conn(0x7fec100bc4d0 0x7fec100be970 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:47:41.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.085+0000 7fec23e00700 1 -- 172.21.15.82:0/3192311733 <== osd.8 v2:172.21.15.151:6816/787870717 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fec100bf040 con 0x7fec100bc4d0 2024-05-08T05:47:41.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.102+0000 7fec32000700 1 -- 172.21.15.82:0/3192311733 --> [v2:172.21.15.151:6816/787870717,v1:172.21.15.151:6817/787870717] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fec2c064060 con 0x7fec100bc4d0 2024-05-08T05:47:41.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.103+0000 7fec23e00700 1 -- 172.21.15.82:0/3192311733 <== osd.8 v2:172.21.15.151:6816/787870717 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fec2c064060 con 0x7fec100bc4d0 2024-05-08T05:47:41.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.104+0000 7fec32000700 1 -- 172.21.15.82:0/3192311733 >> [v2:172.21.15.151:6816/787870717,v1:172.21.15.151:6817/787870717] conn(0x7fec100bc4d0 msgr2=0x7fec100be970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:41.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.104+0000 7fec32000700 1 --2- 172.21.15.82:0/3192311733 >> [v2:172.21.15.151:6816/787870717,v1:172.21.15.151:6817/787870717] conn(0x7fec100bc4d0 0x7fec100be970 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:41.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.104+0000 7fec32000700 1 -- 172.21.15.82:0/3192311733 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fec100b2990 msgr2=0x7fec100b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:41.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.104+0000 7fec32000700 1 --2- 172.21.15.82:0/3192311733 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fec100b2990 0x7fec100b4e50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fec2c10ac80 tx=0x7fec18009260 comp rx=0 tx=0).stop 2024-05-08T05:47:41.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.104+0000 7fec32000700 1 -- 172.21.15.82:0/3192311733 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec2c1056c0 msgr2=0x7fec2c19bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:41.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.104+0000 7fec32000700 1 --2- 172.21.15.82:0/3192311733 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec2c1056c0 0x7fec2c19bd10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fec1c00d750 tx=0x7fec1c00da60 comp rx=0 tx=0).stop 2024-05-08T05:47:41.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.104+0000 7fec2be00700 1 -- 172.21.15.82:0/3192311733 reap_dead start 2024-05-08T05:47:41.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.104+0000 7fec32000700 1 -- 172.21.15.82:0/3192311733 shutdown_connections 2024-05-08T05:47:41.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.104+0000 7fec32000700 1 -- 172.21.15.82:0/3192311733 >> 172.21.15.82:0/3192311733 conn(0x7fec2c1011b0 msgr2=0x7fec2c1016d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:47:41.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.104+0000 7fec32000700 1 -- 172.21.15.82:0/3192311733 shutdown_connections 2024-05-08T05:47:41.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:41.104+0000 7fec32000700 1 -- 172.21.15.82:0/3192311733 wait complete. 2024-05-08T05:47:41.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:47:41 smithi082 ceph-mon[30098]: pgmap v370: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-05-08T05:47:41.499 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:47:41 smithi134 ceph-mon[34132]: pgmap v370: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-05-08T05:47:41.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:47:41 smithi151 ceph-mon[34815]: pgmap v370: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-05-08T05:47:41.945 INFO:teuthology.orchestra.run.smithi082.stdout:137438953548 2024-05-08T05:47:41.945 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-05-08T05:47:41.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.178+0000 7f2f25200700 1 -- 172.21.15.82:0/2218740366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f20075ff0 msgr2=0x7f2f2010f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:41.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.178+0000 7f2f25200700 1 --2- 172.21.15.82:0/2218740366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f20075ff0 0x7f2f2010f9c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2f0c009990 tx=0x7f2f0c009ca0 comp rx=0 tx=0).stop 2024-05-08T05:47:41.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.178+0000 7f2f25200700 1 -- 172.21.15.82:0/2218740366 shutdown_connections 2024-05-08T05:47:41.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.178+0000 7f2f25200700 1 --2- 172.21.15.82:0/2218740366 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f200756d0 0x7f2f20075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:41.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.178+0000 7f2f25200700 1 --2- 172.21.15.82:0/2218740366 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f2010ff00 0x7f2f201122f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:41.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.178+0000 7f2f25200700 1 --2- 172.21.15.82:0/2218740366 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f20075ff0 0x7f2f2010f9c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:41.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.178+0000 7f2f25200700 1 -- 172.21.15.82:0/2218740366 >> 172.21.15.82:0/2218740366 conn(0x7f2f2007a600 msgr2=0x7f2f2007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:47:41.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.178+0000 7f2f25200700 1 -- 172.21.15.82:0/2218740366 shutdown_connections 2024-05-08T05:47:41.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.178+0000 7f2f25200700 1 -- 172.21.15.82:0/2218740366 wait complete. 2024-05-08T05:47:41.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.179+0000 7f2f25200700 1 Processor -- start 2024-05-08T05:47:41.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.179+0000 7f2f25200700 1 -- start start 2024-05-08T05:47:41.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.180+0000 7f2f25200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f200756d0 0x7f2f2019be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:41.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.180+0000 7f2f25200700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f20075ff0 0x7f2f2019c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:41.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.180+0000 7f2f25200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f2010ff00 0x7f2f201a06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:41.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.180+0000 7f2f25200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2f20115930 con 0x7f2f200756d0 2024-05-08T05:47:41.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.180+0000 7f2f25200700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2f201157b0 con 0x7f2f2010ff00 2024-05-08T05:47:41.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.180+0000 7f2f25200700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2f20115ab0 con 0x7f2f20075ff0 2024-05-08T05:47:41.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.180+0000 7f2f1de00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f200756d0 0x7f2f2019be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:41.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.180+0000 7f2f1de00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f200756d0 0x7f2f2019be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:59776/0 (socket says 172.21.15.82:59776) 2024-05-08T05:47:41.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.180+0000 7f2f1de00700 1 -- 172.21.15.82:0/1684649631 learned_addr learned my addr 172.21.15.82:0/1684649631 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:47:41.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.180+0000 7f2f1d400700 1 --2- 172.21.15.82:0/1684649631 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f20075ff0 0x7f2f2019c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:41.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.180+0000 7f2f1e800700 1 --2- 172.21.15.82:0/1684649631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f2010ff00 0x7f2f201a06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:41.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.180+0000 7f2f1de00700 1 -- 172.21.15.82:0/1684649631 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f20075ff0 msgr2=0x7f2f2019c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:41.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.180+0000 7f2f1de00700 1 --2- 172.21.15.82:0/1684649631 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f20075ff0 0x7f2f2019c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:41.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.180+0000 7f2f1de00700 1 -- 172.21.15.82:0/1684649631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f2010ff00 msgr2=0x7f2f201a06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:41.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.180+0000 7f2f1de00700 1 --2- 172.21.15.82:0/1684649631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f2010ff00 0x7f2f201a06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:41.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.180+0000 7f2f1de00700 1 -- 172.21.15.82:0/1684649631 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f201a0e10 con 0x7f2f200756d0 2024-05-08T05:47:41.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.181+0000 7f2f1de00700 1 --2- 172.21.15.82:0/1684649631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f200756d0 0x7f2f2019be00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2f1000d980 tx=0x7f2f1000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:47:41.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.181+0000 7f2f16a00700 1 -- 172.21.15.82:0/1684649631 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f10016070 con 0x7f2f200756d0 2024-05-08T05:47:41.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.181+0000 7f2f16a00700 1 -- 172.21.15.82:0/1684649631 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f10004830 con 0x7f2f200756d0 2024-05-08T05:47:41.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.181+0000 7f2f16a00700 1 -- 172.21.15.82:0/1684649631 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f10005540 con 0x7f2f200756d0 2024-05-08T05:47:41.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.181+0000 7f2f25200700 1 -- 172.21.15.82:0/1684649631 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f201a1100 con 0x7f2f200756d0 2024-05-08T05:47:41.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.181+0000 7f2f25200700 1 -- 172.21.15.82:0/1684649631 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f201a8980 con 0x7f2f200756d0 2024-05-08T05:47:41.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.182+0000 7f2f25200700 1 -- 172.21.15.82:0/1684649631 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2f20063c30 con 0x7f2f200756d0 2024-05-08T05:47:41.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.185+0000 7f2f16a00700 1 -- 172.21.15.82:0/1684649631 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f2f10004220 con 0x7f2f200756d0 2024-05-08T05:47:41.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.186+0000 7f2f16a00700 1 --2- 172.21.15.82:0/1684649631 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2f040b2910 0x7f2f040b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:41.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.186+0000 7f2f16a00700 1 -- 172.21.15.82:0/1684649631 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2f100e2870 con 0x7f2f200756d0 2024-05-08T05:47:41.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.186+0000 7f2f1d400700 1 --2- 172.21.15.82:0/1684649631 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2f040b2910 0x7f2f040b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:41.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.186+0000 7f2f16a00700 1 --2- 172.21.15.82:0/1684649631 >> [v2:172.21.15.134:6816/3006846927,v1:172.21.15.134:6817/3006846927] conn(0x7f2f040bc450 0x7f2f040be8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:41.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.187+0000 7f2f16a00700 1 -- 172.21.15.82:0/1684649631 --> [v2:172.21.15.134:6816/3006846927,v1:172.21.15.134:6817/3006846927] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2f1001ce50 con 0x7f2f040bc450 2024-05-08T05:47:41.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.187+0000 7f2f16a00700 1 -- 172.21.15.82:0/1684649631 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f2f100e2c20 con 0x7f2f200756d0 2024-05-08T05:47:41.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.187+0000 7f2f1e800700 1 --2- 172.21.15.82:0/1684649631 >> [v2:172.21.15.134:6816/3006846927,v1:172.21.15.134:6817/3006846927] conn(0x7f2f040bc450 0x7f2f040be8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:41.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.187+0000 7f2f1d400700 1 --2- 172.21.15.82:0/1684649631 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2f040b2910 0x7f2f040b4dd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2f20103080 tx=0x7f2f0c005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:47:41.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.188+0000 7f2f1e800700 1 --2- 172.21.15.82:0/1684649631 >> [v2:172.21.15.134:6816/3006846927,v1:172.21.15.134:6817/3006846927] conn(0x7f2f040bc450 0x7f2f040be8f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:47:41.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.188+0000 7f2f16a00700 1 -- 172.21.15.82:0/1684649631 <== osd.7 v2:172.21.15.134:6816/3006846927 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2f1001ce50 con 0x7f2f040bc450 2024-05-08T05:47:41.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.207+0000 7f2f25200700 1 -- 172.21.15.82:0/1684649631 --> [v2:172.21.15.134:6816/3006846927,v1:172.21.15.134:6817/3006846927] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2f200640b0 con 0x7f2f040bc450 2024-05-08T05:47:41.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.208+0000 7f2f16a00700 1 -- 172.21.15.82:0/1684649631 <== osd.7 v2:172.21.15.134:6816/3006846927 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2f200640b0 con 0x7f2f040bc450 2024-05-08T05:47:41.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.208+0000 7f2f25200700 1 -- 172.21.15.82:0/1684649631 >> [v2:172.21.15.134:6816/3006846927,v1:172.21.15.134:6817/3006846927] conn(0x7f2f040bc450 msgr2=0x7f2f040be8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:41.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.208+0000 7f2f25200700 1 --2- 172.21.15.82:0/1684649631 >> [v2:172.21.15.134:6816/3006846927,v1:172.21.15.134:6817/3006846927] conn(0x7f2f040bc450 0x7f2f040be8f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:41.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.208+0000 7f2f25200700 1 -- 172.21.15.82:0/1684649631 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2f040b2910 msgr2=0x7f2f040b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:41.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.208+0000 7f2f25200700 1 --2- 172.21.15.82:0/1684649631 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2f040b2910 0x7f2f040b4dd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2f20103080 tx=0x7f2f0c005fd0 comp rx=0 tx=0).stop 2024-05-08T05:47:41.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.208+0000 7f2f25200700 1 -- 172.21.15.82:0/1684649631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f200756d0 msgr2=0x7f2f2019be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:41.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.208+0000 7f2f25200700 1 --2- 172.21.15.82:0/1684649631 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f200756d0 0x7f2f2019be00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2f1000d980 tx=0x7f2f1000dc90 comp rx=0 tx=0).stop 2024-05-08T05:47:41.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.209+0000 7f2f1e800700 1 -- 172.21.15.82:0/1684649631 reap_dead start 2024-05-08T05:47:41.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.209+0000 7f2f25200700 1 -- 172.21.15.82:0/1684649631 shutdown_connections 2024-05-08T05:47:41.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.209+0000 7f2f25200700 1 -- 172.21.15.82:0/1684649631 >> 172.21.15.82:0/1684649631 conn(0x7f2f2007a600 msgr2=0x7f2f20100730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:47:41.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.209+0000 7f2f25200700 1 -- 172.21.15.82:0/1684649631 shutdown_connections 2024-05-08T05:47:41.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:33.209+0000 7f2f25200700 1 -- 172.21.15.82:0/1684649631 wait complete. 2024-05-08T05:47:42.890 INFO:teuthology.orchestra.run.smithi082.stdout:206158430266 2024-05-08T05:47:42.891 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-05-08T05:47:43.050 INFO:teuthology.orchestra.run.smithi082.stdout:231928234039 2024-05-08T05:47:43.051 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-05-08T05:47:43.434 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:47:43 smithi082 ceph-mon[30098]: pgmap v371: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-05-08T05:47:43.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:47:43 smithi134 ceph-mon[34132]: pgmap v371: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-05-08T05:47:43.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:47:43 smithi151 ceph-mon[34815]: pgmap v371: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 10 op/s 2024-05-08T05:47:43.665 INFO:teuthology.orchestra.run.smithi082.stdout:283467841579 2024-05-08T05:47:43.665 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-05-08T05:47:43.666 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:47:44.159 INFO:teuthology.orchestra.run.smithi082.stdout:111669149778 2024-05-08T05:47:44.160 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-05-08T05:47:44.182 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:47:44.203 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:47:44.203 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:47:45.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:47:45 smithi134 ceph-mon[34132]: pgmap v372: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-08T05:47:45.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:47:45 smithi151 ceph-mon[34815]: pgmap v372: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-08T05:47:45.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:47:45 smithi082 ceph-mon[30098]: pgmap v372: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 8 op/s 2024-05-08T05:47:45.747 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:47:45.760 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:47:45.761 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:47:45.765 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:47:45.771 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:47:46.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:47:46 smithi082 ceph-mon[30098]: mgrmap e18: x(active, since 10m), standbys: z, y 2024-05-08T05:47:46.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:47:46 smithi151 ceph-mon[34815]: mgrmap e18: x(active, since 10m), standbys: z, y 2024-05-08T05:47:46.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:47:46 smithi134 ceph-mon[34132]: mgrmap e18: x(active, since 10m), standbys: z, y 2024-05-08T05:47:47.541 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:47:47 smithi082 ceph-mon[30098]: pgmap v373: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-08T05:47:47.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:47:47 smithi151 ceph-mon[34815]: pgmap v373: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-08T05:47:47.753 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:47:47 smithi134 ceph-mon[34132]: pgmap v373: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-08T05:47:49.034 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:47:49.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:47:49 smithi151 ceph-mon[34815]: pgmap v374: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-08T05:47:49.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:47:49 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:47:49.691 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:47:49 smithi082 ceph-mon[30098]: pgmap v374: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-08T05:47:49.692 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:47:49 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:47:49.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:47:49 smithi134 ceph-mon[34132]: pgmap v374: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-08T05:47:49.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:47:49 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:47:51.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:47:51 smithi082 ceph-mon[30098]: pgmap v375: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-08T05:47:51.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:47:51 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:47:51.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:47:51 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:47:51.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:47:51 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:47:51.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:47:51 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:47:51.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:47:51 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:47:51.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:47:51 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:47:52.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:47:51 smithi151 ceph-mon[34815]: pgmap v375: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-08T05:47:52.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:47:51 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:47:52.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:47:51 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:47:52.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:47:51 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:47:52.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:47:51 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:47:52.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:47:51 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:47:52.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:47:51 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:47:52.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:47:51 smithi134 ceph-mon[34132]: pgmap v375: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-08T05:47:52.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:47:51 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:47:52.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:47:51 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:47:52.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:47:51 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:47:52.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:47:51 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:47:52.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:47:51 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:47:52.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:47:51 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:47:53.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:53.200+0000 7f3adfe00700 1 -- 172.21.15.82:0/1205357109 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ae010e8b0 msgr2=0x7f3ae010ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:53.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:53.200+0000 7f3adfe00700 1 --2- 172.21.15.82:0/1205357109 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ae010e8b0 0x7f3ae010ec90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0009990 tx=0x7f3ad0009ca0 comp rx=0 tx=0).stop 2024-05-08T05:47:53.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:53.200+0000 7f3adfe00700 1 -- 172.21.15.82:0/1205357109 shutdown_connections 2024-05-08T05:47:53.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:53.200+0000 7f3adfe00700 1 --2- 172.21.15.82:0/1205357109 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ae010a3a0 0x7f3ae0116840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:53.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:53.200+0000 7f3adfe00700 1 --2- 172.21.15.82:0/1205357109 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ae010e8b0 0x7f3ae010ec90 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:53.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:53.200+0000 7f3adfe00700 1 --2- 172.21.15.82:0/1205357109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ae01099e0 0x7f3ae0109e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:53.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:53.200+0000 7f3adfe00700 1 -- 172.21.15.82:0/1205357109 >> 172.21.15.82:0/1205357109 conn(0x7f3ae0079230 msgr2=0x7f3ae01082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:47:53.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:53.200+0000 7f3adfe00700 1 -- 172.21.15.82:0/1205357109 shutdown_connections 2024-05-08T05:47:53.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:53.200+0000 7f3adfe00700 1 -- 172.21.15.82:0/1205357109 wait complete. 2024-05-08T05:47:53.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:53.201+0000 7f3adfe00700 1 Processor -- start 2024-05-08T05:47:53.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:53.201+0000 7f3adfe00700 1 -- start start 2024-05-08T05:47:53.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:53.202+0000 7f3adfe00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ae01099e0 0x7f3ae01a0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:53.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:53.202+0000 7f3adfe00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ae010a3a0 0x7f3ae01a0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:53.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:53.202+0000 7f3adfe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ae010e8b0 0x7f3ae01a49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:53.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:53.202+0000 7f3adfe00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae0119b80 con 0x7f3ae010e8b0 2024-05-08T05:47:53.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:53.202+0000 7f3adfe00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae0119a00 con 0x7f3ae01099e0 2024-05-08T05:47:53.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:53.202+0000 7f3adfe00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3ae0119d00 con 0x7f3ae010a3a0 2024-05-08T05:47:53.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:53.202+0000 7f3adea00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ae01099e0 0x7f3ae01a0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:53.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:53.202+0000 7f3adea00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ae01099e0 0x7f3ae01a0110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:37736/0 (socket says 172.21.15.82:37736) 2024-05-08T05:47:53.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:53.202+0000 7f3adea00700 1 -- 172.21.15.82:0/2517681607 learned_addr learned my addr 172.21.15.82:0/2517681607 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:47:53.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:53.202+0000 7f3adf400700 1 --2- 172.21.15.82:0/2517681607 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ae010e8b0 0x7f3ae01a49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:53.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:53.202+0000 7f3ade000700 1 --2- 172.21.15.82:0/2517681607 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ae010a3a0 0x7f3ae01a0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:53.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:53.203+0000 7f3adea00700 1 -- 172.21.15.82:0/2517681607 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ae010a3a0 msgr2=0x7f3ae01a0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:53.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:53.203+0000 7f3adea00700 1 --2- 172.21.15.82:0/2517681607 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ae010a3a0 0x7f3ae01a0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:53.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:53.203+0000 7f3adea00700 1 -- 172.21.15.82:0/2517681607 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ae010e8b0 msgr2=0x7f3ae01a49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:53.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:53.203+0000 7f3adea00700 1 --2- 172.21.15.82:0/2517681607 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ae010e8b0 0x7f3ae01a49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:53.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:53.203+0000 7f3adea00700 1 -- 172.21.15.82:0/2517681607 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ae01a5120 con 0x7f3ae01099e0 2024-05-08T05:47:53.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:53.203+0000 7f3adea00700 1 --2- 172.21.15.82:0/2517681607 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ae01099e0 0x7f3ae01a0110 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3ad00057f0 tx=0x7f3ad000bfd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:47:53.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:53.203+0000 7f3ad7400700 1 -- 172.21.15.82:0/2517681607 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad0026070 con 0x7f3ae01099e0 2024-05-08T05:47:53.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:53.203+0000 7f3adfe00700 1 -- 172.21.15.82:0/2517681607 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ae01a53b0 con 0x7f3ae01099e0 2024-05-08T05:47:53.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:53.203+0000 7f3ad7400700 1 -- 172.21.15.82:0/2517681607 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3ad0021410 con 0x7f3ae01099e0 2024-05-08T05:47:53.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:53.203+0000 7f3ad7400700 1 -- 172.21.15.82:0/2517681607 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ad0017650 con 0x7f3ae01099e0 2024-05-08T05:47:53.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:53.203+0000 7f3adfe00700 1 -- 172.21.15.82:0/2517681607 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ae01acc90 con 0x7f3ae01099e0 2024-05-08T05:47:53.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:53.204+0000 7f3adfe00700 1 -- 172.21.15.82:0/2517681607 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ae006a190 con 0x7f3ae01099e0 2024-05-08T05:47:53.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:53.207+0000 7f3ad7400700 1 -- 172.21.15.82:0/2517681607 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f3ad0029070 con 0x7f3ae01099e0 2024-05-08T05:47:53.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:53.208+0000 7f3ad7400700 1 --2- 172.21.15.82:0/2517681607 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3ac40b2880 0x7f3ac40b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:53.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:53.208+0000 7f3ad7400700 1 -- 172.21.15.82:0/2517681607 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f3ad00e31f0 con 0x7f3ae01099e0 2024-05-08T05:47:53.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:53.208+0000 7f3ade000700 1 --2- 172.21.15.82:0/2517681607 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3ac40b2880 0x7f3ac40b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:53.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:53.209+0000 7f3ade000700 1 --2- 172.21.15.82:0/2517681607 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3ac40b2880 0x7f3ac40b4d40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3ac8009680 tx=0x7f3ac8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:47:53.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:53.210+0000 7f3ad7400700 1 -- 172.21.15.82:0/2517681607 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f3ad0030080 con 0x7f3ae01099e0 2024-05-08T05:47:53.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:53.448+0000 7f3adfe00700 1 -- 172.21.15.82:0/2517681607 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f3ae002e510 con 0x7f3ae01099e0 2024-05-08T05:47:53.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:53.448+0000 7f3ad7400700 1 -- 172.21.15.82:0/2517681607 <== mon.2 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3ad0013070 con 0x7f3ae01099e0 2024-05-08T05:47:53.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:53.451+0000 7f3adfe00700 1 -- 172.21.15.82:0/2517681607 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3ac40b2880 msgr2=0x7f3ac40b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:53.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:53.451+0000 7f3adfe00700 1 --2- 172.21.15.82:0/2517681607 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3ac40b2880 0x7f3ac40b4d40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3ac8009680 tx=0x7f3ac8009260 comp rx=0 tx=0).stop 2024-05-08T05:47:53.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:53.451+0000 7f3adfe00700 1 -- 172.21.15.82:0/2517681607 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ae01099e0 msgr2=0x7f3ae01a0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:53.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:53.451+0000 7f3adfe00700 1 --2- 172.21.15.82:0/2517681607 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ae01099e0 0x7f3ae01a0110 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3ad00057f0 tx=0x7f3ad000bfd0 comp rx=0 tx=0).stop 2024-05-08T05:47:53.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:53.452+0000 7f3adfe00700 1 -- 172.21.15.82:0/2517681607 shutdown_connections 2024-05-08T05:47:53.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:53.452+0000 7f3adfe00700 1 --2- 172.21.15.82:0/2517681607 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ae01099e0 0x7f3ae01a0110 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:53.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:53.452+0000 7f3adfe00700 1 --2- 172.21.15.82:0/2517681607 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3ac40b2880 0x7f3ac40b4d40 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:53.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:53.452+0000 7f3adfe00700 1 --2- 172.21.15.82:0/2517681607 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3ae010e8b0 0x7f3ae01a49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:53.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:53.452+0000 7f3adfe00700 1 --2- 172.21.15.82:0/2517681607 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ae010a3a0 0x7f3ae01a0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:53.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:53.452+0000 7f3adfe00700 1 -- 172.21.15.82:0/2517681607 >> 172.21.15.82:0/2517681607 conn(0x7f3ae0079230 msgr2=0x7f3ae00798f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:47:53.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:53.452+0000 7f3adfe00700 1 -- 172.21.15.82:0/2517681607 shutdown_connections 2024-05-08T05:47:53.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:53.452+0000 7f3adfe00700 1 -- 172.21.15.82:0/2517681607 wait complete. 2024-05-08T05:47:53.586 INFO:teuthology.orchestra.run.smithi082.stdout:34359738469 2024-05-08T05:47:54.091 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:47:53 smithi082 ceph-mon[30098]: pgmap v376: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 426 B/s wr, 11 op/s 2024-05-08T05:47:54.091 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:47:53 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/2517681607' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-08T05:47:54.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:47:53 smithi151 ceph-mon[34815]: pgmap v376: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 426 B/s wr, 11 op/s 2024-05-08T05:47:54.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:47:53 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/2517681607' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-08T05:47:54.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:47:53 smithi134 ceph-mon[34132]: pgmap v376: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 426 B/s wr, 11 op/s 2024-05-08T05:47:54.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:47:53 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/2517681607' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-08T05:47:54.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:54.463+0000 7f04bea00700 1 -- 172.21.15.82:0/2777162083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04b8106050 msgr2=0x7f04b8112560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:54.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:54.463+0000 7f04bea00700 1 --2- 172.21.15.82:0/2777162083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04b8106050 0x7f04b8112560 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f04b000b0a0 tx=0x7f04b000b3b0 comp rx=0 tx=0).stop 2024-05-08T05:47:54.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:54.463+0000 7f04bea00700 1 -- 172.21.15.82:0/2777162083 shutdown_connections 2024-05-08T05:47:54.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:54.463+0000 7f04bea00700 1 --2- 172.21.15.82:0/2777162083 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04b8106050 0x7f04b8112560 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:54.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:54.463+0000 7f04bea00700 1 --2- 172.21.15.82:0/2777162083 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04b810b690 0x7f04b810ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:54.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:54.463+0000 7f04bea00700 1 --2- 172.21.15.82:0/2777162083 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04b8105690 0x7f04b8105b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:54.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:54.463+0000 7f04bea00700 1 -- 172.21.15.82:0/2777162083 >> 172.21.15.82:0/2777162083 conn(0x7f04b8101180 msgr2=0x7f04b81035a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:47:54.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:54.463+0000 7f04bea00700 1 -- 172.21.15.82:0/2777162083 shutdown_connections 2024-05-08T05:47:54.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:54.463+0000 7f04bea00700 1 -- 172.21.15.82:0/2777162083 wait complete. 2024-05-08T05:47:54.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:54.464+0000 7f04bea00700 1 Processor -- start 2024-05-08T05:47:54.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:54.464+0000 7f04bea00700 1 -- start start 2024-05-08T05:47:54.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:54.465+0000 7f04bea00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04b8105690 0x7f04b819bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:54.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:54.465+0000 7f04bea00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04b8106050 0x7f04b819c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:54.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:54.465+0000 7f04bea00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04b810b690 0x7f04b81a0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:54.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:54.465+0000 7f04bea00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f04b8115920 con 0x7f04b8106050 2024-05-08T05:47:54.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:54.465+0000 7f04bea00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f04b81157a0 con 0x7f04b8105690 2024-05-08T05:47:54.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:54.465+0000 7f04bea00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f04b8115aa0 con 0x7f04b810b690 2024-05-08T05:47:54.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:54.465+0000 7f04b7e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04b8105690 0x7f04b819bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:54.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:54.465+0000 7f04b7e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04b8105690 0x7f04b819bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:37760/0 (socket says 172.21.15.82:37760) 2024-05-08T05:47:54.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:54.465+0000 7f04b7400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04b8106050 0x7f04b819c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:54.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:54.465+0000 7f04b7e00700 1 -- 172.21.15.82:0/1005456217 learned_addr learned my addr 172.21.15.82:0/1005456217 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:47:54.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:54.465+0000 7f04bca00700 1 --2- 172.21.15.82:0/1005456217 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04b810b690 0x7f04b81a0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:54.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:54.466+0000 7f04b7e00700 1 -- 172.21.15.82:0/1005456217 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04b810b690 msgr2=0x7f04b81a0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:54.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:54.466+0000 7f04b7e00700 1 --2- 172.21.15.82:0/1005456217 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04b810b690 0x7f04b81a0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:54.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:54.466+0000 7f04b7e00700 1 -- 172.21.15.82:0/1005456217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04b8106050 msgr2=0x7f04b819c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:54.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:54.466+0000 7f04b7e00700 1 --2- 172.21.15.82:0/1005456217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04b8106050 0x7f04b819c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:54.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:54.466+0000 7f04b7e00700 1 -- 172.21.15.82:0/1005456217 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04b81a0d40 con 0x7f04b8105690 2024-05-08T05:47:54.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:54.466+0000 7f04b7e00700 1 --2- 172.21.15.82:0/1005456217 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04b8105690 0x7f04b819bd30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f04a800d950 tx=0x7f04a800dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:47:54.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:54.466+0000 7f04b4c00700 1 -- 172.21.15.82:0/1005456217 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a8016070 con 0x7f04b8105690 2024-05-08T05:47:54.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:54.466+0000 7f04bea00700 1 -- 172.21.15.82:0/1005456217 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04b81a1030 con 0x7f04b8105690 2024-05-08T05:47:54.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:54.466+0000 7f04b4c00700 1 -- 172.21.15.82:0/1005456217 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f04a800fd40 con 0x7f04b8105690 2024-05-08T05:47:54.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:54.466+0000 7f04b4c00700 1 -- 172.21.15.82:0/1005456217 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a800e3b0 con 0x7f04b8105690 2024-05-08T05:47:54.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:54.467+0000 7f04bea00700 1 -- 172.21.15.82:0/1005456217 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04b81a88b0 con 0x7f04b8105690 2024-05-08T05:47:54.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:54.467+0000 7f04bea00700 1 -- 172.21.15.82:0/1005456217 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04b806a190 con 0x7f04b8105690 2024-05-08T05:47:54.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:54.470+0000 7f04b4c00700 1 -- 172.21.15.82:0/1005456217 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f04a8019070 con 0x7f04b8105690 2024-05-08T05:47:54.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:54.471+0000 7f04b4c00700 1 --2- 172.21.15.82:0/1005456217 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f049c0b2880 0x7f049c0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:54.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:54.472+0000 7f04b4c00700 1 -- 172.21.15.82:0/1005456217 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f04a80e1c20 con 0x7f04b8105690 2024-05-08T05:47:54.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:54.472+0000 7f04b7400700 1 --2- 172.21.15.82:0/1005456217 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f049c0b2880 0x7f049c0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:54.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:54.472+0000 7f04b7400700 1 --2- 172.21.15.82:0/1005456217 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f049c0b2880 0x7f049c0b4d40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f04a4009680 tx=0x7f04a4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:47:54.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:54.473+0000 7f04b4c00700 1 -- 172.21.15.82:0/1005456217 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f04a80a98f0 con 0x7f04b8105690 2024-05-08T05:47:54.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:54.707+0000 7f04bea00700 1 -- 172.21.15.82:0/1005456217 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f04b802e510 con 0x7f04b8105690 2024-05-08T05:47:54.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:54.707+0000 7f04b4c00700 1 -- 172.21.15.82:0/1005456217 <== mon.2 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f04a80a91f0 con 0x7f04b8105690 2024-05-08T05:47:54.707 INFO:teuthology.orchestra.run.smithi082.stdout:77309411421 2024-05-08T05:47:54.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:54.710+0000 7f04bea00700 1 -- 172.21.15.82:0/1005456217 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f049c0b2880 msgr2=0x7f049c0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:54.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:54.710+0000 7f04bea00700 1 --2- 172.21.15.82:0/1005456217 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f049c0b2880 0x7f049c0b4d40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f04a4009680 tx=0x7f04a4009260 comp rx=0 tx=0).stop 2024-05-08T05:47:54.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:54.710+0000 7f04bea00700 1 -- 172.21.15.82:0/1005456217 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04b8105690 msgr2=0x7f04b819bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:54.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:54.710+0000 7f04bea00700 1 --2- 172.21.15.82:0/1005456217 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04b8105690 0x7f04b819bd30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f04a800d950 tx=0x7f04a800dc60 comp rx=0 tx=0).stop 2024-05-08T05:47:54.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:54.711+0000 7f04bea00700 1 -- 172.21.15.82:0/1005456217 shutdown_connections 2024-05-08T05:47:54.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:54.711+0000 7f04bea00700 1 --2- 172.21.15.82:0/1005456217 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f04b8105690 0x7f04b819bd30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:54.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:54.711+0000 7f04bea00700 1 --2- 172.21.15.82:0/1005456217 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f049c0b2880 0x7f049c0b4d40 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:54.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:54.711+0000 7f04bea00700 1 --2- 172.21.15.82:0/1005456217 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04b810b690 0x7f04b81a0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:54.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:54.711+0000 7f04bea00700 1 --2- 172.21.15.82:0/1005456217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f04b8106050 0x7f04b819c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:54.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:54.711+0000 7f04bea00700 1 -- 172.21.15.82:0/1005456217 >> 172.21.15.82:0/1005456217 conn(0x7f04b8101180 msgr2=0x7f04b8101730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:47:54.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:54.711+0000 7f04bea00700 1 -- 172.21.15.82:0/1005456217 shutdown_connections 2024-05-08T05:47:54.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:54.711+0000 7f04bea00700 1 -- 172.21.15.82:0/1005456217 wait complete. 2024-05-08T05:47:54.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:47:54 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/1005456217' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-08T05:47:55.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:47:54 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/1005456217' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-08T05:47:55.232 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:47:55.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:47:54 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/1005456217' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-08T05:47:55.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:47:55 smithi082 ceph-mon[30098]: pgmap v377: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 426 B/s wr, 9 op/s 2024-05-08T05:47:56.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:47:55 smithi151 ceph-mon[34815]: pgmap v377: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 426 B/s wr, 9 op/s 2024-05-08T05:47:56.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:47:55 smithi134 ceph-mon[34132]: pgmap v377: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 426 B/s wr, 9 op/s 2024-05-08T05:47:56.678 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411415 got 77309411421 for osd.2 2024-05-08T05:47:56.678 DEBUG:teuthology.parallel:result is None 2024-05-08T05:47:57.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:57.448+0000 7fe7f2800700 1 -- 172.21.15.82:0/2031417361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7ec075ff0 msgr2=0x7fe7ec114130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:57.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:57.448+0000 7fe7f2800700 1 --2- 172.21.15.82:0/2031417361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7ec075ff0 0x7fe7ec114130 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe7d8009990 tx=0x7fe7d8009ca0 comp rx=0 tx=0).stop 2024-05-08T05:47:57.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:57.448+0000 7fe7f2800700 1 -- 172.21.15.82:0/2031417361 shutdown_connections 2024-05-08T05:47:57.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:57.448+0000 7fe7f2800700 1 --2- 172.21.15.82:0/2031417361 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7ec0756d0 0x7fe7ec075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:57.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:57.448+0000 7fe7f2800700 1 --2- 172.21.15.82:0/2031417361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7ec114670 0x7fe7ec116a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:57.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:57.448+0000 7fe7f2800700 1 --2- 172.21.15.82:0/2031417361 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7ec075ff0 0x7fe7ec114130 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:57.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:57.448+0000 7fe7f2800700 1 -- 172.21.15.82:0/2031417361 >> 172.21.15.82:0/2031417361 conn(0x7fe7ec07a600 msgr2=0x7fe7ec07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:47:57.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:57.448+0000 7fe7f2800700 1 -- 172.21.15.82:0/2031417361 shutdown_connections 2024-05-08T05:47:57.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:57.448+0000 7fe7f2800700 1 -- 172.21.15.82:0/2031417361 wait complete. 2024-05-08T05:47:57.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:57.450+0000 7fe7f2800700 1 Processor -- start 2024-05-08T05:47:57.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:57.450+0000 7fe7f2800700 1 -- start start 2024-05-08T05:47:57.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:57.450+0000 7fe7f2800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7ec0756d0 0x7fe7ec1a01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:57.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:57.451+0000 7fe7f2800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7ec075ff0 0x7fe7ec1a0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:57.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:57.451+0000 7fe7f2800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7ec114670 0x7fe7ec1a4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:57.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:57.451+0000 7fe7f2800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ec119cb0 con 0x7fe7ec075ff0 2024-05-08T05:47:57.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:57.451+0000 7fe7f2800700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ec119b30 con 0x7fe7ec114670 2024-05-08T05:47:57.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:57.451+0000 7fe7f2800700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe7ec119e30 con 0x7fe7ec0756d0 2024-05-08T05:47:57.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:57.451+0000 7fe7eaa00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7ec075ff0 0x7fe7ec1a0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:57.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:57.451+0000 7fe7eaa00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7ec075ff0 0x7fe7ec1a0700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54124/0 (socket says 172.21.15.82:54124) 2024-05-08T05:47:57.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:57.451+0000 7fe7eaa00700 1 -- 172.21.15.82:0/508758834 learned_addr learned my addr 172.21.15.82:0/508758834 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:47:57.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:57.451+0000 7fe7ebe00700 1 --2- 172.21.15.82:0/508758834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7ec114670 0x7fe7ec1a4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:57.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:57.451+0000 7fe7eb400700 1 --2- 172.21.15.82:0/508758834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7ec0756d0 0x7fe7ec1a01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:57.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:57.451+0000 7fe7eaa00700 1 -- 172.21.15.82:0/508758834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7ec0756d0 msgr2=0x7fe7ec1a01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:57.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:57.451+0000 7fe7eaa00700 1 --2- 172.21.15.82:0/508758834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7ec0756d0 0x7fe7ec1a01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:57.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:57.451+0000 7fe7eaa00700 1 -- 172.21.15.82:0/508758834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7ec114670 msgr2=0x7fe7ec1a4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:57.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:57.451+0000 7fe7eaa00700 1 --2- 172.21.15.82:0/508758834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7ec114670 0x7fe7ec1a4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:57.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:57.451+0000 7fe7eaa00700 1 -- 172.21.15.82:0/508758834 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7ec1a51d0 con 0x7fe7ec075ff0 2024-05-08T05:47:57.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:57.451+0000 7fe7ebe00700 1 --2- 172.21.15.82:0/508758834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7ec114670 0x7fe7ec1a4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:47:57.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:57.452+0000 7fe7eaa00700 1 --2- 172.21.15.82:0/508758834 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7ec075ff0 0x7fe7ec1a0700 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe7d8000c00 tx=0x7fe7d80057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:47:57.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:57.452+0000 7fe7e3e00700 1 -- 172.21.15.82:0/508758834 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7d8027070 con 0x7fe7ec075ff0 2024-05-08T05:47:57.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:57.452+0000 7fe7e3e00700 1 -- 172.21.15.82:0/508758834 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe7d8022470 con 0x7fe7ec075ff0 2024-05-08T05:47:57.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:57.452+0000 7fe7f2800700 1 -- 172.21.15.82:0/508758834 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7ec1a5460 con 0x7fe7ec075ff0 2024-05-08T05:47:57.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:57.452+0000 7fe7e3e00700 1 -- 172.21.15.82:0/508758834 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7d8017650 con 0x7fe7ec075ff0 2024-05-08T05:47:57.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:57.452+0000 7fe7f2800700 1 -- 172.21.15.82:0/508758834 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7ec1acd40 con 0x7fe7ec075ff0 2024-05-08T05:47:57.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:57.453+0000 7fe7f2800700 1 -- 172.21.15.82:0/508758834 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7ec06a190 con 0x7fe7ec075ff0 2024-05-08T05:47:57.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:57.455+0000 7fe7e3e00700 1 -- 172.21.15.82:0/508758834 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fe7d802a070 con 0x7fe7ec075ff0 2024-05-08T05:47:57.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:57.457+0000 7fe7e3e00700 1 --2- 172.21.15.82:0/508758834 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fe7d00b2900 0x7fe7d00b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:57.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:57.457+0000 7fe7e3e00700 1 -- 172.21.15.82:0/508758834 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fe7d80e2f40 con 0x7fe7ec075ff0 2024-05-08T05:47:57.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:57.457+0000 7fe7eb400700 1 --2- 172.21.15.82:0/508758834 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fe7d00b2900 0x7fe7d00b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:57.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:57.458+0000 7fe7eb400700 1 --2- 172.21.15.82:0/508758834 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fe7d00b2900 0x7fe7d00b4dc0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc009c60 tx=0x7fe7dc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:47:57.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:57.460+0000 7fe7e3e00700 1 -- 172.21.15.82:0/508758834 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe7d8013070 con 0x7fe7ec075ff0 2024-05-08T05:47:57.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:57.736+0000 7fe7f2800700 1 -- 172.21.15.82:0/508758834 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fe7ec1acf10 con 0x7fe7ec075ff0 2024-05-08T05:47:57.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:57.737+0000 7fe7e3e00700 1 -- 172.21.15.82:0/508758834 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe7d80aaca0 con 0x7fe7ec075ff0 2024-05-08T05:47:57.737 INFO:teuthology.orchestra.run.smithi082.stdout:184683593798 2024-05-08T05:47:57.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:57.740+0000 7fe7f2800700 1 -- 172.21.15.82:0/508758834 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fe7d00b2900 msgr2=0x7fe7d00b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:57.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:57.740+0000 7fe7f2800700 1 --2- 172.21.15.82:0/508758834 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fe7d00b2900 0x7fe7d00b4dc0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc009c60 tx=0x7fe7dc009260 comp rx=0 tx=0).stop 2024-05-08T05:47:57.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:57.740+0000 7fe7f2800700 1 -- 172.21.15.82:0/508758834 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7ec075ff0 msgr2=0x7fe7ec1a0700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:57.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:57.740+0000 7fe7f2800700 1 --2- 172.21.15.82:0/508758834 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7ec075ff0 0x7fe7ec1a0700 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe7d8000c00 tx=0x7fe7d80057c0 comp rx=0 tx=0).stop 2024-05-08T05:47:57.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:57.740+0000 7fe7f2800700 1 -- 172.21.15.82:0/508758834 shutdown_connections 2024-05-08T05:47:57.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:57.740+0000 7fe7f2800700 1 --2- 172.21.15.82:0/508758834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7ec114670 0x7fe7ec1a4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:57.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:57.740+0000 7fe7f2800700 1 --2- 172.21.15.82:0/508758834 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fe7d00b2900 0x7fe7d00b4dc0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:57.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:57.740+0000 7fe7f2800700 1 --2- 172.21.15.82:0/508758834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7ec0756d0 0x7fe7ec1a01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:57.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:57.740+0000 7fe7f2800700 1 --2- 172.21.15.82:0/508758834 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe7ec075ff0 0x7fe7ec1a0700 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:57.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:57.740+0000 7fe7f2800700 1 -- 172.21.15.82:0/508758834 >> 172.21.15.82:0/508758834 conn(0x7fe7ec07a600 msgr2=0x7fe7ec110110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:47:57.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:57.741+0000 7fe7f2800700 1 -- 172.21.15.82:0/508758834 shutdown_connections 2024-05-08T05:47:57.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:57.741+0000 7fe7f2800700 1 -- 172.21.15.82:0/508758834 wait complete. 2024-05-08T05:47:58.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:58.041+0000 7f5f61c00700 1 -- 172.21.15.82:0/2070912990 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f5c10b6c0 msgr2=0x7f5f5c10baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:58.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:58.041+0000 7f5f61c00700 1 --2- 172.21.15.82:0/2070912990 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f5c10b6c0 0x7f5f5c10baa0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c009990 tx=0x7f5f4c009ca0 comp rx=0 tx=0).stop 2024-05-08T05:47:58.042 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:47:57 smithi082 ceph-mon[30098]: pgmap v378: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-08T05:47:58.042 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:47:57 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/508758834' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-08T05:47:58.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:58.041+0000 7f5f61c00700 1 -- 172.21.15.82:0/2070912990 shutdown_connections 2024-05-08T05:47:58.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:58.041+0000 7f5f61c00700 1 --2- 172.21.15.82:0/2070912990 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f5c106080 0x7f5f5c112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:58.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:58.041+0000 7f5f61c00700 1 --2- 172.21.15.82:0/2070912990 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f5c10b6c0 0x7f5f5c10baa0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:58.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:58.041+0000 7f5f61c00700 1 --2- 172.21.15.82:0/2070912990 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f5c1056c0 0x7f5f5c105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:58.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:58.041+0000 7f5f61c00700 1 -- 172.21.15.82:0/2070912990 >> 172.21.15.82:0/2070912990 conn(0x7f5f5c1011b0 msgr2=0x7f5f5c1035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:47:58.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:58.042+0000 7f5f61c00700 1 -- 172.21.15.82:0/2070912990 shutdown_connections 2024-05-08T05:47:58.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:58.042+0000 7f5f61c00700 1 -- 172.21.15.82:0/2070912990 wait complete. 2024-05-08T05:47:58.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:58.043+0000 7f5f61c00700 1 Processor -- start 2024-05-08T05:47:58.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:58.044+0000 7f5f61c00700 1 -- start start 2024-05-08T05:47:58.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:58.044+0000 7f5f61c00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f5c1056c0 0x7f5f5c19bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:58.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:58.044+0000 7f5f61c00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f5c106080 0x7f5f5c19c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:58.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:58.044+0000 7f5f61c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f5c10b6c0 0x7f5f5c1a0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:58.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:58.044+0000 7f5f61c00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5f5c1158c0 con 0x7f5f5c10b6c0 2024-05-08T05:47:58.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:58.044+0000 7f5f61c00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5f5c115740 con 0x7f5f5c106080 2024-05-08T05:47:58.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:58.044+0000 7f5f61c00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5f5c115a40 con 0x7f5f5c1056c0 2024-05-08T05:47:58.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:58.044+0000 7f5f5aa00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f5c1056c0 0x7f5f5c19bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:58.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:58.044+0000 7f5f5b400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f5c10b6c0 0x7f5f5c1a0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:58.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:58.044+0000 7f5f5a000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f5c106080 0x7f5f5c19c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:58.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:58.044+0000 7f5f5aa00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f5c1056c0 0x7f5f5c19bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:42402/0 (socket says 172.21.15.82:42402) 2024-05-08T05:47:58.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:58.044+0000 7f5f5aa00700 1 -- 172.21.15.82:0/529100736 learned_addr learned my addr 172.21.15.82:0/529100736 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:47:58.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:58.045+0000 7f5f5aa00700 1 -- 172.21.15.82:0/529100736 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f5c106080 msgr2=0x7f5f5c19c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:58.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:58.045+0000 7f5f5aa00700 1 --2- 172.21.15.82:0/529100736 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f5c106080 0x7f5f5c19c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:58.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:58.045+0000 7f5f5aa00700 1 -- 172.21.15.82:0/529100736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f5c10b6c0 msgr2=0x7f5f5c1a0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:58.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:58.045+0000 7f5f5aa00700 1 --2- 172.21.15.82:0/529100736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f5c10b6c0 0x7f5f5c1a0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:58.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:58.045+0000 7f5f5aa00700 1 -- 172.21.15.82:0/529100736 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f5c1a0d60 con 0x7f5f5c1056c0 2024-05-08T05:47:58.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:58.045+0000 7f5f5aa00700 1 --2- 172.21.15.82:0/529100736 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f5c1056c0 0x7f5f5c19bd50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c0057f0 tx=0x7f5f4c00bfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:47:58.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:58.045+0000 7f5f53400700 1 -- 172.21.15.82:0/529100736 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f4c026070 con 0x7f5f5c1056c0 2024-05-08T05:47:58.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:58.046+0000 7f5f53400700 1 -- 172.21.15.82:0/529100736 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5f4c021410 con 0x7f5f5c1056c0 2024-05-08T05:47:58.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:58.046+0000 7f5f53400700 1 -- 172.21.15.82:0/529100736 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f4c017650 con 0x7f5f5c1056c0 2024-05-08T05:47:58.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:58.046+0000 7f5f61c00700 1 -- 172.21.15.82:0/529100736 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f5c1a0ff0 con 0x7f5f5c1056c0 2024-05-08T05:47:58.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:58.046+0000 7f5f61c00700 1 -- 172.21.15.82:0/529100736 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f5c1a1450 con 0x7f5f5c1056c0 2024-05-08T05:47:58.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:58.047+0000 7f5f61c00700 1 -- 172.21.15.82:0/529100736 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f5c10dc50 con 0x7f5f5c1056c0 2024-05-08T05:47:58.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:58.050+0000 7f5f53400700 1 -- 172.21.15.82:0/529100736 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f5f4c009d10 con 0x7f5f5c1056c0 2024-05-08T05:47:58.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:58.051+0000 7f5f53400700 1 --2- 172.21.15.82:0/529100736 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f5f400b2880 0x7f5f400b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:47:58.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:58.051+0000 7f5f53400700 1 -- 172.21.15.82:0/529100736 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f5f4c0e2d70 con 0x7f5f5c1056c0 2024-05-08T05:47:58.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:58.051+0000 7f5f5a000700 1 --2- 172.21.15.82:0/529100736 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f5f400b2880 0x7f5f400b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:47:58.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:58.052+0000 7f5f5a000700 1 --2- 172.21.15.82:0/529100736 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f5f400b2880 0x7f5f400b4d40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5f48009680 tx=0x7f5f48009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:47:58.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:58.053+0000 7f5f53400700 1 -- 172.21.15.82:0/529100736 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5f5c1a1450 con 0x7f5f5c1056c0 2024-05-08T05:47:58.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:47:57 smithi151 ceph-mon[34815]: pgmap v378: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-08T05:47:58.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:47:57 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/508758834' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-08T05:47:58.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:47:57 smithi134 ceph-mon[34132]: pgmap v378: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-08T05:47:58.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:47:57 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/508758834' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-08T05:47:58.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:58.293+0000 7f5f61c00700 1 -- 172.21.15.82:0/529100736 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f5f5c19d0e0 con 0x7f5f5c1056c0 2024-05-08T05:47:58.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:58.294+0000 7f5f53400700 1 -- 172.21.15.82:0/529100736 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f5f5c19d0e0 con 0x7f5f5c1056c0 2024-05-08T05:47:58.294 INFO:teuthology.orchestra.run.smithi082.stdout:309237645353 2024-05-08T05:47:58.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:58.297+0000 7f5f61c00700 1 -- 172.21.15.82:0/529100736 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f5f400b2880 msgr2=0x7f5f400b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:58.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:58.297+0000 7f5f61c00700 1 --2- 172.21.15.82:0/529100736 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f5f400b2880 0x7f5f400b4d40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5f48009680 tx=0x7f5f48009260 comp rx=0 tx=0).stop 2024-05-08T05:47:58.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:58.297+0000 7f5f61c00700 1 -- 172.21.15.82:0/529100736 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f5c1056c0 msgr2=0x7f5f5c19bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:47:58.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:58.297+0000 7f5f61c00700 1 --2- 172.21.15.82:0/529100736 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f5c1056c0 0x7f5f5c19bd50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5f4c0057f0 tx=0x7f5f4c00bfd0 comp rx=0 tx=0).stop 2024-05-08T05:47:58.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:58.297+0000 7f5f61c00700 1 -- 172.21.15.82:0/529100736 shutdown_connections 2024-05-08T05:47:58.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:58.297+0000 7f5f61c00700 1 --2- 172.21.15.82:0/529100736 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f5f400b2880 0x7f5f400b4d40 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:58.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:58.297+0000 7f5f61c00700 1 --2- 172.21.15.82:0/529100736 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5f5c10b6c0 0x7f5f5c1a0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:58.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:58.297+0000 7f5f61c00700 1 --2- 172.21.15.82:0/529100736 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f5c1056c0 0x7f5f5c19bd50 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:58.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:58.297+0000 7f5f61c00700 1 --2- 172.21.15.82:0/529100736 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f5c106080 0x7f5f5c19c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:47:58.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:58.297+0000 7f5f61c00700 1 -- 172.21.15.82:0/529100736 >> 172.21.15.82:0/529100736 conn(0x7f5f5c1011b0 msgr2=0x7f5f5c101920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:47:58.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:58.297+0000 7f5f61c00700 1 -- 172.21.15.82:0/529100736 shutdown_connections 2024-05-08T05:47:58.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:47:58.297+0000 7f5f61c00700 1 -- 172.21.15.82:0/529100736 wait complete. 2024-05-08T05:47:58.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:47:58 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/529100736' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-08T05:47:59.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:47:58 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/529100736' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-08T05:47:59.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:47:58 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/529100736' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-08T05:47:59.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:47:59 smithi082 ceph-mon[30098]: pgmap v379: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 426 B/s wr, 11 op/s 2024-05-08T05:48:00.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:47:59 smithi151 ceph-mon[34815]: pgmap v379: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 426 B/s wr, 11 op/s 2024-05-08T05:48:00.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:47:59 smithi134 ceph-mon[34132]: pgmap v379: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 426 B/s wr, 11 op/s 2024-05-08T05:48:01.336 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:48:01.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.615+0000 7f1d15200700 1 -- 172.21.15.82:0/3649872476 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d1006c3d0 msgr2=0x7f1d10110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:01.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.615+0000 7f1d15200700 1 --2- 172.21.15.82:0/3649872476 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d1006c3d0 0x7f1d10110320 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1d0800b0a0 tx=0x7f1d0800b3b0 comp rx=0 tx=0).stop 2024-05-08T05:48:01.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.616+0000 7f1d15200700 1 -- 172.21.15.82:0/3649872476 shutdown_connections 2024-05-08T05:48:01.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.616+0000 7f1d15200700 1 --2- 172.21.15.82:0/3649872476 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d10109500 0x7f1d101098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:01.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.616+0000 7f1d15200700 1 --2- 172.21.15.82:0/3649872476 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d1006c3d0 0x7f1d10110320 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:01.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.616+0000 7f1d15200700 1 --2- 172.21.15.82:0/3649872476 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d1006ba10 0x7f1d1006be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:01.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.616+0000 7f1d15200700 1 -- 172.21.15.82:0/3649872476 >> 172.21.15.82:0/3649872476 conn(0x7f1d10079310 msgr2=0x7f1d10079720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:01.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.616+0000 7f1d15200700 1 -- 172.21.15.82:0/3649872476 shutdown_connections 2024-05-08T05:48:01.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.616+0000 7f1d15200700 1 -- 172.21.15.82:0/3649872476 wait complete. 2024-05-08T05:48:01.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.617+0000 7f1d15200700 1 Processor -- start 2024-05-08T05:48:01.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.617+0000 7f1d15200700 1 -- start start 2024-05-08T05:48:01.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.618+0000 7f1d15200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d1006ba10 0x7f1d1019f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:01.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.618+0000 7f1d15200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d1006c3d0 0x7f1d1019fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:01.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.618+0000 7f1d15200700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d10109500 0x7f1d10199a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:01.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.618+0000 7f1d15200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1d10113680 con 0x7f1d1006ba10 2024-05-08T05:48:01.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.618+0000 7f1d15200700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1d10113500 con 0x7f1d1006c3d0 2024-05-08T05:48:01.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.618+0000 7f1d15200700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1d10113800 con 0x7f1d10109500 2024-05-08T05:48:01.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.618+0000 7f1d0de00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d1006ba10 0x7f1d1019f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:01.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.618+0000 7f1d0de00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d1006ba10 0x7f1d1019f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54174/0 (socket says 172.21.15.82:54174) 2024-05-08T05:48:01.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.618+0000 7f1d0de00700 1 -- 172.21.15.82:0/4100676774 learned_addr learned my addr 172.21.15.82:0/4100676774 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:48:01.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.618+0000 7f1d0d400700 1 --2- 172.21.15.82:0/4100676774 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d1006c3d0 0x7f1d1019fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:01.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.618+0000 7f1d0e800700 1 --2- 172.21.15.82:0/4100676774 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d10109500 0x7f1d10199a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:01.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.619+0000 7f1d0d400700 1 -- 172.21.15.82:0/4100676774 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d10109500 msgr2=0x7f1d10199a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:01.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.619+0000 7f1d0d400700 1 --2- 172.21.15.82:0/4100676774 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d10109500 0x7f1d10199a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:01.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.619+0000 7f1d0d400700 1 -- 172.21.15.82:0/4100676774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d1006ba10 msgr2=0x7f1d1019f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:01.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.619+0000 7f1d0d400700 1 --2- 172.21.15.82:0/4100676774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d1006ba10 0x7f1d1019f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:01.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.619+0000 7f1d0d400700 1 -- 172.21.15.82:0/4100676774 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d1019a180 con 0x7f1d1006c3d0 2024-05-08T05:48:01.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.619+0000 7f1d0d400700 1 --2- 172.21.15.82:0/4100676774 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d1006c3d0 0x7f1d1019fda0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc00e9f0 tx=0x7f1cfc00ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:01.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.619+0000 7f1d06a00700 1 -- 172.21.15.82:0/4100676774 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc004220 con 0x7f1d1006c3d0 2024-05-08T05:48:01.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.619+0000 7f1d15200700 1 -- 172.21.15.82:0/4100676774 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d1019a470 con 0x7f1d1006c3d0 2024-05-08T05:48:01.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.619+0000 7f1d06a00700 1 -- 172.21.15.82:0/4100676774 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1cfc0043c0 con 0x7f1d1006c3d0 2024-05-08T05:48:01.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.619+0000 7f1d06a00700 1 -- 172.21.15.82:0/4100676774 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc005020 con 0x7f1d1006c3d0 2024-05-08T05:48:01.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.619+0000 7f1d15200700 1 -- 172.21.15.82:0/4100676774 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d101a6730 con 0x7f1d1006c3d0 2024-05-08T05:48:01.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.620+0000 7f1d15200700 1 -- 172.21.15.82:0/4100676774 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cf0005330 con 0x7f1d1006c3d0 2024-05-08T05:48:01.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.624+0000 7f1d06a00700 1 -- 172.21.15.82:0/4100676774 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f1cfc0051c0 con 0x7f1d1006c3d0 2024-05-08T05:48:01.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.625+0000 7f1d06a00700 1 --2- 172.21.15.82:0/4100676774 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f1cf40b2900 0x7f1cf40b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:01.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.626+0000 7f1d06a00700 1 -- 172.21.15.82:0/4100676774 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f1cfc0e20f0 con 0x7f1d1006c3d0 2024-05-08T05:48:01.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.626+0000 7f1d0de00700 1 --2- 172.21.15.82:0/4100676774 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f1cf40b2900 0x7f1cf40b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:01.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.626+0000 7f1d06a00700 1 -- 172.21.15.82:0/4100676774 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1cfc0a9e50 con 0x7f1d1006c3d0 2024-05-08T05:48:01.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.627+0000 7f1d0de00700 1 --2- 172.21.15.82:0/4100676774 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f1cf40b2900 0x7f1cf40b4dc0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1d00009680 tx=0x7f1d00009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:01.806 INFO:tasks.cephadm.ceph_manager.ceph:need seq 184683593792 got 184683593798 for osd.6 2024-05-08T05:48:01.807 DEBUG:teuthology.parallel:result is None 2024-05-08T05:48:01.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.863+0000 7f1d15200700 1 -- 172.21.15.82:0/4100676774 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f1cf00058f0 con 0x7f1d1006c3d0 2024-05-08T05:48:01.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.864+0000 7f1d06a00700 1 -- 172.21.15.82:0/4100676774 <== mon.2 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1cfc0a9750 con 0x7f1d1006c3d0 2024-05-08T05:48:01.864 INFO:teuthology.orchestra.run.smithi082.stdout:55834574946 2024-05-08T05:48:01.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.867+0000 7f1d15200700 1 -- 172.21.15.82:0/4100676774 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f1cf40b2900 msgr2=0x7f1cf40b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:01.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.867+0000 7f1d15200700 1 --2- 172.21.15.82:0/4100676774 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f1cf40b2900 0x7f1cf40b4dc0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1d00009680 tx=0x7f1d00009260 comp rx=0 tx=0).stop 2024-05-08T05:48:01.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.867+0000 7f1d15200700 1 -- 172.21.15.82:0/4100676774 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d1006c3d0 msgr2=0x7f1d1019fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:01.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.867+0000 7f1d15200700 1 --2- 172.21.15.82:0/4100676774 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d1006c3d0 0x7f1d1019fda0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc00e9f0 tx=0x7f1cfc00ed00 comp rx=0 tx=0).stop 2024-05-08T05:48:01.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.867+0000 7f1d15200700 1 -- 172.21.15.82:0/4100676774 shutdown_connections 2024-05-08T05:48:01.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.867+0000 7f1d15200700 1 --2- 172.21.15.82:0/4100676774 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f1cf40b2900 0x7f1cf40b4dc0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:01.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.867+0000 7f1d15200700 1 --2- 172.21.15.82:0/4100676774 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d10109500 0x7f1d10199a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:01.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.867+0000 7f1d15200700 1 --2- 172.21.15.82:0/4100676774 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d1006ba10 0x7f1d1019f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:01.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.867+0000 7f1d15200700 1 --2- 172.21.15.82:0/4100676774 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d1006c3d0 0x7f1d1019fda0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:01.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.867+0000 7f1d15200700 1 -- 172.21.15.82:0/4100676774 >> 172.21.15.82:0/4100676774 conn(0x7f1d10079310 msgr2=0x7f1d101010d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:01.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.867+0000 7f1d15200700 1 -- 172.21.15.82:0/4100676774 shutdown_connections 2024-05-08T05:48:01.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.867+0000 7f1d15200700 1 -- 172.21.15.82:0/4100676774 wait complete. 2024-05-08T05:48:01.885 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:48:01 smithi082 ceph-mon[30098]: pgmap v380: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-08T05:48:01.885 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:48:01 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/844244998' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-08T05:48:02.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:48:01 smithi151 ceph-mon[34815]: pgmap v380: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-08T05:48:02.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:48:01 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/844244998' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-08T05:48:02.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:48:01 smithi134 ceph-mon[34132]: pgmap v380: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-08T05:48:02.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:48:01 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/844244998' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-08T05:48:02.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:02.902+0000 7f4fe4600700 1 -- 172.21.15.82:0/3376740728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fdc0756d0 msgr2=0x7f4fdc075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:02.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:02.902+0000 7f4fe4600700 1 --2- 172.21.15.82:0/3376740728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fdc0756d0 0x7f4fdc075ab0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4fd0009990 tx=0x7f4fd0009ca0 comp rx=0 tx=0).stop 2024-05-08T05:48:02.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:02.903+0000 7f4fe4600700 1 -- 172.21.15.82:0/3376740728 shutdown_connections 2024-05-08T05:48:02.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:02.903+0000 7f4fe4600700 1 --2- 172.21.15.82:0/3376740728 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fdc114670 0x7f4fdc116a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:02.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:02.903+0000 7f4fe4600700 1 --2- 172.21.15.82:0/3376740728 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fdc0756d0 0x7f4fdc075ab0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:02.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:02.903+0000 7f4fe4600700 1 --2- 172.21.15.82:0/3376740728 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fdc075ff0 0x7f4fdc114130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:02.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:02.903+0000 7f4fe4600700 1 -- 172.21.15.82:0/3376740728 >> 172.21.15.82:0/3376740728 conn(0x7f4fdc07a650 msgr2=0x7f4fdc07aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:02.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:02.903+0000 7f4fe4600700 1 -- 172.21.15.82:0/3376740728 shutdown_connections 2024-05-08T05:48:02.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:02.903+0000 7f4fe4600700 1 -- 172.21.15.82:0/3376740728 wait complete. 2024-05-08T05:48:02.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:02.904+0000 7f4fe4600700 1 Processor -- start 2024-05-08T05:48:02.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:02.905+0000 7f4fe4600700 1 -- start start 2024-05-08T05:48:02.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:02.905+0000 7f4fe4600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fdc0756d0 0x7f4fdc1a02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:02.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:02.905+0000 7f4fe4600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fdc075ff0 0x7f4fdc1a0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:02.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:02.905+0000 7f4fe4600700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fdc114670 0x7f4fdc1a4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:02.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:02.905+0000 7f4fe4600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4fdc119cc0 con 0x7f4fdc0756d0 2024-05-08T05:48:02.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:02.905+0000 7f4fe4600700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4fdc119b40 con 0x7f4fdc075ff0 2024-05-08T05:48:02.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:02.905+0000 7f4fe4600700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f4fdc119e40 con 0x7f4fdc114670 2024-05-08T05:48:02.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:02.905+0000 7f4fe1c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fdc0756d0 0x7f4fdc1a02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:02.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:02.905+0000 7f4fe2600700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fdc114670 0x7f4fdc1a4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:02.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:02.905+0000 7f4fe1c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fdc0756d0 0x7f4fdc1a02d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53432/0 (socket says 172.21.15.82:53432) 2024-05-08T05:48:02.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:02.905+0000 7f4fe1c00700 1 -- 172.21.15.82:0/2562974142 learned_addr learned my addr 172.21.15.82:0/2562974142 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:48:02.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:02.905+0000 7f4fe1200700 1 --2- 172.21.15.82:0/2562974142 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fdc075ff0 0x7f4fdc1a0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:02.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:02.906+0000 7f4fe1c00700 1 -- 172.21.15.82:0/2562974142 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fdc114670 msgr2=0x7f4fdc1a4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:02.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:02.906+0000 7f4fe1c00700 1 --2- 172.21.15.82:0/2562974142 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fdc114670 0x7f4fdc1a4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:02.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:02.906+0000 7f4fe1c00700 1 -- 172.21.15.82:0/2562974142 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fdc075ff0 msgr2=0x7f4fdc1a0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:02.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:02.906+0000 7f4fe1c00700 1 --2- 172.21.15.82:0/2562974142 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fdc075ff0 0x7f4fdc1a0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:02.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:02.906+0000 7f4fe1c00700 1 -- 172.21.15.82:0/2562974142 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fdc1a5240 con 0x7f4fdc0756d0 2024-05-08T05:48:02.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:02.906+0000 7f4fe1c00700 1 --2- 172.21.15.82:0/2562974142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fdc0756d0 0x7f4fdc1a02d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4fd00047b0 tx=0x7f4fd0009550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:02.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:02.906+0000 7f4fda000700 1 -- 172.21.15.82:0/2562974142 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd0027070 con 0x7f4fdc0756d0 2024-05-08T05:48:02.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:02.907+0000 7f4fe4600700 1 -- 172.21.15.82:0/2562974142 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fdc1a54d0 con 0x7f4fdc0756d0 2024-05-08T05:48:02.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:02.907+0000 7f4fe4600700 1 -- 172.21.15.82:0/2562974142 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fdc1acdb0 con 0x7f4fdc0756d0 2024-05-08T05:48:02.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:02.907+0000 7f4fda000700 1 -- 172.21.15.82:0/2562974142 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4fd0022470 con 0x7f4fdc0756d0 2024-05-08T05:48:02.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:02.907+0000 7f4fda000700 1 -- 172.21.15.82:0/2562974142 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd0017650 con 0x7f4fdc0756d0 2024-05-08T05:48:02.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:02.908+0000 7f4fe4600700 1 -- 172.21.15.82:0/2562974142 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fdc06a190 con 0x7f4fdc0756d0 2024-05-08T05:48:02.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:02.911+0000 7f4fda000700 1 -- 172.21.15.82:0/2562974142 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f4fd002a070 con 0x7f4fdc0756d0 2024-05-08T05:48:02.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:02.912+0000 7f4fda000700 1 --2- 172.21.15.82:0/2562974142 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f4fc40b2900 0x7f4fc40b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:02.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:02.913+0000 7f4fda000700 1 -- 172.21.15.82:0/2562974142 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f4fd00e2e50 con 0x7f4fdc0756d0 2024-05-08T05:48:02.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:02.913+0000 7f4fe1200700 1 --2- 172.21.15.82:0/2562974142 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f4fc40b2900 0x7f4fc40b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:02.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:02.913+0000 7f4fe1200700 1 --2- 172.21.15.82:0/2562974142 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f4fc40b2900 0x7f4fc40b4dc0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc111160 tx=0x7f4fc8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:02.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:02.917+0000 7f4fda000700 1 -- 172.21.15.82:0/2562974142 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4fd0013070 con 0x7f4fdc0756d0 2024-05-08T05:48:03.061 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:48:02 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/4100676774' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-08T05:48:03.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:48:02 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/4100676774' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-08T05:48:03.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:03.162+0000 7f4fe4600700 1 -- 172.21.15.82:0/2562974142 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f4fdc02e510 con 0x7f4fdc0756d0 2024-05-08T05:48:03.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:03.162+0000 7f4fda000700 1 -- 172.21.15.82:0/2562974142 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f4fd00aabb0 con 0x7f4fdc0756d0 2024-05-08T05:48:03.163 INFO:teuthology.orchestra.run.smithi082.stdout:257698037813 2024-05-08T05:48:03.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:03.166+0000 7f4fe4600700 1 -- 172.21.15.82:0/2562974142 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f4fc40b2900 msgr2=0x7f4fc40b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:03.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:03.166+0000 7f4fe4600700 1 --2- 172.21.15.82:0/2562974142 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f4fc40b2900 0x7f4fc40b4dc0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc111160 tx=0x7f4fc8009260 comp rx=0 tx=0).stop 2024-05-08T05:48:03.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:03.166+0000 7f4fe4600700 1 -- 172.21.15.82:0/2562974142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fdc0756d0 msgr2=0x7f4fdc1a02d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:03.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:03.166+0000 7f4fe4600700 1 --2- 172.21.15.82:0/2562974142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fdc0756d0 0x7f4fdc1a02d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4fd00047b0 tx=0x7f4fd0009550 comp rx=0 tx=0).stop 2024-05-08T05:48:03.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:03.166+0000 7f4fe4600700 1 -- 172.21.15.82:0/2562974142 shutdown_connections 2024-05-08T05:48:03.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:03.166+0000 7f4fe4600700 1 --2- 172.21.15.82:0/2562974142 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f4fc40b2900 0x7f4fc40b4dc0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:03.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:03.166+0000 7f4fe4600700 1 --2- 172.21.15.82:0/2562974142 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fdc114670 0x7f4fdc1a4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:03.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:03.166+0000 7f4fe4600700 1 --2- 172.21.15.82:0/2562974142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fdc0756d0 0x7f4fdc1a02d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:03.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:03.166+0000 7f4fe4600700 1 --2- 172.21.15.82:0/2562974142 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fdc075ff0 0x7f4fdc1a0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:03.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:03.166+0000 7f4fe4600700 1 -- 172.21.15.82:0/2562974142 >> 172.21.15.82:0/2562974142 conn(0x7f4fdc07a650 msgr2=0x7f4fdc111500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:03.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:03.166+0000 7f4fe4600700 1 -- 172.21.15.82:0/2562974142 shutdown_connections 2024-05-08T05:48:03.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:03.166+0000 7f4fe4600700 1 -- 172.21.15.82:0/2562974142 wait complete. 2024-05-08T05:48:03.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.195+0000 7f18ef800700 1 -- 172.21.15.82:0/1561752005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18e8109ad0 msgr2=0x7f18e8109f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:03.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.195+0000 7f18ef800700 1 --2- 172.21.15.82:0/1561752005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18e8109ad0 0x7f18e8109f50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f18d4009990 tx=0x7f18d4009ca0 comp rx=0 tx=0).stop 2024-05-08T05:48:03.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.196+0000 7f18ef800700 1 -- 172.21.15.82:0/1561752005 shutdown_connections 2024-05-08T05:48:03.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.196+0000 7f18ef800700 1 --2- 172.21.15.82:0/1561752005 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18e810a490 0x7f18e81169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:03.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.196+0000 7f18ef800700 1 --2- 172.21.15.82:0/1561752005 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18e810fb60 0x7f18e810ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:03.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.196+0000 7f18ef800700 1 --2- 172.21.15.82:0/1561752005 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18e8109ad0 0x7f18e8109f50 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:03.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.196+0000 7f18ef800700 1 -- 172.21.15.82:0/1561752005 >> 172.21.15.82:0/1561752005 conn(0x7f18e8076c70 msgr2=0x7f18e81082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:03.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.196+0000 7f18ef800700 1 -- 172.21.15.82:0/1561752005 shutdown_connections 2024-05-08T05:48:03.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.196+0000 7f18ef800700 1 -- 172.21.15.82:0/1561752005 wait complete. 2024-05-08T05:48:03.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.197+0000 7f18ef800700 1 Processor -- start 2024-05-08T05:48:03.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.197+0000 7f18ef800700 1 -- start start 2024-05-08T05:48:03.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.197+0000 7f18ef800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18e8109ad0 0x7f18e81a0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:03.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.197+0000 7f18ef800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18e810a490 0x7f18e81a0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:03.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.197+0000 7f18ef800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18e810fb60 0x7f18e81a4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:03.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.197+0000 7f18ef800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f18e8119d10 con 0x7f18e810fb60 2024-05-08T05:48:03.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.197+0000 7f18ef800700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f18e8119b90 con 0x7f18e810a490 2024-05-08T05:48:03.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.197+0000 7f18ef800700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f18e8119e90 con 0x7f18e8109ad0 2024-05-08T05:48:03.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.198+0000 7f18ed800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18e810fb60 0x7f18e81a4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:03.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.198+0000 7f18ece00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18e8109ad0 0x7f18e81a0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:03.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.198+0000 7f18e7e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18e810a490 0x7f18e81a0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:03.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.198+0000 7f18ed800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18e810fb60 0x7f18e81a4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54160/0 (socket says 172.21.15.82:54160) 2024-05-08T05:48:03.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.198+0000 7f18ed800700 1 -- 172.21.15.82:0/844244998 learned_addr learned my addr 172.21.15.82:0/844244998 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:48:03.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.198+0000 7f18e7e00700 1 -- 172.21.15.82:0/844244998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18e8109ad0 msgr2=0x7f18e81a0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:03.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.198+0000 7f18e7e00700 1 --2- 172.21.15.82:0/844244998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18e8109ad0 0x7f18e81a0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:03.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.198+0000 7f18e7e00700 1 -- 172.21.15.82:0/844244998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18e810fb60 msgr2=0x7f18e81a4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:03.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.198+0000 7f18e7e00700 1 --2- 172.21.15.82:0/844244998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18e810fb60 0x7f18e81a4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:03.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.198+0000 7f18e7e00700 1 -- 172.21.15.82:0/844244998 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18e81a5150 con 0x7f18e810a490 2024-05-08T05:48:03.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.198+0000 7f18ed800700 1 --2- 172.21.15.82:0/844244998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18e810fb60 0x7f18e81a4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:48:03.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.199+0000 7f18e7e00700 1 --2- 172.21.15.82:0/844244998 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18e810a490 0x7f18e81a0680 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f18d40059d0 tx=0x7f18d40047b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:03.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.199+0000 7f18e5600700 1 -- 172.21.15.82:0/844244998 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d4027070 con 0x7f18e810a490 2024-05-08T05:48:03.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.199+0000 7f18e5600700 1 -- 172.21.15.82:0/844244998 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f18d4022470 con 0x7f18e810a490 2024-05-08T05:48:03.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.199+0000 7f18ef800700 1 -- 172.21.15.82:0/844244998 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18e81a53e0 con 0x7f18e810a490 2024-05-08T05:48:03.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.199+0000 7f18e5600700 1 -- 172.21.15.82:0/844244998 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d4017650 con 0x7f18e810a490 2024-05-08T05:48:03.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.199+0000 7f18ef800700 1 -- 172.21.15.82:0/844244998 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18e81accc0 con 0x7f18e810a490 2024-05-08T05:48:03.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.200+0000 7f18ef800700 1 -- 172.21.15.82:0/844244998 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18e8112060 con 0x7f18e810a490 2024-05-08T05:48:03.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.202+0000 7f18e5600700 1 -- 172.21.15.82:0/844244998 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f18d402a070 con 0x7f18e810a490 2024-05-08T05:48:03.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.204+0000 7f18e5600700 1 --2- 172.21.15.82:0/844244998 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f18d00b2880 0x7f18d00b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:03.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.204+0000 7f18e5600700 1 -- 172.21.15.82:0/844244998 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f18d40e3320 con 0x7f18e810a490 2024-05-08T05:48:03.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.204+0000 7f18ece00700 1 --2- 172.21.15.82:0/844244998 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f18d00b2880 0x7f18d00b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:03.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.205+0000 7f18ece00700 1 --2- 172.21.15.82:0/844244998 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f18d00b2880 0x7f18d00b4d40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f18dc009be0 tx=0x7f18dc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:03.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.206+0000 7f18e5600700 1 -- 172.21.15.82:0/844244998 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f18d4013070 con 0x7f18e810a490 2024-05-08T05:48:03.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.474+0000 7f18ef800700 1 -- 172.21.15.82:0/844244998 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f18e81a14a0 con 0x7f18e810a490 2024-05-08T05:48:03.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.475+0000 7f18e5600700 1 -- 172.21.15.82:0/844244998 <== mon.2 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f18d40ab080 con 0x7f18e810a490 2024-05-08T05:48:03.172 INFO:teuthology.orchestra.run.smithi082.stdout:158913790028 2024-05-08T05:48:03.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.478+0000 7f18ef800700 1 -- 172.21.15.82:0/844244998 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f18d00b2880 msgr2=0x7f18d00b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:03.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.478+0000 7f18ef800700 1 --2- 172.21.15.82:0/844244998 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f18d00b2880 0x7f18d00b4d40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f18dc009be0 tx=0x7f18dc009260 comp rx=0 tx=0).stop 2024-05-08T05:48:03.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.478+0000 7f18ef800700 1 -- 172.21.15.82:0/844244998 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18e810a490 msgr2=0x7f18e81a0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:03.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.478+0000 7f18ef800700 1 --2- 172.21.15.82:0/844244998 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18e810a490 0x7f18e81a0680 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f18d40059d0 tx=0x7f18d40047b0 comp rx=0 tx=0).stop 2024-05-08T05:48:03.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.478+0000 7f18ef800700 1 -- 172.21.15.82:0/844244998 shutdown_connections 2024-05-08T05:48:03.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.478+0000 7f18ef800700 1 --2- 172.21.15.82:0/844244998 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f18d00b2880 0x7f18d00b4d40 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:03.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.478+0000 7f18ef800700 1 --2- 172.21.15.82:0/844244998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f18e810fb60 0x7f18e81a4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:03.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.478+0000 7f18ef800700 1 --2- 172.21.15.82:0/844244998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18e8109ad0 0x7f18e81a0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:03.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.478+0000 7f18ef800700 1 --2- 172.21.15.82:0/844244998 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18e810a490 0x7f18e81a0680 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:03.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.478+0000 7f18ef800700 1 -- 172.21.15.82:0/844244998 >> 172.21.15.82:0/844244998 conn(0x7f18e8076c70 msgr2=0x7f18e8077290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:03.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.478+0000 7f18ef800700 1 -- 172.21.15.82:0/844244998 shutdown_connections 2024-05-08T05:48:03.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:01.478+0000 7f18ef800700 1 -- 172.21.15.82:0/844244998 wait complete. 2024-05-08T05:48:03.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:48:02 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/4100676774' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-08T05:48:04.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:48:03 smithi151 ceph-mon[34815]: pgmap v381: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:48:04.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:48:03 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/2562974142' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-08T05:48:04.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:48:03 smithi082 ceph-mon[30098]: pgmap v381: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:48:04.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:48:03 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/2562974142' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-08T05:48:04.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:48:03 smithi134 ceph-mon[34132]: pgmap v381: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:48:04.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:48:03 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/2562974142' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-08T05:48:04.325 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738465 got 34359738469 for osd.0 2024-05-08T05:48:04.325 DEBUG:teuthology.parallel:result is None 2024-05-08T05:48:04.880 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913790023 got 158913790028 for osd.5 2024-05-08T05:48:04.880 DEBUG:teuthology.parallel:result is None 2024-05-08T05:48:04.956 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574941 got 55834574946 for osd.1 2024-05-08T05:48:04.956 DEBUG:teuthology.parallel:result is None 2024-05-08T05:48:05.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:05.615+0000 7f9150400700 1 -- 172.21.15.82:0/2725442626 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9148106080 msgr2=0x7f9148112590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:05.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:05.615+0000 7f9150400700 1 --2- 172.21.15.82:0/2725442626 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9148106080 0x7f9148112590 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f914000b0a0 tx=0x7f914000b3b0 comp rx=0 tx=0).stop 2024-05-08T05:48:05.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:05.615+0000 7f9150400700 1 -- 172.21.15.82:0/2725442626 shutdown_connections 2024-05-08T05:48:05.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:05.615+0000 7f9150400700 1 --2- 172.21.15.82:0/2725442626 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f914810b6c0 0x7f914810baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:05.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:05.615+0000 7f9150400700 1 --2- 172.21.15.82:0/2725442626 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9148106080 0x7f9148112590 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:05.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:05.615+0000 7f9150400700 1 --2- 172.21.15.82:0/2725442626 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f91481056c0 0x7f9148105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:05.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:05.615+0000 7f9150400700 1 -- 172.21.15.82:0/2725442626 >> 172.21.15.82:0/2725442626 conn(0x7f91481011b0 msgr2=0x7f91481035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:05.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:05.616+0000 7f9150400700 1 -- 172.21.15.82:0/2725442626 shutdown_connections 2024-05-08T05:48:05.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:05.616+0000 7f9150400700 1 -- 172.21.15.82:0/2725442626 wait complete. 2024-05-08T05:48:05.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:05.617+0000 7f9150400700 1 Processor -- start 2024-05-08T05:48:05.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:05.617+0000 7f9150400700 1 -- start start 2024-05-08T05:48:05.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:05.617+0000 7f9150400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91481056c0 0x7f91481a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:05.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:05.617+0000 7f9150400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9148106080 0x7f91481a1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:05.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:05.617+0000 7f9150400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f914810b6c0 0x7f914819bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:05.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:05.617+0000 7f9150400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9148115900 con 0x7f9148106080 2024-05-08T05:48:05.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:05.617+0000 7f9150400700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9148115780 con 0x7f91481056c0 2024-05-08T05:48:05.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:05.617+0000 7f9150400700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9148115a80 con 0x7f914810b6c0 2024-05-08T05:48:05.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:05.617+0000 7f914d000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9148106080 0x7f91481a1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:05.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:05.617+0000 7f914da00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91481056c0 0x7f91481a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:05.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:05.617+0000 7f914d000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9148106080 0x7f91481a1e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53436/0 (socket says 172.21.15.82:53436) 2024-05-08T05:48:05.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:05.617+0000 7f914d000700 1 -- 172.21.15.82:0/496388486 learned_addr learned my addr 172.21.15.82:0/496388486 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:48:05.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:05.617+0000 7f914e400700 1 --2- 172.21.15.82:0/496388486 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f914810b6c0 0x7f914819bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:05.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:05.618+0000 7f914d000700 1 -- 172.21.15.82:0/496388486 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f914810b6c0 msgr2=0x7f914819bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:05.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:05.618+0000 7f914d000700 1 --2- 172.21.15.82:0/496388486 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f914810b6c0 0x7f914819bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:05.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:05.618+0000 7f914d000700 1 -- 172.21.15.82:0/496388486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91481056c0 msgr2=0x7f91481a1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:05.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:05.618+0000 7f914d000700 1 --2- 172.21.15.82:0/496388486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91481056c0 0x7f91481a1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:05.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:05.618+0000 7f914d000700 1 -- 172.21.15.82:0/496388486 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f914819c260 con 0x7f9148106080 2024-05-08T05:48:05.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:05.618+0000 7f914da00700 1 --2- 172.21.15.82:0/496388486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91481056c0 0x7f91481a1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:48:05.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:05.618+0000 7f914d000700 1 --2- 172.21.15.82:0/496388486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9148106080 0x7f91481a1e80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f913400e9c0 tx=0x7f913400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:05.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:05.618+0000 7f9146000700 1 -- 172.21.15.82:0/496388486 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f913400cbd0 con 0x7f9148106080 2024-05-08T05:48:05.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:05.618+0000 7f9150400700 1 -- 172.21.15.82:0/496388486 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f914819c550 con 0x7f9148106080 2024-05-08T05:48:05.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:05.618+0000 7f9146000700 1 -- 172.21.15.82:0/496388486 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f913400ee60 con 0x7f9148106080 2024-05-08T05:48:05.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:05.618+0000 7f9146000700 1 -- 172.21.15.82:0/496388486 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91340055c0 con 0x7f9148106080 2024-05-08T05:48:05.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:05.618+0000 7f9150400700 1 -- 172.21.15.82:0/496388486 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91481a8810 con 0x7f9148106080 2024-05-08T05:48:05.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:05.620+0000 7f9150400700 1 -- 172.21.15.82:0/496388486 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f914806a190 con 0x7f9148106080 2024-05-08T05:48:05.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:05.622+0000 7f9146000700 1 -- 172.21.15.82:0/496388486 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f9134004750 con 0x7f9148106080 2024-05-08T05:48:05.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:05.623+0000 7f9146000700 1 --2- 172.21.15.82:0/496388486 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f91300b2880 0x7f91300b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:05.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:05.624+0000 7f9146000700 1 -- 172.21.15.82:0/496388486 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f91340e24e0 con 0x7f9148106080 2024-05-08T05:48:05.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:05.624+0000 7f914da00700 1 --2- 172.21.15.82:0/496388486 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f91300b2880 0x7f91300b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:05.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:05.625+0000 7f914da00700 1 --2- 172.21.15.82:0/496388486 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f91300b2880 0x7f91300b4d40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f913c009fd0 tx=0x7f913c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:05.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:05.628+0000 7f9146000700 1 -- 172.21.15.82:0/496388486 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f91340aa1b0 con 0x7f9148106080 2024-05-08T05:48:05.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:05.867+0000 7f9150400700 1 -- 172.21.15.82:0/496388486 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f914802e510 con 0x7f9148106080 2024-05-08T05:48:05.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:05.868+0000 7f9146000700 1 -- 172.21.15.82:0/496388486 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f91340a9ab0 con 0x7f9148106080 2024-05-08T05:48:05.869 INFO:teuthology.orchestra.run.smithi082.stdout:137438953553 2024-05-08T05:48:05.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:05.872+0000 7f9150400700 1 -- 172.21.15.82:0/496388486 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f91300b2880 msgr2=0x7f91300b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:05.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:05.872+0000 7f9150400700 1 --2- 172.21.15.82:0/496388486 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f91300b2880 0x7f91300b4d40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f913c009fd0 tx=0x7f913c009260 comp rx=0 tx=0).stop 2024-05-08T05:48:05.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:05.872+0000 7f9150400700 1 -- 172.21.15.82:0/496388486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9148106080 msgr2=0x7f91481a1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:05.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:05.872+0000 7f9150400700 1 --2- 172.21.15.82:0/496388486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9148106080 0x7f91481a1e80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f913400e9c0 tx=0x7f913400ecd0 comp rx=0 tx=0).stop 2024-05-08T05:48:05.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:05.872+0000 7f9150400700 1 -- 172.21.15.82:0/496388486 shutdown_connections 2024-05-08T05:48:05.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:05.872+0000 7f9150400700 1 --2- 172.21.15.82:0/496388486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91481056c0 0x7f91481a1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:05.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:05.872+0000 7f9150400700 1 --2- 172.21.15.82:0/496388486 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f91300b2880 0x7f91300b4d40 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:05.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:05.872+0000 7f9150400700 1 --2- 172.21.15.82:0/496388486 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f914810b6c0 0x7f914819bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:05.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:05.872+0000 7f9150400700 1 --2- 172.21.15.82:0/496388486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9148106080 0x7f91481a1e80 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:05.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:05.872+0000 7f9150400700 1 -- 172.21.15.82:0/496388486 >> 172.21.15.82:0/496388486 conn(0x7f91481011b0 msgr2=0x7f91481017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:05.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:05.873+0000 7f9150400700 1 -- 172.21.15.82:0/496388486 shutdown_connections 2024-05-08T05:48:05.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:05.873+0000 7f9150400700 1 -- 172.21.15.82:0/496388486 wait complete. 2024-05-08T05:48:05.881 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:48:05 smithi082 ceph-mon[30098]: pgmap v382: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-08T05:48:06.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:48:05 smithi151 ceph-mon[34815]: pgmap v382: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-08T05:48:06.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:48:05 smithi134 ceph-mon[34132]: pgmap v382: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-08T05:48:06.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:48:06 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/496388486' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-08T05:48:07.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:48:06 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/496388486' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-08T05:48:07.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:48:06 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/496388486' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-08T05:48:07.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:07.501+0000 7f15d2400700 1 -- 172.21.15.82:0/1896694062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15cc10fc70 msgr2=0x7f15cc112080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:07.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:07.501+0000 7f15d2400700 1 --2- 172.21.15.82:0/1896694062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15cc10fc70 0x7f15cc112080 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f15c400b0a0 tx=0x7f15c400b3b0 comp rx=0 tx=0).stop 2024-05-08T05:48:07.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:07.501+0000 7f15d2400700 1 -- 172.21.15.82:0/1896694062 shutdown_connections 2024-05-08T05:48:07.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:07.501+0000 7f15d2400700 1 --2- 172.21.15.82:0/1896694062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15cc10fc70 0x7f15cc112080 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:07.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:07.501+0000 7f15d2400700 1 --2- 172.21.15.82:0/1896694062 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f15cc075870 0x7f15cc075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:07.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:07.501+0000 7f15d2400700 1 --2- 172.21.15.82:0/1896694062 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15cc076190 0x7f15cc10f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:07.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:07.501+0000 7f15d2400700 1 -- 172.21.15.82:0/1896694062 >> 172.21.15.82:0/1896694062 conn(0x7f15cc0fef20 msgr2=0x7f15cc101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:07.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:07.501+0000 7f15d2400700 1 -- 172.21.15.82:0/1896694062 shutdown_connections 2024-05-08T05:48:07.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:07.501+0000 7f15d2400700 1 -- 172.21.15.82:0/1896694062 wait complete. 2024-05-08T05:48:07.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:07.502+0000 7f15d2400700 1 Processor -- start 2024-05-08T05:48:07.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:07.503+0000 7f15d2400700 1 -- start start 2024-05-08T05:48:07.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:07.503+0000 7f15d2400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f15cc075870 0x7f15cc1a18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:07.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:07.503+0000 7f15d2400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15cc076190 0x7f15cc1a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:07.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:07.503+0000 7f15d2400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15cc10fc70 0x7f15cc19baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:07.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:07.503+0000 7f15d2400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f15cc1157e0 con 0x7f15cc10fc70 2024-05-08T05:48:07.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:07.503+0000 7f15d2400700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f15cc115660 con 0x7f15cc076190 2024-05-08T05:48:07.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:07.503+0000 7f15d2400700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f15cc115960 con 0x7f15cc075870 2024-05-08T05:48:07.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:07.503+0000 7f15d1000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f15cc075870 0x7f15cc1a18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:07.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:07.504+0000 7f15d1a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15cc10fc70 0x7f15cc19baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:07.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:07.504+0000 7f15cbe00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15cc076190 0x7f15cc1a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:07.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:07.504+0000 7f15d1000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f15cc075870 0x7f15cc1a18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:35548/0 (socket says 172.21.15.82:35548) 2024-05-08T05:48:07.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:07.504+0000 7f15d1000700 1 -- 172.21.15.82:0/1194216441 learned_addr learned my addr 172.21.15.82:0/1194216441 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:48:07.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:07.504+0000 7f15d1000700 1 -- 172.21.15.82:0/1194216441 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15cc076190 msgr2=0x7f15cc1a1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:07.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:07.504+0000 7f15d1000700 1 --2- 172.21.15.82:0/1194216441 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15cc076190 0x7f15cc1a1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:07.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:07.504+0000 7f15d1000700 1 -- 172.21.15.82:0/1194216441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15cc10fc70 msgr2=0x7f15cc19baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:07.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:07.504+0000 7f15d1000700 1 --2- 172.21.15.82:0/1194216441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15cc10fc70 0x7f15cc19baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:07.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:07.504+0000 7f15d1000700 1 -- 172.21.15.82:0/1194216441 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15cc19c200 con 0x7f15cc075870 2024-05-08T05:48:07.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:07.504+0000 7f15d1000700 1 --2- 172.21.15.82:0/1194216441 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f15cc075870 0x7f15cc1a18e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f15c000e9a0 tx=0x7f15c000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:07.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:07.505+0000 7f15c9600700 1 -- 172.21.15.82:0/1194216441 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c000ca10 con 0x7f15cc075870 2024-05-08T05:48:07.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:07.505+0000 7f15c9600700 1 -- 172.21.15.82:0/1194216441 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f15c000cbb0 con 0x7f15cc075870 2024-05-08T05:48:07.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:07.505+0000 7f15c9600700 1 -- 172.21.15.82:0/1194216441 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15c0018680 con 0x7f15cc075870 2024-05-08T05:48:07.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:07.505+0000 7f15d2400700 1 -- 172.21.15.82:0/1194216441 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15cc19c4f0 con 0x7f15cc075870 2024-05-08T05:48:07.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:07.505+0000 7f15d2400700 1 -- 172.21.15.82:0/1194216441 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15cc1032c0 con 0x7f15cc075870 2024-05-08T05:48:07.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:07.506+0000 7f15d2400700 1 -- 172.21.15.82:0/1194216441 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15cc06a190 con 0x7f15cc075870 2024-05-08T05:48:07.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:07.508+0000 7f15c9600700 1 -- 172.21.15.82:0/1194216441 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f15c0010430 con 0x7f15cc075870 2024-05-08T05:48:07.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:07.510+0000 7f15c9600700 1 --2- 172.21.15.82:0/1194216441 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f15b40b2880 0x7f15b40b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:07.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:07.510+0000 7f15c9600700 1 -- 172.21.15.82:0/1194216441 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f15c00e2710 con 0x7f15cc075870 2024-05-08T05:48:07.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:07.510+0000 7f15cbe00700 1 --2- 172.21.15.82:0/1194216441 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f15b40b2880 0x7f15b40b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:07.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:07.511+0000 7f15cbe00700 1 --2- 172.21.15.82:0/1194216441 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f15b40b2880 0x7f15b40b4d40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f15cc110f20 tx=0x7f15b8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:07.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:07.512+0000 7f15c9600700 1 -- 172.21.15.82:0/1194216441 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f15c00aa3e0 con 0x7f15cc075870 2024-05-08T05:48:07.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:07.795+0000 7f15d2400700 1 -- 172.21.15.82:0/1194216441 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f15cc02e510 con 0x7f15cc075870 2024-05-08T05:48:07.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:07.795+0000 7f15c9600700 1 -- 172.21.15.82:0/1194216441 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f15c00a9ce0 con 0x7f15cc075870 2024-05-08T05:48:07.796 INFO:teuthology.orchestra.run.smithi082.stdout:231928234044 2024-05-08T05:48:07.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:07.799+0000 7f15d2400700 1 -- 172.21.15.82:0/1194216441 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f15b40b2880 msgr2=0x7f15b40b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:07.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:07.799+0000 7f15d2400700 1 --2- 172.21.15.82:0/1194216441 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f15b40b2880 0x7f15b40b4d40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f15cc110f20 tx=0x7f15b8009260 comp rx=0 tx=0).stop 2024-05-08T05:48:07.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:07.799+0000 7f15d2400700 1 -- 172.21.15.82:0/1194216441 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f15cc075870 msgr2=0x7f15cc1a18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:07.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:07.799+0000 7f15d2400700 1 --2- 172.21.15.82:0/1194216441 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f15cc075870 0x7f15cc1a18e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f15c000e9a0 tx=0x7f15c000ecb0 comp rx=0 tx=0).stop 2024-05-08T05:48:07.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:07.799+0000 7f15d2400700 1 -- 172.21.15.82:0/1194216441 shutdown_connections 2024-05-08T05:48:07.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:07.799+0000 7f15d2400700 1 --2- 172.21.15.82:0/1194216441 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f15b40b2880 0x7f15b40b4d40 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:07.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:07.799+0000 7f15d2400700 1 --2- 172.21.15.82:0/1194216441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f15cc10fc70 0x7f15cc19baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:07.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:07.799+0000 7f15d2400700 1 --2- 172.21.15.82:0/1194216441 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f15cc075870 0x7f15cc1a18e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:07.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:07.799+0000 7f15d2400700 1 --2- 172.21.15.82:0/1194216441 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15cc076190 0x7f15cc1a1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:07.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:07.799+0000 7f15d2400700 1 -- 172.21.15.82:0/1194216441 >> 172.21.15.82:0/1194216441 conn(0x7f15cc0fef20 msgr2=0x7f15cc0ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:07.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:07.799+0000 7f15d2400700 1 -- 172.21.15.82:0/1194216441 shutdown_connections 2024-05-08T05:48:07.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:07.799+0000 7f15d2400700 1 -- 172.21.15.82:0/1194216441 wait complete. 2024-05-08T05:48:07.955 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:48:07 smithi082 ceph-mon[30098]: pgmap v383: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-08T05:48:07.955 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:48:07 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/1194216441' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-08T05:48:08.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:48:07 smithi151 ceph-mon[34815]: pgmap v383: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-08T05:48:08.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:48:07 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/1194216441' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-08T05:48:08.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:48:07 smithi134 ceph-mon[34132]: pgmap v383: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-08T05:48:08.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:48:07 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/1194216441' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-08T05:48:08.441 INFO:tasks.cephadm.ceph_manager.ceph:need seq 309237645349 got 309237645353 for osd.11 2024-05-08T05:48:08.441 DEBUG:teuthology.parallel:result is None 2024-05-08T05:48:09.105 INFO:tasks.cephadm.ceph_manager.ceph:need seq 257698037806 got 257698037813 for osd.9 2024-05-08T05:48:09.105 DEBUG:teuthology.parallel:result is None 2024-05-08T05:48:09.681 INFO:tasks.cephadm.ceph_manager.ceph:need seq 231928234039 got 231928234044 for osd.8 2024-05-08T05:48:09.682 DEBUG:teuthology.parallel:result is None 2024-05-08T05:48:10.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:48:09 smithi151 ceph-mon[34815]: pgmap v384: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:48:10.130 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:48:09 smithi082 ceph-mon[30098]: pgmap v384: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:48:10.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:48:09 smithi134 ceph-mon[34132]: pgmap v384: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:48:10.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:10.285+0000 7f7749400700 1 -- 172.21.15.82:0/3608692336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7744102450 msgr2=0x7f7744110340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:10.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:10.285+0000 7f7749400700 1 --2- 172.21.15.82:0/3608692336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7744102450 0x7f7744110340 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f773c00b0a0 tx=0x7f773c00b3b0 comp rx=0 tx=0).stop 2024-05-08T05:48:10.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:10.285+0000 7f7749400700 1 -- 172.21.15.82:0/3608692336 shutdown_connections 2024-05-08T05:48:10.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:10.285+0000 7f7749400700 1 --2- 172.21.15.82:0/3608692336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7744102450 0x7f7744110340 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:10.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:10.285+0000 7f7749400700 1 --2- 172.21.15.82:0/3608692336 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7744109520 0x7f7744109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:10.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:10.285+0000 7f7749400700 1 --2- 172.21.15.82:0/3608692336 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7744101a90 0x7f7744101f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:10.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:10.285+0000 7f7749400700 1 -- 172.21.15.82:0/3608692336 >> 172.21.15.82:0/3608692336 conn(0x7f7744078a10 msgr2=0x7f77440ffdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:10.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:10.285+0000 7f7749400700 1 -- 172.21.15.82:0/3608692336 shutdown_connections 2024-05-08T05:48:10.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:10.285+0000 7f7749400700 1 -- 172.21.15.82:0/3608692336 wait complete. 2024-05-08T05:48:10.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:10.286+0000 7f7749400700 1 Processor -- start 2024-05-08T05:48:10.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:10.286+0000 7f7749400700 1 -- start start 2024-05-08T05:48:10.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:10.286+0000 7f7749400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7744101a90 0x7f774419f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:10.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:10.286+0000 7f7749400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7744102450 0x7f774419fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:10.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:10.287+0000 7f7749400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7744109520 0x7f7744199a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:10.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:10.287+0000 7f7749400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f77441136a0 con 0x7f7744101a90 2024-05-08T05:48:10.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:10.287+0000 7f7749400700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7744113520 con 0x7f7744102450 2024-05-08T05:48:10.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:10.287+0000 7f7749400700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7744113820 con 0x7f7744109520 2024-05-08T05:48:10.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:10.287+0000 7f7742800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7744101a90 0x7f774419f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:10.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:10.287+0000 7f7742800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7744101a90 0x7f774419f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53466/0 (socket says 172.21.15.82:53466) 2024-05-08T05:48:10.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:10.287+0000 7f7742800700 1 -- 172.21.15.82:0/4202174216 learned_addr learned my addr 172.21.15.82:0/4202174216 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:48:10.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:10.287+0000 7f7741e00700 1 --2- 172.21.15.82:0/4202174216 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7744102450 0x7f774419fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:10.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:10.287+0000 7f7743200700 1 --2- 172.21.15.82:0/4202174216 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7744109520 0x7f7744199a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:10.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:10.287+0000 7f7742800700 1 -- 172.21.15.82:0/4202174216 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7744109520 msgr2=0x7f7744199a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:10.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:10.287+0000 7f7742800700 1 --2- 172.21.15.82:0/4202174216 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7744109520 0x7f7744199a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:10.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:10.287+0000 7f7742800700 1 -- 172.21.15.82:0/4202174216 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7744102450 msgr2=0x7f774419fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:10.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:10.287+0000 7f7742800700 1 --2- 172.21.15.82:0/4202174216 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7744102450 0x7f774419fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:10.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:10.287+0000 7f7742800700 1 -- 172.21.15.82:0/4202174216 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f774419a160 con 0x7f7744101a90 2024-05-08T05:48:10.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:10.288+0000 7f7742800700 1 --2- 172.21.15.82:0/4202174216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7744101a90 0x7f774419f840 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f773400e9c0 tx=0x7f773400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:10.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:10.288+0000 7f773b400700 1 -- 172.21.15.82:0/4202174216 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f773400cbd0 con 0x7f7744101a90 2024-05-08T05:48:10.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:10.288+0000 7f773b400700 1 -- 172.21.15.82:0/4202174216 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f773400ee60 con 0x7f7744101a90 2024-05-08T05:48:10.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:10.288+0000 7f7749400700 1 -- 172.21.15.82:0/4202174216 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f774419a450 con 0x7f7744101a90 2024-05-08T05:48:10.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:10.288+0000 7f773b400700 1 -- 172.21.15.82:0/4202174216 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77340055c0 con 0x7f7744101a90 2024-05-08T05:48:10.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:10.288+0000 7f7749400700 1 -- 172.21.15.82:0/4202174216 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77441a6710 con 0x7f7744101a90 2024-05-08T05:48:10.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:10.289+0000 7f7749400700 1 -- 172.21.15.82:0/4202174216 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f774406a190 con 0x7f7744101a90 2024-05-08T05:48:10.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:10.292+0000 7f773b400700 1 -- 172.21.15.82:0/4202174216 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f7734004750 con 0x7f7744101a90 2024-05-08T05:48:10.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:10.293+0000 7f773b400700 1 --2- 172.21.15.82:0/4202174216 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f77280b2900 0x7f77280b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:10.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:10.293+0000 7f773b400700 1 -- 172.21.15.82:0/4202174216 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f77340e2620 con 0x7f7744101a90 2024-05-08T05:48:10.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:10.293+0000 7f7741e00700 1 --2- 172.21.15.82:0/4202174216 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f77280b2900 0x7f77280b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:10.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:10.294+0000 7f7741e00700 1 --2- 172.21.15.82:0/4202174216 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f77280b2900 0x7f77280b4dc0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7744108c40 tx=0x7f7730009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:10.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:10.296+0000 7f773b400700 1 -- 172.21.15.82:0/4202174216 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f7734054df0 con 0x7f7744101a90 2024-05-08T05:48:10.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:10.531+0000 7f7749400700 1 -- 172.21.15.82:0/4202174216 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f774419af30 con 0x7f7744101a90 2024-05-08T05:48:10.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:10.531+0000 7f773b400700 1 -- 172.21.15.82:0/4202174216 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f77340aa2f0 con 0x7f7744101a90 2024-05-08T05:48:10.533 INFO:teuthology.orchestra.run.smithi082.stdout:111669149784 2024-05-08T05:48:10.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:10.534+0000 7f7749400700 1 -- 172.21.15.82:0/4202174216 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f77280b2900 msgr2=0x7f77280b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:10.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:10.534+0000 7f7749400700 1 --2- 172.21.15.82:0/4202174216 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f77280b2900 0x7f77280b4dc0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7744108c40 tx=0x7f7730009260 comp rx=0 tx=0).stop 2024-05-08T05:48:10.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:10.534+0000 7f7749400700 1 -- 172.21.15.82:0/4202174216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7744101a90 msgr2=0x7f774419f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:10.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:10.534+0000 7f7749400700 1 --2- 172.21.15.82:0/4202174216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7744101a90 0x7f774419f840 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f773400e9c0 tx=0x7f773400ecd0 comp rx=0 tx=0).stop 2024-05-08T05:48:10.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:10.535+0000 7f7749400700 1 -- 172.21.15.82:0/4202174216 shutdown_connections 2024-05-08T05:48:10.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:10.535+0000 7f7749400700 1 --2- 172.21.15.82:0/4202174216 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f77280b2900 0x7f77280b4dc0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:10.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:10.535+0000 7f7749400700 1 --2- 172.21.15.82:0/4202174216 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7744109520 0x7f7744199a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:10.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:10.535+0000 7f7749400700 1 --2- 172.21.15.82:0/4202174216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7744101a90 0x7f774419f840 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:10.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:10.535+0000 7f7749400700 1 --2- 172.21.15.82:0/4202174216 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7744102450 0x7f774419fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:10.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:10.535+0000 7f7749400700 1 -- 172.21.15.82:0/4202174216 >> 172.21.15.82:0/4202174216 conn(0x7f7744078a10 msgr2=0x7f7744100150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:10.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:10.535+0000 7f7749400700 1 -- 172.21.15.82:0/4202174216 shutdown_connections 2024-05-08T05:48:10.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:10.535+0000 7f7749400700 1 -- 172.21.15.82:0/4202174216 wait complete. 2024-05-08T05:48:10.907 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953548 got 137438953553 for osd.4 2024-05-08T05:48:10.907 DEBUG:teuthology.parallel:result is None 2024-05-08T05:48:11.111 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:48:10 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/4202174216' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-08T05:48:11.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:48:10 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/4202174216' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-08T05:48:11.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.145+0000 7f882dc00700 1 -- 172.21.15.82:0/2487685125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8828109ad0 msgr2=0x7f8828109f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:11.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.145+0000 7f882dc00700 1 --2- 172.21.15.82:0/2487685125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8828109ad0 0x7f8828109f50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8810009990 tx=0x7f8810009ca0 comp rx=0 tx=0).stop 2024-05-08T05:48:11.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.145+0000 7f882dc00700 1 -- 172.21.15.82:0/2487685125 shutdown_connections 2024-05-08T05:48:11.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.145+0000 7f882dc00700 1 --2- 172.21.15.82:0/2487685125 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f882810a490 0x7f88281169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:11.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.145+0000 7f882dc00700 1 --2- 172.21.15.82:0/2487685125 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f882810fb60 0x7f882810ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:11.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.145+0000 7f882dc00700 1 --2- 172.21.15.82:0/2487685125 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8828109ad0 0x7f8828109f50 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:11.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.145+0000 7f882dc00700 1 -- 172.21.15.82:0/2487685125 >> 172.21.15.82:0/2487685125 conn(0x7f8828076c70 msgr2=0x7f88281082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:11.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.145+0000 7f882dc00700 1 -- 172.21.15.82:0/2487685125 shutdown_connections 2024-05-08T05:48:11.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.146+0000 7f882dc00700 1 -- 172.21.15.82:0/2487685125 wait complete. 2024-05-08T05:48:11.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.147+0000 7f882dc00700 1 Processor -- start 2024-05-08T05:48:11.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.147+0000 7f882dc00700 1 -- start start 2024-05-08T05:48:11.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.147+0000 7f882dc00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8828109ad0 0x7f88281a0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:11.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.147+0000 7f882dc00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f882810a490 0x7f88281a0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:11.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.147+0000 7f882dc00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f882810fb60 0x7f88281a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:11.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.148+0000 7f882dc00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8828119d10 con 0x7f882810a490 2024-05-08T05:48:11.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.148+0000 7f882dc00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8828119b90 con 0x7f882810fb60 2024-05-08T05:48:11.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.148+0000 7f882dc00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8828119e90 con 0x7f8828109ad0 2024-05-08T05:48:11.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.148+0000 7f8826a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8828109ad0 0x7f88281a0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:11.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.148+0000 7f8826a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8828109ad0 0x7f88281a0200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:35588/0 (socket says 172.21.15.82:35588) 2024-05-08T05:48:11.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.148+0000 7f881fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f882810a490 0x7f88281a0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:11.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.148+0000 7f8826a00700 1 -- 172.21.15.82:0/1898817639 learned_addr learned my addr 172.21.15.82:0/1898817639 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:48:11.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.148+0000 7f8827400700 1 --2- 172.21.15.82:0/1898817639 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f882810fb60 0x7f88281a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:11.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.148+0000 7f881fe00700 1 -- 172.21.15.82:0/1898817639 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8828109ad0 msgr2=0x7f88281a0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:11.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.148+0000 7f881fe00700 1 --2- 172.21.15.82:0/1898817639 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8828109ad0 0x7f88281a0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:11.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.148+0000 7f881fe00700 1 -- 172.21.15.82:0/1898817639 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f882810fb60 msgr2=0x7f88281a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:11.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.148+0000 7f881fe00700 1 --2- 172.21.15.82:0/1898817639 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f882810fb60 0x7f88281a4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:11.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.148+0000 7f881fe00700 1 -- 172.21.15.82:0/1898817639 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88281a5210 con 0x7f882810a490 2024-05-08T05:48:11.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.148+0000 7f8826a00700 1 --2- 172.21.15.82:0/1898817639 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8828109ad0 0x7f88281a0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:48:11.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.149+0000 7f881fe00700 1 --2- 172.21.15.82:0/1898817639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f882810a490 0x7f88281a0740 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8810006010 tx=0x7f88100057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:11.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.149+0000 7f881f400700 1 -- 172.21.15.82:0/1898817639 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8810027070 con 0x7f882810a490 2024-05-08T05:48:11.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.149+0000 7f881f400700 1 -- 172.21.15.82:0/1898817639 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8810022470 con 0x7f882810a490 2024-05-08T05:48:11.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.149+0000 7f881f400700 1 -- 172.21.15.82:0/1898817639 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8810017650 con 0x7f882810a490 2024-05-08T05:48:11.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.149+0000 7f882dc00700 1 -- 172.21.15.82:0/1898817639 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88281a54a0 con 0x7f882810a490 2024-05-08T05:48:11.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.149+0000 7f882dc00700 1 -- 172.21.15.82:0/1898817639 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88281acd80 con 0x7f882810a490 2024-05-08T05:48:11.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.150+0000 7f882dc00700 1 -- 172.21.15.82:0/1898817639 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8828112060 con 0x7f882810a490 2024-05-08T05:48:11.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.153+0000 7f881f400700 1 -- 172.21.15.82:0/1898817639 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f881002a070 con 0x7f882810a490 2024-05-08T05:48:11.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.154+0000 7f881f400700 1 --2- 172.21.15.82:0/1898817639 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f880c0b2900 0x7f880c0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:11.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.154+0000 7f881f400700 1 -- 172.21.15.82:0/1898817639 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f88100e2e00 con 0x7f882810a490 2024-05-08T05:48:11.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.154+0000 7f8826a00700 1 --2- 172.21.15.82:0/1898817639 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f880c0b2900 0x7f880c0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:11.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.155+0000 7f8826a00700 1 --2- 172.21.15.82:0/1898817639 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f880c0b2900 0x7f880c0b4dc0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8818011550 tx=0x7f8818009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:11.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.157+0000 7f881f400700 1 -- 172.21.15.82:0/1898817639 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f8810013070 con 0x7f882810a490 2024-05-08T05:48:11.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:48:10 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/4202174216' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-08T05:48:11.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.378+0000 7fda11800700 1 -- 172.21.15.82:0/4120223873 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda0c0756d0 msgr2=0x7fda0c075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:11.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.378+0000 7fda11800700 1 --2- 172.21.15.82:0/4120223873 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda0c0756d0 0x7fda0c075ab0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc009990 tx=0x7fd9fc009ca0 comp rx=0 tx=0).stop 2024-05-08T05:48:11.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.378+0000 7fda11800700 1 -- 172.21.15.82:0/4120223873 shutdown_connections 2024-05-08T05:48:11.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.378+0000 7fda11800700 1 --2- 172.21.15.82:0/4120223873 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda0c0756d0 0x7fda0c075ab0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:11.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.378+0000 7fda11800700 1 --2- 172.21.15.82:0/4120223873 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda0c10ff00 0x7fda0c1122f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:11.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.378+0000 7fda11800700 1 --2- 172.21.15.82:0/4120223873 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda0c075ff0 0x7fda0c10f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:11.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.378+0000 7fda11800700 1 -- 172.21.15.82:0/4120223873 >> 172.21.15.82:0/4120223873 conn(0x7fda0c07a600 msgr2=0x7fda0c07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:11.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.378+0000 7fda11800700 1 -- 172.21.15.82:0/4120223873 shutdown_connections 2024-05-08T05:48:11.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.379+0000 7fda11800700 1 -- 172.21.15.82:0/4120223873 wait complete. 2024-05-08T05:48:11.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.380+0000 7fda11800700 1 Processor -- start 2024-05-08T05:48:11.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.380+0000 7fda11800700 1 -- start start 2024-05-08T05:48:11.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.380+0000 7fda11800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda0c0756d0 0x7fda0c1a1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:11.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.381+0000 7fda11800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda0c075ff0 0x7fda0c1a1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:11.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.381+0000 7fda11800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda0c10ff00 0x7fda0c19bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:11.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.381+0000 7fda11800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fda0c1158b0 con 0x7fda0c10ff00 2024-05-08T05:48:11.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.381+0000 7fda11800700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fda0c115730 con 0x7fda0c075ff0 2024-05-08T05:48:11.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.381+0000 7fda11800700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fda0c115a30 con 0x7fda0c0756d0 2024-05-08T05:48:11.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.381+0000 7fda03e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda0c075ff0 0x7fda0c1a1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:11.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.381+0000 7fda03e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda0c075ff0 0x7fda0c1a1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:41902/0 (socket says 172.21.15.82:41902) 2024-05-08T05:48:11.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.381+0000 7fda03e00700 1 -- 172.21.15.82:0/1588607123 learned_addr learned my addr 172.21.15.82:0/1588607123 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:48:11.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.381+0000 7fda0aa00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda0c0756d0 0x7fda0c1a1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:11.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.381+0000 7fda0b400700 1 --2- 172.21.15.82:0/1588607123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda0c10ff00 0x7fda0c19bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:11.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.381+0000 7fda03e00700 1 -- 172.21.15.82:0/1588607123 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda0c0756d0 msgr2=0x7fda0c1a1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:11.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.381+0000 7fda03e00700 1 --2- 172.21.15.82:0/1588607123 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda0c0756d0 0x7fda0c1a1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:11.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.381+0000 7fda03e00700 1 -- 172.21.15.82:0/1588607123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda0c10ff00 msgr2=0x7fda0c19bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:11.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.381+0000 7fda03e00700 1 --2- 172.21.15.82:0/1588607123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda0c10ff00 0x7fda0c19bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:11.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.381+0000 7fda03e00700 1 -- 172.21.15.82:0/1588607123 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda0c19c450 con 0x7fda0c075ff0 2024-05-08T05:48:11.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.382+0000 7fda03e00700 1 --2- 172.21.15.82:0/1588607123 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda0c075ff0 0x7fda0c1a1f90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd9f400e970 tx=0x7fd9f400ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:11.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.382+0000 7fda03400700 1 -- 172.21.15.82:0/1588607123 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f4004220 con 0x7fda0c075ff0 2024-05-08T05:48:11.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.382+0000 7fda03400700 1 -- 172.21.15.82:0/1588607123 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd9f40043c0 con 0x7fda0c075ff0 2024-05-08T05:48:11.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.382+0000 7fda03400700 1 -- 172.21.15.82:0/1588607123 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9f4003ce0 con 0x7fda0c075ff0 2024-05-08T05:48:11.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.382+0000 7fda11800700 1 -- 172.21.15.82:0/1588607123 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda0c19c740 con 0x7fda0c075ff0 2024-05-08T05:48:11.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.382+0000 7fda11800700 1 -- 172.21.15.82:0/1588607123 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda0c1a89d0 con 0x7fda0c075ff0 2024-05-08T05:48:11.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.383+0000 7fda11800700 1 -- 172.21.15.82:0/1588607123 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda0c076db0 con 0x7fda0c075ff0 2024-05-08T05:48:11.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.386+0000 7fda03400700 1 -- 172.21.15.82:0/1588607123 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fd9f400c7e0 con 0x7fda0c075ff0 2024-05-08T05:48:11.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.387+0000 7fda03400700 1 --2- 172.21.15.82:0/1588607123 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd9f00b2880 0x7fd9f00b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:11.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.388+0000 7fda03400700 1 -- 172.21.15.82:0/1588607123 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd9f40e2570 con 0x7fda0c075ff0 2024-05-08T05:48:11.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.388+0000 7fda0aa00700 1 --2- 172.21.15.82:0/1588607123 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd9f00b2880 0x7fd9f00b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:11.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.388+0000 7fda0aa00700 1 --2- 172.21.15.82:0/1588607123 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd9f00b2880 0x7fd9f00b4d40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc0098e0 tx=0x7fd9fc005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:11.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.389+0000 7fda03400700 1 -- 172.21.15.82:0/1588607123 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd9f40aa2d0 con 0x7fda0c075ff0 2024-05-08T05:48:11.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.397+0000 7f882dc00700 1 -- 172.21.15.82:0/1898817639 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f88281a1560 con 0x7f882810a490 2024-05-08T05:48:11.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.397+0000 7f881f400700 1 -- 172.21.15.82:0/1898817639 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f88100aab60 con 0x7f882810a490 2024-05-08T05:48:11.398 INFO:teuthology.orchestra.run.smithi082.stdout:206158430274 2024-05-08T05:48:11.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.400+0000 7f882dc00700 1 -- 172.21.15.82:0/1898817639 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f880c0b2900 msgr2=0x7f880c0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:11.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.400+0000 7f882dc00700 1 --2- 172.21.15.82:0/1898817639 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f880c0b2900 0x7f880c0b4dc0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8818011550 tx=0x7f8818009260 comp rx=0 tx=0).stop 2024-05-08T05:48:11.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.400+0000 7f882dc00700 1 -- 172.21.15.82:0/1898817639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f882810a490 msgr2=0x7f88281a0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:11.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.400+0000 7f882dc00700 1 --2- 172.21.15.82:0/1898817639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f882810a490 0x7f88281a0740 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8810006010 tx=0x7f88100057c0 comp rx=0 tx=0).stop 2024-05-08T05:48:11.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.400+0000 7f882dc00700 1 -- 172.21.15.82:0/1898817639 shutdown_connections 2024-05-08T05:48:11.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.400+0000 7f882dc00700 1 --2- 172.21.15.82:0/1898817639 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f882810fb60 0x7f88281a4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:11.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.400+0000 7f882dc00700 1 --2- 172.21.15.82:0/1898817639 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f880c0b2900 0x7f880c0b4dc0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:11.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.400+0000 7f882dc00700 1 --2- 172.21.15.82:0/1898817639 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8828109ad0 0x7f88281a0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:11.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.400+0000 7f882dc00700 1 --2- 172.21.15.82:0/1898817639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f882810a490 0x7f88281a0740 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:11.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.400+0000 7f882dc00700 1 -- 172.21.15.82:0/1898817639 >> 172.21.15.82:0/1898817639 conn(0x7f8828076c70 msgr2=0x7f8828077330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:11.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.401+0000 7f882dc00700 1 -- 172.21.15.82:0/1898817639 shutdown_connections 2024-05-08T05:48:11.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.401+0000 7f882dc00700 1 -- 172.21.15.82:0/1898817639 wait complete. 2024-05-08T05:48:11.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.626+0000 7fda11800700 1 -- 172.21.15.82:0/1588607123 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fda0c1a8ba0 con 0x7fda0c075ff0 2024-05-08T05:48:11.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.627+0000 7fda03400700 1 -- 172.21.15.82:0/1588607123 <== mon.2 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fd9f40a9bd0 con 0x7fda0c075ff0 2024-05-08T05:48:11.628 INFO:teuthology.orchestra.run.smithi082.stdout:283467841586 2024-05-08T05:48:11.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.630+0000 7fda11800700 1 -- 172.21.15.82:0/1588607123 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd9f00b2880 msgr2=0x7fd9f00b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:11.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.630+0000 7fda11800700 1 --2- 172.21.15.82:0/1588607123 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd9f00b2880 0x7fd9f00b4d40 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc0098e0 tx=0x7fd9fc005960 comp rx=0 tx=0).stop 2024-05-08T05:48:11.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.630+0000 7fda11800700 1 -- 172.21.15.82:0/1588607123 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda0c075ff0 msgr2=0x7fda0c1a1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:11.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.630+0000 7fda11800700 1 --2- 172.21.15.82:0/1588607123 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda0c075ff0 0x7fda0c1a1f90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd9f400e970 tx=0x7fd9f400ec80 comp rx=0 tx=0).stop 2024-05-08T05:48:11.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.630+0000 7fda11800700 1 -- 172.21.15.82:0/1588607123 shutdown_connections 2024-05-08T05:48:11.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.630+0000 7fda11800700 1 --2- 172.21.15.82:0/1588607123 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd9f00b2880 0x7fd9f00b4d40 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:11.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.630+0000 7fda11800700 1 --2- 172.21.15.82:0/1588607123 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fda0c10ff00 0x7fda0c19bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:11.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.630+0000 7fda11800700 1 --2- 172.21.15.82:0/1588607123 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda0c0756d0 0x7fda0c1a1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:11.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.630+0000 7fda11800700 1 --2- 172.21.15.82:0/1588607123 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda0c075ff0 0x7fda0c1a1f90 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:11.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.630+0000 7fda11800700 1 -- 172.21.15.82:0/1588607123 >> 172.21.15.82:0/1588607123 conn(0x7fda0c07a600 msgr2=0x7fda0c100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:11.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.630+0000 7fda11800700 1 -- 172.21.15.82:0/1588607123 shutdown_connections 2024-05-08T05:48:11.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:11.631+0000 7fda11800700 1 -- 172.21.15.82:0/1588607123 wait complete. 2024-05-08T05:48:11.967 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:48:11 smithi082 ceph-mon[30098]: pgmap v385: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-08T05:48:11.967 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:48:11 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/1898817639' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-08T05:48:11.967 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:48:11 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/1588607123' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-08T05:48:12.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:48:11 smithi134 ceph-mon[34132]: pgmap v385: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-08T05:48:12.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:48:11 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/1898817639' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-08T05:48:12.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:48:11 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/1588607123' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-08T05:48:12.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:48:11 smithi151 ceph-mon[34815]: pgmap v385: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-08T05:48:12.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:48:11 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/1898817639' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-08T05:48:12.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:48:11 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/1588607123' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-08T05:48:12.559 INFO:tasks.cephadm.ceph_manager.ceph:need seq 206158430266 got 206158430274 for osd.7 2024-05-08T05:48:12.560 DEBUG:teuthology.parallel:result is None 2024-05-08T05:48:12.668 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149778 got 111669149784 for osd.3 2024-05-08T05:48:12.668 DEBUG:teuthology.parallel:result is None 2024-05-08T05:48:13.468 INFO:tasks.cephadm.ceph_manager.ceph:need seq 283467841579 got 283467841586 for osd.10 2024-05-08T05:48:13.468 DEBUG:teuthology.parallel:result is None 2024-05-08T05:48:13.468 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-05-08T05:48:13.469 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph pg dump --format=json 2024-05-08T05:48:13.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:48:13 smithi082 ceph-mon[30098]: pgmap v386: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:48:14.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:48:13 smithi134 ceph-mon[34132]: pgmap v386: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:48:14.334 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:48:14.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:48:13 smithi151 ceph-mon[34815]: pgmap v386: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:48:16.068 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:48:15 smithi082 ceph-mon[30098]: pgmap v387: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-08T05:48:16.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:48:15 smithi134 ceph-mon[34132]: pgmap v387: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-08T05:48:16.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:48:15 smithi151 ceph-mon[34815]: pgmap v387: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-08T05:48:16.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:16.539+0000 7fd133e00700 1 -- 172.21.15.82:0/589056676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd134076160 msgr2=0x7fd134113ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:16.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:16.539+0000 7fd133e00700 1 --2- 172.21.15.82:0/589056676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd134076160 0x7fd134113ea0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd120009990 tx=0x7fd120009ca0 comp rx=0 tx=0).stop 2024-05-08T05:48:16.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:16.539+0000 7fd133e00700 1 -- 172.21.15.82:0/589056676 shutdown_connections 2024-05-08T05:48:16.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:16.539+0000 7fd133e00700 1 --2- 172.21.15.82:0/589056676 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd134075840 0x7fd134075c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:16.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:16.539+0000 7fd133e00700 1 --2- 172.21.15.82:0/589056676 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1341143e0 0x7fd1341167d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:16.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:16.539+0000 7fd133e00700 1 --2- 172.21.15.82:0/589056676 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd134076160 0x7fd134113ea0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:16.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:16.539+0000 7fd133e00700 1 -- 172.21.15.82:0/589056676 >> 172.21.15.82:0/589056676 conn(0x7fd1340fef20 msgr2=0x7fd134101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:16.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:16.540+0000 7fd133e00700 1 -- 172.21.15.82:0/589056676 shutdown_connections 2024-05-08T05:48:16.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:16.540+0000 7fd133e00700 1 -- 172.21.15.82:0/589056676 wait complete. 2024-05-08T05:48:16.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:16.541+0000 7fd133e00700 1 Processor -- start 2024-05-08T05:48:16.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:16.541+0000 7fd133e00700 1 -- start start 2024-05-08T05:48:16.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:16.542+0000 7fd133e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd134075840 0x7fd1341a0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:16.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:16.542+0000 7fd133e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd134076160 0x7fd1341a0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:16.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:16.542+0000 7fd133e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1341143e0 0x7fd1341a4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:16.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:16.542+0000 7fd133e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd134119c20 con 0x7fd1341143e0 2024-05-08T05:48:16.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:16.542+0000 7fd133e00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd134119aa0 con 0x7fd134076160 2024-05-08T05:48:16.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:16.542+0000 7fd133e00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd134119da0 con 0x7fd134075840 2024-05-08T05:48:16.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:16.542+0000 7fd132a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd134075840 0x7fd1341a0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:16.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:16.542+0000 7fd132000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd134076160 0x7fd1341a0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:16.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:16.542+0000 7fd132a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd134075840 0x7fd1341a0110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:37744/0 (socket says 172.21.15.82:37744) 2024-05-08T05:48:16.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:16.542+0000 7fd132000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd134076160 0x7fd1341a0650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:53790/0 (socket says 172.21.15.82:53790) 2024-05-08T05:48:16.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:16.542+0000 7fd132a00700 1 -- 172.21.15.82:0/1368475606 learned_addr learned my addr 172.21.15.82:0/1368475606 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:48:16.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:16.542+0000 7fd133400700 1 --2- 172.21.15.82:0/1368475606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1341143e0 0x7fd1341a4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:16.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:16.543+0000 7fd132a00700 1 -- 172.21.15.82:0/1368475606 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd134076160 msgr2=0x7fd1341a0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:16.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:16.543+0000 7fd132a00700 1 --2- 172.21.15.82:0/1368475606 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd134076160 0x7fd1341a0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:16.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:16.543+0000 7fd132a00700 1 -- 172.21.15.82:0/1368475606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1341143e0 msgr2=0x7fd1341a4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:16.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:16.543+0000 7fd132a00700 1 --2- 172.21.15.82:0/1368475606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1341143e0 0x7fd1341a4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:16.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:16.543+0000 7fd132a00700 1 -- 172.21.15.82:0/1368475606 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1341a50d0 con 0x7fd134075840 2024-05-08T05:48:16.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:16.543+0000 7fd132000700 1 --2- 172.21.15.82:0/1368475606 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd134076160 0x7fd1341a0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:48:16.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:16.543+0000 7fd132a00700 1 --2- 172.21.15.82:0/1368475606 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd134075840 0x7fd1341a0110 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd12400eb30 tx=0x7fd12400ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:16.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:16.543+0000 7fd12b400700 1 -- 172.21.15.82:0/1368475606 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd12400cbd0 con 0x7fd134075840 2024-05-08T05:48:16.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:16.543+0000 7fd12b400700 1 -- 172.21.15.82:0/1368475606 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd1240044d0 con 0x7fd134075840 2024-05-08T05:48:16.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:16.543+0000 7fd133e00700 1 -- 172.21.15.82:0/1368475606 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1341a53c0 con 0x7fd134075840 2024-05-08T05:48:16.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:16.543+0000 7fd12b400700 1 -- 172.21.15.82:0/1368475606 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd124003e30 con 0x7fd134075840 2024-05-08T05:48:16.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:16.544+0000 7fd133e00700 1 -- 172.21.15.82:0/1368475606 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1341acc40 con 0x7fd134075840 2024-05-08T05:48:16.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:16.545+0000 7fd133e00700 1 -- 172.21.15.82:0/1368475606 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd13406a190 con 0x7fd134075840 2024-05-08T05:48:16.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:16.548+0000 7fd12b400700 1 -- 172.21.15.82:0/1368475606 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fd124004000 con 0x7fd134075840 2024-05-08T05:48:16.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:16.549+0000 7fd12b400700 1 --2- 172.21.15.82:0/1368475606 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd1180b2880 0x7fd1180b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:16.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:16.549+0000 7fd12b400700 1 -- 172.21.15.82:0/1368475606 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd1240e25f0 con 0x7fd134075840 2024-05-08T05:48:16.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:16.550+0000 7fd132000700 1 --2- 172.21.15.82:0/1368475606 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd1180b2880 0x7fd1180b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:16.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:16.550+0000 7fd132000700 1 --2- 172.21.15.82:0/1368475606 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd1180b2880 0x7fd1180b4d40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd1341071d0 tx=0x7fd12001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:16.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:16.553+0000 7fd12b400700 1 -- 172.21.15.82:0/1368475606 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd1240042f0 con 0x7fd134075840 2024-05-08T05:48:16.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:16.783+0000 7fd133e00700 1 -- 172.21.15.82:0/1368475606 --> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd1340638e0 con 0x7fd1180b2880 2024-05-08T05:48:16.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:16.792+0000 7fd12b400700 1 -- 172.21.15.82:0/1368475606 <== mgr.14152 v2:172.21.15.82:6800/4089180091 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259035 (secure 0 0 0) 0x7fd1340638e0 con 0x7fd1180b2880 2024-05-08T05:48:16.799 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:48:16.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:16.798+0000 7fd133e00700 1 -- 172.21.15.82:0/1368475606 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd1180b2880 msgr2=0x7fd1180b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:16.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:16.798+0000 7fd133e00700 1 --2- 172.21.15.82:0/1368475606 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd1180b2880 0x7fd1180b4d40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd1341071d0 tx=0x7fd12001a040 comp rx=0 tx=0).stop 2024-05-08T05:48:16.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:16.798+0000 7fd133e00700 1 -- 172.21.15.82:0/1368475606 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd134075840 msgr2=0x7fd1341a0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:16.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:16.798+0000 7fd133e00700 1 --2- 172.21.15.82:0/1368475606 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd134075840 0x7fd1341a0110 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd12400eb30 tx=0x7fd12400ee40 comp rx=0 tx=0).stop 2024-05-08T05:48:16.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:16.798+0000 7fd133e00700 1 -- 172.21.15.82:0/1368475606 shutdown_connections 2024-05-08T05:48:16.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:16.798+0000 7fd133e00700 1 --2- 172.21.15.82:0/1368475606 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd1180b2880 0x7fd1180b4d40 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:16.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:16.798+0000 7fd133e00700 1 --2- 172.21.15.82:0/1368475606 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd1341143e0 0x7fd1341a4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:16.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:16.798+0000 7fd133e00700 1 --2- 172.21.15.82:0/1368475606 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd134075840 0x7fd1341a0110 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:16.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:16.798+0000 7fd133e00700 1 --2- 172.21.15.82:0/1368475606 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd134076160 0x7fd1341a0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:16.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:16.798+0000 7fd133e00700 1 -- 172.21.15.82:0/1368475606 >> 172.21.15.82:0/1368475606 conn(0x7fd1340fef20 msgr2=0x7fd1340ffc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:16.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:16.798+0000 7fd133e00700 1 -- 172.21.15.82:0/1368475606 shutdown_connections 2024-05-08T05:48:16.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:16.798+0000 7fd133e00700 1 -- 172.21.15.82:0/1368475606 wait complete. 2024-05-08T05:48:16.802 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-05-08T05:48:17.693 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":388,"stamp":"2024-05-08T05:48:16.157586+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":663725,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1261,"num_read_kb":726,"num_write":379,"num_write_kb":2298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":3007130,"num_keys_recovered":20,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":812,"ondisk_log_size":812,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":351844,"kb_used_data":11012,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124589980,"statfs":{"total":1151940427776,"available":1151580139520,"internally_reserved":0,"allocated":11276288,"data_stored":7202031,"data_compressed":116202,"data_compressed_allocated":147456,"data_compressed_original":1822720,"omap_allocated":19138,"internal_metadata":348894526},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":55,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005469"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.105050+0000","last_change":"2024-05-08T05:45:54.796792+0000","last_active":"2024-05-08T05:47:44.105050+0000","last_peered":"2024-05-08T05:47:44.105050+0000","last_clean":"2024-05-08T05:47:44.105050+0000","last_became_active":"2024-05-08T05:45:54.796445+0000","last_became_peered":"2024-05-08T05:45:54.796445+0000","last_unstale":"2024-05-08T05:47:44.105050+0000","last_undegraded":"2024-05-08T05:47:44.105050+0000","last_fullsized":"2024-05-08T05:47:44.105050+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:41:12.762659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.108155+0000","last_change":"2024-05-08T05:45:54.800291+0000","last_active":"2024-05-08T05:47:44.108155+0000","last_peered":"2024-05-08T05:47:44.108155+0000","last_clean":"2024-05-08T05:47:44.108155+0000","last_became_active":"2024-05-08T05:45:54.798182+0000","last_became_peered":"2024-05-08T05:45:54.798182+0000","last_unstale":"2024-05-08T05:47:44.108155+0000","last_undegraded":"2024-05-08T05:47:44.108155+0000","last_fullsized":"2024-05-08T05:47:44.108155+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:55:52.672307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.110374+0000","last_change":"2024-05-08T05:45:54.792574+0000","last_active":"2024-05-08T05:47:44.110374+0000","last_peered":"2024-05-08T05:47:44.110374+0000","last_clean":"2024-05-08T05:47:44.110374+0000","last_became_active":"2024-05-08T05:45:54.790856+0000","last_became_peered":"2024-05-08T05:45:54.790856+0000","last_unstale":"2024-05-08T05:47:44.110374+0000","last_undegraded":"2024-05-08T05:47:44.110374+0000","last_fullsized":"2024-05-08T05:47:44.110374+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:32:33.727532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.082640+0000","last_change":"2024-05-08T05:45:54.772883+0000","last_active":"2024-05-08T05:47:44.082640+0000","last_peered":"2024-05-08T05:47:44.082640+0000","last_clean":"2024-05-08T05:47:44.082640+0000","last_became_active":"2024-05-08T05:45:54.772457+0000","last_became_peered":"2024-05-08T05:45:54.772457+0000","last_unstale":"2024-05-08T05:47:44.082640+0000","last_undegraded":"2024-05-08T05:47:44.082640+0000","last_fullsized":"2024-05-08T05:47:44.082640+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:50:20.116563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.104399+0000","last_change":"2024-05-08T05:45:54.798868+0000","last_active":"2024-05-08T05:47:44.104399+0000","last_peered":"2024-05-08T05:47:44.104399+0000","last_clean":"2024-05-08T05:47:44.104399+0000","last_became_active":"2024-05-08T05:45:54.798459+0000","last_became_peered":"2024-05-08T05:45:54.798459+0000","last_unstale":"2024-05-08T05:47:44.104399+0000","last_undegraded":"2024-05-08T05:47:44.104399+0000","last_fullsized":"2024-05-08T05:47:44.104399+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:59:32.280051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.103327+0000","last_change":"2024-05-08T05:45:54.788172+0000","last_active":"2024-05-08T05:47:44.103327+0000","last_peered":"2024-05-08T05:47:44.103327+0000","last_clean":"2024-05-08T05:47:44.103327+0000","last_became_active":"2024-05-08T05:45:54.787609+0000","last_became_peered":"2024-05-08T05:45:54.787609+0000","last_unstale":"2024-05-08T05:47:44.103327+0000","last_undegraded":"2024-05-08T05:47:44.103327+0000","last_fullsized":"2024-05-08T05:47:44.103327+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:30:17.295770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.086629+0000","last_change":"2024-05-08T05:45:54.786904+0000","last_active":"2024-05-08T05:47:44.086629+0000","last_peered":"2024-05-08T05:47:44.086629+0000","last_clean":"2024-05-08T05:47:44.086629+0000","last_became_active":"2024-05-08T05:45:54.786484+0000","last_became_peered":"2024-05-08T05:45:54.786484+0000","last_unstale":"2024-05-08T05:47:44.086629+0000","last_undegraded":"2024-05-08T05:47:44.086629+0000","last_fullsized":"2024-05-08T05:47:44.086629+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:14:15.398144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.104653+0000","last_change":"2024-05-08T05:45:54.801559+0000","last_active":"2024-05-08T05:47:44.104653+0000","last_peered":"2024-05-08T05:47:44.104653+0000","last_clean":"2024-05-08T05:47:44.104653+0000","last_became_active":"2024-05-08T05:45:54.796293+0000","last_became_peered":"2024-05-08T05:45:54.796293+0000","last_unstale":"2024-05-08T05:47:44.104653+0000","last_undegraded":"2024-05-08T05:47:44.104653+0000","last_fullsized":"2024-05-08T05:47:44.104653+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:07:05.483562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.097483+0000","last_change":"2024-05-08T05:45:54.780450+0000","last_active":"2024-05-08T05:47:44.097483+0000","last_peered":"2024-05-08T05:47:44.097483+0000","last_clean":"2024-05-08T05:47:44.097483+0000","last_became_active":"2024-05-08T05:45:54.780079+0000","last_became_peered":"2024-05-08T05:45:54.780079+0000","last_unstale":"2024-05-08T05:47:44.097483+0000","last_undegraded":"2024-05-08T05:47:44.097483+0000","last_fullsized":"2024-05-08T05:47:44.097483+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:41:26.688748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.078300+0000","last_change":"2024-05-08T05:45:54.776294+0000","last_active":"2024-05-08T05:47:44.078300+0000","last_peered":"2024-05-08T05:47:44.078300+0000","last_clean":"2024-05-08T05:47:44.078300+0000","last_became_active":"2024-05-08T05:45:54.775928+0000","last_became_peered":"2024-05-08T05:45:54.775928+0000","last_unstale":"2024-05-08T05:47:44.078300+0000","last_undegraded":"2024-05-08T05:47:44.078300+0000","last_fullsized":"2024-05-08T05:47:44.078300+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:17:53.453446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.092223+0000","last_change":"2024-05-08T05:45:54.781478+0000","last_active":"2024-05-08T05:47:44.092223+0000","last_peered":"2024-05-08T05:47:44.092223+0000","last_clean":"2024-05-08T05:47:44.092223+0000","last_became_active":"2024-05-08T05:45:54.780839+0000","last_became_peered":"2024-05-08T05:45:54.780839+0000","last_unstale":"2024-05-08T05:47:44.092223+0000","last_undegraded":"2024-05-08T05:47:44.092223+0000","last_fullsized":"2024-05-08T05:47:44.092223+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:39:14.518391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.082311+0000","last_change":"2024-05-08T05:45:54.774650+0000","last_active":"2024-05-08T05:47:44.082311+0000","last_peered":"2024-05-08T05:47:44.082311+0000","last_clean":"2024-05-08T05:47:44.082311+0000","last_became_active":"2024-05-08T05:45:54.774276+0000","last_became_peered":"2024-05-08T05:45:54.774276+0000","last_unstale":"2024-05-08T05:47:44.082311+0000","last_undegraded":"2024-05-08T05:47:44.082311+0000","last_fullsized":"2024-05-08T05:47:44.082311+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:43:53.390553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.092854+0000","last_change":"2024-05-08T05:45:54.783430+0000","last_active":"2024-05-08T05:47:44.092854+0000","last_peered":"2024-05-08T05:47:44.092854+0000","last_clean":"2024-05-08T05:47:44.092854+0000","last_became_active":"2024-05-08T05:45:54.782394+0000","last_became_peered":"2024-05-08T05:45:54.782394+0000","last_unstale":"2024-05-08T05:47:44.092854+0000","last_undegraded":"2024-05-08T05:47:44.092854+0000","last_fullsized":"2024-05-08T05:47:44.092854+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:47:01.864111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.106922+0000","last_change":"2024-05-08T05:45:54.792880+0000","last_active":"2024-05-08T05:47:44.106922+0000","last_peered":"2024-05-08T05:47:44.106922+0000","last_clean":"2024-05-08T05:47:44.106922+0000","last_became_active":"2024-05-08T05:45:54.789653+0000","last_became_peered":"2024-05-08T05:45:54.789653+0000","last_unstale":"2024-05-08T05:47:44.106922+0000","last_undegraded":"2024-05-08T05:47:44.106922+0000","last_fullsized":"2024-05-08T05:47:44.106922+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:57:10.552014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.101060+0000","last_change":"2024-05-08T05:45:54.793612+0000","last_active":"2024-05-08T05:47:44.101060+0000","last_peered":"2024-05-08T05:47:44.101060+0000","last_clean":"2024-05-08T05:47:44.101060+0000","last_became_active":"2024-05-08T05:45:54.793191+0000","last_became_peered":"2024-05-08T05:45:54.793191+0000","last_unstale":"2024-05-08T05:47:44.101060+0000","last_undegraded":"2024-05-08T05:47:44.101060+0000","last_fullsized":"2024-05-08T05:47:44.101060+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:49:35.066070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.110677+0000","last_change":"2024-05-08T05:45:54.799679+0000","last_active":"2024-05-08T05:47:44.110677+0000","last_peered":"2024-05-08T05:47:44.110677+0000","last_clean":"2024-05-08T05:47:44.110677+0000","last_became_active":"2024-05-08T05:45:54.799196+0000","last_became_peered":"2024-05-08T05:45:54.799196+0000","last_unstale":"2024-05-08T05:47:44.110677+0000","last_undegraded":"2024-05-08T05:47:44.110677+0000","last_fullsized":"2024-05-08T05:47:44.110677+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:14:00.597282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.104930+0000","last_change":"2024-05-08T05:45:54.796799+0000","last_active":"2024-05-08T05:47:44.104930+0000","last_peered":"2024-05-08T05:47:44.104930+0000","last_clean":"2024-05-08T05:47:44.104930+0000","last_became_active":"2024-05-08T05:45:54.796501+0000","last_became_peered":"2024-05-08T05:45:54.796501+0000","last_unstale":"2024-05-08T05:47:44.104930+0000","last_undegraded":"2024-05-08T05:47:44.104930+0000","last_fullsized":"2024-05-08T05:47:44.104930+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:14:59.446718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.108986+0000","last_change":"2024-05-08T05:45:54.789544+0000","last_active":"2024-05-08T05:47:44.108986+0000","last_peered":"2024-05-08T05:47:44.108986+0000","last_clean":"2024-05-08T05:47:44.108986+0000","last_became_active":"2024-05-08T05:45:54.787901+0000","last_became_peered":"2024-05-08T05:45:54.787901+0000","last_unstale":"2024-05-08T05:47:44.108986+0000","last_undegraded":"2024-05-08T05:47:44.108986+0000","last_fullsized":"2024-05-08T05:47:44.108986+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:12:23.200311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.104801+0000","last_change":"2024-05-08T05:45:54.782537+0000","last_active":"2024-05-08T05:47:44.104801+0000","last_peered":"2024-05-08T05:47:44.104801+0000","last_clean":"2024-05-08T05:47:44.104801+0000","last_became_active":"2024-05-08T05:45:54.781389+0000","last_became_peered":"2024-05-08T05:45:54.781389+0000","last_unstale":"2024-05-08T05:47:44.104801+0000","last_undegraded":"2024-05-08T05:47:44.104801+0000","last_fullsized":"2024-05-08T05:47:44.104801+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:56:22.041900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"80'13","reported_seq":157,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:48:12.243621+0000","last_change":"2024-05-08T05:45:50.744496+0000","last_active":"2024-05-08T05:48:12.243621+0000","last_peered":"2024-05-08T05:48:12.243621+0000","last_clean":"2024-05-08T05:48:12.243621+0000","last_became_active":"2024-05-08T05:45:50.743882+0000","last_became_peered":"2024-05-08T05:45:50.743882+0000","last_unstale":"2024-05-08T05:48:12.243621+0000","last_undegraded":"2024-05-08T05:48:12.243621+0000","last_fullsized":"2024-05-08T05:48:12.243621+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:45:11.198096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.078945+0000","last_change":"2024-05-08T05:46:45.957649+0000","last_active":"2024-05-08T05:47:44.078945+0000","last_peered":"2024-05-08T05:47:44.078945+0000","last_clean":"2024-05-08T05:47:44.078945+0000","last_became_active":"2024-05-08T05:46:45.957154+0000","last_became_peered":"2024-05-08T05:46:45.957154+0000","last_unstale":"2024-05-08T05:47:44.078945+0000","last_undegraded":"2024-05-08T05:47:44.078945+0000","last_fullsized":"2024-05-08T05:47:44.078945+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:29:25.475541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.763814+0000","last_change":"2024-05-08T05:45:50.863409+0000","last_active":"2024-05-08T05:46:45.763814+0000","last_peered":"2024-05-08T05:46:45.763814+0000","last_clean":"2024-05-08T05:46:45.763814+0000","last_became_active":"2024-05-08T05:45:50.861818+0000","last_became_peered":"2024-05-08T05:45:50.861818+0000","last_unstale":"2024-05-08T05:46:45.763814+0000","last_undegraded":"2024-05-08T05:46:45.763814+0000","last_fullsized":"2024-05-08T05:46:45.763814+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:39:32.821431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.110364+0000","last_change":"2024-05-08T05:45:54.797429+0000","last_active":"2024-05-08T05:47:44.110364+0000","last_peered":"2024-05-08T05:47:44.110364+0000","last_clean":"2024-05-08T05:47:44.110364+0000","last_became_active":"2024-05-08T05:45:54.795030+0000","last_became_peered":"2024-05-08T05:45:54.795030+0000","last_unstale":"2024-05-08T05:47:44.110364+0000","last_undegraded":"2024-05-08T05:47:44.110364+0000","last_fullsized":"2024-05-08T05:47:44.110364+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:43:34.852889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"80'12","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.772846+0000","last_change":"2024-05-08T05:46:45.772846+0000","last_active":"2024-05-08T05:46:45.772846+0000","last_peered":"2024-05-08T05:46:45.772846+0000","last_clean":"2024-05-08T05:46:45.772846+0000","last_became_active":"2024-05-08T05:46:45.763937+0000","last_became_peered":"2024-05-08T05:46:45.763937+0000","last_unstale":"2024-05-08T05:46:45.772846+0000","last_undegraded":"2024-05-08T05:46:45.772846+0000","last_fullsized":"2024-05-08T05:46:45.772846+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:48:13.233059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.099343+0000","last_change":"2024-05-08T05:45:54.788852+0000","last_active":"2024-05-08T05:47:44.099343+0000","last_peered":"2024-05-08T05:47:44.099343+0000","last_clean":"2024-05-08T05:47:44.099343+0000","last_became_active":"2024-05-08T05:45:54.788496+0000","last_became_peered":"2024-05-08T05:45:54.788496+0000","last_unstale":"2024-05-08T05:47:44.099343+0000","last_undegraded":"2024-05-08T05:47:44.099343+0000","last_fullsized":"2024-05-08T05:47:44.099343+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:44:45.379728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"80'5","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762860+0000","last_change":"2024-05-08T05:45:50.741528+0000","last_active":"2024-05-08T05:46:45.762860+0000","last_peered":"2024-05-08T05:46:45.762860+0000","last_clean":"2024-05-08T05:46:45.762860+0000","last_became_active":"2024-05-08T05:45:50.741232+0000","last_became_peered":"2024-05-08T05:45:50.741232+0000","last_unstale":"2024-05-08T05:46:45.762860+0000","last_undegraded":"2024-05-08T05:46:45.762860+0000","last_fullsized":"2024-05-08T05:46:45.762860+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:36:48.540858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.099632+0000","last_change":"2024-05-08T05:46:45.954990+0000","last_active":"2024-05-08T05:47:44.099632+0000","last_peered":"2024-05-08T05:47:44.099632+0000","last_clean":"2024-05-08T05:47:44.099632+0000","last_became_active":"2024-05-08T05:46:45.953589+0000","last_became_peered":"2024-05-08T05:46:45.953589+0000","last_unstale":"2024-05-08T05:47:44.099632+0000","last_undegraded":"2024-05-08T05:47:44.099632+0000","last_fullsized":"2024-05-08T05:47:44.099632+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:29:17.410356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1b","version":"80'5","reported_seq":150,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:48:13.154023+0000","last_change":"2024-05-08T05:45:50.746462+0000","last_active":"2024-05-08T05:48:13.154023+0000","last_peered":"2024-05-08T05:48:13.154023+0000","last_clean":"2024-05-08T05:48:13.154023+0000","last_became_active":"2024-05-08T05:45:50.746064+0000","last_became_peered":"2024-05-08T05:45:50.746064+0000","last_unstale":"2024-05-08T05:48:13.154023+0000","last_undegraded":"2024-05-08T05:48:13.154023+0000","last_fullsized":"2024-05-08T05:48:13.154023+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:51:49.076829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":119,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.084254+0000","last_change":"2024-05-08T05:45:54.788524+0000","last_active":"2024-05-08T05:47:44.084254+0000","last_peered":"2024-05-08T05:47:44.084254+0000","last_clean":"2024-05-08T05:47:44.084254+0000","last_became_active":"2024-05-08T05:45:54.788179+0000","last_became_peered":"2024-05-08T05:45:54.788179+0000","last_unstale":"2024-05-08T05:47:44.084254+0000","last_undegraded":"2024-05-08T05:47:44.084254+0000","last_fullsized":"2024-05-08T05:47:44.084254+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:44:34.257799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":47,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.780705+0000","last_change":"2024-05-08T05:46:45.780705+0000","last_active":"2024-05-08T05:46:45.780705+0000","last_peered":"2024-05-08T05:46:45.780705+0000","last_clean":"2024-05-08T05:46:45.780705+0000","last_became_active":"2024-05-08T05:46:45.773246+0000","last_became_peered":"2024-05-08T05:46:45.773246+0000","last_unstale":"2024-05-08T05:46:45.780705+0000","last_undegraded":"2024-05-08T05:46:45.780705+0000","last_fullsized":"2024-05-08T05:46:45.780705+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:10:33.491186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.103737+0000","last_change":"2024-05-08T05:45:54.792001+0000","last_active":"2024-05-08T05:47:44.103737+0000","last_peered":"2024-05-08T05:47:44.103737+0000","last_clean":"2024-05-08T05:47:44.103737+0000","last_became_active":"2024-05-08T05:45:54.791581+0000","last_became_peered":"2024-05-08T05:45:54.791581+0000","last_unstale":"2024-05-08T05:47:44.103737+0000","last_undegraded":"2024-05-08T05:47:44.103737+0000","last_fullsized":"2024-05-08T05:47:44.103737+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:43:37.437251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"80'3","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.771530+0000","last_change":"2024-05-08T05:45:50.740645+0000","last_active":"2024-05-08T05:46:45.771530+0000","last_peered":"2024-05-08T05:46:45.771530+0000","last_clean":"2024-05-08T05:46:45.771530+0000","last_became_active":"2024-05-08T05:45:50.739997+0000","last_became_peered":"2024-05-08T05:45:50.739997+0000","last_unstale":"2024-05-08T05:46:45.771530+0000","last_undegraded":"2024-05-08T05:46:45.771530+0000","last_fullsized":"2024-05-08T05:46:45.771530+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:24:48.895557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.104972+0000","last_change":"2024-05-08T05:45:54.802757+0000","last_active":"2024-05-08T05:47:44.104972+0000","last_peered":"2024-05-08T05:47:44.104972+0000","last_clean":"2024-05-08T05:47:44.104972+0000","last_became_active":"2024-05-08T05:45:54.798549+0000","last_became_peered":"2024-05-08T05:45:54.798549+0000","last_unstale":"2024-05-08T05:47:44.104972+0000","last_undegraded":"2024-05-08T05:47:44.104972+0000","last_fullsized":"2024-05-08T05:47:44.104972+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:39:37.582997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'3","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.956005+0000","last_change":"2024-05-08T05:45:50.743989+0000","last_active":"2024-05-08T05:46:45.956005+0000","last_peered":"2024-05-08T05:46:45.956005+0000","last_clean":"2024-05-08T05:46:45.956005+0000","last_became_active":"2024-05-08T05:45:50.743582+0000","last_became_peered":"2024-05-08T05:45:50.743582+0000","last_unstale":"2024-05-08T05:46:45.956005+0000","last_undegraded":"2024-05-08T05:46:45.956005+0000","last_fullsized":"2024-05-08T05:46:45.956005+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:14:46.820582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.107917+0000","last_change":"2024-05-08T05:45:54.807249+0000","last_active":"2024-05-08T05:47:44.107917+0000","last_peered":"2024-05-08T05:47:44.107917+0000","last_clean":"2024-05-08T05:47:44.107917+0000","last_became_active":"2024-05-08T05:45:54.806823+0000","last_became_peered":"2024-05-08T05:45:54.806823+0000","last_unstale":"2024-05-08T05:47:44.107917+0000","last_undegraded":"2024-05-08T05:47:44.107917+0000","last_fullsized":"2024-05-08T05:47:44.107917+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:37:25.526927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'5","reported_seq":259,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:48:11.150319+0000","last_change":"2024-05-08T05:45:50.747477+0000","last_active":"2024-05-08T05:48:11.150319+0000","last_peered":"2024-05-08T05:48:11.150319+0000","last_clean":"2024-05-08T05:48:11.150319+0000","last_became_active":"2024-05-08T05:45:50.747103+0000","last_became_peered":"2024-05-08T05:45:50.747103+0000","last_unstale":"2024-05-08T05:48:11.150319+0000","last_undegraded":"2024-05-08T05:48:11.150319+0000","last_fullsized":"2024-05-08T05:48:11.150319+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:08:17.108826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":228,"num_read_kb":228,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.109002+0000","last_change":"2024-05-08T05:45:54.787885+0000","last_active":"2024-05-08T05:47:44.109002+0000","last_peered":"2024-05-08T05:47:44.109002+0000","last_clean":"2024-05-08T05:47:44.109002+0000","last_became_active":"2024-05-08T05:45:54.787480+0000","last_became_peered":"2024-05-08T05:45:54.787480+0000","last_unstale":"2024-05-08T05:47:44.109002+0000","last_undegraded":"2024-05-08T05:47:44.109002+0000","last_fullsized":"2024-05-08T05:47:44.109002+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:13:42.889918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'4","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.763007+0000","last_change":"2024-05-08T05:45:50.741271+0000","last_active":"2024-05-08T05:46:45.763007+0000","last_peered":"2024-05-08T05:46:45.763007+0000","last_clean":"2024-05-08T05:46:45.763007+0000","last_became_active":"2024-05-08T05:45:50.740869+0000","last_became_peered":"2024-05-08T05:45:50.740869+0000","last_unstale":"2024-05-08T05:46:45.763007+0000","last_undegraded":"2024-05-08T05:46:45.763007+0000","last_fullsized":"2024-05-08T05:46:45.763007+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:57:40.855732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.107639+0000","last_change":"2024-05-08T05:46:45.958524+0000","last_active":"2024-05-08T05:47:44.107639+0000","last_peered":"2024-05-08T05:47:44.107639+0000","last_clean":"2024-05-08T05:47:44.107639+0000","last_became_active":"2024-05-08T05:46:45.957576+0000","last_became_peered":"2024-05-08T05:46:45.957576+0000","last_unstale":"2024-05-08T05:47:44.107639+0000","last_undegraded":"2024-05-08T05:47:44.107639+0000","last_fullsized":"2024-05-08T05:47:44.107639+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:59:34.927448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.956564+0000","last_change":"2024-05-08T05:45:50.865467+0000","last_active":"2024-05-08T05:46:45.956564+0000","last_peered":"2024-05-08T05:46:45.956564+0000","last_clean":"2024-05-08T05:46:45.956564+0000","last_became_active":"2024-05-08T05:45:50.865245+0000","last_became_peered":"2024-05-08T05:45:50.865245+0000","last_unstale":"2024-05-08T05:46:45.956564+0000","last_undegraded":"2024-05-08T05:46:45.956564+0000","last_fullsized":"2024-05-08T05:46:45.956564+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:03:40.990651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.099012+0000","last_change":"2024-05-08T05:45:54.780782+0000","last_active":"2024-05-08T05:47:44.099012+0000","last_peered":"2024-05-08T05:47:44.099012+0000","last_clean":"2024-05-08T05:47:44.099012+0000","last_became_active":"2024-05-08T05:45:54.780074+0000","last_became_peered":"2024-05-08T05:45:54.780074+0000","last_unstale":"2024-05-08T05:47:44.099012+0000","last_undegraded":"2024-05-08T05:47:44.099012+0000","last_fullsized":"2024-05-08T05:47:44.099012+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:23:09.026115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'36","reported_seq":322,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:48:11.111764+0000","last_change":"2024-05-08T05:46:45.965985+0000","last_active":"2024-05-08T05:48:11.111764+0000","last_peered":"2024-05-08T05:48:11.111764+0000","last_clean":"2024-05-08T05:48:11.111764+0000","last_became_active":"2024-05-08T05:46:45.953485+0000","last_became_peered":"2024-05-08T05:46:45.953485+0000","last_unstale":"2024-05-08T05:48:11.111764+0000","last_undegraded":"2024-05-08T05:48:11.111764+0000","last_fullsized":"2024-05-08T05:48:11.111764+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:51:45.723988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66169,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":230,"num_read_kb":172,"num_write":38,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":55222,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.088187+0000","last_change":"2024-05-08T05:45:54.777524+0000","last_active":"2024-05-08T05:47:44.088187+0000","last_peered":"2024-05-08T05:47:44.088187+0000","last_clean":"2024-05-08T05:47:44.088187+0000","last_became_active":"2024-05-08T05:45:54.776756+0000","last_became_peered":"2024-05-08T05:45:54.776756+0000","last_unstale":"2024-05-08T05:47:44.088187+0000","last_undegraded":"2024-05-08T05:47:44.088187+0000","last_fullsized":"2024-05-08T05:47:44.088187+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:54:27.320411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'9","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.783284+0000","last_change":"2024-05-08T05:46:45.783284+0000","last_active":"2024-05-08T05:46:45.783284+0000","last_peered":"2024-05-08T05:46:45.783284+0000","last_clean":"2024-05-08T05:46:45.783284+0000","last_became_active":"2024-05-08T05:46:45.765201+0000","last_became_peered":"2024-05-08T05:46:45.765201+0000","last_unstale":"2024-05-08T05:46:45.783284+0000","last_undegraded":"2024-05-08T05:46:45.783284+0000","last_fullsized":"2024-05-08T05:46:45.783284+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:44:59.762324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.105689+0000","last_change":"2024-05-08T05:45:54.789165+0000","last_active":"2024-05-08T05:47:44.105689+0000","last_peered":"2024-05-08T05:47:44.105689+0000","last_clean":"2024-05-08T05:47:44.105689+0000","last_became_active":"2024-05-08T05:45:54.788673+0000","last_became_peered":"2024-05-08T05:45:54.788673+0000","last_unstale":"2024-05-08T05:47:44.105689+0000","last_undegraded":"2024-05-08T05:47:44.105689+0000","last_fullsized":"2024-05-08T05:47:44.105689+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:29:08.722409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'5","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.956256+0000","last_change":"2024-05-08T05:45:50.750836+0000","last_active":"2024-05-08T05:46:45.956256+0000","last_peered":"2024-05-08T05:46:45.956256+0000","last_clean":"2024-05-08T05:46:45.956256+0000","last_became_active":"2024-05-08T05:45:50.750587+0000","last_became_peered":"2024-05-08T05:45:50.750587+0000","last_unstale":"2024-05-08T05:46:45.956256+0000","last_undegraded":"2024-05-08T05:46:45.956256+0000","last_fullsized":"2024-05-08T05:46:45.956256+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:19:03.780050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.096929+0000","last_change":"2024-05-08T05:45:54.791475+0000","last_active":"2024-05-08T05:47:44.096929+0000","last_peered":"2024-05-08T05:47:44.096929+0000","last_clean":"2024-05-08T05:47:44.096929+0000","last_became_active":"2024-05-08T05:45:54.791122+0000","last_became_peered":"2024-05-08T05:45:54.791122+0000","last_unstale":"2024-05-08T05:47:44.096929+0000","last_undegraded":"2024-05-08T05:47:44.096929+0000","last_fullsized":"2024-05-08T05:47:44.096929+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:08:01.261852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'5","reported_seq":151,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:48:13.194531+0000","last_change":"2024-05-08T05:45:50.742848+0000","last_active":"2024-05-08T05:48:13.194531+0000","last_peered":"2024-05-08T05:48:13.194531+0000","last_clean":"2024-05-08T05:48:13.194531+0000","last_became_active":"2024-05-08T05:45:50.742448+0000","last_became_peered":"2024-05-08T05:45:50.742448+0000","last_unstale":"2024-05-08T05:48:13.194531+0000","last_undegraded":"2024-05-08T05:48:13.194531+0000","last_fullsized":"2024-05-08T05:48:13.194531+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:17:35.970285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.083819+0000","last_change":"2024-05-08T05:45:54.773009+0000","last_active":"2024-05-08T05:47:44.083819+0000","last_peered":"2024-05-08T05:47:44.083819+0000","last_clean":"2024-05-08T05:47:44.083819+0000","last_became_active":"2024-05-08T05:45:54.772597+0000","last_became_peered":"2024-05-08T05:45:54.772597+0000","last_unstale":"2024-05-08T05:47:44.083819+0000","last_undegraded":"2024-05-08T05:47:44.083819+0000","last_fullsized":"2024-05-08T05:47:44.083819+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:41:31.632363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'17","reported_seq":45,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762777+0000","last_change":"2024-05-08T05:45:50.867734+0000","last_active":"2024-05-08T05:46:45.762777+0000","last_peered":"2024-05-08T05:46:45.762777+0000","last_clean":"2024-05-08T05:46:45.762777+0000","last_became_active":"2024-05-08T05:45:50.867441+0000","last_became_peered":"2024-05-08T05:45:50.867441+0000","last_unstale":"2024-05-08T05:46:45.762777+0000","last_undegraded":"2024-05-08T05:46:45.762777+0000","last_fullsized":"2024-05-08T05:46:45.762777+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:16:45.430432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.083526+0000","last_change":"2024-05-08T05:45:54.777168+0000","last_active":"2024-05-08T05:47:44.083526+0000","last_peered":"2024-05-08T05:47:44.083526+0000","last_clean":"2024-05-08T05:47:44.083526+0000","last_became_active":"2024-05-08T05:45:54.775985+0000","last_became_peered":"2024-05-08T05:45:54.775985+0000","last_unstale":"2024-05-08T05:47:44.083526+0000","last_undegraded":"2024-05-08T05:47:44.083526+0000","last_fullsized":"2024-05-08T05:47:44.083526+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:57:49.495860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762618+0000","last_change":"2024-05-08T05:45:50.741375+0000","last_active":"2024-05-08T05:46:45.762618+0000","last_peered":"2024-05-08T05:46:45.762618+0000","last_clean":"2024-05-08T05:46:45.762618+0000","last_became_active":"2024-05-08T05:45:50.741025+0000","last_became_peered":"2024-05-08T05:45:50.741025+0000","last_unstale":"2024-05-08T05:46:45.762618+0000","last_undegraded":"2024-05-08T05:46:45.762618+0000","last_fullsized":"2024-05-08T05:46:45.762618+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:01:43.515119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.082394+0000","last_change":"2024-05-08T05:45:54.780302+0000","last_active":"2024-05-08T05:47:44.082394+0000","last_peered":"2024-05-08T05:47:44.082394+0000","last_clean":"2024-05-08T05:47:44.082394+0000","last_became_active":"2024-05-08T05:45:54.778751+0000","last_became_peered":"2024-05-08T05:45:54.778751+0000","last_unstale":"2024-05-08T05:47:44.082394+0000","last_undegraded":"2024-05-08T05:47:44.082394+0000","last_fullsized":"2024-05-08T05:47:44.082394+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:34:57.686504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.770582+0000","last_change":"2024-05-08T05:45:50.870071+0000","last_active":"2024-05-08T05:46:45.770582+0000","last_peered":"2024-05-08T05:46:45.770582+0000","last_clean":"2024-05-08T05:46:45.770582+0000","last_became_active":"2024-05-08T05:45:50.869162+0000","last_became_peered":"2024-05-08T05:45:50.869162+0000","last_unstale":"2024-05-08T05:46:45.770582+0000","last_undegraded":"2024-05-08T05:46:45.770582+0000","last_fullsized":"2024-05-08T05:46:45.770582+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:05:13.104922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.104028+0000","last_change":"2024-05-08T05:45:54.780983+0000","last_active":"2024-05-08T05:47:44.104028+0000","last_peered":"2024-05-08T05:47:44.104028+0000","last_clean":"2024-05-08T05:47:44.104028+0000","last_became_active":"2024-05-08T05:45:54.780617+0000","last_became_peered":"2024-05-08T05:45:54.780617+0000","last_unstale":"2024-05-08T05:47:44.104028+0000","last_undegraded":"2024-05-08T05:47:44.104028+0000","last_fullsized":"2024-05-08T05:47:44.104028+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:56:40.972467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"80'5","reported_seq":150,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:48:13.247094+0000","last_change":"2024-05-08T05:45:50.748869+0000","last_active":"2024-05-08T05:48:13.247094+0000","last_peered":"2024-05-08T05:48:13.247094+0000","last_clean":"2024-05-08T05:48:13.247094+0000","last_became_active":"2024-05-08T05:45:50.748494+0000","last_became_peered":"2024-05-08T05:45:50.748494+0000","last_unstale":"2024-05-08T05:48:13.247094+0000","last_undegraded":"2024-05-08T05:48:13.247094+0000","last_fullsized":"2024-05-08T05:48:13.247094+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:12:25.227090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":118,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.097768+0000","last_change":"2024-05-08T05:45:54.802180+0000","last_active":"2024-05-08T05:47:44.097768+0000","last_peered":"2024-05-08T05:47:44.097768+0000","last_clean":"2024-05-08T05:47:44.097768+0000","last_became_active":"2024-05-08T05:45:54.801822+0000","last_became_peered":"2024-05-08T05:45:54.801822+0000","last_unstale":"2024-05-08T05:47:44.097768+0000","last_undegraded":"2024-05-08T05:47:44.097768+0000","last_fullsized":"2024-05-08T05:47:44.097768+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:52:11.802630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.081450+0000","last_change":"2024-05-08T05:45:54.770981+0000","last_active":"2024-05-08T05:47:44.081450+0000","last_peered":"2024-05-08T05:47:44.081450+0000","last_clean":"2024-05-08T05:47:44.081450+0000","last_became_active":"2024-05-08T05:45:54.770538+0000","last_became_peered":"2024-05-08T05:45:54.770538+0000","last_unstale":"2024-05-08T05:47:44.081450+0000","last_undegraded":"2024-05-08T05:47:44.081450+0000","last_fullsized":"2024-05-08T05:47:44.081450+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:32:34.699752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"80'5","reported_seq":149,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:48:12.191641+0000","last_change":"2024-05-08T05:45:50.864189+0000","last_active":"2024-05-08T05:48:12.191641+0000","last_peered":"2024-05-08T05:48:12.191641+0000","last_clean":"2024-05-08T05:48:12.191641+0000","last_became_active":"2024-05-08T05:45:50.863170+0000","last_became_peered":"2024-05-08T05:45:50.863170+0000","last_unstale":"2024-05-08T05:48:12.191641+0000","last_undegraded":"2024-05-08T05:48:12.191641+0000","last_fullsized":"2024-05-08T05:48:12.191641+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:44:33.109166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":117,"num_read_kb":117,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.107858+0000","last_change":"2024-05-08T05:45:54.792347+0000","last_active":"2024-05-08T05:47:44.107858+0000","last_peered":"2024-05-08T05:47:44.107858+0000","last_clean":"2024-05-08T05:47:44.107858+0000","last_became_active":"2024-05-08T05:45:54.791767+0000","last_became_peered":"2024-05-08T05:45:54.791767+0000","last_unstale":"2024-05-08T05:47:44.107858+0000","last_undegraded":"2024-05-08T05:47:44.107858+0000","last_fullsized":"2024-05-08T05:47:44.107858+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:03:46.354687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"80'6","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.952710+0000","last_change":"2024-05-08T05:45:50.748659+0000","last_active":"2024-05-08T05:46:45.952710+0000","last_peered":"2024-05-08T05:46:45.952710+0000","last_clean":"2024-05-08T05:46:45.952710+0000","last_became_active":"2024-05-08T05:45:50.748279+0000","last_became_peered":"2024-05-08T05:45:50.748279+0000","last_unstale":"2024-05-08T05:46:45.952710+0000","last_undegraded":"2024-05-08T05:46:45.952710+0000","last_fullsized":"2024-05-08T05:46:45.952710+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:42:25.892715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":101,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762503+0000","last_change":"2024-05-08T05:44:18.365376+0000","last_active":"2024-05-08T05:46:45.762503+0000","last_peered":"2024-05-08T05:46:45.762503+0000","last_clean":"2024-05-08T05:46:45.762503+0000","last_became_active":"2024-05-08T05:44:18.360156+0000","last_became_peered":"2024-05-08T05:44:18.360156+0000","last_unstale":"2024-05-08T05:46:45.762503+0000","last_undegraded":"2024-05-08T05:46:45.762503+0000","last_fullsized":"2024-05-08T05:46:45.762503+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:40:28.502228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:40:28.502228+0000","last_clean_scrub_stamp":"2024-05-08T05:40:28.502228+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:38:20.339163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.092968+0000","last_change":"2024-05-08T05:45:54.775625+0000","last_active":"2024-05-08T05:47:44.092968+0000","last_peered":"2024-05-08T05:47:44.092968+0000","last_clean":"2024-05-08T05:47:44.092968+0000","last_became_active":"2024-05-08T05:45:54.774661+0000","last_became_peered":"2024-05-08T05:45:54.774661+0000","last_unstale":"2024-05-08T05:47:44.092968+0000","last_undegraded":"2024-05-08T05:47:44.092968+0000","last_fullsized":"2024-05-08T05:47:44.092968+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:57:05.676092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"80'4","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762660+0000","last_change":"2024-05-08T05:45:50.747823+0000","last_active":"2024-05-08T05:46:45.762660+0000","last_peered":"2024-05-08T05:46:45.762660+0000","last_clean":"2024-05-08T05:46:45.762660+0000","last_became_active":"2024-05-08T05:45:50.747222+0000","last_became_peered":"2024-05-08T05:45:50.747222+0000","last_unstale":"2024-05-08T05:46:45.762660+0000","last_undegraded":"2024-05-08T05:46:45.762660+0000","last_fullsized":"2024-05-08T05:46:45.762660+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:49:06.238468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"80'4","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.763348+0000","last_change":"2024-05-08T05:45:50.861721+0000","last_active":"2024-05-08T05:46:45.763348+0000","last_peered":"2024-05-08T05:46:45.763348+0000","last_clean":"2024-05-08T05:46:45.763348+0000","last_became_active":"2024-05-08T05:45:50.861369+0000","last_became_peered":"2024-05-08T05:45:50.861369+0000","last_unstale":"2024-05-08T05:46:45.763348+0000","last_undegraded":"2024-05-08T05:46:45.763348+0000","last_fullsized":"2024-05-08T05:46:45.763348+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:35:19.781796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.092003+0000","last_change":"2024-05-08T05:45:54.787260+0000","last_active":"2024-05-08T05:47:44.092003+0000","last_peered":"2024-05-08T05:47:44.092003+0000","last_clean":"2024-05-08T05:47:44.092003+0000","last_became_active":"2024-05-08T05:45:54.786897+0000","last_became_peered":"2024-05-08T05:45:54.786897+0000","last_unstale":"2024-05-08T05:47:44.092003+0000","last_undegraded":"2024-05-08T05:47:44.092003+0000","last_fullsized":"2024-05-08T05:47:44.092003+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:10:06.761165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'17","reported_seq":44,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.839150+0000","last_change":"2024-05-08T05:45:50.746160+0000","last_active":"2024-05-08T05:47:44.839150+0000","last_peered":"2024-05-08T05:47:44.839150+0000","last_clean":"2024-05-08T05:47:44.839150+0000","last_became_active":"2024-05-08T05:45:50.745630+0000","last_became_peered":"2024-05-08T05:45:50.745630+0000","last_unstale":"2024-05-08T05:47:44.839150+0000","last_undegraded":"2024-05-08T05:47:44.839150+0000","last_fullsized":"2024-05-08T05:47:44.839150+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:45:27.593902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.100379+0000","last_change":"2024-05-08T05:45:54.797162+0000","last_active":"2024-05-08T05:47:44.100379+0000","last_peered":"2024-05-08T05:47:44.100379+0000","last_clean":"2024-05-08T05:47:44.100379+0000","last_became_active":"2024-05-08T05:45:54.796859+0000","last_became_peered":"2024-05-08T05:45:54.796859+0000","last_unstale":"2024-05-08T05:47:44.100379+0000","last_undegraded":"2024-05-08T05:47:44.100379+0000","last_fullsized":"2024-05-08T05:47:44.100379+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:51:25.701160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'7","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.952417+0000","last_change":"2024-05-08T05:45:50.744793+0000","last_active":"2024-05-08T05:46:45.952417+0000","last_peered":"2024-05-08T05:46:45.952417+0000","last_clean":"2024-05-08T05:46:45.952417+0000","last_became_active":"2024-05-08T05:45:50.744407+0000","last_became_peered":"2024-05-08T05:45:50.744407+0000","last_unstale":"2024-05-08T05:46:45.952417+0000","last_undegraded":"2024-05-08T05:46:45.952417+0000","last_fullsized":"2024-05-08T05:46:45.952417+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:18:17.029402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.110900+0000","last_change":"2024-05-08T05:45:54.797042+0000","last_active":"2024-05-08T05:47:44.110900+0000","last_peered":"2024-05-08T05:47:44.110900+0000","last_clean":"2024-05-08T05:47:44.110900+0000","last_became_active":"2024-05-08T05:45:54.795796+0000","last_became_peered":"2024-05-08T05:45:54.795796+0000","last_unstale":"2024-05-08T05:47:44.110900+0000","last_undegraded":"2024-05-08T05:47:44.110900+0000","last_fullsized":"2024-05-08T05:47:44.110900+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:20:10.789348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.766092+0000","last_change":"2024-05-08T05:45:50.860466+0000","last_active":"2024-05-08T05:46:45.766092+0000","last_peered":"2024-05-08T05:46:45.766092+0000","last_clean":"2024-05-08T05:46:45.766092+0000","last_became_active":"2024-05-08T05:45:50.860093+0000","last_became_peered":"2024-05-08T05:45:50.860093+0000","last_unstale":"2024-05-08T05:46:45.766092+0000","last_undegraded":"2024-05-08T05:46:45.766092+0000","last_fullsized":"2024-05-08T05:46:45.766092+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:42:37.799098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.076334+0000","last_change":"2024-05-08T05:45:54.774635+0000","last_active":"2024-05-08T05:47:44.076334+0000","last_peered":"2024-05-08T05:47:44.076334+0000","last_clean":"2024-05-08T05:47:44.076334+0000","last_became_active":"2024-05-08T05:45:54.774288+0000","last_became_peered":"2024-05-08T05:45:54.774288+0000","last_unstale":"2024-05-08T05:47:44.076334+0000","last_undegraded":"2024-05-08T05:47:44.076334+0000","last_fullsized":"2024-05-08T05:47:44.076334+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:55:59.787540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'7","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.761999+0000","last_change":"2024-05-08T05:45:50.750830+0000","last_active":"2024-05-08T05:46:45.761999+0000","last_peered":"2024-05-08T05:46:45.761999+0000","last_clean":"2024-05-08T05:46:45.761999+0000","last_became_active":"2024-05-08T05:45:50.750473+0000","last_became_peered":"2024-05-08T05:45:50.750473+0000","last_unstale":"2024-05-08T05:46:45.761999+0000","last_undegraded":"2024-05-08T05:46:45.761999+0000","last_fullsized":"2024-05-08T05:46:45.761999+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:04:14.314865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.098673+0000","last_change":"2024-05-08T05:45:54.800008+0000","last_active":"2024-05-08T05:47:44.098673+0000","last_peered":"2024-05-08T05:47:44.098673+0000","last_clean":"2024-05-08T05:47:44.098673+0000","last_became_active":"2024-05-08T05:45:54.799615+0000","last_became_peered":"2024-05-08T05:45:54.799615+0000","last_unstale":"2024-05-08T05:47:44.098673+0000","last_undegraded":"2024-05-08T05:47:44.098673+0000","last_fullsized":"2024-05-08T05:47:44.098673+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:58:12.907617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'3","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762208+0000","last_change":"2024-05-08T05:45:50.745088+0000","last_active":"2024-05-08T05:46:45.762208+0000","last_peered":"2024-05-08T05:46:45.762208+0000","last_clean":"2024-05-08T05:46:45.762208+0000","last_became_active":"2024-05-08T05:45:50.744735+0000","last_became_peered":"2024-05-08T05:45:50.744735+0000","last_unstale":"2024-05-08T05:46:45.762208+0000","last_undegraded":"2024-05-08T05:46:45.762208+0000","last_fullsized":"2024-05-08T05:46:45.762208+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:39:12.404233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.104706+0000","last_change":"2024-05-08T05:45:54.803875+0000","last_active":"2024-05-08T05:47:44.104706+0000","last_peered":"2024-05-08T05:47:44.104706+0000","last_clean":"2024-05-08T05:47:44.104706+0000","last_became_active":"2024-05-08T05:45:54.803504+0000","last_became_peered":"2024-05-08T05:45:54.803504+0000","last_unstale":"2024-05-08T05:47:44.104706+0000","last_undegraded":"2024-05-08T05:47:44.104706+0000","last_fullsized":"2024-05-08T05:47:44.104706+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:49:33.419868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.763106+0000","last_change":"2024-05-08T05:45:50.741351+0000","last_active":"2024-05-08T05:46:45.763106+0000","last_peered":"2024-05-08T05:46:45.763106+0000","last_clean":"2024-05-08T05:46:45.763106+0000","last_became_active":"2024-05-08T05:45:50.740970+0000","last_became_peered":"2024-05-08T05:45:50.740970+0000","last_unstale":"2024-05-08T05:46:45.763106+0000","last_undegraded":"2024-05-08T05:46:45.763106+0000","last_fullsized":"2024-05-08T05:46:45.763106+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:31:02.093446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.096731+0000","last_change":"2024-05-08T05:45:54.792665+0000","last_active":"2024-05-08T05:47:44.096731+0000","last_peered":"2024-05-08T05:47:44.096731+0000","last_clean":"2024-05-08T05:47:44.096731+0000","last_became_active":"2024-05-08T05:45:54.792309+0000","last_became_peered":"2024-05-08T05:45:54.792309+0000","last_unstale":"2024-05-08T05:47:44.096731+0000","last_undegraded":"2024-05-08T05:47:44.096731+0000","last_fullsized":"2024-05-08T05:47:44.096731+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:48:29.154009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'7","reported_seq":152,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:48:10.218698+0000","last_change":"2024-05-08T05:45:50.861234+0000","last_active":"2024-05-08T05:48:10.218698+0000","last_peered":"2024-05-08T05:48:10.218698+0000","last_clean":"2024-05-08T05:48:10.218698+0000","last_became_active":"2024-05-08T05:45:50.860885+0000","last_became_peered":"2024-05-08T05:45:50.860885+0000","last_unstale":"2024-05-08T05:48:10.218698+0000","last_undegraded":"2024-05-08T05:48:10.218698+0000","last_fullsized":"2024-05-08T05:48:10.218698+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:59:50.300316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.096172+0000","last_change":"2024-05-08T05:45:54.781154+0000","last_active":"2024-05-08T05:47:44.096172+0000","last_peered":"2024-05-08T05:47:44.096172+0000","last_clean":"2024-05-08T05:47:44.096172+0000","last_became_active":"2024-05-08T05:45:54.780340+0000","last_became_peered":"2024-05-08T05:45:54.780340+0000","last_unstale":"2024-05-08T05:47:44.096172+0000","last_undegraded":"2024-05-08T05:47:44.096172+0000","last_fullsized":"2024-05-08T05:47:44.096172+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:22:39.614532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'3","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.956451+0000","last_change":"2024-05-08T05:45:50.748015+0000","last_active":"2024-05-08T05:46:45.956451+0000","last_peered":"2024-05-08T05:46:45.956451+0000","last_clean":"2024-05-08T05:46:45.956451+0000","last_became_active":"2024-05-08T05:45:50.747649+0000","last_became_peered":"2024-05-08T05:45:50.747649+0000","last_unstale":"2024-05-08T05:46:45.956451+0000","last_undegraded":"2024-05-08T05:46:45.956451+0000","last_fullsized":"2024-05-08T05:46:45.956451+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:31:49.177676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.103573+0000","last_change":"2024-05-08T05:45:54.779680+0000","last_active":"2024-05-08T05:47:44.103573+0000","last_peered":"2024-05-08T05:47:44.103573+0000","last_clean":"2024-05-08T05:47:44.103573+0000","last_became_active":"2024-05-08T05:45:54.779273+0000","last_became_peered":"2024-05-08T05:45:54.779273+0000","last_unstale":"2024-05-08T05:47:44.103573+0000","last_undegraded":"2024-05-08T05:47:44.103573+0000","last_fullsized":"2024-05-08T05:47:44.103573+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:40:05.192134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"80'5","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.770430+0000","last_change":"2024-05-08T05:45:50.744569+0000","last_active":"2024-05-08T05:46:45.770430+0000","last_peered":"2024-05-08T05:46:45.770430+0000","last_clean":"2024-05-08T05:46:45.770430+0000","last_became_active":"2024-05-08T05:45:50.744164+0000","last_became_peered":"2024-05-08T05:45:50.744164+0000","last_unstale":"2024-05-08T05:46:45.770430+0000","last_undegraded":"2024-05-08T05:46:45.770430+0000","last_fullsized":"2024-05-08T05:46:45.770430+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:17:56.409110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.087373+0000","last_change":"2024-05-08T05:45:54.776338+0000","last_active":"2024-05-08T05:47:44.087373+0000","last_peered":"2024-05-08T05:47:44.087373+0000","last_clean":"2024-05-08T05:47:44.087373+0000","last_became_active":"2024-05-08T05:45:54.776015+0000","last_became_peered":"2024-05-08T05:45:54.776015+0000","last_unstale":"2024-05-08T05:47:44.087373+0000","last_undegraded":"2024-05-08T05:47:44.087373+0000","last_fullsized":"2024-05-08T05:47:44.087373+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:38:10.608436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.083568+0000","last_change":"2024-05-08T05:45:54.782245+0000","last_active":"2024-05-08T05:47:44.083568+0000","last_peered":"2024-05-08T05:47:44.083568+0000","last_clean":"2024-05-08T05:47:44.083568+0000","last_became_active":"2024-05-08T05:45:54.781860+0000","last_became_peered":"2024-05-08T05:45:54.781860+0000","last_unstale":"2024-05-08T05:47:44.083568+0000","last_undegraded":"2024-05-08T05:47:44.083568+0000","last_fullsized":"2024-05-08T05:47:44.083568+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:50:14.658930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.084173+0000","last_change":"2024-05-08T05:45:54.770787+0000","last_active":"2024-05-08T05:47:44.084173+0000","last_peered":"2024-05-08T05:47:44.084173+0000","last_clean":"2024-05-08T05:47:44.084173+0000","last_became_active":"2024-05-08T05:45:54.770409+0000","last_became_peered":"2024-05-08T05:45:54.770409+0000","last_unstale":"2024-05-08T05:47:44.084173+0000","last_undegraded":"2024-05-08T05:47:44.084173+0000","last_fullsized":"2024-05-08T05:47:44.084173+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:09:31.102075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.105251+0000","last_change":"2024-05-08T05:45:54.788799+0000","last_active":"2024-05-08T05:47:44.105251+0000","last_peered":"2024-05-08T05:47:44.105251+0000","last_clean":"2024-05-08T05:47:44.105251+0000","last_became_active":"2024-05-08T05:45:54.788295+0000","last_became_peered":"2024-05-08T05:45:54.788295+0000","last_unstale":"2024-05-08T05:47:44.105251+0000","last_undegraded":"2024-05-08T05:47:44.105251+0000","last_fullsized":"2024-05-08T05:47:44.105251+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:55:07.912479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.109609+0000","last_change":"2024-05-08T05:45:54.801316+0000","last_active":"2024-05-08T05:47:44.109609+0000","last_peered":"2024-05-08T05:47:44.109609+0000","last_clean":"2024-05-08T05:47:44.109609+0000","last_became_active":"2024-05-08T05:45:54.798655+0000","last_became_peered":"2024-05-08T05:45:54.798655+0000","last_unstale":"2024-05-08T05:47:44.109609+0000","last_undegraded":"2024-05-08T05:47:44.109609+0000","last_fullsized":"2024-05-08T05:47:44.109609+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:30:25.786822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.100854+0000","last_change":"2024-05-08T05:45:54.793076+0000","last_active":"2024-05-08T05:47:44.100854+0000","last_peered":"2024-05-08T05:47:44.100854+0000","last_clean":"2024-05-08T05:47:44.100854+0000","last_became_active":"2024-05-08T05:45:54.792726+0000","last_became_peered":"2024-05-08T05:45:54.792726+0000","last_unstale":"2024-05-08T05:47:44.100854+0000","last_undegraded":"2024-05-08T05:47:44.100854+0000","last_fullsized":"2024-05-08T05:47:44.100854+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:46:02.659667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.081706+0000","last_change":"2024-05-08T05:45:54.779134+0000","last_active":"2024-05-08T05:47:44.081706+0000","last_peered":"2024-05-08T05:47:44.081706+0000","last_clean":"2024-05-08T05:47:44.081706+0000","last_became_active":"2024-05-08T05:45:54.778764+0000","last_became_peered":"2024-05-08T05:45:54.778764+0000","last_unstale":"2024-05-08T05:47:44.081706+0000","last_undegraded":"2024-05-08T05:47:44.081706+0000","last_fullsized":"2024-05-08T05:47:44.081706+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:10:00.531228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.077624+0000","last_change":"2024-05-08T05:45:54.775628+0000","last_active":"2024-05-08T05:47:44.077624+0000","last_peered":"2024-05-08T05:47:44.077624+0000","last_clean":"2024-05-08T05:47:44.077624+0000","last_became_active":"2024-05-08T05:45:54.775293+0000","last_became_peered":"2024-05-08T05:45:54.775293+0000","last_unstale":"2024-05-08T05:47:44.077624+0000","last_undegraded":"2024-05-08T05:47:44.077624+0000","last_fullsized":"2024-05-08T05:47:44.077624+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:02:57.884691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.100249+0000","last_change":"2024-05-08T05:45:54.805054+0000","last_active":"2024-05-08T05:47:44.100249+0000","last_peered":"2024-05-08T05:47:44.100249+0000","last_clean":"2024-05-08T05:47:44.100249+0000","last_became_active":"2024-05-08T05:45:54.804642+0000","last_became_peered":"2024-05-08T05:45:54.804642+0000","last_unstale":"2024-05-08T05:47:44.100249+0000","last_undegraded":"2024-05-08T05:47:44.100249+0000","last_fullsized":"2024-05-08T05:47:44.100249+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:17:22.412759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.103859+0000","last_change":"2024-05-08T05:45:54.792217+0000","last_active":"2024-05-08T05:47:44.103859+0000","last_peered":"2024-05-08T05:47:44.103859+0000","last_clean":"2024-05-08T05:47:44.103859+0000","last_became_active":"2024-05-08T05:45:54.791508+0000","last_became_peered":"2024-05-08T05:45:54.791508+0000","last_unstale":"2024-05-08T05:47:44.103859+0000","last_undegraded":"2024-05-08T05:47:44.103859+0000","last_fullsized":"2024-05-08T05:47:44.103859+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:47:19.053306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.108264+0000","last_change":"2024-05-08T05:45:54.794538+0000","last_active":"2024-05-08T05:47:44.108264+0000","last_peered":"2024-05-08T05:47:44.108264+0000","last_clean":"2024-05-08T05:47:44.108264+0000","last_became_active":"2024-05-08T05:45:54.792575+0000","last_became_peered":"2024-05-08T05:45:54.792575+0000","last_unstale":"2024-05-08T05:47:44.108264+0000","last_undegraded":"2024-05-08T05:47:44.108264+0000","last_fullsized":"2024-05-08T05:47:44.108264+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:54:31.086864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.107048+0000","last_change":"2024-05-08T05:45:54.782828+0000","last_active":"2024-05-08T05:47:44.107048+0000","last_peered":"2024-05-08T05:47:44.107048+0000","last_clean":"2024-05-08T05:47:44.107048+0000","last_became_active":"2024-05-08T05:45:54.782442+0000","last_became_peered":"2024-05-08T05:45:54.782442+0000","last_unstale":"2024-05-08T05:47:44.107048+0000","last_undegraded":"2024-05-08T05:47:44.107048+0000","last_fullsized":"2024-05-08T05:47:44.107048+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:42:53.551455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.100977+0000","last_change":"2024-05-08T05:45:54.800422+0000","last_active":"2024-05-08T05:47:44.100977+0000","last_peered":"2024-05-08T05:47:44.100977+0000","last_clean":"2024-05-08T05:47:44.100977+0000","last_became_active":"2024-05-08T05:45:54.799853+0000","last_became_peered":"2024-05-08T05:45:54.799853+0000","last_unstale":"2024-05-08T05:47:44.100977+0000","last_undegraded":"2024-05-08T05:47:44.100977+0000","last_fullsized":"2024-05-08T05:47:44.100977+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:54:22.710347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.104228+0000","last_change":"2024-05-08T05:46:45.775876+0000","last_active":"2024-05-08T05:47:44.104228+0000","last_peered":"2024-05-08T05:47:44.104228+0000","last_clean":"2024-05-08T05:47:44.104228+0000","last_became_active":"2024-05-08T05:46:45.775558+0000","last_became_peered":"2024-05-08T05:46:45.775558+0000","last_unstale":"2024-05-08T05:47:44.104228+0000","last_undegraded":"2024-05-08T05:47:44.104228+0000","last_fullsized":"2024-05-08T05:47:44.104228+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:11:38.649137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":311296,"data_stored":3542208,"data_compressed":212518,"data_compressed_allocated":270336,"data_compressed_original":3522560,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":73123,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1185,"num_read_kb":662,"num_write":254,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":55290,"num_keys_recovered":20,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":536576,"data_stored":219369,"data_compressed":9129,"data_compressed_allocated":12288,"data_compressed_original":53248,"omap_allocated":0,"internal_metadata":0},"log_size":218,"ondisk_log_size":218,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645357,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":901120,"data_stored":436030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841587,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32204,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712948,"statfs":{"total":95995035648,"available":95962058752,"internally_reserved":0,"allocated":1052672,"data_stored":1092628,"data_compressed":35691,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037816,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":917504,"data_stored":435360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234046,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":913408,"data_stored":435738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430275,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":1027865,"data_compressed":35691,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593802,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":901120,"data_stored":435077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574949,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":502159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738474,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":921600,"data_stored":436948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411425,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":905216,"data_stored":436674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149786,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":917504,"data_stored":434902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953556,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":933888,"data_stored":501107,"data_compressed":9129,"data_compressed_allocated":12288,"data_compressed_original":53248,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790031,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":978944,"data_stored":1027543,"data_compressed":35691,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34063,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35691,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35691,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35691,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35691,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35691,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":67921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":66869,"data_compressed":9129,"data_compressed_allocated":12288,"data_compressed_original":53248,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":67905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T05:48:17.698 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph pg dump --format=json 2024-05-08T05:48:17.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:48:17 smithi134 ceph-mon[34132]: pgmap v388: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-08T05:48:17.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:48:17 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:48:17.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:48:17 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:48:17.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:48:17 smithi134 ceph-mon[34132]: from='client.24832 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T05:48:17.762 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:48:17 smithi082 ceph-mon[30098]: pgmap v388: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-08T05:48:17.763 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:48:17 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:48:17.763 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:48:17 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:48:17.763 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:48:17 smithi082 ceph-mon[30098]: from='client.24832 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T05:48:17.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:48:17 smithi151 ceph-mon[34815]: pgmap v388: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-08T05:48:17.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:48:17 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:48:17.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:48:17 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:48:17.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:48:17 smithi151 ceph-mon[34815]: from='client.24832 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T05:48:18.131 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:48:18.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:48:18 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:48:18.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:48:18 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:48:18.697 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:48:18 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:48:18.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:48:18 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:48:18.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:48:18 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:48:18.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:48:18 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:48:18.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:48:18 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:48:18.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:48:18 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:48:18.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:48:18 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:48:19.938 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:48:19 smithi082 ceph-mon[30098]: pgmap v389: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:48:20.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:48:19 smithi134 ceph-mon[34132]: pgmap v389: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:48:20.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:48:19 smithi151 ceph-mon[34815]: pgmap v389: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:48:20.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:20.463+0000 7f0948c00700 1 -- 172.21.15.82:0/2596422278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f094410fea0 msgr2=0x7f0944112290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:20.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:20.463+0000 7f0948c00700 1 --2- 172.21.15.82:0/2596422278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f094410fea0 0x7f0944112290 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f093c00b0a0 tx=0x7f093c00b3b0 comp rx=0 tx=0).stop 2024-05-08T05:48:20.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:20.463+0000 7f0948c00700 1 -- 172.21.15.82:0/2596422278 shutdown_connections 2024-05-08T05:48:20.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:20.463+0000 7f0948c00700 1 --2- 172.21.15.82:0/2596422278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f094410fea0 0x7f0944112290 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:20.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:20.463+0000 7f0948c00700 1 --2- 172.21.15.82:0/2596422278 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f09440756d0 0x7f0944075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:20.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:20.463+0000 7f0948c00700 1 --2- 172.21.15.82:0/2596422278 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0944075ff0 0x7f094410f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:20.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:20.463+0000 7f0948c00700 1 -- 172.21.15.82:0/2596422278 >> 172.21.15.82:0/2596422278 conn(0x7f094407a600 msgr2=0x7f094407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:20.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:20.464+0000 7f0948c00700 1 -- 172.21.15.82:0/2596422278 shutdown_connections 2024-05-08T05:48:20.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:20.464+0000 7f0948c00700 1 -- 172.21.15.82:0/2596422278 wait complete. 2024-05-08T05:48:20.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:20.465+0000 7f0948c00700 1 Processor -- start 2024-05-08T05:48:20.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:20.465+0000 7f0948c00700 1 -- start start 2024-05-08T05:48:20.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:20.465+0000 7f0948c00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09440756d0 0x7f094419bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:20.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:20.465+0000 7f0948c00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0944075ff0 0x7f094419c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:20.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:20.465+0000 7f0948c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f094410fea0 0x7f09441a0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:20.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:20.465+0000 7f0948c00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0944115870 con 0x7f094410fea0 2024-05-08T05:48:20.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:20.465+0000 7f0948c00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f09441156f0 con 0x7f09440756d0 2024-05-08T05:48:20.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:20.465+0000 7f0948c00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f09441159f0 con 0x7f0944075ff0 2024-05-08T05:48:20.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:20.466+0000 7f0941e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09440756d0 0x7f094419bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:20.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:20.466+0000 7f0942800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f094410fea0 0x7f09441a0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:20.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:20.466+0000 7f0941e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09440756d0 0x7f094419bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:53814/0 (socket says 172.21.15.82:53814) 2024-05-08T05:48:20.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:20.466+0000 7f0941e00700 1 -- 172.21.15.82:0/835199768 learned_addr learned my addr 172.21.15.82:0/835199768 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:48:20.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:20.466+0000 7f0941400700 1 --2- 172.21.15.82:0/835199768 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0944075ff0 0x7f094419c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:20.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:20.466+0000 7f0941e00700 1 -- 172.21.15.82:0/835199768 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0944075ff0 msgr2=0x7f094419c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:20.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:20.466+0000 7f0941e00700 1 --2- 172.21.15.82:0/835199768 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0944075ff0 0x7f094419c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:20.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:20.466+0000 7f0941e00700 1 -- 172.21.15.82:0/835199768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f094410fea0 msgr2=0x7f09441a0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:20.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:20.466+0000 7f0941e00700 1 --2- 172.21.15.82:0/835199768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f094410fea0 0x7f09441a0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:20.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:20.466+0000 7f0941e00700 1 -- 172.21.15.82:0/835199768 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09441a0d60 con 0x7f09440756d0 2024-05-08T05:48:20.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:20.466+0000 7f0941400700 1 --2- 172.21.15.82:0/835199768 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0944075ff0 0x7f094419c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:48:20.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:20.467+0000 7f0941e00700 1 --2- 172.21.15.82:0/835199768 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09440756d0 0x7f094419bda0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f093400eb30 tx=0x7f093400ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:20.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:20.467+0000 7f093aa00700 1 -- 172.21.15.82:0/835199768 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f093400cbd0 con 0x7f09440756d0 2024-05-08T05:48:20.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:20.467+0000 7f0948c00700 1 -- 172.21.15.82:0/835199768 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09441a1050 con 0x7f09440756d0 2024-05-08T05:48:20.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:20.467+0000 7f093aa00700 1 -- 172.21.15.82:0/835199768 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09340044d0 con 0x7f09440756d0 2024-05-08T05:48:20.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:20.467+0000 7f093aa00700 1 -- 172.21.15.82:0/835199768 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0934003e30 con 0x7f09440756d0 2024-05-08T05:48:20.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:20.467+0000 7f0948c00700 1 -- 172.21.15.82:0/835199768 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09441a88d0 con 0x7f09440756d0 2024-05-08T05:48:20.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:20.468+0000 7f0948c00700 1 -- 172.21.15.82:0/835199768 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f094406a190 con 0x7f09440756d0 2024-05-08T05:48:20.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:20.471+0000 7f093aa00700 1 -- 172.21.15.82:0/835199768 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f0934004000 con 0x7f09440756d0 2024-05-08T05:48:20.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:20.472+0000 7f093aa00700 1 --2- 172.21.15.82:0/835199768 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f09280b2900 0x7f09280b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:20.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:20.472+0000 7f093aa00700 1 -- 172.21.15.82:0/835199768 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f09340e2780 con 0x7f09440756d0 2024-05-08T05:48:20.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:20.472+0000 7f0941400700 1 --2- 172.21.15.82:0/835199768 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f09280b2900 0x7f09280b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:20.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:20.473+0000 7f0941400700 1 --2- 172.21.15.82:0/835199768 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f09280b2900 0x7f09280b4dc0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0944111bc0 tx=0x7f0930009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:20.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:20.474+0000 7f093aa00700 1 -- 172.21.15.82:0/835199768 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0934054df0 con 0x7f09440756d0 2024-05-08T05:48:20.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:20.699+0000 7f0948c00700 1 -- 172.21.15.82:0/835199768 --> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f09440638e0 con 0x7f09280b2900 2024-05-08T05:48:20.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:20.721+0000 7f093aa00700 1 -- 172.21.15.82:0/835199768 <== mgr.14152 v2:172.21.15.82:6800/4089180091 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259035 (secure 0 0 0) 0x7f09440638e0 con 0x7f09280b2900 2024-05-08T05:48:20.728 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:48:20.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:20.728+0000 7f0948c00700 1 -- 172.21.15.82:0/835199768 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f09280b2900 msgr2=0x7f09280b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:20.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:20.728+0000 7f0948c00700 1 --2- 172.21.15.82:0/835199768 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f09280b2900 0x7f09280b4dc0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0944111bc0 tx=0x7f0930009260 comp rx=0 tx=0).stop 2024-05-08T05:48:20.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:20.728+0000 7f0948c00700 1 -- 172.21.15.82:0/835199768 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09440756d0 msgr2=0x7f094419bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:20.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:20.728+0000 7f0948c00700 1 --2- 172.21.15.82:0/835199768 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09440756d0 0x7f094419bda0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f093400eb30 tx=0x7f093400ee40 comp rx=0 tx=0).stop 2024-05-08T05:48:20.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:20.728+0000 7f0948c00700 1 -- 172.21.15.82:0/835199768 shutdown_connections 2024-05-08T05:48:20.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:20.728+0000 7f0948c00700 1 --2- 172.21.15.82:0/835199768 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09440756d0 0x7f094419bda0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:20.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:20.728+0000 7f0948c00700 1 --2- 172.21.15.82:0/835199768 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f09280b2900 0x7f09280b4dc0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:20.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:20.728+0000 7f0948c00700 1 --2- 172.21.15.82:0/835199768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f094410fea0 0x7f09441a0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:20.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:20.728+0000 7f0948c00700 1 --2- 172.21.15.82:0/835199768 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0944075ff0 0x7f094419c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:20.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:20.728+0000 7f0948c00700 1 -- 172.21.15.82:0/835199768 >> 172.21.15.82:0/835199768 conn(0x7f094407a600 msgr2=0x7f0944100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:20.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:20.729+0000 7f0948c00700 1 -- 172.21.15.82:0/835199768 shutdown_connections 2024-05-08T05:48:20.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:20.729+0000 7f0948c00700 1 -- 172.21.15.82:0/835199768 wait complete. 2024-05-08T05:48:20.731 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-05-08T05:48:21.604 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":390,"stamp":"2024-05-08T05:48:20.159063+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":663725,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1306,"num_read_kb":751,"num_write":379,"num_write_kb":2298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":3007130,"num_keys_recovered":20,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":812,"ondisk_log_size":812,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":351844,"kb_used_data":11012,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124589980,"statfs":{"total":1151940427776,"available":1151580139520,"internally_reserved":0,"allocated":11276288,"data_stored":7202031,"data_compressed":116202,"data_compressed_allocated":147456,"data_compressed_original":1822720,"omap_allocated":19138,"internal_metadata":348894526},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":60,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005107"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.105050+0000","last_change":"2024-05-08T05:45:54.796792+0000","last_active":"2024-05-08T05:47:44.105050+0000","last_peered":"2024-05-08T05:47:44.105050+0000","last_clean":"2024-05-08T05:47:44.105050+0000","last_became_active":"2024-05-08T05:45:54.796445+0000","last_became_peered":"2024-05-08T05:45:54.796445+0000","last_unstale":"2024-05-08T05:47:44.105050+0000","last_undegraded":"2024-05-08T05:47:44.105050+0000","last_fullsized":"2024-05-08T05:47:44.105050+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:41:12.762659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.108155+0000","last_change":"2024-05-08T05:45:54.800291+0000","last_active":"2024-05-08T05:47:44.108155+0000","last_peered":"2024-05-08T05:47:44.108155+0000","last_clean":"2024-05-08T05:47:44.108155+0000","last_became_active":"2024-05-08T05:45:54.798182+0000","last_became_peered":"2024-05-08T05:45:54.798182+0000","last_unstale":"2024-05-08T05:47:44.108155+0000","last_undegraded":"2024-05-08T05:47:44.108155+0000","last_fullsized":"2024-05-08T05:47:44.108155+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:55:52.672307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.110374+0000","last_change":"2024-05-08T05:45:54.792574+0000","last_active":"2024-05-08T05:47:44.110374+0000","last_peered":"2024-05-08T05:47:44.110374+0000","last_clean":"2024-05-08T05:47:44.110374+0000","last_became_active":"2024-05-08T05:45:54.790856+0000","last_became_peered":"2024-05-08T05:45:54.790856+0000","last_unstale":"2024-05-08T05:47:44.110374+0000","last_undegraded":"2024-05-08T05:47:44.110374+0000","last_fullsized":"2024-05-08T05:47:44.110374+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:32:33.727532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.082640+0000","last_change":"2024-05-08T05:45:54.772883+0000","last_active":"2024-05-08T05:47:44.082640+0000","last_peered":"2024-05-08T05:47:44.082640+0000","last_clean":"2024-05-08T05:47:44.082640+0000","last_became_active":"2024-05-08T05:45:54.772457+0000","last_became_peered":"2024-05-08T05:45:54.772457+0000","last_unstale":"2024-05-08T05:47:44.082640+0000","last_undegraded":"2024-05-08T05:47:44.082640+0000","last_fullsized":"2024-05-08T05:47:44.082640+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:50:20.116563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":24,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.104399+0000","last_change":"2024-05-08T05:45:54.798868+0000","last_active":"2024-05-08T05:47:44.104399+0000","last_peered":"2024-05-08T05:47:44.104399+0000","last_clean":"2024-05-08T05:47:44.104399+0000","last_became_active":"2024-05-08T05:45:54.798459+0000","last_became_peered":"2024-05-08T05:45:54.798459+0000","last_unstale":"2024-05-08T05:47:44.104399+0000","last_undegraded":"2024-05-08T05:47:44.104399+0000","last_fullsized":"2024-05-08T05:47:44.104399+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:59:32.280051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.103327+0000","last_change":"2024-05-08T05:45:54.788172+0000","last_active":"2024-05-08T05:47:44.103327+0000","last_peered":"2024-05-08T05:47:44.103327+0000","last_clean":"2024-05-08T05:47:44.103327+0000","last_became_active":"2024-05-08T05:45:54.787609+0000","last_became_peered":"2024-05-08T05:45:54.787609+0000","last_unstale":"2024-05-08T05:47:44.103327+0000","last_undegraded":"2024-05-08T05:47:44.103327+0000","last_fullsized":"2024-05-08T05:47:44.103327+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:30:17.295770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.086629+0000","last_change":"2024-05-08T05:45:54.786904+0000","last_active":"2024-05-08T05:47:44.086629+0000","last_peered":"2024-05-08T05:47:44.086629+0000","last_clean":"2024-05-08T05:47:44.086629+0000","last_became_active":"2024-05-08T05:45:54.786484+0000","last_became_peered":"2024-05-08T05:45:54.786484+0000","last_unstale":"2024-05-08T05:47:44.086629+0000","last_undegraded":"2024-05-08T05:47:44.086629+0000","last_fullsized":"2024-05-08T05:47:44.086629+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:14:15.398144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.104653+0000","last_change":"2024-05-08T05:45:54.801559+0000","last_active":"2024-05-08T05:47:44.104653+0000","last_peered":"2024-05-08T05:47:44.104653+0000","last_clean":"2024-05-08T05:47:44.104653+0000","last_became_active":"2024-05-08T05:45:54.796293+0000","last_became_peered":"2024-05-08T05:45:54.796293+0000","last_unstale":"2024-05-08T05:47:44.104653+0000","last_undegraded":"2024-05-08T05:47:44.104653+0000","last_fullsized":"2024-05-08T05:47:44.104653+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:07:05.483562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.097483+0000","last_change":"2024-05-08T05:45:54.780450+0000","last_active":"2024-05-08T05:47:44.097483+0000","last_peered":"2024-05-08T05:47:44.097483+0000","last_clean":"2024-05-08T05:47:44.097483+0000","last_became_active":"2024-05-08T05:45:54.780079+0000","last_became_peered":"2024-05-08T05:45:54.780079+0000","last_unstale":"2024-05-08T05:47:44.097483+0000","last_undegraded":"2024-05-08T05:47:44.097483+0000","last_fullsized":"2024-05-08T05:47:44.097483+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:41:26.688748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.078300+0000","last_change":"2024-05-08T05:45:54.776294+0000","last_active":"2024-05-08T05:47:44.078300+0000","last_peered":"2024-05-08T05:47:44.078300+0000","last_clean":"2024-05-08T05:47:44.078300+0000","last_became_active":"2024-05-08T05:45:54.775928+0000","last_became_peered":"2024-05-08T05:45:54.775928+0000","last_unstale":"2024-05-08T05:47:44.078300+0000","last_undegraded":"2024-05-08T05:47:44.078300+0000","last_fullsized":"2024-05-08T05:47:44.078300+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:17:53.453446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.095848+0000","last_change":"2024-05-08T05:45:54.781478+0000","last_active":"2024-05-08T05:47:44.095848+0000","last_peered":"2024-05-08T05:47:44.095848+0000","last_clean":"2024-05-08T05:47:44.095848+0000","last_became_active":"2024-05-08T05:45:54.780839+0000","last_became_peered":"2024-05-08T05:45:54.780839+0000","last_unstale":"2024-05-08T05:47:44.095848+0000","last_undegraded":"2024-05-08T05:47:44.095848+0000","last_fullsized":"2024-05-08T05:47:44.095848+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:39:14.518391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.082311+0000","last_change":"2024-05-08T05:45:54.774650+0000","last_active":"2024-05-08T05:47:44.082311+0000","last_peered":"2024-05-08T05:47:44.082311+0000","last_clean":"2024-05-08T05:47:44.082311+0000","last_became_active":"2024-05-08T05:45:54.774276+0000","last_became_peered":"2024-05-08T05:45:54.774276+0000","last_unstale":"2024-05-08T05:47:44.082311+0000","last_undegraded":"2024-05-08T05:47:44.082311+0000","last_fullsized":"2024-05-08T05:47:44.082311+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:43:53.390553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.093679+0000","last_change":"2024-05-08T05:45:54.783430+0000","last_active":"2024-05-08T05:47:44.093679+0000","last_peered":"2024-05-08T05:47:44.093679+0000","last_clean":"2024-05-08T05:47:44.093679+0000","last_became_active":"2024-05-08T05:45:54.782394+0000","last_became_peered":"2024-05-08T05:45:54.782394+0000","last_unstale":"2024-05-08T05:47:44.093679+0000","last_undegraded":"2024-05-08T05:47:44.093679+0000","last_fullsized":"2024-05-08T05:47:44.093679+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:47:01.864111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.107049+0000","last_change":"2024-05-08T05:45:54.792880+0000","last_active":"2024-05-08T05:47:44.107049+0000","last_peered":"2024-05-08T05:47:44.107049+0000","last_clean":"2024-05-08T05:47:44.107049+0000","last_became_active":"2024-05-08T05:45:54.789653+0000","last_became_peered":"2024-05-08T05:45:54.789653+0000","last_unstale":"2024-05-08T05:47:44.107049+0000","last_undegraded":"2024-05-08T05:47:44.107049+0000","last_fullsized":"2024-05-08T05:47:44.107049+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:57:10.552014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.105891+0000","last_change":"2024-05-08T05:45:54.793612+0000","last_active":"2024-05-08T05:47:44.105891+0000","last_peered":"2024-05-08T05:47:44.105891+0000","last_clean":"2024-05-08T05:47:44.105891+0000","last_became_active":"2024-05-08T05:45:54.793191+0000","last_became_peered":"2024-05-08T05:45:54.793191+0000","last_unstale":"2024-05-08T05:47:44.105891+0000","last_undegraded":"2024-05-08T05:47:44.105891+0000","last_fullsized":"2024-05-08T05:47:44.105891+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:49:35.066070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.110756+0000","last_change":"2024-05-08T05:45:54.799679+0000","last_active":"2024-05-08T05:47:44.110756+0000","last_peered":"2024-05-08T05:47:44.110756+0000","last_clean":"2024-05-08T05:47:44.110756+0000","last_became_active":"2024-05-08T05:45:54.799196+0000","last_became_peered":"2024-05-08T05:45:54.799196+0000","last_unstale":"2024-05-08T05:47:44.110756+0000","last_undegraded":"2024-05-08T05:47:44.110756+0000","last_fullsized":"2024-05-08T05:47:44.110756+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:14:00.597282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.104930+0000","last_change":"2024-05-08T05:45:54.796799+0000","last_active":"2024-05-08T05:47:44.104930+0000","last_peered":"2024-05-08T05:47:44.104930+0000","last_clean":"2024-05-08T05:47:44.104930+0000","last_became_active":"2024-05-08T05:45:54.796501+0000","last_became_peered":"2024-05-08T05:45:54.796501+0000","last_unstale":"2024-05-08T05:47:44.104930+0000","last_undegraded":"2024-05-08T05:47:44.104930+0000","last_fullsized":"2024-05-08T05:47:44.104930+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:14:59.446718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.108986+0000","last_change":"2024-05-08T05:45:54.789544+0000","last_active":"2024-05-08T05:47:44.108986+0000","last_peered":"2024-05-08T05:47:44.108986+0000","last_clean":"2024-05-08T05:47:44.108986+0000","last_became_active":"2024-05-08T05:45:54.787901+0000","last_became_peered":"2024-05-08T05:45:54.787901+0000","last_unstale":"2024-05-08T05:47:44.108986+0000","last_undegraded":"2024-05-08T05:47:44.108986+0000","last_fullsized":"2024-05-08T05:47:44.108986+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:12:23.200311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.104801+0000","last_change":"2024-05-08T05:45:54.782537+0000","last_active":"2024-05-08T05:47:44.104801+0000","last_peered":"2024-05-08T05:47:44.104801+0000","last_clean":"2024-05-08T05:47:44.104801+0000","last_became_active":"2024-05-08T05:45:54.781389+0000","last_became_peered":"2024-05-08T05:45:54.781389+0000","last_unstale":"2024-05-08T05:47:44.104801+0000","last_undegraded":"2024-05-08T05:47:44.104801+0000","last_fullsized":"2024-05-08T05:47:44.104801+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:56:22.041900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"80'13","reported_seq":162,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:48:17.253507+0000","last_change":"2024-05-08T05:45:50.744496+0000","last_active":"2024-05-08T05:48:17.253507+0000","last_peered":"2024-05-08T05:48:17.253507+0000","last_clean":"2024-05-08T05:48:17.253507+0000","last_became_active":"2024-05-08T05:45:50.743882+0000","last_became_peered":"2024-05-08T05:45:50.743882+0000","last_unstale":"2024-05-08T05:48:17.253507+0000","last_undegraded":"2024-05-08T05:48:17.253507+0000","last_fullsized":"2024-05-08T05:48:17.253507+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:45:11.198096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":16,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.078945+0000","last_change":"2024-05-08T05:46:45.957649+0000","last_active":"2024-05-08T05:47:44.078945+0000","last_peered":"2024-05-08T05:47:44.078945+0000","last_clean":"2024-05-08T05:47:44.078945+0000","last_became_active":"2024-05-08T05:46:45.957154+0000","last_became_peered":"2024-05-08T05:46:45.957154+0000","last_unstale":"2024-05-08T05:47:44.078945+0000","last_undegraded":"2024-05-08T05:47:44.078945+0000","last_fullsized":"2024-05-08T05:47:44.078945+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:29:25.475541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.763814+0000","last_change":"2024-05-08T05:45:50.863409+0000","last_active":"2024-05-08T05:46:45.763814+0000","last_peered":"2024-05-08T05:46:45.763814+0000","last_clean":"2024-05-08T05:46:45.763814+0000","last_became_active":"2024-05-08T05:45:50.861818+0000","last_became_peered":"2024-05-08T05:45:50.861818+0000","last_unstale":"2024-05-08T05:46:45.763814+0000","last_undegraded":"2024-05-08T05:46:45.763814+0000","last_fullsized":"2024-05-08T05:46:45.763814+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:39:32.821431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.110364+0000","last_change":"2024-05-08T05:45:54.797429+0000","last_active":"2024-05-08T05:47:44.110364+0000","last_peered":"2024-05-08T05:47:44.110364+0000","last_clean":"2024-05-08T05:47:44.110364+0000","last_became_active":"2024-05-08T05:45:54.795030+0000","last_became_peered":"2024-05-08T05:45:54.795030+0000","last_unstale":"2024-05-08T05:47:44.110364+0000","last_undegraded":"2024-05-08T05:47:44.110364+0000","last_fullsized":"2024-05-08T05:47:44.110364+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:43:34.852889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"80'12","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.772846+0000","last_change":"2024-05-08T05:46:45.772846+0000","last_active":"2024-05-08T05:46:45.772846+0000","last_peered":"2024-05-08T05:46:45.772846+0000","last_clean":"2024-05-08T05:46:45.772846+0000","last_became_active":"2024-05-08T05:46:45.763937+0000","last_became_peered":"2024-05-08T05:46:45.763937+0000","last_unstale":"2024-05-08T05:46:45.772846+0000","last_undegraded":"2024-05-08T05:46:45.772846+0000","last_fullsized":"2024-05-08T05:46:45.772846+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:48:13.233059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.099343+0000","last_change":"2024-05-08T05:45:54.788852+0000","last_active":"2024-05-08T05:47:44.099343+0000","last_peered":"2024-05-08T05:47:44.099343+0000","last_clean":"2024-05-08T05:47:44.099343+0000","last_became_active":"2024-05-08T05:45:54.788496+0000","last_became_peered":"2024-05-08T05:45:54.788496+0000","last_unstale":"2024-05-08T05:47:44.099343+0000","last_undegraded":"2024-05-08T05:47:44.099343+0000","last_fullsized":"2024-05-08T05:47:44.099343+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:44:45.379728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"80'5","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762912+0000","last_change":"2024-05-08T05:45:50.741528+0000","last_active":"2024-05-08T05:46:45.762912+0000","last_peered":"2024-05-08T05:46:45.762912+0000","last_clean":"2024-05-08T05:46:45.762912+0000","last_became_active":"2024-05-08T05:45:50.741232+0000","last_became_peered":"2024-05-08T05:45:50.741232+0000","last_unstale":"2024-05-08T05:46:45.762912+0000","last_undegraded":"2024-05-08T05:46:45.762912+0000","last_fullsized":"2024-05-08T05:46:45.762912+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:36:48.540858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.099632+0000","last_change":"2024-05-08T05:46:45.954990+0000","last_active":"2024-05-08T05:47:44.099632+0000","last_peered":"2024-05-08T05:47:44.099632+0000","last_clean":"2024-05-08T05:47:44.099632+0000","last_became_active":"2024-05-08T05:46:45.953589+0000","last_became_peered":"2024-05-08T05:46:45.953589+0000","last_unstale":"2024-05-08T05:47:44.099632+0000","last_undegraded":"2024-05-08T05:47:44.099632+0000","last_fullsized":"2024-05-08T05:47:44.099632+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:29:17.410356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1b","version":"80'5","reported_seq":156,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:48:19.162911+0000","last_change":"2024-05-08T05:45:50.746462+0000","last_active":"2024-05-08T05:48:19.162911+0000","last_peered":"2024-05-08T05:48:19.162911+0000","last_clean":"2024-05-08T05:48:19.162911+0000","last_became_active":"2024-05-08T05:45:50.746064+0000","last_became_peered":"2024-05-08T05:45:50.746064+0000","last_unstale":"2024-05-08T05:48:19.162911+0000","last_undegraded":"2024-05-08T05:48:19.162911+0000","last_fullsized":"2024-05-08T05:48:19.162911+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:51:49.076829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":124,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.084254+0000","last_change":"2024-05-08T05:45:54.788524+0000","last_active":"2024-05-08T05:47:44.084254+0000","last_peered":"2024-05-08T05:47:44.084254+0000","last_clean":"2024-05-08T05:47:44.084254+0000","last_became_active":"2024-05-08T05:45:54.788179+0000","last_became_peered":"2024-05-08T05:45:54.788179+0000","last_unstale":"2024-05-08T05:47:44.084254+0000","last_undegraded":"2024-05-08T05:47:44.084254+0000","last_fullsized":"2024-05-08T05:47:44.084254+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:44:34.257799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":47,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.780705+0000","last_change":"2024-05-08T05:46:45.780705+0000","last_active":"2024-05-08T05:46:45.780705+0000","last_peered":"2024-05-08T05:46:45.780705+0000","last_clean":"2024-05-08T05:46:45.780705+0000","last_became_active":"2024-05-08T05:46:45.773246+0000","last_became_peered":"2024-05-08T05:46:45.773246+0000","last_unstale":"2024-05-08T05:46:45.780705+0000","last_undegraded":"2024-05-08T05:46:45.780705+0000","last_fullsized":"2024-05-08T05:46:45.780705+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:10:33.491186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.103737+0000","last_change":"2024-05-08T05:45:54.792001+0000","last_active":"2024-05-08T05:47:44.103737+0000","last_peered":"2024-05-08T05:47:44.103737+0000","last_clean":"2024-05-08T05:47:44.103737+0000","last_became_active":"2024-05-08T05:45:54.791581+0000","last_became_peered":"2024-05-08T05:45:54.791581+0000","last_unstale":"2024-05-08T05:47:44.103737+0000","last_undegraded":"2024-05-08T05:47:44.103737+0000","last_fullsized":"2024-05-08T05:47:44.103737+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:43:37.437251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"80'3","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.771676+0000","last_change":"2024-05-08T05:45:50.740645+0000","last_active":"2024-05-08T05:46:45.771676+0000","last_peered":"2024-05-08T05:46:45.771676+0000","last_clean":"2024-05-08T05:46:45.771676+0000","last_became_active":"2024-05-08T05:45:50.739997+0000","last_became_peered":"2024-05-08T05:45:50.739997+0000","last_unstale":"2024-05-08T05:46:45.771676+0000","last_undegraded":"2024-05-08T05:46:45.771676+0000","last_fullsized":"2024-05-08T05:46:45.771676+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:24:48.895557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.105072+0000","last_change":"2024-05-08T05:45:54.802757+0000","last_active":"2024-05-08T05:47:44.105072+0000","last_peered":"2024-05-08T05:47:44.105072+0000","last_clean":"2024-05-08T05:47:44.105072+0000","last_became_active":"2024-05-08T05:45:54.798549+0000","last_became_peered":"2024-05-08T05:45:54.798549+0000","last_unstale":"2024-05-08T05:47:44.105072+0000","last_undegraded":"2024-05-08T05:47:44.105072+0000","last_fullsized":"2024-05-08T05:47:44.105072+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:39:37.582997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'3","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.956005+0000","last_change":"2024-05-08T05:45:50.743989+0000","last_active":"2024-05-08T05:46:45.956005+0000","last_peered":"2024-05-08T05:46:45.956005+0000","last_clean":"2024-05-08T05:46:45.956005+0000","last_became_active":"2024-05-08T05:45:50.743582+0000","last_became_peered":"2024-05-08T05:45:50.743582+0000","last_unstale":"2024-05-08T05:46:45.956005+0000","last_undegraded":"2024-05-08T05:46:45.956005+0000","last_fullsized":"2024-05-08T05:46:45.956005+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:14:46.820582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.108021+0000","last_change":"2024-05-08T05:45:54.807249+0000","last_active":"2024-05-08T05:47:44.108021+0000","last_peered":"2024-05-08T05:47:44.108021+0000","last_clean":"2024-05-08T05:47:44.108021+0000","last_became_active":"2024-05-08T05:45:54.806823+0000","last_became_peered":"2024-05-08T05:45:54.806823+0000","last_unstale":"2024-05-08T05:47:44.108021+0000","last_undegraded":"2024-05-08T05:47:44.108021+0000","last_fullsized":"2024-05-08T05:47:44.108021+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:37:25.526927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'5","reported_seq":270,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:48:16.229977+0000","last_change":"2024-05-08T05:45:50.747477+0000","last_active":"2024-05-08T05:48:16.229977+0000","last_peered":"2024-05-08T05:48:16.229977+0000","last_clean":"2024-05-08T05:48:16.229977+0000","last_became_active":"2024-05-08T05:45:50.747103+0000","last_became_peered":"2024-05-08T05:45:50.747103+0000","last_unstale":"2024-05-08T05:48:16.229977+0000","last_undegraded":"2024-05-08T05:48:16.229977+0000","last_fullsized":"2024-05-08T05:48:16.229977+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:08:17.108826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":238,"num_read_kb":238,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.109002+0000","last_change":"2024-05-08T05:45:54.787885+0000","last_active":"2024-05-08T05:47:44.109002+0000","last_peered":"2024-05-08T05:47:44.109002+0000","last_clean":"2024-05-08T05:47:44.109002+0000","last_became_active":"2024-05-08T05:45:54.787480+0000","last_became_peered":"2024-05-08T05:45:54.787480+0000","last_unstale":"2024-05-08T05:47:44.109002+0000","last_undegraded":"2024-05-08T05:47:44.109002+0000","last_fullsized":"2024-05-08T05:47:44.109002+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:13:42.889918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'4","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.763077+0000","last_change":"2024-05-08T05:45:50.741271+0000","last_active":"2024-05-08T05:46:45.763077+0000","last_peered":"2024-05-08T05:46:45.763077+0000","last_clean":"2024-05-08T05:46:45.763077+0000","last_became_active":"2024-05-08T05:45:50.740869+0000","last_became_peered":"2024-05-08T05:45:50.740869+0000","last_unstale":"2024-05-08T05:46:45.763077+0000","last_undegraded":"2024-05-08T05:46:45.763077+0000","last_fullsized":"2024-05-08T05:46:45.763077+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:57:40.855732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.107639+0000","last_change":"2024-05-08T05:46:45.958524+0000","last_active":"2024-05-08T05:47:44.107639+0000","last_peered":"2024-05-08T05:47:44.107639+0000","last_clean":"2024-05-08T05:47:44.107639+0000","last_became_active":"2024-05-08T05:46:45.957576+0000","last_became_peered":"2024-05-08T05:46:45.957576+0000","last_unstale":"2024-05-08T05:47:44.107639+0000","last_undegraded":"2024-05-08T05:47:44.107639+0000","last_fullsized":"2024-05-08T05:47:44.107639+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:59:34.927448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.956564+0000","last_change":"2024-05-08T05:45:50.865467+0000","last_active":"2024-05-08T05:46:45.956564+0000","last_peered":"2024-05-08T05:46:45.956564+0000","last_clean":"2024-05-08T05:46:45.956564+0000","last_became_active":"2024-05-08T05:45:50.865245+0000","last_became_peered":"2024-05-08T05:45:50.865245+0000","last_unstale":"2024-05-08T05:46:45.956564+0000","last_undegraded":"2024-05-08T05:46:45.956564+0000","last_fullsized":"2024-05-08T05:46:45.956564+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:03:40.990651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.099169+0000","last_change":"2024-05-08T05:45:54.780782+0000","last_active":"2024-05-08T05:47:44.099169+0000","last_peered":"2024-05-08T05:47:44.099169+0000","last_clean":"2024-05-08T05:47:44.099169+0000","last_became_active":"2024-05-08T05:45:54.780074+0000","last_became_peered":"2024-05-08T05:45:54.780074+0000","last_unstale":"2024-05-08T05:47:44.099169+0000","last_undegraded":"2024-05-08T05:47:44.099169+0000","last_fullsized":"2024-05-08T05:47:44.099169+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:23:09.026115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'36","reported_seq":332,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:48:16.119122+0000","last_change":"2024-05-08T05:46:45.965985+0000","last_active":"2024-05-08T05:48:16.119122+0000","last_peered":"2024-05-08T05:48:16.119122+0000","last_clean":"2024-05-08T05:48:16.119122+0000","last_became_active":"2024-05-08T05:46:45.953485+0000","last_became_peered":"2024-05-08T05:46:45.953485+0000","last_unstale":"2024-05-08T05:48:16.119122+0000","last_undegraded":"2024-05-08T05:48:16.119122+0000","last_fullsized":"2024-05-08T05:48:16.119122+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:51:45.723988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66169,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":240,"num_read_kb":177,"num_write":38,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":55222,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.088260+0000","last_change":"2024-05-08T05:45:54.777524+0000","last_active":"2024-05-08T05:47:44.088260+0000","last_peered":"2024-05-08T05:47:44.088260+0000","last_clean":"2024-05-08T05:47:44.088260+0000","last_became_active":"2024-05-08T05:45:54.776756+0000","last_became_peered":"2024-05-08T05:45:54.776756+0000","last_unstale":"2024-05-08T05:47:44.088260+0000","last_undegraded":"2024-05-08T05:47:44.088260+0000","last_fullsized":"2024-05-08T05:47:44.088260+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:54:27.320411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'9","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.783284+0000","last_change":"2024-05-08T05:46:45.783284+0000","last_active":"2024-05-08T05:46:45.783284+0000","last_peered":"2024-05-08T05:46:45.783284+0000","last_clean":"2024-05-08T05:46:45.783284+0000","last_became_active":"2024-05-08T05:46:45.765201+0000","last_became_peered":"2024-05-08T05:46:45.765201+0000","last_unstale":"2024-05-08T05:46:45.783284+0000","last_undegraded":"2024-05-08T05:46:45.783284+0000","last_fullsized":"2024-05-08T05:46:45.783284+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:44:59.762324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.105689+0000","last_change":"2024-05-08T05:45:54.789165+0000","last_active":"2024-05-08T05:47:44.105689+0000","last_peered":"2024-05-08T05:47:44.105689+0000","last_clean":"2024-05-08T05:47:44.105689+0000","last_became_active":"2024-05-08T05:45:54.788673+0000","last_became_peered":"2024-05-08T05:45:54.788673+0000","last_unstale":"2024-05-08T05:47:44.105689+0000","last_undegraded":"2024-05-08T05:47:44.105689+0000","last_fullsized":"2024-05-08T05:47:44.105689+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:29:08.722409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'5","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.956256+0000","last_change":"2024-05-08T05:45:50.750836+0000","last_active":"2024-05-08T05:46:45.956256+0000","last_peered":"2024-05-08T05:46:45.956256+0000","last_clean":"2024-05-08T05:46:45.956256+0000","last_became_active":"2024-05-08T05:45:50.750587+0000","last_became_peered":"2024-05-08T05:45:50.750587+0000","last_unstale":"2024-05-08T05:46:45.956256+0000","last_undegraded":"2024-05-08T05:46:45.956256+0000","last_fullsized":"2024-05-08T05:46:45.956256+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:19:03.780050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.096929+0000","last_change":"2024-05-08T05:45:54.791475+0000","last_active":"2024-05-08T05:47:44.096929+0000","last_peered":"2024-05-08T05:47:44.096929+0000","last_clean":"2024-05-08T05:47:44.096929+0000","last_became_active":"2024-05-08T05:45:54.791122+0000","last_became_peered":"2024-05-08T05:45:54.791122+0000","last_unstale":"2024-05-08T05:47:44.096929+0000","last_undegraded":"2024-05-08T05:47:44.096929+0000","last_fullsized":"2024-05-08T05:47:44.096929+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:08:01.261852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"80'5","reported_seq":151,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:48:13.194531+0000","last_change":"2024-05-08T05:45:50.742848+0000","last_active":"2024-05-08T05:48:13.194531+0000","last_peered":"2024-05-08T05:48:13.194531+0000","last_clean":"2024-05-08T05:48:13.194531+0000","last_became_active":"2024-05-08T05:45:50.742448+0000","last_became_peered":"2024-05-08T05:45:50.742448+0000","last_unstale":"2024-05-08T05:48:13.194531+0000","last_undegraded":"2024-05-08T05:48:13.194531+0000","last_fullsized":"2024-05-08T05:48:13.194531+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:17:35.970285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":120,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.083819+0000","last_change":"2024-05-08T05:45:54.773009+0000","last_active":"2024-05-08T05:47:44.083819+0000","last_peered":"2024-05-08T05:47:44.083819+0000","last_clean":"2024-05-08T05:47:44.083819+0000","last_became_active":"2024-05-08T05:45:54.772597+0000","last_became_peered":"2024-05-08T05:45:54.772597+0000","last_unstale":"2024-05-08T05:47:44.083819+0000","last_undegraded":"2024-05-08T05:47:44.083819+0000","last_fullsized":"2024-05-08T05:47:44.083819+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:41:31.632363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'17","reported_seq":45,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762777+0000","last_change":"2024-05-08T05:45:50.867734+0000","last_active":"2024-05-08T05:46:45.762777+0000","last_peered":"2024-05-08T05:46:45.762777+0000","last_clean":"2024-05-08T05:46:45.762777+0000","last_became_active":"2024-05-08T05:45:50.867441+0000","last_became_peered":"2024-05-08T05:45:50.867441+0000","last_unstale":"2024-05-08T05:46:45.762777+0000","last_undegraded":"2024-05-08T05:46:45.762777+0000","last_fullsized":"2024-05-08T05:46:45.762777+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:16:45.430432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.083526+0000","last_change":"2024-05-08T05:45:54.777168+0000","last_active":"2024-05-08T05:47:44.083526+0000","last_peered":"2024-05-08T05:47:44.083526+0000","last_clean":"2024-05-08T05:47:44.083526+0000","last_became_active":"2024-05-08T05:45:54.775985+0000","last_became_peered":"2024-05-08T05:45:54.775985+0000","last_unstale":"2024-05-08T05:47:44.083526+0000","last_undegraded":"2024-05-08T05:47:44.083526+0000","last_fullsized":"2024-05-08T05:47:44.083526+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:57:49.495860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762618+0000","last_change":"2024-05-08T05:45:50.741375+0000","last_active":"2024-05-08T05:46:45.762618+0000","last_peered":"2024-05-08T05:46:45.762618+0000","last_clean":"2024-05-08T05:46:45.762618+0000","last_became_active":"2024-05-08T05:45:50.741025+0000","last_became_peered":"2024-05-08T05:45:50.741025+0000","last_unstale":"2024-05-08T05:46:45.762618+0000","last_undegraded":"2024-05-08T05:46:45.762618+0000","last_fullsized":"2024-05-08T05:46:45.762618+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:01:43.515119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.082394+0000","last_change":"2024-05-08T05:45:54.780302+0000","last_active":"2024-05-08T05:47:44.082394+0000","last_peered":"2024-05-08T05:47:44.082394+0000","last_clean":"2024-05-08T05:47:44.082394+0000","last_became_active":"2024-05-08T05:45:54.778751+0000","last_became_peered":"2024-05-08T05:45:54.778751+0000","last_unstale":"2024-05-08T05:47:44.082394+0000","last_undegraded":"2024-05-08T05:47:44.082394+0000","last_fullsized":"2024-05-08T05:47:44.082394+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:34:57.686504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.770582+0000","last_change":"2024-05-08T05:45:50.870071+0000","last_active":"2024-05-08T05:46:45.770582+0000","last_peered":"2024-05-08T05:46:45.770582+0000","last_clean":"2024-05-08T05:46:45.770582+0000","last_became_active":"2024-05-08T05:45:50.869162+0000","last_became_peered":"2024-05-08T05:45:50.869162+0000","last_unstale":"2024-05-08T05:46:45.770582+0000","last_undegraded":"2024-05-08T05:46:45.770582+0000","last_fullsized":"2024-05-08T05:46:45.770582+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:05:13.104922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.104028+0000","last_change":"2024-05-08T05:45:54.780983+0000","last_active":"2024-05-08T05:47:44.104028+0000","last_peered":"2024-05-08T05:47:44.104028+0000","last_clean":"2024-05-08T05:47:44.104028+0000","last_became_active":"2024-05-08T05:45:54.780617+0000","last_became_peered":"2024-05-08T05:45:54.780617+0000","last_unstale":"2024-05-08T05:47:44.104028+0000","last_undegraded":"2024-05-08T05:47:44.104028+0000","last_fullsized":"2024-05-08T05:47:44.104028+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:56:40.972467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"80'5","reported_seq":155,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:48:18.256417+0000","last_change":"2024-05-08T05:45:50.748869+0000","last_active":"2024-05-08T05:48:18.256417+0000","last_peered":"2024-05-08T05:48:18.256417+0000","last_clean":"2024-05-08T05:48:18.256417+0000","last_became_active":"2024-05-08T05:45:50.748494+0000","last_became_peered":"2024-05-08T05:45:50.748494+0000","last_unstale":"2024-05-08T05:48:18.256417+0000","last_undegraded":"2024-05-08T05:48:18.256417+0000","last_fullsized":"2024-05-08T05:48:18.256417+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:12:25.227090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":123,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.097768+0000","last_change":"2024-05-08T05:45:54.802180+0000","last_active":"2024-05-08T05:47:44.097768+0000","last_peered":"2024-05-08T05:47:44.097768+0000","last_clean":"2024-05-08T05:47:44.097768+0000","last_became_active":"2024-05-08T05:45:54.801822+0000","last_became_peered":"2024-05-08T05:45:54.801822+0000","last_unstale":"2024-05-08T05:47:44.097768+0000","last_undegraded":"2024-05-08T05:47:44.097768+0000","last_fullsized":"2024-05-08T05:47:44.097768+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:52:11.802630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.081450+0000","last_change":"2024-05-08T05:45:54.770981+0000","last_active":"2024-05-08T05:47:44.081450+0000","last_peered":"2024-05-08T05:47:44.081450+0000","last_clean":"2024-05-08T05:47:44.081450+0000","last_became_active":"2024-05-08T05:45:54.770538+0000","last_became_peered":"2024-05-08T05:45:54.770538+0000","last_unstale":"2024-05-08T05:47:44.081450+0000","last_undegraded":"2024-05-08T05:47:44.081450+0000","last_fullsized":"2024-05-08T05:47:44.081450+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:32:34.699752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"80'5","reported_seq":154,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:48:17.200214+0000","last_change":"2024-05-08T05:45:50.864189+0000","last_active":"2024-05-08T05:48:17.200214+0000","last_peered":"2024-05-08T05:48:17.200214+0000","last_clean":"2024-05-08T05:48:17.200214+0000","last_became_active":"2024-05-08T05:45:50.863170+0000","last_became_peered":"2024-05-08T05:45:50.863170+0000","last_unstale":"2024-05-08T05:48:17.200214+0000","last_undegraded":"2024-05-08T05:48:17.200214+0000","last_fullsized":"2024-05-08T05:48:17.200214+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:44:33.109166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.107858+0000","last_change":"2024-05-08T05:45:54.792347+0000","last_active":"2024-05-08T05:47:44.107858+0000","last_peered":"2024-05-08T05:47:44.107858+0000","last_clean":"2024-05-08T05:47:44.107858+0000","last_became_active":"2024-05-08T05:45:54.791767+0000","last_became_peered":"2024-05-08T05:45:54.791767+0000","last_unstale":"2024-05-08T05:47:44.107858+0000","last_undegraded":"2024-05-08T05:47:44.107858+0000","last_fullsized":"2024-05-08T05:47:44.107858+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:03:46.354687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"80'6","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.952710+0000","last_change":"2024-05-08T05:45:50.748659+0000","last_active":"2024-05-08T05:46:45.952710+0000","last_peered":"2024-05-08T05:46:45.952710+0000","last_clean":"2024-05-08T05:46:45.952710+0000","last_became_active":"2024-05-08T05:45:50.748279+0000","last_became_peered":"2024-05-08T05:45:50.748279+0000","last_unstale":"2024-05-08T05:46:45.952710+0000","last_undegraded":"2024-05-08T05:46:45.952710+0000","last_fullsized":"2024-05-08T05:46:45.952710+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:42:25.892715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":101,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762503+0000","last_change":"2024-05-08T05:44:18.365376+0000","last_active":"2024-05-08T05:46:45.762503+0000","last_peered":"2024-05-08T05:46:45.762503+0000","last_clean":"2024-05-08T05:46:45.762503+0000","last_became_active":"2024-05-08T05:44:18.360156+0000","last_became_peered":"2024-05-08T05:44:18.360156+0000","last_unstale":"2024-05-08T05:46:45.762503+0000","last_undegraded":"2024-05-08T05:46:45.762503+0000","last_fullsized":"2024-05-08T05:46:45.762503+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:40:28.502228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:40:28.502228+0000","last_clean_scrub_stamp":"2024-05-08T05:40:28.502228+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:38:20.339163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.092968+0000","last_change":"2024-05-08T05:45:54.775625+0000","last_active":"2024-05-08T05:47:44.092968+0000","last_peered":"2024-05-08T05:47:44.092968+0000","last_clean":"2024-05-08T05:47:44.092968+0000","last_became_active":"2024-05-08T05:45:54.774661+0000","last_became_peered":"2024-05-08T05:45:54.774661+0000","last_unstale":"2024-05-08T05:47:44.092968+0000","last_undegraded":"2024-05-08T05:47:44.092968+0000","last_fullsized":"2024-05-08T05:47:44.092968+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:57:05.676092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"80'4","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762660+0000","last_change":"2024-05-08T05:45:50.747823+0000","last_active":"2024-05-08T05:46:45.762660+0000","last_peered":"2024-05-08T05:46:45.762660+0000","last_clean":"2024-05-08T05:46:45.762660+0000","last_became_active":"2024-05-08T05:45:50.747222+0000","last_became_peered":"2024-05-08T05:45:50.747222+0000","last_unstale":"2024-05-08T05:46:45.762660+0000","last_undegraded":"2024-05-08T05:46:45.762660+0000","last_fullsized":"2024-05-08T05:46:45.762660+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:49:06.238468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"80'4","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.763348+0000","last_change":"2024-05-08T05:45:50.861721+0000","last_active":"2024-05-08T05:46:45.763348+0000","last_peered":"2024-05-08T05:46:45.763348+0000","last_clean":"2024-05-08T05:46:45.763348+0000","last_became_active":"2024-05-08T05:45:50.861369+0000","last_became_peered":"2024-05-08T05:45:50.861369+0000","last_unstale":"2024-05-08T05:46:45.763348+0000","last_undegraded":"2024-05-08T05:46:45.763348+0000","last_fullsized":"2024-05-08T05:46:45.763348+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:35:19.781796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.092003+0000","last_change":"2024-05-08T05:45:54.787260+0000","last_active":"2024-05-08T05:47:44.092003+0000","last_peered":"2024-05-08T05:47:44.092003+0000","last_clean":"2024-05-08T05:47:44.092003+0000","last_became_active":"2024-05-08T05:45:54.786897+0000","last_became_peered":"2024-05-08T05:45:54.786897+0000","last_unstale":"2024-05-08T05:47:44.092003+0000","last_undegraded":"2024-05-08T05:47:44.092003+0000","last_fullsized":"2024-05-08T05:47:44.092003+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:10:06.761165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'17","reported_seq":44,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.839150+0000","last_change":"2024-05-08T05:45:50.746160+0000","last_active":"2024-05-08T05:47:44.839150+0000","last_peered":"2024-05-08T05:47:44.839150+0000","last_clean":"2024-05-08T05:47:44.839150+0000","last_became_active":"2024-05-08T05:45:50.745630+0000","last_became_peered":"2024-05-08T05:45:50.745630+0000","last_unstale":"2024-05-08T05:47:44.839150+0000","last_undegraded":"2024-05-08T05:47:44.839150+0000","last_fullsized":"2024-05-08T05:47:44.839150+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:45:27.593902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.100379+0000","last_change":"2024-05-08T05:45:54.797162+0000","last_active":"2024-05-08T05:47:44.100379+0000","last_peered":"2024-05-08T05:47:44.100379+0000","last_clean":"2024-05-08T05:47:44.100379+0000","last_became_active":"2024-05-08T05:45:54.796859+0000","last_became_peered":"2024-05-08T05:45:54.796859+0000","last_unstale":"2024-05-08T05:47:44.100379+0000","last_undegraded":"2024-05-08T05:47:44.100379+0000","last_fullsized":"2024-05-08T05:47:44.100379+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:51:25.701160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'7","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.952417+0000","last_change":"2024-05-08T05:45:50.744793+0000","last_active":"2024-05-08T05:46:45.952417+0000","last_peered":"2024-05-08T05:46:45.952417+0000","last_clean":"2024-05-08T05:46:45.952417+0000","last_became_active":"2024-05-08T05:45:50.744407+0000","last_became_peered":"2024-05-08T05:45:50.744407+0000","last_unstale":"2024-05-08T05:46:45.952417+0000","last_undegraded":"2024-05-08T05:46:45.952417+0000","last_fullsized":"2024-05-08T05:46:45.952417+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:18:17.029402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.110900+0000","last_change":"2024-05-08T05:45:54.797042+0000","last_active":"2024-05-08T05:47:44.110900+0000","last_peered":"2024-05-08T05:47:44.110900+0000","last_clean":"2024-05-08T05:47:44.110900+0000","last_became_active":"2024-05-08T05:45:54.795796+0000","last_became_peered":"2024-05-08T05:45:54.795796+0000","last_unstale":"2024-05-08T05:47:44.110900+0000","last_undegraded":"2024-05-08T05:47:44.110900+0000","last_fullsized":"2024-05-08T05:47:44.110900+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:20:10.789348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.766092+0000","last_change":"2024-05-08T05:45:50.860466+0000","last_active":"2024-05-08T05:46:45.766092+0000","last_peered":"2024-05-08T05:46:45.766092+0000","last_clean":"2024-05-08T05:46:45.766092+0000","last_became_active":"2024-05-08T05:45:50.860093+0000","last_became_peered":"2024-05-08T05:45:50.860093+0000","last_unstale":"2024-05-08T05:46:45.766092+0000","last_undegraded":"2024-05-08T05:46:45.766092+0000","last_fullsized":"2024-05-08T05:46:45.766092+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:42:37.799098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.076334+0000","last_change":"2024-05-08T05:45:54.774635+0000","last_active":"2024-05-08T05:47:44.076334+0000","last_peered":"2024-05-08T05:47:44.076334+0000","last_clean":"2024-05-08T05:47:44.076334+0000","last_became_active":"2024-05-08T05:45:54.774288+0000","last_became_peered":"2024-05-08T05:45:54.774288+0000","last_unstale":"2024-05-08T05:47:44.076334+0000","last_undegraded":"2024-05-08T05:47:44.076334+0000","last_fullsized":"2024-05-08T05:47:44.076334+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:55:59.787540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'7","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.761999+0000","last_change":"2024-05-08T05:45:50.750830+0000","last_active":"2024-05-08T05:46:45.761999+0000","last_peered":"2024-05-08T05:46:45.761999+0000","last_clean":"2024-05-08T05:46:45.761999+0000","last_became_active":"2024-05-08T05:45:50.750473+0000","last_became_peered":"2024-05-08T05:45:50.750473+0000","last_unstale":"2024-05-08T05:46:45.761999+0000","last_undegraded":"2024-05-08T05:46:45.761999+0000","last_fullsized":"2024-05-08T05:46:45.761999+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:04:14.314865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.098673+0000","last_change":"2024-05-08T05:45:54.800008+0000","last_active":"2024-05-08T05:47:44.098673+0000","last_peered":"2024-05-08T05:47:44.098673+0000","last_clean":"2024-05-08T05:47:44.098673+0000","last_became_active":"2024-05-08T05:45:54.799615+0000","last_became_peered":"2024-05-08T05:45:54.799615+0000","last_unstale":"2024-05-08T05:47:44.098673+0000","last_undegraded":"2024-05-08T05:47:44.098673+0000","last_fullsized":"2024-05-08T05:47:44.098673+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:58:12.907617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"80'3","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762208+0000","last_change":"2024-05-08T05:45:50.745088+0000","last_active":"2024-05-08T05:46:45.762208+0000","last_peered":"2024-05-08T05:46:45.762208+0000","last_clean":"2024-05-08T05:46:45.762208+0000","last_became_active":"2024-05-08T05:45:50.744735+0000","last_became_peered":"2024-05-08T05:45:50.744735+0000","last_unstale":"2024-05-08T05:46:45.762208+0000","last_undegraded":"2024-05-08T05:46:45.762208+0000","last_fullsized":"2024-05-08T05:46:45.762208+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:39:12.404233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.104706+0000","last_change":"2024-05-08T05:45:54.803875+0000","last_active":"2024-05-08T05:47:44.104706+0000","last_peered":"2024-05-08T05:47:44.104706+0000","last_clean":"2024-05-08T05:47:44.104706+0000","last_became_active":"2024-05-08T05:45:54.803504+0000","last_became_peered":"2024-05-08T05:45:54.803504+0000","last_unstale":"2024-05-08T05:47:44.104706+0000","last_undegraded":"2024-05-08T05:47:44.104706+0000","last_fullsized":"2024-05-08T05:47:44.104706+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:49:33.419868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.763106+0000","last_change":"2024-05-08T05:45:50.741351+0000","last_active":"2024-05-08T05:46:45.763106+0000","last_peered":"2024-05-08T05:46:45.763106+0000","last_clean":"2024-05-08T05:46:45.763106+0000","last_became_active":"2024-05-08T05:45:50.740970+0000","last_became_peered":"2024-05-08T05:45:50.740970+0000","last_unstale":"2024-05-08T05:46:45.763106+0000","last_undegraded":"2024-05-08T05:46:45.763106+0000","last_fullsized":"2024-05-08T05:46:45.763106+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:31:02.093446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.096731+0000","last_change":"2024-05-08T05:45:54.792665+0000","last_active":"2024-05-08T05:47:44.096731+0000","last_peered":"2024-05-08T05:47:44.096731+0000","last_clean":"2024-05-08T05:47:44.096731+0000","last_became_active":"2024-05-08T05:45:54.792309+0000","last_became_peered":"2024-05-08T05:45:54.792309+0000","last_unstale":"2024-05-08T05:47:44.096731+0000","last_undegraded":"2024-05-08T05:47:44.096731+0000","last_fullsized":"2024-05-08T05:47:44.096731+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:48:29.154009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'7","reported_seq":157,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:48:15.228932+0000","last_change":"2024-05-08T05:45:50.861234+0000","last_active":"2024-05-08T05:48:15.228932+0000","last_peered":"2024-05-08T05:48:15.228932+0000","last_clean":"2024-05-08T05:48:15.228932+0000","last_became_active":"2024-05-08T05:45:50.860885+0000","last_became_peered":"2024-05-08T05:45:50.860885+0000","last_unstale":"2024-05-08T05:48:15.228932+0000","last_undegraded":"2024-05-08T05:48:15.228932+0000","last_fullsized":"2024-05-08T05:48:15.228932+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:59:50.300316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":123,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.096172+0000","last_change":"2024-05-08T05:45:54.781154+0000","last_active":"2024-05-08T05:47:44.096172+0000","last_peered":"2024-05-08T05:47:44.096172+0000","last_clean":"2024-05-08T05:47:44.096172+0000","last_became_active":"2024-05-08T05:45:54.780340+0000","last_became_peered":"2024-05-08T05:45:54.780340+0000","last_unstale":"2024-05-08T05:47:44.096172+0000","last_undegraded":"2024-05-08T05:47:44.096172+0000","last_fullsized":"2024-05-08T05:47:44.096172+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:22:39.614532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'3","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.956451+0000","last_change":"2024-05-08T05:45:50.748015+0000","last_active":"2024-05-08T05:46:45.956451+0000","last_peered":"2024-05-08T05:46:45.956451+0000","last_clean":"2024-05-08T05:46:45.956451+0000","last_became_active":"2024-05-08T05:45:50.747649+0000","last_became_peered":"2024-05-08T05:45:50.747649+0000","last_unstale":"2024-05-08T05:46:45.956451+0000","last_undegraded":"2024-05-08T05:46:45.956451+0000","last_fullsized":"2024-05-08T05:46:45.956451+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:31:49.177676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.103573+0000","last_change":"2024-05-08T05:45:54.779680+0000","last_active":"2024-05-08T05:47:44.103573+0000","last_peered":"2024-05-08T05:47:44.103573+0000","last_clean":"2024-05-08T05:47:44.103573+0000","last_became_active":"2024-05-08T05:45:54.779273+0000","last_became_peered":"2024-05-08T05:45:54.779273+0000","last_unstale":"2024-05-08T05:47:44.103573+0000","last_undegraded":"2024-05-08T05:47:44.103573+0000","last_fullsized":"2024-05-08T05:47:44.103573+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:40:05.192134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"80'5","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.770430+0000","last_change":"2024-05-08T05:45:50.744569+0000","last_active":"2024-05-08T05:46:45.770430+0000","last_peered":"2024-05-08T05:46:45.770430+0000","last_clean":"2024-05-08T05:46:45.770430+0000","last_became_active":"2024-05-08T05:45:50.744164+0000","last_became_peered":"2024-05-08T05:45:50.744164+0000","last_unstale":"2024-05-08T05:46:45.770430+0000","last_undegraded":"2024-05-08T05:46:45.770430+0000","last_fullsized":"2024-05-08T05:46:45.770430+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:17:56.409110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.087373+0000","last_change":"2024-05-08T05:45:54.776338+0000","last_active":"2024-05-08T05:47:44.087373+0000","last_peered":"2024-05-08T05:47:44.087373+0000","last_clean":"2024-05-08T05:47:44.087373+0000","last_became_active":"2024-05-08T05:45:54.776015+0000","last_became_peered":"2024-05-08T05:45:54.776015+0000","last_unstale":"2024-05-08T05:47:44.087373+0000","last_undegraded":"2024-05-08T05:47:44.087373+0000","last_fullsized":"2024-05-08T05:47:44.087373+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:38:10.608436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.083568+0000","last_change":"2024-05-08T05:45:54.782245+0000","last_active":"2024-05-08T05:47:44.083568+0000","last_peered":"2024-05-08T05:47:44.083568+0000","last_clean":"2024-05-08T05:47:44.083568+0000","last_became_active":"2024-05-08T05:45:54.781860+0000","last_became_peered":"2024-05-08T05:45:54.781860+0000","last_unstale":"2024-05-08T05:47:44.083568+0000","last_undegraded":"2024-05-08T05:47:44.083568+0000","last_fullsized":"2024-05-08T05:47:44.083568+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:50:14.658930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.084173+0000","last_change":"2024-05-08T05:45:54.770787+0000","last_active":"2024-05-08T05:47:44.084173+0000","last_peered":"2024-05-08T05:47:44.084173+0000","last_clean":"2024-05-08T05:47:44.084173+0000","last_became_active":"2024-05-08T05:45:54.770409+0000","last_became_peered":"2024-05-08T05:45:54.770409+0000","last_unstale":"2024-05-08T05:47:44.084173+0000","last_undegraded":"2024-05-08T05:47:44.084173+0000","last_fullsized":"2024-05-08T05:47:44.084173+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:09:31.102075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.105251+0000","last_change":"2024-05-08T05:45:54.788799+0000","last_active":"2024-05-08T05:47:44.105251+0000","last_peered":"2024-05-08T05:47:44.105251+0000","last_clean":"2024-05-08T05:47:44.105251+0000","last_became_active":"2024-05-08T05:45:54.788295+0000","last_became_peered":"2024-05-08T05:45:54.788295+0000","last_unstale":"2024-05-08T05:47:44.105251+0000","last_undegraded":"2024-05-08T05:47:44.105251+0000","last_fullsized":"2024-05-08T05:47:44.105251+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:55:07.912479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.109609+0000","last_change":"2024-05-08T05:45:54.801316+0000","last_active":"2024-05-08T05:47:44.109609+0000","last_peered":"2024-05-08T05:47:44.109609+0000","last_clean":"2024-05-08T05:47:44.109609+0000","last_became_active":"2024-05-08T05:45:54.798655+0000","last_became_peered":"2024-05-08T05:45:54.798655+0000","last_unstale":"2024-05-08T05:47:44.109609+0000","last_undegraded":"2024-05-08T05:47:44.109609+0000","last_fullsized":"2024-05-08T05:47:44.109609+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:30:25.786822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.100854+0000","last_change":"2024-05-08T05:45:54.793076+0000","last_active":"2024-05-08T05:47:44.100854+0000","last_peered":"2024-05-08T05:47:44.100854+0000","last_clean":"2024-05-08T05:47:44.100854+0000","last_became_active":"2024-05-08T05:45:54.792726+0000","last_became_peered":"2024-05-08T05:45:54.792726+0000","last_unstale":"2024-05-08T05:47:44.100854+0000","last_undegraded":"2024-05-08T05:47:44.100854+0000","last_fullsized":"2024-05-08T05:47:44.100854+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:46:02.659667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.081706+0000","last_change":"2024-05-08T05:45:54.779134+0000","last_active":"2024-05-08T05:47:44.081706+0000","last_peered":"2024-05-08T05:47:44.081706+0000","last_clean":"2024-05-08T05:47:44.081706+0000","last_became_active":"2024-05-08T05:45:54.778764+0000","last_became_peered":"2024-05-08T05:45:54.778764+0000","last_unstale":"2024-05-08T05:47:44.081706+0000","last_undegraded":"2024-05-08T05:47:44.081706+0000","last_fullsized":"2024-05-08T05:47:44.081706+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:10:00.531228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.077624+0000","last_change":"2024-05-08T05:45:54.775628+0000","last_active":"2024-05-08T05:47:44.077624+0000","last_peered":"2024-05-08T05:47:44.077624+0000","last_clean":"2024-05-08T05:47:44.077624+0000","last_became_active":"2024-05-08T05:45:54.775293+0000","last_became_peered":"2024-05-08T05:45:54.775293+0000","last_unstale":"2024-05-08T05:47:44.077624+0000","last_undegraded":"2024-05-08T05:47:44.077624+0000","last_fullsized":"2024-05-08T05:47:44.077624+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:02:57.884691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.100249+0000","last_change":"2024-05-08T05:45:54.805054+0000","last_active":"2024-05-08T05:47:44.100249+0000","last_peered":"2024-05-08T05:47:44.100249+0000","last_clean":"2024-05-08T05:47:44.100249+0000","last_became_active":"2024-05-08T05:45:54.804642+0000","last_became_peered":"2024-05-08T05:45:54.804642+0000","last_unstale":"2024-05-08T05:47:44.100249+0000","last_undegraded":"2024-05-08T05:47:44.100249+0000","last_fullsized":"2024-05-08T05:47:44.100249+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:17:22.412759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.103859+0000","last_change":"2024-05-08T05:45:54.792217+0000","last_active":"2024-05-08T05:47:44.103859+0000","last_peered":"2024-05-08T05:47:44.103859+0000","last_clean":"2024-05-08T05:47:44.103859+0000","last_became_active":"2024-05-08T05:45:54.791508+0000","last_became_peered":"2024-05-08T05:45:54.791508+0000","last_unstale":"2024-05-08T05:47:44.103859+0000","last_undegraded":"2024-05-08T05:47:44.103859+0000","last_fullsized":"2024-05-08T05:47:44.103859+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:47:19.053306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.108264+0000","last_change":"2024-05-08T05:45:54.794538+0000","last_active":"2024-05-08T05:47:44.108264+0000","last_peered":"2024-05-08T05:47:44.108264+0000","last_clean":"2024-05-08T05:47:44.108264+0000","last_became_active":"2024-05-08T05:45:54.792575+0000","last_became_peered":"2024-05-08T05:45:54.792575+0000","last_unstale":"2024-05-08T05:47:44.108264+0000","last_undegraded":"2024-05-08T05:47:44.108264+0000","last_fullsized":"2024-05-08T05:47:44.108264+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:54:31.086864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.107048+0000","last_change":"2024-05-08T05:45:54.782828+0000","last_active":"2024-05-08T05:47:44.107048+0000","last_peered":"2024-05-08T05:47:44.107048+0000","last_clean":"2024-05-08T05:47:44.107048+0000","last_became_active":"2024-05-08T05:45:54.782442+0000","last_became_peered":"2024-05-08T05:45:54.782442+0000","last_unstale":"2024-05-08T05:47:44.107048+0000","last_undegraded":"2024-05-08T05:47:44.107048+0000","last_fullsized":"2024-05-08T05:47:44.107048+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:42:53.551455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.100977+0000","last_change":"2024-05-08T05:45:54.800422+0000","last_active":"2024-05-08T05:47:44.100977+0000","last_peered":"2024-05-08T05:47:44.100977+0000","last_clean":"2024-05-08T05:47:44.100977+0000","last_became_active":"2024-05-08T05:45:54.799853+0000","last_became_peered":"2024-05-08T05:45:54.799853+0000","last_unstale":"2024-05-08T05:47:44.100977+0000","last_undegraded":"2024-05-08T05:47:44.100977+0000","last_fullsized":"2024-05-08T05:47:44.100977+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:54:22.710347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.104228+0000","last_change":"2024-05-08T05:46:45.775876+0000","last_active":"2024-05-08T05:47:44.104228+0000","last_peered":"2024-05-08T05:47:44.104228+0000","last_clean":"2024-05-08T05:47:44.104228+0000","last_became_active":"2024-05-08T05:46:45.775558+0000","last_became_peered":"2024-05-08T05:46:45.775558+0000","last_unstale":"2024-05-08T05:47:44.104228+0000","last_undegraded":"2024-05-08T05:47:44.104228+0000","last_fullsized":"2024-05-08T05:47:44.104228+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:11:38.649137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":311296,"data_stored":3542208,"data_compressed":212518,"data_compressed_allocated":270336,"data_compressed_original":3522560,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":73123,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1230,"num_read_kb":687,"num_write":254,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":55290,"num_keys_recovered":20,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":536576,"data_stored":219369,"data_compressed":9129,"data_compressed_allocated":12288,"data_compressed_original":53248,"omap_allocated":0,"internal_metadata":0},"log_size":218,"ondisk_log_size":218,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645357,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":901120,"data_stored":436030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841588,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32204,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712948,"statfs":{"total":95995035648,"available":95962058752,"internally_reserved":0,"allocated":1052672,"data_stored":1092628,"data_compressed":35691,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037817,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":917504,"data_stored":435360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234047,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":913408,"data_stored":435738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430276,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":1027865,"data_compressed":35691,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593803,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":901120,"data_stored":435077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574950,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":502159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738475,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":921600,"data_stored":436948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411426,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":905216,"data_stored":436674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149787,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":917504,"data_stored":434902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953556,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32088,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713064,"statfs":{"total":95995035648,"available":95962177536,"internally_reserved":0,"allocated":933888,"data_stored":501107,"data_compressed":9129,"data_compressed_allocated":12288,"data_compressed_original":53248,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790032,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":978944,"data_stored":1027543,"data_compressed":35691,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34063,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35691,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35691,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35691,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35691,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35691,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":67921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":66869,"data_compressed":9129,"data_compressed_allocated":12288,"data_compressed_original":53248,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":67905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T05:48:21.609 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-05-08T05:48:21.609 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-08T05:48:21.609 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-05-08T05:48:21.609 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph health --format=json 2024-05-08T05:48:21.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:48:21 smithi082 ceph-mon[30098]: pgmap v390: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-08T05:48:21.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:48:21 smithi082 ceph-mon[30098]: from='client.24812 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T05:48:21.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:48:21 smithi134 ceph-mon[34132]: pgmap v390: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-08T05:48:22.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:48:21 smithi134 ceph-mon[34132]: from='client.24812 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T05:48:22.101 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:48:22.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:48:21 smithi151 ceph-mon[34815]: pgmap v390: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-08T05:48:22.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:48:21 smithi151 ceph-mon[34815]: from='client.24812 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T05:48:24.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:48:23 smithi134 ceph-mon[34132]: pgmap v391: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:48:24.005 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:48:23 smithi082 ceph-mon[30098]: pgmap v391: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:48:24.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:48:23 smithi151 ceph-mon[34815]: pgmap v391: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:48:24.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:24.278+0000 7f7bd2600700 1 -- 172.21.15.82:0/1720502250 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bcc10b660 msgr2=0x7f7bcc10ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:24.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:24.278+0000 7f7bd2600700 1 --2- 172.21.15.82:0/1720502250 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bcc10b660 0x7f7bcc10ba40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0009990 tx=0x7f7bc0009ca0 comp rx=0 tx=0).stop 2024-05-08T05:48:24.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:24.278+0000 7f7bd2600700 1 -- 172.21.15.82:0/1720502250 shutdown_connections 2024-05-08T05:48:24.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:24.278+0000 7f7bd2600700 1 --2- 172.21.15.82:0/1720502250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7bcc105f90 0x7f7bcc1124a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:24.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:24.278+0000 7f7bd2600700 1 --2- 172.21.15.82:0/1720502250 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bcc10b660 0x7f7bcc10ba40 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:24.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:24.278+0000 7f7bd2600700 1 --2- 172.21.15.82:0/1720502250 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7bcc1055d0 0x7f7bcc105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:24.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:24.278+0000 7f7bd2600700 1 -- 172.21.15.82:0/1720502250 >> 172.21.15.82:0/1720502250 conn(0x7f7bcc1010c0 msgr2=0x7f7bcc1034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:24.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:24.278+0000 7f7bd2600700 1 -- 172.21.15.82:0/1720502250 shutdown_connections 2024-05-08T05:48:24.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:24.278+0000 7f7bd2600700 1 -- 172.21.15.82:0/1720502250 wait complete. 2024-05-08T05:48:24.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:24.279+0000 7f7bd2600700 1 Processor -- start 2024-05-08T05:48:24.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:24.279+0000 7f7bd2600700 1 -- start start 2024-05-08T05:48:24.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:24.280+0000 7f7bd2600700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7bcc1055d0 0x7f7bcc1a18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:24.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:24.280+0000 7f7bd2600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7bcc105f90 0x7f7bcc1a1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:24.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:24.280+0000 7f7bd2600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bcc10b660 0x7f7bcc19ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:24.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:24.280+0000 7f7bd2600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7bcc115820 con 0x7f7bcc10b660 2024-05-08T05:48:24.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:24.280+0000 7f7bd2600700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7bcc1156a0 con 0x7f7bcc105f90 2024-05-08T05:48:24.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:24.280+0000 7f7bd2600700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7bcc1159a0 con 0x7f7bcc1055d0 2024-05-08T05:48:24.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:24.280+0000 7f7bd1c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bcc10b660 0x7f7bcc19ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:24.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:24.280+0000 7f7bd1c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bcc10b660 0x7f7bcc19ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52174/0 (socket says 172.21.15.82:52174) 2024-05-08T05:48:24.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:24.280+0000 7f7bd1c00700 1 -- 172.21.15.82:0/505045209 learned_addr learned my addr 172.21.15.82:0/505045209 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:48:24.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:24.280+0000 7f7bd1200700 1 --2- 172.21.15.82:0/505045209 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7bcc1055d0 0x7f7bcc1a18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:24.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:24.280+0000 7f7bcbe00700 1 --2- 172.21.15.82:0/505045209 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7bcc105f90 0x7f7bcc1a1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:24.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:24.280+0000 7f7bd1c00700 1 -- 172.21.15.82:0/505045209 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7bcc1055d0 msgr2=0x7f7bcc1a18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:24.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:24.280+0000 7f7bd1c00700 1 --2- 172.21.15.82:0/505045209 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7bcc1055d0 0x7f7bcc1a18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:24.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:24.280+0000 7f7bd1c00700 1 -- 172.21.15.82:0/505045209 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7bcc105f90 msgr2=0x7f7bcc1a1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:24.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:24.280+0000 7f7bd1c00700 1 --2- 172.21.15.82:0/505045209 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7bcc105f90 0x7f7bcc1a1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:24.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:24.281+0000 7f7bd1c00700 1 -- 172.21.15.82:0/505045209 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bcc19c1e0 con 0x7f7bcc10b660 2024-05-08T05:48:24.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:24.281+0000 7f7bd1c00700 1 --2- 172.21.15.82:0/505045209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bcc10b660 0x7f7bcc19ba80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7bc400ef30 tx=0x7f7bc400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:24.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:24.281+0000 7f7bc9600700 1 -- 172.21.15.82:0/505045209 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc40092e0 con 0x7f7bcc10b660 2024-05-08T05:48:24.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:24.281+0000 7f7bc9600700 1 -- 172.21.15.82:0/505045209 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7bc4004bb0 con 0x7f7bcc10b660 2024-05-08T05:48:24.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:24.281+0000 7f7bd2600700 1 -- 172.21.15.82:0/505045209 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bcc19c470 con 0x7f7bcc10b660 2024-05-08T05:48:24.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:24.281+0000 7f7bc9600700 1 -- 172.21.15.82:0/505045209 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc4004020 con 0x7f7bcc10b660 2024-05-08T05:48:24.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:24.281+0000 7f7bd2600700 1 -- 172.21.15.82:0/505045209 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bcc1a8790 con 0x7f7bcc10b660 2024-05-08T05:48:24.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:24.282+0000 7f7bd2600700 1 -- 172.21.15.82:0/505045209 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bcc06a190 con 0x7f7bcc10b660 2024-05-08T05:48:24.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:24.285+0000 7f7bc9600700 1 -- 172.21.15.82:0/505045209 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f7bc401b030 con 0x7f7bcc10b660 2024-05-08T05:48:24.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:24.287+0000 7f7bc9600700 1 --2- 172.21.15.82:0/505045209 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7bb40b2900 0x7f7bb40b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:24.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:24.288+0000 7f7bc9600700 1 -- 172.21.15.82:0/505045209 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f7bc40e26c0 con 0x7f7bcc10b660 2024-05-08T05:48:24.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:24.288+0000 7f7bd1200700 1 --2- 172.21.15.82:0/505045209 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7bb40b2900 0x7f7bb40b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:24.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:24.289+0000 7f7bd1200700 1 --2- 172.21.15.82:0/505045209 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7bb40b2900 0x7f7bb40b4dc0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc19cbc0 tx=0x7f7bc001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:24.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:24.290+0000 7f7bc9600700 1 -- 172.21.15.82:0/505045209 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f7bc4022020 con 0x7f7bcc10b660 2024-05-08T05:48:24.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:24.570+0000 7f7bd2600700 1 -- 172.21.15.82:0/505045209 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7bcc02e510 con 0x7f7bcc10b660 2024-05-08T05:48:24.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:24.571+0000 7f7bc9600700 1 -- 172.21.15.82:0/505045209 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f7bc4010040 con 0x7f7bcc10b660 2024-05-08T05:48:24.572 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:48:24.572 INFO:teuthology.orchestra.run.smithi082.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-08T05:48:24.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:24.574+0000 7f7bd2600700 1 -- 172.21.15.82:0/505045209 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7bb40b2900 msgr2=0x7f7bb40b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:24.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:24.574+0000 7f7bd2600700 1 --2- 172.21.15.82:0/505045209 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7bb40b2900 0x7f7bb40b4dc0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc19cbc0 tx=0x7f7bc001a040 comp rx=0 tx=0).stop 2024-05-08T05:48:24.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:24.574+0000 7f7bd2600700 1 -- 172.21.15.82:0/505045209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bcc10b660 msgr2=0x7f7bcc19ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:24.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:24.574+0000 7f7bd2600700 1 --2- 172.21.15.82:0/505045209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bcc10b660 0x7f7bcc19ba80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7bc400ef30 tx=0x7f7bc400c3a0 comp rx=0 tx=0).stop 2024-05-08T05:48:24.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:24.574+0000 7f7bd2600700 1 -- 172.21.15.82:0/505045209 shutdown_connections 2024-05-08T05:48:24.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:24.574+0000 7f7bd2600700 1 --2- 172.21.15.82:0/505045209 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7bb40b2900 0x7f7bb40b4dc0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:24.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:24.574+0000 7f7bd2600700 1 --2- 172.21.15.82:0/505045209 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7bcc10b660 0x7f7bcc19ba80 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:24.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:24.574+0000 7f7bd2600700 1 --2- 172.21.15.82:0/505045209 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7bcc1055d0 0x7f7bcc1a18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:24.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:24.574+0000 7f7bd2600700 1 --2- 172.21.15.82:0/505045209 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7bcc105f90 0x7f7bcc1a1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:24.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:24.574+0000 7f7bd2600700 1 -- 172.21.15.82:0/505045209 >> 172.21.15.82:0/505045209 conn(0x7f7bcc1010c0 msgr2=0x7f7bcc102760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:24.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:24.574+0000 7f7bd2600700 1 -- 172.21.15.82:0/505045209 shutdown_connections 2024-05-08T05:48:24.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:24.574+0000 7f7bd2600700 1 -- 172.21.15.82:0/505045209 wait complete. 2024-05-08T05:48:24.958 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:48:24 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/505045209' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-08T05:48:25.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:48:24 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/505045209' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-08T05:48:25.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:48:24 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/505045209' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-08T05:48:25.414 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-05-08T05:48:25.414 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T05:48:25.860 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:48:26.036 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:48:25 smithi082 ceph-mon[30098]: pgmap v392: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-08T05:48:26.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:48:25 smithi151 ceph-mon[34815]: pgmap v392: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-08T05:48:26.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:48:25 smithi134 ceph-mon[34132]: pgmap v392: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-08T05:48:27.969 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:48:27 smithi082 ceph-mon[30098]: pgmap v393: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-08T05:48:28.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:48:27 smithi151 ceph-mon[34815]: pgmap v393: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-08T05:48:28.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:48:27 smithi134 ceph-mon[34132]: pgmap v393: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-08T05:48:28.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:28.258+0000 7fd5e1a00700 1 -- 172.21.15.82:0/2707060914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5dc1056b0 msgr2=0x7fd5dc105b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:28.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:28.258+0000 7fd5e1a00700 1 --2- 172.21.15.82:0/2707060914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5dc1056b0 0x7fd5dc105b30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd5c40098f0 tx=0x7fd5c4009c00 comp rx=0 tx=0).stop 2024-05-08T05:48:28.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:28.259+0000 7fd5e1a00700 1 -- 172.21.15.82:0/2707060914 shutdown_connections 2024-05-08T05:48:28.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:28.259+0000 7fd5e1a00700 1 --2- 172.21.15.82:0/2707060914 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5dc10b6b0 0x7fd5dc10ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:28.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:28.259+0000 7fd5e1a00700 1 --2- 172.21.15.82:0/2707060914 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5dc106070 0x7fd5dc112580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:28.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:28.259+0000 7fd5e1a00700 1 --2- 172.21.15.82:0/2707060914 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5dc1056b0 0x7fd5dc105b30 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:28.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:28.259+0000 7fd5e1a00700 1 -- 172.21.15.82:0/2707060914 >> 172.21.15.82:0/2707060914 conn(0x7fd5dc1011a0 msgr2=0x7fd5dc1035c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:28.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:28.259+0000 7fd5e1a00700 1 -- 172.21.15.82:0/2707060914 shutdown_connections 2024-05-08T05:48:28.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:28.259+0000 7fd5e1a00700 1 -- 172.21.15.82:0/2707060914 wait complete. 2024-05-08T05:48:28.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:28.260+0000 7fd5e1a00700 1 Processor -- start 2024-05-08T05:48:28.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:28.260+0000 7fd5e1a00700 1 -- start start 2024-05-08T05:48:28.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:28.260+0000 7fd5e1a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5dc1056b0 0x7fd5dc19bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:28.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:28.260+0000 7fd5e1a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5dc106070 0x7fd5dc19c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:28.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:28.260+0000 7fd5e1a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5dc10b6b0 0x7fd5dc1a0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:28.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:28.260+0000 7fd5e1a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd5dc1158f0 con 0x7fd5dc1056b0 2024-05-08T05:48:28.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:28.260+0000 7fd5e1a00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd5dc115770 con 0x7fd5dc106070 2024-05-08T05:48:28.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:28.260+0000 7fd5e1a00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd5dc115a70 con 0x7fd5dc10b6b0 2024-05-08T05:48:28.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:28.261+0000 7fd5daa00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5dc1056b0 0x7fd5dc19bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:28.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:28.261+0000 7fd5d3e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5dc106070 0x7fd5dc19c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:28.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:28.261+0000 7fd5daa00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5dc1056b0 0x7fd5dc19bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52192/0 (socket says 172.21.15.82:52192) 2024-05-08T05:48:28.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:28.261+0000 7fd5daa00700 1 -- 172.21.15.82:0/1793822909 learned_addr learned my addr 172.21.15.82:0/1793822909 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:48:28.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:28.261+0000 7fd5db400700 1 --2- 172.21.15.82:0/1793822909 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5dc10b6b0 0x7fd5dc1a0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:28.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:28.261+0000 7fd5daa00700 1 -- 172.21.15.82:0/1793822909 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5dc10b6b0 msgr2=0x7fd5dc1a0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:28.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:28.261+0000 7fd5daa00700 1 --2- 172.21.15.82:0/1793822909 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5dc10b6b0 0x7fd5dc1a0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:28.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:28.261+0000 7fd5daa00700 1 -- 172.21.15.82:0/1793822909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5dc106070 msgr2=0x7fd5dc19c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:28.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:28.261+0000 7fd5daa00700 1 --2- 172.21.15.82:0/1793822909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5dc106070 0x7fd5dc19c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:28.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:28.261+0000 7fd5daa00700 1 -- 172.21.15.82:0/1793822909 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5dc1a0dd0 con 0x7fd5dc1056b0 2024-05-08T05:48:28.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:28.262+0000 7fd5daa00700 1 --2- 172.21.15.82:0/1793822909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5dc1056b0 0x7fd5dc19bdc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc00e9a0 tx=0x7fd5cc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:28.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:28.262+0000 7fd5d3400700 1 -- 172.21.15.82:0/1793822909 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc00ca10 con 0x7fd5dc1056b0 2024-05-08T05:48:28.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:28.262+0000 7fd5d3400700 1 -- 172.21.15.82:0/1793822909 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd5cc00cbb0 con 0x7fd5dc1056b0 2024-05-08T05:48:28.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:28.262+0000 7fd5e1a00700 1 -- 172.21.15.82:0/1793822909 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5dc1a10c0 con 0x7fd5dc1056b0 2024-05-08T05:48:28.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:28.262+0000 7fd5d3400700 1 -- 172.21.15.82:0/1793822909 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc018680 con 0x7fd5dc1056b0 2024-05-08T05:48:28.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:28.262+0000 7fd5e1a00700 1 -- 172.21.15.82:0/1793822909 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5dc1a8940 con 0x7fd5dc1056b0 2024-05-08T05:48:28.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:28.263+0000 7fd5e1a00700 1 -- 172.21.15.82:0/1793822909 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5dc06a190 con 0x7fd5dc1056b0 2024-05-08T05:48:28.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:28.265+0000 7fd5d3400700 1 -- 172.21.15.82:0/1793822909 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fd5cc010430 con 0x7fd5dc1056b0 2024-05-08T05:48:28.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:28.267+0000 7fd5d3400700 1 --2- 172.21.15.82:0/1793822909 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd5c00b2880 0x7fd5c00b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:28.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:28.267+0000 7fd5d3400700 1 -- 172.21.15.82:0/1793822909 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd5cc0e2670 con 0x7fd5dc1056b0 2024-05-08T05:48:28.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:28.267+0000 7fd5d3e00700 1 --2- 172.21.15.82:0/1793822909 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd5c00b2880 0x7fd5c00b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:28.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:28.268+0000 7fd5d3e00700 1 --2- 172.21.15.82:0/1793822909 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd5c00b2880 0x7fd5c00b4d40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd5c4009fd0 tx=0x7fd5c4019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:28.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:28.269+0000 7fd5d3400700 1 -- 172.21.15.82:0/1793822909 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd5cc0aa340 con 0x7fd5dc1056b0 2024-05-08T05:48:28.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:28.549+0000 7fd5e1a00700 1 -- 172.21.15.82:0/1793822909 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd5dc02e510 con 0x7fd5dc1056b0 2024-05-08T05:48:28.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:28.550+0000 7fd5d3400700 1 -- 172.21.15.82:0/1793822909 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11948 (secure 0 0 0) 0x7fd5cc0b23c0 con 0x7fd5dc1056b0 2024-05-08T05:48:28.552 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:48:28.552 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14364,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3876883250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3876883250},{"type":"v1","addr":"172.21.15.82:6835","nonce":3876883250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1965070586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1965070586},{"type":"v1","addr":"172.21.15.82:6837","nonce":1965070586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T05:45:57.654009+0000","modified":"2024-05-08T05:46:21.713129+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24505,"mds_2":24487,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14397":{"gid":14397,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/1890720973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1890720973},{"type":"v1","addr":"172.21.15.82:6839","nonce":1890720973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14409":{"gid":14409,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/2957083305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":2957083305},{"type":"v1","addr":"172.21.15.82:6841","nonce":2957083305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6833/3827691638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3827691638},{"type":"v1","addr":"172.21.15.134:6833","nonce":3827691638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6833/3625067797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3625067797},{"type":"v1","addr":"172.21.15.151:6833","nonce":3625067797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/4074163402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4074163402},{"type":"v1","addr":"172.21.15.134:6835","nonce":4074163402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.134:6837/2212411710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2212411710},{"type":"v1","addr":"172.21.15.134:6837","nonce":2212411710}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":17,"addr":"172.21.15.151:6835/2093655929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2093655929},{"type":"v1","addr":"172.21.15.151:6835","nonce":2093655929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6837/4192404464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":4192404464},{"type":"v1","addr":"172.21.15.151:6837","nonce":4192404464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":14,"addr":"172.21.15.151:6839/2963754236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":2963754236},{"type":"v1","addr":"172.21.15.151:6839","nonce":2963754236}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.134:6839/1145270893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1145270893},{"type":"v1","addr":"172.21.15.134:6839","nonce":1145270893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24467,24475,24487,24505,24506]},"id":1}]} 2024-05-08T05:48:28.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:28.554+0000 7fd5e1a00700 1 -- 172.21.15.82:0/1793822909 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd5c00b2880 msgr2=0x7fd5c00b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:28.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:28.554+0000 7fd5e1a00700 1 --2- 172.21.15.82:0/1793822909 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd5c00b2880 0x7fd5c00b4d40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd5c4009fd0 tx=0x7fd5c4019040 comp rx=0 tx=0).stop 2024-05-08T05:48:28.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:28.554+0000 7fd5e1a00700 1 -- 172.21.15.82:0/1793822909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5dc1056b0 msgr2=0x7fd5dc19bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:28.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:28.554+0000 7fd5e1a00700 1 --2- 172.21.15.82:0/1793822909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5dc1056b0 0x7fd5dc19bdc0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc00e9a0 tx=0x7fd5cc00ecb0 comp rx=0 tx=0).stop 2024-05-08T05:48:28.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:28.554+0000 7fd5e1a00700 1 -- 172.21.15.82:0/1793822909 shutdown_connections 2024-05-08T05:48:28.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:28.554+0000 7fd5e1a00700 1 --2- 172.21.15.82:0/1793822909 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd5c00b2880 0x7fd5c00b4d40 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:28.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:28.554+0000 7fd5e1a00700 1 --2- 172.21.15.82:0/1793822909 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5dc10b6b0 0x7fd5dc1a0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:28.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:28.554+0000 7fd5e1a00700 1 --2- 172.21.15.82:0/1793822909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd5dc1056b0 0x7fd5dc19bdc0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:28.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:28.554+0000 7fd5e1a00700 1 --2- 172.21.15.82:0/1793822909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5dc106070 0x7fd5dc19c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:28.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:28.554+0000 7fd5e1a00700 1 -- 172.21.15.82:0/1793822909 >> 172.21.15.82:0/1793822909 conn(0x7fd5dc1011a0 msgr2=0x7fd5dc101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:28.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:28.554+0000 7fd5e1a00700 1 -- 172.21.15.82:0/1793822909 shutdown_connections 2024-05-08T05:48:28.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:28.554+0000 7fd5e1a00700 1 -- 172.21.15.82:0/1793822909 wait complete. 2024-05-08T05:48:28.556 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 28 2024-05-08T05:48:28.924 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:48:28 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/1793822909' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:48:29.131 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:48:28 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/1793822909' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:48:29.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:48:28 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/1793822909' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:48:29.453 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T05:48:29.905 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:48:30.051 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:48:29 smithi082 ceph-mon[30098]: pgmap v394: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:48:30.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:48:29 smithi151 ceph-mon[34815]: pgmap v394: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:48:30.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:48:29 smithi134 ceph-mon[34132]: pgmap v394: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:48:32.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:32.016+0000 7f6c01600700 1 -- 172.21.15.82:0/3092185650 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6bfc103610 msgr2=0x7f6bfc1039f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:32.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:32.016+0000 7f6c01600700 1 --2- 172.21.15.82:0/3092185650 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6bfc103610 0x7f6bfc1039f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6bec009920 tx=0x7f6bec009c30 comp rx=0 tx=0).stop 2024-05-08T05:48:32.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:32.016+0000 7f6c01600700 1 -- 172.21.15.82:0/3092185650 shutdown_connections 2024-05-08T05:48:32.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:32.016+0000 7f6c01600700 1 --2- 172.21.15.82:0/3092185650 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bfc1086f0 0x7f6bfc1102c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:32.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:32.016+0000 7f6c01600700 1 --2- 172.21.15.82:0/3092185650 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6bfc103610 0x7f6bfc1039f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:32.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:32.016+0000 7f6c01600700 1 --2- 172.21.15.82:0/3092185650 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6bfc103fc0 0x7f6bfc108010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:32.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:32.016+0000 7f6c01600700 1 -- 172.21.15.82:0/3092185650 >> 172.21.15.82:0/3092185650 conn(0x7f6bfc0feec0 msgr2=0x7f6bfc1012e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:32.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:32.016+0000 7f6c01600700 1 -- 172.21.15.82:0/3092185650 shutdown_connections 2024-05-08T05:48:32.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:32.016+0000 7f6c01600700 1 -- 172.21.15.82:0/3092185650 wait complete. 2024-05-08T05:48:32.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:32.017+0000 7f6c01600700 1 Processor -- start 2024-05-08T05:48:32.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:32.017+0000 7f6c01600700 1 -- start start 2024-05-08T05:48:32.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:32.018+0000 7f6c01600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6bfc103610 0x7f6bfc19bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:32.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:32.018+0000 7f6c01600700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6bfc103fc0 0x7f6bfc19c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:32.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:32.018+0000 7f6c01600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bfc1086f0 0x7f6bfc1a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:32.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:32.018+0000 7f6c01600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6bfc1135d0 con 0x7f6bfc1086f0 2024-05-08T05:48:32.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:32.018+0000 7f6c01600700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6bfc113450 con 0x7f6bfc103610 2024-05-08T05:48:32.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:32.018+0000 7f6c01600700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6bfc113750 con 0x7f6bfc103fc0 2024-05-08T05:48:32.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:32.018+0000 7f6bfbe00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6bfc103610 0x7f6bfc19bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:32.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:32.018+0000 7f6c00c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bfc1086f0 0x7f6bfc1a06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:32.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:32.018+0000 7f6bfbe00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6bfc103610 0x7f6bfc19bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:46540/0 (socket says 172.21.15.82:46540) 2024-05-08T05:48:32.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:32.018+0000 7f6bfbe00700 1 -- 172.21.15.82:0/3959739951 learned_addr learned my addr 172.21.15.82:0/3959739951 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:48:32.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:32.018+0000 7f6bfb400700 1 --2- 172.21.15.82:0/3959739951 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6bfc103fc0 0x7f6bfc19c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:32.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:32.019+0000 7f6bfbe00700 1 -- 172.21.15.82:0/3959739951 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6bfc103fc0 msgr2=0x7f6bfc19c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:32.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:32.019+0000 7f6bfbe00700 1 --2- 172.21.15.82:0/3959739951 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6bfc103fc0 0x7f6bfc19c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:32.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:32.019+0000 7f6bfbe00700 1 -- 172.21.15.82:0/3959739951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bfc1086f0 msgr2=0x7f6bfc1a06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:32.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:32.019+0000 7f6bfbe00700 1 --2- 172.21.15.82:0/3959739951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bfc1086f0 0x7f6bfc1a06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:32.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:32.019+0000 7f6bfbe00700 1 -- 172.21.15.82:0/3959739951 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bfc1a0df0 con 0x7f6bfc103610 2024-05-08T05:48:32.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:32.019+0000 7f6bfbe00700 1 --2- 172.21.15.82:0/3959739951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6bfc103610 0x7f6bfc19bde0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6bec000c00 tx=0x7f6bec00f990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:32.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:32.019+0000 7f6bf8c00700 1 -- 172.21.15.82:0/3959739951 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bec027070 con 0x7f6bfc103610 2024-05-08T05:48:32.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:32.019+0000 7f6c01600700 1 -- 172.21.15.82:0/3959739951 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bfc1a1080 con 0x7f6bfc103610 2024-05-08T05:48:32.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:32.019+0000 7f6bf8c00700 1 -- 172.21.15.82:0/3959739951 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6bec0054f0 con 0x7f6bfc103610 2024-05-08T05:48:32.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:32.019+0000 7f6bf8c00700 1 -- 172.21.15.82:0/3959739951 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bec004930 con 0x7f6bfc103610 2024-05-08T05:48:32.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:32.020+0000 7f6c01600700 1 -- 172.21.15.82:0/3959739951 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bfc1a8960 con 0x7f6bfc103610 2024-05-08T05:48:32.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:32.021+0000 7f6c01600700 1 -- 172.21.15.82:0/3959739951 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bfc104af0 con 0x7f6bfc103610 2024-05-08T05:48:32.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:32.023+0000 7f6bf8c00700 1 -- 172.21.15.82:0/3959739951 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f6bec02a070 con 0x7f6bfc103610 2024-05-08T05:48:32.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:32.024+0000 7f6bf8c00700 1 --2- 172.21.15.82:0/3959739951 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f6be00b2880 0x7f6be00b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:32.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:32.024+0000 7f6bf8c00700 1 -- 172.21.15.82:0/3959739951 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f6bec0e2b80 con 0x7f6bfc103610 2024-05-08T05:48:32.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:32.024+0000 7f6bfb400700 1 --2- 172.21.15.82:0/3959739951 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f6be00b2880 0x7f6be00b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:32.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:32.025+0000 7f6bfb400700 1 --2- 172.21.15.82:0/3959739951 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f6be00b2880 0x7f6be00b4d40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc0ff7c0 tx=0x7f6be8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:32.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:32.029+0000 7f6bf8c00700 1 -- 172.21.15.82:0/3959739951 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6bec05fdf0 con 0x7f6bfc103610 2024-05-08T05:48:32.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:48:31 smithi151 ceph-mon[34815]: pgmap v395: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-08T05:48:32.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:48:31 smithi082 ceph-mon[30098]: pgmap v395: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-08T05:48:32.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:48:31 smithi134 ceph-mon[34132]: pgmap v395: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-08T05:48:32.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:32.312+0000 7f6c01600700 1 -- 172.21.15.82:0/3959739951 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6bfc06a190 con 0x7f6bfc103610 2024-05-08T05:48:32.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:32.313+0000 7f6bf8c00700 1 -- 172.21.15.82:0/3959739951 <== mon.2 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11948 (secure 0 0 0) 0x7f6bec013030 con 0x7f6bfc103610 2024-05-08T05:48:32.314 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:48:32.314 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14364,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3876883250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3876883250},{"type":"v1","addr":"172.21.15.82:6835","nonce":3876883250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1965070586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1965070586},{"type":"v1","addr":"172.21.15.82:6837","nonce":1965070586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T05:45:57.654009+0000","modified":"2024-05-08T05:46:21.713129+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24505,"mds_2":24487,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14397":{"gid":14397,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/1890720973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1890720973},{"type":"v1","addr":"172.21.15.82:6839","nonce":1890720973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14409":{"gid":14409,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/2957083305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":2957083305},{"type":"v1","addr":"172.21.15.82:6841","nonce":2957083305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6833/3827691638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3827691638},{"type":"v1","addr":"172.21.15.134:6833","nonce":3827691638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6833/3625067797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3625067797},{"type":"v1","addr":"172.21.15.151:6833","nonce":3625067797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/4074163402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4074163402},{"type":"v1","addr":"172.21.15.134:6835","nonce":4074163402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.134:6837/2212411710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2212411710},{"type":"v1","addr":"172.21.15.134:6837","nonce":2212411710}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":17,"addr":"172.21.15.151:6835/2093655929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2093655929},{"type":"v1","addr":"172.21.15.151:6835","nonce":2093655929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6837/4192404464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":4192404464},{"type":"v1","addr":"172.21.15.151:6837","nonce":4192404464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":14,"addr":"172.21.15.151:6839/2963754236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":2963754236},{"type":"v1","addr":"172.21.15.151:6839","nonce":2963754236}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.134:6839/1145270893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1145270893},{"type":"v1","addr":"172.21.15.134:6839","nonce":1145270893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24467,24475,24487,24505,24506]},"id":1}]} 2024-05-08T05:48:32.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:32.316+0000 7f6c01600700 1 -- 172.21.15.82:0/3959739951 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f6be00b2880 msgr2=0x7f6be00b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:32.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:32.316+0000 7f6c01600700 1 --2- 172.21.15.82:0/3959739951 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f6be00b2880 0x7f6be00b4d40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc0ff7c0 tx=0x7f6be8009260 comp rx=0 tx=0).stop 2024-05-08T05:48:32.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:32.316+0000 7f6c01600700 1 -- 172.21.15.82:0/3959739951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6bfc103610 msgr2=0x7f6bfc19bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:32.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:32.316+0000 7f6c01600700 1 --2- 172.21.15.82:0/3959739951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6bfc103610 0x7f6bfc19bde0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6bec000c00 tx=0x7f6bec00f990 comp rx=0 tx=0).stop 2024-05-08T05:48:32.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:32.316+0000 7f6c01600700 1 -- 172.21.15.82:0/3959739951 shutdown_connections 2024-05-08T05:48:32.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:32.316+0000 7f6c01600700 1 --2- 172.21.15.82:0/3959739951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6bfc103610 0x7f6bfc19bde0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:32.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:32.316+0000 7f6c01600700 1 --2- 172.21.15.82:0/3959739951 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f6be00b2880 0x7f6be00b4d40 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:32.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:32.316+0000 7f6c01600700 1 --2- 172.21.15.82:0/3959739951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6bfc1086f0 0x7f6bfc1a06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:32.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:32.316+0000 7f6c01600700 1 --2- 172.21.15.82:0/3959739951 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6bfc103fc0 0x7f6bfc19c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:32.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:32.316+0000 7f6c01600700 1 -- 172.21.15.82:0/3959739951 >> 172.21.15.82:0/3959739951 conn(0x7f6bfc0feec0 msgr2=0x7f6bfc1001f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:32.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:32.316+0000 7f6c01600700 1 -- 172.21.15.82:0/3959739951 shutdown_connections 2024-05-08T05:48:32.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:32.316+0000 7f6c01600700 1 -- 172.21.15.82:0/3959739951 wait complete. 2024-05-08T05:48:32.318 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 28 2024-05-08T05:48:32.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:48:32 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/3959739951' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:48:33.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:48:32 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/3959739951' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:48:33.230 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-08T05:48:33.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:48:32 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/3959739951' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:48:33.684 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:48:34.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:48:33 smithi151 ceph-mon[34815]: pgmap v396: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:48:34.159 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:48:33 smithi082 ceph-mon[30098]: pgmap v396: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:48:34.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:48:33 smithi134 ceph-mon[34132]: pgmap v396: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:48:36.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:36.024+0000 7f8f6e400700 1 -- 172.21.15.82:0/2073227734 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f68114670 msgr2=0x7f8f68116a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:36.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:36.024+0000 7f8f6e400700 1 --2- 172.21.15.82:0/2073227734 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f68114670 0x7f8f68116a60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8f6000b0a0 tx=0x7f8f6000b3b0 comp rx=0 tx=0).stop 2024-05-08T05:48:36.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:36.024+0000 7f8f6e400700 1 -- 172.21.15.82:0/2073227734 shutdown_connections 2024-05-08T05:48:36.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:36.024+0000 7f8f6e400700 1 --2- 172.21.15.82:0/2073227734 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f680756d0 0x7f8f68075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:36.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:36.024+0000 7f8f6e400700 1 --2- 172.21.15.82:0/2073227734 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f68114670 0x7f8f68116a60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:36.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:36.024+0000 7f8f6e400700 1 --2- 172.21.15.82:0/2073227734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f68075ff0 0x7f8f68114130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:36.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:36.024+0000 7f8f6e400700 1 -- 172.21.15.82:0/2073227734 >> 172.21.15.82:0/2073227734 conn(0x7f8f6807a600 msgr2=0x7f8f6807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:36.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:36.025+0000 7f8f6e400700 1 -- 172.21.15.82:0/2073227734 shutdown_connections 2024-05-08T05:48:36.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:36.025+0000 7f8f6e400700 1 -- 172.21.15.82:0/2073227734 wait complete. 2024-05-08T05:48:36.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:36.026+0000 7f8f6e400700 1 Processor -- start 2024-05-08T05:48:36.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:36.026+0000 7f8f6e400700 1 -- start start 2024-05-08T05:48:36.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:36.026+0000 7f8f6e400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f680756d0 0x7f8f681a01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:36.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:36.026+0000 7f8f6e400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f68075ff0 0x7f8f681a0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:36.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:36.026+0000 7f8f6e400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f68114670 0x7f8f681a4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:36.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:36.026+0000 7f8f6e400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8f68119ca0 con 0x7f8f68075ff0 2024-05-08T05:48:36.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:36.026+0000 7f8f6e400700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8f68119b20 con 0x7f8f68114670 2024-05-08T05:48:36.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:36.026+0000 7f8f6e400700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8f68119e20 con 0x7f8f680756d0 2024-05-08T05:48:36.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:36.026+0000 7f8f67400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f680756d0 0x7f8f681a01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:36.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:36.026+0000 7f8f5ea00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f68075ff0 0x7f8f681a0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:36.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:36.026+0000 7f8f67400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f680756d0 0x7f8f681a01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:51938/0 (socket says 172.21.15.82:51938) 2024-05-08T05:48:36.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:36.026+0000 7f8f67400700 1 -- 172.21.15.82:0/808947272 learned_addr learned my addr 172.21.15.82:0/808947272 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:48:36.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:36.027+0000 7f8f67e00700 1 --2- 172.21.15.82:0/808947272 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f68114670 0x7f8f681a4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:36.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:36.027+0000 7f8f67400700 1 -- 172.21.15.82:0/808947272 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f68114670 msgr2=0x7f8f681a4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:36.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:36.027+0000 7f8f67400700 1 --2- 172.21.15.82:0/808947272 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f68114670 0x7f8f681a4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:36.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:36.027+0000 7f8f67400700 1 -- 172.21.15.82:0/808947272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f68075ff0 msgr2=0x7f8f681a0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:36.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:36.027+0000 7f8f67400700 1 --2- 172.21.15.82:0/808947272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f68075ff0 0x7f8f681a0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:36.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:36.027+0000 7f8f67400700 1 -- 172.21.15.82:0/808947272 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f681a51e0 con 0x7f8f680756d0 2024-05-08T05:48:36.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:36.027+0000 7f8f5ea00700 1 --2- 172.21.15.82:0/808947272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f68075ff0 0x7f8f681a0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:48:36.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:36.027+0000 7f8f67400700 1 --2- 172.21.15.82:0/808947272 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f680756d0 0x7f8f681a01d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8f5800e9c0 tx=0x7f8f5800ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:36.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:36.027+0000 7f8f64c00700 1 -- 172.21.15.82:0/808947272 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f5800cbd0 con 0x7f8f680756d0 2024-05-08T05:48:36.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:36.028+0000 7f8f64c00700 1 -- 172.21.15.82:0/808947272 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8f5800ee60 con 0x7f8f680756d0 2024-05-08T05:48:36.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:36.028+0000 7f8f6e400700 1 -- 172.21.15.82:0/808947272 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f681a54d0 con 0x7f8f680756d0 2024-05-08T05:48:36.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:36.028+0000 7f8f64c00700 1 -- 172.21.15.82:0/808947272 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f580055c0 con 0x7f8f680756d0 2024-05-08T05:48:36.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:36.028+0000 7f8f6e400700 1 -- 172.21.15.82:0/808947272 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f681acd50 con 0x7f8f680756d0 2024-05-08T05:48:36.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:36.029+0000 7f8f6e400700 1 -- 172.21.15.82:0/808947272 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f6806a190 con 0x7f8f680756d0 2024-05-08T05:48:36.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:36.031+0000 7f8f64c00700 1 -- 172.21.15.82:0/808947272 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f8f58047960 con 0x7f8f680756d0 2024-05-08T05:48:36.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:36.033+0000 7f8f64c00700 1 --2- 172.21.15.82:0/808947272 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f8f4c0b2880 0x7f8f4c0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:36.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:36.033+0000 7f8f64c00700 1 -- 172.21.15.82:0/808947272 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f8f580e24b0 con 0x7f8f680756d0 2024-05-08T05:48:36.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:36.033+0000 7f8f5ea00700 1 --2- 172.21.15.82:0/808947272 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f8f4c0b2880 0x7f8f4c0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:36.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:36.033+0000 7f8f5ea00700 1 --2- 172.21.15.82:0/808947272 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f8f4c0b2880 0x7f8f4c0b4d40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8f68110f80 tx=0x7f8f50009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:36.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:36.035+0000 7f8f64c00700 1 -- 172.21.15.82:0/808947272 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f8f580aa180 con 0x7f8f680756d0 2024-05-08T05:48:36.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:48:35 smithi151 ceph-mon[34815]: pgmap v397: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-08T05:48:36.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:48:35 smithi082 ceph-mon[30098]: pgmap v397: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-08T05:48:36.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:48:35 smithi134 ceph-mon[34132]: pgmap v397: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-08T05:48:36.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:36.274+0000 7f8f6e400700 1 -- 172.21.15.82:0/808947272 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8f681a1530 con 0x7f8f680756d0 2024-05-08T05:48:36.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:36.276+0000 7f8f64c00700 1 -- 172.21.15.82:0/808947272 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22631 (secure 0 0 0) 0x7f8f580b2030 con 0x7f8f680756d0 2024-05-08T05:48:36.277 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:48:36.277 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":82,"fsid":"c739a5c8-0cfc-11ef-bc97-c7b262605968","created":"2024-05-08T05:36:37.441393+0000","modified":"2024-05-08T05:46:45.754375+0000","last_up_change":"2024-05-08T05:44:40.677995+0000","last_in_change":"2024-05-08T05:44:20.654220+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T05:40:28.102836+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T05:45:48.727521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T05:45:53.574048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bc9bd472-b765-4893-84ed-c66b5c1c61b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":4051651615},{"type":"v1","addr":"172.21.15.82:6803","nonce":4051651615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":4051651615},{"type":"v1","addr":"172.21.15.82:6805","nonce":4051651615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4051651615},{"type":"v1","addr":"172.21.15.82:6809","nonce":4051651615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":4051651615},{"type":"v1","addr":"172.21.15.82:6807","nonce":4051651615}]},"public_addr":"172.21.15.82:6803/4051651615","cluster_addr":"172.21.15.82:6805/4051651615","heartbeat_back_addr":"172.21.15.82:6809/4051651615","heartbeat_front_addr":"172.21.15.82:6807/4051651615","state":["exists","up"]},{"osd":1,"uuid":"ad2d3a6b-8bc5-4177-8757-07e8607ca240","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":2763858634},{"type":"v1","addr":"172.21.15.134:6801","nonce":2763858634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":2763858634},{"type":"v1","addr":"172.21.15.134:6803","nonce":2763858634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":2763858634},{"type":"v1","addr":"172.21.15.134:6807","nonce":2763858634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2763858634},{"type":"v1","addr":"172.21.15.134:6805","nonce":2763858634}]},"public_addr":"172.21.15.134:6801/2763858634","cluster_addr":"172.21.15.134:6803/2763858634","heartbeat_back_addr":"172.21.15.134:6807/2763858634","heartbeat_front_addr":"172.21.15.134:6805/2763858634","state":["exists","up"]},{"osd":2,"uuid":"a06dc8fc-7324-4e42-9487-8cfe372401b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":4193933269},{"type":"v1","addr":"172.21.15.151:6801","nonce":4193933269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":4193933269},{"type":"v1","addr":"172.21.15.151:6803","nonce":4193933269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":4193933269},{"type":"v1","addr":"172.21.15.151:6807","nonce":4193933269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":4193933269},{"type":"v1","addr":"172.21.15.151:6805","nonce":4193933269}]},"public_addr":"172.21.15.151:6801/4193933269","cluster_addr":"172.21.15.151:6803/4193933269","heartbeat_back_addr":"172.21.15.151:6807/4193933269","heartbeat_front_addr":"172.21.15.151:6805/4193933269","state":["exists","up"]},{"osd":3,"uuid":"b8c8bdcd-fbd7-4494-976e-7285408e010e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":2775272422},{"type":"v1","addr":"172.21.15.82:6811","nonce":2775272422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":2775272422},{"type":"v1","addr":"172.21.15.82:6813","nonce":2775272422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":2775272422},{"type":"v1","addr":"172.21.15.82:6817","nonce":2775272422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":2775272422},{"type":"v1","addr":"172.21.15.82:6815","nonce":2775272422}]},"public_addr":"172.21.15.82:6811/2775272422","cluster_addr":"172.21.15.82:6813/2775272422","heartbeat_back_addr":"172.21.15.82:6817/2775272422","heartbeat_front_addr":"172.21.15.82:6815/2775272422","state":["exists","up"]},{"osd":4,"uuid":"391a6040-03d1-483c-9058-308b5998e7c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3565208751},{"type":"v1","addr":"172.21.15.134:6809","nonce":3565208751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3565208751},{"type":"v1","addr":"172.21.15.134:6811","nonce":3565208751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3565208751},{"type":"v1","addr":"172.21.15.134:6815","nonce":3565208751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3565208751},{"type":"v1","addr":"172.21.15.134:6813","nonce":3565208751}]},"public_addr":"172.21.15.134:6809/3565208751","cluster_addr":"172.21.15.134:6811/3565208751","heartbeat_back_addr":"172.21.15.134:6815/3565208751","heartbeat_front_addr":"172.21.15.134:6813/3565208751","state":["exists","up"]},{"osd":5,"uuid":"dacce079-4aad-474e-b747-1ed60c3c71cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":1925634069},{"type":"v1","addr":"172.21.15.151:6809","nonce":1925634069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":1925634069},{"type":"v1","addr":"172.21.15.151:6811","nonce":1925634069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1925634069},{"type":"v1","addr":"172.21.15.151:6815","nonce":1925634069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1925634069},{"type":"v1","addr":"172.21.15.151:6813","nonce":1925634069}]},"public_addr":"172.21.15.151:6809/1925634069","cluster_addr":"172.21.15.151:6811/1925634069","heartbeat_back_addr":"172.21.15.151:6815/1925634069","heartbeat_front_addr":"172.21.15.151:6813/1925634069","state":["exists","up"]},{"osd":6,"uuid":"6a445bf4-09c4-4e9b-be6e-68ef3c05b365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":762647976},{"type":"v1","addr":"172.21.15.82:6819","nonce":762647976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":762647976},{"type":"v1","addr":"172.21.15.82:6821","nonce":762647976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":762647976},{"type":"v1","addr":"172.21.15.82:6825","nonce":762647976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":762647976},{"type":"v1","addr":"172.21.15.82:6823","nonce":762647976}]},"public_addr":"172.21.15.82:6819/762647976","cluster_addr":"172.21.15.82:6821/762647976","heartbeat_back_addr":"172.21.15.82:6825/762647976","heartbeat_front_addr":"172.21.15.82:6823/762647976","state":["exists","up"]},{"osd":7,"uuid":"72b0c735-ef30-4823-8ab8-2e5bf7cc3c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3006846927},{"type":"v1","addr":"172.21.15.134:6817","nonce":3006846927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3006846927},{"type":"v1","addr":"172.21.15.134:6819","nonce":3006846927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3006846927},{"type":"v1","addr":"172.21.15.134:6823","nonce":3006846927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3006846927},{"type":"v1","addr":"172.21.15.134:6821","nonce":3006846927}]},"public_addr":"172.21.15.134:6817/3006846927","cluster_addr":"172.21.15.134:6819/3006846927","heartbeat_back_addr":"172.21.15.134:6823/3006846927","heartbeat_front_addr":"172.21.15.134:6821/3006846927","state":["exists","up"]},{"osd":8,"uuid":"93e4da0f-48ea-4ab7-b612-26b545b76de6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":787870717},{"type":"v1","addr":"172.21.15.151:6817","nonce":787870717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":787870717},{"type":"v1","addr":"172.21.15.151:6819","nonce":787870717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":787870717},{"type":"v1","addr":"172.21.15.151:6823","nonce":787870717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":787870717},{"type":"v1","addr":"172.21.15.151:6821","nonce":787870717}]},"public_addr":"172.21.15.151:6817/787870717","cluster_addr":"172.21.15.151:6819/787870717","heartbeat_back_addr":"172.21.15.151:6823/787870717","heartbeat_front_addr":"172.21.15.151:6821/787870717","state":["exists","up"]},{"osd":9,"uuid":"ea0070c1-286a-47d3-90cf-d1fada6e3cda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":533124002},{"type":"v1","addr":"172.21.15.82:6827","nonce":533124002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":533124002},{"type":"v1","addr":"172.21.15.82:6829","nonce":533124002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":533124002},{"type":"v1","addr":"172.21.15.82:6833","nonce":533124002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":533124002},{"type":"v1","addr":"172.21.15.82:6831","nonce":533124002}]},"public_addr":"172.21.15.82:6827/533124002","cluster_addr":"172.21.15.82:6829/533124002","heartbeat_back_addr":"172.21.15.82:6833/533124002","heartbeat_front_addr":"172.21.15.82:6831/533124002","state":["exists","up"]},{"osd":10,"uuid":"26ca0a0b-ab9e-472f-bb29-428e8c31e5bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":99154842},{"type":"v1","addr":"172.21.15.134:6825","nonce":99154842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":99154842},{"type":"v1","addr":"172.21.15.134:6827","nonce":99154842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":99154842},{"type":"v1","addr":"172.21.15.134:6831","nonce":99154842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":99154842},{"type":"v1","addr":"172.21.15.134:6829","nonce":99154842}]},"public_addr":"172.21.15.134:6825/99154842","cluster_addr":"172.21.15.134:6827/99154842","heartbeat_back_addr":"172.21.15.134:6831/99154842","heartbeat_front_addr":"172.21.15.134:6829/99154842","state":["exists","up"]},{"osd":11,"uuid":"9ae5dca4-acfb-4a46-8601-9d642efde794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2242771269},{"type":"v1","addr":"172.21.15.151:6825","nonce":2242771269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2242771269},{"type":"v1","addr":"172.21.15.151:6827","nonce":2242771269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2242771269},{"type":"v1","addr":"172.21.15.151:6831","nonce":2242771269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2242771269},{"type":"v1","addr":"172.21.15.151:6829","nonce":2242771269}]},"public_addr":"172.21.15.151:6825/2242771269","cluster_addr":"172.21.15.151:6827/2242771269","heartbeat_back_addr":"172.21.15.151:6831/2242771269","heartbeat_front_addr":"172.21.15.151:6829/2242771269","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:39:35.575525+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:40:00.672367+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:40:24.558682+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:40:56.791194+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:41:23.031785+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:41:47.926448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:42:21.231894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:42:47.599982+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:43:12.950581+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:43:46.333027+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:44:13.457489+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:44:38.637273+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/2761274596":"2024-05-09T05:37:43.951218+0000","172.21.15.82:0/2195734928":"2024-05-09T05:37:43.951218+0000","172.21.15.82:6801/765895649":"2024-05-09T05:37:43.951218+0000","172.21.15.82:6800/3546670887":"2024-05-09T05:37:11.114057+0000","172.21.15.82:6800/765895649":"2024-05-09T05:37:43.951218+0000","172.21.15.82:0/3986150437":"2024-05-09T05:37:11.114057+0000","172.21.15.82:0/3457457714":"2024-05-09T05:37:11.114057+0000","172.21.15.82:0/2356749286":"2024-05-09T05:37:11.114057+0000","172.21.15.82:6801/3546670887":"2024-05-09T05:37:11.114057+0000","172.21.15.82:0/1694643083":"2024-05-09T05:37:43.951218+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T05:48:36.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:36.280+0000 7f8f6e400700 1 -- 172.21.15.82:0/808947272 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f8f4c0b2880 msgr2=0x7f8f4c0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:36.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:36.280+0000 7f8f6e400700 1 --2- 172.21.15.82:0/808947272 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f8f4c0b2880 0x7f8f4c0b4d40 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f8f68110f80 tx=0x7f8f50009260 comp rx=0 tx=0).stop 2024-05-08T05:48:36.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:36.280+0000 7f8f6e400700 1 -- 172.21.15.82:0/808947272 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f680756d0 msgr2=0x7f8f681a01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:36.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:36.280+0000 7f8f6e400700 1 --2- 172.21.15.82:0/808947272 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f680756d0 0x7f8f681a01d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8f5800e9c0 tx=0x7f8f5800ecd0 comp rx=0 tx=0).stop 2024-05-08T05:48:36.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:36.280+0000 7f8f6e400700 1 -- 172.21.15.82:0/808947272 shutdown_connections 2024-05-08T05:48:36.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:36.280+0000 7f8f6e400700 1 --2- 172.21.15.82:0/808947272 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f68114670 0x7f8f681a4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:36.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:36.280+0000 7f8f6e400700 1 --2- 172.21.15.82:0/808947272 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f8f4c0b2880 0x7f8f4c0b4d40 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:36.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:36.280+0000 7f8f6e400700 1 --2- 172.21.15.82:0/808947272 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f680756d0 0x7f8f681a01d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:36.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:36.280+0000 7f8f6e400700 1 --2- 172.21.15.82:0/808947272 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8f68075ff0 0x7f8f681a0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:36.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:36.280+0000 7f8f6e400700 1 -- 172.21.15.82:0/808947272 >> 172.21.15.82:0/808947272 conn(0x7f8f6807a600 msgr2=0x7f8f681134a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:36.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:36.280+0000 7f8f6e400700 1 -- 172.21.15.82:0/808947272 shutdown_connections 2024-05-08T05:48:36.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:36.280+0000 7f8f6e400700 1 -- 172.21.15.82:0/808947272 wait complete. 2024-05-08T05:48:36.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:48:36 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/808947272' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:48:37.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:48:36 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/808947272' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:48:37.184 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T05:48:37.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:48:36 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/808947272' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:48:37.626 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:48:38.104 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:48:37 smithi082 ceph-mon[30098]: pgmap v398: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-08T05:48:38.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:48:37 smithi151 ceph-mon[34815]: pgmap v398: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-08T05:48:38.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:48:37 smithi134 ceph-mon[34132]: pgmap v398: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-08T05:48:39.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:39.737+0000 7fd983200700 1 -- 172.21.15.82:0/1629833215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd97c0756d0 msgr2=0x7fd97c075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:39.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:39.737+0000 7fd983200700 1 --2- 172.21.15.82:0/1629833215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd97c0756d0 0x7fd97c075ab0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd96c00b0a0 tx=0x7fd96c00b3b0 comp rx=0 tx=0).stop 2024-05-08T05:48:39.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:39.738+0000 7fd983200700 1 -- 172.21.15.82:0/1629833215 shutdown_connections 2024-05-08T05:48:39.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:39.738+0000 7fd983200700 1 --2- 172.21.15.82:0/1629833215 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd97c114670 0x7fd97c116a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:39.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:39.738+0000 7fd983200700 1 --2- 172.21.15.82:0/1629833215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd97c0756d0 0x7fd97c075ab0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:39.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:39.738+0000 7fd983200700 1 --2- 172.21.15.82:0/1629833215 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd97c075ff0 0x7fd97c114130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:39.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:39.738+0000 7fd983200700 1 -- 172.21.15.82:0/1629833215 >> 172.21.15.82:0/1629833215 conn(0x7fd97c07a600 msgr2=0x7fd97c07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:39.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:39.738+0000 7fd983200700 1 -- 172.21.15.82:0/1629833215 shutdown_connections 2024-05-08T05:48:39.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:39.738+0000 7fd983200700 1 -- 172.21.15.82:0/1629833215 wait complete. 2024-05-08T05:48:39.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:39.739+0000 7fd983200700 1 Processor -- start 2024-05-08T05:48:39.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:39.739+0000 7fd983200700 1 -- start start 2024-05-08T05:48:39.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:39.739+0000 7fd983200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd97c0756d0 0x7fd97c1a0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:39.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:39.739+0000 7fd983200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd97c075ff0 0x7fd97c1a0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:39.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:39.739+0000 7fd983200700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd97c114670 0x7fd97c1a4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:39.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:39.739+0000 7fd983200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd97c119c80 con 0x7fd97c0756d0 2024-05-08T05:48:39.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:39.739+0000 7fd983200700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd97c119b00 con 0x7fd97c075ff0 2024-05-08T05:48:39.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:39.739+0000 7fd983200700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd97c119e00 con 0x7fd97c114670 2024-05-08T05:48:39.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:39.740+0000 7fd97be00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd97c0756d0 0x7fd97c1a0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:39.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:39.740+0000 7fd973400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd97c075ff0 0x7fd97c1a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:39.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:39.740+0000 7fd973400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd97c075ff0 0x7fd97c1a0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:44500/0 (socket says 172.21.15.82:44500) 2024-05-08T05:48:39.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:39.740+0000 7fd973400700 1 -- 172.21.15.82:0/3841067734 learned_addr learned my addr 172.21.15.82:0/3841067734 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:48:39.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:39.740+0000 7fd97be00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd97c0756d0 0x7fd97c1a0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41440/0 (socket says 172.21.15.82:41440) 2024-05-08T05:48:39.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:39.740+0000 7fd981200700 1 --2- 172.21.15.82:0/3841067734 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd97c114670 0x7fd97c1a4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:39.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:39.740+0000 7fd973400700 1 -- 172.21.15.82:0/3841067734 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd97c114670 msgr2=0x7fd97c1a4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:39.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:39.740+0000 7fd973400700 1 --2- 172.21.15.82:0/3841067734 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd97c114670 0x7fd97c1a4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:39.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:39.740+0000 7fd973400700 1 -- 172.21.15.82:0/3841067734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd97c0756d0 msgr2=0x7fd97c1a0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:39.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:39.740+0000 7fd973400700 1 --2- 172.21.15.82:0/3841067734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd97c0756d0 0x7fd97c1a0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:39.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:39.740+0000 7fd973400700 1 -- 172.21.15.82:0/3841067734 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd97c1a5140 con 0x7fd97c075ff0 2024-05-08T05:48:39.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:39.740+0000 7fd97be00700 1 --2- 172.21.15.82:0/3841067734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd97c0756d0 0x7fd97c1a0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:48:39.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:39.741+0000 7fd973400700 1 --2- 172.21.15.82:0/3841067734 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd97c075ff0 0x7fd97c1a0670 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd96400d950 tx=0x7fd96400dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:39.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:39.741+0000 7fd979600700 1 -- 172.21.15.82:0/3841067734 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd964016070 con 0x7fd97c075ff0 2024-05-08T05:48:39.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:39.741+0000 7fd979600700 1 -- 172.21.15.82:0/3841067734 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd96400fd40 con 0x7fd97c075ff0 2024-05-08T05:48:39.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:39.741+0000 7fd983200700 1 -- 172.21.15.82:0/3841067734 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd97c1a5430 con 0x7fd97c075ff0 2024-05-08T05:48:39.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:39.741+0000 7fd979600700 1 -- 172.21.15.82:0/3841067734 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd96400e3b0 con 0x7fd97c075ff0 2024-05-08T05:48:39.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:39.741+0000 7fd983200700 1 -- 172.21.15.82:0/3841067734 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd97c1accb0 con 0x7fd97c075ff0 2024-05-08T05:48:39.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:39.742+0000 7fd983200700 1 -- 172.21.15.82:0/3841067734 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd97c06a190 con 0x7fd97c075ff0 2024-05-08T05:48:39.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:39.745+0000 7fd979600700 1 -- 172.21.15.82:0/3841067734 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fd964019070 con 0x7fd97c075ff0 2024-05-08T05:48:39.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:39.746+0000 7fd979600700 1 --2- 172.21.15.82:0/3841067734 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd9600b2900 0x7fd9600b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:39.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:39.746+0000 7fd979600700 1 -- 172.21.15.82:0/3841067734 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd9640e1c60 con 0x7fd97c075ff0 2024-05-08T05:48:39.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:39.746+0000 7fd97be00700 1 --2- 172.21.15.82:0/3841067734 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd9600b2900 0x7fd9600b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:39.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:39.747+0000 7fd97be00700 1 --2- 172.21.15.82:0/3841067734 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd9600b2900 0x7fd9600b4dc0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd96c0095c0 tx=0x7fd96c00b7b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:39.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:39.748+0000 7fd979600700 1 -- 172.21.15.82:0/3841067734 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd9640a9930 con 0x7fd97c075ff0 2024-05-08T05:48:40.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:40.034+0000 7fd983200700 1 -- 172.21.15.82:0/3841067734 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd97c1a1490 con 0x7fd97c075ff0 2024-05-08T05:48:40.034 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:48:39 smithi082 ceph-mon[30098]: pgmap v399: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:48:40.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:40.035+0000 7fd979600700 1 -- 172.21.15.82:0/3841067734 <== mon.2 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11948 (secure 0 0 0) 0x7fd97c1a1490 con 0x7fd97c075ff0 2024-05-08T05:48:40.035 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:48:40.035 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14364,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3876883250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3876883250},{"type":"v1","addr":"172.21.15.82:6835","nonce":3876883250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1965070586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1965070586},{"type":"v1","addr":"172.21.15.82:6837","nonce":1965070586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T05:45:57.654009+0000","modified":"2024-05-08T05:46:21.713129+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24505,"mds_2":24487,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14397":{"gid":14397,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/1890720973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1890720973},{"type":"v1","addr":"172.21.15.82:6839","nonce":1890720973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14409":{"gid":14409,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/2957083305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":2957083305},{"type":"v1","addr":"172.21.15.82:6841","nonce":2957083305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6833/3827691638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3827691638},{"type":"v1","addr":"172.21.15.134:6833","nonce":3827691638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6833/3625067797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3625067797},{"type":"v1","addr":"172.21.15.151:6833","nonce":3625067797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/4074163402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4074163402},{"type":"v1","addr":"172.21.15.134:6835","nonce":4074163402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.134:6837/2212411710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2212411710},{"type":"v1","addr":"172.21.15.134:6837","nonce":2212411710}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":17,"addr":"172.21.15.151:6835/2093655929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2093655929},{"type":"v1","addr":"172.21.15.151:6835","nonce":2093655929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6837/4192404464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":4192404464},{"type":"v1","addr":"172.21.15.151:6837","nonce":4192404464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":14,"addr":"172.21.15.151:6839/2963754236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":2963754236},{"type":"v1","addr":"172.21.15.151:6839","nonce":2963754236}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.134:6839/1145270893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1145270893},{"type":"v1","addr":"172.21.15.134:6839","nonce":1145270893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24467,24475,24487,24505,24506]},"id":1}]} 2024-05-08T05:48:40.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:40.038+0000 7fd983200700 1 -- 172.21.15.82:0/3841067734 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd9600b2900 msgr2=0x7fd9600b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:40.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:40.038+0000 7fd983200700 1 --2- 172.21.15.82:0/3841067734 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd9600b2900 0x7fd9600b4dc0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd96c0095c0 tx=0x7fd96c00b7b0 comp rx=0 tx=0).stop 2024-05-08T05:48:40.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:40.038+0000 7fd983200700 1 -- 172.21.15.82:0/3841067734 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd97c075ff0 msgr2=0x7fd97c1a0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:40.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:40.038+0000 7fd983200700 1 --2- 172.21.15.82:0/3841067734 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd97c075ff0 0x7fd97c1a0670 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd96400d950 tx=0x7fd96400dc60 comp rx=0 tx=0).stop 2024-05-08T05:48:40.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:40.038+0000 7fd983200700 1 -- 172.21.15.82:0/3841067734 shutdown_connections 2024-05-08T05:48:40.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:40.039+0000 7fd983200700 1 --2- 172.21.15.82:0/3841067734 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd9600b2900 0x7fd9600b4dc0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:40.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:40.039+0000 7fd983200700 1 --2- 172.21.15.82:0/3841067734 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd97c114670 0x7fd97c1a4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:40.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:40.039+0000 7fd983200700 1 --2- 172.21.15.82:0/3841067734 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd97c0756d0 0x7fd97c1a0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:40.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:40.039+0000 7fd983200700 1 --2- 172.21.15.82:0/3841067734 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd97c075ff0 0x7fd97c1a0670 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:40.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:40.039+0000 7fd983200700 1 -- 172.21.15.82:0/3841067734 >> 172.21.15.82:0/3841067734 conn(0x7fd97c07a600 msgr2=0x7fd97c1134a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:40.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:40.039+0000 7fd983200700 1 -- 172.21.15.82:0/3841067734 shutdown_connections 2024-05-08T05:48:40.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:40.039+0000 7fd983200700 1 -- 172.21.15.82:0/3841067734 wait complete. 2024-05-08T05:48:40.040 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 28 2024-05-08T05:48:40.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:48:39 smithi151 ceph-mon[34815]: pgmap v399: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:48:40.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:48:39 smithi134 ceph-mon[34132]: pgmap v399: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:48:40.947 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-05-08T05:45:57.654009+0000', 'modified': '2024-05-08T05:46:21.713129+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24506, 'mds_1': 24505, 'mds_2': 24487, 'mds_3': 24475, 'mds_4': 24467}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14397': {'gid': 14397, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.82:6839/1890720973', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6838', 'nonce': 1890720973}, {'type': 'v1', 'addr': '172.21.15.82:6839', 'nonce': 1890720973}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14409': {'gid': 14409, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.82:6841/2957083305', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6840', 'nonce': 2957083305}, {'type': 'v1', 'addr': '172.21.15.82:6841', 'nonce': 2957083305}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24425': {'gid': 24425, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.134:6833/3827691638', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6832', 'nonce': 3827691638}, {'type': 'v1', 'addr': '172.21.15.134:6833', 'nonce': 3827691638}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24430': {'gid': 24430, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.151:6833/3625067797', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6832', 'nonce': 3625067797}, {'type': 'v1', 'addr': '172.21.15.151:6833', 'nonce': 3625067797}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24455': {'gid': 24455, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.134:6835/4074163402', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6834', 'nonce': 4074163402}, {'type': 'v1', 'addr': '172.21.15.134:6835', 'nonce': 4074163402}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24467': {'gid': 24467, 'name': 'h', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 16, 'addr': '172.21.15.134:6837/2212411710', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6836', 'nonce': 2212411710}, {'type': 'v1', 'addr': '172.21.15.134:6837', 'nonce': 2212411710}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24475': {'gid': 24475, 'name': 'f', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.151:6835/2093655929', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6834', 'nonce': 2093655929}, {'type': 'v1', 'addr': '172.21.15.151:6835', 'nonce': 2093655929}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24487': {'gid': 24487, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 16, 'addr': '172.21.15.151:6837/4192404464', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6836', 'nonce': 4192404464}, {'type': 'v1', 'addr': '172.21.15.151:6837', 'nonce': 4192404464}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24505': {'gid': 24505, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.151:6839/2963754236', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6838', 'nonce': 2963754236}, {'type': 'v1', 'addr': '172.21.15.151:6839', 'nonce': 2963754236}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24506': {'gid': 24506, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.134:6839/1145270893', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6838', 'nonce': 1145270893}, {'type': 'v1', 'addr': '172.21.15.134:6839', 'nonce': 1145270893}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24506, 'qdb_cluster': [24467, 24475, 24487, 24505, 24506]} 2024-05-08T05:48:40.947 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-05-08T05:48:40.947 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.h status 2024-05-08T05:48:41.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:48:40 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/3841067734' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:48:41.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:48:40 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/3841067734' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:48:41.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:48:40 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/3841067734' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:48:41.390 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:48:42.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:48:41 smithi151 ceph-mon[34815]: pgmap v400: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-08T05:48:42.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:48:41 smithi082 ceph-mon[30098]: pgmap v400: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-08T05:48:42.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:48:41 smithi134 ceph-mon[34132]: pgmap v400: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-08T05:48:43.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.843+0000 7f3a53200700 1 -- 172.21.15.82:0/3171684270 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a54076160 msgr2=0x7f3a54113ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:43.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.843+0000 7f3a53200700 1 --2- 172.21.15.82:0/3171684270 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a54076160 0x7f3a54113ea0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3a400098f0 tx=0x7f3a40009c00 comp rx=0 tx=0).stop 2024-05-08T05:48:43.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.844+0000 7f3a53200700 1 -- 172.21.15.82:0/3171684270 shutdown_connections 2024-05-08T05:48:43.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.844+0000 7f3a53200700 1 --2- 172.21.15.82:0/3171684270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a541143e0 0x7f3a541167d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:43.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.844+0000 7f3a53200700 1 --2- 172.21.15.82:0/3171684270 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a54075840 0x7f3a54075c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:43.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.844+0000 7f3a53200700 1 --2- 172.21.15.82:0/3171684270 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a54076160 0x7f3a54113ea0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:43.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.844+0000 7f3a53200700 1 -- 172.21.15.82:0/3171684270 >> 172.21.15.82:0/3171684270 conn(0x7f3a540fef20 msgr2=0x7f3a54101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:43.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.844+0000 7f3a53200700 1 -- 172.21.15.82:0/3171684270 shutdown_connections 2024-05-08T05:48:43.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.844+0000 7f3a53200700 1 -- 172.21.15.82:0/3171684270 wait complete. 2024-05-08T05:48:43.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.845+0000 7f3a53200700 1 Processor -- start 2024-05-08T05:48:43.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.846+0000 7f3a53200700 1 -- start start 2024-05-08T05:48:43.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.846+0000 7f3a53200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a54075840 0x7f3a541a0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:43.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.846+0000 7f3a53200700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a54076160 0x7f3a541a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:43.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.846+0000 7f3a53200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a541143e0 0x7f3a541a49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:43.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.846+0000 7f3a53200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3a54119c00 con 0x7f3a541143e0 2024-05-08T05:48:43.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.846+0000 7f3a53200700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3a54119a80 con 0x7f3a54075840 2024-05-08T05:48:43.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.846+0000 7f3a53200700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3a54119d80 con 0x7f3a54076160 2024-05-08T05:48:43.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.847+0000 7f3a51e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a54075840 0x7f3a541a0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:43.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.847+0000 7f3a51400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a54076160 0x7f3a541a06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:43.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.847+0000 7f3a51e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a54075840 0x7f3a541a0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:57438/0 (socket says 172.21.15.82:57438) 2024-05-08T05:48:43.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.847+0000 7f3a51e00700 1 -- 172.21.15.82:0/1003847233 learned_addr learned my addr 172.21.15.82:0/1003847233 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:48:43.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.847+0000 7f3a52800700 1 --2- 172.21.15.82:0/1003847233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a541143e0 0x7f3a541a49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:43.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.847+0000 7f3a51e00700 1 -- 172.21.15.82:0/1003847233 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a54076160 msgr2=0x7f3a541a06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:43.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.847+0000 7f3a51e00700 1 --2- 172.21.15.82:0/1003847233 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a54076160 0x7f3a541a06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:43.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.847+0000 7f3a51e00700 1 -- 172.21.15.82:0/1003847233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a541143e0 msgr2=0x7f3a541a49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:43.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.847+0000 7f3a51e00700 1 --2- 172.21.15.82:0/1003847233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a541143e0 0x7f3a541a49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:43.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.847+0000 7f3a51e00700 1 -- 172.21.15.82:0/1003847233 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a541a5130 con 0x7f3a54075840 2024-05-08T05:48:43.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.848+0000 7f3a51e00700 1 --2- 172.21.15.82:0/1003847233 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a54075840 0x7f3a541a0170 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3a4400eb30 tx=0x7f3a4400ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:43.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.848+0000 7f3a4aa00700 1 -- 172.21.15.82:0/1003847233 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a4400cbd0 con 0x7f3a54075840 2024-05-08T05:48:43.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.848+0000 7f3a53200700 1 -- 172.21.15.82:0/1003847233 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a541a5420 con 0x7f3a54075840 2024-05-08T05:48:43.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.848+0000 7f3a53200700 1 -- 172.21.15.82:0/1003847233 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a541acca0 con 0x7f3a54075840 2024-05-08T05:48:43.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.848+0000 7f3a4aa00700 1 -- 172.21.15.82:0/1003847233 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a440044d0 con 0x7f3a54075840 2024-05-08T05:48:43.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.848+0000 7f3a4aa00700 1 -- 172.21.15.82:0/1003847233 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a44003e30 con 0x7f3a54075840 2024-05-08T05:48:43.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.852+0000 7f3a4aa00700 1 -- 172.21.15.82:0/1003847233 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f3a44004000 con 0x7f3a54075840 2024-05-08T05:48:43.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.853+0000 7f3a63a55b80 1 Processor -- start 2024-05-08T05:48:43.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.853+0000 7f3a63a55b80 1 -- start start 2024-05-08T05:48:43.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.854+0000 7f3a63a55b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb92eed990 0x55cb92eedd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:43.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.854+0000 7f3a63a55b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cb92eee2b0 0x55cb92ee7f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:43.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.854+0000 7f3a63a55b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cb92ee85b0 0x55cb92ee8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:43.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.854+0000 7f3a63a55b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55cb92e3a9d0 con 0x55cb92ee85b0 2024-05-08T05:48:43.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.854+0000 7f3a63a55b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55cb92dd8710 con 0x55cb92eee2b0 2024-05-08T05:48:43.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.854+0000 7f3a63a55b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55cb92e36990 con 0x55cb92eed990 2024-05-08T05:48:43.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.854+0000 7f3a51e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cb92eee2b0 0x55cb92ee7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:43.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.854+0000 7f3a51e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cb92eee2b0 0x55cb92ee7f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:57442/0 (socket says 172.21.15.82:57442) 2024-05-08T05:48:43.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.854+0000 7f3a51e00700 1 -- 172.21.15.82:0/1567021494 learned_addr learned my addr 172.21.15.82:0/1567021494 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:48:43.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.854+0000 7f3a4aa00700 1 --2- 172.21.15.82:0/1003847233 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3a380b2900 0x7f3a380b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:43.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.854+0000 7f3a52800700 1 --2- 172.21.15.82:0/1567021494 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb92eed990 0x55cb92eedd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:43.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.854+0000 7f3a51400700 1 --2- 172.21.15.82:0/1567021494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cb92ee85b0 0x55cb92ee8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:43.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.855+0000 7f3a4aa00700 1 -- 172.21.15.82:0/1003847233 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f3a440e2500 con 0x7f3a54075840 2024-05-08T05:48:43.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.855+0000 7f3a52800700 1 --2- 172.21.15.82:0/1003847233 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3a380b2900 0x7f3a380b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:43.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.855+0000 7f3a51e00700 1 -- 172.21.15.82:0/1567021494 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb92eed990 msgr2=0x55cb92eedd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:48:43.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.855+0000 7f3a51e00700 1 --2- 172.21.15.82:0/1567021494 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb92eed990 0x55cb92eedd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:43.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.855+0000 7f3a51e00700 1 -- 172.21.15.82:0/1567021494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cb92ee85b0 msgr2=0x55cb92ee8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:48:43.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.855+0000 7f3a51e00700 1 --2- 172.21.15.82:0/1567021494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cb92ee85b0 0x55cb92ee8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:43.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.855+0000 7f3a51e00700 1 -- 172.21.15.82:0/1567021494 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb92d87880 con 0x55cb92eee2b0 2024-05-08T05:48:43.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.855+0000 7f3a51e00700 1 --2- 172.21.15.82:0/1567021494 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cb92eee2b0 0x55cb92ee7f90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3a440a9830 tx=0x7f3a440047e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0e2f381a43960bf server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:43.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.856+0000 7f3a52800700 1 --2- 172.21.15.82:0/1003847233 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3a380b2900 0x7f3a380b4dc0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c009ec0 tx=0x7f3a4c004b40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:43.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.856+0000 7f3a3f400700 1 -- 172.21.15.82:0/1567021494 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a440a9900 con 0x55cb92eee2b0 2024-05-08T05:48:43.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.856+0000 7f3a3f400700 1 -- 172.21.15.82:0/1567021494 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a440e5e30 con 0x55cb92eee2b0 2024-05-08T05:48:43.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.856+0000 7f3a3f400700 1 -- 172.21.15.82:0/1567021494 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a440a52c0 con 0x55cb92eee2b0 2024-05-08T05:48:43.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.857+0000 7f3a63a55b80 1 -- 172.21.15.82:0/1567021494 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cb92eee2b0 msgr2=0x55cb92ee7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:43.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.857+0000 7f3a63a55b80 1 --2- 172.21.15.82:0/1567021494 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cb92eee2b0 0x55cb92ee7f90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3a440a9830 tx=0x7f3a440047e0 comp rx=0 tx=0).stop 2024-05-08T05:48:43.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.857+0000 7f3a63a55b80 1 -- 172.21.15.82:0/1567021494 shutdown_connections 2024-05-08T05:48:43.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.857+0000 7f3a63a55b80 1 --2- 172.21.15.82:0/1567021494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cb92ee85b0 0x55cb92ee8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:43.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.857+0000 7f3a63a55b80 1 --2- 172.21.15.82:0/1567021494 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb92eed990 0x55cb92eedd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:43.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.857+0000 7f3a63a55b80 1 --2- 172.21.15.82:0/1567021494 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cb92eee2b0 0x55cb92ee7f90 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:43.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.857+0000 7f3a63a55b80 1 -- 172.21.15.82:0/1567021494 >> 172.21.15.82:0/1567021494 conn(0x55cb92e16b10 msgr2=0x55cb92ee2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:43.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.857+0000 7f3a63a55b80 1 -- 172.21.15.82:0/1567021494 shutdown_connections 2024-05-08T05:48:43.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.857+0000 7f3a63a55b80 1 -- 172.21.15.82:0/1567021494 wait complete. 2024-05-08T05:48:43.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.858+0000 7f3a63a55b80 1 -- start start 2024-05-08T05:48:43.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.858+0000 7f3a63a55b80 1 Processor -- start 2024-05-08T05:48:43.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.858+0000 7f3a63a55b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb92ee85b0 0x55cb92ef3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:43.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.858+0000 7f3a63a55b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cb92eed990 0x55cb92ef1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:43.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.858+0000 7f3a63a55b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cb92eee2b0 0x55cb92ef1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:43.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.858+0000 7f3a63a55b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55cb92ef4d00 con 0x55cb92eee2b0 2024-05-08T05:48:43.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.858+0000 7f3a63a55b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55cb92da0ad0 con 0x55cb92eed990 2024-05-08T05:48:43.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.858+0000 7f3a63a55b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55cb92ef4e80 con 0x55cb92ee85b0 2024-05-08T05:48:43.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.858+0000 7f3a63a55b80 10 client.0 _ll_register_callbacks cb 0x55cb92de1c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:48:43.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.859+0000 7f3a51e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb92ee85b0 0x55cb92ef3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:43.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.859+0000 7f3a52800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cb92eee2b0 0x55cb92ef1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:43.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.859+0000 7f3a51e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb92ee85b0 0x55cb92ef3e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:55658/0 (socket says 172.21.15.82:55658) 2024-05-08T05:48:43.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.859+0000 7f3a51e00700 1 -- 172.21.15.82:0/749904904 learned_addr learned my addr 172.21.15.82:0/749904904 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:48:43.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.859+0000 7f3a51400700 1 --2- 172.21.15.82:0/749904904 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cb92eed990 0x55cb92ef1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:43.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.859+0000 7f3a51e00700 1 -- 172.21.15.82:0/749904904 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cb92eed990 msgr2=0x55cb92ef1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:48:43.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.859+0000 7f3a51e00700 1 --2- 172.21.15.82:0/749904904 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cb92eed990 0x55cb92ef1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:43.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.859+0000 7f3a51e00700 1 -- 172.21.15.82:0/749904904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cb92eee2b0 msgr2=0x55cb92ef1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:48:43.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.859+0000 7f3a51e00700 1 --2- 172.21.15.82:0/749904904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cb92eee2b0 0x55cb92ef1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:43.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.859+0000 7f3a51e00700 1 -- 172.21.15.82:0/749904904 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb92e003d0 con 0x55cb92ee85b0 2024-05-08T05:48:43.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.859+0000 7f3a51e00700 1 --2- 172.21.15.82:0/749904904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb92ee85b0 0x55cb92ef3e80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3a4401f000 tx=0x7f3a44003890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f16e7be3537e74c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:43.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.859+0000 7f3a33e00700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:48:43.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.860+0000 7f3a33e00700 1 -- 172.21.15.82:0/749904904 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a440c3060 con 0x55cb92ee85b0 2024-05-08T05:48:43.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.860+0000 7f3a33e00700 1 -- 172.21.15.82:0/749904904 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f3a440b2500 con 0x55cb92ee85b0 2024-05-08T05:48:43.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.860+0000 7f3a63a55b80 1 -- 172.21.15.82:0/749904904 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a440e5e30 con 0x55cb92ee85b0 2024-05-08T05:48:43.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.860+0000 7f3a33e00700 1 -- 172.21.15.82:0/749904904 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3a440aae60 con 0x55cb92ee85b0 2024-05-08T05:48:43.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.860+0000 7f3a63a55b80 10 client.24880 fetch_fsmap learned FSMap version 28 2024-05-08T05:48:43.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.860+0000 7f3a63a55b80 1 -- 172.21.15.82:0/749904904 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cb92ef4d00 con 0x55cb92ee85b0 2024-05-08T05:48:43.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.860+0000 7f3a33e00700 1 -- 172.21.15.82:0/749904904 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a440e5e30 con 0x55cb92ee85b0 2024-05-08T05:48:43.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.860+0000 7f3a33e00700 1 -- 172.21.15.82:0/749904904 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f3a440a54a0 con 0x55cb92ee85b0 2024-05-08T05:48:43.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.861+0000 7f3a63a55b80 10 client.24880 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T05:48:43.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.861+0000 7f3a63a55b80 10 client.24880 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-08T05:48:43.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.861+0000 7f3a63a55b80 20 client.24880 populate_metadata read hostname 'smithi082' 2024-05-08T05:48:43.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.861+0000 7f3a63a55b80 1 --2- 172.21.15.82:0/749904904 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x55cb92f01510 0x55cb92f02980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:43.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.861+0000 7f3a63a55b80 4 client.24880 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:48:43.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.861+0000 7f3a63a55b80 1 -- 172.21.15.82:0/749904904 --> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cb92eb5050 con 0x55cb92f01510 2024-05-08T05:48:43.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.861+0000 7f3a51400700 1 --2- 172.21.15.82:0/749904904 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x55cb92f01510 0x55cb92f02980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:43.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.861+0000 7f3a51400700 1 --2- 172.21.15.82:0/749904904 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x55cb92f01510 0x55cb92f02980 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=1b4f5f5282b92303 server_cookie=3a6e9b56fd772b62 in_seq=0 out_seq=0 2024-05-08T05:48:43.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.861+0000 7f3a33e00700 10 client.24880 ms_handle_connect on v2:172.21.15.134:6836/2212411710 2024-05-08T05:48:43.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.862+0000 7f3a33e00700 1 -- 172.21.15.82:0/749904904 <== mds.4 v2:172.21.15.134:6836/2212411710 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55cb92eb5050 con 0x55cb92f01510 2024-05-08T05:48:43.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.862+0000 7f3a33e00700 10 client.24880 handle_command_reply: tid=0 2024-05-08T05:48:43.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.862+0000 7f3a63a55b80 1 client.24880 shutdown 2024-05-08T05:48:43.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.863+0000 7f3a63a55b80 1 -- 172.21.15.82:0/749904904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb92ee85b0 msgr2=0x55cb92ef3e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:43.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.863+0000 7f3a63a55b80 1 --2- 172.21.15.82:0/749904904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb92ee85b0 0x55cb92ef3e80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3a4401f000 tx=0x7f3a44003890 comp rx=0 tx=0).stop 2024-05-08T05:48:43.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.863+0000 7f3a63a55b80 1 -- 172.21.15.82:0/749904904 shutdown_connections 2024-05-08T05:48:43.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.863+0000 7f3a63a55b80 1 --2- 172.21.15.82:0/749904904 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x55cb92f01510 0x55cb92f02980 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:43.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.863+0000 7f3a63a55b80 1 --2- 172.21.15.82:0/749904904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cb92eee2b0 0x55cb92ef1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:43.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.863+0000 7f3a63a55b80 1 --2- 172.21.15.82:0/749904904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb92ee85b0 0x55cb92ef3e80 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:43.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.863+0000 7f3a63a55b80 1 --2- 172.21.15.82:0/749904904 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cb92eed990 0x55cb92ef1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:43.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.863+0000 7f3a63a55b80 1 -- 172.21.15.82:0/749904904 >> 172.21.15.82:0/749904904 conn(0x55cb92e16b10 msgr2=0x55cb92edd410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:43.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.863+0000 7f3a33e00700 0 client.24880 ms_handle_reset on v2:172.21.15.134:6836/2212411710 2024-05-08T05:48:43.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.863+0000 7f3a63a55b80 1 -- 172.21.15.82:0/749904904 shutdown_connections 2024-05-08T05:48:43.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.863+0000 7f3a63a55b80 1 -- 172.21.15.82:0/749904904 wait complete. 2024-05-08T05:48:43.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.863+0000 7f3a63a55b80 20 client.24880 trim_cache size 0 max 16384 2024-05-08T05:48:43.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.886+0000 7f3a63a55b80 1 Processor -- start 2024-05-08T05:48:43.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.886+0000 7f3a63a55b80 1 -- start start 2024-05-08T05:48:43.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.886+0000 7f3a63a55b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cb92ee85b0 0x55cb92ee7f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:43.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.886+0000 7f3a63a55b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cb92eed990 0x55cb92eefb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:43.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.886+0000 7f3a63a55b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb92eee2b0 0x55cb92ef0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:43.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.886+0000 7f3a63a55b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55cb92f00cc0 con 0x55cb92eed990 2024-05-08T05:48:43.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.886+0000 7f3a63a55b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55cb92f01390 con 0x55cb92ee85b0 2024-05-08T05:48:43.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.886+0000 7f3a63a55b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55cb92f01a60 con 0x55cb92eee2b0 2024-05-08T05:48:43.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.887+0000 7f3a51400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cb92eed990 0x55cb92eefb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:43.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.887+0000 7f3a51400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cb92eed990 0x55cb92eefb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60770/0 (socket says 172.21.15.82:60770) 2024-05-08T05:48:43.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.887+0000 7f3a51e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cb92ee85b0 0x55cb92ee7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:43.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.887+0000 7f3a51400700 1 -- 172.21.15.82:0/1818811577 learned_addr learned my addr 172.21.15.82:0/1818811577 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:48:43.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.887+0000 7f3a52800700 1 --2- 172.21.15.82:0/1818811577 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb92eee2b0 0x55cb92ef0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:43.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.887+0000 7f3a51e00700 1 -- 172.21.15.82:0/1818811577 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb92eee2b0 msgr2=0x55cb92ef0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:48:43.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.887+0000 7f3a51e00700 1 --2- 172.21.15.82:0/1818811577 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb92eee2b0 0x55cb92ef0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:43.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.887+0000 7f3a51e00700 1 -- 172.21.15.82:0/1818811577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cb92eed990 msgr2=0x55cb92eefb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:48:43.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.887+0000 7f3a51e00700 1 --2- 172.21.15.82:0/1818811577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cb92eed990 0x55cb92eefb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:43.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.887+0000 7f3a51e00700 1 -- 172.21.15.82:0/1818811577 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb92ef3ac0 con 0x55cb92ee85b0 2024-05-08T05:48:43.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.887+0000 7f3a51e00700 1 --2- 172.21.15.82:0/1818811577 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cb92ee85b0 0x55cb92ee7f90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3a440a5bb0 tx=0x7f3a440aa380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94a1cb3c41c718fe server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:43.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.888+0000 7f3a3ea00700 1 -- 172.21.15.82:0/1818811577 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a440c3070 con 0x55cb92ee85b0 2024-05-08T05:48:43.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.888+0000 7f3a3ea00700 1 -- 172.21.15.82:0/1818811577 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a440a9640 con 0x55cb92ee85b0 2024-05-08T05:48:43.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.888+0000 7f3a3ea00700 1 -- 172.21.15.82:0/1818811577 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a440a92a0 con 0x55cb92ee85b0 2024-05-08T05:48:43.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.889+0000 7f3a63a55b80 1 -- 172.21.15.82:0/1818811577 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cb92ee85b0 msgr2=0x55cb92ee7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:43.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.889+0000 7f3a63a55b80 1 --2- 172.21.15.82:0/1818811577 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cb92ee85b0 0x55cb92ee7f90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3a440a5bb0 tx=0x7f3a440aa380 comp rx=0 tx=0).stop 2024-05-08T05:48:43.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.889+0000 7f3a63a55b80 1 -- 172.21.15.82:0/1818811577 shutdown_connections 2024-05-08T05:48:43.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.889+0000 7f3a63a55b80 1 --2- 172.21.15.82:0/1818811577 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cb92ee85b0 0x55cb92ee7f90 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:43.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.889+0000 7f3a63a55b80 1 --2- 172.21.15.82:0/1818811577 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb92eee2b0 0x55cb92ef0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:43.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.889+0000 7f3a63a55b80 1 --2- 172.21.15.82:0/1818811577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cb92eed990 0x55cb92eefb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:43.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.889+0000 7f3a63a55b80 1 -- 172.21.15.82:0/1818811577 >> 172.21.15.82:0/1818811577 conn(0x55cb92e16b10 msgr2=0x55cb92eeb4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:43.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.889+0000 7f3a63a55b80 1 -- 172.21.15.82:0/1818811577 shutdown_connections 2024-05-08T05:48:43.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.889+0000 7f3a63a55b80 1 -- 172.21.15.82:0/1818811577 wait complete. 2024-05-08T05:48:43.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.889+0000 7f3a63a55b80 1 -- start start 2024-05-08T05:48:43.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.889+0000 7f3a63a55b80 1 Processor -- start 2024-05-08T05:48:43.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.890+0000 7f3a63a55b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cb92ee85b0 0x55cb92f0c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:43.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.890+0000 7f3a63a55b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cb92eed990 0x55cb92ee6f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:43.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.890+0000 7f3a63a55b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb92eee2b0 0x55cb92ee7670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:43.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.890+0000 7f3a63a55b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55cb92f02800 con 0x55cb92ee85b0 2024-05-08T05:48:43.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.890+0000 7f3a63a55b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55cb92f02130 con 0x55cb92eed990 2024-05-08T05:48:43.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.890+0000 7f3a63a55b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55cb92f02ed0 con 0x55cb92eee2b0 2024-05-08T05:48:43.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.890+0000 7f3a63a55b80 10 client.0 _ll_register_callbacks cb 0x55cb92de1c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:48:43.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.890+0000 7f3a51e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cb92ee85b0 0x55cb92f0c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:43.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.890+0000 7f3a51e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cb92ee85b0 0x55cb92f0c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60778/0 (socket says 172.21.15.82:60778) 2024-05-08T05:48:43.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.890+0000 7f3a51e00700 1 -- 172.21.15.82:0/1402863423 learned_addr learned my addr 172.21.15.82:0/1402863423 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:48:43.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.890+0000 7f3a51400700 1 --2- 172.21.15.82:0/1402863423 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cb92eed990 0x55cb92ee6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:43.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.890+0000 7f3a52800700 1 --2- 172.21.15.82:0/1402863423 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb92eee2b0 0x55cb92ee7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:43.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.891+0000 7f3a51e00700 1 -- 172.21.15.82:0/1402863423 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb92eee2b0 msgr2=0x55cb92ee7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:48:43.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.891+0000 7f3a51e00700 1 --2- 172.21.15.82:0/1402863423 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb92eee2b0 0x55cb92ee7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:43.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.891+0000 7f3a51e00700 1 -- 172.21.15.82:0/1402863423 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cb92eed990 msgr2=0x55cb92ee6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:48:43.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.891+0000 7f3a51e00700 1 --2- 172.21.15.82:0/1402863423 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cb92eed990 0x55cb92ee6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:43.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.891+0000 7f3a51e00700 1 -- 172.21.15.82:0/1402863423 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb92f09fa0 con 0x55cb92ee85b0 2024-05-08T05:48:43.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.891+0000 7f3a51e00700 1 --2- 172.21.15.82:0/1402863423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cb92ee85b0 0x55cb92f0c450 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3a440adfc0 tx=0x7f3a4400c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4986a41526e37f16 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:43.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.891+0000 7f3a33e00700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T05:48:43.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.891+0000 7f3a33e00700 1 -- 172.21.15.82:0/1402863423 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a440c3070 con 0x55cb92ee85b0 2024-05-08T05:48:43.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.891+0000 7f3a33e00700 1 -- 172.21.15.82:0/1402863423 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f3a440a8d90 con 0x55cb92ee85b0 2024-05-08T05:48:43.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.891+0000 7f3a63a55b80 1 -- 172.21.15.82:0/1402863423 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a440a9640 con 0x55cb92ee85b0 2024-05-08T05:48:43.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.892+0000 7f3a33e00700 1 -- 172.21.15.82:0/1402863423 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3a440a9480 con 0x55cb92ee85b0 2024-05-08T05:48:43.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.892+0000 7f3a63a55b80 10 client.14769 fetch_fsmap learned FSMap version 28 2024-05-08T05:48:43.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.892+0000 7f3a63a55b80 1 -- 172.21.15.82:0/1402863423 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cb92f6cb50 con 0x55cb92ee85b0 2024-05-08T05:48:43.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.892+0000 7f3a33e00700 1 -- 172.21.15.82:0/1402863423 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a440a9640 con 0x55cb92ee85b0 2024-05-08T05:48:43.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.892+0000 7f3a33e00700 1 -- 172.21.15.82:0/1402863423 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f3a44086070 con 0x55cb92ee85b0 2024-05-08T05:48:43.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.892+0000 7f3a63a55b80 10 client.14769 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T05:48:43.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.892+0000 7f3a63a55b80 10 client.14769 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-08T05:48:43.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.892+0000 7f3a63a55b80 20 client.14769 populate_metadata read hostname 'smithi082' 2024-05-08T05:48:43.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.892+0000 7f3a63a55b80 1 --2- 172.21.15.82:0/1402863423 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x55cb92f711d0 0x55cb92f6fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:43.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.892+0000 7f3a63a55b80 4 client.14769 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T05:48:43.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.892+0000 7f3a63a55b80 1 -- 172.21.15.82:0/1402863423 --> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] -- command(tid 0: {"prefix": "status"}) -- 0x55cb92e483b0 con 0x55cb92f711d0 2024-05-08T05:48:43.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.893+0000 7f3a51400700 1 --2- 172.21.15.82:0/1402863423 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x55cb92f711d0 0x55cb92f6fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:43.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.893+0000 7f3a33e00700 10 client.14769 ms_handle_connect on v2:172.21.15.134:6836/2212411710 2024-05-08T05:48:43.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.893+0000 7f3a51400700 1 --2- 172.21.15.82:0/1402863423 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x55cb92f711d0 0x55cb92f6fee0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=19f48df425558274 server_cookie=b8303f4e6e5a4250 in_seq=0 out_seq=0 2024-05-08T05:48:43.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.894+0000 7f3a33e00700 1 -- 172.21.15.82:0/1402863423 <== mds.4 v2:172.21.15.134:6836/2212411710 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55cb92e483b0 con 0x55cb92f711d0 2024-05-08T05:48:43.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.894+0000 7f3a33e00700 10 client.14769 handle_command_reply: tid=0 2024-05-08T05:48:43.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.894+0000 7f3a63a55b80 1 client.14769 shutdown 2024-05-08T05:48:43.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.894+0000 7f3a63a55b80 1 -- 172.21.15.82:0/1402863423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cb92ee85b0 msgr2=0x55cb92f0c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:43.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.894+0000 7f3a63a55b80 1 --2- 172.21.15.82:0/1402863423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cb92ee85b0 0x55cb92f0c450 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3a440adfc0 tx=0x7f3a4400c750 comp rx=0 tx=0).stop 2024-05-08T05:48:43.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.894+0000 7f3a63a55b80 1 -- 172.21.15.82:0/1402863423 shutdown_connections 2024-05-08T05:48:43.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.894+0000 7f3a63a55b80 1 --2- 172.21.15.82:0/1402863423 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x55cb92f711d0 0x55cb92f6fee0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:43.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.894+0000 7f3a63a55b80 1 --2- 172.21.15.82:0/1402863423 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cb92eee2b0 0x55cb92ee7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:43.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.894+0000 7f3a63a55b80 1 --2- 172.21.15.82:0/1402863423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cb92ee85b0 0x55cb92f0c450 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:43.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.894+0000 7f3a63a55b80 1 --2- 172.21.15.82:0/1402863423 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cb92eed990 0x55cb92ee6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:43.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.894+0000 7f3a63a55b80 1 -- 172.21.15.82:0/1402863423 >> 172.21.15.82:0/1402863423 conn(0x55cb92e16b10 msgr2=0x55cb92eee6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:43.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.894+0000 7f3a33e00700 0 client.14769 ms_handle_reset on v2:172.21.15.134:6836/2212411710 2024-05-08T05:48:43.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.894+0000 7f3a63a55b80 1 -- 172.21.15.82:0/1402863423 shutdown_connections 2024-05-08T05:48:43.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.894+0000 7f3a63a55b80 1 -- 172.21.15.82:0/1402863423 wait complete. 2024-05-08T05:48:43.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.894+0000 7f3a63a55b80 20 client.14769 trim_cache size 0 max 16384 2024-05-08T05:48:43.898 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T05:48:43.899 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "c739a5c8-0cfc-11ef-bc97-c7b262605968", 2024-05-08T05:48:43.899 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 4, 2024-05-08T05:48:43.899 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 24467, 2024-05-08T05:48:43.899 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-05-08T05:48:43.899 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-05-08T05:48:43.899 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-05-08T05:48:43.899 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 146.93595939599999, 2024-05-08T05:48:43.899 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 28, 2024-05-08T05:48:43.899 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 82, 2024-05-08T05:48:43.899 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 80, 2024-05-08T05:48:43.899 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 204.092474243 2024-05-08T05:48:43.899 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T05:48:43.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.895+0000 7f3a53200700 1 -- 172.21.15.82:0/1003847233 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3a380b2900 msgr2=0x7f3a380b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:43.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.895+0000 7f3a53200700 1 --2- 172.21.15.82:0/1003847233 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3a380b2900 0x7f3a380b4dc0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c009ec0 tx=0x7f3a4c004b40 comp rx=0 tx=0).stop 2024-05-08T05:48:43.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.895+0000 7f3a53200700 1 -- 172.21.15.82:0/1003847233 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a54075840 msgr2=0x7f3a541a0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:43.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.895+0000 7f3a53200700 1 --2- 172.21.15.82:0/1003847233 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a54075840 0x7f3a541a0170 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3a4400eb30 tx=0x7f3a4400ee40 comp rx=0 tx=0).stop 2024-05-08T05:48:43.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.895+0000 7f3a53200700 1 -- 172.21.15.82:0/1003847233 shutdown_connections 2024-05-08T05:48:43.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.895+0000 7f3a53200700 1 --2- 172.21.15.82:0/1003847233 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a54075840 0x7f3a541a0170 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:43.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.895+0000 7f3a53200700 1 --2- 172.21.15.82:0/1003847233 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3a380b2900 0x7f3a380b4dc0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:43.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.895+0000 7f3a53200700 1 --2- 172.21.15.82:0/1003847233 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a541143e0 0x7f3a541a49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:43.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.895+0000 7f3a53200700 1 --2- 172.21.15.82:0/1003847233 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a54076160 0x7f3a541a06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:43.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.895+0000 7f3a53200700 1 -- 172.21.15.82:0/1003847233 >> 172.21.15.82:0/1003847233 conn(0x7f3a540fef20 msgr2=0x7f3a541007c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:43.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.895+0000 7f3a53200700 1 -- 172.21.15.82:0/1003847233 shutdown_connections 2024-05-08T05:48:43.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:43.895+0000 7f3a53200700 1 -- 172.21.15.82:0/1003847233 wait complete. 2024-05-08T05:48:43.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:48:43 smithi082 ceph-mon[30098]: pgmap v401: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:48:44.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:48:43 smithi151 ceph-mon[34815]: pgmap v401: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:48:44.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:48:43 smithi134 ceph-mon[34132]: pgmap v401: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:48:44.831 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.f status 2024-05-08T05:48:45.258 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:48:46.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:48:45 smithi151 ceph-mon[34815]: pgmap v402: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-08T05:48:46.182 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:48:45 smithi082 ceph-mon[30098]: pgmap v402: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-08T05:48:46.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:48:45 smithi134 ceph-mon[34132]: pgmap v402: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-08T05:48:47.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.485+0000 7fdb78000700 1 -- 172.21.15.82:0/2200487579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb7010fea0 msgr2=0x7fdb70112290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:47.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.485+0000 7fdb78000700 1 --2- 172.21.15.82:0/2200487579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb7010fea0 0x7fdb70112290 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fdb6800b0a0 tx=0x7fdb6800b3b0 comp rx=0 tx=0).stop 2024-05-08T05:48:47.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.485+0000 7fdb78000700 1 -- 172.21.15.82:0/2200487579 shutdown_connections 2024-05-08T05:48:47.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.485+0000 7fdb78000700 1 --2- 172.21.15.82:0/2200487579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb7010fea0 0x7fdb70112290 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:47.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.485+0000 7fdb78000700 1 --2- 172.21.15.82:0/2200487579 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb700756d0 0x7fdb70075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:47.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.485+0000 7fdb78000700 1 --2- 172.21.15.82:0/2200487579 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb70075ff0 0x7fdb7010f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:47.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.485+0000 7fdb78000700 1 -- 172.21.15.82:0/2200487579 >> 172.21.15.82:0/2200487579 conn(0x7fdb7007a600 msgr2=0x7fdb7007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:47.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.485+0000 7fdb78000700 1 -- 172.21.15.82:0/2200487579 shutdown_connections 2024-05-08T05:48:47.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.486+0000 7fdb78000700 1 -- 172.21.15.82:0/2200487579 wait complete. 2024-05-08T05:48:47.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.487+0000 7fdb78000700 1 Processor -- start 2024-05-08T05:48:47.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.487+0000 7fdb78000700 1 -- start start 2024-05-08T05:48:47.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.487+0000 7fdb78000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb700756d0 0x7fdb701a1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:47.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.487+0000 7fdb78000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb70075ff0 0x7fdb701a1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:47.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.487+0000 7fdb78000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb7010fea0 0x7fdb7019bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:47.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.487+0000 7fdb78000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdb70115830 con 0x7fdb700756d0 2024-05-08T05:48:47.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.487+0000 7fdb78000700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdb701156b0 con 0x7fdb70075ff0 2024-05-08T05:48:47.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.487+0000 7fdb78000700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fdb701159b0 con 0x7fdb7010fea0 2024-05-08T05:48:47.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.487+0000 7fdb75600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb700756d0 0x7fdb701a1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:47.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.488+0000 7fdb75600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb700756d0 0x7fdb701a1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60804/0 (socket says 172.21.15.82:60804) 2024-05-08T05:48:47.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.488+0000 7fdb75600700 1 -- 172.21.15.82:0/3923938778 learned_addr learned my addr 172.21.15.82:0/3923938778 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:48:47.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.488+0000 7fdb74c00700 1 --2- 172.21.15.82:0/3923938778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb70075ff0 0x7fdb701a1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:47.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.488+0000 7fdb76000700 1 --2- 172.21.15.82:0/3923938778 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb7010fea0 0x7fdb7019bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:47.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.488+0000 7fdb75600700 1 -- 172.21.15.82:0/3923938778 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb7010fea0 msgr2=0x7fdb7019bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:47.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.488+0000 7fdb75600700 1 --2- 172.21.15.82:0/3923938778 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb7010fea0 0x7fdb7019bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:47.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.488+0000 7fdb75600700 1 -- 172.21.15.82:0/3923938778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb70075ff0 msgr2=0x7fdb701a1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:47.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.488+0000 7fdb75600700 1 --2- 172.21.15.82:0/3923938778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb70075ff0 0x7fdb701a1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:47.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.488+0000 7fdb75600700 1 -- 172.21.15.82:0/3923938778 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb7019c270 con 0x7fdb700756d0 2024-05-08T05:48:47.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.488+0000 7fdb76000700 1 --2- 172.21.15.82:0/3923938778 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb7010fea0 0x7fdb7019bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:48:47.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.488+0000 7fdb75600700 1 --2- 172.21.15.82:0/3923938778 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb700756d0 0x7fdb701a1900 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdb6400d980 tx=0x7fdb6400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:47.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.489+0000 7fdb6e000700 1 -- 172.21.15.82:0/3923938778 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb64016070 con 0x7fdb700756d0 2024-05-08T05:48:47.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.489+0000 7fdb6e000700 1 -- 172.21.15.82:0/3923938778 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb64004830 con 0x7fdb700756d0 2024-05-08T05:48:47.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.489+0000 7fdb78000700 1 -- 172.21.15.82:0/3923938778 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb7019c560 con 0x7fdb700756d0 2024-05-08T05:48:47.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.489+0000 7fdb6e000700 1 -- 172.21.15.82:0/3923938778 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb640054c0 con 0x7fdb700756d0 2024-05-08T05:48:47.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.489+0000 7fdb78000700 1 -- 172.21.15.82:0/3923938778 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb701a87d0 con 0x7fdb700756d0 2024-05-08T05:48:47.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.492+0000 7fdb6e000700 1 -- 172.21.15.82:0/3923938778 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fdb64004220 con 0x7fdb700756d0 2024-05-08T05:48:47.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.494+0000 7fdb828fdb80 1 Processor -- start 2024-05-08T05:48:47.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.494+0000 7fdb828fdb80 1 -- start start 2024-05-08T05:48:47.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.494+0000 7fdb828fdb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a566d3010 0x556a566d33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:47.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.494+0000 7fdb828fdb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556a566d3930 0x556a566d7440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:47.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.494+0000 7fdb6e000700 1 --2- 172.21.15.82:0/3923938778 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fdb580b2880 0x7fdb580b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:47.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.494+0000 7fdb828fdb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a566d7980 0x556a566d7de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:47.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.494+0000 7fdb828fdb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556a566259d0 con 0x556a566d7980 2024-05-08T05:48:47.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.494+0000 7fdb828fdb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x556a565c3710 con 0x556a566d3010 2024-05-08T05:48:47.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.494+0000 7fdb828fdb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x556a56621990 con 0x556a566d3930 2024-05-08T05:48:47.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.494+0000 7fdb76000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a566d3010 0x556a566d33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:47.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.494+0000 7fdb6e000700 1 -- 172.21.15.82:0/3923938778 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fdb640e2130 con 0x7fdb700756d0 2024-05-08T05:48:47.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.494+0000 7fdb76000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a566d7980 0x556a566d7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:47.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.494+0000 7fdb74c00700 1 --2- 172.21.15.82:0/3923938778 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fdb580b2880 0x7fdb580b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:47.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.495+0000 7fdb75600700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556a566d3930 0x556a566d7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:47.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.495+0000 7fdb76000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a566d7980 0x556a566d7de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60810/0 (socket says 172.21.15.82:60810) 2024-05-08T05:48:47.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.495+0000 7fdb76000700 1 -- 172.21.15.82:0/3775427923 learned_addr learned my addr 172.21.15.82:0/3775427923 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:48:47.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.495+0000 7fdb76000700 1 -- 172.21.15.82:0/3775427923 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556a566d3930 msgr2=0x556a566d7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:48:47.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.495+0000 7fdb76000700 1 --2- 172.21.15.82:0/3775427923 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556a566d3930 0x556a566d7440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:47.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.495+0000 7fdb76000700 1 -- 172.21.15.82:0/3775427923 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a566d3010 msgr2=0x556a566d33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:48:47.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.495+0000 7fdb76000700 1 --2- 172.21.15.82:0/3775427923 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a566d3010 0x556a566d33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:47.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.495+0000 7fdb76000700 1 -- 172.21.15.82:0/3775427923 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a56572880 con 0x556a566d7980 2024-05-08T05:48:47.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.495+0000 7fdb76000700 1 --2- 172.21.15.82:0/3775427923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a566d7980 0x556a566d7de0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdb68009e60 tx=0x7fdb6800b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b30c1a3d72efd320 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:47.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.495+0000 7fdb74c00700 1 --2- 172.21.15.82:0/3923938778 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fdb580b2880 0x7fdb580b4d40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdb70111bc0 tx=0x7fdb5c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:47.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.496+0000 7fdb62a00700 1 -- 172.21.15.82:0/3775427923 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb68003c00 con 0x556a566d7980 2024-05-08T05:48:47.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.496+0000 7fdb62a00700 1 -- 172.21.15.82:0/3775427923 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb68003da0 con 0x556a566d7980 2024-05-08T05:48:47.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.496+0000 7fdb62a00700 1 -- 172.21.15.82:0/3775427923 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb6801d6b0 con 0x556a566d7980 2024-05-08T05:48:47.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.496+0000 7fdb828fdb80 1 -- 172.21.15.82:0/3775427923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a566d7980 msgr2=0x556a566d7de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:47.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.496+0000 7fdb828fdb80 1 --2- 172.21.15.82:0/3775427923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a566d7980 0x556a566d7de0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fdb68009e60 tx=0x7fdb6800b3b0 comp rx=0 tx=0).stop 2024-05-08T05:48:47.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.497+0000 7fdb828fdb80 1 -- 172.21.15.82:0/3775427923 shutdown_connections 2024-05-08T05:48:47.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.497+0000 7fdb828fdb80 1 --2- 172.21.15.82:0/3775427923 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a566d3010 0x556a566d33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:47.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.497+0000 7fdb828fdb80 1 --2- 172.21.15.82:0/3775427923 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a566d7980 0x556a566d7de0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:47.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.497+0000 7fdb828fdb80 1 --2- 172.21.15.82:0/3775427923 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556a566d3930 0x556a566d7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:47.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.497+0000 7fdb828fdb80 1 -- 172.21.15.82:0/3775427923 >> 172.21.15.82:0/3775427923 conn(0x556a56601b10 msgr2=0x556a566cd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:47.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.497+0000 7fdb828fdb80 1 -- 172.21.15.82:0/3775427923 shutdown_connections 2024-05-08T05:48:47.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.497+0000 7fdb828fdb80 1 -- 172.21.15.82:0/3775427923 wait complete. 2024-05-08T05:48:47.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.497+0000 7fdb828fdb80 1 -- start start 2024-05-08T05:48:47.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.498+0000 7fdb828fdb80 1 Processor -- start 2024-05-08T05:48:47.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.498+0000 7fdb828fdb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a566d3010 0x556a566dee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:47.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.498+0000 7fdb828fdb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a566d3930 0x556a566dc220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:47.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.498+0000 7fdb828fdb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556a566d7980 0x556a566dc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:47.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.498+0000 7fdb828fdb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556a566dfb30 con 0x556a566d3930 2024-05-08T05:48:47.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.498+0000 7fdb828fdb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x556a5658bad0 con 0x556a566d3010 2024-05-08T05:48:47.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.498+0000 7fdb828fdb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x556a566dfcb0 con 0x556a566d7980 2024-05-08T05:48:47.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.498+0000 7fdb828fdb80 10 client.0 _ll_register_callbacks cb 0x556a565ccc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:48:47.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.498+0000 7fdb75600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a566d3010 0x556a566dee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:47.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.498+0000 7fdb75600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a566d3010 0x556a566dee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:57516/0 (socket says 172.21.15.82:57516) 2024-05-08T05:48:47.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.498+0000 7fdb75600700 1 -- 172.21.15.82:0/1966502603 learned_addr learned my addr 172.21.15.82:0/1966502603 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:48:47.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.498+0000 7fdb74c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a566d3930 0x556a566dc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:47.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.498+0000 7fdb76000700 1 --2- 172.21.15.82:0/1966502603 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556a566d7980 0x556a566dc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:47.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.499+0000 7fdb75600700 1 -- 172.21.15.82:0/1966502603 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556a566d7980 msgr2=0x556a566dc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:48:47.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.499+0000 7fdb75600700 1 --2- 172.21.15.82:0/1966502603 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556a566d7980 0x556a566dc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:47.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.499+0000 7fdb75600700 1 -- 172.21.15.82:0/1966502603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a566d3930 msgr2=0x556a566dc220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:48:47.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.499+0000 7fdb75600700 1 --2- 172.21.15.82:0/1966502603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a566d3930 0x556a566dc220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:47.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.499+0000 7fdb75600700 1 -- 172.21.15.82:0/1966502603 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a565eb3d0 con 0x556a566d3010 2024-05-08T05:48:47.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.499+0000 7fdb75600700 1 --2- 172.21.15.82:0/1966502603 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a566d3010 0x556a566dee80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdb640dfbe0 tx=0x7fdb640cc0d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8d757371fe36756 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:47.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.499+0000 7fdb57400700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:48:47.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.499+0000 7fdb57400700 1 -- 172.21.15.82:0/1966502603 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb640c3060 con 0x556a566d3010 2024-05-08T05:48:47.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.499+0000 7fdb57400700 1 -- 172.21.15.82:0/1966502603 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fdb640a8040 con 0x556a566d3010 2024-05-08T05:48:47.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.499+0000 7fdb828fdb80 1 -- 172.21.15.82:0/1966502603 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb68003da0 con 0x556a566d3010 2024-05-08T05:48:47.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.499+0000 7fdb57400700 1 -- 172.21.15.82:0/1966502603 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fdb640a9e00 con 0x556a566d3010 2024-05-08T05:48:47.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.499+0000 7fdb828fdb80 10 client.24872 fetch_fsmap learned FSMap version 28 2024-05-08T05:48:47.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.499+0000 7fdb828fdb80 1 -- 172.21.15.82:0/1966502603 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556a566ea410 con 0x556a566d3010 2024-05-08T05:48:47.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.500+0000 7fdb57400700 1 -- 172.21.15.82:0/1966502603 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb68003da0 con 0x556a566d3010 2024-05-08T05:48:47.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.500+0000 7fdb57400700 1 -- 172.21.15.82:0/1966502603 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fdb640a7ad0 con 0x556a566d3010 2024-05-08T05:48:47.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.500+0000 7fdb828fdb80 10 client.24872 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T05:48:47.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.500+0000 7fdb828fdb80 10 client.24872 resolve_mds: resolved name 'f' to daemon mds.f 2024-05-08T05:48:47.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.500+0000 7fdb828fdb80 20 client.24872 populate_metadata read hostname 'smithi082' 2024-05-08T05:48:47.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.500+0000 7fdb828fdb80 1 --2- 172.21.15.82:0/1966502603 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x556a566eca40 0x556a566edeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:47.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.500+0000 7fdb828fdb80 4 client.24872 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:48:47.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.500+0000 7fdb828fdb80 1 -- 172.21.15.82:0/1966502603 --> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556a566a0050 con 0x556a566eca40 2024-05-08T05:48:47.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.501+0000 7fdb74c00700 1 --2- 172.21.15.82:0/1966502603 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x556a566eca40 0x556a566edeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:47.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.501+0000 7fdb74c00700 1 --2- 172.21.15.82:0/1966502603 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x556a566eca40 0x556a566edeb0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=dac38574c9d2e3b5 server_cookie=16987e9d90df8adb in_seq=0 out_seq=0 2024-05-08T05:48:47.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.501+0000 7fdb57400700 10 client.24872 ms_handle_connect on v2:172.21.15.151:6834/2093655929 2024-05-08T05:48:47.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.502+0000 7fdb57400700 1 -- 172.21.15.82:0/1966502603 <== mds.3 v2:172.21.15.151:6834/2093655929 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x556a566a0050 con 0x556a566eca40 2024-05-08T05:48:47.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.502+0000 7fdb57400700 10 client.24872 handle_command_reply: tid=0 2024-05-08T05:48:47.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.502+0000 7fdb828fdb80 1 client.24872 shutdown 2024-05-08T05:48:47.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.502+0000 7fdb828fdb80 1 -- 172.21.15.82:0/1966502603 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a566d3010 msgr2=0x556a566dee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:47.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.502+0000 7fdb828fdb80 1 --2- 172.21.15.82:0/1966502603 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a566d3010 0x556a566dee80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdb640dfbe0 tx=0x7fdb640cc0d0 comp rx=0 tx=0).stop 2024-05-08T05:48:47.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.502+0000 7fdb828fdb80 1 -- 172.21.15.82:0/1966502603 shutdown_connections 2024-05-08T05:48:47.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.502+0000 7fdb828fdb80 1 --2- 172.21.15.82:0/1966502603 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x556a566eca40 0x556a566edeb0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:47.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.502+0000 7fdb828fdb80 1 --2- 172.21.15.82:0/1966502603 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a566d3010 0x556a566dee80 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:47.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.502+0000 7fdb828fdb80 1 --2- 172.21.15.82:0/1966502603 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556a566d7980 0x556a566dc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:47.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.502+0000 7fdb57400700 0 client.24872 ms_handle_reset on v2:172.21.15.151:6834/2093655929 2024-05-08T05:48:47.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.502+0000 7fdb828fdb80 1 --2- 172.21.15.82:0/1966502603 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a566d3930 0x556a566dc220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:47.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.502+0000 7fdb828fdb80 1 -- 172.21.15.82:0/1966502603 >> 172.21.15.82:0/1966502603 conn(0x556a56601b10 msgr2=0x556a566c8260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:47.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.503+0000 7fdb828fdb80 1 -- 172.21.15.82:0/1966502603 shutdown_connections 2024-05-08T05:48:47.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.503+0000 7fdb828fdb80 1 -- 172.21.15.82:0/1966502603 wait complete. 2024-05-08T05:48:47.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.503+0000 7fdb828fdb80 20 client.24872 trim_cache size 0 max 16384 2024-05-08T05:48:47.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.525+0000 7fdb828fdb80 1 Processor -- start 2024-05-08T05:48:47.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.525+0000 7fdb828fdb80 1 -- start start 2024-05-08T05:48:47.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.526+0000 7fdb828fdb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a56601b10 0x556a566d9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:47.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.526+0000 7fdb828fdb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556a566d3010 0x556a566c79d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:47.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.526+0000 7fdb828fdb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a566d3930 0x556a566c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:47.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.526+0000 7fdb828fdb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556a566ec1f0 con 0x556a56601b10 2024-05-08T05:48:47.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.526+0000 7fdb828fdb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x556a566ec8c0 con 0x556a566d3930 2024-05-08T05:48:47.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.526+0000 7fdb828fdb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x556a566ecf90 con 0x556a566d3010 2024-05-08T05:48:47.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.526+0000 7fdb75600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a56601b10 0x556a566d9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:47.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.526+0000 7fdb75600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a56601b10 0x556a566d9ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60824/0 (socket says 172.21.15.82:60824) 2024-05-08T05:48:47.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.526+0000 7fdb75600700 1 -- 172.21.15.82:0/3014110519 learned_addr learned my addr 172.21.15.82:0/3014110519 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:48:47.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.526+0000 7fdb74c00700 1 --2- 172.21.15.82:0/3014110519 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556a566d3010 0x556a566c79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:47.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.526+0000 7fdb76000700 1 --2- 172.21.15.82:0/3014110519 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a566d3930 0x556a566c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:47.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.527+0000 7fdb75600700 1 -- 172.21.15.82:0/3014110519 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556a566d3010 msgr2=0x556a566c79d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:48:47.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.527+0000 7fdb75600700 1 --2- 172.21.15.82:0/3014110519 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556a566d3010 0x556a566c79d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:47.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.527+0000 7fdb75600700 1 -- 172.21.15.82:0/3014110519 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a566d3930 msgr2=0x556a566c7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:48:47.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.527+0000 7fdb75600700 1 --2- 172.21.15.82:0/3014110519 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a566d3930 0x556a566c7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:47.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.527+0000 7fdb75600700 1 -- 172.21.15.82:0/3014110519 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a566ce970 con 0x556a56601b10 2024-05-08T05:48:47.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.527+0000 7fdb76000700 1 --2- 172.21.15.82:0/3014110519 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a566d3930 0x556a566c7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:48:47.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.527+0000 7fdb75600700 1 --2- 172.21.15.82:0/3014110519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a56601b10 0x556a566d9ea0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdb6406f300 tx=0x7fdb64007640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe62d2911a5529a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:47.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.527+0000 7fdb62000700 1 -- 172.21.15.82:0/3014110519 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb640c3070 con 0x556a56601b10 2024-05-08T05:48:47.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.527+0000 7fdb62000700 1 -- 172.21.15.82:0/3014110519 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb640a9700 con 0x556a56601b10 2024-05-08T05:48:47.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.527+0000 7fdb62000700 1 -- 172.21.15.82:0/3014110519 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb6406a030 con 0x556a56601b10 2024-05-08T05:48:47.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.528+0000 7fdb828fdb80 1 -- 172.21.15.82:0/3014110519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a56601b10 msgr2=0x556a566d9ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:47.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.528+0000 7fdb828fdb80 1 --2- 172.21.15.82:0/3014110519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a56601b10 0x556a566d9ea0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fdb6406f300 tx=0x7fdb64007640 comp rx=0 tx=0).stop 2024-05-08T05:48:47.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.528+0000 7fdb828fdb80 1 -- 172.21.15.82:0/3014110519 shutdown_connections 2024-05-08T05:48:47.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.528+0000 7fdb828fdb80 1 --2- 172.21.15.82:0/3014110519 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a566d3930 0x556a566c7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:47.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.528+0000 7fdb828fdb80 1 --2- 172.21.15.82:0/3014110519 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a56601b10 0x556a566d9ea0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:47.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.528+0000 7fdb828fdb80 1 --2- 172.21.15.82:0/3014110519 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556a566d3010 0x556a566c79d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:47.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.528+0000 7fdb828fdb80 1 -- 172.21.15.82:0/3014110519 >> 172.21.15.82:0/3014110519 conn(0x556a566c75c0 msgr2=0x556a566dab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:47.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.528+0000 7fdb828fdb80 1 -- 172.21.15.82:0/3014110519 shutdown_connections 2024-05-08T05:48:47.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.528+0000 7fdb828fdb80 1 -- 172.21.15.82:0/3014110519 wait complete. 2024-05-08T05:48:47.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.528+0000 7fdb828fdb80 1 -- start start 2024-05-08T05:48:47.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.529+0000 7fdb828fdb80 1 Processor -- start 2024-05-08T05:48:47.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.529+0000 7fdb828fdb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a56601b10 0x556a566f04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:47.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.529+0000 7fdb828fdb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a566d3010 0x556a566f09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:47.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.529+0000 7fdb828fdb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556a566d3930 0x556a566f5400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:47.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.529+0000 7fdb828fdb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556a566edd30 con 0x556a566d3010 2024-05-08T05:48:47.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.529+0000 7fdb828fdb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x556a566ed660 con 0x556a56601b10 2024-05-08T05:48:47.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.529+0000 7fdb828fdb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x556a566ee400 con 0x556a566d3930 2024-05-08T05:48:47.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.529+0000 7fdb828fdb80 10 client.0 _ll_register_callbacks cb 0x556a565ccc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:48:47.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.529+0000 7fdb75600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a56601b10 0x556a566f04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:47.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.529+0000 7fdb74c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a566d3010 0x556a566f09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:47.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.529+0000 7fdb75600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a56601b10 0x556a566f04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:57534/0 (socket says 172.21.15.82:57534) 2024-05-08T05:48:47.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.529+0000 7fdb75600700 1 -- 172.21.15.82:0/1183685611 learned_addr learned my addr 172.21.15.82:0/1183685611 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:48:47.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.529+0000 7fdb76000700 1 --2- 172.21.15.82:0/1183685611 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556a566d3930 0x556a566f5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:47.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.530+0000 7fdb75600700 1 -- 172.21.15.82:0/1183685611 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556a566d3930 msgr2=0x556a566f5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:48:47.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.530+0000 7fdb75600700 1 --2- 172.21.15.82:0/1183685611 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556a566d3930 0x556a566f5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:47.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.530+0000 7fdb75600700 1 -- 172.21.15.82:0/1183685611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a566d3010 msgr2=0x556a566f09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:48:47.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.530+0000 7fdb75600700 1 --2- 172.21.15.82:0/1183685611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a566d3010 0x556a566f09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:47.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.530+0000 7fdb75600700 1 -- 172.21.15.82:0/1183685611 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a566f5a40 con 0x556a56601b10 2024-05-08T05:48:47.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.530+0000 7fdb75600700 1 --2- 172.21.15.82:0/1183685611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a56601b10 0x556a566f04b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdb64012040 tx=0x7fdb640a8280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e738d6f1ec6fb744 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:47.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.530+0000 7fdb57400700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:48:47.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.530+0000 7fdb57400700 1 -- 172.21.15.82:0/1183685611 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb6406a030 con 0x556a56601b10 2024-05-08T05:48:47.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.530+0000 7fdb828fdb80 1 -- 172.21.15.82:0/1183685611 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb640a9700 con 0x556a56601b10 2024-05-08T05:48:47.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.530+0000 7fdb57400700 1 -- 172.21.15.82:0/1183685611 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fdb640a5cf0 con 0x556a56601b10 2024-05-08T05:48:47.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.531+0000 7fdb57400700 1 -- 172.21.15.82:0/1183685611 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fdb640c3070 con 0x556a56601b10 2024-05-08T05:48:47.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.531+0000 7fdb828fdb80 10 client.24878 fetch_fsmap learned FSMap version 28 2024-05-08T05:48:47.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.531+0000 7fdb828fdb80 1 -- 172.21.15.82:0/1183685611 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556a566f5a40 con 0x556a56601b10 2024-05-08T05:48:47.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.531+0000 7fdb57400700 1 -- 172.21.15.82:0/1183685611 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb640a9700 con 0x556a56601b10 2024-05-08T05:48:47.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.531+0000 7fdb57400700 1 -- 172.21.15.82:0/1183685611 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fdb640a8960 con 0x556a56601b10 2024-05-08T05:48:47.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.531+0000 7fdb828fdb80 10 client.24878 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T05:48:47.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.531+0000 7fdb828fdb80 10 client.24878 resolve_mds: resolved name 'f' to daemon mds.f 2024-05-08T05:48:47.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.531+0000 7fdb828fdb80 20 client.24878 populate_metadata read hostname 'smithi082' 2024-05-08T05:48:47.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.531+0000 7fdb828fdb80 1 --2- 172.21.15.82:0/1183685611 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x556a566d7980 0x556a567647f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:47.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.531+0000 7fdb828fdb80 4 client.24878 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T05:48:47.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.531+0000 7fdb828fdb80 1 -- 172.21.15.82:0/1183685611 --> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] -- command(tid 0: {"prefix": "status"}) -- 0x556a566333b0 con 0x556a566d7980 2024-05-08T05:48:47.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.532+0000 7fdb74c00700 1 --2- 172.21.15.82:0/1183685611 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x556a566d7980 0x556a567647f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:47.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.532+0000 7fdb74c00700 1 --2- 172.21.15.82:0/1183685611 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x556a566d7980 0x556a567647f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=aa16528d96b5010f server_cookie=705a4769aca55c7c in_seq=0 out_seq=0 2024-05-08T05:48:47.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.532+0000 7fdb57400700 10 client.24878 ms_handle_connect on v2:172.21.15.151:6834/2093655929 2024-05-08T05:48:47.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.532+0000 7fdb57400700 1 -- 172.21.15.82:0/1183685611 <== mds.3 v2:172.21.15.151:6834/2093655929 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x556a566333b0 con 0x556a566d7980 2024-05-08T05:48:47.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.532+0000 7fdb57400700 10 client.24878 handle_command_reply: tid=0 2024-05-08T05:48:47.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.532+0000 7fdb828fdb80 1 client.24878 shutdown 2024-05-08T05:48:47.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.533+0000 7fdb828fdb80 1 -- 172.21.15.82:0/1183685611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a56601b10 msgr2=0x556a566f04b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:47.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.533+0000 7fdb828fdb80 1 --2- 172.21.15.82:0/1183685611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a56601b10 0x556a566f04b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdb64012040 tx=0x7fdb640a8280 comp rx=0 tx=0).stop 2024-05-08T05:48:47.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.533+0000 7fdb828fdb80 1 -- 172.21.15.82:0/1183685611 shutdown_connections 2024-05-08T05:48:47.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.533+0000 7fdb828fdb80 1 --2- 172.21.15.82:0/1183685611 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x556a566d7980 0x556a567647f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:47.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.533+0000 7fdb828fdb80 1 --2- 172.21.15.82:0/1183685611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a56601b10 0x556a566f04b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:47.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.533+0000 7fdb828fdb80 1 --2- 172.21.15.82:0/1183685611 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556a566d3930 0x556a566f5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:47.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.533+0000 7fdb57400700 0 client.24878 ms_handle_reset on v2:172.21.15.151:6834/2093655929 2024-05-08T05:48:47.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.533+0000 7fdb828fdb80 1 --2- 172.21.15.82:0/1183685611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556a566d3010 0x556a566f09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:47.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.533+0000 7fdb828fdb80 1 -- 172.21.15.82:0/1183685611 >> 172.21.15.82:0/1183685611 conn(0x556a566c75c0 msgr2=0x556a566c8260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:47.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.533+0000 7fdb828fdb80 1 -- 172.21.15.82:0/1183685611 shutdown_connections 2024-05-08T05:48:47.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.533+0000 7fdb828fdb80 1 -- 172.21.15.82:0/1183685611 wait complete. 2024-05-08T05:48:47.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.533+0000 7fdb828fdb80 20 client.24878 trim_cache size 0 max 16384 2024-05-08T05:48:47.537 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T05:48:47.537 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "c739a5c8-0cfc-11ef-bc97-c7b262605968", 2024-05-08T05:48:47.537 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 3, 2024-05-08T05:48:47.537 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 24475, 2024-05-08T05:48:47.537 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-05-08T05:48:47.537 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-05-08T05:48:47.537 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-05-08T05:48:47.537 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 151.59550235399999, 2024-05-08T05:48:47.537 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 28, 2024-05-08T05:48:47.537 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 82, 2024-05-08T05:48:47.537 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 80, 2024-05-08T05:48:47.538 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 213.48521747199999 2024-05-08T05:48:47.538 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T05:48:47.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.534+0000 7fdb78000700 1 -- 172.21.15.82:0/3923938778 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fdb580b2880 msgr2=0x7fdb580b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:47.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.534+0000 7fdb78000700 1 --2- 172.21.15.82:0/3923938778 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fdb580b2880 0x7fdb580b4d40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdb70111bc0 tx=0x7fdb5c009260 comp rx=0 tx=0).stop 2024-05-08T05:48:47.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.534+0000 7fdb78000700 1 -- 172.21.15.82:0/3923938778 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb700756d0 msgr2=0x7fdb701a1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:47.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.534+0000 7fdb78000700 1 --2- 172.21.15.82:0/3923938778 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb700756d0 0x7fdb701a1900 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fdb6400d980 tx=0x7fdb6400dc90 comp rx=0 tx=0).stop 2024-05-08T05:48:47.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.534+0000 7fdb78000700 1 -- 172.21.15.82:0/3923938778 shutdown_connections 2024-05-08T05:48:47.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.534+0000 7fdb78000700 1 --2- 172.21.15.82:0/3923938778 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fdb580b2880 0x7fdb580b4d40 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:47.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.534+0000 7fdb78000700 1 --2- 172.21.15.82:0/3923938778 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb7010fea0 0x7fdb7019bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:47.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.534+0000 7fdb78000700 1 --2- 172.21.15.82:0/3923938778 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb700756d0 0x7fdb701a1900 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:47.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.534+0000 7fdb78000700 1 --2- 172.21.15.82:0/3923938778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb70075ff0 0x7fdb701a1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:47.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.534+0000 7fdb78000700 1 -- 172.21.15.82:0/3923938778 >> 172.21.15.82:0/3923938778 conn(0x7fdb7007a600 msgr2=0x7fdb701006b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:47.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.534+0000 7fdb78000700 1 -- 172.21.15.82:0/3923938778 shutdown_connections 2024-05-08T05:48:47.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:47.534+0000 7fdb78000700 1 -- 172.21.15.82:0/3923938778 wait complete. 2024-05-08T05:48:48.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:48:47 smithi151 ceph-mon[34815]: pgmap v403: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-08T05:48:48.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:48:47 smithi082 ceph-mon[30098]: pgmap v403: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-08T05:48:48.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:48:47 smithi134 ceph-mon[34132]: pgmap v403: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-08T05:48:48.470 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.c status 2024-05-08T05:48:48.914 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:48:50.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:48:49 smithi151 ceph-mon[34815]: pgmap v404: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:48:50.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:48:49 smithi082 ceph-mon[30098]: pgmap v404: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:48:50.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:48:49 smithi134 ceph-mon[34132]: pgmap v404: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:48:51.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.280+0000 7fbac3e00700 1 -- 172.21.15.82:0/2354518006 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbabc10b6c0 msgr2=0x7fbabc10baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:51.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.280+0000 7fbac3e00700 1 --2- 172.21.15.82:0/2354518006 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbabc10b6c0 0x7fbabc10baa0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbab0009990 tx=0x7fbab0009ca0 comp rx=0 tx=0).stop 2024-05-08T05:48:51.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.281+0000 7fbac3e00700 1 -- 172.21.15.82:0/2354518006 shutdown_connections 2024-05-08T05:48:51.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.281+0000 7fbac3e00700 1 --2- 172.21.15.82:0/2354518006 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbabc10b6c0 0x7fbabc10baa0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:51.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.281+0000 7fbac3e00700 1 --2- 172.21.15.82:0/2354518006 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbabc106080 0x7fbabc112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:51.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.281+0000 7fbac3e00700 1 --2- 172.21.15.82:0/2354518006 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbabc1056c0 0x7fbabc105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:51.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.281+0000 7fbac3e00700 1 -- 172.21.15.82:0/2354518006 >> 172.21.15.82:0/2354518006 conn(0x7fbabc1011b0 msgr2=0x7fbabc1035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:51.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.281+0000 7fbac3e00700 1 -- 172.21.15.82:0/2354518006 shutdown_connections 2024-05-08T05:48:51.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.281+0000 7fbac3e00700 1 -- 172.21.15.82:0/2354518006 wait complete. 2024-05-08T05:48:51.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.282+0000 7fbac3e00700 1 Processor -- start 2024-05-08T05:48:51.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.282+0000 7fbac3e00700 1 -- start start 2024-05-08T05:48:51.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.282+0000 7fbac3e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbabc1056c0 0x7fbabc19bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:51.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.282+0000 7fbac3e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbabc106080 0x7fbabc19c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:51.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.282+0000 7fbac3e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbabc10b6c0 0x7fbabc1a0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:51.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.282+0000 7fbac3e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbabc115900 con 0x7fbabc1056c0 2024-05-08T05:48:51.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.282+0000 7fbac3e00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbabc115780 con 0x7fbabc10b6c0 2024-05-08T05:48:51.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.282+0000 7fbac3e00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fbabc115a80 con 0x7fbabc106080 2024-05-08T05:48:51.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.283+0000 7fbac1400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbabc1056c0 0x7fbabc19bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:51.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.283+0000 7fbac1400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbabc1056c0 0x7fbabc19bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60856/0 (socket says 172.21.15.82:60856) 2024-05-08T05:48:51.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.283+0000 7fbac1400700 1 -- 172.21.15.82:0/485285428 learned_addr learned my addr 172.21.15.82:0/485285428 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:48:51.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.283+0000 7fbac0a00700 1 --2- 172.21.15.82:0/485285428 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbabc106080 0x7fbabc19c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:51.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.283+0000 7fbac1e00700 1 --2- 172.21.15.82:0/485285428 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbabc10b6c0 0x7fbabc1a0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:51.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.283+0000 7fbac1400700 1 -- 172.21.15.82:0/485285428 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbabc106080 msgr2=0x7fbabc19c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:51.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.283+0000 7fbac1400700 1 --2- 172.21.15.82:0/485285428 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbabc106080 0x7fbabc19c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:51.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.283+0000 7fbac1400700 1 -- 172.21.15.82:0/485285428 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbabc10b6c0 msgr2=0x7fbabc1a0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:51.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.283+0000 7fbac1400700 1 --2- 172.21.15.82:0/485285428 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbabc10b6c0 0x7fbabc1a0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:51.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.283+0000 7fbac1400700 1 -- 172.21.15.82:0/485285428 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbabc1a0d80 con 0x7fbabc1056c0 2024-05-08T05:48:51.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.284+0000 7fbac1400700 1 --2- 172.21.15.82:0/485285428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbabc1056c0 0x7fbabc19bd70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbab0005910 tx=0x7fbab000b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:51.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.284+0000 7fbaba000700 1 -- 172.21.15.82:0/485285428 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab0027070 con 0x7fbabc1056c0 2024-05-08T05:48:51.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.284+0000 7fbac3e00700 1 -- 172.21.15.82:0/485285428 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbabc1a1010 con 0x7fbabc1056c0 2024-05-08T05:48:51.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.284+0000 7fbac3e00700 1 -- 172.21.15.82:0/485285428 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbabc1a88f0 con 0x7fbabc1056c0 2024-05-08T05:48:51.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.284+0000 7fbaba000700 1 -- 172.21.15.82:0/485285428 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbab002b3b0 con 0x7fbabc1056c0 2024-05-08T05:48:51.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.284+0000 7fbaba000700 1 -- 172.21.15.82:0/485285428 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab000e640 con 0x7fbabc1056c0 2024-05-08T05:48:51.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.287+0000 7fbaba000700 1 -- 172.21.15.82:0/485285428 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fbab002a070 con 0x7fbabc1056c0 2024-05-08T05:48:51.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.289+0000 7fbace6a4b80 1 Processor -- start 2024-05-08T05:48:51.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.289+0000 7fbace6a4b80 1 -- start start 2024-05-08T05:48:51.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.289+0000 7fbaba000700 1 --2- 172.21.15.82:0/485285428 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fbaa40b2900 0x7fbaa40b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:51.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.289+0000 7fbaba000700 1 -- 172.21.15.82:0/485285428 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fbab00e2f20 con 0x7fbabc1056c0 2024-05-08T05:48:51.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.289+0000 7fbace6a4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1d9b08010 0x55c1d9b083f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:51.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.289+0000 7fbac1e00700 1 --2- 172.21.15.82:0/485285428 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fbaa40b2900 0x7fbaa40b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:51.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.289+0000 7fbace6a4b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1d9b08930 0x55c1d9b0c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:51.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.289+0000 7fbace6a4b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1d9b0c980 0x55c1d9b0cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:51.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.289+0000 7fbace6a4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c1d9a5a9d0 con 0x55c1d9b08010 2024-05-08T05:48:51.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.289+0000 7fbace6a4b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55c1d99f8710 con 0x55c1d9b08930 2024-05-08T05:48:51.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.289+0000 7fbace6a4b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55c1d9a56990 con 0x55c1d9b0c980 2024-05-08T05:48:51.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.290+0000 7fbac1400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1d9b08010 0x55c1d9b083f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:51.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.290+0000 7fbac1400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1d9b08010 0x55c1d9b083f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60864/0 (socket says 172.21.15.82:60864) 2024-05-08T05:48:51.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.290+0000 7fbac1400700 1 -- 172.21.15.82:0/70690904 learned_addr learned my addr 172.21.15.82:0/70690904 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:48:51.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.290+0000 7fbac0a00700 1 --2- 172.21.15.82:0/70690904 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1d9b08930 0x55c1d9b0c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:51.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.290+0000 7fbac1e00700 1 --2- 172.21.15.82:0/70690904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1d9b0c980 0x55c1d9b0cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:51.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.290+0000 7fbac1e00700 1 --2- 172.21.15.82:0/485285428 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fbaa40b2900 0x7fbaa40b4dc0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fbab40093c0 tx=0x7fbab4009920 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:51.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.290+0000 7fbac1400700 1 -- 172.21.15.82:0/70690904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1d9b0c980 msgr2=0x55c1d9b0cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:48:51.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.290+0000 7fbac1400700 1 --2- 172.21.15.82:0/70690904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1d9b0c980 0x55c1d9b0cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:51.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.290+0000 7fbac1400700 1 -- 172.21.15.82:0/70690904 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1d9b08930 msgr2=0x55c1d9b0c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:48:51.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.290+0000 7fbac1400700 1 --2- 172.21.15.82:0/70690904 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1d9b08930 0x55c1d9b0c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:51.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.290+0000 7fbac1400700 1 -- 172.21.15.82:0/70690904 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1d99a7880 con 0x55c1d9b08010 2024-05-08T05:48:51.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.290+0000 7fbac0a00700 1 --2- 172.21.15.82:0/70690904 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1d9b08930 0x55c1d9b0c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:48:51.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.291+0000 7fbac1400700 1 --2- 172.21.15.82:0/70690904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1d9b08010 0x55c1d9b083f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbab00a65e0 tx=0x7fbab00a9fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b5736bc8838a5af server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:51.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.291+0000 7fbaaea00700 1 -- 172.21.15.82:0/70690904 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab00aa070 con 0x55c1d9b08010 2024-05-08T05:48:51.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.291+0000 7fbaaea00700 1 -- 172.21.15.82:0/70690904 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbab00aac60 con 0x55c1d9b08010 2024-05-08T05:48:51.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.291+0000 7fbaaea00700 1 -- 172.21.15.82:0/70690904 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab00a5ed0 con 0x55c1d9b08010 2024-05-08T05:48:51.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.292+0000 7fbace6a4b80 1 -- 172.21.15.82:0/70690904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1d9b08010 msgr2=0x55c1d9b083f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:51.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.292+0000 7fbace6a4b80 1 --2- 172.21.15.82:0/70690904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1d9b08010 0x55c1d9b083f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbab00a65e0 tx=0x7fbab00a9fb0 comp rx=0 tx=0).stop 2024-05-08T05:48:51.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.292+0000 7fbace6a4b80 1 -- 172.21.15.82:0/70690904 shutdown_connections 2024-05-08T05:48:51.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.292+0000 7fbace6a4b80 1 --2- 172.21.15.82:0/70690904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1d9b0c980 0x55c1d9b0cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:51.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.292+0000 7fbace6a4b80 1 --2- 172.21.15.82:0/70690904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1d9b08010 0x55c1d9b083f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:51.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.292+0000 7fbace6a4b80 1 --2- 172.21.15.82:0/70690904 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1d9b08930 0x55c1d9b0c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:51.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.292+0000 7fbace6a4b80 1 -- 172.21.15.82:0/70690904 >> 172.21.15.82:0/70690904 conn(0x55c1d9a36b10 msgr2=0x55c1d9b02750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:51.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.292+0000 7fbace6a4b80 1 -- 172.21.15.82:0/70690904 shutdown_connections 2024-05-08T05:48:51.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.292+0000 7fbace6a4b80 1 -- 172.21.15.82:0/70690904 wait complete. 2024-05-08T05:48:51.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.292+0000 7fbace6a4b80 1 -- start start 2024-05-08T05:48:51.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.293+0000 7fbace6a4b80 1 Processor -- start 2024-05-08T05:48:51.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.293+0000 7fbace6a4b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1d9b08010 0x55c1d9b13de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:51.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.293+0000 7fbace6a4b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1d9b08930 0x55c1d9b11180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:51.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.293+0000 7fbace6a4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1d9b0c980 0x55c1d9b116c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:51.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.293+0000 7fbace6a4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c1d9b14950 con 0x55c1d9b0c980 2024-05-08T05:48:51.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.293+0000 7fbace6a4b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55c1d99c0ad0 con 0x55c1d9b08930 2024-05-08T05:48:51.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.293+0000 7fbace6a4b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55c1d9b14ad0 con 0x55c1d9b08010 2024-05-08T05:48:51.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.293+0000 7fbace6a4b80 10 client.0 _ll_register_callbacks cb 0x55c1d9a01c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:48:51.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.294+0000 7fbac1400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1d9b08010 0x55c1d9b13de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:51.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.294+0000 7fbac1e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1d9b0c980 0x55c1d9b116c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:51.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.294+0000 7fbac1e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1d9b0c980 0x55c1d9b116c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60880/0 (socket says 172.21.15.82:60880) 2024-05-08T05:48:51.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.294+0000 7fbac1400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1d9b08010 0x55c1d9b13de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:55762/0 (socket says 172.21.15.82:55762) 2024-05-08T05:48:51.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.294+0000 7fbac1e00700 1 -- 172.21.15.82:0/3470460200 learned_addr learned my addr 172.21.15.82:0/3470460200 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:48:51.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.294+0000 7fbac0a00700 1 --2- 172.21.15.82:0/3470460200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1d9b08930 0x55c1d9b11180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:51.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.294+0000 7fbac1400700 1 -- 172.21.15.82:0/3470460200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1d9b08930 msgr2=0x55c1d9b11180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:48:51.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.294+0000 7fbac1400700 1 --2- 172.21.15.82:0/3470460200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1d9b08930 0x55c1d9b11180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:51.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.294+0000 7fbac1400700 1 -- 172.21.15.82:0/3470460200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1d9b0c980 msgr2=0x55c1d9b116c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:48:51.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.294+0000 7fbac1400700 1 --2- 172.21.15.82:0/3470460200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1d9b0c980 0x55c1d9b116c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:51.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.294+0000 7fbac1400700 1 -- 172.21.15.82:0/3470460200 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1d9a203d0 con 0x55c1d9b08010 2024-05-08T05:48:51.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.294+0000 7fbac1e00700 1 --2- 172.21.15.82:0/3470460200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1d9b0c980 0x55c1d9b116c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:48:51.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.294+0000 7fbac1400700 1 --2- 172.21.15.82:0/3470460200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1d9b08010 0x55c1d9b13de0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbab00a65e0 tx=0x7fbab00a9a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f915796ffd5d3c02 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:51.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.294+0000 7fbaa3400700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:48:51.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.295+0000 7fbaa3400700 1 -- 172.21.15.82:0/3470460200 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab00aa070 con 0x55c1d9b08010 2024-05-08T05:48:51.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.295+0000 7fbaa3400700 1 -- 172.21.15.82:0/3470460200 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fbab00a5ed0 con 0x55c1d9b08010 2024-05-08T05:48:51.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.295+0000 7fbace6a4b80 1 -- 172.21.15.82:0/3470460200 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbab00aac60 con 0x55c1d9b08010 2024-05-08T05:48:51.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.295+0000 7fbaa3400700 1 -- 172.21.15.82:0/3470460200 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbab00b3330 con 0x55c1d9b08010 2024-05-08T05:48:51.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.295+0000 7fbace6a4b80 10 client.24916 fetch_fsmap learned FSMap version 28 2024-05-08T05:48:51.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.295+0000 7fbace6a4b80 1 -- 172.21.15.82:0/3470460200 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c1d9b14950 con 0x55c1d9b08010 2024-05-08T05:48:51.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.295+0000 7fbaa3400700 1 -- 172.21.15.82:0/3470460200 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbab00aac60 con 0x55c1d9b08010 2024-05-08T05:48:51.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.295+0000 7fbaa3400700 1 -- 172.21.15.82:0/3470460200 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fbab00cb320 con 0x55c1d9b08010 2024-05-08T05:48:51.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.296+0000 7fbace6a4b80 10 client.24916 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T05:48:51.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.296+0000 7fbace6a4b80 10 client.24916 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-08T05:48:51.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.296+0000 7fbace6a4b80 20 client.24916 populate_metadata read hostname 'smithi082' 2024-05-08T05:48:51.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.296+0000 7fbace6a4b80 1 --2- 172.21.15.82:0/3470460200 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55c1d9b21550 0x55c1d9b229c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:51.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.296+0000 7fbace6a4b80 4 client.24916 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:48:51.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.296+0000 7fbace6a4b80 1 -- 172.21.15.82:0/3470460200 --> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c1d9ad5050 con 0x55c1d9b21550 2024-05-08T05:48:51.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.296+0000 7fbac0a00700 1 --2- 172.21.15.82:0/3470460200 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55c1d9b21550 0x55c1d9b229c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:51.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.297+0000 7fbac0a00700 1 --2- 172.21.15.82:0/3470460200 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55c1d9b21550 0x55c1d9b229c0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=236c03ff03454c58 server_cookie=7880bf6eb72ee6f0 in_seq=0 out_seq=0 2024-05-08T05:48:51.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.297+0000 7fbaa3400700 10 client.24916 ms_handle_connect on v2:172.21.15.151:6836/4192404464 2024-05-08T05:48:51.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.298+0000 7fbaa3400700 1 -- 172.21.15.82:0/3470460200 <== mds.2 v2:172.21.15.151:6836/4192404464 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55c1d9ad5050 con 0x55c1d9b21550 2024-05-08T05:48:51.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.298+0000 7fbaa3400700 10 client.24916 handle_command_reply: tid=0 2024-05-08T05:48:51.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.298+0000 7fbace6a4b80 1 client.24916 shutdown 2024-05-08T05:48:51.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.298+0000 7fbace6a4b80 1 -- 172.21.15.82:0/3470460200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1d9b08010 msgr2=0x55c1d9b13de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:51.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.298+0000 7fbace6a4b80 1 --2- 172.21.15.82:0/3470460200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1d9b08010 0x55c1d9b13de0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbab00a65e0 tx=0x7fbab00a9a50 comp rx=0 tx=0).stop 2024-05-08T05:48:51.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.298+0000 7fbace6a4b80 1 -- 172.21.15.82:0/3470460200 shutdown_connections 2024-05-08T05:48:51.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.298+0000 7fbace6a4b80 1 --2- 172.21.15.82:0/3470460200 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55c1d9b21550 0x55c1d9b229c0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:51.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.298+0000 7fbace6a4b80 1 --2- 172.21.15.82:0/3470460200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1d9b0c980 0x55c1d9b116c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:51.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.298+0000 7fbace6a4b80 1 --2- 172.21.15.82:0/3470460200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1d9b08010 0x55c1d9b13de0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:51.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.298+0000 7fbace6a4b80 1 --2- 172.21.15.82:0/3470460200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1d9b08930 0x55c1d9b11180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:51.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.298+0000 7fbace6a4b80 1 -- 172.21.15.82:0/3470460200 >> 172.21.15.82:0/3470460200 conn(0x55c1d9a36b10 msgr2=0x55c1d9afd260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:51.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.298+0000 7fbaa3400700 0 client.24916 ms_handle_reset on v2:172.21.15.151:6836/4192404464 2024-05-08T05:48:51.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.298+0000 7fbace6a4b80 1 -- 172.21.15.82:0/3470460200 shutdown_connections 2024-05-08T05:48:51.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.298+0000 7fbace6a4b80 1 -- 172.21.15.82:0/3470460200 wait complete. 2024-05-08T05:48:51.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.299+0000 7fbace6a4b80 20 client.24916 trim_cache size 0 max 16384 2024-05-08T05:48:51.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.321+0000 7fbace6a4b80 1 Processor -- start 2024-05-08T05:48:51.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.322+0000 7fbace6a4b80 1 -- start start 2024-05-08T05:48:51.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.322+0000 7fbace6a4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1d9b08010 0x55c1d9b11140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:51.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.322+0000 7fbace6a4b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1d9b08930 0x55c1d9b11680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:51.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.322+0000 7fbace6a4b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1d9b0c980 0x55c1d9b2be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:51.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.322+0000 7fbace6a4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c1d9b20d00 con 0x55c1d9b08010 2024-05-08T05:48:51.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.322+0000 7fbace6a4b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55c1d9b213d0 con 0x55c1d9b08930 2024-05-08T05:48:51.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.322+0000 7fbace6a4b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55c1d9b21aa0 con 0x55c1d9b0c980 2024-05-08T05:48:51.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.322+0000 7fbac0a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1d9b08930 0x55c1d9b11680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:51.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.322+0000 7fbac1e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1d9b0c980 0x55c1d9b2be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:51.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.322+0000 7fbac0a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1d9b08930 0x55c1d9b11680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:57586/0 (socket says 172.21.15.82:57586) 2024-05-08T05:48:51.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.323+0000 7fbac0a00700 1 -- 172.21.15.82:0/637377880 learned_addr learned my addr 172.21.15.82:0/637377880 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:48:51.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.323+0000 7fbac1400700 1 --2- 172.21.15.82:0/637377880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1d9b08010 0x55c1d9b11140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:51.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.323+0000 7fbac1e00700 1 -- 172.21.15.82:0/637377880 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1d9b08930 msgr2=0x55c1d9b11680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:48:51.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.323+0000 7fbac1e00700 1 --2- 172.21.15.82:0/637377880 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1d9b08930 0x55c1d9b11680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:51.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.323+0000 7fbac1e00700 1 -- 172.21.15.82:0/637377880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1d9b08010 msgr2=0x55c1d9b11140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:48:51.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.323+0000 7fbac1e00700 1 --2- 172.21.15.82:0/637377880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1d9b08010 0x55c1d9b11140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:51.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.323+0000 7fbac1e00700 1 -- 172.21.15.82:0/637377880 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1d9b035c0 con 0x55c1d9b0c980 2024-05-08T05:48:51.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.323+0000 7fbac0a00700 1 --2- 172.21.15.82:0/637377880 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1d9b08930 0x55c1d9b11680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:48:51.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.323+0000 7fbac1e00700 1 --2- 172.21.15.82:0/637377880 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1d9b0c980 0x55c1d9b2be20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbab4007b70 tx=0x7fbab401c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd5c34f56bc4c57c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:51.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.324+0000 7fbaae000700 1 -- 172.21.15.82:0/637377880 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab4027070 con 0x55c1d9b0c980 2024-05-08T05:48:51.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.324+0000 7fbaae000700 1 -- 172.21.15.82:0/637377880 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbab4018ca0 con 0x55c1d9b0c980 2024-05-08T05:48:51.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.324+0000 7fbaae000700 1 -- 172.21.15.82:0/637377880 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab401d040 con 0x55c1d9b0c980 2024-05-08T05:48:51.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.324+0000 7fbace6a4b80 1 -- 172.21.15.82:0/637377880 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1d9b0c980 msgr2=0x55c1d9b2be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:51.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.324+0000 7fbace6a4b80 1 --2- 172.21.15.82:0/637377880 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1d9b0c980 0x55c1d9b2be20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbab4007b70 tx=0x7fbab401c000 comp rx=0 tx=0).stop 2024-05-08T05:48:51.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.325+0000 7fbace6a4b80 1 -- 172.21.15.82:0/637377880 shutdown_connections 2024-05-08T05:48:51.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.325+0000 7fbace6a4b80 1 --2- 172.21.15.82:0/637377880 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1d9b0c980 0x55c1d9b2be20 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:51.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.325+0000 7fbace6a4b80 1 --2- 172.21.15.82:0/637377880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1d9b08010 0x55c1d9b11140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:51.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.325+0000 7fbace6a4b80 1 --2- 172.21.15.82:0/637377880 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1d9b08930 0x55c1d9b11680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:51.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.325+0000 7fbace6a4b80 1 -- 172.21.15.82:0/637377880 >> 172.21.15.82:0/637377880 conn(0x55c1d9a36b10 msgr2=0x55c1d9b0d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:51.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.325+0000 7fbace6a4b80 1 -- 172.21.15.82:0/637377880 shutdown_connections 2024-05-08T05:48:51.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.325+0000 7fbace6a4b80 1 -- 172.21.15.82:0/637377880 wait complete. 2024-05-08T05:48:51.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.325+0000 7fbace6a4b80 1 -- start start 2024-05-08T05:48:51.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.325+0000 7fbace6a4b80 1 Processor -- start 2024-05-08T05:48:51.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.326+0000 7fbace6a4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1d9b08010 0x55c1d9b25b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:51.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.326+0000 7fbace6a4b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1d9b08930 0x55c1d9b26040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:51.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.326+0000 7fbace6a4b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1d9b0c980 0x55c1d9b26580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:51.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.326+0000 7fbace6a4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c1d9b22840 con 0x55c1d9b08010 2024-05-08T05:48:51.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.326+0000 7fbace6a4b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55c1d9b22170 con 0x55c1d9b08930 2024-05-08T05:48:51.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.326+0000 7fbace6a4b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55c1d9b22f10 con 0x55c1d9b0c980 2024-05-08T05:48:51.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.326+0000 7fbace6a4b80 10 client.0 _ll_register_callbacks cb 0x55c1d9a01c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:48:51.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.326+0000 7fbac1400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1d9b08010 0x55c1d9b25b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:51.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.326+0000 7fbac1400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1d9b08010 0x55c1d9b25b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60904/0 (socket says 172.21.15.82:60904) 2024-05-08T05:48:51.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.326+0000 7fbac1400700 1 -- 172.21.15.82:0/93001926 learned_addr learned my addr 172.21.15.82:0/93001926 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:48:51.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.326+0000 7fbac0a00700 1 --2- 172.21.15.82:0/93001926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1d9b08930 0x55c1d9b26040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:51.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.326+0000 7fbac1e00700 1 --2- 172.21.15.82:0/93001926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1d9b0c980 0x55c1d9b26580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:51.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.326+0000 7fbac1400700 1 -- 172.21.15.82:0/93001926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1d9b0c980 msgr2=0x55c1d9b26580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:48:51.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.326+0000 7fbac1400700 1 --2- 172.21.15.82:0/93001926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1d9b0c980 0x55c1d9b26580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:51.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.326+0000 7fbac1400700 1 -- 172.21.15.82:0/93001926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1d9b08930 msgr2=0x55c1d9b26040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:48:51.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.326+0000 7fbac1400700 1 --2- 172.21.15.82:0/93001926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1d9b08930 0x55c1d9b26040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:51.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.326+0000 7fbac1400700 1 -- 172.21.15.82:0/93001926 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1d9b2a450 con 0x55c1d9b08010 2024-05-08T05:48:51.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.327+0000 7fbac0a00700 1 --2- 172.21.15.82:0/93001926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1d9b08930 0x55c1d9b26040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:48:51.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.327+0000 7fbac1400700 1 --2- 172.21.15.82:0/93001926 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1d9b08010 0x55c1d9b25b00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbab00b32a0 tx=0x7fbab0005ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cea78492f546eff5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:51.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.327+0000 7fbaa3400700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T05:48:51.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.327+0000 7fbaa3400700 1 -- 172.21.15.82:0/93001926 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab00a9cd0 con 0x55c1d9b08010 2024-05-08T05:48:51.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.327+0000 7fbaa3400700 1 -- 172.21.15.82:0/93001926 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fbab00a5ed0 con 0x55c1d9b08010 2024-05-08T05:48:51.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.327+0000 7fbace6a4b80 1 -- 172.21.15.82:0/93001926 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbab4018ca0 con 0x55c1d9b08010 2024-05-08T05:48:51.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.327+0000 7fbaa3400700 1 -- 172.21.15.82:0/93001926 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbab00aa070 con 0x55c1d9b08010 2024-05-08T05:48:51.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.327+0000 7fbace6a4b80 10 client.14805 fetch_fsmap learned FSMap version 28 2024-05-08T05:48:51.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.327+0000 7fbace6a4b80 1 -- 172.21.15.82:0/93001926 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c1d9b2a450 con 0x55c1d9b08010 2024-05-08T05:48:51.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.328+0000 7fbaa3400700 1 -- 172.21.15.82:0/93001926 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbab4018ca0 con 0x55c1d9b08010 2024-05-08T05:48:51.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.328+0000 7fbaa3400700 1 -- 172.21.15.82:0/93001926 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fbab00a60d0 con 0x55c1d9b08010 2024-05-08T05:48:51.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.328+0000 7fbace6a4b80 10 client.14805 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T05:48:51.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.328+0000 7fbace6a4b80 10 client.14805 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-08T05:48:51.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.328+0000 7fbace6a4b80 20 client.14805 populate_metadata read hostname 'smithi082' 2024-05-08T05:48:51.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.328+0000 7fbace6a4b80 1 --2- 172.21.15.82:0/93001926 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55c1d9b99da0 0x55c1d9b98ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:51.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.328+0000 7fbace6a4b80 4 client.14805 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T05:48:51.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.328+0000 7fbace6a4b80 1 -- 172.21.15.82:0/93001926 --> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] -- command(tid 0: {"prefix": "status"}) -- 0x55c1d9a683b0 con 0x55c1d9b99da0 2024-05-08T05:48:51.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.328+0000 7fbac0a00700 1 --2- 172.21.15.82:0/93001926 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55c1d9b99da0 0x55c1d9b98ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:51.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.329+0000 7fbac0a00700 1 --2- 172.21.15.82:0/93001926 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55c1d9b99da0 0x55c1d9b98ab0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=be10eace190e5b58 server_cookie=6af28393036ff770 in_seq=0 out_seq=0 2024-05-08T05:48:51.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.329+0000 7fbaa3400700 10 client.14805 ms_handle_connect on v2:172.21.15.151:6836/4192404464 2024-05-08T05:48:51.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.329+0000 7fbaa3400700 1 -- 172.21.15.82:0/93001926 <== mds.2 v2:172.21.15.151:6836/4192404464 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x55c1d9a683b0 con 0x55c1d9b99da0 2024-05-08T05:48:51.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.329+0000 7fbaa3400700 10 client.14805 handle_command_reply: tid=0 2024-05-08T05:48:51.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.329+0000 7fbace6a4b80 1 client.14805 shutdown 2024-05-08T05:48:51.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.330+0000 7fbace6a4b80 1 -- 172.21.15.82:0/93001926 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1d9b08010 msgr2=0x55c1d9b25b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:51.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.330+0000 7fbace6a4b80 1 --2- 172.21.15.82:0/93001926 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1d9b08010 0x55c1d9b25b00 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbab00b32a0 tx=0x7fbab0005ab0 comp rx=0 tx=0).stop 2024-05-08T05:48:51.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.330+0000 7fbace6a4b80 1 -- 172.21.15.82:0/93001926 shutdown_connections 2024-05-08T05:48:51.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.330+0000 7fbace6a4b80 1 --2- 172.21.15.82:0/93001926 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55c1d9b99da0 0x55c1d9b98ab0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:51.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.330+0000 7fbace6a4b80 1 --2- 172.21.15.82:0/93001926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1d9b0c980 0x55c1d9b26580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:51.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.330+0000 7fbace6a4b80 1 --2- 172.21.15.82:0/93001926 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1d9b08010 0x55c1d9b25b00 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:51.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.330+0000 7fbace6a4b80 1 --2- 172.21.15.82:0/93001926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1d9b08930 0x55c1d9b26040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:51.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.330+0000 7fbaa3400700 0 client.14805 ms_handle_reset on v2:172.21.15.151:6836/4192404464 2024-05-08T05:48:51.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.330+0000 7fbace6a4b80 1 -- 172.21.15.82:0/93001926 >> 172.21.15.82:0/93001926 conn(0x55c1d9a36b10 msgr2=0x55c1d9b0fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:51.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.330+0000 7fbace6a4b80 1 -- 172.21.15.82:0/93001926 shutdown_connections 2024-05-08T05:48:51.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.330+0000 7fbace6a4b80 1 -- 172.21.15.82:0/93001926 wait complete. 2024-05-08T05:48:51.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.330+0000 7fbace6a4b80 20 client.14805 trim_cache size 0 max 16384 2024-05-08T05:48:51.333 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T05:48:51.334 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "c739a5c8-0cfc-11ef-bc97-c7b262605968", 2024-05-08T05:48:51.334 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 2, 2024-05-08T05:48:51.334 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 24487, 2024-05-08T05:48:51.334 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-05-08T05:48:51.334 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-05-08T05:48:51.334 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-05-08T05:48:51.334 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 156.407875566, 2024-05-08T05:48:51.334 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 28, 2024-05-08T05:48:51.334 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 82, 2024-05-08T05:48:51.334 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 80, 2024-05-08T05:48:51.334 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 214.359435174 2024-05-08T05:48:51.334 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T05:48:51.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.331+0000 7fbac3e00700 1 -- 172.21.15.82:0/485285428 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fbaa40b2900 msgr2=0x7fbaa40b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:51.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.331+0000 7fbac3e00700 1 --2- 172.21.15.82:0/485285428 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fbaa40b2900 0x7fbaa40b4dc0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fbab40093c0 tx=0x7fbab4009920 comp rx=0 tx=0).stop 2024-05-08T05:48:51.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.331+0000 7fbac3e00700 1 -- 172.21.15.82:0/485285428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbabc1056c0 msgr2=0x7fbabc19bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:51.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.331+0000 7fbac3e00700 1 --2- 172.21.15.82:0/485285428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbabc1056c0 0x7fbabc19bd70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbab0005910 tx=0x7fbab000b670 comp rx=0 tx=0).stop 2024-05-08T05:48:51.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.331+0000 7fbac3e00700 1 -- 172.21.15.82:0/485285428 shutdown_connections 2024-05-08T05:48:51.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.331+0000 7fbac3e00700 1 --2- 172.21.15.82:0/485285428 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbabc10b6c0 0x7fbabc1a0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:51.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.331+0000 7fbac3e00700 1 --2- 172.21.15.82:0/485285428 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fbaa40b2900 0x7fbaa40b4dc0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:51.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.331+0000 7fbac3e00700 1 --2- 172.21.15.82:0/485285428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbabc1056c0 0x7fbabc19bd70 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:51.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.331+0000 7fbac3e00700 1 --2- 172.21.15.82:0/485285428 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbabc106080 0x7fbabc19c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:51.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.331+0000 7fbac3e00700 1 -- 172.21.15.82:0/485285428 >> 172.21.15.82:0/485285428 conn(0x7fbabc1011b0 msgr2=0x7fbabc1018a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:51.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.331+0000 7fbac3e00700 1 -- 172.21.15.82:0/485285428 shutdown_connections 2024-05-08T05:48:51.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:51.331+0000 7fbac3e00700 1 -- 172.21.15.82:0/485285428 wait complete. 2024-05-08T05:48:52.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:48:51 smithi151 ceph-mon[34815]: pgmap v405: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-05-08T05:48:52.159 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:48:51 smithi082 ceph-mon[30098]: pgmap v405: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-05-08T05:48:52.224 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.i status 2024-05-08T05:48:52.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:48:51 smithi134 ceph-mon[34132]: pgmap v405: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-05-08T05:48:52.674 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:48:53.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:48:53 smithi082 ceph-mon[30098]: pgmap v406: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:48:54.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:48:53 smithi134 ceph-mon[34132]: pgmap v406: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:48:54.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:48:53 smithi151 ceph-mon[34815]: pgmap v406: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:48:54.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.915+0000 7fd33b000700 1 -- 172.21.15.82:0/2905479444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3340756d0 msgr2=0x7fd334075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:54.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.915+0000 7fd33b000700 1 --2- 172.21.15.82:0/2905479444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3340756d0 0x7fd334075ab0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd324009990 tx=0x7fd324009ca0 comp rx=0 tx=0).stop 2024-05-08T05:48:54.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.915+0000 7fd33b000700 1 -- 172.21.15.82:0/2905479444 shutdown_connections 2024-05-08T05:48:54.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.915+0000 7fd33b000700 1 --2- 172.21.15.82:0/2905479444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd334114670 0x7fd334116a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:54.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.915+0000 7fd33b000700 1 --2- 172.21.15.82:0/2905479444 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3340756d0 0x7fd334075ab0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:54.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.915+0000 7fd33b000700 1 --2- 172.21.15.82:0/2905479444 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd334075ff0 0x7fd334114130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:54.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.915+0000 7fd33b000700 1 -- 172.21.15.82:0/2905479444 >> 172.21.15.82:0/2905479444 conn(0x7fd33407a600 msgr2=0x7fd33407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:54.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.915+0000 7fd33b000700 1 -- 172.21.15.82:0/2905479444 shutdown_connections 2024-05-08T05:48:54.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.915+0000 7fd33b000700 1 -- 172.21.15.82:0/2905479444 wait complete. 2024-05-08T05:48:54.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.916+0000 7fd33b000700 1 Processor -- start 2024-05-08T05:48:54.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.917+0000 7fd33b000700 1 -- start start 2024-05-08T05:48:54.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.917+0000 7fd33b000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3340756d0 0x7fd3341a01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:54.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.917+0000 7fd33b000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd334075ff0 0x7fd3341a0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:54.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.917+0000 7fd33b000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd334114670 0x7fd3341a4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:54.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.917+0000 7fd33b000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd334119cc0 con 0x7fd3340756d0 2024-05-08T05:48:54.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.917+0000 7fd33b000700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd334119b40 con 0x7fd334075ff0 2024-05-08T05:48:54.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.917+0000 7fd33b000700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd334119e40 con 0x7fd334114670 2024-05-08T05:48:54.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.917+0000 7fd333e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3340756d0 0x7fd3341a01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:54.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.917+0000 7fd333e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3340756d0 0x7fd3341a01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40900/0 (socket says 172.21.15.82:40900) 2024-05-08T05:48:54.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.917+0000 7fd333e00700 1 -- 172.21.15.82:0/2941673411 learned_addr learned my addr 172.21.15.82:0/2941673411 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:48:54.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.917+0000 7fd32be00700 1 --2- 172.21.15.82:0/2941673411 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd334075ff0 0x7fd3341a0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:54.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.918+0000 7fd339000700 1 --2- 172.21.15.82:0/2941673411 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd334114670 0x7fd3341a4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:54.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.918+0000 7fd333e00700 1 -- 172.21.15.82:0/2941673411 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd334114670 msgr2=0x7fd3341a4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:54.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.918+0000 7fd333e00700 1 --2- 172.21.15.82:0/2941673411 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd334114670 0x7fd3341a4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:54.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.918+0000 7fd333e00700 1 -- 172.21.15.82:0/2941673411 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd334075ff0 msgr2=0x7fd3341a0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:54.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.918+0000 7fd333e00700 1 --2- 172.21.15.82:0/2941673411 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd334075ff0 0x7fd3341a0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:54.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.918+0000 7fd333e00700 1 -- 172.21.15.82:0/2941673411 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3341a51e0 con 0x7fd3340756d0 2024-05-08T05:48:54.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.918+0000 7fd32be00700 1 --2- 172.21.15.82:0/2941673411 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd334075ff0 0x7fd3341a0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:48:54.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.918+0000 7fd333e00700 1 --2- 172.21.15.82:0/2941673411 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3340756d0 0x7fd3341a01d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd324005910 tx=0x7fd32400b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:54.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.918+0000 7fd331600700 1 -- 172.21.15.82:0/2941673411 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd324027070 con 0x7fd3340756d0 2024-05-08T05:48:54.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.919+0000 7fd331600700 1 -- 172.21.15.82:0/2941673411 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd324022470 con 0x7fd3340756d0 2024-05-08T05:48:54.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.919+0000 7fd33b000700 1 -- 172.21.15.82:0/2941673411 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3341a5470 con 0x7fd3340756d0 2024-05-08T05:48:54.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.919+0000 7fd331600700 1 -- 172.21.15.82:0/2941673411 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd324017650 con 0x7fd3340756d0 2024-05-08T05:48:54.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.919+0000 7fd33b000700 1 -- 172.21.15.82:0/2941673411 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3341acd50 con 0x7fd3340756d0 2024-05-08T05:48:54.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.922+0000 7fd331600700 1 -- 172.21.15.82:0/2941673411 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fd32402a070 con 0x7fd3340756d0 2024-05-08T05:48:54.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.923+0000 7fd345a06b80 1 Processor -- start 2024-05-08T05:48:54.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.923+0000 7fd345a06b80 1 -- start start 2024-05-08T05:48:54.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.924+0000 7fd345a06b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563253c73010 0x563253c733f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:54.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.924+0000 7fd345a06b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563253c73930 0x563253c77440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:54.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.924+0000 7fd345a06b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563253c77980 0x563253c77de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:54.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.924+0000 7fd345a06b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x563253bc59d0 con 0x563253c77980 2024-05-08T05:48:54.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.924+0000 7fd345a06b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x563253b63710 con 0x563253c73010 2024-05-08T05:48:54.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.924+0000 7fd345a06b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x563253bc1990 con 0x563253c73930 2024-05-08T05:48:54.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.924+0000 7fd331600700 1 --2- 172.21.15.82:0/2941673411 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd3180b2880 0x7fd3180b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:54.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.924+0000 7fd32be00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563253c77980 0x563253c77de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:54.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.924+0000 7fd333e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563253c73930 0x563253c77440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:54.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.924+0000 7fd32be00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563253c77980 0x563253c77de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40902/0 (socket says 172.21.15.82:40902) 2024-05-08T05:48:54.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.924+0000 7fd32be00700 1 -- 172.21.15.82:0/601589017 learned_addr learned my addr 172.21.15.82:0/601589017 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:48:54.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.924+0000 7fd339000700 1 --2- 172.21.15.82:0/601589017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563253c73010 0x563253c733f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:54.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.924+0000 7fd339000700 1 --2- 172.21.15.82:0/2941673411 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd3180b2880 0x7fd3180b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:54.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.925+0000 7fd32be00700 1 -- 172.21.15.82:0/601589017 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563253c73930 msgr2=0x563253c77440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:48:54.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.925+0000 7fd32be00700 1 --2- 172.21.15.82:0/601589017 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563253c73930 0x563253c77440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:54.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.925+0000 7fd32be00700 1 -- 172.21.15.82:0/601589017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563253c73010 msgr2=0x563253c733f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:48:54.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.925+0000 7fd32be00700 1 --2- 172.21.15.82:0/601589017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563253c73010 0x563253c733f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:54.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.925+0000 7fd32be00700 1 -- 172.21.15.82:0/601589017 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563253b12880 con 0x563253c77980 2024-05-08T05:48:54.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.925+0000 7fd339000700 1 --2- 172.21.15.82:0/601589017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563253c73010 0x563253c733f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:48:54.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.925+0000 7fd331600700 1 -- 172.21.15.82:0/2941673411 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd3240e2f00 con 0x7fd3340756d0 2024-05-08T05:48:54.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.925+0000 7fd32be00700 1 --2- 172.21.15.82:0/601589017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563253c77980 0x563253c77de0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd31c0115f0 tx=0x7fd31c011900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0a3bc7938c917f1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:54.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.925+0000 7fd339000700 1 --2- 172.21.15.82:0/2941673411 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd3180b2880 0x7fd3180b4d40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd32c009ec0 tx=0x7fd32c00b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:54.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.926+0000 7fd329600700 1 -- 172.21.15.82:0/601589017 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd31c004230 con 0x563253c77980 2024-05-08T05:48:54.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.926+0000 7fd329600700 1 -- 172.21.15.82:0/601589017 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd31c0043d0 con 0x563253c77980 2024-05-08T05:48:54.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.926+0000 7fd329600700 1 -- 172.21.15.82:0/601589017 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd31c0198f0 con 0x563253c77980 2024-05-08T05:48:54.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.926+0000 7fd345a06b80 1 -- 172.21.15.82:0/601589017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563253c77980 msgr2=0x563253c77de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:54.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.926+0000 7fd345a06b80 1 --2- 172.21.15.82:0/601589017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563253c77980 0x563253c77de0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd31c0115f0 tx=0x7fd31c011900 comp rx=0 tx=0).stop 2024-05-08T05:48:54.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.927+0000 7fd345a06b80 1 -- 172.21.15.82:0/601589017 shutdown_connections 2024-05-08T05:48:54.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.927+0000 7fd345a06b80 1 --2- 172.21.15.82:0/601589017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563253c73010 0x563253c733f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:54.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.927+0000 7fd345a06b80 1 --2- 172.21.15.82:0/601589017 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563253c77980 0x563253c77de0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:54.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.927+0000 7fd345a06b80 1 --2- 172.21.15.82:0/601589017 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563253c73930 0x563253c77440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:54.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.927+0000 7fd345a06b80 1 -- 172.21.15.82:0/601589017 >> 172.21.15.82:0/601589017 conn(0x563253ba1b10 msgr2=0x563253c6d750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:54.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.927+0000 7fd345a06b80 1 -- 172.21.15.82:0/601589017 shutdown_connections 2024-05-08T05:48:54.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.927+0000 7fd345a06b80 1 -- 172.21.15.82:0/601589017 wait complete. 2024-05-08T05:48:54.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.927+0000 7fd345a06b80 1 -- start start 2024-05-08T05:48:54.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.927+0000 7fd345a06b80 1 Processor -- start 2024-05-08T05:48:54.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.928+0000 7fd345a06b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563253c73010 0x563253c7ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:54.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.928+0000 7fd345a06b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563253c73930 0x563253c7c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:54.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.928+0000 7fd345a06b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563253c77980 0x563253c7c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:54.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.928+0000 7fd345a06b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x563253c7fb90 con 0x563253c73010 2024-05-08T05:48:54.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.928+0000 7fd345a06b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x563253b2bad0 con 0x563253c73930 2024-05-08T05:48:54.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.928+0000 7fd345a06b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x563253c7fd10 con 0x563253c77980 2024-05-08T05:48:54.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.928+0000 7fd345a06b80 10 client.0 _ll_register_callbacks cb 0x563253b6cc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:48:54.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.928+0000 7fd333e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563253c73010 0x563253c7ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:54.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.928+0000 7fd333e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563253c73010 0x563253c7ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40908/0 (socket says 172.21.15.82:40908) 2024-05-08T05:48:54.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.928+0000 7fd333e00700 1 -- 172.21.15.82:0/421785402 learned_addr learned my addr 172.21.15.82:0/421785402 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:48:54.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.928+0000 7fd339000700 1 --2- 172.21.15.82:0/421785402 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563253c77980 0x563253c7c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:54.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.928+0000 7fd32be00700 1 --2- 172.21.15.82:0/421785402 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563253c73930 0x563253c7c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:54.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.929+0000 7fd333e00700 1 -- 172.21.15.82:0/421785402 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563253c77980 msgr2=0x563253c7c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:48:54.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.929+0000 7fd333e00700 1 --2- 172.21.15.82:0/421785402 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563253c77980 0x563253c7c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:54.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.929+0000 7fd333e00700 1 -- 172.21.15.82:0/421785402 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563253c73930 msgr2=0x563253c7c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:48:54.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.929+0000 7fd333e00700 1 --2- 172.21.15.82:0/421785402 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563253c73930 0x563253c7c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:54.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.929+0000 7fd333e00700 1 -- 172.21.15.82:0/421785402 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563253b8b3d0 con 0x563253c73010 2024-05-08T05:48:54.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.929+0000 7fd333e00700 1 --2- 172.21.15.82:0/421785402 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563253c73010 0x563253c7ee50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd3240a65e0 tx=0x7fd324073e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a68c1d5ed78a90d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:54.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.929+0000 7fd322000700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T05:48:54.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.929+0000 7fd322000700 1 -- 172.21.15.82:0/421785402 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd324031040 con 0x563253c73010 2024-05-08T05:48:54.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.929+0000 7fd322000700 1 -- 172.21.15.82:0/421785402 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd3240b2ea0 con 0x563253c73010 2024-05-08T05:48:54.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.929+0000 7fd345a06b80 1 -- 172.21.15.82:0/421785402 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd31c0043d0 con 0x563253c73010 2024-05-08T05:48:54.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.930+0000 7fd322000700 1 -- 172.21.15.82:0/421785402 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd3240aa330 con 0x563253c73010 2024-05-08T05:48:54.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.930+0000 7fd345a06b80 10 client.14817 fetch_fsmap learned FSMap version 28 2024-05-08T05:48:54.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.930+0000 7fd345a06b80 1 -- 172.21.15.82:0/421785402 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563253c8a440 con 0x563253c73010 2024-05-08T05:48:54.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.930+0000 7fd322000700 1 -- 172.21.15.82:0/421785402 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd31c0043d0 con 0x563253c73010 2024-05-08T05:48:54.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.930+0000 7fd322000700 1 -- 172.21.15.82:0/421785402 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fd3240e4070 con 0x563253c73010 2024-05-08T05:48:54.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.930+0000 7fd345a06b80 10 client.14817 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T05:48:54.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.931+0000 7fd345a06b80 10 client.14817 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-08T05:48:54.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.931+0000 7fd345a06b80 20 client.14817 populate_metadata read hostname 'smithi082' 2024-05-08T05:48:54.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.931+0000 7fd345a06b80 1 --2- 172.21.15.82:0/421785402 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x563253c8cac0 0x563253c8df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:54.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.931+0000 7fd345a06b80 4 client.14817 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:48:54.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.931+0000 7fd345a06b80 1 -- 172.21.15.82:0/421785402 --> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563253c40050 con 0x563253c8cac0 2024-05-08T05:48:54.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.931+0000 7fd32be00700 1 --2- 172.21.15.82:0/421785402 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x563253c8cac0 0x563253c8df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:54.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.932+0000 7fd32be00700 1 --2- 172.21.15.82:0/421785402 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x563253c8cac0 0x563253c8df30 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2af3dd2334a78479 server_cookie=e8664ab085cda90a in_seq=0 out_seq=0 2024-05-08T05:48:54.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.932+0000 7fd322000700 10 client.14817 ms_handle_connect on v2:172.21.15.151:6838/2963754236 2024-05-08T05:48:54.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.933+0000 7fd322000700 1 -- 172.21.15.82:0/421785402 <== mds.1 v2:172.21.15.151:6838/2963754236 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x563253c40050 con 0x563253c8cac0 2024-05-08T05:48:54.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.933+0000 7fd322000700 10 client.14817 handle_command_reply: tid=0 2024-05-08T05:48:54.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.933+0000 7fd345a06b80 1 client.14817 shutdown 2024-05-08T05:48:54.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.933+0000 7fd345a06b80 1 -- 172.21.15.82:0/421785402 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563253c73010 msgr2=0x563253c7ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:54.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.933+0000 7fd345a06b80 1 --2- 172.21.15.82:0/421785402 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563253c73010 0x563253c7ee50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd3240a65e0 tx=0x7fd324073e50 comp rx=0 tx=0).stop 2024-05-08T05:48:54.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.933+0000 7fd345a06b80 1 -- 172.21.15.82:0/421785402 shutdown_connections 2024-05-08T05:48:54.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.933+0000 7fd345a06b80 1 --2- 172.21.15.82:0/421785402 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x563253c8cac0 0x563253c8df30 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:54.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.933+0000 7fd345a06b80 1 --2- 172.21.15.82:0/421785402 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563253c77980 0x563253c7c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:54.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.933+0000 7fd345a06b80 1 --2- 172.21.15.82:0/421785402 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563253c73010 0x563253c7ee50 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:54.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.933+0000 7fd345a06b80 1 --2- 172.21.15.82:0/421785402 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563253c73930 0x563253c7c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:54.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.933+0000 7fd345a06b80 1 -- 172.21.15.82:0/421785402 >> 172.21.15.82:0/421785402 conn(0x563253ba1b10 msgr2=0x563253c68260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:54.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.933+0000 7fd322000700 0 client.14817 ms_handle_reset on v2:172.21.15.151:6838/2963754236 2024-05-08T05:48:54.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.933+0000 7fd345a06b80 1 -- 172.21.15.82:0/421785402 shutdown_connections 2024-05-08T05:48:54.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.933+0000 7fd345a06b80 1 -- 172.21.15.82:0/421785402 wait complete. 2024-05-08T05:48:54.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.933+0000 7fd345a06b80 20 client.14817 trim_cache size 0 max 16384 2024-05-08T05:48:54.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.956+0000 7fd345a06b80 1 Processor -- start 2024-05-08T05:48:54.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.957+0000 7fd345a06b80 1 -- start start 2024-05-08T05:48:54.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.957+0000 7fd345a06b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563253c73010 0x563253c7aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:54.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.957+0000 7fd345a06b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563253c73930 0x563253c7b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:54.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.957+0000 7fd345a06b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563253c77980 0x563253c7c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:54.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.957+0000 7fd345a06b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x563253c8c270 con 0x563253c77980 2024-05-08T05:48:54.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.957+0000 7fd345a06b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x563253c8c940 con 0x563253c73930 2024-05-08T05:48:54.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.957+0000 7fd345a06b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x563253c8d010 con 0x563253c73010 2024-05-08T05:48:54.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.957+0000 7fd333e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563253c73010 0x563253c7aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:54.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.957+0000 7fd333e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563253c73010 0x563253c7aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:57354/0 (socket says 172.21.15.82:57354) 2024-05-08T05:48:54.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.957+0000 7fd333e00700 1 -- 172.21.15.82:0/3907918351 learned_addr learned my addr 172.21.15.82:0/3907918351 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:48:54.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.957+0000 7fd339000700 1 --2- 172.21.15.82:0/3907918351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563253c77980 0x563253c7c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:54.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.957+0000 7fd32be00700 1 --2- 172.21.15.82:0/3907918351 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563253c73930 0x563253c7b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:54.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.958+0000 7fd333e00700 1 -- 172.21.15.82:0/3907918351 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563253c73930 msgr2=0x563253c7b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:48:54.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.958+0000 7fd333e00700 1 --2- 172.21.15.82:0/3907918351 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563253c73930 0x563253c7b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:54.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.958+0000 7fd333e00700 1 -- 172.21.15.82:0/3907918351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563253c77980 msgr2=0x563253c7c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:48:54.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.958+0000 7fd333e00700 1 --2- 172.21.15.82:0/3907918351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563253c77980 0x563253c7c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:54.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.958+0000 7fd333e00700 1 -- 172.21.15.82:0/3907918351 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563253c8e2a0 con 0x563253c73010 2024-05-08T05:48:54.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.958+0000 7fd333e00700 1 --2- 172.21.15.82:0/3907918351 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563253c73010 0x563253c7aae0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd3240a77d0 tx=0x7fd3240b3330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89436799ab81d736 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:54.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.958+0000 7fd328c00700 1 -- 172.21.15.82:0/3907918351 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3240a9cd0 con 0x563253c73010 2024-05-08T05:48:54.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.958+0000 7fd328c00700 1 -- 172.21.15.82:0/3907918351 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd3240aa070 con 0x563253c73010 2024-05-08T05:48:54.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.958+0000 7fd328c00700 1 -- 172.21.15.82:0/3907918351 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3240a9eb0 con 0x563253c73010 2024-05-08T05:48:54.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.959+0000 7fd345a06b80 1 -- 172.21.15.82:0/3907918351 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563253c73010 msgr2=0x563253c7aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:54.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.959+0000 7fd345a06b80 1 --2- 172.21.15.82:0/3907918351 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563253c73010 0x563253c7aae0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd3240a77d0 tx=0x7fd3240b3330 comp rx=0 tx=0).stop 2024-05-08T05:48:54.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.959+0000 7fd345a06b80 1 -- 172.21.15.82:0/3907918351 shutdown_connections 2024-05-08T05:48:54.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.959+0000 7fd345a06b80 1 --2- 172.21.15.82:0/3907918351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563253c77980 0x563253c7c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:54.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.959+0000 7fd345a06b80 1 --2- 172.21.15.82:0/3907918351 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563253c73010 0x563253c7aae0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:54.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.959+0000 7fd345a06b80 1 --2- 172.21.15.82:0/3907918351 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563253c73930 0x563253c7b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:54.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.959+0000 7fd345a06b80 1 -- 172.21.15.82:0/3907918351 >> 172.21.15.82:0/3907918351 conn(0x563253ba1b10 msgr2=0x563253c8b790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:54.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.959+0000 7fd345a06b80 1 -- 172.21.15.82:0/3907918351 shutdown_connections 2024-05-08T05:48:54.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.959+0000 7fd345a06b80 1 -- 172.21.15.82:0/3907918351 wait complete. 2024-05-08T05:48:54.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.960+0000 7fd345a06b80 1 -- start start 2024-05-08T05:48:54.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.960+0000 7fd345a06b80 1 Processor -- start 2024-05-08T05:48:54.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.960+0000 7fd345a06b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563253c73010 0x563253c97620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:54.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.960+0000 7fd345a06b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563253c73930 0x563253c754b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:54.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.960+0000 7fd345a06b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563253c77980 0x563253c759f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:54.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.960+0000 7fd345a06b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x563253c8ddb0 con 0x563253c77980 2024-05-08T05:48:54.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.960+0000 7fd345a06b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x563253c8d6e0 con 0x563253c73010 2024-05-08T05:48:54.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.960+0000 7fd345a06b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x563253c8e480 con 0x563253c73930 2024-05-08T05:48:54.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.961+0000 7fd345a06b80 10 client.0 _ll_register_callbacks cb 0x563253b6cc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:48:54.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.961+0000 7fd32be00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563253c73930 0x563253c754b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:54.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.961+0000 7fd339000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563253c77980 0x563253c759f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:54.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.961+0000 7fd333e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563253c73010 0x563253c97620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:54.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.961+0000 7fd32be00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563253c73930 0x563253c754b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:57368/0 (socket says 172.21.15.82:57368) 2024-05-08T05:48:54.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.961+0000 7fd32be00700 1 -- 172.21.15.82:0/2594218897 learned_addr learned my addr 172.21.15.82:0/2594218897 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:48:54.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.961+0000 7fd339000700 1 -- 172.21.15.82:0/2594218897 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563253c73930 msgr2=0x563253c754b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:48:54.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.961+0000 7fd339000700 1 --2- 172.21.15.82:0/2594218897 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563253c73930 0x563253c754b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:54.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.961+0000 7fd339000700 1 -- 172.21.15.82:0/2594218897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563253c73010 msgr2=0x563253c97620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:48:54.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.961+0000 7fd339000700 1 --2- 172.21.15.82:0/2594218897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563253c73010 0x563253c97620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:54.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.961+0000 7fd339000700 1 -- 172.21.15.82:0/2594218897 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563253c75f30 con 0x563253c77980 2024-05-08T05:48:54.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.962+0000 7fd339000700 1 --2- 172.21.15.82:0/2594218897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563253c77980 0x563253c759f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd32c009c10 tx=0x7fd32c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71ec78366fe0605b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:54.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.962+0000 7fd322000700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T05:48:54.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.962+0000 7fd322000700 1 -- 172.21.15.82:0/2594218897 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd32c02c020 con 0x563253c77980 2024-05-08T05:48:54.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.962+0000 7fd322000700 1 -- 172.21.15.82:0/2594218897 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd32c0077d0 con 0x563253c77980 2024-05-08T05:48:54.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.962+0000 7fd345a06b80 1 -- 172.21.15.82:0/2594218897 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3240aa070 con 0x563253c77980 2024-05-08T05:48:54.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.962+0000 7fd322000700 1 -- 172.21.15.82:0/2594218897 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd32c0079d0 con 0x563253c77980 2024-05-08T05:48:54.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.962+0000 7fd345a06b80 10 client.14823 fetch_fsmap learned FSMap version 28 2024-05-08T05:48:54.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.962+0000 7fd345a06b80 1 -- 172.21.15.82:0/2594218897 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563253c963a0 con 0x563253c77980 2024-05-08T05:48:54.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.962+0000 7fd322000700 1 -- 172.21.15.82:0/2594218897 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd3240aa070 con 0x563253c77980 2024-05-08T05:48:54.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.963+0000 7fd322000700 1 -- 172.21.15.82:0/2594218897 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fd32c028450 con 0x563253c77980 2024-05-08T05:48:54.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.963+0000 7fd345a06b80 10 client.14823 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T05:48:54.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.963+0000 7fd345a06b80 10 client.14823 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-08T05:48:54.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.963+0000 7fd345a06b80 20 client.14823 populate_metadata read hostname 'smithi082' 2024-05-08T05:48:54.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.963+0000 7fd345a06b80 1 --2- 172.21.15.82:0/2594218897 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x563253cfda90 0x563253cfc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:54.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.963+0000 7fd345a06b80 4 client.14823 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T05:48:54.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.963+0000 7fd345a06b80 1 -- 172.21.15.82:0/2594218897 --> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] -- command(tid 0: {"prefix": "status"}) -- 0x563253bd33b0 con 0x563253cfda90 2024-05-08T05:48:54.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.963+0000 7fd333e00700 1 --2- 172.21.15.82:0/2594218897 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x563253cfda90 0x563253cfc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:54.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.964+0000 7fd333e00700 1 --2- 172.21.15.82:0/2594218897 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x563253cfda90 0x563253cfc7a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=da2539ab9b491ff9 server_cookie=d09bd05b88ac736b in_seq=0 out_seq=0 2024-05-08T05:48:54.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.964+0000 7fd322000700 10 client.14823 ms_handle_connect on v2:172.21.15.151:6838/2963754236 2024-05-08T05:48:54.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.964+0000 7fd322000700 1 -- 172.21.15.82:0/2594218897 <== mds.1 v2:172.21.15.151:6838/2963754236 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x563253bd33b0 con 0x563253cfda90 2024-05-08T05:48:54.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.964+0000 7fd322000700 10 client.14823 handle_command_reply: tid=0 2024-05-08T05:48:54.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.964+0000 7fd345a06b80 1 client.14823 shutdown 2024-05-08T05:48:54.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.964+0000 7fd345a06b80 1 -- 172.21.15.82:0/2594218897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563253c77980 msgr2=0x563253c759f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:54.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.964+0000 7fd345a06b80 1 --2- 172.21.15.82:0/2594218897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563253c77980 0x563253c759f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd32c009c10 tx=0x7fd32c004ad0 comp rx=0 tx=0).stop 2024-05-08T05:48:54.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.964+0000 7fd345a06b80 1 -- 172.21.15.82:0/2594218897 shutdown_connections 2024-05-08T05:48:54.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.964+0000 7fd345a06b80 1 --2- 172.21.15.82:0/2594218897 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x563253cfda90 0x563253cfc7a0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:54.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.964+0000 7fd345a06b80 1 --2- 172.21.15.82:0/2594218897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563253c73010 0x563253c97620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:54.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.964+0000 7fd345a06b80 1 --2- 172.21.15.82:0/2594218897 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563253c77980 0x563253c759f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:54.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.964+0000 7fd345a06b80 1 --2- 172.21.15.82:0/2594218897 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563253c73930 0x563253c754b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:54.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.964+0000 7fd322000700 0 client.14823 ms_handle_reset on v2:172.21.15.151:6838/2963754236 2024-05-08T05:48:54.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.964+0000 7fd345a06b80 1 -- 172.21.15.82:0/2594218897 >> 172.21.15.82:0/2594218897 conn(0x563253ba1b10 msgr2=0x563253c7c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:54.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.965+0000 7fd345a06b80 1 -- 172.21.15.82:0/2594218897 shutdown_connections 2024-05-08T05:48:54.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.965+0000 7fd345a06b80 1 -- 172.21.15.82:0/2594218897 wait complete. 2024-05-08T05:48:54.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.965+0000 7fd345a06b80 20 client.14823 trim_cache size 0 max 16384 2024-05-08T05:48:54.969 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T05:48:54.970 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "c739a5c8-0cfc-11ef-bc97-c7b262605968", 2024-05-08T05:48:54.970 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 1, 2024-05-08T05:48:54.970 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 24505, 2024-05-08T05:48:54.970 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-05-08T05:48:54.970 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-05-08T05:48:54.970 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-05-08T05:48:54.970 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 161.06588817900001, 2024-05-08T05:48:54.970 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 28, 2024-05-08T05:48:54.970 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 82, 2024-05-08T05:48:54.970 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 80, 2024-05-08T05:48:54.970 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 212.24075188 2024-05-08T05:48:54.970 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T05:48:54.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.966+0000 7fd33b000700 1 -- 172.21.15.82:0/2941673411 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd3180b2880 msgr2=0x7fd3180b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:54.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.966+0000 7fd33b000700 1 --2- 172.21.15.82:0/2941673411 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd3180b2880 0x7fd3180b4d40 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fd32c009ec0 tx=0x7fd32c00b040 comp rx=0 tx=0).stop 2024-05-08T05:48:54.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.966+0000 7fd33b000700 1 -- 172.21.15.82:0/2941673411 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3340756d0 msgr2=0x7fd3341a01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:54.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.966+0000 7fd33b000700 1 --2- 172.21.15.82:0/2941673411 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3340756d0 0x7fd3341a01d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd324005910 tx=0x7fd32400b670 comp rx=0 tx=0).stop 2024-05-08T05:48:54.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.966+0000 7fd33b000700 1 -- 172.21.15.82:0/2941673411 shutdown_connections 2024-05-08T05:48:54.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.966+0000 7fd33b000700 1 --2- 172.21.15.82:0/2941673411 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd3180b2880 0x7fd3180b4d40 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:54.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.966+0000 7fd33b000700 1 --2- 172.21.15.82:0/2941673411 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd334114670 0x7fd3341a4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:54.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.966+0000 7fd33b000700 1 --2- 172.21.15.82:0/2941673411 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd3340756d0 0x7fd3341a01d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:54.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.966+0000 7fd33b000700 1 --2- 172.21.15.82:0/2941673411 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd334075ff0 0x7fd3341a0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:54.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.966+0000 7fd33b000700 1 -- 172.21.15.82:0/2941673411 >> 172.21.15.82:0/2941673411 conn(0x7fd33407a600 msgr2=0x7fd334113580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:54.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.966+0000 7fd33b000700 1 -- 172.21.15.82:0/2941673411 shutdown_connections 2024-05-08T05:48:54.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:54.966+0000 7fd33b000700 1 -- 172.21.15.82:0/2941673411 wait complete. 2024-05-08T05:48:55.821 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.b status 2024-05-08T05:48:56.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:48:55 smithi082 ceph-mon[30098]: pgmap v407: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-08T05:48:56.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:48:55 smithi134 ceph-mon[34132]: pgmap v407: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-08T05:48:56.265 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:48:56.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:48:55 smithi151 ceph-mon[34815]: pgmap v407: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-08T05:48:58.073 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:48:57 smithi082 ceph-mon[30098]: pgmap v408: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-08T05:48:58.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:48:57 smithi134 ceph-mon[34132]: pgmap v408: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-08T05:48:58.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.341+0000 7fc594c00700 1 -- 172.21.15.82:0/3343333489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc590075ff0 msgr2=0x7fc590114130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:58.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.341+0000 7fc594c00700 1 --2- 172.21.15.82:0/3343333489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc590075ff0 0x7fc590114130 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc57c009990 tx=0x7fc57c009ca0 comp rx=0 tx=0).stop 2024-05-08T05:48:58.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.341+0000 7fc594c00700 1 -- 172.21.15.82:0/3343333489 shutdown_connections 2024-05-08T05:48:58.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.341+0000 7fc594c00700 1 --2- 172.21.15.82:0/3343333489 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc590114670 0x7fc590116a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:58.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.341+0000 7fc594c00700 1 --2- 172.21.15.82:0/3343333489 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5900756d0 0x7fc590075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:58.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.341+0000 7fc594c00700 1 --2- 172.21.15.82:0/3343333489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc590075ff0 0x7fc590114130 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:58.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.341+0000 7fc594c00700 1 -- 172.21.15.82:0/3343333489 >> 172.21.15.82:0/3343333489 conn(0x7fc59007a600 msgr2=0x7fc59007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:58.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.342+0000 7fc594c00700 1 -- 172.21.15.82:0/3343333489 shutdown_connections 2024-05-08T05:48:58.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.342+0000 7fc594c00700 1 -- 172.21.15.82:0/3343333489 wait complete. 2024-05-08T05:48:58.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.343+0000 7fc594c00700 1 Processor -- start 2024-05-08T05:48:58.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.343+0000 7fc594c00700 1 -- start start 2024-05-08T05:48:58.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.343+0000 7fc594c00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5900756d0 0x7fc5901a0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:58.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.343+0000 7fc594c00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc590075ff0 0x7fc5901a0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:58.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.343+0000 7fc594c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc590114670 0x7fc5901a4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:58.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.343+0000 7fc594c00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc590119cc0 con 0x7fc590114670 2024-05-08T05:48:58.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.343+0000 7fc594c00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc590119b40 con 0x7fc590075ff0 2024-05-08T05:48:58.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.343+0000 7fc594c00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc590119e40 con 0x7fc5900756d0 2024-05-08T05:48:58.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.344+0000 7fc58de00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5900756d0 0x7fc5901a0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:58.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.344+0000 7fc58de00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5900756d0 0x7fc5901a0250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:57396/0 (socket says 172.21.15.82:57396) 2024-05-08T05:48:58.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.344+0000 7fc58de00700 1 -- 172.21.15.82:0/2397551691 learned_addr learned my addr 172.21.15.82:0/2397551691 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:48:58.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.344+0000 7fc58e800700 1 --2- 172.21.15.82:0/2397551691 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc590114670 0x7fc5901a4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:58.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.344+0000 7fc58d400700 1 --2- 172.21.15.82:0/2397551691 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc590075ff0 0x7fc5901a0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:58.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.344+0000 7fc58de00700 1 -- 172.21.15.82:0/2397551691 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc590075ff0 msgr2=0x7fc5901a0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:58.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.344+0000 7fc58de00700 1 --2- 172.21.15.82:0/2397551691 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc590075ff0 0x7fc5901a0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:58.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.344+0000 7fc58de00700 1 -- 172.21.15.82:0/2397551691 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc590114670 msgr2=0x7fc5901a4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:58.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.344+0000 7fc58de00700 1 --2- 172.21.15.82:0/2397551691 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc590114670 0x7fc5901a4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:58.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.344+0000 7fc58de00700 1 -- 172.21.15.82:0/2397551691 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5901a5260 con 0x7fc5900756d0 2024-05-08T05:48:58.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.344+0000 7fc58de00700 1 --2- 172.21.15.82:0/2397551691 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5900756d0 0x7fc5901a0250 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc58000d980 tx=0x7fc58000dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:58.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.345+0000 7fc586a00700 1 -- 172.21.15.82:0/2397551691 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc580017070 con 0x7fc5900756d0 2024-05-08T05:48:58.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.345+0000 7fc586a00700 1 -- 172.21.15.82:0/2397551691 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc580005020 con 0x7fc5900756d0 2024-05-08T05:48:58.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.345+0000 7fc586a00700 1 -- 172.21.15.82:0/2397551691 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc58000fa10 con 0x7fc5900756d0 2024-05-08T05:48:58.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.345+0000 7fc594c00700 1 -- 172.21.15.82:0/2397551691 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5901a5550 con 0x7fc5900756d0 2024-05-08T05:48:58.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.345+0000 7fc594c00700 1 -- 172.21.15.82:0/2397551691 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5901acdd0 con 0x7fc5900756d0 2024-05-08T05:48:58.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.349+0000 7fc586a00700 1 -- 172.21.15.82:0/2397551691 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fc580004a30 con 0x7fc5900756d0 2024-05-08T05:48:58.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.349+0000 7fc59f505b80 1 Processor -- start 2024-05-08T05:48:58.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.350+0000 7fc59f505b80 1 -- start start 2024-05-08T05:48:58.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.350+0000 7fc59f505b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5565f6041010 0x5565f60413f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:58.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.350+0000 7fc59f505b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5565f6041930 0x5565f6045440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:58.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.350+0000 7fc59f505b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565f6045980 0x5565f6045de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:58.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.350+0000 7fc59f505b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5565f5f939d0 con 0x5565f6045980 2024-05-08T05:48:58.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.350+0000 7fc59f505b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5565f5f31710 con 0x5565f6041930 2024-05-08T05:48:58.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.350+0000 7fc59f505b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5565f5f8f990 con 0x5565f6041010 2024-05-08T05:48:58.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.350+0000 7fc586a00700 1 --2- 172.21.15.82:0/2397551691 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc5740b2900 0x7fc5740b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:58.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.350+0000 7fc58d400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565f6045980 0x5565f6045de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:58.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.350+0000 7fc58de00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5565f6041930 0x5565f6045440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:58.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.350+0000 7fc58d400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565f6045980 0x5565f6045de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40954/0 (socket says 172.21.15.82:40954) 2024-05-08T05:48:58.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.350+0000 7fc58d400700 1 -- 172.21.15.82:0/369409756 learned_addr learned my addr 172.21.15.82:0/369409756 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:48:58.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.350+0000 7fc58e800700 1 --2- 172.21.15.82:0/369409756 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5565f6041010 0x5565f60413f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:58.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.351+0000 7fc586a00700 1 -- 172.21.15.82:0/2397551691 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fc5800e20a0 con 0x7fc5900756d0 2024-05-08T05:48:58.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.351+0000 7fc58e800700 1 --2- 172.21.15.82:0/2397551691 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc5740b2900 0x7fc5740b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:58.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.351+0000 7fc58d400700 1 -- 172.21.15.82:0/369409756 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5565f6041010 msgr2=0x5565f60413f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:48:58.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.351+0000 7fc58d400700 1 --2- 172.21.15.82:0/369409756 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5565f6041010 0x5565f60413f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:58.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.351+0000 7fc58d400700 1 -- 172.21.15.82:0/369409756 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5565f6041930 msgr2=0x5565f6045440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:48:58.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.351+0000 7fc58d400700 1 --2- 172.21.15.82:0/369409756 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5565f6041930 0x5565f6045440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:58.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.351+0000 7fc58d400700 1 -- 172.21.15.82:0/369409756 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565f5ee0880 con 0x5565f6045980 2024-05-08T05:48:58.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.351+0000 7fc58de00700 1 --2- 172.21.15.82:0/369409756 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5565f6041930 0x5565f6045440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:48:58.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.351+0000 7fc58d400700 1 --2- 172.21.15.82:0/369409756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565f6045980 0x5565f6045de0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc57c015000 tx=0x7fc57c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66bd960436931ac9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:58.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.352+0000 7fc57b400700 1 -- 172.21.15.82:0/369409756 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc57c003a60 con 0x5565f6045980 2024-05-08T05:48:58.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.352+0000 7fc58e800700 1 --2- 172.21.15.82:0/2397551691 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc5740b2900 0x7fc5740b4dc0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc588009790 tx=0x7fc588009130 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:58.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.352+0000 7fc57b400700 1 -- 172.21.15.82:0/369409756 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc57c026070 con 0x5565f6045980 2024-05-08T05:48:58.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.352+0000 7fc57b400700 1 -- 172.21.15.82:0/369409756 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc57c00ba30 con 0x5565f6045980 2024-05-08T05:48:58.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.352+0000 7fc59f505b80 1 -- 172.21.15.82:0/369409756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565f6045980 msgr2=0x5565f6045de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:58.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.352+0000 7fc59f505b80 1 --2- 172.21.15.82:0/369409756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565f6045980 0x5565f6045de0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc57c015000 tx=0x7fc57c009f90 comp rx=0 tx=0).stop 2024-05-08T05:48:58.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.353+0000 7fc59f505b80 1 -- 172.21.15.82:0/369409756 shutdown_connections 2024-05-08T05:48:58.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.353+0000 7fc59f505b80 1 --2- 172.21.15.82:0/369409756 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565f6045980 0x5565f6045de0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:58.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.353+0000 7fc59f505b80 1 --2- 172.21.15.82:0/369409756 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5565f6041010 0x5565f60413f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:58.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.353+0000 7fc59f505b80 1 --2- 172.21.15.82:0/369409756 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5565f6041930 0x5565f6045440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:58.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.353+0000 7fc59f505b80 1 -- 172.21.15.82:0/369409756 >> 172.21.15.82:0/369409756 conn(0x5565f5f6fb10 msgr2=0x5565f603b750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:58.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.353+0000 7fc59f505b80 1 -- 172.21.15.82:0/369409756 shutdown_connections 2024-05-08T05:48:58.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.353+0000 7fc59f505b80 1 -- 172.21.15.82:0/369409756 wait complete. 2024-05-08T05:48:58.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.353+0000 7fc59f505b80 1 -- start start 2024-05-08T05:48:58.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.354+0000 7fc59f505b80 1 Processor -- start 2024-05-08T05:48:58.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.354+0000 7fc59f505b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565f6041010 0x5565f604cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:58.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.354+0000 7fc59f505b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5565f6041930 0x5565f604a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:58.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.354+0000 7fc59f505b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5565f6045980 0x5565f604a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:58.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.354+0000 7fc59f505b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5565f604db30 con 0x5565f6041010 2024-05-08T05:48:58.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.354+0000 7fc59f505b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5565f5ef9ad0 con 0x5565f6045980 2024-05-08T05:48:58.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.354+0000 7fc59f505b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5565f604dcb0 con 0x5565f6041930 2024-05-08T05:48:58.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.354+0000 7fc59f505b80 10 client.0 _ll_register_callbacks cb 0x5565f5f3ac20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:48:58.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.354+0000 7fc58de00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565f6041010 0x5565f604cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:58.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.354+0000 7fc58de00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565f6041010 0x5565f604cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40968/0 (socket says 172.21.15.82:40968) 2024-05-08T05:48:58.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.354+0000 7fc58de00700 1 -- 172.21.15.82:0/414803583 learned_addr learned my addr 172.21.15.82:0/414803583 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:48:58.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.355+0000 7fc58e800700 1 --2- 172.21.15.82:0/414803583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5565f6045980 0x5565f604a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:58.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.355+0000 7fc58d400700 1 --2- 172.21.15.82:0/414803583 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5565f6041930 0x5565f604a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:58.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.355+0000 7fc58de00700 1 -- 172.21.15.82:0/414803583 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5565f6041930 msgr2=0x5565f604a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:48:58.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.355+0000 7fc58de00700 1 --2- 172.21.15.82:0/414803583 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5565f6041930 0x5565f604a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:58.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.355+0000 7fc58de00700 1 -- 172.21.15.82:0/414803583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5565f6045980 msgr2=0x5565f604a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:48:58.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.355+0000 7fc58de00700 1 --2- 172.21.15.82:0/414803583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5565f6045980 0x5565f604a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:58.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.355+0000 7fc58de00700 1 -- 172.21.15.82:0/414803583 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565f5f593d0 con 0x5565f6041010 2024-05-08T05:48:58.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.355+0000 7fc58de00700 1 --2- 172.21.15.82:0/414803583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565f6041010 0x5565f604cdc0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc58000b790 tx=0x7fc580004e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e522513ccb85489 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:58.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.355+0000 7fc56fe00700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T05:48:58.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.355+0000 7fc56fe00700 1 -- 172.21.15.82:0/414803583 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5800e42f0 con 0x5565f6041010 2024-05-08T05:48:58.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.355+0000 7fc56fe00700 1 -- 172.21.15.82:0/414803583 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fc58008fbe0 con 0x5565f6041010 2024-05-08T05:48:58.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.355+0000 7fc59f505b80 1 -- 172.21.15.82:0/414803583 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc57c026070 con 0x5565f6041010 2024-05-08T05:48:58.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.356+0000 7fc56fe00700 1 -- 172.21.15.82:0/414803583 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc5800a9d70 con 0x5565f6041010 2024-05-08T05:48:58.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.356+0000 7fc59f505b80 10 client.14835 fetch_fsmap learned FSMap version 28 2024-05-08T05:48:58.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.356+0000 7fc59f505b80 1 -- 172.21.15.82:0/414803583 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5565f60583a0 con 0x5565f6041010 2024-05-08T05:48:58.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.356+0000 7fc56fe00700 1 -- 172.21.15.82:0/414803583 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc57c026070 con 0x5565f6041010 2024-05-08T05:48:58.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.356+0000 7fc56fe00700 1 -- 172.21.15.82:0/414803583 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fc5800a98d0 con 0x5565f6041010 2024-05-08T05:48:58.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.356+0000 7fc59f505b80 10 client.14835 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T05:48:58.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.356+0000 7fc59f505b80 10 client.14835 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-08T05:48:58.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.356+0000 7fc59f505b80 20 client.14835 populate_metadata read hostname 'smithi082' 2024-05-08T05:48:58.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.356+0000 7fc59f505b80 1 --2- 172.21.15.82:0/414803583 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5565f605a9b0 0x5565f605be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:58.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.356+0000 7fc59f505b80 4 client.14835 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:48:58.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.356+0000 7fc59f505b80 1 -- 172.21.15.82:0/414803583 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5565f600e050 con 0x5565f605a9b0 2024-05-08T05:48:58.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.357+0000 7fc58d400700 1 --2- 172.21.15.82:0/414803583 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5565f605a9b0 0x5565f605be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:58.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.357+0000 7fc58d400700 1 --2- 172.21.15.82:0/414803583 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5565f605a9b0 0x5565f605be20 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8684b75fcc3535a1 server_cookie=8b4052df2b026bd7 in_seq=0 out_seq=0 2024-05-08T05:48:58.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.357+0000 7fc56fe00700 10 client.14835 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:48:58.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.358+0000 7fc56fe00700 1 -- 172.21.15.82:0/414803583 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5565f600e050 con 0x5565f605a9b0 2024-05-08T05:48:58.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.358+0000 7fc56fe00700 10 client.14835 handle_command_reply: tid=0 2024-05-08T05:48:58.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.358+0000 7fc59f505b80 1 client.14835 shutdown 2024-05-08T05:48:58.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.359+0000 7fc59f505b80 1 -- 172.21.15.82:0/414803583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565f6041010 msgr2=0x5565f604cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:58.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.359+0000 7fc59f505b80 1 --2- 172.21.15.82:0/414803583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565f6041010 0x5565f604cdc0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc58000b790 tx=0x7fc580004e10 comp rx=0 tx=0).stop 2024-05-08T05:48:58.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.359+0000 7fc59f505b80 1 -- 172.21.15.82:0/414803583 shutdown_connections 2024-05-08T05:48:58.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.359+0000 7fc59f505b80 1 --2- 172.21.15.82:0/414803583 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5565f605a9b0 0x5565f605be20 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:58.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.359+0000 7fc59f505b80 1 --2- 172.21.15.82:0/414803583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5565f6045980 0x5565f604a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:58.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.359+0000 7fc59f505b80 1 --2- 172.21.15.82:0/414803583 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565f6041010 0x5565f604cdc0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:58.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.359+0000 7fc59f505b80 1 --2- 172.21.15.82:0/414803583 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5565f6041930 0x5565f604a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:58.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.359+0000 7fc59f505b80 1 -- 172.21.15.82:0/414803583 >> 172.21.15.82:0/414803583 conn(0x5565f5f6fb10 msgr2=0x5565f6036260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:58.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.359+0000 7fc56fe00700 0 client.14835 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:48:58.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.359+0000 7fc59f505b80 1 -- 172.21.15.82:0/414803583 shutdown_connections 2024-05-08T05:48:58.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.359+0000 7fc59f505b80 1 -- 172.21.15.82:0/414803583 wait complete. 2024-05-08T05:48:58.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.359+0000 7fc59f505b80 20 client.14835 trim_cache size 0 max 16384 2024-05-08T05:48:58.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:48:57 smithi151 ceph-mon[34815]: pgmap v408: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-08T05:48:58.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.382+0000 7fc59f505b80 1 Processor -- start 2024-05-08T05:48:58.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.382+0000 7fc59f505b80 1 -- start start 2024-05-08T05:48:58.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.382+0000 7fc59f505b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5565f6041010 0x5565f6043270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:58.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.382+0000 7fc59f505b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565f6041930 0x5565f60437b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:58.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.382+0000 7fc59f505b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5565f6045980 0x5565f6065280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:58.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.382+0000 7fc59f505b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5565f605a160 con 0x5565f6041930 2024-05-08T05:48:58.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.382+0000 7fc59f505b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5565f605a830 con 0x5565f6041010 2024-05-08T05:48:58.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.382+0000 7fc59f505b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5565f605af00 con 0x5565f6045980 2024-05-08T05:48:58.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.382+0000 7fc58d400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565f6041930 0x5565f60437b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:58.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.382+0000 7fc58de00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5565f6041010 0x5565f6043270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:58.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.382+0000 7fc58e800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5565f6045980 0x5565f6065280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:58.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.383+0000 7fc58de00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5565f6041010 0x5565f6043270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:56146/0 (socket says 172.21.15.82:56146) 2024-05-08T05:48:58.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.383+0000 7fc58de00700 1 -- 172.21.15.82:0/338228717 learned_addr learned my addr 172.21.15.82:0/338228717 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:48:58.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.383+0000 7fc58de00700 1 -- 172.21.15.82:0/338228717 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5565f6045980 msgr2=0x5565f6065280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:48:58.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.383+0000 7fc58de00700 1 --2- 172.21.15.82:0/338228717 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5565f6045980 0x5565f6065280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:58.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.383+0000 7fc58de00700 1 -- 172.21.15.82:0/338228717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565f6041930 msgr2=0x5565f60437b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:48:58.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.383+0000 7fc58de00700 1 --2- 172.21.15.82:0/338228717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565f6041930 0x5565f60437b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:58.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.383+0000 7fc58de00700 1 -- 172.21.15.82:0/338228717 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565f6059f90 con 0x5565f6041010 2024-05-08T05:48:58.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.383+0000 7fc58d400700 1 --2- 172.21.15.82:0/338228717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565f6041930 0x5565f60437b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:48:58.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.383+0000 7fc58de00700 1 --2- 172.21.15.82:0/338228717 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5565f6041010 0x5565f6043270 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc5800a9320 tx=0x7fc580005bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9bba75106dcfb38d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:58.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.384+0000 7fc57aa00700 1 -- 172.21.15.82:0/338228717 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5800ada20 con 0x5565f6041010 2024-05-08T05:48:58.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.384+0000 7fc57aa00700 1 -- 172.21.15.82:0/338228717 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5800b24d0 con 0x5565f6041010 2024-05-08T05:48:58.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.384+0000 7fc57aa00700 1 -- 172.21.15.82:0/338228717 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc580009e10 con 0x5565f6041010 2024-05-08T05:48:58.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.384+0000 7fc59f505b80 1 -- 172.21.15.82:0/338228717 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5565f6041010 msgr2=0x5565f6043270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:58.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.384+0000 7fc59f505b80 1 --2- 172.21.15.82:0/338228717 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5565f6041010 0x5565f6043270 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc5800a9320 tx=0x7fc580005bb0 comp rx=0 tx=0).stop 2024-05-08T05:48:58.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.384+0000 7fc59f505b80 1 -- 172.21.15.82:0/338228717 shutdown_connections 2024-05-08T05:48:58.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.384+0000 7fc59f505b80 1 --2- 172.21.15.82:0/338228717 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5565f6041010 0x5565f6043270 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:58.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.384+0000 7fc59f505b80 1 --2- 172.21.15.82:0/338228717 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5565f6045980 0x5565f6065280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:58.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.384+0000 7fc59f505b80 1 --2- 172.21.15.82:0/338228717 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565f6041930 0x5565f60437b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:58.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.384+0000 7fc59f505b80 1 -- 172.21.15.82:0/338228717 >> 172.21.15.82:0/338228717 conn(0x5565f5f6fb10 msgr2=0x5565f6048a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:58.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.385+0000 7fc59f505b80 1 -- 172.21.15.82:0/338228717 shutdown_connections 2024-05-08T05:48:58.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.385+0000 7fc59f505b80 1 -- 172.21.15.82:0/338228717 wait complete. 2024-05-08T05:48:58.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.385+0000 7fc59f505b80 1 -- start start 2024-05-08T05:48:58.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.385+0000 7fc59f505b80 1 Processor -- start 2024-05-08T05:48:58.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.386+0000 7fc59f505b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5565f6041010 0x5565f60658b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:58.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.386+0000 7fc59f505b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5565f6041930 0x5565f605fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:58.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.386+0000 7fc59f505b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565f6045980 0x5565f60602f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:58.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.386+0000 7fc59f505b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5565f605bca0 con 0x5565f6045980 2024-05-08T05:48:58.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.386+0000 7fc59f505b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5565f605b5d0 con 0x5565f6041930 2024-05-08T05:48:58.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.386+0000 7fc59f505b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5565f605c370 con 0x5565f6041010 2024-05-08T05:48:58.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.386+0000 7fc59f505b80 10 client.0 _ll_register_callbacks cb 0x5565f5f3ac20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:48:58.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.386+0000 7fc58e800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565f6045980 0x5565f60602f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:58.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.386+0000 7fc58d400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5565f6041930 0x5565f605fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:58.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.386+0000 7fc58de00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5565f6041010 0x5565f60658b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:58.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.386+0000 7fc58e800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565f6045980 0x5565f60602f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40984/0 (socket says 172.21.15.82:40984) 2024-05-08T05:48:58.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.386+0000 7fc58d400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5565f6041930 0x5565f605fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:56162/0 (socket says 172.21.15.82:56162) 2024-05-08T05:48:58.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.386+0000 7fc58e800700 1 -- 172.21.15.82:0/371916402 learned_addr learned my addr 172.21.15.82:0/371916402 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:48:58.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.387+0000 7fc58de00700 1 -- 172.21.15.82:0/371916402 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5565f6041930 msgr2=0x5565f605fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:48:58.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.387+0000 7fc58de00700 1 --2- 172.21.15.82:0/371916402 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5565f6041930 0x5565f605fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:58.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.387+0000 7fc58de00700 1 -- 172.21.15.82:0/371916402 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565f6045980 msgr2=0x5565f60602f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:48:58.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.387+0000 7fc58de00700 1 --2- 172.21.15.82:0/371916402 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565f6045980 0x5565f60602f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:58.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.387+0000 7fc58de00700 1 -- 172.21.15.82:0/371916402 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565f60c5e20 con 0x5565f6041010 2024-05-08T05:48:58.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.387+0000 7fc58d400700 1 --2- 172.21.15.82:0/371916402 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5565f6041930 0x5565f605fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:48:58.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.387+0000 7fc58e800700 1 --2- 172.21.15.82:0/371916402 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565f6045980 0x5565f60602f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:48:58.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.387+0000 7fc58de00700 1 --2- 172.21.15.82:0/371916402 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5565f6041010 0x5565f60658b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc580012040 tx=0x7fc580004e10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1efa020ae384250 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:48:58.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.387+0000 7fc56fe00700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:48:58.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.387+0000 7fc56fe00700 1 -- 172.21.15.82:0/371916402 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc58000fdb0 con 0x5565f6041010 2024-05-08T05:48:58.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.387+0000 7fc56fe00700 1 -- 172.21.15.82:0/371916402 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fc5800a88d0 con 0x5565f6041010 2024-05-08T05:48:58.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.387+0000 7fc59f505b80 1 -- 172.21.15.82:0/371916402 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc5800b24d0 con 0x5565f6041010 2024-05-08T05:48:58.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.388+0000 7fc56fe00700 1 -- 172.21.15.82:0/371916402 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fc5800a9a10 con 0x5565f6041010 2024-05-08T05:48:58.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.388+0000 7fc59f505b80 10 client.24958 fetch_fsmap learned FSMap version 28 2024-05-08T05:48:58.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.388+0000 7fc59f505b80 1 -- 172.21.15.82:0/371916402 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5565f60c6fd0 con 0x5565f6041010 2024-05-08T05:48:58.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.388+0000 7fc56fe00700 1 -- 172.21.15.82:0/371916402 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc5800b24d0 con 0x5565f6041010 2024-05-08T05:48:58.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.388+0000 7fc56fe00700 1 -- 172.21.15.82:0/371916402 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fc5800beac0 con 0x5565f6041010 2024-05-08T05:48:58.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.388+0000 7fc59f505b80 10 client.24958 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T05:48:58.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.388+0000 7fc59f505b80 10 client.24958 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-08T05:48:58.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.388+0000 7fc59f505b80 20 client.24958 populate_metadata read hostname 'smithi082' 2024-05-08T05:48:58.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.388+0000 7fc59f505b80 1 --2- 172.21.15.82:0/371916402 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5565f60cb500 0x5565f60ca210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:48:58.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.388+0000 7fc59f505b80 4 client.24958 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T05:48:58.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.388+0000 7fc59f505b80 1 -- 172.21.15.82:0/371916402 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "status"}) -- 0x5565f5fa13b0 con 0x5565f60cb500 2024-05-08T05:48:58.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.389+0000 7fc58d400700 1 --2- 172.21.15.82:0/371916402 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5565f60cb500 0x5565f60ca210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:48:58.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.389+0000 7fc58d400700 1 --2- 172.21.15.82:0/371916402 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5565f60cb500 0x5565f60ca210 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c0e8bf02dd48b0 server_cookie=da5800232585a538 in_seq=0 out_seq=0 2024-05-08T05:48:58.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.389+0000 7fc56fe00700 10 client.24958 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:48:58.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.389+0000 7fc56fe00700 1 -- 172.21.15.82:0/371916402 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+321 (crc 0 0 0) 0x5565f5fa13b0 con 0x5565f60cb500 2024-05-08T05:48:58.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.389+0000 7fc56fe00700 10 client.24958 handle_command_reply: tid=0 2024-05-08T05:48:58.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.389+0000 7fc59f505b80 1 client.24958 shutdown 2024-05-08T05:48:58.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.390+0000 7fc59f505b80 1 -- 172.21.15.82:0/371916402 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5565f6041010 msgr2=0x5565f60658b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:58.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.390+0000 7fc59f505b80 1 --2- 172.21.15.82:0/371916402 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5565f6041010 0x5565f60658b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc580012040 tx=0x7fc580004e10 comp rx=0 tx=0).stop 2024-05-08T05:48:58.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.390+0000 7fc59f505b80 1 -- 172.21.15.82:0/371916402 shutdown_connections 2024-05-08T05:48:58.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.390+0000 7fc59f505b80 1 --2- 172.21.15.82:0/371916402 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5565f6045980 0x5565f60602f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:58.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.390+0000 7fc59f505b80 1 --2- 172.21.15.82:0/371916402 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5565f6041010 0x5565f60658b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:58.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.390+0000 7fc59f505b80 1 --2- 172.21.15.82:0/371916402 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5565f60cb500 0x5565f60ca210 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:58.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.390+0000 7fc59f505b80 1 --2- 172.21.15.82:0/371916402 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5565f6041930 0x5565f605fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:58.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.390+0000 7fc56fe00700 0 client.24958 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:48:58.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.390+0000 7fc59f505b80 1 -- 172.21.15.82:0/371916402 >> 172.21.15.82:0/371916402 conn(0x5565f5f6fb10 msgr2=0x5565f60359d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:58.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.390+0000 7fc59f505b80 1 -- 172.21.15.82:0/371916402 shutdown_connections 2024-05-08T05:48:58.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.390+0000 7fc59f505b80 1 -- 172.21.15.82:0/371916402 wait complete. 2024-05-08T05:48:58.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.390+0000 7fc59f505b80 20 client.24958 trim_cache size 0 max 16384 2024-05-08T05:48:58.394 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T05:48:58.395 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "c739a5c8-0cfc-11ef-bc97-c7b262605968", 2024-05-08T05:48:58.395 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 0, 2024-05-08T05:48:58.395 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 24506, 2024-05-08T05:48:58.395 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-05-08T05:48:58.395 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-05-08T05:48:58.395 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-05-08T05:48:58.395 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 180.575917285, 2024-05-08T05:48:58.395 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 28, 2024-05-08T05:48:58.395 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 82, 2024-05-08T05:48:58.395 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 80, 2024-05-08T05:48:58.395 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 203.23692821 2024-05-08T05:48:58.395 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T05:48:58.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.391+0000 7fc594c00700 1 -- 172.21.15.82:0/2397551691 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc5740b2900 msgr2=0x7fc5740b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:58.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.391+0000 7fc594c00700 1 --2- 172.21.15.82:0/2397551691 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc5740b2900 0x7fc5740b4dc0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc588009790 tx=0x7fc588009130 comp rx=0 tx=0).stop 2024-05-08T05:48:58.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.391+0000 7fc594c00700 1 -- 172.21.15.82:0/2397551691 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5900756d0 msgr2=0x7fc5901a0250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:48:58.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.391+0000 7fc594c00700 1 --2- 172.21.15.82:0/2397551691 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5900756d0 0x7fc5901a0250 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc58000d980 tx=0x7fc58000dc90 comp rx=0 tx=0).stop 2024-05-08T05:48:58.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.391+0000 7fc594c00700 1 -- 172.21.15.82:0/2397551691 shutdown_connections 2024-05-08T05:48:58.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.391+0000 7fc594c00700 1 --2- 172.21.15.82:0/2397551691 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc5740b2900 0x7fc5740b4dc0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:58.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.391+0000 7fc594c00700 1 --2- 172.21.15.82:0/2397551691 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc590114670 0x7fc5901a4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:58.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.391+0000 7fc594c00700 1 --2- 172.21.15.82:0/2397551691 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5900756d0 0x7fc5901a0250 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:58.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.391+0000 7fc594c00700 1 --2- 172.21.15.82:0/2397551691 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc590075ff0 0x7fc5901a0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:48:58.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.391+0000 7fc594c00700 1 -- 172.21.15.82:0/2397551691 >> 172.21.15.82:0/2397551691 conn(0x7fc59007a600 msgr2=0x7fc590111510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:48:58.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.391+0000 7fc594c00700 1 -- 172.21.15.82:0/2397551691 shutdown_connections 2024-05-08T05:48:58.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:48:58.391+0000 7fc594c00700 1 -- 172.21.15.82:0/2397551691 wait complete. 2024-05-08T05:48:59.379 INFO:tasks.cephadm:Setup complete, yielding 2024-05-08T05:48:59.380 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-08T05:48:59.391 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi082.front.sepia.ceph.com 2024-05-08T05:48:59.391 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- bash -c 'ceph orch status' 2024-05-08T05:48:59.839 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:49:00.148 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:48:59 smithi082 ceph-mon[30098]: pgmap v409: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:49:00.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:48:59 smithi134 ceph-mon[34132]: pgmap v409: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:49:00.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:48:59 smithi151 ceph-mon[34815]: pgmap v409: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:49:02.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:02.044+0000 7f28ca000700 1 -- 172.21.15.82:0/2208116193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28c4106940 msgr2=0x7f28c4106da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:02.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:02.044+0000 7f28ca000700 1 --2- 172.21.15.82:0/2208116193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28c4106940 0x7f28c4106da0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f28b00099c0 tx=0x7f28b0009cd0 comp rx=0 tx=0).stop 2024-05-08T05:49:02.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:02.045+0000 7f28ca000700 1 -- 172.21.15.82:0/2208116193 shutdown_connections 2024-05-08T05:49:02.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:02.045+0000 7f28ca000700 1 --2- 172.21.15.82:0/2208116193 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28c41072e0 0x7f28c410db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:02.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:02.045+0000 7f28ca000700 1 --2- 172.21.15.82:0/2208116193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28c4105740 0x7f28c4105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:02.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:02.045+0000 7f28ca000700 1 --2- 172.21.15.82:0/2208116193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28c4106940 0x7f28c4106da0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:02.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:02.045+0000 7f28ca000700 1 -- 172.21.15.82:0/2208116193 >> 172.21.15.82:0/2208116193 conn(0x7f28c4100d00 msgr2=0x7f28c4103120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:49:02.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:02.045+0000 7f28ca000700 1 -- 172.21.15.82:0/2208116193 shutdown_connections 2024-05-08T05:49:02.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:02.045+0000 7f28ca000700 1 -- 172.21.15.82:0/2208116193 wait complete. 2024-05-08T05:49:02.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:02.046+0000 7f28ca000700 1 Processor -- start 2024-05-08T05:49:02.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:02.046+0000 7f28ca000700 1 -- start start 2024-05-08T05:49:02.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:02.046+0000 7f28ca000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28c4105740 0x7f28c419b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:02.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:02.046+0000 7f28ca000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28c4106940 0x7f28c419bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:02.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:02.046+0000 7f28ca000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28c41072e0 0x7f28c41a2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:02.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:02.046+0000 7f28ca000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f28c41111d0 con 0x7f28c4106940 2024-05-08T05:49:02.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:02.046+0000 7f28ca000700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f28c4111050 con 0x7f28c4105740 2024-05-08T05:49:02.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:02.046+0000 7f28ca000700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f28c4111350 con 0x7f28c41072e0 2024-05-08T05:49:02.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:02.046+0000 7f28c2a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28c4106940 0x7f28c419bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:02.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:02.046+0000 7f28c3400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28c4105740 0x7f28c419b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:02.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:02.047+0000 7f28c3400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28c4105740 0x7f28c419b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:56188/0 (socket says 172.21.15.82:56188) 2024-05-08T05:49:02.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:02.047+0000 7f28c3400700 1 -- 172.21.15.82:0/357766318 learned_addr learned my addr 172.21.15.82:0/357766318 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:49:02.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:02.047+0000 7f28c3e00700 1 --2- 172.21.15.82:0/357766318 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28c41072e0 0x7f28c41a2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:02.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:02.047+0000 7f28c3400700 1 -- 172.21.15.82:0/357766318 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28c41072e0 msgr2=0x7f28c41a2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:02.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:02.047+0000 7f28c3400700 1 --2- 172.21.15.82:0/357766318 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28c41072e0 0x7f28c41a2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:02.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:02.047+0000 7f28c3400700 1 -- 172.21.15.82:0/357766318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28c4106940 msgr2=0x7f28c419bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:02.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:02.047+0000 7f28c3400700 1 --2- 172.21.15.82:0/357766318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28c4106940 0x7f28c419bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:02.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:02.047+0000 7f28c3400700 1 -- 172.21.15.82:0/357766318 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28c41a3470 con 0x7f28c4105740 2024-05-08T05:49:02.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:02.047+0000 7f28c2a00700 1 --2- 172.21.15.82:0/357766318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28c4106940 0x7f28c419bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:49:02.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:02.047+0000 7f28c3400700 1 --2- 172.21.15.82:0/357766318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28c4105740 0x7f28c419b810 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f28b400e950 tx=0x7f28b400ec60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:49:02.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:02.048+0000 7f28bbe00700 1 -- 172.21.15.82:0/357766318 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28b4004230 con 0x7f28c4105740 2024-05-08T05:49:02.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:02.048+0000 7f28bbe00700 1 -- 172.21.15.82:0/357766318 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f28b40043d0 con 0x7f28c4105740 2024-05-08T05:49:02.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:02.048+0000 7f28ca000700 1 -- 172.21.15.82:0/357766318 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28c41a3760 con 0x7f28c4105740 2024-05-08T05:49:02.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:02.048+0000 7f28bbe00700 1 -- 172.21.15.82:0/357766318 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28b4003d60 con 0x7f28c4105740 2024-05-08T05:49:02.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:02.048+0000 7f28ca000700 1 -- 172.21.15.82:0/357766318 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28c41a3ca0 con 0x7f28c4105740 2024-05-08T05:49:02.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:02.049+0000 7f28ca000700 1 -- 172.21.15.82:0/357766318 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28c406a190 con 0x7f28c4105740 2024-05-08T05:49:02.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:02.051+0000 7f28bbe00700 1 -- 172.21.15.82:0/357766318 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f28b400c7e0 con 0x7f28c4105740 2024-05-08T05:49:02.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:02.053+0000 7f28bbe00700 1 --2- 172.21.15.82:0/357766318 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f28a80b2900 0x7f28a80b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:02.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:02.053+0000 7f28bbe00700 1 -- 172.21.15.82:0/357766318 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f28b40e2410 con 0x7f28c4105740 2024-05-08T05:49:02.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:02.053+0000 7f28c2a00700 1 --2- 172.21.15.82:0/357766318 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f28a80b2900 0x7f28a80b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:02.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:02.054+0000 7f28c2a00700 1 --2- 172.21.15.82:0/357766318 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f28a80b2900 0x7f28a80b4dc0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f28b0000c00 tx=0x7f28b0005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:49:02.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:02.055+0000 7f28bbe00700 1 -- 172.21.15.82:0/357766318 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f28b40aa0e0 con 0x7f28c4105740 2024-05-08T05:49:02.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:49:01 smithi082 ceph-mon[30098]: pgmap v410: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-05-08T05:49:02.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:49:01 smithi134 ceph-mon[34132]: pgmap v410: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-05-08T05:49:02.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:02.307+0000 7f28ca000700 1 -- 172.21.15.82:0/357766318 --> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f28c40638e0 con 0x7f28a80b2900 2024-05-08T05:49:02.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:02.309+0000 7f28bbe00700 1 -- 172.21.15.82:0/357766318 <== mgr.14152 v2:172.21.15.82:6800/4089180091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f28c40638e0 con 0x7f28a80b2900 2024-05-08T05:49:02.310 INFO:teuthology.orchestra.run.smithi082.stdout:Backend: cephadm 2024-05-08T05:49:02.310 INFO:teuthology.orchestra.run.smithi082.stdout:Available: Yes 2024-05-08T05:49:02.310 INFO:teuthology.orchestra.run.smithi082.stdout:Paused: No 2024-05-08T05:49:02.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:02.312+0000 7f28ca000700 1 -- 172.21.15.82:0/357766318 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f28a80b2900 msgr2=0x7f28a80b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:02.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:02.312+0000 7f28ca000700 1 --2- 172.21.15.82:0/357766318 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f28a80b2900 0x7f28a80b4dc0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f28b0000c00 tx=0x7f28b0005fb0 comp rx=0 tx=0).stop 2024-05-08T05:49:02.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:02.312+0000 7f28ca000700 1 -- 172.21.15.82:0/357766318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28c4105740 msgr2=0x7f28c419b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:02.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:02.312+0000 7f28ca000700 1 --2- 172.21.15.82:0/357766318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28c4105740 0x7f28c419b810 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f28b400e950 tx=0x7f28b400ec60 comp rx=0 tx=0).stop 2024-05-08T05:49:02.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:02.312+0000 7f28ca000700 1 -- 172.21.15.82:0/357766318 shutdown_connections 2024-05-08T05:49:02.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:02.312+0000 7f28ca000700 1 --2- 172.21.15.82:0/357766318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28c4105740 0x7f28c419b810 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:02.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:02.312+0000 7f28ca000700 1 --2- 172.21.15.82:0/357766318 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f28a80b2900 0x7f28a80b4dc0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:02.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:02.312+0000 7f28ca000700 1 --2- 172.21.15.82:0/357766318 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28c41072e0 0x7f28c41a2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:02.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:02.312+0000 7f28ca000700 1 --2- 172.21.15.82:0/357766318 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f28c4106940 0x7f28c419bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:02.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:02.312+0000 7f28ca000700 1 -- 172.21.15.82:0/357766318 >> 172.21.15.82:0/357766318 conn(0x7f28c4100d00 msgr2=0x7f28c4109c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:49:02.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:02.312+0000 7f28ca000700 1 -- 172.21.15.82:0/357766318 shutdown_connections 2024-05-08T05:49:02.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:02.313+0000 7f28ca000700 1 -- 172.21.15.82:0/357766318 wait complete. 2024-05-08T05:49:02.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:49:01 smithi151 ceph-mon[34815]: pgmap v410: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-05-08T05:49:03.127 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- bash -c 'ceph orch ps' 2024-05-08T05:49:03.569 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:49:03.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:49:03 smithi082 ceph-mon[30098]: pgmap v411: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:49:03.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:49:03 smithi082 ceph-mon[30098]: from='client.24938 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:49:04.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:49:03 smithi134 ceph-mon[34132]: pgmap v411: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:49:04.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:49:03 smithi134 ceph-mon[34132]: from='client.24938 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:49:04.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:49:03 smithi151 ceph-mon[34815]: pgmap v411: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:49:04.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:49:03 smithi151 ceph-mon[34815]: from='client.24938 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:49:05.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:05.747+0000 7f10fce00700 1 -- 172.21.15.82:0/1355905526 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10f810ad40 msgr2=0x7f10f810b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:05.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:05.747+0000 7f10fce00700 1 --2- 172.21.15.82:0/1355905526 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10f810ad40 0x7f10f810b1a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f10e40099c0 tx=0x7f10e4009cd0 comp rx=0 tx=0).stop 2024-05-08T05:49:05.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:05.747+0000 7f10fce00700 1 -- 172.21.15.82:0/1355905526 shutdown_connections 2024-05-08T05:49:05.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:05.747+0000 7f10fce00700 1 --2- 172.21.15.82:0/1355905526 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10f8109b40 0x7f10f8109f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:05.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:05.747+0000 7f10fce00700 1 --2- 172.21.15.82:0/1355905526 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10f810b6e0 0x7f10f8111f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:05.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:05.747+0000 7f10fce00700 1 --2- 172.21.15.82:0/1355905526 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10f810ad40 0x7f10f810b1a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:05.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:05.747+0000 7f10fce00700 1 -- 172.21.15.82:0/1355905526 >> 172.21.15.82:0/1355905526 conn(0x7f10f8078b10 msgr2=0x7f10f807af50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:49:05.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:05.747+0000 7f10fce00700 1 -- 172.21.15.82:0/1355905526 shutdown_connections 2024-05-08T05:49:05.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:05.747+0000 7f10fce00700 1 -- 172.21.15.82:0/1355905526 wait complete. 2024-05-08T05:49:05.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:05.749+0000 7f10fce00700 1 Processor -- start 2024-05-08T05:49:05.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:05.749+0000 7f10fce00700 1 -- start start 2024-05-08T05:49:05.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:05.749+0000 7f10fce00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10f8109b40 0x7f10f819fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:05.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:05.749+0000 7f10fce00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10f810ad40 0x7f10f81a01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:05.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:05.749+0000 7f10fce00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10f810b6e0 0x7f10f81a7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:05.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:05.749+0000 7f10fce00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f10f8115600 con 0x7f10f810ad40 2024-05-08T05:49:05.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:05.749+0000 7f10fce00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f10f8115480 con 0x7f10f810b6e0 2024-05-08T05:49:05.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:05.749+0000 7f10fce00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f10f8115780 con 0x7f10f8109b40 2024-05-08T05:49:05.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:05.749+0000 7f10f5400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10f810ad40 0x7f10f81a01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:05.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:05.749+0000 7f10f5400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10f810ad40 0x7f10f81a01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37602/0 (socket says 172.21.15.82:37602) 2024-05-08T05:49:05.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:05.749+0000 7f10f5400700 1 -- 172.21.15.82:0/1237552231 learned_addr learned my addr 172.21.15.82:0/1237552231 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:49:05.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:05.749+0000 7f10f6800700 1 --2- 172.21.15.82:0/1237552231 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10f810b6e0 0x7f10f81a7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:05.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:05.750+0000 7f10f5e00700 1 --2- 172.21.15.82:0/1237552231 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10f8109b40 0x7f10f819fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:05.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:05.750+0000 7f10f5400700 1 -- 172.21.15.82:0/1237552231 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10f8109b40 msgr2=0x7f10f819fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:05.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:05.750+0000 7f10f5400700 1 --2- 172.21.15.82:0/1237552231 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10f8109b40 0x7f10f819fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:05.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:05.750+0000 7f10f5400700 1 -- 172.21.15.82:0/1237552231 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10f810b6e0 msgr2=0x7f10f81a7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:05.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:05.750+0000 7f10f5400700 1 --2- 172.21.15.82:0/1237552231 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10f810b6e0 0x7f10f81a7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:05.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:05.750+0000 7f10f5400700 1 -- 172.21.15.82:0/1237552231 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10f81a78f0 con 0x7f10f810ad40 2024-05-08T05:49:05.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:05.750+0000 7f10f6800700 1 --2- 172.21.15.82:0/1237552231 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10f810b6e0 0x7f10f81a7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:49:05.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:05.750+0000 7f10f5400700 1 --2- 172.21.15.82:0/1237552231 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10f810ad40 0x7f10f81a01b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f10e40036f0 tx=0x7f10e4003e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:49:05.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:05.750+0000 7f10eea00700 1 -- 172.21.15.82:0/1237552231 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e4009e60 con 0x7f10f810ad40 2024-05-08T05:49:05.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:05.750+0000 7f10eea00700 1 -- 172.21.15.82:0/1237552231 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10e400f460 con 0x7f10f810ad40 2024-05-08T05:49:05.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:05.750+0000 7f10fce00700 1 -- 172.21.15.82:0/1237552231 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10f81a7b80 con 0x7f10f810ad40 2024-05-08T05:49:05.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:05.750+0000 7f10eea00700 1 -- 172.21.15.82:0/1237552231 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10e4017650 con 0x7f10f810ad40 2024-05-08T05:49:05.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:05.751+0000 7f10fce00700 1 -- 172.21.15.82:0/1237552231 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10f81a7fd0 con 0x7f10f810ad40 2024-05-08T05:49:05.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:05.752+0000 7f10fce00700 1 -- 172.21.15.82:0/1237552231 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10f802e510 con 0x7f10f810ad40 2024-05-08T05:49:05.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:05.754+0000 7f10eea00700 1 -- 172.21.15.82:0/1237552231 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f10e400f8a0 con 0x7f10f810ad40 2024-05-08T05:49:05.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:05.756+0000 7f10eea00700 1 --2- 172.21.15.82:0/1237552231 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f10dc0b2880 0x7f10dc0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:05.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:05.756+0000 7f10eea00700 1 -- 172.21.15.82:0/1237552231 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f10e40e3080 con 0x7f10f810ad40 2024-05-08T05:49:05.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:05.756+0000 7f10f5e00700 1 --2- 172.21.15.82:0/1237552231 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f10dc0b2880 0x7f10dc0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:05.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:05.757+0000 7f10f5e00700 1 --2- 172.21.15.82:0/1237552231 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f10dc0b2880 0x7f10dc0b4d40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f10f81a0b50 tx=0x7f10e8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:49:05.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:05.760+0000 7f10eea00700 1 -- 172.21.15.82:0/1237552231 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f10e4013070 con 0x7f10f810ad40 2024-05-08T05:49:06.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:06.006+0000 7f10fce00700 1 -- 172.21.15.82:0/1237552231 --> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f10f80638e0 con 0x7f10dc0b2880 2024-05-08T05:49:06.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:06.047+0000 7f10eea00700 1 -- 172.21.15.82:0/1237552231 <== mgr.14152 v2:172.21.15.82:6800/4089180091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4123 (secure 0 0 0) 0x7f10f80638e0 con 0x7f10dc0b2880 2024-05-08T05:49:06.048 INFO:teuthology.orchestra.run.smithi082.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-08T05:49:06.048 INFO:teuthology.orchestra.run.smithi082.stdout:mds.a smithi082 running (3m) 49s ago 3m 18.0M - 19.0.0-3538-gbee299f4 352576a2df49 b779b6736622 2024-05-08T05:49:06.048 INFO:teuthology.orchestra.run.smithi082.stdout:mds.b smithi134 running (3m) 75s ago 3m 26.5M - 19.0.0-3538-gbee299f4 352576a2df49 c991dcbc68f4 2024-05-08T05:49:06.048 INFO:teuthology.orchestra.run.smithi082.stdout:mds.c smithi151 running (3m) 75s ago 3m 22.2M - 19.0.0-3538-gbee299f4 352576a2df49 774d1f9f7bcb 2024-05-08T05:49:06.049 INFO:teuthology.orchestra.run.smithi082.stdout:mds.d smithi082 running (3m) 49s ago 3m 13.3M - 19.0.0-3538-gbee299f4 352576a2df49 fe7abbc85d64 2024-05-08T05:49:06.049 INFO:teuthology.orchestra.run.smithi082.stdout:mds.e smithi134 running (3m) 75s ago 3m 19.3M - 19.0.0-3538-gbee299f4 352576a2df49 b62b7fbb937a 2024-05-08T05:49:06.049 INFO:teuthology.orchestra.run.smithi082.stdout:mds.f smithi151 running (3m) 75s ago 3m 18.9M - 19.0.0-3538-gbee299f4 352576a2df49 ea9fd08b107f 2024-05-08T05:49:06.049 INFO:teuthology.orchestra.run.smithi082.stdout:mds.g smithi082 running (3m) 49s ago 3m 18.1M - 19.0.0-3538-gbee299f4 352576a2df49 3141edc501dd 2024-05-08T05:49:06.049 INFO:teuthology.orchestra.run.smithi082.stdout:mds.h smithi134 running (3m) 75s ago 3m 20.7M - 19.0.0-3538-gbee299f4 352576a2df49 7ecfb2a1cf81 2024-05-08T05:49:06.049 INFO:teuthology.orchestra.run.smithi082.stdout:mds.i smithi151 running (3m) 75s ago 3m 19.7M - 19.0.0-3538-gbee299f4 352576a2df49 6884b7a6179e 2024-05-08T05:49:06.049 INFO:teuthology.orchestra.run.smithi082.stdout:mds.j smithi082 running (4m) 49s ago 4m 13.4M - 19.0.0-3538-gbee299f4 352576a2df49 3379a8a642ed 2024-05-08T05:49:06.049 INFO:teuthology.orchestra.run.smithi082.stdout:mds.k smithi134 running (4m) 75s ago 4m 20.6M - 19.0.0-3538-gbee299f4 352576a2df49 acaa1f3403b1 2024-05-08T05:49:06.049 INFO:teuthology.orchestra.run.smithi082.stdout:mds.l smithi151 running (4m) 75s ago 4m 19.2M - 19.0.0-3538-gbee299f4 352576a2df49 bf3a64bfb137 2024-05-08T05:49:06.049 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.x smithi082 *:9283,8765 running (12m) 49s ago 12m 531M - 19.0.0-3538-gbee299f4 352576a2df49 5805a3b3e699 2024-05-08T05:49:06.049 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.y smithi134 *:8443,8765 running (9m) 75s ago 9m 469M - 19.0.0-3538-gbee299f4 352576a2df49 d872a9d9122c 2024-05-08T05:49:06.049 INFO:teuthology.orchestra.run.smithi082.stdout:mgr.z smithi151 *:8443,8765 running (10m) 75s ago 10m 467M - 19.0.0-3538-gbee299f4 352576a2df49 f1002fec0153 2024-05-08T05:49:06.049 INFO:teuthology.orchestra.run.smithi082.stdout:mon.a smithi082 running (12m) 49s ago 12m 51.0M 2048M 19.0.0-3538-gbee299f4 352576a2df49 e91a456d9489 2024-05-08T05:49:06.049 INFO:teuthology.orchestra.run.smithi082.stdout:mon.b smithi134 running (10m) 75s ago 10m 43.1M 2048M 19.0.0-3538-gbee299f4 352576a2df49 7bfe54499052 2024-05-08T05:49:06.049 INFO:teuthology.orchestra.run.smithi082.stdout:mon.c smithi151 running (10m) 75s ago 10m 43.1M 2048M 19.0.0-3538-gbee299f4 352576a2df49 fe9f1f14c8ea 2024-05-08T05:49:06.049 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 smithi082 running (9m) 49s ago 9m 56.5M 4272M 19.0.0-3538-gbee299f4 352576a2df49 0145d59dceca 2024-05-08T05:49:06.050 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 smithi134 running (9m) 75s ago 9m 50.1M 4272M 19.0.0-3538-gbee299f4 352576a2df49 ebe3c4c05765 2024-05-08T05:49:06.050 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 smithi151 running (8m) 75s ago 8m 49.4M 4272M 19.0.0-3538-gbee299f4 352576a2df49 7813303bf8aa 2024-05-08T05:49:06.050 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 smithi082 running (8m) 49s ago 8m 43.6M 4272M 19.0.0-3538-gbee299f4 352576a2df49 6d0bcc496aad 2024-05-08T05:49:06.050 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 smithi134 running (7m) 75s ago 7m 55.9M 4272M 19.0.0-3538-gbee299f4 352576a2df49 4f05430349b1 2024-05-08T05:49:06.050 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 smithi151 running (7m) 75s ago 7m 45.0M 4272M 19.0.0-3538-gbee299f4 352576a2df49 8da8f250c612 2024-05-08T05:49:06.050 INFO:teuthology.orchestra.run.smithi082.stdout:osd.6 smithi082 running (6m) 49s ago 6m 57.1M 4272M 19.0.0-3538-gbee299f4 352576a2df49 cbe65cc7a36c 2024-05-08T05:49:06.050 INFO:teuthology.orchestra.run.smithi082.stdout:osd.7 smithi134 running (6m) 75s ago 6m 46.9M 4272M 19.0.0-3538-gbee299f4 352576a2df49 0bd859b196cf 2024-05-08T05:49:06.050 INFO:teuthology.orchestra.run.smithi082.stdout:osd.8 smithi151 running (5m) 75s ago 5m 43.4M 4272M 19.0.0-3538-gbee299f4 352576a2df49 69a0f62ec2ec 2024-05-08T05:49:06.050 INFO:teuthology.orchestra.run.smithi082.stdout:osd.9 smithi082 running (5m) 49s ago 5m 45.2M 4272M 19.0.0-3538-gbee299f4 352576a2df49 a23c1ccf0fbd 2024-05-08T05:49:06.050 INFO:teuthology.orchestra.run.smithi082.stdout:osd.10 smithi134 running (4m) 75s ago 4m 59.4M 4272M 19.0.0-3538-gbee299f4 352576a2df49 119e33bb669e 2024-05-08T05:49:06.050 INFO:teuthology.orchestra.run.smithi082.stdout:osd.11 smithi151 running (4m) 75s ago 4m 43.7M 4272M 19.0.0-3538-gbee299f4 352576a2df49 d1427eaad468 2024-05-08T05:49:06.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:06.050+0000 7f10fce00700 1 -- 172.21.15.82:0/1237552231 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f10dc0b2880 msgr2=0x7f10dc0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:06.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:06.050+0000 7f10fce00700 1 --2- 172.21.15.82:0/1237552231 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f10dc0b2880 0x7f10dc0b4d40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f10f81a0b50 tx=0x7f10e8009260 comp rx=0 tx=0).stop 2024-05-08T05:49:06.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:06.050+0000 7f10fce00700 1 -- 172.21.15.82:0/1237552231 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10f810ad40 msgr2=0x7f10f81a01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:06.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:06.050+0000 7f10fce00700 1 --2- 172.21.15.82:0/1237552231 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10f810ad40 0x7f10f81a01b0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f10e40036f0 tx=0x7f10e4003e60 comp rx=0 tx=0).stop 2024-05-08T05:49:06.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:06.050+0000 7f10fce00700 1 -- 172.21.15.82:0/1237552231 shutdown_connections 2024-05-08T05:49:06.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:06.050+0000 7f10fce00700 1 --2- 172.21.15.82:0/1237552231 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10f810b6e0 0x7f10f81a7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:06.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:06.050+0000 7f10fce00700 1 --2- 172.21.15.82:0/1237552231 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f10dc0b2880 0x7f10dc0b4d40 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:06.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:06.050+0000 7f10fce00700 1 --2- 172.21.15.82:0/1237552231 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10f8109b40 0x7f10f819fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:06.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:06.050+0000 7f10fce00700 1 --2- 172.21.15.82:0/1237552231 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10f810ad40 0x7f10f81a01b0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:06.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:06.050+0000 7f10fce00700 1 -- 172.21.15.82:0/1237552231 >> 172.21.15.82:0/1237552231 conn(0x7f10f8078b10 msgr2=0x7f10f810e090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:49:06.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:06.051+0000 7f10fce00700 1 -- 172.21.15.82:0/1237552231 shutdown_connections 2024-05-08T05:49:06.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:06.051+0000 7f10fce00700 1 -- 172.21.15.82:0/1237552231 wait complete. 2024-05-08T05:49:06.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:49:05 smithi082 ceph-mon[30098]: pgmap v412: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-08T05:49:06.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:49:05 smithi134 ceph-mon[34132]: pgmap v412: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-08T05:49:06.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:49:05 smithi151 ceph-mon[34815]: pgmap v412: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-08T05:49:06.889 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- bash -c 'ceph orch ls' 2024-05-08T05:49:07.328 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:49:08.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:49:07 smithi082 ceph-mon[30098]: from='client.14853 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:49:08.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:49:07 smithi082 ceph-mon[30098]: pgmap v413: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-08T05:49:08.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:49:07 smithi134 ceph-mon[34132]: from='client.14853 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:49:08.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:49:07 smithi134 ceph-mon[34132]: pgmap v413: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-08T05:49:08.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:49:07 smithi151 ceph-mon[34815]: from='client.14853 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:49:08.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:49:07 smithi151 ceph-mon[34815]: pgmap v413: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-08T05:49:09.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:09.573+0000 7fd29f200700 1 -- 172.21.15.82:0/3647289861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd29810ad40 msgr2=0x7fd29810b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:09.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:09.573+0000 7fd29f200700 1 --2- 172.21.15.82:0/3647289861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd29810ad40 0x7fd29810b1a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd2840099c0 tx=0x7fd284009cd0 comp rx=0 tx=0).stop 2024-05-08T05:49:09.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:09.573+0000 7fd29f200700 1 -- 172.21.15.82:0/3647289861 shutdown_connections 2024-05-08T05:49:09.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:09.573+0000 7fd29f200700 1 --2- 172.21.15.82:0/3647289861 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd29810b6e0 0x7fd298111f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:09.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:09.573+0000 7fd29f200700 1 --2- 172.21.15.82:0/3647289861 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd298109b40 0x7fd298109f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:09.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:09.573+0000 7fd29f200700 1 --2- 172.21.15.82:0/3647289861 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd29810ad40 0x7fd29810b1a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:09.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:09.573+0000 7fd29f200700 1 -- 172.21.15.82:0/3647289861 >> 172.21.15.82:0/3647289861 conn(0x7fd298078b10 msgr2=0x7fd29807af50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:49:09.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:09.573+0000 7fd29f200700 1 -- 172.21.15.82:0/3647289861 shutdown_connections 2024-05-08T05:49:09.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:09.573+0000 7fd29f200700 1 -- 172.21.15.82:0/3647289861 wait complete. 2024-05-08T05:49:09.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:09.574+0000 7fd29f200700 1 Processor -- start 2024-05-08T05:49:09.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:09.575+0000 7fd29f200700 1 -- start start 2024-05-08T05:49:09.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:09.575+0000 7fd29f200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd298109b40 0x7fd29819fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:09.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:09.575+0000 7fd29f200700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd29810ad40 0x7fd2981a01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:09.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:09.575+0000 7fd29f200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd29810b6e0 0x7fd2981a71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:09.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:09.575+0000 7fd29f200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd298115600 con 0x7fd29810b6e0 2024-05-08T05:49:09.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:09.575+0000 7fd29f200700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd298115480 con 0x7fd298109b40 2024-05-08T05:49:09.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:09.575+0000 7fd29f200700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd298115780 con 0x7fd29810ad40 2024-05-08T05:49:09.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:09.575+0000 7fd29d200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd29810b6e0 0x7fd2981a71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:09.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:09.575+0000 7fd297e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd298109b40 0x7fd29819fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:09.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:09.575+0000 7fd29d200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd29810b6e0 0x7fd2981a71e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37616/0 (socket says 172.21.15.82:37616) 2024-05-08T05:49:09.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:09.575+0000 7fd29d200700 1 -- 172.21.15.82:0/2776195979 learned_addr learned my addr 172.21.15.82:0/2776195979 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:49:09.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:09.575+0000 7fd297e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd298109b40 0x7fd29819fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:46698/0 (socket says 172.21.15.82:46698) 2024-05-08T05:49:09.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:09.575+0000 7fd297400700 1 --2- 172.21.15.82:0/2776195979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd29810ad40 0x7fd2981a01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:09.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:09.576+0000 7fd297e00700 1 -- 172.21.15.82:0/2776195979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd29810ad40 msgr2=0x7fd2981a01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:09.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:09.576+0000 7fd297e00700 1 --2- 172.21.15.82:0/2776195979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd29810ad40 0x7fd2981a01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:09.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:09.576+0000 7fd297e00700 1 -- 172.21.15.82:0/2776195979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd29810b6e0 msgr2=0x7fd2981a71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:09.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:09.576+0000 7fd297e00700 1 --2- 172.21.15.82:0/2776195979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd29810b6e0 0x7fd2981a71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:09.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:09.576+0000 7fd297e00700 1 -- 172.21.15.82:0/2776195979 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2981a78b0 con 0x7fd298109b40 2024-05-08T05:49:09.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:09.576+0000 7fd29d200700 1 --2- 172.21.15.82:0/2776195979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd29810b6e0 0x7fd2981a71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:49:09.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:09.576+0000 7fd297e00700 1 --2- 172.21.15.82:0/2776195979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd298109b40 0x7fd29819fc60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd28800e9c0 tx=0x7fd28800ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:49:09.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:09.576+0000 7fd294c00700 1 -- 172.21.15.82:0/2776195979 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd288004220 con 0x7fd298109b40 2024-05-08T05:49:09.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:09.577+0000 7fd29f200700 1 -- 172.21.15.82:0/2776195979 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2981a7ba0 con 0x7fd298109b40 2024-05-08T05:49:09.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:09.577+0000 7fd294c00700 1 -- 172.21.15.82:0/2776195979 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2880043c0 con 0x7fd298109b40 2024-05-08T05:49:09.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:09.577+0000 7fd294c00700 1 -- 172.21.15.82:0/2776195979 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd288003c50 con 0x7fd298109b40 2024-05-08T05:49:09.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:09.577+0000 7fd29f200700 1 -- 172.21.15.82:0/2776195979 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2981a8130 con 0x7fd298109b40 2024-05-08T05:49:09.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:09.578+0000 7fd29f200700 1 -- 172.21.15.82:0/2776195979 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd29806a190 con 0x7fd298109b40 2024-05-08T05:49:09.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:09.580+0000 7fd294c00700 1 -- 172.21.15.82:0/2776195979 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fd28800c7c0 con 0x7fd298109b40 2024-05-08T05:49:09.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:09.582+0000 7fd294c00700 1 --2- 172.21.15.82:0/2776195979 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd27c0b2880 0x7fd27c0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:09.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:09.582+0000 7fd294c00700 1 -- 172.21.15.82:0/2776195979 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd2880e2460 con 0x7fd298109b40 2024-05-08T05:49:09.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:09.582+0000 7fd297400700 1 --2- 172.21.15.82:0/2776195979 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd27c0b2880 0x7fd27c0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:09.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:09.583+0000 7fd297400700 1 --2- 172.21.15.82:0/2776195979 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd27c0b2880 0x7fd27c0b4d40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd284000c00 tx=0x7fd284005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:49:09.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:09.586+0000 7fd294c00700 1 -- 172.21.15.82:0/2776195979 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd2880aa130 con 0x7fd298109b40 2024-05-08T05:49:09.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:09.827+0000 7fd29f200700 1 -- 172.21.15.82:0/2776195979 --> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7fd2980638e0 con 0x7fd27c0b2880 2024-05-08T05:49:09.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:09.843+0000 7fd294c00700 1 -- 172.21.15.82:0/2776195979 <== mgr.14152 v2:172.21.15.82:6800/4089180091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7fd2980638e0 con 0x7fd27c0b2880 2024-05-08T05:49:09.844 INFO:teuthology.orchestra.run.smithi082.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-05-08T05:49:09.844 INFO:teuthology.orchestra.run.smithi082.stdout:mds.all 12/12 78s ago 4m smithi082=a;smithi082=d;smithi082=g;smithi082=j;smithi134=b;smithi134=e;smithi134=h;smithi134=k;smithi151=c;smithi151=f;smithi151=i;smithi151=l;count:12 2024-05-08T05:49:09.844 INFO:teuthology.orchestra.run.smithi082.stdout:mgr 3/3 78s ago 10m smithi082=x;smithi134=y;smithi151=z;count:3 2024-05-08T05:49:09.844 INFO:teuthology.orchestra.run.smithi082.stdout:mon 3/3 78s ago 10m smithi082:172.21.15.82=a;smithi134:172.21.15.134=b;smithi151:172.21.15.151=c;count:3 2024-05-08T05:49:09.844 INFO:teuthology.orchestra.run.smithi082.stdout:osd 12 78s ago - 2024-05-08T05:49:09.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:09.846+0000 7fd29f200700 1 -- 172.21.15.82:0/2776195979 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd27c0b2880 msgr2=0x7fd27c0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:09.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:09.846+0000 7fd29f200700 1 --2- 172.21.15.82:0/2776195979 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd27c0b2880 0x7fd27c0b4d40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd284000c00 tx=0x7fd284005fb0 comp rx=0 tx=0).stop 2024-05-08T05:49:09.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:09.846+0000 7fd29f200700 1 -- 172.21.15.82:0/2776195979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd298109b40 msgr2=0x7fd29819fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:09.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:09.846+0000 7fd29f200700 1 --2- 172.21.15.82:0/2776195979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd298109b40 0x7fd29819fc60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd28800e9c0 tx=0x7fd28800ecd0 comp rx=0 tx=0).stop 2024-05-08T05:49:09.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:09.846+0000 7fd29f200700 1 -- 172.21.15.82:0/2776195979 shutdown_connections 2024-05-08T05:49:09.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:09.846+0000 7fd29f200700 1 --2- 172.21.15.82:0/2776195979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd298109b40 0x7fd29819fc60 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:09.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:09.846+0000 7fd29f200700 1 --2- 172.21.15.82:0/2776195979 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd27c0b2880 0x7fd27c0b4d40 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:09.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:09.846+0000 7fd29f200700 1 --2- 172.21.15.82:0/2776195979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd29810b6e0 0x7fd2981a71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:09.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:09.846+0000 7fd29f200700 1 --2- 172.21.15.82:0/2776195979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd29810ad40 0x7fd2981a01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:09.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:09.846+0000 7fd29f200700 1 -- 172.21.15.82:0/2776195979 >> 172.21.15.82:0/2776195979 conn(0x7fd298078b10 msgr2=0x7fd29810e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:49:09.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:09.846+0000 7fd29f200700 1 -- 172.21.15.82:0/2776195979 shutdown_connections 2024-05-08T05:49:09.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:09.847+0000 7fd29f200700 1 -- 172.21.15.82:0/2776195979 wait complete. 2024-05-08T05:49:10.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:49:09 smithi082 ceph-mon[30098]: pgmap v414: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:49:10.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:49:09 smithi134 ceph-mon[34132]: pgmap v414: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:49:10.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:49:09 smithi151 ceph-mon[34815]: pgmap v414: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:49:10.742 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- bash -c 'ceph orch host ls' 2024-05-08T05:49:10.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:49:10 smithi082 ceph-mon[30098]: from='client.24950 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:49:11.200 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:49:11.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:49:10 smithi134 ceph-mon[34132]: from='client.24950 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:49:11.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:49:10 smithi151 ceph-mon[34815]: from='client.24950 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:49:12.217 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:49:11 smithi082 ceph-mon[30098]: pgmap v415: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-05-08T05:49:12.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:49:11 smithi134 ceph-mon[34132]: pgmap v415: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-05-08T05:49:12.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:49:11 smithi151 ceph-mon[34815]: pgmap v415: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-05-08T05:49:13.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:13.563+0000 7fc7f4c00700 1 -- 172.21.15.82:0/1896644896 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7f01072f0 msgr2=0x7fc7f010dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:13.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:13.563+0000 7fc7f4c00700 1 --2- 172.21.15.82:0/1896644896 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7f01072f0 0x7fc7f010dba0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fc7e800b0d0 tx=0x7fc7e800b3e0 comp rx=0 tx=0).stop 2024-05-08T05:49:13.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:13.563+0000 7fc7f4c00700 1 -- 172.21.15.82:0/1896644896 shutdown_connections 2024-05-08T05:49:13.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:13.563+0000 7fc7f4c00700 1 --2- 172.21.15.82:0/1896644896 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7f01072f0 0x7fc7f010dba0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:13.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:13.563+0000 7fc7f4c00700 1 --2- 172.21.15.82:0/1896644896 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7f0105750 0x7fc7f0105b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:13.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:13.563+0000 7fc7f4c00700 1 --2- 172.21.15.82:0/1896644896 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7f0106950 0x7fc7f0106db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:13.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:13.563+0000 7fc7f4c00700 1 -- 172.21.15.82:0/1896644896 >> 172.21.15.82:0/1896644896 conn(0x7fc7f0100cf0 msgr2=0x7fc7f0103130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:49:13.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:13.563+0000 7fc7f4c00700 1 -- 172.21.15.82:0/1896644896 shutdown_connections 2024-05-08T05:49:13.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:13.563+0000 7fc7f4c00700 1 -- 172.21.15.82:0/1896644896 wait complete. 2024-05-08T05:49:13.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:13.564+0000 7fc7f4c00700 1 Processor -- start 2024-05-08T05:49:13.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:13.564+0000 7fc7f4c00700 1 -- start start 2024-05-08T05:49:13.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:13.564+0000 7fc7f4c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7f0105750 0x7fc7f019b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:13.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:13.564+0000 7fc7f4c00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7f0106950 0x7fc7f019bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:13.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:13.565+0000 7fc7f4c00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7f01072f0 0x7fc7f01a2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:13.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:13.565+0000 7fc7f4c00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f01111f0 con 0x7fc7f0105750 2024-05-08T05:49:13.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:13.565+0000 7fc7f4c00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f0111070 con 0x7fc7f0106950 2024-05-08T05:49:13.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:13.565+0000 7fc7f4c00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc7f0111370 con 0x7fc7f01072f0 2024-05-08T05:49:13.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:13.565+0000 7fc7ede00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7f0105750 0x7fc7f019b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:13.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:13.565+0000 7fc7ede00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7f0105750 0x7fc7f019b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52468/0 (socket says 172.21.15.82:52468) 2024-05-08T05:49:13.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:13.565+0000 7fc7ede00700 1 -- 172.21.15.82:0/1134465201 learned_addr learned my addr 172.21.15.82:0/1134465201 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:49:13.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:13.565+0000 7fc7ee800700 1 --2- 172.21.15.82:0/1134465201 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7f01072f0 0x7fc7f01a2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:13.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:13.565+0000 7fc7ed400700 1 --2- 172.21.15.82:0/1134465201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7f0106950 0x7fc7f019bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:13.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:13.565+0000 7fc7ede00700 1 -- 172.21.15.82:0/1134465201 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7f01072f0 msgr2=0x7fc7f01a2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:13.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:13.565+0000 7fc7ede00700 1 --2- 172.21.15.82:0/1134465201 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7f01072f0 0x7fc7f01a2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:13.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:13.565+0000 7fc7ede00700 1 -- 172.21.15.82:0/1134465201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7f0106950 msgr2=0x7fc7f019bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:13.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:13.565+0000 7fc7ede00700 1 --2- 172.21.15.82:0/1134465201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7f0106950 0x7fc7f019bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:13.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:13.565+0000 7fc7ede00700 1 -- 172.21.15.82:0/1134465201 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7f01a3430 con 0x7fc7f0105750 2024-05-08T05:49:13.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:13.565+0000 7fc7ee800700 1 --2- 172.21.15.82:0/1134465201 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7f01072f0 0x7fc7f01a2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:49:13.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:13.566+0000 7fc7ede00700 1 --2- 172.21.15.82:0/1134465201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7f0105750 0x7fc7f019b7d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc7e000e980 tx=0x7fc7e000ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:49:13.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:13.566+0000 7fc7e6a00700 1 -- 172.21.15.82:0/1134465201 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e0004230 con 0x7fc7f0105750 2024-05-08T05:49:13.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:13.566+0000 7fc7f4c00700 1 -- 172.21.15.82:0/1134465201 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7f01a3720 con 0x7fc7f0105750 2024-05-08T05:49:13.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:13.566+0000 7fc7e6a00700 1 -- 172.21.15.82:0/1134465201 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc7e00043d0 con 0x7fc7f0105750 2024-05-08T05:49:13.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:13.566+0000 7fc7e6a00700 1 -- 172.21.15.82:0/1134465201 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e0003d40 con 0x7fc7f0105750 2024-05-08T05:49:13.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:13.566+0000 7fc7f4c00700 1 -- 172.21.15.82:0/1134465201 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7f01a3c10 con 0x7fc7f0105750 2024-05-08T05:49:13.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:13.568+0000 7fc7f4c00700 1 -- 172.21.15.82:0/1134465201 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7f006a190 con 0x7fc7f0105750 2024-05-08T05:49:13.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:13.570+0000 7fc7e6a00700 1 -- 172.21.15.82:0/1134465201 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fc7e000c810 con 0x7fc7f0105750 2024-05-08T05:49:13.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:13.571+0000 7fc7e6a00700 1 --2- 172.21.15.82:0/1134465201 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc7d40b2880 0x7fc7d40b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:13.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:13.571+0000 7fc7e6a00700 1 -- 172.21.15.82:0/1134465201 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fc7e00e2430 con 0x7fc7f0105750 2024-05-08T05:49:13.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:13.572+0000 7fc7ed400700 1 --2- 172.21.15.82:0/1134465201 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc7d40b2880 0x7fc7d40b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:13.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:13.572+0000 7fc7ed400700 1 --2- 172.21.15.82:0/1134465201 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc7d40b2880 0x7fc7d40b4d40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc009680 tx=0x7fc7dc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:49:13.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:13.576+0000 7fc7e6a00700 1 -- 172.21.15.82:0/1134465201 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc7e00aa100 con 0x7fc7f0105750 2024-05-08T05:49:13.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:13.819+0000 7fc7f4c00700 1 -- 172.21.15.82:0/1134465201 --> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7fc7f00638e0 con 0x7fc7d40b2880 2024-05-08T05:49:13.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:13.822+0000 7fc7e6a00700 1 -- 172.21.15.82:0/1134465201 <== mgr.14152 v2:172.21.15.82:6800/4089180091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7fc7f00638e0 con 0x7fc7d40b2880 2024-05-08T05:49:13.823 INFO:teuthology.orchestra.run.smithi082.stdout:HOST ADDR LABELS STATUS 2024-05-08T05:49:13.823 INFO:teuthology.orchestra.run.smithi082.stdout:smithi082 172.21.15.82 2024-05-08T05:49:13.823 INFO:teuthology.orchestra.run.smithi082.stdout:smithi134 172.21.15.134 2024-05-08T05:49:13.823 INFO:teuthology.orchestra.run.smithi082.stdout:smithi151 172.21.15.151 2024-05-08T05:49:13.823 INFO:teuthology.orchestra.run.smithi082.stdout:3 hosts in cluster 2024-05-08T05:49:13.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:13.825+0000 7fc7f4c00700 1 -- 172.21.15.82:0/1134465201 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc7d40b2880 msgr2=0x7fc7d40b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:13.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:13.825+0000 7fc7f4c00700 1 --2- 172.21.15.82:0/1134465201 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc7d40b2880 0x7fc7d40b4d40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc009680 tx=0x7fc7dc009260 comp rx=0 tx=0).stop 2024-05-08T05:49:13.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:13.825+0000 7fc7f4c00700 1 -- 172.21.15.82:0/1134465201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7f0105750 msgr2=0x7fc7f019b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:13.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:13.825+0000 7fc7f4c00700 1 --2- 172.21.15.82:0/1134465201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7f0105750 0x7fc7f019b7d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc7e000e980 tx=0x7fc7e000ec90 comp rx=0 tx=0).stop 2024-05-08T05:49:13.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:13.826+0000 7fc7f4c00700 1 -- 172.21.15.82:0/1134465201 shutdown_connections 2024-05-08T05:49:13.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:13.826+0000 7fc7f4c00700 1 --2- 172.21.15.82:0/1134465201 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc7d40b2880 0x7fc7d40b4d40 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:13.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:13.826+0000 7fc7f4c00700 1 --2- 172.21.15.82:0/1134465201 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7f01072f0 0x7fc7f01a2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:13.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:13.826+0000 7fc7f4c00700 1 --2- 172.21.15.82:0/1134465201 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc7f0105750 0x7fc7f019b7d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:13.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:13.826+0000 7fc7f4c00700 1 --2- 172.21.15.82:0/1134465201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc7f0106950 0x7fc7f019bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:13.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:13.826+0000 7fc7f4c00700 1 -- 172.21.15.82:0/1134465201 >> 172.21.15.82:0/1134465201 conn(0x7fc7f0100cf0 msgr2=0x7fc7f0109c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:49:13.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:13.826+0000 7fc7f4c00700 1 -- 172.21.15.82:0/1134465201 shutdown_connections 2024-05-08T05:49:13.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:13.826+0000 7fc7f4c00700 1 -- 172.21.15.82:0/1134465201 wait complete. 2024-05-08T05:49:14.192 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:49:13 smithi082 ceph-mon[30098]: pgmap v416: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:49:14.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:49:13 smithi134 ceph-mon[34132]: pgmap v416: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:49:14.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:49:13 smithi151 ceph-mon[34815]: pgmap v416: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:49:14.592 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- bash -c 'ceph orch device ls' 2024-05-08T05:49:15.009 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:49:15.159 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:49:14 smithi082 ceph-mon[30098]: from='client.14865 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:49:15.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:49:14 smithi134 ceph-mon[34132]: from='client.14865 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:49:15.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:49:14 smithi151 ceph-mon[34815]: from='client.14865 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:49:16.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:49:15 smithi082 ceph-mon[30098]: pgmap v417: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-08T05:49:16.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:49:15 smithi134 ceph-mon[34132]: pgmap v417: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-08T05:49:16.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:49:15 smithi151 ceph-mon[34815]: pgmap v417: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-08T05:49:17.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:17.261+0000 7f1431c00700 1 -- 172.21.15.82:0/2152776493 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f142c1072e0 msgr2=0x7f142c10db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:17.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:17.261+0000 7f1431c00700 1 --2- 172.21.15.82:0/2152776493 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f142c1072e0 0x7f142c10db90 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f142400b0a0 tx=0x7f142400b3b0 comp rx=0 tx=0).stop 2024-05-08T05:49:17.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:17.261+0000 7f1431c00700 1 -- 172.21.15.82:0/2152776493 shutdown_connections 2024-05-08T05:49:17.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:17.261+0000 7f1431c00700 1 --2- 172.21.15.82:0/2152776493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f142c105740 0x7f142c105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:17.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:17.261+0000 7f1431c00700 1 --2- 172.21.15.82:0/2152776493 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f142c1072e0 0x7f142c10db90 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:17.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:17.261+0000 7f1431c00700 1 --2- 172.21.15.82:0/2152776493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f142c106940 0x7f142c106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:17.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:17.261+0000 7f1431c00700 1 -- 172.21.15.82:0/2152776493 >> 172.21.15.82:0/2152776493 conn(0x7f142c100d00 msgr2=0x7f142c103120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:49:17.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:17.262+0000 7f1431c00700 1 -- 172.21.15.82:0/2152776493 shutdown_connections 2024-05-08T05:49:17.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:17.262+0000 7f1431c00700 1 -- 172.21.15.82:0/2152776493 wait complete. 2024-05-08T05:49:17.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:17.263+0000 7f1431c00700 1 Processor -- start 2024-05-08T05:49:17.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:17.263+0000 7f1431c00700 1 -- start start 2024-05-08T05:49:17.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:17.263+0000 7f1431c00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f142c105740 0x7f142c19b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:17.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:17.263+0000 7f1431c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f142c106940 0x7f142c19bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:17.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:17.263+0000 7f1431c00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f142c1072e0 0x7f142c1a2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:17.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:17.263+0000 7f1431c00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f142c1111e0 con 0x7f142c106940 2024-05-08T05:49:17.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:17.263+0000 7f1431c00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f142c111060 con 0x7f142c105740 2024-05-08T05:49:17.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:17.263+0000 7f1431c00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f142c111360 con 0x7f142c1072e0 2024-05-08T05:49:17.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:17.263+0000 7f142aa00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f142c105740 0x7f142c19b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:17.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:17.263+0000 7f142a000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f142c106940 0x7f142c19bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:17.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:17.263+0000 7f142aa00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f142c105740 0x7f142c19b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:53494/0 (socket says 172.21.15.82:53494) 2024-05-08T05:49:17.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:17.263+0000 7f142aa00700 1 -- 172.21.15.82:0/2209082466 learned_addr learned my addr 172.21.15.82:0/2209082466 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:49:17.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:17.263+0000 7f142a000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f142c106940 0x7f142c19bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52482/0 (socket says 172.21.15.82:52482) 2024-05-08T05:49:17.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:17.263+0000 7f142b400700 1 --2- 172.21.15.82:0/2209082466 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f142c1072e0 0x7f142c1a2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:17.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:17.264+0000 7f142b400700 1 -- 172.21.15.82:0/2209082466 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f142c105740 msgr2=0x7f142c19b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:17.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:17.264+0000 7f142b400700 1 --2- 172.21.15.82:0/2209082466 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f142c105740 0x7f142c19b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:17.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:17.264+0000 7f142b400700 1 -- 172.21.15.82:0/2209082466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f142c106940 msgr2=0x7f142c19bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:17.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:17.264+0000 7f142b400700 1 --2- 172.21.15.82:0/2209082466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f142c106940 0x7f142c19bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:17.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:17.264+0000 7f142b400700 1 -- 172.21.15.82:0/2209082466 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f142c1a33f0 con 0x7f142c1072e0 2024-05-08T05:49:17.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:17.264+0000 7f142b400700 1 --2- 172.21.15.82:0/2209082466 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f142c1072e0 0x7f142c1a2d50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f142400bfd0 tx=0x7f1424004d00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:49:17.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:17.264+0000 7f1423400700 1 -- 172.21.15.82:0/2209082466 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1424021070 con 0x7f142c1072e0 2024-05-08T05:49:17.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:17.265+0000 7f1423400700 1 -- 172.21.15.82:0/2209082466 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1424007b80 con 0x7f142c1072e0 2024-05-08T05:49:17.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:17.265+0000 7f1431c00700 1 -- 172.21.15.82:0/2209082466 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f142c1a3680 con 0x7f142c1072e0 2024-05-08T05:49:17.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:17.265+0000 7f1423400700 1 -- 172.21.15.82:0/2209082466 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f142401b690 con 0x7f142c1072e0 2024-05-08T05:49:17.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:17.265+0000 7f1431c00700 1 -- 172.21.15.82:0/2209082466 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f142c1a3ad0 con 0x7f142c1072e0 2024-05-08T05:49:17.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:17.266+0000 7f1431c00700 1 -- 172.21.15.82:0/2209082466 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f142c06a190 con 0x7f142c1072e0 2024-05-08T05:49:17.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:17.268+0000 7f1423400700 1 -- 172.21.15.82:0/2209082466 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f1424024070 con 0x7f142c1072e0 2024-05-08T05:49:17.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:17.269+0000 7f1423400700 1 --2- 172.21.15.82:0/2209082466 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f14100b2900 0x7f14100b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:17.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:17.270+0000 7f1423400700 1 -- 172.21.15.82:0/2209082466 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f14240e3210 con 0x7f142c1072e0 2024-05-08T05:49:17.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:17.270+0000 7f142aa00700 1 --2- 172.21.15.82:0/2209082466 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f14100b2900 0x7f14100b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:17.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:17.271+0000 7f142aa00700 1 --2- 172.21.15.82:0/2209082466 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f14100b2900 0x7f14100b4dc0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f141c005950 tx=0x7f141c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:49:17.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:17.272+0000 7f1423400700 1 -- 172.21.15.82:0/2209082466 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f14240aaf70 con 0x7f142c1072e0 2024-05-08T05:49:17.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:17.516+0000 7f1431c00700 1 -- 172.21.15.82:0/2209082466 --> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f142c0638e0 con 0x7f14100b2900 2024-05-08T05:49:17.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:17.520+0000 7f1423400700 1 -- 172.21.15.82:0/2209082466 <== mgr.14152 v2:172.21.15.82:6800/4089180091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f142c0638e0 con 0x7f14100b2900 2024-05-08T05:49:17.520 INFO:teuthology.orchestra.run.smithi082.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-05-08T05:49:17.521 INFO:teuthology.orchestra.run.smithi082.stdout:smithi082 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400SD400BGN 372G No 5m ago Has a FileSystem, LVM detected 2024-05-08T05:49:17.521 INFO:teuthology.orchestra.run.smithi082.stdout:smithi134 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT62420002400BGN 372G No 5m ago Has a FileSystem, LVM detected 2024-05-08T05:49:17.521 INFO:teuthology.orchestra.run.smithi082.stdout:smithi151 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300JJ400BGN 372G No 4m ago Has a FileSystem, LVM detected 2024-05-08T05:49:17.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:17.523+0000 7f1431c00700 1 -- 172.21.15.82:0/2209082466 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f14100b2900 msgr2=0x7f14100b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:17.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:17.523+0000 7f1431c00700 1 --2- 172.21.15.82:0/2209082466 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f14100b2900 0x7f14100b4dc0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f141c005950 tx=0x7f141c009260 comp rx=0 tx=0).stop 2024-05-08T05:49:17.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:17.523+0000 7f1431c00700 1 -- 172.21.15.82:0/2209082466 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f142c1072e0 msgr2=0x7f142c1a2d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:17.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:17.523+0000 7f1431c00700 1 --2- 172.21.15.82:0/2209082466 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f142c1072e0 0x7f142c1a2d50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f142400bfd0 tx=0x7f1424004d00 comp rx=0 tx=0).stop 2024-05-08T05:49:17.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:17.523+0000 7f1431c00700 1 -- 172.21.15.82:0/2209082466 shutdown_connections 2024-05-08T05:49:17.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:17.523+0000 7f1431c00700 1 --2- 172.21.15.82:0/2209082466 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f142c105740 0x7f142c19b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:17.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:17.523+0000 7f1431c00700 1 --2- 172.21.15.82:0/2209082466 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f14100b2900 0x7f14100b4dc0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:17.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:17.523+0000 7f1431c00700 1 --2- 172.21.15.82:0/2209082466 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f142c1072e0 0x7f142c1a2d50 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:17.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:17.523+0000 7f1431c00700 1 --2- 172.21.15.82:0/2209082466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f142c106940 0x7f142c19bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:17.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:17.523+0000 7f1431c00700 1 -- 172.21.15.82:0/2209082466 >> 172.21.15.82:0/2209082466 conn(0x7f142c100d00 msgr2=0x7f142c109c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:49:17.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:17.523+0000 7f1431c00700 1 -- 172.21.15.82:0/2209082466 shutdown_connections 2024-05-08T05:49:17.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:17.523+0000 7f1431c00700 1 -- 172.21.15.82:0/2209082466 wait complete. 2024-05-08T05:49:18.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:49:17 smithi082 ceph-mon[30098]: pgmap v418: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-08T05:49:18.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:49:17 smithi134 ceph-mon[34132]: pgmap v418: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-08T05:49:18.321 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-08T05:49:18.331 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi082.front.sepia.ceph.com 2024-05-08T05:49:18.332 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- bash -c 'ceph fs dump' 2024-05-08T05:49:18.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:49:17 smithi151 ceph-mon[34815]: pgmap v418: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-08T05:49:18.775 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:49:19.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:49:18 smithi082 ceph-mon[30098]: from='client.24988 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:49:19.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:49:18 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:49:19.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:49:18 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:49:19.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:49:18 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:49:19.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:49:18 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:49:19.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:49:18 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:49:19.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:49:18 smithi134 ceph-mon[34132]: from='client.24988 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:49:19.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:49:18 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:49:19.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:49:18 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:49:19.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:49:18 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:49:19.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:49:18 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:49:19.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:49:18 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:49:19.281 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:49:18 smithi151 ceph-mon[34815]: from='client.24988 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:49:19.281 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:49:18 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:49:19.281 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:49:18 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:49:19.281 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:49:18 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:49:19.282 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:49:18 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:49:19.282 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:49:18 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:49:20.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:49:19 smithi151 ceph-mon[34815]: pgmap v419: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:49:20.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:49:19 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:49:20.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:49:19 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:49:20.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:49:19 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:49:20.173 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:49:19 smithi082 ceph-mon[30098]: pgmap v419: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:49:20.174 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:49:19 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:49:20.174 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:49:19 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:49:20.174 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:49:19 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:49:20.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:49:19 smithi134 ceph-mon[34132]: pgmap v419: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:49:20.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:49:19 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:49:20.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:49:19 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:49:20.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:49:19 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:49:20.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:20.981+0000 7fc239400700 1 -- 172.21.15.82:0/84212557 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc234105750 msgr2=0x7fc234105b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:20.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:20.981+0000 7fc239400700 1 --2- 172.21.15.82:0/84212557 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc234105750 0x7fc234105b70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc2240098f0 tx=0x7fc224009c00 comp rx=0 tx=0).stop 2024-05-08T05:49:20.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:20.981+0000 7fc239400700 1 -- 172.21.15.82:0/84212557 shutdown_connections 2024-05-08T05:49:20.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:20.981+0000 7fc239400700 1 --2- 172.21.15.82:0/84212557 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2341072f0 0x7fc23410dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:20.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:20.981+0000 7fc239400700 1 --2- 172.21.15.82:0/84212557 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc234105750 0x7fc234105b70 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:20.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:20.981+0000 7fc239400700 1 --2- 172.21.15.82:0/84212557 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc234106950 0x7fc234106db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:20.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:20.981+0000 7fc239400700 1 -- 172.21.15.82:0/84212557 >> 172.21.15.82:0/84212557 conn(0x7fc234100cf0 msgr2=0x7fc234103130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:49:20.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:20.981+0000 7fc239400700 1 -- 172.21.15.82:0/84212557 shutdown_connections 2024-05-08T05:49:20.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:20.981+0000 7fc239400700 1 -- 172.21.15.82:0/84212557 wait complete. 2024-05-08T05:49:20.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:20.982+0000 7fc239400700 1 Processor -- start 2024-05-08T05:49:20.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:20.982+0000 7fc239400700 1 -- start start 2024-05-08T05:49:20.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:20.983+0000 7fc239400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc234105750 0x7fc23419b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:20.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:20.983+0000 7fc239400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc234106950 0x7fc23419be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:20.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:20.983+0000 7fc239400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2341072f0 0x7fc2341a2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:20.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:20.983+0000 7fc239400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc2341111c0 con 0x7fc2341072f0 2024-05-08T05:49:20.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:20.983+0000 7fc239400700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc234111040 con 0x7fc234106950 2024-05-08T05:49:20.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:20.983+0000 7fc239400700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc234111340 con 0x7fc234105750 2024-05-08T05:49:20.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:20.983+0000 7fc233200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2341072f0 0x7fc2341a2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:20.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:20.983+0000 7fc232800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc234105750 0x7fc23419b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:20.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:20.983+0000 7fc233200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2341072f0 0x7fc2341a2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52508/0 (socket says 172.21.15.82:52508) 2024-05-08T05:49:20.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:20.983+0000 7fc233200700 1 -- 172.21.15.82:0/3054432030 learned_addr learned my addr 172.21.15.82:0/3054432030 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:49:20.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:20.983+0000 7fc231e00700 1 --2- 172.21.15.82:0/3054432030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc234106950 0x7fc23419be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:20.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:20.984+0000 7fc233200700 1 -- 172.21.15.82:0/3054432030 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc234105750 msgr2=0x7fc23419b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:20.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:20.984+0000 7fc233200700 1 --2- 172.21.15.82:0/3054432030 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc234105750 0x7fc23419b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:20.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:20.984+0000 7fc233200700 1 -- 172.21.15.82:0/3054432030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc234106950 msgr2=0x7fc23419be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:20.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:20.984+0000 7fc233200700 1 --2- 172.21.15.82:0/3054432030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc234106950 0x7fc23419be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:20.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:20.984+0000 7fc233200700 1 -- 172.21.15.82:0/3054432030 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2341a3520 con 0x7fc2341072f0 2024-05-08T05:49:20.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:20.984+0000 7fc231e00700 1 --2- 172.21.15.82:0/3054432030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc234106950 0x7fc23419be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:49:20.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:20.984+0000 7fc233200700 1 --2- 172.21.15.82:0/3054432030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2341072f0 0x7fc2341a2e80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc22c00e3f0 tx=0x7fc22c00e700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:49:20.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:20.984+0000 7fc22b400700 1 -- 172.21.15.82:0/3054432030 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc22c0090d0 con 0x7fc2341072f0 2024-05-08T05:49:20.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:20.984+0000 7fc22b400700 1 -- 172.21.15.82:0/3054432030 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc22c009270 con 0x7fc2341072f0 2024-05-08T05:49:20.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:20.984+0000 7fc239400700 1 -- 172.21.15.82:0/3054432030 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2341a3810 con 0x7fc2341072f0 2024-05-08T05:49:20.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:20.984+0000 7fc22b400700 1 -- 172.21.15.82:0/3054432030 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc22c004030 con 0x7fc2341072f0 2024-05-08T05:49:20.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:20.984+0000 7fc239400700 1 -- 172.21.15.82:0/3054432030 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2341a3d00 con 0x7fc2341072f0 2024-05-08T05:49:20.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:20.986+0000 7fc239400700 1 -- 172.21.15.82:0/3054432030 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc23406a190 con 0x7fc2341072f0 2024-05-08T05:49:20.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:20.988+0000 7fc22b400700 1 -- 172.21.15.82:0/3054432030 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fc22c012050 con 0x7fc2341072f0 2024-05-08T05:49:20.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:20.989+0000 7fc22b400700 1 --2- 172.21.15.82:0/3054432030 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc2180b2880 0x7fc2180b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:20.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:20.989+0000 7fc22b400700 1 -- 172.21.15.82:0/3054432030 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fc22c0e1e80 con 0x7fc2341072f0 2024-05-08T05:49:20.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:20.990+0000 7fc232800700 1 --2- 172.21.15.82:0/3054432030 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc2180b2880 0x7fc2180b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:20.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:20.990+0000 7fc232800700 1 --2- 172.21.15.82:0/3054432030 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc2180b2880 0x7fc2180b4d40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc224009fd0 tx=0x7fc224019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:49:20.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:20.994+0000 7fc22b400700 1 -- 172.21.15.82:0/3054432030 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc22c022020 con 0x7fc2341072f0 2024-05-08T05:49:21.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:21.282+0000 7fc239400700 1 -- 172.21.15.82:0/3054432030 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fc2340640b0 con 0x7fc2341072f0 2024-05-08T05:49:21.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:21.283+0000 7fc22b400700 1 -- 172.21.15.82:0/3054432030 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) ==== 76+0+3102 (secure 0 0 0) 0x7fc22c010040 con 0x7fc2341072f0 2024-05-08T05:49:21.284 INFO:teuthology.orchestra.run.smithi082.stdout:e28 2024-05-08T05:49:21.284 INFO:teuthology.orchestra.run.smithi082.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-08T05:49:21.284 INFO:teuthology.orchestra.run.smithi082.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-08T05:49:21.284 INFO:teuthology.orchestra.run.smithi082.stdout:legacy client fscid: 1 2024-05-08T05:49:21.284 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:49:21.284 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem 'cephfs' (1) 2024-05-08T05:49:21.284 INFO:teuthology.orchestra.run.smithi082.stdout:fs_name cephfs 2024-05-08T05:49:21.285 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 28 2024-05-08T05:49:21.285 INFO:teuthology.orchestra.run.smithi082.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-05-08T05:49:21.285 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-05-08T05:45:57.654009+0000 2024-05-08T05:49:21.285 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-05-08T05:46:21.713129+0000 2024-05-08T05:49:21.285 INFO:teuthology.orchestra.run.smithi082.stdout:tableserver 0 2024-05-08T05:49:21.285 INFO:teuthology.orchestra.run.smithi082.stdout:root 0 2024-05-08T05:49:21.285 INFO:teuthology.orchestra.run.smithi082.stdout:session_timeout 300 2024-05-08T05:49:21.285 INFO:teuthology.orchestra.run.smithi082.stdout:session_autoclose 300 2024-05-08T05:49:21.285 INFO:teuthology.orchestra.run.smithi082.stdout:max_file_size 1099511627776 2024-05-08T05:49:21.285 INFO:teuthology.orchestra.run.smithi082.stdout:max_xattr_size 65536 2024-05-08T05:49:21.285 INFO:teuthology.orchestra.run.smithi082.stdout:required_client_features {} 2024-05-08T05:49:21.285 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure 0 2024-05-08T05:49:21.285 INFO:teuthology.orchestra.run.smithi082.stdout:last_failure_osd_epoch 0 2024-05-08T05:49:21.285 INFO:teuthology.orchestra.run.smithi082.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-08T05:49:21.286 INFO:teuthology.orchestra.run.smithi082.stdout:max_mds 5 2024-05-08T05:49:21.286 INFO:teuthology.orchestra.run.smithi082.stdout:in 0,1,2,3,4 2024-05-08T05:49:21.286 INFO:teuthology.orchestra.run.smithi082.stdout:up {0=24506,1=24505,2=24487,3=24475,4=24467} 2024-05-08T05:49:21.286 INFO:teuthology.orchestra.run.smithi082.stdout:failed 2024-05-08T05:49:21.286 INFO:teuthology.orchestra.run.smithi082.stdout:damaged 2024-05-08T05:49:21.286 INFO:teuthology.orchestra.run.smithi082.stdout:stopped 2024-05-08T05:49:21.286 INFO:teuthology.orchestra.run.smithi082.stdout:data_pools [3] 2024-05-08T05:49:21.286 INFO:teuthology.orchestra.run.smithi082.stdout:metadata_pool 2 2024-05-08T05:49:21.286 INFO:teuthology.orchestra.run.smithi082.stdout:inline_data disabled 2024-05-08T05:49:21.286 INFO:teuthology.orchestra.run.smithi082.stdout:balancer 2024-05-08T05:49:21.287 INFO:teuthology.orchestra.run.smithi082.stdout:bal_rank_mask -1 2024-05-08T05:49:21.287 INFO:teuthology.orchestra.run.smithi082.stdout:standby_count_wanted 0 2024-05-08T05:49:21.287 INFO:teuthology.orchestra.run.smithi082.stdout:qdb_cluster leader: 24506 members: 24467,24475,24487,24505,24506 2024-05-08T05:49:21.287 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.b{0:24506} state up:active seq 7 addr [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] compat {c=[1],r=[1],i=[1fff]}] 2024-05-08T05:49:21.287 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.e{0:24455} state up:standby-replay seq 1 addr [v2:172.21.15.134:6834/4074163402,v1:172.21.15.134:6835/4074163402] compat {c=[1],r=[1],i=[1fff]}] 2024-05-08T05:49:21.287 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.i{1:24505} state up:active seq 14 addr [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] compat {c=[1],r=[1],i=[1fff]}] 2024-05-08T05:49:21.287 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.l{1:24430} state up:standby-replay seq 1 addr [v2:172.21.15.151:6832/3625067797,v1:172.21.15.151:6833/3625067797] compat {c=[1],r=[1],i=[1fff]}] 2024-05-08T05:49:21.287 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.c{2:24487} state up:active seq 16 addr [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] compat {c=[1],r=[1],i=[1fff]}] 2024-05-08T05:49:21.287 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.k{2:24425} state up:standby-replay seq 1 addr [v2:172.21.15.134:6832/3827691638,v1:172.21.15.134:6833/3827691638] compat {c=[1],r=[1],i=[1fff]}] 2024-05-08T05:49:21.287 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.f{3:24475} state up:active seq 17 addr [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] compat {c=[1],r=[1],i=[1fff]}] 2024-05-08T05:49:21.287 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.a{3:14409} state up:standby-replay seq 1 addr [v2:172.21.15.82:6840/2957083305,v1:172.21.15.82:6841/2957083305] compat {c=[1],r=[1],i=[1fff]}] 2024-05-08T05:49:21.287 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.h{4:24467} state up:active seq 16 addr [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] compat {c=[1],r=[1],i=[1fff]}] 2024-05-08T05:49:21.287 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.g{4:14397} state up:standby-replay seq 1 addr [v2:172.21.15.82:6838/1890720973,v1:172.21.15.82:6839/1890720973] compat {c=[1],r=[1],i=[1fff]}] 2024-05-08T05:49:21.287 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:49:21.288 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:49:21.288 INFO:teuthology.orchestra.run.smithi082.stdout:Standby daemons: 2024-05-08T05:49:21.288 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:49:21.288 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.j{-1:14364} state up:standby seq 1 addr [v2:172.21.15.82:6834/3876883250,v1:172.21.15.82:6835/3876883250] compat {c=[1],r=[1],i=[1fff]}] 2024-05-08T05:49:21.288 INFO:teuthology.orchestra.run.smithi082.stdout:[mds.d{-1:14370} state up:standby seq 1 addr [v2:172.21.15.82:6836/1965070586,v1:172.21.15.82:6837/1965070586] compat {c=[1],r=[1],i=[1fff]}] 2024-05-08T05:49:21.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:21.286+0000 7fc239400700 1 -- 172.21.15.82:0/3054432030 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc2180b2880 msgr2=0x7fc2180b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:21.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:21.286+0000 7fc239400700 1 --2- 172.21.15.82:0/3054432030 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc2180b2880 0x7fc2180b4d40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc224009fd0 tx=0x7fc224019040 comp rx=0 tx=0).stop 2024-05-08T05:49:21.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:21.286+0000 7fc239400700 1 -- 172.21.15.82:0/3054432030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2341072f0 msgr2=0x7fc2341a2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:21.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:21.286+0000 7fc239400700 1 --2- 172.21.15.82:0/3054432030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2341072f0 0x7fc2341a2e80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc22c00e3f0 tx=0x7fc22c00e700 comp rx=0 tx=0).stop 2024-05-08T05:49:21.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:21.286+0000 7fc239400700 1 -- 172.21.15.82:0/3054432030 shutdown_connections 2024-05-08T05:49:21.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:21.286+0000 7fc239400700 1 --2- 172.21.15.82:0/3054432030 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc2180b2880 0x7fc2180b4d40 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:21.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:21.286+0000 7fc239400700 1 --2- 172.21.15.82:0/3054432030 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc2341072f0 0x7fc2341a2e80 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:21.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:21.286+0000 7fc239400700 1 --2- 172.21.15.82:0/3054432030 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc234105750 0x7fc23419b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:21.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:21.286+0000 7fc239400700 1 --2- 172.21.15.82:0/3054432030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc234106950 0x7fc23419be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:21.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:21.286+0000 7fc239400700 1 -- 172.21.15.82:0/3054432030 >> 172.21.15.82:0/3054432030 conn(0x7fc234100cf0 msgr2=0x7fc234109e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:49:21.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:21.287+0000 7fc239400700 1 -- 172.21.15.82:0/3054432030 shutdown_connections 2024-05-08T05:49:21.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:21.287+0000 7fc239400700 1 -- 172.21.15.82:0/3054432030 wait complete. 2024-05-08T05:49:21.289 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 28 2024-05-08T05:49:22.063 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- bash -c 'ceph osd dump' 2024-05-08T05:49:22.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:49:21 smithi082 ceph-mon[30098]: pgmap v420: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-05-08T05:49:22.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:49:21 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/3054432030' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-08T05:49:22.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:49:21 smithi134 ceph-mon[34132]: pgmap v420: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-05-08T05:49:22.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:49:21 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/3054432030' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-08T05:49:22.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:49:21 smithi151 ceph-mon[34815]: pgmap v420: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-05-08T05:49:22.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:49:21 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/3054432030' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-08T05:49:22.538 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:49:23.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:49:22 smithi134 ceph-mon[34132]: pgmap v421: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:49:23.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:49:22 smithi151 ceph-mon[34815]: pgmap v421: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:49:23.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:49:22 smithi082 ceph-mon[30098]: pgmap v421: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:49:24.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:24.714+0000 7fab00000700 1 -- 172.21.15.82:0/1433466781 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faaf810b3d0 msgr2=0x7faaf810d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:24.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:24.714+0000 7fab00000700 1 --2- 172.21.15.82:0/1433466781 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faaf810b3d0 0x7faaf810d860 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7faaf000b0a0 tx=0x7faaf000b3b0 comp rx=0 tx=0).stop 2024-05-08T05:49:24.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:24.714+0000 7fab00000700 1 -- 172.21.15.82:0/1433466781 shutdown_connections 2024-05-08T05:49:24.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:24.714+0000 7fab00000700 1 --2- 172.21.15.82:0/1433466781 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faaf80774d0 0x7faaf8075930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:24.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:24.714+0000 7fab00000700 1 --2- 172.21.15.82:0/1433466781 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faaf810b3d0 0x7faaf810d860 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:24.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:24.714+0000 7fab00000700 1 --2- 172.21.15.82:0/1433466781 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faaf8075f00 0x7faaf8076380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:24.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:24.715+0000 7fab00000700 1 -- 172.21.15.82:0/1433466781 >> 172.21.15.82:0/1433466781 conn(0x7faaf80feaa0 msgr2=0x7faaf8100ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:49:24.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:24.715+0000 7fab00000700 1 -- 172.21.15.82:0/1433466781 shutdown_connections 2024-05-08T05:49:24.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:24.715+0000 7fab00000700 1 -- 172.21.15.82:0/1433466781 wait complete. 2024-05-08T05:49:24.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:24.716+0000 7fab00000700 1 Processor -- start 2024-05-08T05:49:24.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:24.716+0000 7fab00000700 1 -- start start 2024-05-08T05:49:24.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:24.717+0000 7fab00000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faaf8075f00 0x7faaf819b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:24.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:24.717+0000 7fab00000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faaf80774d0 0x7faaf819bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:24.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:24.717+0000 7fab00000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faaf810b3d0 0x7faaf81a2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:24.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:24.717+0000 7fab00000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7faaf81111b0 con 0x7faaf80774d0 2024-05-08T05:49:24.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:24.717+0000 7fab00000700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7faaf8111030 con 0x7faaf810b3d0 2024-05-08T05:49:24.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:24.717+0000 7fab00000700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7faaf8111330 con 0x7faaf8075f00 2024-05-08T05:49:24.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:24.717+0000 7faafcc00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faaf80774d0 0x7faaf819bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:24.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:24.717+0000 7faafcc00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faaf80774d0 0x7faaf819bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45614/0 (socket says 172.21.15.82:45614) 2024-05-08T05:49:24.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:24.717+0000 7faafcc00700 1 -- 172.21.15.82:0/3011140353 learned_addr learned my addr 172.21.15.82:0/3011140353 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:49:24.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:24.717+0000 7faafd600700 1 --2- 172.21.15.82:0/3011140353 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faaf8075f00 0x7faaf819b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:24.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:24.717+0000 7faafe000700 1 --2- 172.21.15.82:0/3011140353 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faaf810b3d0 0x7faaf81a2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:24.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:24.718+0000 7faafd600700 1 -- 172.21.15.82:0/3011140353 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faaf810b3d0 msgr2=0x7faaf81a2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:24.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:24.718+0000 7faafd600700 1 --2- 172.21.15.82:0/3011140353 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faaf810b3d0 0x7faaf81a2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:24.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:24.718+0000 7faafd600700 1 -- 172.21.15.82:0/3011140353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faaf80774d0 msgr2=0x7faaf819bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:24.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:24.718+0000 7faafd600700 1 --2- 172.21.15.82:0/3011140353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faaf80774d0 0x7faaf819bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:24.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:24.718+0000 7faafd600700 1 -- 172.21.15.82:0/3011140353 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaf81a3470 con 0x7faaf8075f00 2024-05-08T05:49:24.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:24.718+0000 7faafcc00700 1 --2- 172.21.15.82:0/3011140353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faaf80774d0 0x7faaf819bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:49:24.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:24.718+0000 7faafe000700 1 --2- 172.21.15.82:0/3011140353 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faaf810b3d0 0x7faaf81a2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:49:24.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:24.718+0000 7faafd600700 1 --2- 172.21.15.82:0/3011140353 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faaf8075f00 0x7faaf819b810 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7faaec00e9f0 tx=0x7faaec00ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:49:24.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:24.718+0000 7faaf6000700 1 -- 172.21.15.82:0/3011140353 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaec00c9c0 con 0x7faaf8075f00 2024-05-08T05:49:24.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:24.718+0000 7fab00000700 1 -- 172.21.15.82:0/3011140353 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaf81a3760 con 0x7faaf8075f00 2024-05-08T05:49:24.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:24.718+0000 7faaf6000700 1 -- 172.21.15.82:0/3011140353 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faaec010430 con 0x7faaf8075f00 2024-05-08T05:49:24.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:24.718+0000 7faaf6000700 1 -- 172.21.15.82:0/3011140353 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaec018680 con 0x7faaf8075f00 2024-05-08T05:49:24.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:24.718+0000 7fab00000700 1 -- 172.21.15.82:0/3011140353 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaf81a3ca0 con 0x7faaf8075f00 2024-05-08T05:49:24.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:24.719+0000 7fab00000700 1 -- 172.21.15.82:0/3011140353 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaf806a190 con 0x7faaf8075f00 2024-05-08T05:49:24.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:24.722+0000 7faaf6000700 1 -- 172.21.15.82:0/3011140353 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7faaec0108e0 con 0x7faaf8075f00 2024-05-08T05:49:24.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:24.723+0000 7faaf6000700 1 --2- 172.21.15.82:0/3011140353 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7faae00b2880 0x7faae00b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:24.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:24.723+0000 7faaf6000700 1 -- 172.21.15.82:0/3011140353 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7faaec0e22f0 con 0x7faaf8075f00 2024-05-08T05:49:24.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:24.723+0000 7faafcc00700 1 --2- 172.21.15.82:0/3011140353 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7faae00b2880 0x7faae00b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:24.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:24.724+0000 7faafcc00700 1 --2- 172.21.15.82:0/3011140353 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7faae00b2880 0x7faae00b4d40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7faae4005950 tx=0x7faae4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:49:24.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:24.725+0000 7faaf6000700 1 -- 172.21.15.82:0/3011140353 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7faaec0a9fc0 con 0x7faaf8075f00 2024-05-08T05:49:24.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:24.958+0000 7fab00000700 1 -- 172.21.15.82:0/3011140353 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7faaf80640b0 con 0x7faaf8075f00 2024-05-08T05:49:24.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:24.960+0000 7faaf6000700 1 -- 172.21.15.82:0/3011140353 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v82) ==== 56+0+5278 (secure 0 0 0) 0x7faaec0a98c0 con 0x7faaf8075f00 2024-05-08T05:49:24.962 INFO:teuthology.orchestra.run.smithi082.stdout:epoch 82 2024-05-08T05:49:24.962 INFO:teuthology.orchestra.run.smithi082.stdout:fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 2024-05-08T05:49:24.963 INFO:teuthology.orchestra.run.smithi082.stdout:created 2024-05-08T05:36:37.441393+0000 2024-05-08T05:49:24.963 INFO:teuthology.orchestra.run.smithi082.stdout:modified 2024-05-08T05:46:45.754375+0000 2024-05-08T05:49:24.963 INFO:teuthology.orchestra.run.smithi082.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-05-08T05:49:24.963 INFO:teuthology.orchestra.run.smithi082.stdout:crush_version 26 2024-05-08T05:49:24.963 INFO:teuthology.orchestra.run.smithi082.stdout:full_ratio 0.95 2024-05-08T05:49:24.963 INFO:teuthology.orchestra.run.smithi082.stdout:backfillfull_ratio 0.9 2024-05-08T05:49:24.963 INFO:teuthology.orchestra.run.smithi082.stdout:nearfull_ratio 0.85 2024-05-08T05:49:24.963 INFO:teuthology.orchestra.run.smithi082.stdout:require_min_compat_client luminous 2024-05-08T05:49:24.963 INFO:teuthology.orchestra.run.smithi082.stdout:min_compat_client luminous 2024-05-08T05:49:24.963 INFO:teuthology.orchestra.run.smithi082.stdout:require_osd_release squid 2024-05-08T05:49:24.963 INFO:teuthology.orchestra.run.smithi082.stdout:stretch_mode_enabled false 2024-05-08T05:49:24.963 INFO:teuthology.orchestra.run.smithi082.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-05-08T05:49:24.964 INFO:teuthology.orchestra.run.smithi082.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 80 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-05-08T05:49:24.964 INFO:teuthology.orchestra.run.smithi082.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 80 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-05-08T05:49:24.964 INFO:teuthology.orchestra.run.smithi082.stdout:max_osd 12 2024-05-08T05:49:24.964 INFO:teuthology.orchestra.run.smithi082.stdout:osd.0 up in weight 1 up_from 8 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.82:6802/4051651615,v1:172.21.15.82:6803/4051651615] [v2:172.21.15.82:6804/4051651615,v1:172.21.15.82:6805/4051651615] exists,up bc9bd472-b765-4893-84ed-c66b5c1c61b1 2024-05-08T05:49:24.964 INFO:teuthology.orchestra.run.smithi082.stdout:osd.1 up in weight 1 up_from 13 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6800/2763858634,v1:172.21.15.134:6801/2763858634] [v2:172.21.15.134:6802/2763858634,v1:172.21.15.134:6803/2763858634] exists,up ad2d3a6b-8bc5-4177-8757-07e8607ca240 2024-05-08T05:49:24.964 INFO:teuthology.orchestra.run.smithi082.stdout:osd.2 up in weight 1 up_from 18 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.151:6800/4193933269,v1:172.21.15.151:6801/4193933269] [v2:172.21.15.151:6802/4193933269,v1:172.21.15.151:6803/4193933269] exists,up a06dc8fc-7324-4e42-9487-8cfe372401b6 2024-05-08T05:49:24.964 INFO:teuthology.orchestra.run.smithi082.stdout:osd.3 up in weight 1 up_from 26 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.82:6810/2775272422,v1:172.21.15.82:6811/2775272422] [v2:172.21.15.82:6812/2775272422,v1:172.21.15.82:6813/2775272422] exists,up b8c8bdcd-fbd7-4494-976e-7285408e010e 2024-05-08T05:49:24.964 INFO:teuthology.orchestra.run.smithi082.stdout:osd.4 up in weight 1 up_from 32 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6808/3565208751,v1:172.21.15.134:6809/3565208751] [v2:172.21.15.134:6810/3565208751,v1:172.21.15.134:6811/3565208751] exists,up 391a6040-03d1-483c-9058-308b5998e7c5 2024-05-08T05:49:24.964 INFO:teuthology.orchestra.run.smithi082.stdout:osd.5 up in weight 1 up_from 37 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.151:6808/1925634069,v1:172.21.15.151:6809/1925634069] [v2:172.21.15.151:6810/1925634069,v1:172.21.15.151:6811/1925634069] exists,up dacce079-4aad-474e-b747-1ed60c3c71cf 2024-05-08T05:49:24.964 INFO:teuthology.orchestra.run.smithi082.stdout:osd.6 up in weight 1 up_from 43 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.82:6818/762647976,v1:172.21.15.82:6819/762647976] [v2:172.21.15.82:6820/762647976,v1:172.21.15.82:6821/762647976] exists,up 6a445bf4-09c4-4e9b-be6e-68ef3c05b365 2024-05-08T05:49:24.964 INFO:teuthology.orchestra.run.smithi082.stdout:osd.7 up in weight 1 up_from 48 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6816/3006846927,v1:172.21.15.134:6817/3006846927] [v2:172.21.15.134:6818/3006846927,v1:172.21.15.134:6819/3006846927] exists,up 72b0c735-ef30-4823-8ab8-2e5bf7cc3c93 2024-05-08T05:49:24.964 INFO:teuthology.orchestra.run.smithi082.stdout:osd.8 up in weight 1 up_from 54 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.151:6816/787870717,v1:172.21.15.151:6817/787870717] [v2:172.21.15.151:6818/787870717,v1:172.21.15.151:6819/787870717] exists,up 93e4da0f-48ea-4ab7-b612-26b545b76de6 2024-05-08T05:49:24.964 INFO:teuthology.orchestra.run.smithi082.stdout:osd.9 up in weight 1 up_from 60 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.82:6826/533124002,v1:172.21.15.82:6827/533124002] [v2:172.21.15.82:6828/533124002,v1:172.21.15.82:6829/533124002] exists,up ea0070c1-286a-47d3-90cf-d1fada6e3cda 2024-05-08T05:49:24.964 INFO:teuthology.orchestra.run.smithi082.stdout:osd.10 up in weight 1 up_from 66 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6824/99154842,v1:172.21.15.134:6825/99154842] [v2:172.21.15.134:6826/99154842,v1:172.21.15.134:6827/99154842] exists,up 26ca0a0b-ab9e-472f-bb29-428e8c31e5bd 2024-05-08T05:49:24.964 INFO:teuthology.orchestra.run.smithi082.stdout:osd.11 up in weight 1 up_from 72 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.151:6824/2242771269,v1:172.21.15.151:6825/2242771269] [v2:172.21.15.151:6826/2242771269,v1:172.21.15.151:6827/2242771269] exists,up 9ae5dca4-acfb-4a46-8601-9d642efde794 2024-05-08T05:49:24.965 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 2.13 [2,11] 2024-05-08T05:49:24.965 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 2.14 [2,4] 2024-05-08T05:49:24.965 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 2.1a [8,1] 2024-05-08T05:49:24.965 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 2.1d [8,11] 2024-05-08T05:49:24.965 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 3.17 [4,8] 2024-05-08T05:49:24.965 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 3.1d [5,9] 2024-05-08T05:49:24.965 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 3.1e [3,9] 2024-05-08T05:49:24.965 INFO:teuthology.orchestra.run.smithi082.stdout:pg_upmap_items 3.2c [4,9] 2024-05-08T05:49:24.965 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:0/2761274596 expires 2024-05-09T05:37:43.951218+0000 2024-05-08T05:49:24.965 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:0/2195734928 expires 2024-05-09T05:37:43.951218+0000 2024-05-08T05:49:24.965 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:6801/765895649 expires 2024-05-09T05:37:43.951218+0000 2024-05-08T05:49:24.965 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:6800/3546670887 expires 2024-05-09T05:37:11.114057+0000 2024-05-08T05:49:24.965 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:6800/765895649 expires 2024-05-09T05:37:43.951218+0000 2024-05-08T05:49:24.965 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:0/3986150437 expires 2024-05-09T05:37:11.114057+0000 2024-05-08T05:49:24.965 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:0/3457457714 expires 2024-05-09T05:37:11.114057+0000 2024-05-08T05:49:24.966 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:0/2356749286 expires 2024-05-09T05:37:11.114057+0000 2024-05-08T05:49:24.966 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:6801/3546670887 expires 2024-05-09T05:37:11.114057+0000 2024-05-08T05:49:24.966 INFO:teuthology.orchestra.run.smithi082.stdout:blocklist 172.21.15.82:0/1694643083 expires 2024-05-09T05:37:43.951218+0000 2024-05-08T05:49:24.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:24.963+0000 7fab00000700 1 -- 172.21.15.82:0/3011140353 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7faae00b2880 msgr2=0x7faae00b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:24.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:24.963+0000 7fab00000700 1 --2- 172.21.15.82:0/3011140353 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7faae00b2880 0x7faae00b4d40 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7faae4005950 tx=0x7faae4009260 comp rx=0 tx=0).stop 2024-05-08T05:49:24.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:24.963+0000 7fab00000700 1 -- 172.21.15.82:0/3011140353 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faaf8075f00 msgr2=0x7faaf819b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:24.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:24.963+0000 7fab00000700 1 --2- 172.21.15.82:0/3011140353 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faaf8075f00 0x7faaf819b810 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7faaec00e9f0 tx=0x7faaec00ed00 comp rx=0 tx=0).stop 2024-05-08T05:49:24.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:24.964+0000 7fab00000700 1 -- 172.21.15.82:0/3011140353 shutdown_connections 2024-05-08T05:49:24.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:24.964+0000 7fab00000700 1 --2- 172.21.15.82:0/3011140353 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faaf810b3d0 0x7faaf81a2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:24.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:24.964+0000 7fab00000700 1 --2- 172.21.15.82:0/3011140353 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7faae00b2880 0x7faae00b4d40 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:24.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:24.964+0000 7fab00000700 1 --2- 172.21.15.82:0/3011140353 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faaf8075f00 0x7faaf819b810 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:24.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:24.964+0000 7fab00000700 1 --2- 172.21.15.82:0/3011140353 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faaf80774d0 0x7faaf819bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:24.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:24.964+0000 7fab00000700 1 -- 172.21.15.82:0/3011140353 >> 172.21.15.82:0/3011140353 conn(0x7faaf80feaa0 msgr2=0x7faaf81072d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:49:24.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:24.964+0000 7fab00000700 1 -- 172.21.15.82:0/3011140353 shutdown_connections 2024-05-08T05:49:24.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:24.964+0000 7fab00000700 1 -- 172.21.15.82:0/3011140353 wait complete. 2024-05-08T05:49:25.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:49:25 smithi134 ceph-mon[34132]: pgmap v422: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-08T05:49:25.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:49:25 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/3011140353' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-08T05:49:25.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:49:25 smithi151 ceph-mon[34815]: pgmap v422: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-08T05:49:25.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:49:25 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/3011140353' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-08T05:49:25.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:49:25 smithi082 ceph-mon[30098]: pgmap v422: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-08T05:49:25.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:49:25 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/3011140353' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-08T05:49:25.791 INFO:teuthology.run_tasks:Running task fs.ready... 2024-05-08T05:49:25.802 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T05:49:26.267 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:49:27.499 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:49:27 smithi134 ceph-mon[34132]: pgmap v423: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-08T05:49:27.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:49:27 smithi151 ceph-mon[34815]: pgmap v423: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-08T05:49:27.636 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:49:27 smithi082 ceph-mon[30098]: pgmap v423: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-08T05:49:28.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:28.457+0000 7f890d800700 1 -- 172.21.15.82:0/850145502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8908106080 msgr2=0x7f8908112590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:28.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:28.457+0000 7f890d800700 1 --2- 172.21.15.82:0/850145502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8908106080 0x7f8908112590 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f890000b0a0 tx=0x7f890000b3b0 comp rx=0 tx=0).stop 2024-05-08T05:49:28.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:28.457+0000 7f890d800700 1 -- 172.21.15.82:0/850145502 shutdown_connections 2024-05-08T05:49:28.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:28.457+0000 7f890d800700 1 --2- 172.21.15.82:0/850145502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8908106080 0x7f8908112590 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:28.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:28.457+0000 7f890d800700 1 --2- 172.21.15.82:0/850145502 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f890810b6c0 0x7f890810baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:28.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:28.457+0000 7f890d800700 1 --2- 172.21.15.82:0/850145502 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89081056c0 0x7f8908105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:28.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:28.457+0000 7f890d800700 1 -- 172.21.15.82:0/850145502 >> 172.21.15.82:0/850145502 conn(0x7f8908101170 msgr2=0x7f8908103590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:49:28.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:28.457+0000 7f890d800700 1 -- 172.21.15.82:0/850145502 shutdown_connections 2024-05-08T05:49:28.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:28.457+0000 7f890d800700 1 -- 172.21.15.82:0/850145502 wait complete. 2024-05-08T05:49:28.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:28.458+0000 7f890d800700 1 Processor -- start 2024-05-08T05:49:28.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:28.459+0000 7f890d800700 1 -- start start 2024-05-08T05:49:28.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:28.459+0000 7f890d800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89081056c0 0x7f890819bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:28.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:28.459+0000 7f890d800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8908106080 0x7f890819c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:28.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:28.459+0000 7f890d800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f890810b6c0 0x7f89081a0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:28.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:28.459+0000 7f890d800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8908115900 con 0x7f89081056c0 2024-05-08T05:49:28.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:28.459+0000 7f890d800700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8908115780 con 0x7f8908106080 2024-05-08T05:49:28.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:28.459+0000 7f890d800700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8908115a80 con 0x7f890810b6c0 2024-05-08T05:49:28.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:28.459+0000 7f8906a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89081056c0 0x7f890819bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:28.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:28.459+0000 7f8906a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89081056c0 0x7f890819bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45618/0 (socket says 172.21.15.82:45618) 2024-05-08T05:49:28.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:28.459+0000 7f8906a00700 1 -- 172.21.15.82:0/2423433327 learned_addr learned my addr 172.21.15.82:0/2423433327 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:49:28.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:28.459+0000 7f8906000700 1 --2- 172.21.15.82:0/2423433327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8908106080 0x7f890819c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:28.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:28.460+0000 7f8907400700 1 --2- 172.21.15.82:0/2423433327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f890810b6c0 0x7f89081a0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:28.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:28.460+0000 7f8906000700 1 -- 172.21.15.82:0/2423433327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f890810b6c0 msgr2=0x7f89081a0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:28.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:28.460+0000 7f8906000700 1 --2- 172.21.15.82:0/2423433327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f890810b6c0 0x7f89081a0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:28.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:28.460+0000 7f8906000700 1 -- 172.21.15.82:0/2423433327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89081056c0 msgr2=0x7f890819bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:28.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:28.460+0000 7f8906000700 1 --2- 172.21.15.82:0/2423433327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89081056c0 0x7f890819bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:28.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:28.460+0000 7f8906000700 1 -- 172.21.15.82:0/2423433327 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89081a0d60 con 0x7f8908106080 2024-05-08T05:49:28.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:28.460+0000 7f8906000700 1 --2- 172.21.15.82:0/2423433327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8908106080 0x7f890819c290 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f88f400e9f0 tx=0x7f88f400ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:49:28.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:28.461+0000 7f88ff400700 1 -- 172.21.15.82:0/2423433327 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f400c9c0 con 0x7f8908106080 2024-05-08T05:49:28.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:28.461+0000 7f88ff400700 1 -- 172.21.15.82:0/2423433327 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f88f400cb60 con 0x7f8908106080 2024-05-08T05:49:28.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:28.461+0000 7f88ff400700 1 -- 172.21.15.82:0/2423433327 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88f4018680 con 0x7f8908106080 2024-05-08T05:49:28.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:28.461+0000 7f890d800700 1 -- 172.21.15.82:0/2423433327 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89081a1050 con 0x7f8908106080 2024-05-08T05:49:28.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:28.461+0000 7f890d800700 1 -- 172.21.15.82:0/2423433327 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89081a88d0 con 0x7f8908106080 2024-05-08T05:49:28.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:28.462+0000 7f890d800700 1 -- 172.21.15.82:0/2423433327 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f890806a190 con 0x7f8908106080 2024-05-08T05:49:28.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:28.465+0000 7f88ff400700 1 -- 172.21.15.82:0/2423433327 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f88f4010430 con 0x7f8908106080 2024-05-08T05:49:28.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:28.466+0000 7f88ff400700 1 --2- 172.21.15.82:0/2423433327 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f88ec0b2880 0x7f88ec0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:28.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:28.467+0000 7f88ff400700 1 -- 172.21.15.82:0/2423433327 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f88f40e2730 con 0x7f8908106080 2024-05-08T05:49:28.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:28.467+0000 7f8906a00700 1 --2- 172.21.15.82:0/2423433327 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f88ec0b2880 0x7f88ec0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:28.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:28.467+0000 7f8906a00700 1 --2- 172.21.15.82:0/2423433327 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f88ec0b2880 0x7f88ec0b4d40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f88f8009680 tx=0x7f88f8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:49:28.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:28.469+0000 7f88ff400700 1 -- 172.21.15.82:0/2423433327 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f88f40aa400 con 0x7f8908106080 2024-05-08T05:49:28.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:28.750+0000 7f890d800700 1 -- 172.21.15.82:0/2423433327 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f890802e510 con 0x7f8908106080 2024-05-08T05:49:28.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:28.751+0000 7f88ff400700 1 -- 172.21.15.82:0/2423433327 <== mon.2 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11948 (secure 0 0 0) 0x7f88f40a9d00 con 0x7f8908106080 2024-05-08T05:49:28.752 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:49:28.752 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14364,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3876883250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3876883250},{"type":"v1","addr":"172.21.15.82:6835","nonce":3876883250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1965070586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1965070586},{"type":"v1","addr":"172.21.15.82:6837","nonce":1965070586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T05:45:57.654009+0000","modified":"2024-05-08T05:46:21.713129+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24505,"mds_2":24487,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14397":{"gid":14397,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/1890720973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1890720973},{"type":"v1","addr":"172.21.15.82:6839","nonce":1890720973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14409":{"gid":14409,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/2957083305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":2957083305},{"type":"v1","addr":"172.21.15.82:6841","nonce":2957083305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6833/3827691638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3827691638},{"type":"v1","addr":"172.21.15.134:6833","nonce":3827691638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6833/3625067797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3625067797},{"type":"v1","addr":"172.21.15.151:6833","nonce":3625067797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/4074163402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4074163402},{"type":"v1","addr":"172.21.15.134:6835","nonce":4074163402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.134:6837/2212411710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2212411710},{"type":"v1","addr":"172.21.15.134:6837","nonce":2212411710}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":17,"addr":"172.21.15.151:6835/2093655929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2093655929},{"type":"v1","addr":"172.21.15.151:6835","nonce":2093655929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6837/4192404464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":4192404464},{"type":"v1","addr":"172.21.15.151:6837","nonce":4192404464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":14,"addr":"172.21.15.151:6839/2963754236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":2963754236},{"type":"v1","addr":"172.21.15.151:6839","nonce":2963754236}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.134:6839/1145270893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1145270893},{"type":"v1","addr":"172.21.15.134:6839","nonce":1145270893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24467,24475,24487,24505,24506]},"id":1}]} 2024-05-08T05:49:28.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:28.754+0000 7f890d800700 1 -- 172.21.15.82:0/2423433327 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f88ec0b2880 msgr2=0x7f88ec0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:28.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:28.754+0000 7f890d800700 1 --2- 172.21.15.82:0/2423433327 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f88ec0b2880 0x7f88ec0b4d40 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f88f8009680 tx=0x7f88f8009260 comp rx=0 tx=0).stop 2024-05-08T05:49:28.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:28.755+0000 7f890d800700 1 -- 172.21.15.82:0/2423433327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8908106080 msgr2=0x7f890819c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:28.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:28.755+0000 7f890d800700 1 --2- 172.21.15.82:0/2423433327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8908106080 0x7f890819c290 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f88f400e9f0 tx=0x7f88f400ed00 comp rx=0 tx=0).stop 2024-05-08T05:49:28.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:28.755+0000 7f890d800700 1 -- 172.21.15.82:0/2423433327 shutdown_connections 2024-05-08T05:49:28.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:28.755+0000 7f890d800700 1 --2- 172.21.15.82:0/2423433327 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f88ec0b2880 0x7f88ec0b4d40 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:28.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:28.755+0000 7f890d800700 1 --2- 172.21.15.82:0/2423433327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f890810b6c0 0x7f89081a0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:28.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:28.755+0000 7f890d800700 1 --2- 172.21.15.82:0/2423433327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89081056c0 0x7f890819bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:28.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:28.755+0000 7f890d800700 1 --2- 172.21.15.82:0/2423433327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8908106080 0x7f890819c290 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:28.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:28.755+0000 7f890d800700 1 -- 172.21.15.82:0/2423433327 >> 172.21.15.82:0/2423433327 conn(0x7f8908101170 msgr2=0x7f89081016f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:49:28.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:28.755+0000 7f890d800700 1 -- 172.21.15.82:0/2423433327 shutdown_connections 2024-05-08T05:49:28.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:28.755+0000 7f890d800700 1 -- 172.21.15.82:0/2423433327 wait complete. 2024-05-08T05:49:28.756 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 28 2024-05-08T05:49:29.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:49:29 smithi082 ceph-mon[30098]: pgmap v424: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:49:29.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:49:29 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/2423433327' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:49:29.547 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T05:49:29.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:49:29 smithi151 ceph-mon[34815]: pgmap v424: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:49:29.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:49:29 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/2423433327' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:49:29.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:49:29 smithi134 ceph-mon[34132]: pgmap v424: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:49:29.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:49:29 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/2423433327' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:49:29.990 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:49:31.377 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:49:31 smithi082 ceph-mon[30098]: pgmap v425: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-05-08T05:49:31.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:49:31 smithi151 ceph-mon[34815]: pgmap v425: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-05-08T05:49:31.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:49:31 smithi134 ceph-mon[34132]: pgmap v425: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-05-08T05:49:32.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:32.203+0000 7fba44400700 1 -- 172.21.15.82:0/1267327849 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba3c109510 msgr2=0x7fba3c1098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:32.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:32.203+0000 7fba44400700 1 --2- 172.21.15.82:0/1267327849 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba3c109510 0x7fba3c1098f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fba30009990 tx=0x7fba30009ca0 comp rx=0 tx=0).stop 2024-05-08T05:49:32.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:32.204+0000 7fba44400700 1 -- 172.21.15.82:0/1267327849 shutdown_connections 2024-05-08T05:49:32.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:32.204+0000 7fba44400700 1 --2- 172.21.15.82:0/1267327849 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba3c109510 0x7fba3c1098f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:32.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:32.204+0000 7fba44400700 1 --2- 172.21.15.82:0/1267327849 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba3c06bb40 0x7fba3c110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:32.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:32.204+0000 7fba44400700 1 --2- 172.21.15.82:0/1267327849 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba3c06b180 0x7fba3c06b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:32.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:32.204+0000 7fba44400700 1 -- 172.21.15.82:0/1267327849 >> 172.21.15.82:0/1267327849 conn(0x7fba3c079350 msgr2=0x7fba3c079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:49:32.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:32.204+0000 7fba44400700 1 -- 172.21.15.82:0/1267327849 shutdown_connections 2024-05-08T05:49:32.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:32.204+0000 7fba44400700 1 -- 172.21.15.82:0/1267327849 wait complete. 2024-05-08T05:49:32.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:32.205+0000 7fba44400700 1 Processor -- start 2024-05-08T05:49:32.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:32.205+0000 7fba44400700 1 -- start start 2024-05-08T05:49:32.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:32.206+0000 7fba44400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba3c06b180 0x7fba3c19bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:32.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:32.206+0000 7fba44400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba3c06bb40 0x7fba3c19c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:32.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:32.206+0000 7fba44400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba3c109510 0x7fba3c1a0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:32.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:32.206+0000 7fba44400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fba3c113640 con 0x7fba3c06bb40 2024-05-08T05:49:32.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:32.206+0000 7fba44400700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fba3c1134c0 con 0x7fba3c06b180 2024-05-08T05:49:32.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:32.206+0000 7fba44400700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fba3c1137c0 con 0x7fba3c109510 2024-05-08T05:49:32.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:32.206+0000 7fba41a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba3c06b180 0x7fba3c19bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:32.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:32.206+0000 7fba41a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba3c06b180 0x7fba3c19bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:39948/0 (socket says 172.21.15.82:39948) 2024-05-08T05:49:32.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:32.206+0000 7fba41a00700 1 -- 172.21.15.82:0/315244456 learned_addr learned my addr 172.21.15.82:0/315244456 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:49:32.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:32.206+0000 7fba41000700 1 --2- 172.21.15.82:0/315244456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba3c06bb40 0x7fba3c19c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:32.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:32.206+0000 7fba42400700 1 --2- 172.21.15.82:0/315244456 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba3c109510 0x7fba3c1a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:32.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:32.207+0000 7fba41a00700 1 -- 172.21.15.82:0/315244456 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba3c109510 msgr2=0x7fba3c1a0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:32.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:32.207+0000 7fba41a00700 1 --2- 172.21.15.82:0/315244456 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba3c109510 0x7fba3c1a0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:32.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:32.207+0000 7fba41a00700 1 -- 172.21.15.82:0/315244456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba3c06bb40 msgr2=0x7fba3c19c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:32.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:32.207+0000 7fba41a00700 1 --2- 172.21.15.82:0/315244456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba3c06bb40 0x7fba3c19c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:32.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:32.207+0000 7fba41a00700 1 -- 172.21.15.82:0/315244456 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba3c1a0d70 con 0x7fba3c06b180 2024-05-08T05:49:32.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:32.207+0000 7fba41a00700 1 --2- 172.21.15.82:0/315244456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba3c06b180 0x7fba3c19bd60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fba300057f0 tx=0x7fba3000bfd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:49:32.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:32.207+0000 7fba3a000700 1 -- 172.21.15.82:0/315244456 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba30026070 con 0x7fba3c06b180 2024-05-08T05:49:32.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:32.207+0000 7fba44400700 1 -- 172.21.15.82:0/315244456 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba3c1a1000 con 0x7fba3c06b180 2024-05-08T05:49:32.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:32.207+0000 7fba3a000700 1 -- 172.21.15.82:0/315244456 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba30021410 con 0x7fba3c06b180 2024-05-08T05:49:32.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:32.208+0000 7fba3a000700 1 -- 172.21.15.82:0/315244456 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba30017650 con 0x7fba3c06b180 2024-05-08T05:49:32.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:32.208+0000 7fba44400700 1 -- 172.21.15.82:0/315244456 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba3c1a88e0 con 0x7fba3c06b180 2024-05-08T05:49:32.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:32.209+0000 7fba44400700 1 -- 172.21.15.82:0/315244456 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba3c06a190 con 0x7fba3c06b180 2024-05-08T05:49:32.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:32.211+0000 7fba3a000700 1 -- 172.21.15.82:0/315244456 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fba30029070 con 0x7fba3c06b180 2024-05-08T05:49:32.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:32.213+0000 7fba3a000700 1 --2- 172.21.15.82:0/315244456 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fba240b2900 0x7fba240b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:32.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:32.213+0000 7fba3a000700 1 -- 172.21.15.82:0/315244456 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fba300e3070 con 0x7fba3c06b180 2024-05-08T05:49:32.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:32.213+0000 7fba41000700 1 --2- 172.21.15.82:0/315244456 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fba240b2900 0x7fba240b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:32.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:32.213+0000 7fba41000700 1 --2- 172.21.15.82:0/315244456 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fba240b2900 0x7fba240b4dc0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fba28009680 tx=0x7fba28009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:49:32.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:32.215+0000 7fba3a000700 1 -- 172.21.15.82:0/315244456 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fba30030080 con 0x7fba3c06b180 2024-05-08T05:49:32.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:32.495+0000 7fba44400700 1 -- 172.21.15.82:0/315244456 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fba3c1a8ab0 con 0x7fba3c06b180 2024-05-08T05:49:32.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:32.497+0000 7fba3a000700 1 -- 172.21.15.82:0/315244456 <== mon.2 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11948 (secure 0 0 0) 0x7fba30013070 con 0x7fba3c06b180 2024-05-08T05:49:32.497 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:49:32.497 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14364,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3876883250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3876883250},{"type":"v1","addr":"172.21.15.82:6835","nonce":3876883250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1965070586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1965070586},{"type":"v1","addr":"172.21.15.82:6837","nonce":1965070586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T05:45:57.654009+0000","modified":"2024-05-08T05:46:21.713129+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24505,"mds_2":24487,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14397":{"gid":14397,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/1890720973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1890720973},{"type":"v1","addr":"172.21.15.82:6839","nonce":1890720973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14409":{"gid":14409,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/2957083305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":2957083305},{"type":"v1","addr":"172.21.15.82:6841","nonce":2957083305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6833/3827691638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3827691638},{"type":"v1","addr":"172.21.15.134:6833","nonce":3827691638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6833/3625067797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3625067797},{"type":"v1","addr":"172.21.15.151:6833","nonce":3625067797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/4074163402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4074163402},{"type":"v1","addr":"172.21.15.134:6835","nonce":4074163402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.134:6837/2212411710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2212411710},{"type":"v1","addr":"172.21.15.134:6837","nonce":2212411710}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":17,"addr":"172.21.15.151:6835/2093655929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2093655929},{"type":"v1","addr":"172.21.15.151:6835","nonce":2093655929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6837/4192404464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":4192404464},{"type":"v1","addr":"172.21.15.151:6837","nonce":4192404464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":14,"addr":"172.21.15.151:6839/2963754236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":2963754236},{"type":"v1","addr":"172.21.15.151:6839","nonce":2963754236}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.134:6839/1145270893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1145270893},{"type":"v1","addr":"172.21.15.134:6839","nonce":1145270893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24467,24475,24487,24505,24506]},"id":1}]} 2024-05-08T05:49:32.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:32.500+0000 7fba44400700 1 -- 172.21.15.82:0/315244456 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fba240b2900 msgr2=0x7fba240b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:32.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:32.500+0000 7fba44400700 1 --2- 172.21.15.82:0/315244456 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fba240b2900 0x7fba240b4dc0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fba28009680 tx=0x7fba28009260 comp rx=0 tx=0).stop 2024-05-08T05:49:32.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:32.500+0000 7fba44400700 1 -- 172.21.15.82:0/315244456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba3c06b180 msgr2=0x7fba3c19bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:32.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:32.500+0000 7fba44400700 1 --2- 172.21.15.82:0/315244456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba3c06b180 0x7fba3c19bd60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fba300057f0 tx=0x7fba3000bfd0 comp rx=0 tx=0).stop 2024-05-08T05:49:32.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:32.500+0000 7fba44400700 1 -- 172.21.15.82:0/315244456 shutdown_connections 2024-05-08T05:49:32.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:32.500+0000 7fba44400700 1 --2- 172.21.15.82:0/315244456 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba3c06b180 0x7fba3c19bd60 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:32.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:32.500+0000 7fba44400700 1 --2- 172.21.15.82:0/315244456 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fba240b2900 0x7fba240b4dc0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:32.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:32.500+0000 7fba44400700 1 --2- 172.21.15.82:0/315244456 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba3c109510 0x7fba3c1a0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:32.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:32.500+0000 7fba44400700 1 --2- 172.21.15.82:0/315244456 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fba3c06bb40 0x7fba3c19c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:32.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:32.500+0000 7fba44400700 1 -- 172.21.15.82:0/315244456 >> 172.21.15.82:0/315244456 conn(0x7fba3c079350 msgr2=0x7fba3c10e680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:49:32.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:32.500+0000 7fba44400700 1 -- 172.21.15.82:0/315244456 shutdown_connections 2024-05-08T05:49:32.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:32.500+0000 7fba44400700 1 -- 172.21.15.82:0/315244456 wait complete. 2024-05-08T05:49:32.501 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 28 2024-05-08T05:49:33.309 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-08T05:49:33.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:49:33 smithi151 ceph-mon[34815]: pgmap v426: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:49:33.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:49:33 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/315244456' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:49:33.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:49:33 smithi082 ceph-mon[30098]: pgmap v426: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:49:33.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:49:33 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/315244456' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:49:33.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:49:33 smithi134 ceph-mon[34132]: pgmap v426: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:49:33.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:49:33 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/315244456' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:49:33.787 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:49:35.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:49:35 smithi082 ceph-mon[30098]: pgmap v427: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-08T05:49:35.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:49:35 smithi151 ceph-mon[34815]: pgmap v427: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-08T05:49:35.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:49:35 smithi134 ceph-mon[34132]: pgmap v427: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-08T05:49:36.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:36.026+0000 7f9e9d600700 1 -- 172.21.15.82:0/4251945159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e9810a490 msgr2=0x7f9e981169a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:36.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:36.026+0000 7f9e9d600700 1 --2- 172.21.15.82:0/4251945159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e9810a490 0x7f9e981169a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9e9000b0a0 tx=0x7f9e9000b3b0 comp rx=0 tx=0).stop 2024-05-08T05:49:36.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:36.026+0000 7f9e9d600700 1 -- 172.21.15.82:0/4251945159 shutdown_connections 2024-05-08T05:49:36.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:36.026+0000 7f9e9d600700 1 --2- 172.21.15.82:0/4251945159 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e9810a490 0x7f9e981169a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:36.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:36.026+0000 7f9e9d600700 1 --2- 172.21.15.82:0/4251945159 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e9810fb60 0x7f9e9810ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:36.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:36.026+0000 7f9e9d600700 1 --2- 172.21.15.82:0/4251945159 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e98109ad0 0x7f9e98109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:36.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:36.026+0000 7f9e9d600700 1 -- 172.21.15.82:0/4251945159 >> 172.21.15.82:0/4251945159 conn(0x7f9e98076c70 msgr2=0x7f9e981082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:49:36.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:36.026+0000 7f9e9d600700 1 -- 172.21.15.82:0/4251945159 shutdown_connections 2024-05-08T05:49:36.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:36.027+0000 7f9e9d600700 1 -- 172.21.15.82:0/4251945159 wait complete. 2024-05-08T05:49:36.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:36.028+0000 7f9e9d600700 1 Processor -- start 2024-05-08T05:49:36.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:36.028+0000 7f9e9d600700 1 -- start start 2024-05-08T05:49:36.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:36.028+0000 7f9e9d600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e98109ad0 0x7f9e981a0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:36.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:36.029+0000 7f9e9d600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e9810a490 0x7f9e981a0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:36.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:36.029+0000 7f9e9d600700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e9810fb60 0x7f9e981a49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:36.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:36.029+0000 7f9e9d600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9e98119cc0 con 0x7f9e9810a490 2024-05-08T05:49:36.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:36.029+0000 7f9e9d600700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9e98119b40 con 0x7f9e98109ad0 2024-05-08T05:49:36.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:36.029+0000 7f9e9d600700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9e98119e40 con 0x7f9e9810fb60 2024-05-08T05:49:36.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:36.029+0000 7f9e96000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e9810a490 0x7f9e981a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:36.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:36.029+0000 7f9e96000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e9810a490 0x7f9e981a0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33504/0 (socket says 172.21.15.82:33504) 2024-05-08T05:49:36.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:36.029+0000 7f9e96a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e98109ad0 0x7f9e981a0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:36.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:36.029+0000 7f9e96000700 1 -- 172.21.15.82:0/3816001591 learned_addr learned my addr 172.21.15.82:0/3816001591 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:49:36.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:36.029+0000 7f9e97400700 1 --2- 172.21.15.82:0/3816001591 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e9810fb60 0x7f9e981a49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:36.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:36.029+0000 7f9e96000700 1 -- 172.21.15.82:0/3816001591 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e9810fb60 msgr2=0x7f9e981a49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:36.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:36.029+0000 7f9e96000700 1 --2- 172.21.15.82:0/3816001591 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e9810fb60 0x7f9e981a49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:36.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:36.029+0000 7f9e96000700 1 -- 172.21.15.82:0/3816001591 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e98109ad0 msgr2=0x7f9e981a0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:36.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:36.029+0000 7f9e96000700 1 --2- 172.21.15.82:0/3816001591 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e98109ad0 0x7f9e981a0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:36.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:36.029+0000 7f9e96000700 1 -- 172.21.15.82:0/3816001591 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e981a50f0 con 0x7f9e9810a490 2024-05-08T05:49:36.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:36.030+0000 7f9e96000700 1 --2- 172.21.15.82:0/3816001591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e9810a490 0x7f9e981a0670 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9e8400e9a0 tx=0x7f9e8400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:49:36.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:36.030+0000 7f9e8f400700 1 -- 172.21.15.82:0/3816001591 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e8400ca10 con 0x7f9e9810a490 2024-05-08T05:49:36.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:36.030+0000 7f9e8f400700 1 -- 172.21.15.82:0/3816001591 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9e8400cbb0 con 0x7f9e9810a490 2024-05-08T05:49:36.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:36.030+0000 7f9e9d600700 1 -- 172.21.15.82:0/3816001591 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e981a53e0 con 0x7f9e9810a490 2024-05-08T05:49:36.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:36.030+0000 7f9e8f400700 1 -- 172.21.15.82:0/3816001591 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e84018680 con 0x7f9e9810a490 2024-05-08T05:49:36.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:36.030+0000 7f9e9d600700 1 -- 172.21.15.82:0/3816001591 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e981acc60 con 0x7f9e9810a490 2024-05-08T05:49:36.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:36.031+0000 7f9e9d600700 1 -- 172.21.15.82:0/3816001591 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e9806a190 con 0x7f9e9810a490 2024-05-08T05:49:36.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:36.034+0000 7f9e8f400700 1 -- 172.21.15.82:0/3816001591 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f9e84010430 con 0x7f9e9810a490 2024-05-08T05:49:36.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:36.036+0000 7f9e8f400700 1 --2- 172.21.15.82:0/3816001591 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9e7c0b2900 0x7f9e7c0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:36.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:36.036+0000 7f9e8f400700 1 -- 172.21.15.82:0/3816001591 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f9e840e2350 con 0x7f9e9810a490 2024-05-08T05:49:36.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:36.036+0000 7f9e96a00700 1 --2- 172.21.15.82:0/3816001591 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9e7c0b2900 0x7f9e7c0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:36.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:36.037+0000 7f9e96a00700 1 --2- 172.21.15.82:0/3816001591 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9e7c0b2900 0x7f9e7c0b4dc0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9e88009be0 tx=0x7f9e88009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:49:36.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:36.041+0000 7f9e8f400700 1 -- 172.21.15.82:0/3816001591 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9e840aa020 con 0x7f9e9810a490 2024-05-08T05:49:36.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:36.274+0000 7f9e9d600700 1 -- 172.21.15.82:0/3816001591 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9e9802e510 con 0x7f9e9810a490 2024-05-08T05:49:36.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:36.277+0000 7f9e8f400700 1 -- 172.21.15.82:0/3816001591 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22631 (secure 0 0 0) 0x7f9e840b20a0 con 0x7f9e9810a490 2024-05-08T05:49:36.278 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:49:36.278 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":82,"fsid":"c739a5c8-0cfc-11ef-bc97-c7b262605968","created":"2024-05-08T05:36:37.441393+0000","modified":"2024-05-08T05:46:45.754375+0000","last_up_change":"2024-05-08T05:44:40.677995+0000","last_in_change":"2024-05-08T05:44:20.654220+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T05:40:28.102836+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T05:45:48.727521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T05:45:53.574048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bc9bd472-b765-4893-84ed-c66b5c1c61b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":4051651615},{"type":"v1","addr":"172.21.15.82:6803","nonce":4051651615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":4051651615},{"type":"v1","addr":"172.21.15.82:6805","nonce":4051651615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4051651615},{"type":"v1","addr":"172.21.15.82:6809","nonce":4051651615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":4051651615},{"type":"v1","addr":"172.21.15.82:6807","nonce":4051651615}]},"public_addr":"172.21.15.82:6803/4051651615","cluster_addr":"172.21.15.82:6805/4051651615","heartbeat_back_addr":"172.21.15.82:6809/4051651615","heartbeat_front_addr":"172.21.15.82:6807/4051651615","state":["exists","up"]},{"osd":1,"uuid":"ad2d3a6b-8bc5-4177-8757-07e8607ca240","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":2763858634},{"type":"v1","addr":"172.21.15.134:6801","nonce":2763858634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":2763858634},{"type":"v1","addr":"172.21.15.134:6803","nonce":2763858634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":2763858634},{"type":"v1","addr":"172.21.15.134:6807","nonce":2763858634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2763858634},{"type":"v1","addr":"172.21.15.134:6805","nonce":2763858634}]},"public_addr":"172.21.15.134:6801/2763858634","cluster_addr":"172.21.15.134:6803/2763858634","heartbeat_back_addr":"172.21.15.134:6807/2763858634","heartbeat_front_addr":"172.21.15.134:6805/2763858634","state":["exists","up"]},{"osd":2,"uuid":"a06dc8fc-7324-4e42-9487-8cfe372401b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":4193933269},{"type":"v1","addr":"172.21.15.151:6801","nonce":4193933269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":4193933269},{"type":"v1","addr":"172.21.15.151:6803","nonce":4193933269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":4193933269},{"type":"v1","addr":"172.21.15.151:6807","nonce":4193933269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":4193933269},{"type":"v1","addr":"172.21.15.151:6805","nonce":4193933269}]},"public_addr":"172.21.15.151:6801/4193933269","cluster_addr":"172.21.15.151:6803/4193933269","heartbeat_back_addr":"172.21.15.151:6807/4193933269","heartbeat_front_addr":"172.21.15.151:6805/4193933269","state":["exists","up"]},{"osd":3,"uuid":"b8c8bdcd-fbd7-4494-976e-7285408e010e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":2775272422},{"type":"v1","addr":"172.21.15.82:6811","nonce":2775272422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":2775272422},{"type":"v1","addr":"172.21.15.82:6813","nonce":2775272422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":2775272422},{"type":"v1","addr":"172.21.15.82:6817","nonce":2775272422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":2775272422},{"type":"v1","addr":"172.21.15.82:6815","nonce":2775272422}]},"public_addr":"172.21.15.82:6811/2775272422","cluster_addr":"172.21.15.82:6813/2775272422","heartbeat_back_addr":"172.21.15.82:6817/2775272422","heartbeat_front_addr":"172.21.15.82:6815/2775272422","state":["exists","up"]},{"osd":4,"uuid":"391a6040-03d1-483c-9058-308b5998e7c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3565208751},{"type":"v1","addr":"172.21.15.134:6809","nonce":3565208751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3565208751},{"type":"v1","addr":"172.21.15.134:6811","nonce":3565208751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3565208751},{"type":"v1","addr":"172.21.15.134:6815","nonce":3565208751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3565208751},{"type":"v1","addr":"172.21.15.134:6813","nonce":3565208751}]},"public_addr":"172.21.15.134:6809/3565208751","cluster_addr":"172.21.15.134:6811/3565208751","heartbeat_back_addr":"172.21.15.134:6815/3565208751","heartbeat_front_addr":"172.21.15.134:6813/3565208751","state":["exists","up"]},{"osd":5,"uuid":"dacce079-4aad-474e-b747-1ed60c3c71cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":1925634069},{"type":"v1","addr":"172.21.15.151:6809","nonce":1925634069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":1925634069},{"type":"v1","addr":"172.21.15.151:6811","nonce":1925634069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1925634069},{"type":"v1","addr":"172.21.15.151:6815","nonce":1925634069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1925634069},{"type":"v1","addr":"172.21.15.151:6813","nonce":1925634069}]},"public_addr":"172.21.15.151:6809/1925634069","cluster_addr":"172.21.15.151:6811/1925634069","heartbeat_back_addr":"172.21.15.151:6815/1925634069","heartbeat_front_addr":"172.21.15.151:6813/1925634069","state":["exists","up"]},{"osd":6,"uuid":"6a445bf4-09c4-4e9b-be6e-68ef3c05b365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":762647976},{"type":"v1","addr":"172.21.15.82:6819","nonce":762647976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":762647976},{"type":"v1","addr":"172.21.15.82:6821","nonce":762647976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":762647976},{"type":"v1","addr":"172.21.15.82:6825","nonce":762647976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":762647976},{"type":"v1","addr":"172.21.15.82:6823","nonce":762647976}]},"public_addr":"172.21.15.82:6819/762647976","cluster_addr":"172.21.15.82:6821/762647976","heartbeat_back_addr":"172.21.15.82:6825/762647976","heartbeat_front_addr":"172.21.15.82:6823/762647976","state":["exists","up"]},{"osd":7,"uuid":"72b0c735-ef30-4823-8ab8-2e5bf7cc3c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3006846927},{"type":"v1","addr":"172.21.15.134:6817","nonce":3006846927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3006846927},{"type":"v1","addr":"172.21.15.134:6819","nonce":3006846927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3006846927},{"type":"v1","addr":"172.21.15.134:6823","nonce":3006846927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3006846927},{"type":"v1","addr":"172.21.15.134:6821","nonce":3006846927}]},"public_addr":"172.21.15.134:6817/3006846927","cluster_addr":"172.21.15.134:6819/3006846927","heartbeat_back_addr":"172.21.15.134:6823/3006846927","heartbeat_front_addr":"172.21.15.134:6821/3006846927","state":["exists","up"]},{"osd":8,"uuid":"93e4da0f-48ea-4ab7-b612-26b545b76de6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":787870717},{"type":"v1","addr":"172.21.15.151:6817","nonce":787870717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":787870717},{"type":"v1","addr":"172.21.15.151:6819","nonce":787870717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":787870717},{"type":"v1","addr":"172.21.15.151:6823","nonce":787870717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":787870717},{"type":"v1","addr":"172.21.15.151:6821","nonce":787870717}]},"public_addr":"172.21.15.151:6817/787870717","cluster_addr":"172.21.15.151:6819/787870717","heartbeat_back_addr":"172.21.15.151:6823/787870717","heartbeat_front_addr":"172.21.15.151:6821/787870717","state":["exists","up"]},{"osd":9,"uuid":"ea0070c1-286a-47d3-90cf-d1fada6e3cda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":533124002},{"type":"v1","addr":"172.21.15.82:6827","nonce":533124002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":533124002},{"type":"v1","addr":"172.21.15.82:6829","nonce":533124002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":533124002},{"type":"v1","addr":"172.21.15.82:6833","nonce":533124002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":533124002},{"type":"v1","addr":"172.21.15.82:6831","nonce":533124002}]},"public_addr":"172.21.15.82:6827/533124002","cluster_addr":"172.21.15.82:6829/533124002","heartbeat_back_addr":"172.21.15.82:6833/533124002","heartbeat_front_addr":"172.21.15.82:6831/533124002","state":["exists","up"]},{"osd":10,"uuid":"26ca0a0b-ab9e-472f-bb29-428e8c31e5bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":99154842},{"type":"v1","addr":"172.21.15.134:6825","nonce":99154842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":99154842},{"type":"v1","addr":"172.21.15.134:6827","nonce":99154842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":99154842},{"type":"v1","addr":"172.21.15.134:6831","nonce":99154842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":99154842},{"type":"v1","addr":"172.21.15.134:6829","nonce":99154842}]},"public_addr":"172.21.15.134:6825/99154842","cluster_addr":"172.21.15.134:6827/99154842","heartbeat_back_addr":"172.21.15.134:6831/99154842","heartbeat_front_addr":"172.21.15.134:6829/99154842","state":["exists","up"]},{"osd":11,"uuid":"9ae5dca4-acfb-4a46-8601-9d642efde794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2242771269},{"type":"v1","addr":"172.21.15.151:6825","nonce":2242771269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2242771269},{"type":"v1","addr":"172.21.15.151:6827","nonce":2242771269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2242771269},{"type":"v1","addr":"172.21.15.151:6831","nonce":2242771269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2242771269},{"type":"v1","addr":"172.21.15.151:6829","nonce":2242771269}]},"public_addr":"172.21.15.151:6825/2242771269","cluster_addr":"172.21.15.151:6827/2242771269","heartbeat_back_addr":"172.21.15.151:6831/2242771269","heartbeat_front_addr":"172.21.15.151:6829/2242771269","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:39:35.575525+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:40:00.672367+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:40:24.558682+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:40:56.791194+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:41:23.031785+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:41:47.926448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:42:21.231894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:42:47.599982+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:43:12.950581+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:43:46.333027+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:44:13.457489+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:44:38.637273+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/2761274596":"2024-05-09T05:37:43.951218+0000","172.21.15.82:0/2195734928":"2024-05-09T05:37:43.951218+0000","172.21.15.82:6801/765895649":"2024-05-09T05:37:43.951218+0000","172.21.15.82:6800/3546670887":"2024-05-09T05:37:11.114057+0000","172.21.15.82:6800/765895649":"2024-05-09T05:37:43.951218+0000","172.21.15.82:0/3986150437":"2024-05-09T05:37:11.114057+0000","172.21.15.82:0/3457457714":"2024-05-09T05:37:11.114057+0000","172.21.15.82:0/2356749286":"2024-05-09T05:37:11.114057+0000","172.21.15.82:6801/3546670887":"2024-05-09T05:37:11.114057+0000","172.21.15.82:0/1694643083":"2024-05-09T05:37:43.951218+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T05:49:36.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:36.280+0000 7f9e9d600700 1 -- 172.21.15.82:0/3816001591 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9e7c0b2900 msgr2=0x7f9e7c0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:36.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:36.280+0000 7f9e9d600700 1 --2- 172.21.15.82:0/3816001591 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9e7c0b2900 0x7f9e7c0b4dc0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9e88009be0 tx=0x7f9e88009260 comp rx=0 tx=0).stop 2024-05-08T05:49:36.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:36.280+0000 7f9e9d600700 1 -- 172.21.15.82:0/3816001591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e9810a490 msgr2=0x7f9e981a0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:36.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:36.280+0000 7f9e9d600700 1 --2- 172.21.15.82:0/3816001591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e9810a490 0x7f9e981a0670 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9e8400e9a0 tx=0x7f9e8400ecb0 comp rx=0 tx=0).stop 2024-05-08T05:49:36.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:36.280+0000 7f9e9d600700 1 -- 172.21.15.82:0/3816001591 shutdown_connections 2024-05-08T05:49:36.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:36.280+0000 7f9e9d600700 1 --2- 172.21.15.82:0/3816001591 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e98109ad0 0x7f9e981a0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:36.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:36.280+0000 7f9e9d600700 1 --2- 172.21.15.82:0/3816001591 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9e7c0b2900 0x7f9e7c0b4dc0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:36.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:36.280+0000 7f9e9d600700 1 --2- 172.21.15.82:0/3816001591 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e9810fb60 0x7f9e981a49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:36.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:36.280+0000 7f9e9d600700 1 --2- 172.21.15.82:0/3816001591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9e9810a490 0x7f9e981a0670 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:36.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:36.281+0000 7f9e9d600700 1 -- 172.21.15.82:0/3816001591 >> 172.21.15.82:0/3816001591 conn(0x7f9e98076c70 msgr2=0x7f9e98077230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:49:36.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:36.281+0000 7f9e9d600700 1 -- 172.21.15.82:0/3816001591 shutdown_connections 2024-05-08T05:49:36.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:36.281+0000 7f9e9d600700 1 -- 172.21.15.82:0/3816001591 wait complete. 2024-05-08T05:49:37.149 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-05-08T05:45:57.654009+0000', 'modified': '2024-05-08T05:46:21.713129+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24506, 'mds_1': 24505, 'mds_2': 24487, 'mds_3': 24475, 'mds_4': 24467}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14397': {'gid': 14397, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.82:6839/1890720973', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6838', 'nonce': 1890720973}, {'type': 'v1', 'addr': '172.21.15.82:6839', 'nonce': 1890720973}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14409': {'gid': 14409, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.82:6841/2957083305', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.82:6840', 'nonce': 2957083305}, {'type': 'v1', 'addr': '172.21.15.82:6841', 'nonce': 2957083305}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24425': {'gid': 24425, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.134:6833/3827691638', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6832', 'nonce': 3827691638}, {'type': 'v1', 'addr': '172.21.15.134:6833', 'nonce': 3827691638}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24430': {'gid': 24430, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.151:6833/3625067797', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6832', 'nonce': 3625067797}, {'type': 'v1', 'addr': '172.21.15.151:6833', 'nonce': 3625067797}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24455': {'gid': 24455, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.134:6835/4074163402', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6834', 'nonce': 4074163402}, {'type': 'v1', 'addr': '172.21.15.134:6835', 'nonce': 4074163402}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24467': {'gid': 24467, 'name': 'h', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 16, 'addr': '172.21.15.134:6837/2212411710', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6836', 'nonce': 2212411710}, {'type': 'v1', 'addr': '172.21.15.134:6837', 'nonce': 2212411710}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24475': {'gid': 24475, 'name': 'f', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.151:6835/2093655929', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6834', 'nonce': 2093655929}, {'type': 'v1', 'addr': '172.21.15.151:6835', 'nonce': 2093655929}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24487': {'gid': 24487, 'name': 'c', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 16, 'addr': '172.21.15.151:6837/4192404464', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6836', 'nonce': 4192404464}, {'type': 'v1', 'addr': '172.21.15.151:6837', 'nonce': 4192404464}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24505': {'gid': 24505, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.151:6839/2963754236', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6838', 'nonce': 2963754236}, {'type': 'v1', 'addr': '172.21.15.151:6839', 'nonce': 2963754236}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24506': {'gid': 24506, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.134:6839/1145270893', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6838', 'nonce': 1145270893}, {'type': 'v1', 'addr': '172.21.15.134:6839', 'nonce': 1145270893}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24506, 'qdb_cluster': [24467, 24475, 24487, 24505, 24506]} 2024-05-08T05:49:37.149 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-05-08T05:49:37.149 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.h status 2024-05-08T05:49:37.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:49:37 smithi082 ceph-mon[30098]: pgmap v428: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-08T05:49:37.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:49:37 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/3816001591' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:49:37.595 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:49:37.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:49:37 smithi151 ceph-mon[34815]: pgmap v428: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-08T05:49:37.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:49:37 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/3816001591' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:49:37.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:49:37 smithi134 ceph-mon[34132]: pgmap v428: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-08T05:49:37.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:49:37 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/3816001591' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:49:39.596 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:49:39 smithi082 ceph-mon[30098]: pgmap v429: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:49:39.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:49:39 smithi151 ceph-mon[34815]: pgmap v429: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:49:39.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:49:39 smithi134 ceph-mon[34132]: pgmap v429: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:49:39.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.765+0000 7f00ee400700 1 -- 172.21.15.82:0/2270987700 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00e810a3a0 msgr2=0x7f00e8116840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:39.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.765+0000 7f00ee400700 1 --2- 172.21.15.82:0/2270987700 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00e810a3a0 0x7f00e8116840 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f00e000b0a0 tx=0x7f00e000b3b0 comp rx=0 tx=0).stop 2024-05-08T05:49:39.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.765+0000 7f00ee400700 1 -- 172.21.15.82:0/2270987700 shutdown_connections 2024-05-08T05:49:39.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.765+0000 7f00ee400700 1 --2- 172.21.15.82:0/2270987700 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00e810a3a0 0x7f00e8116840 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:39.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.765+0000 7f00ee400700 1 --2- 172.21.15.82:0/2270987700 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00e810e8b0 0x7f00e810ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:39.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.765+0000 7f00ee400700 1 --2- 172.21.15.82:0/2270987700 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00e81099e0 0x7f00e8109e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:39.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.765+0000 7f00ee400700 1 -- 172.21.15.82:0/2270987700 >> 172.21.15.82:0/2270987700 conn(0x7f00e8079230 msgr2=0x7f00e81082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:49:39.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.766+0000 7f00ee400700 1 -- 172.21.15.82:0/2270987700 shutdown_connections 2024-05-08T05:49:39.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.766+0000 7f00ee400700 1 -- 172.21.15.82:0/2270987700 wait complete. 2024-05-08T05:49:39.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.767+0000 7f00ee400700 1 Processor -- start 2024-05-08T05:49:39.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.767+0000 7f00ee400700 1 -- start start 2024-05-08T05:49:39.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.768+0000 7f00ee400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00e81099e0 0x7f00e81a0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:39.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.768+0000 7f00ee400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00e810a3a0 0x7f00e81a0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:39.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.768+0000 7f00ee400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00e810e8b0 0x7f00e81a4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:39.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.768+0000 7f00ee400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f00e8119b90 con 0x7f00e81099e0 2024-05-08T05:49:39.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.768+0000 7f00ee400700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f00e8119a10 con 0x7f00e810a3a0 2024-05-08T05:49:39.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.768+0000 7f00ee400700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f00e8119d10 con 0x7f00e810e8b0 2024-05-08T05:49:39.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.768+0000 7f00ed000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00e81099e0 0x7f00e81a0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:39.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.768+0000 7f00ed000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00e81099e0 0x7f00e81a0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33524/0 (socket says 172.21.15.82:33524) 2024-05-08T05:49:39.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.768+0000 7f00ed000700 1 -- 172.21.15.82:0/2632440275 learned_addr learned my addr 172.21.15.82:0/2632440275 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:49:39.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.768+0000 7f00e7e00700 1 --2- 172.21.15.82:0/2632440275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00e810a3a0 0x7f00e81a0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:39.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.768+0000 7f00eda00700 1 --2- 172.21.15.82:0/2632440275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00e810e8b0 0x7f00e81a4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:39.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.768+0000 7f00ed000700 1 -- 172.21.15.82:0/2632440275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00e810e8b0 msgr2=0x7f00e81a4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:39.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.768+0000 7f00ed000700 1 --2- 172.21.15.82:0/2632440275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00e810e8b0 0x7f00e81a4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:39.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.768+0000 7f00ed000700 1 -- 172.21.15.82:0/2632440275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00e810a3a0 msgr2=0x7f00e81a0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:39.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.768+0000 7f00ed000700 1 --2- 172.21.15.82:0/2632440275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00e810a3a0 0x7f00e81a0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:39.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.768+0000 7f00ed000700 1 -- 172.21.15.82:0/2632440275 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00e81a4fc0 con 0x7f00e81099e0 2024-05-08T05:49:39.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.768+0000 7f00eda00700 1 --2- 172.21.15.82:0/2632440275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00e810e8b0 0x7f00e81a4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:49:39.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.769+0000 7f00ed000700 1 --2- 172.21.15.82:0/2632440275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00e81099e0 0x7f00e81a0000 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f00dc00eb30 tx=0x7f00dc00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:49:39.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.769+0000 7f00e5600700 1 -- 172.21.15.82:0/2632440275 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00dc00cbd0 con 0x7f00e81099e0 2024-05-08T05:49:39.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.769+0000 7f00e5600700 1 -- 172.21.15.82:0/2632440275 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00dc0044d0 con 0x7f00e81099e0 2024-05-08T05:49:39.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.769+0000 7f00e5600700 1 -- 172.21.15.82:0/2632440275 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00dc003e30 con 0x7f00e81099e0 2024-05-08T05:49:39.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.769+0000 7f00ee400700 1 -- 172.21.15.82:0/2632440275 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00e81a52b0 con 0x7f00e81099e0 2024-05-08T05:49:39.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.769+0000 7f00ee400700 1 -- 172.21.15.82:0/2632440275 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00e81acb30 con 0x7f00e81099e0 2024-05-08T05:49:39.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.774+0000 7f00e5600700 1 -- 172.21.15.82:0/2632440275 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f00dc004000 con 0x7f00e81099e0 2024-05-08T05:49:39.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.775+0000 7f00fa2eeb80 1 Processor -- start 2024-05-08T05:49:39.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.775+0000 7f00fa2eeb80 1 -- start start 2024-05-08T05:49:39.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.776+0000 7f00fa2eeb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edf22ab990 0x55edf22abd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:39.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.776+0000 7f00fa2eeb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55edf22ac2b0 0x55edf22a5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:39.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.776+0000 7f00fa2eeb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55edf22a65b0 0x55edf22a6a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:39.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.776+0000 7f00fa2eeb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55edf21f89d0 con 0x55edf22ab990 2024-05-08T05:49:39.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.776+0000 7f00fa2eeb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55edf2196710 con 0x55edf22ac2b0 2024-05-08T05:49:39.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.776+0000 7f00fa2eeb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55edf21f4990 con 0x55edf22a65b0 2024-05-08T05:49:39.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.776+0000 7f00eda00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edf22ab990 0x55edf22abd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:39.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.776+0000 7f00eda00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edf22ab990 0x55edf22abd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33540/0 (socket says 172.21.15.82:33540) 2024-05-08T05:49:39.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.776+0000 7f00ed000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55edf22ac2b0 0x55edf22a5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:39.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.776+0000 7f00eda00700 1 -- 172.21.15.82:0/3256015423 learned_addr learned my addr 172.21.15.82:0/3256015423 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:49:39.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.776+0000 7f00e5600700 1 --2- 172.21.15.82:0/2632440275 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f00d00b2900 0x7f00d00b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:39.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.776+0000 7f00e7e00700 1 --2- 172.21.15.82:0/3256015423 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55edf22a65b0 0x55edf22a6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:39.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.776+0000 7f00eda00700 1 --2- 172.21.15.82:0/2632440275 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f00d00b2900 0x7f00d00b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:39.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.776+0000 7f00e5600700 1 -- 172.21.15.82:0/2632440275 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f00dc0e2490 con 0x7f00e81099e0 2024-05-08T05:49:39.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.776+0000 7f00ed000700 1 -- 172.21.15.82:0/3256015423 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55edf22a65b0 msgr2=0x55edf22a6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:49:39.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.776+0000 7f00ed000700 1 --2- 172.21.15.82:0/3256015423 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55edf22a65b0 0x55edf22a6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:39.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.777+0000 7f00ed000700 1 -- 172.21.15.82:0/3256015423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edf22ab990 msgr2=0x55edf22abd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:49:39.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.777+0000 7f00ed000700 1 --2- 172.21.15.82:0/3256015423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edf22ab990 0x55edf22abd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:39.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.777+0000 7f00ed000700 1 -- 172.21.15.82:0/3256015423 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edf2145880 con 0x55edf22ac2b0 2024-05-08T05:49:39.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.777+0000 7f00e7e00700 1 --2- 172.21.15.82:0/3256015423 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55edf22a65b0 0x55edf22a6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:49:39.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.777+0000 7f00ed000700 1 --2- 172.21.15.82:0/3256015423 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55edf22ac2b0 0x55edf22a5f90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f00dc0dfff0 tx=0x7f00dc003890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f254c5a76dcc009 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:49:39.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.777+0000 7f00da000700 1 -- 172.21.15.82:0/3256015423 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00dc0a9410 con 0x55edf22ac2b0 2024-05-08T05:49:39.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.777+0000 7f00da000700 1 -- 172.21.15.82:0/3256015423 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00dc0a95d0 con 0x55edf22ac2b0 2024-05-08T05:49:39.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.777+0000 7f00da000700 1 -- 172.21.15.82:0/3256015423 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00dc0a9890 con 0x55edf22ac2b0 2024-05-08T05:49:39.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.778+0000 7f00fa2eeb80 1 -- 172.21.15.82:0/3256015423 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55edf22ac2b0 msgr2=0x55edf22a5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:39.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.778+0000 7f00fa2eeb80 1 --2- 172.21.15.82:0/3256015423 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55edf22ac2b0 0x55edf22a5f90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f00dc0dfff0 tx=0x7f00dc003890 comp rx=0 tx=0).stop 2024-05-08T05:49:39.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.778+0000 7f00eda00700 1 --2- 172.21.15.82:0/2632440275 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f00d00b2900 0x7f00d00b4dc0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f00e000bfa0 tx=0x7f00e0020040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:49:39.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.778+0000 7f00fa2eeb80 1 -- 172.21.15.82:0/3256015423 shutdown_connections 2024-05-08T05:49:39.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.778+0000 7f00fa2eeb80 1 --2- 172.21.15.82:0/3256015423 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55edf22a65b0 0x55edf22a6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:39.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.778+0000 7f00fa2eeb80 1 --2- 172.21.15.82:0/3256015423 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edf22ab990 0x55edf22abd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:39.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.778+0000 7f00fa2eeb80 1 --2- 172.21.15.82:0/3256015423 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55edf22ac2b0 0x55edf22a5f90 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:39.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.778+0000 7f00fa2eeb80 1 -- 172.21.15.82:0/3256015423 >> 172.21.15.82:0/3256015423 conn(0x55edf21d4b10 msgr2=0x55edf22a0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:49:39.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.778+0000 7f00fa2eeb80 1 -- 172.21.15.82:0/3256015423 shutdown_connections 2024-05-08T05:49:39.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.778+0000 7f00fa2eeb80 1 -- 172.21.15.82:0/3256015423 wait complete. 2024-05-08T05:49:39.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.779+0000 7f00fa2eeb80 1 -- start start 2024-05-08T05:49:39.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.779+0000 7f00fa2eeb80 1 Processor -- start 2024-05-08T05:49:39.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.779+0000 7f00fa2eeb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edf22a65b0 0x55edf22b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:39.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.779+0000 7f00fa2eeb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55edf22ab990 0x55edf22af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:39.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.779+0000 7f00fa2eeb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55edf22ac2b0 0x55edf22af800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:39.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.779+0000 7f00fa2eeb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55edf22b2ca0 con 0x55edf22a65b0 2024-05-08T05:49:39.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.779+0000 7f00fa2eeb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55edf215ead0 con 0x55edf22ac2b0 2024-05-08T05:49:39.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.779+0000 7f00fa2eeb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55edf22b2e20 con 0x55edf22ab990 2024-05-08T05:49:39.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.780+0000 7f00fa2eeb80 10 client.0 _ll_register_callbacks cb 0x55edf219fc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:49:39.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.780+0000 7f00ed000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edf22a65b0 0x55edf22b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:39.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.780+0000 7f00ed000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edf22a65b0 0x55edf22b1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33554/0 (socket says 172.21.15.82:33554) 2024-05-08T05:49:39.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.780+0000 7f00ed000700 1 -- 172.21.15.82:0/654677746 learned_addr learned my addr 172.21.15.82:0/654677746 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:49:39.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.780+0000 7f00eda00700 1 --2- 172.21.15.82:0/654677746 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55edf22ac2b0 0x55edf22af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:39.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.780+0000 7f00e7e00700 1 --2- 172.21.15.82:0/654677746 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55edf22ab990 0x55edf22af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:39.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.780+0000 7f00ed000700 1 -- 172.21.15.82:0/654677746 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55edf22ab990 msgr2=0x55edf22af2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:49:39.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.780+0000 7f00ed000700 1 --2- 172.21.15.82:0/654677746 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55edf22ab990 0x55edf22af2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:39.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.780+0000 7f00ed000700 1 -- 172.21.15.82:0/654677746 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55edf22ac2b0 msgr2=0x55edf22af800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:49:39.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.780+0000 7f00ed000700 1 --2- 172.21.15.82:0/654677746 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55edf22ac2b0 0x55edf22af800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:39.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.780+0000 7f00ed000700 1 -- 172.21.15.82:0/654677746 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edf21be3d0 con 0x55edf22a65b0 2024-05-08T05:49:39.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.781+0000 7f00ed000700 1 --2- 172.21.15.82:0/654677746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edf22a65b0 0x55edf22b1f20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f00dc009230 tx=0x7f00dc0a6130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbf4467414ad6d49 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:49:39.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.781+0000 7f00cea00700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T05:49:39.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.781+0000 7f00cea00700 1 -- 172.21.15.82:0/654677746 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00dc0c2060 con 0x55edf22a65b0 2024-05-08T05:49:39.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.781+0000 7f00cea00700 1 -- 172.21.15.82:0/654677746 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f00dc01e2e0 con 0x55edf22a65b0 2024-05-08T05:49:39.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.781+0000 7f00fa2eeb80 1 -- 172.21.15.82:0/654677746 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00dc0a95d0 con 0x55edf22a65b0 2024-05-08T05:49:39.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.781+0000 7f00cea00700 1 -- 172.21.15.82:0/654677746 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f00dc0a9230 con 0x55edf22a65b0 2024-05-08T05:49:39.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.781+0000 7f00fa2eeb80 10 client.14913 fetch_fsmap learned FSMap version 28 2024-05-08T05:49:39.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.781+0000 7f00fa2eeb80 1 -- 172.21.15.82:0/654677746 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55edf22bd420 con 0x55edf22a65b0 2024-05-08T05:49:39.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.781+0000 7f00cea00700 1 -- 172.21.15.82:0/654677746 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00dc0a95d0 con 0x55edf22a65b0 2024-05-08T05:49:39.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.781+0000 7f00cea00700 1 -- 172.21.15.82:0/654677746 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f00dc0a9d20 con 0x55edf22a65b0 2024-05-08T05:49:39.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.782+0000 7f00fa2eeb80 10 client.14913 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T05:49:39.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.782+0000 7f00fa2eeb80 10 client.14913 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-08T05:49:39.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.782+0000 7f00fa2eeb80 20 client.14913 populate_metadata read hostname 'smithi082' 2024-05-08T05:49:39.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.782+0000 7f00fa2eeb80 1 --2- 172.21.15.82:0/654677746 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x55edf22be770 0x55edf22c0910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:39.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.782+0000 7f00fa2eeb80 4 client.14913 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:49:39.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.782+0000 7f00fa2eeb80 1 -- 172.21.15.82:0/654677746 --> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55edf2273050 con 0x55edf22be770 2024-05-08T05:49:39.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.782+0000 7f00e7e00700 1 --2- 172.21.15.82:0/654677746 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x55edf22be770 0x55edf22c0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:39.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.783+0000 7f00e7e00700 1 --2- 172.21.15.82:0/654677746 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x55edf22be770 0x55edf22c0910 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6b0e87596177a26e server_cookie=a9718206105e769 in_seq=0 out_seq=0 2024-05-08T05:49:39.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.783+0000 7f00cea00700 10 client.14913 ms_handle_connect on v2:172.21.15.134:6836/2212411710 2024-05-08T05:49:39.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.783+0000 7f00cea00700 1 -- 172.21.15.82:0/654677746 <== mds.4 v2:172.21.15.134:6836/2212411710 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55edf2273050 con 0x55edf22be770 2024-05-08T05:49:39.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.783+0000 7f00cea00700 10 client.14913 handle_command_reply: tid=0 2024-05-08T05:49:39.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.784+0000 7f00fa2eeb80 1 client.14913 shutdown 2024-05-08T05:49:39.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.784+0000 7f00fa2eeb80 1 -- 172.21.15.82:0/654677746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edf22a65b0 msgr2=0x55edf22b1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:39.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.784+0000 7f00fa2eeb80 1 --2- 172.21.15.82:0/654677746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edf22a65b0 0x55edf22b1f20 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f00dc009230 tx=0x7f00dc0a6130 comp rx=0 tx=0).stop 2024-05-08T05:49:39.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.784+0000 7f00fa2eeb80 1 -- 172.21.15.82:0/654677746 shutdown_connections 2024-05-08T05:49:39.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.784+0000 7f00fa2eeb80 1 --2- 172.21.15.82:0/654677746 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x55edf22be770 0x55edf22c0910 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:39.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.784+0000 7f00fa2eeb80 1 --2- 172.21.15.82:0/654677746 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55edf22ac2b0 0x55edf22af800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:39.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.784+0000 7f00fa2eeb80 1 --2- 172.21.15.82:0/654677746 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edf22a65b0 0x55edf22b1f20 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:39.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.784+0000 7f00fa2eeb80 1 --2- 172.21.15.82:0/654677746 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55edf22ab990 0x55edf22af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:39.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.784+0000 7f00fa2eeb80 1 -- 172.21.15.82:0/654677746 >> 172.21.15.82:0/654677746 conn(0x55edf21d4b10 msgr2=0x55edf229b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:49:39.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.784+0000 7f00cea00700 0 client.14913 ms_handle_reset on v2:172.21.15.134:6836/2212411710 2024-05-08T05:49:39.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.784+0000 7f00fa2eeb80 1 -- 172.21.15.82:0/654677746 shutdown_connections 2024-05-08T05:49:39.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.784+0000 7f00fa2eeb80 1 -- 172.21.15.82:0/654677746 wait complete. 2024-05-08T05:49:39.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.784+0000 7f00fa2eeb80 20 client.14913 trim_cache size 0 max 16384 2024-05-08T05:49:39.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.807+0000 7f00fa2eeb80 1 Processor -- start 2024-05-08T05:49:39.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.807+0000 7f00fa2eeb80 1 -- start start 2024-05-08T05:49:39.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.807+0000 7f00fa2eeb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edf22a65b0 0x55edf22bedd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:39.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.807+0000 7f00fa2eeb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55edf22ab990 0x55edf22af830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:39.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.807+0000 7f00fa2eeb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55edf22ac2b0 0x55edf22adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:39.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.807+0000 7f00fa2eeb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55edf22bec50 con 0x55edf22a65b0 2024-05-08T05:49:39.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.807+0000 7f00fa2eeb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55edf22bf320 con 0x55edf22ac2b0 2024-05-08T05:49:39.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.807+0000 7f00fa2eeb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55edf22bf9f0 con 0x55edf22ab990 2024-05-08T05:49:39.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.808+0000 7f00ed000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edf22a65b0 0x55edf22bedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:39.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.808+0000 7f00ed000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edf22a65b0 0x55edf22bedd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33570/0 (socket says 172.21.15.82:33570) 2024-05-08T05:49:39.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.808+0000 7f00ed000700 1 -- 172.21.15.82:0/1860082247 learned_addr learned my addr 172.21.15.82:0/1860082247 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:49:39.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.808+0000 7f00e7e00700 1 --2- 172.21.15.82:0/1860082247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55edf22ab990 0x55edf22af830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:39.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.808+0000 7f00eda00700 1 --2- 172.21.15.82:0/1860082247 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55edf22ac2b0 0x55edf22adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:39.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.808+0000 7f00ed000700 1 -- 172.21.15.82:0/1860082247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55edf22ab990 msgr2=0x55edf22af830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:49:39.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.808+0000 7f00ed000700 1 --2- 172.21.15.82:0/1860082247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55edf22ab990 0x55edf22af830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:39.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.808+0000 7f00ed000700 1 -- 172.21.15.82:0/1860082247 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55edf22ac2b0 msgr2=0x55edf22adbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:49:39.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.808+0000 7f00ed000700 1 --2- 172.21.15.82:0/1860082247 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55edf22ac2b0 0x55edf22adbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:39.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.808+0000 7f00ed000700 1 -- 172.21.15.82:0/1860082247 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edf22b1b60 con 0x55edf22a65b0 2024-05-08T05:49:39.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.808+0000 7f00eda00700 1 --2- 172.21.15.82:0/1860082247 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55edf22ac2b0 0x55edf22adbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:49:39.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.809+0000 7f00ed000700 1 --2- 172.21.15.82:0/1860082247 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edf22a65b0 0x55edf22bedd0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f00dc0a9a50 tx=0x7f00dc0b2250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bdcbcbc4263c4b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:49:39.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.809+0000 7f00d9600700 1 -- 172.21.15.82:0/1860082247 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00dc0c2070 con 0x55edf22a65b0 2024-05-08T05:49:39.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.809+0000 7f00d9600700 1 -- 172.21.15.82:0/1860082247 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00dc0a95d0 con 0x55edf22a65b0 2024-05-08T05:49:39.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.809+0000 7f00d9600700 1 -- 172.21.15.82:0/1860082247 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00dc01e2e0 con 0x55edf22a65b0 2024-05-08T05:49:39.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.810+0000 7f00fa2eeb80 1 -- 172.21.15.82:0/1860082247 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edf22a65b0 msgr2=0x55edf22bedd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:39.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.810+0000 7f00fa2eeb80 1 --2- 172.21.15.82:0/1860082247 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edf22a65b0 0x55edf22bedd0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f00dc0a9a50 tx=0x7f00dc0b2250 comp rx=0 tx=0).stop 2024-05-08T05:49:39.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.810+0000 7f00fa2eeb80 1 -- 172.21.15.82:0/1860082247 shutdown_connections 2024-05-08T05:49:39.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.810+0000 7f00fa2eeb80 1 --2- 172.21.15.82:0/1860082247 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55edf22ac2b0 0x55edf22adbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:39.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.810+0000 7f00fa2eeb80 1 --2- 172.21.15.82:0/1860082247 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edf22a65b0 0x55edf22bedd0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:39.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.810+0000 7f00fa2eeb80 1 --2- 172.21.15.82:0/1860082247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55edf22ab990 0x55edf22af830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:39.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.810+0000 7f00fa2eeb80 1 -- 172.21.15.82:0/1860082247 >> 172.21.15.82:0/1860082247 conn(0x55edf21d4b10 msgr2=0x55edf22a94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:49:39.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.810+0000 7f00fa2eeb80 1 -- 172.21.15.82:0/1860082247 shutdown_connections 2024-05-08T05:49:39.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.810+0000 7f00fa2eeb80 1 -- 172.21.15.82:0/1860082247 wait complete. 2024-05-08T05:49:39.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.810+0000 7f00fa2eeb80 1 -- start start 2024-05-08T05:49:39.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.810+0000 7f00fa2eeb80 1 Processor -- start 2024-05-08T05:49:39.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.811+0000 7f00fa2eeb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edf22a65b0 0x55edf22aed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:39.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.811+0000 7f00fa2eeb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55edf22ab990 0x55edf22af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:39.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.811+0000 7f00fa2eeb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55edf22ac2b0 0x55edf22c8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:39.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.811+0000 7f00fa2eeb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55edf22c0790 con 0x55edf22a65b0 2024-05-08T05:49:39.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.811+0000 7f00fa2eeb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55edf22c00c0 con 0x55edf22ab990 2024-05-08T05:49:39.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.811+0000 7f00fa2eeb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55edf22c0e60 con 0x55edf22ac2b0 2024-05-08T05:49:39.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.811+0000 7f00fa2eeb80 10 client.0 _ll_register_callbacks cb 0x55edf219fc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:49:39.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.811+0000 7f00ed000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edf22a65b0 0x55edf22aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:39.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.811+0000 7f00ed000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edf22a65b0 0x55edf22aed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33572/0 (socket says 172.21.15.82:33572) 2024-05-08T05:49:39.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.811+0000 7f00ed000700 1 -- 172.21.15.82:0/616070997 learned_addr learned my addr 172.21.15.82:0/616070997 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:49:39.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.811+0000 7f00eda00700 1 --2- 172.21.15.82:0/616070997 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55edf22ac2b0 0x55edf22c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:39.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.811+0000 7f00e7e00700 1 --2- 172.21.15.82:0/616070997 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55edf22ab990 0x55edf22af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:39.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.812+0000 7f00ed000700 1 -- 172.21.15.82:0/616070997 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55edf22ac2b0 msgr2=0x55edf22c8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:49:39.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.812+0000 7f00ed000700 1 --2- 172.21.15.82:0/616070997 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55edf22ac2b0 0x55edf22c8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:39.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.812+0000 7f00ed000700 1 -- 172.21.15.82:0/616070997 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55edf22ab990 msgr2=0x55edf22af2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:49:39.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.812+0000 7f00ed000700 1 --2- 172.21.15.82:0/616070997 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55edf22ab990 0x55edf22af2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:39.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.812+0000 7f00ed000700 1 -- 172.21.15.82:0/616070997 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edf22c8950 con 0x55edf22a65b0 2024-05-08T05:49:39.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.812+0000 7f00ed000700 1 --2- 172.21.15.82:0/616070997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edf22a65b0 0x55edf22aed60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f00dc009230 tx=0x7f00dc01e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30b950fe6a045a58 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:49:39.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.812+0000 7f00cea00700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T05:49:39.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.812+0000 7f00cea00700 1 -- 172.21.15.82:0/616070997 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00dc08f060 con 0x55edf22a65b0 2024-05-08T05:49:39.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.812+0000 7f00cea00700 1 -- 172.21.15.82:0/616070997 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f00dc0e2280 con 0x55edf22a65b0 2024-05-08T05:49:39.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.812+0000 7f00fa2eeb80 1 -- 172.21.15.82:0/616070997 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00dc0a95d0 con 0x55edf22a65b0 2024-05-08T05:49:39.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.812+0000 7f00cea00700 1 -- 172.21.15.82:0/616070997 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f00dc0c2050 con 0x55edf22a65b0 2024-05-08T05:49:39.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.812+0000 7f00fa2eeb80 10 client.14919 fetch_fsmap learned FSMap version 28 2024-05-08T05:49:39.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.812+0000 7f00fa2eeb80 1 -- 172.21.15.82:0/616070997 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55edf22c8950 con 0x55edf22a65b0 2024-05-08T05:49:39.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.813+0000 7f00cea00700 1 -- 172.21.15.82:0/616070997 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00dc0a95d0 con 0x55edf22a65b0 2024-05-08T05:49:39.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.813+0000 7f00cea00700 1 -- 172.21.15.82:0/616070997 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f00dc0b2490 con 0x55edf22a65b0 2024-05-08T05:49:39.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.813+0000 7f00fa2eeb80 10 client.14919 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T05:49:39.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.813+0000 7f00fa2eeb80 10 client.14919 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-08T05:49:39.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.813+0000 7f00fa2eeb80 20 client.14919 populate_metadata read hostname 'smithi082' 2024-05-08T05:49:39.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.813+0000 7f00fa2eeb80 1 --2- 172.21.15.82:0/616070997 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x55edf232f2d0 0x55edf232dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:39.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.813+0000 7f00fa2eeb80 4 client.14919 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T05:49:39.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.813+0000 7f00fa2eeb80 1 -- 172.21.15.82:0/616070997 --> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] -- command(tid 0: {"prefix": "status"}) -- 0x55edf22063b0 con 0x55edf232f2d0 2024-05-08T05:49:39.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.813+0000 7f00e7e00700 1 --2- 172.21.15.82:0/616070997 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x55edf232f2d0 0x55edf232dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:39.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.814+0000 7f00e7e00700 1 --2- 172.21.15.82:0/616070997 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x55edf232f2d0 0x55edf232dfe0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=1cb47921a627c8ed server_cookie=e5e1245c28b35487 in_seq=0 out_seq=0 2024-05-08T05:49:39.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.814+0000 7f00cea00700 10 client.14919 ms_handle_connect on v2:172.21.15.134:6836/2212411710 2024-05-08T05:49:39.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.814+0000 7f00cea00700 1 -- 172.21.15.82:0/616070997 <== mds.4 v2:172.21.15.134:6836/2212411710 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55edf22063b0 con 0x55edf232f2d0 2024-05-08T05:49:39.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.814+0000 7f00cea00700 10 client.14919 handle_command_reply: tid=0 2024-05-08T05:49:39.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.814+0000 7f00fa2eeb80 1 client.14919 shutdown 2024-05-08T05:49:39.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.814+0000 7f00fa2eeb80 1 -- 172.21.15.82:0/616070997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edf22a65b0 msgr2=0x55edf22aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:39.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.814+0000 7f00fa2eeb80 1 --2- 172.21.15.82:0/616070997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edf22a65b0 0x55edf22aed60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f00dc009230 tx=0x7f00dc01e570 comp rx=0 tx=0).stop 2024-05-08T05:49:39.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.814+0000 7f00fa2eeb80 1 -- 172.21.15.82:0/616070997 shutdown_connections 2024-05-08T05:49:39.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.814+0000 7f00fa2eeb80 1 --2- 172.21.15.82:0/616070997 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x55edf232f2d0 0x55edf232dfe0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:39.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.814+0000 7f00fa2eeb80 1 --2- 172.21.15.82:0/616070997 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55edf22ac2b0 0x55edf22c8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:39.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.814+0000 7f00fa2eeb80 1 --2- 172.21.15.82:0/616070997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55edf22a65b0 0x55edf22aed60 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:39.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.814+0000 7f00fa2eeb80 1 --2- 172.21.15.82:0/616070997 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55edf22ab990 0x55edf22af2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:39.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.814+0000 7f00fa2eeb80 1 -- 172.21.15.82:0/616070997 >> 172.21.15.82:0/616070997 conn(0x55edf21d4b10 msgr2=0x55edf22adb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:49:39.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.814+0000 7f00cea00700 0 client.14919 ms_handle_reset on v2:172.21.15.134:6836/2212411710 2024-05-08T05:49:39.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.815+0000 7f00fa2eeb80 1 -- 172.21.15.82:0/616070997 shutdown_connections 2024-05-08T05:49:39.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.815+0000 7f00fa2eeb80 1 -- 172.21.15.82:0/616070997 wait complete. 2024-05-08T05:49:39.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.815+0000 7f00fa2eeb80 20 client.14919 trim_cache size 0 max 16384 2024-05-08T05:49:39.818 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T05:49:39.818 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "c739a5c8-0cfc-11ef-bc97-c7b262605968", 2024-05-08T05:49:39.818 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 4, 2024-05-08T05:49:39.818 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 24467, 2024-05-08T05:49:39.818 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-05-08T05:49:39.818 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-05-08T05:49:39.818 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-05-08T05:49:39.818 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 202.85654270699999, 2024-05-08T05:49:39.818 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 28, 2024-05-08T05:49:39.818 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 82, 2024-05-08T05:49:39.818 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 80, 2024-05-08T05:49:39.819 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 260.01305608199999 2024-05-08T05:49:39.819 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T05:49:39.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.816+0000 7f00ee400700 1 -- 172.21.15.82:0/2632440275 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f00d00b2900 msgr2=0x7f00d00b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:39.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.816+0000 7f00ee400700 1 --2- 172.21.15.82:0/2632440275 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f00d00b2900 0x7f00d00b4dc0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f00e000bfa0 tx=0x7f00e0020040 comp rx=0 tx=0).stop 2024-05-08T05:49:39.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.816+0000 7f00ee400700 1 -- 172.21.15.82:0/2632440275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00e81099e0 msgr2=0x7f00e81a0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:39.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.816+0000 7f00ee400700 1 --2- 172.21.15.82:0/2632440275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00e81099e0 0x7f00e81a0000 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f00dc00eb30 tx=0x7f00dc00ee40 comp rx=0 tx=0).stop 2024-05-08T05:49:39.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.816+0000 7f00ee400700 1 -- 172.21.15.82:0/2632440275 shutdown_connections 2024-05-08T05:49:39.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.816+0000 7f00ee400700 1 --2- 172.21.15.82:0/2632440275 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f00d00b2900 0x7f00d00b4dc0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:39.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.816+0000 7f00ee400700 1 --2- 172.21.15.82:0/2632440275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00e810e8b0 0x7f00e81a4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:39.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.816+0000 7f00ee400700 1 --2- 172.21.15.82:0/2632440275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00e81099e0 0x7f00e81a0000 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:39.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.816+0000 7f00ee400700 1 --2- 172.21.15.82:0/2632440275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00e810a3a0 0x7f00e81a0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:39.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.816+0000 7f00ee400700 1 -- 172.21.15.82:0/2632440275 >> 172.21.15.82:0/2632440275 conn(0x7f00e8079230 msgr2=0x7f00e80797f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:49:39.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.816+0000 7f00ee400700 1 -- 172.21.15.82:0/2632440275 shutdown_connections 2024-05-08T05:49:39.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:39.816+0000 7f00ee400700 1 -- 172.21.15.82:0/2632440275 wait complete. 2024-05-08T05:49:40.765 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.f status 2024-05-08T05:49:41.211 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:49:41.561 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:49:41 smithi082 ceph-mon[30098]: pgmap v430: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-05-08T05:49:41.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:49:41 smithi151 ceph-mon[34815]: pgmap v430: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-05-08T05:49:41.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:49:41 smithi134 ceph-mon[34132]: pgmap v430: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-05-08T05:49:43.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.537+0000 7f984aa00700 1 -- 172.21.15.82:0/767130131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9844104100 msgr2=0x7f9844108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:43.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.537+0000 7f984aa00700 1 --2- 172.21.15.82:0/767130131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9844104100 0x7f9844108120 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f98300098f0 tx=0x7f9830009c00 comp rx=0 tx=0).stop 2024-05-08T05:49:43.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.537+0000 7f984aa00700 1 -- 172.21.15.82:0/767130131 shutdown_connections 2024-05-08T05:49:43.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.537+0000 7f984aa00700 1 --2- 172.21.15.82:0/767130131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9844108850 0x7f98441103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:43.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.537+0000 7f984aa00700 1 --2- 172.21.15.82:0/767130131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9844103750 0x7f9844103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:43.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.537+0000 7f984aa00700 1 --2- 172.21.15.82:0/767130131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9844104100 0x7f9844108120 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:43.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.537+0000 7f984aa00700 1 -- 172.21.15.82:0/767130131 >> 172.21.15.82:0/767130131 conn(0x7f984407a600 msgr2=0x7f984407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:49:43.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.537+0000 7f984aa00700 1 -- 172.21.15.82:0/767130131 shutdown_connections 2024-05-08T05:49:43.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.537+0000 7f984aa00700 1 -- 172.21.15.82:0/767130131 wait complete. 2024-05-08T05:49:43.539 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:49:43 smithi082 ceph-mon[30098]: pgmap v431: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:49:43.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.539+0000 7f984aa00700 1 Processor -- start 2024-05-08T05:49:43.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.539+0000 7f984aa00700 1 -- start start 2024-05-08T05:49:43.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.539+0000 7f984aa00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9844103750 0x7f984419bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:43.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.539+0000 7f984aa00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9844104100 0x7f984419c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:43.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.539+0000 7f984aa00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9844108850 0x7f98441a05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:43.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.539+0000 7f984aa00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9844113630 con 0x7f9844108850 2024-05-08T05:49:43.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.539+0000 7f984aa00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f98441134b0 con 0x7f9844103750 2024-05-08T05:49:43.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.539+0000 7f984aa00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f98441137b0 con 0x7f9844104100 2024-05-08T05:49:43.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.540+0000 7f9848a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9844108850 0x7f98441a05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:43.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.540+0000 7f9843e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9844103750 0x7f984419bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:43.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.540+0000 7f9848a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9844108850 0x7f98441a05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38720/0 (socket says 172.21.15.82:38720) 2024-05-08T05:49:43.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.540+0000 7f9848a00700 1 -- 172.21.15.82:0/619683055 learned_addr learned my addr 172.21.15.82:0/619683055 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:49:43.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.540+0000 7f9843400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9844104100 0x7f984419c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:43.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.540+0000 7f9843400700 1 -- 172.21.15.82:0/619683055 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9844103750 msgr2=0x7f984419bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:43.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.540+0000 7f9843400700 1 --2- 172.21.15.82:0/619683055 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9844103750 0x7f984419bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:43.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.540+0000 7f9843400700 1 -- 172.21.15.82:0/619683055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9844108850 msgr2=0x7f98441a05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:43.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.540+0000 7f9843400700 1 --2- 172.21.15.82:0/619683055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9844108850 0x7f98441a05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:43.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.540+0000 7f9843400700 1 -- 172.21.15.82:0/619683055 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98441a0d30 con 0x7f9844104100 2024-05-08T05:49:43.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.540+0000 7f9843e00700 1 --2- 172.21.15.82:0/619683055 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9844103750 0x7f984419bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:49:43.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.541+0000 7f9843400700 1 --2- 172.21.15.82:0/619683055 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9844104100 0x7f984419c260 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9830000c00 tx=0x7f983000fa20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:49:43.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.541+0000 7f9840c00700 1 -- 172.21.15.82:0/619683055 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98300050c0 con 0x7f9844104100 2024-05-08T05:49:43.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.541+0000 7f9840c00700 1 -- 172.21.15.82:0/619683055 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f983000b560 con 0x7f9844104100 2024-05-08T05:49:43.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.541+0000 7f9840c00700 1 -- 172.21.15.82:0/619683055 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98300038e0 con 0x7f9844104100 2024-05-08T05:49:43.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.541+0000 7f984aa00700 1 -- 172.21.15.82:0/619683055 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98441a0fc0 con 0x7f9844104100 2024-05-08T05:49:43.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.541+0000 7f984aa00700 1 -- 172.21.15.82:0/619683055 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98441a88a0 con 0x7f9844104100 2024-05-08T05:49:43.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.545+0000 7f9840c00700 1 -- 172.21.15.82:0/619683055 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f9830005260 con 0x7f9844104100 2024-05-08T05:49:43.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.546+0000 7f985542bb80 1 Processor -- start 2024-05-08T05:49:43.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.546+0000 7f9840c00700 1 --2- 172.21.15.82:0/619683055 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f98280b2900 0x7f98280b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:43.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.546+0000 7f985542bb80 1 -- start start 2024-05-08T05:49:43.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.547+0000 7f9840c00700 1 -- 172.21.15.82:0/619683055 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f98300e2aa0 con 0x7f9844104100 2024-05-08T05:49:43.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.547+0000 7f9848a00700 1 --2- 172.21.15.82:0/619683055 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f98280b2900 0x7f98280b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:43.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.547+0000 7f985542bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f7a9c4b70 0x564f7a9c4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:43.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.547+0000 7f985542bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f7a9c5490 0x564f7a9bf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:43.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.547+0000 7f985542bb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564f7a9bf8a0 0x564f7a9bfd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:43.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.547+0000 7f985542bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x564f7a9119d0 con 0x564f7a9c5490 2024-05-08T05:49:43.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.547+0000 7f985542bb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564f7a8af710 con 0x564f7a9bf8a0 2024-05-08T05:49:43.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.547+0000 7f985542bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564f7a90d990 con 0x564f7a9c4b70 2024-05-08T05:49:43.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.547+0000 7f9843e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f7a9c4b70 0x564f7a9c4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:43.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.547+0000 7f9843e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f7a9c4b70 0x564f7a9c4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:38516/0 (socket says 172.21.15.82:38516) 2024-05-08T05:49:43.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.547+0000 7f9843e00700 1 -- 172.21.15.82:0/2650645080 learned_addr learned my addr 172.21.15.82:0/2650645080 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:49:43.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.548+0000 7f9848a00700 1 --2- 172.21.15.82:0/2650645080 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564f7a9bf8a0 0x564f7a9bfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:43.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.548+0000 7f9843400700 1 --2- 172.21.15.82:0/2650645080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f7a9c5490 0x564f7a9bf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:43.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.548+0000 7f9843e00700 1 -- 172.21.15.82:0/2650645080 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564f7a9bf8a0 msgr2=0x564f7a9bfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:49:43.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.548+0000 7f9843e00700 1 --2- 172.21.15.82:0/2650645080 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564f7a9bf8a0 0x564f7a9bfd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:43.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.548+0000 7f9843e00700 1 -- 172.21.15.82:0/2650645080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f7a9c5490 msgr2=0x564f7a9bf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:49:43.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.548+0000 7f9843e00700 1 --2- 172.21.15.82:0/2650645080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f7a9c5490 0x564f7a9bf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:43.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.548+0000 7f9848a00700 1 --2- 172.21.15.82:0/619683055 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f98280b2900 0x7f98280b4dc0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f983c009c10 tx=0x7f983c00b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:49:43.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.548+0000 7f9843e00700 1 -- 172.21.15.82:0/2650645080 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f7a85e880 con 0x564f7a9c4b70 2024-05-08T05:49:43.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.548+0000 7f9843400700 1 --2- 172.21.15.82:0/2650645080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f7a9c5490 0x564f7a9bf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:49:43.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.548+0000 7f9843e00700 1 --2- 172.21.15.82:0/2650645080 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f7a9c4b70 0x564f7a9c4f50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f98340115e0 tx=0x7f98340118f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=603c4cc12cb69dbf server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:49:43.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.548+0000 7f9839600700 1 -- 172.21.15.82:0/2650645080 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9834004230 con 0x564f7a9c4b70 2024-05-08T05:49:43.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.549+0000 7f9839600700 1 -- 172.21.15.82:0/2650645080 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f983401adc0 con 0x564f7a9c4b70 2024-05-08T05:49:43.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.549+0000 7f9839600700 1 -- 172.21.15.82:0/2650645080 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9834005020 con 0x564f7a9c4b70 2024-05-08T05:49:43.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.550+0000 7f985542bb80 1 -- 172.21.15.82:0/2650645080 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f7a9c4b70 msgr2=0x564f7a9c4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:43.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.550+0000 7f985542bb80 1 --2- 172.21.15.82:0/2650645080 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f7a9c4b70 0x564f7a9c4f50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f98340115e0 tx=0x7f98340118f0 comp rx=0 tx=0).stop 2024-05-08T05:49:43.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.550+0000 7f985542bb80 1 -- 172.21.15.82:0/2650645080 shutdown_connections 2024-05-08T05:49:43.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.550+0000 7f985542bb80 1 --2- 172.21.15.82:0/2650645080 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564f7a9bf8a0 0x564f7a9bfd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:43.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.550+0000 7f985542bb80 1 --2- 172.21.15.82:0/2650645080 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f7a9c4b70 0x564f7a9c4f50 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:43.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.550+0000 7f985542bb80 1 --2- 172.21.15.82:0/2650645080 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f7a9c5490 0x564f7a9bf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:43.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.550+0000 7f985542bb80 1 -- 172.21.15.82:0/2650645080 >> 172.21.15.82:0/2650645080 conn(0x564f7a937680 msgr2=0x564f7a9b9ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:49:43.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.550+0000 7f985542bb80 1 -- 172.21.15.82:0/2650645080 shutdown_connections 2024-05-08T05:49:43.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.550+0000 7f985542bb80 1 -- 172.21.15.82:0/2650645080 wait complete. 2024-05-08T05:49:43.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.551+0000 7f985542bb80 1 -- start start 2024-05-08T05:49:43.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.551+0000 7f985542bb80 1 Processor -- start 2024-05-08T05:49:43.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.551+0000 7f985542bb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564f7a9bf8a0 0x564f7a9cb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:43.552 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.551+0000 7f985542bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f7a9c4b70 0x564f7a9c8550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:43.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.552+0000 7f985542bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f7a9c5490 0x564f7a9c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:43.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.552+0000 7f985542bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x564f7a9cbed0 con 0x564f7a9c4b70 2024-05-08T05:49:43.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.552+0000 7f985542bb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564f7a877ad0 con 0x564f7a9bf8a0 2024-05-08T05:49:43.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.552+0000 7f985542bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564f7a9cc050 con 0x564f7a9c5490 2024-05-08T05:49:43.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.552+0000 7f985542bb80 10 client.0 _ll_register_callbacks cb 0x564f7a8b8c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:49:43.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.552+0000 7f9843e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564f7a9bf8a0 0x564f7a9cb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:43.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.552+0000 7f9843e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564f7a9bf8a0 0x564f7a9cb1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:41934/0 (socket says 172.21.15.82:41934) 2024-05-08T05:49:43.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.552+0000 7f9843e00700 1 -- 172.21.15.82:0/3073615315 learned_addr learned my addr 172.21.15.82:0/3073615315 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:49:43.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.552+0000 7f9843400700 1 --2- 172.21.15.82:0/3073615315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f7a9c4b70 0x564f7a9c8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:43.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.552+0000 7f9848a00700 1 --2- 172.21.15.82:0/3073615315 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f7a9c5490 0x564f7a9c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:43.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.553+0000 7f9843e00700 1 -- 172.21.15.82:0/3073615315 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f7a9c5490 msgr2=0x564f7a9c8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:49:43.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.553+0000 7f9843e00700 1 --2- 172.21.15.82:0/3073615315 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f7a9c5490 0x564f7a9c8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:43.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.553+0000 7f9843e00700 1 -- 172.21.15.82:0/3073615315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f7a9c4b70 msgr2=0x564f7a9c8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:49:43.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.553+0000 7f9843e00700 1 --2- 172.21.15.82:0/3073615315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f7a9c4b70 0x564f7a9c8550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:43.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.553+0000 7f9843e00700 1 -- 172.21.15.82:0/3073615315 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f7a8d73d0 con 0x564f7a9bf8a0 2024-05-08T05:49:43.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.553+0000 7f9848a00700 1 --2- 172.21.15.82:0/3073615315 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f7a9c5490 0x564f7a9c8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:49:43.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.553+0000 7f9843e00700 1 --2- 172.21.15.82:0/3073615315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564f7a9bf8a0 0x564f7a9cb1b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9834004a60 tx=0x7f9834009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c21cbd74d143f3e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:49:43.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.553+0000 7f982e000700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:49:43.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.553+0000 7f982e000700 1 -- 172.21.15.82:0/3073615315 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f983402f030 con 0x564f7a9bf8a0 2024-05-08T05:49:43.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.553+0000 7f982e000700 1 -- 172.21.15.82:0/3073615315 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f9834027050 con 0x564f7a9bf8a0 2024-05-08T05:49:43.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.553+0000 7f985542bb80 1 -- 172.21.15.82:0/3073615315 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f983401adc0 con 0x564f7a9bf8a0 2024-05-08T05:49:43.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.554+0000 7f982e000700 1 -- 172.21.15.82:0/3073615315 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9834004810 con 0x564f7a9bf8a0 2024-05-08T05:49:43.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.554+0000 7f985542bb80 10 client.25019 fetch_fsmap learned FSMap version 28 2024-05-08T05:49:43.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.554+0000 7f985542bb80 1 -- 172.21.15.82:0/3073615315 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564f7a9d66f0 con 0x564f7a9bf8a0 2024-05-08T05:49:43.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.554+0000 7f982e000700 1 -- 172.21.15.82:0/3073615315 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f983401adc0 con 0x564f7a9bf8a0 2024-05-08T05:49:43.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.554+0000 7f982e000700 1 -- 172.21.15.82:0/3073615315 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f9834003c90 con 0x564f7a9bf8a0 2024-05-08T05:49:43.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.555+0000 7f985542bb80 10 client.25019 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T05:49:43.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.555+0000 7f985542bb80 10 client.25019 resolve_mds: resolved name 'f' to daemon mds.f 2024-05-08T05:49:43.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.555+0000 7f985542bb80 20 client.25019 populate_metadata read hostname 'smithi082' 2024-05-08T05:49:43.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.555+0000 7f985542bb80 1 --2- 172.21.15.82:0/3073615315 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x564f7a9d8890 0x564f7a9d9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:43.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.555+0000 7f985542bb80 4 client.25019 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:49:43.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.555+0000 7f985542bb80 1 -- 172.21.15.82:0/3073615315 --> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f7a98c0f0 con 0x564f7a9d8890 2024-05-08T05:49:43.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.555+0000 7f9843400700 1 --2- 172.21.15.82:0/3073615315 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x564f7a9d8890 0x564f7a9d9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:43.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.556+0000 7f9843400700 1 --2- 172.21.15.82:0/3073615315 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x564f7a9d8890 0x564f7a9d9d00 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=7858846695587cd1 server_cookie=6e6e12693f3ec6de in_seq=0 out_seq=0 2024-05-08T05:49:43.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.556+0000 7f982e000700 10 client.25019 ms_handle_connect on v2:172.21.15.151:6834/2093655929 2024-05-08T05:49:43.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.557+0000 7f982e000700 1 -- 172.21.15.82:0/3073615315 <== mds.3 v2:172.21.15.151:6834/2093655929 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564f7a98c0f0 con 0x564f7a9d8890 2024-05-08T05:49:43.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.557+0000 7f982e000700 10 client.25019 handle_command_reply: tid=0 2024-05-08T05:49:43.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.557+0000 7f985542bb80 1 client.25019 shutdown 2024-05-08T05:49:43.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.557+0000 7f985542bb80 1 -- 172.21.15.82:0/3073615315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564f7a9bf8a0 msgr2=0x564f7a9cb1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:43.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.557+0000 7f985542bb80 1 --2- 172.21.15.82:0/3073615315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564f7a9bf8a0 0x564f7a9cb1b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f9834004a60 tx=0x7f9834009b80 comp rx=0 tx=0).stop 2024-05-08T05:49:43.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.557+0000 7f985542bb80 1 -- 172.21.15.82:0/3073615315 shutdown_connections 2024-05-08T05:49:43.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.557+0000 7f985542bb80 1 --2- 172.21.15.82:0/3073615315 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x564f7a9d8890 0x564f7a9d9d00 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:43.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.557+0000 7f985542bb80 1 --2- 172.21.15.82:0/3073615315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564f7a9bf8a0 0x564f7a9cb1b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:43.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.557+0000 7f985542bb80 1 --2- 172.21.15.82:0/3073615315 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f7a9c5490 0x564f7a9c8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:43.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.557+0000 7f985542bb80 1 --2- 172.21.15.82:0/3073615315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f7a9c4b70 0x564f7a9c8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:43.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.557+0000 7f982e000700 0 client.25019 ms_handle_reset on v2:172.21.15.151:6834/2093655929 2024-05-08T05:49:43.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.557+0000 7f985542bb80 1 -- 172.21.15.82:0/3073615315 >> 172.21.15.82:0/3073615315 conn(0x564f7a937680 msgr2=0x564f7a9b9140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:49:43.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.557+0000 7f985542bb80 1 -- 172.21.15.82:0/3073615315 shutdown_connections 2024-05-08T05:49:43.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.557+0000 7f985542bb80 1 -- 172.21.15.82:0/3073615315 wait complete. 2024-05-08T05:49:43.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.557+0000 7f985542bb80 20 client.25019 trim_cache size 0 max 16384 2024-05-08T05:49:43.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.599+0000 7f985542bb80 1 Processor -- start 2024-05-08T05:49:43.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.599+0000 7f985542bb80 1 -- start start 2024-05-08T05:49:43.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.599+0000 7f985542bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f7a9bf8a0 0x564f7a9bf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:43.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.599+0000 7f985542bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f7a9c4b70 0x564f7a9c2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:43.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.599+0000 7f985542bb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564f7a9c5490 0x564f7a9c5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:43.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.599+0000 7f985542bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x564f7a9d8040 con 0x564f7a9bf8a0 2024-05-08T05:49:43.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.599+0000 7f985542bb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564f7a9d8710 con 0x564f7a9c5490 2024-05-08T05:49:43.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.599+0000 7f985542bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564f7a9d8de0 con 0x564f7a9c4b70 2024-05-08T05:49:43.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.600+0000 7f9843e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f7a9bf8a0 0x564f7a9bf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:43.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.600+0000 7f9843400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f7a9c4b70 0x564f7a9c2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:43.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.600+0000 7f9843400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f7a9c4b70 0x564f7a9c2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:38522/0 (socket says 172.21.15.82:38522) 2024-05-08T05:49:43.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.600+0000 7f9843400700 1 -- 172.21.15.82:0/1537616528 learned_addr learned my addr 172.21.15.82:0/1537616528 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:49:43.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.600+0000 7f9848a00700 1 --2- 172.21.15.82:0/1537616528 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564f7a9c5490 0x564f7a9c5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:43.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.600+0000 7f9843400700 1 -- 172.21.15.82:0/1537616528 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564f7a9c5490 msgr2=0x564f7a9c5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:49:43.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.600+0000 7f9843400700 1 --2- 172.21.15.82:0/1537616528 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564f7a9c5490 0x564f7a9c5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:43.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.600+0000 7f9843400700 1 -- 172.21.15.82:0/1537616528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f7a9bf8a0 msgr2=0x564f7a9bf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:49:43.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.600+0000 7f9843400700 1 --2- 172.21.15.82:0/1537616528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f7a9bf8a0 0x564f7a9bf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:43.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.600+0000 7f9843400700 1 -- 172.21.15.82:0/1537616528 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f7a9c6ae0 con 0x564f7a9c4b70 2024-05-08T05:49:43.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.601+0000 7f9843400700 1 --2- 172.21.15.82:0/1537616528 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f7a9c4b70 0x564f7a9c2d30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f983000b470 tx=0x7f9830005a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96b8aad390ce01c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:49:43.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.601+0000 7f9838c00700 1 -- 172.21.15.82:0/1537616528 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98300aa100 con 0x564f7a9c4b70 2024-05-08T05:49:43.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.601+0000 7f9838c00700 1 -- 172.21.15.82:0/1537616528 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f98300ae4b0 con 0x564f7a9c4b70 2024-05-08T05:49:43.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.601+0000 7f9838c00700 1 -- 172.21.15.82:0/1537616528 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98300aa5c0 con 0x564f7a9c4b70 2024-05-08T05:49:43.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.602+0000 7f985542bb80 1 -- 172.21.15.82:0/1537616528 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f7a9c4b70 msgr2=0x564f7a9c2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:43.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.602+0000 7f985542bb80 1 --2- 172.21.15.82:0/1537616528 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f7a9c4b70 0x564f7a9c2d30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f983000b470 tx=0x7f9830005a00 comp rx=0 tx=0).stop 2024-05-08T05:49:43.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.602+0000 7f985542bb80 1 -- 172.21.15.82:0/1537616528 shutdown_connections 2024-05-08T05:49:43.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.602+0000 7f985542bb80 1 --2- 172.21.15.82:0/1537616528 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564f7a9c5490 0x564f7a9c5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:43.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.602+0000 7f985542bb80 1 --2- 172.21.15.82:0/1537616528 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f7a9bf8a0 0x564f7a9bf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:43.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.602+0000 7f985542bb80 1 --2- 172.21.15.82:0/1537616528 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f7a9c4b70 0x564f7a9c2d30 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:43.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.602+0000 7f985542bb80 1 -- 172.21.15.82:0/1537616528 >> 172.21.15.82:0/1537616528 conn(0x564f7a937680 msgr2=0x564f7a9c5870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:49:43.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.602+0000 7f985542bb80 1 -- 172.21.15.82:0/1537616528 shutdown_connections 2024-05-08T05:49:43.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.602+0000 7f985542bb80 1 -- 172.21.15.82:0/1537616528 wait complete. 2024-05-08T05:49:43.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.602+0000 7f985542bb80 1 -- start start 2024-05-08T05:49:43.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.603+0000 7f985542bb80 1 Processor -- start 2024-05-08T05:49:43.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.603+0000 7f985542bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f7a9bf8a0 0x564f7a9e3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:43.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.603+0000 7f985542bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f7a9c4b70 0x564f7a9b88b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:43.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.603+0000 7f985542bb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564f7a9c5490 0x564f7a9b8df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:43.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.603+0000 7f985542bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x564f7a9d9b80 con 0x564f7a9bf8a0 2024-05-08T05:49:43.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.603+0000 7f985542bb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564f7a9d94b0 con 0x564f7a9c5490 2024-05-08T05:49:43.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.603+0000 7f985542bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564f7a9da250 con 0x564f7a9c4b70 2024-05-08T05:49:43.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.603+0000 7f985542bb80 10 client.0 _ll_register_callbacks cb 0x564f7a8b8c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:49:43.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.604+0000 7f9843e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f7a9bf8a0 0x564f7a9e3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:43.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.604+0000 7f9843e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f7a9bf8a0 0x564f7a9e3410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38770/0 (socket says 172.21.15.82:38770) 2024-05-08T05:49:43.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.604+0000 7f9843e00700 1 -- 172.21.15.82:0/1541396118 learned_addr learned my addr 172.21.15.82:0/1541396118 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:49:43.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.604+0000 7f9848a00700 1 --2- 172.21.15.82:0/1541396118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564f7a9c5490 0x564f7a9b8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:43.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.604+0000 7f9843400700 1 --2- 172.21.15.82:0/1541396118 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f7a9c4b70 0x564f7a9b88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:43.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.604+0000 7f9848a00700 1 -- 172.21.15.82:0/1541396118 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f7a9c4b70 msgr2=0x564f7a9b88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:49:43.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.604+0000 7f9848a00700 1 --2- 172.21.15.82:0/1541396118 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f7a9c4b70 0x564f7a9b88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:43.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.604+0000 7f9848a00700 1 -- 172.21.15.82:0/1541396118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f7a9bf8a0 msgr2=0x564f7a9e3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:49:43.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.604+0000 7f9848a00700 1 --2- 172.21.15.82:0/1541396118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f7a9bf8a0 0x564f7a9e3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:43.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.604+0000 7f9848a00700 1 -- 172.21.15.82:0/1541396118 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f7a9b9330 con 0x564f7a9c5490 2024-05-08T05:49:43.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.604+0000 7f9843400700 1 --2- 172.21.15.82:0/1541396118 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f7a9c4b70 0x564f7a9b88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:49:43.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.604+0000 7f9848a00700 1 --2- 172.21.15.82:0/1541396118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564f7a9c5490 0x564f7a9b8df0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f983c00ffd0 tx=0x7f983c004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5165385e534cfbd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:49:43.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.604+0000 7f982e000700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:49:43.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.605+0000 7f982e000700 1 -- 172.21.15.82:0/1541396118 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f983c023420 con 0x564f7a9c5490 2024-05-08T05:49:43.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.605+0000 7f985542bb80 1 -- 172.21.15.82:0/1541396118 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f98300ae4b0 con 0x564f7a9c5490 2024-05-08T05:49:43.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.605+0000 7f982e000700 1 -- 172.21.15.82:0/1541396118 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f983c0235c0 con 0x564f7a9c5490 2024-05-08T05:49:43.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.605+0000 7f982e000700 1 -- 172.21.15.82:0/1541396118 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f983c0237c0 con 0x564f7a9c5490 2024-05-08T05:49:43.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.605+0000 7f985542bb80 10 client.25025 fetch_fsmap learned FSMap version 28 2024-05-08T05:49:43.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.605+0000 7f985542bb80 1 -- 172.21.15.82:0/1541396118 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564f7a9e2ee0 con 0x564f7a9c5490 2024-05-08T05:49:43.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.606+0000 7f982e000700 1 -- 172.21.15.82:0/1541396118 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f98300ae4b0 con 0x564f7a9c5490 2024-05-08T05:49:43.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.606+0000 7f982e000700 1 -- 172.21.15.82:0/1541396118 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f983c02d860 con 0x564f7a9c5490 2024-05-08T05:49:43.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.606+0000 7f985542bb80 10 client.25025 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T05:49:43.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.606+0000 7f985542bb80 10 client.25025 resolve_mds: resolved name 'f' to daemon mds.f 2024-05-08T05:49:43.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.606+0000 7f985542bb80 20 client.25025 populate_metadata read hostname 'smithi082' 2024-05-08T05:49:43.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.606+0000 7f985542bb80 1 --2- 172.21.15.82:0/1541396118 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x564f7aa486f0 0x564f7aa47400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:43.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.606+0000 7f985542bb80 4 client.25025 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T05:49:43.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.606+0000 7f985542bb80 1 -- 172.21.15.82:0/1541396118 --> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] -- command(tid 0: {"prefix": "status"}) -- 0x564f7a91f3b0 con 0x564f7aa486f0 2024-05-08T05:49:43.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.606+0000 7f9843e00700 1 --2- 172.21.15.82:0/1541396118 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x564f7aa486f0 0x564f7aa47400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:43.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.607+0000 7f9843e00700 1 --2- 172.21.15.82:0/1541396118 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x564f7aa486f0 0x564f7aa47400 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=152eeff8245d9d11 server_cookie=5df75b6b3d49d68f in_seq=0 out_seq=0 2024-05-08T05:49:43.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.607+0000 7f982e000700 10 client.25025 ms_handle_connect on v2:172.21.15.151:6834/2093655929 2024-05-08T05:49:43.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.607+0000 7f982e000700 1 -- 172.21.15.82:0/1541396118 <== mds.3 v2:172.21.15.151:6834/2093655929 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x564f7a91f3b0 con 0x564f7aa486f0 2024-05-08T05:49:43.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.607+0000 7f982e000700 10 client.25025 handle_command_reply: tid=0 2024-05-08T05:49:43.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.607+0000 7f985542bb80 1 client.25025 shutdown 2024-05-08T05:49:43.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.607+0000 7f985542bb80 1 -- 172.21.15.82:0/1541396118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564f7a9c5490 msgr2=0x564f7a9b8df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:43.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.607+0000 7f985542bb80 1 --2- 172.21.15.82:0/1541396118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564f7a9c5490 0x564f7a9b8df0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f983c00ffd0 tx=0x7f983c004ad0 comp rx=0 tx=0).stop 2024-05-08T05:49:43.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.608+0000 7f985542bb80 1 -- 172.21.15.82:0/1541396118 shutdown_connections 2024-05-08T05:49:43.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.608+0000 7f985542bb80 1 --2- 172.21.15.82:0/1541396118 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x564f7aa486f0 0x564f7aa47400 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:43.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.608+0000 7f985542bb80 1 --2- 172.21.15.82:0/1541396118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564f7a9c5490 0x564f7a9b8df0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:43.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.608+0000 7f985542bb80 1 --2- 172.21.15.82:0/1541396118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564f7a9bf8a0 0x564f7a9e3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:43.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.608+0000 7f985542bb80 1 --2- 172.21.15.82:0/1541396118 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f7a9c4b70 0x564f7a9b88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:43.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.608+0000 7f982e000700 0 client.25025 ms_handle_reset on v2:172.21.15.151:6834/2093655929 2024-05-08T05:49:43.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.608+0000 7f985542bb80 1 -- 172.21.15.82:0/1541396118 >> 172.21.15.82:0/1541396118 conn(0x564f7a937680 msgr2=0x564f7a9c36f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:49:43.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.608+0000 7f985542bb80 1 -- 172.21.15.82:0/1541396118 shutdown_connections 2024-05-08T05:49:43.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.608+0000 7f985542bb80 1 -- 172.21.15.82:0/1541396118 wait complete. 2024-05-08T05:49:43.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.608+0000 7f985542bb80 20 client.25025 trim_cache size 0 max 16384 2024-05-08T05:49:43.610 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T05:49:43.610 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "c739a5c8-0cfc-11ef-bc97-c7b262605968", 2024-05-08T05:49:43.610 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 3, 2024-05-08T05:49:43.610 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 24475, 2024-05-08T05:49:43.610 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-05-08T05:49:43.610 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-05-08T05:49:43.610 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-05-08T05:49:43.610 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 207.67030498599999, 2024-05-08T05:49:43.611 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 28, 2024-05-08T05:49:43.611 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 82, 2024-05-08T05:49:43.611 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 80, 2024-05-08T05:49:43.611 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 269.56002035400002 2024-05-08T05:49:43.611 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T05:49:43.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.609+0000 7f984aa00700 1 -- 172.21.15.82:0/619683055 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f98280b2900 msgr2=0x7f98280b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:43.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.609+0000 7f984aa00700 1 --2- 172.21.15.82:0/619683055 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f98280b2900 0x7f98280b4dc0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f983c009c10 tx=0x7f983c00b040 comp rx=0 tx=0).stop 2024-05-08T05:49:43.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.609+0000 7f984aa00700 1 -- 172.21.15.82:0/619683055 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9844104100 msgr2=0x7f984419c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:43.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.609+0000 7f984aa00700 1 --2- 172.21.15.82:0/619683055 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9844104100 0x7f984419c260 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f9830000c00 tx=0x7f983000fa20 comp rx=0 tx=0).stop 2024-05-08T05:49:43.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.609+0000 7f984aa00700 1 -- 172.21.15.82:0/619683055 shutdown_connections 2024-05-08T05:49:43.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.609+0000 7f984aa00700 1 --2- 172.21.15.82:0/619683055 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9844103750 0x7f984419bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:43.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.609+0000 7f984aa00700 1 --2- 172.21.15.82:0/619683055 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f98280b2900 0x7f98280b4dc0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:43.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.609+0000 7f984aa00700 1 --2- 172.21.15.82:0/619683055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9844108850 0x7f98441a05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:43.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.609+0000 7f984aa00700 1 --2- 172.21.15.82:0/619683055 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9844104100 0x7f984419c260 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:43.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.609+0000 7f984aa00700 1 -- 172.21.15.82:0/619683055 >> 172.21.15.82:0/619683055 conn(0x7f984407a600 msgr2=0x7f98441015a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:49:43.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.609+0000 7f984aa00700 1 -- 172.21.15.82:0/619683055 shutdown_connections 2024-05-08T05:49:43.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:43.609+0000 7f984aa00700 1 -- 172.21.15.82:0/619683055 wait complete. 2024-05-08T05:49:43.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:49:43 smithi151 ceph-mon[34815]: pgmap v431: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:49:43.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:49:43 smithi134 ceph-mon[34132]: pgmap v431: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:49:44.675 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.c status 2024-05-08T05:49:45.099 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:49:45.572 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:49:45 smithi082 ceph-mon[30098]: pgmap v432: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-08T05:49:45.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:49:45 smithi151 ceph-mon[34815]: pgmap v432: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-08T05:49:45.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:49:45 smithi134 ceph-mon[34132]: pgmap v432: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-08T05:49:47.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.416+0000 7fb385a00700 1 -- 172.21.15.82:0/1826835912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb380109ad0 msgr2=0x7fb380109f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:47.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.416+0000 7fb385a00700 1 --2- 172.21.15.82:0/1826835912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb380109ad0 0x7fb380109f50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb36c009990 tx=0x7fb36c009ca0 comp rx=0 tx=0).stop 2024-05-08T05:49:47.419 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:49:47 smithi082 ceph-mon[30098]: pgmap v433: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-08T05:49:47.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.417+0000 7fb385a00700 1 -- 172.21.15.82:0/1826835912 shutdown_connections 2024-05-08T05:49:47.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.417+0000 7fb385a00700 1 --2- 172.21.15.82:0/1826835912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb38010a490 0x7fb3801169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:47.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.417+0000 7fb385a00700 1 --2- 172.21.15.82:0/1826835912 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb38010fb60 0x7fb38010ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:47.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.417+0000 7fb385a00700 1 --2- 172.21.15.82:0/1826835912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb380109ad0 0x7fb380109f50 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:47.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.417+0000 7fb385a00700 1 -- 172.21.15.82:0/1826835912 >> 172.21.15.82:0/1826835912 conn(0x7fb380076c70 msgr2=0x7fb3801082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:49:47.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.417+0000 7fb385a00700 1 -- 172.21.15.82:0/1826835912 shutdown_connections 2024-05-08T05:49:47.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.417+0000 7fb385a00700 1 -- 172.21.15.82:0/1826835912 wait complete. 2024-05-08T05:49:47.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.418+0000 7fb385a00700 1 Processor -- start 2024-05-08T05:49:47.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.418+0000 7fb385a00700 1 -- start start 2024-05-08T05:49:47.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.419+0000 7fb385a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb380109ad0 0x7fb3801a01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:47.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.419+0000 7fb385a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb38010a490 0x7fb3801a0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:47.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.419+0000 7fb385a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb38010fb60 0x7fb3801a4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:47.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.419+0000 7fb385a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb380119d10 con 0x7fb38010a490 2024-05-08T05:49:47.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.419+0000 7fb385a00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb380119b90 con 0x7fb380109ad0 2024-05-08T05:49:47.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.419+0000 7fb385a00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb380119e90 con 0x7fb38010fb60 2024-05-08T05:49:47.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.419+0000 7fb37ea00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb380109ad0 0x7fb3801a01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:47.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.419+0000 7fb37ea00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb380109ad0 0x7fb3801a01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:41978/0 (socket says 172.21.15.82:41978) 2024-05-08T05:49:47.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.419+0000 7fb37ea00700 1 -- 172.21.15.82:0/131744220 learned_addr learned my addr 172.21.15.82:0/131744220 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:49:47.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.419+0000 7fb37e000700 1 --2- 172.21.15.82:0/131744220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb38010a490 0x7fb3801a0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:47.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.419+0000 7fb37f400700 1 --2- 172.21.15.82:0/131744220 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb38010fb60 0x7fb3801a4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:47.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.419+0000 7fb37ea00700 1 -- 172.21.15.82:0/131744220 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb38010fb60 msgr2=0x7fb3801a4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:47.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.419+0000 7fb37ea00700 1 --2- 172.21.15.82:0/131744220 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb38010fb60 0x7fb3801a4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:47.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.419+0000 7fb37ea00700 1 -- 172.21.15.82:0/131744220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb38010a490 msgr2=0x7fb3801a0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:47.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.419+0000 7fb37ea00700 1 --2- 172.21.15.82:0/131744220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb38010a490 0x7fb3801a0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:47.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.420+0000 7fb37ea00700 1 -- 172.21.15.82:0/131744220 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3801a51d0 con 0x7fb380109ad0 2024-05-08T05:49:47.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.420+0000 7fb37f400700 1 --2- 172.21.15.82:0/131744220 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb38010fb60 0x7fb3801a4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:49:47.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.420+0000 7fb37ea00700 1 --2- 172.21.15.82:0/131744220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb380109ad0 0x7fb3801a01c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb37000e9c0 tx=0x7fb37000ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:49:47.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.420+0000 7fb377400700 1 -- 172.21.15.82:0/131744220 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb37000cbd0 con 0x7fb380109ad0 2024-05-08T05:49:47.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.420+0000 7fb377400700 1 -- 172.21.15.82:0/131744220 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb37000cd70 con 0x7fb380109ad0 2024-05-08T05:49:47.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.420+0000 7fb385a00700 1 -- 172.21.15.82:0/131744220 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3801a54c0 con 0x7fb380109ad0 2024-05-08T05:49:47.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.420+0000 7fb377400700 1 -- 172.21.15.82:0/131744220 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb370005610 con 0x7fb380109ad0 2024-05-08T05:49:47.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.420+0000 7fb385a00700 1 -- 172.21.15.82:0/131744220 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3801acd40 con 0x7fb380109ad0 2024-05-08T05:49:47.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.424+0000 7fb377400700 1 -- 172.21.15.82:0/131744220 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fb370004750 con 0x7fb380109ad0 2024-05-08T05:49:47.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.425+0000 7fb377400700 1 --2- 172.21.15.82:0/131744220 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb3640b2880 0x7fb3640b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:47.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.426+0000 7fb39029fb80 1 Processor -- start 2024-05-08T05:49:47.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.426+0000 7fb377400700 1 -- 172.21.15.82:0/131744220 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb3700e2470 con 0x7fb380109ad0 2024-05-08T05:49:47.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.426+0000 7fb39029fb80 1 -- start start 2024-05-08T05:49:47.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.426+0000 7fb37e000700 1 --2- 172.21.15.82:0/131744220 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb3640b2880 0x7fb3640b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:47.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.426+0000 7fb39029fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e6253abb70 0x55e6253abf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:47.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.426+0000 7fb39029fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6253ac490 0x55e6253a6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:47.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.426+0000 7fb39029fb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6253a68a0 0x55e6253a6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:47.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.426+0000 7fb39029fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55e6252f89d0 con 0x55e6253ac490 2024-05-08T05:49:47.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.426+0000 7fb39029fb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e625296710 con 0x55e6253a68a0 2024-05-08T05:49:47.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.426+0000 7fb39029fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55e6252f4990 con 0x55e6253abb70 2024-05-08T05:49:47.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.427+0000 7fb37ea00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e6253abb70 0x55e6253abf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:47.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.427+0000 7fb37ea00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e6253abb70 0x55e6253abf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:38554/0 (socket says 172.21.15.82:38554) 2024-05-08T05:49:47.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.427+0000 7fb37ea00700 1 -- 172.21.15.82:0/4119511979 learned_addr learned my addr 172.21.15.82:0/4119511979 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:49:47.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.427+0000 7fb37f400700 1 --2- 172.21.15.82:0/4119511979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6253a68a0 0x55e6253a6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:47.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.427+0000 7fb37e000700 1 --2- 172.21.15.82:0/4119511979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6253ac490 0x55e6253a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:47.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.427+0000 7fb37ea00700 1 -- 172.21.15.82:0/4119511979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6253a68a0 msgr2=0x55e6253a6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:49:47.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.427+0000 7fb37ea00700 1 --2- 172.21.15.82:0/4119511979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6253a68a0 0x55e6253a6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:47.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.427+0000 7fb37ea00700 1 -- 172.21.15.82:0/4119511979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6253ac490 msgr2=0x55e6253a6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:49:47.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.427+0000 7fb37ea00700 1 --2- 172.21.15.82:0/4119511979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6253ac490 0x55e6253a6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:47.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.427+0000 7fb37ea00700 1 -- 172.21.15.82:0/4119511979 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e625245880 con 0x55e6253abb70 2024-05-08T05:49:47.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.427+0000 7fb37e000700 1 --2- 172.21.15.82:0/131744220 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb3640b2880 0x7fb3640b4d40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb380078b70 tx=0x7fb36c009630 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:49:47.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.427+0000 7fb37ea00700 1 --2- 172.21.15.82:0/4119511979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e6253abb70 0x55e6253abf50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb3700a9740 tx=0x7fb3700a9920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75351125891ee5cf server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:49:47.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.428+0000 7fb36be00700 1 -- 172.21.15.82:0/4119511979 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3700b2050 con 0x55e6253abb70 2024-05-08T05:49:47.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.428+0000 7fb36be00700 1 -- 172.21.15.82:0/4119511979 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3700a9550 con 0x55e6253abb70 2024-05-08T05:49:47.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.428+0000 7fb36be00700 1 -- 172.21.15.82:0/4119511979 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3700a9f00 con 0x55e6253abb70 2024-05-08T05:49:47.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.429+0000 7fb39029fb80 1 -- 172.21.15.82:0/4119511979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e6253abb70 msgr2=0x55e6253abf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:47.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.429+0000 7fb39029fb80 1 --2- 172.21.15.82:0/4119511979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e6253abb70 0x55e6253abf50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb3700a9740 tx=0x7fb3700a9920 comp rx=0 tx=0).stop 2024-05-08T05:49:47.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.429+0000 7fb39029fb80 1 -- 172.21.15.82:0/4119511979 shutdown_connections 2024-05-08T05:49:47.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.429+0000 7fb39029fb80 1 --2- 172.21.15.82:0/4119511979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6253a68a0 0x55e6253a6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:47.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.429+0000 7fb39029fb80 1 --2- 172.21.15.82:0/4119511979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e6253abb70 0x55e6253abf50 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:47.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.429+0000 7fb39029fb80 1 --2- 172.21.15.82:0/4119511979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6253ac490 0x55e6253a6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:47.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.429+0000 7fb39029fb80 1 -- 172.21.15.82:0/4119511979 >> 172.21.15.82:0/4119511979 conn(0x55e62531e680 msgr2=0x55e6253a0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:49:47.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.429+0000 7fb39029fb80 1 -- 172.21.15.82:0/4119511979 shutdown_connections 2024-05-08T05:49:47.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.429+0000 7fb39029fb80 1 -- 172.21.15.82:0/4119511979 wait complete. 2024-05-08T05:49:47.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.430+0000 7fb39029fb80 1 -- start start 2024-05-08T05:49:47.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.430+0000 7fb39029fb80 1 Processor -- start 2024-05-08T05:49:47.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.430+0000 7fb39029fb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6253a68a0 0x55e6253b2150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:47.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.430+0000 7fb39029fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e6253abb70 0x55e6253af4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:47.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.430+0000 7fb39029fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6253ac490 0x55e6253afa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:47.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.431+0000 7fb39029fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55e6253b2e70 con 0x55e6253ac490 2024-05-08T05:49:47.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.431+0000 7fb39029fb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e62525ead0 con 0x55e6253a68a0 2024-05-08T05:49:47.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.431+0000 7fb39029fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55e6253b2ff0 con 0x55e6253abb70 2024-05-08T05:49:47.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.431+0000 7fb39029fb80 10 client.0 _ll_register_callbacks cb 0x55e62529fc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:49:47.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.431+0000 7fb37f400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6253ac490 0x55e6253afa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:47.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.431+0000 7fb37e000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e6253abb70 0x55e6253af4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:47.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.431+0000 7fb37e000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e6253abb70 0x55e6253af4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:38564/0 (socket says 172.21.15.82:38564) 2024-05-08T05:49:47.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.431+0000 7fb37e000700 1 -- 172.21.15.82:0/1958028327 learned_addr learned my addr 172.21.15.82:0/1958028327 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:49:47.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.431+0000 7fb37ea00700 1 --2- 172.21.15.82:0/1958028327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6253a68a0 0x55e6253b2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:47.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.431+0000 7fb37f400700 1 -- 172.21.15.82:0/1958028327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e6253abb70 msgr2=0x55e6253af4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:49:47.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.431+0000 7fb37f400700 1 --2- 172.21.15.82:0/1958028327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e6253abb70 0x55e6253af4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:47.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.431+0000 7fb37f400700 1 -- 172.21.15.82:0/1958028327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6253a68a0 msgr2=0x55e6253b2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:49:47.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.431+0000 7fb37f400700 1 --2- 172.21.15.82:0/1958028327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6253a68a0 0x55e6253b2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:47.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.431+0000 7fb37f400700 1 -- 172.21.15.82:0/1958028327 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6252be3d0 con 0x55e6253ac490 2024-05-08T05:49:47.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.431+0000 7fb37e000700 1 --2- 172.21.15.82:0/1958028327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e6253abb70 0x55e6253af4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:49:47.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.431+0000 7fb37ea00700 1 --2- 172.21.15.82:0/1958028327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6253a68a0 0x55e6253b2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:49:47.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.432+0000 7fb37f400700 1 --2- 172.21.15.82:0/1958028327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6253ac490 0x55e6253afa30 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x55e6253a7260 tx=0x7fb378007c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7e44b377a7ef4f4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:49:47.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.432+0000 7fb368c00700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T05:49:47.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.432+0000 7fb368c00700 1 -- 172.21.15.82:0/1958028327 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb37801a070 con 0x55e6253ac490 2024-05-08T05:49:47.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.432+0000 7fb368c00700 1 -- 172.21.15.82:0/1958028327 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb378012990 con 0x55e6253ac490 2024-05-08T05:49:47.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.432+0000 7fb39029fb80 1 -- 172.21.15.82:0/1958028327 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3700a9550 con 0x55e6253ac490 2024-05-08T05:49:47.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.432+0000 7fb368c00700 1 -- 172.21.15.82:0/1958028327 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb378026050 con 0x55e6253ac490 2024-05-08T05:49:47.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.432+0000 7fb39029fb80 10 client.14946 fetch_fsmap learned FSMap version 28 2024-05-08T05:49:47.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.432+0000 7fb39029fb80 1 -- 172.21.15.82:0/1958028327 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e6253bd7a0 con 0x55e6253ac490 2024-05-08T05:49:47.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.433+0000 7fb368c00700 1 -- 172.21.15.82:0/1958028327 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3700a9550 con 0x55e6253ac490 2024-05-08T05:49:47.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.433+0000 7fb368c00700 1 -- 172.21.15.82:0/1958028327 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fb3780153c0 con 0x55e6253ac490 2024-05-08T05:49:47.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.433+0000 7fb39029fb80 10 client.14946 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T05:49:47.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.433+0000 7fb39029fb80 10 client.14946 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-08T05:49:47.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.433+0000 7fb39029fb80 20 client.14946 populate_metadata read hostname 'smithi082' 2024-05-08T05:49:47.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.433+0000 7fb39029fb80 1 --2- 172.21.15.82:0/1958028327 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55e6253bfe50 0x55e6253c12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:47.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.433+0000 7fb39029fb80 4 client.14946 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:49:47.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.433+0000 7fb39029fb80 1 -- 172.21.15.82:0/1958028327 --> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e6253730f0 con 0x55e6253bfe50 2024-05-08T05:49:47.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.433+0000 7fb37ea00700 1 --2- 172.21.15.82:0/1958028327 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55e6253bfe50 0x55e6253c12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:47.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.434+0000 7fb37ea00700 1 --2- 172.21.15.82:0/1958028327 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55e6253bfe50 0x55e6253c12c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a2ab59ce347f1398 server_cookie=8a7d58ce2cb2c4a in_seq=0 out_seq=0 2024-05-08T05:49:47.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.434+0000 7fb368c00700 10 client.14946 ms_handle_connect on v2:172.21.15.151:6836/4192404464 2024-05-08T05:49:47.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.435+0000 7fb368c00700 1 -- 172.21.15.82:0/1958028327 <== mds.2 v2:172.21.15.151:6836/4192404464 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55e6253730f0 con 0x55e6253bfe50 2024-05-08T05:49:47.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.435+0000 7fb368c00700 10 client.14946 handle_command_reply: tid=0 2024-05-08T05:49:47.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.435+0000 7fb39029fb80 1 client.14946 shutdown 2024-05-08T05:49:47.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.435+0000 7fb39029fb80 1 -- 172.21.15.82:0/1958028327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6253ac490 msgr2=0x55e6253afa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:47.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.435+0000 7fb39029fb80 1 --2- 172.21.15.82:0/1958028327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6253ac490 0x55e6253afa30 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x55e6253a7260 tx=0x7fb378007c60 comp rx=0 tx=0).stop 2024-05-08T05:49:47.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.435+0000 7fb39029fb80 1 -- 172.21.15.82:0/1958028327 shutdown_connections 2024-05-08T05:49:47.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.435+0000 7fb39029fb80 1 --2- 172.21.15.82:0/1958028327 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55e6253bfe50 0x55e6253c12c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:47.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.435+0000 7fb39029fb80 1 --2- 172.21.15.82:0/1958028327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6253a68a0 0x55e6253b2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:47.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.435+0000 7fb39029fb80 1 --2- 172.21.15.82:0/1958028327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6253ac490 0x55e6253afa30 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:47.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.435+0000 7fb39029fb80 1 --2- 172.21.15.82:0/1958028327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e6253abb70 0x55e6253af4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:47.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.435+0000 7fb39029fb80 1 -- 172.21.15.82:0/1958028327 >> 172.21.15.82:0/1958028327 conn(0x55e62531e680 msgr2=0x55e6253a0140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:49:47.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.435+0000 7fb368c00700 0 client.14946 ms_handle_reset on v2:172.21.15.151:6836/4192404464 2024-05-08T05:49:47.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.435+0000 7fb39029fb80 1 -- 172.21.15.82:0/1958028327 shutdown_connections 2024-05-08T05:49:47.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.435+0000 7fb39029fb80 1 -- 172.21.15.82:0/1958028327 wait complete. 2024-05-08T05:49:47.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.435+0000 7fb39029fb80 20 client.14946 trim_cache size 0 max 16384 2024-05-08T05:49:47.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.458+0000 7fb39029fb80 1 Processor -- start 2024-05-08T05:49:47.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.458+0000 7fb39029fb80 1 -- start start 2024-05-08T05:49:47.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.459+0000 7fb39029fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6253a68a0 0x55e6253a6280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:47.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.459+0000 7fb39029fb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6253abb70 0x55e6253ad150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:47.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.459+0000 7fb39029fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e6253ac490 0x55e6253ae4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:47.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.459+0000 7fb39029fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55e6253bf600 con 0x55e6253a68a0 2024-05-08T05:49:47.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.459+0000 7fb39029fb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e6253bfcd0 con 0x55e6253abb70 2024-05-08T05:49:47.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.459+0000 7fb39029fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55e6253c03a0 con 0x55e6253ac490 2024-05-08T05:49:47.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.459+0000 7fb37ea00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6253a68a0 0x55e6253a6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:47.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.459+0000 7fb37ea00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6253a68a0 0x55e6253a6280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38822/0 (socket says 172.21.15.82:38822) 2024-05-08T05:49:47.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.459+0000 7fb37ea00700 1 -- 172.21.15.82:0/2864278593 learned_addr learned my addr 172.21.15.82:0/2864278593 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:49:47.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.459+0000 7fb37e000700 1 --2- 172.21.15.82:0/2864278593 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6253abb70 0x55e6253ad150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:47.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.459+0000 7fb37f400700 1 --2- 172.21.15.82:0/2864278593 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e6253ac490 0x55e6253ae4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:47.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.459+0000 7fb37ea00700 1 -- 172.21.15.82:0/2864278593 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e6253ac490 msgr2=0x55e6253ae4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:49:47.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.459+0000 7fb37ea00700 1 --2- 172.21.15.82:0/2864278593 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e6253ac490 0x55e6253ae4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:47.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.459+0000 7fb37ea00700 1 -- 172.21.15.82:0/2864278593 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6253abb70 msgr2=0x55e6253ad150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:49:47.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.459+0000 7fb37ea00700 1 --2- 172.21.15.82:0/2864278593 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6253abb70 0x55e6253ad150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:47.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.459+0000 7fb37ea00700 1 -- 172.21.15.82:0/2864278593 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e62539ba60 con 0x55e6253a68a0 2024-05-08T05:49:47.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.459+0000 7fb37f400700 1 --2- 172.21.15.82:0/2864278593 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e6253ac490 0x55e6253ae4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:49:47.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.460+0000 7fb37ea00700 1 --2- 172.21.15.82:0/2864278593 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6253a68a0 0x55e6253a6280 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb3700ac040 tx=0x7fb3700cc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6e531c0a6b9f42e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:49:47.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.460+0000 7fb36b400700 1 -- 172.21.15.82:0/2864278593 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3700a9550 con 0x55e6253a68a0 2024-05-08T05:49:47.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.460+0000 7fb36b400700 1 -- 172.21.15.82:0/2864278593 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3700aa140 con 0x55e6253a68a0 2024-05-08T05:49:47.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.460+0000 7fb36b400700 1 -- 172.21.15.82:0/2864278593 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3700b2410 con 0x55e6253a68a0 2024-05-08T05:49:47.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.461+0000 7fb39029fb80 1 -- 172.21.15.82:0/2864278593 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6253a68a0 msgr2=0x55e6253a6280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:47.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.461+0000 7fb39029fb80 1 --2- 172.21.15.82:0/2864278593 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6253a68a0 0x55e6253a6280 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb3700ac040 tx=0x7fb3700cc040 comp rx=0 tx=0).stop 2024-05-08T05:49:47.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.461+0000 7fb39029fb80 1 -- 172.21.15.82:0/2864278593 shutdown_connections 2024-05-08T05:49:47.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.461+0000 7fb39029fb80 1 --2- 172.21.15.82:0/2864278593 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e6253ac490 0x55e6253ae4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:47.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.461+0000 7fb39029fb80 1 --2- 172.21.15.82:0/2864278593 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6253a68a0 0x55e6253a6280 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:47.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.461+0000 7fb39029fb80 1 --2- 172.21.15.82:0/2864278593 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6253abb70 0x55e6253ad150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:47.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.461+0000 7fb39029fb80 1 -- 172.21.15.82:0/2864278593 >> 172.21.15.82:0/2864278593 conn(0x55e62531e680 msgr2=0x55e6253adde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:49:47.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.461+0000 7fb39029fb80 1 -- 172.21.15.82:0/2864278593 shutdown_connections 2024-05-08T05:49:47.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.461+0000 7fb39029fb80 1 -- 172.21.15.82:0/2864278593 wait complete. 2024-05-08T05:49:47.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.462+0000 7fb39029fb80 1 -- start start 2024-05-08T05:49:47.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.462+0000 7fb39029fb80 1 Processor -- start 2024-05-08T05:49:47.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.462+0000 7fb39029fb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6253a68a0 0x55e62539fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:47.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.462+0000 7fb39029fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6253abb70 0x55e62539ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:47.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.462+0000 7fb39029fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e6253ac490 0x55e6253c9730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:47.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.462+0000 7fb39029fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55e6253c1140 con 0x55e6253abb70 2024-05-08T05:49:47.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.462+0000 7fb39029fb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e6253c0a70 con 0x55e6253a68a0 2024-05-08T05:49:47.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.462+0000 7fb39029fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55e6253c1810 con 0x55e6253ac490 2024-05-08T05:49:47.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.463+0000 7fb39029fb80 10 client.0 _ll_register_callbacks cb 0x55e62529fc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:49:47.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.463+0000 7fb37e000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6253abb70 0x55e62539ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:47.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.463+0000 7fb37e000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6253abb70 0x55e62539ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38824/0 (socket says 172.21.15.82:38824) 2024-05-08T05:49:47.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.463+0000 7fb37e000700 1 -- 172.21.15.82:0/2357250192 learned_addr learned my addr 172.21.15.82:0/2357250192 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:49:47.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.463+0000 7fb37ea00700 1 --2- 172.21.15.82:0/2357250192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6253a68a0 0x55e62539fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:47.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.463+0000 7fb37f400700 1 --2- 172.21.15.82:0/2357250192 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e6253ac490 0x55e6253c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:47.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.463+0000 7fb37e000700 1 -- 172.21.15.82:0/2357250192 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e6253ac490 msgr2=0x55e6253c9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:49:47.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.463+0000 7fb37e000700 1 --2- 172.21.15.82:0/2357250192 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e6253ac490 0x55e6253c9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:47.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.463+0000 7fb37e000700 1 -- 172.21.15.82:0/2357250192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6253a68a0 msgr2=0x55e62539fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:49:47.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.463+0000 7fb37e000700 1 --2- 172.21.15.82:0/2357250192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6253a68a0 0x55e62539fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:47.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.463+0000 7fb37e000700 1 -- 172.21.15.82:0/2357250192 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6253c9c70 con 0x55e6253abb70 2024-05-08T05:49:47.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.464+0000 7fb37e000700 1 --2- 172.21.15.82:0/2357250192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6253abb70 0x55e62539ffd0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb36c009990 tx=0x7fb36c009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4462bbf84af708e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:49:47.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.464+0000 7fb368c00700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T05:49:47.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.464+0000 7fb368c00700 1 -- 172.21.15.82:0/2357250192 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb36c003a60 con 0x55e6253abb70 2024-05-08T05:49:47.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.464+0000 7fb368c00700 1 -- 172.21.15.82:0/2357250192 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb36c021070 con 0x55e6253abb70 2024-05-08T05:49:47.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.464+0000 7fb39029fb80 1 -- 172.21.15.82:0/2357250192 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3700aa140 con 0x55e6253abb70 2024-05-08T05:49:47.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.464+0000 7fb368c00700 1 -- 172.21.15.82:0/2357250192 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb36c033480 con 0x55e6253abb70 2024-05-08T05:49:47.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.464+0000 7fb39029fb80 10 client.14952 fetch_fsmap learned FSMap version 28 2024-05-08T05:49:47.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.464+0000 7fb39029fb80 1 -- 172.21.15.82:0/2357250192 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e6253caf70 con 0x55e6253abb70 2024-05-08T05:49:47.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.465+0000 7fb368c00700 1 -- 172.21.15.82:0/2357250192 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb3700aa140 con 0x55e6253abb70 2024-05-08T05:49:47.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.465+0000 7fb368c00700 1 -- 172.21.15.82:0/2357250192 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fb36c00fa30 con 0x55e6253abb70 2024-05-08T05:49:47.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.465+0000 7fb39029fb80 10 client.14952 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T05:49:47.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.465+0000 7fb39029fb80 10 client.14952 resolve_mds: resolved name 'c' to daemon mds.c 2024-05-08T05:49:47.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.465+0000 7fb39029fb80 20 client.14952 populate_metadata read hostname 'smithi082' 2024-05-08T05:49:47.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.465+0000 7fb39029fb80 1 --2- 172.21.15.82:0/2357250192 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55e62542fb80 0x55e62542e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:47.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.465+0000 7fb39029fb80 4 client.14952 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T05:49:47.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.465+0000 7fb39029fb80 1 -- 172.21.15.82:0/2357250192 --> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] -- command(tid 0: {"prefix": "status"}) -- 0x55e6253063b0 con 0x55e62542fb80 2024-05-08T05:49:47.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.465+0000 7fb37ea00700 1 --2- 172.21.15.82:0/2357250192 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55e62542fb80 0x55e62542e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:47.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.466+0000 7fb37ea00700 1 --2- 172.21.15.82:0/2357250192 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55e62542fb80 0x55e62542e890 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a353a43183357f88 server_cookie=186fe2be515f6149 in_seq=0 out_seq=0 2024-05-08T05:49:47.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.466+0000 7fb368c00700 10 client.14952 ms_handle_connect on v2:172.21.15.151:6836/4192404464 2024-05-08T05:49:47.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.466+0000 7fb368c00700 1 -- 172.21.15.82:0/2357250192 <== mds.2 v2:172.21.15.151:6836/4192404464 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55e6253063b0 con 0x55e62542fb80 2024-05-08T05:49:47.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.466+0000 7fb368c00700 10 client.14952 handle_command_reply: tid=0 2024-05-08T05:49:47.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.466+0000 7fb39029fb80 1 client.14952 shutdown 2024-05-08T05:49:47.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.466+0000 7fb39029fb80 1 -- 172.21.15.82:0/2357250192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6253abb70 msgr2=0x55e62539ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:47.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.466+0000 7fb39029fb80 1 --2- 172.21.15.82:0/2357250192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6253abb70 0x55e62539ffd0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb36c009990 tx=0x7fb36c009ca0 comp rx=0 tx=0).stop 2024-05-08T05:49:47.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.466+0000 7fb39029fb80 1 -- 172.21.15.82:0/2357250192 shutdown_connections 2024-05-08T05:49:47.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.466+0000 7fb39029fb80 1 --2- 172.21.15.82:0/2357250192 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55e62542fb80 0x55e62542e890 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:47.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.466+0000 7fb39029fb80 1 --2- 172.21.15.82:0/2357250192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6253a68a0 0x55e62539fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:47.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.466+0000 7fb39029fb80 1 --2- 172.21.15.82:0/2357250192 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e6253ac490 0x55e6253c9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:47.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.466+0000 7fb39029fb80 1 --2- 172.21.15.82:0/2357250192 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e6253abb70 0x55e62539ffd0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:47.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.466+0000 7fb368c00700 0 client.14952 ms_handle_reset on v2:172.21.15.151:6836/4192404464 2024-05-08T05:49:47.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.466+0000 7fb39029fb80 1 -- 172.21.15.82:0/2357250192 >> 172.21.15.82:0/2357250192 conn(0x55e62531e680 msgr2=0x55e6253acfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:49:47.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.467+0000 7fb39029fb80 1 -- 172.21.15.82:0/2357250192 shutdown_connections 2024-05-08T05:49:47.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.467+0000 7fb39029fb80 1 -- 172.21.15.82:0/2357250192 wait complete. 2024-05-08T05:49:47.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.467+0000 7fb39029fb80 20 client.14952 trim_cache size 0 max 16384 2024-05-08T05:49:47.471 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T05:49:47.471 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "c739a5c8-0cfc-11ef-bc97-c7b262605968", 2024-05-08T05:49:47.471 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 2, 2024-05-08T05:49:47.471 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 24487, 2024-05-08T05:49:47.471 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-05-08T05:49:47.471 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-05-08T05:49:47.472 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-05-08T05:49:47.472 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 212.54563615999999, 2024-05-08T05:49:47.472 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 28, 2024-05-08T05:49:47.472 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 82, 2024-05-08T05:49:47.472 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 80, 2024-05-08T05:49:47.472 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 270.49719558800001 2024-05-08T05:49:47.472 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T05:49:47.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.467+0000 7fb385a00700 1 -- 172.21.15.82:0/131744220 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb3640b2880 msgr2=0x7fb3640b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:47.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.467+0000 7fb385a00700 1 --2- 172.21.15.82:0/131744220 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb3640b2880 0x7fb3640b4d40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb380078b70 tx=0x7fb36c009630 comp rx=0 tx=0).stop 2024-05-08T05:49:47.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.468+0000 7fb385a00700 1 -- 172.21.15.82:0/131744220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb380109ad0 msgr2=0x7fb3801a01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:47.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.468+0000 7fb385a00700 1 --2- 172.21.15.82:0/131744220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb380109ad0 0x7fb3801a01c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb37000e9c0 tx=0x7fb37000ecd0 comp rx=0 tx=0).stop 2024-05-08T05:49:47.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.468+0000 7fb385a00700 1 -- 172.21.15.82:0/131744220 shutdown_connections 2024-05-08T05:49:47.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.468+0000 7fb385a00700 1 --2- 172.21.15.82:0/131744220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb380109ad0 0x7fb3801a01c0 secure :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb37000e9c0 tx=0x7fb37000ecd0 comp rx=0 tx=0).stop 2024-05-08T05:49:47.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.468+0000 7fb385a00700 1 --2- 172.21.15.82:0/131744220 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb3640b2880 0x7fb3640b4d40 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:47.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.468+0000 7fb385a00700 1 --2- 172.21.15.82:0/131744220 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb38010fb60 0x7fb3801a4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:47.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.468+0000 7fb385a00700 1 --2- 172.21.15.82:0/131744220 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb38010a490 0x7fb3801a0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:47.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.468+0000 7fb385a00700 1 -- 172.21.15.82:0/131744220 >> 172.21.15.82:0/131744220 conn(0x7fb380076c70 msgr2=0x7fb380077230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:49:47.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.468+0000 7fb385a00700 1 -- 172.21.15.82:0/131744220 shutdown_connections 2024-05-08T05:49:47.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:47.468+0000 7fb385a00700 1 -- 172.21.15.82:0/131744220 wait complete. 2024-05-08T05:49:47.552 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:49:47 smithi134 ceph-mon[34132]: pgmap v433: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-08T05:49:47.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:49:47 smithi151 ceph-mon[34815]: pgmap v433: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-08T05:49:48.465 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.i status 2024-05-08T05:49:48.919 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:49:49.416 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:49:49 smithi082 ceph-mon[30098]: pgmap v434: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:49:49.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:49:49 smithi151 ceph-mon[34815]: pgmap v434: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:49:49.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:49:49 smithi134 ceph-mon[34132]: pgmap v434: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:49:51.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.192+0000 7fae5da00700 1 -- 172.21.15.82:0/1880338720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae5810fea0 msgr2=0x7fae58112290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:51.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.192+0000 7fae5da00700 1 --2- 172.21.15.82:0/1880338720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae5810fea0 0x7fae58112290 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fae50009f90 tx=0x7fae5000b330 comp rx=0 tx=0).stop 2024-05-08T05:49:51.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.192+0000 7fae5da00700 1 -- 172.21.15.82:0/1880338720 shutdown_connections 2024-05-08T05:49:51.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.192+0000 7fae5da00700 1 --2- 172.21.15.82:0/1880338720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae5810fea0 0x7fae58112290 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:51.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.192+0000 7fae5da00700 1 --2- 172.21.15.82:0/1880338720 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae580756d0 0x7fae58075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:51.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.192+0000 7fae5da00700 1 --2- 172.21.15.82:0/1880338720 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae58075ff0 0x7fae5810f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:51.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.192+0000 7fae5da00700 1 -- 172.21.15.82:0/1880338720 >> 172.21.15.82:0/1880338720 conn(0x7fae5807a600 msgr2=0x7fae5807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:49:51.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.193+0000 7fae5da00700 1 -- 172.21.15.82:0/1880338720 shutdown_connections 2024-05-08T05:49:51.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.193+0000 7fae5da00700 1 -- 172.21.15.82:0/1880338720 wait complete. 2024-05-08T05:49:51.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.194+0000 7fae5da00700 1 Processor -- start 2024-05-08T05:49:51.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.194+0000 7fae5da00700 1 -- start start 2024-05-08T05:49:51.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.194+0000 7fae5da00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae580756d0 0x7fae581a1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:51.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.194+0000 7fae5da00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae58075ff0 0x7fae581a1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:51.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.194+0000 7fae5da00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae5810fea0 0x7fae5819bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:51.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.194+0000 7fae5da00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fae58115890 con 0x7fae580756d0 2024-05-08T05:49:51.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.194+0000 7fae5da00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fae58115710 con 0x7fae58075ff0 2024-05-08T05:49:51.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.194+0000 7fae5da00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fae58115a10 con 0x7fae5810fea0 2024-05-08T05:49:51.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.195+0000 7fae56a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae580756d0 0x7fae581a1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:51.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.195+0000 7fae4fe00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae58075ff0 0x7fae581a1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:51.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.195+0000 7fae56a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae580756d0 0x7fae581a1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38830/0 (socket says 172.21.15.82:38830) 2024-05-08T05:49:51.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.195+0000 7fae56a00700 1 -- 172.21.15.82:0/1777610599 learned_addr learned my addr 172.21.15.82:0/1777610599 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:49:51.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.195+0000 7fae57400700 1 --2- 172.21.15.82:0/1777610599 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae5810fea0 0x7fae5819bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:51.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.195+0000 7fae4fe00700 1 -- 172.21.15.82:0/1777610599 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae5810fea0 msgr2=0x7fae5819bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:51.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.195+0000 7fae4fe00700 1 --2- 172.21.15.82:0/1777610599 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae5810fea0 0x7fae5819bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:51.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.195+0000 7fae4fe00700 1 -- 172.21.15.82:0/1777610599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae580756d0 msgr2=0x7fae581a1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:51.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.195+0000 7fae4fe00700 1 --2- 172.21.15.82:0/1777610599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae580756d0 0x7fae581a1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:51.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.195+0000 7fae4fe00700 1 -- 172.21.15.82:0/1777610599 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae5819c3f0 con 0x7fae58075ff0 2024-05-08T05:49:51.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.195+0000 7fae56a00700 1 --2- 172.21.15.82:0/1777610599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae580756d0 0x7fae581a1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:49:51.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.196+0000 7fae4fe00700 1 --2- 172.21.15.82:0/1777610599 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae58075ff0 0x7fae581a1f80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fae40005fd0 tx=0x7fae4000ee70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:49:51.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.196+0000 7fae4f400700 1 -- 172.21.15.82:0/1777610599 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae4000cbd0 con 0x7fae58075ff0 2024-05-08T05:49:51.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.196+0000 7fae5da00700 1 -- 172.21.15.82:0/1777610599 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae5819c6e0 con 0x7fae58075ff0 2024-05-08T05:49:51.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.196+0000 7fae4f400700 1 -- 172.21.15.82:0/1777610599 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae4000cd70 con 0x7fae58075ff0 2024-05-08T05:49:51.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.196+0000 7fae5da00700 1 -- 172.21.15.82:0/1777610599 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae581a89c0 con 0x7fae58075ff0 2024-05-08T05:49:51.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.196+0000 7fae4f400700 1 -- 172.21.15.82:0/1777610599 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae40004a50 con 0x7fae58075ff0 2024-05-08T05:49:51.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.200+0000 7fae4f400700 1 -- 172.21.15.82:0/1777610599 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fae4001f020 con 0x7fae58075ff0 2024-05-08T05:49:51.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.200+0000 7fae682dbb80 1 Processor -- start 2024-05-08T05:49:51.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.201+0000 7fae682dbb80 1 -- start start 2024-05-08T05:49:51.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.201+0000 7fae682dbb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564bd1844010 0x564bd18443f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:51.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.201+0000 7fae682dbb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564bd1844930 0x564bd1848440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:51.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.201+0000 7fae682dbb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564bd1848980 0x564bd1848de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:51.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.201+0000 7fae682dbb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x564bd17969d0 con 0x564bd1848980 2024-05-08T05:49:51.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.201+0000 7fae682dbb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564bd1734710 con 0x564bd1844930 2024-05-08T05:49:51.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.201+0000 7fae682dbb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564bd1792990 con 0x564bd1844010 2024-05-08T05:49:51.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.201+0000 7fae4f400700 1 --2- 172.21.15.82:0/1777610599 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fae3c0b2880 0x7fae3c0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:51.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.201+0000 7fae57400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564bd1844010 0x564bd18443f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:51.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.202+0000 7fae57400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564bd1844010 0x564bd18443f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:38598/0 (socket says 172.21.15.82:38598) 2024-05-08T05:49:51.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.202+0000 7fae57400700 1 -- 172.21.15.82:0/3755072208 learned_addr learned my addr 172.21.15.82:0/3755072208 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:49:51.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.202+0000 7fae56a00700 1 --2- 172.21.15.82:0/3755072208 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564bd1844930 0x564bd1848440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:51.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.202+0000 7fae4fe00700 1 --2- 172.21.15.82:0/3755072208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564bd1848980 0x564bd1848de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:51.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.202+0000 7fae57400700 1 --2- 172.21.15.82:0/1777610599 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fae3c0b2880 0x7fae3c0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:51.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.202+0000 7fae4f400700 1 -- 172.21.15.82:0/1777610599 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fae400e22c0 con 0x7fae58075ff0 2024-05-08T05:49:51.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.202+0000 7fae57400700 1 -- 172.21.15.82:0/3755072208 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564bd1844930 msgr2=0x564bd1848440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:49:51.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.202+0000 7fae57400700 1 --2- 172.21.15.82:0/3755072208 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564bd1844930 0x564bd1848440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:51.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.202+0000 7fae57400700 1 -- 172.21.15.82:0/3755072208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564bd1848980 msgr2=0x564bd1848de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:49:51.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.202+0000 7fae57400700 1 --2- 172.21.15.82:0/3755072208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564bd1848980 0x564bd1848de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:51.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.202+0000 7fae57400700 1 -- 172.21.15.82:0/3755072208 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564bd16e3880 con 0x564bd1844010 2024-05-08T05:49:51.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.202+0000 7fae57400700 1 --2- 172.21.15.82:0/3755072208 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564bd1844010 0x564bd18443f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fae50015000 tx=0x7fae50004d00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a0f5619e17e8de6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:49:51.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.203+0000 7fae57400700 1 --2- 172.21.15.82:0/1777610599 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fae3c0b2880 0x7fae3c0b4d40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fae5001a000 tx=0x7fae50027000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:49:51.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.203+0000 7fae47e00700 1 -- 172.21.15.82:0/3755072208 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae50007620 con 0x564bd1844010 2024-05-08T05:49:51.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.203+0000 7fae47e00700 1 -- 172.21.15.82:0/3755072208 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae50007c70 con 0x564bd1844010 2024-05-08T05:49:51.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.203+0000 7fae47e00700 1 -- 172.21.15.82:0/3755072208 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae50020c80 con 0x564bd1844010 2024-05-08T05:49:51.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.204+0000 7fae682dbb80 1 -- 172.21.15.82:0/3755072208 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564bd1844010 msgr2=0x564bd18443f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:51.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.204+0000 7fae682dbb80 1 --2- 172.21.15.82:0/3755072208 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564bd1844010 0x564bd18443f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fae50015000 tx=0x7fae50004d00 comp rx=0 tx=0).stop 2024-05-08T05:49:51.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.204+0000 7fae682dbb80 1 -- 172.21.15.82:0/3755072208 shutdown_connections 2024-05-08T05:49:51.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.204+0000 7fae682dbb80 1 --2- 172.21.15.82:0/3755072208 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564bd1848980 0x564bd1848de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:51.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.204+0000 7fae682dbb80 1 --2- 172.21.15.82:0/3755072208 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564bd1844010 0x564bd18443f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:51.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.204+0000 7fae682dbb80 1 --2- 172.21.15.82:0/3755072208 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564bd1844930 0x564bd1848440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:51.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.204+0000 7fae682dbb80 1 -- 172.21.15.82:0/3755072208 >> 172.21.15.82:0/3755072208 conn(0x564bd1772b10 msgr2=0x564bd183e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:49:51.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.204+0000 7fae682dbb80 1 -- 172.21.15.82:0/3755072208 shutdown_connections 2024-05-08T05:49:51.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.204+0000 7fae682dbb80 1 -- 172.21.15.82:0/3755072208 wait complete. 2024-05-08T05:49:51.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.204+0000 7fae682dbb80 1 -- start start 2024-05-08T05:49:51.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.205+0000 7fae682dbb80 1 Processor -- start 2024-05-08T05:49:51.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.205+0000 7fae682dbb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564bd1844010 0x564bd184fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:51.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.205+0000 7fae682dbb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564bd1844930 0x564bd184d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:51.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.205+0000 7fae682dbb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564bd1848980 0x564bd184d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:51.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.205+0000 7fae682dbb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x564bd1850b30 con 0x564bd1844930 2024-05-08T05:49:51.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.205+0000 7fae682dbb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564bd16fcad0 con 0x564bd1848980 2024-05-08T05:49:51.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.205+0000 7fae682dbb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564bd1850cb0 con 0x564bd1844010 2024-05-08T05:49:51.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.205+0000 7fae682dbb80 10 client.0 _ll_register_callbacks cb 0x564bd173dc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:49:51.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.206+0000 7fae56a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564bd1844010 0x564bd184fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:51.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.206+0000 7fae4fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564bd1844930 0x564bd184d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:51.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.206+0000 7fae56a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564bd1844010 0x564bd184fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:38610/0 (socket says 172.21.15.82:38610) 2024-05-08T05:49:51.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.206+0000 7fae56a00700 1 -- 172.21.15.82:0/3324016755 learned_addr learned my addr 172.21.15.82:0/3324016755 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:49:51.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.206+0000 7fae57400700 1 --2- 172.21.15.82:0/3324016755 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564bd1848980 0x564bd184d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:51.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.206+0000 7fae57400700 1 -- 172.21.15.82:0/3324016755 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564bd1844010 msgr2=0x564bd184fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:49:51.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.206+0000 7fae57400700 1 --2- 172.21.15.82:0/3324016755 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564bd1844010 0x564bd184fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:51.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.206+0000 7fae57400700 1 -- 172.21.15.82:0/3324016755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564bd1844930 msgr2=0x564bd184d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:49:51.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.206+0000 7fae57400700 1 --2- 172.21.15.82:0/3324016755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564bd1844930 0x564bd184d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:51.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.206+0000 7fae57400700 1 -- 172.21.15.82:0/3324016755 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564bd175c3d0 con 0x564bd1848980 2024-05-08T05:49:51.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.206+0000 7fae56a00700 1 --2- 172.21.15.82:0/3324016755 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564bd1844010 0x564bd184fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:49:51.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.206+0000 7fae4fe00700 1 --2- 172.21.15.82:0/3324016755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564bd1844930 0x564bd184d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:49:51.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.206+0000 7fae57400700 1 --2- 172.21.15.82:0/3324016755 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564bd1848980 0x564bd184d6e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fae50004fd0 tx=0x7fae50006160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ba195cbac5d0ef7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:49:51.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.206+0000 7fae44c00700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:49:51.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.207+0000 7fae44c00700 1 -- 172.21.15.82:0/3324016755 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae50036020 con 0x564bd1848980 2024-05-08T05:49:51.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.207+0000 7fae44c00700 1 -- 172.21.15.82:0/3324016755 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fae500077f0 con 0x564bd1848980 2024-05-08T05:49:51.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.207+0000 7fae682dbb80 1 -- 172.21.15.82:0/3324016755 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae50007c70 con 0x564bd1848980 2024-05-08T05:49:51.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.207+0000 7fae44c00700 1 -- 172.21.15.82:0/3324016755 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fae500079f0 con 0x564bd1848980 2024-05-08T05:49:51.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.207+0000 7fae682dbb80 10 client.25055 fetch_fsmap learned FSMap version 28 2024-05-08T05:49:51.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.207+0000 7fae682dbb80 1 -- 172.21.15.82:0/3324016755 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564bd1850b30 con 0x564bd1848980 2024-05-08T05:49:51.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.207+0000 7fae44c00700 1 -- 172.21.15.82:0/3324016755 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae50007c70 con 0x564bd1848980 2024-05-08T05:49:51.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.208+0000 7fae44c00700 1 -- 172.21.15.82:0/3324016755 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fae50011070 con 0x564bd1848980 2024-05-08T05:49:51.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.208+0000 7fae682dbb80 10 client.25055 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T05:49:51.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.208+0000 7fae682dbb80 10 client.25055 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-08T05:49:51.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.208+0000 7fae682dbb80 20 client.25055 populate_metadata read hostname 'smithi082' 2024-05-08T05:49:51.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.208+0000 7fae682dbb80 1 --2- 172.21.15.82:0/3324016755 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x564bd185d410 0x564bd185e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:51.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.208+0000 7fae682dbb80 4 client.25055 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:49:51.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.208+0000 7fae682dbb80 1 -- 172.21.15.82:0/3324016755 --> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564bd1811050 con 0x564bd185d410 2024-05-08T05:49:51.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.208+0000 7fae56a00700 1 --2- 172.21.15.82:0/3324016755 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x564bd185d410 0x564bd185e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:51.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.209+0000 7fae56a00700 1 --2- 172.21.15.82:0/3324016755 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x564bd185d410 0x564bd185e880 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3e9bb6ed479f2cac server_cookie=6b02c8c95b90ea0 in_seq=0 out_seq=0 2024-05-08T05:49:51.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.209+0000 7fae44c00700 10 client.25055 ms_handle_connect on v2:172.21.15.151:6838/2963754236 2024-05-08T05:49:51.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.210+0000 7fae44c00700 1 -- 172.21.15.82:0/3324016755 <== mds.1 v2:172.21.15.151:6838/2963754236 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564bd1811050 con 0x564bd185d410 2024-05-08T05:49:51.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.210+0000 7fae44c00700 10 client.25055 handle_command_reply: tid=0 2024-05-08T05:49:51.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.210+0000 7fae682dbb80 1 client.25055 shutdown 2024-05-08T05:49:51.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.210+0000 7fae682dbb80 1 -- 172.21.15.82:0/3324016755 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564bd1848980 msgr2=0x564bd184d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:51.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.210+0000 7fae682dbb80 1 --2- 172.21.15.82:0/3324016755 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564bd1848980 0x564bd184d6e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fae50004fd0 tx=0x7fae50006160 comp rx=0 tx=0).stop 2024-05-08T05:49:51.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.210+0000 7fae682dbb80 1 -- 172.21.15.82:0/3324016755 shutdown_connections 2024-05-08T05:49:51.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.210+0000 7fae682dbb80 1 --2- 172.21.15.82:0/3324016755 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x564bd185d410 0x564bd185e880 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:51.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.210+0000 7fae682dbb80 1 --2- 172.21.15.82:0/3324016755 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564bd1848980 0x564bd184d6e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:51.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.210+0000 7fae682dbb80 1 --2- 172.21.15.82:0/3324016755 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564bd1844010 0x564bd184fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:51.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.210+0000 7fae682dbb80 1 --2- 172.21.15.82:0/3324016755 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564bd1844930 0x564bd184d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:51.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.210+0000 7fae44c00700 0 client.25055 ms_handle_reset on v2:172.21.15.151:6838/2963754236 2024-05-08T05:49:51.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.210+0000 7fae682dbb80 1 -- 172.21.15.82:0/3324016755 >> 172.21.15.82:0/3324016755 conn(0x564bd1772b10 msgr2=0x564bd1839260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:49:51.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.210+0000 7fae682dbb80 1 -- 172.21.15.82:0/3324016755 shutdown_connections 2024-05-08T05:49:51.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.210+0000 7fae682dbb80 1 -- 172.21.15.82:0/3324016755 wait complete. 2024-05-08T05:49:51.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.211+0000 7fae682dbb80 20 client.25055 trim_cache size 0 max 16384 2024-05-08T05:49:51.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.233+0000 7fae682dbb80 1 Processor -- start 2024-05-08T05:49:51.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.233+0000 7fae682dbb80 1 -- start start 2024-05-08T05:49:51.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.233+0000 7fae682dbb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564bd1844010 0x564bd18477b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:51.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.233+0000 7fae682dbb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564bd1844930 0x564bd1847cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:51.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.233+0000 7fae682dbb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564bd1848980 0x564bd1848230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:51.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.233+0000 7fae682dbb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x564bd185cbc0 con 0x564bd1848980 2024-05-08T05:49:51.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.233+0000 7fae682dbb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564bd185d290 con 0x564bd1844010 2024-05-08T05:49:51.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.233+0000 7fae682dbb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564bd185d960 con 0x564bd1844930 2024-05-08T05:49:51.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.234+0000 7fae57400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564bd1848980 0x564bd1848230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:51.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.234+0000 7fae56a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564bd1844010 0x564bd18477b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:51.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.234+0000 7fae57400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564bd1848980 0x564bd1848230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38852/0 (socket says 172.21.15.82:38852) 2024-05-08T05:49:51.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.234+0000 7fae57400700 1 -- 172.21.15.82:0/2407420516 learned_addr learned my addr 172.21.15.82:0/2407420516 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:49:51.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.234+0000 7fae4fe00700 1 --2- 172.21.15.82:0/2407420516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564bd1844930 0x564bd1847cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:51.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.234+0000 7fae56a00700 1 -- 172.21.15.82:0/2407420516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564bd1844930 msgr2=0x564bd1847cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:49:51.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.234+0000 7fae56a00700 1 --2- 172.21.15.82:0/2407420516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564bd1844930 0x564bd1847cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:51.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.234+0000 7fae56a00700 1 -- 172.21.15.82:0/2407420516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564bd1848980 msgr2=0x564bd1848230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:49:51.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.234+0000 7fae56a00700 1 --2- 172.21.15.82:0/2407420516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564bd1848980 0x564bd1848230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:51.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.234+0000 7fae56a00700 1 -- 172.21.15.82:0/2407420516 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564bd183f5c0 con 0x564bd1844010 2024-05-08T05:49:51.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.234+0000 7fae4fe00700 1 --2- 172.21.15.82:0/2407420516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564bd1844930 0x564bd1847cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:49:51.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.234+0000 7fae57400700 1 --2- 172.21.15.82:0/2407420516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564bd1848980 0x564bd1848230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:49:51.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.235+0000 7fae56a00700 1 --2- 172.21.15.82:0/2407420516 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564bd1844010 0x564bd18477b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fae48013770 tx=0x7fae48013c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0ba6da27c009af1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:49:51.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.235+0000 7fae47400700 1 -- 172.21.15.82:0/2407420516 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae48004220 con 0x564bd1844010 2024-05-08T05:49:51.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.235+0000 7fae47400700 1 -- 172.21.15.82:0/2407420516 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae480043c0 con 0x564bd1844010 2024-05-08T05:49:51.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.235+0000 7fae47400700 1 -- 172.21.15.82:0/2407420516 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae480056c0 con 0x564bd1844010 2024-05-08T05:49:51.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.236+0000 7fae682dbb80 1 -- 172.21.15.82:0/2407420516 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564bd1844010 msgr2=0x564bd18477b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:51.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.236+0000 7fae682dbb80 1 --2- 172.21.15.82:0/2407420516 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564bd1844010 0x564bd18477b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fae48013770 tx=0x7fae48013c10 comp rx=0 tx=0).stop 2024-05-08T05:49:51.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.236+0000 7fae682dbb80 1 -- 172.21.15.82:0/2407420516 shutdown_connections 2024-05-08T05:49:51.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.236+0000 7fae682dbb80 1 --2- 172.21.15.82:0/2407420516 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564bd1844010 0x564bd18477b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:51.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.236+0000 7fae682dbb80 1 --2- 172.21.15.82:0/2407420516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564bd1848980 0x564bd1848230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:51.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.236+0000 7fae682dbb80 1 --2- 172.21.15.82:0/2407420516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564bd1844930 0x564bd1847cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:51.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.236+0000 7fae682dbb80 1 -- 172.21.15.82:0/2407420516 >> 172.21.15.82:0/2407420516 conn(0x564bd1772b10 msgr2=0x564bd1839260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:49:51.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.236+0000 7fae682dbb80 1 -- 172.21.15.82:0/2407420516 shutdown_connections 2024-05-08T05:49:51.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.236+0000 7fae682dbb80 1 -- 172.21.15.82:0/2407420516 wait complete. 2024-05-08T05:49:51.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.236+0000 7fae682dbb80 1 -- start start 2024-05-08T05:49:51.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.237+0000 7fae682dbb80 1 Processor -- start 2024-05-08T05:49:51.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.237+0000 7fae682dbb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564bd1844010 0x564bd1867d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:51.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.237+0000 7fae682dbb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564bd1844930 0x564bd1868240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:51.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.237+0000 7fae682dbb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564bd1848980 0x564bd1862cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:51.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.237+0000 7fae682dbb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x564bd185e700 con 0x564bd1844010 2024-05-08T05:49:51.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.237+0000 7fae682dbb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564bd185e030 con 0x564bd1844930 2024-05-08T05:49:51.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.237+0000 7fae682dbb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564bd185edd0 con 0x564bd1848980 2024-05-08T05:49:51.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.237+0000 7fae682dbb80 10 client.0 _ll_register_callbacks cb 0x564bd173dc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:49:51.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.237+0000 7fae56a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564bd1844010 0x564bd1867d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:51.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.237+0000 7fae56a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564bd1844010 0x564bd1867d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38856/0 (socket says 172.21.15.82:38856) 2024-05-08T05:49:51.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.238+0000 7fae57400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564bd1848980 0x564bd1862cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:51.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.238+0000 7fae56a00700 1 -- 172.21.15.82:0/2447921981 learned_addr learned my addr 172.21.15.82:0/2447921981 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:49:51.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.238+0000 7fae4fe00700 1 --2- 172.21.15.82:0/2447921981 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564bd1844930 0x564bd1868240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:51.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.238+0000 7fae57400700 1 -- 172.21.15.82:0/2447921981 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564bd1844930 msgr2=0x564bd1868240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:49:51.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.238+0000 7fae57400700 1 --2- 172.21.15.82:0/2447921981 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564bd1844930 0x564bd1868240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:51.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.238+0000 7fae57400700 1 -- 172.21.15.82:0/2447921981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564bd1844010 msgr2=0x564bd1867d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:49:51.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.238+0000 7fae57400700 1 --2- 172.21.15.82:0/2447921981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564bd1844010 0x564bd1867d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:51.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.238+0000 7fae57400700 1 -- 172.21.15.82:0/2447921981 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564bd183b3a0 con 0x564bd1848980 2024-05-08T05:49:51.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.238+0000 7fae57400700 1 --2- 172.21.15.82:0/2447921981 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564bd1848980 0x564bd1862cb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fae50002230 tx=0x7fae500098a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9cad4f9c79d884fe server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:49:51.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.238+0000 7fae44c00700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:49:51.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.238+0000 7fae44c00700 1 -- 172.21.15.82:0/2447921981 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae50040070 con 0x564bd1848980 2024-05-08T05:49:51.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.238+0000 7fae682dbb80 1 -- 172.21.15.82:0/2447921981 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae480043c0 con 0x564bd1848980 2024-05-08T05:49:51.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.238+0000 7fae44c00700 1 -- 172.21.15.82:0/2447921981 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fae500075f0 con 0x564bd1848980 2024-05-08T05:49:51.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.239+0000 7fae44c00700 1 -- 172.21.15.82:0/2447921981 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fae5004c050 con 0x564bd1848980 2024-05-08T05:49:51.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.239+0000 7fae682dbb80 10 client.25087 fetch_fsmap learned FSMap version 28 2024-05-08T05:49:51.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.239+0000 7fae682dbb80 1 -- 172.21.15.82:0/2447921981 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564bd18c8f00 con 0x564bd1848980 2024-05-08T05:49:51.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.239+0000 7fae44c00700 1 -- 172.21.15.82:0/2447921981 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae480043c0 con 0x564bd1848980 2024-05-08T05:49:51.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.240+0000 7fae44c00700 1 -- 172.21.15.82:0/2447921981 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7fae50011070 con 0x564bd1848980 2024-05-08T05:49:51.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.240+0000 7fae682dbb80 10 client.25087 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T05:49:51.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.240+0000 7fae682dbb80 10 client.25087 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-08T05:49:51.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.240+0000 7fae682dbb80 20 client.25087 populate_metadata read hostname 'smithi082' 2024-05-08T05:49:51.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.240+0000 7fae682dbb80 1 --2- 172.21.15.82:0/2447921981 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x564bd18cdad0 0x564bd18cc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:51.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.240+0000 7fae682dbb80 4 client.25087 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T05:49:51.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.240+0000 7fae682dbb80 1 -- 172.21.15.82:0/2447921981 --> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] -- command(tid 0: {"prefix": "status"}) -- 0x564bd17a43b0 con 0x564bd18cdad0 2024-05-08T05:49:51.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.240+0000 7fae56a00700 1 --2- 172.21.15.82:0/2447921981 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x564bd18cdad0 0x564bd18cc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:51.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.241+0000 7fae56a00700 1 --2- 172.21.15.82:0/2447921981 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x564bd18cdad0 0x564bd18cc7e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=419eb1dd2ce4caca server_cookie=71d39d6030b82cf in_seq=0 out_seq=0 2024-05-08T05:49:51.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.241+0000 7fae44c00700 10 client.25087 ms_handle_connect on v2:172.21.15.151:6838/2963754236 2024-05-08T05:49:51.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.241+0000 7fae44c00700 1 -- 172.21.15.82:0/2447921981 <== mds.1 v2:172.21.15.151:6838/2963754236 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x564bd17a43b0 con 0x564bd18cdad0 2024-05-08T05:49:51.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.241+0000 7fae44c00700 10 client.25087 handle_command_reply: tid=0 2024-05-08T05:49:51.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.241+0000 7fae682dbb80 1 client.25087 shutdown 2024-05-08T05:49:51.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.241+0000 7fae682dbb80 1 -- 172.21.15.82:0/2447921981 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564bd1848980 msgr2=0x564bd1862cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:51.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.241+0000 7fae682dbb80 1 --2- 172.21.15.82:0/2447921981 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564bd1848980 0x564bd1862cb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fae50002230 tx=0x7fae500098a0 comp rx=0 tx=0).stop 2024-05-08T05:49:51.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.241+0000 7fae682dbb80 1 -- 172.21.15.82:0/2447921981 shutdown_connections 2024-05-08T05:49:51.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.241+0000 7fae682dbb80 1 --2- 172.21.15.82:0/2447921981 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x564bd18cdad0 0x564bd18cc7e0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:51.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.241+0000 7fae682dbb80 1 --2- 172.21.15.82:0/2447921981 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564bd1848980 0x564bd1862cb0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:51.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.241+0000 7fae682dbb80 1 --2- 172.21.15.82:0/2447921981 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564bd1844010 0x564bd1867d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:51.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.241+0000 7fae682dbb80 1 --2- 172.21.15.82:0/2447921981 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564bd1844930 0x564bd1868240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:51.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.241+0000 7fae44c00700 0 client.25087 ms_handle_reset on v2:172.21.15.151:6838/2963754236 2024-05-08T05:49:51.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.241+0000 7fae682dbb80 1 -- 172.21.15.82:0/2447921981 >> 172.21.15.82:0/2447921981 conn(0x564bd1772b10 msgr2=0x564bd1842e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:49:51.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.241+0000 7fae682dbb80 1 -- 172.21.15.82:0/2447921981 shutdown_connections 2024-05-08T05:49:51.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.242+0000 7fae682dbb80 1 -- 172.21.15.82:0/2447921981 wait complete. 2024-05-08T05:49:51.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.242+0000 7fae682dbb80 20 client.25087 trim_cache size 0 max 16384 2024-05-08T05:49:51.245 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T05:49:51.246 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "c739a5c8-0cfc-11ef-bc97-c7b262605968", 2024-05-08T05:49:51.246 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 1, 2024-05-08T05:49:51.246 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 24505, 2024-05-08T05:49:51.246 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-05-08T05:49:51.246 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-05-08T05:49:51.246 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-05-08T05:49:51.246 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 217.34274003900001, 2024-05-08T05:49:51.246 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 28, 2024-05-08T05:49:51.246 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 82, 2024-05-08T05:49:51.246 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 80, 2024-05-08T05:49:51.246 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 268.51760356300002 2024-05-08T05:49:51.246 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T05:49:51.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.242+0000 7fae5da00700 1 -- 172.21.15.82:0/1777610599 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fae3c0b2880 msgr2=0x7fae3c0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:51.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.242+0000 7fae5da00700 1 --2- 172.21.15.82:0/1777610599 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fae3c0b2880 0x7fae3c0b4d40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fae5001a000 tx=0x7fae50027000 comp rx=0 tx=0).stop 2024-05-08T05:49:51.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.242+0000 7fae5da00700 1 -- 172.21.15.82:0/1777610599 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae58075ff0 msgr2=0x7fae581a1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:51.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.242+0000 7fae5da00700 1 --2- 172.21.15.82:0/1777610599 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae58075ff0 0x7fae581a1f80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fae40005fd0 tx=0x7fae4000ee70 comp rx=0 tx=0).stop 2024-05-08T05:49:51.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.242+0000 7fae5da00700 1 -- 172.21.15.82:0/1777610599 shutdown_connections 2024-05-08T05:49:51.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.242+0000 7fae5da00700 1 --2- 172.21.15.82:0/1777610599 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fae3c0b2880 0x7fae3c0b4d40 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:51.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.242+0000 7fae5da00700 1 --2- 172.21.15.82:0/1777610599 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae5810fea0 0x7fae5819bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:51.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.242+0000 7fae5da00700 1 --2- 172.21.15.82:0/1777610599 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae580756d0 0x7fae581a1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:51.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.242+0000 7fae5da00700 1 --2- 172.21.15.82:0/1777610599 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae58075ff0 0x7fae581a1f80 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:51.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.242+0000 7fae5da00700 1 -- 172.21.15.82:0/1777610599 >> 172.21.15.82:0/1777610599 conn(0x7fae5807a600 msgr2=0x7fae58100670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:49:51.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.243+0000 7fae5da00700 1 -- 172.21.15.82:0/1777610599 shutdown_connections 2024-05-08T05:49:51.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:51.243+0000 7fae5da00700 1 -- 172.21.15.82:0/1777610599 wait complete. 2024-05-08T05:49:51.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:49:51 smithi151 ceph-mon[34815]: pgmap v435: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-05-08T05:49:51.667 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:49:51 smithi082 ceph-mon[30098]: pgmap v435: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-05-08T05:49:51.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:49:51 smithi134 ceph-mon[34132]: pgmap v435: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-05-08T05:49:52.086 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.b status 2024-05-08T05:49:52.533 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:49:53.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:49:53 smithi151 ceph-mon[34815]: pgmap v436: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:49:53.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:49:53 smithi082 ceph-mon[30098]: pgmap v436: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:49:53.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:49:53 smithi134 ceph-mon[34132]: pgmap v436: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:49:54.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.756+0000 7f3da6800700 1 -- 172.21.15.82:0/3496370393 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3da010da00 msgr2=0x7f3da010fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:54.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.756+0000 7f3da6800700 1 --2- 172.21.15.82:0/3496370393 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3da010da00 0x7f3da010fe70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3d9800b0a0 tx=0x7f3d9800b3b0 comp rx=0 tx=0).stop 2024-05-08T05:49:54.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.756+0000 7f3da6800700 1 -- 172.21.15.82:0/3496370393 shutdown_connections 2024-05-08T05:49:54.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.756+0000 7f3da6800700 1 --2- 172.21.15.82:0/3496370393 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3da01045d0 0x7f3da01049b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:54.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.756+0000 7f3da6800700 1 --2- 172.21.15.82:0/3496370393 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3da010da00 0x7f3da010fe70 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:54.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.756+0000 7f3da6800700 1 --2- 172.21.15.82:0/3496370393 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3da0104ef0 0x7f3da010d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:54.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.756+0000 7f3da6800700 1 -- 172.21.15.82:0/3496370393 >> 172.21.15.82:0/3496370393 conn(0x7f3da00fddc0 msgr2=0x7f3da01001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:49:54.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.757+0000 7f3da6800700 1 -- 172.21.15.82:0/3496370393 shutdown_connections 2024-05-08T05:49:54.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.757+0000 7f3da6800700 1 -- 172.21.15.82:0/3496370393 wait complete. 2024-05-08T05:49:54.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.758+0000 7f3da6800700 1 Processor -- start 2024-05-08T05:49:54.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.758+0000 7f3da6800700 1 -- start start 2024-05-08T05:49:54.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.758+0000 7f3da6800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3da01045d0 0x7f3da01a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:54.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.758+0000 7f3da6800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3da0104ef0 0x7f3da01a1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:54.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.758+0000 7f3da6800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3da010da00 0x7f3da019ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:54.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.758+0000 7f3da6800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3da01135b0 con 0x7f3da0104ef0 2024-05-08T05:49:54.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.758+0000 7f3da6800700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3da0113430 con 0x7f3da010da00 2024-05-08T05:49:54.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.758+0000 7f3da6800700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3da0113730 con 0x7f3da01045d0 2024-05-08T05:49:54.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.758+0000 7f3da5400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3da01045d0 0x7f3da01a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:54.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.758+0000 7f3da4a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3da0104ef0 0x7f3da01a1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:54.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.758+0000 7f3da5400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3da01045d0 0x7f3da01a18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:48352/0 (socket says 172.21.15.82:48352) 2024-05-08T05:49:54.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.758+0000 7f3da5400700 1 -- 172.21.15.82:0/630326521 learned_addr learned my addr 172.21.15.82:0/630326521 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:49:54.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.759+0000 7f3da5e00700 1 --2- 172.21.15.82:0/630326521 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3da010da00 0x7f3da019ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:54.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.759+0000 7f3da4a00700 1 -- 172.21.15.82:0/630326521 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3da01045d0 msgr2=0x7f3da01a18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:54.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.759+0000 7f3da4a00700 1 --2- 172.21.15.82:0/630326521 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3da01045d0 0x7f3da01a18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:54.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.759+0000 7f3da4a00700 1 -- 172.21.15.82:0/630326521 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3da010da00 msgr2=0x7f3da019ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:54.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.759+0000 7f3da4a00700 1 --2- 172.21.15.82:0/630326521 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3da010da00 0x7f3da019ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:54.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.759+0000 7f3da4a00700 1 -- 172.21.15.82:0/630326521 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3da019c1d0 con 0x7f3da0104ef0 2024-05-08T05:49:54.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.759+0000 7f3da5400700 1 --2- 172.21.15.82:0/630326521 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3da01045d0 0x7f3da01a18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:49:54.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.759+0000 7f3da4a00700 1 --2- 172.21.15.82:0/630326521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3da0104ef0 0x7f3da01a1df0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c00e9c0 tx=0x7f3d8c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:49:54.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.759+0000 7f3d9e000700 1 -- 172.21.15.82:0/630326521 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c00cb70 con 0x7f3da0104ef0 2024-05-08T05:49:54.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.760+0000 7f3d9e000700 1 -- 172.21.15.82:0/630326521 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d8c00ee60 con 0x7f3da0104ef0 2024-05-08T05:49:54.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.760+0000 7f3d9e000700 1 -- 172.21.15.82:0/630326521 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d8c003d60 con 0x7f3da0104ef0 2024-05-08T05:49:54.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.760+0000 7f3da6800700 1 -- 172.21.15.82:0/630326521 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3da019c4c0 con 0x7f3da0104ef0 2024-05-08T05:49:54.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.760+0000 7f3da6800700 1 -- 172.21.15.82:0/630326521 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3da01a8780 con 0x7f3da0104ef0 2024-05-08T05:49:54.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.763+0000 7f3d9e000700 1 -- 172.21.15.82:0/630326521 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f3d8c003f00 con 0x7f3da0104ef0 2024-05-08T05:49:54.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.765+0000 7f3db2790b80 1 Processor -- start 2024-05-08T05:49:54.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.765+0000 7f3d9e000700 1 --2- 172.21.15.82:0/630326521 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3d880b2880 0x7f3d880b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:54.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.765+0000 7f3db2790b80 1 -- start start 2024-05-08T05:49:54.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.765+0000 7f3d9e000700 1 -- 172.21.15.82:0/630326521 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f3d8c0e22d0 con 0x7f3da0104ef0 2024-05-08T05:49:54.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.765+0000 7f3db2790b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bbb9da8d50 0x55bbb9da9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:54.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.765+0000 7f3da5e00700 1 --2- 172.21.15.82:0/630326521 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3d880b2880 0x7f3d880b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:54.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.765+0000 7f3db2790b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bbb9da9670 0x55bbb9da33e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:54.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.765+0000 7f3db2790b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbb9da3a00 0x55bbb9da3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:54.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.765+0000 7f3db2790b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55bbb9cf59d0 con 0x55bbb9da3a00 2024-05-08T05:49:54.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.765+0000 7f3db2790b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55bbb9c93710 con 0x55bbb9da8d50 2024-05-08T05:49:54.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.765+0000 7f3db2790b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55bbb9cf1990 con 0x55bbb9da9670 2024-05-08T05:49:54.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.766+0000 7f3da5400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bbb9da8d50 0x55bbb9da9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:54.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.766+0000 7f3da5400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bbb9da8d50 0x55bbb9da9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:34426/0 (socket says 172.21.15.82:34426) 2024-05-08T05:49:54.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.766+0000 7f3da5400700 1 -- 172.21.15.82:0/2976874771 learned_addr learned my addr 172.21.15.82:0/2976874771 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:49:54.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.766+0000 7f3da5e00700 1 --2- 172.21.15.82:0/2976874771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbb9da3a00 0x55bbb9da3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:54.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.766+0000 7f3da4a00700 1 --2- 172.21.15.82:0/2976874771 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bbb9da9670 0x55bbb9da33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:54.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.766+0000 7f3da5400700 1 -- 172.21.15.82:0/2976874771 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bbb9da9670 msgr2=0x55bbb9da33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:49:54.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.766+0000 7f3da5400700 1 --2- 172.21.15.82:0/2976874771 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bbb9da9670 0x55bbb9da33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:54.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.766+0000 7f3da5400700 1 -- 172.21.15.82:0/2976874771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbb9da3a00 msgr2=0x55bbb9da3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:49:54.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.766+0000 7f3da5400700 1 --2- 172.21.15.82:0/2976874771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbb9da3a00 0x55bbb9da3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:54.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.766+0000 7f3da5400700 1 -- 172.21.15.82:0/2976874771 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbb9c42880 con 0x55bbb9da8d50 2024-05-08T05:49:54.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.766+0000 7f3da5e00700 1 --2- 172.21.15.82:0/630326521 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3d880b2880 0x7f3d880b4d40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3d98009fd0 tx=0x7f3d9800bbe0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:49:54.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.766+0000 7f3da5400700 1 --2- 172.21.15.82:0/2976874771 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bbb9da8d50 0x55bbb9da9130 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3d94011680 tx=0x7f3d94011990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22f0a8d13ff4668d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:49:54.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.767+0000 7f3d92a00700 1 -- 172.21.15.82:0/2976874771 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d94004020 con 0x55bbb9da8d50 2024-05-08T05:49:54.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.767+0000 7f3d92a00700 1 -- 172.21.15.82:0/2976874771 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d94004830 con 0x55bbb9da8d50 2024-05-08T05:49:54.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.767+0000 7f3d92a00700 1 -- 172.21.15.82:0/2976874771 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d940054c0 con 0x55bbb9da8d50 2024-05-08T05:49:54.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.767+0000 7f3db2790b80 1 -- 172.21.15.82:0/2976874771 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bbb9da8d50 msgr2=0x55bbb9da9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:54.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.767+0000 7f3db2790b80 1 --2- 172.21.15.82:0/2976874771 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bbb9da8d50 0x55bbb9da9130 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3d94011680 tx=0x7f3d94011990 comp rx=0 tx=0).stop 2024-05-08T05:49:54.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.768+0000 7f3db2790b80 1 -- 172.21.15.82:0/2976874771 shutdown_connections 2024-05-08T05:49:54.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.768+0000 7f3db2790b80 1 --2- 172.21.15.82:0/2976874771 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bbb9da8d50 0x55bbb9da9130 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:54.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.768+0000 7f3db2790b80 1 --2- 172.21.15.82:0/2976874771 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbb9da3a00 0x55bbb9da3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:54.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.768+0000 7f3db2790b80 1 --2- 172.21.15.82:0/2976874771 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bbb9da9670 0x55bbb9da33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:54.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.768+0000 7f3db2790b80 1 -- 172.21.15.82:0/2976874771 >> 172.21.15.82:0/2976874771 conn(0x55bbb9d1b680 msgr2=0x55bbb9d9dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:49:54.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.768+0000 7f3db2790b80 1 -- 172.21.15.82:0/2976874771 shutdown_connections 2024-05-08T05:49:54.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.768+0000 7f3db2790b80 1 -- 172.21.15.82:0/2976874771 wait complete. 2024-05-08T05:49:54.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.768+0000 7f3db2790b80 1 -- start start 2024-05-08T05:49:54.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.769+0000 7f3db2790b80 1 Processor -- start 2024-05-08T05:49:54.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.769+0000 7f3db2790b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bbb9da3a00 0x55bbb9daf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:54.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.769+0000 7f3db2790b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbb9da8d50 0x55bbb9dac630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:54.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.769+0000 7f3db2790b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bbb9da9670 0x55bbb9dacb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:54.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.769+0000 7f3db2790b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55bbb9db0100 con 0x55bbb9da8d50 2024-05-08T05:49:54.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.769+0000 7f3db2790b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55bbb9c5bad0 con 0x55bbb9da3a00 2024-05-08T05:49:54.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.769+0000 7f3db2790b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55bbb9db0280 con 0x55bbb9da9670 2024-05-08T05:49:54.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.769+0000 7f3db2790b80 10 client.0 _ll_register_callbacks cb 0x55bbb9c9cc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:49:54.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.769+0000 7f3da4a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbb9da8d50 0x55bbb9dac630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:54.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.769+0000 7f3da5400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bbb9da3a00 0x55bbb9daf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:54.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.769+0000 7f3da5e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bbb9da9670 0x55bbb9dacb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:54.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.769+0000 7f3da5e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bbb9da9670 0x55bbb9dacb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:48372/0 (socket says 172.21.15.82:48372) 2024-05-08T05:49:54.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.769+0000 7f3da4a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbb9da8d50 0x55bbb9dac630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52344/0 (socket says 172.21.15.82:52344) 2024-05-08T05:49:54.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.769+0000 7f3da5400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bbb9da3a00 0x55bbb9daf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:34438/0 (socket says 172.21.15.82:34438) 2024-05-08T05:49:54.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.769+0000 7f3da5e00700 1 -- 172.21.15.82:0/4170603997 learned_addr learned my addr 172.21.15.82:0/4170603997 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:49:54.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.770+0000 7f3da5400700 1 -- 172.21.15.82:0/4170603997 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bbb9da9670 msgr2=0x55bbb9dacb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:49:54.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.770+0000 7f3da5400700 1 --2- 172.21.15.82:0/4170603997 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bbb9da9670 0x55bbb9dacb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:54.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.770+0000 7f3da5400700 1 -- 172.21.15.82:0/4170603997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbb9da8d50 msgr2=0x55bbb9dac630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:49:54.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.770+0000 7f3da5400700 1 --2- 172.21.15.82:0/4170603997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbb9da8d50 0x55bbb9dac630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:54.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.770+0000 7f3da5400700 1 -- 172.21.15.82:0/4170603997 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbb9cbb3d0 con 0x55bbb9da3a00 2024-05-08T05:49:54.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.770+0000 7f3da4a00700 1 --2- 172.21.15.82:0/4170603997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbb9da8d50 0x55bbb9dac630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:49:54.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.770+0000 7f3da5400700 1 --2- 172.21.15.82:0/4170603997 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bbb9da3a00 0x55bbb9daf290 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3d94000c00 tx=0x7f3d94004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0593bf7237e8312 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:49:54.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.770+0000 7f3d87400700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:49:54.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.771+0000 7f3d87400700 1 -- 172.21.15.82:0/4170603997 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d94028060 con 0x55bbb9da3a00 2024-05-08T05:49:54.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.771+0000 7f3d87400700 1 -- 172.21.15.82:0/4170603997 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f3d94004460 con 0x55bbb9da3a00 2024-05-08T05:49:54.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.771+0000 7f3db2790b80 1 -- 172.21.15.82:0/4170603997 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d94004830 con 0x55bbb9da3a00 2024-05-08T05:49:54.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.771+0000 7f3d87400700 1 -- 172.21.15.82:0/4170603997 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3d9401d040 con 0x55bbb9da3a00 2024-05-08T05:49:54.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.771+0000 7f3db2790b80 10 client.25073 fetch_fsmap learned FSMap version 28 2024-05-08T05:49:54.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.771+0000 7f3db2790b80 1 -- 172.21.15.82:0/4170603997 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bbb9dba860 con 0x55bbb9da3a00 2024-05-08T05:49:54.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.771+0000 7f3d87400700 1 -- 172.21.15.82:0/4170603997 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d94004830 con 0x55bbb9da3a00 2024-05-08T05:49:54.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.771+0000 7f3d87400700 1 -- 172.21.15.82:0/4170603997 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f3d94020070 con 0x55bbb9da3a00 2024-05-08T05:49:54.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.772+0000 7f3db2790b80 10 client.25073 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T05:49:54.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.772+0000 7f3db2790b80 10 client.25073 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-08T05:49:54.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.772+0000 7f3db2790b80 20 client.25073 populate_metadata read hostname 'smithi082' 2024-05-08T05:49:54.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.772+0000 7f3db2790b80 1 --2- 172.21.15.82:0/4170603997 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55bbb9dbcc40 0x55bbb9dbe0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:54.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.772+0000 7f3db2790b80 4 client.25073 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:49:54.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.772+0000 7f3db2790b80 1 -- 172.21.15.82:0/4170603997 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bbb9d700f0 con 0x55bbb9dbcc40 2024-05-08T05:49:54.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.772+0000 7f3da4a00700 1 --2- 172.21.15.82:0/4170603997 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55bbb9dbcc40 0x55bbb9dbe0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:54.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.773+0000 7f3da4a00700 1 --2- 172.21.15.82:0/4170603997 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55bbb9dbcc40 0x55bbb9dbe0b0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=985b8a9ce266d035 server_cookie=26a2291ba5e99f60 in_seq=0 out_seq=0 2024-05-08T05:49:54.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.773+0000 7f3d87400700 10 client.25073 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:49:54.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.773+0000 7f3d87400700 1 -- 172.21.15.82:0/4170603997 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55bbb9d700f0 con 0x55bbb9dbcc40 2024-05-08T05:49:54.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.773+0000 7f3d87400700 10 client.25073 handle_command_reply: tid=0 2024-05-08T05:49:54.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.774+0000 7f3db2790b80 1 client.25073 shutdown 2024-05-08T05:49:54.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.774+0000 7f3db2790b80 1 -- 172.21.15.82:0/4170603997 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bbb9da3a00 msgr2=0x55bbb9daf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:54.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.774+0000 7f3db2790b80 1 --2- 172.21.15.82:0/4170603997 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bbb9da3a00 0x55bbb9daf290 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3d94000c00 tx=0x7f3d94004270 comp rx=0 tx=0).stop 2024-05-08T05:49:54.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.774+0000 7f3db2790b80 1 -- 172.21.15.82:0/4170603997 shutdown_connections 2024-05-08T05:49:54.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.774+0000 7f3db2790b80 1 --2- 172.21.15.82:0/4170603997 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55bbb9dbcc40 0x55bbb9dbe0b0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:54.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.774+0000 7f3db2790b80 1 --2- 172.21.15.82:0/4170603997 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bbb9da3a00 0x55bbb9daf290 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:54.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.774+0000 7f3db2790b80 1 --2- 172.21.15.82:0/4170603997 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bbb9da9670 0x55bbb9dacb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:54.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.774+0000 7f3db2790b80 1 --2- 172.21.15.82:0/4170603997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbb9da8d50 0x55bbb9dac630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:54.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.774+0000 7f3d87400700 0 client.25073 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:49:54.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.774+0000 7f3db2790b80 1 -- 172.21.15.82:0/4170603997 >> 172.21.15.82:0/4170603997 conn(0x55bbb9d1b680 msgr2=0x55bbb9d98700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:49:54.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.774+0000 7f3db2790b80 1 -- 172.21.15.82:0/4170603997 shutdown_connections 2024-05-08T05:49:54.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.774+0000 7f3db2790b80 1 -- 172.21.15.82:0/4170603997 wait complete. 2024-05-08T05:49:54.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.774+0000 7f3db2790b80 20 client.25073 trim_cache size 0 max 16384 2024-05-08T05:49:54.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.800+0000 7f3db2790b80 1 Processor -- start 2024-05-08T05:49:54.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.800+0000 7f3db2790b80 1 -- start start 2024-05-08T05:49:54.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.800+0000 7f3db2790b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bbb9da3a00 0x55bbb9daa160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:54.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.800+0000 7f3db2790b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bbb9da8d50 0x55bbb9d98810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:54.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.800+0000 7f3db2790b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbb9da9670 0x55bbb9db8510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:54.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.800+0000 7f3db2790b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55bbb9dbc3f0 con 0x55bbb9da9670 2024-05-08T05:49:54.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.800+0000 7f3db2790b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55bbb9dbcac0 con 0x55bbb9da3a00 2024-05-08T05:49:54.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.800+0000 7f3db2790b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55bbb9dbd190 con 0x55bbb9da8d50 2024-05-08T05:49:54.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.801+0000 7f3da5e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbb9da9670 0x55bbb9db8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:54.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.801+0000 7f3da5400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bbb9da3a00 0x55bbb9daa160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:54.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.801+0000 7f3da4a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bbb9da8d50 0x55bbb9d98810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:54.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.801+0000 7f3da5400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bbb9da3a00 0x55bbb9daa160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:34444/0 (socket says 172.21.15.82:34444) 2024-05-08T05:49:54.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.801+0000 7f3da5400700 1 -- 172.21.15.82:0/2888419566 learned_addr learned my addr 172.21.15.82:0/2888419566 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:49:54.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.801+0000 7f3da5400700 1 -- 172.21.15.82:0/2888419566 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bbb9da8d50 msgr2=0x55bbb9d98810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:49:54.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.801+0000 7f3da5400700 1 --2- 172.21.15.82:0/2888419566 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bbb9da8d50 0x55bbb9d98810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:54.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.801+0000 7f3da5400700 1 -- 172.21.15.82:0/2888419566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbb9da9670 msgr2=0x55bbb9db8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:49:54.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.801+0000 7f3da5400700 1 --2- 172.21.15.82:0/2888419566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbb9da9670 0x55bbb9db8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:54.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.801+0000 7f3da5400700 1 -- 172.21.15.82:0/2888419566 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbb9d9a850 con 0x55bbb9da3a00 2024-05-08T05:49:54.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.802+0000 7f3da5e00700 1 --2- 172.21.15.82:0/2888419566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbb9da9670 0x55bbb9db8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:49:54.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.802+0000 7f3da4a00700 1 --2- 172.21.15.82:0/2888419566 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bbb9da8d50 0x55bbb9d98810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:49:54.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.802+0000 7f3da5400700 1 --2- 172.21.15.82:0/2888419566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bbb9da3a00 0x55bbb9daa160 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3d940115a0 tx=0x7f3d94011990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd57465c643e7ba5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:49:54.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.802+0000 7f3d92000700 1 -- 172.21.15.82:0/2888419566 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d94033070 con 0x55bbb9da3a00 2024-05-08T05:49:54.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.803+0000 7f3d92000700 1 -- 172.21.15.82:0/2888419566 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d94016030 con 0x55bbb9da3a00 2024-05-08T05:49:54.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.803+0000 7f3d92000700 1 -- 172.21.15.82:0/2888419566 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d94028070 con 0x55bbb9da3a00 2024-05-08T05:49:54.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.804+0000 7f3db2790b80 1 -- 172.21.15.82:0/2888419566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bbb9da3a00 msgr2=0x55bbb9daa160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:54.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.804+0000 7f3db2790b80 1 --2- 172.21.15.82:0/2888419566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bbb9da3a00 0x55bbb9daa160 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3d940115a0 tx=0x7f3d94011990 comp rx=0 tx=0).stop 2024-05-08T05:49:54.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.804+0000 7f3db2790b80 1 -- 172.21.15.82:0/2888419566 shutdown_connections 2024-05-08T05:49:54.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.804+0000 7f3db2790b80 1 --2- 172.21.15.82:0/2888419566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bbb9da3a00 0x55bbb9daa160 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:54.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.804+0000 7f3db2790b80 1 --2- 172.21.15.82:0/2888419566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbb9da9670 0x55bbb9db8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:54.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.804+0000 7f3db2790b80 1 --2- 172.21.15.82:0/2888419566 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bbb9da8d50 0x55bbb9d98810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:54.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.804+0000 7f3db2790b80 1 -- 172.21.15.82:0/2888419566 >> 172.21.15.82:0/2888419566 conn(0x55bbb9d1b680 msgr2=0x55bbb9da9a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:49:54.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.804+0000 7f3db2790b80 1 -- 172.21.15.82:0/2888419566 shutdown_connections 2024-05-08T05:49:54.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.804+0000 7f3db2790b80 1 -- 172.21.15.82:0/2888419566 wait complete. 2024-05-08T05:49:54.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.804+0000 7f3db2790b80 1 -- start start 2024-05-08T05:49:54.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.804+0000 7f3db2790b80 1 Processor -- start 2024-05-08T05:49:54.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.805+0000 7f3db2790b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bbb9da3a00 0x55bbb9d97be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:54.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.805+0000 7f3db2790b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbb9da8d50 0x55bbb9d98120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:54.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.805+0000 7f3db2790b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bbb9da9670 0x55bbb9d98660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:54.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.805+0000 7f3db2790b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55bbb9dbdf30 con 0x55bbb9da8d50 2024-05-08T05:49:54.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.805+0000 7f3db2790b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55bbb9dbd860 con 0x55bbb9da9670 2024-05-08T05:49:54.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.805+0000 7f3db2790b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55bbb9dbe600 con 0x55bbb9da3a00 2024-05-08T05:49:54.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.805+0000 7f3db2790b80 10 client.0 _ll_register_callbacks cb 0x55bbb9c9cc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:49:54.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.805+0000 7f3da5400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bbb9da3a00 0x55bbb9d97be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:54.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.805+0000 7f3da5400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bbb9da3a00 0x55bbb9d97be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:48386/0 (socket says 172.21.15.82:48386) 2024-05-08T05:49:54.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.805+0000 7f3da5400700 1 -- 172.21.15.82:0/3200200540 learned_addr learned my addr 172.21.15.82:0/3200200540 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:49:54.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.805+0000 7f3da4a00700 1 --2- 172.21.15.82:0/3200200540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbb9da8d50 0x55bbb9d98120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:54.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.805+0000 7f3da5e00700 1 --2- 172.21.15.82:0/3200200540 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bbb9da9670 0x55bbb9d98660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:54.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.806+0000 7f3da5400700 1 -- 172.21.15.82:0/3200200540 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bbb9da9670 msgr2=0x55bbb9d98660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:49:54.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.806+0000 7f3da5400700 1 --2- 172.21.15.82:0/3200200540 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bbb9da9670 0x55bbb9d98660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:54.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.806+0000 7f3da5400700 1 -- 172.21.15.82:0/3200200540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbb9da8d50 msgr2=0x55bbb9d98120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:49:54.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.806+0000 7f3da5400700 1 --2- 172.21.15.82:0/3200200540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbb9da8d50 0x55bbb9d98120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:54.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.806+0000 7f3da5400700 1 -- 172.21.15.82:0/3200200540 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbb9dc57e0 con 0x55bbb9da3a00 2024-05-08T05:49:54.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.806+0000 7f3da5e00700 1 --2- 172.21.15.82:0/3200200540 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bbb9da9670 0x55bbb9d98660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:49:54.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.806+0000 7f3da5400700 1 --2- 172.21.15.82:0/3200200540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bbb9da3a00 0x55bbb9d97be0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3d94003b30 tx=0x7f3d94005da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ded2871e2415d7c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:49:54.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.806+0000 7f3d87400700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:49:54.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.807+0000 7f3d87400700 1 -- 172.21.15.82:0/3200200540 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d94028070 con 0x55bbb9da3a00 2024-05-08T05:49:54.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.807+0000 7f3d87400700 1 -- 172.21.15.82:0/3200200540 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f3d94004450 con 0x55bbb9da3a00 2024-05-08T05:49:54.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.807+0000 7f3db2790b80 1 -- 172.21.15.82:0/3200200540 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d94016030 con 0x55bbb9da3a00 2024-05-08T05:49:54.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.807+0000 7f3d87400700 1 -- 172.21.15.82:0/3200200540 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f3d94033040 con 0x55bbb9da3a00 2024-05-08T05:49:54.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.807+0000 7f3db2790b80 10 client.25105 fetch_fsmap learned FSMap version 28 2024-05-08T05:49:54.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.807+0000 7f3db2790b80 1 -- 172.21.15.82:0/3200200540 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55bbb9e282f0 con 0x55bbb9da3a00 2024-05-08T05:49:54.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.807+0000 7f3d87400700 1 -- 172.21.15.82:0/3200200540 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3d94016030 con 0x55bbb9da3a00 2024-05-08T05:49:54.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.808+0000 7f3d87400700 1 -- 172.21.15.82:0/3200200540 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 28) ==== 8354+0+0 (secure 0 0 0) 0x7f3d9403e060 con 0x55bbb9da3a00 2024-05-08T05:49:54.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.808+0000 7f3db2790b80 10 client.25105 fetch_fsmap finished waiting for FSMap version 28 2024-05-08T05:49:54.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.808+0000 7f3db2790b80 10 client.25105 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-08T05:49:54.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.808+0000 7f3db2790b80 20 client.25105 populate_metadata read hostname 'smithi082' 2024-05-08T05:49:54.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.808+0000 7f3db2790b80 1 --2- 172.21.15.82:0/3200200540 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55bbb9e2cc60 0x55bbb9e2b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:54.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.808+0000 7f3db2790b80 4 client.25105 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-08T05:49:54.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.808+0000 7f3db2790b80 1 -- 172.21.15.82:0/3200200540 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "status"}) -- 0x55bbb9d033b0 con 0x55bbb9e2cc60 2024-05-08T05:49:54.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.808+0000 7f3da4a00700 1 --2- 172.21.15.82:0/3200200540 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55bbb9e2cc60 0x55bbb9e2b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:54.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.809+0000 7f3d87400700 10 client.25105 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:49:54.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.809+0000 7f3da4a00700 1 --2- 172.21.15.82:0/3200200540 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55bbb9e2cc60 0x55bbb9e2b970 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91b830255fe37c5b server_cookie=23a48dff023b3092 in_seq=0 out_seq=0 2024-05-08T05:49:54.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.809+0000 7f3d87400700 1 -- 172.21.15.82:0/3200200540 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55bbb9d033b0 con 0x55bbb9e2cc60 2024-05-08T05:49:54.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.809+0000 7f3d87400700 10 client.25105 handle_command_reply: tid=0 2024-05-08T05:49:54.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.809+0000 7f3db2790b80 1 client.25105 shutdown 2024-05-08T05:49:54.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.809+0000 7f3db2790b80 1 -- 172.21.15.82:0/3200200540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bbb9da3a00 msgr2=0x55bbb9d97be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:54.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.809+0000 7f3db2790b80 1 --2- 172.21.15.82:0/3200200540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bbb9da3a00 0x55bbb9d97be0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3d94003b30 tx=0x7f3d94005da0 comp rx=0 tx=0).stop 2024-05-08T05:49:54.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.810+0000 7f3db2790b80 1 -- 172.21.15.82:0/3200200540 shutdown_connections 2024-05-08T05:49:54.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.810+0000 7f3db2790b80 1 --2- 172.21.15.82:0/3200200540 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55bbb9e2cc60 0x55bbb9e2b970 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:54.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.810+0000 7f3db2790b80 1 --2- 172.21.15.82:0/3200200540 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bbb9da9670 0x55bbb9d98660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:54.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.810+0000 7f3db2790b80 1 --2- 172.21.15.82:0/3200200540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bbb9da3a00 0x55bbb9d97be0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:54.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.810+0000 7f3db2790b80 1 --2- 172.21.15.82:0/3200200540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55bbb9da8d50 0x55bbb9d98120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:54.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.810+0000 7f3db2790b80 1 -- 172.21.15.82:0/3200200540 >> 172.21.15.82:0/3200200540 conn(0x55bbb9d1b680 msgr2=0x55bbb9dab3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:49:54.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.810+0000 7f3d87400700 0 client.25105 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:49:54.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.810+0000 7f3db2790b80 1 -- 172.21.15.82:0/3200200540 shutdown_connections 2024-05-08T05:49:54.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.810+0000 7f3db2790b80 1 -- 172.21.15.82:0/3200200540 wait complete. 2024-05-08T05:49:54.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.810+0000 7f3db2790b80 20 client.25105 trim_cache size 0 max 16384 2024-05-08T05:49:54.813 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T05:49:54.813 INFO:teuthology.orchestra.run.smithi082.stdout: "cluster_fsid": "c739a5c8-0cfc-11ef-bc97-c7b262605968", 2024-05-08T05:49:54.813 INFO:teuthology.orchestra.run.smithi082.stdout: "whoami": 0, 2024-05-08T05:49:54.813 INFO:teuthology.orchestra.run.smithi082.stdout: "id": 24506, 2024-05-08T05:49:54.813 INFO:teuthology.orchestra.run.smithi082.stdout: "want_state": "up:active", 2024-05-08T05:49:54.813 INFO:teuthology.orchestra.run.smithi082.stdout: "state": "up:active", 2024-05-08T05:49:54.813 INFO:teuthology.orchestra.run.smithi082.stdout: "fs_name": "cephfs", 2024-05-08T05:49:54.813 INFO:teuthology.orchestra.run.smithi082.stdout: "rank_uptime": 236.99551506700001, 2024-05-08T05:49:54.813 INFO:teuthology.orchestra.run.smithi082.stdout: "mdsmap_epoch": 28, 2024-05-08T05:49:54.814 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch": 82, 2024-05-08T05:49:54.814 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_epoch_barrier": 80, 2024-05-08T05:49:54.814 INFO:teuthology.orchestra.run.smithi082.stdout: "uptime": 259.65652550800002 2024-05-08T05:49:54.814 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T05:49:54.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.811+0000 7f3da6800700 1 -- 172.21.15.82:0/630326521 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3d880b2880 msgr2=0x7f3d880b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:54.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.811+0000 7f3da6800700 1 --2- 172.21.15.82:0/630326521 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3d880b2880 0x7f3d880b4d40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3d98009fd0 tx=0x7f3d9800bbe0 comp rx=0 tx=0).stop 2024-05-08T05:49:54.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.811+0000 7f3da6800700 1 -- 172.21.15.82:0/630326521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3da0104ef0 msgr2=0x7f3da01a1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:54.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.811+0000 7f3da6800700 1 --2- 172.21.15.82:0/630326521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3da0104ef0 0x7f3da01a1df0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c00e9c0 tx=0x7f3d8c00ecd0 comp rx=0 tx=0).stop 2024-05-08T05:49:54.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.811+0000 7f3da6800700 1 -- 172.21.15.82:0/630326521 shutdown_connections 2024-05-08T05:49:54.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.811+0000 7f3da6800700 1 --2- 172.21.15.82:0/630326521 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3da010da00 0x7f3da019ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:54.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.811+0000 7f3da6800700 1 --2- 172.21.15.82:0/630326521 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3d880b2880 0x7f3d880b4d40 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:54.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.811+0000 7f3da6800700 1 --2- 172.21.15.82:0/630326521 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3da01045d0 0x7f3da01a18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:54.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.811+0000 7f3da6800700 1 --2- 172.21.15.82:0/630326521 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3da0104ef0 0x7f3da01a1df0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:54.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.811+0000 7f3da6800700 1 -- 172.21.15.82:0/630326521 >> 172.21.15.82:0/630326521 conn(0x7f3da00fddc0 msgr2=0x7f3da010fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:49:54.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.812+0000 7f3da6800700 1 -- 172.21.15.82:0/630326521 shutdown_connections 2024-05-08T05:49:54.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:54.812+0000 7f3da6800700 1 -- 172.21.15.82:0/630326521 wait complete. 2024-05-08T05:49:55.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:49:55 smithi082 ceph-mon[30098]: pgmap v437: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-08T05:49:55.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:49:55 smithi151 ceph-mon[34815]: pgmap v437: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-08T05:49:55.747 INFO:teuthology.run_tasks:Running task sequential... 2024-05-08T05:49:55.758 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-08T05:49:55.759 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-08T05:49:55.759 INFO:teuthology.task.print:Enabling mgr modules 2024-05-08T05:49:55.759 INFO:teuthology.run_tasks:Running task kclient... 2024-05-08T05:49:55.789 INFO:tasks.kclient:Mounting kernel clients... 2024-05-08T05:49:55.790 INFO:tasks.kclient:config is {'client.0': {}} 2024-05-08T05:49:55.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T05:49:55.790 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-05-08T05:49:55.791 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:49:55 smithi134 ceph-mon[34132]: pgmap v437: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-08T05:49:55.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T05:49:55.849 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link delete ceph-brx 2024-05-08T05:49:55.930 INFO:teuthology.orchestra.run.smithi082.stderr:Cannot find device "ceph-brx" 2024-05-08T05:49:55.933 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T05:49:55.934 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'wsync', 'context=system_u:object_r:postgresql_db_t:s0'], 'syntax': 'v1', 'mount_subvol_num': 1, 'mountpoint': '/tmp/cephfs'} 2024-05-08T05:49:55.934 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-08T05:49:55.934 INFO:tasks.cephfs.mount:using client_config["hostfs_mntpt"] = /tmp/cephfs 2024-05-08T05:49:55.934 INFO:tasks.cephfs.mount:hostfs_mntpt = /tmp/cephfs 2024-05-08T05:49:55.934 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph fs ls 2024-05-08T05:49:56.375 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:49:57.453 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:49:57 smithi082 ceph-mon[30098]: pgmap v438: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-08T05:49:57.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:49:57 smithi151 ceph-mon[34815]: pgmap v438: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-08T05:49:57.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:49:57 smithi134 ceph-mon[34132]: pgmap v438: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-08T05:49:58.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:58.580+0000 7ff913600700 1 -- 172.21.15.82:0/3203738639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff90c10b6c0 msgr2=0x7ff90c10baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:58.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:58.580+0000 7ff913600700 1 --2- 172.21.15.82:0/3203738639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff90c10b6c0 0x7ff90c10baa0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7ff9000098f0 tx=0x7ff900009c00 comp rx=0 tx=0).stop 2024-05-08T05:49:58.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:58.580+0000 7ff913600700 1 -- 172.21.15.82:0/3203738639 shutdown_connections 2024-05-08T05:49:58.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:58.580+0000 7ff913600700 1 --2- 172.21.15.82:0/3203738639 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff90c106080 0x7ff90c112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:58.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:58.580+0000 7ff913600700 1 --2- 172.21.15.82:0/3203738639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff90c10b6c0 0x7ff90c10baa0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:58.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:58.580+0000 7ff913600700 1 --2- 172.21.15.82:0/3203738639 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff90c1056c0 0x7ff90c105b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:58.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:58.580+0000 7ff913600700 1 -- 172.21.15.82:0/3203738639 >> 172.21.15.82:0/3203738639 conn(0x7ff90c1011b0 msgr2=0x7ff90c1035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:49:58.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:58.580+0000 7ff913600700 1 -- 172.21.15.82:0/3203738639 shutdown_connections 2024-05-08T05:49:58.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:58.580+0000 7ff913600700 1 -- 172.21.15.82:0/3203738639 wait complete. 2024-05-08T05:49:58.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:58.581+0000 7ff913600700 1 Processor -- start 2024-05-08T05:49:58.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:58.581+0000 7ff913600700 1 -- start start 2024-05-08T05:49:58.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:58.582+0000 7ff913600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff90c1056c0 0x7ff90c19bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:58.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:58.582+0000 7ff913600700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff90c106080 0x7ff90c19c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:58.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:58.582+0000 7ff913600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff90c10b6c0 0x7ff90c1a0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:58.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:58.582+0000 7ff913600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff90c1158a0 con 0x7ff90c1056c0 2024-05-08T05:49:58.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:58.582+0000 7ff913600700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff90c115720 con 0x7ff90c10b6c0 2024-05-08T05:49:58.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:58.582+0000 7ff913600700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff90c115a20 con 0x7ff90c106080 2024-05-08T05:49:58.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:58.582+0000 7ff910c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff90c1056c0 0x7ff90c19bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:58.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:58.582+0000 7ff910c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff90c1056c0 0x7ff90c19bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52380/0 (socket says 172.21.15.82:52380) 2024-05-08T05:49:58.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:58.582+0000 7ff910c00700 1 -- 172.21.15.82:0/4234403399 learned_addr learned my addr 172.21.15.82:0/4234403399 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:49:58.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:58.582+0000 7ff911600700 1 --2- 172.21.15.82:0/4234403399 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff90c10b6c0 0x7ff90c1a0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:58.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:58.582+0000 7ff90be00700 1 --2- 172.21.15.82:0/4234403399 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff90c106080 0x7ff90c19c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:58.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:58.583+0000 7ff910c00700 1 -- 172.21.15.82:0/4234403399 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff90c106080 msgr2=0x7ff90c19c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:58.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:58.583+0000 7ff910c00700 1 --2- 172.21.15.82:0/4234403399 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff90c106080 0x7ff90c19c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:58.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:58.583+0000 7ff910c00700 1 -- 172.21.15.82:0/4234403399 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff90c10b6c0 msgr2=0x7ff90c1a0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:58.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:58.583+0000 7ff910c00700 1 --2- 172.21.15.82:0/4234403399 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff90c10b6c0 0x7ff90c1a0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:58.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:58.583+0000 7ff910c00700 1 -- 172.21.15.82:0/4234403399 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff90c1a0d80 con 0x7ff90c1056c0 2024-05-08T05:49:58.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:58.583+0000 7ff911600700 1 --2- 172.21.15.82:0/4234403399 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff90c10b6c0 0x7ff90c1a0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:49:58.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:58.583+0000 7ff910c00700 1 --2- 172.21.15.82:0/4234403399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff90c1056c0 0x7ff90c19bd70 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff90000f990 tx=0x7ff90000f9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:49:58.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:58.583+0000 7ff909600700 1 -- 172.21.15.82:0/4234403399 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff900027070 con 0x7ff90c1056c0 2024-05-08T05:49:58.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:58.583+0000 7ff909600700 1 -- 172.21.15.82:0/4234403399 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff900005570 con 0x7ff90c1056c0 2024-05-08T05:49:58.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:58.583+0000 7ff913600700 1 -- 172.21.15.82:0/4234403399 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff90c1a1010 con 0x7ff90c1056c0 2024-05-08T05:49:58.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:58.583+0000 7ff909600700 1 -- 172.21.15.82:0/4234403399 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff900004930 con 0x7ff90c1056c0 2024-05-08T05:49:58.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:58.583+0000 7ff913600700 1 -- 172.21.15.82:0/4234403399 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff90c1a88f0 con 0x7ff90c1056c0 2024-05-08T05:49:58.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:58.585+0000 7ff913600700 1 -- 172.21.15.82:0/4234403399 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff90c06a190 con 0x7ff90c1056c0 2024-05-08T05:49:58.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:58.587+0000 7ff909600700 1 -- 172.21.15.82:0/4234403399 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7ff90002a070 con 0x7ff90c1056c0 2024-05-08T05:49:58.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:58.588+0000 7ff909600700 1 --2- 172.21.15.82:0/4234403399 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff8f40b2880 0x7ff8f40b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:49:58.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:58.588+0000 7ff909600700 1 -- 172.21.15.82:0/4234403399 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7ff9000e3300 con 0x7ff90c1056c0 2024-05-08T05:49:58.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:58.589+0000 7ff90be00700 1 --2- 172.21.15.82:0/4234403399 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff8f40b2880 0x7ff8f40b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:49:58.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:58.589+0000 7ff90be00700 1 --2- 172.21.15.82:0/4234403399 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff8f40b2880 0x7ff8f40b4d40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff8f8009750 tx=0x7ff8f8009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:49:58.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:58.591+0000 7ff909600700 1 -- 172.21.15.82:0/4234403399 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff900031070 con 0x7ff90c1056c0 2024-05-08T05:49:58.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:58.877+0000 7ff913600700 1 -- 172.21.15.82:0/4234403399 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7ff90c02e510 con 0x7ff90c1056c0 2024-05-08T05:49:58.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:58.878+0000 7ff909600700 1 -- 172.21.15.82:0/4234403399 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v28) ==== 53+0+73 (secure 0 0 0) 0x7ff900013030 con 0x7ff90c1056c0 2024-05-08T05:49:58.879 INFO:teuthology.orchestra.run.smithi082.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-05-08T05:49:58.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:58.882+0000 7ff913600700 1 -- 172.21.15.82:0/4234403399 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff8f40b2880 msgr2=0x7ff8f40b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:58.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:58.882+0000 7ff913600700 1 --2- 172.21.15.82:0/4234403399 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff8f40b2880 0x7ff8f40b4d40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff8f8009750 tx=0x7ff8f8009310 comp rx=0 tx=0).stop 2024-05-08T05:49:58.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:58.882+0000 7ff913600700 1 -- 172.21.15.82:0/4234403399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff90c1056c0 msgr2=0x7ff90c19bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:49:58.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:58.882+0000 7ff913600700 1 --2- 172.21.15.82:0/4234403399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff90c1056c0 0x7ff90c19bd70 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff90000f990 tx=0x7ff90000f9c0 comp rx=0 tx=0).stop 2024-05-08T05:49:58.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:58.882+0000 7ff913600700 1 -- 172.21.15.82:0/4234403399 shutdown_connections 2024-05-08T05:49:58.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:58.882+0000 7ff913600700 1 --2- 172.21.15.82:0/4234403399 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff90c10b6c0 0x7ff90c1a0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:58.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:58.882+0000 7ff913600700 1 --2- 172.21.15.82:0/4234403399 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff8f40b2880 0x7ff8f40b4d40 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:58.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:58.882+0000 7ff913600700 1 --2- 172.21.15.82:0/4234403399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff90c1056c0 0x7ff90c19bd70 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:58.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:58.882+0000 7ff913600700 1 --2- 172.21.15.82:0/4234403399 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff90c106080 0x7ff90c19c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:49:58.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:58.882+0000 7ff913600700 1 -- 172.21.15.82:0/4234403399 >> 172.21.15.82:0/4234403399 conn(0x7ff90c1011b0 msgr2=0x7ff90c101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:49:58.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:58.883+0000 7ff913600700 1 -- 172.21.15.82:0/4234403399 shutdown_connections 2024-05-08T05:49:58.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:58.883+0000 7ff913600700 1 -- 172.21.15.82:0/4234403399 wait complete. 2024-05-08T05:49:59.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:49:59 smithi151 ceph-mon[34815]: pgmap v439: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:49:59.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:49:59 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/4234403399' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-08T05:49:59.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:49:59 smithi082 ceph-mon[30098]: pgmap v439: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:49:59.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:49:59 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/4234403399' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-08T05:49:59.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:49:59 smithi134 ceph-mon[34132]: pgmap v439: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:49:59.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:49:59 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/4234403399' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-08T05:49:59.818 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-08T05:49:59.818 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-08T05:49:59.818 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi082.front.sepia.ceph.com 2024-05-08T05:49:59.818 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-08T05:49:59.818 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /tmp/cephfs 2024-05-08T05:49:59.818 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-08T05:49:59.818 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-08T05:49:59.818 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-08T05:49:59.819 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/tmp/cephfs' 2024-05-08T05:49:59.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T05:49:59.819 DEBUG:teuthology.orchestra.run.smithi082:> ip addr 2024-05-08T05:49:59.876 INFO:teuthology.orchestra.run.smithi082.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-08T05:49:59.877 INFO:teuthology.orchestra.run.smithi082.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-08T05:49:59.877 INFO:teuthology.orchestra.run.smithi082.stdout: inet 127.0.0.1/8 scope host lo 2024-05-08T05:49:59.877 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-05-08T05:49:59.877 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 ::1/128 scope host 2024-05-08T05:49:59.877 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-05-08T05:49:59.877 INFO:teuthology.orchestra.run.smithi082.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T05:49:59.877 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c6 brd ff:ff:ff:ff:ff:ff 2024-05-08T05:49:59.877 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f0 2024-05-08T05:49:59.877 INFO:teuthology.orchestra.run.smithi082.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T05:49:59.877 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:d8:da:c7 brd ff:ff:ff:ff:ff:ff 2024-05-08T05:49:59.877 INFO:teuthology.orchestra.run.smithi082.stdout: altname enp7s0f1 2024-05-08T05:49:59.878 INFO:teuthology.orchestra.run.smithi082.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-08T05:49:59.878 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:fe brd ff:ff:ff:ff:ff:ff 2024-05-08T05:49:59.878 INFO:teuthology.orchestra.run.smithi082.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-08T05:49:59.878 INFO:teuthology.orchestra.run.smithi082.stdout: link/ether 0c:c4:7a:8f:d3:ff brd ff:ff:ff:ff:ff:ff 2024-05-08T05:49:59.878 INFO:teuthology.orchestra.run.smithi082.stdout: inet 172.21.15.82/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-08T05:49:59.878 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft 41843sec preferred_lft 41843sec 2024-05-08T05:49:59.878 INFO:teuthology.orchestra.run.smithi082.stdout: inet6 fe80::ec4:7aff:fe8f:d3ff/64 scope link 2024-05-08T05:49:59.878 INFO:teuthology.orchestra.run.smithi082.stdout: valid_lft forever preferred_lft forever 2024-05-08T05:49:59.879 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-08T05:49:59.879 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T05:49:59.880 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-05-08T05:49:59.880 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link add name ceph-brx type bridge 2024-05-08T05:49:59.880 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip addr flush dev ceph-brx 2024-05-08T05:49:59.880 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set ceph-brx up 2024-05-08T05:49:59.880 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-08T05:49:59.880 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-05-08T05:49:59.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:49:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T05:50:00.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T05:50:00.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T05:50:00.365 DEBUG:teuthology.orchestra.run.smithi082:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-08T05:50:00.432 INFO:teuthology.orchestra.run.smithi082.stdout:1 2024-05-08T05:50:00.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T05:50:00.437 DEBUG:teuthology.orchestra.run.smithi082:> route 2024-05-08T05:50:00.497 INFO:teuthology.orchestra.run.smithi082.stdout:Kernel IP routing table 2024-05-08T05:50:00.497 INFO:teuthology.orchestra.run.smithi082.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-08T05:50:00.497 INFO:teuthology.orchestra.run.smithi082.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-08T05:50:00.497 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-08T05:50:00.497 INFO:teuthology.orchestra.run.smithi082.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-08T05:50:00.498 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T05:50:00.498 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-05-08T05:50:00.498 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-08T05:50:00.498 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-08T05:50:00.498 DEBUG:teuthology.orchestra.run.smithi082:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-08T05:50:00.498 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-05-08T05:50:00.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T05:50:00.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:50:00 smithi082 ceph-mon[30098]: overall HEALTH_OK 2024-05-08T05:50:00.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:50:00 smithi151 ceph-mon[34815]: overall HEALTH_OK 2024-05-08T05:50:00.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:50:00 smithi134 ceph-mon[34132]: overall HEALTH_OK 2024-05-08T05:50:01.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T05:50:01.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T05:50:01.296 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-05-08T05:50:01.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T05:50:01.351 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list-id 2024-05-08T05:50:01.400 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T05:50:01.400 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-05-08T05:50:01.400 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns add ceph-ns--tmp-cephfs 2024-05-08T05:50:01.400 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns set ceph-ns--tmp-cephfs 0 2024-05-08T05:50:01.400 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-05-08T05:50:01.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T05:50:01.541 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:50:01 smithi082 ceph-mon[30098]: pgmap v440: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-05-08T05:50:01.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T05:50:01.583 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--tmp-cephfs' with 192.168.0.1/16 2024-05-08T05:50:01.583 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T05:50:01.583 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-05-08T05:50:01.583 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link add veth0 netns ceph-ns--tmp-cephfs type veth peer name brx.0 2024-05-08T05:50:01.583 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--tmp-cephfs ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-08T05:50:01.583 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set veth0 up 2024-05-08T05:50:01.583 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set lo up 2024-05-08T05:50:01.583 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns exec ceph-ns--tmp-cephfs ip route add default via 192.168.255.254 2024-05-08T05:50:01.583 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-05-08T05:50:01.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:50:01 smithi151 ceph-mon[34815]: pgmap v440: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-05-08T05:50:01.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T05:50:01.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:50:01 smithi134 ceph-mon[34132]: pgmap v440: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s 2024-05-08T05:50:01.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T05:50:01.876 DEBUG:teuthology.orchestra.run.smithi082:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-08T05:50:01.876 DEBUG:teuthology.orchestra.run.smithi082:> set -e 2024-05-08T05:50:01.877 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set brx.0 up 2024-05-08T05:50:01.877 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link set dev brx.0 master ceph-brx 2024-05-08T05:50:01.877 DEBUG:teuthology.orchestra.run.smithi082:> ') 2024-05-08T05:50:01.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T05:50:02.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T05:50:02.081 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T05:50:02.081 DEBUG:teuthology.orchestra.run.smithi082:> mkdir -p -v /tmp/cephfs 2024-05-08T05:50:02.127 INFO:teuthology.orchestra.run.smithi082.stdout:mkdir: created directory '/tmp/cephfs' 2024-05-08T05:50:02.128 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-08T05:50:02.128 DEBUG:teuthology.orchestra.run.smithi082:> chmod 0000 /tmp/cephfs 2024-05-08T05:50:02.218 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-05-08T05:50:02.218 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-05-08T05:50:02.218 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/5cc92dff-ab65-410c-b632-4df5dd09b865 2024-05-08T05:50:02.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T05:50:02.219 DEBUG:teuthology.orchestra.run.smithi082:> sudo nsenter --net=/var/run/netns/ceph-ns--tmp-cephfs adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/5cc92dff-ab65-410c-b632-4df5dd09b865 /tmp/cephfs -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync,context=system_u:object_r:postgresql_db_t:s0 2024-05-08T05:50:02.361 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync,context="system_u:object_r:postgresql_db_t:s0" 2024-05-08T05:50:02.361 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync,context="system_u:object_r:postgresql_db_t:s0"". 2024-05-08T05:50:02.361 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2024-05-08T05:50:03.076 INFO:teuthology.orchestra.run.smithi082.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync,context="system_u:object_r:postgresql_db_t:s0" 2024-05-08T05:50:03.076 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync,context="system_u:object_r:postgresql_db_t:s0"". 2024-05-08T05:50:03.076 INFO:teuthology.orchestra.run.smithi082.stdout:invalid new device string format 2024-05-08T05:50:03.076 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: resolved to: "172.21.15.82:3300,172.21.15.134:3300,172.21.15.151:3300" 2024-05-08T05:50:03.077 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.82:3300,172.21.15.134:3300,172.21.15.151:3300:/volumes/qa/sv_1/5cc92dff-ab65-410c-b632-4df5dd09b865 2024-05-08T05:50:03.077 INFO:teuthology.orchestra.run.smithi082.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync,context="system_u:object_r:postgresql_db_t:s0",key=0,fsid=c739a5c8-0cfc-11ef-bc97-c7b262605968" will pass to kernel 2024-05-08T05:50:03.085 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-05-08T05:50:03.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T05:50:03.085 DEBUG:teuthology.orchestra.run.smithi082:> sudo chmod 1777 /tmp/cephfs 2024-05-08T05:50:03.169 DEBUG:teuthology.orchestra.run.smithi082:> (cd /tmp/cephfs && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-08T05:50:03.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-08T05:50:03.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T05:50:03.287 INFO:teuthology.orchestra.run.smithi082.stdout:client14997 2024-05-08T05:50:03.288 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-08T05:50:03.288 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T05:50:03.343 DEBUG:teuthology.orchestra.run.smithi082:> (cd /tmp/cephfs && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-08T05:50:03.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-08T05:50:03.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T05:50:03.457 INFO:teuthology.orchestra.run.smithi082.stdout:client14997 2024-05-08T05:50:03.457 DEBUG:teuthology.orchestra.run.smithi082:> (cd /tmp/cephfs && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-05-08T05:50:03.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-08T05:50:03.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T05:50:03.573 INFO:teuthology.orchestra.run.smithi082.stdout:client14997 2024-05-08T05:50:03.573 DEBUG:teuthology.orchestra.run.smithi082:> (cd /tmp/cephfs && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968.client14997/status') 2024-05-08T05:50:03.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:50:03 smithi151 ceph-mon[34815]: pgmap v441: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:50:03.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-08T05:50:03.699 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:50:03 smithi082 ceph-mon[30098]: pgmap v441: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:50:03.707 INFO:teuthology.orchestra.run.smithi082.stdout:instance: client.14997 (3)192.168.0.1:0/1401223522 2024-05-08T05:50:03.707 INFO:teuthology.orchestra.run.smithi082.stdout:blocklisted: false 2024-05-08T05:50:03.707 INFO:teuthology.orchestra.run.smithi082.stderr:0+1 records in 2024-05-08T05:50:03.707 INFO:teuthology.orchestra.run.smithi082.stderr:0+1 records out 2024-05-08T05:50:03.707 INFO:teuthology.orchestra.run.smithi082.stderr:70 bytes copied, 0.000100784 s, 695 kB/s 2024-05-08T05:50:03.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-08T05:50:03.720 INFO:teuthology.run_tasks:Running task exec... 2024-05-08T05:50:03.730 INFO:teuthology.task.exec:Executing custom commands... 2024-05-08T05:50:03.730 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi082.front.sepia.ceph.com 2024-05-08T05:50:03.730 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-05-08T05:50:03.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:50:03 smithi134 ceph-mon[34132]: pgmap v441: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-08T05:50:03.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:03.927+0000 7f2373e00640 1 -- 172.21.15.82:0/3618777137 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f237410ee20 msgr2=0x7f2374111210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:03.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:03.927+0000 7f2373e00640 1 --2- 172.21.15.82:0/3618777137 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f237410ee20 0x7f2374111210 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f236c009cd0 tx=0x7f236c02a8e0 comp rx=0 tx=0).stop 2024-05-08T05:50:03.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:03.927+0000 7f2373e00640 1 -- 172.21.15.82:0/3618777137 shutdown_connections 2024-05-08T05:50:03.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:03.927+0000 7f2373e00640 1 --2- 172.21.15.82:0/3618777137 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f237410ee20 0x7f2374111210 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:03.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:03.927+0000 7f2373e00640 1 --2- 172.21.15.82:0/3618777137 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2374075410 0x7f2374075890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:03.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:03.927+0000 7f2373e00640 1 --2- 172.21.15.82:0/3618777137 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23740769f0 0x7f2374074e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:03.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:03.927+0000 7f2373e00640 1 -- 172.21.15.82:0/3618777137 >> 172.21.15.82:0/3618777137 conn(0x7f23740fddc0 msgr2=0x7f2374100200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:50:03.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:03.927+0000 7f2373e00640 1 -- 172.21.15.82:0/3618777137 shutdown_connections 2024-05-08T05:50:03.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:03.927+0000 7f2373e00640 1 -- 172.21.15.82:0/3618777137 wait complete. 2024-05-08T05:50:03.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:03.928+0000 7f2373e00640 1 Processor -- start 2024-05-08T05:50:03.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:03.928+0000 7f2373e00640 1 -- start start 2024-05-08T05:50:03.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:03.928+0000 7f2373e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2374075410 0x7f237419f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:03.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:03.928+0000 7f2373e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23740769f0 0x7f237419f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:03.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:03.928+0000 7f2373e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f237410ee20 0x7f23741a6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:03.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:03.928+0000 7f2373e00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f23741149c0 con 0x7f23740769f0 2024-05-08T05:50:03.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:03.928+0000 7f2373e00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2374114840 con 0x7f2374075410 2024-05-08T05:50:03.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:03.928+0000 7f2373e00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2374114b40 con 0x7f237410ee20 2024-05-08T05:50:03.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:03.929+0000 7f236be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23740769f0 0x7f237419f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:03.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:03.929+0000 7f236be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23740769f0 0x7f237419f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53314/0 (socket says 172.21.15.82:53314) 2024-05-08T05:50:03.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:03.929+0000 7f236be00640 1 -- 172.21.15.82:0/2358582292 learned_addr learned my addr 172.21.15.82:0/2358582292 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:50:03.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:03.929+0000 7f2373400640 1 --2- 172.21.15.82:0/2358582292 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f237410ee20 0x7f23741a6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:03.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:03.929+0000 7f2372a00640 1 --2- 172.21.15.82:0/2358582292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2374075410 0x7f237419f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:03.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:03.929+0000 7f2373400640 1 -- 172.21.15.82:0/2358582292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2374075410 msgr2=0x7f237419f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:03.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:03.929+0000 7f2373400640 1 --2- 172.21.15.82:0/2358582292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2374075410 0x7f237419f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:03.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:03.929+0000 7f2373400640 1 -- 172.21.15.82:0/2358582292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23740769f0 msgr2=0x7f237419f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:03.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:03.929+0000 7f2373400640 1 --2- 172.21.15.82:0/2358582292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23740769f0 0x7f237419f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:03.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:03.929+0000 7f2373400640 1 -- 172.21.15.82:0/2358582292 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23741a6c70 con 0x7f237410ee20 2024-05-08T05:50:03.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:03.929+0000 7f236be00640 1 --2- 172.21.15.82:0/2358582292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23740769f0 0x7f237419f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:50:03.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:03.929+0000 7f2373400640 1 --2- 172.21.15.82:0/2358582292 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f237410ee20 0x7f23741a6600 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f236c02ae00 tx=0x7f236c003ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:50:03.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:03.930+0000 7f236b400640 1 -- 172.21.15.82:0/2358582292 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f236c004040 con 0x7f237410ee20 2024-05-08T05:50:03.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:03.930+0000 7f2373e00640 1 -- 172.21.15.82:0/2358582292 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23741a6f00 con 0x7f237410ee20 2024-05-08T05:50:03.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:03.930+0000 7f236b400640 1 -- 172.21.15.82:0/2358582292 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f236c004690 con 0x7f237410ee20 2024-05-08T05:50:03.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:03.930+0000 7f236b400640 1 -- 172.21.15.82:0/2358582292 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f236c030e40 con 0x7f237410ee20 2024-05-08T05:50:03.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:03.930+0000 7f2373e00640 1 -- 172.21.15.82:0/2358582292 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23741a7410 con 0x7f237410ee20 2024-05-08T05:50:03.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:03.931+0000 7f2373e00640 1 -- 172.21.15.82:0/2358582292 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2374104ff0 con 0x7f237410ee20 2024-05-08T05:50:03.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:03.933+0000 7f236b400640 1 -- 172.21.15.82:0/2358582292 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f236c0305a0 con 0x7f237410ee20 2024-05-08T05:50:03.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:03.935+0000 7f236b400640 1 --2- 172.21.15.82:0/2358582292 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f23580b27e0 0x7f23580b4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:03.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:03.935+0000 7f236b400640 1 -- 172.21.15.82:0/2358582292 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f236c02e030 con 0x7f237410ee20 2024-05-08T05:50:03.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:03.935+0000 7f2372a00640 1 --2- 172.21.15.82:0/2358582292 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f23580b27e0 0x7f23580b4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:03.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:03.936+0000 7f2372a00640 1 --2- 172.21.15.82:0/2358582292 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f23580b27e0 0x7f23580b4ca0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2364005d00 tx=0x7f236400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:50:03.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:03.938+0000 7f236b400640 1 -- 172.21.15.82:0/2358582292 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f236c0098b0 con 0x7f237410ee20 2024-05-08T05:50:04.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.189+0000 7f2373e00640 1 -- 172.21.15.82:0/2358582292 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7f237402db50 con 0x7f237410ee20 2024-05-08T05:50:04.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.352+0000 7f236b400640 1 -- 172.21.15.82:0/2358582292 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v29) ==== 118+0+0 (secure 0 0 0) 0x7f236c0caa10 con 0x7f237410ee20 2024-05-08T05:50:04.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.356+0000 7f2373e00640 1 -- 172.21.15.82:0/2358582292 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f23580b27e0 msgr2=0x7f23580b4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:04.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.356+0000 7f2373e00640 1 --2- 172.21.15.82:0/2358582292 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f23580b27e0 0x7f23580b4ca0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2364005d00 tx=0x7f236400b410 comp rx=0 tx=0).stop 2024-05-08T05:50:04.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.356+0000 7f2373e00640 1 -- 172.21.15.82:0/2358582292 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f237410ee20 msgr2=0x7f23741a6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:04.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.356+0000 7f2373e00640 1 --2- 172.21.15.82:0/2358582292 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f237410ee20 0x7f23741a6600 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f236c02ae00 tx=0x7f236c003ba0 comp rx=0 tx=0).stop 2024-05-08T05:50:04.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.356+0000 7f2373e00640 1 -- 172.21.15.82:0/2358582292 shutdown_connections 2024-05-08T05:50:04.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.356+0000 7f2373e00640 1 --2- 172.21.15.82:0/2358582292 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f23580b27e0 0x7f23580b4ca0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:04.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.356+0000 7f2373e00640 1 --2- 172.21.15.82:0/2358582292 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f237410ee20 0x7f23741a6600 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:04.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.356+0000 7f2373e00640 1 --2- 172.21.15.82:0/2358582292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f23740769f0 0x7f237419f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:04.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.356+0000 7f2373e00640 1 --2- 172.21.15.82:0/2358582292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2374075410 0x7f237419f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:04.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.356+0000 7f2373e00640 1 -- 172.21.15.82:0/2358582292 >> 172.21.15.82:0/2358582292 conn(0x7f23740fddc0 msgr2=0x7f23741021c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:50:04.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.356+0000 7f2373e00640 1 -- 172.21.15.82:0/2358582292 shutdown_connections 2024-05-08T05:50:04.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.356+0000 7f2373e00640 1 -- 172.21.15.82:0/2358582292 wait complete. 2024-05-08T05:50:04.379 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-05-08T05:50:04.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.588+0000 7efd8c200640 1 -- 172.21.15.82:0/2776408702 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd8410abf0 msgr2=0x7efd84111480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:04.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.588+0000 7efd8c200640 1 --2- 172.21.15.82:0/2776408702 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd8410abf0 0x7efd84111480 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efd7c009ca0 tx=0x7efd7c02a8c0 comp rx=0 tx=0).stop 2024-05-08T05:50:04.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.588+0000 7efd8c200640 1 -- 172.21.15.82:0/2776408702 shutdown_connections 2024-05-08T05:50:04.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.588+0000 7efd8c200640 1 --2- 172.21.15.82:0/2776408702 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd8410abf0 0x7efd84111480 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:04.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.588+0000 7efd8c200640 1 --2- 172.21.15.82:0/2776408702 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd8410a230 0x7efd8410a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:04.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.588+0000 7efd8c200640 1 --2- 172.21.15.82:0/2776408702 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd84109040 0x7efd84109460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:04.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.588+0000 7efd8c200640 1 -- 172.21.15.82:0/2776408702 >> 172.21.15.82:0/2776408702 conn(0x7efd84078000 msgr2=0x7efd8407a420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:50:04.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.588+0000 7efd8c200640 1 -- 172.21.15.82:0/2776408702 shutdown_connections 2024-05-08T05:50:04.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.588+0000 7efd8c200640 1 -- 172.21.15.82:0/2776408702 wait complete. 2024-05-08T05:50:04.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.589+0000 7efd8c200640 1 Processor -- start 2024-05-08T05:50:04.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.590+0000 7efd8c200640 1 -- start start 2024-05-08T05:50:04.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.590+0000 7efd8c200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd84109040 0x7efd8419f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:04.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.590+0000 7efd8c200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd8410a230 0x7efd8419f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:04.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.590+0000 7efd8c200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd8410abf0 0x7efd841a66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:04.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.590+0000 7efd8c200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efd84114bd0 con 0x7efd8410abf0 2024-05-08T05:50:04.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.590+0000 7efd8c200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7efd84114a50 con 0x7efd84109040 2024-05-08T05:50:04.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.590+0000 7efd8c200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7efd84114d50 con 0x7efd8410a230 2024-05-08T05:50:04.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.590+0000 7efd89800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd84109040 0x7efd8419f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:04.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.590+0000 7efd89800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd84109040 0x7efd8419f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:44666/0 (socket says 172.21.15.82:44666) 2024-05-08T05:50:04.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.590+0000 7efd89800640 1 -- 172.21.15.82:0/3190568345 learned_addr learned my addr 172.21.15.82:0/3190568345 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:50:04.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.590+0000 7efd8a200640 1 --2- 172.21.15.82:0/3190568345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd8410abf0 0x7efd841a66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:04.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.590+0000 7efd88e00640 1 --2- 172.21.15.82:0/3190568345 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd8410a230 0x7efd8419f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:04.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.591+0000 7efd89800640 1 -- 172.21.15.82:0/3190568345 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd8410a230 msgr2=0x7efd8419f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:04.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.591+0000 7efd89800640 1 --2- 172.21.15.82:0/3190568345 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd8410a230 0x7efd8419f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:04.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.591+0000 7efd89800640 1 -- 172.21.15.82:0/3190568345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd8410abf0 msgr2=0x7efd841a66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:04.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.591+0000 7efd89800640 1 --2- 172.21.15.82:0/3190568345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd8410abf0 0x7efd841a66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:04.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.591+0000 7efd89800640 1 -- 172.21.15.82:0/3190568345 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd841a6d60 con 0x7efd84109040 2024-05-08T05:50:04.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.591+0000 7efd89800640 1 --2- 172.21.15.82:0/3190568345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd84109040 0x7efd8419f140 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efd7800e9c0 tx=0x7efd7800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:50:04.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.591+0000 7efd82000640 1 -- 172.21.15.82:0/3190568345 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd7800cd80 con 0x7efd84109040 2024-05-08T05:50:04.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.591+0000 7efd82000640 1 -- 172.21.15.82:0/3190568345 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efd780035f0 con 0x7efd84109040 2024-05-08T05:50:04.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.591+0000 7efd82000640 1 -- 172.21.15.82:0/3190568345 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd78010690 con 0x7efd84109040 2024-05-08T05:50:04.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.591+0000 7efd8c200640 1 -- 172.21.15.82:0/3190568345 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd841a6ff0 con 0x7efd84109040 2024-05-08T05:50:04.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.591+0000 7efd8c200640 1 -- 172.21.15.82:0/3190568345 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd841a7460 con 0x7efd84109040 2024-05-08T05:50:04.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.593+0000 7efd8c200640 1 -- 172.21.15.82:0/3190568345 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd84110290 con 0x7efd84109040 2024-05-08T05:50:04.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.594+0000 7efd82000640 1 -- 172.21.15.82:0/3190568345 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7efd780037a0 con 0x7efd84109040 2024-05-08T05:50:04.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.596+0000 7efd82000640 1 --2- 172.21.15.82:0/3190568345 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7efd6c0b28a0 0x7efd6c0b4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:04.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.596+0000 7efd82000640 1 -- 172.21.15.82:0/3190568345 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7efd780e2640 con 0x7efd84109040 2024-05-08T05:50:04.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.596+0000 7efd88e00640 1 --2- 172.21.15.82:0/3190568345 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7efd6c0b28a0 0x7efd6c0b4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:04.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.597+0000 7efd88e00640 1 --2- 172.21.15.82:0/3190568345 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7efd6c0b28a0 0x7efd6c0b4d60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7efd841a0650 tx=0x7efd74005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:50:04.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.600+0000 7efd82000640 1 -- 172.21.15.82:0/3190568345 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7efd780aa310 con 0x7efd84109040 2024-05-08T05:50:04.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:50:04 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/2358582292' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-05-08T05:50:04.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:50:04 smithi151 ceph-mon[34815]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-05-08T05:50:04.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:50:04 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/2358582292' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-05-08T05:50:04.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:50:04 smithi082 ceph-mon[30098]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-05-08T05:50:04.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:50:04 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/2358582292' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-05-08T05:50:04.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:50:04 smithi134 ceph-mon[34132]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-05-08T05:50:04.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.837+0000 7efd8c200640 1 -- 172.21.15.82:0/3190568345 --> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7efd84062e90 con 0x7efd6c0b28a0 2024-05-08T05:50:04.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.867+0000 7efd82000640 1 -- 172.21.15.82:0/3190568345 <== mgr.14152 v2:172.21.15.82:6800/4089180091 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7efd84062e90 con 0x7efd6c0b28a0 2024-05-08T05:50:04.868 INFO:teuthology.orchestra.run.smithi082.stdout:{} 2024-05-08T05:50:04.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.870+0000 7efd8c200640 1 -- 172.21.15.82:0/3190568345 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7efd6c0b28a0 msgr2=0x7efd6c0b4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:04.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.870+0000 7efd8c200640 1 --2- 172.21.15.82:0/3190568345 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7efd6c0b28a0 0x7efd6c0b4d60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7efd841a0650 tx=0x7efd74005f90 comp rx=0 tx=0).stop 2024-05-08T05:50:04.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.870+0000 7efd8c200640 1 -- 172.21.15.82:0/3190568345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd84109040 msgr2=0x7efd8419f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:04.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.870+0000 7efd8c200640 1 --2- 172.21.15.82:0/3190568345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd84109040 0x7efd8419f140 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7efd7800e9c0 tx=0x7efd7800ee80 comp rx=0 tx=0).stop 2024-05-08T05:50:04.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.870+0000 7efd8c200640 1 -- 172.21.15.82:0/3190568345 shutdown_connections 2024-05-08T05:50:04.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.870+0000 7efd8c200640 1 --2- 172.21.15.82:0/3190568345 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7efd6c0b28a0 0x7efd6c0b4d60 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:04.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.870+0000 7efd8c200640 1 --2- 172.21.15.82:0/3190568345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efd8410abf0 0x7efd841a66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:04.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.870+0000 7efd8c200640 1 --2- 172.21.15.82:0/3190568345 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd8410a230 0x7efd8419f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:04.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.870+0000 7efd8c200640 1 --2- 172.21.15.82:0/3190568345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd84109040 0x7efd8419f140 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:04.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.870+0000 7efd8c200640 1 -- 172.21.15.82:0/3190568345 >> 172.21.15.82:0/3190568345 conn(0x7efd84078000 msgr2=0x7efd8410d460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:50:04.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.870+0000 7efd8c200640 1 -- 172.21.15.82:0/3190568345 shutdown_connections 2024-05-08T05:50:04.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:04.870+0000 7efd8c200640 1 -- 172.21.15.82:0/3190568345 wait complete. 2024-05-08T05:50:04.890 INFO:teuthology.run_tasks:Running task check-counter... 2024-05-08T05:50:04.900 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-05-08T05:50:04.912 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T05:50:05.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.111+0000 7f618da00640 1 -- 172.21.15.82:0/3238984960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6188104a30 msgr2=0x7f6188104e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:05.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.111+0000 7f618da00640 1 --2- 172.21.15.82:0/3238984960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6188104a30 0x7f6188104e50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6178009900 tx=0x7f617802a3f0 comp rx=0 tx=0).stop 2024-05-08T05:50:05.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.112+0000 7f618da00640 1 -- 172.21.15.82:0/3238984960 shutdown_connections 2024-05-08T05:50:05.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.112+0000 7f618da00640 1 --2- 172.21.15.82:0/3238984960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61881065e0 0x7f618810ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:05.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.112+0000 7f618da00640 1 --2- 172.21.15.82:0/3238984960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6188105c20 0x7f61881060a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:05.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.112+0000 7f618da00640 1 --2- 172.21.15.82:0/3238984960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6188104a30 0x7f6188104e50 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:05.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.112+0000 7f618da00640 1 -- 172.21.15.82:0/3238984960 >> 172.21.15.82:0/3238984960 conn(0x7f61880fffc0 msgr2=0x7f61881023e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:50:05.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.112+0000 7f618da00640 1 -- 172.21.15.82:0/3238984960 shutdown_connections 2024-05-08T05:50:05.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.112+0000 7f618da00640 1 -- 172.21.15.82:0/3238984960 wait complete. 2024-05-08T05:50:05.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.113+0000 7f618da00640 1 Processor -- start 2024-05-08T05:50:05.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.113+0000 7f618da00640 1 -- start start 2024-05-08T05:50:05.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.114+0000 7f618da00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6188104a30 0x7f618819ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:05.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.114+0000 7f618da00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6188105c20 0x7f618819b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:05.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.114+0000 7f618da00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61881065e0 0x7f61881a2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:05.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.114+0000 7f618da00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f61881105b0 con 0x7f6188104a30 2024-05-08T05:50:05.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.114+0000 7f618da00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6188110430 con 0x7f6188105c20 2024-05-08T05:50:05.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.114+0000 7f618da00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6188110730 con 0x7f61881065e0 2024-05-08T05:50:05.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.114+0000 7f6187400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6188105c20 0x7f618819b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:05.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.114+0000 7f6187400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6188105c20 0x7f618819b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:44714/0 (socket says 172.21.15.82:44714) 2024-05-08T05:50:05.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.114+0000 7f6187400640 1 -- 172.21.15.82:0/2187965539 learned_addr learned my addr 172.21.15.82:0/2187965539 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:50:05.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.114+0000 7f6187e00640 1 --2- 172.21.15.82:0/2187965539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6188104a30 0x7f618819ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:05.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.114+0000 7f618d000640 1 --2- 172.21.15.82:0/2187965539 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61881065e0 0x7f61881a2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:05.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.114+0000 7f6187400640 1 -- 172.21.15.82:0/2187965539 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61881065e0 msgr2=0x7f61881a2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:05.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.114+0000 7f6187400640 1 --2- 172.21.15.82:0/2187965539 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61881065e0 0x7f61881a2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:05.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.114+0000 7f6187400640 1 -- 172.21.15.82:0/2187965539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6188104a30 msgr2=0x7f618819ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:05.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.114+0000 7f6187400640 1 --2- 172.21.15.82:0/2187965539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6188104a30 0x7f618819ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:05.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.114+0000 7f6187400640 1 -- 172.21.15.82:0/2187965539 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61881a28c0 con 0x7f6188105c20 2024-05-08T05:50:05.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.114+0000 7f618d000640 1 --2- 172.21.15.82:0/2187965539 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61881065e0 0x7f61881a2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:50:05.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.115+0000 7f6187400640 1 --2- 172.21.15.82:0/2187965539 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6188105c20 0x7f618819b1c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f617000ea60 tx=0x7f617000ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:50:05.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.115+0000 7f6184c00640 1 -- 172.21.15.82:0/2187965539 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f617000cde0 con 0x7f6188105c20 2024-05-08T05:50:05.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.115+0000 7f6184c00640 1 -- 172.21.15.82:0/2187965539 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f61700035f0 con 0x7f6188105c20 2024-05-08T05:50:05.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.115+0000 7f6184c00640 1 -- 172.21.15.82:0/2187965539 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6170010690 con 0x7f6188105c20 2024-05-08T05:50:05.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.115+0000 7f618da00640 1 -- 172.21.15.82:0/2187965539 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61881a2bb0 con 0x7f6188105c20 2024-05-08T05:50:05.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.115+0000 7f618da00640 1 -- 172.21.15.82:0/2187965539 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61881a3080 con 0x7f6188105c20 2024-05-08T05:50:05.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.116+0000 7f618da00640 1 -- 172.21.15.82:0/2187965539 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f618810bdd0 con 0x7f6188105c20 2024-05-08T05:50:05.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.118+0000 7f6184c00640 1 -- 172.21.15.82:0/2187965539 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f61700037a0 con 0x7f6188105c20 2024-05-08T05:50:05.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.120+0000 7f6184c00640 1 --2- 172.21.15.82:0/2187965539 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f616c0b27f0 0x7f616c0b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:05.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.120+0000 7f6184c00640 1 -- 172.21.15.82:0/2187965539 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f61700e25a0 con 0x7f6188105c20 2024-05-08T05:50:05.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.120+0000 7f6187e00640 1 --2- 172.21.15.82:0/2187965539 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f616c0b27f0 0x7f616c0b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:05.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.121+0000 7f6187e00640 1 --2- 172.21.15.82:0/2187965539 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f616c0b27f0 0x7f616c0b4cb0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6178005ab0 tx=0x7f6178005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:50:05.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.124+0000 7f6184c00640 1 -- 172.21.15.82:0/2187965539 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f61700aa270 con 0x7f6188105c20 2024-05-08T05:50:05.221 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:50:04 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:50:04.846+0000 7f6e23000700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T05:50:05.221 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:50:04 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:50:04.846+0000 7f6e23000700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T05:50:05.221 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:50:04 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:50:04.846+0000 7f6e23000700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T05:50:05.221 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:50:04 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:50:04.846+0000 7f6e23000700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T05:50:05.221 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 05:50:04 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T05:50:04.846+0000 7f6e23000700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-08T05:50:05.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.338+0000 7f618da00640 1 -- 172.21.15.82:0/2187965539 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6188063650 con 0x7f6188105c20 2024-05-08T05:50:05.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.340+0000 7f6184c00640 1 -- 172.21.15.82:0/2187965539 <== mon.2 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22631 (secure 0 0 0) 0x7f61700a9b70 con 0x7f6188105c20 2024-05-08T05:50:05.341 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:50:05.341 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":82,"fsid":"c739a5c8-0cfc-11ef-bc97-c7b262605968","created":"2024-05-08T05:36:37.441393+0000","modified":"2024-05-08T05:46:45.754375+0000","last_up_change":"2024-05-08T05:44:40.677995+0000","last_in_change":"2024-05-08T05:44:20.654220+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T05:40:28.102836+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T05:45:48.727521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T05:45:53.574048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bc9bd472-b765-4893-84ed-c66b5c1c61b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":4051651615},{"type":"v1","addr":"172.21.15.82:6803","nonce":4051651615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":4051651615},{"type":"v1","addr":"172.21.15.82:6805","nonce":4051651615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4051651615},{"type":"v1","addr":"172.21.15.82:6809","nonce":4051651615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":4051651615},{"type":"v1","addr":"172.21.15.82:6807","nonce":4051651615}]},"public_addr":"172.21.15.82:6803/4051651615","cluster_addr":"172.21.15.82:6805/4051651615","heartbeat_back_addr":"172.21.15.82:6809/4051651615","heartbeat_front_addr":"172.21.15.82:6807/4051651615","state":["exists","up"]},{"osd":1,"uuid":"ad2d3a6b-8bc5-4177-8757-07e8607ca240","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":2763858634},{"type":"v1","addr":"172.21.15.134:6801","nonce":2763858634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":2763858634},{"type":"v1","addr":"172.21.15.134:6803","nonce":2763858634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":2763858634},{"type":"v1","addr":"172.21.15.134:6807","nonce":2763858634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2763858634},{"type":"v1","addr":"172.21.15.134:6805","nonce":2763858634}]},"public_addr":"172.21.15.134:6801/2763858634","cluster_addr":"172.21.15.134:6803/2763858634","heartbeat_back_addr":"172.21.15.134:6807/2763858634","heartbeat_front_addr":"172.21.15.134:6805/2763858634","state":["exists","up"]},{"osd":2,"uuid":"a06dc8fc-7324-4e42-9487-8cfe372401b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":4193933269},{"type":"v1","addr":"172.21.15.151:6801","nonce":4193933269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":4193933269},{"type":"v1","addr":"172.21.15.151:6803","nonce":4193933269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":4193933269},{"type":"v1","addr":"172.21.15.151:6807","nonce":4193933269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":4193933269},{"type":"v1","addr":"172.21.15.151:6805","nonce":4193933269}]},"public_addr":"172.21.15.151:6801/4193933269","cluster_addr":"172.21.15.151:6803/4193933269","heartbeat_back_addr":"172.21.15.151:6807/4193933269","heartbeat_front_addr":"172.21.15.151:6805/4193933269","state":["exists","up"]},{"osd":3,"uuid":"b8c8bdcd-fbd7-4494-976e-7285408e010e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":2775272422},{"type":"v1","addr":"172.21.15.82:6811","nonce":2775272422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":2775272422},{"type":"v1","addr":"172.21.15.82:6813","nonce":2775272422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":2775272422},{"type":"v1","addr":"172.21.15.82:6817","nonce":2775272422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":2775272422},{"type":"v1","addr":"172.21.15.82:6815","nonce":2775272422}]},"public_addr":"172.21.15.82:6811/2775272422","cluster_addr":"172.21.15.82:6813/2775272422","heartbeat_back_addr":"172.21.15.82:6817/2775272422","heartbeat_front_addr":"172.21.15.82:6815/2775272422","state":["exists","up"]},{"osd":4,"uuid":"391a6040-03d1-483c-9058-308b5998e7c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3565208751},{"type":"v1","addr":"172.21.15.134:6809","nonce":3565208751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3565208751},{"type":"v1","addr":"172.21.15.134:6811","nonce":3565208751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3565208751},{"type":"v1","addr":"172.21.15.134:6815","nonce":3565208751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3565208751},{"type":"v1","addr":"172.21.15.134:6813","nonce":3565208751}]},"public_addr":"172.21.15.134:6809/3565208751","cluster_addr":"172.21.15.134:6811/3565208751","heartbeat_back_addr":"172.21.15.134:6815/3565208751","heartbeat_front_addr":"172.21.15.134:6813/3565208751","state":["exists","up"]},{"osd":5,"uuid":"dacce079-4aad-474e-b747-1ed60c3c71cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":1925634069},{"type":"v1","addr":"172.21.15.151:6809","nonce":1925634069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":1925634069},{"type":"v1","addr":"172.21.15.151:6811","nonce":1925634069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1925634069},{"type":"v1","addr":"172.21.15.151:6815","nonce":1925634069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1925634069},{"type":"v1","addr":"172.21.15.151:6813","nonce":1925634069}]},"public_addr":"172.21.15.151:6809/1925634069","cluster_addr":"172.21.15.151:6811/1925634069","heartbeat_back_addr":"172.21.15.151:6815/1925634069","heartbeat_front_addr":"172.21.15.151:6813/1925634069","state":["exists","up"]},{"osd":6,"uuid":"6a445bf4-09c4-4e9b-be6e-68ef3c05b365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":762647976},{"type":"v1","addr":"172.21.15.82:6819","nonce":762647976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":762647976},{"type":"v1","addr":"172.21.15.82:6821","nonce":762647976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":762647976},{"type":"v1","addr":"172.21.15.82:6825","nonce":762647976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":762647976},{"type":"v1","addr":"172.21.15.82:6823","nonce":762647976}]},"public_addr":"172.21.15.82:6819/762647976","cluster_addr":"172.21.15.82:6821/762647976","heartbeat_back_addr":"172.21.15.82:6825/762647976","heartbeat_front_addr":"172.21.15.82:6823/762647976","state":["exists","up"]},{"osd":7,"uuid":"72b0c735-ef30-4823-8ab8-2e5bf7cc3c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3006846927},{"type":"v1","addr":"172.21.15.134:6817","nonce":3006846927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3006846927},{"type":"v1","addr":"172.21.15.134:6819","nonce":3006846927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3006846927},{"type":"v1","addr":"172.21.15.134:6823","nonce":3006846927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3006846927},{"type":"v1","addr":"172.21.15.134:6821","nonce":3006846927}]},"public_addr":"172.21.15.134:6817/3006846927","cluster_addr":"172.21.15.134:6819/3006846927","heartbeat_back_addr":"172.21.15.134:6823/3006846927","heartbeat_front_addr":"172.21.15.134:6821/3006846927","state":["exists","up"]},{"osd":8,"uuid":"93e4da0f-48ea-4ab7-b612-26b545b76de6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":787870717},{"type":"v1","addr":"172.21.15.151:6817","nonce":787870717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":787870717},{"type":"v1","addr":"172.21.15.151:6819","nonce":787870717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":787870717},{"type":"v1","addr":"172.21.15.151:6823","nonce":787870717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":787870717},{"type":"v1","addr":"172.21.15.151:6821","nonce":787870717}]},"public_addr":"172.21.15.151:6817/787870717","cluster_addr":"172.21.15.151:6819/787870717","heartbeat_back_addr":"172.21.15.151:6823/787870717","heartbeat_front_addr":"172.21.15.151:6821/787870717","state":["exists","up"]},{"osd":9,"uuid":"ea0070c1-286a-47d3-90cf-d1fada6e3cda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":533124002},{"type":"v1","addr":"172.21.15.82:6827","nonce":533124002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":533124002},{"type":"v1","addr":"172.21.15.82:6829","nonce":533124002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":533124002},{"type":"v1","addr":"172.21.15.82:6833","nonce":533124002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":533124002},{"type":"v1","addr":"172.21.15.82:6831","nonce":533124002}]},"public_addr":"172.21.15.82:6827/533124002","cluster_addr":"172.21.15.82:6829/533124002","heartbeat_back_addr":"172.21.15.82:6833/533124002","heartbeat_front_addr":"172.21.15.82:6831/533124002","state":["exists","up"]},{"osd":10,"uuid":"26ca0a0b-ab9e-472f-bb29-428e8c31e5bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":99154842},{"type":"v1","addr":"172.21.15.134:6825","nonce":99154842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":99154842},{"type":"v1","addr":"172.21.15.134:6827","nonce":99154842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":99154842},{"type":"v1","addr":"172.21.15.134:6831","nonce":99154842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":99154842},{"type":"v1","addr":"172.21.15.134:6829","nonce":99154842}]},"public_addr":"172.21.15.134:6825/99154842","cluster_addr":"172.21.15.134:6827/99154842","heartbeat_back_addr":"172.21.15.134:6831/99154842","heartbeat_front_addr":"172.21.15.134:6829/99154842","state":["exists","up"]},{"osd":11,"uuid":"9ae5dca4-acfb-4a46-8601-9d642efde794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2242771269},{"type":"v1","addr":"172.21.15.151:6825","nonce":2242771269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2242771269},{"type":"v1","addr":"172.21.15.151:6827","nonce":2242771269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2242771269},{"type":"v1","addr":"172.21.15.151:6831","nonce":2242771269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2242771269},{"type":"v1","addr":"172.21.15.151:6829","nonce":2242771269}]},"public_addr":"172.21.15.151:6825/2242771269","cluster_addr":"172.21.15.151:6827/2242771269","heartbeat_back_addr":"172.21.15.151:6831/2242771269","heartbeat_front_addr":"172.21.15.151:6829/2242771269","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:39:35.575525+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:40:00.672367+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:40:24.558682+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:40:56.791194+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:41:23.031785+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:41:47.926448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:42:21.231894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:42:47.599982+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:43:12.950581+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:43:46.333027+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:44:13.457489+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:44:38.637273+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/2761274596":"2024-05-09T05:37:43.951218+0000","172.21.15.82:0/2195734928":"2024-05-09T05:37:43.951218+0000","172.21.15.82:6801/765895649":"2024-05-09T05:37:43.951218+0000","172.21.15.82:6800/3546670887":"2024-05-09T05:37:11.114057+0000","172.21.15.82:6800/765895649":"2024-05-09T05:37:43.951218+0000","172.21.15.82:0/3986150437":"2024-05-09T05:37:11.114057+0000","172.21.15.82:0/3457457714":"2024-05-09T05:37:11.114057+0000","172.21.15.82:0/2356749286":"2024-05-09T05:37:11.114057+0000","172.21.15.82:6801/3546670887":"2024-05-09T05:37:11.114057+0000","172.21.15.82:0/1694643083":"2024-05-09T05:37:43.951218+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T05:50:05.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.343+0000 7f618da00640 1 -- 172.21.15.82:0/2187965539 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f616c0b27f0 msgr2=0x7f616c0b4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:05.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.343+0000 7f618da00640 1 --2- 172.21.15.82:0/2187965539 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f616c0b27f0 0x7f616c0b4cb0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6178005ab0 tx=0x7f6178005a20 comp rx=0 tx=0).stop 2024-05-08T05:50:05.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.343+0000 7f618da00640 1 -- 172.21.15.82:0/2187965539 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6188105c20 msgr2=0x7f618819b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:05.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.343+0000 7f618da00640 1 --2- 172.21.15.82:0/2187965539 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6188105c20 0x7f618819b1c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f617000ea60 tx=0x7f617000ef20 comp rx=0 tx=0).stop 2024-05-08T05:50:05.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.343+0000 7f618da00640 1 -- 172.21.15.82:0/2187965539 shutdown_connections 2024-05-08T05:50:05.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.343+0000 7f618da00640 1 --2- 172.21.15.82:0/2187965539 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f616c0b27f0 0x7f616c0b4cb0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:05.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.343+0000 7f618da00640 1 --2- 172.21.15.82:0/2187965539 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6188105c20 0x7f618819b1c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:05.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.343+0000 7f618da00640 1 --2- 172.21.15.82:0/2187965539 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61881065e0 0x7f61881a2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:05.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.343+0000 7f618da00640 1 --2- 172.21.15.82:0/2187965539 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6188104a30 0x7f618819ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:05.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.343+0000 7f618da00640 1 -- 172.21.15.82:0/2187965539 >> 172.21.15.82:0/2187965539 conn(0x7f61880fffc0 msgr2=0x7f6188108fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:50:05.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.343+0000 7f618da00640 1 -- 172.21.15.82:0/2187965539 shutdown_connections 2024-05-08T05:50:05.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.343+0000 7f618da00640 1 -- 172.21.15.82:0/2187965539 wait complete. 2024-05-08T05:50:05.364 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T05:40:28.102836+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T05:45:48.727521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T05:45:53.574048+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T05:50:05.364 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T05:50:05.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.574+0000 7f2f60a00640 1 -- 172.21.15.82:0/3747212442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f5c104470 msgr2=0x7f2f5c10ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:05.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.574+0000 7f2f60a00640 1 --2- 172.21.15.82:0/3747212442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f5c104470 0x7f2f5c10ad00 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2f54009ca0 tx=0x7f2f5402a8c0 comp rx=0 tx=0).stop 2024-05-08T05:50:05.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.575+0000 7f2f60a00640 1 -- 172.21.15.82:0/3747212442 shutdown_connections 2024-05-08T05:50:05.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.575+0000 7f2f60a00640 1 --2- 172.21.15.82:0/3747212442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f5c104470 0x7f2f5c10ad00 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:05.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.575+0000 7f2f60a00640 1 --2- 172.21.15.82:0/3747212442 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f5c103ab0 0x7f2f5c103f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:05.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.575+0000 7f2f60a00640 1 --2- 172.21.15.82:0/3747212442 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f5c1028c0 0x7f2f5c102ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:05.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.575+0000 7f2f60a00640 1 -- 172.21.15.82:0/3747212442 >> 172.21.15.82:0/3747212442 conn(0x7f2f5c0fde50 msgr2=0x7f2f5c100270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:50:05.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.575+0000 7f2f60a00640 1 -- 172.21.15.82:0/3747212442 shutdown_connections 2024-05-08T05:50:05.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.575+0000 7f2f60a00640 1 -- 172.21.15.82:0/3747212442 wait complete. 2024-05-08T05:50:05.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.576+0000 7f2f60a00640 1 Processor -- start 2024-05-08T05:50:05.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.576+0000 7f2f60a00640 1 -- start start 2024-05-08T05:50:05.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.576+0000 7f2f60a00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f5c1028c0 0x7f2f5c19aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:05.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.576+0000 7f2f60a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f5c103ab0 0x7f2f5c19b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:05.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.576+0000 7f2f60a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f5c104470 0x7f2f5c1a2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:05.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.576+0000 7f2f60a00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5c10e3f0 con 0x7f2f5c104470 2024-05-08T05:50:05.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.576+0000 7f2f60a00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5c10e270 con 0x7f2f5c103ab0 2024-05-08T05:50:05.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.576+0000 7f2f60a00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2f5c10e570 con 0x7f2f5c1028c0 2024-05-08T05:50:05.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.576+0000 7f2f52a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f5c103ab0 0x7f2f5c19b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:05.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.576+0000 7f2f5be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f5c104470 0x7f2f5c1a2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:05.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.576+0000 7f2f52a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f5c103ab0 0x7f2f5c19b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:44734/0 (socket says 172.21.15.82:44734) 2024-05-08T05:50:05.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.576+0000 7f2f52a00640 1 -- 172.21.15.82:0/508024687 learned_addr learned my addr 172.21.15.82:0/508024687 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:50:05.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.576+0000 7f2f5b400640 1 --2- 172.21.15.82:0/508024687 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f5c1028c0 0x7f2f5c19aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:05.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.577+0000 7f2f52a00640 1 -- 172.21.15.82:0/508024687 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f5c1028c0 msgr2=0x7f2f5c19aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:05.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.577+0000 7f2f52a00640 1 --2- 172.21.15.82:0/508024687 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f5c1028c0 0x7f2f5c19aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:05.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.577+0000 7f2f52a00640 1 -- 172.21.15.82:0/508024687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f5c104470 msgr2=0x7f2f5c1a2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:05.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.577+0000 7f2f52a00640 1 --2- 172.21.15.82:0/508024687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f5c104470 0x7f2f5c1a2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:05.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.577+0000 7f2f52a00640 1 -- 172.21.15.82:0/508024687 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f5c1a28e0 con 0x7f2f5c103ab0 2024-05-08T05:50:05.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.577+0000 7f2f5b400640 1 --2- 172.21.15.82:0/508024687 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f5c1028c0 0x7f2f5c19aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:50:05.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.577+0000 7f2f52a00640 1 --2- 172.21.15.82:0/508024687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f5c103ab0 0x7f2f5c19b1e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2f4400e9f0 tx=0x7f2f4400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:50:05.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.577+0000 7f2f58c00640 1 -- 172.21.15.82:0/508024687 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f4400cd80 con 0x7f2f5c103ab0 2024-05-08T05:50:05.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.577+0000 7f2f60a00640 1 -- 172.21.15.82:0/508024687 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f5c1a2bd0 con 0x7f2f5c103ab0 2024-05-08T05:50:05.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.577+0000 7f2f58c00640 1 -- 172.21.15.82:0/508024687 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2f440054d0 con 0x7f2f5c103ab0 2024-05-08T05:50:05.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.577+0000 7f2f58c00640 1 -- 172.21.15.82:0/508024687 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f44010690 con 0x7f2f5c103ab0 2024-05-08T05:50:05.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.577+0000 7f2f60a00640 1 -- 172.21.15.82:0/508024687 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f5c1a30d0 con 0x7f2f5c103ab0 2024-05-08T05:50:05.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.578+0000 7f2f60a00640 1 -- 172.21.15.82:0/508024687 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f5c1a3300 con 0x7f2f5c103ab0 2024-05-08T05:50:05.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.581+0000 7f2f58c00640 1 -- 172.21.15.82:0/508024687 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f2f44004e90 con 0x7f2f5c103ab0 2024-05-08T05:50:05.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.582+0000 7f2f58c00640 1 --2- 172.21.15.82:0/508024687 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2f3c0b27f0 0x7f2f3c0b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:05.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.582+0000 7f2f58c00640 1 -- 172.21.15.82:0/508024687 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2f440e2700 con 0x7f2f5c103ab0 2024-05-08T05:50:05.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.582+0000 7f2f5b400640 1 --2- 172.21.15.82:0/508024687 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2f3c0b27f0 0x7f2f3c0b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:05.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.583+0000 7f2f5b400640 1 --2- 172.21.15.82:0/508024687 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2f3c0b27f0 0x7f2f3c0b4cb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c19bb70 tx=0x7f2f4c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:50:05.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.586+0000 7f2f58c00640 1 -- 172.21.15.82:0/508024687 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2f440aa3d0 con 0x7f2f5c103ab0 2024-05-08T05:50:05.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:50:05 smithi151 ceph-mon[34815]: pgmap v442: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 9 op/s 2024-05-08T05:50:05.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:50:05 smithi151 ceph-mon[34815]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-05-08T05:50:05.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:50:05 smithi151 ceph-mon[34815]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-08T05:50:05.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:50:05 smithi151 ceph-mon[34815]: from='client.25097 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:50:05.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:50:05 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/2187965539' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:50:05.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:50:05 smithi082 ceph-mon[30098]: pgmap v442: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 9 op/s 2024-05-08T05:50:05.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:50:05 smithi082 ceph-mon[30098]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-05-08T05:50:05.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:50:05 smithi082 ceph-mon[30098]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-08T05:50:05.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:50:05 smithi082 ceph-mon[30098]: from='client.25097 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:50:05.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:50:05 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/2187965539' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:50:05.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:50:05 smithi134 ceph-mon[34132]: pgmap v442: 97 pgs: 97 active+clean; 648 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 85 B/s wr, 9 op/s 2024-05-08T05:50:05.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:50:05 smithi134 ceph-mon[34132]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-05-08T05:50:05.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:50:05 smithi134 ceph-mon[34132]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-08T05:50:05.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:50:05 smithi134 ceph-mon[34132]: from='client.25097 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-05-08T05:50:05.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:50:05 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/2187965539' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:50:05.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.794+0000 7f2f60a00640 1 -- 172.21.15.82:0/508024687 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2f5c1a34d0 con 0x7f2f5c103ab0 2024-05-08T05:50:05.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.795+0000 7f2f58c00640 1 -- 172.21.15.82:0/508024687 <== mon.2 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) ==== 93+0+10 (secure 0 0 0) 0x7f2f440a9cd0 con 0x7f2f5c103ab0 2024-05-08T05:50:05.795 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-05-08T05:50:05.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.797+0000 7f2f60a00640 1 -- 172.21.15.82:0/508024687 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2f3c0b27f0 msgr2=0x7f2f3c0b4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:05.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.797+0000 7f2f60a00640 1 --2- 172.21.15.82:0/508024687 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2f3c0b27f0 0x7f2f3c0b4cb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c19bb70 tx=0x7f2f4c005f90 comp rx=0 tx=0).stop 2024-05-08T05:50:05.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.797+0000 7f2f60a00640 1 -- 172.21.15.82:0/508024687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f5c103ab0 msgr2=0x7f2f5c19b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:05.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.797+0000 7f2f60a00640 1 --2- 172.21.15.82:0/508024687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f5c103ab0 0x7f2f5c19b1e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2f4400e9f0 tx=0x7f2f4400edf0 comp rx=0 tx=0).stop 2024-05-08T05:50:05.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.797+0000 7f2f60a00640 1 -- 172.21.15.82:0/508024687 shutdown_connections 2024-05-08T05:50:05.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.797+0000 7f2f60a00640 1 --2- 172.21.15.82:0/508024687 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2f3c0b27f0 0x7f2f3c0b4cb0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:05.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.797+0000 7f2f60a00640 1 --2- 172.21.15.82:0/508024687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f5c103ab0 0x7f2f5c19b1e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:05.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.797+0000 7f2f60a00640 1 --2- 172.21.15.82:0/508024687 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2f5c104470 0x7f2f5c1a2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:05.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.797+0000 7f2f60a00640 1 --2- 172.21.15.82:0/508024687 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2f5c1028c0 0x7f2f5c19aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:05.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.797+0000 7f2f60a00640 1 -- 172.21.15.82:0/508024687 >> 172.21.15.82:0/508024687 conn(0x7f2f5c0fde50 msgr2=0x7f2f5c074be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:50:05.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.798+0000 7f2f60a00640 1 -- 172.21.15.82:0/508024687 shutdown_connections 2024-05-08T05:50:05.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:05.798+0000 7f2f60a00640 1 -- 172.21.15.82:0/508024687 wait complete. 2024-05-08T05:50:05.817 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T05:50:06.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.020+0000 7fa795000640 1 -- 172.21.15.82:0/175789470 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa790108ea0 msgr2=0x7fa7901092c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:06.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.020+0000 7fa795000640 1 --2- 172.21.15.82:0/175789470 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa790108ea0 0x7fa7901092c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa780009900 tx=0x7fa78002a400 comp rx=0 tx=0).stop 2024-05-08T05:50:06.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.020+0000 7fa795000640 1 -- 172.21.15.82:0/175789470 shutdown_connections 2024-05-08T05:50:06.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.020+0000 7fa795000640 1 --2- 172.21.15.82:0/175789470 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa79010aa40 0x7fa790111360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:06.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.020+0000 7fa795000640 1 --2- 172.21.15.82:0/175789470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa79010a080 0x7fa79010a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:06.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.020+0000 7fa795000640 1 --2- 172.21.15.82:0/175789470 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa790108ea0 0x7fa7901092c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:06.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.020+0000 7fa795000640 1 -- 172.21.15.82:0/175789470 >> 172.21.15.82:0/175789470 conn(0x7fa790077e80 msgr2=0x7fa79007a2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:50:06.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.020+0000 7fa795000640 1 -- 172.21.15.82:0/175789470 shutdown_connections 2024-05-08T05:50:06.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.020+0000 7fa795000640 1 -- 172.21.15.82:0/175789470 wait complete. 2024-05-08T05:50:06.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.021+0000 7fa795000640 1 Processor -- start 2024-05-08T05:50:06.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.021+0000 7fa795000640 1 -- start start 2024-05-08T05:50:06.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.021+0000 7fa795000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa790108ea0 0x7fa79019f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:06.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.022+0000 7fa795000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa79010a080 0x7fa79019f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:06.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.022+0000 7fa795000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa79010aa40 0x7fa7901a66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:06.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.022+0000 7fa795000640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa790114a70 con 0x7fa79010a080 2024-05-08T05:50:06.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.022+0000 7fa795000640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa7901148f0 con 0x7fa79010aa40 2024-05-08T05:50:06.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.022+0000 7fa795000640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa790114bf0 con 0x7fa790108ea0 2024-05-08T05:50:06.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.022+0000 7fa787e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa79010a080 0x7fa79019f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:06.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.022+0000 7fa78f400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa790108ea0 0x7fa79019f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:06.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.022+0000 7fa78f400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa790108ea0 0x7fa79019f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:49472/0 (socket says 172.21.15.82:49472) 2024-05-08T05:50:06.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.022+0000 7fa78f400640 1 -- 172.21.15.82:0/3509446164 learned_addr learned my addr 172.21.15.82:0/3509446164 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:50:06.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.022+0000 7fa78fe00640 1 --2- 172.21.15.82:0/3509446164 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa79010aa40 0x7fa7901a66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:06.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.022+0000 7fa787e00640 1 -- 172.21.15.82:0/3509446164 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa790108ea0 msgr2=0x7fa79019f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:06.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.022+0000 7fa787e00640 1 --2- 172.21.15.82:0/3509446164 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa790108ea0 0x7fa79019f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:06.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.022+0000 7fa787e00640 1 -- 172.21.15.82:0/3509446164 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa79010aa40 msgr2=0x7fa7901a66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:06.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.022+0000 7fa787e00640 1 --2- 172.21.15.82:0/3509446164 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa79010aa40 0x7fa7901a66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:06.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.022+0000 7fa787e00640 1 -- 172.21.15.82:0/3509446164 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7901a6d50 con 0x7fa79010a080 2024-05-08T05:50:06.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.023+0000 7fa787e00640 1 --2- 172.21.15.82:0/3509446164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa79010a080 0x7fa79019f670 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa77800e9f0 tx=0x7fa77800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:50:06.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.023+0000 7fa78cc00640 1 -- 172.21.15.82:0/3509446164 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77800cd80 con 0x7fa79010a080 2024-05-08T05:50:06.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.023+0000 7fa78cc00640 1 -- 172.21.15.82:0/3509446164 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa7780035f0 con 0x7fa79010a080 2024-05-08T05:50:06.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.023+0000 7fa78cc00640 1 -- 172.21.15.82:0/3509446164 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa778010670 con 0x7fa79010a080 2024-05-08T05:50:06.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.023+0000 7fa795000640 1 -- 172.21.15.82:0/3509446164 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7901a6fe0 con 0x7fa79010a080 2024-05-08T05:50:06.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.023+0000 7fa795000640 1 -- 172.21.15.82:0/3509446164 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7901a7500 con 0x7fa79010a080 2024-05-08T05:50:06.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.024+0000 7fa795000640 1 -- 172.21.15.82:0/3509446164 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa790110240 con 0x7fa79010a080 2024-05-08T05:50:06.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.027+0000 7fa78cc00640 1 -- 172.21.15.82:0/3509446164 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fa7780037a0 con 0x7fa79010a080 2024-05-08T05:50:06.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.029+0000 7fa78cc00640 1 --2- 172.21.15.82:0/3509446164 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fa7740b27f0 0x7fa7740b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:06.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.029+0000 7fa78cc00640 1 -- 172.21.15.82:0/3509446164 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fa7780e24a0 con 0x7fa79010a080 2024-05-08T05:50:06.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.029+0000 7fa78f400640 1 --2- 172.21.15.82:0/3509446164 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fa7740b27f0 0x7fa7740b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:06.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.030+0000 7fa78f400640 1 --2- 172.21.15.82:0/3509446164 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fa7740b27f0 0x7fa7740b4cb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa780000c00 tx=0x7fa780005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:50:06.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.034+0000 7fa78cc00640 1 -- 172.21.15.82:0/3509446164 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa7780aa170 con 0x7fa79010a080 2024-05-08T05:50:06.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.241+0000 7fa795000640 1 -- 172.21.15.82:0/3509446164 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fa7900635b0 con 0x7fa79010a080 2024-05-08T05:50:06.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.242+0000 7fa78cc00640 1 -- 172.21.15.82:0/3509446164 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v82) ==== 104+0+11 (secure 0 0 0) 0x7fa7780b21f0 con 0x7fa79010a080 2024-05-08T05:50:06.242 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-05-08T05:50:06.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.245+0000 7fa795000640 1 -- 172.21.15.82:0/3509446164 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fa7740b27f0 msgr2=0x7fa7740b4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:06.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.245+0000 7fa795000640 1 --2- 172.21.15.82:0/3509446164 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fa7740b27f0 0x7fa7740b4cb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fa780000c00 tx=0x7fa780005a20 comp rx=0 tx=0).stop 2024-05-08T05:50:06.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.245+0000 7fa795000640 1 -- 172.21.15.82:0/3509446164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa79010a080 msgr2=0x7fa79019f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:06.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.245+0000 7fa795000640 1 --2- 172.21.15.82:0/3509446164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa79010a080 0x7fa79019f670 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa77800e9f0 tx=0x7fa77800eeb0 comp rx=0 tx=0).stop 2024-05-08T05:50:06.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.245+0000 7fa795000640 1 -- 172.21.15.82:0/3509446164 shutdown_connections 2024-05-08T05:50:06.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.245+0000 7fa795000640 1 --2- 172.21.15.82:0/3509446164 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fa7740b27f0 0x7fa7740b4cb0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:06.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.245+0000 7fa795000640 1 --2- 172.21.15.82:0/3509446164 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa79010aa40 0x7fa7901a66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:06.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.245+0000 7fa795000640 1 --2- 172.21.15.82:0/3509446164 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa79010a080 0x7fa79019f670 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:06.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.245+0000 7fa795000640 1 --2- 172.21.15.82:0/3509446164 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa790108ea0 0x7fa79019f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:06.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.245+0000 7fa795000640 1 -- 172.21.15.82:0/3509446164 >> 172.21.15.82:0/3509446164 conn(0x7fa790077e80 msgr2=0x7fa79010d410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:50:06.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.245+0000 7fa795000640 1 -- 172.21.15.82:0/3509446164 shutdown_connections 2024-05-08T05:50:06.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.245+0000 7fa795000640 1 -- 172.21.15.82:0/3509446164 wait complete. 2024-05-08T05:50:06.265 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T05:50:06.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.474+0000 7f6eb7200640 1 -- 172.21.15.82:0/3876079706 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6eb810a080 msgr2=0x7f6eb810a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:06.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.474+0000 7f6eb7200640 1 --2- 172.21.15.82:0/3876079706 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6eb810a080 0x7f6eb810a500 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4009900 tx=0x7f6ea402a3f0 comp rx=0 tx=0).stop 2024-05-08T05:50:06.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.474+0000 7f6eb7200640 1 -- 172.21.15.82:0/3876079706 shutdown_connections 2024-05-08T05:50:06.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.474+0000 7f6eb7200640 1 --2- 172.21.15.82:0/3876079706 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6eb810aa40 0x7f6eb8111360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:06.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.474+0000 7f6eb7200640 1 --2- 172.21.15.82:0/3876079706 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6eb810a080 0x7f6eb810a500 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:06.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.474+0000 7f6eb7200640 1 --2- 172.21.15.82:0/3876079706 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6eb8108ea0 0x7f6eb81092c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:06.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.474+0000 7f6eb7200640 1 -- 172.21.15.82:0/3876079706 >> 172.21.15.82:0/3876079706 conn(0x7f6eb8077e80 msgr2=0x7f6eb807a2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:50:06.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.474+0000 7f6eb7200640 1 -- 172.21.15.82:0/3876079706 shutdown_connections 2024-05-08T05:50:06.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.474+0000 7f6eb7200640 1 -- 172.21.15.82:0/3876079706 wait complete. 2024-05-08T05:50:06.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.475+0000 7f6eb7200640 1 Processor -- start 2024-05-08T05:50:06.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.476+0000 7f6eb7200640 1 -- start start 2024-05-08T05:50:06.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.476+0000 7f6eb7200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6eb8108ea0 0x7f6eb819f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:06.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.476+0000 7f6eb7200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6eb810aa40 0x7f6eb819f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:06.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.476+0000 7f6eb7200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6eb81a48a0 0x7f6eb81a6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:06.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.476+0000 7f6eb7200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb8114a70 con 0x7f6eb810aa40 2024-05-08T05:50:06.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.476+0000 7f6eb7200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb81148f0 con 0x7f6eb81a48a0 2024-05-08T05:50:06.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.476+0000 7f6eb7200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb8114bf0 con 0x7f6eb8108ea0 2024-05-08T05:50:06.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.476+0000 7f6eb5400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6eb810aa40 0x7f6eb819f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:06.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.476+0000 7f6eb5400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6eb810aa40 0x7f6eb819f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53428/0 (socket says 172.21.15.82:53428) 2024-05-08T05:50:06.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.476+0000 7f6eb5400640 1 -- 172.21.15.82:0/3177972960 learned_addr learned my addr 172.21.15.82:0/3177972960 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:50:06.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.476+0000 7f6eb6800640 1 --2- 172.21.15.82:0/3177972960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6eb81a48a0 0x7f6eb81a6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:06.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.476+0000 7f6eb5e00640 1 --2- 172.21.15.82:0/3177972960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6eb8108ea0 0x7f6eb819f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:06.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.477+0000 7f6eb5e00640 1 -- 172.21.15.82:0/3177972960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6eb81a48a0 msgr2=0x7f6eb81a6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:06.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.477+0000 7f6eb5e00640 1 --2- 172.21.15.82:0/3177972960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6eb81a48a0 0x7f6eb81a6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:06.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.477+0000 7f6eb5e00640 1 -- 172.21.15.82:0/3177972960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6eb810aa40 msgr2=0x7f6eb819f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:06.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.477+0000 7f6eb5e00640 1 --2- 172.21.15.82:0/3177972960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6eb810aa40 0x7f6eb819f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:06.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.477+0000 7f6eb5e00640 1 -- 172.21.15.82:0/3177972960 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6eb81a7300 con 0x7f6eb8108ea0 2024-05-08T05:50:06.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.477+0000 7f6eb5e00640 1 --2- 172.21.15.82:0/3177972960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6eb8108ea0 0x7f6eb819f300 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6ea800e9c0 tx=0x7f6ea800edc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:50:06.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.477+0000 7f6eaea00640 1 -- 172.21.15.82:0/3177972960 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea800ccc0 con 0x7f6eb8108ea0 2024-05-08T05:50:06.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.477+0000 7f6eaea00640 1 -- 172.21.15.82:0/3177972960 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6ea80108e0 con 0x7f6eb8108ea0 2024-05-08T05:50:06.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.477+0000 7f6eb7200640 1 -- 172.21.15.82:0/3177972960 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6eb81a75f0 con 0x7f6eb8108ea0 2024-05-08T05:50:06.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.478+0000 7f6eaea00640 1 -- 172.21.15.82:0/3177972960 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea8018840 con 0x7f6eb8108ea0 2024-05-08T05:50:06.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.478+0000 7f6eb7200640 1 -- 172.21.15.82:0/3177972960 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6eb81a7b10 con 0x7f6eb8108ea0 2024-05-08T05:50:06.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.479+0000 7f6eb7200640 1 -- 172.21.15.82:0/3177972960 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6eb81102c0 con 0x7f6eb8108ea0 2024-05-08T05:50:06.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.481+0000 7f6eaea00640 1 -- 172.21.15.82:0/3177972960 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f6ea801f020 con 0x7f6eb8108ea0 2024-05-08T05:50:06.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.483+0000 7f6eaea00640 1 --2- 172.21.15.82:0/3177972960 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f6e9c0b2830 0x7f6e9c0b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:06.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.483+0000 7f6eaea00640 1 -- 172.21.15.82:0/3177972960 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f6ea80e2390 con 0x7f6eb8108ea0 2024-05-08T05:50:06.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.483+0000 7f6eb5400640 1 --2- 172.21.15.82:0/3177972960 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f6e9c0b2830 0x7f6e9c0b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:06.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.484+0000 7f6eb5400640 1 --2- 172.21.15.82:0/3177972960 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f6e9c0b2830 0x7f6e9c0b4cf0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4005ab0 tx=0x7f6ea4005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:50:06.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.485+0000 7f6eaea00640 1 -- 172.21.15.82:0/3177972960 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6ea80aa060 con 0x7f6eb8108ea0 2024-05-08T05:50:06.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:50:06 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/508024687' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T05:50:06.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:50:06 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/3509446164' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-08T05:50:06.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.686+0000 7f6eb7200640 1 -- 172.21.15.82:0/3177972960 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f6eb80635b0 con 0x7f6eb8108ea0 2024-05-08T05:50:06.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.687+0000 7f6eaea00640 1 -- 172.21.15.82:0/3177972960 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v82) ==== 100+0+11 (secure 0 0 0) 0x7f6ea80b20e0 con 0x7f6eb8108ea0 2024-05-08T05:50:06.688 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2024-05-08T05:50:06.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.690+0000 7f6eb7200640 1 -- 172.21.15.82:0/3177972960 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f6e9c0b2830 msgr2=0x7f6e9c0b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:06.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.690+0000 7f6eb7200640 1 --2- 172.21.15.82:0/3177972960 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f6e9c0b2830 0x7f6e9c0b4cf0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4005ab0 tx=0x7f6ea4005fd0 comp rx=0 tx=0).stop 2024-05-08T05:50:06.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.690+0000 7f6eb7200640 1 -- 172.21.15.82:0/3177972960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6eb8108ea0 msgr2=0x7f6eb819f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:06.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.690+0000 7f6eb7200640 1 --2- 172.21.15.82:0/3177972960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6eb8108ea0 0x7f6eb819f300 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6ea800e9c0 tx=0x7f6ea800edc0 comp rx=0 tx=0).stop 2024-05-08T05:50:06.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.690+0000 7f6eb7200640 1 -- 172.21.15.82:0/3177972960 shutdown_connections 2024-05-08T05:50:06.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.690+0000 7f6eb7200640 1 --2- 172.21.15.82:0/3177972960 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f6e9c0b2830 0x7f6e9c0b4cf0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:06.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.690+0000 7f6eb7200640 1 --2- 172.21.15.82:0/3177972960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6eb81a48a0 0x7f6eb81a6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:06.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.690+0000 7f6eb7200640 1 --2- 172.21.15.82:0/3177972960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f6eb810aa40 0x7f6eb819f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:06.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.690+0000 7f6eb7200640 1 --2- 172.21.15.82:0/3177972960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6eb8108ea0 0x7f6eb819f300 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:06.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.690+0000 7f6eb7200640 1 -- 172.21.15.82:0/3177972960 >> 172.21.15.82:0/3177972960 conn(0x7f6eb8077e80 msgr2=0x7f6eb810d490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:50:06.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.690+0000 7f6eb7200640 1 -- 172.21.15.82:0/3177972960 shutdown_connections 2024-05-08T05:50:06.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:06.690+0000 7f6eb7200640 1 -- 172.21.15.82:0/3177972960 wait complete. 2024-05-08T05:50:06.706 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:50:06 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/508024687' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T05:50:06.706 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:50:06 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/3509446164' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-08T05:50:06.710 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-05-08T05:50:06.710 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T05:50:06.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:50:06 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/508024687' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T05:50:06.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:50:06 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/3509446164' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-08T05:50:07.129 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:50:07.607 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:50:07 smithi082 ceph-mon[30098]: pgmap v443: 97 pgs: 97 active+clean; 649 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 10 op/s 2024-05-08T05:50:07.607 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:50:07 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/3177972960' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-08T05:50:07.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:50:07 smithi134 ceph-mon[34132]: pgmap v443: 97 pgs: 97 active+clean; 649 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 10 op/s 2024-05-08T05:50:07.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:50:07 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/3177972960' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-08T05:50:07.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:50:07 smithi151 ceph-mon[34815]: pgmap v443: 97 pgs: 97 active+clean; 649 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 10 op/s 2024-05-08T05:50:07.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:50:07 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/3177972960' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-08T05:50:08.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:50:08 smithi082 ceph-mon[30098]: mgrmap e19: x(active, since 12m), standbys: z, y 2024-05-08T05:50:08.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:50:08 smithi134 ceph-mon[34132]: mgrmap e19: x(active, since 12m), standbys: z, y 2024-05-08T05:50:08.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:50:08 smithi151 ceph-mon[34815]: mgrmap e19: x(active, since 12m), standbys: z, y 2024-05-08T05:50:09.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:09.380+0000 7f75c1200700 1 -- 172.21.15.82:0/1623015651 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75bc06bb40 msgr2=0x7f75bc110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:09.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:09.380+0000 7f75c1200700 1 --2- 172.21.15.82:0/1623015651 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75bc06bb40 0x7f75bc110330 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f75b400b0a0 tx=0x7f75b400b3b0 comp rx=0 tx=0).stop 2024-05-08T05:50:09.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:09.380+0000 7f75c1200700 1 -- 172.21.15.82:0/1623015651 shutdown_connections 2024-05-08T05:50:09.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:09.380+0000 7f75c1200700 1 --2- 172.21.15.82:0/1623015651 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75bc06bb40 0x7f75bc110330 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:09.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:09.380+0000 7f75c1200700 1 --2- 172.21.15.82:0/1623015651 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f75bc109510 0x7f75bc1098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:09.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:09.380+0000 7f75c1200700 1 --2- 172.21.15.82:0/1623015651 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75bc06b180 0x7f75bc06b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:09.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:09.381+0000 7f75c1200700 1 -- 172.21.15.82:0/1623015651 >> 172.21.15.82:0/1623015651 conn(0x7f75bc079350 msgr2=0x7f75bc079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:50:09.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:09.381+0000 7f75c1200700 1 -- 172.21.15.82:0/1623015651 shutdown_connections 2024-05-08T05:50:09.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:09.381+0000 7f75c1200700 1 -- 172.21.15.82:0/1623015651 wait complete. 2024-05-08T05:50:09.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:09.382+0000 7f75c1200700 1 Processor -- start 2024-05-08T05:50:09.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:09.382+0000 7f75c1200700 1 -- start start 2024-05-08T05:50:09.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:09.383+0000 7f75c1200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75bc06b180 0x7f75bc19f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:09.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:09.383+0000 7f75c1200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75bc06bb40 0x7f75bc19fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:09.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:09.383+0000 7f75c1200700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f75bc109510 0x7f75bc1999f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:09.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:09.383+0000 7f75c1200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f75bc113690 con 0x7f75bc06b180 2024-05-08T05:50:09.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:09.383+0000 7f75c1200700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f75bc113510 con 0x7f75bc06bb40 2024-05-08T05:50:09.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:09.383+0000 7f75c1200700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f75bc113810 con 0x7f75bc109510 2024-05-08T05:50:09.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:09.383+0000 7f75b9400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75bc06bb40 0x7f75bc19fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:09.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:09.383+0000 7f75b9400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75bc06bb40 0x7f75bc19fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:44786/0 (socket says 172.21.15.82:44786) 2024-05-08T05:50:09.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:09.383+0000 7f75b9400700 1 -- 172.21.15.82:0/2985487516 learned_addr learned my addr 172.21.15.82:0/2985487516 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:50:09.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:09.383+0000 7f75b9e00700 1 --2- 172.21.15.82:0/2985487516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75bc06b180 0x7f75bc19f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:09.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:09.383+0000 7f75ba800700 1 --2- 172.21.15.82:0/2985487516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f75bc109510 0x7f75bc1999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:09.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:09.384+0000 7f75b9400700 1 -- 172.21.15.82:0/2985487516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f75bc109510 msgr2=0x7f75bc1999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:09.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:09.384+0000 7f75b9400700 1 --2- 172.21.15.82:0/2985487516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f75bc109510 0x7f75bc1999f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:09.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:09.384+0000 7f75b9400700 1 -- 172.21.15.82:0/2985487516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75bc06b180 msgr2=0x7f75bc19f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:09.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:09.384+0000 7f75b9400700 1 --2- 172.21.15.82:0/2985487516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75bc06b180 0x7f75bc19f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:09.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:09.384+0000 7f75b9400700 1 -- 172.21.15.82:0/2985487516 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75bc19a150 con 0x7f75bc06bb40 2024-05-08T05:50:09.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:09.384+0000 7f75b9e00700 1 --2- 172.21.15.82:0/2985487516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75bc06b180 0x7f75bc19f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:50:09.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:09.384+0000 7f75b9400700 1 --2- 172.21.15.82:0/2985487516 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75bc06bb40 0x7f75bc19fd70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f75a800e9a0 tx=0x7f75a800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:50:09.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:09.384+0000 7f75b2a00700 1 -- 172.21.15.82:0/2985487516 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a800cbd0 con 0x7f75bc06bb40 2024-05-08T05:50:09.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:09.384+0000 7f75b2a00700 1 -- 172.21.15.82:0/2985487516 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f75a800cd70 con 0x7f75bc06bb40 2024-05-08T05:50:09.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:09.384+0000 7f75c1200700 1 -- 172.21.15.82:0/2985487516 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75bc19a440 con 0x7f75bc06bb40 2024-05-08T05:50:09.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:09.384+0000 7f75b2a00700 1 -- 172.21.15.82:0/2985487516 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a8018680 con 0x7f75bc06bb40 2024-05-08T05:50:09.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:09.384+0000 7f75c1200700 1 -- 172.21.15.82:0/2985487516 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75bc1023a0 con 0x7f75bc06bb40 2024-05-08T05:50:09.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:09.385+0000 7f75c1200700 1 -- 172.21.15.82:0/2985487516 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75bc06a190 con 0x7f75bc06bb40 2024-05-08T05:50:09.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:09.388+0000 7f75b2a00700 1 -- 172.21.15.82:0/2985487516 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) ==== 149703+0+0 (secure 0 0 0) 0x7f75a8010430 con 0x7f75bc06bb40 2024-05-08T05:50:09.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:09.390+0000 7f75b2a00700 1 --2- 172.21.15.82:0/2985487516 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f75a00b2910 0x7f75a00b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:09.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:09.390+0000 7f75b2a00700 1 -- 172.21.15.82:0/2985487516 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f75a80e2b20 con 0x7f75bc06bb40 2024-05-08T05:50:09.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:09.390+0000 7f75b9e00700 1 --2- 172.21.15.82:0/2985487516 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f75a00b2910 0x7f75a00b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:09.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:09.391+0000 7f75b9e00700 1 --2- 172.21.15.82:0/2985487516 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f75a00b2910 0x7f75a00b4dd0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f75bc19ab30 tx=0x7f75ac009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:50:09.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:09.391+0000 7f75b2a00700 1 -- 172.21.15.82:0/2985487516 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f75a80aa690 con 0x7f75bc06bb40 2024-05-08T05:50:09.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:09.670+0000 7f75c1200700 1 -- 172.21.15.82:0/2985487516 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f75bc02e510 con 0x7f75bc06bb40 2024-05-08T05:50:09.671 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:50:09 smithi082 ceph-mon[30098]: pgmap v444: 97 pgs: 97 active+clean; 657 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-05-08T05:50:09.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:09.671+0000 7f75b2a00700 1 -- 172.21.15.82:0/2985487516 <== mon.2 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11948 (secure 0 0 0) 0x7f75a80a9f90 con 0x7f75bc06bb40 2024-05-08T05:50:09.672 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:50:09.673 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14364,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3876883250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3876883250},{"type":"v1","addr":"172.21.15.82:6835","nonce":3876883250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1965070586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1965070586},{"type":"v1","addr":"172.21.15.82:6837","nonce":1965070586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T05:45:57.654009+0000","modified":"2024-05-08T05:50:04.192279+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24505,"mds_2":24487,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14397":{"gid":14397,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/1890720973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1890720973},{"type":"v1","addr":"172.21.15.82:6839","nonce":1890720973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14409":{"gid":14409,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/2957083305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":2957083305},{"type":"v1","addr":"172.21.15.82:6841","nonce":2957083305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6833/3827691638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3827691638},{"type":"v1","addr":"172.21.15.134:6833","nonce":3827691638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6833/3625067797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3625067797},{"type":"v1","addr":"172.21.15.151:6833","nonce":3625067797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/4074163402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4074163402},{"type":"v1","addr":"172.21.15.134:6835","nonce":4074163402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.134:6837/2212411710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2212411710},{"type":"v1","addr":"172.21.15.134:6837","nonce":2212411710}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":17,"addr":"172.21.15.151:6835/2093655929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2093655929},{"type":"v1","addr":"172.21.15.151:6835","nonce":2093655929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6837/4192404464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":4192404464},{"type":"v1","addr":"172.21.15.151:6837","nonce":4192404464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":14,"addr":"172.21.15.151:6839/2963754236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":2963754236},{"type":"v1","addr":"172.21.15.151:6839","nonce":2963754236}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.134:6839/1145270893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1145270893},{"type":"v1","addr":"172.21.15.134:6839","nonce":1145270893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24506,24505,24487,24467,24475]},"id":1}]} 2024-05-08T05:50:09.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:09.674+0000 7f75c1200700 1 -- 172.21.15.82:0/2985487516 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f75a00b2910 msgr2=0x7f75a00b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:09.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:09.674+0000 7f75c1200700 1 --2- 172.21.15.82:0/2985487516 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f75a00b2910 0x7f75a00b4dd0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f75bc19ab30 tx=0x7f75ac009260 comp rx=0 tx=0).stop 2024-05-08T05:50:09.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:09.674+0000 7f75c1200700 1 -- 172.21.15.82:0/2985487516 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75bc06bb40 msgr2=0x7f75bc19fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:09.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:09.674+0000 7f75c1200700 1 --2- 172.21.15.82:0/2985487516 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75bc06bb40 0x7f75bc19fd70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f75a800e9a0 tx=0x7f75a800ecb0 comp rx=0 tx=0).stop 2024-05-08T05:50:09.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:09.675+0000 7f75c1200700 1 -- 172.21.15.82:0/2985487516 shutdown_connections 2024-05-08T05:50:09.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:09.675+0000 7f75c1200700 1 --2- 172.21.15.82:0/2985487516 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f75a00b2910 0x7f75a00b4dd0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:09.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:09.675+0000 7f75c1200700 1 --2- 172.21.15.82:0/2985487516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f75bc109510 0x7f75bc1999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:09.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:09.675+0000 7f75c1200700 1 --2- 172.21.15.82:0/2985487516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75bc06b180 0x7f75bc19f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:09.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:09.675+0000 7f75c1200700 1 --2- 172.21.15.82:0/2985487516 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75bc06bb40 0x7f75bc19fd70 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:09.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:09.675+0000 7f75c1200700 1 -- 172.21.15.82:0/2985487516 >> 172.21.15.82:0/2985487516 conn(0x7f75bc079350 msgr2=0x7f75bc101170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:50:09.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:09.675+0000 7f75c1200700 1 -- 172.21.15.82:0/2985487516 shutdown_connections 2024-05-08T05:50:09.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:09.675+0000 7f75c1200700 1 -- 172.21.15.82:0/2985487516 wait complete. 2024-05-08T05:50:09.677 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 29 2024-05-08T05:50:09.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:50:09 smithi134 ceph-mon[34132]: pgmap v444: 97 pgs: 97 active+clean; 657 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-05-08T05:50:09.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:50:09 smithi151 ceph-mon[34815]: pgmap v444: 97 pgs: 97 active+clean; 657 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.6 KiB/s wr, 11 op/s 2024-05-08T05:50:10.702 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:50:10 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/2985487516' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:50:10.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:50:10 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/2985487516' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:50:10.761 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-05-08T05:50:10.761 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-05-08T05:50:10.761 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T05:50:10.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:50:10 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/2985487516' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:50:10.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:10.969+0000 7f530be00640 1 -- 172.21.15.82:0/1794866822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f530c108580 msgr2=0x7f530c10a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:10.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:10.969+0000 7f530be00640 1 --2- 172.21.15.82:0/1794866822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f530c108580 0x7f530c10a9d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5304009860 tx=0x7f530402a340 comp rx=0 tx=0).stop 2024-05-08T05:50:10.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:10.969+0000 7f530be00640 1 -- 172.21.15.82:0/1794866822 shutdown_connections 2024-05-08T05:50:10.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:10.969+0000 7f530be00640 1 --2- 172.21.15.82:0/1794866822 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f530c108580 0x7f530c10a9d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:10.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:10.969+0000 7f530be00640 1 --2- 172.21.15.82:0/1794866822 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f530c105c50 0x7f530c108040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:10.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:10.969+0000 7f530be00640 1 --2- 172.21.15.82:0/1794866822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f530c103320 0x7f530c105710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:10.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:10.969+0000 7f530be00640 1 -- 172.21.15.82:0/1794866822 >> 172.21.15.82:0/1794866822 conn(0x7f530c0fcd50 msgr2=0x7f530c0ff170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:50:10.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:10.969+0000 7f530be00640 1 -- 172.21.15.82:0/1794866822 shutdown_connections 2024-05-08T05:50:10.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:10.969+0000 7f530be00640 1 -- 172.21.15.82:0/1794866822 wait complete. 2024-05-08T05:50:10.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:10.970+0000 7f530be00640 1 Processor -- start 2024-05-08T05:50:10.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:10.970+0000 7f530be00640 1 -- start start 2024-05-08T05:50:10.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:10.971+0000 7f530be00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f530c103320 0x7f530c198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:10.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:10.971+0000 7f530be00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f530c105c50 0x7f530c198f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:10.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:10.971+0000 7f530be00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f530c108580 0x7f530c1a0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:10.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:10.971+0000 7f530be00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f530c10e380 con 0x7f530c108580 2024-05-08T05:50:10.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:10.971+0000 7f530be00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f530c10e200 con 0x7f530c103320 2024-05-08T05:50:10.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:10.971+0000 7f530be00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f530c10e500 con 0x7f530c105c50 2024-05-08T05:50:10.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:10.971+0000 7f530b400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f530c108580 0x7f530c1a0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:10.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:10.971+0000 7f530a000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f530c105c50 0x7f530c198f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:10.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:10.971+0000 7f530b400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f530c108580 0x7f530c1a0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53468/0 (socket says 172.21.15.82:53468) 2024-05-08T05:50:10.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:10.971+0000 7f530b400640 1 -- 172.21.15.82:0/2196503855 learned_addr learned my addr 172.21.15.82:0/2196503855 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:50:10.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:10.971+0000 7f530aa00640 1 --2- 172.21.15.82:0/2196503855 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f530c103320 0x7f530c198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:10.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:10.971+0000 7f530b400640 1 -- 172.21.15.82:0/2196503855 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f530c105c50 msgr2=0x7f530c198f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:10.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:10.971+0000 7f530b400640 1 --2- 172.21.15.82:0/2196503855 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f530c105c50 0x7f530c198f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:10.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:10.971+0000 7f530b400640 1 -- 172.21.15.82:0/2196503855 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f530c103320 msgr2=0x7f530c198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:10.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:10.971+0000 7f530b400640 1 --2- 172.21.15.82:0/2196503855 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f530c103320 0x7f530c198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:10.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:10.972+0000 7f530b400640 1 -- 172.21.15.82:0/2196503855 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f530c1a0670 con 0x7f530c108580 2024-05-08T05:50:10.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:10.972+0000 7f530b400640 1 --2- 172.21.15.82:0/2196503855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f530c108580 0x7f530c1a0000 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f530402a930 tx=0x7f530402ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:50:10.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:10.972+0000 7f5303400640 1 -- 172.21.15.82:0/2196503855 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5304037040 con 0x7f530c108580 2024-05-08T05:50:10.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:10.972+0000 7f5303400640 1 -- 172.21.15.82:0/2196503855 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5304041070 con 0x7f530c108580 2024-05-08T05:50:10.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:10.972+0000 7f5303400640 1 -- 172.21.15.82:0/2196503855 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5304003850 con 0x7f530c108580 2024-05-08T05:50:10.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:10.972+0000 7f530be00640 1 -- 172.21.15.82:0/2196503855 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f530c1a0900 con 0x7f530c108580 2024-05-08T05:50:10.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:10.972+0000 7f530be00640 1 -- 172.21.15.82:0/2196503855 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f530c1a0d90 con 0x7f530c108580 2024-05-08T05:50:10.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:10.973+0000 7f530be00640 1 -- 172.21.15.82:0/2196503855 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f530c0fe840 con 0x7f530c108580 2024-05-08T05:50:10.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:10.976+0000 7f5303400640 1 -- 172.21.15.82:0/2196503855 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 149703+0+0 (secure 0 0 0) 0x7f5304030550 con 0x7f530c108580 2024-05-08T05:50:10.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:10.977+0000 7f5303400640 1 --2- 172.21.15.82:0/2196503855 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f52f00b2880 0x7f52f00b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:10.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:10.977+0000 7f5303400640 1 -- 172.21.15.82:0/2196503855 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f5304101f10 con 0x7f530c108580 2024-05-08T05:50:10.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:10.977+0000 7f530aa00640 1 --2- 172.21.15.82:0/2196503855 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f52f00b2880 0x7f52f00b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:10.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:10.978+0000 7f530aa00640 1 --2- 172.21.15.82:0/2196503855 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f52f00b2880 0x7f52f00b4d40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f52fc005fd0 tx=0x7f52fc010040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:50:10.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:10.982+0000 7f5303400640 1 -- 172.21.15.82:0/2196503855 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f53040c9b90 con 0x7f530c108580 2024-05-08T05:50:11.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.189+0000 7f530be00640 1 -- 172.21.15.82:0/2196503855 --> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f530c062df0 con 0x7f52f00b2880 2024-05-08T05:50:11.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.213+0000 7f5303400640 1 -- 172.21.15.82:0/2196503855 <== mgr.14152 v2:172.21.15.82:6800/4089180091 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259043 (secure 0 0 0) 0x7f530c062df0 con 0x7f52f00b2880 2024-05-08T05:50:11.219 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:50:11.221 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-05-08T05:50:11.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.221+0000 7f530be00640 1 -- 172.21.15.82:0/2196503855 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f52f00b2880 msgr2=0x7f52f00b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:11.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.221+0000 7f530be00640 1 --2- 172.21.15.82:0/2196503855 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f52f00b2880 0x7f52f00b4d40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f52fc005fd0 tx=0x7f52fc010040 comp rx=0 tx=0).stop 2024-05-08T05:50:11.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.221+0000 7f530be00640 1 -- 172.21.15.82:0/2196503855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f530c108580 msgr2=0x7f530c1a0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:11.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.221+0000 7f530be00640 1 --2- 172.21.15.82:0/2196503855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f530c108580 0x7f530c1a0000 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f530402a930 tx=0x7f530402ada0 comp rx=0 tx=0).stop 2024-05-08T05:50:11.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.221+0000 7f530be00640 1 -- 172.21.15.82:0/2196503855 shutdown_connections 2024-05-08T05:50:11.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.221+0000 7f530be00640 1 --2- 172.21.15.82:0/2196503855 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f52f00b2880 0x7f52f00b4d40 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:11.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.221+0000 7f530be00640 1 --2- 172.21.15.82:0/2196503855 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f530c108580 0x7f530c1a0000 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:11.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.221+0000 7f530be00640 1 --2- 172.21.15.82:0/2196503855 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f530c105c50 0x7f530c198f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:11.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.221+0000 7f530be00640 1 --2- 172.21.15.82:0/2196503855 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f530c103320 0x7f530c198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:11.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.221+0000 7f530be00640 1 -- 172.21.15.82:0/2196503855 >> 172.21.15.82:0/2196503855 conn(0x7f530c0fcd50 msgr2=0x7f530c103c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:50:11.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.221+0000 7f530be00640 1 -- 172.21.15.82:0/2196503855 shutdown_connections 2024-05-08T05:50:11.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.221+0000 7f530be00640 1 -- 172.21.15.82:0/2196503855 wait complete. 2024-05-08T05:50:11.243 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":445,"stamp":"2024-05-08T05:50:10.204888+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":672743,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":2416,"num_read_kb":1313,"num_write":398,"num_write_kb":2319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":3007130,"num_keys_recovered":20,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":827,"ondisk_log_size":827,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":351868,"kb_used_data":11036,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124589956,"statfs":{"total":1151940427776,"available":1151580114944,"internally_reserved":0,"allocated":11300864,"data_stored":7229085,"data_compressed":116202,"data_compressed_allocated":147456,"data_compressed_original":1822720,"omap_allocated":19138,"internal_metadata":348894526},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9018,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":72,"num_write":19,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004999"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:48:00.719508+0000","last_change":"2024-05-08T05:45:54.796792+0000","last_active":"2024-05-08T05:48:00.719508+0000","last_peered":"2024-05-08T05:48:00.719508+0000","last_clean":"2024-05-08T05:48:00.719508+0000","last_became_active":"2024-05-08T05:45:54.796445+0000","last_became_peered":"2024-05-08T05:45:54.796445+0000","last_unstale":"2024-05-08T05:48:00.719508+0000","last_undegraded":"2024-05-08T05:48:00.719508+0000","last_fullsized":"2024-05-08T05:48:00.719508+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:41:12.762659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:48:02.673136+0000","last_change":"2024-05-08T05:45:54.800291+0000","last_active":"2024-05-08T05:48:02.673136+0000","last_peered":"2024-05-08T05:48:02.673136+0000","last_clean":"2024-05-08T05:48:02.673136+0000","last_became_active":"2024-05-08T05:45:54.798182+0000","last_became_peered":"2024-05-08T05:45:54.798182+0000","last_unstale":"2024-05-08T05:48:02.673136+0000","last_undegraded":"2024-05-08T05:48:02.673136+0000","last_fullsized":"2024-05-08T05:48:02.673136+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:55:52.672307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:48:02.673095+0000","last_change":"2024-05-08T05:45:54.792574+0000","last_active":"2024-05-08T05:48:02.673095+0000","last_peered":"2024-05-08T05:48:02.673095+0000","last_clean":"2024-05-08T05:48:02.673095+0000","last_became_active":"2024-05-08T05:45:54.790856+0000","last_became_peered":"2024-05-08T05:45:54.790856+0000","last_unstale":"2024-05-08T05:48:02.673095+0000","last_undegraded":"2024-05-08T05:48:02.673095+0000","last_fullsized":"2024-05-08T05:48:02.673095+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:32:33.727532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:55.165392+0000","last_change":"2024-05-08T05:45:54.772883+0000","last_active":"2024-05-08T05:47:55.165392+0000","last_peered":"2024-05-08T05:47:55.165392+0000","last_clean":"2024-05-08T05:47:55.165392+0000","last_became_active":"2024-05-08T05:45:54.772457+0000","last_became_peered":"2024-05-08T05:45:54.772457+0000","last_unstale":"2024-05-08T05:47:55.165392+0000","last_undegraded":"2024-05-08T05:47:55.165392+0000","last_fullsized":"2024-05-08T05:47:55.165392+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:50:20.116563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.104530+0000","last_change":"2024-05-08T05:45:54.798868+0000","last_active":"2024-05-08T05:47:44.104530+0000","last_peered":"2024-05-08T05:47:44.104530+0000","last_clean":"2024-05-08T05:47:44.104530+0000","last_became_active":"2024-05-08T05:45:54.798459+0000","last_became_peered":"2024-05-08T05:45:54.798459+0000","last_unstale":"2024-05-08T05:47:44.104530+0000","last_undegraded":"2024-05-08T05:47:44.104530+0000","last_fullsized":"2024-05-08T05:47:44.104530+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:59:32.280051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.103537+0000","last_change":"2024-05-08T05:45:54.788172+0000","last_active":"2024-05-08T05:47:44.103537+0000","last_peered":"2024-05-08T05:47:44.103537+0000","last_clean":"2024-05-08T05:47:44.103537+0000","last_became_active":"2024-05-08T05:45:54.787609+0000","last_became_peered":"2024-05-08T05:45:54.787609+0000","last_unstale":"2024-05-08T05:47:44.103537+0000","last_undegraded":"2024-05-08T05:47:44.103537+0000","last_fullsized":"2024-05-08T05:47:44.103537+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:30:17.295770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.090733+0000","last_change":"2024-05-08T05:45:54.786904+0000","last_active":"2024-05-08T05:47:44.090733+0000","last_peered":"2024-05-08T05:47:44.090733+0000","last_clean":"2024-05-08T05:47:44.090733+0000","last_became_active":"2024-05-08T05:45:54.786484+0000","last_became_peered":"2024-05-08T05:45:54.786484+0000","last_unstale":"2024-05-08T05:47:44.090733+0000","last_undegraded":"2024-05-08T05:47:44.090733+0000","last_fullsized":"2024-05-08T05:47:44.090733+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:14:15.398144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.104866+0000","last_change":"2024-05-08T05:45:54.801559+0000","last_active":"2024-05-08T05:47:44.104866+0000","last_peered":"2024-05-08T05:47:44.104866+0000","last_clean":"2024-05-08T05:47:44.104866+0000","last_became_active":"2024-05-08T05:45:54.796293+0000","last_became_peered":"2024-05-08T05:45:54.796293+0000","last_unstale":"2024-05-08T05:47:44.104866+0000","last_undegraded":"2024-05-08T05:47:44.104866+0000","last_fullsized":"2024-05-08T05:47:44.104866+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:07:05.483562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.097674+0000","last_change":"2024-05-08T05:45:54.780450+0000","last_active":"2024-05-08T05:47:44.097674+0000","last_peered":"2024-05-08T05:47:44.097674+0000","last_clean":"2024-05-08T05:47:44.097674+0000","last_became_active":"2024-05-08T05:45:54.780079+0000","last_became_peered":"2024-05-08T05:45:54.780079+0000","last_unstale":"2024-05-08T05:47:44.097674+0000","last_undegraded":"2024-05-08T05:47:44.097674+0000","last_fullsized":"2024-05-08T05:47:44.097674+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:41:26.688748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.078720+0000","last_change":"2024-05-08T05:45:54.776294+0000","last_active":"2024-05-08T05:47:44.078720+0000","last_peered":"2024-05-08T05:47:44.078720+0000","last_clean":"2024-05-08T05:47:44.078720+0000","last_became_active":"2024-05-08T05:45:54.775928+0000","last_became_peered":"2024-05-08T05:45:54.775928+0000","last_unstale":"2024-05-08T05:47:44.078720+0000","last_undegraded":"2024-05-08T05:47:44.078720+0000","last_fullsized":"2024-05-08T05:47:44.078720+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:17:53.453446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.095848+0000","last_change":"2024-05-08T05:45:54.781478+0000","last_active":"2024-05-08T05:47:44.095848+0000","last_peered":"2024-05-08T05:47:44.095848+0000","last_clean":"2024-05-08T05:47:44.095848+0000","last_became_active":"2024-05-08T05:45:54.780839+0000","last_became_peered":"2024-05-08T05:45:54.780839+0000","last_unstale":"2024-05-08T05:47:44.095848+0000","last_undegraded":"2024-05-08T05:47:44.095848+0000","last_fullsized":"2024-05-08T05:47:44.095848+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:39:14.518391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.082422+0000","last_change":"2024-05-08T05:45:54.774650+0000","last_active":"2024-05-08T05:47:44.082422+0000","last_peered":"2024-05-08T05:47:44.082422+0000","last_clean":"2024-05-08T05:47:44.082422+0000","last_became_active":"2024-05-08T05:45:54.774276+0000","last_became_peered":"2024-05-08T05:45:54.774276+0000","last_unstale":"2024-05-08T05:47:44.082422+0000","last_undegraded":"2024-05-08T05:47:44.082422+0000","last_fullsized":"2024-05-08T05:47:44.082422+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:43:53.390553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.093679+0000","last_change":"2024-05-08T05:45:54.783430+0000","last_active":"2024-05-08T05:47:44.093679+0000","last_peered":"2024-05-08T05:47:44.093679+0000","last_clean":"2024-05-08T05:47:44.093679+0000","last_became_active":"2024-05-08T05:45:54.782394+0000","last_became_peered":"2024-05-08T05:45:54.782394+0000","last_unstale":"2024-05-08T05:47:44.093679+0000","last_undegraded":"2024-05-08T05:47:44.093679+0000","last_fullsized":"2024-05-08T05:47:44.093679+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:47:01.864111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.107049+0000","last_change":"2024-05-08T05:45:54.792880+0000","last_active":"2024-05-08T05:47:44.107049+0000","last_peered":"2024-05-08T05:47:44.107049+0000","last_clean":"2024-05-08T05:47:44.107049+0000","last_became_active":"2024-05-08T05:45:54.789653+0000","last_became_peered":"2024-05-08T05:45:54.789653+0000","last_unstale":"2024-05-08T05:47:44.107049+0000","last_undegraded":"2024-05-08T05:47:44.107049+0000","last_fullsized":"2024-05-08T05:47:44.107049+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:57:10.552014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.105891+0000","last_change":"2024-05-08T05:45:54.793612+0000","last_active":"2024-05-08T05:47:44.105891+0000","last_peered":"2024-05-08T05:47:44.105891+0000","last_clean":"2024-05-08T05:47:44.105891+0000","last_became_active":"2024-05-08T05:45:54.793191+0000","last_became_peered":"2024-05-08T05:45:54.793191+0000","last_unstale":"2024-05-08T05:47:44.105891+0000","last_undegraded":"2024-05-08T05:47:44.105891+0000","last_fullsized":"2024-05-08T05:47:44.105891+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:49:35.066070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.110756+0000","last_change":"2024-05-08T05:45:54.799679+0000","last_active":"2024-05-08T05:47:44.110756+0000","last_peered":"2024-05-08T05:47:44.110756+0000","last_clean":"2024-05-08T05:47:44.110756+0000","last_became_active":"2024-05-08T05:45:54.799196+0000","last_became_peered":"2024-05-08T05:45:54.799196+0000","last_unstale":"2024-05-08T05:47:44.110756+0000","last_undegraded":"2024-05-08T05:47:44.110756+0000","last_fullsized":"2024-05-08T05:47:44.110756+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:14:00.597282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.104930+0000","last_change":"2024-05-08T05:45:54.796799+0000","last_active":"2024-05-08T05:47:44.104930+0000","last_peered":"2024-05-08T05:47:44.104930+0000","last_clean":"2024-05-08T05:47:44.104930+0000","last_became_active":"2024-05-08T05:45:54.796501+0000","last_became_peered":"2024-05-08T05:45:54.796501+0000","last_unstale":"2024-05-08T05:47:44.104930+0000","last_undegraded":"2024-05-08T05:47:44.104930+0000","last_fullsized":"2024-05-08T05:47:44.104930+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:14:59.446718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.108986+0000","last_change":"2024-05-08T05:45:54.789544+0000","last_active":"2024-05-08T05:47:44.108986+0000","last_peered":"2024-05-08T05:47:44.108986+0000","last_clean":"2024-05-08T05:47:44.108986+0000","last_became_active":"2024-05-08T05:45:54.787901+0000","last_became_peered":"2024-05-08T05:45:54.787901+0000","last_unstale":"2024-05-08T05:47:44.108986+0000","last_undegraded":"2024-05-08T05:47:44.108986+0000","last_fullsized":"2024-05-08T05:47:44.108986+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:12:23.200311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.104801+0000","last_change":"2024-05-08T05:45:54.782537+0000","last_active":"2024-05-08T05:47:44.104801+0000","last_peered":"2024-05-08T05:47:44.104801+0000","last_clean":"2024-05-08T05:47:44.104801+0000","last_became_active":"2024-05-08T05:45:54.781389+0000","last_became_peered":"2024-05-08T05:45:54.781389+0000","last_unstale":"2024-05-08T05:47:44.104801+0000","last_undegraded":"2024-05-08T05:47:44.104801+0000","last_fullsized":"2024-05-08T05:47:44.104801+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:56:22.041900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"80'13","reported_seq":273,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:50:07.497674+0000","last_change":"2024-05-08T05:45:50.744496+0000","last_active":"2024-05-08T05:50:07.497674+0000","last_peered":"2024-05-08T05:50:07.497674+0000","last_clean":"2024-05-08T05:50:07.497674+0000","last_became_active":"2024-05-08T05:45:50.743882+0000","last_became_peered":"2024-05-08T05:45:50.743882+0000","last_unstale":"2024-05-08T05:50:07.497674+0000","last_undegraded":"2024-05-08T05:50:07.497674+0000","last_fullsized":"2024-05-08T05:50:07.497674+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:45:11.198096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":232,"num_read_kb":232,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.081356+0000","last_change":"2024-05-08T05:46:45.957649+0000","last_active":"2024-05-08T05:47:44.081356+0000","last_peered":"2024-05-08T05:47:44.081356+0000","last_clean":"2024-05-08T05:47:44.081356+0000","last_became_active":"2024-05-08T05:46:45.957154+0000","last_became_peered":"2024-05-08T05:46:45.957154+0000","last_unstale":"2024-05-08T05:47:44.081356+0000","last_undegraded":"2024-05-08T05:47:44.081356+0000","last_fullsized":"2024-05-08T05:47:44.081356+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:29:25.475541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:54.178928+0000","last_change":"2024-05-08T05:45:50.863409+0000","last_active":"2024-05-08T05:47:54.178928+0000","last_peered":"2024-05-08T05:47:54.178928+0000","last_clean":"2024-05-08T05:47:54.178928+0000","last_became_active":"2024-05-08T05:45:50.861818+0000","last_became_peered":"2024-05-08T05:45:50.861818+0000","last_unstale":"2024-05-08T05:47:54.178928+0000","last_undegraded":"2024-05-08T05:47:54.178928+0000","last_fullsized":"2024-05-08T05:47:54.178928+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:39:32.821431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:48:02.673181+0000","last_change":"2024-05-08T05:45:54.797429+0000","last_active":"2024-05-08T05:48:02.673181+0000","last_peered":"2024-05-08T05:48:02.673181+0000","last_clean":"2024-05-08T05:48:02.673181+0000","last_became_active":"2024-05-08T05:45:54.795030+0000","last_became_peered":"2024-05-08T05:45:54.795030+0000","last_unstale":"2024-05-08T05:48:02.673181+0000","last_undegraded":"2024-05-08T05:48:02.673181+0000","last_fullsized":"2024-05-08T05:48:02.673181+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:43:34.852889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"80'12","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.773238+0000","last_change":"2024-05-08T05:46:45.772846+0000","last_active":"2024-05-08T05:46:45.773238+0000","last_peered":"2024-05-08T05:46:45.773238+0000","last_clean":"2024-05-08T05:46:45.773238+0000","last_became_active":"2024-05-08T05:46:45.763937+0000","last_became_peered":"2024-05-08T05:46:45.763937+0000","last_unstale":"2024-05-08T05:46:45.773238+0000","last_undegraded":"2024-05-08T05:46:45.773238+0000","last_fullsized":"2024-05-08T05:46:45.773238+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:48:13.233059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.099418+0000","last_change":"2024-05-08T05:45:54.788852+0000","last_active":"2024-05-08T05:47:44.099418+0000","last_peered":"2024-05-08T05:47:44.099418+0000","last_clean":"2024-05-08T05:47:44.099418+0000","last_became_active":"2024-05-08T05:45:54.788496+0000","last_became_peered":"2024-05-08T05:45:54.788496+0000","last_unstale":"2024-05-08T05:47:44.099418+0000","last_undegraded":"2024-05-08T05:47:44.099418+0000","last_fullsized":"2024-05-08T05:47:44.099418+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:44:45.379728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"80'5","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762912+0000","last_change":"2024-05-08T05:45:50.741528+0000","last_active":"2024-05-08T05:46:45.762912+0000","last_peered":"2024-05-08T05:46:45.762912+0000","last_clean":"2024-05-08T05:46:45.762912+0000","last_became_active":"2024-05-08T05:45:50.741232+0000","last_became_peered":"2024-05-08T05:45:50.741232+0000","last_unstale":"2024-05-08T05:46:45.762912+0000","last_undegraded":"2024-05-08T05:46:45.762912+0000","last_fullsized":"2024-05-08T05:46:45.762912+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:36:48.540858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.099734+0000","last_change":"2024-05-08T05:46:45.954990+0000","last_active":"2024-05-08T05:47:44.099734+0000","last_peered":"2024-05-08T05:47:44.099734+0000","last_clean":"2024-05-08T05:47:44.099734+0000","last_became_active":"2024-05-08T05:46:45.953589+0000","last_became_peered":"2024-05-08T05:46:45.953589+0000","last_unstale":"2024-05-08T05:47:44.099734+0000","last_undegraded":"2024-05-08T05:47:44.099734+0000","last_fullsized":"2024-05-08T05:47:44.099734+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:29:17.410356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1b","version":"82'7","reported_seq":270,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:50:08.326233+0000","last_change":"2024-05-08T05:45:50.746462+0000","last_active":"2024-05-08T05:50:08.326233+0000","last_peered":"2024-05-08T05:50:08.326233+0000","last_clean":"2024-05-08T05:50:08.326233+0000","last_became_active":"2024-05-08T05:45:50.746064+0000","last_became_peered":"2024-05-08T05:45:50.746064+0000","last_unstale":"2024-05-08T05:50:08.326233+0000","last_undegraded":"2024-05-08T05:50:08.326233+0000","last_fullsized":"2024-05-08T05:50:08.326233+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:51:49.076829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1323,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":236,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.086315+0000","last_change":"2024-05-08T05:45:54.788524+0000","last_active":"2024-05-08T05:47:44.086315+0000","last_peered":"2024-05-08T05:47:44.086315+0000","last_clean":"2024-05-08T05:47:44.086315+0000","last_became_active":"2024-05-08T05:45:54.788179+0000","last_became_peered":"2024-05-08T05:45:54.788179+0000","last_unstale":"2024-05-08T05:47:44.086315+0000","last_undegraded":"2024-05-08T05:47:44.086315+0000","last_fullsized":"2024-05-08T05:47:44.086315+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:44:34.257799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":48,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.781138+0000","last_change":"2024-05-08T05:46:45.780705+0000","last_active":"2024-05-08T05:46:45.781138+0000","last_peered":"2024-05-08T05:46:45.781138+0000","last_clean":"2024-05-08T05:46:45.781138+0000","last_became_active":"2024-05-08T05:46:45.773246+0000","last_became_peered":"2024-05-08T05:46:45.773246+0000","last_unstale":"2024-05-08T05:46:45.781138+0000","last_undegraded":"2024-05-08T05:46:45.781138+0000","last_fullsized":"2024-05-08T05:46:45.781138+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:10:33.491186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.103877+0000","last_change":"2024-05-08T05:45:54.792001+0000","last_active":"2024-05-08T05:47:44.103877+0000","last_peered":"2024-05-08T05:47:44.103877+0000","last_clean":"2024-05-08T05:47:44.103877+0000","last_became_active":"2024-05-08T05:45:54.791581+0000","last_became_peered":"2024-05-08T05:45:54.791581+0000","last_unstale":"2024-05-08T05:47:44.103877+0000","last_undegraded":"2024-05-08T05:47:44.103877+0000","last_fullsized":"2024-05-08T05:47:44.103877+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:43:37.437251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"80'3","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.771676+0000","last_change":"2024-05-08T05:45:50.740645+0000","last_active":"2024-05-08T05:46:45.771676+0000","last_peered":"2024-05-08T05:46:45.771676+0000","last_clean":"2024-05-08T05:46:45.771676+0000","last_became_active":"2024-05-08T05:45:50.739997+0000","last_became_peered":"2024-05-08T05:45:50.739997+0000","last_unstale":"2024-05-08T05:46:45.771676+0000","last_undegraded":"2024-05-08T05:46:45.771676+0000","last_fullsized":"2024-05-08T05:46:45.771676+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:24:48.895557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.105072+0000","last_change":"2024-05-08T05:45:54.802757+0000","last_active":"2024-05-08T05:47:44.105072+0000","last_peered":"2024-05-08T05:47:44.105072+0000","last_clean":"2024-05-08T05:47:44.105072+0000","last_became_active":"2024-05-08T05:45:54.798549+0000","last_became_peered":"2024-05-08T05:45:54.798549+0000","last_unstale":"2024-05-08T05:47:44.105072+0000","last_undegraded":"2024-05-08T05:47:44.105072+0000","last_fullsized":"2024-05-08T05:47:44.105072+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:39:37.582997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'3","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.956005+0000","last_change":"2024-05-08T05:45:50.743989+0000","last_active":"2024-05-08T05:46:45.956005+0000","last_peered":"2024-05-08T05:46:45.956005+0000","last_clean":"2024-05-08T05:46:45.956005+0000","last_became_active":"2024-05-08T05:45:50.743582+0000","last_became_peered":"2024-05-08T05:45:50.743582+0000","last_unstale":"2024-05-08T05:46:45.956005+0000","last_undegraded":"2024-05-08T05:46:45.956005+0000","last_fullsized":"2024-05-08T05:46:45.956005+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:14:46.820582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.108021+0000","last_change":"2024-05-08T05:45:54.807249+0000","last_active":"2024-05-08T05:47:44.108021+0000","last_peered":"2024-05-08T05:47:44.108021+0000","last_clean":"2024-05-08T05:47:44.108021+0000","last_became_active":"2024-05-08T05:45:54.806823+0000","last_became_peered":"2024-05-08T05:45:54.806823+0000","last_unstale":"2024-05-08T05:47:44.108021+0000","last_undegraded":"2024-05-08T05:47:44.108021+0000","last_fullsized":"2024-05-08T05:47:44.108021+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:37:25.526927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'7","reported_seq":491,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:50:05.460267+0000","last_change":"2024-05-08T05:45:50.747477+0000","last_active":"2024-05-08T05:50:05.460267+0000","last_peered":"2024-05-08T05:50:05.460267+0000","last_clean":"2024-05-08T05:50:05.460267+0000","last_became_active":"2024-05-08T05:45:50.747103+0000","last_became_peered":"2024-05-08T05:45:50.747103+0000","last_unstale":"2024-05-08T05:50:05.460267+0000","last_undegraded":"2024-05-08T05:50:05.460267+0000","last_fullsized":"2024-05-08T05:50:05.460267+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:08:17.108826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":457,"num_read_kb":457,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.109143+0000","last_change":"2024-05-08T05:45:54.787885+0000","last_active":"2024-05-08T05:47:44.109143+0000","last_peered":"2024-05-08T05:47:44.109143+0000","last_clean":"2024-05-08T05:47:44.109143+0000","last_became_active":"2024-05-08T05:45:54.787480+0000","last_became_peered":"2024-05-08T05:45:54.787480+0000","last_unstale":"2024-05-08T05:47:44.109143+0000","last_undegraded":"2024-05-08T05:47:44.109143+0000","last_fullsized":"2024-05-08T05:47:44.109143+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:13:42.889918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'4","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.763077+0000","last_change":"2024-05-08T05:45:50.741271+0000","last_active":"2024-05-08T05:46:45.763077+0000","last_peered":"2024-05-08T05:46:45.763077+0000","last_clean":"2024-05-08T05:46:45.763077+0000","last_became_active":"2024-05-08T05:45:50.740869+0000","last_became_peered":"2024-05-08T05:45:50.740869+0000","last_unstale":"2024-05-08T05:46:45.763077+0000","last_undegraded":"2024-05-08T05:46:45.763077+0000","last_fullsized":"2024-05-08T05:46:45.763077+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:57:40.855732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.107752+0000","last_change":"2024-05-08T05:46:45.958524+0000","last_active":"2024-05-08T05:47:44.107752+0000","last_peered":"2024-05-08T05:47:44.107752+0000","last_clean":"2024-05-08T05:47:44.107752+0000","last_became_active":"2024-05-08T05:46:45.957576+0000","last_became_peered":"2024-05-08T05:46:45.957576+0000","last_unstale":"2024-05-08T05:47:44.107752+0000","last_undegraded":"2024-05-08T05:47:44.107752+0000","last_fullsized":"2024-05-08T05:47:44.107752+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:59:34.927448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.956564+0000","last_change":"2024-05-08T05:45:50.865467+0000","last_active":"2024-05-08T05:46:45.956564+0000","last_peered":"2024-05-08T05:46:45.956564+0000","last_clean":"2024-05-08T05:46:45.956564+0000","last_became_active":"2024-05-08T05:45:50.865245+0000","last_became_peered":"2024-05-08T05:45:50.865245+0000","last_unstale":"2024-05-08T05:46:45.956564+0000","last_undegraded":"2024-05-08T05:46:45.956564+0000","last_fullsized":"2024-05-08T05:46:45.956564+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:03:40.990651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.099169+0000","last_change":"2024-05-08T05:45:54.780782+0000","last_active":"2024-05-08T05:47:44.099169+0000","last_peered":"2024-05-08T05:47:44.099169+0000","last_clean":"2024-05-08T05:47:44.099169+0000","last_became_active":"2024-05-08T05:45:54.780074+0000","last_became_peered":"2024-05-08T05:45:54.780074+0000","last_unstale":"2024-05-08T05:47:44.099169+0000","last_undegraded":"2024-05-08T05:47:44.099169+0000","last_fullsized":"2024-05-08T05:47:44.099169+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:23:09.026115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'40","reported_seq":558,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:50:06.278209+0000","last_change":"2024-05-08T05:46:45.965985+0000","last_active":"2024-05-08T05:50:06.278209+0000","last_peered":"2024-05-08T05:50:06.278209+0000","last_clean":"2024-05-08T05:50:06.278209+0000","last_became_active":"2024-05-08T05:46:45.953485+0000","last_became_peered":"2024-05-08T05:46:45.953485+0000","last_unstale":"2024-05-08T05:50:06.278209+0000","last_undegraded":"2024-05-08T05:50:06.278209+0000","last_fullsized":"2024-05-08T05:50:06.278209+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:51:45.723988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73704,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":462,"num_read_kb":296,"num_write":42,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":55222,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.088260+0000","last_change":"2024-05-08T05:45:54.777524+0000","last_active":"2024-05-08T05:47:44.088260+0000","last_peered":"2024-05-08T05:47:44.088260+0000","last_clean":"2024-05-08T05:47:44.088260+0000","last_became_active":"2024-05-08T05:45:54.776756+0000","last_became_peered":"2024-05-08T05:45:54.776756+0000","last_unstale":"2024-05-08T05:47:44.088260+0000","last_undegraded":"2024-05-08T05:47:44.088260+0000","last_fullsized":"2024-05-08T05:47:44.088260+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:54:27.320411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.783597+0000","last_change":"2024-05-08T05:46:45.783284+0000","last_active":"2024-05-08T05:46:45.783597+0000","last_peered":"2024-05-08T05:46:45.783597+0000","last_clean":"2024-05-08T05:46:45.783597+0000","last_became_active":"2024-05-08T05:46:45.765201+0000","last_became_peered":"2024-05-08T05:46:45.765201+0000","last_unstale":"2024-05-08T05:46:45.783597+0000","last_undegraded":"2024-05-08T05:46:45.783597+0000","last_fullsized":"2024-05-08T05:46:45.783597+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:44:59.762324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.105689+0000","last_change":"2024-05-08T05:45:54.789165+0000","last_active":"2024-05-08T05:47:44.105689+0000","last_peered":"2024-05-08T05:47:44.105689+0000","last_clean":"2024-05-08T05:47:44.105689+0000","last_became_active":"2024-05-08T05:45:54.788673+0000","last_became_peered":"2024-05-08T05:45:54.788673+0000","last_unstale":"2024-05-08T05:47:44.105689+0000","last_undegraded":"2024-05-08T05:47:44.105689+0000","last_fullsized":"2024-05-08T05:47:44.105689+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:29:08.722409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'5","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.956256+0000","last_change":"2024-05-08T05:45:50.750836+0000","last_active":"2024-05-08T05:46:45.956256+0000","last_peered":"2024-05-08T05:46:45.956256+0000","last_clean":"2024-05-08T05:46:45.956256+0000","last_became_active":"2024-05-08T05:45:50.750587+0000","last_became_peered":"2024-05-08T05:45:50.750587+0000","last_unstale":"2024-05-08T05:46:45.956256+0000","last_undegraded":"2024-05-08T05:46:45.956256+0000","last_fullsized":"2024-05-08T05:46:45.956256+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:19:03.780050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.096929+0000","last_change":"2024-05-08T05:45:54.791475+0000","last_active":"2024-05-08T05:47:44.096929+0000","last_peered":"2024-05-08T05:47:44.096929+0000","last_clean":"2024-05-08T05:47:44.096929+0000","last_became_active":"2024-05-08T05:45:54.791122+0000","last_became_peered":"2024-05-08T05:45:54.791122+0000","last_unstale":"2024-05-08T05:47:44.096929+0000","last_undegraded":"2024-05-08T05:47:44.096929+0000","last_fullsized":"2024-05-08T05:47:44.096929+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:08:01.261852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'6","reported_seq":268,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:50:08.408135+0000","last_change":"2024-05-08T05:45:50.742848+0000","last_active":"2024-05-08T05:50:08.408135+0000","last_peered":"2024-05-08T05:50:08.408135+0000","last_clean":"2024-05-08T05:50:08.408135+0000","last_became_active":"2024-05-08T05:45:50.742448+0000","last_became_peered":"2024-05-08T05:45:50.742448+0000","last_unstale":"2024-05-08T05:50:08.408135+0000","last_undegraded":"2024-05-08T05:50:08.408135+0000","last_fullsized":"2024-05-08T05:50:08.408135+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:17:35.970285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":236,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.083819+0000","last_change":"2024-05-08T05:45:54.773009+0000","last_active":"2024-05-08T05:47:44.083819+0000","last_peered":"2024-05-08T05:47:44.083819+0000","last_clean":"2024-05-08T05:47:44.083819+0000","last_became_active":"2024-05-08T05:45:54.772597+0000","last_became_peered":"2024-05-08T05:45:54.772597+0000","last_unstale":"2024-05-08T05:47:44.083819+0000","last_undegraded":"2024-05-08T05:47:44.083819+0000","last_fullsized":"2024-05-08T05:47:44.083819+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:41:31.632363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'17","reported_seq":45,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762777+0000","last_change":"2024-05-08T05:45:50.867734+0000","last_active":"2024-05-08T05:46:45.762777+0000","last_peered":"2024-05-08T05:46:45.762777+0000","last_clean":"2024-05-08T05:46:45.762777+0000","last_became_active":"2024-05-08T05:45:50.867441+0000","last_became_peered":"2024-05-08T05:45:50.867441+0000","last_unstale":"2024-05-08T05:46:45.762777+0000","last_undegraded":"2024-05-08T05:46:45.762777+0000","last_fullsized":"2024-05-08T05:46:45.762777+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:16:45.430432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.083526+0000","last_change":"2024-05-08T05:45:54.777168+0000","last_active":"2024-05-08T05:47:44.083526+0000","last_peered":"2024-05-08T05:47:44.083526+0000","last_clean":"2024-05-08T05:47:44.083526+0000","last_became_active":"2024-05-08T05:45:54.775985+0000","last_became_peered":"2024-05-08T05:45:54.775985+0000","last_unstale":"2024-05-08T05:47:44.083526+0000","last_undegraded":"2024-05-08T05:47:44.083526+0000","last_fullsized":"2024-05-08T05:47:44.083526+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:57:49.495860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762618+0000","last_change":"2024-05-08T05:45:50.741375+0000","last_active":"2024-05-08T05:46:45.762618+0000","last_peered":"2024-05-08T05:46:45.762618+0000","last_clean":"2024-05-08T05:46:45.762618+0000","last_became_active":"2024-05-08T05:45:50.741025+0000","last_became_peered":"2024-05-08T05:45:50.741025+0000","last_unstale":"2024-05-08T05:46:45.762618+0000","last_undegraded":"2024-05-08T05:46:45.762618+0000","last_fullsized":"2024-05-08T05:46:45.762618+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:01:43.515119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.082394+0000","last_change":"2024-05-08T05:45:54.780302+0000","last_active":"2024-05-08T05:47:44.082394+0000","last_peered":"2024-05-08T05:47:44.082394+0000","last_clean":"2024-05-08T05:47:44.082394+0000","last_became_active":"2024-05-08T05:45:54.778751+0000","last_became_peered":"2024-05-08T05:45:54.778751+0000","last_unstale":"2024-05-08T05:47:44.082394+0000","last_undegraded":"2024-05-08T05:47:44.082394+0000","last_fullsized":"2024-05-08T05:47:44.082394+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:34:57.686504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:59.165931+0000","last_change":"2024-05-08T05:45:50.870071+0000","last_active":"2024-05-08T05:47:59.165931+0000","last_peered":"2024-05-08T05:47:59.165931+0000","last_clean":"2024-05-08T05:47:59.165931+0000","last_became_active":"2024-05-08T05:45:50.869162+0000","last_became_peered":"2024-05-08T05:45:50.869162+0000","last_unstale":"2024-05-08T05:47:59.165931+0000","last_undegraded":"2024-05-08T05:47:59.165931+0000","last_fullsized":"2024-05-08T05:47:59.165931+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:05:13.104922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:48:01.442949+0000","last_change":"2024-05-08T05:45:54.780983+0000","last_active":"2024-05-08T05:48:01.442949+0000","last_peered":"2024-05-08T05:48:01.442949+0000","last_clean":"2024-05-08T05:48:01.442949+0000","last_became_active":"2024-05-08T05:45:54.780617+0000","last_became_peered":"2024-05-08T05:45:54.780617+0000","last_unstale":"2024-05-08T05:48:01.442949+0000","last_undegraded":"2024-05-08T05:48:01.442949+0000","last_fullsized":"2024-05-08T05:48:01.442949+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:56:40.972467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"80'5","reported_seq":266,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:50:08.501027+0000","last_change":"2024-05-08T05:45:50.748869+0000","last_active":"2024-05-08T05:50:08.501027+0000","last_peered":"2024-05-08T05:50:08.501027+0000","last_clean":"2024-05-08T05:50:08.501027+0000","last_became_active":"2024-05-08T05:45:50.748494+0000","last_became_peered":"2024-05-08T05:45:50.748494+0000","last_unstale":"2024-05-08T05:50:08.501027+0000","last_undegraded":"2024-05-08T05:50:08.501027+0000","last_fullsized":"2024-05-08T05:50:08.501027+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:12:25.227090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":233,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:48:01.442925+0000","last_change":"2024-05-08T05:45:54.802180+0000","last_active":"2024-05-08T05:48:01.442925+0000","last_peered":"2024-05-08T05:48:01.442925+0000","last_clean":"2024-05-08T05:48:01.442925+0000","last_became_active":"2024-05-08T05:45:54.801822+0000","last_became_peered":"2024-05-08T05:45:54.801822+0000","last_unstale":"2024-05-08T05:48:01.442925+0000","last_undegraded":"2024-05-08T05:48:01.442925+0000","last_fullsized":"2024-05-08T05:48:01.442925+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:52:11.802630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:54.989668+0000","last_change":"2024-05-08T05:45:54.770981+0000","last_active":"2024-05-08T05:47:54.989668+0000","last_peered":"2024-05-08T05:47:54.989668+0000","last_clean":"2024-05-08T05:47:54.989668+0000","last_became_active":"2024-05-08T05:45:54.770538+0000","last_became_peered":"2024-05-08T05:45:54.770538+0000","last_unstale":"2024-05-08T05:47:54.989668+0000","last_undegraded":"2024-05-08T05:47:54.989668+0000","last_fullsized":"2024-05-08T05:47:54.989668+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:32:34.699752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"82'6","reported_seq":266,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:50:07.404447+0000","last_change":"2024-05-08T05:45:50.864189+0000","last_active":"2024-05-08T05:50:07.404447+0000","last_peered":"2024-05-08T05:50:07.404447+0000","last_clean":"2024-05-08T05:50:07.404447+0000","last_became_active":"2024-05-08T05:45:50.863170+0000","last_became_peered":"2024-05-08T05:45:50.863170+0000","last_unstale":"2024-05-08T05:50:07.404447+0000","last_undegraded":"2024-05-08T05:50:07.404447+0000","last_fullsized":"2024-05-08T05:50:07.404447+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:44:33.109166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":232,"num_read_kb":232,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:59.179674+0000","last_change":"2024-05-08T05:45:54.792347+0000","last_active":"2024-05-08T05:47:59.179674+0000","last_peered":"2024-05-08T05:47:59.179674+0000","last_clean":"2024-05-08T05:47:59.179674+0000","last_became_active":"2024-05-08T05:45:54.791767+0000","last_became_peered":"2024-05-08T05:45:54.791767+0000","last_unstale":"2024-05-08T05:47:59.179674+0000","last_undegraded":"2024-05-08T05:47:59.179674+0000","last_fullsized":"2024-05-08T05:47:59.179674+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:03:46.354687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"80'6","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:55.165375+0000","last_change":"2024-05-08T05:45:50.748659+0000","last_active":"2024-05-08T05:47:55.165375+0000","last_peered":"2024-05-08T05:47:55.165375+0000","last_clean":"2024-05-08T05:47:55.165375+0000","last_became_active":"2024-05-08T05:45:50.748279+0000","last_became_peered":"2024-05-08T05:45:50.748279+0000","last_unstale":"2024-05-08T05:47:55.165375+0000","last_undegraded":"2024-05-08T05:47:55.165375+0000","last_fullsized":"2024-05-08T05:47:55.165375+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:42:25.892715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":102,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:54.651328+0000","last_change":"2024-05-08T05:44:18.365376+0000","last_active":"2024-05-08T05:46:54.651328+0000","last_peered":"2024-05-08T05:46:54.651328+0000","last_clean":"2024-05-08T05:46:54.651328+0000","last_became_active":"2024-05-08T05:44:18.360156+0000","last_became_peered":"2024-05-08T05:44:18.360156+0000","last_unstale":"2024-05-08T05:46:54.651328+0000","last_undegraded":"2024-05-08T05:46:54.651328+0000","last_fullsized":"2024-05-08T05:46:54.651328+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:40:28.502228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:40:28.502228+0000","last_clean_scrub_stamp":"2024-05-08T05:40:28.502228+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:38:20.339163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:59.108848+0000","last_change":"2024-05-08T05:45:54.775625+0000","last_active":"2024-05-08T05:47:59.108848+0000","last_peered":"2024-05-08T05:47:59.108848+0000","last_clean":"2024-05-08T05:47:59.108848+0000","last_became_active":"2024-05-08T05:45:54.774661+0000","last_became_peered":"2024-05-08T05:45:54.774661+0000","last_unstale":"2024-05-08T05:47:59.108848+0000","last_undegraded":"2024-05-08T05:47:59.108848+0000","last_fullsized":"2024-05-08T05:47:59.108848+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:57:05.676092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"80'4","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:54.657532+0000","last_change":"2024-05-08T05:45:50.747823+0000","last_active":"2024-05-08T05:47:54.657532+0000","last_peered":"2024-05-08T05:47:54.657532+0000","last_clean":"2024-05-08T05:47:54.657532+0000","last_became_active":"2024-05-08T05:45:50.747222+0000","last_became_peered":"2024-05-08T05:45:50.747222+0000","last_unstale":"2024-05-08T05:47:54.657532+0000","last_undegraded":"2024-05-08T05:47:54.657532+0000","last_fullsized":"2024-05-08T05:47:54.657532+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:49:06.238468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"80'4","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:54.798564+0000","last_change":"2024-05-08T05:45:50.861721+0000","last_active":"2024-05-08T05:47:54.798564+0000","last_peered":"2024-05-08T05:47:54.798564+0000","last_clean":"2024-05-08T05:47:54.798564+0000","last_became_active":"2024-05-08T05:45:50.861369+0000","last_became_peered":"2024-05-08T05:45:50.861369+0000","last_unstale":"2024-05-08T05:47:54.798564+0000","last_undegraded":"2024-05-08T05:47:54.798564+0000","last_fullsized":"2024-05-08T05:47:54.798564+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:35:19.781796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:59.108978+0000","last_change":"2024-05-08T05:45:54.787260+0000","last_active":"2024-05-08T05:47:59.108978+0000","last_peered":"2024-05-08T05:47:59.108978+0000","last_clean":"2024-05-08T05:47:59.108978+0000","last_became_active":"2024-05-08T05:45:54.786897+0000","last_became_peered":"2024-05-08T05:45:54.786897+0000","last_unstale":"2024-05-08T05:47:59.108978+0000","last_undegraded":"2024-05-08T05:47:59.108978+0000","last_fullsized":"2024-05-08T05:47:59.108978+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:10:06.761165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'19","reported_seq":46,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:50:03.861026+0000","last_change":"2024-05-08T05:45:50.746160+0000","last_active":"2024-05-08T05:50:03.861026+0000","last_peered":"2024-05-08T05:50:03.861026+0000","last_clean":"2024-05-08T05:50:03.861026+0000","last_became_active":"2024-05-08T05:45:50.745630+0000","last_became_peered":"2024-05-08T05:45:50.745630+0000","last_unstale":"2024-05-08T05:50:03.861026+0000","last_undegraded":"2024-05-08T05:50:03.861026+0000","last_fullsized":"2024-05-08T05:50:03.861026+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:45:27.593902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.100379+0000","last_change":"2024-05-08T05:45:54.797162+0000","last_active":"2024-05-08T05:47:44.100379+0000","last_peered":"2024-05-08T05:47:44.100379+0000","last_clean":"2024-05-08T05:47:44.100379+0000","last_became_active":"2024-05-08T05:45:54.796859+0000","last_became_peered":"2024-05-08T05:45:54.796859+0000","last_unstale":"2024-05-08T05:47:44.100379+0000","last_undegraded":"2024-05-08T05:47:44.100379+0000","last_fullsized":"2024-05-08T05:47:44.100379+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:51:25.701160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'7","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:48:00.165958+0000","last_change":"2024-05-08T05:45:50.744793+0000","last_active":"2024-05-08T05:48:00.165958+0000","last_peered":"2024-05-08T05:48:00.165958+0000","last_clean":"2024-05-08T05:48:00.165958+0000","last_became_active":"2024-05-08T05:45:50.744407+0000","last_became_peered":"2024-05-08T05:45:50.744407+0000","last_unstale":"2024-05-08T05:48:00.165958+0000","last_undegraded":"2024-05-08T05:48:00.165958+0000","last_fullsized":"2024-05-08T05:48:00.165958+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:18:17.029402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.110900+0000","last_change":"2024-05-08T05:45:54.797042+0000","last_active":"2024-05-08T05:47:44.110900+0000","last_peered":"2024-05-08T05:47:44.110900+0000","last_clean":"2024-05-08T05:47:44.110900+0000","last_became_active":"2024-05-08T05:45:54.795796+0000","last_became_peered":"2024-05-08T05:45:54.795796+0000","last_unstale":"2024-05-08T05:47:44.110900+0000","last_undegraded":"2024-05-08T05:47:44.110900+0000","last_fullsized":"2024-05-08T05:47:44.110900+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:20:10.789348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.766092+0000","last_change":"2024-05-08T05:45:50.860466+0000","last_active":"2024-05-08T05:46:45.766092+0000","last_peered":"2024-05-08T05:46:45.766092+0000","last_clean":"2024-05-08T05:46:45.766092+0000","last_became_active":"2024-05-08T05:45:50.860093+0000","last_became_peered":"2024-05-08T05:45:50.860093+0000","last_unstale":"2024-05-08T05:46:45.766092+0000","last_undegraded":"2024-05-08T05:46:45.766092+0000","last_fullsized":"2024-05-08T05:46:45.766092+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:42:37.799098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.076334+0000","last_change":"2024-05-08T05:45:54.774635+0000","last_active":"2024-05-08T05:47:44.076334+0000","last_peered":"2024-05-08T05:47:44.076334+0000","last_clean":"2024-05-08T05:47:44.076334+0000","last_became_active":"2024-05-08T05:45:54.774288+0000","last_became_peered":"2024-05-08T05:45:54.774288+0000","last_unstale":"2024-05-08T05:47:44.076334+0000","last_undegraded":"2024-05-08T05:47:44.076334+0000","last_fullsized":"2024-05-08T05:47:44.076334+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:55:59.787540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'7","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.761999+0000","last_change":"2024-05-08T05:45:50.750830+0000","last_active":"2024-05-08T05:46:45.761999+0000","last_peered":"2024-05-08T05:46:45.761999+0000","last_clean":"2024-05-08T05:46:45.761999+0000","last_became_active":"2024-05-08T05:45:50.750473+0000","last_became_peered":"2024-05-08T05:45:50.750473+0000","last_unstale":"2024-05-08T05:46:45.761999+0000","last_undegraded":"2024-05-08T05:46:45.761999+0000","last_fullsized":"2024-05-08T05:46:45.761999+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:04:14.314865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.098673+0000","last_change":"2024-05-08T05:45:54.800008+0000","last_active":"2024-05-08T05:47:44.098673+0000","last_peered":"2024-05-08T05:47:44.098673+0000","last_clean":"2024-05-08T05:47:44.098673+0000","last_became_active":"2024-05-08T05:45:54.799615+0000","last_became_peered":"2024-05-08T05:45:54.799615+0000","last_unstale":"2024-05-08T05:47:44.098673+0000","last_undegraded":"2024-05-08T05:47:44.098673+0000","last_fullsized":"2024-05-08T05:47:44.098673+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:58:12.907617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'5","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:50:03.936259+0000","last_change":"2024-05-08T05:45:50.745088+0000","last_active":"2024-05-08T05:50:03.936259+0000","last_peered":"2024-05-08T05:50:03.936259+0000","last_clean":"2024-05-08T05:50:03.936259+0000","last_became_active":"2024-05-08T05:45:50.744735+0000","last_became_peered":"2024-05-08T05:45:50.744735+0000","last_unstale":"2024-05-08T05:50:03.936259+0000","last_undegraded":"2024-05-08T05:50:03.936259+0000","last_fullsized":"2024-05-08T05:50:03.936259+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:39:12.404233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.104706+0000","last_change":"2024-05-08T05:45:54.803875+0000","last_active":"2024-05-08T05:47:44.104706+0000","last_peered":"2024-05-08T05:47:44.104706+0000","last_clean":"2024-05-08T05:47:44.104706+0000","last_became_active":"2024-05-08T05:45:54.803504+0000","last_became_peered":"2024-05-08T05:45:54.803504+0000","last_unstale":"2024-05-08T05:47:44.104706+0000","last_undegraded":"2024-05-08T05:47:44.104706+0000","last_fullsized":"2024-05-08T05:47:44.104706+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:49:33.419868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.763106+0000","last_change":"2024-05-08T05:45:50.741351+0000","last_active":"2024-05-08T05:46:45.763106+0000","last_peered":"2024-05-08T05:46:45.763106+0000","last_clean":"2024-05-08T05:46:45.763106+0000","last_became_active":"2024-05-08T05:45:50.740970+0000","last_became_peered":"2024-05-08T05:45:50.740970+0000","last_unstale":"2024-05-08T05:46:45.763106+0000","last_undegraded":"2024-05-08T05:46:45.763106+0000","last_fullsized":"2024-05-08T05:46:45.763106+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:31:02.093446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.096731+0000","last_change":"2024-05-08T05:45:54.792665+0000","last_active":"2024-05-08T05:47:44.096731+0000","last_peered":"2024-05-08T05:47:44.096731+0000","last_clean":"2024-05-08T05:47:44.096731+0000","last_became_active":"2024-05-08T05:45:54.792309+0000","last_became_peered":"2024-05-08T05:45:54.792309+0000","last_unstale":"2024-05-08T05:47:44.096731+0000","last_undegraded":"2024-05-08T05:47:44.096731+0000","last_fullsized":"2024-05-08T05:47:44.096731+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:48:29.154009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'8","reported_seq":269,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:50:05.462113+0000","last_change":"2024-05-08T05:45:50.861234+0000","last_active":"2024-05-08T05:50:05.462113+0000","last_peered":"2024-05-08T05:50:05.462113+0000","last_clean":"2024-05-08T05:50:05.462113+0000","last_became_active":"2024-05-08T05:45:50.860885+0000","last_became_peered":"2024-05-08T05:45:50.860885+0000","last_unstale":"2024-05-08T05:50:05.462113+0000","last_undegraded":"2024-05-08T05:50:05.462113+0000","last_fullsized":"2024-05-08T05:50:05.462113+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:59:50.300316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2093,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":234,"num_read_kb":5,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.096172+0000","last_change":"2024-05-08T05:45:54.781154+0000","last_active":"2024-05-08T05:47:44.096172+0000","last_peered":"2024-05-08T05:47:44.096172+0000","last_clean":"2024-05-08T05:47:44.096172+0000","last_became_active":"2024-05-08T05:45:54.780340+0000","last_became_peered":"2024-05-08T05:45:54.780340+0000","last_unstale":"2024-05-08T05:47:44.096172+0000","last_undegraded":"2024-05-08T05:47:44.096172+0000","last_fullsized":"2024-05-08T05:47:44.096172+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:22:39.614532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'3","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.956451+0000","last_change":"2024-05-08T05:45:50.748015+0000","last_active":"2024-05-08T05:46:45.956451+0000","last_peered":"2024-05-08T05:46:45.956451+0000","last_clean":"2024-05-08T05:46:45.956451+0000","last_became_active":"2024-05-08T05:45:50.747649+0000","last_became_peered":"2024-05-08T05:45:50.747649+0000","last_unstale":"2024-05-08T05:46:45.956451+0000","last_undegraded":"2024-05-08T05:46:45.956451+0000","last_fullsized":"2024-05-08T05:46:45.956451+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:31:49.177676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.103573+0000","last_change":"2024-05-08T05:45:54.779680+0000","last_active":"2024-05-08T05:47:44.103573+0000","last_peered":"2024-05-08T05:47:44.103573+0000","last_clean":"2024-05-08T05:47:44.103573+0000","last_became_active":"2024-05-08T05:45:54.779273+0000","last_became_peered":"2024-05-08T05:45:54.779273+0000","last_unstale":"2024-05-08T05:47:44.103573+0000","last_undegraded":"2024-05-08T05:47:44.103573+0000","last_fullsized":"2024-05-08T05:47:44.103573+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:40:05.192134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"80'5","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.770430+0000","last_change":"2024-05-08T05:45:50.744569+0000","last_active":"2024-05-08T05:46:45.770430+0000","last_peered":"2024-05-08T05:46:45.770430+0000","last_clean":"2024-05-08T05:46:45.770430+0000","last_became_active":"2024-05-08T05:45:50.744164+0000","last_became_peered":"2024-05-08T05:45:50.744164+0000","last_unstale":"2024-05-08T05:46:45.770430+0000","last_undegraded":"2024-05-08T05:46:45.770430+0000","last_fullsized":"2024-05-08T05:46:45.770430+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:17:56.409110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.087373+0000","last_change":"2024-05-08T05:45:54.776338+0000","last_active":"2024-05-08T05:47:44.087373+0000","last_peered":"2024-05-08T05:47:44.087373+0000","last_clean":"2024-05-08T05:47:44.087373+0000","last_became_active":"2024-05-08T05:45:54.776015+0000","last_became_peered":"2024-05-08T05:45:54.776015+0000","last_unstale":"2024-05-08T05:47:44.087373+0000","last_undegraded":"2024-05-08T05:47:44.087373+0000","last_fullsized":"2024-05-08T05:47:44.087373+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:38:10.608436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:48:00.719465+0000","last_change":"2024-05-08T05:45:54.782245+0000","last_active":"2024-05-08T05:48:00.719465+0000","last_peered":"2024-05-08T05:48:00.719465+0000","last_clean":"2024-05-08T05:48:00.719465+0000","last_became_active":"2024-05-08T05:45:54.781860+0000","last_became_peered":"2024-05-08T05:45:54.781860+0000","last_unstale":"2024-05-08T05:48:00.719465+0000","last_undegraded":"2024-05-08T05:48:00.719465+0000","last_fullsized":"2024-05-08T05:48:00.719465+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:50:14.658930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:48:02.137027+0000","last_change":"2024-05-08T05:45:54.770787+0000","last_active":"2024-05-08T05:48:02.137027+0000","last_peered":"2024-05-08T05:48:02.137027+0000","last_clean":"2024-05-08T05:48:02.137027+0000","last_became_active":"2024-05-08T05:45:54.770409+0000","last_became_peered":"2024-05-08T05:45:54.770409+0000","last_unstale":"2024-05-08T05:48:02.137027+0000","last_undegraded":"2024-05-08T05:48:02.137027+0000","last_fullsized":"2024-05-08T05:48:02.137027+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:09:31.102075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:48:02.137056+0000","last_change":"2024-05-08T05:45:54.788799+0000","last_active":"2024-05-08T05:48:02.137056+0000","last_peered":"2024-05-08T05:48:02.137056+0000","last_clean":"2024-05-08T05:48:02.137056+0000","last_became_active":"2024-05-08T05:45:54.788295+0000","last_became_peered":"2024-05-08T05:45:54.788295+0000","last_unstale":"2024-05-08T05:48:02.137056+0000","last_undegraded":"2024-05-08T05:48:02.137056+0000","last_fullsized":"2024-05-08T05:48:02.137056+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:55:07.912479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:48:02.673023+0000","last_change":"2024-05-08T05:45:54.801316+0000","last_active":"2024-05-08T05:48:02.673023+0000","last_peered":"2024-05-08T05:48:02.673023+0000","last_clean":"2024-05-08T05:48:02.673023+0000","last_became_active":"2024-05-08T05:45:54.798655+0000","last_became_peered":"2024-05-08T05:45:54.798655+0000","last_unstale":"2024-05-08T05:48:02.673023+0000","last_undegraded":"2024-05-08T05:48:02.673023+0000","last_fullsized":"2024-05-08T05:48:02.673023+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:30:25.786822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.100854+0000","last_change":"2024-05-08T05:45:54.793076+0000","last_active":"2024-05-08T05:47:44.100854+0000","last_peered":"2024-05-08T05:47:44.100854+0000","last_clean":"2024-05-08T05:47:44.100854+0000","last_became_active":"2024-05-08T05:45:54.792726+0000","last_became_peered":"2024-05-08T05:45:54.792726+0000","last_unstale":"2024-05-08T05:47:44.100854+0000","last_undegraded":"2024-05-08T05:47:44.100854+0000","last_fullsized":"2024-05-08T05:47:44.100854+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:46:02.659667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.081706+0000","last_change":"2024-05-08T05:45:54.779134+0000","last_active":"2024-05-08T05:47:44.081706+0000","last_peered":"2024-05-08T05:47:44.081706+0000","last_clean":"2024-05-08T05:47:44.081706+0000","last_became_active":"2024-05-08T05:45:54.778764+0000","last_became_peered":"2024-05-08T05:45:54.778764+0000","last_unstale":"2024-05-08T05:47:44.081706+0000","last_undegraded":"2024-05-08T05:47:44.081706+0000","last_fullsized":"2024-05-08T05:47:44.081706+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:10:00.531228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.077624+0000","last_change":"2024-05-08T05:45:54.775628+0000","last_active":"2024-05-08T05:47:44.077624+0000","last_peered":"2024-05-08T05:47:44.077624+0000","last_clean":"2024-05-08T05:47:44.077624+0000","last_became_active":"2024-05-08T05:45:54.775293+0000","last_became_peered":"2024-05-08T05:45:54.775293+0000","last_unstale":"2024-05-08T05:47:44.077624+0000","last_undegraded":"2024-05-08T05:47:44.077624+0000","last_fullsized":"2024-05-08T05:47:44.077624+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:02:57.884691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.100249+0000","last_change":"2024-05-08T05:45:54.805054+0000","last_active":"2024-05-08T05:47:44.100249+0000","last_peered":"2024-05-08T05:47:44.100249+0000","last_clean":"2024-05-08T05:47:44.100249+0000","last_became_active":"2024-05-08T05:45:54.804642+0000","last_became_peered":"2024-05-08T05:45:54.804642+0000","last_unstale":"2024-05-08T05:47:44.100249+0000","last_undegraded":"2024-05-08T05:47:44.100249+0000","last_fullsized":"2024-05-08T05:47:44.100249+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:17:22.412759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.103859+0000","last_change":"2024-05-08T05:45:54.792217+0000","last_active":"2024-05-08T05:47:44.103859+0000","last_peered":"2024-05-08T05:47:44.103859+0000","last_clean":"2024-05-08T05:47:44.103859+0000","last_became_active":"2024-05-08T05:45:54.791508+0000","last_became_peered":"2024-05-08T05:45:54.791508+0000","last_unstale":"2024-05-08T05:47:44.103859+0000","last_undegraded":"2024-05-08T05:47:44.103859+0000","last_fullsized":"2024-05-08T05:47:44.103859+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:47:19.053306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.108264+0000","last_change":"2024-05-08T05:45:54.794538+0000","last_active":"2024-05-08T05:47:44.108264+0000","last_peered":"2024-05-08T05:47:44.108264+0000","last_clean":"2024-05-08T05:47:44.108264+0000","last_became_active":"2024-05-08T05:45:54.792575+0000","last_became_peered":"2024-05-08T05:45:54.792575+0000","last_unstale":"2024-05-08T05:47:44.108264+0000","last_undegraded":"2024-05-08T05:47:44.108264+0000","last_fullsized":"2024-05-08T05:47:44.108264+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:54:31.086864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.107048+0000","last_change":"2024-05-08T05:45:54.782828+0000","last_active":"2024-05-08T05:47:44.107048+0000","last_peered":"2024-05-08T05:47:44.107048+0000","last_clean":"2024-05-08T05:47:44.107048+0000","last_became_active":"2024-05-08T05:45:54.782442+0000","last_became_peered":"2024-05-08T05:45:54.782442+0000","last_unstale":"2024-05-08T05:47:44.107048+0000","last_undegraded":"2024-05-08T05:47:44.107048+0000","last_fullsized":"2024-05-08T05:47:44.107048+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:42:53.551455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.100977+0000","last_change":"2024-05-08T05:45:54.800422+0000","last_active":"2024-05-08T05:47:44.100977+0000","last_peered":"2024-05-08T05:47:44.100977+0000","last_clean":"2024-05-08T05:47:44.100977+0000","last_became_active":"2024-05-08T05:45:54.799853+0000","last_became_peered":"2024-05-08T05:45:54.799853+0000","last_unstale":"2024-05-08T05:47:44.100977+0000","last_undegraded":"2024-05-08T05:47:44.100977+0000","last_fullsized":"2024-05-08T05:47:44.100977+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:54:22.710347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.104228+0000","last_change":"2024-05-08T05:46:45.775876+0000","last_active":"2024-05-08T05:47:44.104228+0000","last_peered":"2024-05-08T05:47:44.104228+0000","last_clean":"2024-05-08T05:47:44.104228+0000","last_became_active":"2024-05-08T05:46:45.775558+0000","last_became_peered":"2024-05-08T05:46:45.775558+0000","last_unstale":"2024-05-08T05:47:44.104228+0000","last_undegraded":"2024-05-08T05:47:44.104228+0000","last_fullsized":"2024-05-08T05:47:44.104228+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:11:38.649137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":311296,"data_stored":3542208,"data_compressed":212518,"data_compressed_allocated":270336,"data_compressed_original":3522560,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":82141,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":2340,"num_read_kb":1249,"num_write":273,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":55290,"num_keys_recovered":20,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":561152,"data_stored":246423,"data_compressed":9129,"data_compressed_allocated":12288,"data_compressed_original":53248,"omap_allocated":0,"internal_metadata":0},"log_size":233,"ondisk_log_size":233,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645379,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":901120,"data_stored":436421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841610,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32212,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712940,"statfs":{"total":95995035648,"available":95962050560,"internally_reserved":0,"allocated":1060864,"data_stored":1100554,"data_compressed":35691,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037839,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":917504,"data_stored":435360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234069,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":913408,"data_stored":435738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430298,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":1028957,"data_compressed":35691,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593825,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":901120,"data_stored":435077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574972,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":974848,"data_stored":509694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738497,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":921600,"data_stored":437339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411448,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":905216,"data_stored":437766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149809,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":917504,"data_stored":434902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953579,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":942080,"data_stored":509033,"data_compressed":9129,"data_compressed_allocated":12288,"data_compressed_original":53248,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790054,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":978944,"data_stored":1028244,"data_compressed":35691,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34063,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35691,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35691,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35691,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35691,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35691,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":75456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":74795,"data_compressed":9129,"data_compressed_allocated":12288,"data_compressed_original":53248,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":75831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T05:50:11.248 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T05:50:11.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.489+0000 7f1d75400640 1 -- 172.21.15.82:0/3445963105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d70100f20 msgr2=0x7f1d70101340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:11.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.489+0000 7f1d75400640 1 --2- 172.21.15.82:0/3445963105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d70100f20 0x7f1d70101340 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1d60009900 tx=0x7f1d6002a410 comp rx=0 tx=0).stop 2024-05-08T05:50:11.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.489+0000 7f1d75400640 1 -- 172.21.15.82:0/3445963105 shutdown_connections 2024-05-08T05:50:11.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.489+0000 7f1d75400640 1 --2- 172.21.15.82:0/3445963105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d70102a30 0x7f1d70109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:11.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.489+0000 7f1d75400640 1 --2- 172.21.15.82:0/3445963105 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d70102070 0x7f1d701024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:11.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.489+0000 7f1d75400640 1 --2- 172.21.15.82:0/3445963105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d70100f20 0x7f1d70101340 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:11.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.489+0000 7f1d75400640 1 -- 172.21.15.82:0/3445963105 >> 172.21.15.82:0/3445963105 conn(0x7f1d700fc4b0 msgr2=0x7f1d700fe8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:50:11.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.489+0000 7f1d75400640 1 -- 172.21.15.82:0/3445963105 shutdown_connections 2024-05-08T05:50:11.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.489+0000 7f1d75400640 1 -- 172.21.15.82:0/3445963105 wait complete. 2024-05-08T05:50:11.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.490+0000 7f1d75400640 1 Processor -- start 2024-05-08T05:50:11.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.491+0000 7f1d75400640 1 -- start start 2024-05-08T05:50:11.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.491+0000 7f1d75400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d70100f20 0x7f1d7019ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:11.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.491+0000 7f1d75400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d70102070 0x7f1d7019b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:11.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.491+0000 7f1d75400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d70102a30 0x7f1d701a2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:11.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.491+0000 7f1d75400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1d7010e410 con 0x7f1d70102070 2024-05-08T05:50:11.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.491+0000 7f1d75400640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1d7010e290 con 0x7f1d70102a30 2024-05-08T05:50:11.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.491+0000 7f1d75400640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1d7010e590 con 0x7f1d70100f20 2024-05-08T05:50:11.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.491+0000 7f1d67400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d70102070 0x7f1d7019b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:11.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.491+0000 7f1d74a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d70102a30 0x7f1d701a2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:11.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.491+0000 7f1d67400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d70102070 0x7f1d7019b2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53486/0 (socket says 172.21.15.82:53486) 2024-05-08T05:50:11.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.491+0000 7f1d74a00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d70102a30 0x7f1d701a2290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:44826/0 (socket says 172.21.15.82:44826) 2024-05-08T05:50:11.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.491+0000 7f1d67400640 1 -- 172.21.15.82:0/3681885362 learned_addr learned my addr 172.21.15.82:0/3681885362 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:50:11.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.491+0000 7f1d6fe00640 1 --2- 172.21.15.82:0/3681885362 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d70100f20 0x7f1d7019ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:11.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.492+0000 7f1d67400640 1 -- 172.21.15.82:0/3681885362 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d70100f20 msgr2=0x7f1d7019ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:11.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.492+0000 7f1d67400640 1 --2- 172.21.15.82:0/3681885362 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d70100f20 0x7f1d7019ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:11.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.492+0000 7f1d67400640 1 -- 172.21.15.82:0/3681885362 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d70102a30 msgr2=0x7f1d701a2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:11.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.492+0000 7f1d67400640 1 --2- 172.21.15.82:0/3681885362 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d70102a30 0x7f1d701a2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:11.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.492+0000 7f1d67400640 1 -- 172.21.15.82:0/3681885362 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d701a2930 con 0x7f1d70102070 2024-05-08T05:50:11.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.492+0000 7f1d74a00640 1 --2- 172.21.15.82:0/3681885362 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d70102a30 0x7f1d701a2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:50:11.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.492+0000 7f1d67400640 1 --2- 172.21.15.82:0/3681885362 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d70102070 0x7f1d7019b2b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1d5800e9c0 tx=0x7f1d5800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:50:11.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.492+0000 7f1d6d600640 1 -- 172.21.15.82:0/3681885362 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d5800cd80 con 0x7f1d70102070 2024-05-08T05:50:11.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.492+0000 7f1d6d600640 1 -- 172.21.15.82:0/3681885362 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1d580035f0 con 0x7f1d70102070 2024-05-08T05:50:11.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.492+0000 7f1d6d600640 1 -- 172.21.15.82:0/3681885362 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d58010690 con 0x7f1d70102070 2024-05-08T05:50:11.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.492+0000 7f1d75400640 1 -- 172.21.15.82:0/3681885362 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d701a2c20 con 0x7f1d70102070 2024-05-08T05:50:11.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.493+0000 7f1d75400640 1 -- 172.21.15.82:0/3681885362 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d701a30f0 con 0x7f1d70102070 2024-05-08T05:50:11.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.494+0000 7f1d75400640 1 -- 172.21.15.82:0/3681885362 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d701a3320 con 0x7f1d70102070 2024-05-08T05:50:11.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.496+0000 7f1d6d600640 1 -- 172.21.15.82:0/3681885362 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 149703+0+0 (secure 0 0 0) 0x7f1d58004000 con 0x7f1d70102070 2024-05-08T05:50:11.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.497+0000 7f1d6d600640 1 --2- 172.21.15.82:0/3681885362 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f1d540b2900 0x7f1d540b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:11.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.498+0000 7f1d6d600640 1 -- 172.21.15.82:0/3681885362 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f1d580e28d0 con 0x7f1d70102070 2024-05-08T05:50:11.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.498+0000 7f1d6fe00640 1 --2- 172.21.15.82:0/3681885362 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f1d540b2900 0x7f1d540b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:11.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.498+0000 7f1d6fe00640 1 --2- 172.21.15.82:0/3681885362 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f1d540b2900 0x7f1d540b4dc0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1d60031500 tx=0x7f1d60005a20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:50:11.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.502+0000 7f1d6d600640 1 -- 172.21.15.82:0/3681885362 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1d580aa440 con 0x7f1d70102070 2024-05-08T05:50:11.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.705+0000 7f1d75400640 1 -- 172.21.15.82:0/3681885362 --> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1d701a34f0 con 0x7f1d540b2900 2024-05-08T05:50:11.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:50:11 smithi082 ceph-mon[30098]: pgmap v445: 97 pgs: 97 active+clean; 657 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-05-08T05:50:11.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.729+0000 7f1d6d600640 1 -- 172.21.15.82:0/3681885362 <== mgr.14152 v2:172.21.15.82:6800/4089180091 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259043 (secure 0 0 0) 0x7f1d701a34f0 con 0x7f1d540b2900 2024-05-08T05:50:11.733 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:50:11.734 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-05-08T05:50:11.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.734+0000 7f1d75400640 1 -- 172.21.15.82:0/3681885362 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f1d540b2900 msgr2=0x7f1d540b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:11.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.734+0000 7f1d75400640 1 --2- 172.21.15.82:0/3681885362 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f1d540b2900 0x7f1d540b4dc0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1d60031500 tx=0x7f1d60005a20 comp rx=0 tx=0).stop 2024-05-08T05:50:11.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.734+0000 7f1d75400640 1 -- 172.21.15.82:0/3681885362 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d70102070 msgr2=0x7f1d7019b2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:11.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.734+0000 7f1d75400640 1 --2- 172.21.15.82:0/3681885362 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d70102070 0x7f1d7019b2b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1d5800e9c0 tx=0x7f1d5800ee80 comp rx=0 tx=0).stop 2024-05-08T05:50:11.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.734+0000 7f1d75400640 1 -- 172.21.15.82:0/3681885362 shutdown_connections 2024-05-08T05:50:11.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.734+0000 7f1d75400640 1 --2- 172.21.15.82:0/3681885362 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f1d540b2900 0x7f1d540b4dc0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:11.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.734+0000 7f1d75400640 1 --2- 172.21.15.82:0/3681885362 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d70102a30 0x7f1d701a2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:11.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.734+0000 7f1d75400640 1 --2- 172.21.15.82:0/3681885362 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1d70102070 0x7f1d7019b2b0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:11.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.734+0000 7f1d75400640 1 --2- 172.21.15.82:0/3681885362 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d70100f20 0x7f1d7019ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:11.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.734+0000 7f1d75400640 1 -- 172.21.15.82:0/3681885362 >> 172.21.15.82:0/3681885362 conn(0x7f1d700fc4b0 msgr2=0x7f1d7010ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:50:11.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.734+0000 7f1d75400640 1 -- 172.21.15.82:0/3681885362 shutdown_connections 2024-05-08T05:50:11.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:11.734+0000 7f1d75400640 1 -- 172.21.15.82:0/3681885362 wait complete. 2024-05-08T05:50:11.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:50:11 smithi134 ceph-mon[34132]: pgmap v445: 97 pgs: 97 active+clean; 657 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-05-08T05:50:11.755 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":445,"stamp":"2024-05-08T05:50:10.204888+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":672743,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":2416,"num_read_kb":1313,"num_write":398,"num_write_kb":2319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":3007130,"num_keys_recovered":20,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":827,"ondisk_log_size":827,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":351868,"kb_used_data":11036,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124589956,"statfs":{"total":1151940427776,"available":1151580114944,"internally_reserved":0,"allocated":11300864,"data_stored":7229085,"data_compressed":116202,"data_compressed_allocated":147456,"data_compressed_original":1822720,"omap_allocated":19138,"internal_metadata":348894526},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9018,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":72,"num_write":19,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004999"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:48:00.719508+0000","last_change":"2024-05-08T05:45:54.796792+0000","last_active":"2024-05-08T05:48:00.719508+0000","last_peered":"2024-05-08T05:48:00.719508+0000","last_clean":"2024-05-08T05:48:00.719508+0000","last_became_active":"2024-05-08T05:45:54.796445+0000","last_became_peered":"2024-05-08T05:45:54.796445+0000","last_unstale":"2024-05-08T05:48:00.719508+0000","last_undegraded":"2024-05-08T05:48:00.719508+0000","last_fullsized":"2024-05-08T05:48:00.719508+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:41:12.762659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:48:02.673136+0000","last_change":"2024-05-08T05:45:54.800291+0000","last_active":"2024-05-08T05:48:02.673136+0000","last_peered":"2024-05-08T05:48:02.673136+0000","last_clean":"2024-05-08T05:48:02.673136+0000","last_became_active":"2024-05-08T05:45:54.798182+0000","last_became_peered":"2024-05-08T05:45:54.798182+0000","last_unstale":"2024-05-08T05:48:02.673136+0000","last_undegraded":"2024-05-08T05:48:02.673136+0000","last_fullsized":"2024-05-08T05:48:02.673136+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:55:52.672307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:48:02.673095+0000","last_change":"2024-05-08T05:45:54.792574+0000","last_active":"2024-05-08T05:48:02.673095+0000","last_peered":"2024-05-08T05:48:02.673095+0000","last_clean":"2024-05-08T05:48:02.673095+0000","last_became_active":"2024-05-08T05:45:54.790856+0000","last_became_peered":"2024-05-08T05:45:54.790856+0000","last_unstale":"2024-05-08T05:48:02.673095+0000","last_undegraded":"2024-05-08T05:48:02.673095+0000","last_fullsized":"2024-05-08T05:48:02.673095+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:32:33.727532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:55.165392+0000","last_change":"2024-05-08T05:45:54.772883+0000","last_active":"2024-05-08T05:47:55.165392+0000","last_peered":"2024-05-08T05:47:55.165392+0000","last_clean":"2024-05-08T05:47:55.165392+0000","last_became_active":"2024-05-08T05:45:54.772457+0000","last_became_peered":"2024-05-08T05:45:54.772457+0000","last_unstale":"2024-05-08T05:47:55.165392+0000","last_undegraded":"2024-05-08T05:47:55.165392+0000","last_fullsized":"2024-05-08T05:47:55.165392+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:50:20.116563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.104530+0000","last_change":"2024-05-08T05:45:54.798868+0000","last_active":"2024-05-08T05:47:44.104530+0000","last_peered":"2024-05-08T05:47:44.104530+0000","last_clean":"2024-05-08T05:47:44.104530+0000","last_became_active":"2024-05-08T05:45:54.798459+0000","last_became_peered":"2024-05-08T05:45:54.798459+0000","last_unstale":"2024-05-08T05:47:44.104530+0000","last_undegraded":"2024-05-08T05:47:44.104530+0000","last_fullsized":"2024-05-08T05:47:44.104530+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:59:32.280051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.103537+0000","last_change":"2024-05-08T05:45:54.788172+0000","last_active":"2024-05-08T05:47:44.103537+0000","last_peered":"2024-05-08T05:47:44.103537+0000","last_clean":"2024-05-08T05:47:44.103537+0000","last_became_active":"2024-05-08T05:45:54.787609+0000","last_became_peered":"2024-05-08T05:45:54.787609+0000","last_unstale":"2024-05-08T05:47:44.103537+0000","last_undegraded":"2024-05-08T05:47:44.103537+0000","last_fullsized":"2024-05-08T05:47:44.103537+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:30:17.295770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.090733+0000","last_change":"2024-05-08T05:45:54.786904+0000","last_active":"2024-05-08T05:47:44.090733+0000","last_peered":"2024-05-08T05:47:44.090733+0000","last_clean":"2024-05-08T05:47:44.090733+0000","last_became_active":"2024-05-08T05:45:54.786484+0000","last_became_peered":"2024-05-08T05:45:54.786484+0000","last_unstale":"2024-05-08T05:47:44.090733+0000","last_undegraded":"2024-05-08T05:47:44.090733+0000","last_fullsized":"2024-05-08T05:47:44.090733+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:14:15.398144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.104866+0000","last_change":"2024-05-08T05:45:54.801559+0000","last_active":"2024-05-08T05:47:44.104866+0000","last_peered":"2024-05-08T05:47:44.104866+0000","last_clean":"2024-05-08T05:47:44.104866+0000","last_became_active":"2024-05-08T05:45:54.796293+0000","last_became_peered":"2024-05-08T05:45:54.796293+0000","last_unstale":"2024-05-08T05:47:44.104866+0000","last_undegraded":"2024-05-08T05:47:44.104866+0000","last_fullsized":"2024-05-08T05:47:44.104866+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:07:05.483562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.097674+0000","last_change":"2024-05-08T05:45:54.780450+0000","last_active":"2024-05-08T05:47:44.097674+0000","last_peered":"2024-05-08T05:47:44.097674+0000","last_clean":"2024-05-08T05:47:44.097674+0000","last_became_active":"2024-05-08T05:45:54.780079+0000","last_became_peered":"2024-05-08T05:45:54.780079+0000","last_unstale":"2024-05-08T05:47:44.097674+0000","last_undegraded":"2024-05-08T05:47:44.097674+0000","last_fullsized":"2024-05-08T05:47:44.097674+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:41:26.688748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.078720+0000","last_change":"2024-05-08T05:45:54.776294+0000","last_active":"2024-05-08T05:47:44.078720+0000","last_peered":"2024-05-08T05:47:44.078720+0000","last_clean":"2024-05-08T05:47:44.078720+0000","last_became_active":"2024-05-08T05:45:54.775928+0000","last_became_peered":"2024-05-08T05:45:54.775928+0000","last_unstale":"2024-05-08T05:47:44.078720+0000","last_undegraded":"2024-05-08T05:47:44.078720+0000","last_fullsized":"2024-05-08T05:47:44.078720+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:17:53.453446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.095848+0000","last_change":"2024-05-08T05:45:54.781478+0000","last_active":"2024-05-08T05:47:44.095848+0000","last_peered":"2024-05-08T05:47:44.095848+0000","last_clean":"2024-05-08T05:47:44.095848+0000","last_became_active":"2024-05-08T05:45:54.780839+0000","last_became_peered":"2024-05-08T05:45:54.780839+0000","last_unstale":"2024-05-08T05:47:44.095848+0000","last_undegraded":"2024-05-08T05:47:44.095848+0000","last_fullsized":"2024-05-08T05:47:44.095848+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:39:14.518391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.082422+0000","last_change":"2024-05-08T05:45:54.774650+0000","last_active":"2024-05-08T05:47:44.082422+0000","last_peered":"2024-05-08T05:47:44.082422+0000","last_clean":"2024-05-08T05:47:44.082422+0000","last_became_active":"2024-05-08T05:45:54.774276+0000","last_became_peered":"2024-05-08T05:45:54.774276+0000","last_unstale":"2024-05-08T05:47:44.082422+0000","last_undegraded":"2024-05-08T05:47:44.082422+0000","last_fullsized":"2024-05-08T05:47:44.082422+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:43:53.390553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.093679+0000","last_change":"2024-05-08T05:45:54.783430+0000","last_active":"2024-05-08T05:47:44.093679+0000","last_peered":"2024-05-08T05:47:44.093679+0000","last_clean":"2024-05-08T05:47:44.093679+0000","last_became_active":"2024-05-08T05:45:54.782394+0000","last_became_peered":"2024-05-08T05:45:54.782394+0000","last_unstale":"2024-05-08T05:47:44.093679+0000","last_undegraded":"2024-05-08T05:47:44.093679+0000","last_fullsized":"2024-05-08T05:47:44.093679+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:47:01.864111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.107049+0000","last_change":"2024-05-08T05:45:54.792880+0000","last_active":"2024-05-08T05:47:44.107049+0000","last_peered":"2024-05-08T05:47:44.107049+0000","last_clean":"2024-05-08T05:47:44.107049+0000","last_became_active":"2024-05-08T05:45:54.789653+0000","last_became_peered":"2024-05-08T05:45:54.789653+0000","last_unstale":"2024-05-08T05:47:44.107049+0000","last_undegraded":"2024-05-08T05:47:44.107049+0000","last_fullsized":"2024-05-08T05:47:44.107049+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:57:10.552014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.105891+0000","last_change":"2024-05-08T05:45:54.793612+0000","last_active":"2024-05-08T05:47:44.105891+0000","last_peered":"2024-05-08T05:47:44.105891+0000","last_clean":"2024-05-08T05:47:44.105891+0000","last_became_active":"2024-05-08T05:45:54.793191+0000","last_became_peered":"2024-05-08T05:45:54.793191+0000","last_unstale":"2024-05-08T05:47:44.105891+0000","last_undegraded":"2024-05-08T05:47:44.105891+0000","last_fullsized":"2024-05-08T05:47:44.105891+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:49:35.066070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.110756+0000","last_change":"2024-05-08T05:45:54.799679+0000","last_active":"2024-05-08T05:47:44.110756+0000","last_peered":"2024-05-08T05:47:44.110756+0000","last_clean":"2024-05-08T05:47:44.110756+0000","last_became_active":"2024-05-08T05:45:54.799196+0000","last_became_peered":"2024-05-08T05:45:54.799196+0000","last_unstale":"2024-05-08T05:47:44.110756+0000","last_undegraded":"2024-05-08T05:47:44.110756+0000","last_fullsized":"2024-05-08T05:47:44.110756+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:14:00.597282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.104930+0000","last_change":"2024-05-08T05:45:54.796799+0000","last_active":"2024-05-08T05:47:44.104930+0000","last_peered":"2024-05-08T05:47:44.104930+0000","last_clean":"2024-05-08T05:47:44.104930+0000","last_became_active":"2024-05-08T05:45:54.796501+0000","last_became_peered":"2024-05-08T05:45:54.796501+0000","last_unstale":"2024-05-08T05:47:44.104930+0000","last_undegraded":"2024-05-08T05:47:44.104930+0000","last_fullsized":"2024-05-08T05:47:44.104930+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:14:59.446718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.108986+0000","last_change":"2024-05-08T05:45:54.789544+0000","last_active":"2024-05-08T05:47:44.108986+0000","last_peered":"2024-05-08T05:47:44.108986+0000","last_clean":"2024-05-08T05:47:44.108986+0000","last_became_active":"2024-05-08T05:45:54.787901+0000","last_became_peered":"2024-05-08T05:45:54.787901+0000","last_unstale":"2024-05-08T05:47:44.108986+0000","last_undegraded":"2024-05-08T05:47:44.108986+0000","last_fullsized":"2024-05-08T05:47:44.108986+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:12:23.200311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.104801+0000","last_change":"2024-05-08T05:45:54.782537+0000","last_active":"2024-05-08T05:47:44.104801+0000","last_peered":"2024-05-08T05:47:44.104801+0000","last_clean":"2024-05-08T05:47:44.104801+0000","last_became_active":"2024-05-08T05:45:54.781389+0000","last_became_peered":"2024-05-08T05:45:54.781389+0000","last_unstale":"2024-05-08T05:47:44.104801+0000","last_undegraded":"2024-05-08T05:47:44.104801+0000","last_fullsized":"2024-05-08T05:47:44.104801+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:56:22.041900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"80'13","reported_seq":273,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:50:07.497674+0000","last_change":"2024-05-08T05:45:50.744496+0000","last_active":"2024-05-08T05:50:07.497674+0000","last_peered":"2024-05-08T05:50:07.497674+0000","last_clean":"2024-05-08T05:50:07.497674+0000","last_became_active":"2024-05-08T05:45:50.743882+0000","last_became_peered":"2024-05-08T05:45:50.743882+0000","last_unstale":"2024-05-08T05:50:07.497674+0000","last_undegraded":"2024-05-08T05:50:07.497674+0000","last_fullsized":"2024-05-08T05:50:07.497674+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:45:11.198096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":232,"num_read_kb":232,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.081356+0000","last_change":"2024-05-08T05:46:45.957649+0000","last_active":"2024-05-08T05:47:44.081356+0000","last_peered":"2024-05-08T05:47:44.081356+0000","last_clean":"2024-05-08T05:47:44.081356+0000","last_became_active":"2024-05-08T05:46:45.957154+0000","last_became_peered":"2024-05-08T05:46:45.957154+0000","last_unstale":"2024-05-08T05:47:44.081356+0000","last_undegraded":"2024-05-08T05:47:44.081356+0000","last_fullsized":"2024-05-08T05:47:44.081356+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:29:25.475541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:54.178928+0000","last_change":"2024-05-08T05:45:50.863409+0000","last_active":"2024-05-08T05:47:54.178928+0000","last_peered":"2024-05-08T05:47:54.178928+0000","last_clean":"2024-05-08T05:47:54.178928+0000","last_became_active":"2024-05-08T05:45:50.861818+0000","last_became_peered":"2024-05-08T05:45:50.861818+0000","last_unstale":"2024-05-08T05:47:54.178928+0000","last_undegraded":"2024-05-08T05:47:54.178928+0000","last_fullsized":"2024-05-08T05:47:54.178928+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:39:32.821431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:48:02.673181+0000","last_change":"2024-05-08T05:45:54.797429+0000","last_active":"2024-05-08T05:48:02.673181+0000","last_peered":"2024-05-08T05:48:02.673181+0000","last_clean":"2024-05-08T05:48:02.673181+0000","last_became_active":"2024-05-08T05:45:54.795030+0000","last_became_peered":"2024-05-08T05:45:54.795030+0000","last_unstale":"2024-05-08T05:48:02.673181+0000","last_undegraded":"2024-05-08T05:48:02.673181+0000","last_fullsized":"2024-05-08T05:48:02.673181+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:43:34.852889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"80'12","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.773238+0000","last_change":"2024-05-08T05:46:45.772846+0000","last_active":"2024-05-08T05:46:45.773238+0000","last_peered":"2024-05-08T05:46:45.773238+0000","last_clean":"2024-05-08T05:46:45.773238+0000","last_became_active":"2024-05-08T05:46:45.763937+0000","last_became_peered":"2024-05-08T05:46:45.763937+0000","last_unstale":"2024-05-08T05:46:45.773238+0000","last_undegraded":"2024-05-08T05:46:45.773238+0000","last_fullsized":"2024-05-08T05:46:45.773238+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:48:13.233059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.099418+0000","last_change":"2024-05-08T05:45:54.788852+0000","last_active":"2024-05-08T05:47:44.099418+0000","last_peered":"2024-05-08T05:47:44.099418+0000","last_clean":"2024-05-08T05:47:44.099418+0000","last_became_active":"2024-05-08T05:45:54.788496+0000","last_became_peered":"2024-05-08T05:45:54.788496+0000","last_unstale":"2024-05-08T05:47:44.099418+0000","last_undegraded":"2024-05-08T05:47:44.099418+0000","last_fullsized":"2024-05-08T05:47:44.099418+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:44:45.379728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"80'5","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762912+0000","last_change":"2024-05-08T05:45:50.741528+0000","last_active":"2024-05-08T05:46:45.762912+0000","last_peered":"2024-05-08T05:46:45.762912+0000","last_clean":"2024-05-08T05:46:45.762912+0000","last_became_active":"2024-05-08T05:45:50.741232+0000","last_became_peered":"2024-05-08T05:45:50.741232+0000","last_unstale":"2024-05-08T05:46:45.762912+0000","last_undegraded":"2024-05-08T05:46:45.762912+0000","last_fullsized":"2024-05-08T05:46:45.762912+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:36:48.540858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.099734+0000","last_change":"2024-05-08T05:46:45.954990+0000","last_active":"2024-05-08T05:47:44.099734+0000","last_peered":"2024-05-08T05:47:44.099734+0000","last_clean":"2024-05-08T05:47:44.099734+0000","last_became_active":"2024-05-08T05:46:45.953589+0000","last_became_peered":"2024-05-08T05:46:45.953589+0000","last_unstale":"2024-05-08T05:47:44.099734+0000","last_undegraded":"2024-05-08T05:47:44.099734+0000","last_fullsized":"2024-05-08T05:47:44.099734+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:29:17.410356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1b","version":"82'7","reported_seq":270,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:50:08.326233+0000","last_change":"2024-05-08T05:45:50.746462+0000","last_active":"2024-05-08T05:50:08.326233+0000","last_peered":"2024-05-08T05:50:08.326233+0000","last_clean":"2024-05-08T05:50:08.326233+0000","last_became_active":"2024-05-08T05:45:50.746064+0000","last_became_peered":"2024-05-08T05:45:50.746064+0000","last_unstale":"2024-05-08T05:50:08.326233+0000","last_undegraded":"2024-05-08T05:50:08.326233+0000","last_fullsized":"2024-05-08T05:50:08.326233+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:51:49.076829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1323,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":236,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.086315+0000","last_change":"2024-05-08T05:45:54.788524+0000","last_active":"2024-05-08T05:47:44.086315+0000","last_peered":"2024-05-08T05:47:44.086315+0000","last_clean":"2024-05-08T05:47:44.086315+0000","last_became_active":"2024-05-08T05:45:54.788179+0000","last_became_peered":"2024-05-08T05:45:54.788179+0000","last_unstale":"2024-05-08T05:47:44.086315+0000","last_undegraded":"2024-05-08T05:47:44.086315+0000","last_fullsized":"2024-05-08T05:47:44.086315+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:44:34.257799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":48,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.781138+0000","last_change":"2024-05-08T05:46:45.780705+0000","last_active":"2024-05-08T05:46:45.781138+0000","last_peered":"2024-05-08T05:46:45.781138+0000","last_clean":"2024-05-08T05:46:45.781138+0000","last_became_active":"2024-05-08T05:46:45.773246+0000","last_became_peered":"2024-05-08T05:46:45.773246+0000","last_unstale":"2024-05-08T05:46:45.781138+0000","last_undegraded":"2024-05-08T05:46:45.781138+0000","last_fullsized":"2024-05-08T05:46:45.781138+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:10:33.491186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.103877+0000","last_change":"2024-05-08T05:45:54.792001+0000","last_active":"2024-05-08T05:47:44.103877+0000","last_peered":"2024-05-08T05:47:44.103877+0000","last_clean":"2024-05-08T05:47:44.103877+0000","last_became_active":"2024-05-08T05:45:54.791581+0000","last_became_peered":"2024-05-08T05:45:54.791581+0000","last_unstale":"2024-05-08T05:47:44.103877+0000","last_undegraded":"2024-05-08T05:47:44.103877+0000","last_fullsized":"2024-05-08T05:47:44.103877+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:43:37.437251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"80'3","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.771676+0000","last_change":"2024-05-08T05:45:50.740645+0000","last_active":"2024-05-08T05:46:45.771676+0000","last_peered":"2024-05-08T05:46:45.771676+0000","last_clean":"2024-05-08T05:46:45.771676+0000","last_became_active":"2024-05-08T05:45:50.739997+0000","last_became_peered":"2024-05-08T05:45:50.739997+0000","last_unstale":"2024-05-08T05:46:45.771676+0000","last_undegraded":"2024-05-08T05:46:45.771676+0000","last_fullsized":"2024-05-08T05:46:45.771676+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:24:48.895557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.105072+0000","last_change":"2024-05-08T05:45:54.802757+0000","last_active":"2024-05-08T05:47:44.105072+0000","last_peered":"2024-05-08T05:47:44.105072+0000","last_clean":"2024-05-08T05:47:44.105072+0000","last_became_active":"2024-05-08T05:45:54.798549+0000","last_became_peered":"2024-05-08T05:45:54.798549+0000","last_unstale":"2024-05-08T05:47:44.105072+0000","last_undegraded":"2024-05-08T05:47:44.105072+0000","last_fullsized":"2024-05-08T05:47:44.105072+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:39:37.582997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'3","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.956005+0000","last_change":"2024-05-08T05:45:50.743989+0000","last_active":"2024-05-08T05:46:45.956005+0000","last_peered":"2024-05-08T05:46:45.956005+0000","last_clean":"2024-05-08T05:46:45.956005+0000","last_became_active":"2024-05-08T05:45:50.743582+0000","last_became_peered":"2024-05-08T05:45:50.743582+0000","last_unstale":"2024-05-08T05:46:45.956005+0000","last_undegraded":"2024-05-08T05:46:45.956005+0000","last_fullsized":"2024-05-08T05:46:45.956005+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:14:46.820582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.108021+0000","last_change":"2024-05-08T05:45:54.807249+0000","last_active":"2024-05-08T05:47:44.108021+0000","last_peered":"2024-05-08T05:47:44.108021+0000","last_clean":"2024-05-08T05:47:44.108021+0000","last_became_active":"2024-05-08T05:45:54.806823+0000","last_became_peered":"2024-05-08T05:45:54.806823+0000","last_unstale":"2024-05-08T05:47:44.108021+0000","last_undegraded":"2024-05-08T05:47:44.108021+0000","last_fullsized":"2024-05-08T05:47:44.108021+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:37:25.526927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'7","reported_seq":491,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:50:05.460267+0000","last_change":"2024-05-08T05:45:50.747477+0000","last_active":"2024-05-08T05:50:05.460267+0000","last_peered":"2024-05-08T05:50:05.460267+0000","last_clean":"2024-05-08T05:50:05.460267+0000","last_became_active":"2024-05-08T05:45:50.747103+0000","last_became_peered":"2024-05-08T05:45:50.747103+0000","last_unstale":"2024-05-08T05:50:05.460267+0000","last_undegraded":"2024-05-08T05:50:05.460267+0000","last_fullsized":"2024-05-08T05:50:05.460267+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:08:17.108826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":457,"num_read_kb":457,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.109143+0000","last_change":"2024-05-08T05:45:54.787885+0000","last_active":"2024-05-08T05:47:44.109143+0000","last_peered":"2024-05-08T05:47:44.109143+0000","last_clean":"2024-05-08T05:47:44.109143+0000","last_became_active":"2024-05-08T05:45:54.787480+0000","last_became_peered":"2024-05-08T05:45:54.787480+0000","last_unstale":"2024-05-08T05:47:44.109143+0000","last_undegraded":"2024-05-08T05:47:44.109143+0000","last_fullsized":"2024-05-08T05:47:44.109143+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:13:42.889918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'4","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.763077+0000","last_change":"2024-05-08T05:45:50.741271+0000","last_active":"2024-05-08T05:46:45.763077+0000","last_peered":"2024-05-08T05:46:45.763077+0000","last_clean":"2024-05-08T05:46:45.763077+0000","last_became_active":"2024-05-08T05:45:50.740869+0000","last_became_peered":"2024-05-08T05:45:50.740869+0000","last_unstale":"2024-05-08T05:46:45.763077+0000","last_undegraded":"2024-05-08T05:46:45.763077+0000","last_fullsized":"2024-05-08T05:46:45.763077+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:57:40.855732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.107752+0000","last_change":"2024-05-08T05:46:45.958524+0000","last_active":"2024-05-08T05:47:44.107752+0000","last_peered":"2024-05-08T05:47:44.107752+0000","last_clean":"2024-05-08T05:47:44.107752+0000","last_became_active":"2024-05-08T05:46:45.957576+0000","last_became_peered":"2024-05-08T05:46:45.957576+0000","last_unstale":"2024-05-08T05:47:44.107752+0000","last_undegraded":"2024-05-08T05:47:44.107752+0000","last_fullsized":"2024-05-08T05:47:44.107752+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:59:34.927448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.956564+0000","last_change":"2024-05-08T05:45:50.865467+0000","last_active":"2024-05-08T05:46:45.956564+0000","last_peered":"2024-05-08T05:46:45.956564+0000","last_clean":"2024-05-08T05:46:45.956564+0000","last_became_active":"2024-05-08T05:45:50.865245+0000","last_became_peered":"2024-05-08T05:45:50.865245+0000","last_unstale":"2024-05-08T05:46:45.956564+0000","last_undegraded":"2024-05-08T05:46:45.956564+0000","last_fullsized":"2024-05-08T05:46:45.956564+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:03:40.990651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.099169+0000","last_change":"2024-05-08T05:45:54.780782+0000","last_active":"2024-05-08T05:47:44.099169+0000","last_peered":"2024-05-08T05:47:44.099169+0000","last_clean":"2024-05-08T05:47:44.099169+0000","last_became_active":"2024-05-08T05:45:54.780074+0000","last_became_peered":"2024-05-08T05:45:54.780074+0000","last_unstale":"2024-05-08T05:47:44.099169+0000","last_undegraded":"2024-05-08T05:47:44.099169+0000","last_fullsized":"2024-05-08T05:47:44.099169+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:23:09.026115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'40","reported_seq":558,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:50:06.278209+0000","last_change":"2024-05-08T05:46:45.965985+0000","last_active":"2024-05-08T05:50:06.278209+0000","last_peered":"2024-05-08T05:50:06.278209+0000","last_clean":"2024-05-08T05:50:06.278209+0000","last_became_active":"2024-05-08T05:46:45.953485+0000","last_became_peered":"2024-05-08T05:46:45.953485+0000","last_unstale":"2024-05-08T05:50:06.278209+0000","last_undegraded":"2024-05-08T05:50:06.278209+0000","last_fullsized":"2024-05-08T05:50:06.278209+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:51:45.723988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73704,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":462,"num_read_kb":296,"num_write":42,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":55222,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.088260+0000","last_change":"2024-05-08T05:45:54.777524+0000","last_active":"2024-05-08T05:47:44.088260+0000","last_peered":"2024-05-08T05:47:44.088260+0000","last_clean":"2024-05-08T05:47:44.088260+0000","last_became_active":"2024-05-08T05:45:54.776756+0000","last_became_peered":"2024-05-08T05:45:54.776756+0000","last_unstale":"2024-05-08T05:47:44.088260+0000","last_undegraded":"2024-05-08T05:47:44.088260+0000","last_fullsized":"2024-05-08T05:47:44.088260+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:54:27.320411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.783597+0000","last_change":"2024-05-08T05:46:45.783284+0000","last_active":"2024-05-08T05:46:45.783597+0000","last_peered":"2024-05-08T05:46:45.783597+0000","last_clean":"2024-05-08T05:46:45.783597+0000","last_became_active":"2024-05-08T05:46:45.765201+0000","last_became_peered":"2024-05-08T05:46:45.765201+0000","last_unstale":"2024-05-08T05:46:45.783597+0000","last_undegraded":"2024-05-08T05:46:45.783597+0000","last_fullsized":"2024-05-08T05:46:45.783597+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:44:59.762324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.105689+0000","last_change":"2024-05-08T05:45:54.789165+0000","last_active":"2024-05-08T05:47:44.105689+0000","last_peered":"2024-05-08T05:47:44.105689+0000","last_clean":"2024-05-08T05:47:44.105689+0000","last_became_active":"2024-05-08T05:45:54.788673+0000","last_became_peered":"2024-05-08T05:45:54.788673+0000","last_unstale":"2024-05-08T05:47:44.105689+0000","last_undegraded":"2024-05-08T05:47:44.105689+0000","last_fullsized":"2024-05-08T05:47:44.105689+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:29:08.722409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'5","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.956256+0000","last_change":"2024-05-08T05:45:50.750836+0000","last_active":"2024-05-08T05:46:45.956256+0000","last_peered":"2024-05-08T05:46:45.956256+0000","last_clean":"2024-05-08T05:46:45.956256+0000","last_became_active":"2024-05-08T05:45:50.750587+0000","last_became_peered":"2024-05-08T05:45:50.750587+0000","last_unstale":"2024-05-08T05:46:45.956256+0000","last_undegraded":"2024-05-08T05:46:45.956256+0000","last_fullsized":"2024-05-08T05:46:45.956256+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:19:03.780050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.096929+0000","last_change":"2024-05-08T05:45:54.791475+0000","last_active":"2024-05-08T05:47:44.096929+0000","last_peered":"2024-05-08T05:47:44.096929+0000","last_clean":"2024-05-08T05:47:44.096929+0000","last_became_active":"2024-05-08T05:45:54.791122+0000","last_became_peered":"2024-05-08T05:45:54.791122+0000","last_unstale":"2024-05-08T05:47:44.096929+0000","last_undegraded":"2024-05-08T05:47:44.096929+0000","last_fullsized":"2024-05-08T05:47:44.096929+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:08:01.261852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'6","reported_seq":268,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:50:08.408135+0000","last_change":"2024-05-08T05:45:50.742848+0000","last_active":"2024-05-08T05:50:08.408135+0000","last_peered":"2024-05-08T05:50:08.408135+0000","last_clean":"2024-05-08T05:50:08.408135+0000","last_became_active":"2024-05-08T05:45:50.742448+0000","last_became_peered":"2024-05-08T05:45:50.742448+0000","last_unstale":"2024-05-08T05:50:08.408135+0000","last_undegraded":"2024-05-08T05:50:08.408135+0000","last_fullsized":"2024-05-08T05:50:08.408135+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:17:35.970285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":236,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.083819+0000","last_change":"2024-05-08T05:45:54.773009+0000","last_active":"2024-05-08T05:47:44.083819+0000","last_peered":"2024-05-08T05:47:44.083819+0000","last_clean":"2024-05-08T05:47:44.083819+0000","last_became_active":"2024-05-08T05:45:54.772597+0000","last_became_peered":"2024-05-08T05:45:54.772597+0000","last_unstale":"2024-05-08T05:47:44.083819+0000","last_undegraded":"2024-05-08T05:47:44.083819+0000","last_fullsized":"2024-05-08T05:47:44.083819+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:41:31.632363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'17","reported_seq":45,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762777+0000","last_change":"2024-05-08T05:45:50.867734+0000","last_active":"2024-05-08T05:46:45.762777+0000","last_peered":"2024-05-08T05:46:45.762777+0000","last_clean":"2024-05-08T05:46:45.762777+0000","last_became_active":"2024-05-08T05:45:50.867441+0000","last_became_peered":"2024-05-08T05:45:50.867441+0000","last_unstale":"2024-05-08T05:46:45.762777+0000","last_undegraded":"2024-05-08T05:46:45.762777+0000","last_fullsized":"2024-05-08T05:46:45.762777+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:16:45.430432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.083526+0000","last_change":"2024-05-08T05:45:54.777168+0000","last_active":"2024-05-08T05:47:44.083526+0000","last_peered":"2024-05-08T05:47:44.083526+0000","last_clean":"2024-05-08T05:47:44.083526+0000","last_became_active":"2024-05-08T05:45:54.775985+0000","last_became_peered":"2024-05-08T05:45:54.775985+0000","last_unstale":"2024-05-08T05:47:44.083526+0000","last_undegraded":"2024-05-08T05:47:44.083526+0000","last_fullsized":"2024-05-08T05:47:44.083526+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:57:49.495860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762618+0000","last_change":"2024-05-08T05:45:50.741375+0000","last_active":"2024-05-08T05:46:45.762618+0000","last_peered":"2024-05-08T05:46:45.762618+0000","last_clean":"2024-05-08T05:46:45.762618+0000","last_became_active":"2024-05-08T05:45:50.741025+0000","last_became_peered":"2024-05-08T05:45:50.741025+0000","last_unstale":"2024-05-08T05:46:45.762618+0000","last_undegraded":"2024-05-08T05:46:45.762618+0000","last_fullsized":"2024-05-08T05:46:45.762618+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:01:43.515119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.082394+0000","last_change":"2024-05-08T05:45:54.780302+0000","last_active":"2024-05-08T05:47:44.082394+0000","last_peered":"2024-05-08T05:47:44.082394+0000","last_clean":"2024-05-08T05:47:44.082394+0000","last_became_active":"2024-05-08T05:45:54.778751+0000","last_became_peered":"2024-05-08T05:45:54.778751+0000","last_unstale":"2024-05-08T05:47:44.082394+0000","last_undegraded":"2024-05-08T05:47:44.082394+0000","last_fullsized":"2024-05-08T05:47:44.082394+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:34:57.686504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:59.165931+0000","last_change":"2024-05-08T05:45:50.870071+0000","last_active":"2024-05-08T05:47:59.165931+0000","last_peered":"2024-05-08T05:47:59.165931+0000","last_clean":"2024-05-08T05:47:59.165931+0000","last_became_active":"2024-05-08T05:45:50.869162+0000","last_became_peered":"2024-05-08T05:45:50.869162+0000","last_unstale":"2024-05-08T05:47:59.165931+0000","last_undegraded":"2024-05-08T05:47:59.165931+0000","last_fullsized":"2024-05-08T05:47:59.165931+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:05:13.104922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:48:01.442949+0000","last_change":"2024-05-08T05:45:54.780983+0000","last_active":"2024-05-08T05:48:01.442949+0000","last_peered":"2024-05-08T05:48:01.442949+0000","last_clean":"2024-05-08T05:48:01.442949+0000","last_became_active":"2024-05-08T05:45:54.780617+0000","last_became_peered":"2024-05-08T05:45:54.780617+0000","last_unstale":"2024-05-08T05:48:01.442949+0000","last_undegraded":"2024-05-08T05:48:01.442949+0000","last_fullsized":"2024-05-08T05:48:01.442949+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:56:40.972467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"80'5","reported_seq":266,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:50:08.501027+0000","last_change":"2024-05-08T05:45:50.748869+0000","last_active":"2024-05-08T05:50:08.501027+0000","last_peered":"2024-05-08T05:50:08.501027+0000","last_clean":"2024-05-08T05:50:08.501027+0000","last_became_active":"2024-05-08T05:45:50.748494+0000","last_became_peered":"2024-05-08T05:45:50.748494+0000","last_unstale":"2024-05-08T05:50:08.501027+0000","last_undegraded":"2024-05-08T05:50:08.501027+0000","last_fullsized":"2024-05-08T05:50:08.501027+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:12:25.227090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":233,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:48:01.442925+0000","last_change":"2024-05-08T05:45:54.802180+0000","last_active":"2024-05-08T05:48:01.442925+0000","last_peered":"2024-05-08T05:48:01.442925+0000","last_clean":"2024-05-08T05:48:01.442925+0000","last_became_active":"2024-05-08T05:45:54.801822+0000","last_became_peered":"2024-05-08T05:45:54.801822+0000","last_unstale":"2024-05-08T05:48:01.442925+0000","last_undegraded":"2024-05-08T05:48:01.442925+0000","last_fullsized":"2024-05-08T05:48:01.442925+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:52:11.802630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:54.989668+0000","last_change":"2024-05-08T05:45:54.770981+0000","last_active":"2024-05-08T05:47:54.989668+0000","last_peered":"2024-05-08T05:47:54.989668+0000","last_clean":"2024-05-08T05:47:54.989668+0000","last_became_active":"2024-05-08T05:45:54.770538+0000","last_became_peered":"2024-05-08T05:45:54.770538+0000","last_unstale":"2024-05-08T05:47:54.989668+0000","last_undegraded":"2024-05-08T05:47:54.989668+0000","last_fullsized":"2024-05-08T05:47:54.989668+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:32:34.699752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"82'6","reported_seq":266,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:50:07.404447+0000","last_change":"2024-05-08T05:45:50.864189+0000","last_active":"2024-05-08T05:50:07.404447+0000","last_peered":"2024-05-08T05:50:07.404447+0000","last_clean":"2024-05-08T05:50:07.404447+0000","last_became_active":"2024-05-08T05:45:50.863170+0000","last_became_peered":"2024-05-08T05:45:50.863170+0000","last_unstale":"2024-05-08T05:50:07.404447+0000","last_undegraded":"2024-05-08T05:50:07.404447+0000","last_fullsized":"2024-05-08T05:50:07.404447+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:44:33.109166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":232,"num_read_kb":232,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:59.179674+0000","last_change":"2024-05-08T05:45:54.792347+0000","last_active":"2024-05-08T05:47:59.179674+0000","last_peered":"2024-05-08T05:47:59.179674+0000","last_clean":"2024-05-08T05:47:59.179674+0000","last_became_active":"2024-05-08T05:45:54.791767+0000","last_became_peered":"2024-05-08T05:45:54.791767+0000","last_unstale":"2024-05-08T05:47:59.179674+0000","last_undegraded":"2024-05-08T05:47:59.179674+0000","last_fullsized":"2024-05-08T05:47:59.179674+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:03:46.354687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"80'6","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:55.165375+0000","last_change":"2024-05-08T05:45:50.748659+0000","last_active":"2024-05-08T05:47:55.165375+0000","last_peered":"2024-05-08T05:47:55.165375+0000","last_clean":"2024-05-08T05:47:55.165375+0000","last_became_active":"2024-05-08T05:45:50.748279+0000","last_became_peered":"2024-05-08T05:45:50.748279+0000","last_unstale":"2024-05-08T05:47:55.165375+0000","last_undegraded":"2024-05-08T05:47:55.165375+0000","last_fullsized":"2024-05-08T05:47:55.165375+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:42:25.892715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":102,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:54.651328+0000","last_change":"2024-05-08T05:44:18.365376+0000","last_active":"2024-05-08T05:46:54.651328+0000","last_peered":"2024-05-08T05:46:54.651328+0000","last_clean":"2024-05-08T05:46:54.651328+0000","last_became_active":"2024-05-08T05:44:18.360156+0000","last_became_peered":"2024-05-08T05:44:18.360156+0000","last_unstale":"2024-05-08T05:46:54.651328+0000","last_undegraded":"2024-05-08T05:46:54.651328+0000","last_fullsized":"2024-05-08T05:46:54.651328+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:40:28.502228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:40:28.502228+0000","last_clean_scrub_stamp":"2024-05-08T05:40:28.502228+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:38:20.339163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:59.108848+0000","last_change":"2024-05-08T05:45:54.775625+0000","last_active":"2024-05-08T05:47:59.108848+0000","last_peered":"2024-05-08T05:47:59.108848+0000","last_clean":"2024-05-08T05:47:59.108848+0000","last_became_active":"2024-05-08T05:45:54.774661+0000","last_became_peered":"2024-05-08T05:45:54.774661+0000","last_unstale":"2024-05-08T05:47:59.108848+0000","last_undegraded":"2024-05-08T05:47:59.108848+0000","last_fullsized":"2024-05-08T05:47:59.108848+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:57:05.676092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"80'4","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:54.657532+0000","last_change":"2024-05-08T05:45:50.747823+0000","last_active":"2024-05-08T05:47:54.657532+0000","last_peered":"2024-05-08T05:47:54.657532+0000","last_clean":"2024-05-08T05:47:54.657532+0000","last_became_active":"2024-05-08T05:45:50.747222+0000","last_became_peered":"2024-05-08T05:45:50.747222+0000","last_unstale":"2024-05-08T05:47:54.657532+0000","last_undegraded":"2024-05-08T05:47:54.657532+0000","last_fullsized":"2024-05-08T05:47:54.657532+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:49:06.238468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"80'4","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:54.798564+0000","last_change":"2024-05-08T05:45:50.861721+0000","last_active":"2024-05-08T05:47:54.798564+0000","last_peered":"2024-05-08T05:47:54.798564+0000","last_clean":"2024-05-08T05:47:54.798564+0000","last_became_active":"2024-05-08T05:45:50.861369+0000","last_became_peered":"2024-05-08T05:45:50.861369+0000","last_unstale":"2024-05-08T05:47:54.798564+0000","last_undegraded":"2024-05-08T05:47:54.798564+0000","last_fullsized":"2024-05-08T05:47:54.798564+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:35:19.781796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:59.108978+0000","last_change":"2024-05-08T05:45:54.787260+0000","last_active":"2024-05-08T05:47:59.108978+0000","last_peered":"2024-05-08T05:47:59.108978+0000","last_clean":"2024-05-08T05:47:59.108978+0000","last_became_active":"2024-05-08T05:45:54.786897+0000","last_became_peered":"2024-05-08T05:45:54.786897+0000","last_unstale":"2024-05-08T05:47:59.108978+0000","last_undegraded":"2024-05-08T05:47:59.108978+0000","last_fullsized":"2024-05-08T05:47:59.108978+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:10:06.761165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'19","reported_seq":46,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:50:03.861026+0000","last_change":"2024-05-08T05:45:50.746160+0000","last_active":"2024-05-08T05:50:03.861026+0000","last_peered":"2024-05-08T05:50:03.861026+0000","last_clean":"2024-05-08T05:50:03.861026+0000","last_became_active":"2024-05-08T05:45:50.745630+0000","last_became_peered":"2024-05-08T05:45:50.745630+0000","last_unstale":"2024-05-08T05:50:03.861026+0000","last_undegraded":"2024-05-08T05:50:03.861026+0000","last_fullsized":"2024-05-08T05:50:03.861026+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:45:27.593902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.100379+0000","last_change":"2024-05-08T05:45:54.797162+0000","last_active":"2024-05-08T05:47:44.100379+0000","last_peered":"2024-05-08T05:47:44.100379+0000","last_clean":"2024-05-08T05:47:44.100379+0000","last_became_active":"2024-05-08T05:45:54.796859+0000","last_became_peered":"2024-05-08T05:45:54.796859+0000","last_unstale":"2024-05-08T05:47:44.100379+0000","last_undegraded":"2024-05-08T05:47:44.100379+0000","last_fullsized":"2024-05-08T05:47:44.100379+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:51:25.701160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'7","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:48:00.165958+0000","last_change":"2024-05-08T05:45:50.744793+0000","last_active":"2024-05-08T05:48:00.165958+0000","last_peered":"2024-05-08T05:48:00.165958+0000","last_clean":"2024-05-08T05:48:00.165958+0000","last_became_active":"2024-05-08T05:45:50.744407+0000","last_became_peered":"2024-05-08T05:45:50.744407+0000","last_unstale":"2024-05-08T05:48:00.165958+0000","last_undegraded":"2024-05-08T05:48:00.165958+0000","last_fullsized":"2024-05-08T05:48:00.165958+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:18:17.029402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.110900+0000","last_change":"2024-05-08T05:45:54.797042+0000","last_active":"2024-05-08T05:47:44.110900+0000","last_peered":"2024-05-08T05:47:44.110900+0000","last_clean":"2024-05-08T05:47:44.110900+0000","last_became_active":"2024-05-08T05:45:54.795796+0000","last_became_peered":"2024-05-08T05:45:54.795796+0000","last_unstale":"2024-05-08T05:47:44.110900+0000","last_undegraded":"2024-05-08T05:47:44.110900+0000","last_fullsized":"2024-05-08T05:47:44.110900+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:20:10.789348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.766092+0000","last_change":"2024-05-08T05:45:50.860466+0000","last_active":"2024-05-08T05:46:45.766092+0000","last_peered":"2024-05-08T05:46:45.766092+0000","last_clean":"2024-05-08T05:46:45.766092+0000","last_became_active":"2024-05-08T05:45:50.860093+0000","last_became_peered":"2024-05-08T05:45:50.860093+0000","last_unstale":"2024-05-08T05:46:45.766092+0000","last_undegraded":"2024-05-08T05:46:45.766092+0000","last_fullsized":"2024-05-08T05:46:45.766092+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:42:37.799098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.076334+0000","last_change":"2024-05-08T05:45:54.774635+0000","last_active":"2024-05-08T05:47:44.076334+0000","last_peered":"2024-05-08T05:47:44.076334+0000","last_clean":"2024-05-08T05:47:44.076334+0000","last_became_active":"2024-05-08T05:45:54.774288+0000","last_became_peered":"2024-05-08T05:45:54.774288+0000","last_unstale":"2024-05-08T05:47:44.076334+0000","last_undegraded":"2024-05-08T05:47:44.076334+0000","last_fullsized":"2024-05-08T05:47:44.076334+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:55:59.787540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'7","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.761999+0000","last_change":"2024-05-08T05:45:50.750830+0000","last_active":"2024-05-08T05:46:45.761999+0000","last_peered":"2024-05-08T05:46:45.761999+0000","last_clean":"2024-05-08T05:46:45.761999+0000","last_became_active":"2024-05-08T05:45:50.750473+0000","last_became_peered":"2024-05-08T05:45:50.750473+0000","last_unstale":"2024-05-08T05:46:45.761999+0000","last_undegraded":"2024-05-08T05:46:45.761999+0000","last_fullsized":"2024-05-08T05:46:45.761999+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:04:14.314865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.098673+0000","last_change":"2024-05-08T05:45:54.800008+0000","last_active":"2024-05-08T05:47:44.098673+0000","last_peered":"2024-05-08T05:47:44.098673+0000","last_clean":"2024-05-08T05:47:44.098673+0000","last_became_active":"2024-05-08T05:45:54.799615+0000","last_became_peered":"2024-05-08T05:45:54.799615+0000","last_unstale":"2024-05-08T05:47:44.098673+0000","last_undegraded":"2024-05-08T05:47:44.098673+0000","last_fullsized":"2024-05-08T05:47:44.098673+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:58:12.907617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'5","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:50:03.936259+0000","last_change":"2024-05-08T05:45:50.745088+0000","last_active":"2024-05-08T05:50:03.936259+0000","last_peered":"2024-05-08T05:50:03.936259+0000","last_clean":"2024-05-08T05:50:03.936259+0000","last_became_active":"2024-05-08T05:45:50.744735+0000","last_became_peered":"2024-05-08T05:45:50.744735+0000","last_unstale":"2024-05-08T05:50:03.936259+0000","last_undegraded":"2024-05-08T05:50:03.936259+0000","last_fullsized":"2024-05-08T05:50:03.936259+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:39:12.404233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.104706+0000","last_change":"2024-05-08T05:45:54.803875+0000","last_active":"2024-05-08T05:47:44.104706+0000","last_peered":"2024-05-08T05:47:44.104706+0000","last_clean":"2024-05-08T05:47:44.104706+0000","last_became_active":"2024-05-08T05:45:54.803504+0000","last_became_peered":"2024-05-08T05:45:54.803504+0000","last_unstale":"2024-05-08T05:47:44.104706+0000","last_undegraded":"2024-05-08T05:47:44.104706+0000","last_fullsized":"2024-05-08T05:47:44.104706+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:49:33.419868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.763106+0000","last_change":"2024-05-08T05:45:50.741351+0000","last_active":"2024-05-08T05:46:45.763106+0000","last_peered":"2024-05-08T05:46:45.763106+0000","last_clean":"2024-05-08T05:46:45.763106+0000","last_became_active":"2024-05-08T05:45:50.740970+0000","last_became_peered":"2024-05-08T05:45:50.740970+0000","last_unstale":"2024-05-08T05:46:45.763106+0000","last_undegraded":"2024-05-08T05:46:45.763106+0000","last_fullsized":"2024-05-08T05:46:45.763106+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:31:02.093446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.096731+0000","last_change":"2024-05-08T05:45:54.792665+0000","last_active":"2024-05-08T05:47:44.096731+0000","last_peered":"2024-05-08T05:47:44.096731+0000","last_clean":"2024-05-08T05:47:44.096731+0000","last_became_active":"2024-05-08T05:45:54.792309+0000","last_became_peered":"2024-05-08T05:45:54.792309+0000","last_unstale":"2024-05-08T05:47:44.096731+0000","last_undegraded":"2024-05-08T05:47:44.096731+0000","last_fullsized":"2024-05-08T05:47:44.096731+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:48:29.154009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'8","reported_seq":269,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:50:05.462113+0000","last_change":"2024-05-08T05:45:50.861234+0000","last_active":"2024-05-08T05:50:05.462113+0000","last_peered":"2024-05-08T05:50:05.462113+0000","last_clean":"2024-05-08T05:50:05.462113+0000","last_became_active":"2024-05-08T05:45:50.860885+0000","last_became_peered":"2024-05-08T05:45:50.860885+0000","last_unstale":"2024-05-08T05:50:05.462113+0000","last_undegraded":"2024-05-08T05:50:05.462113+0000","last_fullsized":"2024-05-08T05:50:05.462113+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:59:50.300316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2093,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":234,"num_read_kb":5,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.096172+0000","last_change":"2024-05-08T05:45:54.781154+0000","last_active":"2024-05-08T05:47:44.096172+0000","last_peered":"2024-05-08T05:47:44.096172+0000","last_clean":"2024-05-08T05:47:44.096172+0000","last_became_active":"2024-05-08T05:45:54.780340+0000","last_became_peered":"2024-05-08T05:45:54.780340+0000","last_unstale":"2024-05-08T05:47:44.096172+0000","last_undegraded":"2024-05-08T05:47:44.096172+0000","last_fullsized":"2024-05-08T05:47:44.096172+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:22:39.614532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'3","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.956451+0000","last_change":"2024-05-08T05:45:50.748015+0000","last_active":"2024-05-08T05:46:45.956451+0000","last_peered":"2024-05-08T05:46:45.956451+0000","last_clean":"2024-05-08T05:46:45.956451+0000","last_became_active":"2024-05-08T05:45:50.747649+0000","last_became_peered":"2024-05-08T05:45:50.747649+0000","last_unstale":"2024-05-08T05:46:45.956451+0000","last_undegraded":"2024-05-08T05:46:45.956451+0000","last_fullsized":"2024-05-08T05:46:45.956451+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:31:49.177676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.103573+0000","last_change":"2024-05-08T05:45:54.779680+0000","last_active":"2024-05-08T05:47:44.103573+0000","last_peered":"2024-05-08T05:47:44.103573+0000","last_clean":"2024-05-08T05:47:44.103573+0000","last_became_active":"2024-05-08T05:45:54.779273+0000","last_became_peered":"2024-05-08T05:45:54.779273+0000","last_unstale":"2024-05-08T05:47:44.103573+0000","last_undegraded":"2024-05-08T05:47:44.103573+0000","last_fullsized":"2024-05-08T05:47:44.103573+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:40:05.192134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"80'5","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.770430+0000","last_change":"2024-05-08T05:45:50.744569+0000","last_active":"2024-05-08T05:46:45.770430+0000","last_peered":"2024-05-08T05:46:45.770430+0000","last_clean":"2024-05-08T05:46:45.770430+0000","last_became_active":"2024-05-08T05:45:50.744164+0000","last_became_peered":"2024-05-08T05:45:50.744164+0000","last_unstale":"2024-05-08T05:46:45.770430+0000","last_undegraded":"2024-05-08T05:46:45.770430+0000","last_fullsized":"2024-05-08T05:46:45.770430+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:17:56.409110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.087373+0000","last_change":"2024-05-08T05:45:54.776338+0000","last_active":"2024-05-08T05:47:44.087373+0000","last_peered":"2024-05-08T05:47:44.087373+0000","last_clean":"2024-05-08T05:47:44.087373+0000","last_became_active":"2024-05-08T05:45:54.776015+0000","last_became_peered":"2024-05-08T05:45:54.776015+0000","last_unstale":"2024-05-08T05:47:44.087373+0000","last_undegraded":"2024-05-08T05:47:44.087373+0000","last_fullsized":"2024-05-08T05:47:44.087373+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:38:10.608436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:48:00.719465+0000","last_change":"2024-05-08T05:45:54.782245+0000","last_active":"2024-05-08T05:48:00.719465+0000","last_peered":"2024-05-08T05:48:00.719465+0000","last_clean":"2024-05-08T05:48:00.719465+0000","last_became_active":"2024-05-08T05:45:54.781860+0000","last_became_peered":"2024-05-08T05:45:54.781860+0000","last_unstale":"2024-05-08T05:48:00.719465+0000","last_undegraded":"2024-05-08T05:48:00.719465+0000","last_fullsized":"2024-05-08T05:48:00.719465+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:50:14.658930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:48:02.137027+0000","last_change":"2024-05-08T05:45:54.770787+0000","last_active":"2024-05-08T05:48:02.137027+0000","last_peered":"2024-05-08T05:48:02.137027+0000","last_clean":"2024-05-08T05:48:02.137027+0000","last_became_active":"2024-05-08T05:45:54.770409+0000","last_became_peered":"2024-05-08T05:45:54.770409+0000","last_unstale":"2024-05-08T05:48:02.137027+0000","last_undegraded":"2024-05-08T05:48:02.137027+0000","last_fullsized":"2024-05-08T05:48:02.137027+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:09:31.102075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:48:02.137056+0000","last_change":"2024-05-08T05:45:54.788799+0000","last_active":"2024-05-08T05:48:02.137056+0000","last_peered":"2024-05-08T05:48:02.137056+0000","last_clean":"2024-05-08T05:48:02.137056+0000","last_became_active":"2024-05-08T05:45:54.788295+0000","last_became_peered":"2024-05-08T05:45:54.788295+0000","last_unstale":"2024-05-08T05:48:02.137056+0000","last_undegraded":"2024-05-08T05:48:02.137056+0000","last_fullsized":"2024-05-08T05:48:02.137056+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:55:07.912479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:48:02.673023+0000","last_change":"2024-05-08T05:45:54.801316+0000","last_active":"2024-05-08T05:48:02.673023+0000","last_peered":"2024-05-08T05:48:02.673023+0000","last_clean":"2024-05-08T05:48:02.673023+0000","last_became_active":"2024-05-08T05:45:54.798655+0000","last_became_peered":"2024-05-08T05:45:54.798655+0000","last_unstale":"2024-05-08T05:48:02.673023+0000","last_undegraded":"2024-05-08T05:48:02.673023+0000","last_fullsized":"2024-05-08T05:48:02.673023+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:30:25.786822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.100854+0000","last_change":"2024-05-08T05:45:54.793076+0000","last_active":"2024-05-08T05:47:44.100854+0000","last_peered":"2024-05-08T05:47:44.100854+0000","last_clean":"2024-05-08T05:47:44.100854+0000","last_became_active":"2024-05-08T05:45:54.792726+0000","last_became_peered":"2024-05-08T05:45:54.792726+0000","last_unstale":"2024-05-08T05:47:44.100854+0000","last_undegraded":"2024-05-08T05:47:44.100854+0000","last_fullsized":"2024-05-08T05:47:44.100854+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:46:02.659667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.081706+0000","last_change":"2024-05-08T05:45:54.779134+0000","last_active":"2024-05-08T05:47:44.081706+0000","last_peered":"2024-05-08T05:47:44.081706+0000","last_clean":"2024-05-08T05:47:44.081706+0000","last_became_active":"2024-05-08T05:45:54.778764+0000","last_became_peered":"2024-05-08T05:45:54.778764+0000","last_unstale":"2024-05-08T05:47:44.081706+0000","last_undegraded":"2024-05-08T05:47:44.081706+0000","last_fullsized":"2024-05-08T05:47:44.081706+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:10:00.531228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.077624+0000","last_change":"2024-05-08T05:45:54.775628+0000","last_active":"2024-05-08T05:47:44.077624+0000","last_peered":"2024-05-08T05:47:44.077624+0000","last_clean":"2024-05-08T05:47:44.077624+0000","last_became_active":"2024-05-08T05:45:54.775293+0000","last_became_peered":"2024-05-08T05:45:54.775293+0000","last_unstale":"2024-05-08T05:47:44.077624+0000","last_undegraded":"2024-05-08T05:47:44.077624+0000","last_fullsized":"2024-05-08T05:47:44.077624+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:02:57.884691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.100249+0000","last_change":"2024-05-08T05:45:54.805054+0000","last_active":"2024-05-08T05:47:44.100249+0000","last_peered":"2024-05-08T05:47:44.100249+0000","last_clean":"2024-05-08T05:47:44.100249+0000","last_became_active":"2024-05-08T05:45:54.804642+0000","last_became_peered":"2024-05-08T05:45:54.804642+0000","last_unstale":"2024-05-08T05:47:44.100249+0000","last_undegraded":"2024-05-08T05:47:44.100249+0000","last_fullsized":"2024-05-08T05:47:44.100249+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:17:22.412759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.103859+0000","last_change":"2024-05-08T05:45:54.792217+0000","last_active":"2024-05-08T05:47:44.103859+0000","last_peered":"2024-05-08T05:47:44.103859+0000","last_clean":"2024-05-08T05:47:44.103859+0000","last_became_active":"2024-05-08T05:45:54.791508+0000","last_became_peered":"2024-05-08T05:45:54.791508+0000","last_unstale":"2024-05-08T05:47:44.103859+0000","last_undegraded":"2024-05-08T05:47:44.103859+0000","last_fullsized":"2024-05-08T05:47:44.103859+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:47:19.053306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.108264+0000","last_change":"2024-05-08T05:45:54.794538+0000","last_active":"2024-05-08T05:47:44.108264+0000","last_peered":"2024-05-08T05:47:44.108264+0000","last_clean":"2024-05-08T05:47:44.108264+0000","last_became_active":"2024-05-08T05:45:54.792575+0000","last_became_peered":"2024-05-08T05:45:54.792575+0000","last_unstale":"2024-05-08T05:47:44.108264+0000","last_undegraded":"2024-05-08T05:47:44.108264+0000","last_fullsized":"2024-05-08T05:47:44.108264+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:54:31.086864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.107048+0000","last_change":"2024-05-08T05:45:54.782828+0000","last_active":"2024-05-08T05:47:44.107048+0000","last_peered":"2024-05-08T05:47:44.107048+0000","last_clean":"2024-05-08T05:47:44.107048+0000","last_became_active":"2024-05-08T05:45:54.782442+0000","last_became_peered":"2024-05-08T05:45:54.782442+0000","last_unstale":"2024-05-08T05:47:44.107048+0000","last_undegraded":"2024-05-08T05:47:44.107048+0000","last_fullsized":"2024-05-08T05:47:44.107048+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:42:53.551455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.100977+0000","last_change":"2024-05-08T05:45:54.800422+0000","last_active":"2024-05-08T05:47:44.100977+0000","last_peered":"2024-05-08T05:47:44.100977+0000","last_clean":"2024-05-08T05:47:44.100977+0000","last_became_active":"2024-05-08T05:45:54.799853+0000","last_became_peered":"2024-05-08T05:45:54.799853+0000","last_unstale":"2024-05-08T05:47:44.100977+0000","last_undegraded":"2024-05-08T05:47:44.100977+0000","last_fullsized":"2024-05-08T05:47:44.100977+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:54:22.710347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.104228+0000","last_change":"2024-05-08T05:46:45.775876+0000","last_active":"2024-05-08T05:47:44.104228+0000","last_peered":"2024-05-08T05:47:44.104228+0000","last_clean":"2024-05-08T05:47:44.104228+0000","last_became_active":"2024-05-08T05:46:45.775558+0000","last_became_peered":"2024-05-08T05:46:45.775558+0000","last_unstale":"2024-05-08T05:47:44.104228+0000","last_undegraded":"2024-05-08T05:47:44.104228+0000","last_fullsized":"2024-05-08T05:47:44.104228+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:11:38.649137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":311296,"data_stored":3542208,"data_compressed":212518,"data_compressed_allocated":270336,"data_compressed_original":3522560,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":82141,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":2340,"num_read_kb":1249,"num_write":273,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":55290,"num_keys_recovered":20,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":561152,"data_stored":246423,"data_compressed":9129,"data_compressed_allocated":12288,"data_compressed_original":53248,"omap_allocated":0,"internal_metadata":0},"log_size":233,"ondisk_log_size":233,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645379,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":901120,"data_stored":436421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841610,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32212,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712940,"statfs":{"total":95995035648,"available":95962050560,"internally_reserved":0,"allocated":1060864,"data_stored":1100554,"data_compressed":35691,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037839,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":917504,"data_stored":435360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234069,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":913408,"data_stored":435738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430298,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":1028957,"data_compressed":35691,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593825,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":901120,"data_stored":435077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574972,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":974848,"data_stored":509694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738497,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":921600,"data_stored":437339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411448,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":905216,"data_stored":437766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149809,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":917504,"data_stored":434902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953579,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":942080,"data_stored":509033,"data_compressed":9129,"data_compressed_allocated":12288,"data_compressed_original":53248,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790054,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":978944,"data_stored":1028244,"data_compressed":35691,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34063,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35691,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35691,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35691,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35691,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35691,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":75456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":74795,"data_compressed":9129,"data_compressed_allocated":12288,"data_compressed_original":53248,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":75831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T05:50:11.759 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-05-08T05:50:11.759 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-08T05:50:11.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:50:11 smithi151 ceph-mon[34815]: pgmap v445: 97 pgs: 97 active+clean; 657 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-05-08T05:50:12.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:12.003+0000 7f76d5000640 1 -- 172.21.15.82:0/1135548316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76d0109010 msgr2=0x7f76d0109430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:12.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:12.003+0000 7f76d5000640 1 --2- 172.21.15.82:0/1135548316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76d0109010 0x7f76d0109430 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f76c0009900 tx=0x7f76c002a410 comp rx=0 tx=0).stop 2024-05-08T05:50:12.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:12.003+0000 7f76d5000640 1 -- 172.21.15.82:0/1135548316 shutdown_connections 2024-05-08T05:50:12.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:12.003+0000 7f76d5000640 1 --2- 172.21.15.82:0/1135548316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76d010a200 0x7f76d010a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:12.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:12.003+0000 7f76d5000640 1 --2- 172.21.15.82:0/1135548316 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f76d010abc0 0x7f76d0111450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:12.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:12.003+0000 7f76d5000640 1 --2- 172.21.15.82:0/1135548316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76d0109010 0x7f76d0109430 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:12.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:12.003+0000 7f76d5000640 1 -- 172.21.15.82:0/1135548316 >> 172.21.15.82:0/1135548316 conn(0x7f76d0077fd0 msgr2=0x7f76d007a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:50:12.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:12.004+0000 7f76d5000640 1 -- 172.21.15.82:0/1135548316 shutdown_connections 2024-05-08T05:50:12.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:12.004+0000 7f76d5000640 1 -- 172.21.15.82:0/1135548316 wait complete. 2024-05-08T05:50:12.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:12.005+0000 7f76d5000640 1 Processor -- start 2024-05-08T05:50:12.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:12.005+0000 7f76d5000640 1 -- start start 2024-05-08T05:50:12.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:12.005+0000 7f76d5000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f76d0109010 0x7f76d019f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:12.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:12.005+0000 7f76d5000640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76d010a200 0x7f76d019f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:12.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:12.005+0000 7f76d5000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76d010abc0 0x7f76d01a67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:12.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:12.005+0000 7f76d5000640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f76d0114b50 con 0x7f76d010a200 2024-05-08T05:50:12.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:12.005+0000 7f76d5000640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f76d01149d0 con 0x7f76d010abc0 2024-05-08T05:50:12.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:12.005+0000 7f76d5000640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f76d0114cd0 con 0x7f76d0109010 2024-05-08T05:50:12.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:12.005+0000 7f76c7e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76d010a200 0x7f76d019f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:12.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:12.005+0000 7f76ce800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76d010abc0 0x7f76d01a67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:12.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:12.005+0000 7f76cde00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f76d0109010 0x7f76d019f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:12.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:12.005+0000 7f76c7e00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76d010a200 0x7f76d019f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53508/0 (socket says 172.21.15.82:53508) 2024-05-08T05:50:12.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:12.005+0000 7f76c7e00640 1 -- 172.21.15.82:0/3485697075 learned_addr learned my addr 172.21.15.82:0/3485697075 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:50:12.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:12.006+0000 7f76ce800640 1 -- 172.21.15.82:0/3485697075 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f76d0109010 msgr2=0x7f76d019f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:12.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:12.006+0000 7f76ce800640 1 --2- 172.21.15.82:0/3485697075 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f76d0109010 0x7f76d019f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:12.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:12.006+0000 7f76ce800640 1 -- 172.21.15.82:0/3485697075 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76d010a200 msgr2=0x7f76d019f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:12.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:12.006+0000 7f76ce800640 1 --2- 172.21.15.82:0/3485697075 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76d010a200 0x7f76d019f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:12.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:12.006+0000 7f76ce800640 1 -- 172.21.15.82:0/3485697075 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76d01a6e60 con 0x7f76d010abc0 2024-05-08T05:50:12.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:12.006+0000 7f76ce800640 1 --2- 172.21.15.82:0/3485697075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76d010abc0 0x7f76d01a67f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f76c8009fd0 tx=0x7f76c800ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:50:12.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:12.006+0000 7f76c6a00640 1 -- 172.21.15.82:0/3485697075 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c800ce20 con 0x7f76d010abc0 2024-05-08T05:50:12.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:12.007+0000 7f76c6a00640 1 -- 172.21.15.82:0/3485697075 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76c8005020 con 0x7f76d010abc0 2024-05-08T05:50:12.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:12.007+0000 7f76c6a00640 1 -- 172.21.15.82:0/3485697075 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c8010690 con 0x7f76d010abc0 2024-05-08T05:50:12.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:12.007+0000 7f76d5000640 1 -- 172.21.15.82:0/3485697075 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76d01a7150 con 0x7f76d010abc0 2024-05-08T05:50:12.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:12.007+0000 7f76d5000640 1 -- 172.21.15.82:0/3485697075 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76d01a7650 con 0x7f76d010abc0 2024-05-08T05:50:12.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:12.008+0000 7f76d5000640 1 -- 172.21.15.82:0/3485697075 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76d0110350 con 0x7f76d010abc0 2024-05-08T05:50:12.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:12.010+0000 7f76c6a00640 1 -- 172.21.15.82:0/3485697075 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) ==== 149703+0+0 (secure 0 0 0) 0x7f76c80054d0 con 0x7f76d010abc0 2024-05-08T05:50:12.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:12.011+0000 7f76c6a00640 1 --2- 172.21.15.82:0/3485697075 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f76b40b2900 0x7f76b40b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:12.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:12.012+0000 7f76c6a00640 1 -- 172.21.15.82:0/3485697075 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f76c80e2a00 con 0x7f76d010abc0 2024-05-08T05:50:12.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:12.012+0000 7f76cde00640 1 --2- 172.21.15.82:0/3485697075 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f76b40b2900 0x7f76b40b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:12.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:12.013+0000 7f76cde00640 1 --2- 172.21.15.82:0/3485697075 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f76b40b2900 0x7f76b40b4dc0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f76c0009230 tx=0x7f76c00314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:50:12.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:12.014+0000 7f76c6a00640 1 -- 172.21.15.82:0/3485697075 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f76c80aa570 con 0x7f76d010abc0 2024-05-08T05:50:12.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:12.221+0000 7f76d5000640 1 -- 172.21.15.82:0/3485697075 --> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f76d0062df0 con 0x7f76b40b2900 2024-05-08T05:50:12.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:12.241+0000 7f76c6a00640 1 -- 172.21.15.82:0/3485697075 <== mgr.14152 v2:172.21.15.82:6800/4089180091 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+259043 (secure 0 0 0) 0x7f76d0062df0 con 0x7f76b40b2900 2024-05-08T05:50:12.246 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:50:12.247 INFO:teuthology.orchestra.run.smithi082.stderr:dumped all 2024-05-08T05:50:12.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:12.248+0000 7f76d5000640 1 -- 172.21.15.82:0/3485697075 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f76b40b2900 msgr2=0x7f76b40b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:12.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:12.248+0000 7f76d5000640 1 --2- 172.21.15.82:0/3485697075 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f76b40b2900 0x7f76b40b4dc0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f76c0009230 tx=0x7f76c00314a0 comp rx=0 tx=0).stop 2024-05-08T05:50:12.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:12.248+0000 7f76d5000640 1 -- 172.21.15.82:0/3485697075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76d010abc0 msgr2=0x7f76d01a67f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:12.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:12.248+0000 7f76d5000640 1 --2- 172.21.15.82:0/3485697075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76d010abc0 0x7f76d01a67f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f76c8009fd0 tx=0x7f76c800ef10 comp rx=0 tx=0).stop 2024-05-08T05:50:12.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:12.248+0000 7f76d5000640 1 -- 172.21.15.82:0/3485697075 shutdown_connections 2024-05-08T05:50:12.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:12.248+0000 7f76d5000640 1 --2- 172.21.15.82:0/3485697075 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f76b40b2900 0x7f76b40b4dc0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:12.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:12.248+0000 7f76d5000640 1 --2- 172.21.15.82:0/3485697075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76d010abc0 0x7f76d01a67f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:12.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:12.248+0000 7f76d5000640 1 --2- 172.21.15.82:0/3485697075 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f76d010a200 0x7f76d019f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:12.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:12.248+0000 7f76d5000640 1 --2- 172.21.15.82:0/3485697075 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f76d0109010 0x7f76d019f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:12.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:12.248+0000 7f76d5000640 1 -- 172.21.15.82:0/3485697075 >> 172.21.15.82:0/3485697075 conn(0x7f76d0077fd0 msgr2=0x7f76d010d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:50:12.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:12.248+0000 7f76d5000640 1 -- 172.21.15.82:0/3485697075 shutdown_connections 2024-05-08T05:50:12.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:12.248+0000 7f76d5000640 1 -- 172.21.15.82:0/3485697075 wait complete. 2024-05-08T05:50:12.269 INFO:teuthology.orchestra.run.smithi082.stdout:{"pg_ready":true,"pg_map":{"version":446,"stamp":"2024-05-08T05:50:12.205825+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":672743,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":2441,"num_read_kb":1328,"num_write":398,"num_write_kb":2319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":3007130,"num_keys_recovered":20,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":827,"ondisk_log_size":827,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":351868,"kb_used_data":11036,"kb_used_omap":18,"kb_used_meta":340717,"kb_avail":1124589956,"statfs":{"total":1151940427776,"available":1151580114944,"internally_reserved":0,"allocated":11300864,"data_stored":7229085,"data_compressed":116202,"data_compressed_allocated":147456,"data_compressed_original":1822720,"omap_allocated":19138,"internal_metadata":348894526},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9018,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":130,"num_read_kb":77,"num_write":19,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005116"},"pg_stats":[{"pgid":"3.3f","version":"82'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:48:00.719508+0000","last_change":"2024-05-08T05:45:54.796792+0000","last_active":"2024-05-08T05:48:00.719508+0000","last_peered":"2024-05-08T05:48:00.719508+0000","last_clean":"2024-05-08T05:48:00.719508+0000","last_became_active":"2024-05-08T05:45:54.796445+0000","last_became_peered":"2024-05-08T05:45:54.796445+0000","last_unstale":"2024-05-08T05:48:00.719508+0000","last_undegraded":"2024-05-08T05:48:00.719508+0000","last_fullsized":"2024-05-08T05:48:00.719508+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:41:12.762659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"82'4","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:48:02.673136+0000","last_change":"2024-05-08T05:45:54.800291+0000","last_active":"2024-05-08T05:48:02.673136+0000","last_peered":"2024-05-08T05:48:02.673136+0000","last_clean":"2024-05-08T05:48:02.673136+0000","last_became_active":"2024-05-08T05:45:54.798182+0000","last_became_peered":"2024-05-08T05:45:54.798182+0000","last_unstale":"2024-05-08T05:48:02.673136+0000","last_undegraded":"2024-05-08T05:48:02.673136+0000","last_fullsized":"2024-05-08T05:48:02.673136+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:55:52.672307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"82'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:48:02.673095+0000","last_change":"2024-05-08T05:45:54.792574+0000","last_active":"2024-05-08T05:48:02.673095+0000","last_peered":"2024-05-08T05:48:02.673095+0000","last_clean":"2024-05-08T05:48:02.673095+0000","last_became_active":"2024-05-08T05:45:54.790856+0000","last_became_peered":"2024-05-08T05:45:54.790856+0000","last_unstale":"2024-05-08T05:48:02.673095+0000","last_undegraded":"2024-05-08T05:48:02.673095+0000","last_fullsized":"2024-05-08T05:48:02.673095+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:32:33.727532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"82'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:55.165392+0000","last_change":"2024-05-08T05:45:54.772883+0000","last_active":"2024-05-08T05:47:55.165392+0000","last_peered":"2024-05-08T05:47:55.165392+0000","last_clean":"2024-05-08T05:47:55.165392+0000","last_became_active":"2024-05-08T05:45:54.772457+0000","last_became_peered":"2024-05-08T05:45:54.772457+0000","last_unstale":"2024-05-08T05:47:55.165392+0000","last_undegraded":"2024-05-08T05:47:55.165392+0000","last_fullsized":"2024-05-08T05:47:55.165392+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:50:20.116563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"82'4","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.104530+0000","last_change":"2024-05-08T05:45:54.798868+0000","last_active":"2024-05-08T05:47:44.104530+0000","last_peered":"2024-05-08T05:47:44.104530+0000","last_clean":"2024-05-08T05:47:44.104530+0000","last_became_active":"2024-05-08T05:45:54.798459+0000","last_became_peered":"2024-05-08T05:45:54.798459+0000","last_unstale":"2024-05-08T05:47:44.104530+0000","last_undegraded":"2024-05-08T05:47:44.104530+0000","last_fullsized":"2024-05-08T05:47:44.104530+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:59:32.280051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.103537+0000","last_change":"2024-05-08T05:45:54.788172+0000","last_active":"2024-05-08T05:47:44.103537+0000","last_peered":"2024-05-08T05:47:44.103537+0000","last_clean":"2024-05-08T05:47:44.103537+0000","last_became_active":"2024-05-08T05:45:54.787609+0000","last_became_peered":"2024-05-08T05:45:54.787609+0000","last_unstale":"2024-05-08T05:47:44.103537+0000","last_undegraded":"2024-05-08T05:47:44.103537+0000","last_fullsized":"2024-05-08T05:47:44.103537+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:30:17.295770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.090733+0000","last_change":"2024-05-08T05:45:54.786904+0000","last_active":"2024-05-08T05:47:44.090733+0000","last_peered":"2024-05-08T05:47:44.090733+0000","last_clean":"2024-05-08T05:47:44.090733+0000","last_became_active":"2024-05-08T05:45:54.786484+0000","last_became_peered":"2024-05-08T05:45:54.786484+0000","last_unstale":"2024-05-08T05:47:44.090733+0000","last_undegraded":"2024-05-08T05:47:44.090733+0000","last_fullsized":"2024-05-08T05:47:44.090733+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:14:15.398144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.104866+0000","last_change":"2024-05-08T05:45:54.801559+0000","last_active":"2024-05-08T05:47:44.104866+0000","last_peered":"2024-05-08T05:47:44.104866+0000","last_clean":"2024-05-08T05:47:44.104866+0000","last_became_active":"2024-05-08T05:45:54.796293+0000","last_became_peered":"2024-05-08T05:45:54.796293+0000","last_unstale":"2024-05-08T05:47:44.104866+0000","last_undegraded":"2024-05-08T05:47:44.104866+0000","last_fullsized":"2024-05-08T05:47:44.104866+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:07:05.483562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"82'11","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.097674+0000","last_change":"2024-05-08T05:45:54.780450+0000","last_active":"2024-05-08T05:47:44.097674+0000","last_peered":"2024-05-08T05:47:44.097674+0000","last_clean":"2024-05-08T05:47:44.097674+0000","last_became_active":"2024-05-08T05:45:54.780079+0000","last_became_peered":"2024-05-08T05:45:54.780079+0000","last_unstale":"2024-05-08T05:47:44.097674+0000","last_undegraded":"2024-05-08T05:47:44.097674+0000","last_fullsized":"2024-05-08T05:47:44.097674+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:41:26.688748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'16","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.078720+0000","last_change":"2024-05-08T05:45:54.776294+0000","last_active":"2024-05-08T05:47:44.078720+0000","last_peered":"2024-05-08T05:47:44.078720+0000","last_clean":"2024-05-08T05:47:44.078720+0000","last_became_active":"2024-05-08T05:45:54.775928+0000","last_became_peered":"2024-05-08T05:45:54.775928+0000","last_unstale":"2024-05-08T05:47:44.078720+0000","last_undegraded":"2024-05-08T05:47:44.078720+0000","last_fullsized":"2024-05-08T05:47:44.078720+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:17:53.453446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.095848+0000","last_change":"2024-05-08T05:45:54.781478+0000","last_active":"2024-05-08T05:47:44.095848+0000","last_peered":"2024-05-08T05:47:44.095848+0000","last_clean":"2024-05-08T05:47:44.095848+0000","last_became_active":"2024-05-08T05:45:54.780839+0000","last_became_peered":"2024-05-08T05:45:54.780839+0000","last_unstale":"2024-05-08T05:47:44.095848+0000","last_undegraded":"2024-05-08T05:47:44.095848+0000","last_fullsized":"2024-05-08T05:47:44.095848+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:39:14.518391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.082422+0000","last_change":"2024-05-08T05:45:54.774650+0000","last_active":"2024-05-08T05:47:44.082422+0000","last_peered":"2024-05-08T05:47:44.082422+0000","last_clean":"2024-05-08T05:47:44.082422+0000","last_became_active":"2024-05-08T05:45:54.774276+0000","last_became_peered":"2024-05-08T05:45:54.774276+0000","last_unstale":"2024-05-08T05:47:44.082422+0000","last_undegraded":"2024-05-08T05:47:44.082422+0000","last_fullsized":"2024-05-08T05:47:44.082422+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:43:53.390553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"82'10","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.093679+0000","last_change":"2024-05-08T05:45:54.783430+0000","last_active":"2024-05-08T05:47:44.093679+0000","last_peered":"2024-05-08T05:47:44.093679+0000","last_clean":"2024-05-08T05:47:44.093679+0000","last_became_active":"2024-05-08T05:45:54.782394+0000","last_became_peered":"2024-05-08T05:45:54.782394+0000","last_unstale":"2024-05-08T05:47:44.093679+0000","last_undegraded":"2024-05-08T05:47:44.093679+0000","last_fullsized":"2024-05-08T05:47:44.093679+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:47:01.864111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.107049+0000","last_change":"2024-05-08T05:45:54.792880+0000","last_active":"2024-05-08T05:47:44.107049+0000","last_peered":"2024-05-08T05:47:44.107049+0000","last_clean":"2024-05-08T05:47:44.107049+0000","last_became_active":"2024-05-08T05:45:54.789653+0000","last_became_peered":"2024-05-08T05:45:54.789653+0000","last_unstale":"2024-05-08T05:47:44.107049+0000","last_undegraded":"2024-05-08T05:47:44.107049+0000","last_fullsized":"2024-05-08T05:47:44.107049+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:57:10.552014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.105891+0000","last_change":"2024-05-08T05:45:54.793612+0000","last_active":"2024-05-08T05:47:44.105891+0000","last_peered":"2024-05-08T05:47:44.105891+0000","last_clean":"2024-05-08T05:47:44.105891+0000","last_became_active":"2024-05-08T05:45:54.793191+0000","last_became_peered":"2024-05-08T05:45:54.793191+0000","last_unstale":"2024-05-08T05:47:44.105891+0000","last_undegraded":"2024-05-08T05:47:44.105891+0000","last_fullsized":"2024-05-08T05:47:44.105891+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:49:35.066070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.110756+0000","last_change":"2024-05-08T05:45:54.799679+0000","last_active":"2024-05-08T05:47:44.110756+0000","last_peered":"2024-05-08T05:47:44.110756+0000","last_clean":"2024-05-08T05:47:44.110756+0000","last_became_active":"2024-05-08T05:45:54.799196+0000","last_became_peered":"2024-05-08T05:45:54.799196+0000","last_unstale":"2024-05-08T05:47:44.110756+0000","last_undegraded":"2024-05-08T05:47:44.110756+0000","last_fullsized":"2024-05-08T05:47:44.110756+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:14:00.597282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.104930+0000","last_change":"2024-05-08T05:45:54.796799+0000","last_active":"2024-05-08T05:47:44.104930+0000","last_peered":"2024-05-08T05:47:44.104930+0000","last_clean":"2024-05-08T05:47:44.104930+0000","last_became_active":"2024-05-08T05:45:54.796501+0000","last_became_peered":"2024-05-08T05:45:54.796501+0000","last_unstale":"2024-05-08T05:47:44.104930+0000","last_undegraded":"2024-05-08T05:47:44.104930+0000","last_fullsized":"2024-05-08T05:47:44.104930+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:14:59.446718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"82'10","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.108986+0000","last_change":"2024-05-08T05:45:54.789544+0000","last_active":"2024-05-08T05:47:44.108986+0000","last_peered":"2024-05-08T05:47:44.108986+0000","last_clean":"2024-05-08T05:47:44.108986+0000","last_became_active":"2024-05-08T05:45:54.787901+0000","last_became_peered":"2024-05-08T05:45:54.787901+0000","last_unstale":"2024-05-08T05:47:44.108986+0000","last_undegraded":"2024-05-08T05:47:44.108986+0000","last_fullsized":"2024-05-08T05:47:44.108986+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:12:23.200311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.104801+0000","last_change":"2024-05-08T05:45:54.782537+0000","last_active":"2024-05-08T05:47:44.104801+0000","last_peered":"2024-05-08T05:47:44.104801+0000","last_clean":"2024-05-08T05:47:44.104801+0000","last_became_active":"2024-05-08T05:45:54.781389+0000","last_became_peered":"2024-05-08T05:45:54.781389+0000","last_unstale":"2024-05-08T05:47:44.104801+0000","last_undegraded":"2024-05-08T05:47:44.104801+0000","last_fullsized":"2024-05-08T05:47:44.104801+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:56:22.041900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"80'13","reported_seq":273,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:50:07.497674+0000","last_change":"2024-05-08T05:45:50.744496+0000","last_active":"2024-05-08T05:50:07.497674+0000","last_peered":"2024-05-08T05:50:07.497674+0000","last_clean":"2024-05-08T05:50:07.497674+0000","last_became_active":"2024-05-08T05:45:50.743882+0000","last_became_peered":"2024-05-08T05:45:50.743882+0000","last_unstale":"2024-05-08T05:50:07.497674+0000","last_undegraded":"2024-05-08T05:50:07.497674+0000","last_fullsized":"2024-05-08T05:50:07.497674+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:45:11.198096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":232,"num_read_kb":232,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"82'5","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.081356+0000","last_change":"2024-05-08T05:46:45.957649+0000","last_active":"2024-05-08T05:47:44.081356+0000","last_peered":"2024-05-08T05:47:44.081356+0000","last_clean":"2024-05-08T05:47:44.081356+0000","last_became_active":"2024-05-08T05:46:45.957154+0000","last_became_peered":"2024-05-08T05:46:45.957154+0000","last_unstale":"2024-05-08T05:47:44.081356+0000","last_undegraded":"2024-05-08T05:47:44.081356+0000","last_fullsized":"2024-05-08T05:47:44.081356+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:29:25.475541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1e","version":"80'2","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:54.178928+0000","last_change":"2024-05-08T05:45:50.863409+0000","last_active":"2024-05-08T05:47:54.178928+0000","last_peered":"2024-05-08T05:47:54.178928+0000","last_clean":"2024-05-08T05:47:54.178928+0000","last_became_active":"2024-05-08T05:45:50.861818+0000","last_became_peered":"2024-05-08T05:45:50.861818+0000","last_unstale":"2024-05-08T05:47:54.178928+0000","last_undegraded":"2024-05-08T05:47:54.178928+0000","last_fullsized":"2024-05-08T05:47:54.178928+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:39:32.821431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"82'6","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:48:02.673181+0000","last_change":"2024-05-08T05:45:54.797429+0000","last_active":"2024-05-08T05:48:02.673181+0000","last_peered":"2024-05-08T05:48:02.673181+0000","last_clean":"2024-05-08T05:48:02.673181+0000","last_became_active":"2024-05-08T05:45:54.795030+0000","last_became_peered":"2024-05-08T05:45:54.795030+0000","last_unstale":"2024-05-08T05:48:02.673181+0000","last_undegraded":"2024-05-08T05:48:02.673181+0000","last_fullsized":"2024-05-08T05:48:02.673181+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:43:34.852889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"80'12","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.773238+0000","last_change":"2024-05-08T05:46:45.772846+0000","last_active":"2024-05-08T05:46:45.773238+0000","last_peered":"2024-05-08T05:46:45.773238+0000","last_clean":"2024-05-08T05:46:45.773238+0000","last_became_active":"2024-05-08T05:46:45.763937+0000","last_became_peered":"2024-05-08T05:46:45.763937+0000","last_unstale":"2024-05-08T05:46:45.773238+0000","last_undegraded":"2024-05-08T05:46:45.773238+0000","last_fullsized":"2024-05-08T05:46:45.773238+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:48:13.233059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.099418+0000","last_change":"2024-05-08T05:45:54.788852+0000","last_active":"2024-05-08T05:47:44.099418+0000","last_peered":"2024-05-08T05:47:44.099418+0000","last_clean":"2024-05-08T05:47:44.099418+0000","last_became_active":"2024-05-08T05:45:54.788496+0000","last_became_peered":"2024-05-08T05:45:54.788496+0000","last_unstale":"2024-05-08T05:47:44.099418+0000","last_undegraded":"2024-05-08T05:47:44.099418+0000","last_fullsized":"2024-05-08T05:47:44.099418+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:44:45.379728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"80'5","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762912+0000","last_change":"2024-05-08T05:45:50.741528+0000","last_active":"2024-05-08T05:46:45.762912+0000","last_peered":"2024-05-08T05:46:45.762912+0000","last_clean":"2024-05-08T05:46:45.762912+0000","last_became_active":"2024-05-08T05:45:50.741232+0000","last_became_peered":"2024-05-08T05:45:50.741232+0000","last_unstale":"2024-05-08T05:46:45.762912+0000","last_undegraded":"2024-05-08T05:46:45.762912+0000","last_fullsized":"2024-05-08T05:46:45.762912+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:36:48.540858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"82'15","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.099734+0000","last_change":"2024-05-08T05:46:45.954990+0000","last_active":"2024-05-08T05:47:44.099734+0000","last_peered":"2024-05-08T05:47:44.099734+0000","last_clean":"2024-05-08T05:47:44.099734+0000","last_became_active":"2024-05-08T05:46:45.953589+0000","last_became_peered":"2024-05-08T05:46:45.953589+0000","last_unstale":"2024-05-08T05:47:44.099734+0000","last_undegraded":"2024-05-08T05:47:44.099734+0000","last_fullsized":"2024-05-08T05:47:44.099734+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:29:17.410356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,1],"acting":[9,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1b","version":"82'7","reported_seq":270,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:50:08.326233+0000","last_change":"2024-05-08T05:45:50.746462+0000","last_active":"2024-05-08T05:50:08.326233+0000","last_peered":"2024-05-08T05:50:08.326233+0000","last_clean":"2024-05-08T05:50:08.326233+0000","last_became_active":"2024-05-08T05:45:50.746064+0000","last_became_peered":"2024-05-08T05:45:50.746064+0000","last_unstale":"2024-05-08T05:50:08.326233+0000","last_undegraded":"2024-05-08T05:50:08.326233+0000","last_fullsized":"2024-05-08T05:50:08.326233+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:51:49.076829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1323,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":236,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.086315+0000","last_change":"2024-05-08T05:45:54.788524+0000","last_active":"2024-05-08T05:47:44.086315+0000","last_peered":"2024-05-08T05:47:44.086315+0000","last_clean":"2024-05-08T05:47:44.086315+0000","last_became_active":"2024-05-08T05:45:54.788179+0000","last_became_peered":"2024-05-08T05:45:54.788179+0000","last_unstale":"2024-05-08T05:47:44.086315+0000","last_undegraded":"2024-05-08T05:47:44.086315+0000","last_fullsized":"2024-05-08T05:47:44.086315+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:44:34.257799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"80'7","reported_seq":48,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.781138+0000","last_change":"2024-05-08T05:46:45.780705+0000","last_active":"2024-05-08T05:46:45.781138+0000","last_peered":"2024-05-08T05:46:45.781138+0000","last_clean":"2024-05-08T05:46:45.781138+0000","last_became_active":"2024-05-08T05:46:45.773246+0000","last_became_peered":"2024-05-08T05:46:45.773246+0000","last_unstale":"2024-05-08T05:46:45.781138+0000","last_undegraded":"2024-05-08T05:46:45.781138+0000","last_fullsized":"2024-05-08T05:46:45.781138+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:10:33.491186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.103877+0000","last_change":"2024-05-08T05:45:54.792001+0000","last_active":"2024-05-08T05:47:44.103877+0000","last_peered":"2024-05-08T05:47:44.103877+0000","last_clean":"2024-05-08T05:47:44.103877+0000","last_became_active":"2024-05-08T05:45:54.791581+0000","last_became_peered":"2024-05-08T05:45:54.791581+0000","last_unstale":"2024-05-08T05:47:44.103877+0000","last_undegraded":"2024-05-08T05:47:44.103877+0000","last_fullsized":"2024-05-08T05:47:44.103877+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:43:37.437251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"80'3","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.771676+0000","last_change":"2024-05-08T05:45:50.740645+0000","last_active":"2024-05-08T05:46:45.771676+0000","last_peered":"2024-05-08T05:46:45.771676+0000","last_clean":"2024-05-08T05:46:45.771676+0000","last_became_active":"2024-05-08T05:45:50.739997+0000","last_became_peered":"2024-05-08T05:45:50.739997+0000","last_unstale":"2024-05-08T05:46:45.771676+0000","last_undegraded":"2024-05-08T05:46:45.771676+0000","last_fullsized":"2024-05-08T05:46:45.771676+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:24:48.895557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.105072+0000","last_change":"2024-05-08T05:45:54.802757+0000","last_active":"2024-05-08T05:47:44.105072+0000","last_peered":"2024-05-08T05:47:44.105072+0000","last_clean":"2024-05-08T05:47:44.105072+0000","last_became_active":"2024-05-08T05:45:54.798549+0000","last_became_peered":"2024-05-08T05:45:54.798549+0000","last_unstale":"2024-05-08T05:47:44.105072+0000","last_undegraded":"2024-05-08T05:47:44.105072+0000","last_fullsized":"2024-05-08T05:47:44.105072+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:39:37.582997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"80'3","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.956005+0000","last_change":"2024-05-08T05:45:50.743989+0000","last_active":"2024-05-08T05:46:45.956005+0000","last_peered":"2024-05-08T05:46:45.956005+0000","last_clean":"2024-05-08T05:46:45.956005+0000","last_became_active":"2024-05-08T05:45:50.743582+0000","last_became_peered":"2024-05-08T05:45:50.743582+0000","last_unstale":"2024-05-08T05:46:45.956005+0000","last_undegraded":"2024-05-08T05:46:45.956005+0000","last_fullsized":"2024-05-08T05:46:45.956005+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:14:46.820582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"82'11","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.108021+0000","last_change":"2024-05-08T05:45:54.807249+0000","last_active":"2024-05-08T05:47:44.108021+0000","last_peered":"2024-05-08T05:47:44.108021+0000","last_clean":"2024-05-08T05:47:44.108021+0000","last_became_active":"2024-05-08T05:45:54.806823+0000","last_became_peered":"2024-05-08T05:45:54.806823+0000","last_unstale":"2024-05-08T05:47:44.108021+0000","last_undegraded":"2024-05-08T05:47:44.108021+0000","last_fullsized":"2024-05-08T05:47:44.108021+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:37:25.526927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"82'7","reported_seq":501,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:50:10.471999+0000","last_change":"2024-05-08T05:45:50.747477+0000","last_active":"2024-05-08T05:50:10.471999+0000","last_peered":"2024-05-08T05:50:10.471999+0000","last_clean":"2024-05-08T05:50:10.471999+0000","last_became_active":"2024-05-08T05:45:50.747103+0000","last_became_peered":"2024-05-08T05:45:50.747103+0000","last_unstale":"2024-05-08T05:50:10.471999+0000","last_undegraded":"2024-05-08T05:50:10.471999+0000","last_fullsized":"2024-05-08T05:50:10.471999+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:08:17.108826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":467,"num_read_kb":467,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"82'10","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.109143+0000","last_change":"2024-05-08T05:45:54.787885+0000","last_active":"2024-05-08T05:47:44.109143+0000","last_peered":"2024-05-08T05:47:44.109143+0000","last_clean":"2024-05-08T05:47:44.109143+0000","last_became_active":"2024-05-08T05:45:54.787480+0000","last_became_peered":"2024-05-08T05:45:54.787480+0000","last_unstale":"2024-05-08T05:47:44.109143+0000","last_undegraded":"2024-05-08T05:47:44.109143+0000","last_fullsized":"2024-05-08T05:47:44.109143+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:13:42.889918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"80'4","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.763077+0000","last_change":"2024-05-08T05:45:50.741271+0000","last_active":"2024-05-08T05:46:45.763077+0000","last_peered":"2024-05-08T05:46:45.763077+0000","last_clean":"2024-05-08T05:46:45.763077+0000","last_became_active":"2024-05-08T05:45:50.740869+0000","last_became_peered":"2024-05-08T05:45:50.740869+0000","last_unstale":"2024-05-08T05:46:45.763077+0000","last_undegraded":"2024-05-08T05:46:45.763077+0000","last_fullsized":"2024-05-08T05:46:45.763077+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:57:40.855732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"82'9","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.107752+0000","last_change":"2024-05-08T05:46:45.958524+0000","last_active":"2024-05-08T05:47:44.107752+0000","last_peered":"2024-05-08T05:47:44.107752+0000","last_clean":"2024-05-08T05:47:44.107752+0000","last_became_active":"2024-05-08T05:46:45.957576+0000","last_became_peered":"2024-05-08T05:46:45.957576+0000","last_unstale":"2024-05-08T05:47:44.107752+0000","last_undegraded":"2024-05-08T05:47:44.107752+0000","last_fullsized":"2024-05-08T05:47:44.107752+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:59:34.927448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,5],"acting":[0,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"80'5","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.956564+0000","last_change":"2024-05-08T05:45:50.865467+0000","last_active":"2024-05-08T05:46:45.956564+0000","last_peered":"2024-05-08T05:46:45.956564+0000","last_clean":"2024-05-08T05:46:45.956564+0000","last_became_active":"2024-05-08T05:45:50.865245+0000","last_became_peered":"2024-05-08T05:45:50.865245+0000","last_unstale":"2024-05-08T05:46:45.956564+0000","last_undegraded":"2024-05-08T05:46:45.956564+0000","last_fullsized":"2024-05-08T05:46:45.956564+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:03:40.990651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"82'11","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.099169+0000","last_change":"2024-05-08T05:45:54.780782+0000","last_active":"2024-05-08T05:47:44.099169+0000","last_peered":"2024-05-08T05:47:44.099169+0000","last_clean":"2024-05-08T05:47:44.099169+0000","last_became_active":"2024-05-08T05:45:54.780074+0000","last_became_peered":"2024-05-08T05:45:54.780074+0000","last_unstale":"2024-05-08T05:47:44.099169+0000","last_undegraded":"2024-05-08T05:47:44.099169+0000","last_fullsized":"2024-05-08T05:47:44.099169+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:23:09.026115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"82'40","reported_seq":568,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:50:11.285942+0000","last_change":"2024-05-08T05:46:45.965985+0000","last_active":"2024-05-08T05:50:11.285942+0000","last_peered":"2024-05-08T05:50:11.285942+0000","last_clean":"2024-05-08T05:50:11.285942+0000","last_became_active":"2024-05-08T05:46:45.953485+0000","last_became_peered":"2024-05-08T05:46:45.953485+0000","last_unstale":"2024-05-08T05:50:11.285942+0000","last_undegraded":"2024-05-08T05:50:11.285942+0000","last_fullsized":"2024-05-08T05:50:11.285942+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:51:45.723988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73704,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":472,"num_read_kb":301,"num_write":42,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":55222,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,4],"acting":[10,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.088260+0000","last_change":"2024-05-08T05:45:54.777524+0000","last_active":"2024-05-08T05:47:44.088260+0000","last_peered":"2024-05-08T05:47:44.088260+0000","last_clean":"2024-05-08T05:47:44.088260+0000","last_became_active":"2024-05-08T05:45:54.776756+0000","last_became_peered":"2024-05-08T05:45:54.776756+0000","last_unstale":"2024-05-08T05:47:44.088260+0000","last_undegraded":"2024-05-08T05:47:44.088260+0000","last_fullsized":"2024-05-08T05:47:44.088260+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:54:27.320411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"80'9","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.783597+0000","last_change":"2024-05-08T05:46:45.783284+0000","last_active":"2024-05-08T05:46:45.783597+0000","last_peered":"2024-05-08T05:46:45.783597+0000","last_clean":"2024-05-08T05:46:45.783597+0000","last_became_active":"2024-05-08T05:46:45.765201+0000","last_became_peered":"2024-05-08T05:46:45.765201+0000","last_unstale":"2024-05-08T05:46:45.783597+0000","last_undegraded":"2024-05-08T05:46:45.783597+0000","last_fullsized":"2024-05-08T05:46:45.783597+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:44:59.762324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":68,"num_keys_recovered":10,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.105689+0000","last_change":"2024-05-08T05:45:54.789165+0000","last_active":"2024-05-08T05:47:44.105689+0000","last_peered":"2024-05-08T05:47:44.105689+0000","last_clean":"2024-05-08T05:47:44.105689+0000","last_became_active":"2024-05-08T05:45:54.788673+0000","last_became_peered":"2024-05-08T05:45:54.788673+0000","last_unstale":"2024-05-08T05:47:44.105689+0000","last_undegraded":"2024-05-08T05:47:44.105689+0000","last_fullsized":"2024-05-08T05:47:44.105689+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:29:08.722409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"80'5","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.956256+0000","last_change":"2024-05-08T05:45:50.750836+0000","last_active":"2024-05-08T05:46:45.956256+0000","last_peered":"2024-05-08T05:46:45.956256+0000","last_clean":"2024-05-08T05:46:45.956256+0000","last_became_active":"2024-05-08T05:45:50.750587+0000","last_became_peered":"2024-05-08T05:45:50.750587+0000","last_unstale":"2024-05-08T05:46:45.956256+0000","last_undegraded":"2024-05-08T05:46:45.956256+0000","last_fullsized":"2024-05-08T05:46:45.956256+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:19:03.780050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"82'15","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.096929+0000","last_change":"2024-05-08T05:45:54.791475+0000","last_active":"2024-05-08T05:47:44.096929+0000","last_peered":"2024-05-08T05:47:44.096929+0000","last_clean":"2024-05-08T05:47:44.096929+0000","last_became_active":"2024-05-08T05:45:54.791122+0000","last_became_peered":"2024-05-08T05:45:54.791122+0000","last_unstale":"2024-05-08T05:47:44.096929+0000","last_undegraded":"2024-05-08T05:47:44.096929+0000","last_fullsized":"2024-05-08T05:47:44.096929+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:08:01.261852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"82'6","reported_seq":268,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:50:08.408135+0000","last_change":"2024-05-08T05:45:50.742848+0000","last_active":"2024-05-08T05:50:08.408135+0000","last_peered":"2024-05-08T05:50:08.408135+0000","last_clean":"2024-05-08T05:50:08.408135+0000","last_became_active":"2024-05-08T05:45:50.742448+0000","last_became_peered":"2024-05-08T05:45:50.742448+0000","last_unstale":"2024-05-08T05:50:08.408135+0000","last_undegraded":"2024-05-08T05:50:08.408135+0000","last_fullsized":"2024-05-08T05:50:08.408135+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:17:35.970285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":236,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.083819+0000","last_change":"2024-05-08T05:45:54.773009+0000","last_active":"2024-05-08T05:47:44.083819+0000","last_peered":"2024-05-08T05:47:44.083819+0000","last_clean":"2024-05-08T05:47:44.083819+0000","last_became_active":"2024-05-08T05:45:54.772597+0000","last_became_peered":"2024-05-08T05:45:54.772597+0000","last_unstale":"2024-05-08T05:47:44.083819+0000","last_undegraded":"2024-05-08T05:47:44.083819+0000","last_fullsized":"2024-05-08T05:47:44.083819+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:41:31.632363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"80'17","reported_seq":45,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762777+0000","last_change":"2024-05-08T05:45:50.867734+0000","last_active":"2024-05-08T05:46:45.762777+0000","last_peered":"2024-05-08T05:46:45.762777+0000","last_clean":"2024-05-08T05:46:45.762777+0000","last_became_active":"2024-05-08T05:45:50.867441+0000","last_became_peered":"2024-05-08T05:45:50.867441+0000","last_unstale":"2024-05-08T05:46:45.762777+0000","last_undegraded":"2024-05-08T05:46:45.762777+0000","last_fullsized":"2024-05-08T05:46:45.762777+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:16:45.430432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.083526+0000","last_change":"2024-05-08T05:45:54.777168+0000","last_active":"2024-05-08T05:47:44.083526+0000","last_peered":"2024-05-08T05:47:44.083526+0000","last_clean":"2024-05-08T05:47:44.083526+0000","last_became_active":"2024-05-08T05:45:54.775985+0000","last_became_peered":"2024-05-08T05:45:54.775985+0000","last_unstale":"2024-05-08T05:47:44.083526+0000","last_undegraded":"2024-05-08T05:47:44.083526+0000","last_fullsized":"2024-05-08T05:47:44.083526+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:57:49.495860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"80'2","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.762618+0000","last_change":"2024-05-08T05:45:50.741375+0000","last_active":"2024-05-08T05:46:45.762618+0000","last_peered":"2024-05-08T05:46:45.762618+0000","last_clean":"2024-05-08T05:46:45.762618+0000","last_became_active":"2024-05-08T05:45:50.741025+0000","last_became_peered":"2024-05-08T05:45:50.741025+0000","last_unstale":"2024-05-08T05:46:45.762618+0000","last_undegraded":"2024-05-08T05:46:45.762618+0000","last_fullsized":"2024-05-08T05:46:45.762618+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:01:43.515119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.082394+0000","last_change":"2024-05-08T05:45:54.780302+0000","last_active":"2024-05-08T05:47:44.082394+0000","last_peered":"2024-05-08T05:47:44.082394+0000","last_clean":"2024-05-08T05:47:44.082394+0000","last_became_active":"2024-05-08T05:45:54.778751+0000","last_became_peered":"2024-05-08T05:45:54.778751+0000","last_unstale":"2024-05-08T05:47:44.082394+0000","last_undegraded":"2024-05-08T05:47:44.082394+0000","last_fullsized":"2024-05-08T05:47:44.082394+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:34:57.686504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"80'1","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:59.165931+0000","last_change":"2024-05-08T05:45:50.870071+0000","last_active":"2024-05-08T05:47:59.165931+0000","last_peered":"2024-05-08T05:47:59.165931+0000","last_clean":"2024-05-08T05:47:59.165931+0000","last_became_active":"2024-05-08T05:45:50.869162+0000","last_became_peered":"2024-05-08T05:45:50.869162+0000","last_unstale":"2024-05-08T05:47:59.165931+0000","last_undegraded":"2024-05-08T05:47:59.165931+0000","last_fullsized":"2024-05-08T05:47:59.165931+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:05:13.104922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'5","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:48:01.442949+0000","last_change":"2024-05-08T05:45:54.780983+0000","last_active":"2024-05-08T05:48:01.442949+0000","last_peered":"2024-05-08T05:48:01.442949+0000","last_clean":"2024-05-08T05:48:01.442949+0000","last_became_active":"2024-05-08T05:45:54.780617+0000","last_became_peered":"2024-05-08T05:45:54.780617+0000","last_unstale":"2024-05-08T05:48:01.442949+0000","last_undegraded":"2024-05-08T05:48:01.442949+0000","last_fullsized":"2024-05-08T05:48:01.442949+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:56:40.972467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"80'5","reported_seq":266,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:50:08.501027+0000","last_change":"2024-05-08T05:45:50.748869+0000","last_active":"2024-05-08T05:50:08.501027+0000","last_peered":"2024-05-08T05:50:08.501027+0000","last_clean":"2024-05-08T05:50:08.501027+0000","last_became_active":"2024-05-08T05:45:50.748494+0000","last_became_peered":"2024-05-08T05:45:50.748494+0000","last_unstale":"2024-05-08T05:50:08.501027+0000","last_undegraded":"2024-05-08T05:50:08.501027+0000","last_fullsized":"2024-05-08T05:50:08.501027+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:12:25.227090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":233,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"82'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:48:01.442925+0000","last_change":"2024-05-08T05:45:54.802180+0000","last_active":"2024-05-08T05:48:01.442925+0000","last_peered":"2024-05-08T05:48:01.442925+0000","last_clean":"2024-05-08T05:48:01.442925+0000","last_became_active":"2024-05-08T05:45:54.801822+0000","last_became_peered":"2024-05-08T05:45:54.801822+0000","last_unstale":"2024-05-08T05:48:01.442925+0000","last_undegraded":"2024-05-08T05:48:01.442925+0000","last_fullsized":"2024-05-08T05:48:01.442925+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:52:11.802630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"82'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:54.989668+0000","last_change":"2024-05-08T05:45:54.770981+0000","last_active":"2024-05-08T05:47:54.989668+0000","last_peered":"2024-05-08T05:47:54.989668+0000","last_clean":"2024-05-08T05:47:54.989668+0000","last_became_active":"2024-05-08T05:45:54.770538+0000","last_became_peered":"2024-05-08T05:45:54.770538+0000","last_unstale":"2024-05-08T05:47:54.989668+0000","last_undegraded":"2024-05-08T05:47:54.989668+0000","last_fullsized":"2024-05-08T05:47:54.989668+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:32:34.699752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"82'6","reported_seq":266,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:50:07.404447+0000","last_change":"2024-05-08T05:45:50.864189+0000","last_active":"2024-05-08T05:50:07.404447+0000","last_peered":"2024-05-08T05:50:07.404447+0000","last_clean":"2024-05-08T05:50:07.404447+0000","last_became_active":"2024-05-08T05:45:50.863170+0000","last_became_peered":"2024-05-08T05:45:50.863170+0000","last_unstale":"2024-05-08T05:50:07.404447+0000","last_undegraded":"2024-05-08T05:50:07.404447+0000","last_fullsized":"2024-05-08T05:50:07.404447+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:44:33.109166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":232,"num_read_kb":232,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"82'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:59.179674+0000","last_change":"2024-05-08T05:45:54.792347+0000","last_active":"2024-05-08T05:47:59.179674+0000","last_peered":"2024-05-08T05:47:59.179674+0000","last_clean":"2024-05-08T05:47:59.179674+0000","last_became_active":"2024-05-08T05:45:54.791767+0000","last_became_peered":"2024-05-08T05:45:54.791767+0000","last_unstale":"2024-05-08T05:47:59.179674+0000","last_undegraded":"2024-05-08T05:47:59.179674+0000","last_fullsized":"2024-05-08T05:47:59.179674+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:03:46.354687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"80'6","reported_seq":37,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:55.165375+0000","last_change":"2024-05-08T05:45:50.748659+0000","last_active":"2024-05-08T05:47:55.165375+0000","last_peered":"2024-05-08T05:47:55.165375+0000","last_clean":"2024-05-08T05:47:55.165375+0000","last_became_active":"2024-05-08T05:45:50.748279+0000","last_became_peered":"2024-05-08T05:45:50.748279+0000","last_unstale":"2024-05-08T05:47:55.165375+0000","last_undegraded":"2024-05-08T05:47:55.165375+0000","last_fullsized":"2024-05-08T05:47:55.165375+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:42:25.892715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'92","reported_seq":102,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:54.651328+0000","last_change":"2024-05-08T05:44:18.365376+0000","last_active":"2024-05-08T05:46:54.651328+0000","last_peered":"2024-05-08T05:46:54.651328+0000","last_clean":"2024-05-08T05:46:54.651328+0000","last_became_active":"2024-05-08T05:44:18.360156+0000","last_became_peered":"2024-05-08T05:44:18.360156+0000","last_unstale":"2024-05-08T05:46:54.651328+0000","last_undegraded":"2024-05-08T05:46:54.651328+0000","last_fullsized":"2024-05-08T05:46:54.651328+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:40:28.502228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:40:28.502228+0000","last_clean_scrub_stamp":"2024-05-08T05:40:28.502228+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:38:20.339163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"82'5","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:59.108848+0000","last_change":"2024-05-08T05:45:54.775625+0000","last_active":"2024-05-08T05:47:59.108848+0000","last_peered":"2024-05-08T05:47:59.108848+0000","last_clean":"2024-05-08T05:47:59.108848+0000","last_became_active":"2024-05-08T05:45:54.774661+0000","last_became_peered":"2024-05-08T05:45:54.774661+0000","last_unstale":"2024-05-08T05:47:59.108848+0000","last_undegraded":"2024-05-08T05:47:59.108848+0000","last_fullsized":"2024-05-08T05:47:59.108848+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:57:05.676092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"80'4","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:54.657532+0000","last_change":"2024-05-08T05:45:50.747823+0000","last_active":"2024-05-08T05:47:54.657532+0000","last_peered":"2024-05-08T05:47:54.657532+0000","last_clean":"2024-05-08T05:47:54.657532+0000","last_became_active":"2024-05-08T05:45:50.747222+0000","last_became_peered":"2024-05-08T05:45:50.747222+0000","last_unstale":"2024-05-08T05:47:54.657532+0000","last_undegraded":"2024-05-08T05:47:54.657532+0000","last_fullsized":"2024-05-08T05:47:54.657532+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:49:06.238468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"80'4","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:54.798564+0000","last_change":"2024-05-08T05:45:50.861721+0000","last_active":"2024-05-08T05:47:54.798564+0000","last_peered":"2024-05-08T05:47:54.798564+0000","last_clean":"2024-05-08T05:47:54.798564+0000","last_became_active":"2024-05-08T05:45:50.861369+0000","last_became_peered":"2024-05-08T05:45:50.861369+0000","last_unstale":"2024-05-08T05:47:54.798564+0000","last_undegraded":"2024-05-08T05:47:54.798564+0000","last_fullsized":"2024-05-08T05:47:54.798564+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:35:19.781796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"82'9","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:59.108978+0000","last_change":"2024-05-08T05:45:54.787260+0000","last_active":"2024-05-08T05:47:59.108978+0000","last_peered":"2024-05-08T05:47:59.108978+0000","last_clean":"2024-05-08T05:47:59.108978+0000","last_became_active":"2024-05-08T05:45:54.786897+0000","last_became_peered":"2024-05-08T05:45:54.786897+0000","last_unstale":"2024-05-08T05:47:59.108978+0000","last_undegraded":"2024-05-08T05:47:59.108978+0000","last_fullsized":"2024-05-08T05:47:59.108978+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:10:06.761165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"82'19","reported_seq":46,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:50:03.861026+0000","last_change":"2024-05-08T05:45:50.746160+0000","last_active":"2024-05-08T05:50:03.861026+0000","last_peered":"2024-05-08T05:50:03.861026+0000","last_clean":"2024-05-08T05:50:03.861026+0000","last_became_active":"2024-05-08T05:45:50.745630+0000","last_became_peered":"2024-05-08T05:45:50.745630+0000","last_unstale":"2024-05-08T05:50:03.861026+0000","last_undegraded":"2024-05-08T05:50:03.861026+0000","last_fullsized":"2024-05-08T05:50:03.861026+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:45:27.593902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.100379+0000","last_change":"2024-05-08T05:45:54.797162+0000","last_active":"2024-05-08T05:47:44.100379+0000","last_peered":"2024-05-08T05:47:44.100379+0000","last_clean":"2024-05-08T05:47:44.100379+0000","last_became_active":"2024-05-08T05:45:54.796859+0000","last_became_peered":"2024-05-08T05:45:54.796859+0000","last_unstale":"2024-05-08T05:47:44.100379+0000","last_undegraded":"2024-05-08T05:47:44.100379+0000","last_fullsized":"2024-05-08T05:47:44.100379+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T06:51:25.701160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"80'7","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:48:00.165958+0000","last_change":"2024-05-08T05:45:50.744793+0000","last_active":"2024-05-08T05:48:00.165958+0000","last_peered":"2024-05-08T05:48:00.165958+0000","last_clean":"2024-05-08T05:48:00.165958+0000","last_became_active":"2024-05-08T05:45:50.744407+0000","last_became_peered":"2024-05-08T05:45:50.744407+0000","last_unstale":"2024-05-08T05:48:00.165958+0000","last_undegraded":"2024-05-08T05:48:00.165958+0000","last_fullsized":"2024-05-08T05:48:00.165958+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:18:17.029402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.110900+0000","last_change":"2024-05-08T05:45:54.797042+0000","last_active":"2024-05-08T05:47:44.110900+0000","last_peered":"2024-05-08T05:47:44.110900+0000","last_clean":"2024-05-08T05:47:44.110900+0000","last_became_active":"2024-05-08T05:45:54.795796+0000","last_became_peered":"2024-05-08T05:45:54.795796+0000","last_unstale":"2024-05-08T05:47:44.110900+0000","last_undegraded":"2024-05-08T05:47:44.110900+0000","last_fullsized":"2024-05-08T05:47:44.110900+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:20:10.789348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"80'2","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.766092+0000","last_change":"2024-05-08T05:45:50.860466+0000","last_active":"2024-05-08T05:46:45.766092+0000","last_peered":"2024-05-08T05:46:45.766092+0000","last_clean":"2024-05-08T05:46:45.766092+0000","last_became_active":"2024-05-08T05:45:50.860093+0000","last_became_peered":"2024-05-08T05:45:50.860093+0000","last_unstale":"2024-05-08T05:46:45.766092+0000","last_undegraded":"2024-05-08T05:46:45.766092+0000","last_fullsized":"2024-05-08T05:46:45.766092+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T16:42:37.799098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"82'2","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.076334+0000","last_change":"2024-05-08T05:45:54.774635+0000","last_active":"2024-05-08T05:47:44.076334+0000","last_peered":"2024-05-08T05:47:44.076334+0000","last_clean":"2024-05-08T05:47:44.076334+0000","last_became_active":"2024-05-08T05:45:54.774288+0000","last_became_peered":"2024-05-08T05:45:54.774288+0000","last_unstale":"2024-05-08T05:47:44.076334+0000","last_undegraded":"2024-05-08T05:47:44.076334+0000","last_fullsized":"2024-05-08T05:47:44.076334+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:55:59.787540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"80'7","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.761999+0000","last_change":"2024-05-08T05:45:50.750830+0000","last_active":"2024-05-08T05:46:45.761999+0000","last_peered":"2024-05-08T05:46:45.761999+0000","last_clean":"2024-05-08T05:46:45.761999+0000","last_became_active":"2024-05-08T05:45:50.750473+0000","last_became_peered":"2024-05-08T05:45:50.750473+0000","last_unstale":"2024-05-08T05:46:45.761999+0000","last_undegraded":"2024-05-08T05:46:45.761999+0000","last_fullsized":"2024-05-08T05:46:45.761999+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T13:04:14.314865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.098673+0000","last_change":"2024-05-08T05:45:54.800008+0000","last_active":"2024-05-08T05:47:44.098673+0000","last_peered":"2024-05-08T05:47:44.098673+0000","last_clean":"2024-05-08T05:47:44.098673+0000","last_became_active":"2024-05-08T05:45:54.799615+0000","last_became_peered":"2024-05-08T05:45:54.799615+0000","last_unstale":"2024-05-08T05:47:44.098673+0000","last_undegraded":"2024-05-08T05:47:44.098673+0000","last_fullsized":"2024-05-08T05:47:44.098673+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T15:58:12.907617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"82'5","reported_seq":33,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:50:04.972325+0000","last_change":"2024-05-08T05:45:50.745088+0000","last_active":"2024-05-08T05:50:04.972325+0000","last_peered":"2024-05-08T05:50:04.972325+0000","last_clean":"2024-05-08T05:50:04.972325+0000","last_became_active":"2024-05-08T05:45:50.744735+0000","last_became_peered":"2024-05-08T05:45:50.744735+0000","last_unstale":"2024-05-08T05:50:04.972325+0000","last_undegraded":"2024-05-08T05:50:04.972325+0000","last_fullsized":"2024-05-08T05:50:04.972325+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:39:12.404233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.104706+0000","last_change":"2024-05-08T05:45:54.803875+0000","last_active":"2024-05-08T05:47:44.104706+0000","last_peered":"2024-05-08T05:47:44.104706+0000","last_clean":"2024-05-08T05:47:44.104706+0000","last_became_active":"2024-05-08T05:45:54.803504+0000","last_became_peered":"2024-05-08T05:45:54.803504+0000","last_unstale":"2024-05-08T05:47:44.104706+0000","last_undegraded":"2024-05-08T05:47:44.104706+0000","last_fullsized":"2024-05-08T05:47:44.104706+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:49:33.419868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"80'4","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.763106+0000","last_change":"2024-05-08T05:45:50.741351+0000","last_active":"2024-05-08T05:46:45.763106+0000","last_peered":"2024-05-08T05:46:45.763106+0000","last_clean":"2024-05-08T05:46:45.763106+0000","last_became_active":"2024-05-08T05:45:50.740970+0000","last_became_peered":"2024-05-08T05:45:50.740970+0000","last_unstale":"2024-05-08T05:46:45.763106+0000","last_undegraded":"2024-05-08T05:46:45.763106+0000","last_fullsized":"2024-05-08T05:46:45.763106+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:31:02.093446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"82'5","reported_seq":26,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.096731+0000","last_change":"2024-05-08T05:45:54.792665+0000","last_active":"2024-05-08T05:47:44.096731+0000","last_peered":"2024-05-08T05:47:44.096731+0000","last_clean":"2024-05-08T05:47:44.096731+0000","last_became_active":"2024-05-08T05:45:54.792309+0000","last_became_peered":"2024-05-08T05:45:54.792309+0000","last_unstale":"2024-05-08T05:47:44.096731+0000","last_undegraded":"2024-05-08T05:47:44.096731+0000","last_fullsized":"2024-05-08T05:47:44.096731+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:48:29.154009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"82'8","reported_seq":274,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:50:10.472852+0000","last_change":"2024-05-08T05:45:50.861234+0000","last_active":"2024-05-08T05:50:10.472852+0000","last_peered":"2024-05-08T05:50:10.472852+0000","last_clean":"2024-05-08T05:50:10.472852+0000","last_became_active":"2024-05-08T05:45:50.860885+0000","last_became_peered":"2024-05-08T05:45:50.860885+0000","last_unstale":"2024-05-08T05:50:10.472852+0000","last_undegraded":"2024-05-08T05:50:10.472852+0000","last_fullsized":"2024-05-08T05:50:10.472852+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:59:50.300316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2093,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":239,"num_read_kb":5,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.096172+0000","last_change":"2024-05-08T05:45:54.781154+0000","last_active":"2024-05-08T05:47:44.096172+0000","last_peered":"2024-05-08T05:47:44.096172+0000","last_clean":"2024-05-08T05:47:44.096172+0000","last_became_active":"2024-05-08T05:45:54.780340+0000","last_became_peered":"2024-05-08T05:45:54.780340+0000","last_unstale":"2024-05-08T05:47:44.096172+0000","last_undegraded":"2024-05-08T05:47:44.096172+0000","last_fullsized":"2024-05-08T05:47:44.096172+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:22:39.614532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"80'3","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.956451+0000","last_change":"2024-05-08T05:45:50.748015+0000","last_active":"2024-05-08T05:46:45.956451+0000","last_peered":"2024-05-08T05:46:45.956451+0000","last_clean":"2024-05-08T05:46:45.956451+0000","last_became_active":"2024-05-08T05:45:50.747649+0000","last_became_peered":"2024-05-08T05:45:50.747649+0000","last_unstale":"2024-05-08T05:46:45.956451+0000","last_undegraded":"2024-05-08T05:46:45.956451+0000","last_fullsized":"2024-05-08T05:46:45.956451+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:31:49.177676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"82'7","reported_seq":28,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.103573+0000","last_change":"2024-05-08T05:45:54.779680+0000","last_active":"2024-05-08T05:47:44.103573+0000","last_peered":"2024-05-08T05:47:44.103573+0000","last_clean":"2024-05-08T05:47:44.103573+0000","last_became_active":"2024-05-08T05:45:54.779273+0000","last_became_peered":"2024-05-08T05:45:54.779273+0000","last_unstale":"2024-05-08T05:47:44.103573+0000","last_undegraded":"2024-05-08T05:47:44.103573+0000","last_fullsized":"2024-05-08T05:47:44.103573+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T08:40:05.192134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"80'5","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:46:45.770430+0000","last_change":"2024-05-08T05:45:50.744569+0000","last_active":"2024-05-08T05:46:45.770430+0000","last_peered":"2024-05-08T05:46:45.770430+0000","last_clean":"2024-05-08T05:46:45.770430+0000","last_became_active":"2024-05-08T05:45:50.744164+0000","last_became_peered":"2024-05-08T05:45:50.744164+0000","last_unstale":"2024-05-08T05:46:45.770430+0000","last_undegraded":"2024-05-08T05:46:45.770430+0000","last_fullsized":"2024-05-08T05:46:45.770430+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:49.705529+0000","last_clean_scrub_stamp":"2024-05-08T05:45:49.705529+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:17:56.409110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"82'9","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.087373+0000","last_change":"2024-05-08T05:45:54.776338+0000","last_active":"2024-05-08T05:47:44.087373+0000","last_peered":"2024-05-08T05:47:44.087373+0000","last_clean":"2024-05-08T05:47:44.087373+0000","last_became_active":"2024-05-08T05:45:54.776015+0000","last_became_peered":"2024-05-08T05:45:54.776015+0000","last_unstale":"2024-05-08T05:47:44.087373+0000","last_undegraded":"2024-05-08T05:47:44.087373+0000","last_fullsized":"2024-05-08T05:47:44.087373+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:38:10.608436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"82'9","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:48:00.719465+0000","last_change":"2024-05-08T05:45:54.782245+0000","last_active":"2024-05-08T05:48:00.719465+0000","last_peered":"2024-05-08T05:48:00.719465+0000","last_clean":"2024-05-08T05:48:00.719465+0000","last_became_active":"2024-05-08T05:45:54.781860+0000","last_became_peered":"2024-05-08T05:45:54.781860+0000","last_unstale":"2024-05-08T05:48:00.719465+0000","last_undegraded":"2024-05-08T05:48:00.719465+0000","last_fullsized":"2024-05-08T05:48:00.719465+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:50:14.658930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"82'12","reported_seq":34,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:48:02.137027+0000","last_change":"2024-05-08T05:45:54.770787+0000","last_active":"2024-05-08T05:48:02.137027+0000","last_peered":"2024-05-08T05:48:02.137027+0000","last_clean":"2024-05-08T05:48:02.137027+0000","last_became_active":"2024-05-08T05:45:54.770409+0000","last_became_peered":"2024-05-08T05:45:54.770409+0000","last_unstale":"2024-05-08T05:48:02.137027+0000","last_undegraded":"2024-05-08T05:48:02.137027+0000","last_fullsized":"2024-05-08T05:48:02.137027+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T12:09:31.102075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"82'8","reported_seq":30,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:48:02.137056+0000","last_change":"2024-05-08T05:45:54.788799+0000","last_active":"2024-05-08T05:48:02.137056+0000","last_peered":"2024-05-08T05:48:02.137056+0000","last_clean":"2024-05-08T05:48:02.137056+0000","last_became_active":"2024-05-08T05:45:54.788295+0000","last_became_peered":"2024-05-08T05:45:54.788295+0000","last_unstale":"2024-05-08T05:48:02.137056+0000","last_undegraded":"2024-05-08T05:48:02.137056+0000","last_fullsized":"2024-05-08T05:48:02.137056+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T05:55:07.912479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"82'7","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:48:02.673023+0000","last_change":"2024-05-08T05:45:54.801316+0000","last_active":"2024-05-08T05:48:02.673023+0000","last_peered":"2024-05-08T05:48:02.673023+0000","last_clean":"2024-05-08T05:48:02.673023+0000","last_became_active":"2024-05-08T05:45:54.798655+0000","last_became_peered":"2024-05-08T05:45:54.798655+0000","last_unstale":"2024-05-08T05:48:02.673023+0000","last_undegraded":"2024-05-08T05:48:02.673023+0000","last_fullsized":"2024-05-08T05:48:02.673023+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T17:30:25.786822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"82'4","reported_seq":25,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.100854+0000","last_change":"2024-05-08T05:45:54.793076+0000","last_active":"2024-05-08T05:47:44.100854+0000","last_peered":"2024-05-08T05:47:44.100854+0000","last_clean":"2024-05-08T05:47:44.100854+0000","last_became_active":"2024-05-08T05:45:54.792726+0000","last_became_peered":"2024-05-08T05:45:54.792726+0000","last_unstale":"2024-05-08T05:47:44.100854+0000","last_undegraded":"2024-05-08T05:47:44.100854+0000","last_fullsized":"2024-05-08T05:47:44.100854+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T09:46:02.659667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.081706+0000","last_change":"2024-05-08T05:45:54.779134+0000","last_active":"2024-05-08T05:47:44.081706+0000","last_peered":"2024-05-08T05:47:44.081706+0000","last_clean":"2024-05-08T05:47:44.081706+0000","last_became_active":"2024-05-08T05:45:54.778764+0000","last_became_peered":"2024-05-08T05:45:54.778764+0000","last_unstale":"2024-05-08T05:47:44.081706+0000","last_undegraded":"2024-05-08T05:47:44.081706+0000","last_fullsized":"2024-05-08T05:47:44.081706+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:10:00.531228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"82'15","reported_seq":36,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.077624+0000","last_change":"2024-05-08T05:45:54.775628+0000","last_active":"2024-05-08T05:47:44.077624+0000","last_peered":"2024-05-08T05:47:44.077624+0000","last_clean":"2024-05-08T05:47:44.077624+0000","last_became_active":"2024-05-08T05:45:54.775293+0000","last_became_peered":"2024-05-08T05:45:54.775293+0000","last_unstale":"2024-05-08T05:47:44.077624+0000","last_undegraded":"2024-05-08T05:47:44.077624+0000","last_fullsized":"2024-05-08T05:47:44.077624+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:02:57.884691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"82'2","reported_seq":23,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.100249+0000","last_change":"2024-05-08T05:45:54.805054+0000","last_active":"2024-05-08T05:47:44.100249+0000","last_peered":"2024-05-08T05:47:44.100249+0000","last_clean":"2024-05-08T05:47:44.100249+0000","last_became_active":"2024-05-08T05:45:54.804642+0000","last_became_peered":"2024-05-08T05:45:54.804642+0000","last_unstale":"2024-05-08T05:47:44.100249+0000","last_undegraded":"2024-05-08T05:47:44.100249+0000","last_fullsized":"2024-05-08T05:47:44.100249+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:17:22.412759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"82'6","reported_seq":27,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.103859+0000","last_change":"2024-05-08T05:45:54.792217+0000","last_active":"2024-05-08T05:47:44.103859+0000","last_peered":"2024-05-08T05:47:44.103859+0000","last_clean":"2024-05-08T05:47:44.103859+0000","last_became_active":"2024-05-08T05:45:54.791508+0000","last_became_peered":"2024-05-08T05:45:54.791508+0000","last_unstale":"2024-05-08T05:47:44.103859+0000","last_undegraded":"2024-05-08T05:47:44.103859+0000","last_fullsized":"2024-05-08T05:47:44.103859+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T10:47:19.053306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"82'8","reported_seq":29,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.108264+0000","last_change":"2024-05-08T05:45:54.794538+0000","last_active":"2024-05-08T05:47:44.108264+0000","last_peered":"2024-05-08T05:47:44.108264+0000","last_clean":"2024-05-08T05:47:44.108264+0000","last_became_active":"2024-05-08T05:45:54.792575+0000","last_became_peered":"2024-05-08T05:45:54.792575+0000","last_unstale":"2024-05-08T05:47:44.108264+0000","last_undegraded":"2024-05-08T05:47:44.108264+0000","last_fullsized":"2024-05-08T05:47:44.108264+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:54:31.086864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"82'10","reported_seq":31,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.107048+0000","last_change":"2024-05-08T05:45:54.782828+0000","last_active":"2024-05-08T05:47:44.107048+0000","last_peered":"2024-05-08T05:47:44.107048+0000","last_clean":"2024-05-08T05:47:44.107048+0000","last_became_active":"2024-05-08T05:45:54.782442+0000","last_became_peered":"2024-05-08T05:45:54.782442+0000","last_unstale":"2024-05-08T05:47:44.107048+0000","last_undegraded":"2024-05-08T05:47:44.107048+0000","last_fullsized":"2024-05-08T05:47:44.107048+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T11:42:53.551455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"82'11","reported_seq":32,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.100977+0000","last_change":"2024-05-08T05:45:54.800422+0000","last_active":"2024-05-08T05:47:44.100977+0000","last_peered":"2024-05-08T05:47:44.100977+0000","last_clean":"2024-05-08T05:47:44.100977+0000","last_became_active":"2024-05-08T05:45:54.799853+0000","last_became_peered":"2024-05-08T05:45:54.799853+0000","last_unstale":"2024-05-08T05:47:44.100977+0000","last_undegraded":"2024-05-08T05:47:44.100977+0000","last_fullsized":"2024-05-08T05:47:44.100977+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T07:54:22.710347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"82'8","reported_seq":35,"reported_epoch":82,"state":"active+clean","last_fresh":"2024-05-08T05:47:44.104228+0000","last_change":"2024-05-08T05:46:45.775876+0000","last_active":"2024-05-08T05:47:44.104228+0000","last_peered":"2024-05-08T05:47:44.104228+0000","last_clean":"2024-05-08T05:47:44.104228+0000","last_became_active":"2024-05-08T05:46:45.775558+0000","last_became_peered":"2024-05-08T05:46:45.775558+0000","last_unstale":"2024-05-08T05:47:44.104228+0000","last_undegraded":"2024-05-08T05:47:44.104228+0000","last_fullsized":"2024-05-08T05:47:44.104228+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-08T05:45:53.746002+0000","last_clean_scrub_stamp":"2024-05-08T05:45:53.746002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-09T14:11:38.649137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":311296,"data_stored":3542208,"data_compressed":212518,"data_compressed_allocated":270336,"data_compressed_original":3522560,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":82141,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":2365,"num_read_kb":1264,"num_write":273,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":55290,"num_keys_recovered":20,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":561152,"data_stored":246423,"data_compressed":9129,"data_compressed_allocated":12288,"data_compressed_original":53248,"omap_allocated":0,"internal_metadata":0},"log_size":233,"ondisk_log_size":233,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645380,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":901120,"data_stored":436421,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841611,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32212,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712940,"statfs":{"total":95995035648,"available":95962050560,"internally_reserved":0,"allocated":1060864,"data_stored":1100554,"data_compressed":35691,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":60,"seq":257698037839,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":917504,"data_stored":435360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":54,"seq":231928234069,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":913408,"data_stored":435738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430298,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":966656,"data_stored":1028957,"data_compressed":35691,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593825,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32056,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713096,"statfs":{"total":95995035648,"available":95962210304,"internally_reserved":0,"allocated":901120,"data_stored":435077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574972,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":974848,"data_stored":509694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738497,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32076,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713076,"statfs":{"total":95995035648,"available":95962189824,"internally_reserved":0,"allocated":921600,"data_stored":437339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411449,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":905216,"data_stored":437766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149809,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":917504,"data_stored":434902,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953579,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":942080,"data_stored":509033,"data_compressed":9129,"data_compressed_allocated":12288,"data_compressed_original":53248,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790054,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":978944,"data_stored":1028244,"data_compressed":35691,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34063,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35691,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35691,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35691,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35691,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35691,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":75456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":74795,"data_compressed":9129,"data_compressed_allocated":12288,"data_compressed_original":53248,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":75831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-08T05:50:12.274 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T05:50:12.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:50:12 smithi082 ceph-mon[30098]: from='client.15048 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T05:50:12.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:50:12 smithi082 ceph-mon[30098]: from='client.15054 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T05:50:12.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:50:12 smithi134 ceph-mon[34132]: from='client.15048 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T05:50:12.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:50:12 smithi134 ceph-mon[34132]: from='client.15054 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T05:50:12.765 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:50:12.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:50:12 smithi151 ceph-mon[34815]: from='client.15048 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T05:50:12.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:50:12 smithi151 ceph-mon[34815]: from='client.15054 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T05:50:13.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:50:13 smithi082 ceph-mon[30098]: pgmap v446: 97 pgs: 97 active+clean; 657 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-05-08T05:50:13.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:50:13 smithi082 ceph-mon[30098]: from='client.25151 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T05:50:13.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:50:13 smithi134 ceph-mon[34132]: pgmap v446: 97 pgs: 97 active+clean; 657 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-05-08T05:50:13.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:50:13 smithi134 ceph-mon[34132]: from='client.25151 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T05:50:13.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:50:13 smithi151 ceph-mon[34815]: pgmap v446: 97 pgs: 97 active+clean; 657 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2024-05-08T05:50:13.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:50:13 smithi151 ceph-mon[34815]: from='client.25151 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-08T05:50:15.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:15.116+0000 7f52f8c00700 1 -- 172.21.15.82:0/1374466193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52f4102890 msgr2=0x7f52f4110390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:15.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:15.116+0000 7f52f8c00700 1 --2- 172.21.15.82:0/1374466193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52f4102890 0x7f52f4110390 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f52ec00b0a0 tx=0x7f52ec00b3b0 comp rx=0 tx=0).stop 2024-05-08T05:50:15.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:15.117+0000 7f52f8c00700 1 -- 172.21.15.82:0/1374466193 shutdown_connections 2024-05-08T05:50:15.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:15.117+0000 7f52f8c00700 1 --2- 172.21.15.82:0/1374466193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52f4102890 0x7f52f4110390 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:15.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:15.117+0000 7f52f8c00700 1 --2- 172.21.15.82:0/1374466193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52f4109680 0x7f52f4109a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:15.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:15.117+0000 7f52f8c00700 1 --2- 172.21.15.82:0/1374466193 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52f4101ed0 0x7f52f4102350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:15.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:15.117+0000 7f52f8c00700 1 -- 172.21.15.82:0/1374466193 >> 172.21.15.82:0/1374466193 conn(0x7f52f4077610 msgr2=0x7f52f4077a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:50:15.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:15.117+0000 7f52f8c00700 1 -- 172.21.15.82:0/1374466193 shutdown_connections 2024-05-08T05:50:15.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:15.117+0000 7f52f8c00700 1 -- 172.21.15.82:0/1374466193 wait complete. 2024-05-08T05:50:15.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:15.118+0000 7f52f8c00700 1 Processor -- start 2024-05-08T05:50:15.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:15.119+0000 7f52f8c00700 1 -- start start 2024-05-08T05:50:15.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:15.119+0000 7f52f8c00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52f4101ed0 0x7f52f41030b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:15.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:15.119+0000 7f52f8c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52f4102890 0x7f52f41035f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:15.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:15.119+0000 7f52f8c00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52f4109680 0x7f52f4103b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:15.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:15.119+0000 7f52f8c00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f52f4113640 con 0x7f52f4102890 2024-05-08T05:50:15.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:15.119+0000 7f52f8c00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f52f41134c0 con 0x7f52f4109680 2024-05-08T05:50:15.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:15.119+0000 7f52f8c00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f52f41137c0 con 0x7f52f4101ed0 2024-05-08T05:50:15.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:15.119+0000 7f52f1400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52f4102890 0x7f52f41035f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:15.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:15.119+0000 7f52f1400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52f4102890 0x7f52f41035f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34692/0 (socket says 172.21.15.82:34692) 2024-05-08T05:50:15.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:15.119+0000 7f52f1400700 1 -- 172.21.15.82:0/2783755522 learned_addr learned my addr 172.21.15.82:0/2783755522 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:50:15.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:15.119+0000 7f52f1e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52f4101ed0 0x7f52f41030b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:15.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:15.120+0000 7f52f2800700 1 --2- 172.21.15.82:0/2783755522 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52f4109680 0x7f52f4103b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:15.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:15.120+0000 7f52f1e00700 1 -- 172.21.15.82:0/2783755522 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52f4109680 msgr2=0x7f52f4103b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:15.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:15.120+0000 7f52f1e00700 1 --2- 172.21.15.82:0/2783755522 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52f4109680 0x7f52f4103b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:15.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:15.120+0000 7f52f1e00700 1 -- 172.21.15.82:0/2783755522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52f4102890 msgr2=0x7f52f41035f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:15.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:15.120+0000 7f52f1e00700 1 --2- 172.21.15.82:0/2783755522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52f4102890 0x7f52f41035f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:15.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:15.120+0000 7f52f1e00700 1 -- 172.21.15.82:0/2783755522 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52f41a7fa0 con 0x7f52f4101ed0 2024-05-08T05:50:15.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:15.120+0000 7f52f1400700 1 --2- 172.21.15.82:0/2783755522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52f4102890 0x7f52f41035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:50:15.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:15.120+0000 7f52f1e00700 1 --2- 172.21.15.82:0/2783755522 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52f4101ed0 0x7f52f41030b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f52e400e9f0 tx=0x7f52e400ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:50:15.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:15.121+0000 7f52eaa00700 1 -- 172.21.15.82:0/2783755522 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e400c9c0 con 0x7f52f4101ed0 2024-05-08T05:50:15.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:15.121+0000 7f52eaa00700 1 -- 172.21.15.82:0/2783755522 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52e400cb60 con 0x7f52f4101ed0 2024-05-08T05:50:15.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:15.121+0000 7f52f8c00700 1 -- 172.21.15.82:0/2783755522 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52f41a8290 con 0x7f52f4101ed0 2024-05-08T05:50:15.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:15.121+0000 7f52eaa00700 1 -- 172.21.15.82:0/2783755522 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52e4018680 con 0x7f52f4101ed0 2024-05-08T05:50:15.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:15.121+0000 7f52f8c00700 1 -- 172.21.15.82:0/2783755522 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52f41a87d0 con 0x7f52f4101ed0 2024-05-08T05:50:15.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:15.122+0000 7f52f8c00700 1 -- 172.21.15.82:0/2783755522 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52f406a190 con 0x7f52f4101ed0 2024-05-08T05:50:15.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:15.124+0000 7f52eaa00700 1 -- 172.21.15.82:0/2783755522 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 19) ==== 149703+0+0 (secure 0 0 0) 0x7f52e4010430 con 0x7f52f4101ed0 2024-05-08T05:50:15.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:15.126+0000 7f52eaa00700 1 --2- 172.21.15.82:0/2783755522 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f52d80b2910 0x7f52d80b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:15.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:15.126+0000 7f52eaa00700 1 -- 172.21.15.82:0/2783755522 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f52e40e2850 con 0x7f52f4101ed0 2024-05-08T05:50:15.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:15.126+0000 7f52f1400700 1 --2- 172.21.15.82:0/2783755522 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f52d80b2910 0x7f52d80b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:15.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:15.127+0000 7f52f1400700 1 --2- 172.21.15.82:0/2783755522 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f52d80b2910 0x7f52d80b4dd0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f52f4077ba0 tx=0x7f52e0007480 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:50:15.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:15.128+0000 7f52eaa00700 1 -- 172.21.15.82:0/2783755522 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f52e40aa3c0 con 0x7f52f4101ed0 2024-05-08T05:50:15.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:15.412+0000 7f52f8c00700 1 -- 172.21.15.82:0/2783755522 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f52f41a8a30 con 0x7f52f4101ed0 2024-05-08T05:50:15.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:15.413+0000 7f52eaa00700 1 -- 172.21.15.82:0/2783755522 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11948 (secure 0 0 0) 0x7f52e40a9cc0 con 0x7f52f4101ed0 2024-05-08T05:50:15.414 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:50:15.414 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14364,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3876883250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3876883250},{"type":"v1","addr":"172.21.15.82:6835","nonce":3876883250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1965070586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1965070586},{"type":"v1","addr":"172.21.15.82:6837","nonce":1965070586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T05:45:57.654009+0000","modified":"2024-05-08T05:50:04.192279+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24505,"mds_2":24487,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14397":{"gid":14397,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/1890720973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1890720973},{"type":"v1","addr":"172.21.15.82:6839","nonce":1890720973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14409":{"gid":14409,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/2957083305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":2957083305},{"type":"v1","addr":"172.21.15.82:6841","nonce":2957083305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6833/3827691638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3827691638},{"type":"v1","addr":"172.21.15.134:6833","nonce":3827691638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6833/3625067797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3625067797},{"type":"v1","addr":"172.21.15.151:6833","nonce":3625067797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/4074163402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4074163402},{"type":"v1","addr":"172.21.15.134:6835","nonce":4074163402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.134:6837/2212411710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2212411710},{"type":"v1","addr":"172.21.15.134:6837","nonce":2212411710}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":17,"addr":"172.21.15.151:6835/2093655929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2093655929},{"type":"v1","addr":"172.21.15.151:6835","nonce":2093655929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6837/4192404464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":4192404464},{"type":"v1","addr":"172.21.15.151:6837","nonce":4192404464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":14,"addr":"172.21.15.151:6839/2963754236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":2963754236},{"type":"v1","addr":"172.21.15.151:6839","nonce":2963754236}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.134:6839/1145270893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1145270893},{"type":"v1","addr":"172.21.15.134:6839","nonce":1145270893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24506,24505,24487,24467,24475]},"id":1}]} 2024-05-08T05:50:15.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:15.416+0000 7f52f8c00700 1 -- 172.21.15.82:0/2783755522 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f52d80b2910 msgr2=0x7f52d80b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:15.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:15.416+0000 7f52f8c00700 1 --2- 172.21.15.82:0/2783755522 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f52d80b2910 0x7f52d80b4dd0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f52f4077ba0 tx=0x7f52e0007480 comp rx=0 tx=0).stop 2024-05-08T05:50:15.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:15.416+0000 7f52f8c00700 1 -- 172.21.15.82:0/2783755522 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52f4101ed0 msgr2=0x7f52f41030b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:15.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:15.416+0000 7f52f8c00700 1 --2- 172.21.15.82:0/2783755522 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52f4101ed0 0x7f52f41030b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f52e400e9f0 tx=0x7f52e400ed00 comp rx=0 tx=0).stop 2024-05-08T05:50:15.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:15.416+0000 7f52f8c00700 1 -- 172.21.15.82:0/2783755522 shutdown_connections 2024-05-08T05:50:15.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:15.416+0000 7f52f8c00700 1 --2- 172.21.15.82:0/2783755522 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52f4109680 0x7f52f4103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:15.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:15.416+0000 7f52f8c00700 1 --2- 172.21.15.82:0/2783755522 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f52d80b2910 0x7f52d80b4dd0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:15.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:15.416+0000 7f52f8c00700 1 --2- 172.21.15.82:0/2783755522 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52f4101ed0 0x7f52f41030b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:15.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:15.416+0000 7f52f8c00700 1 --2- 172.21.15.82:0/2783755522 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52f4102890 0x7f52f41035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:15.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:15.416+0000 7f52f8c00700 1 -- 172.21.15.82:0/2783755522 >> 172.21.15.82:0/2783755522 conn(0x7f52f4077610 msgr2=0x7f52f4100a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:50:15.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:15.416+0000 7f52f8c00700 1 -- 172.21.15.82:0/2783755522 shutdown_connections 2024-05-08T05:50:15.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:15.417+0000 7f52f8c00700 1 -- 172.21.15.82:0/2783755522 wait complete. 2024-05-08T05:50:15.419 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 29 2024-05-08T05:50:15.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:50:15 smithi082 ceph-mon[30098]: pgmap v447: 97 pgs: 97 active+clean; 657 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-05-08T05:50:15.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:50:15 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/2783755522' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:50:15.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:50:15 smithi134 ceph-mon[34132]: pgmap v447: 97 pgs: 97 active+clean; 657 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-05-08T05:50:15.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:50:15 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/2783755522' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:50:15.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:50:15 smithi151 ceph-mon[34815]: pgmap v447: 97 pgs: 97 active+clean; 657 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-05-08T05:50:15.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:50:15 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/2783755522' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:50:16.334 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-08T05:50:16.743 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:50:17.676 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:50:17 smithi082 ceph-mon[30098]: pgmap v448: 97 pgs: 97 active+clean; 657 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-05-08T05:50:17.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:50:17 smithi134 ceph-mon[34132]: pgmap v448: 97 pgs: 97 active+clean; 657 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-05-08T05:50:17.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:50:17 smithi151 ceph-mon[34815]: pgmap v448: 97 pgs: 97 active+clean; 657 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-05-08T05:50:18.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:18.898+0000 7fbd0d400700 1 -- 172.21.15.82:0/4204261978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd0806c3d0 msgr2=0x7fbd08110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:18.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:18.898+0000 7fbd0d400700 1 --2- 172.21.15.82:0/4204261978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd0806c3d0 0x7fbd08110320 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbd0000b0a0 tx=0x7fbd0000b3b0 comp rx=0 tx=0).stop 2024-05-08T05:50:18.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:18.899+0000 7fbd0d400700 1 -- 172.21.15.82:0/4204261978 shutdown_connections 2024-05-08T05:50:18.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:18.899+0000 7fbd0d400700 1 --2- 172.21.15.82:0/4204261978 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd08109500 0x7fbd081098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:18.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:18.899+0000 7fbd0d400700 1 --2- 172.21.15.82:0/4204261978 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd0806c3d0 0x7fbd08110320 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:18.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:18.899+0000 7fbd0d400700 1 --2- 172.21.15.82:0/4204261978 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd0806ba10 0x7fbd0806be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:18.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:18.899+0000 7fbd0d400700 1 -- 172.21.15.82:0/4204261978 >> 172.21.15.82:0/4204261978 conn(0x7fbd08079310 msgr2=0x7fbd08079720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:50:18.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:18.899+0000 7fbd0d400700 1 -- 172.21.15.82:0/4204261978 shutdown_connections 2024-05-08T05:50:18.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:18.899+0000 7fbd0d400700 1 -- 172.21.15.82:0/4204261978 wait complete. 2024-05-08T05:50:18.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:18.900+0000 7fbd0d400700 1 Processor -- start 2024-05-08T05:50:18.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:18.900+0000 7fbd0d400700 1 -- start start 2024-05-08T05:50:18.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:18.901+0000 7fbd0d400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd0806ba10 0x7fbd081a1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:18.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:18.901+0000 7fbd0d400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd0806c3d0 0x7fbd081a1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:18.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:18.901+0000 7fbd0d400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd08109500 0x7fbd0819bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:18.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:18.901+0000 7fbd0d400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbd08113630 con 0x7fbd0806c3d0 2024-05-08T05:50:18.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:18.901+0000 7fbd0d400700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbd081134b0 con 0x7fbd08109500 2024-05-08T05:50:18.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:18.901+0000 7fbd0d400700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fbd081137b0 con 0x7fbd0806ba10 2024-05-08T05:50:18.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:18.901+0000 7fbd06800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd0806ba10 0x7fbd081a1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:18.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:18.901+0000 7fbd06800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd0806ba10 0x7fbd081a1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:60550/0 (socket says 172.21.15.82:60550) 2024-05-08T05:50:18.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:18.901+0000 7fbd06800700 1 -- 172.21.15.82:0/1812066852 learned_addr learned my addr 172.21.15.82:0/1812066852 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:50:18.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:18.901+0000 7fbd07200700 1 --2- 172.21.15.82:0/1812066852 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd08109500 0x7fbd0819bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:18.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:18.901+0000 7fbcffe00700 1 --2- 172.21.15.82:0/1812066852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd0806c3d0 0x7fbd081a1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:18.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:18.902+0000 7fbd06800700 1 -- 172.21.15.82:0/1812066852 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd08109500 msgr2=0x7fbd0819bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:18.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:18.902+0000 7fbd06800700 1 --2- 172.21.15.82:0/1812066852 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd08109500 0x7fbd0819bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:18.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:18.902+0000 7fbd06800700 1 -- 172.21.15.82:0/1812066852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd0806c3d0 msgr2=0x7fbd081a1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:18.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:18.902+0000 7fbd06800700 1 --2- 172.21.15.82:0/1812066852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd0806c3d0 0x7fbd081a1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:18.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:18.902+0000 7fbd06800700 1 -- 172.21.15.82:0/1812066852 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd0819c3f0 con 0x7fbd0806ba10 2024-05-08T05:50:18.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:18.902+0000 7fbd07200700 1 --2- 172.21.15.82:0/1812066852 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd08109500 0x7fbd0819bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:50:18.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:18.902+0000 7fbd06800700 1 --2- 172.21.15.82:0/1812066852 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd0806ba10 0x7fbd081a1a40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbcf800e9a0 tx=0x7fbcf800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:50:18.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:18.902+0000 7fbcff400700 1 -- 172.21.15.82:0/1812066852 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf800ca10 con 0x7fbd0806ba10 2024-05-08T05:50:18.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:18.902+0000 7fbd0d400700 1 -- 172.21.15.82:0/1812066852 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd0819c6e0 con 0x7fbd0806ba10 2024-05-08T05:50:18.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:18.902+0000 7fbcff400700 1 -- 172.21.15.82:0/1812066852 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbcf800cbb0 con 0x7fbd0806ba10 2024-05-08T05:50:18.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:18.902+0000 7fbcff400700 1 -- 172.21.15.82:0/1812066852 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf8018680 con 0x7fbd0806ba10 2024-05-08T05:50:18.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:18.902+0000 7fbd0d400700 1 -- 172.21.15.82:0/1812066852 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd081a89c0 con 0x7fbd0806ba10 2024-05-08T05:50:18.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:18.904+0000 7fbd0d400700 1 -- 172.21.15.82:0/1812066852 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd08104bc0 con 0x7fbd0806ba10 2024-05-08T05:50:18.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:18.906+0000 7fbcff400700 1 -- 172.21.15.82:0/1812066852 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 19) ==== 149703+0+0 (secure 0 0 0) 0x7fbcf804aae0 con 0x7fbd0806ba10 2024-05-08T05:50:18.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:18.907+0000 7fbcff400700 1 --2- 172.21.15.82:0/1812066852 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fbcec0b2990 0x7fbcec0b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:18.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:18.908+0000 7fbcff400700 1 -- 172.21.15.82:0/1812066852 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fbcf80e2580 con 0x7fbd0806ba10 2024-05-08T05:50:18.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:18.908+0000 7fbcffe00700 1 --2- 172.21.15.82:0/1812066852 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fbcec0b2990 0x7fbcec0b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:18.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:18.908+0000 7fbcffe00700 1 --2- 172.21.15.82:0/1812066852 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fbcec0b2990 0x7fbcec0b4e50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fbd0819d260 tx=0x7fbcf0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:50:18.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:18.910+0000 7fbcff400700 1 -- 172.21.15.82:0/1812066852 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fbcf80aa0f0 con 0x7fbd0806ba10 2024-05-08T05:50:19.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:19.140+0000 7fbd0d400700 1 -- 172.21.15.82:0/1812066852 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbd081a8b90 con 0x7fbd0806ba10 2024-05-08T05:50:19.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:19.142+0000 7fbcff400700 1 -- 172.21.15.82:0/1812066852 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22631 (secure 0 0 0) 0x7fbcf80a99f0 con 0x7fbd0806ba10 2024-05-08T05:50:19.143 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:50:19.143 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":82,"fsid":"c739a5c8-0cfc-11ef-bc97-c7b262605968","created":"2024-05-08T05:36:37.441393+0000","modified":"2024-05-08T05:46:45.754375+0000","last_up_change":"2024-05-08T05:44:40.677995+0000","last_in_change":"2024-05-08T05:44:20.654220+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T05:40:28.102836+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T05:45:48.727521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T05:45:53.574048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bc9bd472-b765-4893-84ed-c66b5c1c61b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":4051651615},{"type":"v1","addr":"172.21.15.82:6803","nonce":4051651615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":4051651615},{"type":"v1","addr":"172.21.15.82:6805","nonce":4051651615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4051651615},{"type":"v1","addr":"172.21.15.82:6809","nonce":4051651615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":4051651615},{"type":"v1","addr":"172.21.15.82:6807","nonce":4051651615}]},"public_addr":"172.21.15.82:6803/4051651615","cluster_addr":"172.21.15.82:6805/4051651615","heartbeat_back_addr":"172.21.15.82:6809/4051651615","heartbeat_front_addr":"172.21.15.82:6807/4051651615","state":["exists","up"]},{"osd":1,"uuid":"ad2d3a6b-8bc5-4177-8757-07e8607ca240","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":2763858634},{"type":"v1","addr":"172.21.15.134:6801","nonce":2763858634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":2763858634},{"type":"v1","addr":"172.21.15.134:6803","nonce":2763858634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":2763858634},{"type":"v1","addr":"172.21.15.134:6807","nonce":2763858634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2763858634},{"type":"v1","addr":"172.21.15.134:6805","nonce":2763858634}]},"public_addr":"172.21.15.134:6801/2763858634","cluster_addr":"172.21.15.134:6803/2763858634","heartbeat_back_addr":"172.21.15.134:6807/2763858634","heartbeat_front_addr":"172.21.15.134:6805/2763858634","state":["exists","up"]},{"osd":2,"uuid":"a06dc8fc-7324-4e42-9487-8cfe372401b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":4193933269},{"type":"v1","addr":"172.21.15.151:6801","nonce":4193933269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":4193933269},{"type":"v1","addr":"172.21.15.151:6803","nonce":4193933269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":4193933269},{"type":"v1","addr":"172.21.15.151:6807","nonce":4193933269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":4193933269},{"type":"v1","addr":"172.21.15.151:6805","nonce":4193933269}]},"public_addr":"172.21.15.151:6801/4193933269","cluster_addr":"172.21.15.151:6803/4193933269","heartbeat_back_addr":"172.21.15.151:6807/4193933269","heartbeat_front_addr":"172.21.15.151:6805/4193933269","state":["exists","up"]},{"osd":3,"uuid":"b8c8bdcd-fbd7-4494-976e-7285408e010e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":2775272422},{"type":"v1","addr":"172.21.15.82:6811","nonce":2775272422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":2775272422},{"type":"v1","addr":"172.21.15.82:6813","nonce":2775272422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":2775272422},{"type":"v1","addr":"172.21.15.82:6817","nonce":2775272422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":2775272422},{"type":"v1","addr":"172.21.15.82:6815","nonce":2775272422}]},"public_addr":"172.21.15.82:6811/2775272422","cluster_addr":"172.21.15.82:6813/2775272422","heartbeat_back_addr":"172.21.15.82:6817/2775272422","heartbeat_front_addr":"172.21.15.82:6815/2775272422","state":["exists","up"]},{"osd":4,"uuid":"391a6040-03d1-483c-9058-308b5998e7c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3565208751},{"type":"v1","addr":"172.21.15.134:6809","nonce":3565208751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3565208751},{"type":"v1","addr":"172.21.15.134:6811","nonce":3565208751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3565208751},{"type":"v1","addr":"172.21.15.134:6815","nonce":3565208751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3565208751},{"type":"v1","addr":"172.21.15.134:6813","nonce":3565208751}]},"public_addr":"172.21.15.134:6809/3565208751","cluster_addr":"172.21.15.134:6811/3565208751","heartbeat_back_addr":"172.21.15.134:6815/3565208751","heartbeat_front_addr":"172.21.15.134:6813/3565208751","state":["exists","up"]},{"osd":5,"uuid":"dacce079-4aad-474e-b747-1ed60c3c71cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":1925634069},{"type":"v1","addr":"172.21.15.151:6809","nonce":1925634069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":1925634069},{"type":"v1","addr":"172.21.15.151:6811","nonce":1925634069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1925634069},{"type":"v1","addr":"172.21.15.151:6815","nonce":1925634069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1925634069},{"type":"v1","addr":"172.21.15.151:6813","nonce":1925634069}]},"public_addr":"172.21.15.151:6809/1925634069","cluster_addr":"172.21.15.151:6811/1925634069","heartbeat_back_addr":"172.21.15.151:6815/1925634069","heartbeat_front_addr":"172.21.15.151:6813/1925634069","state":["exists","up"]},{"osd":6,"uuid":"6a445bf4-09c4-4e9b-be6e-68ef3c05b365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":762647976},{"type":"v1","addr":"172.21.15.82:6819","nonce":762647976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":762647976},{"type":"v1","addr":"172.21.15.82:6821","nonce":762647976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":762647976},{"type":"v1","addr":"172.21.15.82:6825","nonce":762647976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":762647976},{"type":"v1","addr":"172.21.15.82:6823","nonce":762647976}]},"public_addr":"172.21.15.82:6819/762647976","cluster_addr":"172.21.15.82:6821/762647976","heartbeat_back_addr":"172.21.15.82:6825/762647976","heartbeat_front_addr":"172.21.15.82:6823/762647976","state":["exists","up"]},{"osd":7,"uuid":"72b0c735-ef30-4823-8ab8-2e5bf7cc3c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3006846927},{"type":"v1","addr":"172.21.15.134:6817","nonce":3006846927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3006846927},{"type":"v1","addr":"172.21.15.134:6819","nonce":3006846927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3006846927},{"type":"v1","addr":"172.21.15.134:6823","nonce":3006846927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3006846927},{"type":"v1","addr":"172.21.15.134:6821","nonce":3006846927}]},"public_addr":"172.21.15.134:6817/3006846927","cluster_addr":"172.21.15.134:6819/3006846927","heartbeat_back_addr":"172.21.15.134:6823/3006846927","heartbeat_front_addr":"172.21.15.134:6821/3006846927","state":["exists","up"]},{"osd":8,"uuid":"93e4da0f-48ea-4ab7-b612-26b545b76de6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":787870717},{"type":"v1","addr":"172.21.15.151:6817","nonce":787870717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":787870717},{"type":"v1","addr":"172.21.15.151:6819","nonce":787870717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":787870717},{"type":"v1","addr":"172.21.15.151:6823","nonce":787870717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":787870717},{"type":"v1","addr":"172.21.15.151:6821","nonce":787870717}]},"public_addr":"172.21.15.151:6817/787870717","cluster_addr":"172.21.15.151:6819/787870717","heartbeat_back_addr":"172.21.15.151:6823/787870717","heartbeat_front_addr":"172.21.15.151:6821/787870717","state":["exists","up"]},{"osd":9,"uuid":"ea0070c1-286a-47d3-90cf-d1fada6e3cda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":533124002},{"type":"v1","addr":"172.21.15.82:6827","nonce":533124002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":533124002},{"type":"v1","addr":"172.21.15.82:6829","nonce":533124002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":533124002},{"type":"v1","addr":"172.21.15.82:6833","nonce":533124002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":533124002},{"type":"v1","addr":"172.21.15.82:6831","nonce":533124002}]},"public_addr":"172.21.15.82:6827/533124002","cluster_addr":"172.21.15.82:6829/533124002","heartbeat_back_addr":"172.21.15.82:6833/533124002","heartbeat_front_addr":"172.21.15.82:6831/533124002","state":["exists","up"]},{"osd":10,"uuid":"26ca0a0b-ab9e-472f-bb29-428e8c31e5bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":99154842},{"type":"v1","addr":"172.21.15.134:6825","nonce":99154842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":99154842},{"type":"v1","addr":"172.21.15.134:6827","nonce":99154842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":99154842},{"type":"v1","addr":"172.21.15.134:6831","nonce":99154842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":99154842},{"type":"v1","addr":"172.21.15.134:6829","nonce":99154842}]},"public_addr":"172.21.15.134:6825/99154842","cluster_addr":"172.21.15.134:6827/99154842","heartbeat_back_addr":"172.21.15.134:6831/99154842","heartbeat_front_addr":"172.21.15.134:6829/99154842","state":["exists","up"]},{"osd":11,"uuid":"9ae5dca4-acfb-4a46-8601-9d642efde794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2242771269},{"type":"v1","addr":"172.21.15.151:6825","nonce":2242771269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2242771269},{"type":"v1","addr":"172.21.15.151:6827","nonce":2242771269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2242771269},{"type":"v1","addr":"172.21.15.151:6831","nonce":2242771269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2242771269},{"type":"v1","addr":"172.21.15.151:6829","nonce":2242771269}]},"public_addr":"172.21.15.151:6825/2242771269","cluster_addr":"172.21.15.151:6827/2242771269","heartbeat_back_addr":"172.21.15.151:6831/2242771269","heartbeat_front_addr":"172.21.15.151:6829/2242771269","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:39:35.575525+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:40:00.672367+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:40:24.558682+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:40:56.791194+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:41:23.031785+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:41:47.926448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:42:21.231894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:42:47.599982+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:43:12.950581+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:43:46.333027+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:44:13.457489+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:44:38.637273+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/2761274596":"2024-05-09T05:37:43.951218+0000","172.21.15.82:0/2195734928":"2024-05-09T05:37:43.951218+0000","172.21.15.82:6801/765895649":"2024-05-09T05:37:43.951218+0000","172.21.15.82:6800/3546670887":"2024-05-09T05:37:11.114057+0000","172.21.15.82:6800/765895649":"2024-05-09T05:37:43.951218+0000","172.21.15.82:0/3986150437":"2024-05-09T05:37:11.114057+0000","172.21.15.82:0/3457457714":"2024-05-09T05:37:11.114057+0000","172.21.15.82:0/2356749286":"2024-05-09T05:37:11.114057+0000","172.21.15.82:6801/3546670887":"2024-05-09T05:37:11.114057+0000","172.21.15.82:0/1694643083":"2024-05-09T05:37:43.951218+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T05:50:19.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:19.145+0000 7fbd0d400700 1 -- 172.21.15.82:0/1812066852 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fbcec0b2990 msgr2=0x7fbcec0b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:19.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:19.145+0000 7fbd0d400700 1 --2- 172.21.15.82:0/1812066852 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fbcec0b2990 0x7fbcec0b4e50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fbd0819d260 tx=0x7fbcf0009260 comp rx=0 tx=0).stop 2024-05-08T05:50:19.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:19.145+0000 7fbd0d400700 1 -- 172.21.15.82:0/1812066852 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd0806ba10 msgr2=0x7fbd081a1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:19.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:19.145+0000 7fbd0d400700 1 --2- 172.21.15.82:0/1812066852 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd0806ba10 0x7fbd081a1a40 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbcf800e9a0 tx=0x7fbcf800ecb0 comp rx=0 tx=0).stop 2024-05-08T05:50:19.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:19.145+0000 7fbd0d400700 1 -- 172.21.15.82:0/1812066852 shutdown_connections 2024-05-08T05:50:19.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:19.145+0000 7fbd0d400700 1 --2- 172.21.15.82:0/1812066852 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbd08109500 0x7fbd0819bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:19.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:19.145+0000 7fbd0d400700 1 --2- 172.21.15.82:0/1812066852 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fbcec0b2990 0x7fbcec0b4e50 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:19.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:19.145+0000 7fbd0d400700 1 --2- 172.21.15.82:0/1812066852 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbd0806ba10 0x7fbd081a1a40 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:19.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:19.145+0000 7fbd0d400700 1 --2- 172.21.15.82:0/1812066852 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbd0806c3d0 0x7fbd081a1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:19.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:19.145+0000 7fbd0d400700 1 -- 172.21.15.82:0/1812066852 >> 172.21.15.82:0/1812066852 conn(0x7fbd08079310 msgr2=0x7fbd0810e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:50:19.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:19.145+0000 7fbd0d400700 1 -- 172.21.15.82:0/1812066852 shutdown_connections 2024-05-08T05:50:19.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:19.145+0000 7fbd0d400700 1 -- 172.21.15.82:0/1812066852 wait complete. 2024-05-08T05:50:19.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:50:19 smithi082 ceph-mon[30098]: pgmap v449: 97 pgs: 97 active+clean; 657 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-05-08T05:50:19.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:50:19 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/1812066852' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:50:19.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:50:19 smithi134 ceph-mon[34132]: pgmap v449: 97 pgs: 97 active+clean; 657 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-05-08T05:50:19.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:50:19 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/1812066852' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:50:19.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:50:19 smithi151 ceph-mon[34815]: pgmap v449: 97 pgs: 97 active+clean; 657 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.4 KiB/s wr, 11 op/s 2024-05-08T05:50:19.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:50:19 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/1812066852' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T05:50:20.036 DEBUG:tasks.fwd_scrub:Yielding 2024-05-08T05:50:20.036 INFO:teuthology.run_tasks:Running task exec... 2024-05-08T05:50:20.046 INFO:teuthology.task.exec:Executing custom commands... 2024-05-08T05:50:20.047 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi082.front.sepia.ceph.com 2024-05-08T05:50:20.047 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/' 2024-05-08T05:50:20.047 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-05-08T05:50:20.047 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-08T05:50:20.047 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-05-08T05:50:20.144 INFO:teuthology.orchestra.run.smithi082.stdout:total 0 2024-05-08T05:50:20.185 INFO:teuthology.orchestra.run.smithi082.stdout:Filesystem Size Used Avail Use% Mounted on 2024-05-08T05:50:20.186 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:3300,172.21.15.134:3300,172.21.15.151:3300:/volumes/qa/sv_1/5cc92dff-ab65-410c-b632-4df5dd09b865 340G 0 340G 0% /tmp/cephfs 2024-05-08T05:50:20.193 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres' 2024-05-08T05:50:20.320 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data' 2024-05-08T05:50:20.417 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?"' 2024-05-08T05:50:20.527 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:50:20.678 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:50:20 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:50:20.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:50:20 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:50:20.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:50:20 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:50:21.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:50:21 smithi082 ceph-mon[30098]: pgmap v450: 97 pgs: 97 active+clean; 657 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 170 B/s wr, 10 op/s 2024-05-08T05:50:21.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:50:21 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:50:21.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:50:21 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:50:21.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:50:21 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:50:21.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:50:21 smithi134 ceph-mon[34132]: pgmap v450: 97 pgs: 97 active+clean; 657 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 170 B/s wr, 10 op/s 2024-05-08T05:50:21.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:50:21 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:50:21.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:50:21 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:50:21.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:50:21 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:50:21.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:50:21 smithi151 ceph-mon[34815]: pgmap v450: 97 pgs: 97 active+clean; 657 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 170 B/s wr, 10 op/s 2024-05-08T05:50:21.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:50:21 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:50:21.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:50:21 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:50:21.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:50:21 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:50:22.774 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local' 2024-05-08T05:50:22.869 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres(/.*)? system_u:object_r:postgresql_db_t:s0 2024-05-08T05:50:22.876 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo restorecon -R -v /tmp/cephfs/postgres' 2024-05-08T05:50:22.978 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-05-08T05:50:23.076 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/: 2024-05-08T05:50:23.077 INFO:teuthology.orchestra.run.smithi082.stdout:total 0 2024-05-08T05:50:23.077 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 8 05:50 . 2024-05-08T05:50:23.077 INFO:teuthology.orchestra.run.smithi082.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 May 8 05:50 .. 2024-05-08T05:50:23.077 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 data 2024-05-08T05:50:23.077 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:50:23.077 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data: 2024-05-08T05:50:23.077 INFO:teuthology.orchestra.run.smithi082.stdout:total 0 2024-05-08T05:50:23.077 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 . 2024-05-08T05:50:23.077 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 8 05:50 .. 2024-05-08T05:50:23.084 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '"'"'[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n'"'"' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf' 2024-05-08T05:50:23.227 INFO:teuthology.orchestra.run.smithi082.stdout:[Service] 2024-05-08T05:50:23.228 INFO:teuthology.orchestra.run.smithi082.stdout:Environment=PGDATA=/tmp/cephfs/postgres/data 2024-05-08T05:50:23.228 INFO:teuthology.orchestra.run.smithi082.stdout:Environment=PGLOG=/tmp/cephfs/postgres/pgstartup.log 2024-05-08T05:50:23.234 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- postgresql-setup --initdb' 2024-05-08T05:50:23.465 INFO:teuthology.orchestra.run.smithi082.stderr: * Initializing database in '/tmp/cephfs/postgres/data' 2024-05-08T05:50:23.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.474+0000 7fb917200700 1 -- 172.21.15.82:0/2109004742 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb91006b180 msgr2=0x7fb91006b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:23.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.474+0000 7fb917200700 1 --2- 172.21.15.82:0/2109004742 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb91006b180 0x7fb91006b600 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc009990 tx=0x7fb8fc009ca0 comp rx=0 tx=0).stop 2024-05-08T05:50:23.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.474+0000 7fb917200700 1 -- 172.21.15.82:0/2109004742 shutdown_connections 2024-05-08T05:50:23.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.474+0000 7fb917200700 1 --2- 172.21.15.82:0/2109004742 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb91006bb40 0x7fb910110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:23.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.474+0000 7fb917200700 1 --2- 172.21.15.82:0/2109004742 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb910109510 0x7fb9101098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:23.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.474+0000 7fb917200700 1 --2- 172.21.15.82:0/2109004742 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb91006b180 0x7fb91006b600 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:23.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.474+0000 7fb917200700 1 -- 172.21.15.82:0/2109004742 >> 172.21.15.82:0/2109004742 conn(0x7fb910079350 msgr2=0x7fb910079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:50:23.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.474+0000 7fb917200700 1 -- 172.21.15.82:0/2109004742 shutdown_connections 2024-05-08T05:50:23.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.475+0000 7fb917200700 1 -- 172.21.15.82:0/2109004742 wait complete. 2024-05-08T05:50:23.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.476+0000 7fb917200700 1 Processor -- start 2024-05-08T05:50:23.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.476+0000 7fb917200700 1 -- start start 2024-05-08T05:50:23.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.477+0000 7fb917200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb91006b180 0x7fb91019f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:23.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.477+0000 7fb917200700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb91006bb40 0x7fb91019fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:23.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.477+0000 7fb917200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb910109510 0x7fb9101999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:23.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.477+0000 7fb917200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb910113670 con 0x7fb910109510 2024-05-08T05:50:23.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.477+0000 7fb917200700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb9101134f0 con 0x7fb91006b180 2024-05-08T05:50:23.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.477+0000 7fb917200700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb9101137f0 con 0x7fb91006bb40 2024-05-08T05:50:23.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.477+0000 7fb915200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb910109510 0x7fb9101999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:23.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.477+0000 7fb915200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb910109510 0x7fb9101999d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40022/0 (socket says 172.21.15.82:40022) 2024-05-08T05:50:23.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.477+0000 7fb915200700 1 -- 172.21.15.82:0/168689753 learned_addr learned my addr 172.21.15.82:0/168689753 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:50:23.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.477+0000 7fb90fe00700 1 --2- 172.21.15.82:0/168689753 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb91006b180 0x7fb91019f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:23.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.477+0000 7fb90f400700 1 --2- 172.21.15.82:0/168689753 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb91006bb40 0x7fb91019fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:23.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.478+0000 7fb915200700 1 -- 172.21.15.82:0/168689753 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb91006bb40 msgr2=0x7fb91019fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:23.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.478+0000 7fb915200700 1 --2- 172.21.15.82:0/168689753 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb91006bb40 0x7fb91019fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:23.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.478+0000 7fb915200700 1 -- 172.21.15.82:0/168689753 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb91006b180 msgr2=0x7fb91019f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:23.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.478+0000 7fb915200700 1 --2- 172.21.15.82:0/168689753 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb91006b180 0x7fb91019f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:23.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.478+0000 7fb915200700 1 -- 172.21.15.82:0/168689753 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb91019a130 con 0x7fb910109510 2024-05-08T05:50:23.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.478+0000 7fb90f400700 1 --2- 172.21.15.82:0/168689753 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb91006bb40 0x7fb91019fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:50:23.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.478+0000 7fb90fe00700 1 --2- 172.21.15.82:0/168689753 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb91006b180 0x7fb91019f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:50:23.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.478+0000 7fb915200700 1 --2- 172.21.15.82:0/168689753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb910109510 0x7fb9101999d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb90800ef30 tx=0x7fb90800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:50:23.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.478+0000 7fb90cc00700 1 -- 172.21.15.82:0/168689753 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9080092e0 con 0x7fb910109510 2024-05-08T05:50:23.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.478+0000 7fb90cc00700 1 -- 172.21.15.82:0/168689753 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb908004bb0 con 0x7fb910109510 2024-05-08T05:50:23.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.478+0000 7fb917200700 1 -- 172.21.15.82:0/168689753 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb91019a3c0 con 0x7fb910109510 2024-05-08T05:50:23.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.478+0000 7fb917200700 1 -- 172.21.15.82:0/168689753 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9101a66e0 con 0x7fb910109510 2024-05-08T05:50:23.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.479+0000 7fb90cc00700 1 -- 172.21.15.82:0/168689753 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb908004020 con 0x7fb910109510 2024-05-08T05:50:23.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.482+0000 7fb90cc00700 1 -- 172.21.15.82:0/168689753 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 149703+0+0 (secure 0 0 0) 0x7fb90801b030 con 0x7fb910109510 2024-05-08T05:50:23.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.483+0000 7fb921adfb80 1 Processor -- start 2024-05-08T05:50:23.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.483+0000 7fb921adfb80 1 -- start start 2024-05-08T05:50:23.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.484+0000 7fb921adfb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a9267c050 0x562a9267c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:23.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.484+0000 7fb921adfb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a9267c970 0x562a92676760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:23.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.484+0000 7fb921adfb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a92676d80 0x562a92677200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:23.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.484+0000 7fb921adfb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x562a925c4aa0 con 0x562a9267c970 2024-05-08T05:50:23.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.484+0000 7fb921adfb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562a925627e0 con 0x562a92676d80 2024-05-08T05:50:23.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.484+0000 7fb921adfb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x562a925c0a60 con 0x562a9267c050 2024-05-08T05:50:23.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.484+0000 7fb90fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a9267c970 0x562a92676760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:23.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.484+0000 7fb90f400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a92676d80 0x562a92677200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:23.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.484+0000 7fb90cc00700 1 --2- 172.21.15.82:0/168689753 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb8f40b2910 0x7fb8f40b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:23.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.484+0000 7fb90f400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a92676d80 0x562a92677200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:46280/0 (socket says 172.21.15.82:46280) 2024-05-08T05:50:23.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.484+0000 7fb90f400700 1 -- 172.21.15.82:0/3873592502 learned_addr learned my addr 172.21.15.82:0/3873592502 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:50:23.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.484+0000 7fb90f400700 1 --2- 172.21.15.82:0/3873592502 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a9267c050 0x562a9267c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:23.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.485+0000 7fb90cc00700 1 -- 172.21.15.82:0/168689753 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb9080e1f00 con 0x7fb910109510 2024-05-08T05:50:23.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.485+0000 7fb90f400700 1 -- 172.21.15.82:0/3873592502 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a9267c050 msgr2=0x562a9267c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:50:23.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.485+0000 7fb90f400700 1 --2- 172.21.15.82:0/3873592502 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a9267c050 0x562a9267c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:23.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.485+0000 7fb90f400700 1 -- 172.21.15.82:0/3873592502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a9267c970 msgr2=0x562a92676760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:50:23.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.485+0000 7fb90f400700 1 --2- 172.21.15.82:0/3873592502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a9267c970 0x562a92676760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:23.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.485+0000 7fb915200700 1 --2- 172.21.15.82:0/168689753 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb8f40b2910 0x7fb8f40b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:23.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.485+0000 7fb90f400700 1 -- 172.21.15.82:0/3873592502 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a92511950 con 0x562a92676d80 2024-05-08T05:50:23.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.485+0000 7fb90f400700 1 --2- 172.21.15.82:0/3873592502 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a92676d80 0x562a92677200 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc00b6c0 tx=0x7fb8fc00b610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db0866cb9d0b8c22 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:50:23.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.486+0000 7fb905600700 1 -- 172.21.15.82:0/3873592502 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8fc004a30 con 0x562a92676d80 2024-05-08T05:50:23.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.486+0000 7fb915200700 1 --2- 172.21.15.82:0/168689753 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb8f40b2910 0x7fb8f40b4dd0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb9080090a0 tx=0x7fb908004ad0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:50:23.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.486+0000 7fb905600700 1 -- 172.21.15.82:0/3873592502 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8fc0054d0 con 0x562a92676d80 2024-05-08T05:50:23.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.486+0000 7fb905600700 1 -- 172.21.15.82:0/3873592502 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8fc00f750 con 0x562a92676d80 2024-05-08T05:50:23.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.486+0000 7fb921adfb80 1 -- 172.21.15.82:0/3873592502 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a92676d80 msgr2=0x562a92677200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:23.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.486+0000 7fb921adfb80 1 --2- 172.21.15.82:0/3873592502 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a92676d80 0x562a92677200 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc00b6c0 tx=0x7fb8fc00b610 comp rx=0 tx=0).stop 2024-05-08T05:50:23.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.487+0000 7fb921adfb80 1 -- 172.21.15.82:0/3873592502 shutdown_connections 2024-05-08T05:50:23.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.487+0000 7fb921adfb80 1 --2- 172.21.15.82:0/3873592502 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a92676d80 0x562a92677200 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:23.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.487+0000 7fb921adfb80 1 --2- 172.21.15.82:0/3873592502 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a9267c050 0x562a9267c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:23.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.487+0000 7fb921adfb80 1 --2- 172.21.15.82:0/3873592502 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a9267c970 0x562a92676760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:23.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.487+0000 7fb921adfb80 1 -- 172.21.15.82:0/3873592502 >> 172.21.15.82:0/3873592502 conn(0x562a925ea750 msgr2=0x562a9266cb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:50:23.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.487+0000 7fb921adfb80 1 -- 172.21.15.82:0/3873592502 shutdown_connections 2024-05-08T05:50:23.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.487+0000 7fb921adfb80 1 -- 172.21.15.82:0/3873592502 wait complete. 2024-05-08T05:50:23.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.487+0000 7fb921adfb80 1 -- start start 2024-05-08T05:50:23.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.488+0000 7fb921adfb80 1 Processor -- start 2024-05-08T05:50:23.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.488+0000 7fb921adfb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a92676d80 0x562a926825f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:23.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.488+0000 7fb921adfb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a9267c050 0x562a9267f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:23.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.488+0000 7fb921adfb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a9267c970 0x562a9267fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:23.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.488+0000 7fb921adfb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x562a92683350 con 0x562a9267c970 2024-05-08T05:50:23.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.488+0000 7fb921adfb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562a9252aba0 con 0x562a92676d80 2024-05-08T05:50:23.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.488+0000 7fb921adfb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x562a926834d0 con 0x562a9267c050 2024-05-08T05:50:23.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.488+0000 7fb921adfb80 10 client.0 _ll_register_callbacks cb 0x562a9256bcf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:50:23.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.488+0000 7fb90fe00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a9267c050 0x562a9267f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:23.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.488+0000 7fb90f400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a92676d80 0x562a926825f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:23.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.488+0000 7fb90fe00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a9267c050 0x562a9267f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:42948/0 (socket says 172.21.15.82:42948) 2024-05-08T05:50:23.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.488+0000 7fb90fe00700 1 -- 172.21.15.82:0/2771527294 learned_addr learned my addr 172.21.15.82:0/2771527294 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:50:23.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.489+0000 7fb90f400700 1 --2- 172.21.15.82:0/2771527294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a9267c970 0x562a9267fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:23.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.489+0000 7fb90fe00700 1 -- 172.21.15.82:0/2771527294 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a92676d80 msgr2=0x562a926825f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:50:23.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.489+0000 7fb90fe00700 1 --2- 172.21.15.82:0/2771527294 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a92676d80 0x562a926825f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:23.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.489+0000 7fb90fe00700 1 -- 172.21.15.82:0/2771527294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a9267c970 msgr2=0x562a9267fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:50:23.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.489+0000 7fb90fe00700 1 --2- 172.21.15.82:0/2771527294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a9267c970 0x562a9267fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:23.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.489+0000 7fb90fe00700 1 -- 172.21.15.82:0/2771527294 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a9258a4a0 con 0x562a9267c050 2024-05-08T05:50:23.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.489+0000 7fb90fe00700 1 --2- 172.21.15.82:0/2771527294 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a9267c050 0x562a9267f990 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb900011d10 tx=0x7fb90000f6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6bae7e60eb1de1bd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:50:23.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.489+0000 7fb8fa000700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:50:23.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.489+0000 7fb8fa000700 1 -- 172.21.15.82:0/2771527294 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb90000fd90 con 0x562a9267c050 2024-05-08T05:50:23.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.490+0000 7fb8fa000700 1 -- 172.21.15.82:0/2771527294 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb900004050 con 0x562a9267c050 2024-05-08T05:50:23.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.490+0000 7fb921adfb80 1 -- 172.21.15.82:0/2771527294 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8fc0054d0 con 0x562a9267c050 2024-05-08T05:50:23.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.490+0000 7fb8fa000700 1 -- 172.21.15.82:0/2771527294 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb900004250 con 0x562a9267c050 2024-05-08T05:50:23.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.490+0000 7fb921adfb80 10 client.25198 fetch_fsmap learned FSMap version 29 2024-05-08T05:50:23.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.490+0000 7fb921adfb80 1 -- 172.21.15.82:0/2771527294 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562a9268db80 con 0x562a9267c050 2024-05-08T05:50:23.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.490+0000 7fb8fa000700 1 -- 172.21.15.82:0/2771527294 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8fc0054d0 con 0x562a9267c050 2024-05-08T05:50:23.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.490+0000 7fb8fa000700 1 -- 172.21.15.82:0/2771527294 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fb90001a4a0 con 0x562a9267c050 2024-05-08T05:50:23.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.491+0000 7fb921adfb80 10 client.25198 fetch_fsmap finished waiting for FSMap version 29 2024-05-08T05:50:23.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.491+0000 7fb921adfb80 10 client.25198 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:50:23.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.491+0000 7fb921adfb80 20 client.25198 populate_metadata read hostname 'smithi082' 2024-05-08T05:50:23.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.491+0000 7fb921adfb80 1 --2- 172.21.15.82:0/2771527294 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x562a92690210 0x562a92692650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:23.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.491+0000 7fb921adfb80 4 client.25198 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:50:23.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.491+0000 7fb921adfb80 1 -- 172.21.15.82:0/2771527294 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562a9263f1c0 con 0x562a92690210 2024-05-08T05:50:23.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.491+0000 7fb90f400700 1 --2- 172.21.15.82:0/2771527294 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x562a92690210 0x562a92692650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:23.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.492+0000 7fb8fa000700 10 client.25198 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:50:23.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.492+0000 7fb90f400700 1 --2- 172.21.15.82:0/2771527294 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x562a92690210 0x562a92692650 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74ff0600d1cbff8b server_cookie=14fd571db4cfdfdb in_seq=0 out_seq=0 2024-05-08T05:50:23.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.493+0000 7fb8fa000700 1 -- 172.21.15.82:0/2771527294 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562a9263f1c0 con 0x562a92690210 2024-05-08T05:50:23.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.493+0000 7fb8fa000700 10 client.25198 handle_command_reply: tid=0 2024-05-08T05:50:23.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.493+0000 7fb921adfb80 1 client.25198 shutdown 2024-05-08T05:50:23.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.493+0000 7fb921adfb80 1 -- 172.21.15.82:0/2771527294 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a9267c050 msgr2=0x562a9267f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:23.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.493+0000 7fb921adfb80 1 --2- 172.21.15.82:0/2771527294 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a9267c050 0x562a9267f990 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb900011d10 tx=0x7fb90000f6a0 comp rx=0 tx=0).stop 2024-05-08T05:50:23.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.493+0000 7fb921adfb80 1 -- 172.21.15.82:0/2771527294 shutdown_connections 2024-05-08T05:50:23.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.493+0000 7fb921adfb80 1 --2- 172.21.15.82:0/2771527294 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x562a92690210 0x562a92692650 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:23.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.493+0000 7fb921adfb80 1 --2- 172.21.15.82:0/2771527294 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a92676d80 0x562a926825f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:23.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.493+0000 7fb921adfb80 1 --2- 172.21.15.82:0/2771527294 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a9267c970 0x562a9267fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:23.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.493+0000 7fb921adfb80 1 --2- 172.21.15.82:0/2771527294 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a9267c050 0x562a9267f990 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:23.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.493+0000 7fb921adfb80 1 -- 172.21.15.82:0/2771527294 >> 172.21.15.82:0/2771527294 conn(0x562a925ea750 msgr2=0x562a9266c210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:50:23.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.493+0000 7fb8fa000700 0 client.25198 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:50:23.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.494+0000 7fb921adfb80 1 -- 172.21.15.82:0/2771527294 shutdown_connections 2024-05-08T05:50:23.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.494+0000 7fb921adfb80 1 -- 172.21.15.82:0/2771527294 wait complete. 2024-05-08T05:50:23.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.494+0000 7fb921adfb80 20 client.25198 trim_cache size 0 max 16384 2024-05-08T05:50:23.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.516+0000 7fb921adfb80 1 Processor -- start 2024-05-08T05:50:23.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.516+0000 7fb921adfb80 1 -- start start 2024-05-08T05:50:23.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.516+0000 7fb921adfb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a92676d80 0x562a9268c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:23.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.516+0000 7fb921adfb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a9267c050 0x562a9266c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:23.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.516+0000 7fb921adfb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a9267c970 0x562a92697f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:23.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.516+0000 7fb921adfb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb9101ab920 con 0x562a92676d80 2024-05-08T05:50:23.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.516+0000 7fb921adfb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb9101ad460 con 0x562a9267c050 2024-05-08T05:50:23.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.516+0000 7fb921adfb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb9101abff0 con 0x562a9267c970 2024-05-08T05:50:23.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.517+0000 7fb90f400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a92676d80 0x562a9268c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:23.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.517+0000 7fb90fe00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a9267c050 0x562a9266c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:23.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.517+0000 7fb90f400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a92676d80 0x562a9268c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40056/0 (socket says 172.21.15.82:40056) 2024-05-08T05:50:23.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.517+0000 7fb90f400700 1 -- 172.21.15.82:0/1430141064 learned_addr learned my addr 172.21.15.82:0/1430141064 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:50:23.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.517+0000 7fb90f400700 1 --2- 172.21.15.82:0/1430141064 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a9267c970 0x562a92697f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:23.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.517+0000 7fb90f400700 1 -- 172.21.15.82:0/1430141064 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a9267c970 msgr2=0x562a92697f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:50:23.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.517+0000 7fb90f400700 1 --2- 172.21.15.82:0/1430141064 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a9267c970 0x562a92697f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:23.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.517+0000 7fb90f400700 1 -- 172.21.15.82:0/1430141064 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a9267c050 msgr2=0x562a9266c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:50:23.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.517+0000 7fb90f400700 1 --2- 172.21.15.82:0/1430141064 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a9267c050 0x562a9266c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:23.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.517+0000 7fb90f400700 1 -- 172.21.15.82:0/1430141064 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a92667b30 con 0x562a92676d80 2024-05-08T05:50:23.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.517+0000 7fb90fe00700 1 --2- 172.21.15.82:0/1430141064 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a9267c050 0x562a9266c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:50:23.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.517+0000 7fb90f400700 1 --2- 172.21.15.82:0/1430141064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a92676d80 0x562a9268c410 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc00b6c0 tx=0x7fb8fc004690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9cc48619e198c0b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:50:23.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.518+0000 7fb904c00700 1 -- 172.21.15.82:0/1430141064 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8fc00f900 con 0x562a92676d80 2024-05-08T05:50:23.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.518+0000 7fb904c00700 1 -- 172.21.15.82:0/1430141064 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8fc028450 con 0x562a92676d80 2024-05-08T05:50:23.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.518+0000 7fb904c00700 1 -- 172.21.15.82:0/1430141064 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8fc0386a0 con 0x562a92676d80 2024-05-08T05:50:23.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.519+0000 7fb921adfb80 1 -- 172.21.15.82:0/1430141064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a92676d80 msgr2=0x562a9268c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:23.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.519+0000 7fb921adfb80 1 --2- 172.21.15.82:0/1430141064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a92676d80 0x562a9268c410 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc00b6c0 tx=0x7fb8fc004690 comp rx=0 tx=0).stop 2024-05-08T05:50:23.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.519+0000 7fb921adfb80 1 -- 172.21.15.82:0/1430141064 shutdown_connections 2024-05-08T05:50:23.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.519+0000 7fb921adfb80 1 --2- 172.21.15.82:0/1430141064 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a9267c970 0x562a92697f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:23.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.519+0000 7fb921adfb80 1 --2- 172.21.15.82:0/1430141064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a92676d80 0x562a9268c410 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:23.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.519+0000 7fb921adfb80 1 --2- 172.21.15.82:0/1430141064 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a9267c050 0x562a9266c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:23.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.519+0000 7fb921adfb80 1 -- 172.21.15.82:0/1430141064 >> 172.21.15.82:0/1430141064 conn(0x562a925ea750 msgr2=0x562a9267b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:50:23.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.519+0000 7fb921adfb80 1 -- 172.21.15.82:0/1430141064 shutdown_connections 2024-05-08T05:50:23.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.519+0000 7fb921adfb80 1 -- 172.21.15.82:0/1430141064 wait complete. 2024-05-08T05:50:23.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.519+0000 7fb921adfb80 1 -- start start 2024-05-08T05:50:23.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.520+0000 7fb921adfb80 1 Processor -- start 2024-05-08T05:50:23.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.520+0000 7fb921adfb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a92676d80 0x562a92686a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:23.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.520+0000 7fb921adfb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a9267c050 0x562a92686f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:23.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.520+0000 7fb921adfb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a9267c970 0x562a926f9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:23.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.520+0000 7fb921adfb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb9101acd90 con 0x562a9267c050 2024-05-08T05:50:23.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.520+0000 7fb921adfb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb9101ac6c0 con 0x562a9267c970 2024-05-08T05:50:23.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.520+0000 7fb921adfb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb9101a98c0 con 0x562a92676d80 2024-05-08T05:50:23.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.520+0000 7fb921adfb80 10 client.0 _ll_register_callbacks cb 0x562a9256bcf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:50:23.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.521+0000 7fb90f400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a92676d80 0x562a92686a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:23.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.521+0000 7fb90fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a9267c050 0x562a92686f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:23.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.521+0000 7fb90f400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a92676d80 0x562a92686a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:42966/0 (socket says 172.21.15.82:42966) 2024-05-08T05:50:23.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.521+0000 7fb90f400700 1 -- 172.21.15.82:0/3538236450 learned_addr learned my addr 172.21.15.82:0/3538236450 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:50:23.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.521+0000 7fb90f400700 1 --2- 172.21.15.82:0/3538236450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a9267c970 0x562a926f9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:23.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.521+0000 7fb90fe00700 1 -- 172.21.15.82:0/3538236450 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a92676d80 msgr2=0x562a92686a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:50:23.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.521+0000 7fb90fe00700 1 --2- 172.21.15.82:0/3538236450 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a92676d80 0x562a92686a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:23.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.521+0000 7fb90fe00700 1 -- 172.21.15.82:0/3538236450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a9267c970 msgr2=0x562a926f9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:50:23.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.521+0000 7fb90fe00700 1 --2- 172.21.15.82:0/3538236450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a9267c970 0x562a926f9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:23.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.521+0000 7fb90fe00700 1 -- 172.21.15.82:0/3538236450 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a926fa020 con 0x562a9267c050 2024-05-08T05:50:23.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.521+0000 7fb90f400700 1 --2- 172.21.15.82:0/3538236450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a9267c970 0x562a926f9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:50:23.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.521+0000 7fb90fe00700 1 --2- 172.21.15.82:0/3538236450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a9267c050 0x562a92686f50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb90001a8b0 tx=0x7fb90000fa80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62c2bea833dcc21c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:50:23.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.521+0000 7fb8fa000700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T05:50:23.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.522+0000 7fb8fa000700 1 -- 172.21.15.82:0/3538236450 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb900029040 con 0x562a9267c050 2024-05-08T05:50:23.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.522+0000 7fb921adfb80 1 -- 172.21.15.82:0/3538236450 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8fc028450 con 0x562a9267c050 2024-05-08T05:50:23.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.522+0000 7fb8fa000700 1 -- 172.21.15.82:0/3538236450 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb90001a3f0 con 0x562a9267c050 2024-05-08T05:50:23.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.522+0000 7fb8fa000700 1 -- 172.21.15.82:0/3538236450 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb900000e60 con 0x562a9267c050 2024-05-08T05:50:23.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.522+0000 7fb921adfb80 10 client.15090 fetch_fsmap learned FSMap version 29 2024-05-08T05:50:23.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.522+0000 7fb921adfb80 1 -- 172.21.15.82:0/3538236450 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562a926fb310 con 0x562a9267c050 2024-05-08T05:50:23.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.522+0000 7fb8fa000700 1 -- 172.21.15.82:0/3538236450 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb8fc028450 con 0x562a9267c050 2024-05-08T05:50:23.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.522+0000 7fb8fa000700 1 -- 172.21.15.82:0/3538236450 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fb90002c070 con 0x562a9267c050 2024-05-08T05:50:23.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.522+0000 7fb921adfb80 10 client.15090 fetch_fsmap finished waiting for FSMap version 29 2024-05-08T05:50:23.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.522+0000 7fb921adfb80 10 client.15090 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:50:23.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.522+0000 7fb921adfb80 20 client.15090 populate_metadata read hostname 'smithi082' 2024-05-08T05:50:23.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.522+0000 7fb921adfb80 1 --2- 172.21.15.82:0/3538236450 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x562a926fba10 0x562a926fde30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:23.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.522+0000 7fb921adfb80 4 client.15090 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-08T05:50:23.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.522+0000 7fb921adfb80 1 -- 172.21.15.82:0/3538236450 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x562a925d2480 con 0x562a926fba10 2024-05-08T05:50:23.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.523+0000 7fb90f400700 1 --2- 172.21.15.82:0/3538236450 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x562a926fba10 0x562a926fde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:23.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.523+0000 7fb90f400700 1 --2- 172.21.15.82:0/3538236450 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x562a926fba10 0x562a926fde30 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cecdc5e893c49353 server_cookie=c7f0f6b599e98e8b in_seq=0 out_seq=0 2024-05-08T05:50:23.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.523+0000 7fb8fa000700 10 client.15090 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:50:23.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.524+0000 7fb8fa000700 1 -- 172.21.15.82:0/3538236450 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562a925d2480 con 0x562a926fba10 2024-05-08T05:50:23.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.524+0000 7fb8fa000700 10 client.15090 handle_command_reply: tid=0 2024-05-08T05:50:23.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.524+0000 7fb921adfb80 1 client.15090 shutdown 2024-05-08T05:50:23.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.525+0000 7fb921adfb80 1 -- 172.21.15.82:0/3538236450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a9267c050 msgr2=0x562a92686f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:23.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.525+0000 7fb921adfb80 1 --2- 172.21.15.82:0/3538236450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a9267c050 0x562a92686f50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fb90001a8b0 tx=0x7fb90000fa80 comp rx=0 tx=0).stop 2024-05-08T05:50:23.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.525+0000 7fb921adfb80 1 -- 172.21.15.82:0/3538236450 shutdown_connections 2024-05-08T05:50:23.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.525+0000 7fb921adfb80 1 --2- 172.21.15.82:0/3538236450 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x562a926fba10 0x562a926fde30 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:23.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.525+0000 7fb921adfb80 1 --2- 172.21.15.82:0/3538236450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562a9267c970 0x562a926f9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:23.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.525+0000 7fb921adfb80 1 --2- 172.21.15.82:0/3538236450 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a92676d80 0x562a92686a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:23.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.525+0000 7fb921adfb80 1 --2- 172.21.15.82:0/3538236450 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562a9267c050 0x562a92686f50 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:23.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.525+0000 7fb921adfb80 1 -- 172.21.15.82:0/3538236450 >> 172.21.15.82:0/3538236450 conn(0x562a925ea750 msgr2=0x562a92680f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:50:23.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.525+0000 7fb8fa000700 0 client.15090 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:50:23.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.525+0000 7fb921adfb80 1 -- 172.21.15.82:0/3538236450 shutdown_connections 2024-05-08T05:50:23.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.525+0000 7fb921adfb80 1 -- 172.21.15.82:0/3538236450 wait complete. 2024-05-08T05:50:23.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.525+0000 7fb921adfb80 20 client.15090 trim_cache size 0 max 16384 2024-05-08T05:50:23.529 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T05:50:23.529 INFO:teuthology.orchestra.run.smithi082.stdout: "return_code": 0, 2024-05-08T05:50:23.529 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_tag": "fdc32259-e213-4c52-9ccf-7afecc474e96", 2024-05-08T05:50:23.529 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": "asynchronous" 2024-05-08T05:50:23.530 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T05:50:23.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.526+0000 7fb917200700 1 -- 172.21.15.82:0/168689753 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb8f40b2910 msgr2=0x7fb8f40b4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:23.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.526+0000 7fb917200700 1 --2- 172.21.15.82:0/168689753 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb8f40b2910 0x7fb8f40b4dd0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb9080090a0 tx=0x7fb908004ad0 comp rx=0 tx=0).stop 2024-05-08T05:50:23.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.526+0000 7fb917200700 1 -- 172.21.15.82:0/168689753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb910109510 msgr2=0x7fb9101999d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:23.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.526+0000 7fb917200700 1 --2- 172.21.15.82:0/168689753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb910109510 0x7fb9101999d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb90800ef30 tx=0x7fb90800c3a0 comp rx=0 tx=0).stop 2024-05-08T05:50:23.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.526+0000 7fb917200700 1 -- 172.21.15.82:0/168689753 shutdown_connections 2024-05-08T05:50:23.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.526+0000 7fb917200700 1 --2- 172.21.15.82:0/168689753 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb91006b180 0x7fb91019f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:23.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.526+0000 7fb917200700 1 --2- 172.21.15.82:0/168689753 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb8f40b2910 0x7fb8f40b4dd0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:23.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.526+0000 7fb917200700 1 --2- 172.21.15.82:0/168689753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb910109510 0x7fb9101999d0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:23.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.526+0000 7fb917200700 1 --2- 172.21.15.82:0/168689753 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb91006bb40 0x7fb91019fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:23.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.526+0000 7fb917200700 1 -- 172.21.15.82:0/168689753 >> 172.21.15.82:0/168689753 conn(0x7fb910079350 msgr2=0x7fb910101140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:50:23.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.526+0000 7fb917200700 1 -- 172.21.15.82:0/168689753 shutdown_connections 2024-05-08T05:50:23.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:23.527+0000 7fb917200700 1 -- 172.21.15.82:0/168689753 wait complete. 2024-05-08T05:50:23.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:50:23 smithi082 ceph-mon[30098]: pgmap v451: 97 pgs: 97 active+clean; 665 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1023 B/s wr, 11 op/s 2024-05-08T05:50:23.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:50:23 smithi134 ceph-mon[34132]: pgmap v451: 97 pgs: 97 active+clean; 665 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1023 B/s wr, 11 op/s 2024-05-08T05:50:23.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:50:23 smithi151 ceph-mon[34815]: pgmap v451: 97 pgs: 97 active+clean; 665 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1023 B/s wr, 11 op/s 2024-05-08T05:50:24.471 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-08T05:50:24.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:50:24 smithi082 ceph-mon[30098]: scrub queued for path: / 2024-05-08T05:50:24.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:50:24 smithi082 ceph-mon[30098]: scrub summary: idle+waiting paths [/] 2024-05-08T05:50:24.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:50:24 smithi082 ceph-mon[30098]: scrub summary: active paths [/] 2024-05-08T05:50:24.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:50:24 smithi082 ceph-mon[30098]: scrub summary: idle+waiting paths [/] 2024-05-08T05:50:24.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:50:24 smithi134 ceph-mon[34132]: scrub queued for path: / 2024-05-08T05:50:24.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:50:24 smithi134 ceph-mon[34132]: scrub summary: idle+waiting paths [/] 2024-05-08T05:50:24.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:50:24 smithi134 ceph-mon[34132]: scrub summary: active paths [/] 2024-05-08T05:50:24.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:50:24 smithi134 ceph-mon[34132]: scrub summary: idle+waiting paths [/] 2024-05-08T05:50:24.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:50:24 smithi151 ceph-mon[34815]: scrub queued for path: / 2024-05-08T05:50:24.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:50:24 smithi151 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-05-08T05:50:24.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:50:24 smithi151 ceph-mon[34815]: scrub summary: active paths [/] 2024-05-08T05:50:24.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:50:24 smithi151 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-05-08T05:50:24.926 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:50:25.722 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:50:25 smithi082 ceph-mon[30098]: pgmap v452: 97 pgs: 97 active+clean; 665 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-05-08T05:50:25.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:50:25 smithi134 ceph-mon[34132]: pgmap v452: 97 pgs: 97 active+clean; 665 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-05-08T05:50:25.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:50:25 smithi151 ceph-mon[34815]: pgmap v452: 97 pgs: 97 active+clean; 665 KiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2024-05-08T05:50:27.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.373+0000 7f48b2c00700 1 -- 172.21.15.82:0/4207402853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48ac108700 msgr2=0x7f48ac1102d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:27.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.373+0000 7f48b2c00700 1 --2- 172.21.15.82:0/4207402853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48ac108700 0x7f48ac1102d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f48a400b0d0 tx=0x7f48a400b3e0 comp rx=0 tx=0).stop 2024-05-08T05:50:27.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.373+0000 7f48b2c00700 1 -- 172.21.15.82:0/4207402853 shutdown_connections 2024-05-08T05:50:27.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.373+0000 7f48b2c00700 1 --2- 172.21.15.82:0/4207402853 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48ac108700 0x7f48ac1102d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:27.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.373+0000 7f48b2c00700 1 --2- 172.21.15.82:0/4207402853 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48ac103620 0x7f48ac103a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:27.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.373+0000 7f48b2c00700 1 --2- 172.21.15.82:0/4207402853 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48ac103fd0 0x7f48ac108020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:27.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.373+0000 7f48b2c00700 1 -- 172.21.15.82:0/4207402853 >> 172.21.15.82:0/4207402853 conn(0x7f48ac0feeb0 msgr2=0x7f48ac1012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:50:27.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.373+0000 7f48b2c00700 1 -- 172.21.15.82:0/4207402853 shutdown_connections 2024-05-08T05:50:27.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.373+0000 7f48b2c00700 1 -- 172.21.15.82:0/4207402853 wait complete. 2024-05-08T05:50:27.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.375+0000 7f48b2c00700 1 Processor -- start 2024-05-08T05:50:27.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.375+0000 7f48b2c00700 1 -- start start 2024-05-08T05:50:27.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.375+0000 7f48b2c00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48ac103620 0x7f48ac19f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:27.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.375+0000 7f48b2c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48ac103fd0 0x7f48ac19fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:27.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.375+0000 7f48b2c00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48ac108700 0x7f48ac199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:27.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.376+0000 7f48b2c00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f48ac1135a0 con 0x7f48ac103fd0 2024-05-08T05:50:27.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.376+0000 7f48b2c00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f48ac113420 con 0x7f48ac108700 2024-05-08T05:50:27.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.376+0000 7f48b2c00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f48ac113720 con 0x7f48ac103620 2024-05-08T05:50:27.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.376+0000 7f48b0e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48ac103fd0 0x7f48ac19fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:27.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.376+0000 7f48b0e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48ac103fd0 0x7f48ac19fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40068/0 (socket says 172.21.15.82:40068) 2024-05-08T05:50:27.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.376+0000 7f48b0e00700 1 -- 172.21.15.82:0/693520695 learned_addr learned my addr 172.21.15.82:0/693520695 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:50:27.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.376+0000 7f48b1800700 1 --2- 172.21.15.82:0/693520695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48ac103620 0x7f48ac19f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:27.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.376+0000 7f48b2200700 1 --2- 172.21.15.82:0/693520695 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48ac108700 0x7f48ac199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:27.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.376+0000 7f48b0e00700 1 -- 172.21.15.82:0/693520695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48ac103620 msgr2=0x7f48ac19f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:27.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.376+0000 7f48b0e00700 1 --2- 172.21.15.82:0/693520695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48ac103620 0x7f48ac19f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:27.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.376+0000 7f48b0e00700 1 -- 172.21.15.82:0/693520695 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48ac108700 msgr2=0x7f48ac199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:27.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.376+0000 7f48b0e00700 1 --2- 172.21.15.82:0/693520695 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48ac108700 0x7f48ac199840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:27.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.376+0000 7f48b0e00700 1 -- 172.21.15.82:0/693520695 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48ac19a020 con 0x7f48ac103fd0 2024-05-08T05:50:27.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.377+0000 7f48b0e00700 1 --2- 172.21.15.82:0/693520695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48ac103fd0 0x7f48ac19fc00 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f489800e970 tx=0x7f489800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:50:27.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.377+0000 7f48aa000700 1 -- 172.21.15.82:0/693520695 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4898004a30 con 0x7f48ac103fd0 2024-05-08T05:50:27.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.377+0000 7f48aa000700 1 -- 172.21.15.82:0/693520695 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f489800cc90 con 0x7f48ac103fd0 2024-05-08T05:50:27.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.377+0000 7f48b2c00700 1 -- 172.21.15.82:0/693520695 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48ac19a310 con 0x7f48ac103fd0 2024-05-08T05:50:27.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.377+0000 7f48aa000700 1 -- 172.21.15.82:0/693520695 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4898005610 con 0x7f48ac103fd0 2024-05-08T05:50:27.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.377+0000 7f48b2c00700 1 -- 172.21.15.82:0/693520695 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48ac1a6520 con 0x7f48ac103fd0 2024-05-08T05:50:27.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.381+0000 7f48aa000700 1 -- 172.21.15.82:0/693520695 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 19) ==== 149703+0+0 (secure 0 0 0) 0x7f489800c7e0 con 0x7f48ac103fd0 2024-05-08T05:50:27.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.382+0000 7f48bebf4b80 1 Processor -- start 2024-05-08T05:50:27.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.382+0000 7f48bebf4b80 1 -- start start 2024-05-08T05:50:27.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.382+0000 7f48aa000700 1 --2- 172.21.15.82:0/693520695 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f48940b2990 0x7f48940b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:27.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.383+0000 7f48aa000700 1 -- 172.21.15.82:0/693520695 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f48980e2490 con 0x7f48ac103fd0 2024-05-08T05:50:27.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.383+0000 7f48bebf4b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f7c7972a20 0x55f7c7972e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:27.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.383+0000 7f48bebf4b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7c7973340 0x55f7c7976d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:27.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.383+0000 7f48bebf4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7c79772c0 0x55f7c7977720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:27.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.383+0000 7f48bebf4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f7c78c0a20 con 0x55f7c79772c0 2024-05-08T05:50:27.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.383+0000 7f48bebf4b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f7c785e760 con 0x55f7c7972a20 2024-05-08T05:50:27.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.383+0000 7f48bebf4b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55f7c78bc9e0 con 0x55f7c7973340 2024-05-08T05:50:27.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.383+0000 7f48b2200700 1 --2- 172.21.15.82:0/693520695 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f48940b2990 0x7f48940b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:27.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.383+0000 7f48b1800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f7c7972a20 0x55f7c7972e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:27.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.383+0000 7f48b2200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7c79772c0 0x55f7c7977720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:27.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.383+0000 7f48b1800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f7c7972a20 0x55f7c7972e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:46334/0 (socket says 172.21.15.82:46334) 2024-05-08T05:50:27.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.383+0000 7f48b1800700 1 -- 172.21.15.82:0/4172272620 learned_addr learned my addr 172.21.15.82:0/4172272620 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:50:27.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.383+0000 7f48b0e00700 1 --2- 172.21.15.82:0/4172272620 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7c7973340 0x55f7c7976d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:27.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.384+0000 7f48b1800700 1 -- 172.21.15.82:0/4172272620 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7c7973340 msgr2=0x55f7c7976d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:50:27.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.384+0000 7f48b1800700 1 --2- 172.21.15.82:0/4172272620 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7c7973340 0x55f7c7976d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:27.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.384+0000 7f48b1800700 1 -- 172.21.15.82:0/4172272620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7c79772c0 msgr2=0x55f7c7977720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:50:27.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.384+0000 7f48b1800700 1 --2- 172.21.15.82:0/4172272620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7c79772c0 0x55f7c7977720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:27.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.384+0000 7f48b1800700 1 -- 172.21.15.82:0/4172272620 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7c780d8d0 con 0x55f7c7972a20 2024-05-08T05:50:27.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.384+0000 7f48b2200700 1 --2- 172.21.15.82:0/693520695 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f48940b2990 0x7f48940b4e50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f48a4009850 tx=0x7f48a4009e20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:50:27.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.384+0000 7f48b1800700 1 --2- 172.21.15.82:0/4172272620 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f7c7972a20 0x55f7c7972e00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f48a0007cf0 tx=0x7f48a00103d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b023349cee1c4e3f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:50:27.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.384+0000 7f489ea00700 1 -- 172.21.15.82:0/4172272620 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a0010d10 con 0x55f7c7972a20 2024-05-08T05:50:27.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.384+0000 7f489ea00700 1 -- 172.21.15.82:0/4172272620 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f48a00118f0 con 0x55f7c7972a20 2024-05-08T05:50:27.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.384+0000 7f489ea00700 1 -- 172.21.15.82:0/4172272620 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a00196c0 con 0x55f7c7972a20 2024-05-08T05:50:27.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.385+0000 7f48bebf4b80 1 -- 172.21.15.82:0/4172272620 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f7c7972a20 msgr2=0x55f7c7972e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:27.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.385+0000 7f48bebf4b80 1 --2- 172.21.15.82:0/4172272620 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f7c7972a20 0x55f7c7972e00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f48a0007cf0 tx=0x7f48a00103d0 comp rx=0 tx=0).stop 2024-05-08T05:50:27.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.385+0000 7f48bebf4b80 1 -- 172.21.15.82:0/4172272620 shutdown_connections 2024-05-08T05:50:27.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.385+0000 7f48bebf4b80 1 --2- 172.21.15.82:0/4172272620 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f7c7972a20 0x55f7c7972e00 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:27.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.385+0000 7f48bebf4b80 1 --2- 172.21.15.82:0/4172272620 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7c79772c0 0x55f7c7977720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:27.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.385+0000 7f48bebf4b80 1 --2- 172.21.15.82:0/4172272620 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7c7973340 0x55f7c7976d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:27.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.385+0000 7f48bebf4b80 1 -- 172.21.15.82:0/4172272620 >> 172.21.15.82:0/4172272620 conn(0x55f7c78e66d0 msgr2=0x55f7c7968ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:50:27.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.385+0000 7f48bebf4b80 1 -- 172.21.15.82:0/4172272620 shutdown_connections 2024-05-08T05:50:27.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.385+0000 7f48bebf4b80 1 -- 172.21.15.82:0/4172272620 wait complete. 2024-05-08T05:50:27.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.386+0000 7f48bebf4b80 1 -- start start 2024-05-08T05:50:27.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.386+0000 7f48bebf4b80 1 Processor -- start 2024-05-08T05:50:27.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.387+0000 7f48bebf4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7c7972a20 0x55f7c797e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:27.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.387+0000 7f48bebf4b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f7c7973340 0x55f7c797ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:27.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.387+0000 7f48bebf4b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7c79772c0 0x55f7c797bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:27.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.387+0000 7f48bebf4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f7c797f540 con 0x55f7c7972a20 2024-05-08T05:50:27.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.387+0000 7f48bebf4b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f7c7826b20 con 0x55f7c7973340 2024-05-08T05:50:27.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.387+0000 7f48bebf4b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55f7c797f6c0 con 0x55f7c79772c0 2024-05-08T05:50:27.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.387+0000 7f48bebf4b80 10 client.0 _ll_register_callbacks cb 0x55f7c7867c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:50:27.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.387+0000 7f48b1800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7c7972a20 0x55f7c797e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:27.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.387+0000 7f48b1800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7c7972a20 0x55f7c797e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40090/0 (socket says 172.21.15.82:40090) 2024-05-08T05:50:27.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.387+0000 7f48b1800700 1 -- 172.21.15.82:0/115533478 learned_addr learned my addr 172.21.15.82:0/115533478 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:50:27.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.387+0000 7f48b2200700 1 --2- 172.21.15.82:0/115533478 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7c79772c0 0x55f7c797bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:27.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.387+0000 7f48b0e00700 1 --2- 172.21.15.82:0/115533478 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f7c7973340 0x55f7c797ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:27.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.388+0000 7f48b1800700 1 -- 172.21.15.82:0/115533478 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7c79772c0 msgr2=0x55f7c797bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:50:27.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.388+0000 7f48b1800700 1 --2- 172.21.15.82:0/115533478 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7c79772c0 0x55f7c797bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:27.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.388+0000 7f48b1800700 1 -- 172.21.15.82:0/115533478 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f7c7973340 msgr2=0x55f7c797ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:50:27.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.388+0000 7f48b1800700 1 --2- 172.21.15.82:0/115533478 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f7c7973340 0x55f7c797ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:27.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.388+0000 7f48b1800700 1 -- 172.21.15.82:0/115533478 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7c7886420 con 0x55f7c7972a20 2024-05-08T05:50:27.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.388+0000 7f48b1800700 1 --2- 172.21.15.82:0/115533478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7c7972a20 0x55f7c797e6c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f48a0010b90 tx=0x7f48a0010bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54a959fea2029c81 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:50:27.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.388+0000 7f4893400700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T05:50:27.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.388+0000 7f4893400700 1 -- 172.21.15.82:0/115533478 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a0026020 con 0x55f7c7972a20 2024-05-08T05:50:27.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.388+0000 7f4893400700 1 -- 172.21.15.82:0/115533478 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f48a0011650 con 0x55f7c7972a20 2024-05-08T05:50:27.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.388+0000 7f48bebf4b80 1 -- 172.21.15.82:0/115533478 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48a00118f0 con 0x55f7c7972a20 2024-05-08T05:50:27.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.389+0000 7f4893400700 1 -- 172.21.15.82:0/115533478 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f48a0011aa0 con 0x55f7c7972a20 2024-05-08T05:50:27.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.389+0000 7f48bebf4b80 10 client.15102 fetch_fsmap learned FSMap version 29 2024-05-08T05:50:27.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.389+0000 7f48bebf4b80 1 -- 172.21.15.82:0/115533478 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f7c7989ce0 con 0x55f7c7972a20 2024-05-08T05:50:27.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.389+0000 7f4893400700 1 -- 172.21.15.82:0/115533478 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f48a00118f0 con 0x55f7c7972a20 2024-05-08T05:50:27.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.389+0000 7f4893400700 1 -- 172.21.15.82:0/115533478 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f48a00047e0 con 0x55f7c7972a20 2024-05-08T05:50:27.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.389+0000 7f48bebf4b80 10 client.15102 fetch_fsmap finished waiting for FSMap version 29 2024-05-08T05:50:27.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.389+0000 7f48bebf4b80 10 client.15102 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:50:27.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.389+0000 7f48bebf4b80 20 client.15102 populate_metadata read hostname 'smithi082' 2024-05-08T05:50:27.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.389+0000 7f48bebf4b80 1 --2- 172.21.15.82:0/115533478 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55f7c798c1b0 0x55f7c798e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:27.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.389+0000 7f48bebf4b80 4 client.15102 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:50:27.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.389+0000 7f48bebf4b80 1 -- 172.21.15.82:0/115533478 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f7c793b140 con 0x55f7c798c1b0 2024-05-08T05:50:27.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.390+0000 7f48b0e00700 1 --2- 172.21.15.82:0/115533478 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55f7c798c1b0 0x55f7c798e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:27.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.390+0000 7f48b0e00700 1 --2- 172.21.15.82:0/115533478 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55f7c798c1b0 0x55f7c798e5a0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=792ad742728b0541 server_cookie=476b93a0b1a51dc0 in_seq=0 out_seq=0 2024-05-08T05:50:27.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.390+0000 7f4893400700 10 client.15102 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:50:27.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.391+0000 7f4893400700 1 -- 172.21.15.82:0/115533478 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f7c793b140 con 0x55f7c798c1b0 2024-05-08T05:50:27.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.391+0000 7f4893400700 10 client.15102 handle_command_reply: tid=0 2024-05-08T05:50:27.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.391+0000 7f48bebf4b80 1 client.15102 shutdown 2024-05-08T05:50:27.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.391+0000 7f48bebf4b80 1 -- 172.21.15.82:0/115533478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7c7972a20 msgr2=0x55f7c797e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:27.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.391+0000 7f48bebf4b80 1 --2- 172.21.15.82:0/115533478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7c7972a20 0x55f7c797e6c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f48a0010b90 tx=0x7f48a0010bc0 comp rx=0 tx=0).stop 2024-05-08T05:50:27.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.391+0000 7f48bebf4b80 1 -- 172.21.15.82:0/115533478 shutdown_connections 2024-05-08T05:50:27.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.391+0000 7f48bebf4b80 1 --2- 172.21.15.82:0/115533478 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7c79772c0 0x55f7c797bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:27.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.391+0000 7f48bebf4b80 1 --2- 172.21.15.82:0/115533478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7c7972a20 0x55f7c797e6c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:27.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.391+0000 7f48bebf4b80 1 --2- 172.21.15.82:0/115533478 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55f7c798c1b0 0x55f7c798e5a0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:27.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.391+0000 7f48bebf4b80 1 --2- 172.21.15.82:0/115533478 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f7c7973340 0x55f7c797ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:27.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.391+0000 7f48bebf4b80 1 -- 172.21.15.82:0/115533478 >> 172.21.15.82:0/115533478 conn(0x55f7c78e66d0 msgr2=0x55f7c7968c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:50:27.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.391+0000 7f4893400700 0 client.15102 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:50:27.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.391+0000 7f48bebf4b80 1 -- 172.21.15.82:0/115533478 shutdown_connections 2024-05-08T05:50:27.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.392+0000 7f48bebf4b80 1 -- 172.21.15.82:0/115533478 wait complete. 2024-05-08T05:50:27.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.392+0000 7f48bebf4b80 20 client.15102 trim_cache size 0 max 16384 2024-05-08T05:50:27.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.413+0000 7f48bebf4b80 1 Processor -- start 2024-05-08T05:50:27.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.413+0000 7f48bebf4b80 1 -- start start 2024-05-08T05:50:27.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.414+0000 7f48bebf4b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f7c7972a20 0x55f7c79885d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:27.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.414+0000 7f48bebf4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7c7973340 0x55f7c79630e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:27.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.414+0000 7f48bebf4b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7c79772c0 0x55f7c797d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:27.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.414+0000 7f48bebf4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f48ac1ab800 con 0x55f7c7973340 2024-05-08T05:50:27.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.414+0000 7f48bebf4b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f48ac1ad340 con 0x55f7c7972a20 2024-05-08T05:50:27.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.414+0000 7f48bebf4b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f48ac1abed0 con 0x55f7c79772c0 2024-05-08T05:50:27.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.414+0000 7f48b1800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f7c7972a20 0x55f7c79885d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:27.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.414+0000 7f48b0e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7c7973340 0x55f7c79630e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:27.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.414+0000 7f48b1800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f7c7972a20 0x55f7c79885d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:46354/0 (socket says 172.21.15.82:46354) 2024-05-08T05:50:27.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.414+0000 7f48b1800700 1 -- 172.21.15.82:0/2914762674 learned_addr learned my addr 172.21.15.82:0/2914762674 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:50:27.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.415+0000 7f48b2200700 1 --2- 172.21.15.82:0/2914762674 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7c79772c0 0x55f7c797d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:27.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.415+0000 7f48b1800700 1 -- 172.21.15.82:0/2914762674 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7c79772c0 msgr2=0x55f7c797d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:50:27.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.415+0000 7f48b1800700 1 --2- 172.21.15.82:0/2914762674 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7c79772c0 0x55f7c797d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:27.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.415+0000 7f48b1800700 1 -- 172.21.15.82:0/2914762674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7c7973340 msgr2=0x55f7c79630e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:50:27.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.415+0000 7f48b1800700 1 --2- 172.21.15.82:0/2914762674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7c7973340 0x55f7c79630e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:27.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.415+0000 7f48b1800700 1 -- 172.21.15.82:0/2914762674 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7c79658a0 con 0x55f7c7972a20 2024-05-08T05:50:27.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.415+0000 7f48b1800700 1 --2- 172.21.15.82:0/2914762674 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f7c7972a20 0x55f7c79885d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f48a0004bd0 tx=0x7f48a0005990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=577f51b6719f629a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:50:27.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.415+0000 7f489e000700 1 -- 172.21.15.82:0/2914762674 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a0026030 con 0x55f7c7972a20 2024-05-08T05:50:27.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.415+0000 7f489e000700 1 -- 172.21.15.82:0/2914762674 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f48a001a430 con 0x55f7c7972a20 2024-05-08T05:50:27.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.415+0000 7f489e000700 1 -- 172.21.15.82:0/2914762674 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a0010c30 con 0x55f7c7972a20 2024-05-08T05:50:27.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.416+0000 7f48bebf4b80 1 -- 172.21.15.82:0/2914762674 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f7c7972a20 msgr2=0x55f7c79885d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:27.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.416+0000 7f48bebf4b80 1 --2- 172.21.15.82:0/2914762674 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f7c7972a20 0x55f7c79885d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f48a0004bd0 tx=0x7f48a0005990 comp rx=0 tx=0).stop 2024-05-08T05:50:27.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.416+0000 7f48bebf4b80 1 -- 172.21.15.82:0/2914762674 shutdown_connections 2024-05-08T05:50:27.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.416+0000 7f48bebf4b80 1 --2- 172.21.15.82:0/2914762674 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f7c7972a20 0x55f7c79885d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:27.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.416+0000 7f48bebf4b80 1 --2- 172.21.15.82:0/2914762674 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7c79772c0 0x55f7c797d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:27.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.416+0000 7f48bebf4b80 1 --2- 172.21.15.82:0/2914762674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7c7973340 0x55f7c79630e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:27.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.416+0000 7f48bebf4b80 1 -- 172.21.15.82:0/2914762674 >> 172.21.15.82:0/2914762674 conn(0x55f7c78e66d0 msgr2=0x55f7c797d110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:50:27.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.416+0000 7f48bebf4b80 1 -- 172.21.15.82:0/2914762674 shutdown_connections 2024-05-08T05:50:27.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.416+0000 7f48bebf4b80 1 -- 172.21.15.82:0/2914762674 wait complete. 2024-05-08T05:50:27.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.417+0000 7f48bebf4b80 1 -- start start 2024-05-08T05:50:27.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.417+0000 7f48bebf4b80 1 Processor -- start 2024-05-08T05:50:27.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.418+0000 7f48bebf4b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7c7972a20 0x55f7c7984950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:27.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.418+0000 7f48bebf4b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f7c7973340 0x55f7c7984e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:27.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.418+0000 7f48bebf4b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7c79772c0 0x55f7c7981920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:27.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.418+0000 7f48bebf4b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f48ac1acc70 con 0x55f7c7972a20 2024-05-08T05:50:27.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.418+0000 7f48bebf4b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f48ac1ac5a0 con 0x55f7c7973340 2024-05-08T05:50:27.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.418+0000 7f48bebf4b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f48ac1a97a0 con 0x55f7c79772c0 2024-05-08T05:50:27.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.418+0000 7f48bebf4b80 10 client.0 _ll_register_callbacks cb 0x55f7c798eac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:50:27.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.418+0000 7f48b1800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7c7972a20 0x55f7c7984950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:27.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.418+0000 7f48b1800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7c7972a20 0x55f7c7984950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40112/0 (socket says 172.21.15.82:40112) 2024-05-08T05:50:27.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.418+0000 7f48b1800700 1 -- 172.21.15.82:0/1016946737 learned_addr learned my addr 172.21.15.82:0/1016946737 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:50:27.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.418+0000 7f48b0e00700 1 --2- 172.21.15.82:0/1016946737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f7c7973340 0x55f7c7984e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:27.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.419+0000 7f48b1800700 1 -- 172.21.15.82:0/1016946737 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7c79772c0 msgr2=0x55f7c7981920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:50:27.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.419+0000 7f48b2200700 1 --2- 172.21.15.82:0/1016946737 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7c79772c0 0x55f7c7981920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:27.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.419+0000 7f48b1800700 1 --2- 172.21.15.82:0/1016946737 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7c79772c0 0x55f7c7981920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:27.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.419+0000 7f48b1800700 1 -- 172.21.15.82:0/1016946737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f7c7973340 msgr2=0x55f7c7984e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:50:27.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.419+0000 7f48b1800700 1 --2- 172.21.15.82:0/1016946737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f7c7973340 0x55f7c7984e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:27.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.419+0000 7f48b1800700 1 -- 172.21.15.82:0/1016946737 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7c7981ee0 con 0x55f7c7972a20 2024-05-08T05:50:27.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.419+0000 7f48b0e00700 1 --2- 172.21.15.82:0/1016946737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f7c7973340 0x55f7c7984e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:50:27.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.419+0000 7f48b1800700 1 --2- 172.21.15.82:0/1016946737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7c7972a20 0x55f7c7984950 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f48a0010720 tx=0x7f48a0011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=328a7e887ac92419 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:50:27.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.419+0000 7f4893400700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T05:50:27.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.419+0000 7f4893400700 1 -- 172.21.15.82:0/1016946737 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48a0011850 con 0x55f7c7972a20 2024-05-08T05:50:27.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.419+0000 7f4893400700 1 -- 172.21.15.82:0/1016946737 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f48a0010b10 con 0x55f7c7972a20 2024-05-08T05:50:27.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.419+0000 7f48bebf4b80 1 -- 172.21.15.82:0/1016946737 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48a001a430 con 0x55f7c7972a20 2024-05-08T05:50:27.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.420+0000 7f4893400700 1 -- 172.21.15.82:0/1016946737 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f48a0010d10 con 0x55f7c7972a20 2024-05-08T05:50:27.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.420+0000 7f48bebf4b80 10 client.15108 fetch_fsmap learned FSMap version 29 2024-05-08T05:50:27.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.420+0000 7f48bebf4b80 1 -- 172.21.15.82:0/1016946737 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f7c79f7020 con 0x55f7c7972a20 2024-05-08T05:50:27.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.420+0000 7f4893400700 1 -- 172.21.15.82:0/1016946737 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f48a001a430 con 0x55f7c7972a20 2024-05-08T05:50:27.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.420+0000 7f4893400700 1 -- 172.21.15.82:0/1016946737 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f48a003f060 con 0x55f7c7972a20 2024-05-08T05:50:27.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.420+0000 7f48bebf4b80 10 client.15108 fetch_fsmap finished waiting for FSMap version 29 2024-05-08T05:50:27.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.420+0000 7f48bebf4b80 10 client.15108 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:50:27.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.420+0000 7f48bebf4b80 20 client.15108 populate_metadata read hostname 'smithi082' 2024-05-08T05:50:27.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.420+0000 7f48bebf4b80 1 --2- 172.21.15.82:0/1016946737 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55f7c79f7480 0x55f7c79f9870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:50:27.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.420+0000 7f48bebf4b80 4 client.15108 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-08T05:50:27.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.420+0000 7f48bebf4b80 1 -- 172.21.15.82:0/1016946737 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f7c78ce400 con 0x55f7c79f7480 2024-05-08T05:50:27.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.421+0000 7f48b0e00700 1 --2- 172.21.15.82:0/1016946737 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55f7c79f7480 0x55f7c79f9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:50:27.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.421+0000 7f48b0e00700 1 --2- 172.21.15.82:0/1016946737 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55f7c79f7480 0x55f7c79f9870 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a89fec26941daa8 server_cookie=7d518602f1260ea8 in_seq=0 out_seq=0 2024-05-08T05:50:27.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.421+0000 7f4893400700 10 client.15108 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:50:27.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.422+0000 7f4893400700 1 -- 172.21.15.82:0/1016946737 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55f7c78ce400 con 0x55f7c79f7480 2024-05-08T05:50:27.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.422+0000 7f4893400700 10 client.15108 handle_command_reply: tid=0 2024-05-08T05:50:27.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.422+0000 7f48bebf4b80 1 client.15108 shutdown 2024-05-08T05:50:27.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.422+0000 7f48bebf4b80 1 -- 172.21.15.82:0/1016946737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7c7972a20 msgr2=0x55f7c7984950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:27.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.422+0000 7f48bebf4b80 1 --2- 172.21.15.82:0/1016946737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7c7972a20 0x55f7c7984950 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f48a0010720 tx=0x7f48a0011e70 comp rx=0 tx=0).stop 2024-05-08T05:50:27.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.422+0000 7f48bebf4b80 1 -- 172.21.15.82:0/1016946737 shutdown_connections 2024-05-08T05:50:27.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.422+0000 7f48bebf4b80 1 --2- 172.21.15.82:0/1016946737 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7c79772c0 0x55f7c7981920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:27.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.422+0000 7f48bebf4b80 1 --2- 172.21.15.82:0/1016946737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f7c7972a20 0x55f7c7984950 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:27.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.422+0000 7f48bebf4b80 1 --2- 172.21.15.82:0/1016946737 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55f7c79f7480 0x55f7c79f9870 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:27.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.422+0000 7f48bebf4b80 1 --2- 172.21.15.82:0/1016946737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f7c7973340 0x55f7c7984e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:27.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.422+0000 7f48bebf4b80 1 -- 172.21.15.82:0/1016946737 >> 172.21.15.82:0/1016946737 conn(0x55f7c78e66d0 msgr2=0x55f7c797a860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:50:27.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.422+0000 7f4893400700 0 client.15108 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:50:27.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.422+0000 7f48bebf4b80 1 -- 172.21.15.82:0/1016946737 shutdown_connections 2024-05-08T05:50:27.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.422+0000 7f48bebf4b80 1 -- 172.21.15.82:0/1016946737 wait complete. 2024-05-08T05:50:27.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.422+0000 7f48bebf4b80 20 client.15108 trim_cache size 0 max 16384 2024-05-08T05:50:27.427 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T05:50:27.427 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-08T05:50:27.427 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2024-05-08T05:50:27.427 INFO:teuthology.orchestra.run.smithi082.stdout: "fdc32259-e213-4c52-9ccf-7afecc474e96": { 2024-05-08T05:50:27.427 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2024-05-08T05:50:27.427 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "fdc32259-e213-4c52-9ccf-7afecc474e96", 2024-05-08T05:50:27.427 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2024-05-08T05:50:27.427 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T05:50:27.427 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T05:50:27.427 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T05:50:27.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.423+0000 7f48b2c00700 1 -- 172.21.15.82:0/693520695 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f48940b2990 msgr2=0x7f48940b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:27.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.423+0000 7f48b2c00700 1 --2- 172.21.15.82:0/693520695 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f48940b2990 0x7f48940b4e50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f48a4009850 tx=0x7f48a4009e20 comp rx=0 tx=0).stop 2024-05-08T05:50:27.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.423+0000 7f48b2c00700 1 -- 172.21.15.82:0/693520695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48ac103fd0 msgr2=0x7f48ac19fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:50:27.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.423+0000 7f48b2c00700 1 --2- 172.21.15.82:0/693520695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48ac103fd0 0x7f48ac19fc00 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f489800e970 tx=0x7f489800ec80 comp rx=0 tx=0).stop 2024-05-08T05:50:27.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.423+0000 7f48b2c00700 1 -- 172.21.15.82:0/693520695 shutdown_connections 2024-05-08T05:50:27.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.423+0000 7f48b2c00700 1 --2- 172.21.15.82:0/693520695 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48ac108700 0x7f48ac199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:27.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.423+0000 7f48b2c00700 1 --2- 172.21.15.82:0/693520695 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f48940b2990 0x7f48940b4e50 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:27.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.423+0000 7f48b2c00700 1 --2- 172.21.15.82:0/693520695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48ac103620 0x7f48ac19f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:27.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.423+0000 7f48b2c00700 1 --2- 172.21.15.82:0/693520695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f48ac103fd0 0x7f48ac19fc00 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:50:27.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.423+0000 7f48b2c00700 1 -- 172.21.15.82:0/693520695 >> 172.21.15.82:0/693520695 conn(0x7f48ac0feeb0 msgr2=0x7f48ac0ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:50:27.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.423+0000 7f48b2c00700 1 -- 172.21.15.82:0/693520695 shutdown_connections 2024-05-08T05:50:27.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:50:27.423+0000 7f48b2c00700 1 -- 172.21.15.82:0/693520695 wait complete. 2024-05-08T05:50:27.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:50:27 smithi082 ceph-mon[30098]: pgmap v453: 97 pgs: 97 active+clean; 5.0 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 377 KiB/s wr, 14 op/s 2024-05-08T05:50:27.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:50:27 smithi134 ceph-mon[34132]: pgmap v453: 97 pgs: 97 active+clean; 5.0 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 377 KiB/s wr, 14 op/s 2024-05-08T05:50:27.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:50:27 smithi151 ceph-mon[34815]: pgmap v453: 97 pgs: 97 active+clean; 5.0 MiB data, 344 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 377 KiB/s wr, 14 op/s 2024-05-08T05:50:28.210 INFO:tasks.cephfs.filesystem:scrub status for tag:fdc32259-e213-4c52-9ccf-7afecc474e96 - {'path': '/', 'tag': 'fdc32259-e213-4c52-9ccf-7afecc474e96', 'options': 'recursive,force'} 2024-05-08T05:50:29.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:50:29 smithi134 ceph-mon[34132]: pgmap v454: 97 pgs: 97 active+clean; 7.2 MiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 567 KiB/s wr, 20 op/s 2024-05-08T05:50:29.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:50:29 smithi151 ceph-mon[34815]: pgmap v454: 97 pgs: 97 active+clean; 7.2 MiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 567 KiB/s wr, 20 op/s 2024-05-08T05:50:29.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:50:29 smithi082 ceph-mon[30098]: pgmap v454: 97 pgs: 97 active+clean; 7.2 MiB data, 346 MiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 567 KiB/s wr, 20 op/s 2024-05-08T05:50:31.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:50:31 smithi134 ceph-mon[34132]: pgmap v455: 97 pgs: 97 active+clean; 23 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 1.9 MiB/s wr, 33 op/s 2024-05-08T05:50:31.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:50:31 smithi151 ceph-mon[34815]: pgmap v455: 97 pgs: 97 active+clean; 23 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 1.9 MiB/s wr, 33 op/s 2024-05-08T05:50:31.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:50:31 smithi082 ceph-mon[30098]: pgmap v455: 97 pgs: 97 active+clean; 23 MiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 1.9 MiB/s wr, 33 op/s 2024-05-08T05:50:33.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:50:33 smithi134 ceph-mon[34132]: pgmap v456: 97 pgs: 97 active+clean; 24 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 2.0 MiB/s wr, 35 op/s 2024-05-08T05:50:33.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:50:33 smithi151 ceph-mon[34815]: pgmap v456: 97 pgs: 97 active+clean; 24 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 2.0 MiB/s wr, 35 op/s 2024-05-08T05:50:33.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:50:33 smithi082 ceph-mon[30098]: pgmap v456: 97 pgs: 97 active+clean; 24 MiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 2.0 MiB/s wr, 35 op/s 2024-05-08T05:50:35.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:50:35 smithi151 ceph-mon[34815]: pgmap v457: 97 pgs: 97 active+clean; 25 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 2.0 MiB/s wr, 34 op/s 2024-05-08T05:50:35.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:50:35 smithi151 ceph-mon[34815]: scrub summary: idle 2024-05-08T05:50:35.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:50:35 smithi082 ceph-mon[30098]: pgmap v457: 97 pgs: 97 active+clean; 25 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 2.0 MiB/s wr, 34 op/s 2024-05-08T05:50:35.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:50:35 smithi082 ceph-mon[30098]: scrub summary: idle 2024-05-08T05:50:36.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:50:35 smithi134 ceph-mon[34132]: pgmap v457: 97 pgs: 97 active+clean; 25 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 2.0 MiB/s wr, 34 op/s 2024-05-08T05:50:36.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:50:35 smithi134 ceph-mon[34132]: scrub summary: idle 2024-05-08T05:50:36.539 INFO:teuthology.orchestra.run.smithi082.stderr: * Initialized, logs are in /var/lib/pgsql/initdb_postgresql.log 2024-05-08T05:50:36.548 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-05-08T05:50:36.675 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/: 2024-05-08T05:50:36.676 INFO:teuthology.orchestra.run.smithi082.stdout:total 0 2024-05-08T05:50:36.676 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 8 05:50 . 2024-05-08T05:50:36.676 INFO:teuthology.orchestra.run.smithi082.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 May 8 05:50 .. 2024-05-08T05:50:36.676 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 8 05:50 data 2024-05-08T05:50:36.676 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:50:36.676 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data: 2024-05-08T05:50:36.676 INFO:teuthology.orchestra.run.smithi082.stdout:total 35 2024-05-08T05:50:36.676 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 8 05:50 . 2024-05-08T05:50:36.676 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 8 05:50 .. 2024-05-08T05:50:36.676 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 8 05:50 base 2024-05-08T05:50:36.676 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 57 May 8 05:50 global 2024-05-08T05:50:36.676 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 log 2024-05-08T05:50:36.676 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 pg_commit_ts 2024-05-08T05:50:36.677 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 pg_dynshmem 2024-05-08T05:50:36.677 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4516 May 8 05:50 pg_hba.conf 2024-05-08T05:50:36.677 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 May 8 05:50 pg_ident.conf 2024-05-08T05:50:36.677 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 8 05:50 pg_logical 2024-05-08T05:50:36.677 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 May 8 05:50 pg_multixact 2024-05-08T05:50:36.677 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 pg_notify 2024-05-08T05:50:36.677 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 pg_replslot 2024-05-08T05:50:36.677 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 pg_serial 2024-05-08T05:50:36.677 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 pg_snapshots 2024-05-08T05:50:36.677 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 pg_stat 2024-05-08T05:50:36.677 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 pg_stat_tmp 2024-05-08T05:50:36.677 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 8 05:50 pg_subtrans 2024-05-08T05:50:36.677 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 pg_tblspc 2024-05-08T05:50:36.677 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 pg_twophase 2024-05-08T05:50:36.678 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 8 05:50 PG_VERSION 2024-05-08T05:50:36.678 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 May 8 05:50 pg_wal 2024-05-08T05:50:36.678 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 8 05:50 pg_xact 2024-05-08T05:50:36.678 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 May 8 05:50 postgresql.auto.conf 2024-05-08T05:50:36.678 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 28082 May 8 05:50 postgresql.conf 2024-05-08T05:50:36.678 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:50:36.678 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/base: 2024-05-08T05:50:36.678 INFO:teuthology.orchestra.run.smithi082.stdout:total 0 2024-05-08T05:50:36.678 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 8 05:50 . 2024-05-08T05:50:36.678 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 8 05:50 .. 2024-05-08T05:50:36.678 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 May 8 05:50 1 2024-05-08T05:50:36.678 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 May 8 05:50 13493 2024-05-08T05:50:36.678 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 May 8 05:50 13494 2024-05-08T05:50:36.679 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:50:36.679 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/base/1: 2024-05-08T05:50:36.679 INFO:teuthology.orchestra.run.smithi082.stdout:total 7777 2024-05-08T05:50:36.679 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 May 8 05:50 . 2024-05-08T05:50:36.679 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 8 05:50 .. 2024-05-08T05:50:36.679 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 112 2024-05-08T05:50:36.679 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 113 2024-05-08T05:50:36.679 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 May 8 05:50 1247 2024-05-08T05:50:36.679 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 1247_fsm 2024-05-08T05:50:36.679 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 1247_vm 2024-05-08T05:50:36.679 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 May 8 05:50 1249 2024-05-08T05:50:36.679 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 1249_fsm 2024-05-08T05:50:36.679 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 1249_vm 2024-05-08T05:50:36.679 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 May 8 05:50 1255 2024-05-08T05:50:36.679 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 1255_fsm 2024-05-08T05:50:36.679 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 1255_vm 2024-05-08T05:50:36.680 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 May 8 05:50 1259 2024-05-08T05:50:36.680 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 1259_fsm 2024-05-08T05:50:36.680 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 1259_vm 2024-05-08T05:50:36.680 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 May 8 05:50 13344 2024-05-08T05:50:36.680 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 13344_fsm 2024-05-08T05:50:36.680 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13344_vm 2024-05-08T05:50:36.680 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 13346 2024-05-08T05:50:36.680 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13348 2024-05-08T05:50:36.680 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13349 2024-05-08T05:50:36.680 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 13349_fsm 2024-05-08T05:50:36.680 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13349_vm 2024-05-08T05:50:36.680 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 13351 2024-05-08T05:50:36.680 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13353 2024-05-08T05:50:36.680 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13354 2024-05-08T05:50:36.680 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 13354_fsm 2024-05-08T05:50:36.681 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13354_vm 2024-05-08T05:50:36.681 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 13356 2024-05-08T05:50:36.681 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13358 2024-05-08T05:50:36.681 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13359 2024-05-08T05:50:36.681 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 13359_fsm 2024-05-08T05:50:36.681 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13359_vm 2024-05-08T05:50:36.681 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 13361 2024-05-08T05:50:36.681 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13363 2024-05-08T05:50:36.681 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 1417 2024-05-08T05:50:36.681 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 1418 2024-05-08T05:50:36.681 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 174 2024-05-08T05:50:36.681 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 175 2024-05-08T05:50:36.681 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2187 2024-05-08T05:50:36.681 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2224 2024-05-08T05:50:36.681 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2328 2024-05-08T05:50:36.682 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2336 2024-05-08T05:50:36.682 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2337 2024-05-08T05:50:36.682 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2579 2024-05-08T05:50:36.682 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2600 2024-05-08T05:50:36.682 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2600_fsm 2024-05-08T05:50:36.682 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2600_vm 2024-05-08T05:50:36.682 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2601 2024-05-08T05:50:36.682 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2601_fsm 2024-05-08T05:50:36.682 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2601_vm 2024-05-08T05:50:36.682 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 8 05:50 2602 2024-05-08T05:50:36.682 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2602_fsm 2024-05-08T05:50:36.682 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2602_vm 2024-05-08T05:50:36.682 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 05:50 2603 2024-05-08T05:50:36.682 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2603_fsm 2024-05-08T05:50:36.682 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2603_vm 2024-05-08T05:50:36.683 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2604 2024-05-08T05:50:36.683 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2605 2024-05-08T05:50:36.683 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2605_fsm 2024-05-08T05:50:36.683 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2605_vm 2024-05-08T05:50:36.683 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2606 2024-05-08T05:50:36.683 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2606_fsm 2024-05-08T05:50:36.683 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2606_vm 2024-05-08T05:50:36.683 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2607 2024-05-08T05:50:36.683 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2607_fsm 2024-05-08T05:50:36.683 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2607_vm 2024-05-08T05:50:36.683 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 May 8 05:50 2608 2024-05-08T05:50:36.683 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2608_fsm 2024-05-08T05:50:36.683 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2608_vm 2024-05-08T05:50:36.683 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 May 8 05:50 2609 2024-05-08T05:50:36.684 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2609_fsm 2024-05-08T05:50:36.684 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2609_vm 2024-05-08T05:50:36.684 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 05:50 2610 2024-05-08T05:50:36.684 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2610_fsm 2024-05-08T05:50:36.684 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2610_vm 2024-05-08T05:50:36.684 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2611 2024-05-08T05:50:36.684 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2612 2024-05-08T05:50:36.684 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2612_fsm 2024-05-08T05:50:36.684 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2612_vm 2024-05-08T05:50:36.684 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2613 2024-05-08T05:50:36.684 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2615 2024-05-08T05:50:36.684 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2615_fsm 2024-05-08T05:50:36.684 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2615_vm 2024-05-08T05:50:36.685 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2616 2024-05-08T05:50:36.685 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2616_fsm 2024-05-08T05:50:36.685 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2616_vm 2024-05-08T05:50:36.685 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 May 8 05:50 2617 2024-05-08T05:50:36.685 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2617_fsm 2024-05-08T05:50:36.685 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2617_vm 2024-05-08T05:50:36.685 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 May 8 05:50 2618 2024-05-08T05:50:36.685 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2618_fsm 2024-05-08T05:50:36.685 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2618_vm 2024-05-08T05:50:36.685 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 May 8 05:50 2619 2024-05-08T05:50:36.685 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2619_fsm 2024-05-08T05:50:36.685 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2619_vm 2024-05-08T05:50:36.685 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2620 2024-05-08T05:50:36.686 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2650 2024-05-08T05:50:36.686 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2651 2024-05-08T05:50:36.686 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2652 2024-05-08T05:50:36.686 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 8 05:50 2653 2024-05-08T05:50:36.686 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 8 05:50 2654 2024-05-08T05:50:36.686 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 05:50 2655 2024-05-08T05:50:36.686 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2656 2024-05-08T05:50:36.686 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2657 2024-05-08T05:50:36.686 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 May 8 05:50 2658 2024-05-08T05:50:36.686 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 May 8 05:50 2659 2024-05-08T05:50:36.686 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2660 2024-05-08T05:50:36.686 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2661 2024-05-08T05:50:36.686 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 05:50 2662 2024-05-08T05:50:36.686 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 8 05:50 2663 2024-05-08T05:50:36.686 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2664 2024-05-08T05:50:36.687 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2665 2024-05-08T05:50:36.687 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2666 2024-05-08T05:50:36.687 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2667 2024-05-08T05:50:36.687 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2668 2024-05-08T05:50:36.687 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2669 2024-05-08T05:50:36.687 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2670 2024-05-08T05:50:36.687 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 May 8 05:50 2673 2024-05-08T05:50:36.687 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 May 8 05:50 2674 2024-05-08T05:50:36.687 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 May 8 05:50 2675 2024-05-08T05:50:36.687 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2678 2024-05-08T05:50:36.687 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2679 2024-05-08T05:50:36.687 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2680 2024-05-08T05:50:36.687 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2681 2024-05-08T05:50:36.687 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2682 2024-05-08T05:50:36.687 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2683 2024-05-08T05:50:36.687 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2684 2024-05-08T05:50:36.688 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2685 2024-05-08T05:50:36.688 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2686 2024-05-08T05:50:36.688 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2687 2024-05-08T05:50:36.688 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 8 05:50 2688 2024-05-08T05:50:36.688 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 8 05:50 2689 2024-05-08T05:50:36.688 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 May 8 05:50 2690 2024-05-08T05:50:36.688 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 May 8 05:50 2691 2024-05-08T05:50:36.688 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2692 2024-05-08T05:50:36.688 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2693 2024-05-08T05:50:36.688 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2696 2024-05-08T05:50:36.688 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2699 2024-05-08T05:50:36.688 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2701 2024-05-08T05:50:36.688 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2702 2024-05-08T05:50:36.689 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 05:50 2703 2024-05-08T05:50:36.689 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 8 05:50 2704 2024-05-08T05:50:36.689 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2753 2024-05-08T05:50:36.689 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2753_fsm 2024-05-08T05:50:36.689 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2753_vm 2024-05-08T05:50:36.689 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2754 2024-05-08T05:50:36.689 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2755 2024-05-08T05:50:36.689 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 05:50 2756 2024-05-08T05:50:36.689 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 05:50 2757 2024-05-08T05:50:36.689 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2830 2024-05-08T05:50:36.689 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2831 2024-05-08T05:50:36.689 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2832 2024-05-08T05:50:36.689 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2833 2024-05-08T05:50:36.689 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2834 2024-05-08T05:50:36.689 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2835 2024-05-08T05:50:36.690 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2836 2024-05-08T05:50:36.690 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2837 2024-05-08T05:50:36.690 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 May 8 05:50 2838 2024-05-08T05:50:36.690 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2838_fsm 2024-05-08T05:50:36.690 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2838_vm 2024-05-08T05:50:36.690 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2839 2024-05-08T05:50:36.690 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2840 2024-05-08T05:50:36.690 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2840_fsm 2024-05-08T05:50:36.690 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2840_vm 2024-05-08T05:50:36.690 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2841 2024-05-08T05:50:36.690 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2995 2024-05-08T05:50:36.690 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2996 2024-05-08T05:50:36.690 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3079 2024-05-08T05:50:36.690 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3079_fsm 2024-05-08T05:50:36.691 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3079_vm 2024-05-08T05:50:36.691 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3080 2024-05-08T05:50:36.691 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3081 2024-05-08T05:50:36.691 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 8 05:50 3085 2024-05-08T05:50:36.691 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3118 2024-05-08T05:50:36.691 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3119 2024-05-08T05:50:36.691 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 May 8 05:50 3164 2024-05-08T05:50:36.691 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3256 2024-05-08T05:50:36.691 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3257 2024-05-08T05:50:36.691 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3258 2024-05-08T05:50:36.691 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3350 2024-05-08T05:50:36.691 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3351 2024-05-08T05:50:36.691 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3379 2024-05-08T05:50:36.691 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3380 2024-05-08T05:50:36.692 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3381 2024-05-08T05:50:36.692 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3394 2024-05-08T05:50:36.692 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3394_fsm 2024-05-08T05:50:36.692 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3394_vm 2024-05-08T05:50:36.692 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3395 2024-05-08T05:50:36.692 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3429 2024-05-08T05:50:36.692 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3430 2024-05-08T05:50:36.692 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3431 2024-05-08T05:50:36.692 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3433 2024-05-08T05:50:36.692 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3439 2024-05-08T05:50:36.692 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3440 2024-05-08T05:50:36.692 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 8 05:50 3455 2024-05-08T05:50:36.692 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 May 8 05:50 3456 2024-05-08T05:50:36.692 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3456_fsm 2024-05-08T05:50:36.693 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3456_vm 2024-05-08T05:50:36.693 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3466 2024-05-08T05:50:36.693 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3467 2024-05-08T05:50:36.693 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3468 2024-05-08T05:50:36.693 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3501 2024-05-08T05:50:36.693 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3502 2024-05-08T05:50:36.693 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3503 2024-05-08T05:50:36.693 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3534 2024-05-08T05:50:36.693 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3541 2024-05-08T05:50:36.693 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3541_fsm 2024-05-08T05:50:36.693 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3541_vm 2024-05-08T05:50:36.693 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3542 2024-05-08T05:50:36.693 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3574 2024-05-08T05:50:36.694 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3575 2024-05-08T05:50:36.694 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3576 2024-05-08T05:50:36.694 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3596 2024-05-08T05:50:36.694 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3597 2024-05-08T05:50:36.694 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3598 2024-05-08T05:50:36.694 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3599 2024-05-08T05:50:36.694 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3600 2024-05-08T05:50:36.694 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3600_fsm 2024-05-08T05:50:36.694 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3600_vm 2024-05-08T05:50:36.694 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3601 2024-05-08T05:50:36.694 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3601_fsm 2024-05-08T05:50:36.694 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3601_vm 2024-05-08T05:50:36.694 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3602 2024-05-08T05:50:36.695 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3602_fsm 2024-05-08T05:50:36.695 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3602_vm 2024-05-08T05:50:36.695 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3603 2024-05-08T05:50:36.695 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3603_fsm 2024-05-08T05:50:36.695 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3603_vm 2024-05-08T05:50:36.695 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3604 2024-05-08T05:50:36.695 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3605 2024-05-08T05:50:36.695 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3606 2024-05-08T05:50:36.695 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3607 2024-05-08T05:50:36.695 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3608 2024-05-08T05:50:36.695 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 05:50 3609 2024-05-08T05:50:36.695 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3712 2024-05-08T05:50:36.695 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3764 2024-05-08T05:50:36.695 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3764_fsm 2024-05-08T05:50:36.696 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3764_vm 2024-05-08T05:50:36.696 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3766 2024-05-08T05:50:36.696 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3767 2024-05-08T05:50:36.696 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3997 2024-05-08T05:50:36.696 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4143 2024-05-08T05:50:36.696 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4144 2024-05-08T05:50:36.696 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4145 2024-05-08T05:50:36.696 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4146 2024-05-08T05:50:36.696 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4147 2024-05-08T05:50:36.696 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4148 2024-05-08T05:50:36.696 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4149 2024-05-08T05:50:36.696 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4150 2024-05-08T05:50:36.696 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4151 2024-05-08T05:50:36.697 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4152 2024-05-08T05:50:36.697 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4153 2024-05-08T05:50:36.697 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4154 2024-05-08T05:50:36.697 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4155 2024-05-08T05:50:36.697 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4156 2024-05-08T05:50:36.697 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4157 2024-05-08T05:50:36.697 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4158 2024-05-08T05:50:36.697 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4159 2024-05-08T05:50:36.697 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4160 2024-05-08T05:50:36.697 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4161 2024-05-08T05:50:36.697 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4162 2024-05-08T05:50:36.697 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4163 2024-05-08T05:50:36.697 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4164 2024-05-08T05:50:36.697 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4165 2024-05-08T05:50:36.698 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4166 2024-05-08T05:50:36.698 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4167 2024-05-08T05:50:36.698 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4168 2024-05-08T05:50:36.698 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4169 2024-05-08T05:50:36.699 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4170 2024-05-08T05:50:36.699 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4171 2024-05-08T05:50:36.699 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4172 2024-05-08T05:50:36.699 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4173 2024-05-08T05:50:36.699 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4174 2024-05-08T05:50:36.699 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 5002 2024-05-08T05:50:36.699 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 548 2024-05-08T05:50:36.699 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 549 2024-05-08T05:50:36.699 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 6102 2024-05-08T05:50:36.699 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 6104 2024-05-08T05:50:36.699 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 6106 2024-05-08T05:50:36.699 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 6110 2024-05-08T05:50:36.699 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 6111 2024-05-08T05:50:36.699 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 6112 2024-05-08T05:50:36.699 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 6113 2024-05-08T05:50:36.700 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 6117 2024-05-08T05:50:36.700 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 826 2024-05-08T05:50:36.700 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 827 2024-05-08T05:50:36.700 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 828 2024-05-08T05:50:36.700 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 May 8 05:50 pg_filenode.map 2024-05-08T05:50:36.700 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 8 05:50 PG_VERSION 2024-05-08T05:50:36.700 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:50:36.700 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/base/13493: 2024-05-08T05:50:36.700 INFO:teuthology.orchestra.run.smithi082.stdout:total 7777 2024-05-08T05:50:36.700 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 May 8 05:50 . 2024-05-08T05:50:36.700 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 8 05:50 .. 2024-05-08T05:50:36.700 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 112 2024-05-08T05:50:36.700 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 113 2024-05-08T05:50:36.700 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 May 8 05:50 1247 2024-05-08T05:50:36.700 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 1247_fsm 2024-05-08T05:50:36.700 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 1247_vm 2024-05-08T05:50:36.701 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 May 8 05:50 1249 2024-05-08T05:50:36.701 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 1249_fsm 2024-05-08T05:50:36.701 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 1249_vm 2024-05-08T05:50:36.701 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 May 8 05:50 1255 2024-05-08T05:50:36.701 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 1255_fsm 2024-05-08T05:50:36.701 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 1255_vm 2024-05-08T05:50:36.701 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 May 8 05:50 1259 2024-05-08T05:50:36.701 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 1259_fsm 2024-05-08T05:50:36.701 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 1259_vm 2024-05-08T05:50:36.701 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 May 8 05:50 13344 2024-05-08T05:50:36.701 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 13344_fsm 2024-05-08T05:50:36.701 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13344_vm 2024-05-08T05:50:36.701 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 13346 2024-05-08T05:50:36.701 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13348 2024-05-08T05:50:36.702 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13349 2024-05-08T05:50:36.702 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 13349_fsm 2024-05-08T05:50:36.702 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13349_vm 2024-05-08T05:50:36.702 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 13351 2024-05-08T05:50:36.702 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13353 2024-05-08T05:50:36.702 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13354 2024-05-08T05:50:36.702 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 13354_fsm 2024-05-08T05:50:36.702 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13354_vm 2024-05-08T05:50:36.702 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 13356 2024-05-08T05:50:36.702 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13358 2024-05-08T05:50:36.702 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13359 2024-05-08T05:50:36.702 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 13359_fsm 2024-05-08T05:50:36.702 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13359_vm 2024-05-08T05:50:36.702 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 13361 2024-05-08T05:50:36.703 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13363 2024-05-08T05:50:36.703 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 1417 2024-05-08T05:50:36.703 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 1418 2024-05-08T05:50:36.703 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 174 2024-05-08T05:50:36.703 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 175 2024-05-08T05:50:36.703 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2187 2024-05-08T05:50:36.703 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2224 2024-05-08T05:50:36.703 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2328 2024-05-08T05:50:36.703 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2336 2024-05-08T05:50:36.703 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2337 2024-05-08T05:50:36.703 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2579 2024-05-08T05:50:36.703 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2600 2024-05-08T05:50:36.703 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2600_fsm 2024-05-08T05:50:36.703 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2600_vm 2024-05-08T05:50:36.703 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2601 2024-05-08T05:50:36.703 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2601_fsm 2024-05-08T05:50:36.704 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2601_vm 2024-05-08T05:50:36.704 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 8 05:50 2602 2024-05-08T05:50:36.704 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2602_fsm 2024-05-08T05:50:36.704 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2602_vm 2024-05-08T05:50:36.704 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 05:50 2603 2024-05-08T05:50:36.704 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2603_fsm 2024-05-08T05:50:36.704 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2603_vm 2024-05-08T05:50:36.704 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2604 2024-05-08T05:50:36.704 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2605 2024-05-08T05:50:36.704 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2605_fsm 2024-05-08T05:50:36.704 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2605_vm 2024-05-08T05:50:36.704 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2606 2024-05-08T05:50:36.704 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2606_fsm 2024-05-08T05:50:36.704 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2606_vm 2024-05-08T05:50:36.704 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2607 2024-05-08T05:50:36.705 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2607_fsm 2024-05-08T05:50:36.705 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2607_vm 2024-05-08T05:50:36.705 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 May 8 05:50 2608 2024-05-08T05:50:36.705 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2608_fsm 2024-05-08T05:50:36.705 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2608_vm 2024-05-08T05:50:36.705 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 May 8 05:50 2609 2024-05-08T05:50:36.705 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2609_fsm 2024-05-08T05:50:36.705 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2609_vm 2024-05-08T05:50:36.705 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 05:50 2610 2024-05-08T05:50:36.705 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2610_fsm 2024-05-08T05:50:36.705 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2610_vm 2024-05-08T05:50:36.705 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2611 2024-05-08T05:50:36.705 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2612 2024-05-08T05:50:36.705 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2612_fsm 2024-05-08T05:50:36.706 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2612_vm 2024-05-08T05:50:36.706 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2613 2024-05-08T05:50:36.706 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2615 2024-05-08T05:50:36.706 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2615_fsm 2024-05-08T05:50:36.706 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2615_vm 2024-05-08T05:50:36.706 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2616 2024-05-08T05:50:36.706 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2616_fsm 2024-05-08T05:50:36.706 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2616_vm 2024-05-08T05:50:36.706 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 May 8 05:50 2617 2024-05-08T05:50:36.706 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2617_fsm 2024-05-08T05:50:36.706 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2617_vm 2024-05-08T05:50:36.706 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 May 8 05:50 2618 2024-05-08T05:50:36.707 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2618_fsm 2024-05-08T05:50:36.707 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2618_vm 2024-05-08T05:50:36.707 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 May 8 05:50 2619 2024-05-08T05:50:36.707 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2619_fsm 2024-05-08T05:50:36.707 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2619_vm 2024-05-08T05:50:36.707 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2620 2024-05-08T05:50:36.707 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2650 2024-05-08T05:50:36.707 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2651 2024-05-08T05:50:36.707 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2652 2024-05-08T05:50:36.707 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 8 05:50 2653 2024-05-08T05:50:36.707 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 8 05:50 2654 2024-05-08T05:50:36.707 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 05:50 2655 2024-05-08T05:50:36.707 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2656 2024-05-08T05:50:36.707 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2657 2024-05-08T05:50:36.708 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 May 8 05:50 2658 2024-05-08T05:50:36.708 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 May 8 05:50 2659 2024-05-08T05:50:36.708 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2660 2024-05-08T05:50:36.708 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2661 2024-05-08T05:50:36.708 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 05:50 2662 2024-05-08T05:50:36.708 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 8 05:50 2663 2024-05-08T05:50:36.708 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2664 2024-05-08T05:50:36.708 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2665 2024-05-08T05:50:36.708 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2666 2024-05-08T05:50:36.708 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2667 2024-05-08T05:50:36.708 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2668 2024-05-08T05:50:36.708 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2669 2024-05-08T05:50:36.708 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2670 2024-05-08T05:50:36.708 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 May 8 05:50 2673 2024-05-08T05:50:36.708 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 May 8 05:50 2674 2024-05-08T05:50:36.708 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 May 8 05:50 2675 2024-05-08T05:50:36.709 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2678 2024-05-08T05:50:36.709 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2679 2024-05-08T05:50:36.709 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2680 2024-05-08T05:50:36.709 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2681 2024-05-08T05:50:36.709 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2682 2024-05-08T05:50:36.709 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2683 2024-05-08T05:50:36.709 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2684 2024-05-08T05:50:36.709 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2685 2024-05-08T05:50:36.709 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2686 2024-05-08T05:50:36.709 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2687 2024-05-08T05:50:36.709 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 8 05:50 2688 2024-05-08T05:50:36.709 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 8 05:50 2689 2024-05-08T05:50:36.709 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 May 8 05:50 2690 2024-05-08T05:50:36.709 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 May 8 05:50 2691 2024-05-08T05:50:36.709 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2692 2024-05-08T05:50:36.709 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2693 2024-05-08T05:50:36.710 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2696 2024-05-08T05:50:36.710 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2699 2024-05-08T05:50:36.710 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2701 2024-05-08T05:50:36.710 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2702 2024-05-08T05:50:36.710 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 05:50 2703 2024-05-08T05:50:36.710 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 8 05:50 2704 2024-05-08T05:50:36.710 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2753 2024-05-08T05:50:36.710 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2753_fsm 2024-05-08T05:50:36.710 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2753_vm 2024-05-08T05:50:36.710 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2754 2024-05-08T05:50:36.710 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2755 2024-05-08T05:50:36.710 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 05:50 2756 2024-05-08T05:50:36.710 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 05:50 2757 2024-05-08T05:50:36.711 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2830 2024-05-08T05:50:36.711 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2831 2024-05-08T05:50:36.711 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2832 2024-05-08T05:50:36.711 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2833 2024-05-08T05:50:36.711 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2834 2024-05-08T05:50:36.711 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2835 2024-05-08T05:50:36.711 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2836 2024-05-08T05:50:36.711 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2837 2024-05-08T05:50:36.711 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 May 8 05:50 2838 2024-05-08T05:50:36.711 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2838_fsm 2024-05-08T05:50:36.711 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2838_vm 2024-05-08T05:50:36.711 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2839 2024-05-08T05:50:36.711 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2840 2024-05-08T05:50:36.711 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2840_fsm 2024-05-08T05:50:36.712 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2840_vm 2024-05-08T05:50:36.712 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2841 2024-05-08T05:50:36.712 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2995 2024-05-08T05:50:36.712 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2996 2024-05-08T05:50:36.712 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3079 2024-05-08T05:50:36.712 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3079_fsm 2024-05-08T05:50:36.712 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3079_vm 2024-05-08T05:50:36.712 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3080 2024-05-08T05:50:36.712 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3081 2024-05-08T05:50:36.712 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 8 05:50 3085 2024-05-08T05:50:36.712 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3118 2024-05-08T05:50:36.712 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3119 2024-05-08T05:50:36.712 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 May 8 05:50 3164 2024-05-08T05:50:36.712 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3256 2024-05-08T05:50:36.713 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3257 2024-05-08T05:50:36.713 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3258 2024-05-08T05:50:36.713 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3350 2024-05-08T05:50:36.713 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3351 2024-05-08T05:50:36.713 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3379 2024-05-08T05:50:36.713 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3380 2024-05-08T05:50:36.713 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3381 2024-05-08T05:50:36.713 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3394 2024-05-08T05:50:36.713 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3394_fsm 2024-05-08T05:50:36.713 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3394_vm 2024-05-08T05:50:36.713 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3395 2024-05-08T05:50:36.713 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3429 2024-05-08T05:50:36.713 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3430 2024-05-08T05:50:36.714 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3431 2024-05-08T05:50:36.714 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3433 2024-05-08T05:50:36.714 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3439 2024-05-08T05:50:36.714 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3440 2024-05-08T05:50:36.714 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 8 05:50 3455 2024-05-08T05:50:36.714 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 May 8 05:50 3456 2024-05-08T05:50:36.714 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3456_fsm 2024-05-08T05:50:36.714 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3456_vm 2024-05-08T05:50:36.714 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3466 2024-05-08T05:50:36.714 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3467 2024-05-08T05:50:36.714 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3468 2024-05-08T05:50:36.714 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3501 2024-05-08T05:50:36.714 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3502 2024-05-08T05:50:36.715 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3503 2024-05-08T05:50:36.715 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3534 2024-05-08T05:50:36.715 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3541 2024-05-08T05:50:36.715 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3541_fsm 2024-05-08T05:50:36.715 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3541_vm 2024-05-08T05:50:36.715 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3542 2024-05-08T05:50:36.715 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3574 2024-05-08T05:50:36.715 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3575 2024-05-08T05:50:36.715 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3576 2024-05-08T05:50:36.715 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3596 2024-05-08T05:50:36.715 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3597 2024-05-08T05:50:36.715 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3598 2024-05-08T05:50:36.715 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3599 2024-05-08T05:50:36.716 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3600 2024-05-08T05:50:36.716 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3600_fsm 2024-05-08T05:50:36.716 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3600_vm 2024-05-08T05:50:36.716 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3601 2024-05-08T05:50:36.716 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3601_fsm 2024-05-08T05:50:36.716 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3601_vm 2024-05-08T05:50:36.716 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3602 2024-05-08T05:50:36.716 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3602_fsm 2024-05-08T05:50:36.716 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3602_vm 2024-05-08T05:50:36.716 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3603 2024-05-08T05:50:36.716 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3603_fsm 2024-05-08T05:50:36.716 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3603_vm 2024-05-08T05:50:36.716 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3604 2024-05-08T05:50:36.716 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3605 2024-05-08T05:50:36.717 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3606 2024-05-08T05:50:36.717 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3607 2024-05-08T05:50:36.717 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3608 2024-05-08T05:50:36.717 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 05:50 3609 2024-05-08T05:50:36.717 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3712 2024-05-08T05:50:36.717 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3764 2024-05-08T05:50:36.717 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3764_fsm 2024-05-08T05:50:36.717 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3764_vm 2024-05-08T05:50:36.717 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3766 2024-05-08T05:50:36.717 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3767 2024-05-08T05:50:36.717 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3997 2024-05-08T05:50:36.717 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4143 2024-05-08T05:50:36.717 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4144 2024-05-08T05:50:36.717 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4145 2024-05-08T05:50:36.717 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4146 2024-05-08T05:50:36.717 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4147 2024-05-08T05:50:36.718 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4148 2024-05-08T05:50:36.718 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4149 2024-05-08T05:50:36.718 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4150 2024-05-08T05:50:36.718 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4151 2024-05-08T05:50:36.718 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4152 2024-05-08T05:50:36.718 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4153 2024-05-08T05:50:36.718 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4154 2024-05-08T05:50:36.718 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4155 2024-05-08T05:50:36.718 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4156 2024-05-08T05:50:36.718 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4157 2024-05-08T05:50:36.718 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4158 2024-05-08T05:50:36.718 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4159 2024-05-08T05:50:36.718 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4160 2024-05-08T05:50:36.718 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4161 2024-05-08T05:50:36.718 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4162 2024-05-08T05:50:36.719 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4163 2024-05-08T05:50:36.719 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4164 2024-05-08T05:50:36.719 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4165 2024-05-08T05:50:36.719 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4166 2024-05-08T05:50:36.719 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4167 2024-05-08T05:50:36.719 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4168 2024-05-08T05:50:36.719 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4169 2024-05-08T05:50:36.719 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4170 2024-05-08T05:50:36.719 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4171 2024-05-08T05:50:36.719 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4172 2024-05-08T05:50:36.719 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4173 2024-05-08T05:50:36.719 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4174 2024-05-08T05:50:36.719 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 5002 2024-05-08T05:50:36.719 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 548 2024-05-08T05:50:36.721 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 549 2024-05-08T05:50:36.721 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 6102 2024-05-08T05:50:36.721 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 6104 2024-05-08T05:50:36.721 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 6106 2024-05-08T05:50:36.721 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 6110 2024-05-08T05:50:36.722 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 6111 2024-05-08T05:50:36.722 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 6112 2024-05-08T05:50:36.722 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 6113 2024-05-08T05:50:36.722 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 6117 2024-05-08T05:50:36.722 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 826 2024-05-08T05:50:36.722 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 827 2024-05-08T05:50:36.722 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 828 2024-05-08T05:50:36.722 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 May 8 05:50 pg_filenode.map 2024-05-08T05:50:36.722 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 8 05:50 PG_VERSION 2024-05-08T05:50:36.722 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:50:36.722 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/base/13494: 2024-05-08T05:50:36.722 INFO:teuthology.orchestra.run.smithi082.stdout:total 7777 2024-05-08T05:50:36.722 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 May 8 05:50 . 2024-05-08T05:50:36.722 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 8 05:50 .. 2024-05-08T05:50:36.723 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 112 2024-05-08T05:50:36.723 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 113 2024-05-08T05:50:36.723 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 May 8 05:50 1247 2024-05-08T05:50:36.723 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 1247_fsm 2024-05-08T05:50:36.723 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 1247_vm 2024-05-08T05:50:36.723 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 May 8 05:50 1249 2024-05-08T05:50:36.723 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 1249_fsm 2024-05-08T05:50:36.723 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 1249_vm 2024-05-08T05:50:36.723 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 May 8 05:50 1255 2024-05-08T05:50:36.723 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 1255_fsm 2024-05-08T05:50:36.723 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 1255_vm 2024-05-08T05:50:36.723 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 May 8 05:50 1259 2024-05-08T05:50:36.723 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 1259_fsm 2024-05-08T05:50:36.723 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 1259_vm 2024-05-08T05:50:36.723 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 May 8 05:50 13344 2024-05-08T05:50:36.723 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 13344_fsm 2024-05-08T05:50:36.724 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13344_vm 2024-05-08T05:50:36.724 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 13346 2024-05-08T05:50:36.724 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13348 2024-05-08T05:50:36.724 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13349 2024-05-08T05:50:36.724 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 13349_fsm 2024-05-08T05:50:36.724 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13349_vm 2024-05-08T05:50:36.724 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 13351 2024-05-08T05:50:36.724 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13353 2024-05-08T05:50:36.724 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13354 2024-05-08T05:50:36.724 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 13354_fsm 2024-05-08T05:50:36.724 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13354_vm 2024-05-08T05:50:36.724 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 13356 2024-05-08T05:50:36.724 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13358 2024-05-08T05:50:36.724 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13359 2024-05-08T05:50:36.725 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 13359_fsm 2024-05-08T05:50:36.725 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13359_vm 2024-05-08T05:50:36.725 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 13361 2024-05-08T05:50:36.725 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13363 2024-05-08T05:50:36.725 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 1417 2024-05-08T05:50:36.725 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 1418 2024-05-08T05:50:36.725 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 174 2024-05-08T05:50:36.725 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 175 2024-05-08T05:50:36.725 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2187 2024-05-08T05:50:36.725 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2224 2024-05-08T05:50:36.725 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2328 2024-05-08T05:50:36.725 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2336 2024-05-08T05:50:36.725 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2337 2024-05-08T05:50:36.725 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2579 2024-05-08T05:50:36.725 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2600 2024-05-08T05:50:36.726 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2600_fsm 2024-05-08T05:50:36.726 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2600_vm 2024-05-08T05:50:36.726 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2601 2024-05-08T05:50:36.726 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2601_fsm 2024-05-08T05:50:36.726 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2601_vm 2024-05-08T05:50:36.726 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 8 05:50 2602 2024-05-08T05:50:36.726 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2602_fsm 2024-05-08T05:50:36.726 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2602_vm 2024-05-08T05:50:36.726 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 05:50 2603 2024-05-08T05:50:36.726 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2603_fsm 2024-05-08T05:50:36.726 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2603_vm 2024-05-08T05:50:36.726 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2604 2024-05-08T05:50:36.726 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2605 2024-05-08T05:50:36.726 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2605_fsm 2024-05-08T05:50:36.727 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2605_vm 2024-05-08T05:50:36.727 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2606 2024-05-08T05:50:36.727 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2606_fsm 2024-05-08T05:50:36.727 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2606_vm 2024-05-08T05:50:36.727 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2607 2024-05-08T05:50:36.727 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2607_fsm 2024-05-08T05:50:36.727 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2607_vm 2024-05-08T05:50:36.727 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 May 8 05:50 2608 2024-05-08T05:50:36.727 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2608_fsm 2024-05-08T05:50:36.727 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2608_vm 2024-05-08T05:50:36.727 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 May 8 05:50 2609 2024-05-08T05:50:36.727 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2609_fsm 2024-05-08T05:50:36.727 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2609_vm 2024-05-08T05:50:36.727 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 05:50 2610 2024-05-08T05:50:36.728 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2610_fsm 2024-05-08T05:50:36.728 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2610_vm 2024-05-08T05:50:36.728 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2611 2024-05-08T05:50:36.728 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2612 2024-05-08T05:50:36.728 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2612_fsm 2024-05-08T05:50:36.728 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2612_vm 2024-05-08T05:50:36.728 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2613 2024-05-08T05:50:36.728 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2615 2024-05-08T05:50:36.728 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2615_fsm 2024-05-08T05:50:36.728 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2615_vm 2024-05-08T05:50:36.728 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2616 2024-05-08T05:50:36.728 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2616_fsm 2024-05-08T05:50:36.728 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2616_vm 2024-05-08T05:50:36.728 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 May 8 05:50 2617 2024-05-08T05:50:36.729 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2617_fsm 2024-05-08T05:50:36.729 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2617_vm 2024-05-08T05:50:36.729 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 May 8 05:50 2618 2024-05-08T05:50:36.729 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2618_fsm 2024-05-08T05:50:36.729 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2618_vm 2024-05-08T05:50:36.729 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 May 8 05:50 2619 2024-05-08T05:50:36.729 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2619_fsm 2024-05-08T05:50:36.729 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2619_vm 2024-05-08T05:50:36.729 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2620 2024-05-08T05:50:36.729 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2650 2024-05-08T05:50:36.729 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2651 2024-05-08T05:50:36.729 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2652 2024-05-08T05:50:36.729 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 8 05:50 2653 2024-05-08T05:50:36.729 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 8 05:50 2654 2024-05-08T05:50:36.729 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 05:50 2655 2024-05-08T05:50:36.730 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2656 2024-05-08T05:50:36.730 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2657 2024-05-08T05:50:36.730 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 May 8 05:50 2658 2024-05-08T05:50:36.730 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 May 8 05:50 2659 2024-05-08T05:50:36.730 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2660 2024-05-08T05:50:36.730 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2661 2024-05-08T05:50:36.730 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 05:50 2662 2024-05-08T05:50:36.730 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 8 05:50 2663 2024-05-08T05:50:36.730 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2664 2024-05-08T05:50:36.730 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2665 2024-05-08T05:50:36.730 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2666 2024-05-08T05:50:36.730 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2667 2024-05-08T05:50:36.730 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2668 2024-05-08T05:50:36.730 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2669 2024-05-08T05:50:36.731 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2670 2024-05-08T05:50:36.731 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 May 8 05:50 2673 2024-05-08T05:50:36.731 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 May 8 05:50 2674 2024-05-08T05:50:36.731 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 May 8 05:50 2675 2024-05-08T05:50:36.731 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2678 2024-05-08T05:50:36.731 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2679 2024-05-08T05:50:36.731 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2680 2024-05-08T05:50:36.731 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2681 2024-05-08T05:50:36.731 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2682 2024-05-08T05:50:36.731 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2683 2024-05-08T05:50:36.731 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2684 2024-05-08T05:50:36.731 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2685 2024-05-08T05:50:36.731 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2686 2024-05-08T05:50:36.731 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2687 2024-05-08T05:50:36.731 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 8 05:50 2688 2024-05-08T05:50:36.732 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 8 05:50 2689 2024-05-08T05:50:36.732 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 May 8 05:50 2690 2024-05-08T05:50:36.732 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 May 8 05:50 2691 2024-05-08T05:50:36.732 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2692 2024-05-08T05:50:36.732 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2693 2024-05-08T05:50:36.732 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2696 2024-05-08T05:50:36.732 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2699 2024-05-08T05:50:36.732 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2701 2024-05-08T05:50:36.732 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2702 2024-05-08T05:50:36.732 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 05:50 2703 2024-05-08T05:50:36.732 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 8 05:50 2704 2024-05-08T05:50:36.732 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2753 2024-05-08T05:50:36.732 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2753_fsm 2024-05-08T05:50:36.732 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2753_vm 2024-05-08T05:50:36.733 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2754 2024-05-08T05:50:36.733 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2755 2024-05-08T05:50:36.733 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 05:50 2756 2024-05-08T05:50:36.733 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 05:50 2757 2024-05-08T05:50:36.733 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2830 2024-05-08T05:50:36.733 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2831 2024-05-08T05:50:36.733 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2832 2024-05-08T05:50:36.733 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2833 2024-05-08T05:50:36.733 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2834 2024-05-08T05:50:36.733 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2835 2024-05-08T05:50:36.733 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2836 2024-05-08T05:50:36.733 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2837 2024-05-08T05:50:36.733 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 May 8 05:50 2838 2024-05-08T05:50:36.734 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2838_fsm 2024-05-08T05:50:36.734 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2838_vm 2024-05-08T05:50:36.734 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2839 2024-05-08T05:50:36.734 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2840 2024-05-08T05:50:36.734 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2840_fsm 2024-05-08T05:50:36.734 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2840_vm 2024-05-08T05:50:36.734 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2841 2024-05-08T05:50:36.734 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2995 2024-05-08T05:50:36.734 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2996 2024-05-08T05:50:36.734 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3079 2024-05-08T05:50:36.734 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3079_fsm 2024-05-08T05:50:36.734 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3079_vm 2024-05-08T05:50:36.734 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3080 2024-05-08T05:50:36.734 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3081 2024-05-08T05:50:36.735 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 8 05:50 3085 2024-05-08T05:50:36.735 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3118 2024-05-08T05:50:36.735 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3119 2024-05-08T05:50:36.735 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 May 8 05:50 3164 2024-05-08T05:50:36.735 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3256 2024-05-08T05:50:36.735 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3257 2024-05-08T05:50:36.735 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3258 2024-05-08T05:50:36.735 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3350 2024-05-08T05:50:36.735 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3351 2024-05-08T05:50:36.735 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3379 2024-05-08T05:50:36.735 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3380 2024-05-08T05:50:36.735 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3381 2024-05-08T05:50:36.735 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3394 2024-05-08T05:50:36.735 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3394_fsm 2024-05-08T05:50:36.736 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3394_vm 2024-05-08T05:50:36.736 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3395 2024-05-08T05:50:36.736 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3429 2024-05-08T05:50:36.736 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3430 2024-05-08T05:50:36.736 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3431 2024-05-08T05:50:36.736 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3433 2024-05-08T05:50:36.736 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3439 2024-05-08T05:50:36.736 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3440 2024-05-08T05:50:36.736 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 8 05:50 3455 2024-05-08T05:50:36.736 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 May 8 05:50 3456 2024-05-08T05:50:36.736 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3456_fsm 2024-05-08T05:50:36.736 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3456_vm 2024-05-08T05:50:36.736 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3466 2024-05-08T05:50:36.737 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3467 2024-05-08T05:50:36.737 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3468 2024-05-08T05:50:36.737 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3501 2024-05-08T05:50:36.737 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3502 2024-05-08T05:50:36.737 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3503 2024-05-08T05:50:36.737 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3534 2024-05-08T05:50:36.737 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3541 2024-05-08T05:50:36.737 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3541_fsm 2024-05-08T05:50:36.737 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3541_vm 2024-05-08T05:50:36.737 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3542 2024-05-08T05:50:36.737 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3574 2024-05-08T05:50:36.737 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3575 2024-05-08T05:50:36.737 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3576 2024-05-08T05:50:36.737 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3596 2024-05-08T05:50:36.737 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3597 2024-05-08T05:50:36.738 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3598 2024-05-08T05:50:36.738 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3599 2024-05-08T05:50:36.738 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3600 2024-05-08T05:50:36.738 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3600_fsm 2024-05-08T05:50:36.738 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3600_vm 2024-05-08T05:50:36.738 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3601 2024-05-08T05:50:36.738 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3601_fsm 2024-05-08T05:50:36.738 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3601_vm 2024-05-08T05:50:36.738 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3602 2024-05-08T05:50:36.738 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3602_fsm 2024-05-08T05:50:36.738 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3602_vm 2024-05-08T05:50:36.738 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3603 2024-05-08T05:50:36.738 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3603_fsm 2024-05-08T05:50:36.738 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3603_vm 2024-05-08T05:50:36.738 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3604 2024-05-08T05:50:36.739 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3605 2024-05-08T05:50:36.739 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3606 2024-05-08T05:50:36.739 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3607 2024-05-08T05:50:36.739 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3608 2024-05-08T05:50:36.739 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 05:50 3609 2024-05-08T05:50:36.739 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3712 2024-05-08T05:50:36.739 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3764 2024-05-08T05:50:36.739 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3764_fsm 2024-05-08T05:50:36.739 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3764_vm 2024-05-08T05:50:36.739 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3766 2024-05-08T05:50:36.739 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3767 2024-05-08T05:50:36.739 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3997 2024-05-08T05:50:36.739 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4143 2024-05-08T05:50:36.739 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4144 2024-05-08T05:50:36.740 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4145 2024-05-08T05:50:36.740 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4146 2024-05-08T05:50:36.740 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4147 2024-05-08T05:50:36.740 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4148 2024-05-08T05:50:36.740 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4149 2024-05-08T05:50:36.740 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4150 2024-05-08T05:50:36.740 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4151 2024-05-08T05:50:36.740 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4152 2024-05-08T05:50:36.740 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4153 2024-05-08T05:50:36.740 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4154 2024-05-08T05:50:36.740 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4155 2024-05-08T05:50:36.740 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4156 2024-05-08T05:50:36.740 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4157 2024-05-08T05:50:36.741 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4158 2024-05-08T05:50:36.741 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4159 2024-05-08T05:50:36.741 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4160 2024-05-08T05:50:36.741 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4161 2024-05-08T05:50:36.741 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4162 2024-05-08T05:50:36.741 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4163 2024-05-08T05:50:36.741 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4164 2024-05-08T05:50:36.741 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4165 2024-05-08T05:50:36.741 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4166 2024-05-08T05:50:36.741 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4167 2024-05-08T05:50:36.741 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4168 2024-05-08T05:50:36.741 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4169 2024-05-08T05:50:36.741 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4170 2024-05-08T05:50:36.741 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4171 2024-05-08T05:50:36.741 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4172 2024-05-08T05:50:36.742 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4173 2024-05-08T05:50:36.742 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4174 2024-05-08T05:50:36.742 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 5002 2024-05-08T05:50:36.742 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 548 2024-05-08T05:50:36.742 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 549 2024-05-08T05:50:36.742 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 6102 2024-05-08T05:50:36.742 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 6104 2024-05-08T05:50:36.742 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 6106 2024-05-08T05:50:36.742 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 6110 2024-05-08T05:50:36.742 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 6111 2024-05-08T05:50:36.742 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 6112 2024-05-08T05:50:36.742 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 6113 2024-05-08T05:50:36.742 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 6117 2024-05-08T05:50:36.743 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 826 2024-05-08T05:50:36.743 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 827 2024-05-08T05:50:36.743 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 828 2024-05-08T05:50:36.743 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 May 8 05:50 pg_filenode.map 2024-05-08T05:50:36.743 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 8 05:50 PG_VERSION 2024-05-08T05:50:36.743 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:50:36.743 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/global: 2024-05-08T05:50:36.743 INFO:teuthology.orchestra.run.smithi082.stdout:total 537 2024-05-08T05:50:36.743 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 57 May 8 05:50 . 2024-05-08T05:50:36.743 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 8 05:50 .. 2024-05-08T05:50:36.743 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 1213 2024-05-08T05:50:36.743 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 1213_fsm 2024-05-08T05:50:36.743 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 1213_vm 2024-05-08T05:50:36.743 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 1214 2024-05-08T05:50:36.743 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 1214_fsm 2024-05-08T05:50:36.743 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 1214_vm 2024-05-08T05:50:36.744 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 1232 2024-05-08T05:50:36.744 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 1233 2024-05-08T05:50:36.744 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 1260 2024-05-08T05:50:36.744 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 1260_fsm 2024-05-08T05:50:36.744 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 1260_vm 2024-05-08T05:50:36.744 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 1261 2024-05-08T05:50:36.744 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 1261_fsm 2024-05-08T05:50:36.744 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 1261_vm 2024-05-08T05:50:36.744 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 1262 2024-05-08T05:50:36.744 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 1262_fsm 2024-05-08T05:50:36.744 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 1262_vm 2024-05-08T05:50:36.744 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2396 2024-05-08T05:50:36.744 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2396_fsm 2024-05-08T05:50:36.744 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2396_vm 2024-05-08T05:50:36.744 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2397 2024-05-08T05:50:36.744 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2671 2024-05-08T05:50:36.745 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2672 2024-05-08T05:50:36.745 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2676 2024-05-08T05:50:36.745 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2677 2024-05-08T05:50:36.745 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2694 2024-05-08T05:50:36.745 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2695 2024-05-08T05:50:36.745 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2697 2024-05-08T05:50:36.745 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2698 2024-05-08T05:50:36.745 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2846 2024-05-08T05:50:36.745 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2847 2024-05-08T05:50:36.745 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2964 2024-05-08T05:50:36.745 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2965 2024-05-08T05:50:36.745 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2966 2024-05-08T05:50:36.745 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2967 2024-05-08T05:50:36.745 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3592 2024-05-08T05:50:36.745 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3593 2024-05-08T05:50:36.746 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4060 2024-05-08T05:50:36.746 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4061 2024-05-08T05:50:36.746 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4175 2024-05-08T05:50:36.746 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4176 2024-05-08T05:50:36.746 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4177 2024-05-08T05:50:36.746 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4178 2024-05-08T05:50:36.746 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4181 2024-05-08T05:50:36.746 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4182 2024-05-08T05:50:36.746 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4183 2024-05-08T05:50:36.746 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4184 2024-05-08T05:50:36.746 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4185 2024-05-08T05:50:36.746 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4186 2024-05-08T05:50:36.746 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 6000 2024-05-08T05:50:36.746 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 6001 2024-05-08T05:50:36.746 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 6002 2024-05-08T05:50:36.747 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 6100 2024-05-08T05:50:36.747 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 6114 2024-05-08T05:50:36.747 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 6115 2024-05-08T05:50:36.747 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 pg_control 2024-05-08T05:50:36.747 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 May 8 05:50 pg_filenode.map 2024-05-08T05:50:36.747 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:50:36.747 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/log: 2024-05-08T05:50:36.747 INFO:teuthology.orchestra.run.smithi082.stdout:total 0 2024-05-08T05:50:36.747 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 . 2024-05-08T05:50:36.747 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 8 05:50 .. 2024-05-08T05:50:36.747 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:50:36.747 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2024-05-08T05:50:36.747 INFO:teuthology.orchestra.run.smithi082.stdout:total 0 2024-05-08T05:50:36.747 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 . 2024-05-08T05:50:36.747 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 8 05:50 .. 2024-05-08T05:50:36.748 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:50:36.748 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2024-05-08T05:50:36.748 INFO:teuthology.orchestra.run.smithi082.stdout:total 0 2024-05-08T05:50:36.748 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 . 2024-05-08T05:50:36.748 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 8 05:50 .. 2024-05-08T05:50:36.748 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:50:36.748 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_logical: 2024-05-08T05:50:36.748 INFO:teuthology.orchestra.run.smithi082.stdout:total 1 2024-05-08T05:50:36.748 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 8 05:50 . 2024-05-08T05:50:36.748 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 8 05:50 .. 2024-05-08T05:50:36.748 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 mappings 2024-05-08T05:50:36.748 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 May 8 05:50 replorigin_checkpoint 2024-05-08T05:50:36.748 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 snapshots 2024-05-08T05:50:36.748 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:50:36.748 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2024-05-08T05:50:36.749 INFO:teuthology.orchestra.run.smithi082.stdout:total 0 2024-05-08T05:50:36.749 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 . 2024-05-08T05:50:36.749 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 8 05:50 .. 2024-05-08T05:50:36.749 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:50:36.749 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2024-05-08T05:50:36.749 INFO:teuthology.orchestra.run.smithi082.stdout:total 0 2024-05-08T05:50:36.749 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 . 2024-05-08T05:50:36.749 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 8 05:50 .. 2024-05-08T05:50:36.749 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:50:36.749 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2024-05-08T05:50:36.749 INFO:teuthology.orchestra.run.smithi082.stdout:total 0 2024-05-08T05:50:36.749 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 May 8 05:50 . 2024-05-08T05:50:36.749 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 8 05:50 .. 2024-05-08T05:50:36.749 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 8 05:50 members 2024-05-08T05:50:36.749 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 8 05:50 offsets 2024-05-08T05:50:36.749 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:50:36.749 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2024-05-08T05:50:36.750 INFO:teuthology.orchestra.run.smithi082.stdout:total 8 2024-05-08T05:50:36.750 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 8 05:50 . 2024-05-08T05:50:36.750 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 May 8 05:50 .. 2024-05-08T05:50:36.750 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 0000 2024-05-08T05:50:36.750 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:50:36.750 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2024-05-08T05:50:36.750 INFO:teuthology.orchestra.run.smithi082.stdout:total 8 2024-05-08T05:50:36.750 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 8 05:50 . 2024-05-08T05:50:36.750 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 May 8 05:50 .. 2024-05-08T05:50:36.750 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 0000 2024-05-08T05:50:36.750 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:50:36.750 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_notify: 2024-05-08T05:50:36.750 INFO:teuthology.orchestra.run.smithi082.stdout:total 0 2024-05-08T05:50:36.750 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 . 2024-05-08T05:50:36.751 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 8 05:50 .. 2024-05-08T05:50:36.751 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:50:36.751 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2024-05-08T05:50:36.751 INFO:teuthology.orchestra.run.smithi082.stdout:total 0 2024-05-08T05:50:36.751 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 . 2024-05-08T05:50:36.751 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 8 05:50 .. 2024-05-08T05:50:36.751 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:50:36.751 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_serial: 2024-05-08T05:50:36.751 INFO:teuthology.orchestra.run.smithi082.stdout:total 0 2024-05-08T05:50:36.751 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 . 2024-05-08T05:50:36.751 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 8 05:50 .. 2024-05-08T05:50:36.751 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:50:36.751 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2024-05-08T05:50:36.751 INFO:teuthology.orchestra.run.smithi082.stdout:total 0 2024-05-08T05:50:36.752 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 . 2024-05-08T05:50:36.752 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 8 05:50 .. 2024-05-08T05:50:36.752 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:50:36.752 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_stat: 2024-05-08T05:50:36.752 INFO:teuthology.orchestra.run.smithi082.stdout:total 0 2024-05-08T05:50:36.752 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 . 2024-05-08T05:50:36.752 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 8 05:50 .. 2024-05-08T05:50:36.752 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:50:36.752 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2024-05-08T05:50:36.752 INFO:teuthology.orchestra.run.smithi082.stdout:total 0 2024-05-08T05:50:36.752 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 . 2024-05-08T05:50:36.752 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 8 05:50 .. 2024-05-08T05:50:36.752 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:50:36.752 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2024-05-08T05:50:36.752 INFO:teuthology.orchestra.run.smithi082.stdout:total 8 2024-05-08T05:50:36.752 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 8 05:50 . 2024-05-08T05:50:36.753 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 8 05:50 .. 2024-05-08T05:50:36.753 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 0000 2024-05-08T05:50:36.753 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:50:36.753 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2024-05-08T05:50:36.753 INFO:teuthology.orchestra.run.smithi082.stdout:total 0 2024-05-08T05:50:36.753 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 . 2024-05-08T05:50:36.753 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 8 05:50 .. 2024-05-08T05:50:36.753 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:50:36.753 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2024-05-08T05:50:36.753 INFO:teuthology.orchestra.run.smithi082.stdout:total 0 2024-05-08T05:50:36.753 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 . 2024-05-08T05:50:36.753 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 8 05:50 .. 2024-05-08T05:50:36.753 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:50:36.753 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_wal: 2024-05-08T05:50:36.753 INFO:teuthology.orchestra.run.smithi082.stdout:total 16384 2024-05-08T05:50:36.754 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 May 8 05:50 . 2024-05-08T05:50:36.754 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 8 05:50 .. 2024-05-08T05:50:36.754 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 05:50 000000010000000000000001 2024-05-08T05:50:36.754 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 archive_status 2024-05-08T05:50:36.754 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:50:36.754 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2024-05-08T05:50:36.754 INFO:teuthology.orchestra.run.smithi082.stdout:total 0 2024-05-08T05:50:36.754 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 . 2024-05-08T05:50:36.754 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 2 May 8 05:50 .. 2024-05-08T05:50:36.754 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:50:36.754 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_xact: 2024-05-08T05:50:36.754 INFO:teuthology.orchestra.run.smithi082.stdout:total 8 2024-05-08T05:50:36.754 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 8 05:50 . 2024-05-08T05:50:36.755 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 23 May 8 05:50 .. 2024-05-08T05:50:36.755 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 0000 2024-05-08T05:50:36.755 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl start postgresql' 2024-05-08T05:50:37.039 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -s 32 -i' 2024-05-08T05:50:37.153 INFO:teuthology.orchestra.run.smithi082.stderr:dropping old tables... 2024-05-08T05:50:37.253 INFO:teuthology.orchestra.run.smithi082.stderr:NOTICE: table "pgbench_accounts" does not exist, skipping 2024-05-08T05:50:37.253 INFO:teuthology.orchestra.run.smithi082.stderr:NOTICE: table "pgbench_branches" does not exist, skipping 2024-05-08T05:50:37.253 INFO:teuthology.orchestra.run.smithi082.stderr:NOTICE: table "pgbench_history" does not exist, skipping 2024-05-08T05:50:37.253 INFO:teuthology.orchestra.run.smithi082.stderr:NOTICE: table "pgbench_tellers" does not exist, skipping 2024-05-08T05:50:37.253 INFO:teuthology.orchestra.run.smithi082.stderr:creating tables... 2024-05-08T05:50:37.254 INFO:teuthology.orchestra.run.smithi082.stderr:generating data (client-side)... 2024-05-08T05:50:37.316 INFO:teuthology.orchestra.run.smithi082.stderr:100000 of 3200000 tuples (3%) done (elapsed 0.10 s, remaining 3.25 s) 2024-05-08T05:50:37.709 INFO:teuthology.orchestra.run.smithi082.stderr:200000 of 3200000 tuples (6%) done (elapsed 0.50 s, remaining 7.47 s) 2024-05-08T05:50:37.824 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:50:37 smithi134 ceph-mon[34132]: pgmap v458: 97 pgs: 97 active+clean; 25 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 2.1 MiB/s wr, 37 op/s 2024-05-08T05:50:37.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:50:37 smithi151 ceph-mon[34815]: pgmap v458: 97 pgs: 97 active+clean; 25 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 2.1 MiB/s wr, 37 op/s 2024-05-08T05:50:37.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:50:37 smithi082 ceph-mon[30098]: pgmap v458: 97 pgs: 97 active+clean; 25 MiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 2.1 MiB/s wr, 37 op/s 2024-05-08T05:50:37.987 INFO:teuthology.orchestra.run.smithi082.stderr:300000 of 3200000 tuples (9%) done (elapsed 0.78 s, remaining 7.51 s) 2024-05-08T05:50:38.146 INFO:teuthology.orchestra.run.smithi082.stderr:400000 of 3200000 tuples (12%) done (elapsed 0.93 s, remaining 6.54 s) 2024-05-08T05:50:38.373 INFO:teuthology.orchestra.run.smithi082.stderr:500000 of 3200000 tuples (15%) done (elapsed 1.16 s, remaining 6.28 s) 2024-05-08T05:50:38.564 INFO:teuthology.orchestra.run.smithi082.stderr:600000 of 3200000 tuples (18%) done (elapsed 1.35 s, remaining 5.86 s) 2024-05-08T05:50:38.989 INFO:teuthology.orchestra.run.smithi082.stderr:700000 of 3200000 tuples (21%) done (elapsed 1.78 s, remaining 6.35 s) 2024-05-08T05:50:39.329 INFO:teuthology.orchestra.run.smithi082.stderr:800000 of 3200000 tuples (25%) done (elapsed 2.12 s, remaining 6.35 s) 2024-05-08T05:50:39.478 INFO:teuthology.orchestra.run.smithi082.stderr:900000 of 3200000 tuples (28%) done (elapsed 2.27 s, remaining 5.79 s) 2024-05-08T05:50:39.876 INFO:teuthology.orchestra.run.smithi082.stderr:1000000 of 3200000 tuples (31%) done (elapsed 2.67 s, remaining 5.86 s) 2024-05-08T05:50:39.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:50:39 smithi151 ceph-mon[34815]: pgmap v459: 97 pgs: 97 active+clean; 36 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 2.7 MiB/s wr, 99 op/s 2024-05-08T05:50:39.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:50:39 smithi082 ceph-mon[30098]: pgmap v459: 97 pgs: 97 active+clean; 36 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 2.7 MiB/s wr, 99 op/s 2024-05-08T05:50:39.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:50:39 smithi134 ceph-mon[34132]: pgmap v459: 97 pgs: 97 active+clean; 36 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 2.7 MiB/s wr, 99 op/s 2024-05-08T05:50:40.224 INFO:teuthology.orchestra.run.smithi082.stderr:1100000 of 3200000 tuples (34%) done (elapsed 3.01 s, remaining 5.75 s) 2024-05-08T05:50:40.402 INFO:teuthology.orchestra.run.smithi082.stderr:1200000 of 3200000 tuples (37%) done (elapsed 3.19 s, remaining 5.32 s) 2024-05-08T05:50:40.802 INFO:teuthology.orchestra.run.smithi082.stderr:1300000 of 3200000 tuples (40%) done (elapsed 3.59 s, remaining 5.25 s) 2024-05-08T05:50:41.214 INFO:teuthology.orchestra.run.smithi082.stderr:1400000 of 3200000 tuples (43%) done (elapsed 4.00 s, remaining 5.15 s) 2024-05-08T05:50:41.398 INFO:teuthology.orchestra.run.smithi082.stderr:1500000 of 3200000 tuples (46%) done (elapsed 4.19 s, remaining 4.75 s) 2024-05-08T05:50:41.822 INFO:teuthology.orchestra.run.smithi082.stderr:1600000 of 3200000 tuples (50%) done (elapsed 4.61 s, remaining 4.61 s) 2024-05-08T05:50:41.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:50:41 smithi151 ceph-mon[34815]: pgmap v460: 97 pgs: 97 active+clean; 95 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 12 MiB/s wr, 138 op/s 2024-05-08T05:50:41.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:50:41 smithi151 ceph-mon[34815]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-08T05:50:41.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:50:41 smithi082 ceph-mon[30098]: pgmap v460: 97 pgs: 97 active+clean; 95 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 12 MiB/s wr, 138 op/s 2024-05-08T05:50:41.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:50:41 smithi082 ceph-mon[30098]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-08T05:50:41.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:50:41 smithi134 ceph-mon[34132]: pgmap v460: 97 pgs: 97 active+clean; 95 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 215 KiB/s rd, 12 MiB/s wr, 138 op/s 2024-05-08T05:50:41.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:50:41 smithi134 ceph-mon[34132]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-08T05:50:42.160 INFO:teuthology.orchestra.run.smithi082.stderr:1700000 of 3200000 tuples (53%) done (elapsed 4.95 s, remaining 4.37 s) 2024-05-08T05:50:42.263 INFO:teuthology.orchestra.run.smithi082.stderr:1800000 of 3200000 tuples (56%) done (elapsed 5.05 s, remaining 3.93 s) 2024-05-08T05:50:42.766 INFO:teuthology.orchestra.run.smithi082.stderr:1900000 of 3200000 tuples (59%) done (elapsed 5.56 s, remaining 3.80 s) 2024-05-08T05:50:43.120 INFO:teuthology.orchestra.run.smithi082.stderr:2000000 of 3200000 tuples (62%) done (elapsed 5.91 s, remaining 3.55 s) 2024-05-08T05:50:43.220 INFO:teuthology.orchestra.run.smithi082.stderr:2100000 of 3200000 tuples (65%) done (elapsed 6.01 s, remaining 3.15 s) 2024-05-08T05:50:43.638 INFO:teuthology.orchestra.run.smithi082.stderr:2200000 of 3200000 tuples (68%) done (elapsed 6.43 s, remaining 2.92 s) 2024-05-08T05:50:43.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:50:43 smithi151 ceph-mon[34815]: pgmap v461: 97 pgs: 97 active+clean; 128 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 16 MiB/s wr, 139 op/s 2024-05-08T05:50:43.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:50:43 smithi082 ceph-mon[30098]: pgmap v461: 97 pgs: 97 active+clean; 128 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 16 MiB/s wr, 139 op/s 2024-05-08T05:50:43.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:50:43 smithi134 ceph-mon[34132]: pgmap v461: 97 pgs: 97 active+clean; 128 MiB data, 421 MiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 16 MiB/s wr, 139 op/s 2024-05-08T05:50:44.221 INFO:teuthology.orchestra.run.smithi082.stderr:2300000 of 3200000 tuples (71%) done (elapsed 7.01 s, remaining 2.74 s) 2024-05-08T05:50:44.311 INFO:teuthology.orchestra.run.smithi082.stderr:2400000 of 3200000 tuples (75%) done (elapsed 7.10 s, remaining 2.37 s) 2024-05-08T05:50:44.602 INFO:teuthology.orchestra.run.smithi082.stderr:2500000 of 3200000 tuples (78%) done (elapsed 7.39 s, remaining 2.07 s) 2024-05-08T05:50:44.807 INFO:teuthology.orchestra.run.smithi082.stderr:2600000 of 3200000 tuples (81%) done (elapsed 7.60 s, remaining 1.75 s) 2024-05-08T05:50:45.210 INFO:teuthology.orchestra.run.smithi082.stderr:2700000 of 3200000 tuples (84%) done (elapsed 8.00 s, remaining 1.48 s) 2024-05-08T05:50:45.544 INFO:teuthology.orchestra.run.smithi082.stderr:2800000 of 3200000 tuples (87%) done (elapsed 8.33 s, remaining 1.19 s) 2024-05-08T05:50:45.646 INFO:teuthology.orchestra.run.smithi082.stderr:2900000 of 3200000 tuples (90%) done (elapsed 8.44 s, remaining 0.87 s) 2024-05-08T05:50:45.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:50:45 smithi151 ceph-mon[34815]: pgmap v462: 97 pgs: 97 active+clean; 184 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 26 MiB/s wr, 140 op/s 2024-05-08T05:50:45.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:50:45 smithi082 ceph-mon[30098]: pgmap v462: 97 pgs: 97 active+clean; 184 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 26 MiB/s wr, 140 op/s 2024-05-08T05:50:45.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:50:45 smithi134 ceph-mon[34132]: pgmap v462: 97 pgs: 97 active+clean; 184 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 26 MiB/s wr, 140 op/s 2024-05-08T05:50:46.064 INFO:teuthology.orchestra.run.smithi082.stderr:3000000 of 3200000 tuples (93%) done (elapsed 8.85 s, remaining 0.59 s) 2024-05-08T05:50:46.382 INFO:teuthology.orchestra.run.smithi082.stderr:3100000 of 3200000 tuples (96%) done (elapsed 9.17 s, remaining 0.30 s) 2024-05-08T05:50:46.493 INFO:teuthology.orchestra.run.smithi082.stderr:3200000 of 3200000 tuples (100%) done (elapsed 9.28 s, remaining 0.00 s) 2024-05-08T05:50:46.597 INFO:teuthology.orchestra.run.smithi082.stderr:vacuuming... 2024-05-08T05:50:47.685 INFO:teuthology.orchestra.run.smithi082.stderr:creating primary keys... 2024-05-08T05:50:47.802 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:50:47 smithi134 ceph-mon[34132]: pgmap v463: 97 pgs: 97 active+clean; 269 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 40 MiB/s wr, 151 op/s 2024-05-08T05:50:47.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:50:47 smithi151 ceph-mon[34815]: pgmap v463: 97 pgs: 97 active+clean; 269 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 40 MiB/s wr, 151 op/s 2024-05-08T05:50:47.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:50:47 smithi082 ceph-mon[30098]: pgmap v463: 97 pgs: 97 active+clean; 269 MiB data, 476 MiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 40 MiB/s wr, 151 op/s 2024-05-08T05:50:49.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:50:49 smithi151 ceph-mon[34815]: pgmap v464: 97 pgs: 97 active+clean; 333 MiB data, 499 MiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 50 MiB/s wr, 153 op/s 2024-05-08T05:50:49.981 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:50:49 smithi082 ceph-mon[30098]: pgmap v464: 97 pgs: 97 active+clean; 333 MiB data, 499 MiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 50 MiB/s wr, 153 op/s 2024-05-08T05:50:49.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:50:49 smithi134 ceph-mon[34132]: pgmap v464: 97 pgs: 97 active+clean; 333 MiB data, 499 MiB used, 1.0 TiB / 1.0 TiB avail; 239 KiB/s rd, 50 MiB/s wr, 153 op/s 2024-05-08T05:50:50.114 INFO:teuthology.orchestra.run.smithi082.stderr:done in 12.96 s (drop tables 0.00 s, create tables 0.02 s, client-side generate 9.42 s, vacuum 1.09 s, primary keys 2.43 s). 2024-05-08T05:50:50.122 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900' 2024-05-08T05:50:50.265 INFO:teuthology.orchestra.run.smithi082.stderr:starting vacuum...end. 2024-05-08T05:50:51.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:50:51 smithi151 ceph-mon[34815]: pgmap v465: 97 pgs: 97 active+clean; 417 MiB data, 537 MiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 62 MiB/s wr, 100 op/s 2024-05-08T05:50:51.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:50:51 smithi082 ceph-mon[30098]: pgmap v465: 97 pgs: 97 active+clean; 417 MiB data, 537 MiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 62 MiB/s wr, 100 op/s 2024-05-08T05:50:51.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:50:51 smithi134 ceph-mon[34132]: pgmap v465: 97 pgs: 97 active+clean; 417 MiB data, 537 MiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 62 MiB/s wr, 100 op/s 2024-05-08T05:50:53.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:50:53 smithi151 ceph-mon[34815]: pgmap v466: 97 pgs: 97 active+clean; 441 MiB data, 574 MiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 56 MiB/s wr, 63 op/s 2024-05-08T05:50:53.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:50:53 smithi082 ceph-mon[30098]: pgmap v466: 97 pgs: 97 active+clean; 441 MiB data, 574 MiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 56 MiB/s wr, 63 op/s 2024-05-08T05:50:54.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:50:53 smithi134 ceph-mon[34132]: pgmap v466: 97 pgs: 97 active+clean; 441 MiB data, 574 MiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 56 MiB/s wr, 63 op/s 2024-05-08T05:50:55.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 5.0 s, 2734.5 tps, lat 34.909 ms stddev 38.545 2024-05-08T05:50:55.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:50:55 smithi151 ceph-mon[34815]: pgmap v467: 97 pgs: 97 active+clean; 541 MiB data, 639 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 57 MiB/s wr, 102 op/s 2024-05-08T05:50:55.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:50:55 smithi082 ceph-mon[30098]: pgmap v467: 97 pgs: 97 active+clean; 541 MiB data, 639 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 57 MiB/s wr, 102 op/s 2024-05-08T05:50:55.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:50:55 smithi134 ceph-mon[34132]: pgmap v467: 97 pgs: 97 active+clean; 541 MiB data, 639 MiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 57 MiB/s wr, 102 op/s 2024-05-08T05:50:57.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:50:57 smithi151 ceph-mon[34815]: pgmap v468: 97 pgs: 97 active+clean; 671 MiB data, 695 MiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 49 MiB/s wr, 124 op/s 2024-05-08T05:50:57.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:50:57 smithi082 ceph-mon[30098]: pgmap v468: 97 pgs: 97 active+clean; 671 MiB data, 695 MiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 49 MiB/s wr, 124 op/s 2024-05-08T05:50:57.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:50:57 smithi134 ceph-mon[34132]: pgmap v468: 97 pgs: 97 active+clean; 671 MiB data, 695 MiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 49 MiB/s wr, 124 op/s 2024-05-08T05:50:58.212 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-08T05:50:58.820 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:50:59.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:50:59 smithi082 ceph-mon[30098]: pgmap v469: 97 pgs: 97 active+clean; 768 MiB data, 713 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 35 MiB/s wr, 158 op/s 2024-05-08T05:50:59.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:50:59 smithi151 ceph-mon[34815]: pgmap v469: 97 pgs: 97 active+clean; 768 MiB data, 713 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 35 MiB/s wr, 158 op/s 2024-05-08T05:50:59.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:50:59 smithi134 ceph-mon[34132]: pgmap v469: 97 pgs: 97 active+clean; 768 MiB data, 713 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 35 MiB/s wr, 158 op/s 2024-05-08T05:51:00.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 10.0 s, 2949.8 tps, lat 33.955 ms stddev 34.525 2024-05-08T05:51:01.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.366+0000 7fd95c600700 1 -- 172.21.15.82:0/3066200920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9540756d0 msgr2=0x7fd954075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:01.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.366+0000 7fd95c600700 1 --2- 172.21.15.82:0/3066200920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9540756d0 0x7fd954075ab0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd948009f90 tx=0x7fd94800b330 comp rx=0 tx=0).stop 2024-05-08T05:51:01.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.367+0000 7fd95c600700 1 -- 172.21.15.82:0/3066200920 shutdown_connections 2024-05-08T05:51:01.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.367+0000 7fd95c600700 1 --2- 172.21.15.82:0/3066200920 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd95410fed0 0x7fd9541122c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:01.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.367+0000 7fd95c600700 1 --2- 172.21.15.82:0/3066200920 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9540756d0 0x7fd954075ab0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:01.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.367+0000 7fd95c600700 1 --2- 172.21.15.82:0/3066200920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd954075ff0 0x7fd95410f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:01.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.367+0000 7fd95c600700 1 -- 172.21.15.82:0/3066200920 >> 172.21.15.82:0/3066200920 conn(0x7fd95407a650 msgr2=0x7fd95407aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:51:01.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.368+0000 7fd95c600700 1 -- 172.21.15.82:0/3066200920 shutdown_connections 2024-05-08T05:51:01.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.368+0000 7fd95c600700 1 -- 172.21.15.82:0/3066200920 wait complete. 2024-05-08T05:51:01.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.370+0000 7fd95c600700 1 Processor -- start 2024-05-08T05:51:01.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.370+0000 7fd95c600700 1 -- start start 2024-05-08T05:51:01.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.371+0000 7fd95c600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9540756d0 0x7fd95419bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:01.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.371+0000 7fd95c600700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd954075ff0 0x7fd95419c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:01.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.371+0000 7fd95c600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd95410fed0 0x7fd9541a0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:01.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.371+0000 7fd95c600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd954115920 con 0x7fd9540756d0 2024-05-08T05:51:01.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.371+0000 7fd95c600700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd9541157a0 con 0x7fd95410fed0 2024-05-08T05:51:01.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.371+0000 7fd95c600700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd954115aa0 con 0x7fd954075ff0 2024-05-08T05:51:01.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.372+0000 7fd95a600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd95410fed0 0x7fd9541a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:01.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.372+0000 7fd959200700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd954075ff0 0x7fd95419c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:01.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.372+0000 7fd95a600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd95410fed0 0x7fd9541a0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:36074/0 (socket says 172.21.15.82:36074) 2024-05-08T05:51:01.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.372+0000 7fd95a600700 1 -- 172.21.15.82:0/1202798421 learned_addr learned my addr 172.21.15.82:0/1202798421 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:51:01.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.372+0000 7fd959c00700 1 --2- 172.21.15.82:0/1202798421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9540756d0 0x7fd95419bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:01.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.372+0000 7fd95a600700 1 -- 172.21.15.82:0/1202798421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd954075ff0 msgr2=0x7fd95419c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:01.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.372+0000 7fd95a600700 1 --2- 172.21.15.82:0/1202798421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd954075ff0 0x7fd95419c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:01.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.372+0000 7fd95a600700 1 -- 172.21.15.82:0/1202798421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9540756d0 msgr2=0x7fd95419bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:01.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.372+0000 7fd95a600700 1 --2- 172.21.15.82:0/1202798421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9540756d0 0x7fd95419bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:01.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.372+0000 7fd95a600700 1 -- 172.21.15.82:0/1202798421 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9541a0d50 con 0x7fd95410fed0 2024-05-08T05:51:01.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.373+0000 7fd959c00700 1 --2- 172.21.15.82:0/1202798421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9540756d0 0x7fd95419bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:51:01.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.373+0000 7fd95a600700 1 --2- 172.21.15.82:0/1202798421 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd95410fed0 0x7fd9541a0610 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd94c00d750 tx=0x7fd94c00db10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:51:01.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.373+0000 7fd952000700 1 -- 172.21.15.82:0/1202798421 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd94c017070 con 0x7fd95410fed0 2024-05-08T05:51:01.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.373+0000 7fd952000700 1 -- 172.21.15.82:0/1202798421 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd94c005020 con 0x7fd95410fed0 2024-05-08T05:51:01.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.373+0000 7fd952000700 1 -- 172.21.15.82:0/1202798421 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd94c00fa90 con 0x7fd95410fed0 2024-05-08T05:51:01.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.376+0000 7fd95c600700 1 -- 172.21.15.82:0/1202798421 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9541a1040 con 0x7fd95410fed0 2024-05-08T05:51:01.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.376+0000 7fd95c600700 1 -- 172.21.15.82:0/1202798421 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9541a88c0 con 0x7fd95410fed0 2024-05-08T05:51:01.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.389+0000 7fd952000700 1 -- 172.21.15.82:0/1202798421 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) ==== 149703+0+0 (secure 0 0 0) 0x7fd94c0054f0 con 0x7fd95410fed0 2024-05-08T05:51:01.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.390+0000 7fd966f70b80 1 Processor -- start 2024-05-08T05:51:01.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.391+0000 7fd966f70b80 1 -- start start 2024-05-08T05:51:01.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.391+0000 7fd966f70b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1aa03abc0 0x55c1aa03afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:01.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.391+0000 7fd966f70b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1aa03b4e0 0x55c1aa0352d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:01.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.391+0000 7fd966f70b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1aa0358f0 0x55c1aa035d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:01.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.391+0000 7fd966f70b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c1a9f87a20 con 0x55c1aa0358f0 2024-05-08T05:51:01.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.391+0000 7fd966f70b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55c1a9f25760 con 0x55c1aa03b4e0 2024-05-08T05:51:01.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.391+0000 7fd966f70b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55c1a9f839e0 con 0x55c1aa03abc0 2024-05-08T05:51:01.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.392+0000 7fd959200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1aa0358f0 0x55c1aa035d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:01.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.392+0000 7fd959200700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1aa03abc0 0x55c1aa03afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:01.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.392+0000 7fd959200700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1aa03abc0 0x55c1aa03afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:40880/0 (socket says 172.21.15.82:40880) 2024-05-08T05:51:01.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.392+0000 7fd959200700 1 -- 172.21.15.82:0/2565161884 learned_addr learned my addr 172.21.15.82:0/2565161884 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:51:01.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.392+0000 7fd959c00700 1 --2- 172.21.15.82:0/2565161884 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1aa03b4e0 0x55c1aa0352d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:01.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.393+0000 7fd959c00700 1 -- 172.21.15.82:0/2565161884 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1aa03abc0 msgr2=0x55c1aa03afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:01.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.393+0000 7fd959c00700 1 --2- 172.21.15.82:0/2565161884 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1aa03abc0 0x55c1aa03afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:01.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.393+0000 7fd959c00700 1 -- 172.21.15.82:0/2565161884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1aa0358f0 msgr2=0x55c1aa035d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:01.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.393+0000 7fd959c00700 1 --2- 172.21.15.82:0/2565161884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1aa0358f0 0x55c1aa035d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:01.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.393+0000 7fd959c00700 1 -- 172.21.15.82:0/2565161884 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1a9ed48d0 con 0x55c1aa03b4e0 2024-05-08T05:51:01.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.393+0000 7fd959200700 1 --2- 172.21.15.82:0/2565161884 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1aa03abc0 0x55c1aa03afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:51:01.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.394+0000 7fd959c00700 1 --2- 172.21.15.82:0/2565161884 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1aa03b4e0 0x55c1aa0352d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd948000f80 tx=0x7fd948009470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=606063122e90844e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:51:01.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.396+0000 7fd946a00700 1 -- 172.21.15.82:0/2565161884 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd94801f070 con 0x55c1aa03b4e0 2024-05-08T05:51:01.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.397+0000 7fd946a00700 1 -- 172.21.15.82:0/2565161884 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd94800bca0 con 0x55c1aa03b4e0 2024-05-08T05:51:01.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.397+0000 7fd946a00700 1 -- 172.21.15.82:0/2565161884 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd948007c70 con 0x55c1aa03b4e0 2024-05-08T05:51:01.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.398+0000 7fd966f70b80 1 -- 172.21.15.82:0/2565161884 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1aa03b4e0 msgr2=0x55c1aa0352d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:01.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.398+0000 7fd966f70b80 1 --2- 172.21.15.82:0/2565161884 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1aa03b4e0 0x55c1aa0352d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd948000f80 tx=0x7fd948009470 comp rx=0 tx=0).stop 2024-05-08T05:51:01.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.399+0000 7fd966f70b80 1 -- 172.21.15.82:0/2565161884 shutdown_connections 2024-05-08T05:51:01.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.399+0000 7fd966f70b80 1 --2- 172.21.15.82:0/2565161884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1aa0358f0 0x55c1aa035d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:01.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.399+0000 7fd966f70b80 1 --2- 172.21.15.82:0/2565161884 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1aa03abc0 0x55c1aa03afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:01.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.399+0000 7fd966f70b80 1 --2- 172.21.15.82:0/2565161884 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1aa03b4e0 0x55c1aa0352d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:01.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.399+0000 7fd966f70b80 1 -- 172.21.15.82:0/2565161884 >> 172.21.15.82:0/2565161884 conn(0x55c1a9fad6d0 msgr2=0x55c1aa02fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:51:01.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.399+0000 7fd952000700 1 --2- 172.21.15.82:0/1202798421 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd93c0b2a90 0x7fd93c0b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:01.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.399+0000 7fd952000700 1 -- 172.21.15.82:0/1202798421 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd94c0e1ad0 con 0x7fd95410fed0 2024-05-08T05:51:01.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.400+0000 7fd966f70b80 1 -- 172.21.15.82:0/2565161884 shutdown_connections 2024-05-08T05:51:01.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.400+0000 7fd959200700 1 --2- 172.21.15.82:0/1202798421 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd93c0b2a90 0x7fd93c0b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:01.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.400+0000 7fd966f70b80 1 -- 172.21.15.82:0/2565161884 wait complete. 2024-05-08T05:51:01.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.401+0000 7fd966f70b80 1 -- start start 2024-05-08T05:51:01.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.401+0000 7fd966f70b80 1 Processor -- start 2024-05-08T05:51:01.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.402+0000 7fd966f70b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1aa0358f0 0x55c1aa041140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:01.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.402+0000 7fd966f70b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1aa03abc0 0x55c1aa03e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:01.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.402+0000 7fd966f70b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1aa03b4e0 0x55c1aa03ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:01.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.402+0000 7fd966f70b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c1aa041ec0 con 0x55c1aa0358f0 2024-05-08T05:51:01.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.402+0000 7fd966f70b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55c1a9eedb20 con 0x55c1aa03abc0 2024-05-08T05:51:01.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.402+0000 7fd966f70b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55c1aa042040 con 0x55c1aa03b4e0 2024-05-08T05:51:01.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.403+0000 7fd966f70b80 10 client.0 _ll_register_callbacks cb 0x55c1a9f2ec70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:51:01.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.404+0000 7fd95a600700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1aa03b4e0 0x55c1aa03ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:01.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.404+0000 7fd95a600700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1aa03b4e0 0x55c1aa03ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:40888/0 (socket says 172.21.15.82:40888) 2024-05-08T05:51:01.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.404+0000 7fd95a600700 1 -- 172.21.15.82:0/992495489 learned_addr learned my addr 172.21.15.82:0/992495489 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:51:01.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.404+0000 7fd959c00700 1 --2- 172.21.15.82:0/992495489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1aa0358f0 0x55c1aa041140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:01.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.404+0000 7fd959200700 1 --2- 172.21.15.82:0/1202798421 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd93c0b2a90 0x7fd93c0b4f50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd94000b350 tx=0x7fd94000b2c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:51:01.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.404+0000 7fd959200700 1 --2- 172.21.15.82:0/992495489 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1aa03abc0 0x55c1aa03e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:01.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.404+0000 7fd95a600700 1 -- 172.21.15.82:0/992495489 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1aa03abc0 msgr2=0x55c1aa03e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:01.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.404+0000 7fd95a600700 1 --2- 172.21.15.82:0/992495489 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1aa03abc0 0x55c1aa03e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:01.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.404+0000 7fd95a600700 1 -- 172.21.15.82:0/992495489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1aa0358f0 msgr2=0x55c1aa041140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:01.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.404+0000 7fd95a600700 1 --2- 172.21.15.82:0/992495489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1aa0358f0 0x55c1aa041140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:01.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.405+0000 7fd95a600700 1 -- 172.21.15.82:0/992495489 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1a9f4d420 con 0x55c1aa03b4e0 2024-05-08T05:51:01.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.405+0000 7fd95a600700 1 --2- 172.21.15.82:0/992495489 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1aa03b4e0 0x55c1aa03ea20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd94c0a5020 tx=0x7fd94c0df910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d333ad067e97a70 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:51:01.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.405+0000 7fd93b400700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:51:01.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.405+0000 7fd93b400700 1 -- 172.21.15.82:0/992495489 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd94c020040 con 0x55c1aa03b4e0 2024-05-08T05:51:01.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.405+0000 7fd93b400700 1 -- 172.21.15.82:0/992495489 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd94c0b1b80 con 0x55c1aa03b4e0 2024-05-08T05:51:01.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.405+0000 7fd966f70b80 1 -- 172.21.15.82:0/992495489 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd94800bca0 con 0x55c1aa03b4e0 2024-05-08T05:51:01.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.406+0000 7fd93b400700 1 -- 172.21.15.82:0/992495489 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd94c0ad350 con 0x55c1aa03b4e0 2024-05-08T05:51:01.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.406+0000 7fd966f70b80 10 client.25231 fetch_fsmap learned FSMap version 30 2024-05-08T05:51:01.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.406+0000 7fd966f70b80 1 -- 172.21.15.82:0/992495489 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c1aa054f00 con 0x55c1aa03b4e0 2024-05-08T05:51:01.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.406+0000 7fd93b400700 1 -- 172.21.15.82:0/992495489 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd94800bca0 con 0x55c1aa03b4e0 2024-05-08T05:51:01.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.406+0000 7fd93b400700 1 -- 172.21.15.82:0/992495489 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7fd94c0a4910 con 0x55c1aa03b4e0 2024-05-08T05:51:01.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.406+0000 7fd966f70b80 10 client.25231 fetch_fsmap finished waiting for FSMap version 30 2024-05-08T05:51:01.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.406+0000 7fd966f70b80 10 client.25231 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:51:01.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.406+0000 7fd966f70b80 20 client.25231 populate_metadata read hostname 'smithi082' 2024-05-08T05:51:01.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.406+0000 7fd966f70b80 1 --2- 172.21.15.82:0/992495489 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55c1aa057420 0x55c1aa059870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:01.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.406+0000 7fd966f70b80 4 client.25231 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:51:01.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.406+0000 7fd966f70b80 1 -- 172.21.15.82:0/992495489 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c1aa002140 con 0x55c1aa057420 2024-05-08T05:51:01.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.407+0000 7fd959c00700 1 --2- 172.21.15.82:0/992495489 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55c1aa057420 0x55c1aa059870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:01.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.408+0000 7fd959c00700 1 --2- 172.21.15.82:0/992495489 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55c1aa057420 0x55c1aa059870 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f40b1b963a57c978 server_cookie=bcc5c4f044f4cdd8 in_seq=0 out_seq=0 2024-05-08T05:51:01.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.408+0000 7fd93b400700 10 client.25231 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:51:01.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.408+0000 7fd93b400700 1 -- 172.21.15.82:0/992495489 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55c1aa002140 con 0x55c1aa057420 2024-05-08T05:51:01.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.409+0000 7fd93b400700 10 client.25231 handle_command_reply: tid=0 2024-05-08T05:51:01.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.409+0000 7fd966f70b80 1 client.25231 shutdown 2024-05-08T05:51:01.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.409+0000 7fd966f70b80 1 -- 172.21.15.82:0/992495489 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1aa03b4e0 msgr2=0x55c1aa03ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:01.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.409+0000 7fd966f70b80 1 --2- 172.21.15.82:0/992495489 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1aa03b4e0 0x55c1aa03ea20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd94c0a5020 tx=0x7fd94c0df910 comp rx=0 tx=0).stop 2024-05-08T05:51:01.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.410+0000 7fd966f70b80 1 -- 172.21.15.82:0/992495489 shutdown_connections 2024-05-08T05:51:01.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.410+0000 7fd966f70b80 1 --2- 172.21.15.82:0/992495489 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1aa03b4e0 0x55c1aa03ea20 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:01.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.410+0000 7fd966f70b80 1 --2- 172.21.15.82:0/992495489 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1aa0358f0 0x55c1aa041140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:01.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.410+0000 7fd966f70b80 1 --2- 172.21.15.82:0/992495489 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55c1aa057420 0x55c1aa059870 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:01.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.410+0000 7fd93b400700 0 client.25231 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:51:01.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.410+0000 7fd966f70b80 1 --2- 172.21.15.82:0/992495489 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1aa03abc0 0x55c1aa03e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:01.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.410+0000 7fd966f70b80 1 -- 172.21.15.82:0/992495489 >> 172.21.15.82:0/992495489 conn(0x55c1a9fad6d0 msgr2=0x55c1aa02f190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:51:01.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.410+0000 7fd966f70b80 1 -- 172.21.15.82:0/992495489 shutdown_connections 2024-05-08T05:51:01.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.410+0000 7fd966f70b80 1 -- 172.21.15.82:0/992495489 wait complete. 2024-05-08T05:51:01.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.411+0000 7fd966f70b80 20 client.25231 trim_cache size 0 max 16384 2024-05-08T05:51:01.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.440+0000 7fd966f70b80 1 Processor -- start 2024-05-08T05:51:01.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.441+0000 7fd966f70b80 1 -- start start 2024-05-08T05:51:01.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.441+0000 7fd966f70b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1aa0358f0 0x55c1aa0352d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:01.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.441+0000 7fd966f70b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1aa03abc0 0x55c1aa04af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:01.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.441+0000 7fd966f70b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1aa03b4e0 0x55c1aa03c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:01.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.441+0000 7fd966f70b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd95406fc60 con 0x55c1aa03b4e0 2024-05-08T05:51:01.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.441+0000 7fd966f70b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd9540717d0 con 0x55c1aa0358f0 2024-05-08T05:51:01.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.441+0000 7fd966f70b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd954070330 con 0x55c1aa03abc0 2024-05-08T05:51:01.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.442+0000 7fd959c00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1aa0358f0 0x55c1aa0352d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:01.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.442+0000 7fd959200700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1aa03abc0 0x55c1aa04af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:01.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.442+0000 7fd959c00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1aa0358f0 0x55c1aa0352d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:36098/0 (socket says 172.21.15.82:36098) 2024-05-08T05:51:01.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.442+0000 7fd959c00700 1 -- 172.21.15.82:0/4123368050 learned_addr learned my addr 172.21.15.82:0/4123368050 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:51:01.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.442+0000 7fd95a600700 1 --2- 172.21.15.82:0/4123368050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1aa03b4e0 0x55c1aa03c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:01.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.443+0000 7fd959200700 1 -- 172.21.15.82:0/4123368050 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1aa0358f0 msgr2=0x55c1aa0352d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:01.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.443+0000 7fd959200700 1 --2- 172.21.15.82:0/4123368050 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1aa0358f0 0x55c1aa0352d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:01.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.443+0000 7fd959200700 1 -- 172.21.15.82:0/4123368050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1aa03b4e0 msgr2=0x55c1aa03c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:01.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.443+0000 7fd959200700 1 --2- 172.21.15.82:0/4123368050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1aa03b4e0 0x55c1aa03c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:01.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.443+0000 7fd959200700 1 -- 172.21.15.82:0/4123368050 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1aa02aab0 con 0x55c1aa03abc0 2024-05-08T05:51:01.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.443+0000 7fd959200700 1 --2- 172.21.15.82:0/4123368050 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1aa03abc0 0x55c1aa04af80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x55c1aa030550 tx=0x7fd940004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=994ab3a18985f9f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:51:01.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.443+0000 7fd946000700 1 -- 172.21.15.82:0/4123368050 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd940011df0 con 0x55c1aa03abc0 2024-05-08T05:51:01.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.444+0000 7fd946000700 1 -- 172.21.15.82:0/4123368050 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd94002c900 con 0x55c1aa03abc0 2024-05-08T05:51:01.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.444+0000 7fd946000700 1 -- 172.21.15.82:0/4123368050 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd94002d7d0 con 0x55c1aa03abc0 2024-05-08T05:51:01.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.444+0000 7fd966f70b80 1 -- 172.21.15.82:0/4123368050 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1aa03abc0 msgr2=0x55c1aa04af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:01.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.444+0000 7fd966f70b80 1 --2- 172.21.15.82:0/4123368050 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1aa03abc0 0x55c1aa04af80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x55c1aa030550 tx=0x7fd940004750 comp rx=0 tx=0).stop 2024-05-08T05:51:01.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.444+0000 7fd966f70b80 1 -- 172.21.15.82:0/4123368050 shutdown_connections 2024-05-08T05:51:01.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.444+0000 7fd966f70b80 1 --2- 172.21.15.82:0/4123368050 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1aa0358f0 0x55c1aa0352d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:01.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.444+0000 7fd966f70b80 1 --2- 172.21.15.82:0/4123368050 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1aa03b4e0 0x55c1aa03c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:01.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.444+0000 7fd966f70b80 1 --2- 172.21.15.82:0/4123368050 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1aa03abc0 0x55c1aa04af80 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:01.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.444+0000 7fd966f70b80 1 -- 172.21.15.82:0/4123368050 >> 172.21.15.82:0/4123368050 conn(0x55c1a9fad6d0 msgr2=0x55c1aa03b910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:51:01.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.445+0000 7fd966f70b80 1 -- 172.21.15.82:0/4123368050 shutdown_connections 2024-05-08T05:51:01.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.445+0000 7fd966f70b80 1 -- 172.21.15.82:0/4123368050 wait complete. 2024-05-08T05:51:01.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.445+0000 7fd966f70b80 1 -- start start 2024-05-08T05:51:01.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.446+0000 7fd966f70b80 1 Processor -- start 2024-05-08T05:51:01.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.446+0000 7fd966f70b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1aa0358f0 0x55c1aa05ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:01.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.446+0000 7fd966f70b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1aa03abc0 0x55c1aa05f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:01.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.446+0000 7fd966f70b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1aa03b4e0 0x55c1aa0c0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:01.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.446+0000 7fd966f70b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd9540710d0 con 0x55c1aa0358f0 2024-05-08T05:51:01.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.446+0000 7fd966f70b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd954070a00 con 0x55c1aa03b4e0 2024-05-08T05:51:01.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.446+0000 7fd966f70b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd954107460 con 0x55c1aa03abc0 2024-05-08T05:51:01.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.446+0000 7fd966f70b80 10 client.0 _ll_register_callbacks cb 0x55c1a9f2ec70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:51:01.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.447+0000 7fd959200700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1aa03abc0 0x55c1aa05f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:01.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.447+0000 7fd95a600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1aa03b4e0 0x55c1aa0c0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:01.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.447+0000 7fd959200700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1aa03abc0 0x55c1aa05f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:40908/0 (socket says 172.21.15.82:40908) 2024-05-08T05:51:01.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.447+0000 7fd959200700 1 -- 172.21.15.82:0/1845269836 learned_addr learned my addr 172.21.15.82:0/1845269836 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:51:01.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.447+0000 7fd959c00700 1 --2- 172.21.15.82:0/1845269836 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1aa0358f0 0x55c1aa05ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:01.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.447+0000 7fd959200700 1 -- 172.21.15.82:0/1845269836 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1aa03b4e0 msgr2=0x55c1aa0c0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:01.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.447+0000 7fd959200700 1 --2- 172.21.15.82:0/1845269836 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1aa03b4e0 0x55c1aa0c0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:01.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.447+0000 7fd959200700 1 -- 172.21.15.82:0/1845269836 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1aa0358f0 msgr2=0x55c1aa05ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:01.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.447+0000 7fd959200700 1 --2- 172.21.15.82:0/1845269836 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1aa0358f0 0x55c1aa05ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:01.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.447+0000 7fd959200700 1 -- 172.21.15.82:0/1845269836 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1aa0c1230 con 0x55c1aa03abc0 2024-05-08T05:51:01.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.447+0000 7fd95a600700 1 --2- 172.21.15.82:0/1845269836 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1aa03b4e0 0x55c1aa0c0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:51:01.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.447+0000 7fd959c00700 1 --2- 172.21.15.82:0/1845269836 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1aa0358f0 0x55c1aa05ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:51:01.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.448+0000 7fd959200700 1 --2- 172.21.15.82:0/1845269836 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1aa03abc0 0x55c1aa05f230 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd94000c010 tx=0x7fd94000bbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c567b75122e464 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:51:01.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.448+0000 7fd93b400700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:51:01.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.448+0000 7fd93b400700 1 -- 172.21.15.82:0/1845269836 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd94002cdc0 con 0x55c1aa03abc0 2024-05-08T05:51:01.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.448+0000 7fd93b400700 1 -- 172.21.15.82:0/1845269836 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd94003d070 con 0x55c1aa03abc0 2024-05-08T05:51:01.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.448+0000 7fd966f70b80 1 -- 172.21.15.82:0/1845269836 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd94002c900 con 0x55c1aa03abc0 2024-05-08T05:51:01.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.448+0000 7fd93b400700 1 -- 172.21.15.82:0/1845269836 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd94004b420 con 0x55c1aa03abc0 2024-05-08T05:51:01.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.449+0000 7fd966f70b80 10 client.25237 fetch_fsmap learned FSMap version 30 2024-05-08T05:51:01.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.449+0000 7fd966f70b80 1 -- 172.21.15.82:0/1845269836 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c1aa0c23a0 con 0x55c1aa03abc0 2024-05-08T05:51:01.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.449+0000 7fd93b400700 1 -- 172.21.15.82:0/1845269836 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd94002c900 con 0x55c1aa03abc0 2024-05-08T05:51:01.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.450+0000 7fd93b400700 1 -- 172.21.15.82:0/1845269836 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7fd94002a040 con 0x55c1aa03abc0 2024-05-08T05:51:01.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.450+0000 7fd966f70b80 10 client.25237 fetch_fsmap finished waiting for FSMap version 30 2024-05-08T05:51:01.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.450+0000 7fd966f70b80 10 client.25237 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:51:01.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.450+0000 7fd966f70b80 20 client.25237 populate_metadata read hostname 'smithi082' 2024-05-08T05:51:01.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.450+0000 7fd966f70b80 1 --2- 172.21.15.82:0/1845269836 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55c1aa0c2a20 0x55c1aa0c4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:01.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.450+0000 7fd966f70b80 4 client.25237 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-08T05:51:01.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.450+0000 7fd966f70b80 1 -- 172.21.15.82:0/1845269836 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c1a9f95400 con 0x55c1aa0c2a20 2024-05-08T05:51:01.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.451+0000 7fd959c00700 1 --2- 172.21.15.82:0/1845269836 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55c1aa0c2a20 0x55c1aa0c4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:01.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.451+0000 7fd959c00700 1 --2- 172.21.15.82:0/1845269836 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55c1aa0c2a20 0x55c1aa0c4e40 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=473606403ad1de24 server_cookie=2d62eea13eb60f64 in_seq=0 out_seq=0 2024-05-08T05:51:01.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.451+0000 7fd93b400700 10 client.25237 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:51:01.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.451+0000 7fd93b400700 1 -- 172.21.15.82:0/1845269836 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55c1a9f95400 con 0x55c1aa0c2a20 2024-05-08T05:51:01.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.452+0000 7fd93b400700 10 client.25237 handle_command_reply: tid=0 2024-05-08T05:51:01.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.452+0000 7fd966f70b80 1 client.25237 shutdown 2024-05-08T05:51:01.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.452+0000 7fd966f70b80 1 -- 172.21.15.82:0/1845269836 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1aa03abc0 msgr2=0x55c1aa05f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:01.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.452+0000 7fd966f70b80 1 --2- 172.21.15.82:0/1845269836 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1aa03abc0 0x55c1aa05f230 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd94000c010 tx=0x7fd94000bbe0 comp rx=0 tx=0).stop 2024-05-08T05:51:01.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.452+0000 7fd966f70b80 1 -- 172.21.15.82:0/1845269836 shutdown_connections 2024-05-08T05:51:01.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.452+0000 7fd966f70b80 1 --2- 172.21.15.82:0/1845269836 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55c1aa0c2a20 0x55c1aa0c4e40 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:01.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.452+0000 7fd966f70b80 1 --2- 172.21.15.82:0/1845269836 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c1aa03b4e0 0x55c1aa0c0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:01.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.452+0000 7fd966f70b80 1 --2- 172.21.15.82:0/1845269836 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c1aa0358f0 0x55c1aa05ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:01.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.452+0000 7fd966f70b80 1 --2- 172.21.15.82:0/1845269836 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c1aa03abc0 0x55c1aa05f230 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:01.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.452+0000 7fd966f70b80 1 -- 172.21.15.82:0/1845269836 >> 172.21.15.82:0/1845269836 conn(0x55c1a9fad6d0 msgr2=0x55c1aa03fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:51:01.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.452+0000 7fd93b400700 0 client.25237 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:51:01.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.453+0000 7fd966f70b80 1 -- 172.21.15.82:0/1845269836 shutdown_connections 2024-05-08T05:51:01.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.453+0000 7fd966f70b80 1 -- 172.21.15.82:0/1845269836 wait complete. 2024-05-08T05:51:01.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.453+0000 7fd966f70b80 20 client.25237 trim_cache size 0 max 16384 2024-05-08T05:51:01.456 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T05:51:01.456 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "no active scrubs running", 2024-05-08T05:51:01.456 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": {} 2024-05-08T05:51:01.456 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T05:51:01.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.454+0000 7fd95c600700 1 -- 172.21.15.82:0/1202798421 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd93c0b2a90 msgr2=0x7fd93c0b4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:01.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.454+0000 7fd95c600700 1 --2- 172.21.15.82:0/1202798421 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd93c0b2a90 0x7fd93c0b4f50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd94000b350 tx=0x7fd94000b2c0 comp rx=0 tx=0).stop 2024-05-08T05:51:01.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.454+0000 7fd95c600700 1 -- 172.21.15.82:0/1202798421 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd95410fed0 msgr2=0x7fd9541a0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:01.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.454+0000 7fd95c600700 1 --2- 172.21.15.82:0/1202798421 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd95410fed0 0x7fd9541a0610 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd94c00d750 tx=0x7fd94c00db10 comp rx=0 tx=0).stop 2024-05-08T05:51:01.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.454+0000 7fd95c600700 1 -- 172.21.15.82:0/1202798421 shutdown_connections 2024-05-08T05:51:01.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.455+0000 7fd95c600700 1 --2- 172.21.15.82:0/1202798421 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd95410fed0 0x7fd9541a0610 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:01.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.455+0000 7fd95c600700 1 --2- 172.21.15.82:0/1202798421 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd93c0b2a90 0x7fd93c0b4f50 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:01.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.455+0000 7fd95c600700 1 --2- 172.21.15.82:0/1202798421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd9540756d0 0x7fd95419bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:01.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.455+0000 7fd95c600700 1 --2- 172.21.15.82:0/1202798421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd954075ff0 0x7fd95419c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:01.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.455+0000 7fd95c600700 1 -- 172.21.15.82:0/1202798421 >> 172.21.15.82:0/1202798421 conn(0x7fd95407a650 msgr2=0x7fd954100640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:51:01.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.455+0000 7fd95c600700 1 -- 172.21.15.82:0/1202798421 shutdown_connections 2024-05-08T05:51:01.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:01.455+0000 7fd95c600700 1 -- 172.21.15.82:0/1202798421 wait complete. 2024-05-08T05:51:01.722 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:51:01 smithi082 ceph-mon[30098]: pgmap v470: 97 pgs: 97 active+clean; 897 MiB data, 768 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 28 MiB/s wr, 393 op/s 2024-05-08T05:51:01.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:51:01 smithi151 ceph-mon[34815]: pgmap v470: 97 pgs: 97 active+clean; 897 MiB data, 768 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 28 MiB/s wr, 393 op/s 2024-05-08T05:51:02.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:51:01 smithi134 ceph-mon[34132]: pgmap v470: 97 pgs: 97 active+clean; 897 MiB data, 768 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 28 MiB/s wr, 393 op/s 2024-05-08T05:51:02.430 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-08T05:51:02.430 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T05:51:03.082 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:51:03.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:51:03 smithi151 ceph-mon[34815]: pgmap v471: 97 pgs: 97 active+clean; 905 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 16 MiB/s wr, 429 op/s 2024-05-08T05:51:03.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:51:03 smithi082 ceph-mon[30098]: pgmap v471: 97 pgs: 97 active+clean; 905 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 16 MiB/s wr, 429 op/s 2024-05-08T05:51:03.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:51:03 smithi134 ceph-mon[34132]: pgmap v471: 97 pgs: 97 active+clean; 905 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 16 MiB/s wr, 429 op/s 2024-05-08T05:51:05.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 15.0 s, 2995.8 tps, lat 33.250 ms stddev 36.889 2024-05-08T05:51:05.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:05.406+0000 7f2c50400700 1 -- 172.21.15.82:0/1723973179 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c4806b1b0 msgr2=0x7f2c4806b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:05.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:05.406+0000 7f2c50400700 1 --2- 172.21.15.82:0/1723973179 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c4806b1b0 0x7f2c4806b590 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c0098f0 tx=0x7f2c3c009c00 comp rx=0 tx=0).stop 2024-05-08T05:51:05.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:05.407+0000 7f2c50400700 1 -- 172.21.15.82:0/1723973179 shutdown_connections 2024-05-08T05:51:05.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:05.407+0000 7f2c50400700 1 --2- 172.21.15.82:0/1723973179 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c4810ff50 0x7f2c48112340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:05.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:05.407+0000 7f2c50400700 1 --2- 172.21.15.82:0/1723973179 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c4806b1b0 0x7f2c4806b590 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:05.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:05.407+0000 7f2c50400700 1 --2- 172.21.15.82:0/1723973179 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c4806bad0 0x7f2c4810fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:05.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:05.407+0000 7f2c50400700 1 -- 172.21.15.82:0/1723973179 >> 172.21.15.82:0/1723973179 conn(0x7f2c48079350 msgr2=0x7f2c48079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:51:05.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:05.407+0000 7f2c50400700 1 -- 172.21.15.82:0/1723973179 shutdown_connections 2024-05-08T05:51:05.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:05.407+0000 7f2c50400700 1 -- 172.21.15.82:0/1723973179 wait complete. 2024-05-08T05:51:05.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:05.409+0000 7f2c50400700 1 Processor -- start 2024-05-08T05:51:05.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:05.410+0000 7f2c50400700 1 -- start start 2024-05-08T05:51:05.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:05.410+0000 7f2c50400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c4806b1b0 0x7f2c48109050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:05.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:05.410+0000 7f2c50400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c4806bad0 0x7f2c48109590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:05.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:05.410+0000 7f2c50400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c4810ff50 0x7f2c481045b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:05.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:05.410+0000 7f2c50400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2c481158f0 con 0x7f2c4806b1b0 2024-05-08T05:51:05.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:05.410+0000 7f2c50400700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2c48115770 con 0x7f2c4810ff50 2024-05-08T05:51:05.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:05.410+0000 7f2c50400700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2c48115a70 con 0x7f2c4806bad0 2024-05-08T05:51:05.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:05.411+0000 7f2c4d000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c4806bad0 0x7f2c48109590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:05.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:05.411+0000 7f2c4da00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c4806b1b0 0x7f2c48109050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:05.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:05.411+0000 7f2c4d000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c4806bad0 0x7f2c48109590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:54076/0 (socket says 172.21.15.82:54076) 2024-05-08T05:51:05.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:05.411+0000 7f2c4d000700 1 -- 172.21.15.82:0/2232976827 learned_addr learned my addr 172.21.15.82:0/2232976827 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:51:05.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:05.411+0000 7f2c4e400700 1 --2- 172.21.15.82:0/2232976827 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c4810ff50 0x7f2c481045b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:05.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:05.412+0000 7f2c4e400700 1 -- 172.21.15.82:0/2232976827 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c4806bad0 msgr2=0x7f2c48109590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:05.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:05.412+0000 7f2c4e400700 1 --2- 172.21.15.82:0/2232976827 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c4806bad0 0x7f2c48109590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:05.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:05.412+0000 7f2c4e400700 1 -- 172.21.15.82:0/2232976827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c4806b1b0 msgr2=0x7f2c48109050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:05.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:05.412+0000 7f2c4e400700 1 --2- 172.21.15.82:0/2232976827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c4806b1b0 0x7f2c48109050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:05.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:05.412+0000 7f2c4e400700 1 -- 172.21.15.82:0/2232976827 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c48104eb0 con 0x7f2c4810ff50 2024-05-08T05:51:05.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:05.412+0000 7f2c4d000700 1 --2- 172.21.15.82:0/2232976827 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c4806bad0 0x7f2c48109590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:51:05.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:05.412+0000 7f2c4e400700 1 --2- 172.21.15.82:0/2232976827 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c4810ff50 0x7f2c481045b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2c4000cc20 tx=0x7f2c4000cf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:51:05.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:05.413+0000 7f2c46000700 1 -- 172.21.15.82:0/2232976827 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c40016020 con 0x7f2c4810ff50 2024-05-08T05:51:05.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:05.413+0000 7f2c46000700 1 -- 172.21.15.82:0/2232976827 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c40012420 con 0x7f2c4810ff50 2024-05-08T05:51:05.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:05.413+0000 7f2c50400700 1 -- 172.21.15.82:0/2232976827 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c481051a0 con 0x7f2c4810ff50 2024-05-08T05:51:05.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:05.413+0000 7f2c46000700 1 -- 172.21.15.82:0/2232976827 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c400115c0 con 0x7f2c4810ff50 2024-05-08T05:51:05.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:05.413+0000 7f2c50400700 1 -- 172.21.15.82:0/2232976827 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c4810ef40 con 0x7f2c4810ff50 2024-05-08T05:51:05.417 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:05.416+0000 7f2c50400700 1 -- 172.21.15.82:0/2232976827 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c481029c0 con 0x7f2c4810ff50 2024-05-08T05:51:05.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:05.419+0000 7f2c46000700 1 -- 172.21.15.82:0/2232976827 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) ==== 149703+0+0 (secure 0 0 0) 0x7f2c40019020 con 0x7f2c4810ff50 2024-05-08T05:51:05.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:05.421+0000 7f2c46000700 1 --2- 172.21.15.82:0/2232976827 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2c300b2a90 0x7f2c300b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:05.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:05.422+0000 7f2c46000700 1 -- 172.21.15.82:0/2232976827 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2c400e2020 con 0x7f2c4810ff50 2024-05-08T05:51:05.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:05.422+0000 7f2c4da00700 1 --2- 172.21.15.82:0/2232976827 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2c300b2a90 0x7f2c300b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:05.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:05.424+0000 7f2c4da00700 1 --2- 172.21.15.82:0/2232976827 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2c300b2a90 0x7f2c300b4f50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c009680 tx=0x7f2c3c019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:51:05.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:05.425+0000 7f2c46000700 1 -- 172.21.15.82:0/2232976827 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2c40020020 con 0x7f2c4810ff50 2024-05-08T05:51:05.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:51:05 smithi151 ceph-mon[34815]: pgmap v472: 97 pgs: 97 active+clean; 919 MiB data, 813 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 15 MiB/s wr, 536 op/s 2024-05-08T05:51:05.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:05.895+0000 7f2c50400700 1 -- 172.21.15.82:0/2232976827 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2c481056a0 con 0x7f2c4810ff50 2024-05-08T05:51:05.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:05.897+0000 7f2c46000700 1 -- 172.21.15.82:0/2232976827 <== mon.2 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11949 (secure 0 0 0) 0x7f2c400a9ca0 con 0x7f2c4810ff50 2024-05-08T05:51:05.897 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:51:05 smithi082 ceph-mon[30098]: pgmap v472: 97 pgs: 97 active+clean; 919 MiB data, 813 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 15 MiB/s wr, 536 op/s 2024-05-08T05:51:05.898 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:51:05.898 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14364,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3876883250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3876883250},{"type":"v1","addr":"172.21.15.82:6835","nonce":3876883250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1965070586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1965070586},{"type":"v1","addr":"172.21.15.82:6837","nonce":1965070586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T05:45:57.654009+0000","modified":"2024-05-08T05:50:40.164747+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24505,"mds_2":24487,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14397":{"gid":14397,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/1890720973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1890720973},{"type":"v1","addr":"172.21.15.82:6839","nonce":1890720973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14409":{"gid":14409,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/2957083305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":2957083305},{"type":"v1","addr":"172.21.15.82:6841","nonce":2957083305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6833/3827691638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3827691638},{"type":"v1","addr":"172.21.15.134:6833","nonce":3827691638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6833/3625067797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3625067797},{"type":"v1","addr":"172.21.15.151:6833","nonce":3625067797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/4074163402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4074163402},{"type":"v1","addr":"172.21.15.134:6835","nonce":4074163402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.134:6837/2212411710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2212411710},{"type":"v1","addr":"172.21.15.134:6837","nonce":2212411710}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":17,"addr":"172.21.15.151:6835/2093655929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2093655929},{"type":"v1","addr":"172.21.15.151:6835","nonce":2093655929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6837/4192404464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":4192404464},{"type":"v1","addr":"172.21.15.151:6837","nonce":4192404464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":14,"addr":"172.21.15.151:6839/2963754236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":2963754236},{"type":"v1","addr":"172.21.15.151:6839","nonce":2963754236}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.134:6839/1145270893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1145270893},{"type":"v1","addr":"172.21.15.134:6839","nonce":1145270893}]},"join_fscid":-1,"export_targets":[3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24475,24467,24487,24506,24505]},"id":1}]} 2024-05-08T05:51:05.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:05.900+0000 7f2c50400700 1 -- 172.21.15.82:0/2232976827 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2c300b2a90 msgr2=0x7f2c300b4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:05.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:05.900+0000 7f2c50400700 1 --2- 172.21.15.82:0/2232976827 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2c300b2a90 0x7f2c300b4f50 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2c3c009680 tx=0x7f2c3c019040 comp rx=0 tx=0).stop 2024-05-08T05:51:05.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:05.900+0000 7f2c50400700 1 -- 172.21.15.82:0/2232976827 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c4810ff50 msgr2=0x7f2c481045b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:05.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:05.900+0000 7f2c50400700 1 --2- 172.21.15.82:0/2232976827 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c4810ff50 0x7f2c481045b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2c4000cc20 tx=0x7f2c4000cf30 comp rx=0 tx=0).stop 2024-05-08T05:51:05.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:05.900+0000 7f2c50400700 1 -- 172.21.15.82:0/2232976827 shutdown_connections 2024-05-08T05:51:05.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:05.900+0000 7f2c50400700 1 --2- 172.21.15.82:0/2232976827 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c4810ff50 0x7f2c481045b0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:05.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:05.900+0000 7f2c50400700 1 --2- 172.21.15.82:0/2232976827 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2c300b2a90 0x7f2c300b4f50 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:05.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:05.900+0000 7f2c50400700 1 --2- 172.21.15.82:0/2232976827 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c4806b1b0 0x7f2c48109050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:05.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:05.900+0000 7f2c50400700 1 --2- 172.21.15.82:0/2232976827 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c4806bad0 0x7f2c48109590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:05.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:05.900+0000 7f2c50400700 1 -- 172.21.15.82:0/2232976827 >> 172.21.15.82:0/2232976827 conn(0x7f2c48079350 msgr2=0x7f2c48111360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:51:05.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:05.900+0000 7f2c50400700 1 -- 172.21.15.82:0/2232976827 shutdown_connections 2024-05-08T05:51:05.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:05.900+0000 7f2c50400700 1 -- 172.21.15.82:0/2232976827 wait complete. 2024-05-08T05:51:05.902 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 30 2024-05-08T05:51:05.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:51:05 smithi134 ceph-mon[34132]: pgmap v472: 97 pgs: 97 active+clean; 919 MiB data, 813 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 15 MiB/s wr, 536 op/s 2024-05-08T05:51:06.850 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:51:06 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/2232976827' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:51:06.854 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-05-08T05:51:06.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:51:06 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/2232976827' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:51:06.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:51:06 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/2232976827' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:51:07.454 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:51:07.857 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:51:07 smithi082 ceph-mon[30098]: pgmap v473: 97 pgs: 97 active+clean; 932 MiB data, 849 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 10 MiB/s wr, 635 op/s 2024-05-08T05:51:07.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:51:07 smithi151 ceph-mon[34815]: pgmap v473: 97 pgs: 97 active+clean; 932 MiB data, 849 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 10 MiB/s wr, 635 op/s 2024-05-08T05:51:07.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:51:07 smithi134 ceph-mon[34132]: pgmap v473: 97 pgs: 97 active+clean; 932 MiB data, 849 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 10 MiB/s wr, 635 op/s 2024-05-08T05:51:09.683 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:51:09 smithi082 ceph-mon[30098]: pgmap v474: 97 pgs: 97 active+clean; 934 MiB data, 867 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.3 MiB/s wr, 681 op/s 2024-05-08T05:51:09.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:51:09 smithi151 ceph-mon[34815]: pgmap v474: 97 pgs: 97 active+clean; 934 MiB data, 867 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.3 MiB/s wr, 681 op/s 2024-05-08T05:51:09.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.896+0000 7faa4dc00700 1 -- 172.21.15.82:0/3572732752 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa48104100 msgr2=0x7faa48108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:09.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.896+0000 7faa4dc00700 1 --2- 172.21.15.82:0/3572732752 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa48104100 0x7faa48108120 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7faa30009990 tx=0x7faa30009ca0 comp rx=0 tx=0).stop 2024-05-08T05:51:09.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.898+0000 7faa4dc00700 1 -- 172.21.15.82:0/3572732752 shutdown_connections 2024-05-08T05:51:09.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.898+0000 7faa4dc00700 1 --2- 172.21.15.82:0/3572732752 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa48108850 0x7faa481103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:09.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.898+0000 7faa4dc00700 1 --2- 172.21.15.82:0/3572732752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa48103750 0x7faa48103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:09.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.898+0000 7faa4dc00700 1 --2- 172.21.15.82:0/3572732752 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa48104100 0x7faa48108120 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:09.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.898+0000 7faa4dc00700 1 -- 172.21.15.82:0/3572732752 >> 172.21.15.82:0/3572732752 conn(0x7faa4807a600 msgr2=0x7faa4807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:51:09.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.899+0000 7faa4dc00700 1 -- 172.21.15.82:0/3572732752 shutdown_connections 2024-05-08T05:51:09.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.899+0000 7faa4dc00700 1 -- 172.21.15.82:0/3572732752 wait complete. 2024-05-08T05:51:09.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.901+0000 7faa4dc00700 1 Processor -- start 2024-05-08T05:51:09.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.902+0000 7faa4dc00700 1 -- start start 2024-05-08T05:51:09.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.902+0000 7faa4dc00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa48103750 0x7faa4810f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:09.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.903+0000 7faa4dc00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa48104100 0x7faa4810fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:09.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.903+0000 7faa4dc00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa48108850 0x7faa481a49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:09.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.903+0000 7faa4dc00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7faa48113660 con 0x7faa48108850 2024-05-08T05:51:09.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.903+0000 7faa4dc00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7faa481134e0 con 0x7faa48103750 2024-05-08T05:51:09.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.903+0000 7faa4dc00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7faa481137e0 con 0x7faa48104100 2024-05-08T05:51:09.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.903+0000 7faa46a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa48103750 0x7faa4810f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:09.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.903+0000 7faa46a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa48103750 0x7faa4810f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:53896/0 (socket says 172.21.15.82:53896) 2024-05-08T05:51:09.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.903+0000 7faa46a00700 1 -- 172.21.15.82:0/70606684 learned_addr learned my addr 172.21.15.82:0/70606684 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:51:09.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.903+0000 7faa47400700 1 --2- 172.21.15.82:0/70606684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa48108850 0x7faa481a49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:09.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.904+0000 7faa3fe00700 1 --2- 172.21.15.82:0/70606684 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa48104100 0x7faa4810fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:09.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.904+0000 7faa46a00700 1 -- 172.21.15.82:0/70606684 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa48104100 msgr2=0x7faa4810fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:09.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.904+0000 7faa46a00700 1 --2- 172.21.15.82:0/70606684 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa48104100 0x7faa4810fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:09.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.904+0000 7faa46a00700 1 -- 172.21.15.82:0/70606684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa48108850 msgr2=0x7faa481a49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:09.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.904+0000 7faa46a00700 1 --2- 172.21.15.82:0/70606684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa48108850 0x7faa481a49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:09.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.904+0000 7faa46a00700 1 -- 172.21.15.82:0/70606684 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa481a50d0 con 0x7faa48103750 2024-05-08T05:51:09.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.904+0000 7faa3fe00700 1 --2- 172.21.15.82:0/70606684 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa48104100 0x7faa4810fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:51:09.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.904+0000 7faa46a00700 1 --2- 172.21.15.82:0/70606684 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa48103750 0x7faa4810f6c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7faa3800e9a0 tx=0x7faa3800ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:51:09.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.905+0000 7faa3f400700 1 -- 172.21.15.82:0/70606684 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa3800cbd0 con 0x7faa48103750 2024-05-08T05:51:09.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.905+0000 7faa3f400700 1 -- 172.21.15.82:0/70606684 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa3800cd70 con 0x7faa48103750 2024-05-08T05:51:09.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.905+0000 7faa3f400700 1 -- 172.21.15.82:0/70606684 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa38018680 con 0x7faa48103750 2024-05-08T05:51:09.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.905+0000 7faa4dc00700 1 -- 172.21.15.82:0/70606684 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa481a53c0 con 0x7faa48103750 2024-05-08T05:51:09.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.905+0000 7faa4dc00700 1 -- 172.21.15.82:0/70606684 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa481acc70 con 0x7faa48103750 2024-05-08T05:51:09.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.911+0000 7faa3f400700 1 -- 172.21.15.82:0/70606684 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 19) ==== 149703+0+0 (secure 0 0 0) 0x7faa38018860 con 0x7faa48103750 2024-05-08T05:51:09.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.913+0000 7faa58571b80 1 Processor -- start 2024-05-08T05:51:09.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.913+0000 7faa58571b80 1 -- start start 2024-05-08T05:51:09.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.913+0000 7faa58571b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f838592bc0 0x55f838592fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:09.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.914+0000 7faa58571b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f8385934e0 0x55f83858d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:09.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.914+0000 7faa58571b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f83858d8f0 0x55f83858dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:09.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.914+0000 7faa58571b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f8384dfa20 con 0x55f83858d8f0 2024-05-08T05:51:09.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.914+0000 7faa58571b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f83847d760 con 0x55f8385934e0 2024-05-08T05:51:09.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.914+0000 7faa58571b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55f8384db9e0 con 0x55f838592bc0 2024-05-08T05:51:09.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.914+0000 7faa3fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f83858d8f0 0x55f83858dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:09.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.914+0000 7faa3fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f83858d8f0 0x55f83858dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48734/0 (socket says 172.21.15.82:48734) 2024-05-08T05:51:09.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.914+0000 7faa3fe00700 1 -- 172.21.15.82:0/1203785486 learned_addr learned my addr 172.21.15.82:0/1203785486 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:51:09.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.914+0000 7faa47400700 1 --2- 172.21.15.82:0/1203785486 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f838592bc0 0x55f838592fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:09.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.915+0000 7faa46a00700 1 --2- 172.21.15.82:0/1203785486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f8385934e0 0x55f83858d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:09.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.915+0000 7faa3fe00700 1 -- 172.21.15.82:0/1203785486 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f838592bc0 msgr2=0x55f838592fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:09.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.915+0000 7faa3fe00700 1 --2- 172.21.15.82:0/1203785486 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f838592bc0 0x55f838592fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:09.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.915+0000 7faa3fe00700 1 -- 172.21.15.82:0/1203785486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f8385934e0 msgr2=0x55f83858d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:09.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.915+0000 7faa3fe00700 1 --2- 172.21.15.82:0/1203785486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f8385934e0 0x55f83858d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:09.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.915+0000 7faa3fe00700 1 -- 172.21.15.82:0/1203785486 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f83842c8d0 con 0x55f83858d8f0 2024-05-08T05:51:09.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.916+0000 7faa3fe00700 1 --2- 172.21.15.82:0/1203785486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f83858d8f0 0x55f83858dd70 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7faa3000b2e0 tx=0x7faa3000b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21a8521c5cacb5ea server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:51:09.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.917+0000 7faa37e00700 1 -- 172.21.15.82:0/1203785486 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa30005da0 con 0x55f83858d8f0 2024-05-08T05:51:09.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.918+0000 7faa37e00700 1 -- 172.21.15.82:0/1203785486 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa30005560 con 0x55f83858d8f0 2024-05-08T05:51:09.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.918+0000 7faa37e00700 1 -- 172.21.15.82:0/1203785486 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa30003c10 con 0x55f83858d8f0 2024-05-08T05:51:09.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.918+0000 7faa3f400700 1 --2- 172.21.15.82:0/70606684 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7faa2c0b2a60 0x7faa2c0b4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:09.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.918+0000 7faa3f400700 1 -- 172.21.15.82:0/70606684 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7faa380e2550 con 0x7faa48103750 2024-05-08T05:51:09.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.919+0000 7faa58571b80 1 -- 172.21.15.82:0/1203785486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f83858d8f0 msgr2=0x55f83858dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:09.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.919+0000 7faa58571b80 1 --2- 172.21.15.82:0/1203785486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f83858d8f0 0x55f83858dd70 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7faa3000b2e0 tx=0x7faa3000b650 comp rx=0 tx=0).stop 2024-05-08T05:51:09.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.922+0000 7faa47400700 1 --2- 172.21.15.82:0/70606684 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7faa2c0b2a60 0x7faa2c0b4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:09.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.925+0000 7faa58571b80 1 -- 172.21.15.82:0/1203785486 shutdown_connections 2024-05-08T05:51:09.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.925+0000 7faa58571b80 1 --2- 172.21.15.82:0/1203785486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f83858d8f0 0x55f83858dd70 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:09.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.925+0000 7faa58571b80 1 --2- 172.21.15.82:0/1203785486 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f838592bc0 0x55f838592fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:09.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.925+0000 7faa58571b80 1 --2- 172.21.15.82:0/1203785486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f8385934e0 0x55f83858d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:09.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.925+0000 7faa58571b80 1 -- 172.21.15.82:0/1203785486 >> 172.21.15.82:0/1203785486 conn(0x55f8385056d0 msgr2=0x55f838587b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:51:09.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.926+0000 7faa58571b80 1 -- 172.21.15.82:0/1203785486 shutdown_connections 2024-05-08T05:51:09.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.927+0000 7faa58571b80 1 -- 172.21.15.82:0/1203785486 wait complete. 2024-05-08T05:51:09.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.928+0000 7faa58571b80 1 -- start start 2024-05-08T05:51:09.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.929+0000 7faa58571b80 1 Processor -- start 2024-05-08T05:51:09.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.929+0000 7faa58571b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f83858d8f0 0x55f838599180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:09.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.930+0000 7faa58571b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f838592bc0 0x55f838596520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:09.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.930+0000 7faa58571b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f8385934e0 0x55f838596a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:09.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.930+0000 7faa58571b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f838599e60 con 0x55f83858d8f0 2024-05-08T05:51:09.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.930+0000 7faa58571b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f838445b20 con 0x55f8385934e0 2024-05-08T05:51:09.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.930+0000 7faa58571b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55f838599fe0 con 0x55f838592bc0 2024-05-08T05:51:09.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.931+0000 7faa47400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f8385934e0 0x55f838596a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:09.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.931+0000 7faa47400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f8385934e0 0x55f838596a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:53910/0 (socket says 172.21.15.82:53910) 2024-05-08T05:51:09.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.931+0000 7faa47400700 1 -- 172.21.15.82:0/959241098 learned_addr learned my addr 172.21.15.82:0/959241098 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:51:09.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.931+0000 7faa3fe00700 1 --2- 172.21.15.82:0/959241098 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f838592bc0 0x55f838596520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:09.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.931+0000 7faa47400700 1 -- 172.21.15.82:0/959241098 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f838592bc0 msgr2=0x55f838596520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:09.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.931+0000 7faa47400700 1 --2- 172.21.15.82:0/959241098 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f838592bc0 0x55f838596520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:09.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.931+0000 7faa47400700 1 -- 172.21.15.82:0/959241098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f83858d8f0 msgr2=0x55f838599180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:09.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.932+0000 7faa58571b80 10 client.0 _ll_register_callbacks cb 0x55f838486c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:51:09.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.932+0000 7faa46a00700 1 --2- 172.21.15.82:0/959241098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f83858d8f0 0x55f838599180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:09.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.932+0000 7faa47400700 1 --2- 172.21.15.82:0/959241098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f83858d8f0 0x55f838599180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:09.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.933+0000 7faa47400700 1 -- 172.21.15.82:0/959241098 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8384a5420 con 0x55f8385934e0 2024-05-08T05:51:09.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.933+0000 7faa47400700 1 --2- 172.21.15.82:0/70606684 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7faa2c0b2a60 0x7faa2c0b4f20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7faa400094c0 tx=0x7faa40009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:51:09.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.933+0000 7faa58571b80 1 -- 172.21.15.82:0/959241098 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa30005560 con 0x55f8385934e0 2024-05-08T05:51:09.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.933+0000 7faa46a00700 1 --2- 172.21.15.82:0/959241098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f83858d8f0 0x55f838599180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:51:09.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.933+0000 7faa34c00700 10 client.25235 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:51:09.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.933+0000 7faa47400700 1 --2- 172.21.15.82:0/959241098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f8385934e0 0x55f838596a60 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7faa40009fd0 tx=0x7faa40004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=174ab4a7f60a8a1b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:51:09.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.934+0000 7faa34c00700 1 -- 172.21.15.82:0/959241098 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa40003a00 con 0x55f8385934e0 2024-05-08T05:51:09.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.934+0000 7faa34c00700 1 -- 172.21.15.82:0/959241098 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7faa40028020 con 0x55f8385934e0 2024-05-08T05:51:09.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.936+0000 7faa34c00700 1 -- 172.21.15.82:0/959241098 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7faa40003a00 con 0x55f8385934e0 2024-05-08T05:51:09.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.936+0000 7faa58571b80 10 client.25235 fetch_fsmap learned FSMap version 30 2024-05-08T05:51:09.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.936+0000 7faa58571b80 1 -- 172.21.15.82:0/959241098 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({fsmap=30}) -- 0x55f8385a4660 con 0x55f8385934e0 2024-05-08T05:51:09.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.937+0000 7faa34c00700 1 -- 172.21.15.82:0/959241098 <== mon.2 v2:172.21.15.134:3300/0 4 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7faa40017960 con 0x55f8385934e0 2024-05-08T05:51:09.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.937+0000 7faa58571b80 10 client.25235 fetch_fsmap finished waiting for FSMap version 30 2024-05-08T05:51:09.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.937+0000 7faa58571b80 10 client.25235 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-05-08T05:51:09.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.937+0000 7faa58571b80 20 client.25235 populate_metadata read hostname 'smithi082' 2024-05-08T05:51:09.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.937+0000 7faa58571b80 1 --2- 172.21.15.82:0/959241098 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x55f8385a7100 0x55f8385a95a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:09.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.937+0000 7faa58571b80 4 client.25235 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:51:09.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.937+0000 7faa58571b80 1 -- 172.21.15.82:0/959241098 --> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f83855a140 con 0x55f8385a7100 2024-05-08T05:51:09.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.938+0000 7faa46a00700 1 --2- 172.21.15.82:0/959241098 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x55f8385a7100 0x55f8385a95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:09.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.939+0000 7faa34c00700 10 client.25235 ms_handle_connect on v2:172.21.15.134:6836/2212411710 2024-05-08T05:51:09.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.939+0000 7faa46a00700 1 --2- 172.21.15.82:0/959241098 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x55f8385a7100 0x55f8385a95a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e224a64b1fb42cc8 server_cookie=8a229cdda44909c3 in_seq=0 out_seq=0 2024-05-08T05:51:09.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.940+0000 7faa34c00700 1 -- 172.21.15.82:0/959241098 <== mds.4 v2:172.21.15.134:6836/2212411710 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f83855a140 con 0x55f8385a7100 2024-05-08T05:51:09.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.940+0000 7faa34c00700 10 client.25235 handle_command_reply: tid=0 2024-05-08T05:51:09.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.940+0000 7faa58571b80 1 client.25235 shutdown 2024-05-08T05:51:09.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.941+0000 7faa58571b80 1 -- 172.21.15.82:0/959241098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f8385934e0 msgr2=0x55f838596a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:09.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.941+0000 7faa58571b80 1 --2- 172.21.15.82:0/959241098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f8385934e0 0x55f838596a60 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7faa40009fd0 tx=0x7faa40004b40 comp rx=0 tx=0).stop 2024-05-08T05:51:09.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.942+0000 7faa58571b80 1 -- 172.21.15.82:0/959241098 shutdown_connections 2024-05-08T05:51:09.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.942+0000 7faa58571b80 1 --2- 172.21.15.82:0/959241098 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x55f8385a7100 0x55f8385a95a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:09.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.942+0000 7faa34c00700 0 client.25235 ms_handle_reset on v2:172.21.15.134:6836/2212411710 2024-05-08T05:51:09.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.942+0000 7faa58571b80 1 --2- 172.21.15.82:0/959241098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f8385934e0 0x55f838596a60 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:09.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.942+0000 7faa58571b80 1 --2- 172.21.15.82:0/959241098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f83858d8f0 0x55f838599180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:09.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.942+0000 7faa58571b80 1 --2- 172.21.15.82:0/959241098 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f838592bc0 0x55f838596520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:09.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.942+0000 7faa58571b80 1 -- 172.21.15.82:0/959241098 >> 172.21.15.82:0/959241098 conn(0x55f8385056d0 msgr2=0x55f838587190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:51:09.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.942+0000 7faa58571b80 1 -- 172.21.15.82:0/959241098 shutdown_connections 2024-05-08T05:51:09.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.943+0000 7faa58571b80 1 -- 172.21.15.82:0/959241098 wait complete. 2024-05-08T05:51:09.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.943+0000 7faa58571b80 20 client.25235 trim_cache size 0 max 16384 2024-05-08T05:51:09.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.982+0000 7faa58571b80 1 Processor -- start 2024-05-08T05:51:09.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.982+0000 7faa58571b80 1 -- start start 2024-05-08T05:51:09.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.983+0000 7faa58571b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f83858d8f0 0x55f838594150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:09.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.983+0000 7faa58571b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f838592bc0 0x55f8385a2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:09.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.983+0000 7faa58571b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f8385934e0 0x55f8385954a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:09.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.983+0000 7faa58571b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7faa2400d3b0 con 0x55f83858d8f0 2024-05-08T05:51:09.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.983+0000 7faa58571b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7faa2400ef20 con 0x55f838592bc0 2024-05-08T05:51:09.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.983+0000 7faa58571b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7faa2400da80 con 0x55f8385934e0 2024-05-08T05:51:09.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.983+0000 7faa3fe00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f838592bc0 0x55f8385a2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:09.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.983+0000 7faa46a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f83858d8f0 0x55f838594150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:09.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.984+0000 7faa3fe00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f838592bc0 0x55f8385a2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:53918/0 (socket says 172.21.15.82:53918) 2024-05-08T05:51:09.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.984+0000 7faa3fe00700 1 -- 172.21.15.82:0/2874477594 learned_addr learned my addr 172.21.15.82:0/2874477594 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:51:09.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.984+0000 7faa3fe00700 1 -- 172.21.15.82:0/2874477594 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f8385934e0 msgr2=0x55f8385954a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T05:51:09.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.984+0000 7faa3fe00700 1 --2- 172.21.15.82:0/2874477594 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f8385934e0 0x55f8385954a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:09.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.984+0000 7faa3fe00700 1 -- 172.21.15.82:0/2874477594 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f83858d8f0 msgr2=0x55f838594150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:09.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.984+0000 7faa3fe00700 1 --2- 172.21.15.82:0/2874477594 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f83858d8f0 0x55f838594150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:09.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.984+0000 7faa3fe00700 1 -- 172.21.15.82:0/2874477594 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8385931f0 con 0x55f838592bc0 2024-05-08T05:51:09.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.984+0000 7faa3fe00700 1 --2- 172.21.15.82:0/2874477594 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f838592bc0 0x55f8385a2f80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7faa30009ce0 tx=0x7faa3000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1797803158990d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:51:09.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.985+0000 7faa37400700 1 -- 172.21.15.82:0/2874477594 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa300050b0 con 0x55f838592bc0 2024-05-08T05:51:09.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.985+0000 7faa37400700 1 -- 172.21.15.82:0/2874477594 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa30005250 con 0x55f838592bc0 2024-05-08T05:51:09.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.986+0000 7faa58571b80 1 -- 172.21.15.82:0/2874477594 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f838592bc0 msgr2=0x55f8385a2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:09.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.986+0000 7faa58571b80 1 --2- 172.21.15.82:0/2874477594 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f838592bc0 0x55f8385a2f80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7faa30009ce0 tx=0x7faa3000b330 comp rx=0 tx=0).stop 2024-05-08T05:51:09.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.986+0000 7faa58571b80 1 -- 172.21.15.82:0/2874477594 shutdown_connections 2024-05-08T05:51:09.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.986+0000 7faa58571b80 1 --2- 172.21.15.82:0/2874477594 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f8385934e0 0x55f8385954a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:09.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.986+0000 7faa58571b80 1 --2- 172.21.15.82:0/2874477594 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f83858d8f0 0x55f838594150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:09.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.986+0000 7faa58571b80 1 --2- 172.21.15.82:0/2874477594 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f838592bc0 0x55f8385a2f80 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:09.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.986+0000 7faa58571b80 1 -- 172.21.15.82:0/2874477594 >> 172.21.15.82:0/2874477594 conn(0x55f8385056d0 msgr2=0x55f8385916e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:51:09.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.987+0000 7faa58571b80 1 -- 172.21.15.82:0/2874477594 shutdown_connections 2024-05-08T05:51:09.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.987+0000 7faa58571b80 1 -- 172.21.15.82:0/2874477594 wait complete. 2024-05-08T05:51:09.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.988+0000 7faa58571b80 1 -- start start 2024-05-08T05:51:09.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.988+0000 7faa58571b80 1 Processor -- start 2024-05-08T05:51:09.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.989+0000 7faa58571b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f83858d8f0 0x55f83859f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:09.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.989+0000 7faa58571b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f838592bc0 0x55f83859f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:09.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.989+0000 7faa3fe00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f838592bc0 0x55f83859f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:09.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.989+0000 7faa3fe00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f838592bc0 0x55f83859f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:53932/0 (socket says 172.21.15.82:53932) 2024-05-08T05:51:09.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.989+0000 7faa3fe00700 1 -- 172.21.15.82:0/526381241 learned_addr learned my addr 172.21.15.82:0/526381241 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:51:09.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.989+0000 7faa58571b80 1 --2- 172.21.15.82:0/526381241 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f8385934e0 0x55f8385adea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:09.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.989+0000 7faa58571b80 1 -- 172.21.15.82:0/526381241 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7faa2400e820 con 0x55f83858d8f0 2024-05-08T05:51:09.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.989+0000 7faa58571b80 1 -- 172.21.15.82:0/526381241 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7faa2400e150 con 0x55f838592bc0 2024-05-08T05:51:09.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.989+0000 7faa58571b80 1 -- 172.21.15.82:0/526381241 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7faa2400b2f0 con 0x55f8385934e0 2024-05-08T05:51:09.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.990+0000 7faa58571b80 10 client.0 _ll_register_callbacks cb 0x55f838486c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:51:09.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.990+0000 7faa3fe00700 1 -- 172.21.15.82:0/526381241 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f8385934e0 msgr2=0x55f8385adea0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T05:51:09.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.990+0000 7faa3fe00700 1 --2- 172.21.15.82:0/526381241 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f8385934e0 0x55f8385adea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:09.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.990+0000 7faa46a00700 1 --2- 172.21.15.82:0/526381241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f83858d8f0 0x55f83859f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:09.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.990+0000 7faa3fe00700 1 -- 172.21.15.82:0/526381241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f83858d8f0 msgr2=0x55f83859f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:09.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.990+0000 7faa3fe00700 1 --2- 172.21.15.82:0/526381241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f83858d8f0 0x55f83859f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:09.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.990+0000 7faa3fe00700 1 -- 172.21.15.82:0/526381241 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8385ae690 con 0x55f838592bc0 2024-05-08T05:51:09.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.990+0000 7faa3fe00700 1 --2- 172.21.15.82:0/526381241 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f838592bc0 0x55f83859f840 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7faa30023040 tx=0x7faa30003940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71a984e19a018a84 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:51:09.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.990+0000 7faa34c00700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:51:09.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.991+0000 7faa34c00700 1 -- 172.21.15.82:0/526381241 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa3002c880 con 0x55f838592bc0 2024-05-08T05:51:09.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.991+0000 7faa34c00700 1 -- 172.21.15.82:0/526381241 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7faa3002ca20 con 0x55f838592bc0 2024-05-08T05:51:09.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.991+0000 7faa58571b80 1 -- 172.21.15.82:0/526381241 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa30005250 con 0x55f838592bc0 2024-05-08T05:51:09.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.991+0000 7faa34c00700 1 -- 172.21.15.82:0/526381241 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7faa30005da0 con 0x55f838592bc0 2024-05-08T05:51:09.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.991+0000 7faa58571b80 10 client.25241 fetch_fsmap learned FSMap version 30 2024-05-08T05:51:09.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.991+0000 7faa58571b80 1 -- 172.21.15.82:0/526381241 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55f838611520 con 0x55f838592bc0 2024-05-08T05:51:09.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.992+0000 7faa34c00700 1 -- 172.21.15.82:0/526381241 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faa30005250 con 0x55f838592bc0 2024-05-08T05:51:09.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.992+0000 7faa34c00700 1 -- 172.21.15.82:0/526381241 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7faa3000f910 con 0x55f838592bc0 2024-05-08T05:51:09.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.992+0000 7faa58571b80 10 client.25241 fetch_fsmap finished waiting for FSMap version 30 2024-05-08T05:51:09.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.992+0000 7faa58571b80 10 client.25241 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-05-08T05:51:09.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.992+0000 7faa58571b80 20 client.25241 populate_metadata read hostname 'smithi082' 2024-05-08T05:51:09.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.992+0000 7faa58571b80 1 --2- 172.21.15.82:0/526381241 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x55f8385a7100 0x55f838613700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:09.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.992+0000 7faa58571b80 4 client.25241 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:51:09.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.992+0000 7faa58571b80 1 -- 172.21.15.82:0/526381241 --> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f8384ed400 con 0x55f8385a7100 2024-05-08T05:51:09.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.993+0000 7faa46a00700 1 --2- 172.21.15.82:0/526381241 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x55f8385a7100 0x55f838613700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:09.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.994+0000 7faa46a00700 1 --2- 172.21.15.82:0/526381241 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x55f8385a7100 0x55f838613700 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8f3a8ebbddf9d4ce server_cookie=c5f55461431b6295 in_seq=0 out_seq=0 2024-05-08T05:51:09.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.994+0000 7faa34c00700 10 client.25241 ms_handle_connect on v2:172.21.15.134:6836/2212411710 2024-05-08T05:51:09.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.994+0000 7faa34c00700 1 -- 172.21.15.82:0/526381241 <== mds.4 v2:172.21.15.134:6836/2212411710 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f8384ed400 con 0x55f8385a7100 2024-05-08T05:51:09.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.994+0000 7faa34c00700 10 client.25241 handle_command_reply: tid=0 2024-05-08T05:51:09.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.995+0000 7faa58571b80 1 client.25241 shutdown 2024-05-08T05:51:09.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.995+0000 7faa58571b80 1 -- 172.21.15.82:0/526381241 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f838592bc0 msgr2=0x55f83859f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:09.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.995+0000 7faa58571b80 1 --2- 172.21.15.82:0/526381241 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f838592bc0 0x55f83859f840 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7faa30023040 tx=0x7faa30003940 comp rx=0 tx=0).stop 2024-05-08T05:51:09.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.995+0000 7faa58571b80 1 -- 172.21.15.82:0/526381241 shutdown_connections 2024-05-08T05:51:09.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.995+0000 7faa58571b80 1 --2- 172.21.15.82:0/526381241 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x55f8385a7100 0x55f838613700 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:09.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.995+0000 7faa58571b80 1 --2- 172.21.15.82:0/526381241 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f8385934e0 0x55f8385adea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:09.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.995+0000 7faa34c00700 0 client.25241 ms_handle_reset on v2:172.21.15.134:6836/2212411710 2024-05-08T05:51:09.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.996+0000 7faa58571b80 1 --2- 172.21.15.82:0/526381241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f83858d8f0 0x55f83859f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:09.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.996+0000 7faa58571b80 1 --2- 172.21.15.82:0/526381241 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f838592bc0 0x55f83859f840 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:09.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.996+0000 7faa58571b80 1 -- 172.21.15.82:0/526381241 >> 172.21.15.82:0/526381241 conn(0x55f8385056d0 msgr2=0x55f838598380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:51:09.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.996+0000 7faa58571b80 1 -- 172.21.15.82:0/526381241 shutdown_connections 2024-05-08T05:51:09.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.996+0000 7faa58571b80 1 -- 172.21.15.82:0/526381241 wait complete. 2024-05-08T05:51:09.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.996+0000 7faa58571b80 20 client.25241 trim_cache size 0 max 16384 2024-05-08T05:51:09.998 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T05:51:09.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.998+0000 7faa4dc00700 1 -- 172.21.15.82:0/70606684 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7faa2c0b2a60 msgr2=0x7faa2c0b4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:09.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.998+0000 7faa4dc00700 1 --2- 172.21.15.82:0/70606684 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7faa2c0b2a60 0x7faa2c0b4f20 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7faa400094c0 tx=0x7faa40009040 comp rx=0 tx=0).stop 2024-05-08T05:51:09.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.998+0000 7faa4dc00700 1 -- 172.21.15.82:0/70606684 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa48103750 msgr2=0x7faa4810f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:09.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.998+0000 7faa4dc00700 1 --2- 172.21.15.82:0/70606684 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa48103750 0x7faa4810f6c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7faa3800e9a0 tx=0x7faa3800ed60 comp rx=0 tx=0).stop 2024-05-08T05:51:09.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.998+0000 7faa4dc00700 1 -- 172.21.15.82:0/70606684 shutdown_connections 2024-05-08T05:51:09.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.998+0000 7faa4dc00700 1 --2- 172.21.15.82:0/70606684 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa48103750 0x7faa4810f6c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:09.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.998+0000 7faa4dc00700 1 --2- 172.21.15.82:0/70606684 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7faa2c0b2a60 0x7faa2c0b4f20 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:09.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.998+0000 7faa4dc00700 1 --2- 172.21.15.82:0/70606684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faa48108850 0x7faa481a49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:09.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.998+0000 7faa4dc00700 1 --2- 172.21.15.82:0/70606684 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa48104100 0x7faa4810fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:09.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.998+0000 7faa4dc00700 1 -- 172.21.15.82:0/70606684 >> 172.21.15.82:0/70606684 conn(0x7faa4807a600 msgr2=0x7faa48101490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:51:10.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:51:09 smithi134 ceph-mon[34132]: pgmap v474: 97 pgs: 97 active+clean; 934 MiB data, 867 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.3 MiB/s wr, 681 op/s 2024-05-08T05:51:10.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.999+0000 7faa4dc00700 1 -- 172.21.15.82:0/70606684 shutdown_connections 2024-05-08T05:51:10.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:09.999+0000 7faa4dc00700 1 -- 172.21.15.82:0/70606684 wait complete. 2024-05-08T05:51:10.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 20.0 s, 3003.7 tps, lat 33.302 ms stddev 36.222 2024-05-08T05:51:10.923 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-05-08T05:51:11.534 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:51:11.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:51:11 smithi151 ceph-mon[34815]: pgmap v475: 97 pgs: 97 active+clean; 936 MiB data, 904 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 MiB/s wr, 851 op/s 2024-05-08T05:51:11.918 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:51:11 smithi082 ceph-mon[30098]: pgmap v475: 97 pgs: 97 active+clean; 936 MiB data, 904 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 MiB/s wr, 851 op/s 2024-05-08T05:51:11.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:51:11 smithi134 ceph-mon[34132]: pgmap v475: 97 pgs: 97 active+clean; 936 MiB data, 904 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 MiB/s wr, 851 op/s 2024-05-08T05:51:13.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:51:13 smithi151 ceph-mon[34815]: pgmap v476: 97 pgs: 97 active+clean; 942 MiB data, 912 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.3 MiB/s wr, 669 op/s 2024-05-08T05:51:13.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:51:13 smithi082 ceph-mon[30098]: pgmap v476: 97 pgs: 97 active+clean; 942 MiB data, 912 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.3 MiB/s wr, 669 op/s 2024-05-08T05:51:13.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:51:13 smithi134 ceph-mon[34132]: pgmap v476: 97 pgs: 97 active+clean; 942 MiB data, 912 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.3 MiB/s wr, 669 op/s 2024-05-08T05:51:14.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.738+0000 7f00ece00700 1 -- 172.21.15.82:0/2112854932 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00e8075ff0 msgr2=0x7f00e8114130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:14.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.738+0000 7f00ece00700 1 --2- 172.21.15.82:0/2112854932 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00e8075ff0 0x7f00e8114130 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f00d4009990 tx=0x7f00d4009ca0 comp rx=0 tx=0).stop 2024-05-08T05:51:14.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.739+0000 7f00ece00700 1 -- 172.21.15.82:0/2112854932 shutdown_connections 2024-05-08T05:51:14.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.739+0000 7f00ece00700 1 --2- 172.21.15.82:0/2112854932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00e80756d0 0x7f00e8075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:14.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.739+0000 7f00ece00700 1 --2- 172.21.15.82:0/2112854932 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00e8114670 0x7f00e8116a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:14.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.739+0000 7f00ece00700 1 --2- 172.21.15.82:0/2112854932 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00e8075ff0 0x7f00e8114130 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:14.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.739+0000 7f00ece00700 1 -- 172.21.15.82:0/2112854932 >> 172.21.15.82:0/2112854932 conn(0x7f00e807a600 msgr2=0x7f00e807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:51:14.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.739+0000 7f00ece00700 1 -- 172.21.15.82:0/2112854932 shutdown_connections 2024-05-08T05:51:14.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.739+0000 7f00ece00700 1 -- 172.21.15.82:0/2112854932 wait complete. 2024-05-08T05:51:14.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.741+0000 7f00ece00700 1 Processor -- start 2024-05-08T05:51:14.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.741+0000 7f00ece00700 1 -- start start 2024-05-08T05:51:14.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.741+0000 7f00ece00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00e80756d0 0x7f00e81a0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:14.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.741+0000 7f00ece00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00e8075ff0 0x7f00e81a07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:14.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.741+0000 7f00ece00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00e8114670 0x7f00e81a4b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:14.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.741+0000 7f00ece00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f00e8119cb0 con 0x7f00e8114670 2024-05-08T05:51:14.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.741+0000 7f00ece00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f00e8119b30 con 0x7f00e80756d0 2024-05-08T05:51:14.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.741+0000 7f00ece00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f00e8119e30 con 0x7f00e8075ff0 2024-05-08T05:51:14.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.742+0000 7f00e5e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00e80756d0 0x7f00e81a0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:14.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.742+0000 7f00e5e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00e80756d0 0x7f00e81a0260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:45704/0 (socket says 172.21.15.82:45704) 2024-05-08T05:51:14.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.742+0000 7f00e5e00700 1 -- 172.21.15.82:0/2911961561 learned_addr learned my addr 172.21.15.82:0/2911961561 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:51:14.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.742+0000 7f00e5400700 1 --2- 172.21.15.82:0/2911961561 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00e8075ff0 0x7f00e81a07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:14.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.742+0000 7f00e6800700 1 --2- 172.21.15.82:0/2911961561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00e8114670 0x7f00e81a4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:14.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.742+0000 7f00e5e00700 1 -- 172.21.15.82:0/2911961561 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00e8075ff0 msgr2=0x7f00e81a07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:14.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.742+0000 7f00e5e00700 1 --2- 172.21.15.82:0/2911961561 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00e8075ff0 0x7f00e81a07a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:14.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.742+0000 7f00e5e00700 1 -- 172.21.15.82:0/2911961561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00e8114670 msgr2=0x7f00e81a4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:14.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.742+0000 7f00e5e00700 1 --2- 172.21.15.82:0/2911961561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00e8114670 0x7f00e81a4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:14.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.742+0000 7f00e5e00700 1 -- 172.21.15.82:0/2911961561 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00e81a5270 con 0x7f00e80756d0 2024-05-08T05:51:14.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.742+0000 7f00e6800700 1 --2- 172.21.15.82:0/2911961561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00e8114670 0x7f00e81a4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:51:14.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.742+0000 7f00e5e00700 1 --2- 172.21.15.82:0/2911961561 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00e80756d0 0x7f00e81a0260 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f00d800d950 tx=0x7f00d800dd10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:51:14.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.743+0000 7f00dea00700 1 -- 172.21.15.82:0/2911961561 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d8016070 con 0x7f00e80756d0 2024-05-08T05:51:14.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.743+0000 7f00dea00700 1 -- 172.21.15.82:0/2911961561 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00d8010460 con 0x7f00e80756d0 2024-05-08T05:51:14.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.743+0000 7f00dea00700 1 -- 172.21.15.82:0/2911961561 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d800f620 con 0x7f00e80756d0 2024-05-08T05:51:14.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.743+0000 7f00ece00700 1 -- 172.21.15.82:0/2911961561 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00e81a5560 con 0x7f00e80756d0 2024-05-08T05:51:14.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.743+0000 7f00ece00700 1 -- 172.21.15.82:0/2911961561 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00e81acde0 con 0x7f00e80756d0 2024-05-08T05:51:14.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.753+0000 7f00dea00700 1 -- 172.21.15.82:0/2911961561 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f00d8019070 con 0x7f00e80756d0 2024-05-08T05:51:14.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.753+0000 7f00f7693b80 1 Processor -- start 2024-05-08T05:51:14.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.755+0000 7f00f7693b80 1 -- start start 2024-05-08T05:51:14.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.755+0000 7f00f7693b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad755b0bc0 0x55ad755b0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:14.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.755+0000 7f00f7693b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad755b14e0 0x55ad755ab2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:14.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.755+0000 7f00f7693b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ad755ab8f0 0x55ad755abd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:14.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.755+0000 7f00f7693b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55ad754fda20 con 0x55ad755b14e0 2024-05-08T05:51:14.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.755+0000 7f00f7693b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ad7549b760 con 0x55ad755ab8f0 2024-05-08T05:51:14.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.756+0000 7f00f7693b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ad754f99e0 con 0x55ad755b0bc0 2024-05-08T05:51:14.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.756+0000 7f00e5400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ad755ab8f0 0x55ad755abd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:14.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.756+0000 7f00e6800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad755b0bc0 0x55ad755b0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:14.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.756+0000 7f00e5400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ad755ab8f0 0x55ad755abd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:45710/0 (socket says 172.21.15.82:45710) 2024-05-08T05:51:14.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.756+0000 7f00e5400700 1 -- 172.21.15.82:0/4154066037 learned_addr learned my addr 172.21.15.82:0/4154066037 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:51:14.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.756+0000 7f00e5400700 1 -- 172.21.15.82:0/4154066037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad755b0bc0 msgr2=0x55ad755b0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:14.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.756+0000 7f00e5400700 1 --2- 172.21.15.82:0/4154066037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad755b0bc0 0x55ad755b0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:14.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.756+0000 7f00e5400700 1 -- 172.21.15.82:0/4154066037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad755b14e0 msgr2=0x55ad755ab2d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T05:51:14.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.756+0000 7f00dea00700 1 --2- 172.21.15.82:0/2911961561 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f00cc0b2a50 0x7f00cc0b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:14.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.757+0000 7f00e5400700 1 --2- 172.21.15.82:0/4154066037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad755b14e0 0x55ad755ab2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:14.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.757+0000 7f00dea00700 1 -- 172.21.15.82:0/2911961561 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f00d80e1e60 con 0x7f00e80756d0 2024-05-08T05:51:14.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.757+0000 7f00e5400700 1 -- 172.21.15.82:0/4154066037 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad7544a8d0 con 0x55ad755ab8f0 2024-05-08T05:51:14.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.757+0000 7f00e6800700 1 --2- 172.21.15.82:0/4154066037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad755b0bc0 0x55ad755b0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:51:14.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.757+0000 7f00e6800700 1 --2- 172.21.15.82:0/2911961561 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f00cc0b2a50 0x7f00cc0b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:14.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.757+0000 7f00e5400700 1 --2- 172.21.15.82:0/4154066037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ad755ab8f0 0x55ad755abd70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f00d4015000 tx=0x7f00d4005c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3aee52a37d2e4d82 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:51:14.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.758+0000 7f00d3400700 1 -- 172.21.15.82:0/4154066037 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d4027070 con 0x55ad755ab8f0 2024-05-08T05:51:14.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.758+0000 7f00d3400700 1 -- 172.21.15.82:0/4154066037 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00d4005070 con 0x55ad755ab8f0 2024-05-08T05:51:14.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.759+0000 7f00f7693b80 1 -- 172.21.15.82:0/4154066037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ad755ab8f0 msgr2=0x55ad755abd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:14.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.759+0000 7f00f7693b80 1 --2- 172.21.15.82:0/4154066037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ad755ab8f0 0x55ad755abd70 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f00d4015000 tx=0x7f00d4005c00 comp rx=0 tx=0).stop 2024-05-08T05:51:14.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.759+0000 7f00e6800700 1 --2- 172.21.15.82:0/2911961561 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f00cc0b2a50 0x7f00cc0b4f10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f00e00094f0 tx=0x7f00e0009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:51:14.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.759+0000 7f00d3400700 1 -- 172.21.15.82:0/4154066037 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d400ba10 con 0x55ad755ab8f0 2024-05-08T05:51:14.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.759+0000 7f00f7693b80 1 -- 172.21.15.82:0/4154066037 shutdown_connections 2024-05-08T05:51:14.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.759+0000 7f00f7693b80 1 --2- 172.21.15.82:0/4154066037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ad755ab8f0 0x55ad755abd70 secure :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f00d4015000 tx=0x7f00d4005c00 comp rx=0 tx=0).stop 2024-05-08T05:51:14.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.759+0000 7f00f7693b80 1 --2- 172.21.15.82:0/4154066037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad755b0bc0 0x55ad755b0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:14.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.759+0000 7f00f7693b80 1 --2- 172.21.15.82:0/4154066037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad755b14e0 0x55ad755ab2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:14.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.759+0000 7f00f7693b80 1 -- 172.21.15.82:0/4154066037 >> 172.21.15.82:0/4154066037 conn(0x55ad755236d0 msgr2=0x55ad755a5b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:51:14.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.760+0000 7f00f7693b80 1 -- 172.21.15.82:0/4154066037 shutdown_connections 2024-05-08T05:51:14.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.760+0000 7f00f7693b80 1 -- 172.21.15.82:0/4154066037 wait complete. 2024-05-08T05:51:14.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.761+0000 7f00f7693b80 1 -- start start 2024-05-08T05:51:14.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.761+0000 7f00f7693b80 1 Processor -- start 2024-05-08T05:51:14.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.762+0000 7f00f7693b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad755b0bc0 0x55ad755b72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:14.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.762+0000 7f00f7693b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad755b14e0 0x55ad755b45e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:14.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.763+0000 7f00e5e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad755b0bc0 0x55ad755b72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:14.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.763+0000 7f00f7693b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ad755b4b20 0x55ad755b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:14.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.763+0000 7f00f7693b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55ad755c8f20 con 0x55ad755b14e0 2024-05-08T05:51:14.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.763+0000 7f00f7693b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ad75463b20 con 0x55ad755b4b20 2024-05-08T05:51:14.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.763+0000 7f00f7693b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ad755c90a0 con 0x55ad755b0bc0 2024-05-08T05:51:14.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.763+0000 7f00e5400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad755b14e0 0x55ad755b45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:14.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.763+0000 7f00e5e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad755b0bc0 0x55ad755b72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:59648/0 (socket says 172.21.15.82:59648) 2024-05-08T05:51:14.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.763+0000 7f00e5e00700 1 -- 172.21.15.82:0/4284597689 learned_addr learned my addr 172.21.15.82:0/4284597689 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:51:14.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.763+0000 7f00e6800700 1 --2- 172.21.15.82:0/4284597689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ad755b4b20 0x55ad755b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:14.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.764+0000 7f00f7693b80 10 client.0 _ll_register_callbacks cb 0x55ad754a4c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:51:14.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.765+0000 7f00e5e00700 1 -- 172.21.15.82:0/4284597689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ad755b4b20 msgr2=0x55ad755b4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:14.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.765+0000 7f00e5e00700 1 --2- 172.21.15.82:0/4284597689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ad755b4b20 0x55ad755b4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:14.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.765+0000 7f00e5e00700 1 -- 172.21.15.82:0/4284597689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad755b14e0 msgr2=0x55ad755b45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:14.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.766+0000 7f00e5e00700 1 --2- 172.21.15.82:0/4284597689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad755b14e0 0x55ad755b45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:14.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.766+0000 7f00e5e00700 1 -- 172.21.15.82:0/4284597689 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad754c3420 con 0x55ad755b0bc0 2024-05-08T05:51:14.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.766+0000 7f00e6800700 1 --2- 172.21.15.82:0/4284597689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ad755b4b20 0x55ad755b4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:51:14.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.766+0000 7f00e5400700 1 --2- 172.21.15.82:0/4284597689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad755b14e0 0x55ad755b45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:51:14.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.766+0000 7f00e5e00700 1 --2- 172.21.15.82:0/4284597689 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad755b0bc0 0x55ad755b72e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f00d80a66a0 tx=0x7f00d8010b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef0166f5ce1b6c68 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:51:14.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.766+0000 7f00c7e00700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:51:14.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.767+0000 7f00c7e00700 1 -- 172.21.15.82:0/4284597689 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d8020040 con 0x55ad755b0bc0 2024-05-08T05:51:14.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.767+0000 7f00c7e00700 1 -- 172.21.15.82:0/4284597689 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f00d80a9690 con 0x55ad755b0bc0 2024-05-08T05:51:14.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.767+0000 7f00f7693b80 1 -- 172.21.15.82:0/4284597689 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00d4005070 con 0x55ad755b0bc0 2024-05-08T05:51:14.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.767+0000 7f00c7e00700 1 -- 172.21.15.82:0/4284597689 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f00d80a9b30 con 0x55ad755b0bc0 2024-05-08T05:51:14.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.767+0000 7f00f7693b80 10 client.25261 fetch_fsmap learned FSMap version 30 2024-05-08T05:51:14.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.767+0000 7f00f7693b80 1 -- 172.21.15.82:0/4284597689 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55ad755d3dd0 con 0x55ad755b0bc0 2024-05-08T05:51:14.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.768+0000 7f00c7e00700 1 -- 172.21.15.82:0/4284597689 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00d4005070 con 0x55ad755b0bc0 2024-05-08T05:51:14.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.768+0000 7f00c7e00700 1 -- 172.21.15.82:0/4284597689 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f00d80b1e00 con 0x55ad755b0bc0 2024-05-08T05:51:14.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.768+0000 7f00f7693b80 10 client.25261 fetch_fsmap finished waiting for FSMap version 30 2024-05-08T05:51:14.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.768+0000 7f00f7693b80 10 client.25261 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-05-08T05:51:14.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.768+0000 7f00f7693b80 20 client.25261 populate_metadata read hostname 'smithi082' 2024-05-08T05:51:14.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.768+0000 7f00f7693b80 1 --2- 172.21.15.82:0/4284597689 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x55ad755d6360 0x55ad755d8750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:14.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.768+0000 7f00f7693b80 4 client.25261 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:51:14.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.768+0000 7f00f7693b80 1 -- 172.21.15.82:0/4284597689 --> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ad75578140 con 0x55ad755d6360 2024-05-08T05:51:14.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.768+0000 7f00e5400700 1 --2- 172.21.15.82:0/4284597689 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x55ad755d6360 0x55ad755d8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:14.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.769+0000 7f00c7e00700 10 client.25261 ms_handle_connect on v2:172.21.15.151:6834/2093655929 2024-05-08T05:51:14.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.769+0000 7f00e5400700 1 --2- 172.21.15.82:0/4284597689 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x55ad755d6360 0x55ad755d8750 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f752ef766e86ab95 server_cookie=403ed0be36fad96b in_seq=0 out_seq=0 2024-05-08T05:51:14.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.770+0000 7f00c7e00700 1 -- 172.21.15.82:0/4284597689 <== mds.3 v2:172.21.15.151:6834/2093655929 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55ad75578140 con 0x55ad755d6360 2024-05-08T05:51:14.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.770+0000 7f00c7e00700 10 client.25261 handle_command_reply: tid=0 2024-05-08T05:51:14.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.770+0000 7f00f7693b80 1 client.25261 shutdown 2024-05-08T05:51:14.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.771+0000 7f00f7693b80 1 -- 172.21.15.82:0/4284597689 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad755b0bc0 msgr2=0x55ad755b72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:14.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.771+0000 7f00f7693b80 1 --2- 172.21.15.82:0/4284597689 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad755b0bc0 0x55ad755b72e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f00d80a66a0 tx=0x7f00d8010b60 comp rx=0 tx=0).stop 2024-05-08T05:51:14.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.771+0000 7f00f7693b80 1 -- 172.21.15.82:0/4284597689 shutdown_connections 2024-05-08T05:51:14.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.771+0000 7f00f7693b80 1 --2- 172.21.15.82:0/4284597689 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x55ad755d6360 0x55ad755d8750 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:14.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.771+0000 7f00f7693b80 1 --2- 172.21.15.82:0/4284597689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ad755b4b20 0x55ad755b4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:14.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.771+0000 7f00f7693b80 1 --2- 172.21.15.82:0/4284597689 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad755b0bc0 0x55ad755b72e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:14.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.771+0000 7f00f7693b80 1 --2- 172.21.15.82:0/4284597689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad755b14e0 0x55ad755b45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:14.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.771+0000 7f00f7693b80 1 -- 172.21.15.82:0/4284597689 >> 172.21.15.82:0/4284597689 conn(0x55ad755236d0 msgr2=0x55ad755a5190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:51:14.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.771+0000 7f00c7e00700 0 client.25261 ms_handle_reset on v2:172.21.15.151:6834/2093655929 2024-05-08T05:51:14.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.771+0000 7f00f7693b80 1 -- 172.21.15.82:0/4284597689 shutdown_connections 2024-05-08T05:51:14.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.772+0000 7f00f7693b80 1 -- 172.21.15.82:0/4284597689 wait complete. 2024-05-08T05:51:14.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.773+0000 7f00f7693b80 20 client.25261 trim_cache size 0 max 16384 2024-05-08T05:51:14.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.802+0000 7f00f7693b80 1 Processor -- start 2024-05-08T05:51:14.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.802+0000 7f00f7693b80 1 -- start start 2024-05-08T05:51:14.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.803+0000 7f00f7693b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ad755b0bc0 0x55ad755ab2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:14.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.803+0000 7f00f7693b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad755b14e0 0x55ad755aed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:14.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.803+0000 7f00f7693b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad755b4b20 0x55ad755d2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:14.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.803+0000 7f00f7693b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f00e8073f10 con 0x55ad755b4b20 2024-05-08T05:51:14.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.803+0000 7f00f7693b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f00e81ad370 con 0x55ad755b0bc0 2024-05-08T05:51:14.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.803+0000 7f00f7693b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f00e80745e0 con 0x55ad755b14e0 2024-05-08T05:51:14.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.803+0000 7f00e5e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ad755b0bc0 0x55ad755ab2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:14.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.803+0000 7f00e5e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ad755b0bc0 0x55ad755ab2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:45728/0 (socket says 172.21.15.82:45728) 2024-05-08T05:51:14.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.803+0000 7f00e5400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad755b14e0 0x55ad755aed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:14.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.803+0000 7f00e5e00700 1 -- 172.21.15.82:0/2160634434 learned_addr learned my addr 172.21.15.82:0/2160634434 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:51:14.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.804+0000 7f00e6800700 1 --2- 172.21.15.82:0/2160634434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad755b4b20 0x55ad755d2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:14.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.804+0000 7f00e5400700 1 -- 172.21.15.82:0/2160634434 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ad755b0bc0 msgr2=0x55ad755ab2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:14.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.804+0000 7f00e5400700 1 --2- 172.21.15.82:0/2160634434 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ad755b0bc0 0x55ad755ab2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:14.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.804+0000 7f00e5400700 1 -- 172.21.15.82:0/2160634434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad755b4b20 msgr2=0x55ad755d2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:14.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.804+0000 7f00e5400700 1 --2- 172.21.15.82:0/2160634434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad755b4b20 0x55ad755d2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:14.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.804+0000 7f00e5400700 1 -- 172.21.15.82:0/2160634434 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad755c90e0 con 0x55ad755b14e0 2024-05-08T05:51:14.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.805+0000 7f00e5e00700 1 --2- 172.21.15.82:0/2160634434 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ad755b0bc0 0x55ad755ab2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:51:14.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.805+0000 7f00e6800700 1 --2- 172.21.15.82:0/2160634434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad755b4b20 0x55ad755d2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:51:14.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.805+0000 7f00e5400700 1 --2- 172.21.15.82:0/2160634434 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad755b14e0 0x55ad755aed80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x55ad755a7500 tx=0x7f00d4005c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbca13dab096a2b7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:51:14.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.806+0000 7f00d2a00700 1 -- 172.21.15.82:0/2160634434 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d4027040 con 0x55ad755b14e0 2024-05-08T05:51:14.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.806+0000 7f00d2a00700 1 -- 172.21.15.82:0/2160634434 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00d4034070 con 0x55ad755b14e0 2024-05-08T05:51:14.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.807+0000 7f00d2a00700 1 -- 172.21.15.82:0/2160634434 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d4027040 con 0x55ad755b14e0 2024-05-08T05:51:14.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.808+0000 7f00f7693b80 1 -- 172.21.15.82:0/2160634434 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad755b14e0 msgr2=0x55ad755aed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:14.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.808+0000 7f00f7693b80 1 --2- 172.21.15.82:0/2160634434 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad755b14e0 0x55ad755aed80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x55ad755a7500 tx=0x7f00d4005c90 comp rx=0 tx=0).stop 2024-05-08T05:51:14.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.809+0000 7f00f7693b80 1 -- 172.21.15.82:0/2160634434 shutdown_connections 2024-05-08T05:51:14.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.809+0000 7f00f7693b80 1 --2- 172.21.15.82:0/2160634434 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ad755b0bc0 0x55ad755ab2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:14.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.809+0000 7f00f7693b80 1 --2- 172.21.15.82:0/2160634434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad755b4b20 0x55ad755d2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:14.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.809+0000 7f00f7693b80 1 --2- 172.21.15.82:0/2160634434 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad755b14e0 0x55ad755aed80 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:14.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.809+0000 7f00f7693b80 1 -- 172.21.15.82:0/2160634434 >> 172.21.15.82:0/2160634434 conn(0x55ad755236d0 msgr2=0x55ad755b18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:51:14.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.810+0000 7f00f7693b80 1 -- 172.21.15.82:0/2160634434 shutdown_connections 2024-05-08T05:51:14.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.810+0000 7f00f7693b80 1 -- 172.21.15.82:0/2160634434 wait complete. 2024-05-08T05:51:14.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.811+0000 7f00f7693b80 1 -- start start 2024-05-08T05:51:14.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.811+0000 7f00f7693b80 1 Processor -- start 2024-05-08T05:51:14.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.812+0000 7f00f7693b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad755b0bc0 0x55ad755ce380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:14.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.812+0000 7f00f7693b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad755b14e0 0x55ad755ce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:14.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.812+0000 7f00f7693b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ad755b4b20 0x55ad7563bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:14.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.812+0000 7f00f7693b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f00e8075380 con 0x55ad755b0bc0 2024-05-08T05:51:14.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.812+0000 7f00f7693b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f00e8074cb0 con 0x55ad755b4b20 2024-05-08T05:51:14.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.812+0000 7f00f7693b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f00e8071eb0 con 0x55ad755b14e0 2024-05-08T05:51:14.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.813+0000 7f00f7693b80 10 client.0 _ll_register_callbacks cb 0x55ad754a4c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:51:14.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.813+0000 7f00e6800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ad755b4b20 0x55ad7563bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:14.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.813+0000 7f00e5e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad755b0bc0 0x55ad755ce380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:14.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.813+0000 7f00e6800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ad755b4b20 0x55ad7563bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:45736/0 (socket says 172.21.15.82:45736) 2024-05-08T05:51:14.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.813+0000 7f00e6800700 1 -- 172.21.15.82:0/2297332372 learned_addr learned my addr 172.21.15.82:0/2297332372 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:51:14.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.814+0000 7f00e5400700 1 --2- 172.21.15.82:0/2297332372 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad755b14e0 0x55ad755ce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:14.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.814+0000 7f00e5e00700 1 -- 172.21.15.82:0/2297332372 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad755b14e0 msgr2=0x55ad755ce8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:14.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.814+0000 7f00e5e00700 1 --2- 172.21.15.82:0/2297332372 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad755b14e0 0x55ad755ce8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:14.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.814+0000 7f00e5e00700 1 -- 172.21.15.82:0/2297332372 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ad755b4b20 msgr2=0x55ad7563bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:14.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.814+0000 7f00e5e00700 1 --2- 172.21.15.82:0/2297332372 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ad755b4b20 0x55ad7563bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:14.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.814+0000 7f00e5e00700 1 -- 172.21.15.82:0/2297332372 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad755b78c0 con 0x55ad755b0bc0 2024-05-08T05:51:14.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.815+0000 7f00e5e00700 1 --2- 172.21.15.82:0/2297332372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad755b0bc0 0x55ad755ce380 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f00d80a93c0 tx=0x7f00d80a9970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0fa7375317cf122 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:51:14.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.816+0000 7f00c7e00700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T05:51:14.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.818+0000 7f00c7e00700 1 -- 172.21.15.82:0/2297332372 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d8020040 con 0x55ad755b0bc0 2024-05-08T05:51:14.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.818+0000 7f00c7e00700 1 -- 172.21.15.82:0/2297332372 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f00d8009bc0 con 0x55ad755b0bc0 2024-05-08T05:51:14.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.818+0000 7f00f7693b80 1 -- 172.21.15.82:0/2297332372 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00d4034070 con 0x55ad755b0bc0 2024-05-08T05:51:14.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.820+0000 7f00c7e00700 1 -- 172.21.15.82:0/2297332372 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f00d80b2290 con 0x55ad755b0bc0 2024-05-08T05:51:14.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.820+0000 7f00f7693b80 10 client.15141 fetch_fsmap learned FSMap version 30 2024-05-08T05:51:14.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.820+0000 7f00f7693b80 1 -- 172.21.15.82:0/2297332372 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55ad755dda10 con 0x55ad755b0bc0 2024-05-08T05:51:14.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.822+0000 7f00c7e00700 1 -- 172.21.15.82:0/2297332372 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00d4034070 con 0x55ad755b0bc0 2024-05-08T05:51:14.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.822+0000 7f00c7e00700 1 -- 172.21.15.82:0/2297332372 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f00d80ca320 con 0x55ad755b0bc0 2024-05-08T05:51:14.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.824+0000 7f00f7693b80 10 client.15141 fetch_fsmap finished waiting for FSMap version 30 2024-05-08T05:51:14.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.824+0000 7f00f7693b80 10 client.15141 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-05-08T05:51:14.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.824+0000 7f00f7693b80 20 client.15141 populate_metadata read hostname 'smithi082' 2024-05-08T05:51:14.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.824+0000 7f00f7693b80 1 --2- 172.21.15.82:0/2297332372 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x55ad755ddf30 0x55ad755de340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:14.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.824+0000 7f00f7693b80 4 client.15141 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:51:14.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.824+0000 7f00f7693b80 1 -- 172.21.15.82:0/2297332372 --> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ad7550b400 con 0x55ad755ddf30 2024-05-08T05:51:14.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.824+0000 7f00e5400700 1 --2- 172.21.15.82:0/2297332372 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x55ad755ddf30 0x55ad755de340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:14.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.825+0000 7f00e5400700 1 --2- 172.21.15.82:0/2297332372 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x55ad755ddf30 0x55ad755de340 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=57620d1e6f0fc68c server_cookie=de1994864a6936b0 in_seq=0 out_seq=0 2024-05-08T05:51:14.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.825+0000 7f00c7e00700 10 client.15141 ms_handle_connect on v2:172.21.15.151:6834/2093655929 2024-05-08T05:51:14.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.825+0000 7f00c7e00700 1 -- 172.21.15.82:0/2297332372 <== mds.3 v2:172.21.15.151:6834/2093655929 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ad7550b400 con 0x55ad755ddf30 2024-05-08T05:51:14.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.826+0000 7f00c7e00700 10 client.15141 handle_command_reply: tid=0 2024-05-08T05:51:14.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.826+0000 7f00f7693b80 1 client.15141 shutdown 2024-05-08T05:51:14.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.827+0000 7f00f7693b80 1 -- 172.21.15.82:0/2297332372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad755b0bc0 msgr2=0x55ad755ce380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:14.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.827+0000 7f00f7693b80 1 --2- 172.21.15.82:0/2297332372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad755b0bc0 0x55ad755ce380 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f00d80a93c0 tx=0x7f00d80a9970 comp rx=0 tx=0).stop 2024-05-08T05:51:14.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.828+0000 7f00f7693b80 1 -- 172.21.15.82:0/2297332372 shutdown_connections 2024-05-08T05:51:14.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.828+0000 7f00f7693b80 1 --2- 172.21.15.82:0/2297332372 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x55ad755ddf30 0x55ad755de340 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:14.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.828+0000 7f00f7693b80 1 --2- 172.21.15.82:0/2297332372 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ad755b4b20 0x55ad7563bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:14.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.828+0000 7f00f7693b80 1 --2- 172.21.15.82:0/2297332372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ad755b0bc0 0x55ad755ce380 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:14.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.828+0000 7f00f7693b80 1 --2- 172.21.15.82:0/2297332372 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ad755b14e0 0x55ad755ce8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:14.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.828+0000 7f00f7693b80 1 -- 172.21.15.82:0/2297332372 >> 172.21.15.82:0/2297332372 conn(0x55ad755236d0 msgr2=0x55ad755b2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:51:14.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.829+0000 7f00c7e00700 0 client.15141 ms_handle_reset on v2:172.21.15.151:6834/2093655929 2024-05-08T05:51:14.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.829+0000 7f00f7693b80 1 -- 172.21.15.82:0/2297332372 shutdown_connections 2024-05-08T05:51:14.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.829+0000 7f00f7693b80 1 -- 172.21.15.82:0/2297332372 wait complete. 2024-05-08T05:51:14.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.829+0000 7f00f7693b80 20 client.15141 trim_cache size 0 max 16384 2024-05-08T05:51:14.830 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T05:51:14.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.831+0000 7f00ece00700 1 -- 172.21.15.82:0/2911961561 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f00cc0b2a50 msgr2=0x7f00cc0b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:14.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.831+0000 7f00ece00700 1 --2- 172.21.15.82:0/2911961561 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f00cc0b2a50 0x7f00cc0b4f10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f00e00094f0 tx=0x7f00e0009040 comp rx=0 tx=0).stop 2024-05-08T05:51:14.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.831+0000 7f00ece00700 1 -- 172.21.15.82:0/2911961561 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00e80756d0 msgr2=0x7f00e81a0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:14.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.831+0000 7f00ece00700 1 --2- 172.21.15.82:0/2911961561 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00e80756d0 0x7f00e81a0260 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f00d800d950 tx=0x7f00d800dd10 comp rx=0 tx=0).stop 2024-05-08T05:51:14.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.831+0000 7f00ece00700 1 -- 172.21.15.82:0/2911961561 shutdown_connections 2024-05-08T05:51:14.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.831+0000 7f00ece00700 1 --2- 172.21.15.82:0/2911961561 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00e80756d0 0x7f00e81a0260 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:14.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.831+0000 7f00ece00700 1 --2- 172.21.15.82:0/2911961561 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f00cc0b2a50 0x7f00cc0b4f10 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:14.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.831+0000 7f00ece00700 1 --2- 172.21.15.82:0/2911961561 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f00e8114670 0x7f00e81a4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:14.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.831+0000 7f00ece00700 1 --2- 172.21.15.82:0/2911961561 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00e8075ff0 0x7f00e81a07a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:14.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.831+0000 7f00ece00700 1 -- 172.21.15.82:0/2911961561 >> 172.21.15.82:0/2911961561 conn(0x7f00e807a600 msgr2=0x7f00e8110110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:51:14.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.832+0000 7f00ece00700 1 -- 172.21.15.82:0/2911961561 shutdown_connections 2024-05-08T05:51:14.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:14.832+0000 7f00ece00700 1 -- 172.21.15.82:0/2911961561 wait complete. 2024-05-08T05:51:15.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 25.0 s, 2915.0 tps, lat 34.245 ms stddev 37.804 2024-05-08T05:51:15.702 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-05-08T05:51:15.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:51:15 smithi151 ceph-mon[34815]: pgmap v477: 97 pgs: 97 active+clean; 952 MiB data, 922 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 758 op/s 2024-05-08T05:51:15.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:51:15 smithi151 ceph-mon[34815]: mgrmap e20: x(active, since 13m), standbys: z, y 2024-05-08T05:51:15.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:51:15 smithi082 ceph-mon[30098]: pgmap v477: 97 pgs: 97 active+clean; 952 MiB data, 922 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 758 op/s 2024-05-08T05:51:15.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:51:15 smithi082 ceph-mon[30098]: mgrmap e20: x(active, since 13m), standbys: z, y 2024-05-08T05:51:15.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:51:15 smithi134 ceph-mon[34132]: pgmap v477: 97 pgs: 97 active+clean; 952 MiB data, 922 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 758 op/s 2024-05-08T05:51:15.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:51:15 smithi134 ceph-mon[34132]: mgrmap e20: x(active, since 13m), standbys: z, y 2024-05-08T05:51:16.281 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:51:17.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:51:17 smithi151 ceph-mon[34815]: pgmap v478: 97 pgs: 97 active+clean; 958 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 MiB/s wr, 748 op/s 2024-05-08T05:51:17.958 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:51:17 smithi082 ceph-mon[30098]: pgmap v478: 97 pgs: 97 active+clean; 958 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 MiB/s wr, 748 op/s 2024-05-08T05:51:17.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:51:17 smithi134 ceph-mon[34132]: pgmap v478: 97 pgs: 97 active+clean; 958 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 10 MiB/s wr, 748 op/s 2024-05-08T05:51:19.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.093+0000 7f7712a00700 1 -- 172.21.15.82:0/985632737 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f770c10ff50 msgr2=0x7f770c112340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:19.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.093+0000 7f7712a00700 1 --2- 172.21.15.82:0/985632737 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f770c10ff50 0x7f770c112340 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f77040098f0 tx=0x7f7704009c00 comp rx=0 tx=0).stop 2024-05-08T05:51:19.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.093+0000 7f7712a00700 1 -- 172.21.15.82:0/985632737 shutdown_connections 2024-05-08T05:51:19.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.093+0000 7f7712a00700 1 --2- 172.21.15.82:0/985632737 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f770c10ff50 0x7f770c112340 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:19.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.093+0000 7f7712a00700 1 --2- 172.21.15.82:0/985632737 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f770c06b1b0 0x7f770c06b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:19.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.093+0000 7f7712a00700 1 --2- 172.21.15.82:0/985632737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f770c06bad0 0x7f770c10fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:19.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.093+0000 7f7712a00700 1 -- 172.21.15.82:0/985632737 >> 172.21.15.82:0/985632737 conn(0x7f770c079350 msgr2=0x7f770c079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:51:19.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.095+0000 7f7712a00700 1 -- 172.21.15.82:0/985632737 shutdown_connections 2024-05-08T05:51:19.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.095+0000 7f7712a00700 1 -- 172.21.15.82:0/985632737 wait complete. 2024-05-08T05:51:19.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.096+0000 7f7712a00700 1 Processor -- start 2024-05-08T05:51:19.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.097+0000 7f7712a00700 1 -- start start 2024-05-08T05:51:19.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.097+0000 7f7712a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f770c06b1b0 0x7f770c10f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:19.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.097+0000 7f7712a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f770c06bad0 0x7f770c10fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:19.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.097+0000 7f7712a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f770c10ff50 0x7f770c10d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:19.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.097+0000 7f7712a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f770c104a60 con 0x7f770c06bad0 2024-05-08T05:51:19.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.097+0000 7f7712a00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f770c1048e0 con 0x7f770c10ff50 2024-05-08T05:51:19.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.097+0000 7f7712a00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f770c104be0 con 0x7f770c06b1b0 2024-05-08T05:51:19.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.098+0000 7f770be00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f770c06b1b0 0x7f770c10f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:19.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.098+0000 7f770be00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f770c06b1b0 0x7f770c10f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:59692/0 (socket says 172.21.15.82:59692) 2024-05-08T05:51:19.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.098+0000 7f770be00700 1 -- 172.21.15.82:0/2782380329 learned_addr learned my addr 172.21.15.82:0/2782380329 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:51:19.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.098+0000 7f7710a00700 1 --2- 172.21.15.82:0/2782380329 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f770c10ff50 0x7f770c10d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:19.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.098+0000 7f7703400700 1 --2- 172.21.15.82:0/2782380329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f770c06bad0 0x7f770c10fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:19.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.098+0000 7f770be00700 1 -- 172.21.15.82:0/2782380329 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f770c10ff50 msgr2=0x7f770c10d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:19.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.098+0000 7f770be00700 1 --2- 172.21.15.82:0/2782380329 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f770c10ff50 0x7f770c10d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:19.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.098+0000 7f770be00700 1 -- 172.21.15.82:0/2782380329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f770c06bad0 msgr2=0x7f770c10fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:19.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.098+0000 7f770be00700 1 --2- 172.21.15.82:0/2782380329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f770c06bad0 0x7f770c10fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:19.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.098+0000 7f770be00700 1 -- 172.21.15.82:0/2782380329 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f770c10e110 con 0x7f770c06b1b0 2024-05-08T05:51:19.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.098+0000 7f7710a00700 1 --2- 172.21.15.82:0/2782380329 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f770c10ff50 0x7f770c10d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:51:19.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.098+0000 7f7703400700 1 --2- 172.21.15.82:0/2782380329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f770c06bad0 0x7f770c10fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:51:19.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.099+0000 7f770be00700 1 --2- 172.21.15.82:0/2782380329 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f770c06b1b0 0x7f770c10f4d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f76fc00c370 tx=0x7f76fc00c680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:51:19.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.099+0000 7f7709600700 1 -- 172.21.15.82:0/2782380329 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76fc00cea0 con 0x7f770c06b1b0 2024-05-08T05:51:19.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.099+0000 7f7709600700 1 -- 172.21.15.82:0/2782380329 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76fc0090d0 con 0x7f770c06b1b0 2024-05-08T05:51:19.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.099+0000 7f7712a00700 1 -- 172.21.15.82:0/2782380329 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f770c10e3a0 con 0x7f770c06b1b0 2024-05-08T05:51:19.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.099+0000 7f7709600700 1 -- 172.21.15.82:0/2782380329 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76fc0047d0 con 0x7f770c06b1b0 2024-05-08T05:51:19.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.099+0000 7f7712a00700 1 -- 172.21.15.82:0/2782380329 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f770c1acd00 con 0x7f770c06b1b0 2024-05-08T05:51:19.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.104+0000 7f771d3deb80 1 Processor -- start 2024-05-08T05:51:19.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.104+0000 7f771d3deb80 1 -- start start 2024-05-08T05:51:19.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.104+0000 7f7709600700 1 -- 172.21.15.82:0/2782380329 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f76fc01a020 con 0x7f770c06b1b0 2024-05-08T05:51:19.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.105+0000 7f771d3deb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55774cd2cbc0 0x55774cd2cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:19.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.105+0000 7f771d3deb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55774cd2d4e0 0x55774cd272d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:19.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.105+0000 7f771d3deb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55774cd278f0 0x55774cd27d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:19.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.105+0000 7f771d3deb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55774cc79a20 con 0x55774cd278f0 2024-05-08T05:51:19.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.105+0000 7f771d3deb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55774cc17760 con 0x55774cd2d4e0 2024-05-08T05:51:19.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.105+0000 7f771d3deb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55774cc759e0 con 0x55774cd2cbc0 2024-05-08T05:51:19.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.106+0000 7f7710a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55774cd2cbc0 0x55774cd2cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:19.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.106+0000 7f7710a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55774cd2cbc0 0x55774cd2cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:59702/0 (socket says 172.21.15.82:59702) 2024-05-08T05:51:19.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.106+0000 7f7703400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55774cd278f0 0x55774cd27d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:19.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.106+0000 7f7710a00700 1 -- 172.21.15.82:0/625014210 learned_addr learned my addr 172.21.15.82:0/625014210 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:51:19.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.106+0000 7f770be00700 1 --2- 172.21.15.82:0/625014210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55774cd2d4e0 0x55774cd272d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:19.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.107+0000 7f7710a00700 1 -- 172.21.15.82:0/625014210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55774cd2d4e0 msgr2=0x55774cd272d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:19.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.107+0000 7f7710a00700 1 --2- 172.21.15.82:0/625014210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55774cd2d4e0 0x55774cd272d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:19.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.107+0000 7f7710a00700 1 -- 172.21.15.82:0/625014210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55774cd278f0 msgr2=0x55774cd27d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:19.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.107+0000 7f7710a00700 1 --2- 172.21.15.82:0/625014210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55774cd278f0 0x55774cd27d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:19.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.107+0000 7f7710a00700 1 -- 172.21.15.82:0/625014210 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55774cbc68d0 con 0x55774cd2cbc0 2024-05-08T05:51:19.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.107+0000 7f7710a00700 1 --2- 172.21.15.82:0/625014210 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55774cd2cbc0 0x55774cd2cfa0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7704011040 tx=0x7f770400bfa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3343aaca71f5b5eb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:51:19.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.108+0000 7f7701600700 1 -- 172.21.15.82:0/625014210 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7704028070 con 0x55774cd2cbc0 2024-05-08T05:51:19.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.108+0000 7f7701600700 1 -- 172.21.15.82:0/625014210 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7704005040 con 0x55774cd2cbc0 2024-05-08T05:51:19.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.108+0000 7f7701600700 1 -- 172.21.15.82:0/625014210 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7704003900 con 0x55774cd2cbc0 2024-05-08T05:51:19.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.109+0000 7f7709600700 1 --2- 172.21.15.82:0/2782380329 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f76f00b2980 0x7f76f00b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:19.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.109+0000 7f771d3deb80 1 -- 172.21.15.82:0/625014210 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55774cd2cbc0 msgr2=0x55774cd2cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:19.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.109+0000 7f771d3deb80 1 --2- 172.21.15.82:0/625014210 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55774cd2cbc0 0x55774cd2cfa0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7704011040 tx=0x7f770400bfa0 comp rx=0 tx=0).stop 2024-05-08T05:51:19.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.109+0000 7f7709600700 1 -- 172.21.15.82:0/2782380329 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f76fc0e1c30 con 0x7f770c06b1b0 2024-05-08T05:51:19.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.110+0000 7f771d3deb80 1 -- 172.21.15.82:0/625014210 shutdown_connections 2024-05-08T05:51:19.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.110+0000 7f771d3deb80 1 --2- 172.21.15.82:0/625014210 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55774cd278f0 0x55774cd27d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:19.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.110+0000 7f771d3deb80 1 --2- 172.21.15.82:0/625014210 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55774cd2cbc0 0x55774cd2cfa0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:19.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.110+0000 7f771d3deb80 1 --2- 172.21.15.82:0/625014210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55774cd2d4e0 0x55774cd272d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:19.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.110+0000 7f771d3deb80 1 -- 172.21.15.82:0/625014210 >> 172.21.15.82:0/625014210 conn(0x55774cc9f6d0 msgr2=0x55774cd21b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:51:19.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.111+0000 7f771d3deb80 1 -- 172.21.15.82:0/625014210 shutdown_connections 2024-05-08T05:51:19.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.111+0000 7f770be00700 1 --2- 172.21.15.82:0/2782380329 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f76f00b2980 0x7f76f00b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:19.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.111+0000 7f771d3deb80 1 -- 172.21.15.82:0/625014210 wait complete. 2024-05-08T05:51:19.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.112+0000 7f771d3deb80 1 -- start start 2024-05-08T05:51:19.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.112+0000 7f771d3deb80 1 Processor -- start 2024-05-08T05:51:19.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.112+0000 7f770be00700 1 --2- 172.21.15.82:0/2782380329 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f76f00b2980 0x7f76f00b4e40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f76fc000f80 tx=0x7f76fc00e1b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:51:19.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.113+0000 7f771d3deb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55774cd278f0 0x55774cd33150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:19.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.113+0000 7f771d3deb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55774cd2cbc0 0x55774cd30560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:19.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.113+0000 7f771d3deb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55774cd2d4e0 0x55774cd30aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:19.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.113+0000 7f771d3deb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55774cd33ec0 con 0x55774cd2cbc0 2024-05-08T05:51:19.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.113+0000 7f771d3deb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55774cbdfb20 con 0x55774cd2d4e0 2024-05-08T05:51:19.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.113+0000 7f771d3deb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55774cd34040 con 0x55774cd278f0 2024-05-08T05:51:19.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.113+0000 7f771d3deb80 10 client.0 _ll_register_callbacks cb 0x55774cc20c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:51:19.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.113+0000 7f7710a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55774cd278f0 0x55774cd33150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:19.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.113+0000 7f7710a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55774cd278f0 0x55774cd33150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:59714/0 (socket says 172.21.15.82:59714) 2024-05-08T05:51:19.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.113+0000 7f7710a00700 1 -- 172.21.15.82:0/3320671301 learned_addr learned my addr 172.21.15.82:0/3320671301 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:51:19.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.114+0000 7f7710a00700 1 --2- 172.21.15.82:0/3320671301 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55774cd2d4e0 0x55774cd30aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:19.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.114+0000 7f7710a00700 1 -- 172.21.15.82:0/3320671301 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55774cd278f0 msgr2=0x55774cd33150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:19.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.114+0000 7f7710a00700 1 --2- 172.21.15.82:0/3320671301 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55774cd278f0 0x55774cd33150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:19.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.114+0000 7f7710a00700 1 -- 172.21.15.82:0/3320671301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55774cd2cbc0 msgr2=0x55774cd30560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T05:51:19.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.115+0000 7f7703400700 1 --2- 172.21.15.82:0/3320671301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55774cd2cbc0 0x55774cd30560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:19.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.115+0000 7f7710a00700 1 --2- 172.21.15.82:0/3320671301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55774cd2cbc0 0x55774cd30560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:19.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.115+0000 7f7710a00700 1 -- 172.21.15.82:0/3320671301 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55774cc3f420 con 0x55774cd2d4e0 2024-05-08T05:51:19.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.115+0000 7f7710a00700 1 --2- 172.21.15.82:0/3320671301 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55774cd2d4e0 0x55774cd30aa0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7704009c40 tx=0x7f7704019040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=360e6be601629d3b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:51:19.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.115+0000 7f76fa000700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:51:19.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.116+0000 7f76fa000700 1 -- 172.21.15.82:0/3320671301 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7704028070 con 0x55774cd2d4e0 2024-05-08T05:51:19.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.116+0000 7f76fa000700 1 -- 172.21.15.82:0/3320671301 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f770400f870 con 0x55774cd2d4e0 2024-05-08T05:51:19.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.116+0000 7f771d3deb80 1 -- 172.21.15.82:0/3320671301 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7704005040 con 0x55774cd2d4e0 2024-05-08T05:51:19.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.116+0000 7f76fa000700 1 -- 172.21.15.82:0/3320671301 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7704003ae0 con 0x55774cd2d4e0 2024-05-08T05:51:19.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.116+0000 7f771d3deb80 10 client.25271 fetch_fsmap learned FSMap version 30 2024-05-08T05:51:19.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.116+0000 7f771d3deb80 1 -- 172.21.15.82:0/3320671301 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55774cd3e730 con 0x55774cd2d4e0 2024-05-08T05:51:19.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.118+0000 7f76fa000700 1 -- 172.21.15.82:0/3320671301 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7704005040 con 0x55774cd2d4e0 2024-05-08T05:51:19.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.118+0000 7f76fa000700 1 -- 172.21.15.82:0/3320671301 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f77040354b0 con 0x55774cd2d4e0 2024-05-08T05:51:19.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.118+0000 7f771d3deb80 10 client.25271 fetch_fsmap finished waiting for FSMap version 30 2024-05-08T05:51:19.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.118+0000 7f771d3deb80 10 client.25271 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-05-08T05:51:19.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.118+0000 7f771d3deb80 20 client.25271 populate_metadata read hostname 'smithi082' 2024-05-08T05:51:19.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.118+0000 7f771d3deb80 1 --2- 172.21.15.82:0/3320671301 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55774cd40c00 0x55774cd42ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:19.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.118+0000 7f771d3deb80 4 client.25271 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:51:19.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.118+0000 7f771d3deb80 1 -- 172.21.15.82:0/3320671301 --> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55774ccf4140 con 0x55774cd40c00 2024-05-08T05:51:19.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.119+0000 7f7703400700 1 --2- 172.21.15.82:0/3320671301 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55774cd40c00 0x55774cd42ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:19.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.122+0000 7f7703400700 1 --2- 172.21.15.82:0/3320671301 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55774cd40c00 0x55774cd42ff0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=23bbf92b84d9bca server_cookie=585393d24cced38c in_seq=0 out_seq=0 2024-05-08T05:51:19.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.122+0000 7f76fa000700 10 client.25271 ms_handle_connect on v2:172.21.15.151:6836/4192404464 2024-05-08T05:51:19.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.123+0000 7f76fa000700 1 -- 172.21.15.82:0/3320671301 <== mds.2 v2:172.21.15.151:6836/4192404464 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55774ccf4140 con 0x55774cd40c00 2024-05-08T05:51:19.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.124+0000 7f76fa000700 10 client.25271 handle_command_reply: tid=0 2024-05-08T05:51:19.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.124+0000 7f771d3deb80 1 client.25271 shutdown 2024-05-08T05:51:19.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.125+0000 7f771d3deb80 1 -- 172.21.15.82:0/3320671301 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55774cd2d4e0 msgr2=0x55774cd30aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:19.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.125+0000 7f771d3deb80 1 --2- 172.21.15.82:0/3320671301 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55774cd2d4e0 0x55774cd30aa0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f7704009c40 tx=0x7f7704019040 comp rx=0 tx=0).stop 2024-05-08T05:51:19.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.125+0000 7f771d3deb80 1 -- 172.21.15.82:0/3320671301 shutdown_connections 2024-05-08T05:51:19.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.125+0000 7f771d3deb80 1 --2- 172.21.15.82:0/3320671301 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55774cd40c00 0x55774cd42ff0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:19.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.125+0000 7f771d3deb80 1 --2- 172.21.15.82:0/3320671301 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55774cd2d4e0 0x55774cd30aa0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:19.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.125+0000 7f771d3deb80 1 --2- 172.21.15.82:0/3320671301 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55774cd278f0 0x55774cd33150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:19.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.125+0000 7f771d3deb80 1 --2- 172.21.15.82:0/3320671301 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55774cd2cbc0 0x55774cd30560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:19.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.125+0000 7f771d3deb80 1 -- 172.21.15.82:0/3320671301 >> 172.21.15.82:0/3320671301 conn(0x55774cc9f6d0 msgr2=0x55774cd21190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:51:19.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.125+0000 7f76fa000700 0 client.25271 ms_handle_reset on v2:172.21.15.151:6836/4192404464 2024-05-08T05:51:19.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.125+0000 7f771d3deb80 1 -- 172.21.15.82:0/3320671301 shutdown_connections 2024-05-08T05:51:19.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.126+0000 7f771d3deb80 1 -- 172.21.15.82:0/3320671301 wait complete. 2024-05-08T05:51:19.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.126+0000 7f771d3deb80 20 client.25271 trim_cache size 0 max 16384 2024-05-08T05:51:19.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.154+0000 7f771d3deb80 1 Processor -- start 2024-05-08T05:51:19.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.154+0000 7f771d3deb80 1 -- start start 2024-05-08T05:51:19.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.154+0000 7f771d3deb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55774cd278f0 0x55774cd2e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:19.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.154+0000 7f771d3deb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55774cd2cbc0 0x55774cd21910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:19.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.154+0000 7f771d3deb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55774cd2d4e0 0x55774cd2bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:19.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.154+0000 7f771d3deb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f770c1b4010 con 0x55774cd2d4e0 2024-05-08T05:51:19.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.154+0000 7f771d3deb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f770c1b5b80 con 0x55774cd2cbc0 2024-05-08T05:51:19.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.154+0000 7f771d3deb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f770c1b46e0 con 0x55774cd278f0 2024-05-08T05:51:19.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.155+0000 7f7703400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55774cd2cbc0 0x55774cd21910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:19.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.155+0000 7f7703400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55774cd2cbc0 0x55774cd21910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:45790/0 (socket says 172.21.15.82:45790) 2024-05-08T05:51:19.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.155+0000 7f7703400700 1 -- 172.21.15.82:0/4001552399 learned_addr learned my addr 172.21.15.82:0/4001552399 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:51:19.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.155+0000 7f7710a00700 1 --2- 172.21.15.82:0/4001552399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55774cd2d4e0 0x55774cd2bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:19.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.155+0000 7f7710a00700 1 --2- 172.21.15.82:0/4001552399 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55774cd278f0 0x55774cd2e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:19.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.155+0000 7f7703400700 1 -- 172.21.15.82:0/4001552399 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55774cd278f0 msgr2=0x55774cd2e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:19.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.155+0000 7f7703400700 1 --2- 172.21.15.82:0/4001552399 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55774cd278f0 0x55774cd2e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:19.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.155+0000 7f7703400700 1 -- 172.21.15.82:0/4001552399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55774cd2d4e0 msgr2=0x55774cd2bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:19.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.155+0000 7f7703400700 1 --2- 172.21.15.82:0/4001552399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55774cd2d4e0 0x55774cd2bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:19.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.155+0000 7f7703400700 1 -- 172.21.15.82:0/4001552399 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55774cd23530 con 0x55774cd2cbc0 2024-05-08T05:51:19.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.156+0000 7f7703400700 1 --2- 172.21.15.82:0/4001552399 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55774cd2cbc0 0x55774cd21910 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f76f40095c0 tx=0x7f76f4004320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c3953f11e874753 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:51:19.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.156+0000 7f7700c00700 1 -- 172.21.15.82:0/4001552399 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f4023070 con 0x55774cd2cbc0 2024-05-08T05:51:19.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.156+0000 7f7700c00700 1 -- 172.21.15.82:0/4001552399 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76f4003680 con 0x55774cd2cbc0 2024-05-08T05:51:19.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.157+0000 7f771d3deb80 1 -- 172.21.15.82:0/4001552399 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55774cd2cbc0 msgr2=0x55774cd21910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:19.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.157+0000 7f771d3deb80 1 --2- 172.21.15.82:0/4001552399 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55774cd2cbc0 0x55774cd21910 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f76f40095c0 tx=0x7f76f4004320 comp rx=0 tx=0).stop 2024-05-08T05:51:19.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.157+0000 7f771d3deb80 1 -- 172.21.15.82:0/4001552399 shutdown_connections 2024-05-08T05:51:19.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.157+0000 7f771d3deb80 1 --2- 172.21.15.82:0/4001552399 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55774cd2d4e0 0x55774cd2bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:19.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.157+0000 7f771d3deb80 1 --2- 172.21.15.82:0/4001552399 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55774cd278f0 0x55774cd2e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:19.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.157+0000 7f771d3deb80 1 --2- 172.21.15.82:0/4001552399 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55774cd2cbc0 0x55774cd21910 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:19.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.157+0000 7f771d3deb80 1 -- 172.21.15.82:0/4001552399 >> 172.21.15.82:0/4001552399 conn(0x55774cc9f6d0 msgr2=0x55774cd2b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:51:19.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.157+0000 7f771d3deb80 1 -- 172.21.15.82:0/4001552399 shutdown_connections 2024-05-08T05:51:19.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.157+0000 7f771d3deb80 1 -- 172.21.15.82:0/4001552399 wait complete. 2024-05-08T05:51:19.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.158+0000 7f771d3deb80 1 -- start start 2024-05-08T05:51:19.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.158+0000 7f771d3deb80 1 Processor -- start 2024-05-08T05:51:19.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.158+0000 7f771d3deb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55774cd278f0 0x55774cd45060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:19.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.158+0000 7f771d3deb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55774cd2cbc0 0x55774cd455a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:19.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.158+0000 7f771d3deb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55774cd2d4e0 0x55774cda30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:19.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.158+0000 7f771d3deb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f770c1b5480 con 0x55774cd2cbc0 2024-05-08T05:51:19.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.158+0000 7f771d3deb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f770c1b4db0 con 0x55774cd2d4e0 2024-05-08T05:51:19.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.158+0000 7f771d3deb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f770c1b1fd0 con 0x55774cd278f0 2024-05-08T05:51:19.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.158+0000 7f771d3deb80 10 client.0 _ll_register_callbacks cb 0x55774cc20c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:51:19.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.159+0000 7f7710a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55774cd278f0 0x55774cd45060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:19.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.159+0000 7f7710a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55774cd2d4e0 0x55774cda30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:19.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.159+0000 7f7710a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55774cd278f0 0x55774cd45060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:59734/0 (socket says 172.21.15.82:59734) 2024-05-08T05:51:19.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.159+0000 7f7710a00700 1 -- 172.21.15.82:0/1512433795 learned_addr learned my addr 172.21.15.82:0/1512433795 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:51:19.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.160+0000 7f7703400700 1 --2- 172.21.15.82:0/1512433795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55774cd2cbc0 0x55774cd455a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:19.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.160+0000 7f7710a00700 1 -- 172.21.15.82:0/1512433795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55774cd2d4e0 msgr2=0x55774cda30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:19.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.160+0000 7f7710a00700 1 --2- 172.21.15.82:0/1512433795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55774cd2d4e0 0x55774cda30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:19.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.160+0000 7f7710a00700 1 -- 172.21.15.82:0/1512433795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55774cd2cbc0 msgr2=0x55774cd455a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:19.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.160+0000 7f7710a00700 1 --2- 172.21.15.82:0/1512433795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55774cd2cbc0 0x55774cd455a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:19.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.160+0000 7f7710a00700 1 -- 172.21.15.82:0/1512433795 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55774cd276f0 con 0x55774cd278f0 2024-05-08T05:51:19.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.161+0000 7f7710a00700 1 --2- 172.21.15.82:0/1512433795 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55774cd278f0 0x55774cd45060 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7704035900 tx=0x7f7704000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=725c4b50c939f5f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:51:19.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.161+0000 7f76fa000700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:51:19.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.161+0000 7f76fa000700 1 -- 172.21.15.82:0/1512433795 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7704028070 con 0x55774cd278f0 2024-05-08T05:51:19.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.162+0000 7f76fa000700 1 -- 172.21.15.82:0/1512433795 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f770400f880 con 0x55774cd278f0 2024-05-08T05:51:19.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.162+0000 7f771d3deb80 1 -- 172.21.15.82:0/1512433795 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76f4003680 con 0x55774cd278f0 2024-05-08T05:51:19.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.162+0000 7f76fa000700 1 -- 172.21.15.82:0/1512433795 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f77040350d0 con 0x55774cd278f0 2024-05-08T05:51:19.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.162+0000 7f771d3deb80 10 client.25285 fetch_fsmap learned FSMap version 30 2024-05-08T05:51:19.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.162+0000 7f771d3deb80 1 -- 172.21.15.82:0/1512433795 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55774cdaa8e0 con 0x55774cd278f0 2024-05-08T05:51:19.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.163+0000 7f76fa000700 1 -- 172.21.15.82:0/1512433795 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76f4003680 con 0x55774cd278f0 2024-05-08T05:51:19.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.163+0000 7f76fa000700 1 -- 172.21.15.82:0/1512433795 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f770400bb00 con 0x55774cd278f0 2024-05-08T05:51:19.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.163+0000 7f771d3deb80 10 client.25285 fetch_fsmap finished waiting for FSMap version 30 2024-05-08T05:51:19.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.163+0000 7f771d3deb80 10 client.25285 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-05-08T05:51:19.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.163+0000 7f771d3deb80 20 client.25285 populate_metadata read hostname 'smithi082' 2024-05-08T05:51:19.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.163+0000 7f771d3deb80 1 --2- 172.21.15.82:0/1512433795 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55774cdaaed0 0x55774cdad2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:19.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.163+0000 7f771d3deb80 4 client.25285 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:51:19.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.163+0000 7f771d3deb80 1 -- 172.21.15.82:0/1512433795 --> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55774cc87400 con 0x55774cdaaed0 2024-05-08T05:51:19.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.164+0000 7f7703400700 1 --2- 172.21.15.82:0/1512433795 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55774cdaaed0 0x55774cdad2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:19.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.164+0000 7f7703400700 1 --2- 172.21.15.82:0/1512433795 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55774cdaaed0 0x55774cdad2c0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e46734bed5d676fc server_cookie=e7b92ab13c62a9fd in_seq=0 out_seq=0 2024-05-08T05:51:19.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.165+0000 7f76fa000700 10 client.25285 ms_handle_connect on v2:172.21.15.151:6836/4192404464 2024-05-08T05:51:19.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.165+0000 7f76fa000700 1 -- 172.21.15.82:0/1512433795 <== mds.2 v2:172.21.15.151:6836/4192404464 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55774cc87400 con 0x55774cdaaed0 2024-05-08T05:51:19.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.165+0000 7f76fa000700 10 client.25285 handle_command_reply: tid=0 2024-05-08T05:51:19.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.165+0000 7f771d3deb80 1 client.25285 shutdown 2024-05-08T05:51:19.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.165+0000 7f771d3deb80 1 -- 172.21.15.82:0/1512433795 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55774cd278f0 msgr2=0x55774cd45060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:19.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.165+0000 7f771d3deb80 1 --2- 172.21.15.82:0/1512433795 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55774cd278f0 0x55774cd45060 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7704035900 tx=0x7f7704000bc0 comp rx=0 tx=0).stop 2024-05-08T05:51:19.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.165+0000 7f771d3deb80 1 -- 172.21.15.82:0/1512433795 shutdown_connections 2024-05-08T05:51:19.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.165+0000 7f771d3deb80 1 --2- 172.21.15.82:0/1512433795 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55774cdaaed0 0x55774cdad2c0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:19.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.165+0000 7f771d3deb80 1 --2- 172.21.15.82:0/1512433795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55774cd2d4e0 0x55774cda30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:19.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.165+0000 7f76fa000700 0 client.25285 ms_handle_reset on v2:172.21.15.151:6836/4192404464 2024-05-08T05:51:19.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.165+0000 7f771d3deb80 1 --2- 172.21.15.82:0/1512433795 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55774cd278f0 0x55774cd45060 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:19.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.165+0000 7f771d3deb80 1 --2- 172.21.15.82:0/1512433795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55774cd2cbc0 0x55774cd455a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:19.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.165+0000 7f771d3deb80 1 -- 172.21.15.82:0/1512433795 >> 172.21.15.82:0/1512433795 conn(0x55774cc9f6d0 msgr2=0x55774cd2e020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:51:19.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.168+0000 7f771d3deb80 1 -- 172.21.15.82:0/1512433795 shutdown_connections 2024-05-08T05:51:19.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.168+0000 7f771d3deb80 1 -- 172.21.15.82:0/1512433795 wait complete. 2024-05-08T05:51:19.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.168+0000 7f771d3deb80 20 client.25285 trim_cache size 0 max 16384 2024-05-08T05:51:19.168 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T05:51:19.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.169+0000 7f7712a00700 1 -- 172.21.15.82:0/2782380329 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f76f00b2980 msgr2=0x7f76f00b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:19.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.169+0000 7f7712a00700 1 --2- 172.21.15.82:0/2782380329 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f76f00b2980 0x7f76f00b4e40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f76fc000f80 tx=0x7f76fc00e1b0 comp rx=0 tx=0).stop 2024-05-08T05:51:19.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.169+0000 7f7712a00700 1 -- 172.21.15.82:0/2782380329 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f770c06b1b0 msgr2=0x7f770c10f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:19.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.169+0000 7f7712a00700 1 --2- 172.21.15.82:0/2782380329 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f770c06b1b0 0x7f770c10f4d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f76fc00c370 tx=0x7f76fc00c680 comp rx=0 tx=0).stop 2024-05-08T05:51:19.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.169+0000 7f7712a00700 1 -- 172.21.15.82:0/2782380329 shutdown_connections 2024-05-08T05:51:19.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.169+0000 7f7712a00700 1 --2- 172.21.15.82:0/2782380329 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f770c10ff50 0x7f770c10d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:19.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.169+0000 7f7712a00700 1 --2- 172.21.15.82:0/2782380329 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f76f00b2980 0x7f76f00b4e40 secure :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f76fc000f80 tx=0x7f76fc00e1b0 comp rx=0 tx=0).stop 2024-05-08T05:51:19.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.169+0000 7f7712a00700 1 --2- 172.21.15.82:0/2782380329 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f770c06b1b0 0x7f770c10f4d0 secure :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f76fc00c370 tx=0x7f76fc00c680 comp rx=0 tx=0).stop 2024-05-08T05:51:19.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.169+0000 7f7712a00700 1 --2- 172.21.15.82:0/2782380329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f770c06bad0 0x7f770c10fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:19.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.169+0000 7f7712a00700 1 -- 172.21.15.82:0/2782380329 >> 172.21.15.82:0/2782380329 conn(0x7f770c079350 msgr2=0x7f770c111400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:51:19.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.170+0000 7f7712a00700 1 -- 172.21.15.82:0/2782380329 shutdown_connections 2024-05-08T05:51:19.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:19.170+0000 7f7712a00700 1 -- 172.21.15.82:0/2782380329 wait complete. 2024-05-08T05:51:19.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:51:19 smithi082 ceph-mon[30098]: pgmap v479: 97 pgs: 97 active+clean; 960 MiB data, 984 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.8 MiB/s wr, 694 op/s 2024-05-08T05:51:19.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:51:19 smithi134 ceph-mon[34132]: pgmap v479: 97 pgs: 97 active+clean; 960 MiB data, 984 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.8 MiB/s wr, 694 op/s 2024-05-08T05:51:20.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:51:19 smithi151 ceph-mon[34815]: pgmap v479: 97 pgs: 97 active+clean; 960 MiB data, 984 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.8 MiB/s wr, 694 op/s 2024-05-08T05:51:20.170 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-05-08T05:51:20.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 30.0 s, 2503.2 tps, lat 39.771 ms stddev 44.392 2024-05-08T05:51:20.750 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:51:21.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:51:21 smithi082 ceph-mon[30098]: pgmap v480: 97 pgs: 97 active+clean; 961 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.7 MiB/s wr, 794 op/s 2024-05-08T05:51:21.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:51:21 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:51:21.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:51:21 smithi134 ceph-mon[34132]: pgmap v480: 97 pgs: 97 active+clean; 961 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.7 MiB/s wr, 794 op/s 2024-05-08T05:51:22.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:51:21 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:51:22.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:51:21 smithi151 ceph-mon[34815]: pgmap v480: 97 pgs: 97 active+clean; 961 MiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.7 MiB/s wr, 794 op/s 2024-05-08T05:51:22.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:51:21 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:51:23.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.339+0000 7f83e7000700 1 -- 172.21.15.82:0/2905691466 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83e0109510 msgr2=0x7f83e01098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:23.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.339+0000 7f83e7000700 1 --2- 172.21.15.82:0/2905691466 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83e0109510 0x7f83e01098f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f83d0009990 tx=0x7f83d0009ca0 comp rx=0 tx=0).stop 2024-05-08T05:51:23.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.339+0000 7f83e7000700 1 -- 172.21.15.82:0/2905691466 shutdown_connections 2024-05-08T05:51:23.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.339+0000 7f83e7000700 1 --2- 172.21.15.82:0/2905691466 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83e006bb40 0x7f83e0110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:23.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.339+0000 7f83e7000700 1 --2- 172.21.15.82:0/2905691466 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83e0109510 0x7f83e01098f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:23.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.339+0000 7f83e7000700 1 --2- 172.21.15.82:0/2905691466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83e006b180 0x7f83e006b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:23.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.339+0000 7f83e7000700 1 -- 172.21.15.82:0/2905691466 >> 172.21.15.82:0/2905691466 conn(0x7f83e0079350 msgr2=0x7f83e0079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:51:23.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.339+0000 7f83e7000700 1 -- 172.21.15.82:0/2905691466 shutdown_connections 2024-05-08T05:51:23.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.340+0000 7f83e7000700 1 -- 172.21.15.82:0/2905691466 wait complete. 2024-05-08T05:51:23.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.342+0000 7f83e7000700 1 Processor -- start 2024-05-08T05:51:23.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.342+0000 7f83e7000700 1 -- start start 2024-05-08T05:51:23.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.343+0000 7f83e7000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83e006b180 0x7f83e01a0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:23.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.343+0000 7f83e7000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83e006bb40 0x7f83e01a0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:23.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.343+0000 7f83e7000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83e0109510 0x7f83e010e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:23.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.343+0000 7f83e7000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f83e0113670 con 0x7f83e0109510 2024-05-08T05:51:23.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.343+0000 7f83dfe00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83e006b180 0x7f83e01a0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:23.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.343+0000 7f83e7000700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f83e01134f0 con 0x7f83e006b180 2024-05-08T05:51:23.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.343+0000 7f83e7000700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f83e01137f0 con 0x7f83e006bb40 2024-05-08T05:51:23.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.343+0000 7f83dfe00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83e006b180 0x7f83e01a0890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:53522/0 (socket says 172.21.15.82:53522) 2024-05-08T05:51:23.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.343+0000 7f83dfe00700 1 -- 172.21.15.82:0/1691817536 learned_addr learned my addr 172.21.15.82:0/1691817536 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:51:23.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.343+0000 7f83df400700 1 --2- 172.21.15.82:0/1691817536 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83e006bb40 0x7f83e01a0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:23.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.343+0000 7f83e5000700 1 --2- 172.21.15.82:0/1691817536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83e0109510 0x7f83e010e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:23.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.344+0000 7f83dfe00700 1 -- 172.21.15.82:0/1691817536 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83e006bb40 msgr2=0x7f83e01a0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:23.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.344+0000 7f83dfe00700 1 --2- 172.21.15.82:0/1691817536 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83e006bb40 0x7f83e01a0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:23.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.344+0000 7f83dfe00700 1 -- 172.21.15.82:0/1691817536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83e0109510 msgr2=0x7f83e010e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:23.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.344+0000 7f83dfe00700 1 --2- 172.21.15.82:0/1691817536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83e0109510 0x7f83e010e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:23.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.344+0000 7f83dfe00700 1 -- 172.21.15.82:0/1691817536 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83e010edd0 con 0x7f83e006b180 2024-05-08T05:51:23.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.344+0000 7f83e5000700 1 --2- 172.21.15.82:0/1691817536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83e0109510 0x7f83e010e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:51:23.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.344+0000 7f83dfe00700 1 --2- 172.21.15.82:0/1691817536 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83e006b180 0x7f83e01a0890 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f83d0005910 tx=0x7f83d000b670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:51:23.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.345+0000 7f83dcc00700 1 -- 172.21.15.82:0/1691817536 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d0027070 con 0x7f83e006b180 2024-05-08T05:51:23.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.345+0000 7f83dcc00700 1 -- 172.21.15.82:0/1691817536 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83d0022470 con 0x7f83e006b180 2024-05-08T05:51:23.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.345+0000 7f83dcc00700 1 -- 172.21.15.82:0/1691817536 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d0017650 con 0x7f83e006b180 2024-05-08T05:51:23.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.345+0000 7f83e7000700 1 -- 172.21.15.82:0/1691817536 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83e010f060 con 0x7f83e006b180 2024-05-08T05:51:23.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.345+0000 7f83e7000700 1 -- 172.21.15.82:0/1691817536 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83e019c440 con 0x7f83e006b180 2024-05-08T05:51:23.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.355+0000 7f83dcc00700 1 -- 172.21.15.82:0/1691817536 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f83d002a070 con 0x7f83e006b180 2024-05-08T05:51:23.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.356+0000 7f83f1a40b80 1 Processor -- start 2024-05-08T05:51:23.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.357+0000 7f83f1a40b80 1 -- start start 2024-05-08T05:51:23.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.357+0000 7f83f1a40b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557aef7ddbc0 0x557aef7ddfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:23.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.357+0000 7f83f1a40b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557aef7de4e0 0x557aef7d82d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:23.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.358+0000 7f83dfe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557aef7de4e0 0x557aef7d82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:23.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.358+0000 7f83dfe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557aef7de4e0 0x557aef7d82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39384/0 (socket says 172.21.15.82:39384) 2024-05-08T05:51:23.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.358+0000 7f83dfe00700 1 -- 172.21.15.82:0/3916993921 learned_addr learned my addr 172.21.15.82:0/3916993921 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:51:23.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.358+0000 7f83e5000700 1 --2- 172.21.15.82:0/3916993921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557aef7ddbc0 0x557aef7ddfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:23.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.358+0000 7f83f1a40b80 1 --2- 172.21.15.82:0/3916993921 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557aef7d88f0 0x557aef7d8d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:23.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.359+0000 7f83f1a40b80 1 -- 172.21.15.82:0/3916993921 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x557aef72aa20 con 0x557aef7de4e0 2024-05-08T05:51:23.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.359+0000 7f83f1a40b80 1 -- 172.21.15.82:0/3916993921 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x557aef6c8760 con 0x557aef7ddbc0 2024-05-08T05:51:23.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.359+0000 7f83f1a40b80 1 -- 172.21.15.82:0/3916993921 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x557aef7269e0 con 0x557aef7d88f0 2024-05-08T05:51:23.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.359+0000 7f83dcc00700 1 --2- 172.21.15.82:0/1691817536 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f83c40b2980 0x7f83c40b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:23.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.360+0000 7f83df400700 1 --2- 172.21.15.82:0/3916993921 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557aef7d88f0 0x557aef7d8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:23.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.361+0000 7f83dcc00700 1 -- 172.21.15.82:0/1691817536 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f83d00e2f40 con 0x7f83e006b180 2024-05-08T05:51:23.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.361+0000 7f83df400700 1 -- 172.21.15.82:0/3916993921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557aef7ddbc0 msgr2=0x557aef7ddfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:23.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.361+0000 7f83df400700 1 --2- 172.21.15.82:0/3916993921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557aef7ddbc0 0x557aef7ddfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:23.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.361+0000 7f83df400700 1 -- 172.21.15.82:0/3916993921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557aef7de4e0 msgr2=0x557aef7d82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:23.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.361+0000 7f83e5000700 1 --2- 172.21.15.82:0/1691817536 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f83c40b2980 0x7f83c40b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:23.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.361+0000 7f83df400700 1 --2- 172.21.15.82:0/3916993921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557aef7de4e0 0x557aef7d82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:23.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.361+0000 7f83df400700 1 -- 172.21.15.82:0/3916993921 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557aef6778d0 con 0x557aef7d88f0 2024-05-08T05:51:23.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.362+0000 7f83dfe00700 1 --2- 172.21.15.82:0/3916993921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557aef7de4e0 0x557aef7d82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:51:23.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.362+0000 7f83df400700 1 --2- 172.21.15.82:0/3916993921 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557aef7d88f0 0x557aef7d8d70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f83e0199030 tx=0x7f83cc009f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=282372323daf44ec server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:51:23.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.362+0000 7f83d5600700 1 -- 172.21.15.82:0/3916993921 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83cc01e070 con 0x557aef7d88f0 2024-05-08T05:51:23.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.362+0000 7f83d5600700 1 -- 172.21.15.82:0/3916993921 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83cc011c80 con 0x557aef7d88f0 2024-05-08T05:51:23.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.365+0000 7f83d5600700 1 -- 172.21.15.82:0/3916993921 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83cc00e5f0 con 0x557aef7d88f0 2024-05-08T05:51:23.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.366+0000 7f83f1a40b80 1 -- 172.21.15.82:0/3916993921 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557aef7d88f0 msgr2=0x557aef7d8d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:23.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.366+0000 7f83f1a40b80 1 --2- 172.21.15.82:0/3916993921 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557aef7d88f0 0x557aef7d8d70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f83e0199030 tx=0x7f83cc009f60 comp rx=0 tx=0).stop 2024-05-08T05:51:23.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.366+0000 7f83e5000700 1 --2- 172.21.15.82:0/1691817536 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f83c40b2980 0x7f83c40b4e40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f83d8009da0 tx=0x7f83d8009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:51:23.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.366+0000 7f83f1a40b80 1 -- 172.21.15.82:0/3916993921 shutdown_connections 2024-05-08T05:51:23.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.366+0000 7f83f1a40b80 1 --2- 172.21.15.82:0/3916993921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557aef7ddbc0 0x557aef7ddfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:23.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.366+0000 7f83f1a40b80 1 --2- 172.21.15.82:0/3916993921 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557aef7d88f0 0x557aef7d8d70 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:23.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.366+0000 7f83f1a40b80 1 --2- 172.21.15.82:0/3916993921 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557aef7de4e0 0x557aef7d82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:23.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.366+0000 7f83f1a40b80 1 -- 172.21.15.82:0/3916993921 >> 172.21.15.82:0/3916993921 conn(0x557aef7506d0 msgr2=0x557aef7d2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:51:23.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.366+0000 7f83f1a40b80 1 -- 172.21.15.82:0/3916993921 shutdown_connections 2024-05-08T05:51:23.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.366+0000 7f83f1a40b80 1 -- 172.21.15.82:0/3916993921 wait complete. 2024-05-08T05:51:23.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.367+0000 7f83f1a40b80 1 -- start start 2024-05-08T05:51:23.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.367+0000 7f83f1a40b80 1 Processor -- start 2024-05-08T05:51:23.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.368+0000 7f83f1a40b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557aef7d88f0 0x557aef7e4200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:23.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.368+0000 7f83f1a40b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557aef7ddbc0 0x557aef7e15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:23.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.368+0000 7f83f1a40b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557aef7de4e0 0x557aef7e1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:23.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.368+0000 7f83f1a40b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x557aef7e4f20 con 0x557aef7de4e0 2024-05-08T05:51:23.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.368+0000 7f83f1a40b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x557aef690b20 con 0x557aef7ddbc0 2024-05-08T05:51:23.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.368+0000 7f83f1a40b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x557aef7e50a0 con 0x557aef7d88f0 2024-05-08T05:51:23.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.368+0000 7f83f1a40b80 10 client.0 _ll_register_callbacks cb 0x557aef6d1c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:51:23.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.368+0000 7f83e5000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557aef7de4e0 0x557aef7e1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:23.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.369+0000 7f83e5000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557aef7de4e0 0x557aef7e1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39398/0 (socket says 172.21.15.82:39398) 2024-05-08T05:51:23.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.369+0000 7f83e5000700 1 -- 172.21.15.82:0/3106067879 learned_addr learned my addr 172.21.15.82:0/3106067879 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:51:23.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.370+0000 7f83df400700 1 --2- 172.21.15.82:0/3106067879 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557aef7ddbc0 0x557aef7e15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:23.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.370+0000 7f83dfe00700 1 --2- 172.21.15.82:0/3106067879 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557aef7d88f0 0x557aef7e4200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:23.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.370+0000 7f83e5000700 1 -- 172.21.15.82:0/3106067879 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557aef7d88f0 msgr2=0x557aef7e4200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:23.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.370+0000 7f83e5000700 1 --2- 172.21.15.82:0/3106067879 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557aef7d88f0 0x557aef7e4200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:23.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.370+0000 7f83e5000700 1 -- 172.21.15.82:0/3106067879 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557aef7ddbc0 msgr2=0x557aef7e15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:23.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.370+0000 7f83e5000700 1 --2- 172.21.15.82:0/3106067879 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557aef7ddbc0 0x557aef7e15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:23.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.370+0000 7f83e5000700 1 -- 172.21.15.82:0/3106067879 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557aef6f0420 con 0x557aef7de4e0 2024-05-08T05:51:23.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.370+0000 7f83dfe00700 1 --2- 172.21.15.82:0/3106067879 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557aef7d88f0 0x557aef7e4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:51:23.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.370+0000 7f83df400700 1 --2- 172.21.15.82:0/3106067879 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557aef7ddbc0 0x557aef7e15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:51:23.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.371+0000 7f83e5000700 1 --2- 172.21.15.82:0/3106067879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557aef7de4e0 0x557aef7e1b30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f83d8017c30 tx=0x7f83d8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=345ccc179f43be4d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:51:23.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.371+0000 7f83ca000700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T05:51:23.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.372+0000 7f83ca000700 1 -- 172.21.15.82:0/3106067879 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d8027060 con 0x557aef7de4e0 2024-05-08T05:51:23.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.372+0000 7f83f1a40b80 1 -- 172.21.15.82:0/3106067879 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83cc011c80 con 0x557aef7de4e0 2024-05-08T05:51:23.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.372+0000 7f83ca000700 1 -- 172.21.15.82:0/3106067879 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f83d8016910 con 0x557aef7de4e0 2024-05-08T05:51:23.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.373+0000 7f83ca000700 1 -- 172.21.15.82:0/3106067879 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f83d8016b50 con 0x557aef7de4e0 2024-05-08T05:51:23.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.373+0000 7f83f1a40b80 10 client.15165 fetch_fsmap learned FSMap version 30 2024-05-08T05:51:23.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.373+0000 7f83f1a40b80 1 -- 172.21.15.82:0/3106067879 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557aef7ef880 con 0x557aef7de4e0 2024-05-08T05:51:23.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.374+0000 7f83ca000700 1 -- 172.21.15.82:0/3106067879 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83cc011c80 con 0x557aef7de4e0 2024-05-08T05:51:23.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.376+0000 7f83ca000700 1 -- 172.21.15.82:0/3106067879 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f83d802d410 con 0x557aef7de4e0 2024-05-08T05:51:23.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.376+0000 7f83f1a40b80 10 client.15165 fetch_fsmap finished waiting for FSMap version 30 2024-05-08T05:51:23.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.376+0000 7f83f1a40b80 10 client.15165 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-08T05:51:23.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.376+0000 7f83f1a40b80 20 client.15165 populate_metadata read hostname 'smithi082' 2024-05-08T05:51:23.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.376+0000 7f83f1a40b80 1 --2- 172.21.15.82:0/3106067879 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x557aef7f1e10 0x557aef7f4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:23.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.376+0000 7f83f1a40b80 4 client.15165 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:51:23.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.376+0000 7f83f1a40b80 1 -- 172.21.15.82:0/3106067879 --> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557aef7a5140 con 0x557aef7f1e10 2024-05-08T05:51:23.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.377+0000 7f83dfe00700 1 --2- 172.21.15.82:0/3106067879 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x557aef7f1e10 0x557aef7f4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:23.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.378+0000 7f83dfe00700 1 --2- 172.21.15.82:0/3106067879 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x557aef7f1e10 0x557aef7f4240 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c0630d66cc80a8f5 server_cookie=99d73eac1d4cccb6 in_seq=0 out_seq=0 2024-05-08T05:51:23.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.378+0000 7f83ca000700 10 client.15165 ms_handle_connect on v2:172.21.15.151:6838/2963754236 2024-05-08T05:51:23.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.379+0000 7f83ca000700 1 -- 172.21.15.82:0/3106067879 <== mds.1 v2:172.21.15.151:6838/2963754236 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557aef7a5140 con 0x557aef7f1e10 2024-05-08T05:51:23.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.379+0000 7f83ca000700 10 client.15165 handle_command_reply: tid=0 2024-05-08T05:51:23.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.379+0000 7f83f1a40b80 1 client.15165 shutdown 2024-05-08T05:51:23.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.380+0000 7f83f1a40b80 1 -- 172.21.15.82:0/3106067879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557aef7de4e0 msgr2=0x557aef7e1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:23.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.380+0000 7f83f1a40b80 1 --2- 172.21.15.82:0/3106067879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557aef7de4e0 0x557aef7e1b30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f83d8017c30 tx=0x7f83d8004ad0 comp rx=0 tx=0).stop 2024-05-08T05:51:23.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.380+0000 7f83f1a40b80 1 -- 172.21.15.82:0/3106067879 shutdown_connections 2024-05-08T05:51:23.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.380+0000 7f83f1a40b80 1 --2- 172.21.15.82:0/3106067879 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x557aef7f1e10 0x557aef7f4240 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:23.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.380+0000 7f83f1a40b80 1 --2- 172.21.15.82:0/3106067879 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557aef7de4e0 0x557aef7e1b30 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:23.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.380+0000 7f83f1a40b80 1 --2- 172.21.15.82:0/3106067879 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557aef7d88f0 0x557aef7e4200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:23.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.380+0000 7f83f1a40b80 1 --2- 172.21.15.82:0/3106067879 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557aef7ddbc0 0x557aef7e15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:23.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.380+0000 7f83f1a40b80 1 -- 172.21.15.82:0/3106067879 >> 172.21.15.82:0/3106067879 conn(0x557aef7506d0 msgr2=0x557aef7d2190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:51:23.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.380+0000 7f83ca000700 0 client.15165 ms_handle_reset on v2:172.21.15.151:6838/2963754236 2024-05-08T05:51:23.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.380+0000 7f83f1a40b80 1 -- 172.21.15.82:0/3106067879 shutdown_connections 2024-05-08T05:51:23.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.380+0000 7f83f1a40b80 1 -- 172.21.15.82:0/3106067879 wait complete. 2024-05-08T05:51:23.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.381+0000 7f83f1a40b80 20 client.15165 trim_cache size 0 max 16384 2024-05-08T05:51:23.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.418+0000 7f83f1a40b80 1 Processor -- start 2024-05-08T05:51:23.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.418+0000 7f83f1a40b80 1 -- start start 2024-05-08T05:51:23.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.420+0000 7f83f1a40b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557aef7d88f0 0x557aef7d82d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:23.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.420+0000 7f83f1a40b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557aef7ddbc0 0x557aef7edfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:23.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.420+0000 7f83f1a40b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557aef7de4e0 0x557aef7d2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:23.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.420+0000 7f83f1a40b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f83e01bc7f0 con 0x557aef7d88f0 2024-05-08T05:51:23.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.420+0000 7f83f1a40b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f83e01be360 con 0x557aef7ddbc0 2024-05-08T05:51:23.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.420+0000 7f83f1a40b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f83e01bcec0 con 0x557aef7de4e0 2024-05-08T05:51:23.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.420+0000 7f83df400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557aef7ddbc0 0x557aef7edfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:23.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.420+0000 7f83e5000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557aef7de4e0 0x557aef7d2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:23.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.420+0000 7f83df400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557aef7ddbc0 0x557aef7edfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:53544/0 (socket says 172.21.15.82:53544) 2024-05-08T05:51:23.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.420+0000 7f83df400700 1 -- 172.21.15.82:0/294975454 learned_addr learned my addr 172.21.15.82:0/294975454 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:51:23.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.421+0000 7f83df400700 1 -- 172.21.15.82:0/294975454 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557aef7de4e0 msgr2=0x557aef7d2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:23.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.421+0000 7f83df400700 1 --2- 172.21.15.82:0/294975454 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557aef7de4e0 0x557aef7d2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:23.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.421+0000 7f83dfe00700 1 --2- 172.21.15.82:0/294975454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557aef7d88f0 0x557aef7d82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:23.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.421+0000 7f83df400700 1 -- 172.21.15.82:0/294975454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557aef7d88f0 msgr2=0x557aef7d82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:23.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.421+0000 7f83df400700 1 --2- 172.21.15.82:0/294975454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557aef7d88f0 0x557aef7d82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:23.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.421+0000 7f83df400700 1 -- 172.21.15.82:0/294975454 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557aef7e24d0 con 0x557aef7ddbc0 2024-05-08T05:51:23.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.421+0000 7f83e5000700 1 --2- 172.21.15.82:0/294975454 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557aef7de4e0 0x557aef7d2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:51:23.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.422+0000 7f83df400700 1 --2- 172.21.15.82:0/294975454 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557aef7ddbc0 0x557aef7edfb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f83cc009230 tx=0x7f83cc011c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3a2883ef8b75ad8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:51:23.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.423+0000 7f83d4c00700 1 -- 172.21.15.82:0/294975454 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83cc01e040 con 0x557aef7ddbc0 2024-05-08T05:51:23.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.423+0000 7f83d4c00700 1 -- 172.21.15.82:0/294975454 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83cc011dc0 con 0x557aef7ddbc0 2024-05-08T05:51:23.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.424+0000 7f83f1a40b80 1 -- 172.21.15.82:0/294975454 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557aef7ddbc0 msgr2=0x557aef7edfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:23.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.424+0000 7f83f1a40b80 1 --2- 172.21.15.82:0/294975454 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557aef7ddbc0 0x557aef7edfb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f83cc009230 tx=0x7f83cc011c50 comp rx=0 tx=0).stop 2024-05-08T05:51:23.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.426+0000 7f83f1a40b80 1 -- 172.21.15.82:0/294975454 shutdown_connections 2024-05-08T05:51:23.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.426+0000 7f83f1a40b80 1 --2- 172.21.15.82:0/294975454 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557aef7de4e0 0x557aef7d2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:23.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.426+0000 7f83f1a40b80 1 --2- 172.21.15.82:0/294975454 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557aef7d88f0 0x557aef7d82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:23.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.426+0000 7f83f1a40b80 1 --2- 172.21.15.82:0/294975454 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557aef7ddbc0 0x557aef7edfb0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:23.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.426+0000 7f83f1a40b80 1 -- 172.21.15.82:0/294975454 >> 172.21.15.82:0/294975454 conn(0x557aef7506d0 msgr2=0x557aef7dfee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:51:23.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.426+0000 7f83f1a40b80 1 -- 172.21.15.82:0/294975454 shutdown_connections 2024-05-08T05:51:23.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.426+0000 7f83f1a40b80 1 -- 172.21.15.82:0/294975454 wait complete. 2024-05-08T05:51:23.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.427+0000 7f83f1a40b80 1 -- start start 2024-05-08T05:51:23.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.427+0000 7f83f1a40b80 1 Processor -- start 2024-05-08T05:51:23.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.430+0000 7f83f1a40b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557aef7d88f0 0x557aef7ea970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:23.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.430+0000 7f83f1a40b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557aef7ddbc0 0x557aef7f9210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:23.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.430+0000 7f83dfe00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557aef7d88f0 0x557aef7ea970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:23.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.430+0000 7f83dfe00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557aef7d88f0 0x557aef7ea970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:33114/0 (socket says 172.21.15.82:33114) 2024-05-08T05:51:23.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.431+0000 7f83dfe00700 1 -- 172.21.15.82:0/2536757141 learned_addr learned my addr 172.21.15.82:0/2536757141 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:51:23.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.431+0000 7f83df400700 1 --2- 172.21.15.82:0/2536757141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557aef7ddbc0 0x557aef7f9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:23.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.431+0000 7f83f1a40b80 1 --2- 172.21.15.82:0/2536757141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557aef7de4e0 0x557aef7f9820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:23.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.431+0000 7f83f1a40b80 1 -- 172.21.15.82:0/2536757141 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f83e01bdc60 con 0x557aef7de4e0 2024-05-08T05:51:23.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.431+0000 7f83f1a40b80 1 -- 172.21.15.82:0/2536757141 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f83e01bd590 con 0x557aef7ddbc0 2024-05-08T05:51:23.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.431+0000 7f83f1a40b80 1 -- 172.21.15.82:0/2536757141 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f83e01ba790 con 0x557aef7d88f0 2024-05-08T05:51:23.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.431+0000 7f83f1a40b80 10 client.0 _ll_register_callbacks cb 0x557aef6d1c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:51:23.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.431+0000 7f83df400700 1 -- 172.21.15.82:0/2536757141 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557aef7d88f0 msgr2=0x557aef7ea970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:23.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.431+0000 7f83df400700 1 --2- 172.21.15.82:0/2536757141 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557aef7d88f0 0x557aef7ea970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:23.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.432+0000 7f83df400700 1 -- 172.21.15.82:0/2536757141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557aef7de4e0 msgr2=0x557aef7f9820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T05:51:23.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.432+0000 7f83e5000700 1 --2- 172.21.15.82:0/2536757141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557aef7de4e0 0x557aef7f9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:23.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.432+0000 7f83df400700 1 --2- 172.21.15.82:0/2536757141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557aef7de4e0 0x557aef7f9820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:23.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.432+0000 7f83df400700 1 -- 172.21.15.82:0/2536757141 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557aef85b750 con 0x557aef7ddbc0 2024-05-08T05:51:23.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.432+0000 7f83dfe00700 1 --2- 172.21.15.82:0/2536757141 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557aef7d88f0 0x557aef7ea970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:51:23.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.433+0000 7f83df400700 1 --2- 172.21.15.82:0/2536757141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557aef7ddbc0 0x557aef7f9210 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x557aef7d4650 tx=0x7f83cc003c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=207789050dabcf0c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:51:23.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.433+0000 7f83ca000700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:51:23.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.433+0000 7f83ca000700 1 -- 172.21.15.82:0/2536757141 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83cc0056b0 con 0x557aef7ddbc0 2024-05-08T05:51:23.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.433+0000 7f83ca000700 1 -- 172.21.15.82:0/2536757141 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f83cc02c460 con 0x557aef7ddbc0 2024-05-08T05:51:23.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.433+0000 7f83f1a40b80 1 -- 172.21.15.82:0/2536757141 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x557aef738400 con 0x557aef7ddbc0 2024-05-08T05:51:23.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.434+0000 7f83ca000700 1 -- 172.21.15.82:0/2536757141 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f83cc0094c0 con 0x557aef7ddbc0 2024-05-08T05:51:23.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.434+0000 7f83f1a40b80 10 client.25295 fetch_fsmap learned FSMap version 30 2024-05-08T05:51:23.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.434+0000 7f83f1a40b80 1 -- 172.21.15.82:0/2536757141 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557aef85c8a0 con 0x557aef7ddbc0 2024-05-08T05:51:23.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.435+0000 7f83ca000700 1 -- 172.21.15.82:0/2536757141 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x557aef738400 con 0x557aef7ddbc0 2024-05-08T05:51:23.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.435+0000 7f83ca000700 1 -- 172.21.15.82:0/2536757141 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f83cc019870 con 0x557aef7ddbc0 2024-05-08T05:51:23.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.435+0000 7f83f1a40b80 10 client.25295 fetch_fsmap finished waiting for FSMap version 30 2024-05-08T05:51:23.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.435+0000 7f83f1a40b80 10 client.25295 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-08T05:51:23.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.435+0000 7f83f1a40b80 20 client.25295 populate_metadata read hostname 'smithi082' 2024-05-08T05:51:23.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.435+0000 7f83f1a40b80 1 --2- 172.21.15.82:0/2536757141 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x557aef85ccb0 0x557aef85f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:23.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.435+0000 7f83f1a40b80 4 client.25295 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:51:23.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.435+0000 7f83f1a40b80 1 -- 172.21.15.82:0/2536757141 --> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557aef7324a0 con 0x557aef85ccb0 2024-05-08T05:51:23.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.438+0000 7f83dfe00700 1 --2- 172.21.15.82:0/2536757141 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x557aef85ccb0 0x557aef85f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:23.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.439+0000 7f83dfe00700 1 --2- 172.21.15.82:0/2536757141 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x557aef85ccb0 0x557aef85f0a0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2374ff649e82e838 server_cookie=49a093abf3fd05d7 in_seq=0 out_seq=0 2024-05-08T05:51:23.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.439+0000 7f83ca000700 10 client.25295 ms_handle_connect on v2:172.21.15.151:6838/2963754236 2024-05-08T05:51:23.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.440+0000 7f83ca000700 1 -- 172.21.15.82:0/2536757141 <== mds.1 v2:172.21.15.151:6838/2963754236 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557aef7324a0 con 0x557aef85ccb0 2024-05-08T05:51:23.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.440+0000 7f83ca000700 10 client.25295 handle_command_reply: tid=0 2024-05-08T05:51:23.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.440+0000 7f83f1a40b80 1 client.25295 shutdown 2024-05-08T05:51:23.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.441+0000 7f83f1a40b80 1 -- 172.21.15.82:0/2536757141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557aef7ddbc0 msgr2=0x557aef7f9210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:23.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.441+0000 7f83f1a40b80 1 --2- 172.21.15.82:0/2536757141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557aef7ddbc0 0x557aef7f9210 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x557aef7d4650 tx=0x7f83cc003c30 comp rx=0 tx=0).stop 2024-05-08T05:51:23.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.441+0000 7f83f1a40b80 1 -- 172.21.15.82:0/2536757141 shutdown_connections 2024-05-08T05:51:23.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.441+0000 7f83f1a40b80 1 --2- 172.21.15.82:0/2536757141 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x557aef85ccb0 0x557aef85f0a0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:23.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.441+0000 7f83f1a40b80 1 --2- 172.21.15.82:0/2536757141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557aef7de4e0 0x557aef7f9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:23.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.441+0000 7f83f1a40b80 1 --2- 172.21.15.82:0/2536757141 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557aef7d88f0 0x557aef7ea970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:23.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.441+0000 7f83f1a40b80 1 --2- 172.21.15.82:0/2536757141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557aef7ddbc0 0x557aef7f9210 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:23.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.441+0000 7f83f1a40b80 1 -- 172.21.15.82:0/2536757141 >> 172.21.15.82:0/2536757141 conn(0x557aef7506d0 msgr2=0x557aef7de910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:51:23.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.441+0000 7f83ca000700 0 client.25295 ms_handle_reset on v2:172.21.15.151:6838/2963754236 2024-05-08T05:51:23.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.442+0000 7f83f1a40b80 1 -- 172.21.15.82:0/2536757141 shutdown_connections 2024-05-08T05:51:23.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.442+0000 7f83f1a40b80 1 -- 172.21.15.82:0/2536757141 wait complete. 2024-05-08T05:51:23.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.443+0000 7f83f1a40b80 20 client.25295 trim_cache size 0 max 16384 2024-05-08T05:51:23.444 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T05:51:23.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.445+0000 7f83e7000700 1 -- 172.21.15.82:0/1691817536 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f83c40b2980 msgr2=0x7f83c40b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:23.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.445+0000 7f83e7000700 1 --2- 172.21.15.82:0/1691817536 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f83c40b2980 0x7f83c40b4e40 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f83d8009da0 tx=0x7f83d8009040 comp rx=0 tx=0).stop 2024-05-08T05:51:23.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.445+0000 7f83e7000700 1 -- 172.21.15.82:0/1691817536 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83e006b180 msgr2=0x7f83e01a0890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:23.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.445+0000 7f83e7000700 1 --2- 172.21.15.82:0/1691817536 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83e006b180 0x7f83e01a0890 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f83d0005910 tx=0x7f83d000b670 comp rx=0 tx=0).stop 2024-05-08T05:51:23.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.445+0000 7f83e7000700 1 -- 172.21.15.82:0/1691817536 shutdown_connections 2024-05-08T05:51:23.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.445+0000 7f83e7000700 1 --2- 172.21.15.82:0/1691817536 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83e006b180 0x7f83e01a0890 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:23.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.445+0000 7f83e7000700 1 --2- 172.21.15.82:0/1691817536 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f83c40b2980 0x7f83c40b4e40 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:23.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.445+0000 7f83e7000700 1 --2- 172.21.15.82:0/1691817536 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83e0109510 0x7f83e010e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:23.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.445+0000 7f83e7000700 1 --2- 172.21.15.82:0/1691817536 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83e006bb40 0x7f83e01a0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:23.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.445+0000 7f83e7000700 1 -- 172.21.15.82:0/1691817536 >> 172.21.15.82:0/1691817536 conn(0x7f83e0079350 msgr2=0x7f83e0102ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:51:23.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.448+0000 7f83e7000700 1 -- 172.21.15.82:0/1691817536 shutdown_connections 2024-05-08T05:51:23.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:23.448+0000 7f83e7000700 1 -- 172.21.15.82:0/1691817536 wait complete. 2024-05-08T05:51:23.895 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:51:23 smithi082 ceph-mon[30098]: pgmap v481: 97 pgs: 97 active+clean; 961 MiB data, 979 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.0 MiB/s wr, 637 op/s 2024-05-08T05:51:23.895 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:51:23 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:51:23.896 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:51:23 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:51:23.896 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:51:23 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:51:24.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:51:23 smithi134 ceph-mon[34132]: pgmap v481: 97 pgs: 97 active+clean; 961 MiB data, 979 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.0 MiB/s wr, 637 op/s 2024-05-08T05:51:24.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:51:23 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:51:24.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:51:23 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:51:24.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:51:23 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:51:24.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:51:23 smithi151 ceph-mon[34815]: pgmap v481: 97 pgs: 97 active+clean; 961 MiB data, 979 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.0 MiB/s wr, 637 op/s 2024-05-08T05:51:24.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:51:23 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:51:24.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:51:23 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:51:24.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:51:23 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:51:24.403 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-05-08T05:51:25.046 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:51:25.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 35.0 s, 3056.4 tps, lat 32.806 ms stddev 42.032 2024-05-08T05:51:25.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:51:25 smithi082 ceph-mon[30098]: pgmap v482: 97 pgs: 97 active+clean; 980 MiB data, 1014 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 684 op/s 2024-05-08T05:51:25.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:51:25 smithi134 ceph-mon[34132]: pgmap v482: 97 pgs: 97 active+clean; 980 MiB data, 1014 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 684 op/s 2024-05-08T05:51:26.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:51:25 smithi151 ceph-mon[34815]: pgmap v482: 97 pgs: 97 active+clean; 980 MiB data, 1014 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 684 op/s 2024-05-08T05:51:27.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.499+0000 7f7946000700 1 -- 172.21.15.82:0/3427656351 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f794006b6f0 msgr2=0x7f794006bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:27.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.499+0000 7f7946000700 1 --2- 172.21.15.82:0/3427656351 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f794006b6f0 0x7f794006bb50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7930009990 tx=0x7f7930009ca0 comp rx=0 tx=0).stop 2024-05-08T05:51:27.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.499+0000 7f7946000700 1 -- 172.21.15.82:0/3427656351 shutdown_connections 2024-05-08T05:51:27.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.499+0000 7f7946000700 1 --2- 172.21.15.82:0/3427656351 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7940105ee0 0x7f7940106370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:27.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.499+0000 7f7946000700 1 --2- 172.21.15.82:0/3427656351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79401083d0 0x7f794006b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:27.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.499+0000 7f7946000700 1 --2- 172.21.15.82:0/3427656351 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f794006b6f0 0x7f794006bb50 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:27.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.499+0000 7f7946000700 1 -- 172.21.15.82:0/3427656351 >> 172.21.15.82:0/3427656351 conn(0x7f7940079350 msgr2=0x7f7940079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:51:27.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.499+0000 7f7946000700 1 -- 172.21.15.82:0/3427656351 shutdown_connections 2024-05-08T05:51:27.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.500+0000 7f7946000700 1 -- 172.21.15.82:0/3427656351 wait complete. 2024-05-08T05:51:27.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.501+0000 7f7946000700 1 Processor -- start 2024-05-08T05:51:27.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.501+0000 7f7946000700 1 -- start start 2024-05-08T05:51:27.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.502+0000 7f7946000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f794006b6f0 0x7f79401a0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:27.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.502+0000 7f7946000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7940105ee0 0x7f79401a06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:27.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.502+0000 7f7946000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79401083d0 0x7f79401a4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:27.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.502+0000 7f7946000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7940119c80 con 0x7f79401083d0 2024-05-08T05:51:27.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.502+0000 7f7946000700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7940119b00 con 0x7f7940105ee0 2024-05-08T05:51:27.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.502+0000 7f7946000700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7940119e00 con 0x7f794006b6f0 2024-05-08T05:51:27.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.502+0000 7f793ea00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7940105ee0 0x7f79401a06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:27.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.502+0000 7f793ea00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7940105ee0 0x7f79401a06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:53580/0 (socket says 172.21.15.82:53580) 2024-05-08T05:51:27.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.502+0000 7f793ea00700 1 -- 172.21.15.82:0/438926196 learned_addr learned my addr 172.21.15.82:0/438926196 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:51:27.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.502+0000 7f793f400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f794006b6f0 0x7f79401a0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:27.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.503+0000 7f793ea00700 1 -- 172.21.15.82:0/438926196 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f794006b6f0 msgr2=0x7f79401a0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:27.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.503+0000 7f793ea00700 1 --2- 172.21.15.82:0/438926196 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f794006b6f0 0x7f79401a0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:27.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.503+0000 7f793ea00700 1 -- 172.21.15.82:0/438926196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79401083d0 msgr2=0x7f79401a4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:27.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.503+0000 7f793ea00700 1 --2- 172.21.15.82:0/438926196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79401083d0 0x7f79401a4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:27.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.503+0000 7f793ea00700 1 -- 172.21.15.82:0/438926196 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79401a51a0 con 0x7f7940105ee0 2024-05-08T05:51:27.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.503+0000 7f793ea00700 1 --2- 172.21.15.82:0/438926196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7940105ee0 0x7f79401a06d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7930000c00 tx=0x7f7930009510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:51:27.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.503+0000 7f7937e00700 1 -- 172.21.15.82:0/438926196 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7930027070 con 0x7f7940105ee0 2024-05-08T05:51:27.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.504+0000 7f7937e00700 1 -- 172.21.15.82:0/438926196 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7930022470 con 0x7f7940105ee0 2024-05-08T05:51:27.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.504+0000 7f7937e00700 1 -- 172.21.15.82:0/438926196 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7930017650 con 0x7f7940105ee0 2024-05-08T05:51:27.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.505+0000 7f7946000700 1 -- 172.21.15.82:0/438926196 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79401a5430 con 0x7f7940105ee0 2024-05-08T05:51:27.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.505+0000 7f7946000700 1 -- 172.21.15.82:0/438926196 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79401acd10 con 0x7f7940105ee0 2024-05-08T05:51:27.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.509+0000 7f7937e00700 1 -- 172.21.15.82:0/438926196 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f793002a070 con 0x7f7940105ee0 2024-05-08T05:51:27.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.513+0000 7f7950a10b80 1 Processor -- start 2024-05-08T05:51:27.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.513+0000 7f7950a10b80 1 -- start start 2024-05-08T05:51:27.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.514+0000 7f7950a10b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c07f6e060 0x557c07f6e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:27.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.514+0000 7f7950a10b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c07f6e980 0x557c07f72490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:27.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.514+0000 7f7950a10b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557c07f729d0 0x557c07f72e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:27.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.514+0000 7f7950a10b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x557c07ec0a20 con 0x557c07f6e060 2024-05-08T05:51:27.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.514+0000 7f7950a10b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x557c07e5e760 con 0x557c07f729d0 2024-05-08T05:51:27.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.514+0000 7f7950a10b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x557c07ebc9e0 con 0x557c07f6e980 2024-05-08T05:51:27.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.514+0000 7f793fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c07f6e060 0x557c07f6e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:27.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.514+0000 7f793fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c07f6e060 0x557c07f6e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39444/0 (socket says 172.21.15.82:39444) 2024-05-08T05:51:27.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.514+0000 7f793fe00700 1 -- 172.21.15.82:0/2043044785 learned_addr learned my addr 172.21.15.82:0/2043044785 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:51:27.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.514+0000 7f793f400700 1 --2- 172.21.15.82:0/2043044785 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c07f6e980 0x557c07f72490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:27.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.515+0000 7f793fe00700 1 -- 172.21.15.82:0/2043044785 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c07f6e980 msgr2=0x557c07f72490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:27.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.515+0000 7f793fe00700 1 --2- 172.21.15.82:0/2043044785 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c07f6e980 0x557c07f72490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:27.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.515+0000 7f793fe00700 1 -- 172.21.15.82:0/2043044785 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557c07f729d0 msgr2=0x557c07f72e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:27.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.516+0000 7f793ea00700 1 --2- 172.21.15.82:0/2043044785 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557c07f729d0 0x557c07f72e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:27.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.516+0000 7f793fe00700 1 --2- 172.21.15.82:0/2043044785 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557c07f729d0 0x557c07f72e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:27.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.516+0000 7f793fe00700 1 -- 172.21.15.82:0/2043044785 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c07e0d8d0 con 0x557c07f6e060 2024-05-08T05:51:27.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.516+0000 7f793fe00700 1 --2- 172.21.15.82:0/2043044785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c07f6e060 0x557c07f6e440 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f793800e400 tx=0x7f793800e710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b78f9651897c825 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:51:27.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.517+0000 7f7937e00700 1 --2- 172.21.15.82:0/438926196 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f79240b29d0 0x7f79240b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:27.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.517+0000 7f7937e00700 1 -- 172.21.15.82:0/438926196 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f79300e2f90 con 0x7f7940105ee0 2024-05-08T05:51:27.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.518+0000 7f793f400700 1 --2- 172.21.15.82:0/438926196 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f79240b29d0 0x7f79240b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:27.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.518+0000 7f7934c00700 1 -- 172.21.15.82:0/2043044785 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7938004bb0 con 0x557c07f6e060 2024-05-08T05:51:27.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.518+0000 7f7934c00700 1 -- 172.21.15.82:0/2043044785 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7938004d50 con 0x557c07f6e060 2024-05-08T05:51:27.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.518+0000 7f7934c00700 1 -- 172.21.15.82:0/2043044785 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79380043e0 con 0x557c07f6e060 2024-05-08T05:51:27.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.519+0000 7f7950a10b80 1 -- 172.21.15.82:0/2043044785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c07f6e060 msgr2=0x557c07f6e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:27.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.519+0000 7f7950a10b80 1 --2- 172.21.15.82:0/2043044785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c07f6e060 0x557c07f6e440 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f793800e400 tx=0x7f793800e710 comp rx=0 tx=0).stop 2024-05-08T05:51:27.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.520+0000 7f7950a10b80 1 -- 172.21.15.82:0/2043044785 shutdown_connections 2024-05-08T05:51:27.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.520+0000 7f7950a10b80 1 --2- 172.21.15.82:0/2043044785 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557c07f729d0 0x557c07f72e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:27.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.520+0000 7f7950a10b80 1 --2- 172.21.15.82:0/2043044785 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c07f6e060 0x557c07f6e440 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:27.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.520+0000 7f7950a10b80 1 --2- 172.21.15.82:0/2043044785 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c07f6e980 0x557c07f72490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:27.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.520+0000 7f7950a10b80 1 -- 172.21.15.82:0/2043044785 >> 172.21.15.82:0/2043044785 conn(0x557c07e9cb60 msgr2=0x557c07f687a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:51:27.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.520+0000 7f7950a10b80 1 -- 172.21.15.82:0/2043044785 shutdown_connections 2024-05-08T05:51:27.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.520+0000 7f7950a10b80 1 -- 172.21.15.82:0/2043044785 wait complete. 2024-05-08T05:51:27.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.520+0000 7f7950a10b80 1 -- start start 2024-05-08T05:51:27.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.521+0000 7f7950a10b80 1 Processor -- start 2024-05-08T05:51:27.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.521+0000 7f7950a10b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c07f6e060 0x557c07f79eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:27.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.521+0000 7f7950a10b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c07f6e980 0x557c07f77250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:27.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.521+0000 7f7950a10b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557c07f729d0 0x557c07f77790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:27.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.522+0000 7f793f400700 1 --2- 172.21.15.82:0/438926196 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f79240b29d0 0x7f79240b4e90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7928004690 tx=0x7f7928009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:51:27.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.522+0000 7f793f400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c07f6e060 0x557c07f79eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:27.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.522+0000 7f793f400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c07f6e060 0x557c07f79eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39446/0 (socket says 172.21.15.82:39446) 2024-05-08T05:51:27.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.522+0000 7f793ea00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c07f6e980 0x557c07f77250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:27.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.522+0000 7f793ea00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c07f6e980 0x557c07f77250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:33152/0 (socket says 172.21.15.82:33152) 2024-05-08T05:51:27.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.522+0000 7f7950a10b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x557c07f8bb90 con 0x557c07f6e060 2024-05-08T05:51:27.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.522+0000 7f7950a10b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x557c07e26b20 con 0x557c07f729d0 2024-05-08T05:51:27.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.522+0000 7f7950a10b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x557c07f8bd10 con 0x557c07f6e980 2024-05-08T05:51:27.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.523+0000 7f7950a10b80 10 client.0 _ll_register_callbacks cb 0x557c07e67c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:51:27.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.523+0000 7f793f400700 1 -- 172.21.15.82:0/1491916069 learned_addr learned my addr 172.21.15.82:0/1491916069 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:51:27.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.523+0000 7f793fe00700 1 --2- 172.21.15.82:0/1491916069 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557c07f729d0 0x557c07f77790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:27.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.523+0000 7f793ea00700 1 -- 172.21.15.82:0/1491916069 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557c07f729d0 msgr2=0x557c07f77790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:27.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.523+0000 7f793ea00700 1 --2- 172.21.15.82:0/1491916069 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557c07f729d0 0x557c07f77790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:27.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.523+0000 7f793ea00700 1 -- 172.21.15.82:0/1491916069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c07f6e060 msgr2=0x557c07f79eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:27.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.523+0000 7f793ea00700 1 --2- 172.21.15.82:0/1491916069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c07f6e060 0x557c07f79eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:27.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.523+0000 7f793ea00700 1 -- 172.21.15.82:0/1491916069 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c07e86420 con 0x557c07f6e980 2024-05-08T05:51:27.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.524+0000 7f793ea00700 1 --2- 172.21.15.82:0/1491916069 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c07f6e980 0x557c07f77250 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f79300aa580 tx=0x7f7930022b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ac74eea3aff2c68 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:51:27.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.524+0000 7f793fe00700 1 --2- 172.21.15.82:0/1491916069 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557c07f729d0 0x557c07f77790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:51:27.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.524+0000 7f792d600700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:51:27.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.524+0000 7f792d600700 1 -- 172.21.15.82:0/1491916069 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79300aa100 con 0x557c07f6e980 2024-05-08T05:51:27.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.524+0000 7f792d600700 1 -- 172.21.15.82:0/1491916069 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f7930009580 con 0x557c07f6e980 2024-05-08T05:51:27.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.524+0000 7f7950a10b80 1 -- 172.21.15.82:0/1491916069 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7938004d50 con 0x557c07f6e980 2024-05-08T05:51:27.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.525+0000 7f792d600700 1 -- 172.21.15.82:0/1491916069 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f79300aacf0 con 0x557c07f6e980 2024-05-08T05:51:27.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.525+0000 7f7950a10b80 10 client.25312 fetch_fsmap learned FSMap version 30 2024-05-08T05:51:27.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.525+0000 7f7950a10b80 1 -- 172.21.15.82:0/1491916069 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557c07f8bbf0 con 0x557c07f6e980 2024-05-08T05:51:27.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.525+0000 7f792d600700 1 -- 172.21.15.82:0/1491916069 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7938004d50 con 0x557c07f6e980 2024-05-08T05:51:27.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.525+0000 7f792d600700 1 -- 172.21.15.82:0/1491916069 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f79300e6140 con 0x557c07f6e980 2024-05-08T05:51:27.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.525+0000 7f7950a10b80 10 client.25312 fetch_fsmap finished waiting for FSMap version 30 2024-05-08T05:51:27.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.525+0000 7f7950a10b80 10 client.25312 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:51:27.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.525+0000 7f7950a10b80 20 client.25312 populate_metadata read hostname 'smithi082' 2024-05-08T05:51:27.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.525+0000 7f7950a10b80 1 --2- 172.21.15.82:0/1491916069 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x557c07f98a00 0x557c07f9ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:27.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.525+0000 7f7950a10b80 4 client.25312 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:51:27.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.525+0000 7f7950a10b80 1 -- 172.21.15.82:0/1491916069 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557c07f3b0a0 con 0x557c07f98a00 2024-05-08T05:51:27.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.527+0000 7f793f400700 1 --2- 172.21.15.82:0/1491916069 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x557c07f98a00 0x557c07f9ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:27.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.528+0000 7f793f400700 1 --2- 172.21.15.82:0/1491916069 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x557c07f98a00 0x557c07f9ae20 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13ee21e31e2d4ab6 server_cookie=9faf991d041eca5f in_seq=0 out_seq=0 2024-05-08T05:51:27.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.528+0000 7f792d600700 10 client.25312 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:51:27.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.529+0000 7f792d600700 1 -- 172.21.15.82:0/1491916069 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557c07f3b0a0 con 0x557c07f98a00 2024-05-08T05:51:27.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.529+0000 7f792d600700 10 client.25312 handle_command_reply: tid=0 2024-05-08T05:51:27.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.529+0000 7f7950a10b80 1 client.25312 shutdown 2024-05-08T05:51:27.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.529+0000 7f7950a10b80 1 -- 172.21.15.82:0/1491916069 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c07f6e980 msgr2=0x557c07f77250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:27.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.529+0000 7f7950a10b80 1 --2- 172.21.15.82:0/1491916069 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c07f6e980 0x557c07f77250 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f79300aa580 tx=0x7f7930022b90 comp rx=0 tx=0).stop 2024-05-08T05:51:27.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.530+0000 7f7950a10b80 1 -- 172.21.15.82:0/1491916069 shutdown_connections 2024-05-08T05:51:27.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.530+0000 7f7950a10b80 1 --2- 172.21.15.82:0/1491916069 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x557c07f98a00 0x557c07f9ae20 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:27.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.530+0000 7f7950a10b80 1 --2- 172.21.15.82:0/1491916069 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557c07f729d0 0x557c07f77790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:27.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.530+0000 7f7950a10b80 1 --2- 172.21.15.82:0/1491916069 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c07f6e060 0x557c07f79eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:27.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.530+0000 7f7950a10b80 1 --2- 172.21.15.82:0/1491916069 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c07f6e980 0x557c07f77250 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:27.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.530+0000 7f7950a10b80 1 -- 172.21.15.82:0/1491916069 >> 172.21.15.82:0/1491916069 conn(0x557c07e9cb60 msgr2=0x557c07f632b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:51:27.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.530+0000 7f792d600700 0 client.25312 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:51:27.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.530+0000 7f7950a10b80 1 -- 172.21.15.82:0/1491916069 shutdown_connections 2024-05-08T05:51:27.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.530+0000 7f7950a10b80 1 -- 172.21.15.82:0/1491916069 wait complete. 2024-05-08T05:51:27.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.530+0000 7f7950a10b80 20 client.25312 trim_cache size 0 max 16384 2024-05-08T05:51:27.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.555+0000 7f7950a10b80 1 Processor -- start 2024-05-08T05:51:27.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.556+0000 7f7950a10b80 1 -- start start 2024-05-08T05:51:27.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.556+0000 7f7950a10b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c07f6e060 0x557c07f9ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:27.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.556+0000 7f7950a10b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557c07f6e980 0x557c07f94c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:27.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.556+0000 7f7950a10b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c07f729d0 0x557c07f73dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:27.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.556+0000 7f7950a10b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7940073f70 con 0x557c07f729d0 2024-05-08T05:51:27.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.556+0000 7f7950a10b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f79401ad2f0 con 0x557c07f6e980 2024-05-08T05:51:27.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.556+0000 7f7950a10b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7940074640 con 0x557c07f6e060 2024-05-08T05:51:27.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.557+0000 7f793f400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c07f6e060 0x557c07f9ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:27.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.557+0000 7f793f400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c07f6e060 0x557c07f9ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:33166/0 (socket says 172.21.15.82:33166) 2024-05-08T05:51:27.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.557+0000 7f793f400700 1 -- 172.21.15.82:0/3159078349 learned_addr learned my addr 172.21.15.82:0/3159078349 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:51:27.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.557+0000 7f793fe00700 1 --2- 172.21.15.82:0/3159078349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c07f729d0 0x557c07f73dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:27.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.557+0000 7f793ea00700 1 --2- 172.21.15.82:0/3159078349 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557c07f6e980 0x557c07f94c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:27.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.557+0000 7f793f400700 1 -- 172.21.15.82:0/3159078349 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557c07f6e980 msgr2=0x557c07f94c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:27.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.557+0000 7f793f400700 1 --2- 172.21.15.82:0/3159078349 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557c07f6e980 0x557c07f94c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:27.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.557+0000 7f793f400700 1 -- 172.21.15.82:0/3159078349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c07f729d0 msgr2=0x557c07f73dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:27.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.557+0000 7f793f400700 1 --2- 172.21.15.82:0/3159078349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c07f729d0 0x557c07f73dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:27.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.557+0000 7f793f400700 1 -- 172.21.15.82:0/3159078349 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c07f69610 con 0x557c07f6e060 2024-05-08T05:51:27.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.557+0000 7f793fe00700 1 --2- 172.21.15.82:0/3159078349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c07f729d0 0x557c07f73dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:51:27.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.557+0000 7f793ea00700 1 --2- 172.21.15.82:0/3159078349 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557c07f6e980 0x557c07f94c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:51:27.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.558+0000 7f793f400700 1 --2- 172.21.15.82:0/3159078349 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c07f6e060 0x557c07f9ad80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7928003790 tx=0x7f7928018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c985d5d9bd32ab1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:51:27.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.558+0000 7f792fe00700 1 -- 172.21.15.82:0/3159078349 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7928030070 con 0x557c07f6e060 2024-05-08T05:51:27.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.558+0000 7f792fe00700 1 -- 172.21.15.82:0/3159078349 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f792802a9e0 con 0x557c07f6e060 2024-05-08T05:51:27.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.559+0000 7f792fe00700 1 -- 172.21.15.82:0/3159078349 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79280116a0 con 0x557c07f6e060 2024-05-08T05:51:27.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.559+0000 7f7950a10b80 1 -- 172.21.15.82:0/3159078349 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c07f6e060 msgr2=0x557c07f9ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:27.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.559+0000 7f7950a10b80 1 --2- 172.21.15.82:0/3159078349 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c07f6e060 0x557c07f9ad80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7928003790 tx=0x7f7928018000 comp rx=0 tx=0).stop 2024-05-08T05:51:27.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.560+0000 7f7950a10b80 1 -- 172.21.15.82:0/3159078349 shutdown_connections 2024-05-08T05:51:27.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.560+0000 7f7950a10b80 1 --2- 172.21.15.82:0/3159078349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c07f729d0 0x557c07f73dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:27.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.560+0000 7f7950a10b80 1 --2- 172.21.15.82:0/3159078349 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c07f6e060 0x557c07f9ad80 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:27.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.560+0000 7f7950a10b80 1 --2- 172.21.15.82:0/3159078349 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557c07f6e980 0x557c07f94c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:27.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.560+0000 7f7950a10b80 1 -- 172.21.15.82:0/3159078349 >> 172.21.15.82:0/3159078349 conn(0x557c07e9cb60 msgr2=0x557c07f74d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:51:27.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.560+0000 7f7950a10b80 1 -- 172.21.15.82:0/3159078349 shutdown_connections 2024-05-08T05:51:27.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.560+0000 7f7950a10b80 1 -- 172.21.15.82:0/3159078349 wait complete. 2024-05-08T05:51:27.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.561+0000 7f7950a10b80 1 -- start start 2024-05-08T05:51:27.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.561+0000 7f7950a10b80 1 Processor -- start 2024-05-08T05:51:27.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.562+0000 7f7950a10b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c07f6e060 0x557c07f90fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:27.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.563+0000 7f7950a10b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c07f6e980 0x557c07f914e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:27.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.563+0000 7f793f400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c07f6e060 0x557c07f90fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:27.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.563+0000 7f793f400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c07f6e060 0x557c07f90fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:33178/0 (socket says 172.21.15.82:33178) 2024-05-08T05:51:27.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.563+0000 7f793f400700 1 -- 172.21.15.82:0/2629138424 learned_addr learned my addr 172.21.15.82:0/2629138424 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:51:27.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.563+0000 7f7950a10b80 1 --2- 172.21.15.82:0/2629138424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557c07f729d0 0x557c07ffe280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:27.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.563+0000 7f7950a10b80 1 -- 172.21.15.82:0/2629138424 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f79400753e0 con 0x557c07f6e980 2024-05-08T05:51:27.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.563+0000 7f7950a10b80 1 -- 172.21.15.82:0/2629138424 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7940074d10 con 0x557c07f729d0 2024-05-08T05:51:27.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.563+0000 7f7950a10b80 1 -- 172.21.15.82:0/2629138424 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7940071ef0 con 0x557c07f6e060 2024-05-08T05:51:27.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.563+0000 7f793ea00700 1 --2- 172.21.15.82:0/2629138424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c07f6e980 0x557c07f914e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:27.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.563+0000 7f7950a10b80 10 client.0 _ll_register_callbacks cb 0x557c07e67c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:51:27.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.564+0000 7f793fe00700 1 --2- 172.21.15.82:0/2629138424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557c07f729d0 0x557c07ffe280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:27.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.564+0000 7f793f400700 1 -- 172.21.15.82:0/2629138424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557c07f729d0 msgr2=0x557c07ffe280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:27.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.564+0000 7f793f400700 1 --2- 172.21.15.82:0/2629138424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557c07f729d0 0x557c07ffe280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:27.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.564+0000 7f793f400700 1 -- 172.21.15.82:0/2629138424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c07f6e980 msgr2=0x557c07f914e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:27.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.564+0000 7f793f400700 1 --2- 172.21.15.82:0/2629138424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c07f6e980 0x557c07f914e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:27.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.564+0000 7f793f400700 1 -- 172.21.15.82:0/2629138424 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c07ffe7c0 con 0x557c07f6e060 2024-05-08T05:51:27.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.565+0000 7f793f400700 1 --2- 172.21.15.82:0/2629138424 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c07f6e060 0x557c07f90fa0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7928009f50 tx=0x7f7928003870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e88f604c17bc7aa7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:51:27.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.565+0000 7f792d600700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:51:27.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.565+0000 7f792d600700 1 -- 172.21.15.82:0/2629138424 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7928030050 con 0x557c07f6e060 2024-05-08T05:51:27.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.565+0000 7f7950a10b80 1 -- 172.21.15.82:0/2629138424 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f792802a9e0 con 0x557c07f6e060 2024-05-08T05:51:27.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.565+0000 7f792d600700 1 -- 172.21.15.82:0/2629138424 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f792801e800 con 0x557c07f6e060 2024-05-08T05:51:27.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.566+0000 7f792d600700 1 -- 172.21.15.82:0/2629138424 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f792801ea00 con 0x557c07f6e060 2024-05-08T05:51:27.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.566+0000 7f7950a10b80 10 client.25318 fetch_fsmap learned FSMap version 30 2024-05-08T05:51:27.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.566+0000 7f7950a10b80 1 -- 172.21.15.82:0/2629138424 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x557c07f9fe40 con 0x557c07f6e060 2024-05-08T05:51:27.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.566+0000 7f792d600700 1 -- 172.21.15.82:0/2629138424 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f792802a9e0 con 0x557c07f6e060 2024-05-08T05:51:27.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.566+0000 7f792d600700 1 -- 172.21.15.82:0/2629138424 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f7928004ab0 con 0x557c07f6e060 2024-05-08T05:51:27.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.566+0000 7f7950a10b80 10 client.25318 fetch_fsmap finished waiting for FSMap version 30 2024-05-08T05:51:27.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.566+0000 7f7950a10b80 10 client.25318 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:51:27.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.566+0000 7f7950a10b80 20 client.25318 populate_metadata read hostname 'smithi082' 2024-05-08T05:51:27.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.566+0000 7f7950a10b80 1 --2- 172.21.15.82:0/2629138424 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x557c080142b0 0x557c080166a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:27.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.567+0000 7f7950a10b80 4 client.25318 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:51:27.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.567+0000 7f7950a10b80 1 -- 172.21.15.82:0/2629138424 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557c07ece400 con 0x557c080142b0 2024-05-08T05:51:27.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.567+0000 7f793ea00700 1 --2- 172.21.15.82:0/2629138424 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x557c080142b0 0x557c080166a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:27.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.568+0000 7f793ea00700 1 --2- 172.21.15.82:0/2629138424 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x557c080142b0 0x557c080166a0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a30b17dbce78769 server_cookie=25fad0815332f28b in_seq=0 out_seq=0 2024-05-08T05:51:27.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.568+0000 7f792d600700 10 client.25318 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:51:27.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.568+0000 7f792d600700 1 -- 172.21.15.82:0/2629138424 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557c07ece400 con 0x557c080142b0 2024-05-08T05:51:27.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.568+0000 7f792d600700 10 client.25318 handle_command_reply: tid=0 2024-05-08T05:51:27.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.568+0000 7f7950a10b80 1 client.25318 shutdown 2024-05-08T05:51:27.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.569+0000 7f7950a10b80 1 -- 172.21.15.82:0/2629138424 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c07f6e060 msgr2=0x557c07f90fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:27.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.569+0000 7f7950a10b80 1 --2- 172.21.15.82:0/2629138424 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c07f6e060 0x557c07f90fa0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7928009f50 tx=0x7f7928003870 comp rx=0 tx=0).stop 2024-05-08T05:51:27.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.569+0000 7f7950a10b80 1 -- 172.21.15.82:0/2629138424 shutdown_connections 2024-05-08T05:51:27.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.569+0000 7f7950a10b80 1 --2- 172.21.15.82:0/2629138424 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x557c080142b0 0x557c080166a0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:27.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.569+0000 7f792d600700 0 client.25318 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:51:27.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.569+0000 7f7950a10b80 1 --2- 172.21.15.82:0/2629138424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557c07f729d0 0x557c07ffe280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:27.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.569+0000 7f7950a10b80 1 --2- 172.21.15.82:0/2629138424 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557c07f6e060 0x557c07f90fa0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:27.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.569+0000 7f7950a10b80 1 --2- 172.21.15.82:0/2629138424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557c07f6e980 0x557c07f914e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:27.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.569+0000 7f7950a10b80 1 -- 172.21.15.82:0/2629138424 >> 172.21.15.82:0/2629138424 conn(0x557c07e9cb60 msgr2=0x557c07f62a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:51:27.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.569+0000 7f7950a10b80 1 -- 172.21.15.82:0/2629138424 shutdown_connections 2024-05-08T05:51:27.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.569+0000 7f7950a10b80 1 -- 172.21.15.82:0/2629138424 wait complete. 2024-05-08T05:51:27.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.569+0000 7f7950a10b80 20 client.25318 trim_cache size 0 max 16384 2024-05-08T05:51:27.570 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T05:51:27.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.571+0000 7f7946000700 1 -- 172.21.15.82:0/438926196 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f79240b29d0 msgr2=0x7f79240b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:27.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.571+0000 7f7946000700 1 --2- 172.21.15.82:0/438926196 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f79240b29d0 0x7f79240b4e90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7928004690 tx=0x7f7928009260 comp rx=0 tx=0).stop 2024-05-08T05:51:27.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.571+0000 7f7946000700 1 -- 172.21.15.82:0/438926196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7940105ee0 msgr2=0x7f79401a06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:27.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.571+0000 7f7946000700 1 --2- 172.21.15.82:0/438926196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7940105ee0 0x7f79401a06d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f7930000c00 tx=0x7f7930009510 comp rx=0 tx=0).stop 2024-05-08T05:51:27.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.571+0000 7f7946000700 1 -- 172.21.15.82:0/438926196 shutdown_connections 2024-05-08T05:51:27.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.571+0000 7f7946000700 1 --2- 172.21.15.82:0/438926196 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f79240b29d0 0x7f79240b4e90 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:27.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.571+0000 7f7946000700 1 --2- 172.21.15.82:0/438926196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f79401083d0 0x7f79401a4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:27.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.571+0000 7f7946000700 1 --2- 172.21.15.82:0/438926196 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f794006b6f0 0x7f79401a0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:27.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.571+0000 7f7946000700 1 --2- 172.21.15.82:0/438926196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7940105ee0 0x7f79401a06d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:27.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.571+0000 7f7946000700 1 -- 172.21.15.82:0/438926196 >> 172.21.15.82:0/438926196 conn(0x7f7940079350 msgr2=0x7f7940104ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:51:27.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.572+0000 7f7946000700 1 -- 172.21.15.82:0/438926196 shutdown_connections 2024-05-08T05:51:27.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:27.572+0000 7f7946000700 1 -- 172.21.15.82:0/438926196 wait complete. 2024-05-08T05:51:27.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:51:27 smithi082 ceph-mon[30098]: pgmap v483: 97 pgs: 97 active+clean; 994 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 14 MiB/s wr, 727 op/s 2024-05-08T05:51:28.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:51:27 smithi134 ceph-mon[34132]: pgmap v483: 97 pgs: 97 active+clean; 994 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 14 MiB/s wr, 727 op/s 2024-05-08T05:51:28.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:51:27 smithi151 ceph-mon[34815]: pgmap v483: 97 pgs: 97 active+clean; 994 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 14 MiB/s wr, 727 op/s 2024-05-08T05:51:29.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:51:29 smithi082 ceph-mon[30098]: pgmap v484: 97 pgs: 97 active+clean; 988 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 13 MiB/s wr, 679 op/s 2024-05-08T05:51:29.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:51:29 smithi134 ceph-mon[34132]: pgmap v484: 97 pgs: 97 active+clean; 988 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 13 MiB/s wr, 679 op/s 2024-05-08T05:51:30.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:51:29 smithi151 ceph-mon[34815]: pgmap v484: 97 pgs: 97 active+clean; 988 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 13 MiB/s wr, 679 op/s 2024-05-08T05:51:30.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 40.0 s, 3036.2 tps, lat 32.896 ms stddev 39.522 2024-05-08T05:51:30.376 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-08T05:51:30.376 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-05-08T05:51:30.988 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:51:31.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:51:31 smithi082 ceph-mon[30098]: pgmap v485: 97 pgs: 97 active+clean; 980 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 MiB/s wr, 802 op/s 2024-05-08T05:51:32.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:51:31 smithi134 ceph-mon[34132]: pgmap v485: 97 pgs: 97 active+clean; 980 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 MiB/s wr, 802 op/s 2024-05-08T05:51:32.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:51:31 smithi151 ceph-mon[34815]: pgmap v485: 97 pgs: 97 active+clean; 980 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 15 MiB/s wr, 802 op/s 2024-05-08T05:51:33.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.420+0000 7f9a22200700 1 -- 172.21.15.82:0/1712213215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a1c10a490 msgr2=0x7f9a1c1169a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:33.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.420+0000 7f9a22200700 1 --2- 172.21.15.82:0/1712213215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a1c10a490 0x7f9a1c1169a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9a14009f90 tx=0x7f9a1400b330 comp rx=0 tx=0).stop 2024-05-08T05:51:33.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.421+0000 7f9a22200700 1 -- 172.21.15.82:0/1712213215 shutdown_connections 2024-05-08T05:51:33.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.421+0000 7f9a22200700 1 --2- 172.21.15.82:0/1712213215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a1c10a490 0x7f9a1c1169a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:33.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.421+0000 7f9a22200700 1 --2- 172.21.15.82:0/1712213215 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a1c10fb60 0x7f9a1c10ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:33.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.421+0000 7f9a22200700 1 --2- 172.21.15.82:0/1712213215 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a1c109ad0 0x7f9a1c109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:33.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.421+0000 7f9a22200700 1 -- 172.21.15.82:0/1712213215 >> 172.21.15.82:0/1712213215 conn(0x7f9a1c076c70 msgr2=0x7f9a1c1082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:51:33.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.421+0000 7f9a22200700 1 -- 172.21.15.82:0/1712213215 shutdown_connections 2024-05-08T05:51:33.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.423+0000 7f9a22200700 1 -- 172.21.15.82:0/1712213215 wait complete. 2024-05-08T05:51:33.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.424+0000 7f9a22200700 1 Processor -- start 2024-05-08T05:51:33.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.425+0000 7f9a22200700 1 -- start start 2024-05-08T05:51:33.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.425+0000 7f9a22200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a1c109ad0 0x7f9a1c074c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:33.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.425+0000 7f9a22200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a1c10a490 0x7f9a1c075140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:33.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.425+0000 7f9a22200700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a1c10fb60 0x7f9a1c06dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:33.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.425+0000 7f9a22200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9a1c119d20 con 0x7f9a1c10a490 2024-05-08T05:51:33.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.425+0000 7f9a22200700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9a1c119ba0 con 0x7f9a1c109ad0 2024-05-08T05:51:33.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.425+0000 7f9a22200700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9a1c119ea0 con 0x7f9a1c10fb60 2024-05-08T05:51:33.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.425+0000 7f9a1b400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a1c109ad0 0x7f9a1c074c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:33.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.425+0000 7f9a1b400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a1c109ad0 0x7f9a1c074c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:54992/0 (socket says 172.21.15.82:54992) 2024-05-08T05:51:33.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.425+0000 7f9a1b400700 1 -- 172.21.15.82:0/3120372696 learned_addr learned my addr 172.21.15.82:0/3120372696 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:51:33.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.426+0000 7f9a1be00700 1 --2- 172.21.15.82:0/3120372696 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a1c10fb60 0x7f9a1c06dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:33.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.426+0000 7f9a1b400700 1 -- 172.21.15.82:0/3120372696 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a1c10fb60 msgr2=0x7f9a1c06dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:33.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.426+0000 7f9a1b400700 1 --2- 172.21.15.82:0/3120372696 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a1c10fb60 0x7f9a1c06dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:33.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.426+0000 7f9a1b400700 1 -- 172.21.15.82:0/3120372696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a1c10a490 msgr2=0x7f9a1c075140 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T05:51:33.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.427+0000 7f9a1aa00700 1 --2- 172.21.15.82:0/3120372696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a1c10a490 0x7f9a1c075140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:33.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.427+0000 7f9a1b400700 1 --2- 172.21.15.82:0/3120372696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a1c10a490 0x7f9a1c075140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:33.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.428+0000 7f9a1b400700 1 -- 172.21.15.82:0/3120372696 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a1c06e7e0 con 0x7f9a1c109ad0 2024-05-08T05:51:33.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.428+0000 7f9a1b400700 1 --2- 172.21.15.82:0/3120372696 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a1c109ad0 0x7f9a1c074c00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9a0800e9c0 tx=0x7f9a0800ed80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:51:33.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.428+0000 7f9a13e00700 1 -- 172.21.15.82:0/3120372696 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0800cbd0 con 0x7f9a1c109ad0 2024-05-08T05:51:33.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.428+0000 7f9a13e00700 1 -- 172.21.15.82:0/3120372696 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9a0800cd70 con 0x7f9a1c109ad0 2024-05-08T05:51:33.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.428+0000 7f9a13e00700 1 -- 172.21.15.82:0/3120372696 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a080056a0 con 0x7f9a1c109ad0 2024-05-08T05:51:33.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.429+0000 7f9a22200700 1 -- 172.21.15.82:0/3120372696 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a1c06ead0 con 0x7f9a1c109ad0 2024-05-08T05:51:33.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.430+0000 7f9a22200700 1 -- 172.21.15.82:0/3120372696 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a1c0729c0 con 0x7f9a1c109ad0 2024-05-08T05:51:33.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.439+0000 7f9a13e00700 1 -- 172.21.15.82:0/3120372696 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f9a08004750 con 0x7f9a1c109ad0 2024-05-08T05:51:33.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.441+0000 7f9a2cbc1b80 1 Processor -- start 2024-05-08T05:51:33.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.443+0000 7f9a2cbc1b80 1 -- start start 2024-05-08T05:51:33.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.444+0000 7f9a13e00700 1 --2- 172.21.15.82:0/3120372696 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9a000b29d0 0x7f9a000b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:33.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.444+0000 7f9a2cbc1b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555b7a3f0e0 0x5555b7a3f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:33.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.444+0000 7f9a2cbc1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555b7a3fa00 0x5555b7a43510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:33.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.444+0000 7f9a2cbc1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555b7a43a50 0x5555b7a43eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:33.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.444+0000 7f9a2cbc1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5555b7991aa0 con 0x5555b7a3fa00 2024-05-08T05:51:33.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.444+0000 7f9a2cbc1b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5555b792f7e0 con 0x5555b7a3f0e0 2024-05-08T05:51:33.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.444+0000 7f9a2cbc1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5555b798da60 con 0x5555b7a43a50 2024-05-08T05:51:33.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.444+0000 7f9a1b400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555b7a3f0e0 0x5555b7a3f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:33.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.444+0000 7f9a1b400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555b7a3f0e0 0x5555b7a3f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:54996/0 (socket says 172.21.15.82:54996) 2024-05-08T05:51:33.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.444+0000 7f9a1b400700 1 -- 172.21.15.82:0/1139242542 learned_addr learned my addr 172.21.15.82:0/1139242542 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:51:33.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.445+0000 7f9a1be00700 1 --2- 172.21.15.82:0/1139242542 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555b7a43a50 0x5555b7a43eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:33.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.445+0000 7f9a1b400700 1 -- 172.21.15.82:0/1139242542 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555b7a43a50 msgr2=0x5555b7a43eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:33.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.446+0000 7f9a1be00700 1 --2- 172.21.15.82:0/3120372696 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9a000b29d0 0x7f9a000b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:33.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.446+0000 7f9a13e00700 1 -- 172.21.15.82:0/3120372696 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f9a080e2350 con 0x7f9a1c109ad0 2024-05-08T05:51:33.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.446+0000 7f9a1aa00700 1 --2- 172.21.15.82:0/1139242542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555b7a3fa00 0x5555b7a43510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:33.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.446+0000 7f9a1b400700 1 --2- 172.21.15.82:0/1139242542 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555b7a43a50 0x5555b7a43eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:33.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.446+0000 7f9a1b400700 1 -- 172.21.15.82:0/1139242542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555b7a3fa00 msgr2=0x5555b7a43510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:33.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.446+0000 7f9a1b400700 1 --2- 172.21.15.82:0/1139242542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555b7a3fa00 0x5555b7a43510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:33.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.446+0000 7f9a1b400700 1 -- 172.21.15.82:0/1139242542 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555b78de950 con 0x5555b7a3f0e0 2024-05-08T05:51:33.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.447+0000 7f9a1be00700 1 --2- 172.21.15.82:0/1139242542 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555b7a43a50 0x5555b7a43eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:51:33.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.447+0000 7f9a1b400700 1 --2- 172.21.15.82:0/1139242542 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555b7a3f0e0 0x5555b7a3f4c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9a080a9910 tx=0x7f9a08009740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1fc7e41279b8c24 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:51:33.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.447+0000 7f9a1aa00700 1 --2- 172.21.15.82:0/1139242542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555b7a3fa00 0x5555b7a43510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:51:33.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.447+0000 7f9a1be00700 1 --2- 172.21.15.82:0/3120372696 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9a000b29d0 0x7f9a000b4e90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9a1400b6c0 tx=0x7f9a1400b330 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:51:33.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.447+0000 7f9a10c00700 1 -- 172.21.15.82:0/1139242542 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a080a9490 con 0x5555b7a3f0e0 2024-05-08T05:51:33.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.447+0000 7f9a10c00700 1 -- 172.21.15.82:0/1139242542 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9a080aa080 con 0x5555b7a3f0e0 2024-05-08T05:51:33.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.448+0000 7f9a10c00700 1 -- 172.21.15.82:0/1139242542 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a080a9e40 con 0x5555b7a3f0e0 2024-05-08T05:51:33.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.449+0000 7f9a2cbc1b80 1 -- 172.21.15.82:0/1139242542 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555b7a3f0e0 msgr2=0x5555b7a3f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:33.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.449+0000 7f9a2cbc1b80 1 --2- 172.21.15.82:0/1139242542 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555b7a3f0e0 0x5555b7a3f4c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9a080a9910 tx=0x7f9a08009740 comp rx=0 tx=0).stop 2024-05-08T05:51:33.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.449+0000 7f9a2cbc1b80 1 -- 172.21.15.82:0/1139242542 shutdown_connections 2024-05-08T05:51:33.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.449+0000 7f9a2cbc1b80 1 --2- 172.21.15.82:0/1139242542 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555b7a3f0e0 0x5555b7a3f4c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:33.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.449+0000 7f9a2cbc1b80 1 --2- 172.21.15.82:0/1139242542 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555b7a43a50 0x5555b7a43eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:33.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.449+0000 7f9a2cbc1b80 1 --2- 172.21.15.82:0/1139242542 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555b7a3fa00 0x5555b7a43510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:33.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.449+0000 7f9a2cbc1b80 1 -- 172.21.15.82:0/1139242542 >> 172.21.15.82:0/1139242542 conn(0x5555b796dbe0 msgr2=0x5555b7a39820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:51:33.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.453+0000 7f9a2cbc1b80 1 -- 172.21.15.82:0/1139242542 shutdown_connections 2024-05-08T05:51:33.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.453+0000 7f9a2cbc1b80 1 -- 172.21.15.82:0/1139242542 wait complete. 2024-05-08T05:51:33.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.454+0000 7f9a2cbc1b80 1 -- start start 2024-05-08T05:51:33.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.454+0000 7f9a2cbc1b80 1 Processor -- start 2024-05-08T05:51:33.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.456+0000 7f9a2cbc1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555b7a3f0e0 0x5555b7a4ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:33.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.456+0000 7f9a2cbc1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555b7a3fa00 0x5555b7a48220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:33.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.456+0000 7f9a2cbc1b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555b7a43a50 0x5555b7a48760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:33.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.457+0000 7f9a1b400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555b7a3f0e0 0x5555b7a4ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:33.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.457+0000 7f9a1b400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555b7a3f0e0 0x5555b7a4ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:53468/0 (socket says 172.21.15.82:53468) 2024-05-08T05:51:33.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.458+0000 7f9a1aa00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555b7a3fa00 0x5555b7a48220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:33.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.458+0000 7f9a1aa00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555b7a3fa00 0x5555b7a48220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40636/0 (socket says 172.21.15.82:40636) 2024-05-08T05:51:33.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.458+0000 7f9a1b400700 1 -- 172.21.15.82:0/3114163657 learned_addr learned my addr 172.21.15.82:0/3114163657 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:51:33.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.458+0000 7f9a2cbc1b80 1 -- 172.21.15.82:0/3114163657 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5555b7a4bc60 con 0x5555b7a3fa00 2024-05-08T05:51:33.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.458+0000 7f9a2cbc1b80 1 -- 172.21.15.82:0/3114163657 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5555b78f7ba0 con 0x5555b7a43a50 2024-05-08T05:51:33.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.458+0000 7f9a2cbc1b80 1 -- 172.21.15.82:0/3114163657 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5555b7a4bde0 con 0x5555b7a3f0e0 2024-05-08T05:51:33.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.458+0000 7f9a2cbc1b80 10 client.0 _ll_register_callbacks cb 0x5555b7938cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:51:33.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.458+0000 7f9a1be00700 1 --2- 172.21.15.82:0/3114163657 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555b7a43a50 0x5555b7a48760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:33.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.460+0000 7f9a1b400700 1 -- 172.21.15.82:0/3114163657 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555b7a43a50 msgr2=0x5555b7a48760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:33.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.460+0000 7f9a1b400700 1 --2- 172.21.15.82:0/3114163657 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555b7a43a50 0x5555b7a48760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:33.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.460+0000 7f9a1b400700 1 -- 172.21.15.82:0/3114163657 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555b7a3fa00 msgr2=0x5555b7a48220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:33.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.460+0000 7f9a1b400700 1 --2- 172.21.15.82:0/3114163657 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555b7a3fa00 0x5555b7a48220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:33.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.460+0000 7f9a1b400700 1 -- 172.21.15.82:0/3114163657 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555b79574a0 con 0x5555b7a3f0e0 2024-05-08T05:51:33.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.461+0000 7f9a1b400700 1 --2- 172.21.15.82:0/3114163657 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555b7a3f0e0 0x5555b7a4ae80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9a080a59b0 tx=0x7f9a080a9e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=316de12483f9780d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:51:33.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.461+0000 7f9a05600700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:51:33.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.461+0000 7f9a05600700 1 -- 172.21.15.82:0/3114163657 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a080a9980 con 0x5555b7a3f0e0 2024-05-08T05:51:33.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.461+0000 7f9a05600700 1 -- 172.21.15.82:0/3114163657 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f9a080b2560 con 0x5555b7a3f0e0 2024-05-08T05:51:33.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.462+0000 7f9a2cbc1b80 1 -- 172.21.15.82:0/3114163657 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a080aa080 con 0x5555b7a3f0e0 2024-05-08T05:51:33.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.463+0000 7f9a05600700 1 -- 172.21.15.82:0/3114163657 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9a080add30 con 0x5555b7a3f0e0 2024-05-08T05:51:33.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.463+0000 7f9a2cbc1b80 10 client.25330 fetch_fsmap learned FSMap version 30 2024-05-08T05:51:33.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.463+0000 7f9a2cbc1b80 1 -- 172.21.15.82:0/3114163657 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5555b7a4bc60 con 0x5555b7a3f0e0 2024-05-08T05:51:33.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.463+0000 7f9a05600700 1 -- 172.21.15.82:0/3114163657 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9a080aa080 con 0x5555b7a3f0e0 2024-05-08T05:51:33.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.463+0000 7f9a05600700 1 -- 172.21.15.82:0/3114163657 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f9a080c7020 con 0x5555b7a3f0e0 2024-05-08T05:51:33.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.464+0000 7f9a2cbc1b80 10 client.25330 fetch_fsmap finished waiting for FSMap version 30 2024-05-08T05:51:33.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.464+0000 7f9a2cbc1b80 10 client.25330 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:51:33.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.464+0000 7f9a2cbc1b80 20 client.25330 populate_metadata read hostname 'smithi082' 2024-05-08T05:51:33.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.464+0000 7f9a2cbc1b80 1 --2- 172.21.15.82:0/3114163657 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5555b7a586f0 0x5555b7a5aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:33.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.464+0000 7f9a2cbc1b80 4 client.25330 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:51:33.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.464+0000 7f9a2cbc1b80 1 -- 172.21.15.82:0/3114163657 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5555b7a0c120 con 0x5555b7a586f0 2024-05-08T05:51:33.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.465+0000 7f9a1aa00700 1 --2- 172.21.15.82:0/3114163657 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5555b7a586f0 0x5555b7a5aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:33.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.467+0000 7f9a1aa00700 1 --2- 172.21.15.82:0/3114163657 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5555b7a586f0 0x5555b7a5aae0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3f91f2f80fb1807 server_cookie=1f52b2725f388e61 in_seq=0 out_seq=0 2024-05-08T05:51:33.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.467+0000 7f9a05600700 10 client.25330 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:51:33.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.468+0000 7f9a05600700 1 -- 172.21.15.82:0/3114163657 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5555b7a0c120 con 0x5555b7a586f0 2024-05-08T05:51:33.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.468+0000 7f9a05600700 10 client.25330 handle_command_reply: tid=0 2024-05-08T05:51:33.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.468+0000 7f9a2cbc1b80 1 client.25330 shutdown 2024-05-08T05:51:33.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.468+0000 7f9a2cbc1b80 1 -- 172.21.15.82:0/3114163657 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555b7a3f0e0 msgr2=0x5555b7a4ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:33.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.468+0000 7f9a2cbc1b80 1 --2- 172.21.15.82:0/3114163657 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555b7a3f0e0 0x5555b7a4ae80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9a080a59b0 tx=0x7f9a080a9e70 comp rx=0 tx=0).stop 2024-05-08T05:51:33.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.469+0000 7f9a2cbc1b80 1 -- 172.21.15.82:0/3114163657 shutdown_connections 2024-05-08T05:51:33.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.469+0000 7f9a2cbc1b80 1 --2- 172.21.15.82:0/3114163657 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5555b7a586f0 0x5555b7a5aae0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:33.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.469+0000 7f9a2cbc1b80 1 --2- 172.21.15.82:0/3114163657 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555b7a43a50 0x5555b7a48760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:33.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.469+0000 7f9a2cbc1b80 1 --2- 172.21.15.82:0/3114163657 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555b7a3f0e0 0x5555b7a4ae80 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:33.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.469+0000 7f9a2cbc1b80 1 --2- 172.21.15.82:0/3114163657 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555b7a3fa00 0x5555b7a48220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:33.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.469+0000 7f9a2cbc1b80 1 -- 172.21.15.82:0/3114163657 >> 172.21.15.82:0/3114163657 conn(0x5555b796dbe0 msgr2=0x5555b7a397e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:51:33.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.469+0000 7f9a05600700 0 client.25330 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:51:33.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.469+0000 7f9a2cbc1b80 1 -- 172.21.15.82:0/3114163657 shutdown_connections 2024-05-08T05:51:33.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.469+0000 7f9a2cbc1b80 1 -- 172.21.15.82:0/3114163657 wait complete. 2024-05-08T05:51:33.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.469+0000 7f9a2cbc1b80 20 client.25330 trim_cache size 0 max 16384 2024-05-08T05:51:33.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.517+0000 7f9a2cbc1b80 1 Processor -- start 2024-05-08T05:51:33.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.517+0000 7f9a2cbc1b80 1 -- start start 2024-05-08T05:51:33.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.518+0000 7f9a2cbc1b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555b796dbe0 0x5555b7a45ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:33.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.518+0000 7f9a2cbc1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555b7a3fa00 0x5555b7a54cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:33.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.518+0000 7f9a2cbc1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555b7a43a50 0x5555b7a498d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:33.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.518+0000 7f9a2cbc1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9a1c1bca60 con 0x5555b7a43a50 2024-05-08T05:51:33.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.518+0000 7f9a2cbc1b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9a1c1be5d0 con 0x5555b796dbe0 2024-05-08T05:51:33.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.518+0000 7f9a2cbc1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9a1c1bd130 con 0x5555b7a3fa00 2024-05-08T05:51:33.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.518+0000 7f9a1aa00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555b7a3fa00 0x5555b7a54cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:33.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.518+0000 7f9a1aa00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555b7a3fa00 0x5555b7a54cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:53474/0 (socket says 172.21.15.82:53474) 2024-05-08T05:51:33.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.518+0000 7f9a1aa00700 1 -- 172.21.15.82:0/3036629904 learned_addr learned my addr 172.21.15.82:0/3036629904 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:51:33.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.519+0000 7f9a1aa00700 1 -- 172.21.15.82:0/3036629904 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555b796dbe0 msgr2=0x5555b7a45ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:33.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.519+0000 7f9a1b400700 1 --2- 172.21.15.82:0/3036629904 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555b796dbe0 0x5555b7a45ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:33.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.519+0000 7f9a1aa00700 1 --2- 172.21.15.82:0/3036629904 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555b796dbe0 0x5555b7a45ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:33.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.519+0000 7f9a1be00700 1 --2- 172.21.15.82:0/3036629904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555b7a43a50 0x5555b7a498d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:33.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.519+0000 7f9a1aa00700 1 -- 172.21.15.82:0/3036629904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555b7a43a50 msgr2=0x5555b7a498d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:33.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.519+0000 7f9a1aa00700 1 --2- 172.21.15.82:0/3036629904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555b7a43a50 0x5555b7a498d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:33.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.519+0000 7f9a1aa00700 1 -- 172.21.15.82:0/3036629904 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555b7a43850 con 0x5555b7a3fa00 2024-05-08T05:51:33.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.519+0000 7f9a1aa00700 1 --2- 172.21.15.82:0/3036629904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555b7a3fa00 0x5555b7a54cf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c06f4e0 tx=0x7f9a0c00df90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3cf5d5a36b64f93 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:51:33.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.519+0000 7f9a07e00700 1 -- 172.21.15.82:0/3036629904 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c013a10 con 0x5555b7a3fa00 2024-05-08T05:51:33.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.520+0000 7f9a07e00700 1 -- 172.21.15.82:0/3036629904 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9a0c01b850 con 0x5555b7a3fa00 2024-05-08T05:51:33.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.520+0000 7f9a2cbc1b80 1 -- 172.21.15.82:0/3036629904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555b7a3fa00 msgr2=0x5555b7a54cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:33.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.520+0000 7f9a2cbc1b80 1 --2- 172.21.15.82:0/3036629904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555b7a3fa00 0x5555b7a54cf0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f9a1c06f4e0 tx=0x7f9a0c00df90 comp rx=0 tx=0).stop 2024-05-08T05:51:33.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.520+0000 7f9a2cbc1b80 1 -- 172.21.15.82:0/3036629904 shutdown_connections 2024-05-08T05:51:33.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.520+0000 7f9a2cbc1b80 1 --2- 172.21.15.82:0/3036629904 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555b796dbe0 0x5555b7a45ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:33.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.520+0000 7f9a2cbc1b80 1 --2- 172.21.15.82:0/3036629904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555b7a43a50 0x5555b7a498d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:33.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.521+0000 7f9a2cbc1b80 1 --2- 172.21.15.82:0/3036629904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555b7a3fa00 0x5555b7a54cf0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:33.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.521+0000 7f9a2cbc1b80 1 -- 172.21.15.82:0/3036629904 >> 172.21.15.82:0/3036629904 conn(0x5555b7a44a50 msgr2=0x5555b7a34330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:51:33.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.521+0000 7f9a2cbc1b80 1 -- 172.21.15.82:0/3036629904 shutdown_connections 2024-05-08T05:51:33.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.521+0000 7f9a2cbc1b80 1 -- 172.21.15.82:0/3036629904 wait complete. 2024-05-08T05:51:33.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.521+0000 7f9a2cbc1b80 1 -- start start 2024-05-08T05:51:33.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.521+0000 7f9a2cbc1b80 1 Processor -- start 2024-05-08T05:51:33.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.522+0000 7f9a2cbc1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555b796dbe0 0x5555b7a4c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:33.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.522+0000 7f9a2cbc1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555b7a3fa00 0x5555b7a4c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:33.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.522+0000 7f9a2cbc1b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555b7a43a50 0x5555b7a4cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:33.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.522+0000 7f9a2cbc1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9a1c1bded0 con 0x5555b796dbe0 2024-05-08T05:51:33.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.522+0000 7f9a2cbc1b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9a1c1bd800 con 0x5555b7a43a50 2024-05-08T05:51:33.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.522+0000 7f9a2cbc1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9a1c1baa20 con 0x5555b7a3fa00 2024-05-08T05:51:33.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.522+0000 7f9a2cbc1b80 10 client.0 _ll_register_callbacks cb 0x5555b7938cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:51:33.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.523+0000 7f9a1aa00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555b7a3fa00 0x5555b7a4c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:33.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.523+0000 7f9a1aa00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555b7a3fa00 0x5555b7a4c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:53490/0 (socket says 172.21.15.82:53490) 2024-05-08T05:51:33.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.523+0000 7f9a1aa00700 1 -- 172.21.15.82:0/4100206986 learned_addr learned my addr 172.21.15.82:0/4100206986 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:51:33.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.523+0000 7f9a1b400700 1 --2- 172.21.15.82:0/4100206986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555b796dbe0 0x5555b7a4c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:33.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.523+0000 7f9a1be00700 1 --2- 172.21.15.82:0/4100206986 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555b7a43a50 0x5555b7a4cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:33.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.523+0000 7f9a1aa00700 1 -- 172.21.15.82:0/4100206986 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555b7a43a50 msgr2=0x5555b7a4cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:33.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.524+0000 7f9a1aa00700 1 --2- 172.21.15.82:0/4100206986 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555b7a43a50 0x5555b7a4cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:33.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.524+0000 7f9a1aa00700 1 -- 172.21.15.82:0/4100206986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555b796dbe0 msgr2=0x5555b7a4c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:33.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.524+0000 7f9a1aa00700 1 --2- 172.21.15.82:0/4100206986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555b796dbe0 0x5555b7a4c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:33.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.524+0000 7f9a1aa00700 1 -- 172.21.15.82:0/4100206986 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555b7ac2d80 con 0x5555b7a3fa00 2024-05-08T05:51:33.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.524+0000 7f9a1b400700 1 --2- 172.21.15.82:0/4100206986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555b796dbe0 0x5555b7a4c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:51:33.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.524+0000 7f9a1be00700 1 --2- 172.21.15.82:0/4100206986 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555b7a43a50 0x5555b7a4cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:51:33.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.525+0000 7f9a1aa00700 1 --2- 172.21.15.82:0/4100206986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555b7a3fa00 0x5555b7a4c570 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c0114a0 tx=0x7f9a0c00d910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66749058439072c6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:51:33.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.525+0000 7f9a05600700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:51:33.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.526+0000 7f9a05600700 1 -- 172.21.15.82:0/4100206986 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c0130d0 con 0x5555b7a3fa00 2024-05-08T05:51:33.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.526+0000 7f9a05600700 1 -- 172.21.15.82:0/4100206986 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f9a0c01b3a0 con 0x5555b7a3fa00 2024-05-08T05:51:33.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.526+0000 7f9a2cbc1b80 1 -- 172.21.15.82:0/4100206986 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a0c01b850 con 0x5555b7a3fa00 2024-05-08T05:51:33.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.527+0000 7f9a05600700 1 -- 172.21.15.82:0/4100206986 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f9a0c013270 con 0x5555b7a3fa00 2024-05-08T05:51:33.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.527+0000 7f9a2cbc1b80 10 client.25336 fetch_fsmap learned FSMap version 30 2024-05-08T05:51:33.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.527+0000 7f9a2cbc1b80 1 -- 172.21.15.82:0/4100206986 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5555b7ac4040 con 0x5555b7a3fa00 2024-05-08T05:51:33.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.527+0000 7f9a05600700 1 -- 172.21.15.82:0/4100206986 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9a0c01b850 con 0x5555b7a3fa00 2024-05-08T05:51:33.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.530+0000 7f9a05600700 1 -- 172.21.15.82:0/4100206986 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f9a0c011950 con 0x5555b7a3fa00 2024-05-08T05:51:33.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.530+0000 7f9a2cbc1b80 10 client.25336 fetch_fsmap finished waiting for FSMap version 30 2024-05-08T05:51:33.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.530+0000 7f9a2cbc1b80 10 client.25336 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:51:33.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.530+0000 7f9a2cbc1b80 20 client.25336 populate_metadata read hostname 'smithi082' 2024-05-08T05:51:33.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.530+0000 7f9a2cbc1b80 1 --2- 172.21.15.82:0/4100206986 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5555b7ac46f0 0x5555b7ac6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:33.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.530+0000 7f9a2cbc1b80 4 client.25336 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-08T05:51:33.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.530+0000 7f9a2cbc1b80 1 -- 172.21.15.82:0/4100206986 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5555b799f480 con 0x5555b7ac46f0 2024-05-08T05:51:33.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.530+0000 7f9a1b400700 1 --2- 172.21.15.82:0/4100206986 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5555b7ac46f0 0x5555b7ac6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:33.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.532+0000 7f9a05600700 10 client.25336 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:51:33.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.532+0000 7f9a1b400700 1 --2- 172.21.15.82:0/4100206986 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5555b7ac46f0 0x5555b7ac6b10 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2090e17c0d44468c server_cookie=64de7fd583bce3ed in_seq=0 out_seq=0 2024-05-08T05:51:33.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.533+0000 7f9a05600700 1 -- 172.21.15.82:0/4100206986 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5555b799f480 con 0x5555b7ac46f0 2024-05-08T05:51:33.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.533+0000 7f9a05600700 10 client.25336 handle_command_reply: tid=0 2024-05-08T05:51:33.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.533+0000 7f9a2cbc1b80 1 client.25336 shutdown 2024-05-08T05:51:33.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.534+0000 7f9a2cbc1b80 1 -- 172.21.15.82:0/4100206986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555b7a3fa00 msgr2=0x5555b7a4c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:33.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.534+0000 7f9a2cbc1b80 1 --2- 172.21.15.82:0/4100206986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555b7a3fa00 0x5555b7a4c570 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c0114a0 tx=0x7f9a0c00d910 comp rx=0 tx=0).stop 2024-05-08T05:51:33.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.534+0000 7f9a2cbc1b80 1 -- 172.21.15.82:0/4100206986 shutdown_connections 2024-05-08T05:51:33.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.534+0000 7f9a2cbc1b80 1 --2- 172.21.15.82:0/4100206986 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5555b7ac46f0 0x5555b7ac6b10 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:33.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.534+0000 7f9a2cbc1b80 1 --2- 172.21.15.82:0/4100206986 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5555b7a43a50 0x5555b7a4cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:33.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.534+0000 7f9a2cbc1b80 1 --2- 172.21.15.82:0/4100206986 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5555b796dbe0 0x5555b7a4c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:33.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.534+0000 7f9a05600700 0 client.25336 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:51:33.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.534+0000 7f9a2cbc1b80 1 --2- 172.21.15.82:0/4100206986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555b7a3fa00 0x5555b7a4c570 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:33.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.534+0000 7f9a2cbc1b80 1 -- 172.21.15.82:0/4100206986 >> 172.21.15.82:0/4100206986 conn(0x5555b7a44a50 msgr2=0x5555b7a3def0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:51:33.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.535+0000 7f9a2cbc1b80 1 -- 172.21.15.82:0/4100206986 shutdown_connections 2024-05-08T05:51:33.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.535+0000 7f9a2cbc1b80 1 -- 172.21.15.82:0/4100206986 wait complete. 2024-05-08T05:51:33.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.535+0000 7f9a2cbc1b80 20 client.25336 trim_cache size 0 max 16384 2024-05-08T05:51:33.536 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T05:51:33.536 INFO:teuthology.orchestra.run.smithi082.stdout: "return_code": 0, 2024-05-08T05:51:33.536 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_tag": "819d0fd2-8ea3-49c0-b9ab-4a44a223adb0", 2024-05-08T05:51:33.536 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": "asynchronous" 2024-05-08T05:51:33.536 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T05:51:33.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.536+0000 7f9a22200700 1 -- 172.21.15.82:0/3120372696 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9a000b29d0 msgr2=0x7f9a000b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:33.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.536+0000 7f9a22200700 1 --2- 172.21.15.82:0/3120372696 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9a000b29d0 0x7f9a000b4e90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9a1400b6c0 tx=0x7f9a1400b330 comp rx=0 tx=0).stop 2024-05-08T05:51:33.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.536+0000 7f9a22200700 1 -- 172.21.15.82:0/3120372696 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a1c109ad0 msgr2=0x7f9a1c074c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:33.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.536+0000 7f9a22200700 1 --2- 172.21.15.82:0/3120372696 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a1c109ad0 0x7f9a1c074c00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9a0800e9c0 tx=0x7f9a0800ed80 comp rx=0 tx=0).stop 2024-05-08T05:51:33.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.536+0000 7f9a22200700 1 -- 172.21.15.82:0/3120372696 shutdown_connections 2024-05-08T05:51:33.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.536+0000 7f9a22200700 1 --2- 172.21.15.82:0/3120372696 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a1c109ad0 0x7f9a1c074c00 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:33.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.536+0000 7f9a22200700 1 --2- 172.21.15.82:0/3120372696 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9a000b29d0 0x7f9a000b4e90 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:33.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.536+0000 7f9a22200700 1 --2- 172.21.15.82:0/3120372696 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a1c10fb60 0x7f9a1c06dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:33.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.536+0000 7f9a22200700 1 --2- 172.21.15.82:0/3120372696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a1c10a490 0x7f9a1c075140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:33.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.536+0000 7f9a22200700 1 -- 172.21.15.82:0/3120372696 >> 172.21.15.82:0/3120372696 conn(0x7f9a1c076c70 msgr2=0x7f9a1c077230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:51:33.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.536+0000 7f9a22200700 1 -- 172.21.15.82:0/3120372696 shutdown_connections 2024-05-08T05:51:33.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:33.536+0000 7f9a22200700 1 -- 172.21.15.82:0/3120372696 wait complete. 2024-05-08T05:51:33.880 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:51:33 smithi082 ceph-mon[30098]: pgmap v486: 97 pgs: 97 active+clean; 980 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 679 op/s 2024-05-08T05:51:33.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:51:33 smithi134 ceph-mon[34132]: pgmap v486: 97 pgs: 97 active+clean; 980 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 679 op/s 2024-05-08T05:51:34.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:51:33 smithi151 ceph-mon[34815]: pgmap v486: 97 pgs: 97 active+clean; 980 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 679 op/s 2024-05-08T05:51:34.810 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-08T05:51:34.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:51:34 smithi082 ceph-mon[30098]: scrub queued for path: / 2024-05-08T05:51:34.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:51:34 smithi082 ceph-mon[30098]: scrub summary: idle+waiting paths [/] 2024-05-08T05:51:34.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:51:34 smithi082 ceph-mon[30098]: scrub summary: active paths [/] 2024-05-08T05:51:34.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:51:34 smithi082 ceph-mon[30098]: scrub summary: active paths [/] 2024-05-08T05:51:34.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:51:34 smithi082 ceph-mon[30098]: scrub summary: idle+waiting paths [/] 2024-05-08T05:51:34.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:51:34 smithi082 ceph-mon[30098]: scrub summary: idle+waiting paths [/] 2024-05-08T05:51:34.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:51:34 smithi134 ceph-mon[34132]: scrub queued for path: / 2024-05-08T05:51:35.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:51:34 smithi134 ceph-mon[34132]: scrub summary: idle+waiting paths [/] 2024-05-08T05:51:35.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:51:34 smithi134 ceph-mon[34132]: scrub summary: active paths [/] 2024-05-08T05:51:35.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:51:34 smithi134 ceph-mon[34132]: scrub summary: active paths [/] 2024-05-08T05:51:35.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:51:34 smithi134 ceph-mon[34132]: scrub summary: idle+waiting paths [/] 2024-05-08T05:51:35.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:51:34 smithi134 ceph-mon[34132]: scrub summary: idle+waiting paths [/] 2024-05-08T05:51:35.131 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:51:34 smithi151 ceph-mon[34815]: scrub queued for path: / 2024-05-08T05:51:35.131 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:51:34 smithi151 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-05-08T05:51:35.131 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:51:34 smithi151 ceph-mon[34815]: scrub summary: active paths [/] 2024-05-08T05:51:35.131 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:51:34 smithi151 ceph-mon[34815]: scrub summary: active paths [/] 2024-05-08T05:51:35.131 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:51:34 smithi151 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-05-08T05:51:35.131 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:51:34 smithi151 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-05-08T05:51:35.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 45.0 s, 2636.8 tps, lat 37.930 ms stddev 44.833 2024-05-08T05:51:35.418 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:51:35.874 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:51:35 smithi082 ceph-mon[30098]: pgmap v487: 97 pgs: 97 active+clean; 981 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 769 op/s 2024-05-08T05:51:35.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:51:35 smithi134 ceph-mon[34132]: pgmap v487: 97 pgs: 97 active+clean; 981 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 769 op/s 2024-05-08T05:51:36.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:51:35 smithi151 ceph-mon[34815]: pgmap v487: 97 pgs: 97 active+clean; 981 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 769 op/s 2024-05-08T05:51:37.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.801+0000 7fd8b7400700 1 -- 172.21.15.82:0/297658310 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8b0075ff0 msgr2=0x7fd8b010f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:37.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.801+0000 7fd8b7400700 1 --2- 172.21.15.82:0/297658310 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8b0075ff0 0x7fd8b010f960 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd89c009990 tx=0x7fd89c009ca0 comp rx=0 tx=0).stop 2024-05-08T05:51:37.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.802+0000 7fd8b7400700 1 -- 172.21.15.82:0/297658310 shutdown_connections 2024-05-08T05:51:37.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.802+0000 7fd8b7400700 1 --2- 172.21.15.82:0/297658310 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8b00756d0 0x7fd8b0075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:37.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.802+0000 7fd8b7400700 1 --2- 172.21.15.82:0/297658310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8b010fea0 0x7fd8b0112290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:37.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.802+0000 7fd8b7400700 1 --2- 172.21.15.82:0/297658310 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8b0075ff0 0x7fd8b010f960 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:37.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.802+0000 7fd8b7400700 1 -- 172.21.15.82:0/297658310 >> 172.21.15.82:0/297658310 conn(0x7fd8b007a600 msgr2=0x7fd8b007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:51:37.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.802+0000 7fd8b7400700 1 -- 172.21.15.82:0/297658310 shutdown_connections 2024-05-08T05:51:37.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.802+0000 7fd8b7400700 1 -- 172.21.15.82:0/297658310 wait complete. 2024-05-08T05:51:37.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.803+0000 7fd8b7400700 1 Processor -- start 2024-05-08T05:51:37.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.804+0000 7fd8b7400700 1 -- start start 2024-05-08T05:51:37.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.804+0000 7fd8b7400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8b00756d0 0x7fd8b01a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:37.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.804+0000 7fd8b7400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8b0075ff0 0x7fd8b01a1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:37.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.804+0000 7fd8b7400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8b010fea0 0x7fd8b010e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:37.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.805+0000 7fd8b7400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd8b0115860 con 0x7fd8b00756d0 2024-05-08T05:51:37.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.805+0000 7fd8b7400700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd8b01156e0 con 0x7fd8b010fea0 2024-05-08T05:51:37.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.805+0000 7fd8b7400700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd8b01159e0 con 0x7fd8b0075ff0 2024-05-08T05:51:37.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.805+0000 7fd8b5400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8b010fea0 0x7fd8b010e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:37.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.805+0000 7fd8b5400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8b010fea0 0x7fd8b010e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:55056/0 (socket says 172.21.15.82:55056) 2024-05-08T05:51:37.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.805+0000 7fd8b5400700 1 -- 172.21.15.82:0/1448982045 learned_addr learned my addr 172.21.15.82:0/1448982045 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:51:37.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.805+0000 7fd8afe00700 1 --2- 172.21.15.82:0/1448982045 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8b0075ff0 0x7fd8b01a1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:37.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.805+0000 7fd8b4a00700 1 --2- 172.21.15.82:0/1448982045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8b00756d0 0x7fd8b01a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:37.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.806+0000 7fd8b5400700 1 -- 172.21.15.82:0/1448982045 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8b0075ff0 msgr2=0x7fd8b01a1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:37.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.806+0000 7fd8b5400700 1 --2- 172.21.15.82:0/1448982045 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8b0075ff0 0x7fd8b01a1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:37.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.806+0000 7fd8b5400700 1 -- 172.21.15.82:0/1448982045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8b00756d0 msgr2=0x7fd8b01a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:37.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.806+0000 7fd8b5400700 1 --2- 172.21.15.82:0/1448982045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8b00756d0 0x7fd8b01a0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:37.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.806+0000 7fd8b5400700 1 -- 172.21.15.82:0/1448982045 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8b010ef00 con 0x7fd8b010fea0 2024-05-08T05:51:37.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.806+0000 7fd8afe00700 1 --2- 172.21.15.82:0/1448982045 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8b0075ff0 0x7fd8b01a1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:51:37.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.807+0000 7fd8b5400700 1 --2- 172.21.15.82:0/1448982045 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8b010fea0 0x7fd8b010e940 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd8a8007d40 tx=0x7fd8a800a340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:51:37.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.808+0000 7fd8ad600700 1 -- 172.21.15.82:0/1448982045 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a8016020 con 0x7fd8b010fea0 2024-05-08T05:51:37.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.808+0000 7fd8b7400700 1 -- 172.21.15.82:0/1448982045 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8b010f1f0 con 0x7fd8b010fea0 2024-05-08T05:51:37.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.808+0000 7fd8b7400700 1 -- 172.21.15.82:0/1448982045 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8b010f730 con 0x7fd8b010fea0 2024-05-08T05:51:37.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.808+0000 7fd8ad600700 1 -- 172.21.15.82:0/1448982045 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8a800ad40 con 0x7fd8b010fea0 2024-05-08T05:51:37.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.808+0000 7fd8ad600700 1 -- 172.21.15.82:0/1448982045 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a801b660 con 0x7fd8b010fea0 2024-05-08T05:51:37.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.814+0000 7fd8ad600700 1 -- 172.21.15.82:0/1448982045 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fd8a8019020 con 0x7fd8b010fea0 2024-05-08T05:51:37.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.817+0000 7fd8ad600700 1 --2- 172.21.15.82:0/1448982045 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd8980b2900 0x7fd8980b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:37.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.817+0000 7fd8c1df1b80 1 Processor -- start 2024-05-08T05:51:37.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.817+0000 7fd8ad600700 1 -- 172.21.15.82:0/1448982045 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd8a80e1cb0 con 0x7fd8b010fea0 2024-05-08T05:51:37.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.818+0000 7fd8c1df1b80 1 -- start start 2024-05-08T05:51:37.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.818+0000 7fd8c1df1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616a8b1c060 0x5616a8b1c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:37.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.818+0000 7fd8c1df1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616a8b1c980 0x5616a8b20490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:37.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.818+0000 7fd8c1df1b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5616a8b209d0 0x5616a8b20e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:37.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.818+0000 7fd8c1df1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5616a8a6ea20 con 0x5616a8b1c980 2024-05-08T05:51:37.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.818+0000 7fd8c1df1b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5616a8a0c760 con 0x5616a8b209d0 2024-05-08T05:51:37.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.818+0000 7fd8c1df1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5616a8a6a9e0 con 0x5616a8b1c060 2024-05-08T05:51:37.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.819+0000 7fd8b4a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616a8b1c060 0x5616a8b1c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:37.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.819+0000 7fd8b4a00700 1 --2- 172.21.15.82:0/1448982045 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd8980b2900 0x7fd8980b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:37.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.819+0000 7fd8afe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616a8b1c980 0x5616a8b20490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:37.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.819+0000 7fd8afe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616a8b1c980 0x5616a8b20490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40674/0 (socket says 172.21.15.82:40674) 2024-05-08T05:51:37.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.819+0000 7fd8afe00700 1 -- 172.21.15.82:0/2283356002 learned_addr learned my addr 172.21.15.82:0/2283356002 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:51:37.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.819+0000 7fd8b5400700 1 --2- 172.21.15.82:0/2283356002 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5616a8b209d0 0x5616a8b20e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:37.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.819+0000 7fd8b4a00700 1 -- 172.21.15.82:0/2283356002 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5616a8b209d0 msgr2=0x5616a8b20e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:37.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.819+0000 7fd8b4a00700 1 --2- 172.21.15.82:0/2283356002 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5616a8b209d0 0x5616a8b20e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:37.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.819+0000 7fd8b4a00700 1 -- 172.21.15.82:0/2283356002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616a8b1c980 msgr2=0x5616a8b20490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:37.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.819+0000 7fd8b4a00700 1 --2- 172.21.15.82:0/2283356002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616a8b1c980 0x5616a8b20490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:37.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.819+0000 7fd8b4a00700 1 -- 172.21.15.82:0/2283356002 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616a89bb8d0 con 0x5616a8b1c060 2024-05-08T05:51:37.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.820+0000 7fd8afe00700 1 --2- 172.21.15.82:0/2283356002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616a8b1c980 0x5616a8b20490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:51:37.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.820+0000 7fd8b5400700 1 --2- 172.21.15.82:0/2283356002 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5616a8b209d0 0x5616a8b20e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:51:37.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.820+0000 7fd8b4a00700 1 --2- 172.21.15.82:0/2283356002 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616a8b1c060 0x5616a8b1c440 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd8a400a630 tx=0x7fd8a4011d70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=213f6ad79001ce32 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:51:37.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.820+0000 7fd8b4a00700 1 --2- 172.21.15.82:0/1448982045 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd8980b2900 0x7fd8980b4dc0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd8a4005950 tx=0x7fd8a4016000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:51:37.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.820+0000 7fd8a2000700 1 -- 172.21.15.82:0/2283356002 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a4021070 con 0x5616a8b1c060 2024-05-08T05:51:37.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.821+0000 7fd8a2000700 1 -- 172.21.15.82:0/2283356002 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8a4011050 con 0x5616a8b1c060 2024-05-08T05:51:37.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.821+0000 7fd8a2000700 1 -- 172.21.15.82:0/2283356002 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a401d420 con 0x5616a8b1c060 2024-05-08T05:51:37.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.822+0000 7fd8c1df1b80 1 -- 172.21.15.82:0/2283356002 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616a8b1c060 msgr2=0x5616a8b1c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:37.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.822+0000 7fd8c1df1b80 1 --2- 172.21.15.82:0/2283356002 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616a8b1c060 0x5616a8b1c440 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd8a400a630 tx=0x7fd8a4011d70 comp rx=0 tx=0).stop 2024-05-08T05:51:37.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.822+0000 7fd8c1df1b80 1 -- 172.21.15.82:0/2283356002 shutdown_connections 2024-05-08T05:51:37.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.822+0000 7fd8c1df1b80 1 --2- 172.21.15.82:0/2283356002 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5616a8b209d0 0x5616a8b20e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:37.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.822+0000 7fd8c1df1b80 1 --2- 172.21.15.82:0/2283356002 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616a8b1c060 0x5616a8b1c440 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:37.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.822+0000 7fd8c1df1b80 1 --2- 172.21.15.82:0/2283356002 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616a8b1c980 0x5616a8b20490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:37.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.822+0000 7fd8c1df1b80 1 -- 172.21.15.82:0/2283356002 >> 172.21.15.82:0/2283356002 conn(0x5616a8a4ab60 msgr2=0x5616a8b167a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:51:37.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.822+0000 7fd8c1df1b80 1 -- 172.21.15.82:0/2283356002 shutdown_connections 2024-05-08T05:51:37.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.822+0000 7fd8c1df1b80 1 -- 172.21.15.82:0/2283356002 wait complete. 2024-05-08T05:51:37.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.823+0000 7fd8c1df1b80 1 -- start start 2024-05-08T05:51:37.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.823+0000 7fd8c1df1b80 1 Processor -- start 2024-05-08T05:51:37.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.824+0000 7fd8c1df1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616a8b1c060 0x5616a8b27e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:37.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.824+0000 7fd8c1df1b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5616a8b1c980 0x5616a8b251f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:37.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.824+0000 7fd8c1df1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616a8b209d0 0x5616a8b25730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:37.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.824+0000 7fd8c1df1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5616a8b28b80 con 0x5616a8b209d0 2024-05-08T05:51:37.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.824+0000 7fd8b4a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616a8b1c060 0x5616a8b27e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:37.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.824+0000 7fd8b4a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616a8b1c060 0x5616a8b27e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:53518/0 (socket says 172.21.15.82:53518) 2024-05-08T05:51:37.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.824+0000 7fd8b4a00700 1 -- 172.21.15.82:0/2240987244 learned_addr learned my addr 172.21.15.82:0/2240987244 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:51:37.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.824+0000 7fd8c1df1b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5616a89d4b20 con 0x5616a8b1c980 2024-05-08T05:51:37.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.824+0000 7fd8c1df1b80 1 -- 172.21.15.82:0/2240987244 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5616a8b28d00 con 0x5616a8b1c060 2024-05-08T05:51:37.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.825+0000 7fd8afe00700 1 --2- 172.21.15.82:0/2240987244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5616a8b1c980 0x5616a8b251f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:37.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.825+0000 7fd8c1df1b80 10 client.0 _ll_register_callbacks cb 0x5616a8a15c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:51:37.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.825+0000 7fd8b5400700 1 --2- 172.21.15.82:0/2240987244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616a8b209d0 0x5616a8b25730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:37.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.825+0000 7fd8b4a00700 1 -- 172.21.15.82:0/2240987244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5616a8b1c980 msgr2=0x5616a8b251f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:37.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.825+0000 7fd8b4a00700 1 --2- 172.21.15.82:0/2240987244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5616a8b1c980 0x5616a8b251f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:37.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.825+0000 7fd8b4a00700 1 -- 172.21.15.82:0/2240987244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616a8b209d0 msgr2=0x5616a8b25730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:37.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.825+0000 7fd8b4a00700 1 --2- 172.21.15.82:0/2240987244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616a8b209d0 0x5616a8b25730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:37.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.825+0000 7fd8b4a00700 1 -- 172.21.15.82:0/2240987244 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616a8a34420 con 0x5616a8b1c060 2024-05-08T05:51:37.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.826+0000 7fd8b4a00700 1 --2- 172.21.15.82:0/2240987244 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616a8b1c060 0x5616a8b27e50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd8a4014040 tx=0x7fd8a4010d80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9cea392136f314af server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:51:37.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.826+0000 7fd896a00700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:51:37.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.826+0000 7fd896a00700 1 -- 172.21.15.82:0/2240987244 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a4021050 con 0x5616a8b1c060 2024-05-08T05:51:37.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.826+0000 7fd896a00700 1 -- 172.21.15.82:0/2240987244 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd8a4010640 con 0x5616a8b1c060 2024-05-08T05:51:37.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.826+0000 7fd8c1df1b80 1 -- 172.21.15.82:0/2240987244 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8a4011050 con 0x5616a8b1c060 2024-05-08T05:51:37.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.826+0000 7fd896a00700 1 -- 172.21.15.82:0/2240987244 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd8a4010840 con 0x5616a8b1c060 2024-05-08T05:51:37.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.827+0000 7fd8c1df1b80 10 client.25345 fetch_fsmap learned FSMap version 30 2024-05-08T05:51:37.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.827+0000 7fd8c1df1b80 1 -- 172.21.15.82:0/2240987244 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5616a8b33400 con 0x5616a8b1c060 2024-05-08T05:51:37.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.827+0000 7fd896a00700 1 -- 172.21.15.82:0/2240987244 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8a4011050 con 0x5616a8b1c060 2024-05-08T05:51:37.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.827+0000 7fd896a00700 1 -- 172.21.15.82:0/2240987244 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7fd8a40265f0 con 0x5616a8b1c060 2024-05-08T05:51:37.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.827+0000 7fd8c1df1b80 10 client.25345 fetch_fsmap finished waiting for FSMap version 30 2024-05-08T05:51:37.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.827+0000 7fd8c1df1b80 10 client.25345 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:51:37.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.827+0000 7fd8c1df1b80 20 client.25345 populate_metadata read hostname 'smithi082' 2024-05-08T05:51:37.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.827+0000 7fd8c1df1b80 1 --2- 172.21.15.82:0/2240987244 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5616a8b35a40 0x5616a8b37e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:37.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.827+0000 7fd8c1df1b80 4 client.25345 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:51:37.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.827+0000 7fd8c1df1b80 1 -- 172.21.15.82:0/2240987244 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5616a8ae90a0 con 0x5616a8b35a40 2024-05-08T05:51:37.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.828+0000 7fd8afe00700 1 --2- 172.21.15.82:0/2240987244 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5616a8b35a40 0x5616a8b37e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:37.829 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:51:37 smithi082 ceph-mon[30098]: pgmap v488: 97 pgs: 97 active+clean; 986 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 791 op/s 2024-05-08T05:51:37.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.828+0000 7fd8afe00700 1 --2- 172.21.15.82:0/2240987244 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5616a8b35a40 0x5616a8b37e30 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=289162bf9f8f36c4 server_cookie=2e1f1c4a4078bdff in_seq=0 out_seq=0 2024-05-08T05:51:37.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.828+0000 7fd896a00700 10 client.25345 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:51:37.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.829+0000 7fd896a00700 1 -- 172.21.15.82:0/2240987244 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5616a8ae90a0 con 0x5616a8b35a40 2024-05-08T05:51:37.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.829+0000 7fd896a00700 10 client.25345 handle_command_reply: tid=0 2024-05-08T05:51:37.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.829+0000 7fd8c1df1b80 1 client.25345 shutdown 2024-05-08T05:51:37.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.830+0000 7fd8c1df1b80 1 -- 172.21.15.82:0/2240987244 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616a8b1c060 msgr2=0x5616a8b27e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:37.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.830+0000 7fd8c1df1b80 1 --2- 172.21.15.82:0/2240987244 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616a8b1c060 0x5616a8b27e50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd8a4014040 tx=0x7fd8a4010d80 comp rx=0 tx=0).stop 2024-05-08T05:51:37.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.830+0000 7fd8c1df1b80 1 -- 172.21.15.82:0/2240987244 shutdown_connections 2024-05-08T05:51:37.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.830+0000 7fd8c1df1b80 1 --2- 172.21.15.82:0/2240987244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616a8b209d0 0x5616a8b25730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:37.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.830+0000 7fd8c1df1b80 1 --2- 172.21.15.82:0/2240987244 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616a8b1c060 0x5616a8b27e50 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:37.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.830+0000 7fd8c1df1b80 1 --2- 172.21.15.82:0/2240987244 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5616a8b35a40 0x5616a8b37e30 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:37.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.830+0000 7fd8c1df1b80 1 --2- 172.21.15.82:0/2240987244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5616a8b1c980 0x5616a8b251f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:37.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.830+0000 7fd8c1df1b80 1 -- 172.21.15.82:0/2240987244 >> 172.21.15.82:0/2240987244 conn(0x5616a8a4ab60 msgr2=0x5616a8b112b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:51:37.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.830+0000 7fd896a00700 0 client.25345 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:51:37.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.830+0000 7fd8c1df1b80 1 -- 172.21.15.82:0/2240987244 shutdown_connections 2024-05-08T05:51:37.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.830+0000 7fd8c1df1b80 1 -- 172.21.15.82:0/2240987244 wait complete. 2024-05-08T05:51:37.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.831+0000 7fd8c1df1b80 20 client.25345 trim_cache size 0 max 16384 2024-05-08T05:51:37.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.868+0000 7fd8c1df1b80 1 Processor -- start 2024-05-08T05:51:37.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.868+0000 7fd8c1df1b80 1 -- start start 2024-05-08T05:51:37.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.869+0000 7fd8c1df1b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5616a8b1c060 0x5616a8b23e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:37.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.869+0000 7fd8c1df1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616a8b1c980 0x5616a8b31cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:37.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.869+0000 7fd8c1df1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616a8b209d0 0x5616a8b21df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:37.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.869+0000 7fd8c1df1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd89000d340 con 0x5616a8b1c980 2024-05-08T05:51:37.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.869+0000 7fd8c1df1b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd89000eeb0 con 0x5616a8b1c060 2024-05-08T05:51:37.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.869+0000 7fd8c1df1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd89000da10 con 0x5616a8b209d0 2024-05-08T05:51:37.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.871+0000 7fd8b4a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5616a8b1c060 0x5616a8b23e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:37.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.871+0000 7fd8b5400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616a8b209d0 0x5616a8b21df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:37.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.871+0000 7fd8b4a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5616a8b1c060 0x5616a8b23e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:55098/0 (socket says 172.21.15.82:55098) 2024-05-08T05:51:37.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.871+0000 7fd8b4a00700 1 -- 172.21.15.82:0/2107811724 learned_addr learned my addr 172.21.15.82:0/2107811724 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:51:37.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.871+0000 7fd8afe00700 1 --2- 172.21.15.82:0/2107811724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616a8b1c980 0x5616a8b31cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:37.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.873+0000 7fd8b4a00700 1 -- 172.21.15.82:0/2107811724 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616a8b209d0 msgr2=0x5616a8b21df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:37.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.873+0000 7fd8b4a00700 1 --2- 172.21.15.82:0/2107811724 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616a8b209d0 0x5616a8b21df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:37.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.873+0000 7fd8b4a00700 1 -- 172.21.15.82:0/2107811724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616a8b1c980 msgr2=0x5616a8b31cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:37.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.873+0000 7fd8b4a00700 1 --2- 172.21.15.82:0/2107811724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616a8b1c980 0x5616a8b31cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:37.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.873+0000 7fd8b4a00700 1 -- 172.21.15.82:0/2107811724 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616a8b17610 con 0x5616a8b1c060 2024-05-08T05:51:37.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.874+0000 7fd8b4a00700 1 --2- 172.21.15.82:0/2107811724 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5616a8b1c060 0x5616a8b23e70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd8a4011490 tx=0x7fd8a4005840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63062562c4e9e3ca server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:51:37.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.875+0000 7fd8a1600700 1 -- 172.21.15.82:0/2107811724 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a4021040 con 0x5616a8b1c060 2024-05-08T05:51:37.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.875+0000 7fd8a1600700 1 -- 172.21.15.82:0/2107811724 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8a402a070 con 0x5616a8b1c060 2024-05-08T05:51:37.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.875+0000 7fd8a1600700 1 -- 172.21.15.82:0/2107811724 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a40050f0 con 0x5616a8b1c060 2024-05-08T05:51:37.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.876+0000 7fd8afe00700 1 --2- 172.21.15.82:0/2107811724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616a8b1c980 0x5616a8b31cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:51:37.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.877+0000 7fd8c1df1b80 1 -- 172.21.15.82:0/2107811724 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5616a8b1c060 msgr2=0x5616a8b23e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:37.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.877+0000 7fd8c1df1b80 1 --2- 172.21.15.82:0/2107811724 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5616a8b1c060 0x5616a8b23e70 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd8a4011490 tx=0x7fd8a4005840 comp rx=0 tx=0).stop 2024-05-08T05:51:37.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.877+0000 7fd8c1df1b80 1 -- 172.21.15.82:0/2107811724 shutdown_connections 2024-05-08T05:51:37.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.877+0000 7fd8c1df1b80 1 --2- 172.21.15.82:0/2107811724 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5616a8b1c060 0x5616a8b23e70 secure :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd8a4011490 tx=0x7fd8a4005840 comp rx=0 tx=0).stop 2024-05-08T05:51:37.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.877+0000 7fd8c1df1b80 1 --2- 172.21.15.82:0/2107811724 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616a8b209d0 0x5616a8b21df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:37.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.877+0000 7fd8c1df1b80 1 --2- 172.21.15.82:0/2107811724 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616a8b1c980 0x5616a8b31cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:37.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.877+0000 7fd8c1df1b80 1 -- 172.21.15.82:0/2107811724 >> 172.21.15.82:0/2107811724 conn(0x5616a8a4ab60 msgr2=0x5616a8b10a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:51:37.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.878+0000 7fd8c1df1b80 1 -- 172.21.15.82:0/2107811724 shutdown_connections 2024-05-08T05:51:37.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.879+0000 7fd8c1df1b80 1 -- 172.21.15.82:0/2107811724 wait complete. 2024-05-08T05:51:37.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.879+0000 7fd8c1df1b80 1 -- start start 2024-05-08T05:51:37.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.879+0000 7fd8c1df1b80 1 Processor -- start 2024-05-08T05:51:37.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.880+0000 7fd8c1df1b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5616a8b1c980 0x5616a8b21ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:37.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.880+0000 7fd8c1df1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616a8b209d0 0x5616a8b22400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:37.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.880+0000 7fd8c1df1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616a8b22940 0x5616a8b9f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:37.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.880+0000 7fd8c1df1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd89000e7b0 con 0x5616a8b22940 2024-05-08T05:51:37.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.880+0000 7fd8c1df1b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd89000e0e0 con 0x5616a8b1c980 2024-05-08T05:51:37.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.880+0000 7fd8c1df1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd89000b2e0 con 0x5616a8b209d0 2024-05-08T05:51:37.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.880+0000 7fd8c1df1b80 10 client.0 _ll_register_callbacks cb 0x5616a8a15c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:51:37.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.882+0000 7fd8b5400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616a8b22940 0x5616a8b9f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:37.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.882+0000 7fd8afe00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616a8b209d0 0x5616a8b22400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:37.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.882+0000 7fd8afe00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616a8b209d0 0x5616a8b22400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:53536/0 (socket says 172.21.15.82:53536) 2024-05-08T05:51:37.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.882+0000 7fd8afe00700 1 -- 172.21.15.82:0/704971234 learned_addr learned my addr 172.21.15.82:0/704971234 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:51:37.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.882+0000 7fd8afe00700 1 -- 172.21.15.82:0/704971234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5616a8b1c980 msgr2=0x5616a8b21ec0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T05:51:37.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.882+0000 7fd8afe00700 1 --2- 172.21.15.82:0/704971234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5616a8b1c980 0x5616a8b21ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:37.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.882+0000 7fd8afe00700 1 -- 172.21.15.82:0/704971234 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616a8b22940 msgr2=0x5616a8b9f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:51:37.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.883+0000 7fd8afe00700 1 --2- 172.21.15.82:0/704971234 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616a8b22940 0x5616a8b9f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:37.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.883+0000 7fd8afe00700 1 -- 172.21.15.82:0/704971234 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616a8b184b0 con 0x5616a8b209d0 2024-05-08T05:51:37.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.885+0000 7fd8afe00700 1 --2- 172.21.15.82:0/704971234 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616a8b209d0 0x5616a8b22400 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd89c000c00 tx=0x7fd89c003730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e02db5623121189 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:51:37.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.885+0000 7fd896a00700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:51:37.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.886+0000 7fd896a00700 1 -- 172.21.15.82:0/704971234 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd89c003ba0 con 0x5616a8b209d0 2024-05-08T05:51:37.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.886+0000 7fd896a00700 1 -- 172.21.15.82:0/704971234 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd89c003d40 con 0x5616a8b209d0 2024-05-08T05:51:37.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.886+0000 7fd8c1df1b80 1 -- 172.21.15.82:0/704971234 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8a402a070 con 0x5616a8b209d0 2024-05-08T05:51:37.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.887+0000 7fd896a00700 1 -- 172.21.15.82:0/704971234 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fd89c0050c0 con 0x5616a8b209d0 2024-05-08T05:51:37.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.887+0000 7fd8c1df1b80 10 client.25351 fetch_fsmap learned FSMap version 30 2024-05-08T05:51:37.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.887+0000 7fd8c1df1b80 1 -- 172.21.15.82:0/704971234 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5616a8ba0550 con 0x5616a8b209d0 2024-05-08T05:51:37.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.888+0000 7fd896a00700 1 -- 172.21.15.82:0/704971234 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8a402a070 con 0x5616a8b209d0 2024-05-08T05:51:37.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.888+0000 7fd896a00700 1 -- 172.21.15.82:0/704971234 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7fd89c00f460 con 0x5616a8b209d0 2024-05-08T05:51:37.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.888+0000 7fd8c1df1b80 10 client.25351 fetch_fsmap finished waiting for FSMap version 30 2024-05-08T05:51:37.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.888+0000 7fd8c1df1b80 10 client.25351 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:51:37.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.888+0000 7fd8c1df1b80 20 client.25351 populate_metadata read hostname 'smithi082' 2024-05-08T05:51:37.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.888+0000 7fd8c1df1b80 1 --2- 172.21.15.82:0/704971234 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5616a8ba0ca0 0x5616a8ba30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:51:37.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.888+0000 7fd8c1df1b80 4 client.25351 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-08T05:51:37.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.888+0000 7fd8c1df1b80 1 -- 172.21.15.82:0/704971234 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5616a8a7c400 con 0x5616a8ba0ca0 2024-05-08T05:51:37.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.888+0000 7fd8b4a00700 1 --2- 172.21.15.82:0/704971234 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5616a8ba0ca0 0x5616a8ba30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:51:37.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.889+0000 7fd896a00700 10 client.25351 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:51:37.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.889+0000 7fd8b4a00700 1 --2- 172.21.15.82:0/704971234 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5616a8ba0ca0 0x5616a8ba30c0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ef0ea78b9a0135e server_cookie=7bd7e38a45d96cd0 in_seq=0 out_seq=0 2024-05-08T05:51:37.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.889+0000 7fd896a00700 1 -- 172.21.15.82:0/704971234 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5616a8a7c400 con 0x5616a8ba0ca0 2024-05-08T05:51:37.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.889+0000 7fd896a00700 10 client.25351 handle_command_reply: tid=0 2024-05-08T05:51:37.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.890+0000 7fd8c1df1b80 1 client.25351 shutdown 2024-05-08T05:51:37.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.893+0000 7fd8c1df1b80 1 -- 172.21.15.82:0/704971234 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616a8b209d0 msgr2=0x5616a8b22400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:37.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.893+0000 7fd8c1df1b80 1 --2- 172.21.15.82:0/704971234 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616a8b209d0 0x5616a8b22400 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd89c000c00 tx=0x7fd89c003730 comp rx=0 tx=0).stop 2024-05-08T05:51:37.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.893+0000 7fd8c1df1b80 1 -- 172.21.15.82:0/704971234 shutdown_connections 2024-05-08T05:51:37.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.893+0000 7fd8c1df1b80 1 --2- 172.21.15.82:0/704971234 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5616a8ba0ca0 0x5616a8ba30c0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:37.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.893+0000 7fd8c1df1b80 1 --2- 172.21.15.82:0/704971234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5616a8b1c980 0x5616a8b21ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:37.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.893+0000 7fd8c1df1b80 1 --2- 172.21.15.82:0/704971234 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5616a8b22940 0x5616a8b9f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:37.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.893+0000 7fd8c1df1b80 1 --2- 172.21.15.82:0/704971234 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5616a8b209d0 0x5616a8b22400 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:37.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.893+0000 7fd8c1df1b80 1 -- 172.21.15.82:0/704971234 >> 172.21.15.82:0/704971234 conn(0x5616a8a4ab60 msgr2=0x5616a8b1ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:51:37.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.893+0000 7fd896a00700 0 client.25351 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:51:37.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.894+0000 7fd8c1df1b80 1 -- 172.21.15.82:0/704971234 shutdown_connections 2024-05-08T05:51:37.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.894+0000 7fd8c1df1b80 1 -- 172.21.15.82:0/704971234 wait complete. 2024-05-08T05:51:37.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.896+0000 7fd8c1df1b80 20 client.25351 trim_cache size 0 max 16384 2024-05-08T05:51:37.896 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T05:51:37.897 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-08T05:51:37.897 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2024-05-08T05:51:37.897 INFO:teuthology.orchestra.run.smithi082.stdout: "819d0fd2-8ea3-49c0-b9ab-4a44a223adb0": { 2024-05-08T05:51:37.897 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2024-05-08T05:51:37.897 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "819d0fd2-8ea3-49c0-b9ab-4a44a223adb0", 2024-05-08T05:51:37.897 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2024-05-08T05:51:37.897 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T05:51:37.897 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T05:51:37.897 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T05:51:37.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.897+0000 7fd8b7400700 1 -- 172.21.15.82:0/1448982045 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd8980b2900 msgr2=0x7fd8980b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:37.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.897+0000 7fd8b7400700 1 --2- 172.21.15.82:0/1448982045 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd8980b2900 0x7fd8980b4dc0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fd8a4005950 tx=0x7fd8a4016000 comp rx=0 tx=0).stop 2024-05-08T05:51:37.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.897+0000 7fd8b7400700 1 -- 172.21.15.82:0/1448982045 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8b010fea0 msgr2=0x7fd8b010e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:51:37.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.897+0000 7fd8b7400700 1 --2- 172.21.15.82:0/1448982045 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8b010fea0 0x7fd8b010e940 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd8a8007d40 tx=0x7fd8a800a340 comp rx=0 tx=0).stop 2024-05-08T05:51:37.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.897+0000 7fd8b7400700 1 -- 172.21.15.82:0/1448982045 shutdown_connections 2024-05-08T05:51:37.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.897+0000 7fd8b7400700 1 --2- 172.21.15.82:0/1448982045 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8b010fea0 0x7fd8b010e940 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:37.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.897+0000 7fd8b7400700 1 --2- 172.21.15.82:0/1448982045 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd8980b2900 0x7fd8980b4dc0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:37.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.897+0000 7fd8b7400700 1 --2- 172.21.15.82:0/1448982045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8b00756d0 0x7fd8b01a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:37.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.897+0000 7fd8b7400700 1 --2- 172.21.15.82:0/1448982045 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8b0075ff0 0x7fd8b01a1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:51:37.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.897+0000 7fd8b7400700 1 -- 172.21.15.82:0/1448982045 >> 172.21.15.82:0/1448982045 conn(0x7fd8b007a600 msgr2=0x7fd8b0105770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:51:37.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.898+0000 7fd8b7400700 1 -- 172.21.15.82:0/1448982045 shutdown_connections 2024-05-08T05:51:37.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:51:37.898+0000 7fd8b7400700 1 -- 172.21.15.82:0/1448982045 wait complete. 2024-05-08T05:51:38.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:51:37 smithi134 ceph-mon[34132]: pgmap v488: 97 pgs: 97 active+clean; 986 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 791 op/s 2024-05-08T05:51:38.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:51:37 smithi151 ceph-mon[34815]: pgmap v488: 97 pgs: 97 active+clean; 986 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 13 MiB/s wr, 791 op/s 2024-05-08T05:51:38.788 INFO:tasks.cephfs.filesystem:scrub status for tag:819d0fd2-8ea3-49c0-b9ab-4a44a223adb0 - {'path': '/', 'tag': '819d0fd2-8ea3-49c0-b9ab-4a44a223adb0', 'options': 'recursive,force'} 2024-05-08T05:51:39.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:51:39 smithi082 ceph-mon[30098]: pgmap v489: 97 pgs: 97 active+clean; 987 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 7.1 MiB/s wr, 669 op/s 2024-05-08T05:51:39.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:51:39 smithi134 ceph-mon[34132]: pgmap v489: 97 pgs: 97 active+clean; 987 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 7.1 MiB/s wr, 669 op/s 2024-05-08T05:51:40.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:51:39 smithi151 ceph-mon[34815]: pgmap v489: 97 pgs: 97 active+clean; 987 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 7.1 MiB/s wr, 669 op/s 2024-05-08T05:51:40.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 50.0 s, 3089.4 tps, lat 32.373 ms stddev 37.862 2024-05-08T05:51:40.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:51:40 smithi082 ceph-mon[30098]: scrub summary: idle 2024-05-08T05:51:40.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:51:40 smithi134 ceph-mon[34132]: scrub summary: idle 2024-05-08T05:51:41.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:51:40 smithi151 ceph-mon[34815]: scrub summary: idle 2024-05-08T05:51:41.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:51:41 smithi082 ceph-mon[30098]: scrub summary: idle 2024-05-08T05:51:41.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:51:41 smithi082 ceph-mon[30098]: pgmap v490: 97 pgs: 97 active+clean; 1000 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 9.1 MiB/s wr, 811 op/s 2024-05-08T05:51:42.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:51:41 smithi134 ceph-mon[34132]: scrub summary: idle 2024-05-08T05:51:42.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:51:41 smithi134 ceph-mon[34132]: pgmap v490: 97 pgs: 97 active+clean; 1000 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 9.1 MiB/s wr, 811 op/s 2024-05-08T05:51:42.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:51:41 smithi151 ceph-mon[34815]: scrub summary: idle 2024-05-08T05:51:42.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:51:41 smithi151 ceph-mon[34815]: pgmap v490: 97 pgs: 97 active+clean; 1000 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 9.1 MiB/s wr, 811 op/s 2024-05-08T05:51:43.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:51:43 smithi082 ceph-mon[30098]: pgmap v491: 97 pgs: 97 active+clean; 1000 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 8.0 MiB/s wr, 692 op/s 2024-05-08T05:51:43.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:51:43 smithi134 ceph-mon[34132]: pgmap v491: 97 pgs: 97 active+clean; 1000 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 8.0 MiB/s wr, 692 op/s 2024-05-08T05:51:44.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:51:43 smithi151 ceph-mon[34815]: pgmap v491: 97 pgs: 97 active+clean; 1000 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 8.0 MiB/s wr, 692 op/s 2024-05-08T05:51:45.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 55.0 s, 2911.5 tps, lat 34.434 ms stddev 38.292 2024-05-08T05:51:45.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:51:45 smithi082 ceph-mon[30098]: pgmap v492: 97 pgs: 97 active+clean; 1001 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 8.6 MiB/s wr, 739 op/s 2024-05-08T05:51:45.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:51:45 smithi134 ceph-mon[34132]: pgmap v492: 97 pgs: 97 active+clean; 1001 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 8.6 MiB/s wr, 739 op/s 2024-05-08T05:51:46.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:51:45 smithi151 ceph-mon[34815]: pgmap v492: 97 pgs: 97 active+clean; 1001 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 8.6 MiB/s wr, 739 op/s 2024-05-08T05:51:47.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:51:47 smithi082 ceph-mon[30098]: pgmap v493: 97 pgs: 97 active+clean; 1001 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 8.6 MiB/s wr, 731 op/s 2024-05-08T05:51:47.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:51:47 smithi134 ceph-mon[34132]: pgmap v493: 97 pgs: 97 active+clean; 1001 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 8.6 MiB/s wr, 731 op/s 2024-05-08T05:51:48.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:51:47 smithi151 ceph-mon[34815]: pgmap v493: 97 pgs: 97 active+clean; 1001 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 8.6 MiB/s wr, 731 op/s 2024-05-08T05:51:49.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:51:49 smithi082 ceph-mon[30098]: pgmap v494: 97 pgs: 97 active+clean; 1001 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 7.5 MiB/s wr, 664 op/s 2024-05-08T05:51:49.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:51:49 smithi134 ceph-mon[34132]: pgmap v494: 97 pgs: 97 active+clean; 1001 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 7.5 MiB/s wr, 664 op/s 2024-05-08T05:51:50.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:51:49 smithi151 ceph-mon[34815]: pgmap v494: 97 pgs: 97 active+clean; 1001 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 7.5 MiB/s wr, 664 op/s 2024-05-08T05:51:50.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 60.0 s, 2566.9 tps, lat 38.712 ms stddev 47.635 2024-05-08T05:51:51.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:51:51 smithi082 ceph-mon[30098]: pgmap v495: 97 pgs: 97 active+clean; 1010 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 9.9 MiB/s wr, 826 op/s 2024-05-08T05:51:51.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:51:51 smithi134 ceph-mon[34132]: pgmap v495: 97 pgs: 97 active+clean; 1010 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 9.9 MiB/s wr, 826 op/s 2024-05-08T05:51:52.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:51:51 smithi151 ceph-mon[34815]: pgmap v495: 97 pgs: 97 active+clean; 1010 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 9.9 MiB/s wr, 826 op/s 2024-05-08T05:51:54.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:51:53 smithi134 ceph-mon[34132]: pgmap v496: 97 pgs: 97 active+clean; 1018 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 8.1 MiB/s wr, 674 op/s 2024-05-08T05:51:54.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:51:53 smithi151 ceph-mon[34815]: pgmap v496: 97 pgs: 97 active+clean; 1018 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 8.1 MiB/s wr, 674 op/s 2024-05-08T05:51:54.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:51:53 smithi082 ceph-mon[30098]: pgmap v496: 97 pgs: 97 active+clean; 1018 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 8.1 MiB/s wr, 674 op/s 2024-05-08T05:51:55.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 65.0 s, 3092.6 tps, lat 32.262 ms stddev 40.132 2024-05-08T05:51:55.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:51:55 smithi134 ceph-mon[34132]: pgmap v497: 97 pgs: 97 active+clean; 1019 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.0 MiB/s wr, 684 op/s 2024-05-08T05:51:56.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:51:55 smithi151 ceph-mon[34815]: pgmap v497: 97 pgs: 97 active+clean; 1019 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.0 MiB/s wr, 684 op/s 2024-05-08T05:51:56.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:51:55 smithi082 ceph-mon[30098]: pgmap v497: 97 pgs: 97 active+clean; 1019 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.0 MiB/s wr, 684 op/s 2024-05-08T05:51:57.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:51:57 smithi134 ceph-mon[34132]: pgmap v498: 97 pgs: 97 active+clean; 1021 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 10 MiB/s wr, 777 op/s 2024-05-08T05:51:58.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:51:57 smithi151 ceph-mon[34815]: pgmap v498: 97 pgs: 97 active+clean; 1021 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 10 MiB/s wr, 777 op/s 2024-05-08T05:51:58.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:51:57 smithi082 ceph-mon[30098]: pgmap v498: 97 pgs: 97 active+clean; 1021 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 10 MiB/s wr, 777 op/s 2024-05-08T05:52:00.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:51:59 smithi134 ceph-mon[34132]: pgmap v499: 97 pgs: 97 active+clean; 1021 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.4 MiB/s wr, 697 op/s 2024-05-08T05:52:00.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:51:59 smithi151 ceph-mon[34815]: pgmap v499: 97 pgs: 97 active+clean; 1021 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.4 MiB/s wr, 697 op/s 2024-05-08T05:52:00.218 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:51:59 smithi082 ceph-mon[30098]: pgmap v499: 97 pgs: 97 active+clean; 1021 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.4 MiB/s wr, 697 op/s 2024-05-08T05:52:00.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 70.0 s, 2899.1 tps, lat 34.343 ms stddev 46.381 2024-05-08T05:52:02.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:52:01 smithi134 ceph-mon[34132]: pgmap v500: 97 pgs: 97 active+clean; 1.0 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 10 MiB/s wr, 771 op/s 2024-05-08T05:52:02.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:52:01 smithi151 ceph-mon[34815]: pgmap v500: 97 pgs: 97 active+clean; 1.0 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 10 MiB/s wr, 771 op/s 2024-05-08T05:52:02.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:52:01 smithi082 ceph-mon[30098]: pgmap v500: 97 pgs: 97 active+clean; 1.0 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 10 MiB/s wr, 771 op/s 2024-05-08T05:52:04.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:52:03 smithi134 ceph-mon[34132]: pgmap v501: 97 pgs: 97 active+clean; 1.0 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.0 MiB/s wr, 677 op/s 2024-05-08T05:52:04.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:52:03 smithi151 ceph-mon[34815]: pgmap v501: 97 pgs: 97 active+clean; 1.0 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.0 MiB/s wr, 677 op/s 2024-05-08T05:52:04.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:52:03 smithi082 ceph-mon[30098]: pgmap v501: 97 pgs: 97 active+clean; 1.0 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.0 MiB/s wr, 677 op/s 2024-05-08T05:52:05.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 75.0 s, 2782.5 tps, lat 36.167 ms stddev 41.201 2024-05-08T05:52:06.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:52:05 smithi151 ceph-mon[34815]: pgmap v502: 97 pgs: 97 active+clean; 1.0 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 808 op/s 2024-05-08T05:52:06.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:52:05 smithi082 ceph-mon[30098]: pgmap v502: 97 pgs: 97 active+clean; 1.0 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 808 op/s 2024-05-08T05:52:06.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:52:05 smithi134 ceph-mon[34132]: pgmap v502: 97 pgs: 97 active+clean; 1.0 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 11 MiB/s wr, 808 op/s 2024-05-08T05:52:08.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:52:07 smithi151 ceph-mon[34815]: pgmap v503: 97 pgs: 97 active+clean; 1.0 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 10 MiB/s wr, 771 op/s 2024-05-08T05:52:08.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:52:07 smithi082 ceph-mon[30098]: pgmap v503: 97 pgs: 97 active+clean; 1.0 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 10 MiB/s wr, 771 op/s 2024-05-08T05:52:08.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:52:07 smithi134 ceph-mon[34132]: pgmap v503: 97 pgs: 97 active+clean; 1.0 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 10 MiB/s wr, 771 op/s 2024-05-08T05:52:08.789 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-08T05:52:09.365 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:52:09.861 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:52:09 smithi082 ceph-mon[30098]: pgmap v504: 97 pgs: 97 active+clean; 1.0 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.7 MiB/s wr, 650 op/s 2024-05-08T05:52:10.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:52:09 smithi151 ceph-mon[34815]: pgmap v504: 97 pgs: 97 active+clean; 1.0 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.7 MiB/s wr, 650 op/s 2024-05-08T05:52:10.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:52:09 smithi134 ceph-mon[34132]: pgmap v504: 97 pgs: 97 active+clean; 1.0 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.7 MiB/s wr, 650 op/s 2024-05-08T05:52:10.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 80.0 s, 2839.2 tps, lat 35.132 ms stddev 39.279 2024-05-08T05:52:11.961 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:52:11 smithi082 ceph-mon[30098]: pgmap v505: 97 pgs: 97 active+clean; 1.0 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.4 MiB/s wr, 759 op/s 2024-05-08T05:52:12.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:52:11 smithi151 ceph-mon[34815]: pgmap v505: 97 pgs: 97 active+clean; 1.0 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.4 MiB/s wr, 759 op/s 2024-05-08T05:52:12.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:52:11 smithi134 ceph-mon[34132]: pgmap v505: 97 pgs: 97 active+clean; 1.0 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.4 MiB/s wr, 759 op/s 2024-05-08T05:52:12.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.295+0000 7f3f2e200700 1 -- 172.21.15.82:0/1357047449 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f280782f0 msgr2=0x7f3f28113e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:12.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.295+0000 7f3f2e200700 1 --2- 172.21.15.82:0/1357047449 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f280782f0 0x7f3f28113e40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3f18009990 tx=0x7f3f18009ca0 comp rx=0 tx=0).stop 2024-05-08T05:52:12.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.295+0000 7f3f2e200700 1 -- 172.21.15.82:0/1357047449 shutdown_connections 2024-05-08T05:52:12.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.295+0000 7f3f2e200700 1 --2- 172.21.15.82:0/1357047449 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f28114380 0x7f3f28116770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:12.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.295+0000 7f3f2e200700 1 --2- 172.21.15.82:0/1357047449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f280779d0 0x7f3f28077db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:12.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.295+0000 7f3f2e200700 1 --2- 172.21.15.82:0/1357047449 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f280782f0 0x7f3f28113e40 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:12.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.295+0000 7f3f2e200700 1 -- 172.21.15.82:0/1357047449 >> 172.21.15.82:0/1357047449 conn(0x7f3f281011d0 msgr2=0x7f3f281035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:52:12.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.295+0000 7f3f2e200700 1 -- 172.21.15.82:0/1357047449 shutdown_connections 2024-05-08T05:52:12.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.296+0000 7f3f2e200700 1 -- 172.21.15.82:0/1357047449 wait complete. 2024-05-08T05:52:12.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.301+0000 7f3f2e200700 1 Processor -- start 2024-05-08T05:52:12.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.301+0000 7f3f2e200700 1 -- start start 2024-05-08T05:52:12.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.305+0000 7f3f2e200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f280779d0 0x7f3f281a01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:12.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.307+0000 7f3f2e200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f280782f0 0x7f3f281a0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:12.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.307+0000 7f3f2e200700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f28114380 0x7f3f281a4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:12.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.308+0000 7f3f26a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f280782f0 0x7f3f281a0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:12.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.309+0000 7f3f2e200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3f28119d60 con 0x7f3f280779d0 2024-05-08T05:52:12.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.309+0000 7f3f26a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f280782f0 0x7f3f281a0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:58278/0 (socket says 172.21.15.82:58278) 2024-05-08T05:52:12.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.309+0000 7f3f2e200700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3f28119be0 con 0x7f3f280782f0 2024-05-08T05:52:12.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.309+0000 7f3f26a00700 1 -- 172.21.15.82:0/2534004076 learned_addr learned my addr 172.21.15.82:0/2534004076 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:52:12.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.309+0000 7f3f2e200700 1 -- 172.21.15.82:0/2534004076 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3f28119ee0 con 0x7f3f28114380 2024-05-08T05:52:12.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.309+0000 7f3f27e00700 1 --2- 172.21.15.82:0/2534004076 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f28114380 0x7f3f281a4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:12.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.310+0000 7f3f27400700 1 --2- 172.21.15.82:0/2534004076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f280779d0 0x7f3f281a01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:12.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.314+0000 7f3f27e00700 1 -- 172.21.15.82:0/2534004076 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f280782f0 msgr2=0x7f3f281a0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:12.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.316+0000 7f3f27e00700 1 --2- 172.21.15.82:0/2534004076 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f280782f0 0x7f3f281a0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:12.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.316+0000 7f3f27e00700 1 -- 172.21.15.82:0/2534004076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f280779d0 msgr2=0x7f3f281a01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:12.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.316+0000 7f3f27e00700 1 --2- 172.21.15.82:0/2534004076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f280779d0 0x7f3f281a01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:12.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.316+0000 7f3f27e00700 1 -- 172.21.15.82:0/2534004076 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f281a5200 con 0x7f3f28114380 2024-05-08T05:52:12.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.317+0000 7f3f26a00700 1 --2- 172.21.15.82:0/2534004076 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f280782f0 0x7f3f281a0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:52:12.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.318+0000 7f3f27400700 1 --2- 172.21.15.82:0/2534004076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f280779d0 0x7f3f281a01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:52:12.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.319+0000 7f3f27e00700 1 --2- 172.21.15.82:0/2534004076 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f28114380 0x7f3f281a4ac0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3f2807bcc0 tx=0x7f3f2000ef90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:52:12.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.320+0000 7f3f1fe00700 1 -- 172.21.15.82:0/2534004076 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f200092e0 con 0x7f3f28114380 2024-05-08T05:52:12.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.320+0000 7f3f1fe00700 1 -- 172.21.15.82:0/2534004076 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f20004bb0 con 0x7f3f28114380 2024-05-08T05:52:12.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.320+0000 7f3f1fe00700 1 -- 172.21.15.82:0/2534004076 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f20004020 con 0x7f3f28114380 2024-05-08T05:52:12.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.320+0000 7f3f2e200700 1 -- 172.21.15.82:0/2534004076 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f281a5490 con 0x7f3f28114380 2024-05-08T05:52:12.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.320+0000 7f3f2e200700 1 -- 172.21.15.82:0/2534004076 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f281acd70 con 0x7f3f28114380 2024-05-08T05:52:12.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.329+0000 7f3f1fe00700 1 -- 172.21.15.82:0/2534004076 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f3f2001b030 con 0x7f3f28114380 2024-05-08T05:52:12.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.331+0000 7f3f38c5bb80 1 Processor -- start 2024-05-08T05:52:12.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.332+0000 7f3f38c5bb80 1 -- start start 2024-05-08T05:52:12.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.332+0000 7f3f38c5bb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560ec7337bc0 0x560ec7337fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:12.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.333+0000 7f3f38c5bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ec73384e0 0x560ec73322d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:12.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.333+0000 7f3f38c5bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560ec73328f0 0x560ec7332d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:12.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.333+0000 7f3f38c5bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x560ec7284a20 con 0x560ec73384e0 2024-05-08T05:52:12.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.333+0000 7f3f38c5bb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x560ec7222760 con 0x560ec7337bc0 2024-05-08T05:52:12.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.333+0000 7f3f38c5bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x560ec72809e0 con 0x560ec73328f0 2024-05-08T05:52:12.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.335+0000 7f3f1fe00700 1 --2- 172.21.15.82:0/2534004076 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3f0c0b2a50 0x7f3f0c0b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:12.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.335+0000 7f3f26a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560ec7337bc0 0x560ec7337fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:12.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.335+0000 7f3f26a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560ec73328f0 0x560ec7332d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:12.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.335+0000 7f3f26a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560ec73328f0 0x560ec7332d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:34616/0 (socket says 172.21.15.82:34616) 2024-05-08T05:52:12.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.335+0000 7f3f26a00700 1 -- 172.21.15.82:0/1937193581 learned_addr learned my addr 172.21.15.82:0/1937193581 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:52:12.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.336+0000 7f3f26a00700 1 -- 172.21.15.82:0/1937193581 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560ec7337bc0 msgr2=0x560ec7337fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:12.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.336+0000 7f3f26a00700 1 --2- 172.21.15.82:0/1937193581 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560ec7337bc0 0x560ec7337fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:12.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.336+0000 7f3f26a00700 1 -- 172.21.15.82:0/1937193581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ec73384e0 msgr2=0x560ec73322d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:12.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.336+0000 7f3f26a00700 1 --2- 172.21.15.82:0/1937193581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ec73384e0 0x560ec73322d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:12.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.336+0000 7f3f26a00700 1 -- 172.21.15.82:0/1937193581 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ec71d18d0 con 0x560ec73328f0 2024-05-08T05:52:12.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.336+0000 7f3f1fe00700 1 -- 172.21.15.82:0/2534004076 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f3f200e1be0 con 0x7f3f28114380 2024-05-08T05:52:12.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.337+0000 7f3f26a00700 1 --2- 172.21.15.82:0/1937193581 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560ec73328f0 0x560ec7332d70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3f18004800 tx=0x7f3f18009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=308a8630eab69241 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:52:12.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.337+0000 7f3f27e00700 1 --2- 172.21.15.82:0/2534004076 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3f0c0b2a50 0x7f3f0c0b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:12.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.337+0000 7f3f1cc00700 1 -- 172.21.15.82:0/1937193581 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f18021040 con 0x560ec73328f0 2024-05-08T05:52:12.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.337+0000 7f3f1cc00700 1 -- 172.21.15.82:0/1937193581 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f180044e0 con 0x560ec73328f0 2024-05-08T05:52:12.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.337+0000 7f3f1cc00700 1 -- 172.21.15.82:0/1937193581 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f18005280 con 0x560ec73328f0 2024-05-08T05:52:12.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.338+0000 7f3f38c5bb80 1 -- 172.21.15.82:0/1937193581 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560ec73328f0 msgr2=0x560ec7332d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:12.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.338+0000 7f3f38c5bb80 1 --2- 172.21.15.82:0/1937193581 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560ec73328f0 0x560ec7332d70 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3f18004800 tx=0x7f3f18009ca0 comp rx=0 tx=0).stop 2024-05-08T05:52:12.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.339+0000 7f3f27e00700 1 --2- 172.21.15.82:0/2534004076 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3f0c0b2a50 0x7f3f0c0b4f10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3f200bcfd0 tx=0x7f3f20000f40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:52:12.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.339+0000 7f3f38c5bb80 1 -- 172.21.15.82:0/1937193581 shutdown_connections 2024-05-08T05:52:12.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.339+0000 7f3f38c5bb80 1 --2- 172.21.15.82:0/1937193581 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560ec7337bc0 0x560ec7337fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:12.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.339+0000 7f3f38c5bb80 1 --2- 172.21.15.82:0/1937193581 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560ec73328f0 0x560ec7332d70 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:12.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.339+0000 7f3f38c5bb80 1 --2- 172.21.15.82:0/1937193581 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ec73384e0 0x560ec73322d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:12.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.339+0000 7f3f38c5bb80 1 -- 172.21.15.82:0/1937193581 >> 172.21.15.82:0/1937193581 conn(0x560ec72aa6d0 msgr2=0x560ec732cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:52:12.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.340+0000 7f3f38c5bb80 1 -- 172.21.15.82:0/1937193581 shutdown_connections 2024-05-08T05:52:12.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.340+0000 7f3f38c5bb80 1 -- 172.21.15.82:0/1937193581 wait complete. 2024-05-08T05:52:12.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.341+0000 7f3f38c5bb80 1 -- start start 2024-05-08T05:52:12.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.342+0000 7f3f38c5bb80 1 Processor -- start 2024-05-08T05:52:12.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.342+0000 7f3f38c5bb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560ec73328f0 0x560ec733e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:12.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.342+0000 7f3f38c5bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ec7337bc0 0x560ec733b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:12.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.342+0000 7f3f38c5bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560ec73384e0 0x560ec733bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:12.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.343+0000 7f3f38c5bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x560ec733eec0 con 0x560ec7337bc0 2024-05-08T05:52:12.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.343+0000 7f3f38c5bb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x560ec71eab20 con 0x560ec73328f0 2024-05-08T05:52:12.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.343+0000 7f3f38c5bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x560ec733f040 con 0x560ec73384e0 2024-05-08T05:52:12.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.343+0000 7f3f38c5bb80 10 client.0 _ll_register_callbacks cb 0x560ec722bc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:52:12.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.343+0000 7f3f26a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560ec73328f0 0x560ec733e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:12.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.343+0000 7f3f26a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560ec73384e0 0x560ec733bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:12.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.343+0000 7f3f26a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560ec73384e0 0x560ec733bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:34630/0 (socket says 172.21.15.82:34630) 2024-05-08T05:52:12.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.343+0000 7f3f26a00700 1 -- 172.21.15.82:0/890012904 learned_addr learned my addr 172.21.15.82:0/890012904 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:52:12.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.344+0000 7f3f26a00700 1 -- 172.21.15.82:0/890012904 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560ec73328f0 msgr2=0x560ec733e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:12.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.344+0000 7f3f26a00700 1 --2- 172.21.15.82:0/890012904 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560ec73328f0 0x560ec733e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:12.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.344+0000 7f3f26a00700 1 -- 172.21.15.82:0/890012904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ec7337bc0 msgr2=0x560ec733b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:12.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.344+0000 7f3f26a00700 1 --2- 172.21.15.82:0/890012904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ec7337bc0 0x560ec733b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:12.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.344+0000 7f3f26a00700 1 -- 172.21.15.82:0/890012904 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ec724a420 con 0x560ec73384e0 2024-05-08T05:52:12.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.345+0000 7f3f26a00700 1 --2- 172.21.15.82:0/890012904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560ec73384e0 0x560ec733bb10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3f1800b360 tx=0x7f3f18004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fed6f6b4aa65c6dc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:52:12.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.345+0000 7f3f11600700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:52:12.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.345+0000 7f3f11600700 1 -- 172.21.15.82:0/890012904 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f1802d060 con 0x560ec73384e0 2024-05-08T05:52:12.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.346+0000 7f3f11600700 1 -- 172.21.15.82:0/890012904 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f3f18005000 con 0x560ec73384e0 2024-05-08T05:52:12.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.346+0000 7f3f38c5bb80 1 -- 172.21.15.82:0/890012904 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f180044e0 con 0x560ec73384e0 2024-05-08T05:52:12.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.347+0000 7f3f11600700 1 -- 172.21.15.82:0/890012904 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3f18030070 con 0x560ec73384e0 2024-05-08T05:52:12.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.348+0000 7f3f38c5bb80 10 client.25363 fetch_fsmap learned FSMap version 30 2024-05-08T05:52:12.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.348+0000 7f3f38c5bb80 1 -- 172.21.15.82:0/890012904 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x560ec733eec0 con 0x560ec73384e0 2024-05-08T05:52:12.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.349+0000 7f3f11600700 1 -- 172.21.15.82:0/890012904 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f180044e0 con 0x560ec73384e0 2024-05-08T05:52:12.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.350+0000 7f3f11600700 1 -- 172.21.15.82:0/890012904 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f3f18039070 con 0x560ec73384e0 2024-05-08T05:52:12.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.351+0000 7f3f38c5bb80 10 client.25363 fetch_fsmap finished waiting for FSMap version 30 2024-05-08T05:52:12.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.351+0000 7f3f38c5bb80 10 client.25363 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:52:12.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.351+0000 7f3f38c5bb80 20 client.25363 populate_metadata read hostname 'smithi082' 2024-05-08T05:52:12.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.351+0000 7f3f38c5bb80 1 --2- 172.21.15.82:0/890012904 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x560ec734ba90 0x560ec734de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:12.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.351+0000 7f3f38c5bb80 4 client.25363 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:52:12.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.351+0000 7f3f38c5bb80 1 -- 172.21.15.82:0/890012904 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560ec72ff140 con 0x560ec734ba90 2024-05-08T05:52:12.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.351+0000 7f3f27400700 1 --2- 172.21.15.82:0/890012904 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x560ec734ba90 0x560ec734de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:12.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.352+0000 7f3f27400700 1 --2- 172.21.15.82:0/890012904 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x560ec734ba90 0x560ec734de80 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6459a1af5fa6f8c3 server_cookie=6e413f0fc222e251 in_seq=0 out_seq=0 2024-05-08T05:52:12.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.353+0000 7f3f11600700 10 client.25363 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:52:12.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.353+0000 7f3f11600700 1 -- 172.21.15.82:0/890012904 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x560ec72ff140 con 0x560ec734ba90 2024-05-08T05:52:12.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.353+0000 7f3f11600700 10 client.25363 handle_command_reply: tid=0 2024-05-08T05:52:12.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.353+0000 7f3f38c5bb80 1 client.25363 shutdown 2024-05-08T05:52:12.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.355+0000 7f3f38c5bb80 1 -- 172.21.15.82:0/890012904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560ec73384e0 msgr2=0x560ec733bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:12.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.355+0000 7f3f38c5bb80 1 --2- 172.21.15.82:0/890012904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560ec73384e0 0x560ec733bb10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f3f1800b360 tx=0x7f3f18004770 comp rx=0 tx=0).stop 2024-05-08T05:52:12.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.355+0000 7f3f38c5bb80 1 -- 172.21.15.82:0/890012904 shutdown_connections 2024-05-08T05:52:12.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.355+0000 7f3f38c5bb80 1 --2- 172.21.15.82:0/890012904 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x560ec734ba90 0x560ec734de80 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:12.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.355+0000 7f3f38c5bb80 1 --2- 172.21.15.82:0/890012904 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560ec73328f0 0x560ec733e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:12.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.355+0000 7f3f38c5bb80 1 --2- 172.21.15.82:0/890012904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560ec73384e0 0x560ec733bb10 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:12.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.355+0000 7f3f38c5bb80 1 --2- 172.21.15.82:0/890012904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ec7337bc0 0x560ec733b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:12.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.355+0000 7f3f38c5bb80 1 -- 172.21.15.82:0/890012904 >> 172.21.15.82:0/890012904 conn(0x560ec72aa6d0 msgr2=0x560ec732c190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:52:12.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.355+0000 7f3f11600700 0 client.25363 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:52:12.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.356+0000 7f3f38c5bb80 1 -- 172.21.15.82:0/890012904 shutdown_connections 2024-05-08T05:52:12.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.356+0000 7f3f38c5bb80 1 -- 172.21.15.82:0/890012904 wait complete. 2024-05-08T05:52:12.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.356+0000 7f3f38c5bb80 20 client.25363 trim_cache size 0 max 16384 2024-05-08T05:52:12.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.391+0000 7f3f38c5bb80 1 Processor -- start 2024-05-08T05:52:12.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.392+0000 7f3f38c5bb80 1 -- start start 2024-05-08T05:52:12.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.392+0000 7f3f38c5bb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560ec73328f0 0x560ec73322d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:12.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.392+0000 7f3f38c5bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560ec7337bc0 0x560ec7347f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:12.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.392+0000 7f3f38c5bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ec73384e0 0x560ec733a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:12.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.392+0000 7f3f38c5bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3f281b41e0 con 0x560ec73384e0 2024-05-08T05:52:12.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.392+0000 7f3f38c5bb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3f281b5d50 con 0x560ec73328f0 2024-05-08T05:52:12.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.392+0000 7f3f38c5bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3f281b48b0 con 0x560ec7337bc0 2024-05-08T05:52:12.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.392+0000 7f3f26a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560ec73328f0 0x560ec73322d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:12.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.392+0000 7f3f26a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560ec73328f0 0x560ec73322d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:58306/0 (socket says 172.21.15.82:58306) 2024-05-08T05:52:12.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.392+0000 7f3f26a00700 1 -- 172.21.15.82:0/1756300628 learned_addr learned my addr 172.21.15.82:0/1756300628 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:52:12.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.393+0000 7f3f26a00700 1 --2- 172.21.15.82:0/1756300628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ec73384e0 0x560ec733a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:12.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.393+0000 7f3f27400700 1 --2- 172.21.15.82:0/1756300628 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560ec7337bc0 0x560ec7347f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:12.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.393+0000 7f3f26a00700 1 -- 172.21.15.82:0/1756300628 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560ec7337bc0 msgr2=0x560ec7347f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:12.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.393+0000 7f3f26a00700 1 --2- 172.21.15.82:0/1756300628 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560ec7337bc0 0x560ec7347f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:12.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.393+0000 7f3f26a00700 1 -- 172.21.15.82:0/1756300628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ec73384e0 msgr2=0x560ec733a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:12.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.393+0000 7f3f26a00700 1 --2- 172.21.15.82:0/1756300628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ec73384e0 0x560ec733a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:12.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.393+0000 7f3f26a00700 1 -- 172.21.15.82:0/1756300628 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ec73381f0 con 0x560ec73328f0 2024-05-08T05:52:12.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.394+0000 7f3f26a00700 1 --2- 172.21.15.82:0/1756300628 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560ec73328f0 0x560ec73322d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3f18001eb0 tx=0x7f3f18019040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c373e50ccdd9023 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:52:12.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.394+0000 7f3f13e00700 1 -- 172.21.15.82:0/1756300628 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f1802d070 con 0x560ec73328f0 2024-05-08T05:52:12.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.394+0000 7f3f13e00700 1 -- 172.21.15.82:0/1756300628 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f1802e040 con 0x560ec73328f0 2024-05-08T05:52:12.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.394+0000 7f3f13e00700 1 -- 172.21.15.82:0/1756300628 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f1803f040 con 0x560ec73328f0 2024-05-08T05:52:12.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.395+0000 7f3f38c5bb80 1 -- 172.21.15.82:0/1756300628 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560ec73328f0 msgr2=0x560ec73322d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:12.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.395+0000 7f3f38c5bb80 1 --2- 172.21.15.82:0/1756300628 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560ec73328f0 0x560ec73322d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3f18001eb0 tx=0x7f3f18019040 comp rx=0 tx=0).stop 2024-05-08T05:52:12.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.395+0000 7f3f38c5bb80 1 -- 172.21.15.82:0/1756300628 shutdown_connections 2024-05-08T05:52:12.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.395+0000 7f3f38c5bb80 1 --2- 172.21.15.82:0/1756300628 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560ec73328f0 0x560ec73322d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:12.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.395+0000 7f3f38c5bb80 1 --2- 172.21.15.82:0/1756300628 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ec73384e0 0x560ec733a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:12.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.395+0000 7f3f38c5bb80 1 --2- 172.21.15.82:0/1756300628 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560ec7337bc0 0x560ec7347f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:12.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.395+0000 7f3f38c5bb80 1 -- 172.21.15.82:0/1756300628 >> 172.21.15.82:0/1756300628 conn(0x560ec72aa6d0 msgr2=0x560ec7339ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:52:12.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.395+0000 7f3f38c5bb80 1 -- 172.21.15.82:0/1756300628 shutdown_connections 2024-05-08T05:52:12.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.395+0000 7f3f38c5bb80 1 -- 172.21.15.82:0/1756300628 wait complete. 2024-05-08T05:52:12.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.396+0000 7f3f38c5bb80 1 -- start start 2024-05-08T05:52:12.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.396+0000 7f3f38c5bb80 1 Processor -- start 2024-05-08T05:52:12.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.397+0000 7f3f38c5bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560ec73328f0 0x560ec7353050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:12.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.397+0000 7f3f38c5bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ec7337bc0 0x560ec7353590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:12.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.397+0000 7f3f26a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560ec73328f0 0x560ec7353050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:12.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.397+0000 7f3f38c5bb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560ec73384e0 0x560ec73b5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:12.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.397+0000 7f3f38c5bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3f281b5650 con 0x560ec7337bc0 2024-05-08T05:52:12.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.397+0000 7f3f38c5bb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3f281b4f80 con 0x560ec73384e0 2024-05-08T05:52:12.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.397+0000 7f3f38c5bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3f281b2180 con 0x560ec73328f0 2024-05-08T05:52:12.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.397+0000 7f3f38c5bb80 10 client.0 _ll_register_callbacks cb 0x560ec722bc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:52:12.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.397+0000 7f3f27400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ec7337bc0 0x560ec7353590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:12.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.397+0000 7f3f26a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560ec73328f0 0x560ec7353050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:34654/0 (socket says 172.21.15.82:34654) 2024-05-08T05:52:12.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.397+0000 7f3f26a00700 1 -- 172.21.15.82:0/2247376403 learned_addr learned my addr 172.21.15.82:0/2247376403 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:52:12.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.398+0000 7f3f26a00700 1 -- 172.21.15.82:0/2247376403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560ec73384e0 msgr2=0x560ec73b5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:12.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.398+0000 7f3f26a00700 1 --2- 172.21.15.82:0/2247376403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560ec73384e0 0x560ec73b5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:12.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.398+0000 7f3f26a00700 1 -- 172.21.15.82:0/2247376403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ec7337bc0 msgr2=0x560ec7353590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:12.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.398+0000 7f3f26a00700 1 --2- 172.21.15.82:0/2247376403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ec7337bc0 0x560ec7353590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:12.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.398+0000 7f3f26a00700 1 -- 172.21.15.82:0/2247376403 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ec7353e80 con 0x560ec73328f0 2024-05-08T05:52:12.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.398+0000 7f3f26a00700 1 --2- 172.21.15.82:0/2247376403 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560ec73328f0 0x560ec7353050 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3f180098e0 tx=0x7f3f1800b680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e854cef98e714112 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:52:12.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.398+0000 7f3f11600700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:52:12.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.401+0000 7f3f11600700 1 -- 172.21.15.82:0/2247376403 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f1803f040 con 0x560ec73328f0 2024-05-08T05:52:12.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.401+0000 7f3f38c5bb80 1 -- 172.21.15.82:0/2247376403 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f1802e040 con 0x560ec73328f0 2024-05-08T05:52:12.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.401+0000 7f3f11600700 1 -- 172.21.15.82:0/2247376403 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f3f18005000 con 0x560ec73328f0 2024-05-08T05:52:12.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.401+0000 7f3f11600700 1 -- 172.21.15.82:0/2247376403 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f3f1802d040 con 0x560ec73328f0 2024-05-08T05:52:12.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.401+0000 7f3f38c5bb80 10 client.25369 fetch_fsmap learned FSMap version 30 2024-05-08T05:52:12.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.401+0000 7f3f38c5bb80 1 -- 172.21.15.82:0/2247376403 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x560ec73b66c0 con 0x560ec73328f0 2024-05-08T05:52:12.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.402+0000 7f3f11600700 1 -- 172.21.15.82:0/2247376403 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f1802e040 con 0x560ec73328f0 2024-05-08T05:52:12.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.402+0000 7f3f11600700 1 -- 172.21.15.82:0/2247376403 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f3f18056080 con 0x560ec73328f0 2024-05-08T05:52:12.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.402+0000 7f3f38c5bb80 10 client.25369 fetch_fsmap finished waiting for FSMap version 30 2024-05-08T05:52:12.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.402+0000 7f3f38c5bb80 10 client.25369 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:52:12.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.402+0000 7f3f38c5bb80 20 client.25369 populate_metadata read hostname 'smithi082' 2024-05-08T05:52:12.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.402+0000 7f3f38c5bb80 1 --2- 172.21.15.82:0/2247376403 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x560ec73b6d50 0x560ec73b9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:12.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.402+0000 7f3f38c5bb80 4 client.25369 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-08T05:52:12.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.402+0000 7f3f38c5bb80 1 -- 172.21.15.82:0/2247376403 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560ec7292400 con 0x560ec73b6d50 2024-05-08T05:52:12.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.403+0000 7f3f27400700 1 --2- 172.21.15.82:0/2247376403 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x560ec73b6d50 0x560ec73b9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:12.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.403+0000 7f3f27400700 1 --2- 172.21.15.82:0/2247376403 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x560ec73b6d50 0x560ec73b9170 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18cc47cdb3cb86a3 server_cookie=366761b020e007fa in_seq=0 out_seq=0 2024-05-08T05:52:12.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.403+0000 7f3f11600700 10 client.25369 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:52:12.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.404+0000 7f3f11600700 1 -- 172.21.15.82:0/2247376403 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x560ec7292400 con 0x560ec73b6d50 2024-05-08T05:52:12.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.404+0000 7f3f11600700 10 client.25369 handle_command_reply: tid=0 2024-05-08T05:52:12.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.404+0000 7f3f38c5bb80 1 client.25369 shutdown 2024-05-08T05:52:12.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.404+0000 7f3f38c5bb80 1 -- 172.21.15.82:0/2247376403 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560ec73328f0 msgr2=0x560ec7353050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:12.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.404+0000 7f3f38c5bb80 1 --2- 172.21.15.82:0/2247376403 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560ec73328f0 0x560ec7353050 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3f180098e0 tx=0x7f3f1800b680 comp rx=0 tx=0).stop 2024-05-08T05:52:12.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.405+0000 7f3f38c5bb80 1 -- 172.21.15.82:0/2247376403 shutdown_connections 2024-05-08T05:52:12.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.405+0000 7f3f38c5bb80 1 --2- 172.21.15.82:0/2247376403 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x560ec73b6d50 0x560ec73b9170 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:12.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.405+0000 7f3f11600700 0 client.25369 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:52:12.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.405+0000 7f3f38c5bb80 1 --2- 172.21.15.82:0/2247376403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560ec73384e0 0x560ec73b5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:12.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.405+0000 7f3f38c5bb80 1 --2- 172.21.15.82:0/2247376403 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560ec73328f0 0x560ec7353050 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:12.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.405+0000 7f3f38c5bb80 1 --2- 172.21.15.82:0/2247376403 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560ec7337bc0 0x560ec7353590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:12.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.405+0000 7f3f38c5bb80 1 -- 172.21.15.82:0/2247376403 >> 172.21.15.82:0/2247376403 conn(0x560ec72aa6d0 msgr2=0x560ec7337000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:52:12.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.405+0000 7f3f38c5bb80 1 -- 172.21.15.82:0/2247376403 shutdown_connections 2024-05-08T05:52:12.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.405+0000 7f3f38c5bb80 1 -- 172.21.15.82:0/2247376403 wait complete. 2024-05-08T05:52:12.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.405+0000 7f3f38c5bb80 20 client.25369 trim_cache size 0 max 16384 2024-05-08T05:52:12.407 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T05:52:12.407 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "no active scrubs running", 2024-05-08T05:52:12.407 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": {} 2024-05-08T05:52:12.407 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T05:52:12.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.406+0000 7f3f2e200700 1 -- 172.21.15.82:0/2534004076 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3f0c0b2a50 msgr2=0x7f3f0c0b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:12.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.406+0000 7f3f2e200700 1 --2- 172.21.15.82:0/2534004076 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3f0c0b2a50 0x7f3f0c0b4f10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3f200bcfd0 tx=0x7f3f20000f40 comp rx=0 tx=0).stop 2024-05-08T05:52:12.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.406+0000 7f3f2e200700 1 -- 172.21.15.82:0/2534004076 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f28114380 msgr2=0x7f3f281a4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:12.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.406+0000 7f3f2e200700 1 --2- 172.21.15.82:0/2534004076 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f28114380 0x7f3f281a4ac0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3f2807bcc0 tx=0x7f3f2000ef90 comp rx=0 tx=0).stop 2024-05-08T05:52:12.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.406+0000 7f3f2e200700 1 -- 172.21.15.82:0/2534004076 shutdown_connections 2024-05-08T05:52:12.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.406+0000 7f3f2e200700 1 --2- 172.21.15.82:0/2534004076 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3f0c0b2a50 0x7f3f0c0b4f10 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:12.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.406+0000 7f3f2e200700 1 --2- 172.21.15.82:0/2534004076 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f28114380 0x7f3f281a4ac0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:12.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.406+0000 7f3f2e200700 1 --2- 172.21.15.82:0/2534004076 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f280779d0 0x7f3f281a01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:12.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.406+0000 7f3f2e200700 1 --2- 172.21.15.82:0/2534004076 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f280782f0 0x7f3f281a0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:12.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.406+0000 7f3f2e200700 1 -- 172.21.15.82:0/2534004076 >> 172.21.15.82:0/2534004076 conn(0x7f3f281011d0 msgr2=0x7f3f281035c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:52:12.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.406+0000 7f3f2e200700 1 -- 172.21.15.82:0/2534004076 shutdown_connections 2024-05-08T05:52:12.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:12.406+0000 7f3f2e200700 1 -- 172.21.15.82:0/2534004076 wait complete. 2024-05-08T05:52:13.359 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-08T05:52:13.359 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T05:52:14.013 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:52:14.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:52:13 smithi151 ceph-mon[34815]: pgmap v506: 97 pgs: 97 active+clean; 1.0 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 8.1 MiB/s wr, 722 op/s 2024-05-08T05:52:14.188 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:52:13 smithi082 ceph-mon[30098]: pgmap v506: 97 pgs: 97 active+clean; 1.0 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 8.1 MiB/s wr, 722 op/s 2024-05-08T05:52:14.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:52:13 smithi134 ceph-mon[34132]: pgmap v506: 97 pgs: 97 active+clean; 1.0 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 8.1 MiB/s wr, 722 op/s 2024-05-08T05:52:15.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 85.0 s, 2833.6 tps, lat 35.446 ms stddev 41.555 2024-05-08T05:52:16.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:52:15 smithi151 ceph-mon[34815]: pgmap v507: 97 pgs: 97 active+clean; 1.0 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 8.5 MiB/s wr, 715 op/s 2024-05-08T05:52:16.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:52:15 smithi082 ceph-mon[30098]: pgmap v507: 97 pgs: 97 active+clean; 1.0 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 8.5 MiB/s wr, 715 op/s 2024-05-08T05:52:16.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:52:15 smithi134 ceph-mon[34132]: pgmap v507: 97 pgs: 97 active+clean; 1.0 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 8.5 MiB/s wr, 715 op/s 2024-05-08T05:52:16.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:16.959+0000 7f586e800700 1 -- 172.21.15.82:0/1477719992 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58680756d0 msgr2=0x7f5868075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:16.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:16.959+0000 7f586e800700 1 --2- 172.21.15.82:0/1477719992 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58680756d0 0x7f5868075ab0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f58580098f0 tx=0x7f5858009c00 comp rx=0 tx=0).stop 2024-05-08T05:52:16.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:16.959+0000 7f586e800700 1 -- 172.21.15.82:0/1477719992 shutdown_connections 2024-05-08T05:52:16.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:16.959+0000 7f586e800700 1 --2- 172.21.15.82:0/1477719992 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5868114670 0x7f5868116a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:16.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:16.959+0000 7f586e800700 1 --2- 172.21.15.82:0/1477719992 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58680756d0 0x7f5868075ab0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:16.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:16.959+0000 7f586e800700 1 --2- 172.21.15.82:0/1477719992 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5868075ff0 0x7f5868114130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:16.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:16.959+0000 7f586e800700 1 -- 172.21.15.82:0/1477719992 >> 172.21.15.82:0/1477719992 conn(0x7f586807a600 msgr2=0x7f586807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:52:16.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:16.959+0000 7f586e800700 1 -- 172.21.15.82:0/1477719992 shutdown_connections 2024-05-08T05:52:16.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:16.960+0000 7f586e800700 1 -- 172.21.15.82:0/1477719992 wait complete. 2024-05-08T05:52:16.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:16.960+0000 7f586e800700 1 Processor -- start 2024-05-08T05:52:16.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:16.961+0000 7f586e800700 1 -- start start 2024-05-08T05:52:16.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:16.962+0000 7f586e800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58680756d0 0x7f58681a0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:16.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:16.962+0000 7f586e800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5868075ff0 0x7f58681a0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:16.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:16.962+0000 7f586e800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5868114670 0x7f58681a4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:16.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:16.962+0000 7f586e800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5868119ca0 con 0x7f58680756d0 2024-05-08T05:52:16.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:16.962+0000 7f586e800700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5868119b20 con 0x7f5868114670 2024-05-08T05:52:16.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:16.962+0000 7f586e800700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5868119e20 con 0x7f5868075ff0 2024-05-08T05:52:16.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:16.962+0000 7f5866a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5868075ff0 0x7f58681a0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:16.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:16.962+0000 7f5866a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5868075ff0 0x7f58681a0790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:35640/0 (socket says 172.21.15.82:35640) 2024-05-08T05:52:16.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:16.962+0000 7f5866a00700 1 -- 172.21.15.82:0/291134345 learned_addr learned my addr 172.21.15.82:0/291134345 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:52:16.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:16.962+0000 7f5867400700 1 --2- 172.21.15.82:0/291134345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58680756d0 0x7f58681a0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:16.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:16.962+0000 7f5867e00700 1 --2- 172.21.15.82:0/291134345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5868114670 0x7f58681a4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:16.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:16.963+0000 7f5866a00700 1 -- 172.21.15.82:0/291134345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5868114670 msgr2=0x7f58681a4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:16.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:16.963+0000 7f5866a00700 1 --2- 172.21.15.82:0/291134345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5868114670 0x7f58681a4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:16.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:16.963+0000 7f5866a00700 1 -- 172.21.15.82:0/291134345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58680756d0 msgr2=0x7f58681a0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:16.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:16.963+0000 7f5866a00700 1 --2- 172.21.15.82:0/291134345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58680756d0 0x7f58681a0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:16.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:16.963+0000 7f5866a00700 1 -- 172.21.15.82:0/291134345 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58681a5260 con 0x7f5868075ff0 2024-05-08T05:52:16.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:16.964+0000 7f5866a00700 1 --2- 172.21.15.82:0/291134345 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5868075ff0 0x7f58681a0790 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f585400eb30 tx=0x7f585400ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:52:16.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:16.964+0000 7f585fe00700 1 -- 172.21.15.82:0/291134345 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f585400cc90 con 0x7f5868075ff0 2024-05-08T05:52:16.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:16.964+0000 7f585fe00700 1 -- 172.21.15.82:0/291134345 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f58540044d0 con 0x7f5868075ff0 2024-05-08T05:52:16.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:16.964+0000 7f585fe00700 1 -- 172.21.15.82:0/291134345 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5854010430 con 0x7f5868075ff0 2024-05-08T05:52:16.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:16.965+0000 7f586e800700 1 -- 172.21.15.82:0/291134345 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58681a5550 con 0x7f5868075ff0 2024-05-08T05:52:16.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:16.965+0000 7f586e800700 1 -- 172.21.15.82:0/291134345 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58681acdd0 con 0x7f5868075ff0 2024-05-08T05:52:16.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:16.966+0000 7f586e800700 1 -- 172.21.15.82:0/291134345 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f586806a190 con 0x7f5868075ff0 2024-05-08T05:52:16.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:16.970+0000 7f585fe00700 1 -- 172.21.15.82:0/291134345 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f5854003ed0 con 0x7f5868075ff0 2024-05-08T05:52:16.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:16.972+0000 7f585fe00700 1 --2- 172.21.15.82:0/291134345 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f584c0b2900 0x7f584c0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:16.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:16.972+0000 7f585fe00700 1 -- 172.21.15.82:0/291134345 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f58540e2480 con 0x7f5868075ff0 2024-05-08T05:52:16.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:16.973+0000 7f585fe00700 1 -- 172.21.15.82:0/291134345 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f58540aa1b0 con 0x7f5868075ff0 2024-05-08T05:52:16.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:16.973+0000 7f5867400700 1 --2- 172.21.15.82:0/291134345 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f584c0b2900 0x7f584c0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:16.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:16.977+0000 7f5867400700 1 --2- 172.21.15.82:0/291134345 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f584c0b2900 0x7f584c0b4dc0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5858009680 tx=0x7f5858019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:52:17.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:17.424+0000 7f586e800700 1 -- 172.21.15.82:0/291134345 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f58681a15b0 con 0x7f5868075ff0 2024-05-08T05:52:17.429 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:52:17.429 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14364,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3876883250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3876883250},{"type":"v1","addr":"172.21.15.82:6835","nonce":3876883250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1965070586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1965070586},{"type":"v1","addr":"172.21.15.82:6837","nonce":1965070586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T05:45:57.654009+0000","modified":"2024-05-08T05:50:40.164747+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24505,"mds_2":24487,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14397":{"gid":14397,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/1890720973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1890720973},{"type":"v1","addr":"172.21.15.82:6839","nonce":1890720973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14409":{"gid":14409,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/2957083305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":2957083305},{"type":"v1","addr":"172.21.15.82:6841","nonce":2957083305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6833/3827691638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3827691638},{"type":"v1","addr":"172.21.15.134:6833","nonce":3827691638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6833/3625067797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3625067797},{"type":"v1","addr":"172.21.15.151:6833","nonce":3625067797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/4074163402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4074163402},{"type":"v1","addr":"172.21.15.134:6835","nonce":4074163402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.134:6837/2212411710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2212411710},{"type":"v1","addr":"172.21.15.134:6837","nonce":2212411710}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":17,"addr":"172.21.15.151:6835/2093655929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2093655929},{"type":"v1","addr":"172.21.15.151:6835","nonce":2093655929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6837/4192404464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":4192404464},{"type":"v1","addr":"172.21.15.151:6837","nonce":4192404464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":14,"addr":"172.21.15.151:6839/2963754236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":2963754236},{"type":"v1","addr":"172.21.15.151:6839","nonce":2963754236}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.134:6839/1145270893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1145270893},{"type":"v1","addr":"172.21.15.134:6839","nonce":1145270893}]},"join_fscid":-1,"export_targets":[3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24475,24467,24487,24506,24505]},"id":1}]} 2024-05-08T05:52:17.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:17.425+0000 7f585fe00700 1 -- 172.21.15.82:0/291134345 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11949 (secure 0 0 0) 0x7f58681a15b0 con 0x7f5868075ff0 2024-05-08T05:52:17.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:17.430+0000 7f586e800700 1 -- 172.21.15.82:0/291134345 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f584c0b2900 msgr2=0x7f584c0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:17.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:17.430+0000 7f586e800700 1 --2- 172.21.15.82:0/291134345 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f584c0b2900 0x7f584c0b4dc0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5858009680 tx=0x7f5858019040 comp rx=0 tx=0).stop 2024-05-08T05:52:17.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:17.430+0000 7f586e800700 1 -- 172.21.15.82:0/291134345 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5868075ff0 msgr2=0x7f58681a0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:17.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:17.430+0000 7f586e800700 1 --2- 172.21.15.82:0/291134345 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5868075ff0 0x7f58681a0790 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f585400eb30 tx=0x7f585400ee40 comp rx=0 tx=0).stop 2024-05-08T05:52:17.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:17.430+0000 7f586e800700 1 -- 172.21.15.82:0/291134345 shutdown_connections 2024-05-08T05:52:17.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:17.430+0000 7f586e800700 1 --2- 172.21.15.82:0/291134345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5868114670 0x7f58681a4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:17.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:17.430+0000 7f586e800700 1 --2- 172.21.15.82:0/291134345 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f584c0b2900 0x7f584c0b4dc0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:17.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:17.430+0000 7f586e800700 1 --2- 172.21.15.82:0/291134345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58680756d0 0x7f58681a0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:17.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:17.430+0000 7f586e800700 1 --2- 172.21.15.82:0/291134345 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5868075ff0 0x7f58681a0790 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:17.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:17.430+0000 7f586e800700 1 -- 172.21.15.82:0/291134345 >> 172.21.15.82:0/291134345 conn(0x7f586807a600 msgr2=0x7f5868110110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:52:17.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:17.430+0000 7f586e800700 1 -- 172.21.15.82:0/291134345 shutdown_connections 2024-05-08T05:52:17.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:17.430+0000 7f586e800700 1 -- 172.21.15.82:0/291134345 wait complete. 2024-05-08T05:52:17.432 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 30 2024-05-08T05:52:18.052 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:52:17 smithi134 ceph-mon[34132]: pgmap v508: 97 pgs: 97 active+clean; 1.0 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.7 MiB/s wr, 665 op/s 2024-05-08T05:52:18.052 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:52:17 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/291134345' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:52:18.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:52:17 smithi151 ceph-mon[34815]: pgmap v508: 97 pgs: 97 active+clean; 1.0 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.7 MiB/s wr, 665 op/s 2024-05-08T05:52:18.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:52:17 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/291134345' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:52:18.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:52:17 smithi082 ceph-mon[30098]: pgmap v508: 97 pgs: 97 active+clean; 1.0 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.7 MiB/s wr, 665 op/s 2024-05-08T05:52:18.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:52:17 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/291134345' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:52:18.370 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-05-08T05:52:18.990 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:52:20.091 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:52:19 smithi082 ceph-mon[30098]: pgmap v509: 97 pgs: 97 active+clean; 1.0 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 MiB/s wr, 685 op/s 2024-05-08T05:52:20.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:52:19 smithi151 ceph-mon[34815]: pgmap v509: 97 pgs: 97 active+clean; 1.0 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 MiB/s wr, 685 op/s 2024-05-08T05:52:20.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:52:19 smithi134 ceph-mon[34132]: pgmap v509: 97 pgs: 97 active+clean; 1.0 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 MiB/s wr, 685 op/s 2024-05-08T05:52:20.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 90.0 s, 2885.5 tps, lat 34.618 ms stddev 37.801 2024-05-08T05:52:21.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.961+0000 7f27e9a00700 1 -- 172.21.15.82:0/2914847700 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27e4109510 msgr2=0x7f27e41098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:21.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.961+0000 7f27e9a00700 1 --2- 172.21.15.82:0/2914847700 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27e4109510 0x7f27e41098f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f27d4009990 tx=0x7f27d4009ca0 comp rx=0 tx=0).stop 2024-05-08T05:52:21.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.961+0000 7f27e9a00700 1 -- 172.21.15.82:0/2914847700 shutdown_connections 2024-05-08T05:52:21.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.961+0000 7f27e9a00700 1 --2- 172.21.15.82:0/2914847700 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27e4109510 0x7f27e41098f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:21.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.961+0000 7f27e9a00700 1 --2- 172.21.15.82:0/2914847700 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27e406bb40 0x7f27e4110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:21.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.961+0000 7f27e9a00700 1 --2- 172.21.15.82:0/2914847700 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27e406b180 0x7f27e406b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:21.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.961+0000 7f27e9a00700 1 -- 172.21.15.82:0/2914847700 >> 172.21.15.82:0/2914847700 conn(0x7f27e4079350 msgr2=0x7f27e4079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:52:21.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.962+0000 7f27e9a00700 1 -- 172.21.15.82:0/2914847700 shutdown_connections 2024-05-08T05:52:21.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.962+0000 7f27e9a00700 1 -- 172.21.15.82:0/2914847700 wait complete. 2024-05-08T05:52:21.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.963+0000 7f27e9a00700 1 Processor -- start 2024-05-08T05:52:21.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.964+0000 7f27e9a00700 1 -- start start 2024-05-08T05:52:21.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.965+0000 7f27e9a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27e406b180 0x7f27e41a0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:21.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.965+0000 7f27e9a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27e406bb40 0x7f27e41a0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:21.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.965+0000 7f27e9a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27e4109510 0x7f27e410f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:21.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.965+0000 7f27e2000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27e406bb40 0x7f27e41a0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:21.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.965+0000 7f27e2000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27e406bb40 0x7f27e41a0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:33728/0 (socket says 172.21.15.82:33728) 2024-05-08T05:52:21.967 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:52:21 smithi082 ceph-mon[30098]: pgmap v510: 97 pgs: 97 active+clean; 1.0 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.4 MiB/s wr, 813 op/s 2024-05-08T05:52:21.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.966+0000 7f27e2a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27e406b180 0x7f27e41a0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:21.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.966+0000 7f27e9a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f27e41136f0 con 0x7f27e4109510 2024-05-08T05:52:21.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.966+0000 7f27e9a00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f27e4113570 con 0x7f27e406bb40 2024-05-08T05:52:21.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.966+0000 7f27e9a00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f27e4113870 con 0x7f27e406b180 2024-05-08T05:52:21.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.966+0000 7f27e2a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27e406b180 0x7f27e41a0740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:35672/0 (socket says 172.21.15.82:35672) 2024-05-08T05:52:21.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.966+0000 7f27e2a00700 1 -- 172.21.15.82:0/2617169036 learned_addr learned my addr 172.21.15.82:0/2617169036 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:52:21.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.966+0000 7f27e3400700 1 --2- 172.21.15.82:0/2617169036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27e4109510 0x7f27e410f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:21.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.966+0000 7f27e2a00700 1 -- 172.21.15.82:0/2617169036 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27e406bb40 msgr2=0x7f27e41a0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:21.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.966+0000 7f27e2a00700 1 --2- 172.21.15.82:0/2617169036 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27e406bb40 0x7f27e41a0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:21.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.966+0000 7f27e2a00700 1 -- 172.21.15.82:0/2617169036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27e4109510 msgr2=0x7f27e410f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:21.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.966+0000 7f27e2a00700 1 --2- 172.21.15.82:0/2617169036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27e4109510 0x7f27e410f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:21.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.966+0000 7f27e2a00700 1 -- 172.21.15.82:0/2617169036 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27e410fd20 con 0x7f27e406b180 2024-05-08T05:52:21.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.967+0000 7f27e2a00700 1 --2- 172.21.15.82:0/2617169036 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27e406b180 0x7f27e41a0740 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f27d4006010 tx=0x7f27d40047b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:52:21.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.967+0000 7f27db400700 1 -- 172.21.15.82:0/2617169036 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d4004830 con 0x7f27e406b180 2024-05-08T05:52:21.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.967+0000 7f27db400700 1 -- 172.21.15.82:0/2617169036 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27d4005020 con 0x7f27e406b180 2024-05-08T05:52:21.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.968+0000 7f27e9a00700 1 -- 172.21.15.82:0/2617169036 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27e410ffb0 con 0x7f27e406b180 2024-05-08T05:52:21.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.968+0000 7f27db400700 1 -- 172.21.15.82:0/2617169036 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d4003df0 con 0x7f27e406b180 2024-05-08T05:52:21.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.968+0000 7f27e9a00700 1 -- 172.21.15.82:0/2617169036 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27e419c280 con 0x7f27e406b180 2024-05-08T05:52:21.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.971+0000 7f27db400700 1 -- 172.21.15.82:0/2617169036 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f27d4005510 con 0x7f27e406b180 2024-05-08T05:52:21.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.976+0000 7f27db400700 1 --2- 172.21.15.82:0/2617169036 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f27c80b2900 0x7f27c80b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:21.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.976+0000 7f27e2000700 1 --2- 172.21.15.82:0/2617169036 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f27c80b2900 0x7f27c80b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:21.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.977+0000 7f27db400700 1 -- 172.21.15.82:0/2617169036 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f27d40e3040 con 0x7f27e406b180 2024-05-08T05:52:21.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.978+0000 7f27e2000700 1 --2- 172.21.15.82:0/2617169036 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f27c80b2900 0x7f27c80b4dc0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f27e4079800 tx=0x7f27d0009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:52:21.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.979+0000 7f27f4314b80 1 Processor -- start 2024-05-08T05:52:21.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.979+0000 7f27f4314b80 1 -- start start 2024-05-08T05:52:21.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.980+0000 7f27f4314b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c383f2b060 0x55c383f2b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:21.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.980+0000 7f27f4314b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c383f2b980 0x55c383f2f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:21.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.980+0000 7f27f4314b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c383f2f9d0 0x55c383f2fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:21.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.980+0000 7f27f4314b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c383e7da20 con 0x55c383f2f9d0 2024-05-08T05:52:21.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.980+0000 7f27f4314b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55c383e1b760 con 0x55c383f2b060 2024-05-08T05:52:21.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.980+0000 7f27f4314b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55c383e799e0 con 0x55c383f2b980 2024-05-08T05:52:21.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.980+0000 7f27e2a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c383f2b060 0x55c383f2b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:21.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.980+0000 7f27e2a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c383f2b060 0x55c383f2b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:33734/0 (socket says 172.21.15.82:33734) 2024-05-08T05:52:21.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.980+0000 7f27e2a00700 1 -- 172.21.15.82:0/3962545254 learned_addr learned my addr 172.21.15.82:0/3962545254 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:52:21.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.981+0000 7f27e2a00700 1 -- 172.21.15.82:0/3962545254 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c383f2b980 msgr2=0x55c383f2f490 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T05:52:21.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.981+0000 7f27e2a00700 1 --2- 172.21.15.82:0/3962545254 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c383f2b980 0x55c383f2f490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:21.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.981+0000 7f27e2a00700 1 -- 172.21.15.82:0/3962545254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c383f2f9d0 msgr2=0x55c383f2fe30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T05:52:21.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.982+0000 7f27e3400700 1 --2- 172.21.15.82:0/3962545254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c383f2f9d0 0x55c383f2fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:21.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.982+0000 7f27e2a00700 1 --2- 172.21.15.82:0/3962545254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c383f2f9d0 0x55c383f2fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:21.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.982+0000 7f27e2a00700 1 -- 172.21.15.82:0/3962545254 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c383dca8d0 con 0x55c383f2b060 2024-05-08T05:52:21.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.983+0000 7f27e3400700 1 --2- 172.21.15.82:0/3962545254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c383f2f9d0 0x55c383f2fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:52:21.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.983+0000 7f27e2a00700 1 --2- 172.21.15.82:0/3962545254 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c383f2b060 0x55c383f2b440 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f27d40a6780 tx=0x7f27d4005480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1db905c245981cf server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:52:21.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.983+0000 7f27cfe00700 1 -- 172.21.15.82:0/3962545254 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d40aa700 con 0x55c383f2b060 2024-05-08T05:52:21.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.983+0000 7f27cfe00700 1 -- 172.21.15.82:0/3962545254 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27d40aeab0 con 0x55c383f2b060 2024-05-08T05:52:21.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.983+0000 7f27cfe00700 1 -- 172.21.15.82:0/3962545254 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d40b3040 con 0x55c383f2b060 2024-05-08T05:52:21.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.984+0000 7f27f4314b80 1 -- 172.21.15.82:0/3962545254 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c383f2b060 msgr2=0x55c383f2b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:21.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.984+0000 7f27f4314b80 1 --2- 172.21.15.82:0/3962545254 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c383f2b060 0x55c383f2b440 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f27d40a6780 tx=0x7f27d4005480 comp rx=0 tx=0).stop 2024-05-08T05:52:21.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.984+0000 7f27f4314b80 1 -- 172.21.15.82:0/3962545254 shutdown_connections 2024-05-08T05:52:21.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.984+0000 7f27f4314b80 1 --2- 172.21.15.82:0/3962545254 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c383f2b060 0x55c383f2b440 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:21.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.984+0000 7f27f4314b80 1 --2- 172.21.15.82:0/3962545254 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c383f2f9d0 0x55c383f2fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:21.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.984+0000 7f27f4314b80 1 --2- 172.21.15.82:0/3962545254 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c383f2b980 0x55c383f2f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:21.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.985+0000 7f27f4314b80 1 -- 172.21.15.82:0/3962545254 >> 172.21.15.82:0/3962545254 conn(0x55c383e59b60 msgr2=0x55c383f257a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:52:21.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.985+0000 7f27f4314b80 1 -- 172.21.15.82:0/3962545254 shutdown_connections 2024-05-08T05:52:21.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.985+0000 7f27f4314b80 1 -- 172.21.15.82:0/3962545254 wait complete. 2024-05-08T05:52:21.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.985+0000 7f27f4314b80 1 -- start start 2024-05-08T05:52:21.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.986+0000 7f27f4314b80 1 Processor -- start 2024-05-08T05:52:21.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.987+0000 7f27f4314b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c383f2b060 0x55c383f36f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:21.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.987+0000 7f27f4314b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c383f2b980 0x55c383f342e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:21.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.987+0000 7f27f4314b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c383f2f9d0 0x55c383f34820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:21.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.988+0000 7f27e2a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c383f2b060 0x55c383f36f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:21.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.988+0000 7f27e2a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c383f2b060 0x55c383f36f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:35692/0 (socket says 172.21.15.82:35692) 2024-05-08T05:52:21.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.988+0000 7f27e2000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c383f2b980 0x55c383f342e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:21.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.988+0000 7f27e2000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c383f2b980 0x55c383f342e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43474/0 (socket says 172.21.15.82:43474) 2024-05-08T05:52:21.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.989+0000 7f27e2a00700 1 -- 172.21.15.82:0/2874725753 learned_addr learned my addr 172.21.15.82:0/2874725753 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:52:21.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.989+0000 7f27e3400700 1 --2- 172.21.15.82:0/2874725753 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c383f2f9d0 0x55c383f34820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:21.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.989+0000 7f27f4314b80 1 -- 172.21.15.82:0/2874725753 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c383f379a0 con 0x55c383f2b980 2024-05-08T05:52:21.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.989+0000 7f27f4314b80 1 -- 172.21.15.82:0/2874725753 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55c383de3b20 con 0x55c383f2f9d0 2024-05-08T05:52:21.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.989+0000 7f27f4314b80 1 -- 172.21.15.82:0/2874725753 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55c383f37b20 con 0x55c383f2b060 2024-05-08T05:52:21.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.989+0000 7f27f4314b80 10 client.0 _ll_register_callbacks cb 0x55c383e24c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:52:21.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.990+0000 7f27e3400700 1 -- 172.21.15.82:0/2874725753 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c383f2b060 msgr2=0x55c383f36f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:21.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.990+0000 7f27e3400700 1 --2- 172.21.15.82:0/2874725753 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c383f2b060 0x55c383f36f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:21.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.990+0000 7f27e3400700 1 -- 172.21.15.82:0/2874725753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c383f2b980 msgr2=0x55c383f342e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:21.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.990+0000 7f27e3400700 1 --2- 172.21.15.82:0/2874725753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c383f2b980 0x55c383f342e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:21.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.990+0000 7f27e3400700 1 -- 172.21.15.82:0/2874725753 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c383e43420 con 0x55c383f2f9d0 2024-05-08T05:52:21.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.991+0000 7f27e3400700 1 --2- 172.21.15.82:0/2874725753 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c383f2f9d0 0x55c383f34820 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f27dc00f810 tx=0x7f27dc00fb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea2da91e0ec0ff04 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:52:21.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.991+0000 7f27ccc00700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:52:21.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.991+0000 7f27ccc00700 1 -- 172.21.15.82:0/2874725753 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27dc010040 con 0x55c383f2f9d0 2024-05-08T05:52:21.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.991+0000 7f27ccc00700 1 -- 172.21.15.82:0/2874725753 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f27dc003c00 con 0x55c383f2f9d0 2024-05-08T05:52:21.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.991+0000 7f27f4314b80 1 -- 172.21.15.82:0/2874725753 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27d40aeab0 con 0x55c383f2f9d0 2024-05-08T05:52:21.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.992+0000 7f27ccc00700 1 -- 172.21.15.82:0/2874725753 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f27dc003e00 con 0x55c383f2f9d0 2024-05-08T05:52:21.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.992+0000 7f27f4314b80 10 client.25364 fetch_fsmap learned FSMap version 30 2024-05-08T05:52:21.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.992+0000 7f27f4314b80 1 -- 172.21.15.82:0/2874725753 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c383f42250 con 0x55c383f2f9d0 2024-05-08T05:52:21.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.992+0000 7f27ccc00700 1 -- 172.21.15.82:0/2874725753 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27d40aeab0 con 0x55c383f2f9d0 2024-05-08T05:52:21.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.993+0000 7f27ccc00700 1 -- 172.21.15.82:0/2874725753 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f27dc013050 con 0x55c383f2f9d0 2024-05-08T05:52:21.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.993+0000 7f27f4314b80 10 client.25364 fetch_fsmap finished waiting for FSMap version 30 2024-05-08T05:52:21.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.993+0000 7f27f4314b80 10 client.25364 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-05-08T05:52:21.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.993+0000 7f27f4314b80 20 client.25364 populate_metadata read hostname 'smithi082' 2024-05-08T05:52:21.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.993+0000 7f27f4314b80 1 --2- 172.21.15.82:0/2874725753 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x55c383f44890 0x55c383f46c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:21.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.993+0000 7f27f4314b80 4 client.25364 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:52:21.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.993+0000 7f27f4314b80 1 -- 172.21.15.82:0/2874725753 --> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c383ef80a0 con 0x55c383f44890 2024-05-08T05:52:21.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.993+0000 7f27e2a00700 1 --2- 172.21.15.82:0/2874725753 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x55c383f44890 0x55c383f46c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:21.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.994+0000 7f27ccc00700 10 client.25364 ms_handle_connect on v2:172.21.15.134:6836/2212411710 2024-05-08T05:52:21.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.994+0000 7f27e2a00700 1 --2- 172.21.15.82:0/2874725753 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x55c383f44890 0x55c383f46c80 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b22b3d81a0fbcfe1 server_cookie=8ee6fe5682ee26a1 in_seq=0 out_seq=0 2024-05-08T05:52:21.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.996+0000 7f27ccc00700 1 -- 172.21.15.82:0/2874725753 <== mds.4 v2:172.21.15.134:6836/2212411710 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55c383ef80a0 con 0x55c383f44890 2024-05-08T05:52:21.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.996+0000 7f27ccc00700 10 client.25364 handle_command_reply: tid=0 2024-05-08T05:52:21.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.996+0000 7f27f4314b80 1 client.25364 shutdown 2024-05-08T05:52:21.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.996+0000 7f27f4314b80 1 -- 172.21.15.82:0/2874725753 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c383f2f9d0 msgr2=0x55c383f34820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:21.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.996+0000 7f27f4314b80 1 --2- 172.21.15.82:0/2874725753 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c383f2f9d0 0x55c383f34820 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f27dc00f810 tx=0x7f27dc00fb20 comp rx=0 tx=0).stop 2024-05-08T05:52:21.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.997+0000 7f27f4314b80 1 -- 172.21.15.82:0/2874725753 shutdown_connections 2024-05-08T05:52:21.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.997+0000 7f27f4314b80 1 --2- 172.21.15.82:0/2874725753 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x55c383f44890 0x55c383f46c80 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:21.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.997+0000 7f27f4314b80 1 --2- 172.21.15.82:0/2874725753 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c383f2f9d0 0x55c383f34820 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:21.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.997+0000 7f27f4314b80 1 --2- 172.21.15.82:0/2874725753 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c383f2b060 0x55c383f36f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:21.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.997+0000 7f27f4314b80 1 --2- 172.21.15.82:0/2874725753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c383f2b980 0x55c383f342e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:21.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.997+0000 7f27ccc00700 0 client.25364 ms_handle_reset on v2:172.21.15.134:6836/2212411710 2024-05-08T05:52:21.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.997+0000 7f27f4314b80 1 -- 172.21.15.82:0/2874725753 >> 172.21.15.82:0/2874725753 conn(0x55c383e59b60 msgr2=0x55c383f202b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:52:21.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.998+0000 7f27f4314b80 1 -- 172.21.15.82:0/2874725753 shutdown_connections 2024-05-08T05:52:21.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.998+0000 7f27f4314b80 1 -- 172.21.15.82:0/2874725753 wait complete. 2024-05-08T05:52:21.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:21.998+0000 7f27f4314b80 20 client.25364 trim_cache size 0 max 16384 2024-05-08T05:52:22.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.021+0000 7f27f4314b80 1 Processor -- start 2024-05-08T05:52:22.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.021+0000 7f27f4314b80 1 -- start start 2024-05-08T05:52:22.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.022+0000 7f27f4314b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c383f2b060 0x55c383f31f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:22.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.022+0000 7f27f4314b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c383f2b980 0x55c383f409f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:22.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.022+0000 7f27f4314b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c383f2f9d0 0x55c383f33460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:22.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.022+0000 7f27f4314b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f27e41bc880 con 0x55c383f2b980 2024-05-08T05:52:22.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.022+0000 7f27f4314b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f27e41be3f0 con 0x55c383f2b060 2024-05-08T05:52:22.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.022+0000 7f27f4314b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f27e41bcf50 con 0x55c383f2f9d0 2024-05-08T05:52:22.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.022+0000 7f27e2a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c383f2b060 0x55c383f31f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:22.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.022+0000 7f27e2a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c383f2b060 0x55c383f31f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:33752/0 (socket says 172.21.15.82:33752) 2024-05-08T05:52:22.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.022+0000 7f27e2a00700 1 -- 172.21.15.82:0/2618109285 learned_addr learned my addr 172.21.15.82:0/2618109285 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:52:22.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.023+0000 7f27e3400700 1 --2- 172.21.15.82:0/2618109285 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c383f2f9d0 0x55c383f33460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:22.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.023+0000 7f27e2000700 1 --2- 172.21.15.82:0/2618109285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c383f2b980 0x55c383f409f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:22.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.023+0000 7f27e3400700 1 -- 172.21.15.82:0/2618109285 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c383f2b060 msgr2=0x55c383f31f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:22.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.023+0000 7f27e3400700 1 --2- 172.21.15.82:0/2618109285 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c383f2b060 0x55c383f31f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:22.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.023+0000 7f27e3400700 1 -- 172.21.15.82:0/2618109285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c383f2b980 msgr2=0x55c383f409f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:22.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.024+0000 7f27e3400700 1 --2- 172.21.15.82:0/2618109285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c383f2b980 0x55c383f409f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:22.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.024+0000 7f27e3400700 1 -- 172.21.15.82:0/2618109285 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c383f472e0 con 0x55c383f2f9d0 2024-05-08T05:52:22.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.024+0000 7f27e2000700 1 --2- 172.21.15.82:0/2618109285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c383f2b980 0x55c383f409f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:52:22.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.024+0000 7f27e3400700 1 --2- 172.21.15.82:0/2618109285 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c383f2f9d0 0x55c383f33460 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f27dc002230 tx=0x7f27dc007830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1cfe61ea8dcd37c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:52:22.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.025+0000 7f27cf400700 1 -- 172.21.15.82:0/2618109285 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27dc02c070 con 0x55c383f2f9d0 2024-05-08T05:52:22.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.025+0000 7f27cf400700 1 -- 172.21.15.82:0/2618109285 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27dc01d440 con 0x55c383f2f9d0 2024-05-08T05:52:22.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.025+0000 7f27cf400700 1 -- 172.21.15.82:0/2618109285 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27dc0057e0 con 0x55c383f2f9d0 2024-05-08T05:52:22.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.026+0000 7f27f4314b80 1 -- 172.21.15.82:0/2618109285 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c383f2f9d0 msgr2=0x55c383f33460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:22.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.026+0000 7f27f4314b80 1 --2- 172.21.15.82:0/2618109285 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c383f2f9d0 0x55c383f33460 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f27dc002230 tx=0x7f27dc007830 comp rx=0 tx=0).stop 2024-05-08T05:52:22.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.027+0000 7f27f4314b80 1 -- 172.21.15.82:0/2618109285 shutdown_connections 2024-05-08T05:52:22.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.027+0000 7f27f4314b80 1 --2- 172.21.15.82:0/2618109285 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c383f2b060 0x55c383f31f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:22.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.027+0000 7f27f4314b80 1 --2- 172.21.15.82:0/2618109285 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c383f2f9d0 0x55c383f33460 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:22.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.027+0000 7f27f4314b80 1 --2- 172.21.15.82:0/2618109285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c383f2b980 0x55c383f409f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:22.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.027+0000 7f27f4314b80 1 -- 172.21.15.82:0/2618109285 >> 172.21.15.82:0/2618109285 conn(0x55c383e59b60 msgr2=0x55c383f1fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:52:22.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.027+0000 7f27f4314b80 1 -- 172.21.15.82:0/2618109285 shutdown_connections 2024-05-08T05:52:22.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.027+0000 7f27f4314b80 1 -- 172.21.15.82:0/2618109285 wait complete. 2024-05-08T05:52:22.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.028+0000 7f27f4314b80 1 -- start start 2024-05-08T05:52:22.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.028+0000 7f27f4314b80 1 Processor -- start 2024-05-08T05:52:22.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.031+0000 7f27f4314b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c383f2b060 0x55c383f3d290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:22.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.031+0000 7f27f4314b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c383f2b980 0x55c383f4bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:22.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.031+0000 7f27f4314b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c383f2f9d0 0x55c383f4c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:22.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.031+0000 7f27f4314b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f27e41bdcf0 con 0x55c383f2f9d0 2024-05-08T05:52:22.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.032+0000 7f27f4314b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f27e41bd620 con 0x55c383f2b060 2024-05-08T05:52:22.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.032+0000 7f27f4314b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f27e41ba820 con 0x55c383f2b980 2024-05-08T05:52:22.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.032+0000 7f27f4314b80 10 client.0 _ll_register_callbacks cb 0x55c383e24c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:52:22.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.032+0000 7f27e2a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c383f2b060 0x55c383f3d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:22.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.032+0000 7f27e2000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c383f2b980 0x55c383f4bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:22.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.032+0000 7f27e2a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c383f2b060 0x55c383f3d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:33758/0 (socket says 172.21.15.82:33758) 2024-05-08T05:52:22.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.032+0000 7f27e2a00700 1 -- 172.21.15.82:0/1122220262 learned_addr learned my addr 172.21.15.82:0/1122220262 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:52:22.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.032+0000 7f27e2a00700 1 -- 172.21.15.82:0/1122220262 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c383f2b980 msgr2=0x55c383f4bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:22.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.032+0000 7f27e2a00700 1 --2- 172.21.15.82:0/1122220262 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c383f2b980 0x55c383f4bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:22.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.032+0000 7f27e2a00700 1 -- 172.21.15.82:0/1122220262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c383f2f9d0 msgr2=0x55c383f4c020 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T05:52:22.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.032+0000 7f27e2a00700 1 --2- 172.21.15.82:0/1122220262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c383f2f9d0 0x55c383f4c020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:22.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.032+0000 7f27e2a00700 1 -- 172.21.15.82:0/1122220262 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c383f2e2c0 con 0x55c383f2b060 2024-05-08T05:52:22.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.033+0000 7f27e2a00700 1 --2- 172.21.15.82:0/1122220262 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c383f2b060 0x55c383f3d290 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f27d40036b0 tx=0x7f27d4000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9180cca277f4af44 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:52:22.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.033+0000 7f27ccc00700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:52:22.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.033+0000 7f27ccc00700 1 -- 172.21.15.82:0/1122220262 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27d40aeab0 con 0x55c383f2b060 2024-05-08T05:52:22.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.033+0000 7f27ccc00700 1 -- 172.21.15.82:0/1122220262 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f27d40920b0 con 0x55c383f2b060 2024-05-08T05:52:22.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.033+0000 7f27e2000700 1 --2- 172.21.15.82:0/1122220262 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c383f2b980 0x55c383f4bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:52:22.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.033+0000 7f27f4314b80 1 -- 172.21.15.82:0/1122220262 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f27dc01d440 con 0x55c383f2b060 2024-05-08T05:52:22.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.034+0000 7f27ccc00700 1 -- 172.21.15.82:0/1122220262 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f27d40922b0 con 0x55c383f2b060 2024-05-08T05:52:22.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.034+0000 7f27f4314b80 10 client.25370 fetch_fsmap learned FSMap version 30 2024-05-08T05:52:22.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.034+0000 7f27f4314b80 1 -- 172.21.15.82:0/1122220262 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55c383f223f0 con 0x55c383f2b060 2024-05-08T05:52:22.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.034+0000 7f27ccc00700 1 -- 172.21.15.82:0/1122220262 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f27dc01d440 con 0x55c383f2b060 2024-05-08T05:52:22.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.034+0000 7f27ccc00700 1 -- 172.21.15.82:0/1122220262 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f27d40049d0 con 0x55c383f2b060 2024-05-08T05:52:22.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.034+0000 7f27f4314b80 10 client.25370 fetch_fsmap finished waiting for FSMap version 30 2024-05-08T05:52:22.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.034+0000 7f27f4314b80 10 client.25370 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-05-08T05:52:22.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.034+0000 7f27f4314b80 20 client.25370 populate_metadata read hostname 'smithi082' 2024-05-08T05:52:22.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.034+0000 7f27f4314b80 1 --2- 172.21.15.82:0/1122220262 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x55c383faf050 0x55c383fb14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:22.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.034+0000 7f27f4314b80 4 client.25370 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:52:22.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.034+0000 7f27f4314b80 1 -- 172.21.15.82:0/1122220262 --> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c383e8b400 con 0x55c383faf050 2024-05-08T05:52:22.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.035+0000 7f27e2000700 1 --2- 172.21.15.82:0/1122220262 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x55c383faf050 0x55c383fb14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:22.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.036+0000 7f27e2000700 1 --2- 172.21.15.82:0/1122220262 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x55c383faf050 0x55c383fb14d0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f5e4a25b132f4daa server_cookie=d302603fb5f3fb6f in_seq=0 out_seq=0 2024-05-08T05:52:22.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.036+0000 7f27ccc00700 10 client.25370 ms_handle_connect on v2:172.21.15.134:6836/2212411710 2024-05-08T05:52:22.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.036+0000 7f27ccc00700 1 -- 172.21.15.82:0/1122220262 <== mds.4 v2:172.21.15.134:6836/2212411710 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c383e8b400 con 0x55c383faf050 2024-05-08T05:52:22.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.036+0000 7f27ccc00700 10 client.25370 handle_command_reply: tid=0 2024-05-08T05:52:22.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.036+0000 7f27f4314b80 1 client.25370 shutdown 2024-05-08T05:52:22.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.036+0000 7f27f4314b80 1 -- 172.21.15.82:0/1122220262 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c383f2b060 msgr2=0x55c383f3d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:22.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.036+0000 7f27f4314b80 1 --2- 172.21.15.82:0/1122220262 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c383f2b060 0x55c383f3d290 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f27d40036b0 tx=0x7f27d4000bc0 comp rx=0 tx=0).stop 2024-05-08T05:52:22.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.037+0000 7f27f4314b80 1 -- 172.21.15.82:0/1122220262 shutdown_connections 2024-05-08T05:52:22.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.037+0000 7f27f4314b80 1 --2- 172.21.15.82:0/1122220262 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x55c383faf050 0x55c383fb14d0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:22.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.037+0000 7f27f4314b80 1 --2- 172.21.15.82:0/1122220262 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c383f2b060 0x55c383f3d290 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:22.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.037+0000 7f27f4314b80 1 --2- 172.21.15.82:0/1122220262 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c383f2f9d0 0x55c383f4c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:22.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.037+0000 7f27f4314b80 1 --2- 172.21.15.82:0/1122220262 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c383f2b980 0x55c383f4bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:22.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.037+0000 7f27f4314b80 1 -- 172.21.15.82:0/1122220262 >> 172.21.15.82:0/1122220262 conn(0x55c383e59b60 msgr2=0x55c383f202b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:52:22.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.037+0000 7f27ccc00700 0 client.25370 ms_handle_reset on v2:172.21.15.134:6836/2212411710 2024-05-08T05:52:22.039 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T05:52:22.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.037+0000 7f27f4314b80 1 -- 172.21.15.82:0/1122220262 shutdown_connections 2024-05-08T05:52:22.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.037+0000 7f27f4314b80 1 -- 172.21.15.82:0/1122220262 wait complete. 2024-05-08T05:52:22.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.037+0000 7f27f4314b80 20 client.25370 trim_cache size 0 max 16384 2024-05-08T05:52:22.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.039+0000 7f27e9a00700 1 -- 172.21.15.82:0/2617169036 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f27c80b2900 msgr2=0x7f27c80b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:22.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.039+0000 7f27e9a00700 1 --2- 172.21.15.82:0/2617169036 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f27c80b2900 0x7f27c80b4dc0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f27e4079800 tx=0x7f27d0009190 comp rx=0 tx=0).stop 2024-05-08T05:52:22.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.039+0000 7f27e9a00700 1 -- 172.21.15.82:0/2617169036 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27e406b180 msgr2=0x7f27e41a0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:22.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.039+0000 7f27e9a00700 1 --2- 172.21.15.82:0/2617169036 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27e406b180 0x7f27e41a0740 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f27d4006010 tx=0x7f27d40047b0 comp rx=0 tx=0).stop 2024-05-08T05:52:22.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.039+0000 7f27e9a00700 1 -- 172.21.15.82:0/2617169036 shutdown_connections 2024-05-08T05:52:22.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.039+0000 7f27e9a00700 1 --2- 172.21.15.82:0/2617169036 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f27c80b2900 0x7f27c80b4dc0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:22.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.039+0000 7f27e9a00700 1 --2- 172.21.15.82:0/2617169036 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f27e4109510 0x7f27e410f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:22.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.039+0000 7f27e9a00700 1 --2- 172.21.15.82:0/2617169036 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27e406b180 0x7f27e41a0740 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:22.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.039+0000 7f27e9a00700 1 --2- 172.21.15.82:0/2617169036 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27e406bb40 0x7f27e41a0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:22.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.039+0000 7f27e9a00700 1 -- 172.21.15.82:0/2617169036 >> 172.21.15.82:0/2617169036 conn(0x7f27e4079350 msgr2=0x7f27e4100df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:52:22.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.040+0000 7f27e9a00700 1 -- 172.21.15.82:0/2617169036 shutdown_connections 2024-05-08T05:52:22.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:22.040+0000 7f27e9a00700 1 -- 172.21.15.82:0/2617169036 wait complete. 2024-05-08T05:52:22.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:52:21 smithi151 ceph-mon[34815]: pgmap v510: 97 pgs: 97 active+clean; 1.0 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.4 MiB/s wr, 813 op/s 2024-05-08T05:52:22.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:52:21 smithi134 ceph-mon[34132]: pgmap v510: 97 pgs: 97 active+clean; 1.0 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.4 MiB/s wr, 813 op/s 2024-05-08T05:52:22.924 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-05-08T05:52:23.557 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:52:24.011 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:52:23 smithi082 ceph-mon[30098]: pgmap v511: 97 pgs: 97 active+clean; 1.0 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.2 MiB/s wr, 692 op/s 2024-05-08T05:52:24.011 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:52:23 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:52:24.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:52:23 smithi151 ceph-mon[34815]: pgmap v511: 97 pgs: 97 active+clean; 1.0 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.2 MiB/s wr, 692 op/s 2024-05-08T05:52:24.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:52:23 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:52:24.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:52:23 smithi134 ceph-mon[34132]: pgmap v511: 97 pgs: 97 active+clean; 1.0 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.2 MiB/s wr, 692 op/s 2024-05-08T05:52:24.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:52:23 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:52:25.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 95.0 s, 2998.4 tps, lat 33.316 ms stddev 38.755 2024-05-08T05:52:25.982 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:52:25 smithi082 ceph-mon[30098]: pgmap v512: 97 pgs: 97 active+clean; 1.0 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.1 MiB/s wr, 763 op/s 2024-05-08T05:52:25.982 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:52:25 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:52:25.982 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:52:25 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:52:25.983 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:52:25 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:52:26.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:52:25 smithi151 ceph-mon[34815]: pgmap v512: 97 pgs: 97 active+clean; 1.0 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.1 MiB/s wr, 763 op/s 2024-05-08T05:52:26.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:52:25 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:52:26.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:52:25 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:52:26.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:52:25 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:52:26.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:52:25 smithi134 ceph-mon[34132]: pgmap v512: 97 pgs: 97 active+clean; 1.0 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.1 MiB/s wr, 763 op/s 2024-05-08T05:52:26.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:52:25 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:52:26.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:52:25 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:52:26.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:52:25 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:52:26.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.305+0000 7f93b4e00700 1 -- 172.21.15.82:0/299883266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93b006b1b0 msgr2=0x7f93b006b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:26.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.305+0000 7f93b4e00700 1 --2- 172.21.15.82:0/299883266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93b006b1b0 0x7f93b006b590 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f93a0009990 tx=0x7f93a0009ca0 comp rx=0 tx=0).stop 2024-05-08T05:52:26.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.305+0000 7f93b4e00700 1 -- 172.21.15.82:0/299883266 shutdown_connections 2024-05-08T05:52:26.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.305+0000 7f93b4e00700 1 --2- 172.21.15.82:0/299883266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93b006b1b0 0x7f93b006b590 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:26.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.305+0000 7f93b4e00700 1 --2- 172.21.15.82:0/299883266 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93b010ff50 0x7f93b0112340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:26.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.305+0000 7f93b4e00700 1 --2- 172.21.15.82:0/299883266 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93b006bad0 0x7f93b010fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:26.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.305+0000 7f93b4e00700 1 -- 172.21.15.82:0/299883266 >> 172.21.15.82:0/299883266 conn(0x7f93b0079350 msgr2=0x7f93b0079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:52:26.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.307+0000 7f93b4e00700 1 -- 172.21.15.82:0/299883266 shutdown_connections 2024-05-08T05:52:26.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.307+0000 7f93b4e00700 1 -- 172.21.15.82:0/299883266 wait complete. 2024-05-08T05:52:26.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.308+0000 7f93b4e00700 1 Processor -- start 2024-05-08T05:52:26.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.308+0000 7f93b4e00700 1 -- start start 2024-05-08T05:52:26.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.309+0000 7f93b4e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93b006b1b0 0x7f93b0104680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:26.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.309+0000 7f93b4e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93b006bad0 0x7f93b0104bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:26.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.309+0000 7f93b4e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93b010ff50 0x7f93b0105100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:26.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.309+0000 7f93b4e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f93b01158c0 con 0x7f93b006bad0 2024-05-08T05:52:26.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.309+0000 7f93b4e00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f93b0115740 con 0x7f93b010ff50 2024-05-08T05:52:26.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.309+0000 7f93b4e00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f93b0115a40 con 0x7f93b006b1b0 2024-05-08T05:52:26.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.309+0000 7f93ae800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93b010ff50 0x7f93b0105100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:26.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.309+0000 7f93ae800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93b010ff50 0x7f93b0105100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:51786/0 (socket says 172.21.15.82:51786) 2024-05-08T05:52:26.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.309+0000 7f93ae800700 1 -- 172.21.15.82:0/581486242 learned_addr learned my addr 172.21.15.82:0/581486242 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:52:26.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.310+0000 7f93ade00700 1 --2- 172.21.15.82:0/581486242 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93b006b1b0 0x7f93b0104680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:26.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.310+0000 7f93ad400700 1 --2- 172.21.15.82:0/581486242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93b006bad0 0x7f93b0104bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:26.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.311+0000 7f93ae800700 1 -- 172.21.15.82:0/581486242 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93b006b1b0 msgr2=0x7f93b0104680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:26.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.311+0000 7f93ae800700 1 --2- 172.21.15.82:0/581486242 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93b006b1b0 0x7f93b0104680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:26.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.311+0000 7f93ae800700 1 -- 172.21.15.82:0/581486242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93b006bad0 msgr2=0x7f93b0104bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:26.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.311+0000 7f93ae800700 1 --2- 172.21.15.82:0/581486242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93b006bad0 0x7f93b0104bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:26.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.311+0000 7f93ae800700 1 -- 172.21.15.82:0/581486242 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93b0073f50 con 0x7f93b010ff50 2024-05-08T05:52:26.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.311+0000 7f93ade00700 1 --2- 172.21.15.82:0/581486242 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93b006b1b0 0x7f93b0104680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:52:26.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.311+0000 7f93ae800700 1 --2- 172.21.15.82:0/581486242 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93b010ff50 0x7f93b0105100 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f93a800c110 tx=0x7f93a800c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:52:26.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.311+0000 7f93a6a00700 1 -- 172.21.15.82:0/581486242 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a80093a0 con 0x7f93b010ff50 2024-05-08T05:52:26.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.312+0000 7f93a6a00700 1 -- 172.21.15.82:0/581486242 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93a800cb80 con 0x7f93b010ff50 2024-05-08T05:52:26.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.312+0000 7f93a6a00700 1 -- 172.21.15.82:0/581486242 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a80047a0 con 0x7f93b010ff50 2024-05-08T05:52:26.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.312+0000 7f93b4e00700 1 -- 172.21.15.82:0/581486242 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93b00741e0 con 0x7f93b010ff50 2024-05-08T05:52:26.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.312+0000 7f93b4e00700 1 -- 172.21.15.82:0/581486242 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93b00746d0 con 0x7f93b010ff50 2024-05-08T05:52:26.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.322+0000 7f93bf834b80 1 Processor -- start 2024-05-08T05:52:26.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.332+0000 7f93bf834b80 1 -- start start 2024-05-08T05:52:26.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.332+0000 7f93bf834b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d0c4852060 0x55d0c4852440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:26.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.332+0000 7f93bf834b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0c4852980 0x55d0c4856490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:26.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.332+0000 7f93bf834b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0c48569d0 0x55d0c4856e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:26.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.332+0000 7f93bf834b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d0c47a4a20 con 0x55d0c48569d0 2024-05-08T05:52:26.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.332+0000 7f93bf834b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d0c4742760 con 0x55d0c4852980 2024-05-08T05:52:26.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.332+0000 7f93bf834b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55d0c47a09e0 con 0x55d0c4852060 2024-05-08T05:52:26.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.332+0000 7f93a6a00700 1 -- 172.21.15.82:0/581486242 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f93a801a020 con 0x7f93b010ff50 2024-05-08T05:52:26.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.333+0000 7f93ade00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0c4852980 0x55d0c4856490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:26.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.333+0000 7f93ade00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0c4852980 0x55d0c4856490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:51788/0 (socket says 172.21.15.82:51788) 2024-05-08T05:52:26.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.333+0000 7f93ade00700 1 -- 172.21.15.82:0/2937578917 learned_addr learned my addr 172.21.15.82:0/2937578917 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:52:26.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.333+0000 7f93ad400700 1 --2- 172.21.15.82:0/2937578917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d0c4852060 0x55d0c4852440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:26.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.333+0000 7f93ad400700 1 --2- 172.21.15.82:0/2937578917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0c48569d0 0x55d0c4856e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:26.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.334+0000 7f93ade00700 1 -- 172.21.15.82:0/2937578917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d0c4852060 msgr2=0x55d0c4852440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:26.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.334+0000 7f93ade00700 1 --2- 172.21.15.82:0/2937578917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d0c4852060 0x55d0c4852440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:26.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.334+0000 7f93ade00700 1 -- 172.21.15.82:0/2937578917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0c48569d0 msgr2=0x55d0c4856e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:26.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.334+0000 7f93ade00700 1 --2- 172.21.15.82:0/2937578917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0c48569d0 0x55d0c4856e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:26.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.334+0000 7f93ade00700 1 -- 172.21.15.82:0/2937578917 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0c46f18d0 con 0x55d0c4852980 2024-05-08T05:52:26.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.334+0000 7f93ad400700 1 --2- 172.21.15.82:0/2937578917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0c48569d0 0x55d0c4856e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:52:26.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.334+0000 7f93ade00700 1 --2- 172.21.15.82:0/2937578917 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0c4852980 0x55d0c4856490 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f93a0005f40 tx=0x7f93a0005c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=212a3618afe2d1e6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:52:26.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.335+0000 7f939b400700 1 -- 172.21.15.82:0/2937578917 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a000bbb0 con 0x55d0c4852980 2024-05-08T05:52:26.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.335+0000 7f939b400700 1 -- 172.21.15.82:0/2937578917 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93a000bd50 con 0x55d0c4852980 2024-05-08T05:52:26.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.336+0000 7f939b400700 1 -- 172.21.15.82:0/2937578917 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a000f460 con 0x55d0c4852980 2024-05-08T05:52:26.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.336+0000 7f93bf834b80 1 -- 172.21.15.82:0/2937578917 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0c4852980 msgr2=0x55d0c4856490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:26.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.336+0000 7f93bf834b80 1 --2- 172.21.15.82:0/2937578917 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0c4852980 0x55d0c4856490 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f93a0005f40 tx=0x7f93a0005c00 comp rx=0 tx=0).stop 2024-05-08T05:52:26.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.338+0000 7f93a6a00700 1 --2- 172.21.15.82:0/581486242 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f93940b2980 0x7f93940b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:26.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.338+0000 7f93a6a00700 1 -- 172.21.15.82:0/581486242 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f93a80e1a90 con 0x7f93b010ff50 2024-05-08T05:52:26.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.339+0000 7f93ad400700 1 --2- 172.21.15.82:0/581486242 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f93940b2980 0x7f93940b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:26.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.340+0000 7f93ad400700 1 --2- 172.21.15.82:0/581486242 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f93940b2980 0x7f93940b4e40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f93b0105e40 tx=0x7f939c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:52:26.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.341+0000 7f93bf834b80 1 -- 172.21.15.82:0/2937578917 shutdown_connections 2024-05-08T05:52:26.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.341+0000 7f93bf834b80 1 --2- 172.21.15.82:0/2937578917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0c48569d0 0x55d0c4856e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:26.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.341+0000 7f93bf834b80 1 --2- 172.21.15.82:0/2937578917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d0c4852060 0x55d0c4852440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:26.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.341+0000 7f93bf834b80 1 --2- 172.21.15.82:0/2937578917 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0c4852980 0x55d0c4856490 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:26.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.341+0000 7f93bf834b80 1 -- 172.21.15.82:0/2937578917 >> 172.21.15.82:0/2937578917 conn(0x55d0c4780b60 msgr2=0x55d0c484c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:52:26.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.342+0000 7f93bf834b80 1 -- 172.21.15.82:0/2937578917 shutdown_connections 2024-05-08T05:52:26.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.343+0000 7f93bf834b80 1 -- 172.21.15.82:0/2937578917 wait complete. 2024-05-08T05:52:26.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.343+0000 7f93bf834b80 1 -- start start 2024-05-08T05:52:26.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.343+0000 7f93bf834b80 1 Processor -- start 2024-05-08T05:52:26.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.345+0000 7f93bf834b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0c4852060 0x55d0c485dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:26.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.345+0000 7f93bf834b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d0c4852980 0x55d0c485e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:26.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.345+0000 7f93bf834b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0c48569d0 0x55d0c485b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:26.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.345+0000 7f93ad400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d0c4852980 0x55d0c485e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:26.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.346+0000 7f93ad400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d0c4852980 0x55d0c485e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:58054/0 (socket says 172.21.15.82:58054) 2024-05-08T05:52:26.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.346+0000 7f93ad400700 1 -- 172.21.15.82:0/3166780883 learned_addr learned my addr 172.21.15.82:0/3166780883 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:52:26.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.346+0000 7f93ae800700 1 --2- 172.21.15.82:0/3166780883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0c48569d0 0x55d0c485b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:26.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.346+0000 7f93bf834b80 1 -- 172.21.15.82:0/3166780883 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d0c485eb70 con 0x55d0c4852060 2024-05-08T05:52:26.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.346+0000 7f93bf834b80 1 -- 172.21.15.82:0/3166780883 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d0c470ab20 con 0x55d0c48569d0 2024-05-08T05:52:26.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.346+0000 7f93bf834b80 1 -- 172.21.15.82:0/3166780883 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55d0c485ecf0 con 0x55d0c4852980 2024-05-08T05:52:26.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.346+0000 7f93bf834b80 10 client.0 _ll_register_callbacks cb 0x55d0c474bc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:52:26.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.346+0000 7f93ade00700 1 --2- 172.21.15.82:0/3166780883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0c4852060 0x55d0c485dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:26.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.346+0000 7f93ae800700 1 -- 172.21.15.82:0/3166780883 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d0c4852980 msgr2=0x55d0c485e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:26.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.346+0000 7f93ae800700 1 --2- 172.21.15.82:0/3166780883 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d0c4852980 0x55d0c485e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:26.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.346+0000 7f93ae800700 1 -- 172.21.15.82:0/3166780883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0c4852060 msgr2=0x55d0c485dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:26.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.346+0000 7f93ae800700 1 --2- 172.21.15.82:0/3166780883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0c4852060 0x55d0c485dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:26.348 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.346+0000 7f93ae800700 1 -- 172.21.15.82:0/3166780883 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0c476a420 con 0x55d0c48569d0 2024-05-08T05:52:26.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.346+0000 7f93ade00700 1 --2- 172.21.15.82:0/3166780883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0c4852060 0x55d0c485dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:52:26.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.346+0000 7f93ad400700 1 --2- 172.21.15.82:0/3166780883 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d0c4852980 0x55d0c485e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:52:26.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.347+0000 7f93ae800700 1 --2- 172.21.15.82:0/3166780883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0c48569d0 0x55d0c485b240 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f93a800c8d0 tx=0x7f93a80a95a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a72f60779215173 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:52:26.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.347+0000 7f938fe00700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:52:26.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.347+0000 7f938fe00700 1 -- 172.21.15.82:0/3166780883 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a80a9760 con 0x55d0c48569d0 2024-05-08T05:52:26.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.347+0000 7f938fe00700 1 -- 172.21.15.82:0/3166780883 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f93a800cd30 con 0x55d0c48569d0 2024-05-08T05:52:26.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.347+0000 7f93bf834b80 1 -- 172.21.15.82:0/3166780883 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f93a000bd50 con 0x55d0c48569d0 2024-05-08T05:52:26.349 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.348+0000 7f938fe00700 1 -- 172.21.15.82:0/3166780883 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f93a80a9060 con 0x55d0c48569d0 2024-05-08T05:52:26.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.348+0000 7f93bf834b80 10 client.25382 fetch_fsmap learned FSMap version 30 2024-05-08T05:52:26.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.348+0000 7f93bf834b80 1 -- 172.21.15.82:0/3166780883 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d0c4869370 con 0x55d0c48569d0 2024-05-08T05:52:26.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.348+0000 7f938fe00700 1 -- 172.21.15.82:0/3166780883 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f93a000bd50 con 0x55d0c48569d0 2024-05-08T05:52:26.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.349+0000 7f938fe00700 1 -- 172.21.15.82:0/3166780883 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f93a8004bd0 con 0x55d0c48569d0 2024-05-08T05:52:26.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.349+0000 7f93bf834b80 10 client.25382 fetch_fsmap finished waiting for FSMap version 30 2024-05-08T05:52:26.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.349+0000 7f93bf834b80 10 client.25382 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-05-08T05:52:26.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.349+0000 7f93bf834b80 20 client.25382 populate_metadata read hostname 'smithi082' 2024-05-08T05:52:26.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.349+0000 7f93bf834b80 1 --2- 172.21.15.82:0/3166780883 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x55d0c486b950 0x55d0c486dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:26.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.349+0000 7f93bf834b80 4 client.25382 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:52:26.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.349+0000 7f93bf834b80 1 -- 172.21.15.82:0/3166780883 --> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d0c481f0a0 con 0x55d0c486b950 2024-05-08T05:52:26.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.350+0000 7f93ade00700 1 --2- 172.21.15.82:0/3166780883 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x55d0c486b950 0x55d0c486dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:26.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.350+0000 7f93ade00700 1 --2- 172.21.15.82:0/3166780883 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x55d0c486b950 0x55d0c486dd60 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8e6abd4e49bc41d2 server_cookie=e721239344cc40b5 in_seq=0 out_seq=0 2024-05-08T05:52:26.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.350+0000 7f938fe00700 10 client.25382 ms_handle_connect on v2:172.21.15.151:6834/2093655929 2024-05-08T05:52:26.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.352+0000 7f938fe00700 1 -- 172.21.15.82:0/3166780883 <== mds.3 v2:172.21.15.151:6834/2093655929 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55d0c481f0a0 con 0x55d0c486b950 2024-05-08T05:52:26.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.353+0000 7f938fe00700 10 client.25382 handle_command_reply: tid=0 2024-05-08T05:52:26.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.353+0000 7f93bf834b80 1 client.25382 shutdown 2024-05-08T05:52:26.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.354+0000 7f93bf834b80 1 -- 172.21.15.82:0/3166780883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0c48569d0 msgr2=0x55d0c485b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:26.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.354+0000 7f93bf834b80 1 --2- 172.21.15.82:0/3166780883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0c48569d0 0x55d0c485b240 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f93a800c8d0 tx=0x7f93a80a95a0 comp rx=0 tx=0).stop 2024-05-08T05:52:26.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.354+0000 7f93bf834b80 1 -- 172.21.15.82:0/3166780883 shutdown_connections 2024-05-08T05:52:26.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.354+0000 7f93bf834b80 1 --2- 172.21.15.82:0/3166780883 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x55d0c486b950 0x55d0c486dd60 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:26.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.354+0000 7f93bf834b80 1 --2- 172.21.15.82:0/3166780883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0c48569d0 0x55d0c485b240 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:26.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.354+0000 7f93bf834b80 1 --2- 172.21.15.82:0/3166780883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0c4852060 0x55d0c485dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:26.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.354+0000 7f93bf834b80 1 --2- 172.21.15.82:0/3166780883 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d0c4852980 0x55d0c485e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:26.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.354+0000 7f93bf834b80 1 -- 172.21.15.82:0/3166780883 >> 172.21.15.82:0/3166780883 conn(0x55d0c4780b60 msgr2=0x55d0c48472b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:52:26.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.354+0000 7f938fe00700 0 client.25382 ms_handle_reset on v2:172.21.15.151:6834/2093655929 2024-05-08T05:52:26.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.355+0000 7f93bf834b80 1 -- 172.21.15.82:0/3166780883 shutdown_connections 2024-05-08T05:52:26.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.355+0000 7f93bf834b80 1 -- 172.21.15.82:0/3166780883 wait complete. 2024-05-08T05:52:26.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.355+0000 7f93bf834b80 20 client.25382 trim_cache size 0 max 16384 2024-05-08T05:52:26.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.381+0000 7f93bf834b80 1 Processor -- start 2024-05-08T05:52:26.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.382+0000 7f93bf834b80 1 -- start start 2024-05-08T05:52:26.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.382+0000 7f93bf834b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0c4852060 0x55d0c4873670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:26.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.382+0000 7f93bf834b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0c4852980 0x55d0c4873bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:26.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.382+0000 7f93bf834b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d0c48569d0 0x55d0c4864050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:26.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.382+0000 7f93bf834b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f939000d2e0 con 0x55d0c4852060 2024-05-08T05:52:26.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.382+0000 7f93bf834b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f939000ee50 con 0x55d0c4852980 2024-05-08T05:52:26.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.382+0000 7f93bf834b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f939000d9b0 con 0x55d0c48569d0 2024-05-08T05:52:26.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.382+0000 7f93ad400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0c4852980 0x55d0c4873bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:26.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.382+0000 7f93ad400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0c4852980 0x55d0c4873bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:51814/0 (socket says 172.21.15.82:51814) 2024-05-08T05:52:26.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.382+0000 7f93ad400700 1 -- 172.21.15.82:0/2953744028 learned_addr learned my addr 172.21.15.82:0/2953744028 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:52:26.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.382+0000 7f93ade00700 1 --2- 172.21.15.82:0/2953744028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0c4852060 0x55d0c4873670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:26.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.382+0000 7f93ae800700 1 --2- 172.21.15.82:0/2953744028 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d0c48569d0 0x55d0c4864050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:26.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.384+0000 7f93ad400700 1 -- 172.21.15.82:0/2953744028 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d0c48569d0 msgr2=0x55d0c4864050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:26.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.384+0000 7f93ad400700 1 --2- 172.21.15.82:0/2953744028 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d0c48569d0 0x55d0c4864050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:26.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.384+0000 7f93ad400700 1 -- 172.21.15.82:0/2953744028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0c4852060 msgr2=0x55d0c4873670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:26.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.384+0000 7f93ad400700 1 --2- 172.21.15.82:0/2953744028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0c4852060 0x55d0c4873670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:26.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.384+0000 7f93ad400700 1 -- 172.21.15.82:0/2953744028 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0c485d8e0 con 0x55d0c4852980 2024-05-08T05:52:26.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.384+0000 7f93ae800700 1 --2- 172.21.15.82:0/2953744028 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d0c48569d0 0x55d0c4864050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:52:26.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.385+0000 7f93ad400700 1 --2- 172.21.15.82:0/2953744028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0c4852980 0x55d0c4873bb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f939c004410 tx=0x7f939c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee739f97181a2d60 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:52:26.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.385+0000 7f939aa00700 1 -- 172.21.15.82:0/2953744028 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f939c003b10 con 0x55d0c4852980 2024-05-08T05:52:26.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.385+0000 7f939aa00700 1 -- 172.21.15.82:0/2953744028 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f939c003cb0 con 0x55d0c4852980 2024-05-08T05:52:26.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.385+0000 7f939aa00700 1 -- 172.21.15.82:0/2953744028 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f939c0296a0 con 0x55d0c4852980 2024-05-08T05:52:26.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.386+0000 7f93bf834b80 1 -- 172.21.15.82:0/2953744028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0c4852980 msgr2=0x55d0c4873bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:26.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.386+0000 7f93bf834b80 1 --2- 172.21.15.82:0/2953744028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0c4852980 0x55d0c4873bb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f939c004410 tx=0x7f939c004750 comp rx=0 tx=0).stop 2024-05-08T05:52:26.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.386+0000 7f93bf834b80 1 -- 172.21.15.82:0/2953744028 shutdown_connections 2024-05-08T05:52:26.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.386+0000 7f93bf834b80 1 --2- 172.21.15.82:0/2953744028 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d0c48569d0 0x55d0c4864050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:26.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.386+0000 7f93bf834b80 1 --2- 172.21.15.82:0/2953744028 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0c4852060 0x55d0c4873670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:26.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.386+0000 7f93bf834b80 1 --2- 172.21.15.82:0/2953744028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0c4852980 0x55d0c4873bb0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:26.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.386+0000 7f93bf834b80 1 -- 172.21.15.82:0/2953744028 >> 172.21.15.82:0/2953744028 conn(0x55d0c4780b60 msgr2=0x55d0c4859950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:52:26.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.386+0000 7f93bf834b80 1 -- 172.21.15.82:0/2953744028 shutdown_connections 2024-05-08T05:52:26.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.386+0000 7f93bf834b80 1 -- 172.21.15.82:0/2953744028 wait complete. 2024-05-08T05:52:26.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.387+0000 7f93bf834b80 1 -- start start 2024-05-08T05:52:26.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.387+0000 7f93bf834b80 1 Processor -- start 2024-05-08T05:52:26.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.388+0000 7f93bf834b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0c4852060 0x55d0c4864770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:26.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.388+0000 7f93bf834b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d0c4852980 0x55d0c4857df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:26.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.388+0000 7f93bf834b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0c48569d0 0x55d0c48584e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:26.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.388+0000 7f93bf834b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f939000e750 con 0x55d0c4852060 2024-05-08T05:52:26.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.388+0000 7f93bf834b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f939000e080 con 0x55d0c48569d0 2024-05-08T05:52:26.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.388+0000 7f93bf834b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f939000b280 con 0x55d0c4852980 2024-05-08T05:52:26.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.388+0000 7f93bf834b80 10 client.0 _ll_register_callbacks cb 0x55d0c474bc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:52:26.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.388+0000 7f93ad400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d0c4852980 0x55d0c4857df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:26.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.388+0000 7f93ade00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0c4852060 0x55d0c4864770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:26.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.388+0000 7f93ae800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0c48569d0 0x55d0c48584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:26.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.388+0000 7f93ad400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d0c4852980 0x55d0c4857df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:58064/0 (socket says 172.21.15.82:58064) 2024-05-08T05:52:26.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.388+0000 7f93ad400700 1 -- 172.21.15.82:0/1437435354 learned_addr learned my addr 172.21.15.82:0/1437435354 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:52:26.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.389+0000 7f93ad400700 1 -- 172.21.15.82:0/1437435354 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0c48569d0 msgr2=0x55d0c48584e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:26.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.389+0000 7f93ad400700 1 --2- 172.21.15.82:0/1437435354 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0c48569d0 0x55d0c48584e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:26.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.389+0000 7f93ad400700 1 -- 172.21.15.82:0/1437435354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0c4852060 msgr2=0x55d0c4864770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:26.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.389+0000 7f93ad400700 1 --2- 172.21.15.82:0/1437435354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0c4852060 0x55d0c4864770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:26.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.389+0000 7f93ad400700 1 -- 172.21.15.82:0/1437435354 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0c48d5220 con 0x55d0c4852980 2024-05-08T05:52:26.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.389+0000 7f93ad400700 1 --2- 172.21.15.82:0/1437435354 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d0c4852980 0x55d0c4857df0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f939c01edb0 tx=0x7f939c01e940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90210727103765a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:52:26.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.390+0000 7f938fe00700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:52:26.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.390+0000 7f938fe00700 1 -- 172.21.15.82:0/1437435354 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f939c003b10 con 0x55d0c4852980 2024-05-08T05:52:26.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.390+0000 7f938fe00700 1 -- 172.21.15.82:0/1437435354 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f939c005020 con 0x55d0c4852980 2024-05-08T05:52:26.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.391+0000 7f93bf834b80 1 -- 172.21.15.82:0/1437435354 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f939c003cb0 con 0x55d0c4852980 2024-05-08T05:52:26.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.391+0000 7f938fe00700 1 -- 172.21.15.82:0/1437435354 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f939c003e60 con 0x55d0c4852980 2024-05-08T05:52:26.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.391+0000 7f93bf834b80 10 client.25402 fetch_fsmap learned FSMap version 30 2024-05-08T05:52:26.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.391+0000 7f93bf834b80 1 -- 172.21.15.82:0/1437435354 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d0c48d6460 con 0x55d0c4852980 2024-05-08T05:52:26.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.392+0000 7f938fe00700 1 -- 172.21.15.82:0/1437435354 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f939c003cb0 con 0x55d0c4852980 2024-05-08T05:52:26.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.392+0000 7f938fe00700 1 -- 172.21.15.82:0/1437435354 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f939c027020 con 0x55d0c4852980 2024-05-08T05:52:26.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.392+0000 7f93bf834b80 10 client.25402 fetch_fsmap finished waiting for FSMap version 30 2024-05-08T05:52:26.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.392+0000 7f93bf834b80 10 client.25402 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-05-08T05:52:26.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.392+0000 7f93bf834b80 20 client.25402 populate_metadata read hostname 'smithi082' 2024-05-08T05:52:26.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.392+0000 7f93bf834b80 1 --2- 172.21.15.82:0/1437435354 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x55d0c48d6a70 0x55d0c48d8e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:26.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.392+0000 7f93bf834b80 4 client.25402 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:52:26.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.392+0000 7f93bf834b80 1 -- 172.21.15.82:0/1437435354 --> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d0c47b2400 con 0x55d0c48d6a70 2024-05-08T05:52:26.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.392+0000 7f93ade00700 1 --2- 172.21.15.82:0/1437435354 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x55d0c48d6a70 0x55d0c48d8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:26.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.393+0000 7f93ade00700 1 --2- 172.21.15.82:0/1437435354 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x55d0c48d6a70 0x55d0c48d8e90 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=159846a3aa2aaf36 server_cookie=3fa9a673b7383e22 in_seq=0 out_seq=0 2024-05-08T05:52:26.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.393+0000 7f938fe00700 10 client.25402 ms_handle_connect on v2:172.21.15.151:6834/2093655929 2024-05-08T05:52:26.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.393+0000 7f938fe00700 1 -- 172.21.15.82:0/1437435354 <== mds.3 v2:172.21.15.151:6834/2093655929 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d0c47b2400 con 0x55d0c48d6a70 2024-05-08T05:52:26.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.393+0000 7f938fe00700 10 client.25402 handle_command_reply: tid=0 2024-05-08T05:52:26.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.393+0000 7f93bf834b80 1 client.25402 shutdown 2024-05-08T05:52:26.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.394+0000 7f93bf834b80 1 -- 172.21.15.82:0/1437435354 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d0c4852980 msgr2=0x55d0c4857df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:26.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.394+0000 7f93bf834b80 1 --2- 172.21.15.82:0/1437435354 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d0c4852980 0x55d0c4857df0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f939c01edb0 tx=0x7f939c01e940 comp rx=0 tx=0).stop 2024-05-08T05:52:26.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.394+0000 7f93bf834b80 1 -- 172.21.15.82:0/1437435354 shutdown_connections 2024-05-08T05:52:26.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.394+0000 7f93bf834b80 1 --2- 172.21.15.82:0/1437435354 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x55d0c48d6a70 0x55d0c48d8e90 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:26.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.394+0000 7f93bf834b80 1 --2- 172.21.15.82:0/1437435354 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0c48569d0 0x55d0c48584e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:26.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.394+0000 7f93bf834b80 1 --2- 172.21.15.82:0/1437435354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d0c4852060 0x55d0c4864770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:26.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.394+0000 7f93bf834b80 1 --2- 172.21.15.82:0/1437435354 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d0c4852980 0x55d0c4857df0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:26.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.394+0000 7f93bf834b80 1 -- 172.21.15.82:0/1437435354 >> 172.21.15.82:0/1437435354 conn(0x55d0c4780b60 msgr2=0x55d0c4846a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:52:26.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.394+0000 7f938fe00700 0 client.25402 ms_handle_reset on v2:172.21.15.151:6834/2093655929 2024-05-08T05:52:26.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.394+0000 7f93bf834b80 1 -- 172.21.15.82:0/1437435354 shutdown_connections 2024-05-08T05:52:26.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.394+0000 7f93bf834b80 1 -- 172.21.15.82:0/1437435354 wait complete. 2024-05-08T05:52:26.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.395+0000 7f93bf834b80 20 client.25402 trim_cache size 0 max 16384 2024-05-08T05:52:26.396 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T05:52:26.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.395+0000 7f93b4e00700 1 -- 172.21.15.82:0/581486242 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f93940b2980 msgr2=0x7f93940b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:26.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.395+0000 7f93b4e00700 1 --2- 172.21.15.82:0/581486242 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f93940b2980 0x7f93940b4e40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f93b0105e40 tx=0x7f939c009260 comp rx=0 tx=0).stop 2024-05-08T05:52:26.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.395+0000 7f93b4e00700 1 -- 172.21.15.82:0/581486242 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93b010ff50 msgr2=0x7f93b0105100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:26.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.395+0000 7f93b4e00700 1 --2- 172.21.15.82:0/581486242 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93b010ff50 0x7f93b0105100 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f93a800c110 tx=0x7f93a800c4d0 comp rx=0 tx=0).stop 2024-05-08T05:52:26.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.396+0000 7f93b4e00700 1 -- 172.21.15.82:0/581486242 shutdown_connections 2024-05-08T05:52:26.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.396+0000 7f93b4e00700 1 --2- 172.21.15.82:0/581486242 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93b010ff50 0x7f93b0105100 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:26.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.396+0000 7f93b4e00700 1 --2- 172.21.15.82:0/581486242 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f93940b2980 0x7f93940b4e40 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:26.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.396+0000 7f93b4e00700 1 --2- 172.21.15.82:0/581486242 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93b006b1b0 0x7f93b0104680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:26.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.396+0000 7f93b4e00700 1 --2- 172.21.15.82:0/581486242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93b006bad0 0x7f93b0104bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:26.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.396+0000 7f93b4e00700 1 -- 172.21.15.82:0/581486242 >> 172.21.15.82:0/581486242 conn(0x7f93b0079350 msgr2=0x7f93b01114e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:52:26.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.396+0000 7f93b4e00700 1 -- 172.21.15.82:0/581486242 shutdown_connections 2024-05-08T05:52:26.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:26.396+0000 7f93b4e00700 1 -- 172.21.15.82:0/581486242 wait complete. 2024-05-08T05:52:27.331 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-05-08T05:52:27.824 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:52:27 smithi082 ceph-mon[30098]: pgmap v513: 97 pgs: 97 active+clean; 1.0 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.7 MiB/s wr, 765 op/s 2024-05-08T05:52:27.951 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:52:28.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:52:27 smithi151 ceph-mon[34815]: pgmap v513: 97 pgs: 97 active+clean; 1.0 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.7 MiB/s wr, 765 op/s 2024-05-08T05:52:28.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:52:27 smithi134 ceph-mon[34132]: pgmap v513: 97 pgs: 97 active+clean; 1.0 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.7 MiB/s wr, 765 op/s 2024-05-08T05:52:29.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:52:29 smithi082 ceph-mon[30098]: pgmap v514: 97 pgs: 97 active+clean; 1.0 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.3 MiB/s wr, 692 op/s 2024-05-08T05:52:30.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:52:29 smithi151 ceph-mon[34815]: pgmap v514: 97 pgs: 97 active+clean; 1.0 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.3 MiB/s wr, 692 op/s 2024-05-08T05:52:30.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:52:29 smithi134 ceph-mon[34132]: pgmap v514: 97 pgs: 97 active+clean; 1.0 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.3 MiB/s wr, 692 op/s 2024-05-08T05:52:30.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 100.0 s, 2591.4 tps, lat 37.769 ms stddev 42.560 2024-05-08T05:52:31.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.010+0000 7faeafa00700 1 -- 172.21.15.82:0/3545008973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faea81056e0 msgr2=0x7faea8105b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:31.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.010+0000 7faeafa00700 1 --2- 172.21.15.82:0/3545008973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faea81056e0 0x7faea8105b60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fae9c009990 tx=0x7fae9c009ca0 comp rx=0 tx=0).stop 2024-05-08T05:52:31.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.010+0000 7faeafa00700 1 -- 172.21.15.82:0/3545008973 shutdown_connections 2024-05-08T05:52:31.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.010+0000 7faeafa00700 1 --2- 172.21.15.82:0/3545008973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faea810b6e0 0x7faea810bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:31.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.010+0000 7faeafa00700 1 --2- 172.21.15.82:0/3545008973 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faea81060a0 0x7faea81125b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:31.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.010+0000 7faeafa00700 1 --2- 172.21.15.82:0/3545008973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faea81056e0 0x7faea8105b60 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:31.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.010+0000 7faeafa00700 1 -- 172.21.15.82:0/3545008973 >> 172.21.15.82:0/3545008973 conn(0x7faea81011d0 msgr2=0x7faea81035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:52:31.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.010+0000 7faeafa00700 1 -- 172.21.15.82:0/3545008973 shutdown_connections 2024-05-08T05:52:31.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.010+0000 7faeafa00700 1 -- 172.21.15.82:0/3545008973 wait complete. 2024-05-08T05:52:31.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.012+0000 7faeafa00700 1 Processor -- start 2024-05-08T05:52:31.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.012+0000 7faeafa00700 1 -- start start 2024-05-08T05:52:31.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.012+0000 7faeafa00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faea81056e0 0x7faea819bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:31.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.012+0000 7faeafa00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faea81060a0 0x7faea819c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:31.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.012+0000 7faeafa00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faea810b6e0 0x7faea81a0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:31.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.012+0000 7faeafa00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7faea8115970 con 0x7faea81056e0 2024-05-08T05:52:31.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.012+0000 7faeafa00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7faea81157f0 con 0x7faea81060a0 2024-05-08T05:52:31.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.012+0000 7faeafa00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7faea8115af0 con 0x7faea810b6e0 2024-05-08T05:52:31.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.012+0000 7faea7e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faea81060a0 0x7faea819c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:31.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.012+0000 7faea7e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faea81060a0 0x7faea819c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:51858/0 (socket says 172.21.15.82:51858) 2024-05-08T05:52:31.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.012+0000 7faea7e00700 1 -- 172.21.15.82:0/4163351445 learned_addr learned my addr 172.21.15.82:0/4163351445 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:52:31.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.013+0000 7faeada00700 1 --2- 172.21.15.82:0/4163351445 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faea810b6e0 0x7faea81a0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:31.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.013+0000 7faead000700 1 --2- 172.21.15.82:0/4163351445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faea81056e0 0x7faea819bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:31.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.013+0000 7faea7e00700 1 -- 172.21.15.82:0/4163351445 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faea810b6e0 msgr2=0x7faea81a0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:31.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.013+0000 7faea7e00700 1 --2- 172.21.15.82:0/4163351445 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faea810b6e0 0x7faea81a0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:31.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.013+0000 7faea7e00700 1 -- 172.21.15.82:0/4163351445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faea81056e0 msgr2=0x7faea819bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:31.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.013+0000 7faea7e00700 1 --2- 172.21.15.82:0/4163351445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faea81056e0 0x7faea819bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:31.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.013+0000 7faea7e00700 1 -- 172.21.15.82:0/4163351445 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faea81a0da0 con 0x7faea81060a0 2024-05-08T05:52:31.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.013+0000 7faead000700 1 --2- 172.21.15.82:0/4163351445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faea81056e0 0x7faea819bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:52:31.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.013+0000 7faea7e00700 1 --2- 172.21.15.82:0/4163351445 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faea81060a0 0x7faea819c320 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fae9c005910 tx=0x7fae9c00b670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:52:31.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.013+0000 7faea5600700 1 -- 172.21.15.82:0/4163351445 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae9c027070 con 0x7faea81060a0 2024-05-08T05:52:31.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.014+0000 7faeafa00700 1 -- 172.21.15.82:0/4163351445 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faea81a1030 con 0x7faea81060a0 2024-05-08T05:52:31.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.014+0000 7faeafa00700 1 -- 172.21.15.82:0/4163351445 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faea81a8910 con 0x7faea81060a0 2024-05-08T05:52:31.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.014+0000 7faea5600700 1 -- 172.21.15.82:0/4163351445 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae9c022470 con 0x7faea81060a0 2024-05-08T05:52:31.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.014+0000 7faea5600700 1 -- 172.21.15.82:0/4163351445 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae9c017650 con 0x7faea81060a0 2024-05-08T05:52:31.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.021+0000 7faeba426b80 1 Processor -- start 2024-05-08T05:52:31.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.022+0000 7faea5600700 1 -- 172.21.15.82:0/4163351445 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fae9c02a070 con 0x7faea81060a0 2024-05-08T05:52:31.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.024+0000 7faeba426b80 1 -- start start 2024-05-08T05:52:31.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.024+0000 7faea5600700 1 --2- 172.21.15.82:0/4163351445 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fae900b2880 0x7fae900b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:31.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.025+0000 7faea5600700 1 -- 172.21.15.82:0/4163351445 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fae9c0e2e50 con 0x7faea81060a0 2024-05-08T05:52:31.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.025+0000 7faeba426b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5572b9babbc0 0x5572b9babfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:31.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.025+0000 7faeba426b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5572b9bac4e0 0x5572b9ba62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:31.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.025+0000 7faeba426b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5572b9ba68f0 0x5572b9ba6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:31.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.025+0000 7faeba426b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5572b9af8a20 con 0x5572b9ba68f0 2024-05-08T05:52:31.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.025+0000 7faeba426b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5572b9a96760 con 0x5572b9babbc0 2024-05-08T05:52:31.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.025+0000 7faeba426b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5572b9af49e0 con 0x5572b9bac4e0 2024-05-08T05:52:31.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.025+0000 7faeada00700 1 --2- 172.21.15.82:0/4163351445 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fae900b2880 0x7fae900b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:31.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.025+0000 7faeada00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5572b9ba68f0 0x5572b9ba6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:31.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.025+0000 7faead000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5572b9babbc0 0x5572b9babfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:31.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.025+0000 7faeada00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5572b9ba68f0 0x5572b9ba6d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40986/0 (socket says 172.21.15.82:40986) 2024-05-08T05:52:31.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.025+0000 7faeada00700 1 -- 172.21.15.82:0/2313687611 learned_addr learned my addr 172.21.15.82:0/2313687611 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:52:31.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.025+0000 7faea7e00700 1 --2- 172.21.15.82:0/2313687611 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5572b9bac4e0 0x5572b9ba62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:31.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.025+0000 7faeada00700 1 -- 172.21.15.82:0/2313687611 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5572b9bac4e0 msgr2=0x5572b9ba62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:31.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.025+0000 7faeada00700 1 --2- 172.21.15.82:0/2313687611 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5572b9bac4e0 0x5572b9ba62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:31.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.025+0000 7faeada00700 1 -- 172.21.15.82:0/2313687611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5572b9babbc0 msgr2=0x5572b9babfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:31.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.025+0000 7faeada00700 1 --2- 172.21.15.82:0/2313687611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5572b9babbc0 0x5572b9babfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:31.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.025+0000 7faeada00700 1 -- 172.21.15.82:0/2313687611 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572b9a458d0 con 0x5572b9ba68f0 2024-05-08T05:52:31.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.026+0000 7faead000700 1 --2- 172.21.15.82:0/2313687611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5572b9babbc0 0x5572b9babfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:52:31.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.026+0000 7faeada00700 1 --2- 172.21.15.82:0/4163351445 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fae900b2880 0x7fae900b4d40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7faea001aa10 tx=0x7faea0013000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:52:31.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.026+0000 7faeada00700 1 --2- 172.21.15.82:0/2313687611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5572b9ba68f0 0x5572b9ba6d70 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7faea0008f70 tx=0x7faea001a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e7f2f26e5e5fdcd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:52:31.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.026+0000 7fae96000700 1 -- 172.21.15.82:0/2313687611 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea00088c0 con 0x5572b9ba68f0 2024-05-08T05:52:31.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.026+0000 7fae96000700 1 -- 172.21.15.82:0/2313687611 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faea0028070 con 0x5572b9ba68f0 2024-05-08T05:52:31.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.026+0000 7fae96000700 1 -- 172.21.15.82:0/2313687611 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea00238c0 con 0x5572b9ba68f0 2024-05-08T05:52:31.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.027+0000 7faeba426b80 1 -- 172.21.15.82:0/2313687611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5572b9ba68f0 msgr2=0x5572b9ba6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:31.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.027+0000 7faeba426b80 1 --2- 172.21.15.82:0/2313687611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5572b9ba68f0 0x5572b9ba6d70 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7faea0008f70 tx=0x7faea001a6c0 comp rx=0 tx=0).stop 2024-05-08T05:52:31.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.027+0000 7faeba426b80 1 -- 172.21.15.82:0/2313687611 shutdown_connections 2024-05-08T05:52:31.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.027+0000 7faeba426b80 1 --2- 172.21.15.82:0/2313687611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5572b9babbc0 0x5572b9babfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:31.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.027+0000 7faeba426b80 1 --2- 172.21.15.82:0/2313687611 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5572b9ba68f0 0x5572b9ba6d70 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:31.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.027+0000 7faeba426b80 1 --2- 172.21.15.82:0/2313687611 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5572b9bac4e0 0x5572b9ba62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:31.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.027+0000 7faeba426b80 1 -- 172.21.15.82:0/2313687611 >> 172.21.15.82:0/2313687611 conn(0x5572b9b1e6d0 msgr2=0x5572b9ba0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:52:31.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.028+0000 7faeba426b80 1 -- 172.21.15.82:0/2313687611 shutdown_connections 2024-05-08T05:52:31.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.028+0000 7faeba426b80 1 -- 172.21.15.82:0/2313687611 wait complete. 2024-05-08T05:52:31.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.028+0000 7faeba426b80 1 -- start start 2024-05-08T05:52:31.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.029+0000 7faeba426b80 1 Processor -- start 2024-05-08T05:52:31.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.029+0000 7faeba426b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5572b9ba68f0 0x5572b9bb2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:31.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.029+0000 7faeba426b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5572b9babbc0 0x5572b9baf520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:31.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.029+0000 7faeba426b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5572b9bac4e0 0x5572b9bafa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:31.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.029+0000 7faeba426b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5572b9bb2ec0 con 0x5572b9bac4e0 2024-05-08T05:52:31.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.029+0000 7faeba426b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5572b9a5eb20 con 0x5572b9babbc0 2024-05-08T05:52:31.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.029+0000 7faeba426b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5572b9bb3040 con 0x5572b9ba68f0 2024-05-08T05:52:31.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.029+0000 7faeba426b80 10 client.0 _ll_register_callbacks cb 0x5572b9a9fc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:52:31.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.030+0000 7faea7e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5572b9babbc0 0x5572b9baf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:31.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.030+0000 7faea7e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5572b9babbc0 0x5572b9baf520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:51870/0 (socket says 172.21.15.82:51870) 2024-05-08T05:52:31.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.030+0000 7faea7e00700 1 -- 172.21.15.82:0/3079989495 learned_addr learned my addr 172.21.15.82:0/3079989495 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:52:31.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.030+0000 7faead000700 1 --2- 172.21.15.82:0/3079989495 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5572b9ba68f0 0x5572b9bb2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:31.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.030+0000 7faeada00700 1 --2- 172.21.15.82:0/3079989495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5572b9bac4e0 0x5572b9bafa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:31.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.030+0000 7faea7e00700 1 -- 172.21.15.82:0/3079989495 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5572b9ba68f0 msgr2=0x5572b9bb2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:31.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.031+0000 7faea7e00700 1 --2- 172.21.15.82:0/3079989495 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5572b9ba68f0 0x5572b9bb2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:31.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.031+0000 7faea7e00700 1 -- 172.21.15.82:0/3079989495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5572b9bac4e0 msgr2=0x5572b9bafa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:31.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.031+0000 7faea7e00700 1 --2- 172.21.15.82:0/3079989495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5572b9bac4e0 0x5572b9bafa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:31.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.031+0000 7faea7e00700 1 -- 172.21.15.82:0/3079989495 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572b9abe420 con 0x5572b9babbc0 2024-05-08T05:52:31.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.031+0000 7faea7e00700 1 --2- 172.21.15.82:0/3079989495 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5572b9babbc0 0x5572b9baf520 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fae9c0aa450 tx=0x7fae9c009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d29e92a606e855a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:52:31.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.031+0000 7fae8aa00700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:52:31.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.031+0000 7fae8aa00700 1 -- 172.21.15.82:0/3079989495 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae9c0aac10 con 0x5572b9babbc0 2024-05-08T05:52:31.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.031+0000 7fae8aa00700 1 -- 172.21.15.82:0/3079989495 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fae9c0b3060 con 0x5572b9babbc0 2024-05-08T05:52:31.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.031+0000 7faeba426b80 1 -- 172.21.15.82:0/3079989495 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faea0028070 con 0x5572b9babbc0 2024-05-08T05:52:31.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.031+0000 7fae8aa00700 1 -- 172.21.15.82:0/3079989495 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fae9c0aa510 con 0x5572b9babbc0 2024-05-08T05:52:31.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.031+0000 7faeba426b80 10 client.25397 fetch_fsmap learned FSMap version 30 2024-05-08T05:52:31.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.032+0000 7faeba426b80 1 -- 172.21.15.82:0/3079989495 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5572b9bbd740 con 0x5572b9babbc0 2024-05-08T05:52:31.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.032+0000 7fae8aa00700 1 -- 172.21.15.82:0/3079989495 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faea0028070 con 0x5572b9babbc0 2024-05-08T05:52:31.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.032+0000 7fae8aa00700 1 -- 172.21.15.82:0/3079989495 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7fae9c0a5e80 con 0x5572b9babbc0 2024-05-08T05:52:31.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.032+0000 7faeba426b80 10 client.25397 fetch_fsmap finished waiting for FSMap version 30 2024-05-08T05:52:31.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.032+0000 7faeba426b80 10 client.25397 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-05-08T05:52:31.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.032+0000 7faeba426b80 20 client.25397 populate_metadata read hostname 'smithi082' 2024-05-08T05:52:31.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.032+0000 7faeba426b80 1 --2- 172.21.15.82:0/3079989495 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x5572b9bbfd60 0x5572b9bc2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:31.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.032+0000 7faeba426b80 4 client.25397 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:52:31.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.032+0000 7faeba426b80 1 -- 172.21.15.82:0/3079989495 --> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5572b9b73140 con 0x5572b9bbfd60 2024-05-08T05:52:31.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.033+0000 7faead000700 1 --2- 172.21.15.82:0/3079989495 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x5572b9bbfd60 0x5572b9bc2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:31.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.033+0000 7faead000700 1 --2- 172.21.15.82:0/3079989495 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x5572b9bbfd60 0x5572b9bc2180 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=239aafd7f2b30442 server_cookie=7c34b65de09098d2 in_seq=0 out_seq=0 2024-05-08T05:52:31.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.034+0000 7fae8aa00700 10 client.25397 ms_handle_connect on v2:172.21.15.151:6836/4192404464 2024-05-08T05:52:31.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.034+0000 7fae8aa00700 1 -- 172.21.15.82:0/3079989495 <== mds.2 v2:172.21.15.151:6836/4192404464 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5572b9b73140 con 0x5572b9bbfd60 2024-05-08T05:52:31.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.034+0000 7fae8aa00700 10 client.25397 handle_command_reply: tid=0 2024-05-08T05:52:31.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.034+0000 7faeba426b80 1 client.25397 shutdown 2024-05-08T05:52:31.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.035+0000 7faeba426b80 1 -- 172.21.15.82:0/3079989495 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5572b9babbc0 msgr2=0x5572b9baf520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:31.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.035+0000 7faeba426b80 1 --2- 172.21.15.82:0/3079989495 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5572b9babbc0 0x5572b9baf520 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fae9c0aa450 tx=0x7fae9c009310 comp rx=0 tx=0).stop 2024-05-08T05:52:31.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.035+0000 7faeba426b80 1 -- 172.21.15.82:0/3079989495 shutdown_connections 2024-05-08T05:52:31.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.035+0000 7faeba426b80 1 --2- 172.21.15.82:0/3079989495 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x5572b9bbfd60 0x5572b9bc2180 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:31.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.035+0000 7faeba426b80 1 --2- 172.21.15.82:0/3079989495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5572b9bac4e0 0x5572b9bafa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:31.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.035+0000 7faeba426b80 1 --2- 172.21.15.82:0/3079989495 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5572b9ba68f0 0x5572b9bb2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:31.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.035+0000 7faeba426b80 1 --2- 172.21.15.82:0/3079989495 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5572b9babbc0 0x5572b9baf520 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:31.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.035+0000 7faeba426b80 1 -- 172.21.15.82:0/3079989495 >> 172.21.15.82:0/3079989495 conn(0x5572b9b1e6d0 msgr2=0x5572b9ba0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:52:31.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.035+0000 7fae8aa00700 0 client.25397 ms_handle_reset on v2:172.21.15.151:6836/4192404464 2024-05-08T05:52:31.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.036+0000 7faeba426b80 1 -- 172.21.15.82:0/3079989495 shutdown_connections 2024-05-08T05:52:31.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.036+0000 7faeba426b80 1 -- 172.21.15.82:0/3079989495 wait complete. 2024-05-08T05:52:31.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.036+0000 7faeba426b80 20 client.25397 trim_cache size 0 max 16384 2024-05-08T05:52:31.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.063+0000 7faeba426b80 1 Processor -- start 2024-05-08T05:52:31.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.063+0000 7faeba426b80 1 -- start start 2024-05-08T05:52:31.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.063+0000 7faeba426b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5572b9ba68f0 0x5572b9ba62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:31.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.063+0000 7faeba426b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5572b9babbc0 0x5572b9bbbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:31.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.063+0000 7faeba426b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5572b9bac4e0 0x5572b9bacfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:31.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.063+0000 7faeba426b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fae8c00d230 con 0x5572b9babbc0 2024-05-08T05:52:31.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.063+0000 7faeba426b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fae8c00eda0 con 0x5572b9ba68f0 2024-05-08T05:52:31.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.063+0000 7faeba426b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fae8c00d900 con 0x5572b9bac4e0 2024-05-08T05:52:31.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.063+0000 7faeada00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5572b9bac4e0 0x5572b9bacfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:31.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.064+0000 7faeada00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5572b9bac4e0 0x5572b9bacfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:58120/0 (socket says 172.21.15.82:58120) 2024-05-08T05:52:31.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.064+0000 7faeada00700 1 -- 172.21.15.82:0/1675641824 learned_addr learned my addr 172.21.15.82:0/1675641824 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:52:31.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.064+0000 7faead000700 1 --2- 172.21.15.82:0/1675641824 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5572b9ba68f0 0x5572b9ba62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:31.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.064+0000 7faeada00700 1 -- 172.21.15.82:0/1675641824 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5572b9ba68f0 msgr2=0x5572b9ba62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:31.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.064+0000 7faeada00700 1 --2- 172.21.15.82:0/1675641824 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5572b9ba68f0 0x5572b9ba62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:31.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.064+0000 7faeada00700 1 -- 172.21.15.82:0/1675641824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5572b9babbc0 msgr2=0x5572b9bbbfb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T05:52:31.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.064+0000 7faea7e00700 1 --2- 172.21.15.82:0/1675641824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5572b9babbc0 0x5572b9bbbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:31.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.064+0000 7faeada00700 1 --2- 172.21.15.82:0/1675641824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5572b9babbc0 0x5572b9bbbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:31.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.064+0000 7faeada00700 1 -- 172.21.15.82:0/1675641824 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5572b9b9bab0 con 0x5572b9bac4e0 2024-05-08T05:52:31.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.065+0000 7faead000700 1 --2- 172.21.15.82:0/1675641824 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5572b9ba68f0 0x5572b9ba62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:52:31.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.065+0000 7faeada00700 1 --2- 172.21.15.82:0/1675641824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5572b9bac4e0 0x5572b9bacfd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7faea0009ec0 tx=0x7faea0009ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2ca3d326bca328 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:52:31.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.065+0000 7faea7e00700 1 --2- 172.21.15.82:0/1675641824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5572b9babbc0 0x5572b9bbbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:52:31.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.065+0000 7fae95600700 1 -- 172.21.15.82:0/1675641824 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea0032020 con 0x5572b9bac4e0 2024-05-08T05:52:31.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.065+0000 7fae95600700 1 -- 172.21.15.82:0/1675641824 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faea0028050 con 0x5572b9bac4e0 2024-05-08T05:52:31.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.065+0000 7fae95600700 1 -- 172.21.15.82:0/1675641824 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faea00052a0 con 0x5572b9bac4e0 2024-05-08T05:52:31.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.066+0000 7faeba426b80 1 -- 172.21.15.82:0/1675641824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5572b9bac4e0 msgr2=0x5572b9bacfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:31.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.066+0000 7faeba426b80 1 --2- 172.21.15.82:0/1675641824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5572b9bac4e0 0x5572b9bacfd0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7faea0009ec0 tx=0x7faea0009ef0 comp rx=0 tx=0).stop 2024-05-08T05:52:31.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.066+0000 7faeba426b80 1 -- 172.21.15.82:0/1675641824 shutdown_connections 2024-05-08T05:52:31.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.066+0000 7faeba426b80 1 --2- 172.21.15.82:0/1675641824 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5572b9ba68f0 0x5572b9ba62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:31.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.066+0000 7faeba426b80 1 --2- 172.21.15.82:0/1675641824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5572b9bac4e0 0x5572b9bacfd0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:31.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.066+0000 7faeba426b80 1 --2- 172.21.15.82:0/1675641824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5572b9babbc0 0x5572b9bbbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:31.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.066+0000 7faeba426b80 1 -- 172.21.15.82:0/1675641824 >> 172.21.15.82:0/1675641824 conn(0x5572b9b1e6d0 msgr2=0x5572b9bac8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:52:31.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.067+0000 7faeba426b80 1 -- 172.21.15.82:0/1675641824 shutdown_connections 2024-05-08T05:52:31.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.067+0000 7faeba426b80 1 -- 172.21.15.82:0/1675641824 wait complete. 2024-05-08T05:52:31.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.067+0000 7faeba426b80 1 -- start start 2024-05-08T05:52:31.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.067+0000 7faeba426b80 1 Processor -- start 2024-05-08T05:52:31.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.068+0000 7faeba426b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5572b9ba68f0 0x5572b9bb8330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:31.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.068+0000 7faeba426b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5572b9babbc0 0x5572b9bb8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:31.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.068+0000 7faeba426b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5572b9bac4e0 0x5572b9c25980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:31.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.068+0000 7faeba426b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fae8c00e6a0 con 0x5572b9bac4e0 2024-05-08T05:52:31.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.068+0000 7faeba426b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fae8c00dfd0 con 0x5572b9babbc0 2024-05-08T05:52:31.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.068+0000 7faeba426b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fae8c00b1d0 con 0x5572b9ba68f0 2024-05-08T05:52:31.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.068+0000 7faeba426b80 10 client.0 _ll_register_callbacks cb 0x5572b9a9fc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:52:31.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.068+0000 7faeada00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5572b9bac4e0 0x5572b9c25980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:31.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.068+0000 7faeada00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5572b9bac4e0 0x5572b9c25980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:41024/0 (socket says 172.21.15.82:41024) 2024-05-08T05:52:31.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.068+0000 7faeada00700 1 -- 172.21.15.82:0/2160426431 learned_addr learned my addr 172.21.15.82:0/2160426431 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:52:31.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.069+0000 7faea7e00700 1 --2- 172.21.15.82:0/2160426431 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5572b9babbc0 0x5572b9bb8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:31.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.069+0000 7faead000700 1 --2- 172.21.15.82:0/2160426431 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5572b9ba68f0 0x5572b9bb8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:31.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.069+0000 7faea7e00700 1 -- 172.21.15.82:0/2160426431 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5572b9ba68f0 msgr2=0x5572b9bb8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:31.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.069+0000 7faea7e00700 1 --2- 172.21.15.82:0/2160426431 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5572b9ba68f0 0x5572b9bb8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:31.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.069+0000 7faea7e00700 1 -- 172.21.15.82:0/2160426431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5572b9bac4e0 msgr2=0x5572b9c25980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:31.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.069+0000 7faea7e00700 1 --2- 172.21.15.82:0/2160426431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5572b9bac4e0 0x5572b9c25980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:31.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.069+0000 7faea7e00700 1 -- 172.21.15.82:0/2160426431 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5572b9c261c0 con 0x5572b9babbc0 2024-05-08T05:52:31.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.071+0000 7faea7e00700 1 --2- 172.21.15.82:0/2160426431 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5572b9babbc0 0x5572b9bb8870 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x5572b9bab9b0 tx=0x7fae9c0e09b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aab182642d0b992f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:52:31.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.071+0000 7fae8aa00700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:52:31.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.071+0000 7fae8aa00700 1 -- 172.21.15.82:0/2160426431 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae9c0aac10 con 0x5572b9babbc0 2024-05-08T05:52:31.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.072+0000 7fae8aa00700 1 -- 172.21.15.82:0/2160426431 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fae9c0a6b00 con 0x5572b9babbc0 2024-05-08T05:52:31.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.072+0000 7faeba426b80 1 -- 172.21.15.82:0/2160426431 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faea0028050 con 0x5572b9babbc0 2024-05-08T05:52:31.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.072+0000 7fae8aa00700 1 -- 172.21.15.82:0/2160426431 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fae9c0aac10 con 0x5572b9babbc0 2024-05-08T05:52:31.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.072+0000 7faeba426b80 10 client.25400 fetch_fsmap learned FSMap version 30 2024-05-08T05:52:31.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.072+0000 7faeba426b80 1 -- 172.21.15.82:0/2160426431 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x5572b9bc7c30 con 0x5572b9babbc0 2024-05-08T05:52:31.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.073+0000 7fae8aa00700 1 -- 172.21.15.82:0/2160426431 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7faea0028050 con 0x5572b9babbc0 2024-05-08T05:52:31.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.073+0000 7fae8aa00700 1 -- 172.21.15.82:0/2160426431 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7fae9c00fae0 con 0x5572b9babbc0 2024-05-08T05:52:31.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.074+0000 7faeba426b80 10 client.25400 fetch_fsmap finished waiting for FSMap version 30 2024-05-08T05:52:31.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.074+0000 7faeba426b80 10 client.25400 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-05-08T05:52:31.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.074+0000 7faeba426b80 20 client.25400 populate_metadata read hostname 'smithi082' 2024-05-08T05:52:31.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.074+0000 7faeba426b80 1 --2- 172.21.15.82:0/2160426431 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x5572b9c33140 0x5572b9c35560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:31.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.074+0000 7faeba426b80 4 client.25400 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:52:31.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.074+0000 7faeba426b80 1 -- 172.21.15.82:0/2160426431 --> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5572b9b06400 con 0x5572b9c33140 2024-05-08T05:52:31.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.074+0000 7faead000700 1 --2- 172.21.15.82:0/2160426431 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x5572b9c33140 0x5572b9c35560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:31.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.075+0000 7faead000700 1 --2- 172.21.15.82:0/2160426431 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x5572b9c33140 0x5572b9c35560 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8b4af60b1f951a9a server_cookie=e00cb1a4c2963f01 in_seq=0 out_seq=0 2024-05-08T05:52:31.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.075+0000 7fae8aa00700 10 client.25400 ms_handle_connect on v2:172.21.15.151:6836/4192404464 2024-05-08T05:52:31.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.076+0000 7fae8aa00700 1 -- 172.21.15.82:0/2160426431 <== mds.2 v2:172.21.15.151:6836/4192404464 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5572b9b06400 con 0x5572b9c33140 2024-05-08T05:52:31.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.076+0000 7fae8aa00700 10 client.25400 handle_command_reply: tid=0 2024-05-08T05:52:31.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.076+0000 7faeba426b80 1 client.25400 shutdown 2024-05-08T05:52:31.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.076+0000 7faeba426b80 1 -- 172.21.15.82:0/2160426431 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5572b9babbc0 msgr2=0x5572b9bb8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:31.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.076+0000 7faeba426b80 1 --2- 172.21.15.82:0/2160426431 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5572b9babbc0 0x5572b9bb8870 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x5572b9bab9b0 tx=0x7fae9c0e09b0 comp rx=0 tx=0).stop 2024-05-08T05:52:31.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.077+0000 7faeba426b80 1 -- 172.21.15.82:0/2160426431 shutdown_connections 2024-05-08T05:52:31.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.077+0000 7faeba426b80 1 --2- 172.21.15.82:0/2160426431 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x5572b9c33140 0x5572b9c35560 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:31.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.077+0000 7faeba426b80 1 --2- 172.21.15.82:0/2160426431 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5572b9bac4e0 0x5572b9c25980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:31.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.077+0000 7faeba426b80 1 --2- 172.21.15.82:0/2160426431 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5572b9ba68f0 0x5572b9bb8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:31.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.077+0000 7faeba426b80 1 --2- 172.21.15.82:0/2160426431 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5572b9babbc0 0x5572b9bb8870 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:31.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.077+0000 7faeba426b80 1 -- 172.21.15.82:0/2160426431 >> 172.21.15.82:0/2160426431 conn(0x5572b9b1e6d0 msgr2=0x5572b9baa700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:52:31.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.077+0000 7fae8aa00700 0 client.25400 ms_handle_reset on v2:172.21.15.151:6836/4192404464 2024-05-08T05:52:31.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.077+0000 7faeba426b80 1 -- 172.21.15.82:0/2160426431 shutdown_connections 2024-05-08T05:52:31.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.077+0000 7faeba426b80 1 -- 172.21.15.82:0/2160426431 wait complete. 2024-05-08T05:52:31.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.077+0000 7faeba426b80 20 client.25400 trim_cache size 0 max 16384 2024-05-08T05:52:31.079 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T05:52:31.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.078+0000 7faeafa00700 1 -- 172.21.15.82:0/4163351445 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fae900b2880 msgr2=0x7fae900b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:31.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.078+0000 7faeafa00700 1 --2- 172.21.15.82:0/4163351445 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fae900b2880 0x7fae900b4d40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7faea001aa10 tx=0x7faea0013000 comp rx=0 tx=0).stop 2024-05-08T05:52:31.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.078+0000 7faeafa00700 1 -- 172.21.15.82:0/4163351445 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faea81060a0 msgr2=0x7faea819c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:31.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.078+0000 7faeafa00700 1 --2- 172.21.15.82:0/4163351445 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faea81060a0 0x7faea819c320 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fae9c005910 tx=0x7fae9c00b670 comp rx=0 tx=0).stop 2024-05-08T05:52:31.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.078+0000 7faeafa00700 1 -- 172.21.15.82:0/4163351445 shutdown_connections 2024-05-08T05:52:31.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.078+0000 7faeafa00700 1 --2- 172.21.15.82:0/4163351445 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fae900b2880 0x7fae900b4d40 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:31.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.079+0000 7faeafa00700 1 --2- 172.21.15.82:0/4163351445 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faea810b6e0 0x7faea81a0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:31.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.079+0000 7faeafa00700 1 --2- 172.21.15.82:0/4163351445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7faea81056e0 0x7faea819bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:31.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.079+0000 7faeafa00700 1 --2- 172.21.15.82:0/4163351445 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faea81060a0 0x7faea819c320 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:31.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.079+0000 7faeafa00700 1 -- 172.21.15.82:0/4163351445 >> 172.21.15.82:0/4163351445 conn(0x7faea81011d0 msgr2=0x7faea8101790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:52:31.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.080+0000 7faeafa00700 1 -- 172.21.15.82:0/4163351445 shutdown_connections 2024-05-08T05:52:31.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:31.080+0000 7faeafa00700 1 -- 172.21.15.82:0/4163351445 wait complete. 2024-05-08T05:52:32.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:52:31 smithi151 ceph-mon[34815]: pgmap v515: 97 pgs: 97 active+clean; 1.1 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.8 MiB/s wr, 814 op/s 2024-05-08T05:52:32.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:52:31 smithi082 ceph-mon[30098]: pgmap v515: 97 pgs: 97 active+clean; 1.1 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.8 MiB/s wr, 814 op/s 2024-05-08T05:52:32.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:52:31 smithi134 ceph-mon[34132]: pgmap v515: 97 pgs: 97 active+clean; 1.1 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.8 MiB/s wr, 814 op/s 2024-05-08T05:52:32.281 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-05-08T05:52:32.880 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:52:34.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:52:33 smithi151 ceph-mon[34815]: pgmap v516: 97 pgs: 97 active+clean; 1.1 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.3 MiB/s wr, 668 op/s 2024-05-08T05:52:34.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:52:33 smithi082 ceph-mon[30098]: pgmap v516: 97 pgs: 97 active+clean; 1.1 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.3 MiB/s wr, 668 op/s 2024-05-08T05:52:34.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:52:33 smithi134 ceph-mon[34132]: pgmap v516: 97 pgs: 97 active+clean; 1.1 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.3 MiB/s wr, 668 op/s 2024-05-08T05:52:35.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 105.0 s, 2371.0 tps, lat 43.053 ms stddev 55.337 2024-05-08T05:52:35.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.384+0000 7f7ac1a00700 1 -- 172.21.15.82:0/3045922129 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7abc1076c0 msgr2=0x7f7abc107aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:35.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.384+0000 7f7ac1a00700 1 --2- 172.21.15.82:0/3045922129 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7abc1076c0 0x7f7abc107aa0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7aac00c310 tx=0x7f7aac00c620 comp rx=0 tx=0).stop 2024-05-08T05:52:35.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.384+0000 7f7ac1a00700 1 -- 172.21.15.82:0/3045922129 shutdown_connections 2024-05-08T05:52:35.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.384+0000 7f7ac1a00700 1 --2- 172.21.15.82:0/3045922129 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7abc1076c0 0x7f7abc107aa0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:35.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.384+0000 7f7ac1a00700 1 --2- 172.21.15.82:0/3045922129 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7abc102080 0x7f7abc10e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:35.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.384+0000 7f7ac1a00700 1 --2- 172.21.15.82:0/3045922129 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7abc1016c0 0x7f7abc101b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:35.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.384+0000 7f7ac1a00700 1 -- 172.21.15.82:0/3045922129 >> 172.21.15.82:0/3045922129 conn(0x7f7abc0785a0 msgr2=0x7f7abc0ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:52:35.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.384+0000 7f7ac1a00700 1 -- 172.21.15.82:0/3045922129 shutdown_connections 2024-05-08T05:52:35.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.384+0000 7f7ac1a00700 1 -- 172.21.15.82:0/3045922129 wait complete. 2024-05-08T05:52:35.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.386+0000 7f7ac1a00700 1 Processor -- start 2024-05-08T05:52:35.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.386+0000 7f7ac1a00700 1 -- start start 2024-05-08T05:52:35.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.386+0000 7f7ac1a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7abc1016c0 0x7f7abc075080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:35.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.386+0000 7f7ac1a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7abc102080 0x7f7abc072180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:35.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.387+0000 7f7ac1a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7abc1076c0 0x7f7abc072720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:35.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.387+0000 7f7ac1a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7abc111510 con 0x7f7abc1016c0 2024-05-08T05:52:35.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.387+0000 7f7ac1a00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7abc111390 con 0x7f7abc1076c0 2024-05-08T05:52:35.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.387+0000 7f7ac1a00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7abc111690 con 0x7f7abc102080 2024-05-08T05:52:35.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.387+0000 7f7ab2000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7abc102080 0x7f7abc072180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:35.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.388+0000 7f7ab2000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7abc102080 0x7f7abc072180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:41330/0 (socket says 172.21.15.82:41330) 2024-05-08T05:52:35.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.388+0000 7f7ab2000700 1 -- 172.21.15.82:0/2427503979 learned_addr learned my addr 172.21.15.82:0/2427503979 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:52:35.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.389+0000 7f7ab2000700 1 -- 172.21.15.82:0/2427503979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7abc1076c0 msgr2=0x7f7abc072720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:35.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.389+0000 7f7abb400700 1 --2- 172.21.15.82:0/2427503979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7abc1076c0 0x7f7abc072720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:35.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.389+0000 7f7ab2000700 1 --2- 172.21.15.82:0/2427503979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7abc1076c0 0x7f7abc072720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:35.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.389+0000 7f7ab2000700 1 -- 172.21.15.82:0/2427503979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7abc1016c0 msgr2=0x7f7abc075080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:35.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.389+0000 7f7abaa00700 1 --2- 172.21.15.82:0/2427503979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7abc1016c0 0x7f7abc075080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:35.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.389+0000 7f7ab2000700 1 --2- 172.21.15.82:0/2427503979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7abc1016c0 0x7f7abc075080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:35.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.389+0000 7f7ab2000700 1 -- 172.21.15.82:0/2427503979 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7abc1b0a10 con 0x7f7abc102080 2024-05-08T05:52:35.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.389+0000 7f7abb400700 1 --2- 172.21.15.82:0/2427503979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7abc1076c0 0x7f7abc072720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:52:35.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.389+0000 7f7ab2000700 1 --2- 172.21.15.82:0/2427503979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7abc102080 0x7f7abc072180 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7aa400e9c0 tx=0x7f7aa400ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:52:35.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.390+0000 7f7ab3e00700 1 -- 172.21.15.82:0/2427503979 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa400cbd0 con 0x7f7abc102080 2024-05-08T05:52:35.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.390+0000 7f7ab3e00700 1 -- 172.21.15.82:0/2427503979 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7aa400cd70 con 0x7f7abc102080 2024-05-08T05:52:35.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.390+0000 7f7ab3e00700 1 -- 172.21.15.82:0/2427503979 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa4010430 con 0x7f7abc102080 2024-05-08T05:52:35.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.390+0000 7f7ac1a00700 1 -- 172.21.15.82:0/2427503979 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7abc1b0be0 con 0x7f7abc102080 2024-05-08T05:52:35.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.390+0000 7f7ac1a00700 1 -- 172.21.15.82:0/2427503979 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7abc1b10a0 con 0x7f7abc102080 2024-05-08T05:52:35.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.390+0000 7f7abaa00700 1 --2- 172.21.15.82:0/2427503979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7abc1016c0 0x7f7abc075080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:52:35.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.396+0000 7f7ab3e00700 1 -- 172.21.15.82:0/2427503979 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f7aa4004750 con 0x7f7abc102080 2024-05-08T05:52:35.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.396+0000 7f7acc445b80 1 Processor -- start 2024-05-08T05:52:35.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.396+0000 7f7acc445b80 1 -- start start 2024-05-08T05:52:35.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.397+0000 7f7acc445b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56151e63f870 0x56151e63fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:35.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.397+0000 7f7acc445b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56151e640190 0x56151e643ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:35.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.397+0000 7f7acc445b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56151e6441e0 0x56151e644640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:35.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.397+0000 7f7acc445b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56151e589a20 con 0x56151e6441e0 2024-05-08T05:52:35.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.397+0000 7f7acc445b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56151e527760 con 0x56151e640190 2024-05-08T05:52:35.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.397+0000 7f7acc445b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56151e5859e0 con 0x56151e63f870 2024-05-08T05:52:35.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.397+0000 7f7abb400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56151e63f870 0x56151e63fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:35.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.397+0000 7f7abb400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56151e63f870 0x56151e63fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:41338/0 (socket says 172.21.15.82:41338) 2024-05-08T05:52:35.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.397+0000 7f7abb400700 1 -- 172.21.15.82:0/3164501535 learned_addr learned my addr 172.21.15.82:0/3164501535 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:52:35.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.398+0000 7f7abaa00700 1 --2- 172.21.15.82:0/3164501535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56151e640190 0x56151e643ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:35.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.398+0000 7f7ab2000700 1 --2- 172.21.15.82:0/3164501535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56151e6441e0 0x56151e644640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:35.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.398+0000 7f7abb400700 1 -- 172.21.15.82:0/3164501535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56151e640190 msgr2=0x56151e643ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:35.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.398+0000 7f7abb400700 1 --2- 172.21.15.82:0/3164501535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56151e640190 0x56151e643ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:35.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.398+0000 7f7abb400700 1 -- 172.21.15.82:0/3164501535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56151e6441e0 msgr2=0x56151e644640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:35.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.398+0000 7f7abb400700 1 --2- 172.21.15.82:0/3164501535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56151e6441e0 0x56151e644640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:35.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.398+0000 7f7abb400700 1 -- 172.21.15.82:0/3164501535 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56151e4d68d0 con 0x56151e63f870 2024-05-08T05:52:35.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.398+0000 7f7abaa00700 1 --2- 172.21.15.82:0/3164501535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56151e640190 0x56151e643ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:52:35.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.398+0000 7f7ab2000700 1 --2- 172.21.15.82:0/3164501535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56151e6441e0 0x56151e644640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:52:35.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.398+0000 7f7ab3e00700 1 --2- 172.21.15.82:0/2427503979 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7aa00b28b0 0x7f7aa00b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:35.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.399+0000 7f7ab3e00700 1 -- 172.21.15.82:0/2427503979 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f7aa40e2600 con 0x7f7abc102080 2024-05-08T05:52:35.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.399+0000 7f7abaa00700 1 --2- 172.21.15.82:0/2427503979 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7aa00b28b0 0x7f7aa00b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:35.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.400+0000 7f7abb400700 1 --2- 172.21.15.82:0/3164501535 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56151e63f870 0x56151e63fc50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7ab4009bf0 tx=0x7f7ab4009f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9bff08e11946613e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:52:35.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.401+0000 7f7aabe00700 1 -- 172.21.15.82:0/3164501535 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab400fbc0 con 0x56151e63f870 2024-05-08T05:52:35.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.401+0000 7f7aabe00700 1 -- 172.21.15.82:0/3164501535 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ab400fd60 con 0x56151e63f870 2024-05-08T05:52:35.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.401+0000 7f7aabe00700 1 -- 172.21.15.82:0/3164501535 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab4011440 con 0x56151e63f870 2024-05-08T05:52:35.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.402+0000 7f7acc445b80 1 -- 172.21.15.82:0/3164501535 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56151e63f870 msgr2=0x56151e63fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:35.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.402+0000 7f7acc445b80 1 --2- 172.21.15.82:0/3164501535 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56151e63f870 0x56151e63fc50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f7ab4009bf0 tx=0x7f7ab4009f00 comp rx=0 tx=0).stop 2024-05-08T05:52:35.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.402+0000 7f7abaa00700 1 --2- 172.21.15.82:0/2427503979 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7aa00b28b0 0x7f7aa00b4d70 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7aac00c1b0 tx=0x7f7aac006230 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:52:35.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.402+0000 7f7acc445b80 1 -- 172.21.15.82:0/3164501535 shutdown_connections 2024-05-08T05:52:35.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.402+0000 7f7acc445b80 1 --2- 172.21.15.82:0/3164501535 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56151e6441e0 0x56151e644640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:35.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.402+0000 7f7acc445b80 1 --2- 172.21.15.82:0/3164501535 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56151e63f870 0x56151e63fc50 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:35.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.402+0000 7f7acc445b80 1 --2- 172.21.15.82:0/3164501535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56151e640190 0x56151e643ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:35.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.402+0000 7f7acc445b80 1 -- 172.21.15.82:0/3164501535 >> 172.21.15.82:0/3164501535 conn(0x56151e565b60 msgr2=0x56151e6317a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:52:35.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.402+0000 7f7acc445b80 1 -- 172.21.15.82:0/3164501535 shutdown_connections 2024-05-08T05:52:35.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.403+0000 7f7acc445b80 1 -- 172.21.15.82:0/3164501535 wait complete. 2024-05-08T05:52:35.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.403+0000 7f7acc445b80 1 -- start start 2024-05-08T05:52:35.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.403+0000 7f7acc445b80 1 Processor -- start 2024-05-08T05:52:35.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.404+0000 7f7acc445b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56151e63f870 0x56151e64b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:35.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.404+0000 7f7acc445b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56151e640190 0x56151e648990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:35.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.404+0000 7f7acc445b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56151e6441e0 0x56151e648ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:35.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.404+0000 7f7acc445b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56151e64c3f0 con 0x56151e6441e0 2024-05-08T05:52:35.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.404+0000 7f7acc445b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56151e4efb20 con 0x56151e63f870 2024-05-08T05:52:35.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.404+0000 7f7acc445b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56151e64c570 con 0x56151e640190 2024-05-08T05:52:35.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.404+0000 7f7acc445b80 10 client.0 _ll_register_callbacks cb 0x56151e530c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:52:35.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.404+0000 7f7ab2000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56151e640190 0x56151e648990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:35.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.404+0000 7f7ab2000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56151e640190 0x56151e648990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:41350/0 (socket says 172.21.15.82:41350) 2024-05-08T05:52:35.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.404+0000 7f7ab2000700 1 -- 172.21.15.82:0/2848381569 learned_addr learned my addr 172.21.15.82:0/2848381569 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:52:35.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.405+0000 7f7abb400700 1 --2- 172.21.15.82:0/2848381569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56151e6441e0 0x56151e648ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:35.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.405+0000 7f7abaa00700 1 --2- 172.21.15.82:0/2848381569 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56151e63f870 0x56151e64b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:35.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.405+0000 7f7ab2000700 1 -- 172.21.15.82:0/2848381569 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56151e63f870 msgr2=0x56151e64b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:35.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.405+0000 7f7ab2000700 1 --2- 172.21.15.82:0/2848381569 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56151e63f870 0x56151e64b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:35.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.405+0000 7f7ab2000700 1 -- 172.21.15.82:0/2848381569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56151e6441e0 msgr2=0x56151e648ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:35.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.405+0000 7f7ab2000700 1 --2- 172.21.15.82:0/2848381569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56151e6441e0 0x56151e648ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:35.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.405+0000 7f7ab2000700 1 -- 172.21.15.82:0/2848381569 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56151e54f420 con 0x56151e640190 2024-05-08T05:52:35.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.406+0000 7f7ab2000700 1 --2- 172.21.15.82:0/2848381569 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56151e640190 0x56151e648990 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7aa40e00b0 tx=0x7f7aa40a93f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcd45d41c11f908e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:52:35.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.406+0000 7f7aa8c00700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:52:35.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.406+0000 7f7aa8c00700 1 -- 172.21.15.82:0/2848381569 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa40a9bd0 con 0x56151e640190 2024-05-08T05:52:35.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.406+0000 7f7aa8c00700 1 -- 172.21.15.82:0/2848381569 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f7aa40a9e30 con 0x56151e640190 2024-05-08T05:52:35.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.406+0000 7f7acc445b80 1 -- 172.21.15.82:0/2848381569 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ab400fd60 con 0x56151e640190 2024-05-08T05:52:35.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.406+0000 7f7aa8c00700 1 -- 172.21.15.82:0/2848381569 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7aa40c4280 con 0x56151e640190 2024-05-08T05:52:35.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.407+0000 7f7acc445b80 10 client.25432 fetch_fsmap learned FSMap version 30 2024-05-08T05:52:35.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.407+0000 7f7acc445b80 1 -- 172.21.15.82:0/2848381569 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56151e656bf0 con 0x56151e640190 2024-05-08T05:52:35.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.407+0000 7f7aa8c00700 1 -- 172.21.15.82:0/2848381569 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7ab400fd60 con 0x56151e640190 2024-05-08T05:52:35.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.407+0000 7f7aa8c00700 1 -- 172.21.15.82:0/2848381569 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f7aa40a5040 con 0x56151e640190 2024-05-08T05:52:35.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.407+0000 7f7acc445b80 10 client.25432 fetch_fsmap finished waiting for FSMap version 30 2024-05-08T05:52:35.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.407+0000 7f7acc445b80 10 client.25432 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-08T05:52:35.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.407+0000 7f7acc445b80 20 client.25432 populate_metadata read hostname 'smithi082' 2024-05-08T05:52:35.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.407+0000 7f7acc445b80 1 --2- 172.21.15.82:0/2848381569 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x56151e659230 0x56151e65b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:35.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.407+0000 7f7acc445b80 4 client.25432 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:52:35.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.407+0000 7f7acc445b80 1 -- 172.21.15.82:0/2848381569 --> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56151e6040a0 con 0x56151e659230 2024-05-08T05:52:35.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.408+0000 7f7abaa00700 1 --2- 172.21.15.82:0/2848381569 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x56151e659230 0x56151e65b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:35.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.408+0000 7f7abaa00700 1 --2- 172.21.15.82:0/2848381569 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x56151e659230 0x56151e65b620 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=229ffc31e04ce19f server_cookie=555a2c3dd0b5e212 in_seq=0 out_seq=0 2024-05-08T05:52:35.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.408+0000 7f7aa8c00700 10 client.25432 ms_handle_connect on v2:172.21.15.151:6838/2963754236 2024-05-08T05:52:35.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.410+0000 7f7aa8c00700 1 -- 172.21.15.82:0/2848381569 <== mds.1 v2:172.21.15.151:6838/2963754236 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56151e6040a0 con 0x56151e659230 2024-05-08T05:52:35.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.410+0000 7f7aa8c00700 10 client.25432 handle_command_reply: tid=0 2024-05-08T05:52:35.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.410+0000 7f7acc445b80 1 client.25432 shutdown 2024-05-08T05:52:35.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.411+0000 7f7acc445b80 1 -- 172.21.15.82:0/2848381569 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56151e640190 msgr2=0x56151e648990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:35.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.411+0000 7f7acc445b80 1 --2- 172.21.15.82:0/2848381569 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56151e640190 0x56151e648990 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7aa40e00b0 tx=0x7f7aa40a93f0 comp rx=0 tx=0).stop 2024-05-08T05:52:35.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.412+0000 7f7acc445b80 1 -- 172.21.15.82:0/2848381569 shutdown_connections 2024-05-08T05:52:35.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.412+0000 7f7acc445b80 1 --2- 172.21.15.82:0/2848381569 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x56151e659230 0x56151e65b620 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:35.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.412+0000 7f7acc445b80 1 --2- 172.21.15.82:0/2848381569 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56151e63f870 0x56151e64b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:35.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.412+0000 7f7acc445b80 1 --2- 172.21.15.82:0/2848381569 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56151e6441e0 0x56151e648ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:35.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.412+0000 7f7acc445b80 1 --2- 172.21.15.82:0/2848381569 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56151e640190 0x56151e648990 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:35.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.412+0000 7f7aa8c00700 0 client.25432 ms_handle_reset on v2:172.21.15.151:6838/2963754236 2024-05-08T05:52:35.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.412+0000 7f7acc445b80 1 -- 172.21.15.82:0/2848381569 >> 172.21.15.82:0/2848381569 conn(0x56151e565b60 msgr2=0x56151e62c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:52:35.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.412+0000 7f7acc445b80 1 -- 172.21.15.82:0/2848381569 shutdown_connections 2024-05-08T05:52:35.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.413+0000 7f7acc445b80 1 -- 172.21.15.82:0/2848381569 wait complete. 2024-05-08T05:52:35.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.413+0000 7f7acc445b80 20 client.25432 trim_cache size 0 max 16384 2024-05-08T05:52:35.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.438+0000 7f7acc445b80 1 Processor -- start 2024-05-08T05:52:35.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.439+0000 7f7acc445b80 1 -- start start 2024-05-08T05:52:35.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.439+0000 7f7acc445b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56151e63f870 0x56151e6554b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:35.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.439+0000 7f7acc445b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56151e640190 0x56151e645480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:35.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.439+0000 7f7acc445b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56151e6441e0 0x56151e660e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:35.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.439+0000 7f7acc445b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7abc1b4200 con 0x56151e6441e0 2024-05-08T05:52:35.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.439+0000 7f7acc445b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7abc1b5d70 con 0x56151e63f870 2024-05-08T05:52:35.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.439+0000 7f7acc445b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7abc1b48d0 con 0x56151e640190 2024-05-08T05:52:35.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.440+0000 7f7abaa00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56151e63f870 0x56151e6554b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:35.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.440+0000 7f7abaa00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56151e63f870 0x56151e6554b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:49472/0 (socket says 172.21.15.82:49472) 2024-05-08T05:52:35.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.440+0000 7f7abaa00700 1 -- 172.21.15.82:0/335475565 learned_addr learned my addr 172.21.15.82:0/335475565 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:52:35.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.440+0000 7f7ab2000700 1 --2- 172.21.15.82:0/335475565 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56151e640190 0x56151e645480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:35.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.440+0000 7f7abaa00700 1 -- 172.21.15.82:0/335475565 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56151e640190 msgr2=0x56151e645480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:35.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.440+0000 7f7abaa00700 1 --2- 172.21.15.82:0/335475565 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56151e640190 0x56151e645480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:35.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.440+0000 7f7abaa00700 1 -- 172.21.15.82:0/335475565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56151e6441e0 msgr2=0x56151e660e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:35.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.440+0000 7f7abb400700 1 --2- 172.21.15.82:0/335475565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56151e6441e0 0x56151e660e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:35.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.441+0000 7f7abaa00700 1 --2- 172.21.15.82:0/335475565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56151e6441e0 0x56151e660e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:35.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.441+0000 7f7abaa00700 1 -- 172.21.15.82:0/335475565 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56151e6459c0 con 0x56151e63f870 2024-05-08T05:52:35.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.441+0000 7f7abb400700 1 --2- 172.21.15.82:0/335475565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56151e6441e0 0x56151e660e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:52:35.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.441+0000 7f7abaa00700 1 --2- 172.21.15.82:0/335475565 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56151e63f870 0x56151e6554b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7aac012690 tx=0x7f7aac01d000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6247f2f73a224d74 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:52:35.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.441+0000 7f7aab400700 1 -- 172.21.15.82:0/335475565 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aac003d30 con 0x56151e63f870 2024-05-08T05:52:35.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.442+0000 7f7aab400700 1 -- 172.21.15.82:0/335475565 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7aac02e070 con 0x56151e63f870 2024-05-08T05:52:35.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.442+0000 7f7aab400700 1 -- 172.21.15.82:0/335475565 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aac0052d0 con 0x56151e63f870 2024-05-08T05:52:35.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.442+0000 7f7acc445b80 1 -- 172.21.15.82:0/335475565 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56151e63f870 msgr2=0x56151e6554b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:35.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.442+0000 7f7acc445b80 1 --2- 172.21.15.82:0/335475565 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56151e63f870 0x56151e6554b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7aac012690 tx=0x7f7aac01d000 comp rx=0 tx=0).stop 2024-05-08T05:52:35.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.442+0000 7f7acc445b80 1 -- 172.21.15.82:0/335475565 shutdown_connections 2024-05-08T05:52:35.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.442+0000 7f7acc445b80 1 --2- 172.21.15.82:0/335475565 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56151e63f870 0x56151e6554b0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:35.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.442+0000 7f7acc445b80 1 --2- 172.21.15.82:0/335475565 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56151e6441e0 0x56151e660e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:35.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.442+0000 7f7acc445b80 1 --2- 172.21.15.82:0/335475565 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56151e640190 0x56151e645480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:35.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.442+0000 7f7acc445b80 1 -- 172.21.15.82:0/335475565 >> 172.21.15.82:0/335475565 conn(0x56151e565b60 msgr2=0x56151e644d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:52:35.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.442+0000 7f7acc445b80 1 -- 172.21.15.82:0/335475565 shutdown_connections 2024-05-08T05:52:35.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.442+0000 7f7acc445b80 1 -- 172.21.15.82:0/335475565 wait complete. 2024-05-08T05:52:35.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.443+0000 7f7acc445b80 1 -- start start 2024-05-08T05:52:35.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.444+0000 7f7acc445b80 1 Processor -- start 2024-05-08T05:52:35.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.444+0000 7f7acc445b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56151e63f870 0x56151e651830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:35.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.444+0000 7f7acc445b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56151e640190 0x56151e651d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:35.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.444+0000 7f7acc445b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56151e6441e0 0x56151e640b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:35.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.444+0000 7f7acc445b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7abc1b5670 con 0x56151e640190 2024-05-08T05:52:35.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.444+0000 7f7acc445b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7abc1b4fa0 con 0x56151e63f870 2024-05-08T05:52:35.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.444+0000 7f7acc445b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7abc071d90 con 0x56151e6441e0 2024-05-08T05:52:35.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.444+0000 7f7acc445b80 10 client.0 _ll_register_callbacks cb 0x56151e530c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:52:35.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.444+0000 7f7abb400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56151e6441e0 0x56151e640b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:35.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.444+0000 7f7abb400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56151e6441e0 0x56151e640b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:41366/0 (socket says 172.21.15.82:41366) 2024-05-08T05:52:35.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.444+0000 7f7abb400700 1 -- 172.21.15.82:0/1770240764 learned_addr learned my addr 172.21.15.82:0/1770240764 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:52:35.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.445+0000 7f7abaa00700 1 --2- 172.21.15.82:0/1770240764 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56151e63f870 0x56151e651830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:35.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.445+0000 7f7ab2000700 1 --2- 172.21.15.82:0/1770240764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56151e640190 0x56151e651d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:35.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.445+0000 7f7abb400700 1 -- 172.21.15.82:0/1770240764 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56151e63f870 msgr2=0x56151e651830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:35.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.445+0000 7f7abb400700 1 --2- 172.21.15.82:0/1770240764 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56151e63f870 0x56151e651830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:35.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.445+0000 7f7abb400700 1 -- 172.21.15.82:0/1770240764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56151e640190 msgr2=0x56151e651d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:35.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.445+0000 7f7abb400700 1 --2- 172.21.15.82:0/1770240764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56151e640190 0x56151e651d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:35.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.445+0000 7f7abb400700 1 -- 172.21.15.82:0/1770240764 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56151e6410d0 con 0x56151e6441e0 2024-05-08T05:52:35.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.445+0000 7f7abb400700 1 --2- 172.21.15.82:0/1770240764 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56151e6441e0 0x56151e640b90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7ab400a010 tx=0x7f7ab4005600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df5c3f2144fbd9c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:52:35.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.445+0000 7f7aa8c00700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:52:35.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.446+0000 7f7aa8c00700 1 -- 172.21.15.82:0/1770240764 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab400fdd0 con 0x56151e6441e0 2024-05-08T05:52:35.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.446+0000 7f7aa8c00700 1 -- 172.21.15.82:0/1770240764 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f7ab400fbd0 con 0x56151e6441e0 2024-05-08T05:52:35.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.446+0000 7f7acc445b80 1 -- 172.21.15.82:0/1770240764 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7aac02e070 con 0x56151e6441e0 2024-05-08T05:52:35.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.447+0000 7f7aa8c00700 1 -- 172.21.15.82:0/1770240764 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f7ab400fdd0 con 0x56151e6441e0 2024-05-08T05:52:35.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.447+0000 7f7acc445b80 10 client.25438 fetch_fsmap learned FSMap version 30 2024-05-08T05:52:35.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.447+0000 7f7acc445b80 1 -- 172.21.15.82:0/1770240764 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56151e6422e0 con 0x56151e6441e0 2024-05-08T05:52:35.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.448+0000 7f7aa8c00700 1 -- 172.21.15.82:0/1770240764 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7aac02e070 con 0x56151e6441e0 2024-05-08T05:52:35.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.448+0000 7f7aa8c00700 1 -- 172.21.15.82:0/1770240764 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f7ab401b4a0 con 0x56151e6441e0 2024-05-08T05:52:35.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.448+0000 7f7acc445b80 10 client.25438 fetch_fsmap finished waiting for FSMap version 30 2024-05-08T05:52:35.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.448+0000 7f7acc445b80 10 client.25438 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-08T05:52:35.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.448+0000 7f7acc445b80 20 client.25438 populate_metadata read hostname 'smithi082' 2024-05-08T05:52:35.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.448+0000 7f7acc445b80 1 --2- 172.21.15.82:0/1770240764 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x56151e642660 0x56151e6c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:35.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.448+0000 7f7acc445b80 4 client.25438 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:52:35.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.448+0000 7f7acc445b80 1 -- 172.21.15.82:0/1770240764 --> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56151e597400 con 0x56151e642660 2024-05-08T05:52:35.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.449+0000 7f7abaa00700 1 --2- 172.21.15.82:0/1770240764 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x56151e642660 0x56151e6c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:35.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.450+0000 7f7abaa00700 1 --2- 172.21.15.82:0/1770240764 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x56151e642660 0x56151e6c6a00 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=70da154ab7f10309 server_cookie=51689d9b10e539e8 in_seq=0 out_seq=0 2024-05-08T05:52:35.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.450+0000 7f7aa8c00700 10 client.25438 ms_handle_connect on v2:172.21.15.151:6838/2963754236 2024-05-08T05:52:35.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.450+0000 7f7aa8c00700 1 -- 172.21.15.82:0/1770240764 <== mds.1 v2:172.21.15.151:6838/2963754236 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56151e597400 con 0x56151e642660 2024-05-08T05:52:35.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.450+0000 7f7aa8c00700 10 client.25438 handle_command_reply: tid=0 2024-05-08T05:52:35.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.451+0000 7f7acc445b80 1 client.25438 shutdown 2024-05-08T05:52:35.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.451+0000 7f7acc445b80 1 -- 172.21.15.82:0/1770240764 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56151e6441e0 msgr2=0x56151e640b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:35.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.451+0000 7f7acc445b80 1 --2- 172.21.15.82:0/1770240764 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56151e6441e0 0x56151e640b90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7ab400a010 tx=0x7f7ab4005600 comp rx=0 tx=0).stop 2024-05-08T05:52:35.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.451+0000 7f7acc445b80 1 -- 172.21.15.82:0/1770240764 shutdown_connections 2024-05-08T05:52:35.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.451+0000 7f7acc445b80 1 --2- 172.21.15.82:0/1770240764 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x56151e642660 0x56151e6c6a00 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:35.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.451+0000 7f7acc445b80 1 --2- 172.21.15.82:0/1770240764 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56151e63f870 0x56151e651830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:35.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.451+0000 7f7acc445b80 1 --2- 172.21.15.82:0/1770240764 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56151e6441e0 0x56151e640b90 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:35.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.451+0000 7f7acc445b80 1 --2- 172.21.15.82:0/1770240764 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56151e640190 0x56151e651d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:35.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.451+0000 7f7acc445b80 1 -- 172.21.15.82:0/1770240764 >> 172.21.15.82:0/1770240764 conn(0x56151e565b60 msgr2=0x56151e62ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:52:35.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.451+0000 7f7aa8c00700 0 client.25438 ms_handle_reset on v2:172.21.15.151:6838/2963754236 2024-05-08T05:52:35.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.451+0000 7f7acc445b80 1 -- 172.21.15.82:0/1770240764 shutdown_connections 2024-05-08T05:52:35.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.451+0000 7f7acc445b80 1 -- 172.21.15.82:0/1770240764 wait complete. 2024-05-08T05:52:35.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.452+0000 7f7acc445b80 20 client.25438 trim_cache size 0 max 16384 2024-05-08T05:52:35.453 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T05:52:35.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.452+0000 7f7ac1a00700 1 -- 172.21.15.82:0/2427503979 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7aa00b28b0 msgr2=0x7f7aa00b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:35.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.452+0000 7f7ac1a00700 1 --2- 172.21.15.82:0/2427503979 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7aa00b28b0 0x7f7aa00b4d70 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7aac00c1b0 tx=0x7f7aac006230 comp rx=0 tx=0).stop 2024-05-08T05:52:35.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.452+0000 7f7ac1a00700 1 -- 172.21.15.82:0/2427503979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7abc102080 msgr2=0x7f7abc072180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:35.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.452+0000 7f7ac1a00700 1 --2- 172.21.15.82:0/2427503979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7abc102080 0x7f7abc072180 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7aa400e9c0 tx=0x7f7aa400ed80 comp rx=0 tx=0).stop 2024-05-08T05:52:35.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.453+0000 7f7ac1a00700 1 -- 172.21.15.82:0/2427503979 shutdown_connections 2024-05-08T05:52:35.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.453+0000 7f7ac1a00700 1 --2- 172.21.15.82:0/2427503979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7abc1076c0 0x7f7abc072720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:35.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.453+0000 7f7ac1a00700 1 --2- 172.21.15.82:0/2427503979 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7aa00b28b0 0x7f7aa00b4d70 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:35.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.453+0000 7f7ac1a00700 1 --2- 172.21.15.82:0/2427503979 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7abc1016c0 0x7f7abc075080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:35.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.453+0000 7f7ac1a00700 1 --2- 172.21.15.82:0/2427503979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7abc102080 0x7f7abc072180 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:35.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.453+0000 7f7ac1a00700 1 -- 172.21.15.82:0/2427503979 >> 172.21.15.82:0/2427503979 conn(0x7f7abc0785a0 msgr2=0x7f7abc1045f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:52:35.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.453+0000 7f7ac1a00700 1 -- 172.21.15.82:0/2427503979 shutdown_connections 2024-05-08T05:52:35.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:35.453+0000 7f7ac1a00700 1 -- 172.21.15.82:0/2427503979 wait complete. 2024-05-08T05:52:36.111 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:52:35 smithi082 ceph-mon[30098]: pgmap v517: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.4 MiB/s wr, 766 op/s 2024-05-08T05:52:36.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:52:35 smithi151 ceph-mon[34815]: pgmap v517: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.4 MiB/s wr, 766 op/s 2024-05-08T05:52:36.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:52:35 smithi134 ceph-mon[34132]: pgmap v517: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.4 MiB/s wr, 766 op/s 2024-05-08T05:52:36.594 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-05-08T05:52:37.239 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:52:38.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:52:37 smithi151 ceph-mon[34815]: pgmap v518: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.0 MiB/s wr, 667 op/s 2024-05-08T05:52:38.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:52:37 smithi082 ceph-mon[30098]: pgmap v518: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.0 MiB/s wr, 667 op/s 2024-05-08T05:52:38.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:52:37 smithi134 ceph-mon[34132]: pgmap v518: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.0 MiB/s wr, 667 op/s 2024-05-08T05:52:39.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.753+0000 7f61ad800700 1 -- 172.21.15.82:0/3175289579 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61a8114380 msgr2=0x7f61a8116770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:39.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.753+0000 7f61ad800700 1 --2- 172.21.15.82:0/3175289579 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61a8114380 0x7f61a8116770 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f61a000b0a0 tx=0x7f61a000b3b0 comp rx=0 tx=0).stop 2024-05-08T05:52:39.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.753+0000 7f61ad800700 1 -- 172.21.15.82:0/3175289579 shutdown_connections 2024-05-08T05:52:39.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.753+0000 7f61ad800700 1 --2- 172.21.15.82:0/3175289579 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61a80779d0 0x7f61a8077db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:39.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.753+0000 7f61ad800700 1 --2- 172.21.15.82:0/3175289579 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61a8114380 0x7f61a8116770 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:39.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.753+0000 7f61ad800700 1 --2- 172.21.15.82:0/3175289579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61a80782f0 0x7f61a8113e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:39.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.753+0000 7f61ad800700 1 -- 172.21.15.82:0/3175289579 >> 172.21.15.82:0/3175289579 conn(0x7f61a81011d0 msgr2=0x7f61a81035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:52:39.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.753+0000 7f61ad800700 1 -- 172.21.15.82:0/3175289579 shutdown_connections 2024-05-08T05:52:39.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.753+0000 7f61ad800700 1 -- 172.21.15.82:0/3175289579 wait complete. 2024-05-08T05:52:39.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.754+0000 7f61ad800700 1 Processor -- start 2024-05-08T05:52:39.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.754+0000 7f61ad800700 1 -- start start 2024-05-08T05:52:39.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.754+0000 7f61ad800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61a80779d0 0x7f61a81a01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:39.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.754+0000 7f61ad800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61a80782f0 0x7f61a81a0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:39.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.754+0000 7f61ad800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61a8114380 0x7f61a81a4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:39.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.754+0000 7f61ad800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f61a8119d10 con 0x7f61a80782f0 2024-05-08T05:52:39.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.754+0000 7f61ad800700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f61a8119b90 con 0x7f61a8114380 2024-05-08T05:52:39.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.754+0000 7f61ad800700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f61a8119e90 con 0x7f61a80779d0 2024-05-08T05:52:39.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.755+0000 7f61a6a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61a80779d0 0x7f61a81a01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:39.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.755+0000 7f61a6a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61a80779d0 0x7f61a81a01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:41384/0 (socket says 172.21.15.82:41384) 2024-05-08T05:52:39.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.755+0000 7f61a6a00700 1 -- 172.21.15.82:0/3676890072 learned_addr learned my addr 172.21.15.82:0/3676890072 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:52:39.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.755+0000 7f61a6000700 1 --2- 172.21.15.82:0/3676890072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61a80782f0 0x7f61a81a0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:39.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.755+0000 7f61a7400700 1 --2- 172.21.15.82:0/3676890072 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61a8114380 0x7f61a81a4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:39.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.755+0000 7f61a6a00700 1 -- 172.21.15.82:0/3676890072 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61a8114380 msgr2=0x7f61a81a4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:39.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.755+0000 7f61a6a00700 1 --2- 172.21.15.82:0/3676890072 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61a8114380 0x7f61a81a4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:39.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.755+0000 7f61a6a00700 1 -- 172.21.15.82:0/3676890072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61a80782f0 msgr2=0x7f61a81a0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:39.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.755+0000 7f61a6a00700 1 --2- 172.21.15.82:0/3676890072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61a80782f0 0x7f61a81a0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:39.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.755+0000 7f61a6a00700 1 -- 172.21.15.82:0/3676890072 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61a81a51d0 con 0x7f61a80779d0 2024-05-08T05:52:39.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.756+0000 7f61a7400700 1 --2- 172.21.15.82:0/3676890072 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61a8114380 0x7f61a81a4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:52:39.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.756+0000 7f61a6000700 1 --2- 172.21.15.82:0/3676890072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61a80782f0 0x7f61a81a0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:52:39.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.756+0000 7f61a6a00700 1 --2- 172.21.15.82:0/3676890072 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61a80779d0 0x7f61a81a01c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f619800d950 tx=0x7f619800dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:52:39.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.756+0000 7f619f400700 1 -- 172.21.15.82:0/3676890072 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6198016070 con 0x7f61a80779d0 2024-05-08T05:52:39.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.756+0000 7f619f400700 1 -- 172.21.15.82:0/3676890072 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f619800fd40 con 0x7f61a80779d0 2024-05-08T05:52:39.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.756+0000 7f619f400700 1 -- 172.21.15.82:0/3676890072 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f619800e3b0 con 0x7f61a80779d0 2024-05-08T05:52:39.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.757+0000 7f61ad800700 1 -- 172.21.15.82:0/3676890072 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61a81a54c0 con 0x7f61a80779d0 2024-05-08T05:52:39.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.758+0000 7f61ad800700 1 -- 172.21.15.82:0/3676890072 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61a81acd40 con 0x7f61a80779d0 2024-05-08T05:52:39.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.765+0000 7f61b8216b80 1 Processor -- start 2024-05-08T05:52:39.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.766+0000 7f619f400700 1 -- 172.21.15.82:0/3676890072 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f6198019070 con 0x7f61a80779d0 2024-05-08T05:52:39.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.766+0000 7f61b8216b80 1 -- start start 2024-05-08T05:52:39.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.766+0000 7f61b8216b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564816cfabc0 0x564816cfafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:39.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.766+0000 7f61b8216b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564816cfb4e0 0x564816cf52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:39.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.766+0000 7f61b8216b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564816cf58f0 0x564816cf5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:39.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.766+0000 7f61b8216b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x564816c47a20 con 0x564816cfb4e0 2024-05-08T05:52:39.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.766+0000 7f61b8216b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564816be5760 con 0x564816cfabc0 2024-05-08T05:52:39.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.766+0000 7f61b8216b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564816c439e0 con 0x564816cf58f0 2024-05-08T05:52:39.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.767+0000 7f61a6000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564816cf58f0 0x564816cf5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:39.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.767+0000 7f61a6a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564816cfb4e0 0x564816cf52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:39.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.767+0000 7f61a7400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564816cfabc0 0x564816cfafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:39.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.767+0000 7f61a6a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564816cfb4e0 0x564816cf52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48036/0 (socket says 172.21.15.82:48036) 2024-05-08T05:52:39.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.767+0000 7f61a6a00700 1 -- 172.21.15.82:0/922367922 learned_addr learned my addr 172.21.15.82:0/922367922 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:52:39.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.767+0000 7f61a6000700 1 -- 172.21.15.82:0/922367922 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564816cfabc0 msgr2=0x564816cfafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:39.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.767+0000 7f61a6000700 1 --2- 172.21.15.82:0/922367922 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564816cfabc0 0x564816cfafa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:39.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.767+0000 7f61a6000700 1 -- 172.21.15.82:0/922367922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564816cfb4e0 msgr2=0x564816cf52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:39.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.767+0000 7f61a6000700 1 --2- 172.21.15.82:0/922367922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564816cfb4e0 0x564816cf52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:39.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.767+0000 7f61a6000700 1 -- 172.21.15.82:0/922367922 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564816b948d0 con 0x564816cf58f0 2024-05-08T05:52:39.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.767+0000 7f619f400700 1 --2- 172.21.15.82:0/3676890072 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f618c0b29d0 0x7f618c0b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:39.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.767+0000 7f61a6a00700 1 --2- 172.21.15.82:0/922367922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564816cfb4e0 0x564816cf52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:52:39.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.768+0000 7f619f400700 1 -- 172.21.15.82:0/3676890072 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f61980e1bc0 con 0x7f61a80779d0 2024-05-08T05:52:39.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.768+0000 7f61a6000700 1 --2- 172.21.15.82:0/922367922 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564816cf58f0 0x564816cf5d70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6194009fb0 tx=0x7f6194011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6813cf9c38f88a18 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:52:39.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.768+0000 7f61a7400700 1 --2- 172.21.15.82:0/3676890072 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f618c0b29d0 0x7f618c0b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:39.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.768+0000 7f6193e00700 1 -- 172.21.15.82:0/922367922 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6194004230 con 0x564816cf58f0 2024-05-08T05:52:39.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.768+0000 7f6193e00700 1 -- 172.21.15.82:0/922367922 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6194004ce0 con 0x564816cf58f0 2024-05-08T05:52:39.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.768+0000 7f6193e00700 1 -- 172.21.15.82:0/922367922 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61940056c0 con 0x564816cf58f0 2024-05-08T05:52:39.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.770+0000 7f61a7400700 1 --2- 172.21.15.82:0/3676890072 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f618c0b29d0 0x7f618c0b4e90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f61a0009fd0 tx=0x7f61a001d040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:52:39.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.771+0000 7f61b8216b80 1 -- 172.21.15.82:0/922367922 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564816cf58f0 msgr2=0x564816cf5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:39.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.771+0000 7f61b8216b80 1 --2- 172.21.15.82:0/922367922 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564816cf58f0 0x564816cf5d70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6194009fb0 tx=0x7f6194011720 comp rx=0 tx=0).stop 2024-05-08T05:52:39.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.771+0000 7f61b8216b80 1 -- 172.21.15.82:0/922367922 shutdown_connections 2024-05-08T05:52:39.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.771+0000 7f61b8216b80 1 --2- 172.21.15.82:0/922367922 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564816cfabc0 0x564816cfafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:39.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.771+0000 7f61b8216b80 1 --2- 172.21.15.82:0/922367922 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564816cf58f0 0x564816cf5d70 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:39.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.771+0000 7f61b8216b80 1 --2- 172.21.15.82:0/922367922 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564816cfb4e0 0x564816cf52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:39.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.771+0000 7f61b8216b80 1 -- 172.21.15.82:0/922367922 >> 172.21.15.82:0/922367922 conn(0x564816c6d6d0 msgr2=0x564816cefb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:52:39.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.773+0000 7f61b8216b80 1 -- 172.21.15.82:0/922367922 shutdown_connections 2024-05-08T05:52:39.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.773+0000 7f61b8216b80 1 -- 172.21.15.82:0/922367922 wait complete. 2024-05-08T05:52:39.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.773+0000 7f61b8216b80 1 -- start start 2024-05-08T05:52:39.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.773+0000 7f61b8216b80 1 Processor -- start 2024-05-08T05:52:39.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.774+0000 7f61b8216b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564816cf58f0 0x564816d01110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:39.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.774+0000 7f61b8216b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564816cfabc0 0x564816cfe4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:39.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.774+0000 7f61b8216b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564816cfb4e0 0x564816cfe9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:39.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.774+0000 7f61b8216b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x564816d01f20 con 0x564816cfabc0 2024-05-08T05:52:39.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.774+0000 7f61b8216b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564816badb20 con 0x564816cfb4e0 2024-05-08T05:52:39.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.774+0000 7f61b8216b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564816d020a0 con 0x564816cf58f0 2024-05-08T05:52:39.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.774+0000 7f61b8216b80 10 client.0 _ll_register_callbacks cb 0x564816beec70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:52:39.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.774+0000 7f61a6a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564816cf58f0 0x564816d01110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:39.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.774+0000 7f61a6a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564816cf58f0 0x564816d01110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:41402/0 (socket says 172.21.15.82:41402) 2024-05-08T05:52:39.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.774+0000 7f61a6a00700 1 -- 172.21.15.82:0/2950562299 learned_addr learned my addr 172.21.15.82:0/2950562299 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:52:39.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.774+0000 7f61a7400700 1 --2- 172.21.15.82:0/2950562299 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564816cfb4e0 0x564816cfe9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:39.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.775+0000 7f61a6000700 1 --2- 172.21.15.82:0/2950562299 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564816cfabc0 0x564816cfe4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:39.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.775+0000 7f61a6a00700 1 -- 172.21.15.82:0/2950562299 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564816cfb4e0 msgr2=0x564816cfe9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:39.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.775+0000 7f61a6a00700 1 --2- 172.21.15.82:0/2950562299 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564816cfb4e0 0x564816cfe9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:39.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.775+0000 7f61a6a00700 1 -- 172.21.15.82:0/2950562299 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564816cfabc0 msgr2=0x564816cfe4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:39.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.775+0000 7f61a6a00700 1 --2- 172.21.15.82:0/2950562299 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564816cfabc0 0x564816cfe4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:39.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.775+0000 7f61a6a00700 1 -- 172.21.15.82:0/2950562299 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564816c0d420 con 0x564816cf58f0 2024-05-08T05:52:39.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.775+0000 7f61a6a00700 1 --2- 172.21.15.82:0/2950562299 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564816cf58f0 0x564816d01110 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f61980a6460 tx=0x7f6198005c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a06986a7de6b54a6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:52:39.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.775+0000 7f6190c00700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:52:39.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.775+0000 7f6190c00700 1 -- 172.21.15.82:0/2950562299 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6198020070 con 0x564816cf58f0 2024-05-08T05:52:39.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.775+0000 7f6190c00700 1 -- 172.21.15.82:0/2950562299 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f61980a9660 con 0x564816cf58f0 2024-05-08T05:52:39.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.775+0000 7f61b8216b80 1 -- 172.21.15.82:0/2950562299 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6194004ce0 con 0x564816cf58f0 2024-05-08T05:52:39.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.775+0000 7f6190c00700 1 -- 172.21.15.82:0/2950562299 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f61980a8b40 con 0x564816cf58f0 2024-05-08T05:52:39.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.776+0000 7f61b8216b80 10 client.25450 fetch_fsmap learned FSMap version 30 2024-05-08T05:52:39.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.776+0000 7f61b8216b80 1 -- 172.21.15.82:0/2950562299 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564816d1d750 con 0x564816cf58f0 2024-05-08T05:52:39.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.776+0000 7f6190c00700 1 -- 172.21.15.82:0/2950562299 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6194004ce0 con 0x564816cf58f0 2024-05-08T05:52:39.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.776+0000 7f6190c00700 1 -- 172.21.15.82:0/2950562299 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f61980b1bc0 con 0x564816cf58f0 2024-05-08T05:52:39.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.776+0000 7f61b8216b80 10 client.25450 fetch_fsmap finished waiting for FSMap version 30 2024-05-08T05:52:39.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.776+0000 7f61b8216b80 10 client.25450 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:52:39.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.776+0000 7f61b8216b80 20 client.25450 populate_metadata read hostname 'smithi082' 2024-05-08T05:52:39.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.776+0000 7f61b8216b80 1 --2- 172.21.15.82:0/2950562299 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x564816d1fd90 0x564816d22180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:39.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.776+0000 7f61b8216b80 4 client.25450 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:52:39.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.776+0000 7f61b8216b80 1 -- 172.21.15.82:0/2950562299 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564816cc2140 con 0x564816d1fd90 2024-05-08T05:52:39.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.777+0000 7f61a6000700 1 --2- 172.21.15.82:0/2950562299 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x564816d1fd90 0x564816d22180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:39.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.778+0000 7f61a6000700 1 --2- 172.21.15.82:0/2950562299 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x564816d1fd90 0x564816d22180 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92432f10a8836dd7 server_cookie=b1e7558d4da8e714 in_seq=0 out_seq=0 2024-05-08T05:52:39.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.778+0000 7f6190c00700 10 client.25450 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:52:39.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.779+0000 7f6190c00700 1 -- 172.21.15.82:0/2950562299 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564816cc2140 con 0x564816d1fd90 2024-05-08T05:52:39.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.779+0000 7f6190c00700 10 client.25450 handle_command_reply: tid=0 2024-05-08T05:52:39.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.779+0000 7f61b8216b80 1 client.25450 shutdown 2024-05-08T05:52:39.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.779+0000 7f61b8216b80 1 -- 172.21.15.82:0/2950562299 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564816cf58f0 msgr2=0x564816d01110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:39.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.779+0000 7f61b8216b80 1 --2- 172.21.15.82:0/2950562299 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564816cf58f0 0x564816d01110 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f61980a6460 tx=0x7f6198005c80 comp rx=0 tx=0).stop 2024-05-08T05:52:39.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.780+0000 7f61b8216b80 1 -- 172.21.15.82:0/2950562299 shutdown_connections 2024-05-08T05:52:39.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.780+0000 7f61b8216b80 1 --2- 172.21.15.82:0/2950562299 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x564816d1fd90 0x564816d22180 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:39.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.780+0000 7f61b8216b80 1 --2- 172.21.15.82:0/2950562299 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564816cfb4e0 0x564816cfe9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:39.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.780+0000 7f61b8216b80 1 --2- 172.21.15.82:0/2950562299 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564816cf58f0 0x564816d01110 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:39.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.780+0000 7f61b8216b80 1 --2- 172.21.15.82:0/2950562299 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564816cfabc0 0x564816cfe4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:39.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.780+0000 7f61b8216b80 1 -- 172.21.15.82:0/2950562299 >> 172.21.15.82:0/2950562299 conn(0x564816c6d6d0 msgr2=0x564816cef190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:52:39.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.781+0000 7f6190c00700 0 client.25450 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:52:39.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.781+0000 7f61b8216b80 1 -- 172.21.15.82:0/2950562299 shutdown_connections 2024-05-08T05:52:39.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.781+0000 7f61b8216b80 1 -- 172.21.15.82:0/2950562299 wait complete. 2024-05-08T05:52:39.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.781+0000 7f61b8216b80 20 client.25450 trim_cache size 0 max 16384 2024-05-08T05:52:39.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.807+0000 7f61b8216b80 1 Processor -- start 2024-05-08T05:52:39.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.807+0000 7f61b8216b80 1 -- start start 2024-05-08T05:52:39.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.807+0000 7f61b8216b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564816cf58f0 0x564816cf52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:39.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.808+0000 7f61b8216b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564816cfabc0 0x564816cfbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:39.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.808+0000 7f61a6a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564816cf58f0 0x564816cf52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:39.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.808+0000 7f61b8216b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564816cfb4e0 0x564816cef910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:39.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.808+0000 7f61b8216b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f61a8074150 con 0x564816cfb4e0 2024-05-08T05:52:39.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.808+0000 7f61b8216b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f61a81ad570 con 0x564816cf58f0 2024-05-08T05:52:39.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.808+0000 7f61b8216b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f61a8074820 con 0x564816cfabc0 2024-05-08T05:52:39.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.809+0000 7f61a6a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564816cf58f0 0x564816cf52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:49534/0 (socket says 172.21.15.82:49534) 2024-05-08T05:52:39.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.809+0000 7f61a6000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564816cfabc0 0x564816cfbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:39.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.809+0000 7f61a6a00700 1 -- 172.21.15.82:0/554766182 learned_addr learned my addr 172.21.15.82:0/554766182 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:52:39.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.809+0000 7f61a7400700 1 --2- 172.21.15.82:0/554766182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564816cfb4e0 0x564816cef910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:39.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.810+0000 7f61a6000700 1 -- 172.21.15.82:0/554766182 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564816cf58f0 msgr2=0x564816cf52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:39.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.810+0000 7f61a6000700 1 --2- 172.21.15.82:0/554766182 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564816cf58f0 0x564816cf52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:39.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.810+0000 7f61a6000700 1 -- 172.21.15.82:0/554766182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564816cfb4e0 msgr2=0x564816cef910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:39.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.810+0000 7f61a6000700 1 --2- 172.21.15.82:0/554766182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564816cfb4e0 0x564816cef910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:39.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.810+0000 7f61a6000700 1 -- 172.21.15.82:0/554766182 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564816d01480 con 0x564816cfabc0 2024-05-08T05:52:39.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.811+0000 7f61a6000700 1 --2- 172.21.15.82:0/554766182 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564816cfabc0 0x564816cfbfd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6194000c00 tx=0x7f61940052a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e512570a99db45a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:52:39.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.811+0000 7f6193400700 1 -- 172.21.15.82:0/554766182 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6194005090 con 0x564816cfabc0 2024-05-08T05:52:39.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.811+0000 7f6193400700 1 -- 172.21.15.82:0/554766182 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6194004b90 con 0x564816cfabc0 2024-05-08T05:52:39.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.811+0000 7f6193400700 1 -- 172.21.15.82:0/554766182 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f619402a640 con 0x564816cfabc0 2024-05-08T05:52:39.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.813+0000 7f61b8216b80 1 -- 172.21.15.82:0/554766182 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564816cfabc0 msgr2=0x564816cfbfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:39.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.813+0000 7f61b8216b80 1 --2- 172.21.15.82:0/554766182 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564816cfabc0 0x564816cfbfd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6194000c00 tx=0x7f61940052a0 comp rx=0 tx=0).stop 2024-05-08T05:52:39.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.813+0000 7f61b8216b80 1 -- 172.21.15.82:0/554766182 shutdown_connections 2024-05-08T05:52:39.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.813+0000 7f61b8216b80 1 --2- 172.21.15.82:0/554766182 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564816cf58f0 0x564816cf52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:39.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.813+0000 7f61b8216b80 1 --2- 172.21.15.82:0/554766182 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564816cfb4e0 0x564816cef910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:39.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.813+0000 7f61b8216b80 1 --2- 172.21.15.82:0/554766182 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564816cfabc0 0x564816cfbfd0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:39.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.813+0000 7f61b8216b80 1 -- 172.21.15.82:0/554766182 >> 172.21.15.82:0/554766182 conn(0x564816c6d6d0 msgr2=0x564816cfb8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:52:39.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.813+0000 7f61b8216b80 1 -- 172.21.15.82:0/554766182 shutdown_connections 2024-05-08T05:52:39.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.814+0000 7f61b8216b80 1 -- 172.21.15.82:0/554766182 wait complete. 2024-05-08T05:52:39.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.814+0000 7f61b8216b80 1 -- start start 2024-05-08T05:52:39.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.815+0000 7f61b8216b80 1 Processor -- start 2024-05-08T05:52:39.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.816+0000 7f61b8216b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564816cf58f0 0x564816d27f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:39.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.816+0000 7f61b8216b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564816cfabc0 0x564816d07330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:39.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.816+0000 7f61b8216b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564816cfb4e0 0x564816d07870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:39.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.816+0000 7f61b8216b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f61a81acf70 con 0x564816cfabc0 2024-05-08T05:52:39.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.816+0000 7f61b8216b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f61a8074ef0 con 0x564816cf58f0 2024-05-08T05:52:39.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.816+0000 7f61b8216b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f61a80720f0 con 0x564816cfb4e0 2024-05-08T05:52:39.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.816+0000 7f61b8216b80 10 client.0 _ll_register_callbacks cb 0x564816beec70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:52:39.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.817+0000 7f61a6000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564816cfabc0 0x564816d07330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:39.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.817+0000 7f61a6000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564816cfabc0 0x564816d07330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48064/0 (socket says 172.21.15.82:48064) 2024-05-08T05:52:39.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.817+0000 7f61a6000700 1 -- 172.21.15.82:0/1964930007 learned_addr learned my addr 172.21.15.82:0/1964930007 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:52:39.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.817+0000 7f61a6a00700 1 --2- 172.21.15.82:0/1964930007 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564816cf58f0 0x564816d27f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:39.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.817+0000 7f61a6000700 1 -- 172.21.15.82:0/1964930007 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564816cfb4e0 msgr2=0x564816d07870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T05:52:39.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.817+0000 7f61a6000700 1 --2- 172.21.15.82:0/1964930007 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564816cfb4e0 0x564816d07870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:39.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.817+0000 7f61a6000700 1 -- 172.21.15.82:0/1964930007 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564816cf58f0 msgr2=0x564816d27f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:39.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.817+0000 7f61a6000700 1 --2- 172.21.15.82:0/1964930007 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564816cf58f0 0x564816d27f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:39.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.817+0000 7f61a6000700 1 -- 172.21.15.82:0/1964930007 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564816d26b00 con 0x564816cfabc0 2024-05-08T05:52:39.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.818+0000 7f61a6000700 1 --2- 172.21.15.82:0/1964930007 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564816cfabc0 0x564816d07330 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6194011b40 tx=0x7f6194005ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a14290f3ad7ddeb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:52:39.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.818+0000 7f6190c00700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T05:52:39.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.818+0000 7f6190c00700 1 -- 172.21.15.82:0/1964930007 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6194038060 con 0x564816cfabc0 2024-05-08T05:52:39.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.818+0000 7f6190c00700 1 -- 172.21.15.82:0/1964930007 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f619402a330 con 0x564816cfabc0 2024-05-08T05:52:39.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.818+0000 7f61b8216b80 1 -- 172.21.15.82:0/1964930007 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6194004b90 con 0x564816cfabc0 2024-05-08T05:52:39.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.819+0000 7f6190c00700 1 -- 172.21.15.82:0/1964930007 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6194005440 con 0x564816cfabc0 2024-05-08T05:52:39.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.819+0000 7f61b8216b80 10 client.15276 fetch_fsmap learned FSMap version 30 2024-05-08T05:52:39.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.819+0000 7f61b8216b80 1 -- 172.21.15.82:0/1964930007 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x564816d89990 con 0x564816cfabc0 2024-05-08T05:52:39.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.819+0000 7f6190c00700 1 -- 172.21.15.82:0/1964930007 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6194004b90 con 0x564816cfabc0 2024-05-08T05:52:39.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.820+0000 7f6190c00700 1 -- 172.21.15.82:0/1964930007 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f61940038f0 con 0x564816cfabc0 2024-05-08T05:52:39.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.820+0000 7f61b8216b80 10 client.15276 fetch_fsmap finished waiting for FSMap version 30 2024-05-08T05:52:39.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.820+0000 7f61b8216b80 10 client.15276 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:52:39.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.820+0000 7f61b8216b80 20 client.15276 populate_metadata read hostname 'smithi082' 2024-05-08T05:52:39.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.820+0000 7f61b8216b80 1 --2- 172.21.15.82:0/1964930007 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x564816d89df0 0x564816d8c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:39.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.820+0000 7f61b8216b80 4 client.15276 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:52:39.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.820+0000 7f61b8216b80 1 -- 172.21.15.82:0/1964930007 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564816c55400 con 0x564816d89df0 2024-05-08T05:52:39.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.820+0000 7f61a6a00700 1 --2- 172.21.15.82:0/1964930007 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x564816d89df0 0x564816d8c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:39.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.822+0000 7f6190c00700 10 client.15276 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:52:39.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.824+0000 7f61a6a00700 1 --2- 172.21.15.82:0/1964930007 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x564816d89df0 0x564816d8c210 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c43ed8eae34a00c server_cookie=bc049376b0cb5373 in_seq=0 out_seq=0 2024-05-08T05:52:39.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.824+0000 7f6190c00700 1 -- 172.21.15.82:0/1964930007 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564816c55400 con 0x564816d89df0 2024-05-08T05:52:39.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.824+0000 7f6190c00700 10 client.15276 handle_command_reply: tid=0 2024-05-08T05:52:39.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.825+0000 7f61b8216b80 1 client.15276 shutdown 2024-05-08T05:52:39.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.825+0000 7f61b8216b80 1 -- 172.21.15.82:0/1964930007 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564816cfabc0 msgr2=0x564816d07330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:39.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.825+0000 7f61b8216b80 1 --2- 172.21.15.82:0/1964930007 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564816cfabc0 0x564816d07330 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6194011b40 tx=0x7f6194005ce0 comp rx=0 tx=0).stop 2024-05-08T05:52:39.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.826+0000 7f61b8216b80 1 -- 172.21.15.82:0/1964930007 shutdown_connections 2024-05-08T05:52:39.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.826+0000 7f61b8216b80 1 --2- 172.21.15.82:0/1964930007 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x564816d89df0 0x564816d8c210 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:39.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.826+0000 7f61b8216b80 1 --2- 172.21.15.82:0/1964930007 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564816cf58f0 0x564816d27f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:39.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.826+0000 7f61b8216b80 1 --2- 172.21.15.82:0/1964930007 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564816cfb4e0 0x564816d07870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:39.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.826+0000 7f61b8216b80 1 --2- 172.21.15.82:0/1964930007 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564816cfabc0 0x564816d07330 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:39.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.826+0000 7f6190c00700 0 client.15276 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:52:39.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.826+0000 7f61b8216b80 1 -- 172.21.15.82:0/1964930007 >> 172.21.15.82:0/1964930007 conn(0x564816c6d6d0 msgr2=0x564816cfdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:52:39.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.826+0000 7f61b8216b80 1 -- 172.21.15.82:0/1964930007 shutdown_connections 2024-05-08T05:52:39.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.826+0000 7f61b8216b80 1 -- 172.21.15.82:0/1964930007 wait complete. 2024-05-08T05:52:39.828 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T05:52:39.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.826+0000 7f61b8216b80 20 client.15276 trim_cache size 0 max 16384 2024-05-08T05:52:39.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.827+0000 7f61ad800700 1 -- 172.21.15.82:0/3676890072 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f618c0b29d0 msgr2=0x7f618c0b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:39.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.827+0000 7f61ad800700 1 --2- 172.21.15.82:0/3676890072 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f618c0b29d0 0x7f618c0b4e90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f61a0009fd0 tx=0x7f61a001d040 comp rx=0 tx=0).stop 2024-05-08T05:52:39.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.828+0000 7f61ad800700 1 -- 172.21.15.82:0/3676890072 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61a80779d0 msgr2=0x7f61a81a01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:39.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.828+0000 7f61ad800700 1 --2- 172.21.15.82:0/3676890072 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61a80779d0 0x7f61a81a01c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f619800d950 tx=0x7f619800dc60 comp rx=0 tx=0).stop 2024-05-08T05:52:39.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.828+0000 7f61ad800700 1 -- 172.21.15.82:0/3676890072 shutdown_connections 2024-05-08T05:52:39.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.828+0000 7f61ad800700 1 --2- 172.21.15.82:0/3676890072 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61a8114380 0x7f61a81a4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:39.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.828+0000 7f61ad800700 1 --2- 172.21.15.82:0/3676890072 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f618c0b29d0 0x7f618c0b4e90 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:39.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.828+0000 7f61ad800700 1 --2- 172.21.15.82:0/3676890072 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61a80779d0 0x7f61a81a01c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:39.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.828+0000 7f61ad800700 1 --2- 172.21.15.82:0/3676890072 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f61a80782f0 0x7f61a81a0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:39.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.828+0000 7f61ad800700 1 -- 172.21.15.82:0/3676890072 >> 172.21.15.82:0/3676890072 conn(0x7f61a81011d0 msgr2=0x7f61a81035c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:52:39.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.829+0000 7f61ad800700 1 -- 172.21.15.82:0/3676890072 shutdown_connections 2024-05-08T05:52:39.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:39.829+0000 7f61ad800700 1 -- 172.21.15.82:0/3676890072 wait complete. 2024-05-08T05:52:40.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:52:39 smithi151 ceph-mon[34815]: pgmap v519: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.7 MiB/s wr, 680 op/s 2024-05-08T05:52:40.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:52:39 smithi082 ceph-mon[30098]: pgmap v519: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.7 MiB/s wr, 680 op/s 2024-05-08T05:52:40.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:52:39 smithi134 ceph-mon[34132]: pgmap v519: 97 pgs: 97 active+clean; 1.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.7 MiB/s wr, 680 op/s 2024-05-08T05:52:40.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 110.0 s, 2395.6 tps, lat 41.611 ms stddev 52.266 2024-05-08T05:52:41.911 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-08T05:52:41.911 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-05-08T05:52:42.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:52:41 smithi151 ceph-mon[34815]: pgmap v520: 97 pgs: 97 active+clean; 1.1 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 8.5 MiB/s wr, 762 op/s 2024-05-08T05:52:42.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:52:41 smithi082 ceph-mon[30098]: pgmap v520: 97 pgs: 97 active+clean; 1.1 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 8.5 MiB/s wr, 762 op/s 2024-05-08T05:52:42.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:52:41 smithi134 ceph-mon[34132]: pgmap v520: 97 pgs: 97 active+clean; 1.1 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 8.5 MiB/s wr, 762 op/s 2024-05-08T05:52:42.511 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:52:44.143 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:52:43 smithi082 ceph-mon[30098]: pgmap v521: 97 pgs: 97 active+clean; 1.1 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 7.0 MiB/s wr, 623 op/s 2024-05-08T05:52:44.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:52:43 smithi134 ceph-mon[34132]: pgmap v521: 97 pgs: 97 active+clean; 1.1 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 7.0 MiB/s wr, 623 op/s 2024-05-08T05:52:44.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:52:43 smithi151 ceph-mon[34815]: pgmap v521: 97 pgs: 97 active+clean; 1.1 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 7.0 MiB/s wr, 623 op/s 2024-05-08T05:52:44.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:44.972+0000 7fcbb5c00700 1 -- 172.21.15.82:0/1048434177 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcbb0108410 msgr2=0x7fcbb01087f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:44.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:44.972+0000 7fcbb5c00700 1 --2- 172.21.15.82:0/1048434177 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcbb0108410 0x7fcbb01087f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fcba0009990 tx=0x7fcba0009ca0 comp rx=0 tx=0).stop 2024-05-08T05:52:44.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:44.973+0000 7fcbb5c00700 1 -- 172.21.15.82:0/1048434177 shutdown_connections 2024-05-08T05:52:44.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:44.973+0000 7fcbb5c00700 1 --2- 172.21.15.82:0/1048434177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbb0102d60 0x7fcbb010f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:44.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:44.973+0000 7fcbb5c00700 1 --2- 172.21.15.82:0/1048434177 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcbb0108410 0x7fcbb01087f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:44.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:44.973+0000 7fcbb5c00700 1 --2- 172.21.15.82:0/1048434177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcbb01023a0 0x7fcbb0102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:44.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:44.973+0000 7fcbb5c00700 1 -- 172.21.15.82:0/1048434177 >> 172.21.15.82:0/1048434177 conn(0x7fcbb0079350 msgr2=0x7fcbb0079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:52:44.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:44.974+0000 7fcbb5c00700 1 -- 172.21.15.82:0/1048434177 shutdown_connections 2024-05-08T05:52:44.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:44.974+0000 7fcbb5c00700 1 -- 172.21.15.82:0/1048434177 wait complete. 2024-05-08T05:52:44.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:44.975+0000 7fcbb5c00700 1 Processor -- start 2024-05-08T05:52:44.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:44.975+0000 7fcbb5c00700 1 -- start start 2024-05-08T05:52:44.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:44.975+0000 7fcbb5c00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcbb01023a0 0x7fcbb010ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:44.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:44.975+0000 7fcbb5c00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcbb0102d60 0x7fcbb01104b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:44.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:44.975+0000 7fcbb5c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbb0108410 0x7fcbb01109f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:44.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:44.975+0000 7fcbb5c00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb0113690 con 0x7fcbb0108410 2024-05-08T05:52:44.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:44.975+0000 7fcbb5c00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb0113510 con 0x7fcbb0102d60 2024-05-08T05:52:44.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:44.975+0000 7fcbb5c00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb0113810 con 0x7fcbb01023a0 2024-05-08T05:52:44.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:44.976+0000 7fcbaea00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcbb01023a0 0x7fcbb010ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:44.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:44.976+0000 7fcbaea00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcbb01023a0 0x7fcbb010ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:40224/0 (socket says 172.21.15.82:40224) 2024-05-08T05:52:44.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:44.976+0000 7fcbaea00700 1 -- 172.21.15.82:0/1146530761 learned_addr learned my addr 172.21.15.82:0/1146530761 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:52:44.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:44.976+0000 7fcbaf400700 1 --2- 172.21.15.82:0/1146530761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbb0108410 0x7fcbb01109f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:44.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:44.976+0000 7fcbae000700 1 --2- 172.21.15.82:0/1146530761 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcbb0102d60 0x7fcbb01104b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:44.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:44.976+0000 7fcbaea00700 1 -- 172.21.15.82:0/1146530761 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcbb0102d60 msgr2=0x7fcbb01104b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:44.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:44.976+0000 7fcbaea00700 1 --2- 172.21.15.82:0/1146530761 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcbb0102d60 0x7fcbb01104b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:44.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:44.976+0000 7fcbaea00700 1 -- 172.21.15.82:0/1146530761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbb0108410 msgr2=0x7fcbb01109f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:44.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:44.976+0000 7fcbaea00700 1 --2- 172.21.15.82:0/1146530761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbb0108410 0x7fcbb01109f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:44.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:44.976+0000 7fcbaea00700 1 -- 172.21.15.82:0/1146530761 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbb01a80e0 con 0x7fcbb01023a0 2024-05-08T05:52:44.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:44.976+0000 7fcbaf400700 1 --2- 172.21.15.82:0/1146530761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbb0108410 0x7fcbb01109f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:52:44.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:44.976+0000 7fcbaea00700 1 --2- 172.21.15.82:0/1146530761 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcbb01023a0 0x7fcbb010ff70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcba0000c00 tx=0x7fcba00057c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:52:44.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:44.977+0000 7fcba7400700 1 -- 172.21.15.82:0/1146530761 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcba0027070 con 0x7fcbb01023a0 2024-05-08T05:52:44.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:44.977+0000 7fcba7400700 1 -- 172.21.15.82:0/1146530761 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcba0022470 con 0x7fcbb01023a0 2024-05-08T05:52:44.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:44.977+0000 7fcba7400700 1 -- 172.21.15.82:0/1146530761 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcba0017630 con 0x7fcbb01023a0 2024-05-08T05:52:44.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:44.977+0000 7fcbb5c00700 1 -- 172.21.15.82:0/1146530761 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbb01a8370 con 0x7fcbb01023a0 2024-05-08T05:52:44.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:44.977+0000 7fcbb5c00700 1 -- 172.21.15.82:0/1146530761 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbb01a87c0 con 0x7fcbb01023a0 2024-05-08T05:52:44.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:44.983+0000 7fcba7400700 1 -- 172.21.15.82:0/1146530761 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fcba0009d10 con 0x7fcbb01023a0 2024-05-08T05:52:44.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:44.985+0000 7fcba7400700 1 --2- 172.21.15.82:0/1146530761 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fcb940b2a50 0x7fcb940b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:44.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:44.986+0000 7fcba7400700 1 -- 172.21.15.82:0/1146530761 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fcba00e2bd0 con 0x7fcbb01023a0 2024-05-08T05:52:44.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:44.986+0000 7fcbae000700 1 --2- 172.21.15.82:0/1146530761 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fcb940b2a50 0x7fcb940b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:44.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:44.994+0000 7fcbae000700 1 --2- 172.21.15.82:0/1146530761 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fcb940b2a50 0x7fcb940b4f10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fcb98009680 tx=0x7fcb98009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:52:44.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:44.997+0000 7fcbc0550b80 1 Processor -- start 2024-05-08T05:52:44.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:44.997+0000 7fcbc0550b80 1 -- start start 2024-05-08T05:52:44.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:44.998+0000 7fcbc0550b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c1674d0e0 0x563c1674d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:45.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:44.998+0000 7fcbc0550b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c1674da00 0x563c16751510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:45.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.000+0000 7fcbc0550b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c16751a50 0x563c16751eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:45.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.000+0000 7fcbae000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c1674da00 0x563c16751510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:45.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.001+0000 7fcbaf400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c16751a50 0x563c16751eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:45.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.001+0000 7fcbaf400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c16751a50 0x563c16751eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48430/0 (socket says 172.21.15.82:48430) 2024-05-08T05:52:45.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.001+0000 7fcbaf400700 1 -- 172.21.15.82:0/209874883 learned_addr learned my addr 172.21.15.82:0/209874883 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:52:45.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.001+0000 7fcbaea00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c1674d0e0 0x563c1674d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:45.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.002+0000 7fcbc0550b80 1 -- 172.21.15.82:0/209874883 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x563c1669faa0 con 0x563c16751a50 2024-05-08T05:52:45.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.002+0000 7fcbc0550b80 1 -- 172.21.15.82:0/209874883 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x563c1663d7e0 con 0x563c1674da00 2024-05-08T05:52:45.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.002+0000 7fcbc0550b80 1 -- 172.21.15.82:0/209874883 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x563c1669ba60 con 0x563c1674d0e0 2024-05-08T05:52:45.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.003+0000 7fcbae000700 1 -- 172.21.15.82:0/209874883 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c1674d0e0 msgr2=0x563c1674d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:45.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.003+0000 7fcbae000700 1 --2- 172.21.15.82:0/209874883 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c1674d0e0 0x563c1674d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:45.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.003+0000 7fcbae000700 1 -- 172.21.15.82:0/209874883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c16751a50 msgr2=0x563c16751eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:45.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.003+0000 7fcbae000700 1 --2- 172.21.15.82:0/209874883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c16751a50 0x563c16751eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:45.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.003+0000 7fcbae000700 1 -- 172.21.15.82:0/209874883 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c165ec950 con 0x563c1674da00 2024-05-08T05:52:45.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.004+0000 7fcbae000700 1 --2- 172.21.15.82:0/209874883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c1674da00 0x563c16751510 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcbb01119b0 tx=0x7fcb98014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c009c7bd840d0ac0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:52:45.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.005+0000 7fcb9fe00700 1 -- 172.21.15.82:0/209874883 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb9800ea40 con 0x563c1674da00 2024-05-08T05:52:45.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.005+0000 7fcb9fe00700 1 -- 172.21.15.82:0/209874883 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb9800ebe0 con 0x563c1674da00 2024-05-08T05:52:45.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.005+0000 7fcb9fe00700 1 -- 172.21.15.82:0/209874883 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb9801d410 con 0x563c1674da00 2024-05-08T05:52:45.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.006+0000 7fcbc0550b80 1 -- 172.21.15.82:0/209874883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c1674da00 msgr2=0x563c16751510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:45.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.006+0000 7fcbc0550b80 1 --2- 172.21.15.82:0/209874883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c1674da00 0x563c16751510 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fcbb01119b0 tx=0x7fcb98014000 comp rx=0 tx=0).stop 2024-05-08T05:52:45.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.007+0000 7fcbc0550b80 1 -- 172.21.15.82:0/209874883 shutdown_connections 2024-05-08T05:52:45.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.007+0000 7fcbc0550b80 1 --2- 172.21.15.82:0/209874883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c16751a50 0x563c16751eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:45.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.007+0000 7fcbc0550b80 1 --2- 172.21.15.82:0/209874883 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c1674d0e0 0x563c1674d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:45.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.007+0000 7fcbc0550b80 1 --2- 172.21.15.82:0/209874883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c1674da00 0x563c16751510 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:45.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.007+0000 7fcbc0550b80 1 -- 172.21.15.82:0/209874883 >> 172.21.15.82:0/209874883 conn(0x563c1667bbe0 msgr2=0x563c16747820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:52:45.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.008+0000 7fcbc0550b80 1 -- 172.21.15.82:0/209874883 shutdown_connections 2024-05-08T05:52:45.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.008+0000 7fcbc0550b80 1 -- 172.21.15.82:0/209874883 wait complete. 2024-05-08T05:52:45.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.009+0000 7fcbc0550b80 1 -- start start 2024-05-08T05:52:45.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.009+0000 7fcbc0550b80 1 Processor -- start 2024-05-08T05:52:45.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.010+0000 7fcbc0550b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c1674d0e0 0x563c16758f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:45.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.010+0000 7fcbc0550b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c1674da00 0x563c16756340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:45.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.010+0000 7fcbc0550b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c16751a50 0x563c16756880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:45.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.010+0000 7fcbaea00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c1674d0e0 0x563c16758f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:45.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.011+0000 7fcbaea00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c1674d0e0 0x563c16758f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48440/0 (socket says 172.21.15.82:48440) 2024-05-08T05:52:45.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.013+0000 7fcbaea00700 1 -- 172.21.15.82:0/183276999 learned_addr learned my addr 172.21.15.82:0/183276999 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:52:45.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.013+0000 7fcbc0550b80 1 -- 172.21.15.82:0/183276999 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x563c16759c60 con 0x563c1674d0e0 2024-05-08T05:52:45.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.013+0000 7fcbc0550b80 1 -- 172.21.15.82:0/183276999 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x563c16605ba0 con 0x563c1674da00 2024-05-08T05:52:45.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.013+0000 7fcbc0550b80 1 -- 172.21.15.82:0/183276999 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x563c16759de0 con 0x563c16751a50 2024-05-08T05:52:45.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.014+0000 7fcbae000700 1 --2- 172.21.15.82:0/183276999 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c1674da00 0x563c16756340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:45.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.015+0000 7fcbaf400700 1 --2- 172.21.15.82:0/183276999 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c16751a50 0x563c16756880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:45.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.015+0000 7fcbaea00700 1 -- 172.21.15.82:0/183276999 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c16751a50 msgr2=0x563c16756880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:45.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.015+0000 7fcbaea00700 1 --2- 172.21.15.82:0/183276999 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c16751a50 0x563c16756880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:45.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.015+0000 7fcbc0550b80 10 client.0 _ll_register_callbacks cb 0x563c16646cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:52:45.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.015+0000 7fcbaea00700 1 -- 172.21.15.82:0/183276999 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c1674da00 msgr2=0x563c16756340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:45.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.015+0000 7fcbaea00700 1 --2- 172.21.15.82:0/183276999 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c1674da00 0x563c16756340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:45.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.015+0000 7fcbaea00700 1 -- 172.21.15.82:0/183276999 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c166654a0 con 0x563c1674d0e0 2024-05-08T05:52:45.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.015+0000 7fcbc0550b80 1 -- 172.21.15.82:0/183276999 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb9800ebe0 con 0x563c1674d0e0 2024-05-08T05:52:45.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.015+0000 7fcbaea00700 1 --2- 172.21.15.82:0/183276999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c1674d0e0 0x563c16758f30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fcba00098e0 tx=0x7fcba00a9c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79bbe76657bc1c3e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:52:45.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.016+0000 7fcb9cc00700 10 client.15288 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T05:52:45.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.016+0000 7fcb9cc00700 1 -- 172.21.15.82:0/183276999 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcba00a9d40 con 0x563c1674d0e0 2024-05-08T05:52:45.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.016+0000 7fcb9cc00700 1 -- 172.21.15.82:0/183276999 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fcba00a6820 con 0x563c1674d0e0 2024-05-08T05:52:45.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.017+0000 7fcb9cc00700 1 -- 172.21.15.82:0/183276999 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fcba00a9d40 con 0x563c1674d0e0 2024-05-08T05:52:45.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.017+0000 7fcbc0550b80 10 client.15288 fetch_fsmap learned FSMap version 30 2024-05-08T05:52:45.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.017+0000 7fcbc0550b80 1 -- 172.21.15.82:0/183276999 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({fsmap=30}) -- 0x563c1676cc70 con 0x563c1674d0e0 2024-05-08T05:52:45.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.020+0000 7fcb9cc00700 1 -- 172.21.15.82:0/183276999 <== mon.0 v2:172.21.15.82:3300/0 4 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7fcba00aa490 con 0x563c1674d0e0 2024-05-08T05:52:45.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.020+0000 7fcbc0550b80 10 client.15288 fetch_fsmap finished waiting for FSMap version 30 2024-05-08T05:52:45.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.020+0000 7fcbc0550b80 10 client.15288 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:52:45.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.021+0000 7fcbc0550b80 20 client.15288 populate_metadata read hostname 'smithi082' 2024-05-08T05:52:45.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.021+0000 7fcbc0550b80 1 --2- 172.21.15.82:0/183276999 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x563c1676f1e0 0x563c16771600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:45.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.021+0000 7fcbc0550b80 4 client.15288 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:52:45.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.021+0000 7fcbc0550b80 1 -- 172.21.15.82:0/183276999 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563c1671a120 con 0x563c1676f1e0 2024-05-08T05:52:45.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.021+0000 7fcbae000700 1 --2- 172.21.15.82:0/183276999 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x563c1676f1e0 0x563c16771600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:45.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.023+0000 7fcb9cc00700 10 client.15288 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:52:45.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.023+0000 7fcbae000700 1 --2- 172.21.15.82:0/183276999 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x563c1676f1e0 0x563c16771600 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f4dc370377f2ce9 server_cookie=8df5e24b5be2697c in_seq=0 out_seq=0 2024-05-08T05:52:45.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.024+0000 7fcb9cc00700 1 -- 172.21.15.82:0/183276999 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x563c1671a120 con 0x563c1676f1e0 2024-05-08T05:52:45.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.026+0000 7fcb9cc00700 10 client.15288 handle_command_reply: tid=0 2024-05-08T05:52:45.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.026+0000 7fcbc0550b80 1 client.15288 shutdown 2024-05-08T05:52:45.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.026+0000 7fcbc0550b80 1 -- 172.21.15.82:0/183276999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c1674d0e0 msgr2=0x563c16758f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:45.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.026+0000 7fcbc0550b80 1 --2- 172.21.15.82:0/183276999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c1674d0e0 0x563c16758f30 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fcba00098e0 tx=0x7fcba00a9c30 comp rx=0 tx=0).stop 2024-05-08T05:52:45.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.028+0000 7fcbc0550b80 1 -- 172.21.15.82:0/183276999 shutdown_connections 2024-05-08T05:52:45.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.028+0000 7fcbc0550b80 1 --2- 172.21.15.82:0/183276999 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c16751a50 0x563c16756880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:45.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.028+0000 7fcbc0550b80 1 --2- 172.21.15.82:0/183276999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c1674d0e0 0x563c16758f30 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:45.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.028+0000 7fcbc0550b80 1 --2- 172.21.15.82:0/183276999 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x563c1676f1e0 0x563c16771600 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:45.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.029+0000 7fcbc0550b80 1 --2- 172.21.15.82:0/183276999 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c1674da00 0x563c16756340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:45.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.029+0000 7fcbc0550b80 1 -- 172.21.15.82:0/183276999 >> 172.21.15.82:0/183276999 conn(0x563c1667bbe0 msgr2=0x563c167477e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:52:45.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.029+0000 7fcb9cc00700 0 client.15288 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:52:45.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.029+0000 7fcbc0550b80 1 -- 172.21.15.82:0/183276999 shutdown_connections 2024-05-08T05:52:45.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.029+0000 7fcbc0550b80 1 -- 172.21.15.82:0/183276999 wait complete. 2024-05-08T05:52:45.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.029+0000 7fcbc0550b80 20 client.15288 trim_cache size 0 max 16384 2024-05-08T05:52:45.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.061+0000 7fcbc0550b80 1 Processor -- start 2024-05-08T05:52:45.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.061+0000 7fcbc0550b80 1 -- start start 2024-05-08T05:52:45.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.062+0000 7fcbc0550b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c1667bbe0 0x563c1676b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:45.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.062+0000 7fcbc0550b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c1674d0e0 0x563c16750a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:45.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.062+0000 7fcbc0550b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c1674da00 0x563c16750f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:45.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.062+0000 7fcbc0550b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb01ab850 con 0x563c1674d0e0 2024-05-08T05:52:45.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.062+0000 7fcbc0550b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb01ad3c0 con 0x563c1667bbe0 2024-05-08T05:52:45.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.062+0000 7fcbc0550b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb01abf20 con 0x563c1674da00 2024-05-08T05:52:45.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.062+0000 7fcbaea00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c1667bbe0 0x563c1676b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:45.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.062+0000 7fcbaea00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c1667bbe0 0x563c1676b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:58294/0 (socket says 172.21.15.82:58294) 2024-05-08T05:52:45.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.062+0000 7fcbaea00700 1 -- 172.21.15.82:0/2892020202 learned_addr learned my addr 172.21.15.82:0/2892020202 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:52:45.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.062+0000 7fcbaf400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c1674da00 0x563c16750f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:45.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.062+0000 7fcbae000700 1 --2- 172.21.15.82:0/2892020202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c1674d0e0 0x563c16750a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:45.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.063+0000 7fcbaea00700 1 -- 172.21.15.82:0/2892020202 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c1674da00 msgr2=0x563c16750f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:45.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.063+0000 7fcbaea00700 1 --2- 172.21.15.82:0/2892020202 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c1674da00 0x563c16750f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:45.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.063+0000 7fcbaea00700 1 -- 172.21.15.82:0/2892020202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c1674d0e0 msgr2=0x563c16750a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:45.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.063+0000 7fcbaea00700 1 --2- 172.21.15.82:0/2892020202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c1674d0e0 0x563c16750a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:45.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.063+0000 7fcbaea00700 1 -- 172.21.15.82:0/2892020202 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c167572b0 con 0x563c1667bbe0 2024-05-08T05:52:45.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.063+0000 7fcbaea00700 1 --2- 172.21.15.82:0/2892020202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c1667bbe0 0x563c1676b580 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fcba000b3e0 tx=0x7fcba00e2000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd235e4e457f43fc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:52:45.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.063+0000 7fcb9f400700 1 -- 172.21.15.82:0/2892020202 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcba00ae5e0 con 0x563c1667bbe0 2024-05-08T05:52:45.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.063+0000 7fcb9f400700 1 -- 172.21.15.82:0/2892020202 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb9800ebe0 con 0x563c1667bbe0 2024-05-08T05:52:45.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.063+0000 7fcb9f400700 1 -- 172.21.15.82:0/2892020202 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcba00b2b70 con 0x563c1667bbe0 2024-05-08T05:52:45.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.065+0000 7fcbc0550b80 1 -- 172.21.15.82:0/2892020202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c1667bbe0 msgr2=0x563c1676b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:45.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.065+0000 7fcbc0550b80 1 --2- 172.21.15.82:0/2892020202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c1667bbe0 0x563c1676b580 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fcba000b3e0 tx=0x7fcba00e2000 comp rx=0 tx=0).stop 2024-05-08T05:52:45.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.065+0000 7fcbc0550b80 1 -- 172.21.15.82:0/2892020202 shutdown_connections 2024-05-08T05:52:45.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.065+0000 7fcbc0550b80 1 --2- 172.21.15.82:0/2892020202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c1667bbe0 0x563c1676b580 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:45.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.065+0000 7fcbc0550b80 1 --2- 172.21.15.82:0/2892020202 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c1674da00 0x563c16750f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:45.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.065+0000 7fcbc0550b80 1 --2- 172.21.15.82:0/2892020202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c1674d0e0 0x563c16750a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:45.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.065+0000 7fcbc0550b80 1 -- 172.21.15.82:0/2892020202 >> 172.21.15.82:0/2892020202 conn(0x563c167426c0 msgr2=0x563c16750340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:52:45.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.066+0000 7fcbc0550b80 1 -- 172.21.15.82:0/2892020202 shutdown_connections 2024-05-08T05:52:45.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.066+0000 7fcbc0550b80 1 -- 172.21.15.82:0/2892020202 wait complete. 2024-05-08T05:52:45.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.067+0000 7fcbc0550b80 1 -- start start 2024-05-08T05:52:45.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.067+0000 7fcbc0550b80 1 Processor -- start 2024-05-08T05:52:45.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.068+0000 7fcbc0550b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c1667bbe0 0x563c16766ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:45.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.068+0000 7fcbc0550b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c1674d0e0 0x563c167670e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:45.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.068+0000 7fcbc0550b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c1674da00 0x563c167d9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:45.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.068+0000 7fcbc0550b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb01accc0 con 0x563c1674da00 2024-05-08T05:52:45.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.068+0000 7fcbc0550b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb01ac5f0 con 0x563c1674d0e0 2024-05-08T05:52:45.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.068+0000 7fcbc0550b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fcbb019d860 con 0x563c1667bbe0 2024-05-08T05:52:45.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.068+0000 7fcbc0550b80 10 client.0 _ll_register_callbacks cb 0x563c16646cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:52:45.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.068+0000 7fcbae000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c1674d0e0 0x563c167670e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:45.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.068+0000 7fcbae000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c1674d0e0 0x563c167670e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:58308/0 (socket says 172.21.15.82:58308) 2024-05-08T05:52:45.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.068+0000 7fcbae000700 1 -- 172.21.15.82:0/558214999 learned_addr learned my addr 172.21.15.82:0/558214999 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:52:45.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.068+0000 7fcbaf400700 1 --2- 172.21.15.82:0/558214999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c1674da00 0x563c167d9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:45.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.068+0000 7fcbaea00700 1 --2- 172.21.15.82:0/558214999 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c1667bbe0 0x563c16766ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:45.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.068+0000 7fcbae000700 1 -- 172.21.15.82:0/558214999 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c1667bbe0 msgr2=0x563c16766ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:45.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.068+0000 7fcbae000700 1 --2- 172.21.15.82:0/558214999 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c1667bbe0 0x563c16766ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:45.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.068+0000 7fcbae000700 1 -- 172.21.15.82:0/558214999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c1674da00 msgr2=0x563c167d9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:45.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.068+0000 7fcbae000700 1 --2- 172.21.15.82:0/558214999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c1674da00 0x563c167d9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:45.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.068+0000 7fcbae000700 1 -- 172.21.15.82:0/558214999 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c167da030 con 0x563c1674d0e0 2024-05-08T05:52:45.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.069+0000 7fcbae000700 1 --2- 172.21.15.82:0/558214999 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c1674d0e0 0x563c167670e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fcb98009440 tx=0x7fcb98005ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fa127b7bbea1c4a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:52:45.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.069+0000 7fcb9cc00700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:52:45.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.069+0000 7fcb9cc00700 1 -- 172.21.15.82:0/558214999 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb9802b040 con 0x563c1674d0e0 2024-05-08T05:52:45.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.069+0000 7fcbc0550b80 1 -- 172.21.15.82:0/558214999 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcb9800ebe0 con 0x563c1674d0e0 2024-05-08T05:52:45.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.069+0000 7fcb9cc00700 1 -- 172.21.15.82:0/558214999 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fcb98005040 con 0x563c1674d0e0 2024-05-08T05:52:45.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.069+0000 7fcb9cc00700 1 -- 172.21.15.82:0/558214999 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fcb98005240 con 0x563c1674d0e0 2024-05-08T05:52:45.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.070+0000 7fcbc0550b80 10 client.25448 fetch_fsmap learned FSMap version 30 2024-05-08T05:52:45.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.070+0000 7fcbc0550b80 1 -- 172.21.15.82:0/558214999 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x563c167db370 con 0x563c1674d0e0 2024-05-08T05:52:45.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.070+0000 7fcb9cc00700 1 -- 172.21.15.82:0/558214999 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb9800ebe0 con 0x563c1674d0e0 2024-05-08T05:52:45.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.070+0000 7fcb9cc00700 1 -- 172.21.15.82:0/558214999 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7fcb98030470 con 0x563c1674d0e0 2024-05-08T05:52:45.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.071+0000 7fcbc0550b80 10 client.25448 fetch_fsmap finished waiting for FSMap version 30 2024-05-08T05:52:45.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.071+0000 7fcbc0550b80 10 client.25448 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:52:45.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.071+0000 7fcbc0550b80 20 client.25448 populate_metadata read hostname 'smithi082' 2024-05-08T05:52:45.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.071+0000 7fcbc0550b80 1 --2- 172.21.15.82:0/558214999 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x563c16751a50 0x563c167dd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:45.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.071+0000 7fcbc0550b80 4 client.25448 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-08T05:52:45.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.071+0000 7fcbc0550b80 1 -- 172.21.15.82:0/558214999 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x563c166ad480 con 0x563c16751a50 2024-05-08T05:52:45.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.071+0000 7fcbaea00700 1 --2- 172.21.15.82:0/558214999 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x563c16751a50 0x563c167dd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:45.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.072+0000 7fcb9cc00700 10 client.25448 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:52:45.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.072+0000 7fcbaea00700 1 --2- 172.21.15.82:0/558214999 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x563c16751a50 0x563c167dd7e0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c6543c026f28cee server_cookie=1b3707ef06f7f5a7 in_seq=0 out_seq=0 2024-05-08T05:52:45.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.073+0000 7fcb9cc00700 1 -- 172.21.15.82:0/558214999 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563c166ad480 con 0x563c16751a50 2024-05-08T05:52:45.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.073+0000 7fcb9cc00700 10 client.25448 handle_command_reply: tid=0 2024-05-08T05:52:45.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.073+0000 7fcbc0550b80 1 client.25448 shutdown 2024-05-08T05:52:45.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.074+0000 7fcbc0550b80 1 -- 172.21.15.82:0/558214999 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c1674d0e0 msgr2=0x563c167670e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:45.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.074+0000 7fcbc0550b80 1 --2- 172.21.15.82:0/558214999 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c1674d0e0 0x563c167670e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fcb98009440 tx=0x7fcb98005ce0 comp rx=0 tx=0).stop 2024-05-08T05:52:45.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.074+0000 7fcbc0550b80 1 -- 172.21.15.82:0/558214999 shutdown_connections 2024-05-08T05:52:45.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.074+0000 7fcbc0550b80 1 --2- 172.21.15.82:0/558214999 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563c1674da00 0x563c167d9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:45.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.074+0000 7fcbc0550b80 1 --2- 172.21.15.82:0/558214999 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c1667bbe0 0x563c16766ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:45.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.074+0000 7fcbc0550b80 1 --2- 172.21.15.82:0/558214999 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x563c16751a50 0x563c167dd7e0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:45.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.074+0000 7fcbc0550b80 1 --2- 172.21.15.82:0/558214999 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c1674d0e0 0x563c167670e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:45.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.074+0000 7fcbc0550b80 1 -- 172.21.15.82:0/558214999 >> 172.21.15.82:0/558214999 conn(0x563c167426c0 msgr2=0x563c16750bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:52:45.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.074+0000 7fcb9cc00700 0 client.25448 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:52:45.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.075+0000 7fcbc0550b80 1 -- 172.21.15.82:0/558214999 shutdown_connections 2024-05-08T05:52:45.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.075+0000 7fcbc0550b80 1 -- 172.21.15.82:0/558214999 wait complete. 2024-05-08T05:52:45.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.075+0000 7fcbc0550b80 20 client.25448 trim_cache size 0 max 16384 2024-05-08T05:52:45.076 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T05:52:45.077 INFO:teuthology.orchestra.run.smithi082.stdout: "return_code": 0, 2024-05-08T05:52:45.077 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_tag": "dec0adab-4fd5-4772-baff-f08796049191", 2024-05-08T05:52:45.077 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": "asynchronous" 2024-05-08T05:52:45.077 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T05:52:45.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.077+0000 7fcbb5c00700 1 -- 172.21.15.82:0/1146530761 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fcb940b2a50 msgr2=0x7fcb940b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:45.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.077+0000 7fcbb5c00700 1 --2- 172.21.15.82:0/1146530761 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fcb940b2a50 0x7fcb940b4f10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fcb98009680 tx=0x7fcb98009260 comp rx=0 tx=0).stop 2024-05-08T05:52:45.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.077+0000 7fcbb5c00700 1 -- 172.21.15.82:0/1146530761 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcbb01023a0 msgr2=0x7fcbb010ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:45.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.077+0000 7fcbb5c00700 1 --2- 172.21.15.82:0/1146530761 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcbb01023a0 0x7fcbb010ff70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcba0000c00 tx=0x7fcba00057c0 comp rx=0 tx=0).stop 2024-05-08T05:52:45.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.078+0000 7fcbb5c00700 1 -- 172.21.15.82:0/1146530761 shutdown_connections 2024-05-08T05:52:45.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.078+0000 7fcbb5c00700 1 --2- 172.21.15.82:0/1146530761 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fcb940b2a50 0x7fcb940b4f10 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:45.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.078+0000 7fcbb5c00700 1 --2- 172.21.15.82:0/1146530761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcbb0108410 0x7fcbb01109f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:45.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.078+0000 7fcbb5c00700 1 --2- 172.21.15.82:0/1146530761 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcbb01023a0 0x7fcbb010ff70 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:45.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.078+0000 7fcbb5c00700 1 --2- 172.21.15.82:0/1146530761 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcbb0102d60 0x7fcbb01104b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:45.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.078+0000 7fcbb5c00700 1 -- 172.21.15.82:0/1146530761 >> 172.21.15.82:0/1146530761 conn(0x7fcbb0079350 msgr2=0x7fcbb0101320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:52:45.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.078+0000 7fcbb5c00700 1 -- 172.21.15.82:0/1146530761 shutdown_connections 2024-05-08T05:52:45.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:45.078+0000 7fcbb5c00700 1 -- 172.21.15.82:0/1146530761 wait complete. 2024-05-08T05:52:45.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 115.0 s, 2537.4 tps, lat 39.407 ms stddev 47.018 2024-05-08T05:52:46.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:52:45 smithi082 ceph-mon[30098]: pgmap v522: 97 pgs: 97 active+clean; 1.1 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 8.1 MiB/s wr, 722 op/s 2024-05-08T05:52:46.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:52:45 smithi082 ceph-mon[30098]: scrub queued for path: / 2024-05-08T05:52:46.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:52:45 smithi082 ceph-mon[30098]: scrub summary: idle+waiting paths [/] 2024-05-08T05:52:46.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:52:45 smithi082 ceph-mon[30098]: scrub summary: active paths [/] 2024-05-08T05:52:46.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:52:45 smithi082 ceph-mon[30098]: scrub summary: active paths [/] 2024-05-08T05:52:46.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:52:45 smithi134 ceph-mon[34132]: pgmap v522: 97 pgs: 97 active+clean; 1.1 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 8.1 MiB/s wr, 722 op/s 2024-05-08T05:52:46.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:52:45 smithi134 ceph-mon[34132]: scrub queued for path: / 2024-05-08T05:52:46.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:52:45 smithi134 ceph-mon[34132]: scrub summary: idle+waiting paths [/] 2024-05-08T05:52:46.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:52:45 smithi134 ceph-mon[34132]: scrub summary: active paths [/] 2024-05-08T05:52:46.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:52:45 smithi134 ceph-mon[34132]: scrub summary: active paths [/] 2024-05-08T05:52:46.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:52:45 smithi151 ceph-mon[34815]: pgmap v522: 97 pgs: 97 active+clean; 1.1 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 8.1 MiB/s wr, 722 op/s 2024-05-08T05:52:46.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:52:45 smithi151 ceph-mon[34815]: scrub queued for path: / 2024-05-08T05:52:46.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:52:45 smithi151 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-05-08T05:52:46.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:52:45 smithi151 ceph-mon[34815]: scrub summary: active paths [/] 2024-05-08T05:52:46.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:52:45 smithi151 ceph-mon[34815]: scrub summary: active paths [/] 2024-05-08T05:52:46.460 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-08T05:52:47.136 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:52:47.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:52:46 smithi082 ceph-mon[30098]: scrub summary: idle+waiting paths [/] 2024-05-08T05:52:47.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:52:46 smithi082 ceph-mon[30098]: scrub summary: idle+waiting paths [/] 2024-05-08T05:52:47.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:52:46 smithi134 ceph-mon[34132]: scrub summary: idle+waiting paths [/] 2024-05-08T05:52:47.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:52:46 smithi134 ceph-mon[34132]: scrub summary: idle+waiting paths [/] 2024-05-08T05:52:47.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:52:46 smithi151 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-05-08T05:52:47.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:52:46 smithi151 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-05-08T05:52:48.150 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:52:47 smithi134 ceph-mon[34132]: pgmap v523: 97 pgs: 97 active+clean; 1.1 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 7.7 MiB/s wr, 688 op/s 2024-05-08T05:52:48.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:52:47 smithi082 ceph-mon[30098]: pgmap v523: 97 pgs: 97 active+clean; 1.1 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 7.7 MiB/s wr, 688 op/s 2024-05-08T05:52:48.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:52:47 smithi151 ceph-mon[34815]: pgmap v523: 97 pgs: 97 active+clean; 1.1 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 7.7 MiB/s wr, 688 op/s 2024-05-08T05:52:49.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.602+0000 7f010a400700 1 -- 172.21.15.82:0/3542638974 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0104102ee0 msgr2=0x7f0104106f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:49.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.602+0000 7f010a400700 1 --2- 172.21.15.82:0/3542638974 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0104102ee0 0x7f0104106f30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f00ec0099c0 tx=0x7f00ec009cd0 comp rx=0 tx=0).stop 2024-05-08T05:52:49.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.602+0000 7f010a400700 1 -- 172.21.15.82:0/3542638974 shutdown_connections 2024-05-08T05:52:49.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.602+0000 7f010a400700 1 --2- 172.21.15.82:0/3542638974 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0104107610 0x7f010410f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:49.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.602+0000 7f010a400700 1 --2- 172.21.15.82:0/3542638974 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0104102530 0x7f0104102910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:49.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.603+0000 7f010a400700 1 --2- 172.21.15.82:0/3542638974 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0104102ee0 0x7f0104106f30 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:49.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.603+0000 7f010a400700 1 -- 172.21.15.82:0/3542638974 >> 172.21.15.82:0/3542638974 conn(0x7f01040fddc0 msgr2=0x7f01041001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:52:49.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.603+0000 7f010a400700 1 -- 172.21.15.82:0/3542638974 shutdown_connections 2024-05-08T05:52:49.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.604+0000 7f010a400700 1 -- 172.21.15.82:0/3542638974 wait complete. 2024-05-08T05:52:49.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.607+0000 7f010a400700 1 Processor -- start 2024-05-08T05:52:49.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.607+0000 7f010a400700 1 -- start start 2024-05-08T05:52:49.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.609+0000 7f010a400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0104102530 0x7f010410b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:49.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.609+0000 7f010a400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0104102ee0 0x7f010410b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:49.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.609+0000 7f0109000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0104102530 0x7f010410b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:49.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.610+0000 7f010a400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0104107610 0x7f010410be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:49.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.610+0000 7f010a400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0104111460 con 0x7f0104102ee0 2024-05-08T05:52:49.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.610+0000 7f010a400700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f01041112e0 con 0x7f0104107610 2024-05-08T05:52:49.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.610+0000 7f010a400700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f01041115e0 con 0x7f0104102530 2024-05-08T05:52:49.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.610+0000 7f00fbe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0104102ee0 0x7f010410b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:49.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.610+0000 7f00fbe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0104102ee0 0x7f010410b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48472/0 (socket says 172.21.15.82:48472) 2024-05-08T05:52:49.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.610+0000 7f00fbe00700 1 -- 172.21.15.82:0/746316392 learned_addr learned my addr 172.21.15.82:0/746316392 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:52:49.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.610+0000 7f0109a00700 1 --2- 172.21.15.82:0/746316392 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0104107610 0x7f010410be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:49.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.611+0000 7f00fbe00700 1 -- 172.21.15.82:0/746316392 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0104102530 msgr2=0x7f010410b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:49.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.611+0000 7f00fbe00700 1 --2- 172.21.15.82:0/746316392 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0104102530 0x7f010410b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:49.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.611+0000 7f00fbe00700 1 -- 172.21.15.82:0/746316392 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0104107610 msgr2=0x7f010410be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:49.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.611+0000 7f00fbe00700 1 --2- 172.21.15.82:0/746316392 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0104107610 0x7f010410be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:49.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.611+0000 7f00fbe00700 1 -- 172.21.15.82:0/746316392 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01041ac440 con 0x7f0104102ee0 2024-05-08T05:52:49.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.611+0000 7f0109a00700 1 --2- 172.21.15.82:0/746316392 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0104107610 0x7f010410be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:52:49.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.611+0000 7f00fbe00700 1 --2- 172.21.15.82:0/746316392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0104102ee0 0x7f010410b920 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f00ec006010 tx=0x7f00ec0038b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:52:49.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.612+0000 7f0102000700 1 -- 172.21.15.82:0/746316392 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00ec026070 con 0x7f0104102ee0 2024-05-08T05:52:49.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.612+0000 7f0102000700 1 -- 172.21.15.82:0/746316392 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00ec0056d0 con 0x7f0104102ee0 2024-05-08T05:52:49.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.612+0000 7f0102000700 1 -- 172.21.15.82:0/746316392 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00ec00fb40 con 0x7f0104102ee0 2024-05-08T05:52:49.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.615+0000 7f010a400700 1 -- 172.21.15.82:0/746316392 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01041ac6d0 con 0x7f0104102ee0 2024-05-08T05:52:49.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.615+0000 7f010a400700 1 -- 172.21.15.82:0/746316392 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01041acad0 con 0x7f0104102ee0 2024-05-08T05:52:49.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.622+0000 7f0102000700 1 -- 172.21.15.82:0/746316392 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f00ec00fce0 con 0x7f0104102ee0 2024-05-08T05:52:49.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.622+0000 7f011630db80 1 Processor -- start 2024-05-08T05:52:49.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.623+0000 7f011630db80 1 -- start start 2024-05-08T05:52:49.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.623+0000 7f011630db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ace9c49e0 0x558ace9c4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:49.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.623+0000 7f011630db80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ace9c5300 0x558ace9befe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:49.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.623+0000 7f011630db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ace9bf600 0x558ace9bfa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:49.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.623+0000 7f011630db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x558ace911a20 con 0x558ace9bf600 2024-05-08T05:52:49.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.623+0000 7f011630db80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558ace8af760 con 0x558ace9c5300 2024-05-08T05:52:49.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.623+0000 7f011630db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x558ace90d9e0 con 0x558ace9c49e0 2024-05-08T05:52:49.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.623+0000 7f0102000700 1 --2- 172.21.15.82:0/746316392 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f00e80b2930 0x7f00e80b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:49.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.624+0000 7f0102000700 1 -- 172.21.15.82:0/746316392 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f00ec005020 con 0x7f0104102ee0 2024-05-08T05:52:49.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.624+0000 7f00fbe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ace9bf600 0x558ace9bfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:49.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.624+0000 7f00fbe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ace9bf600 0x558ace9bfa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48482/0 (socket says 172.21.15.82:48482) 2024-05-08T05:52:49.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.624+0000 7f00fbe00700 1 -- 172.21.15.82:0/435771951 learned_addr learned my addr 172.21.15.82:0/435771951 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:52:49.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.624+0000 7f0109000700 1 --2- 172.21.15.82:0/435771951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ace9c5300 0x558ace9befe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:49.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.624+0000 7f0109a00700 1 --2- 172.21.15.82:0/746316392 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f00e80b2930 0x7f00e80b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:49.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.625+0000 7f00fbe00700 1 -- 172.21.15.82:0/435771951 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ace9c49e0 msgr2=0x558ace9c4dc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T05:52:49.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.625+0000 7f00fbe00700 1 --2- 172.21.15.82:0/435771951 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ace9c49e0 0x558ace9c4dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:49.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.625+0000 7f00fbe00700 1 -- 172.21.15.82:0/435771951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ace9c5300 msgr2=0x558ace9befe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:49.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.625+0000 7f00fbe00700 1 --2- 172.21.15.82:0/435771951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ace9c5300 0x558ace9befe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:49.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.625+0000 7f00fbe00700 1 -- 172.21.15.82:0/435771951 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ace85e8d0 con 0x558ace9bf600 2024-05-08T05:52:49.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.625+0000 7f00fbe00700 1 --2- 172.21.15.82:0/435771951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ace9bf600 0x558ace9bfa80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f00ec0a62c0 tx=0x7f00ec009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc73412e73af7807 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:52:49.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.626+0000 7f0109a00700 1 --2- 172.21.15.82:0/746316392 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f00e80b2930 0x7f00e80b4df0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f00fc005950 tx=0x7f00fc00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:52:49.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.627+0000 7f00fa000700 1 -- 172.21.15.82:0/435771951 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00ec0aa240 con 0x558ace9bf600 2024-05-08T05:52:49.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.627+0000 7f00fa000700 1 -- 172.21.15.82:0/435771951 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00ec0ae5f0 con 0x558ace9bf600 2024-05-08T05:52:49.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.628+0000 7f00fa000700 1 -- 172.21.15.82:0/435771951 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00ec0b2de0 con 0x558ace9bf600 2024-05-08T05:52:49.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.628+0000 7f011630db80 1 -- 172.21.15.82:0/435771951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ace9bf600 msgr2=0x558ace9bfa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:49.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.628+0000 7f011630db80 1 --2- 172.21.15.82:0/435771951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ace9bf600 0x558ace9bfa80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f00ec0a62c0 tx=0x7f00ec009cd0 comp rx=0 tx=0).stop 2024-05-08T05:52:49.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.629+0000 7f011630db80 1 -- 172.21.15.82:0/435771951 shutdown_connections 2024-05-08T05:52:49.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.629+0000 7f011630db80 1 --2- 172.21.15.82:0/435771951 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ace9bf600 0x558ace9bfa80 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:49.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.629+0000 7f011630db80 1 --2- 172.21.15.82:0/435771951 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ace9c49e0 0x558ace9c4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:49.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.629+0000 7f011630db80 1 --2- 172.21.15.82:0/435771951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ace9c5300 0x558ace9befe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:49.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.629+0000 7f011630db80 1 -- 172.21.15.82:0/435771951 >> 172.21.15.82:0/435771951 conn(0x558ace8edb60 msgr2=0x558ace9b99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:52:49.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.629+0000 7f011630db80 1 -- 172.21.15.82:0/435771951 shutdown_connections 2024-05-08T05:52:49.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.629+0000 7f011630db80 1 -- 172.21.15.82:0/435771951 wait complete. 2024-05-08T05:52:49.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.630+0000 7f011630db80 1 -- start start 2024-05-08T05:52:49.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.630+0000 7f011630db80 1 Processor -- start 2024-05-08T05:52:49.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.631+0000 7f011630db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ace9bf600 0x558ace9caf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:49.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.631+0000 7f011630db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ace9c49e0 0x558ace9c82b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:49.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.631+0000 7f011630db80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ace9c5300 0x558ace9c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:49.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.631+0000 7f011630db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x558ace9cbb70 con 0x558ace9bf600 2024-05-08T05:52:49.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.631+0000 7f011630db80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558ace877b20 con 0x558ace9c5300 2024-05-08T05:52:49.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.631+0000 7f011630db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x558ace9cbcf0 con 0x558ace9c49e0 2024-05-08T05:52:49.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.631+0000 7f011630db80 10 client.0 _ll_register_callbacks cb 0x558ace8b8c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:52:49.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.632+0000 7f0109000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ace9bf600 0x558ace9caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:49.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.632+0000 7f00fbe00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ace9c49e0 0x558ace9c82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:49.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.632+0000 7f00fbe00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ace9c49e0 0x558ace9c82b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:40272/0 (socket says 172.21.15.82:40272) 2024-05-08T05:52:49.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.632+0000 7f00fbe00700 1 -- 172.21.15.82:0/3566726870 learned_addr learned my addr 172.21.15.82:0/3566726870 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:52:49.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.633+0000 7f0109a00700 1 --2- 172.21.15.82:0/3566726870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ace9c5300 0x558ace9c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:49.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.633+0000 7f00fbe00700 1 -- 172.21.15.82:0/3566726870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ace9c5300 msgr2=0x558ace9c87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:49.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.633+0000 7f00fbe00700 1 --2- 172.21.15.82:0/3566726870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ace9c5300 0x558ace9c87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:49.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.633+0000 7f00fbe00700 1 -- 172.21.15.82:0/3566726870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ace9bf600 msgr2=0x558ace9caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:49.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.633+0000 7f00fbe00700 1 --2- 172.21.15.82:0/3566726870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ace9bf600 0x558ace9caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:49.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.633+0000 7f00fbe00700 1 -- 172.21.15.82:0/3566726870 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ace8d7420 con 0x558ace9c49e0 2024-05-08T05:52:49.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.634+0000 7f00fbe00700 1 --2- 172.21.15.82:0/3566726870 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ace9c49e0 0x558ace9c82b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f00ec0aa1d0 tx=0x7f00ec0b30c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce0ff3c33a5ca339 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:52:49.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.635+0000 7f00f2a00700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:52:49.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.635+0000 7f00f2a00700 1 -- 172.21.15.82:0/3566726870 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00ec0ae3c0 con 0x558ace9c49e0 2024-05-08T05:52:49.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.635+0000 7f00f2a00700 1 -- 172.21.15.82:0/3566726870 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f00ec0a6830 con 0x558ace9c49e0 2024-05-08T05:52:49.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.635+0000 7f011630db80 1 -- 172.21.15.82:0/3566726870 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00ec0ae5f0 con 0x558ace9c49e0 2024-05-08T05:52:49.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.636+0000 7f00f2a00700 1 -- 172.21.15.82:0/3566726870 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f00ec0ca050 con 0x558ace9c49e0 2024-05-08T05:52:49.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.636+0000 7f011630db80 10 client.25477 fetch_fsmap learned FSMap version 30 2024-05-08T05:52:49.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.636+0000 7f011630db80 1 -- 172.21.15.82:0/3566726870 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x558ace9cbb70 con 0x558ace9c49e0 2024-05-08T05:52:49.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.636+0000 7f00f2a00700 1 -- 172.21.15.82:0/3566726870 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00ec0ae5f0 con 0x558ace9c49e0 2024-05-08T05:52:49.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.636+0000 7f00f2a00700 1 -- 172.21.15.82:0/3566726870 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f00ec0a94a0 con 0x558ace9c49e0 2024-05-08T05:52:49.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.637+0000 7f011630db80 10 client.25477 fetch_fsmap finished waiting for FSMap version 30 2024-05-08T05:52:49.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.637+0000 7f011630db80 10 client.25477 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:52:49.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.637+0000 7f011630db80 20 client.25477 populate_metadata read hostname 'smithi082' 2024-05-08T05:52:49.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.637+0000 7f011630db80 1 --2- 172.21.15.82:0/3566726870 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x558ace9d84d0 0x558ace9da8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:49.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.637+0000 7f011630db80 4 client.25477 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:52:49.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.637+0000 7f011630db80 1 -- 172.21.15.82:0/3566726870 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558ace98c0a0 con 0x558ace9d84d0 2024-05-08T05:52:49.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.637+0000 7f0109000700 1 --2- 172.21.15.82:0/3566726870 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x558ace9d84d0 0x558ace9da8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:49.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.638+0000 7f0109000700 1 --2- 172.21.15.82:0/3566726870 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x558ace9d84d0 0x558ace9da8c0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8ce1cb9a44aeaa5 server_cookie=2cacdf81605b634 in_seq=0 out_seq=0 2024-05-08T05:52:49.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.638+0000 7f00f2a00700 10 client.25477 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:52:49.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.639+0000 7f00f2a00700 1 -- 172.21.15.82:0/3566726870 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x558ace98c0a0 con 0x558ace9d84d0 2024-05-08T05:52:49.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.639+0000 7f00f2a00700 10 client.25477 handle_command_reply: tid=0 2024-05-08T05:52:49.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.639+0000 7f011630db80 1 client.25477 shutdown 2024-05-08T05:52:49.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.643+0000 7f011630db80 1 -- 172.21.15.82:0/3566726870 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ace9c49e0 msgr2=0x558ace9c82b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:49.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.643+0000 7f011630db80 1 --2- 172.21.15.82:0/3566726870 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ace9c49e0 0x558ace9c82b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f00ec0aa1d0 tx=0x7f00ec0b30c0 comp rx=0 tx=0).stop 2024-05-08T05:52:49.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.643+0000 7f011630db80 1 -- 172.21.15.82:0/3566726870 shutdown_connections 2024-05-08T05:52:49.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.643+0000 7f011630db80 1 --2- 172.21.15.82:0/3566726870 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x558ace9d84d0 0x558ace9da8c0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:49.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.643+0000 7f011630db80 1 --2- 172.21.15.82:0/3566726870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ace9c5300 0x558ace9c87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:49.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.643+0000 7f011630db80 1 --2- 172.21.15.82:0/3566726870 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ace9bf600 0x558ace9caf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:49.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.643+0000 7f011630db80 1 --2- 172.21.15.82:0/3566726870 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ace9c49e0 0x558ace9c82b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:49.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.643+0000 7f011630db80 1 -- 172.21.15.82:0/3566726870 >> 172.21.15.82:0/3566726870 conn(0x558ace8edb60 msgr2=0x558ace9b4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:52:49.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.643+0000 7f00f2a00700 0 client.25477 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:52:49.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.643+0000 7f011630db80 1 -- 172.21.15.82:0/3566726870 shutdown_connections 2024-05-08T05:52:49.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.643+0000 7f011630db80 1 -- 172.21.15.82:0/3566726870 wait complete. 2024-05-08T05:52:49.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.644+0000 7f011630db80 20 client.25477 trim_cache size 0 max 16384 2024-05-08T05:52:49.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.674+0000 7f011630db80 1 Processor -- start 2024-05-08T05:52:49.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.674+0000 7f011630db80 1 -- start start 2024-05-08T05:52:49.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.674+0000 7f011630db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ace9bf600 0x558ace9befe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:49.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.674+0000 7f011630db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ace9c49e0 0x558ace9b42e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:49.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.674+0000 7f011630db80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ace9c5300 0x558ace9e0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:49.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.674+0000 7f011630db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f01041b40c0 con 0x558ace9bf600 2024-05-08T05:52:49.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.674+0000 7f011630db80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f01041b5c30 con 0x558ace9c5300 2024-05-08T05:52:49.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.674+0000 7f011630db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f01041b4790 con 0x558ace9c49e0 2024-05-08T05:52:49.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.675+0000 7f0109000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ace9bf600 0x558ace9befe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:49.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.675+0000 7f0109a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ace9c5300 0x558ace9e0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:49.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.675+0000 7f0109000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ace9bf600 0x558ace9befe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48496/0 (socket says 172.21.15.82:48496) 2024-05-08T05:52:49.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.675+0000 7f0109a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ace9c5300 0x558ace9e0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:58360/0 (socket says 172.21.15.82:58360) 2024-05-08T05:52:49.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.675+0000 7f0109a00700 1 -- 172.21.15.82:0/3695322281 learned_addr learned my addr 172.21.15.82:0/3695322281 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:52:49.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.675+0000 7f00fbe00700 1 --2- 172.21.15.82:0/3695322281 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ace9c49e0 0x558ace9b42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:49.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.675+0000 7f0109000700 1 -- 172.21.15.82:0/3695322281 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ace9c49e0 msgr2=0x558ace9b42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:49.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.675+0000 7f0109000700 1 --2- 172.21.15.82:0/3695322281 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ace9c49e0 0x558ace9b42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:49.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.676+0000 7f0109000700 1 -- 172.21.15.82:0/3695322281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ace9c5300 msgr2=0x558ace9e0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:49.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.676+0000 7f0109000700 1 --2- 172.21.15.82:0/3695322281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ace9c5300 0x558ace9e0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:49.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.676+0000 7f0109000700 1 -- 172.21.15.82:0/3695322281 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ace9c6840 con 0x558ace9bf600 2024-05-08T05:52:49.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.676+0000 7f00fbe00700 1 --2- 172.21.15.82:0/3695322281 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ace9c49e0 0x558ace9b42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:52:49.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.676+0000 7f0109a00700 1 --2- 172.21.15.82:0/3695322281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ace9c5300 0x558ace9e0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:52:49.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.676+0000 7f0109000700 1 --2- 172.21.15.82:0/3695322281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ace9bf600 0x558ace9befe0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f00f400a520 tx=0x7f00f40096d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a573cdb815c15617 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:52:49.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.677+0000 7f00f9600700 1 -- 172.21.15.82:0/3695322281 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f400ad70 con 0x558ace9bf600 2024-05-08T05:52:49.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.677+0000 7f00f9600700 1 -- 172.21.15.82:0/3695322281 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00f401d680 con 0x558ace9bf600 2024-05-08T05:52:49.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.677+0000 7f00f9600700 1 -- 172.21.15.82:0/3695322281 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f4026ad0 con 0x558ace9bf600 2024-05-08T05:52:49.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.678+0000 7f011630db80 1 -- 172.21.15.82:0/3695322281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ace9bf600 msgr2=0x558ace9befe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:49.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.678+0000 7f011630db80 1 --2- 172.21.15.82:0/3695322281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ace9bf600 0x558ace9befe0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f00f400a520 tx=0x7f00f40096d0 comp rx=0 tx=0).stop 2024-05-08T05:52:49.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.678+0000 7f011630db80 1 -- 172.21.15.82:0/3695322281 shutdown_connections 2024-05-08T05:52:49.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.678+0000 7f011630db80 1 --2- 172.21.15.82:0/3695322281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ace9c5300 0x558ace9e0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:49.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.678+0000 7f011630db80 1 --2- 172.21.15.82:0/3695322281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ace9bf600 0x558ace9befe0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:49.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.678+0000 7f011630db80 1 --2- 172.21.15.82:0/3695322281 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ace9c49e0 0x558ace9b42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:49.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.678+0000 7f011630db80 1 -- 172.21.15.82:0/3695322281 >> 172.21.15.82:0/3695322281 conn(0x558ace8edb60 msgr2=0x558ace9b3bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:52:49.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.679+0000 7f011630db80 1 -- 172.21.15.82:0/3695322281 shutdown_connections 2024-05-08T05:52:49.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.679+0000 7f011630db80 1 -- 172.21.15.82:0/3695322281 wait complete. 2024-05-08T05:52:49.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.680+0000 7f011630db80 1 -- start start 2024-05-08T05:52:49.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.680+0000 7f011630db80 1 Processor -- start 2024-05-08T05:52:49.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.681+0000 7f011630db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ace9bf600 0x558ace9d1070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:49.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.681+0000 7f011630db80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ace9c49e0 0x558ace9cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:49.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.681+0000 7f011630db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ace9c5300 0x558ace9ce330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:49.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.681+0000 7f011630db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f01041b5530 con 0x558ace9c5300 2024-05-08T05:52:49.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.681+0000 7f011630db80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f01041b4e60 con 0x558ace9c49e0 2024-05-08T05:52:49.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.681+0000 7f011630db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f01041b2020 con 0x558ace9bf600 2024-05-08T05:52:49.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.681+0000 7f011630db80 10 client.0 _ll_register_callbacks cb 0x558ace9c92f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:52:49.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.681+0000 7f0109a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ace9c5300 0x558ace9ce330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:49.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.681+0000 7f00fbe00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ace9c49e0 0x558ace9cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:49.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.681+0000 7f00fbe00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ace9c49e0 0x558ace9cddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:58376/0 (socket says 172.21.15.82:58376) 2024-05-08T05:52:49.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.681+0000 7f00fbe00700 1 -- 172.21.15.82:0/3612553357 learned_addr learned my addr 172.21.15.82:0/3612553357 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:52:49.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.682+0000 7f0109000700 1 --2- 172.21.15.82:0/3612553357 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ace9bf600 0x558ace9d1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:49.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.682+0000 7f00fbe00700 1 -- 172.21.15.82:0/3612553357 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ace9bf600 msgr2=0x558ace9d1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:49.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.682+0000 7f00fbe00700 1 --2- 172.21.15.82:0/3612553357 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ace9bf600 0x558ace9d1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:49.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.682+0000 7f00fbe00700 1 -- 172.21.15.82:0/3612553357 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ace9c5300 msgr2=0x558ace9ce330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:52:49.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.682+0000 7f00fbe00700 1 --2- 172.21.15.82:0/3612553357 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ace9c5300 0x558ace9ce330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:49.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.682+0000 7f00fbe00700 1 -- 172.21.15.82:0/3612553357 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ace9ce870 con 0x558ace9c49e0 2024-05-08T05:52:49.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.683+0000 7f00fbe00700 1 --2- 172.21.15.82:0/3612553357 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ace9c49e0 0x558ace9cddf0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f00ec0a74b0 tx=0x7f00ec0aa730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8570baad424aab5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:52:49.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.683+0000 7f00f2a00700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:52:49.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.684+0000 7f00f2a00700 1 -- 172.21.15.82:0/3612553357 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00ec0ca050 con 0x558ace9c49e0 2024-05-08T05:52:49.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.684+0000 7f00f2a00700 1 -- 172.21.15.82:0/3612553357 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f00ec0a6830 con 0x558ace9c49e0 2024-05-08T05:52:49.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.684+0000 7f011630db80 1 -- 172.21.15.82:0/3612553357 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00f401d680 con 0x558ace9c49e0 2024-05-08T05:52:49.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.685+0000 7f00f2a00700 1 -- 172.21.15.82:0/3612553357 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f00ec0a6100 con 0x558ace9c49e0 2024-05-08T05:52:49.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.685+0000 7f011630db80 10 client.25466 fetch_fsmap learned FSMap version 30 2024-05-08T05:52:49.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.685+0000 7f011630db80 1 -- 172.21.15.82:0/3612553357 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x558ace9ce870 con 0x558ace9c49e0 2024-05-08T05:52:49.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.686+0000 7f00f2a00700 1 -- 172.21.15.82:0/3612553357 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f00f401d680 con 0x558ace9c49e0 2024-05-08T05:52:49.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.686+0000 7f00f2a00700 1 -- 172.21.15.82:0/3612553357 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 30) ==== 8358+0+0 (secure 0 0 0) 0x7f00ec0a94a0 con 0x558ace9c49e0 2024-05-08T05:52:49.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.686+0000 7f011630db80 10 client.25466 fetch_fsmap finished waiting for FSMap version 30 2024-05-08T05:52:49.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.687+0000 7f011630db80 10 client.25466 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:52:49.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.687+0000 7f011630db80 20 client.25466 populate_metadata read hostname 'smithi082' 2024-05-08T05:52:49.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.687+0000 7f011630db80 1 --2- 172.21.15.82:0/3612553357 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x558acea43d50 0x558acea46170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:52:49.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.687+0000 7f011630db80 4 client.25466 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-08T05:52:49.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.687+0000 7f011630db80 1 -- 172.21.15.82:0/3612553357 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558ace91f400 con 0x558acea43d50 2024-05-08T05:52:49.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.688+0000 7f0109000700 1 --2- 172.21.15.82:0/3612553357 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x558acea43d50 0x558acea46170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:52:49.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.689+0000 7f0109000700 1 --2- 172.21.15.82:0/3612553357 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x558acea43d50 0x558acea46170 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c9f98daf15a9f51 server_cookie=f0b29d60fa2eaf1 in_seq=0 out_seq=0 2024-05-08T05:52:49.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.689+0000 7f00f2a00700 10 client.25466 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:52:49.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.689+0000 7f00f2a00700 1 -- 172.21.15.82:0/3612553357 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x558ace91f400 con 0x558acea43d50 2024-05-08T05:52:49.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.689+0000 7f00f2a00700 10 client.25466 handle_command_reply: tid=0 2024-05-08T05:52:49.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.689+0000 7f011630db80 1 client.25466 shutdown 2024-05-08T05:52:49.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.689+0000 7f011630db80 1 -- 172.21.15.82:0/3612553357 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ace9c49e0 msgr2=0x558ace9cddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:49.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.689+0000 7f011630db80 1 --2- 172.21.15.82:0/3612553357 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ace9c49e0 0x558ace9cddf0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f00ec0a74b0 tx=0x7f00ec0aa730 comp rx=0 tx=0).stop 2024-05-08T05:52:49.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.690+0000 7f011630db80 1 -- 172.21.15.82:0/3612553357 shutdown_connections 2024-05-08T05:52:49.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.690+0000 7f011630db80 1 --2- 172.21.15.82:0/3612553357 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ace9c5300 0x558ace9ce330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:49.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.690+0000 7f011630db80 1 --2- 172.21.15.82:0/3612553357 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ace9bf600 0x558ace9d1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:49.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.690+0000 7f011630db80 1 --2- 172.21.15.82:0/3612553357 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x558acea43d50 0x558acea46170 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:49.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.690+0000 7f011630db80 1 --2- 172.21.15.82:0/3612553357 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ace9c49e0 0x558ace9cddf0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:49.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.690+0000 7f011630db80 1 -- 172.21.15.82:0/3612553357 >> 172.21.15.82:0/3612553357 conn(0x558ace8edb60 msgr2=0x558ace9b4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:52:49.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.690+0000 7f00f2a00700 0 client.25466 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:52:49.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.690+0000 7f011630db80 1 -- 172.21.15.82:0/3612553357 shutdown_connections 2024-05-08T05:52:49.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.690+0000 7f011630db80 1 -- 172.21.15.82:0/3612553357 wait complete. 2024-05-08T05:52:49.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.690+0000 7f011630db80 20 client.25466 trim_cache size 0 max 16384 2024-05-08T05:52:49.692 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T05:52:49.692 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-08T05:52:49.693 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2024-05-08T05:52:49.693 INFO:teuthology.orchestra.run.smithi082.stdout: "dec0adab-4fd5-4772-baff-f08796049191": { 2024-05-08T05:52:49.693 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2024-05-08T05:52:49.693 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "dec0adab-4fd5-4772-baff-f08796049191", 2024-05-08T05:52:49.693 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2024-05-08T05:52:49.693 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T05:52:49.693 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T05:52:49.693 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T05:52:49.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.691+0000 7f010a400700 1 -- 172.21.15.82:0/746316392 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f00e80b2930 msgr2=0x7f00e80b4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:49.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.691+0000 7f010a400700 1 --2- 172.21.15.82:0/746316392 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f00e80b2930 0x7f00e80b4df0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f00fc005950 tx=0x7f00fc00b390 comp rx=0 tx=0).stop 2024-05-08T05:52:49.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.691+0000 7f010a400700 1 -- 172.21.15.82:0/746316392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0104102ee0 msgr2=0x7f010410b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:52:49.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.691+0000 7f010a400700 1 --2- 172.21.15.82:0/746316392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0104102ee0 0x7f010410b920 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f00ec006010 tx=0x7f00ec0038b0 comp rx=0 tx=0).stop 2024-05-08T05:52:49.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.692+0000 7f010a400700 1 -- 172.21.15.82:0/746316392 shutdown_connections 2024-05-08T05:52:49.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.692+0000 7f010a400700 1 --2- 172.21.15.82:0/746316392 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0104107610 0x7f010410be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:49.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.692+0000 7f010a400700 1 --2- 172.21.15.82:0/746316392 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f00e80b2930 0x7f00e80b4df0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:49.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.692+0000 7f010a400700 1 --2- 172.21.15.82:0/746316392 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0104102530 0x7f010410b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:49.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.692+0000 7f010a400700 1 --2- 172.21.15.82:0/746316392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0104102ee0 0x7f010410b920 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:52:49.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.692+0000 7f010a400700 1 -- 172.21.15.82:0/746316392 >> 172.21.15.82:0/746316392 conn(0x7f01040fddc0 msgr2=0x7f0104100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:52:49.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.692+0000 7f010a400700 1 -- 172.21.15.82:0/746316392 shutdown_connections 2024-05-08T05:52:49.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:52:49.692+0000 7f010a400700 1 -- 172.21.15.82:0/746316392 wait complete. 2024-05-08T05:52:50.181 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:52:49 smithi151 ceph-mon[34815]: pgmap v524: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 7.7 MiB/s wr, 676 op/s 2024-05-08T05:52:50.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:52:49 smithi082 ceph-mon[30098]: pgmap v524: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 7.7 MiB/s wr, 676 op/s 2024-05-08T05:52:50.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:52:49 smithi134 ceph-mon[34132]: pgmap v524: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 7.7 MiB/s wr, 676 op/s 2024-05-08T05:52:50.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 120.0 s, 3020.6 tps, lat 33.089 ms stddev 38.283 2024-05-08T05:52:50.595 INFO:tasks.cephfs.filesystem:scrub status for tag:dec0adab-4fd5-4772-baff-f08796049191 - {'path': '/', 'tag': 'dec0adab-4fd5-4772-baff-f08796049191', 'options': 'recursive,force'} 2024-05-08T05:52:51.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:52:50 smithi082 ceph-mon[30098]: scrub summary: idle 2024-05-08T05:52:51.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:52:50 smithi134 ceph-mon[34132]: scrub summary: idle 2024-05-08T05:52:51.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:52:50 smithi151 ceph-mon[34815]: scrub summary: idle 2024-05-08T05:52:52.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:52:51 smithi082 ceph-mon[30098]: scrub summary: idle 2024-05-08T05:52:52.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:52:51 smithi082 ceph-mon[30098]: pgmap v525: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 8.0 MiB/s wr, 713 op/s 2024-05-08T05:52:52.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:52:51 smithi134 ceph-mon[34132]: scrub summary: idle 2024-05-08T05:52:52.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:52:51 smithi134 ceph-mon[34132]: pgmap v525: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 8.0 MiB/s wr, 713 op/s 2024-05-08T05:52:52.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:52:51 smithi151 ceph-mon[34815]: scrub summary: idle 2024-05-08T05:52:52.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:52:51 smithi151 ceph-mon[34815]: pgmap v525: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 8.0 MiB/s wr, 713 op/s 2024-05-08T05:52:54.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:52:53 smithi082 ceph-mon[30098]: pgmap v526: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.1 MiB/s wr, 685 op/s 2024-05-08T05:52:54.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:52:53 smithi134 ceph-mon[34132]: pgmap v526: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.1 MiB/s wr, 685 op/s 2024-05-08T05:52:54.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:52:53 smithi151 ceph-mon[34815]: pgmap v526: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.1 MiB/s wr, 685 op/s 2024-05-08T05:52:55.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 125.0 s, 2872.2 tps, lat 34.756 ms stddev 39.973 2024-05-08T05:52:56.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:52:55 smithi082 ceph-mon[30098]: pgmap v527: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 7.4 MiB/s wr, 745 op/s 2024-05-08T05:52:56.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:52:55 smithi134 ceph-mon[34132]: pgmap v527: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 7.4 MiB/s wr, 745 op/s 2024-05-08T05:52:56.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:52:55 smithi151 ceph-mon[34815]: pgmap v527: 97 pgs: 97 active+clean; 1.1 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 7.4 MiB/s wr, 745 op/s 2024-05-08T05:52:58.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:52:57 smithi082 ceph-mon[30098]: pgmap v528: 97 pgs: 97 active+clean; 1.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.6 MiB/s wr, 732 op/s 2024-05-08T05:52:58.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:52:57 smithi134 ceph-mon[34132]: pgmap v528: 97 pgs: 97 active+clean; 1.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.6 MiB/s wr, 732 op/s 2024-05-08T05:52:58.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:52:57 smithi151 ceph-mon[34815]: pgmap v528: 97 pgs: 97 active+clean; 1.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.6 MiB/s wr, 732 op/s 2024-05-08T05:53:00.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:52:59 smithi082 ceph-mon[30098]: pgmap v529: 97 pgs: 97 active+clean; 1.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.2 MiB/s wr, 719 op/s 2024-05-08T05:53:00.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:52:59 smithi134 ceph-mon[34132]: pgmap v529: 97 pgs: 97 active+clean; 1.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.2 MiB/s wr, 719 op/s 2024-05-08T05:53:00.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 130.0 s, 2689.8 tps, lat 37.133 ms stddev 41.848 2024-05-08T05:53:00.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:52:59 smithi151 ceph-mon[34815]: pgmap v529: 97 pgs: 97 active+clean; 1.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.2 MiB/s wr, 719 op/s 2024-05-08T05:53:02.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:53:01 smithi082 ceph-mon[30098]: pgmap v530: 97 pgs: 97 active+clean; 1.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 829 op/s 2024-05-08T05:53:02.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:53:01 smithi134 ceph-mon[34132]: pgmap v530: 97 pgs: 97 active+clean; 1.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 829 op/s 2024-05-08T05:53:02.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:53:01 smithi151 ceph-mon[34815]: pgmap v530: 97 pgs: 97 active+clean; 1.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 829 op/s 2024-05-08T05:53:04.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:53:03 smithi082 ceph-mon[30098]: pgmap v531: 97 pgs: 97 active+clean; 1.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.1 MiB/s wr, 730 op/s 2024-05-08T05:53:04.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:53:03 smithi134 ceph-mon[34132]: pgmap v531: 97 pgs: 97 active+clean; 1.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.1 MiB/s wr, 730 op/s 2024-05-08T05:53:04.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:53:03 smithi151 ceph-mon[34815]: pgmap v531: 97 pgs: 97 active+clean; 1.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.1 MiB/s wr, 730 op/s 2024-05-08T05:53:05.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 135.0 s, 3094.0 tps, lat 32.278 ms stddev 38.132 2024-05-08T05:53:06.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:53:05 smithi082 ceph-mon[30098]: pgmap v532: 97 pgs: 97 active+clean; 1.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.0 MiB/s wr, 711 op/s 2024-05-08T05:53:06.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:53:05 smithi134 ceph-mon[34132]: pgmap v532: 97 pgs: 97 active+clean; 1.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.0 MiB/s wr, 711 op/s 2024-05-08T05:53:06.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:53:05 smithi151 ceph-mon[34815]: pgmap v532: 97 pgs: 97 active+clean; 1.1 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.0 MiB/s wr, 711 op/s 2024-05-08T05:53:08.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:53:07 smithi082 ceph-mon[30098]: pgmap v533: 97 pgs: 97 active+clean; 1.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.7 MiB/s wr, 734 op/s 2024-05-08T05:53:08.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:53:07 smithi134 ceph-mon[34132]: pgmap v533: 97 pgs: 97 active+clean; 1.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.7 MiB/s wr, 734 op/s 2024-05-08T05:53:08.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:53:07 smithi151 ceph-mon[34815]: pgmap v533: 97 pgs: 97 active+clean; 1.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.7 MiB/s wr, 734 op/s 2024-05-08T05:53:10.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:53:09 smithi082 ceph-mon[30098]: pgmap v534: 97 pgs: 97 active+clean; 1.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.9 MiB/s wr, 715 op/s 2024-05-08T05:53:10.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:53:09 smithi134 ceph-mon[34132]: pgmap v534: 97 pgs: 97 active+clean; 1.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.9 MiB/s wr, 715 op/s 2024-05-08T05:53:10.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 140.0 s, 2561.4 tps, lat 39.115 ms stddev 43.873 2024-05-08T05:53:10.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:53:09 smithi151 ceph-mon[34815]: pgmap v534: 97 pgs: 97 active+clean; 1.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.9 MiB/s wr, 715 op/s 2024-05-08T05:53:12.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:53:11 smithi082 ceph-mon[30098]: pgmap v535: 97 pgs: 97 active+clean; 1.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.6 MiB/s wr, 771 op/s 2024-05-08T05:53:12.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:53:11 smithi134 ceph-mon[34132]: pgmap v535: 97 pgs: 97 active+clean; 1.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.6 MiB/s wr, 771 op/s 2024-05-08T05:53:12.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:53:11 smithi151 ceph-mon[34815]: pgmap v535: 97 pgs: 97 active+clean; 1.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.6 MiB/s wr, 771 op/s 2024-05-08T05:53:14.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:53:13 smithi134 ceph-mon[34132]: pgmap v536: 97 pgs: 97 active+clean; 1.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.5 MiB/s wr, 653 op/s 2024-05-08T05:53:14.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:53:13 smithi151 ceph-mon[34815]: pgmap v536: 97 pgs: 97 active+clean; 1.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.5 MiB/s wr, 653 op/s 2024-05-08T05:53:14.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:53:13 smithi082 ceph-mon[30098]: pgmap v536: 97 pgs: 97 active+clean; 1.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.5 MiB/s wr, 653 op/s 2024-05-08T05:53:15.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 145.0 s, 2637.0 tps, lat 37.934 ms stddev 47.116 2024-05-08T05:53:16.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:53:15 smithi134 ceph-mon[34132]: pgmap v537: 97 pgs: 97 active+clean; 1.1 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 8.3 MiB/s wr, 736 op/s 2024-05-08T05:53:16.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:53:15 smithi151 ceph-mon[34815]: pgmap v537: 97 pgs: 97 active+clean; 1.1 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 8.3 MiB/s wr, 736 op/s 2024-05-08T05:53:16.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:53:15 smithi082 ceph-mon[30098]: pgmap v537: 97 pgs: 97 active+clean; 1.1 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 8.3 MiB/s wr, 736 op/s 2024-05-08T05:53:18.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:53:17 smithi134 ceph-mon[34132]: pgmap v538: 97 pgs: 97 active+clean; 1.1 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 MiB/s wr, 740 op/s 2024-05-08T05:53:18.271 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:53:17 smithi082 ceph-mon[30098]: pgmap v538: 97 pgs: 97 active+clean; 1.1 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 MiB/s wr, 740 op/s 2024-05-08T05:53:18.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:53:17 smithi151 ceph-mon[34815]: pgmap v538: 97 pgs: 97 active+clean; 1.1 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.1 MiB/s wr, 740 op/s 2024-05-08T05:53:20.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:53:19 smithi134 ceph-mon[34132]: pgmap v539: 97 pgs: 97 active+clean; 1.1 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.9 MiB/s wr, 668 op/s 2024-05-08T05:53:20.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 150.0 s, 3172.6 tps, lat 31.549 ms stddev 34.829 2024-05-08T05:53:20.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:53:19 smithi151 ceph-mon[34815]: pgmap v539: 97 pgs: 97 active+clean; 1.1 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.9 MiB/s wr, 668 op/s 2024-05-08T05:53:20.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:53:19 smithi082 ceph-mon[30098]: pgmap v539: 97 pgs: 97 active+clean; 1.1 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.9 MiB/s wr, 668 op/s 2024-05-08T05:53:20.596 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-08T05:53:21.200 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:53:22.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:53:21 smithi134 ceph-mon[34132]: pgmap v540: 97 pgs: 97 active+clean; 1.1 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.4 MiB/s wr, 745 op/s 2024-05-08T05:53:22.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:53:21 smithi134 ceph-mon[34132]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-08T05:53:22.278 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:53:21 smithi082 ceph-mon[30098]: pgmap v540: 97 pgs: 97 active+clean; 1.1 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.4 MiB/s wr, 745 op/s 2024-05-08T05:53:22.278 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:53:21 smithi082 ceph-mon[30098]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-08T05:53:22.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:53:21 smithi151 ceph-mon[34815]: pgmap v540: 97 pgs: 97 active+clean; 1.1 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.4 MiB/s wr, 745 op/s 2024-05-08T05:53:22.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:53:21 smithi151 ceph-mon[34815]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-08T05:53:23.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.807+0000 7fdee0000700 1 -- 172.21.15.82:0/1282931421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fded8102230 msgr2=0x7fded8109280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:23.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.807+0000 7fdee0000700 1 --2- 172.21.15.82:0/1282931421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fded8102230 0x7fded8109280 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fdec4009920 tx=0x7fdec4009c30 comp rx=0 tx=0).stop 2024-05-08T05:53:23.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.808+0000 7fdee0000700 1 -- 172.21.15.82:0/1282931421 shutdown_connections 2024-05-08T05:53:23.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.808+0000 7fdee0000700 1 --2- 172.21.15.82:0/1282931421 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fded8101880 0x7fded8101c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:23.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.808+0000 7fdee0000700 1 --2- 172.21.15.82:0/1282931421 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fded8109960 0x7fded8110390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:23.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.808+0000 7fdee0000700 1 --2- 172.21.15.82:0/1282931421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fded8102230 0x7fded8109280 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:23.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.808+0000 7fdee0000700 1 -- 172.21.15.82:0/1282931421 >> 172.21.15.82:0/1282931421 conn(0x7fded80785a0 msgr2=0x7fded80ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:53:23.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.809+0000 7fdee0000700 1 -- 172.21.15.82:0/1282931421 shutdown_connections 2024-05-08T05:53:23.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.809+0000 7fdee0000700 1 -- 172.21.15.82:0/1282931421 wait complete. 2024-05-08T05:53:23.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.811+0000 7fdee0000700 1 Processor -- start 2024-05-08T05:53:23.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.815+0000 7fdee0000700 1 -- start start 2024-05-08T05:53:23.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.816+0000 7fdee0000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fded8101880 0x7fded810c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:23.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.816+0000 7fdee0000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fded8102230 0x7fded810ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:23.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.816+0000 7fdee0000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fded8109960 0x7fded8074f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:23.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.817+0000 7fdedcc00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fded8102230 0x7fded810ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:23.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.817+0000 7fdedcc00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fded8102230 0x7fded810ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:46148/0 (socket says 172.21.15.82:46148) 2024-05-08T05:53:23.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.818+0000 7fdee0000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fded8104180 con 0x7fded8101880 2024-05-08T05:53:23.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.818+0000 7fdee0000700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fded8104000 con 0x7fded8109960 2024-05-08T05:53:23.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.818+0000 7fdee0000700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fded8104300 con 0x7fded8102230 2024-05-08T05:53:23.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.818+0000 7fdede000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fded8109960 0x7fded8074f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:23.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.818+0000 7fdede000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fded8109960 0x7fded8074f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:60986/0 (socket says 172.21.15.82:60986) 2024-05-08T05:53:23.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.818+0000 7fdede000700 1 -- 172.21.15.82:0/3021892345 learned_addr learned my addr 172.21.15.82:0/3021892345 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:53:23.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.819+0000 7fdede000700 1 -- 172.21.15.82:0/3021892345 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fded8102230 msgr2=0x7fded810ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:23.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.819+0000 7fdede000700 1 --2- 172.21.15.82:0/3021892345 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fded8102230 0x7fded810ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:23.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.819+0000 7fdede000700 1 -- 172.21.15.82:0/3021892345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fded8101880 msgr2=0x7fded810c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:23.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.819+0000 7fdede000700 1 --2- 172.21.15.82:0/3021892345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fded8101880 0x7fded810c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:23.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.819+0000 7fdede000700 1 -- 172.21.15.82:0/3021892345 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fded810d6d0 con 0x7fded8109960 2024-05-08T05:53:23.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.819+0000 7fdede000700 1 --2- 172.21.15.82:0/3021892345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fded8109960 0x7fded8074f10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdecc00c140 tx=0x7fdecc00c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:53:23.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.819+0000 7fded6000700 1 -- 172.21.15.82:0/3021892345 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdecc0092e0 con 0x7fded8109960 2024-05-08T05:53:23.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.820+0000 7fded6000700 1 -- 172.21.15.82:0/3021892345 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdecc004bb0 con 0x7fded8109960 2024-05-08T05:53:23.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.820+0000 7fded6000700 1 -- 172.21.15.82:0/3021892345 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdecc007cc0 con 0x7fded8109960 2024-05-08T05:53:23.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.820+0000 7fdee0000700 1 -- 172.21.15.82:0/3021892345 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fded81b4e00 con 0x7fded8109960 2024-05-08T05:53:23.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.820+0000 7fdee0000700 1 -- 172.21.15.82:0/3021892345 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fded81b5260 con 0x7fded8109960 2024-05-08T05:53:23.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.829+0000 7fdeea917b80 1 Processor -- start 2024-05-08T05:53:23.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.831+0000 7fded6000700 1 -- 172.21.15.82:0/3021892345 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fdecc01a020 con 0x7fded8109960 2024-05-08T05:53:23.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.831+0000 7fdeea917b80 1 -- start start 2024-05-08T05:53:23.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.832+0000 7fdeea917b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f082e53bc0 0x55f082e53fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:23.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.832+0000 7fdeea917b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f082e544e0 0x55f082e4e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:23.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.832+0000 7fdeea917b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f082e4e8f0 0x55f082e4ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:23.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.832+0000 7fdeea917b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f082da0a20 con 0x55f082e4e8f0 2024-05-08T05:53:23.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.832+0000 7fdeea917b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f082d3e760 con 0x55f082e53bc0 2024-05-08T05:53:23.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.832+0000 7fdeea917b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55f082d9c9e0 con 0x55f082e544e0 2024-05-08T05:53:23.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.833+0000 7fdedcc00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f082e53bc0 0x55f082e53fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:23.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.833+0000 7fdedcc00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f082e53bc0 0x55f082e53fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:32768/0 (socket says 172.21.15.82:32768) 2024-05-08T05:53:23.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.833+0000 7fdedcc00700 1 -- 172.21.15.82:0/4264378196 learned_addr learned my addr 172.21.15.82:0/4264378196 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:53:23.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.833+0000 7fdedd600700 1 --2- 172.21.15.82:0/4264378196 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f082e544e0 0x55f082e4e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:23.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.834+0000 7fdedcc00700 1 --2- 172.21.15.82:0/4264378196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f082e4e8f0 0x55f082e4ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:23.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.834+0000 7fdedd600700 1 -- 172.21.15.82:0/4264378196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f082e53bc0 msgr2=0x55f082e53fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:53:23.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.835+0000 7fdedd600700 1 --2- 172.21.15.82:0/4264378196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f082e53bc0 0x55f082e53fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:23.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.835+0000 7fdedd600700 1 -- 172.21.15.82:0/4264378196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f082e4e8f0 msgr2=0x55f082e4ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:53:23.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.835+0000 7fdedd600700 1 --2- 172.21.15.82:0/4264378196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f082e4e8f0 0x55f082e4ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:23.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.835+0000 7fdedd600700 1 -- 172.21.15.82:0/4264378196 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f082ced8d0 con 0x55f082e544e0 2024-05-08T05:53:23.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.836+0000 7fdedcc00700 1 --2- 172.21.15.82:0/4264378196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f082e53bc0 0x55f082e53fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:53:23.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.836+0000 7fdedd600700 1 --2- 172.21.15.82:0/4264378196 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f082e544e0 0x55f082e4e2d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fded0009bd0 tx=0x7fded0009ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50027185e0cdbb67 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:53:23.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.837+0000 7fdecaa00700 1 -- 172.21.15.82:0/4264378196 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded0004230 con 0x55f082e544e0 2024-05-08T05:53:23.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.837+0000 7fdecaa00700 1 -- 172.21.15.82:0/4264378196 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fded000ee10 con 0x55f082e544e0 2024-05-08T05:53:23.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.837+0000 7fdecaa00700 1 -- 172.21.15.82:0/4264378196 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded0005060 con 0x55f082e544e0 2024-05-08T05:53:23.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.837+0000 7fded6000700 1 --2- 172.21.15.82:0/3021892345 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fdec00b29d0 0x7fdec00b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:23.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.838+0000 7fdedcc00700 1 --2- 172.21.15.82:0/3021892345 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fdec00b29d0 0x7fdec00b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:23.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.838+0000 7fdeea917b80 1 -- 172.21.15.82:0/4264378196 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f082e544e0 msgr2=0x55f082e4e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:23.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.838+0000 7fdeea917b80 1 --2- 172.21.15.82:0/4264378196 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f082e544e0 0x55f082e4e2d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fded0009bd0 tx=0x7fded0009ee0 comp rx=0 tx=0).stop 2024-05-08T05:53:23.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.838+0000 7fded6000700 1 -- 172.21.15.82:0/3021892345 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fdecc0e1b50 con 0x7fded8109960 2024-05-08T05:53:23.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.839+0000 7fdeea917b80 1 -- 172.21.15.82:0/4264378196 shutdown_connections 2024-05-08T05:53:23.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.840+0000 7fdeea917b80 1 --2- 172.21.15.82:0/4264378196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f082e53bc0 0x55f082e53fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:23.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.840+0000 7fdeea917b80 1 --2- 172.21.15.82:0/4264378196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f082e4e8f0 0x55f082e4ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:23.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.840+0000 7fdeea917b80 1 --2- 172.21.15.82:0/4264378196 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f082e544e0 0x55f082e4e2d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:23.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.840+0000 7fdeea917b80 1 -- 172.21.15.82:0/4264378196 >> 172.21.15.82:0/4264378196 conn(0x55f082dc66d0 msgr2=0x55f082e48b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:53:23.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.840+0000 7fdedcc00700 1 --2- 172.21.15.82:0/3021892345 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fdec00b29d0 0x7fdec00b4e90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fdec4005c50 tx=0x7fdec400bfa0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:53:23.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.841+0000 7fdeea917b80 1 -- 172.21.15.82:0/4264378196 shutdown_connections 2024-05-08T05:53:23.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.841+0000 7fdeea917b80 1 -- 172.21.15.82:0/4264378196 wait complete. 2024-05-08T05:53:23.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.842+0000 7fdeea917b80 1 -- start start 2024-05-08T05:53:23.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.842+0000 7fdeea917b80 1 Processor -- start 2024-05-08T05:53:23.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.844+0000 7fdeea917b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f082e4e8f0 0x55f082e5a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:23.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.844+0000 7fdeea917b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f082e53bc0 0x55f082e57520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:23.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.844+0000 7fdeea917b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f082e544e0 0x55f082e57a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:23.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.845+0000 7fdeea917b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f082e5af20 con 0x55f082e544e0 2024-05-08T05:53:23.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.845+0000 7fdeea917b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f082d06b20 con 0x55f082e53bc0 2024-05-08T05:53:23.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.845+0000 7fdeea917b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55f082e5b0a0 con 0x55f082e4e8f0 2024-05-08T05:53:23.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.845+0000 7fdeea917b80 10 client.0 _ll_register_callbacks cb 0x55f082d47c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:53:23.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.845+0000 7fdede000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f082e544e0 0x55f082e57a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:23.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.845+0000 7fdedd600700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f082e4e8f0 0x55f082e5a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:23.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.845+0000 7fdedd600700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f082e4e8f0 0x55f082e5a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:46164/0 (socket says 172.21.15.82:46164) 2024-05-08T05:53:23.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.845+0000 7fdedd600700 1 -- 172.21.15.82:0/2221011842 learned_addr learned my addr 172.21.15.82:0/2221011842 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:53:23.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.846+0000 7fdedd600700 1 -- 172.21.15.82:0/2221011842 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f082e53bc0 msgr2=0x55f082e57520 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T05:53:23.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.846+0000 7fdedd600700 1 --2- 172.21.15.82:0/2221011842 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f082e53bc0 0x55f082e57520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:23.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.846+0000 7fdedd600700 1 -- 172.21.15.82:0/2221011842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f082e544e0 msgr2=0x55f082e57a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:53:23.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.846+0000 7fdedd600700 1 --2- 172.21.15.82:0/2221011842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f082e544e0 0x55f082e57a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:23.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.846+0000 7fdedd600700 1 -- 172.21.15.82:0/2221011842 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f082d66420 con 0x55f082e4e8f0 2024-05-08T05:53:23.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.846+0000 7fdede000700 1 --2- 172.21.15.82:0/2221011842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f082e544e0 0x55f082e57a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:53:23.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.846+0000 7fdedd600700 1 --2- 172.21.15.82:0/2221011842 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f082e4e8f0 0x55f082e5a130 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fded0005c50 tx=0x7fded000eb90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b14b53eecbbc5323 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:53:23.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.846+0000 7fdebf400700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:53:23.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.846+0000 7fdebf400700 1 -- 172.21.15.82:0/2221011842 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded0004450 con 0x55f082e4e8f0 2024-05-08T05:53:23.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.846+0000 7fdebf400700 1 -- 172.21.15.82:0/2221011842 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fded0005020 con 0x55f082e4e8f0 2024-05-08T05:53:23.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.847+0000 7fdeea917b80 1 -- 172.21.15.82:0/2221011842 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fded000ee10 con 0x55f082e4e8f0 2024-05-08T05:53:23.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.847+0000 7fdebf400700 1 -- 172.21.15.82:0/2221011842 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fded0005220 con 0x55f082e4e8f0 2024-05-08T05:53:23.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.847+0000 7fdeea917b80 10 client.25492 fetch_fsmap learned FSMap version 31 2024-05-08T05:53:23.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.847+0000 7fdeea917b80 1 -- 172.21.15.82:0/2221011842 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55f082e65730 con 0x55f082e4e8f0 2024-05-08T05:53:23.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.847+0000 7fdebf400700 1 -- 172.21.15.82:0/2221011842 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fded000ee10 con 0x55f082e4e8f0 2024-05-08T05:53:23.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.848+0000 7fdebf400700 1 -- 172.21.15.82:0/2221011842 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fded0003cc0 con 0x55f082e4e8f0 2024-05-08T05:53:23.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.848+0000 7fdeea917b80 10 client.25492 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:53:23.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.848+0000 7fdeea917b80 10 client.25492 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:53:23.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.848+0000 7fdeea917b80 20 client.25492 populate_metadata read hostname 'smithi082' 2024-05-08T05:53:23.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.848+0000 7fdeea917b80 1 --2- 172.21.15.82:0/2221011842 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55f082e67c00 0x55f082e69ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:23.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.848+0000 7fdeea917b80 4 client.25492 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:53:23.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.848+0000 7fdeea917b80 1 -- 172.21.15.82:0/2221011842 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f082e1b140 con 0x55f082e67c00 2024-05-08T05:53:23.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.849+0000 7fdedcc00700 1 --2- 172.21.15.82:0/2221011842 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55f082e67c00 0x55f082e69ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:23.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.850+0000 7fdedcc00700 1 --2- 172.21.15.82:0/2221011842 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55f082e67c00 0x55f082e69ff0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=971f7ab6cae78475 server_cookie=64460a76d39b58da in_seq=0 out_seq=0 2024-05-08T05:53:23.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.850+0000 7fdebf400700 10 client.25492 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:53:23.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.851+0000 7fdebf400700 1 -- 172.21.15.82:0/2221011842 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f082e1b140 con 0x55f082e67c00 2024-05-08T05:53:23.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.851+0000 7fdebf400700 10 client.25492 handle_command_reply: tid=0 2024-05-08T05:53:23.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.851+0000 7fdeea917b80 1 client.25492 shutdown 2024-05-08T05:53:23.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.852+0000 7fdeea917b80 1 -- 172.21.15.82:0/2221011842 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f082e4e8f0 msgr2=0x55f082e5a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:23.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.852+0000 7fdeea917b80 1 --2- 172.21.15.82:0/2221011842 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f082e4e8f0 0x55f082e5a130 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fded0005c50 tx=0x7fded000eb90 comp rx=0 tx=0).stop 2024-05-08T05:53:23.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.852+0000 7fdeea917b80 1 -- 172.21.15.82:0/2221011842 shutdown_connections 2024-05-08T05:53:23.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.852+0000 7fdeea917b80 1 --2- 172.21.15.82:0/2221011842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f082e544e0 0x55f082e57a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:23.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.852+0000 7fdeea917b80 1 --2- 172.21.15.82:0/2221011842 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f082e4e8f0 0x55f082e5a130 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:23.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.852+0000 7fdeea917b80 1 --2- 172.21.15.82:0/2221011842 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55f082e67c00 0x55f082e69ff0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:23.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.852+0000 7fdeea917b80 1 --2- 172.21.15.82:0/2221011842 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f082e53bc0 0x55f082e57520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:23.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.852+0000 7fdeea917b80 1 -- 172.21.15.82:0/2221011842 >> 172.21.15.82:0/2221011842 conn(0x55f082dc66d0 msgr2=0x55f082e48190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:53:23.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.852+0000 7fdebf400700 0 client.25492 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:53:23.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.852+0000 7fdeea917b80 1 -- 172.21.15.82:0/2221011842 shutdown_connections 2024-05-08T05:53:23.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.853+0000 7fdeea917b80 1 -- 172.21.15.82:0/2221011842 wait complete. 2024-05-08T05:53:23.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.853+0000 7fdeea917b80 20 client.25492 trim_cache size 0 max 16384 2024-05-08T05:53:23.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.886+0000 7fdeea917b80 1 Processor -- start 2024-05-08T05:53:23.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.886+0000 7fdeea917b80 1 -- start start 2024-05-08T05:53:23.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.886+0000 7fdeea917b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f082e4e8f0 0x55f082e4e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:23.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.887+0000 7fdeea917b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f082e53bc0 0x55f082e63fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:23.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.887+0000 7fdeea917b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f082e544e0 0x55f082e55150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:23.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.887+0000 7fdeea917b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fded81bc840 con 0x55f082e544e0 2024-05-08T05:53:23.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.887+0000 7fdeea917b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fded81be380 con 0x55f082e4e8f0 2024-05-08T05:53:23.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.887+0000 7fdeea917b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fded81bcf10 con 0x55f082e53bc0 2024-05-08T05:53:23.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.887+0000 7fdedd600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f082e4e8f0 0x55f082e4e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:23.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.888+0000 7fdedcc00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f082e53bc0 0x55f082e63fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:23.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.888+0000 7fdedcc00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f082e53bc0 0x55f082e63fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:46166/0 (socket says 172.21.15.82:46166) 2024-05-08T05:53:23.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.888+0000 7fdedcc00700 1 -- 172.21.15.82:0/1921825472 learned_addr learned my addr 172.21.15.82:0/1921825472 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:53:23.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.888+0000 7fdede000700 1 --2- 172.21.15.82:0/1921825472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f082e544e0 0x55f082e55150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:23.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.888+0000 7fdedcc00700 1 -- 172.21.15.82:0/1921825472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f082e4e8f0 msgr2=0x55f082e4e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:53:23.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.888+0000 7fdedcc00700 1 --2- 172.21.15.82:0/1921825472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f082e4e8f0 0x55f082e4e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:23.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.888+0000 7fdedcc00700 1 -- 172.21.15.82:0/1921825472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f082e544e0 msgr2=0x55f082e55150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:53:23.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.888+0000 7fdedcc00700 1 --2- 172.21.15.82:0/1921825472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f082e544e0 0x55f082e55150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:23.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.888+0000 7fdedcc00700 1 -- 172.21.15.82:0/1921825472 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f082e5a4a0 con 0x55f082e53bc0 2024-05-08T05:53:23.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.888+0000 7fdede000700 1 --2- 172.21.15.82:0/1921825472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f082e544e0 0x55f082e55150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:53:23.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.889+0000 7fdedcc00700 1 --2- 172.21.15.82:0/1921825472 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f082e53bc0 0x55f082e63fe0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdec400a010 tx=0x7fdec4019040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22f8641db708b032 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:53:23.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.889+0000 7fdeca000700 1 -- 172.21.15.82:0/1921825472 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec4021040 con 0x55f082e53bc0 2024-05-08T05:53:23.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.889+0000 7fdeca000700 1 -- 172.21.15.82:0/1921825472 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdec4035070 con 0x55f082e53bc0 2024-05-08T05:53:23.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.889+0000 7fdeca000700 1 -- 172.21.15.82:0/1921825472 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec4030920 con 0x55f082e53bc0 2024-05-08T05:53:23.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.891+0000 7fdeea917b80 1 -- 172.21.15.82:0/1921825472 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f082e53bc0 msgr2=0x55f082e63fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:23.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.891+0000 7fdeea917b80 1 --2- 172.21.15.82:0/1921825472 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f082e53bc0 0x55f082e63fe0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdec400a010 tx=0x7fdec4019040 comp rx=0 tx=0).stop 2024-05-08T05:53:23.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.891+0000 7fdeea917b80 1 -- 172.21.15.82:0/1921825472 shutdown_connections 2024-05-08T05:53:23.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.891+0000 7fdeea917b80 1 --2- 172.21.15.82:0/1921825472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f082e4e8f0 0x55f082e4e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:23.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.891+0000 7fdeea917b80 1 --2- 172.21.15.82:0/1921825472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f082e544e0 0x55f082e55150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:23.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.892+0000 7fdeea917b80 1 --2- 172.21.15.82:0/1921825472 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f082e53bc0 0x55f082e63fe0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:23.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.892+0000 7fdeea917b80 1 -- 172.21.15.82:0/1921825472 >> 172.21.15.82:0/1921825472 conn(0x55f082dc66d0 msgr2=0x55f082e58b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:53:23.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.892+0000 7fdeea917b80 1 -- 172.21.15.82:0/1921825472 shutdown_connections 2024-05-08T05:53:23.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.892+0000 7fdeea917b80 1 -- 172.21.15.82:0/1921825472 wait complete. 2024-05-08T05:53:23.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.892+0000 7fdeea917b80 1 -- start start 2024-05-08T05:53:23.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.893+0000 7fdeea917b80 1 Processor -- start 2024-05-08T05:53:23.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.894+0000 7fdeea917b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f082e4e8f0 0x55f082e60540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:23.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.894+0000 7fdeea917b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f082e53bc0 0x55f082e60a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:23.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.894+0000 7fdeea917b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f082e544e0 0x55f082e6e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:23.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.894+0000 7fdeea917b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fded81bdcb0 con 0x55f082e53bc0 2024-05-08T05:53:23.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.894+0000 7fdeea917b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fded81bd5e0 con 0x55f082e544e0 2024-05-08T05:53:23.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.894+0000 7fdeea917b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fded81ba7e0 con 0x55f082e4e8f0 2024-05-08T05:53:23.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.894+0000 7fdeea917b80 10 client.0 _ll_register_callbacks cb 0x55f082e4acd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:53:23.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.894+0000 7fdedcc00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f082e53bc0 0x55f082e60a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:23.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.894+0000 7fdedcc00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f082e53bc0 0x55f082e60a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50440/0 (socket says 172.21.15.82:50440) 2024-05-08T05:53:23.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.894+0000 7fdedcc00700 1 -- 172.21.15.82:0/1468759744 learned_addr learned my addr 172.21.15.82:0/1468759744 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:53:23.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.894+0000 7fdedd600700 1 --2- 172.21.15.82:0/1468759744 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f082e4e8f0 0x55f082e60540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:23.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.894+0000 7fdede000700 1 --2- 172.21.15.82:0/1468759744 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f082e544e0 0x55f082e6e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:23.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.895+0000 7fdedcc00700 1 -- 172.21.15.82:0/1468759744 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f082e4e8f0 msgr2=0x55f082e60540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:53:23.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.895+0000 7fdedcc00700 1 --2- 172.21.15.82:0/1468759744 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f082e4e8f0 0x55f082e60540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:23.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.895+0000 7fdedcc00700 1 -- 172.21.15.82:0/1468759744 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f082e544e0 msgr2=0x55f082e6e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:53:23.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.895+0000 7fdedcc00700 1 --2- 172.21.15.82:0/1468759744 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f082e544e0 0x55f082e6e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:23.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.895+0000 7fdedcc00700 1 -- 172.21.15.82:0/1468759744 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f082e6f200 con 0x55f082e53bc0 2024-05-08T05:53:23.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.896+0000 7fdebf400700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T05:53:23.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.896+0000 7fdedcc00700 1 --2- 172.21.15.82:0/1468759744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f082e53bc0 0x55f082e60a80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fdec400c010 tx=0x7fdec4005bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdaf661eb5f883c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:53:23.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.900+0000 7fdebf400700 1 -- 172.21.15.82:0/1468759744 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec403e060 con 0x55f082e53bc0 2024-05-08T05:53:23.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.900+0000 7fdeea917b80 1 -- 172.21.15.82:0/1468759744 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdec4035070 con 0x55f082e53bc0 2024-05-08T05:53:23.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.900+0000 7fdebf400700 1 -- 172.21.15.82:0/1468759744 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fdec4021070 con 0x55f082e53bc0 2024-05-08T05:53:23.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.901+0000 7fdebf400700 1 -- 172.21.15.82:0/1468759744 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fdec40055e0 con 0x55f082e53bc0 2024-05-08T05:53:23.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.901+0000 7fdeea917b80 10 client.15321 fetch_fsmap learned FSMap version 31 2024-05-08T05:53:23.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.901+0000 7fdeea917b80 1 -- 172.21.15.82:0/1468759744 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55f082ed1f40 con 0x55f082e53bc0 2024-05-08T05:53:23.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.902+0000 7fdebf400700 1 -- 172.21.15.82:0/1468759744 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdec4035070 con 0x55f082e53bc0 2024-05-08T05:53:23.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.904+0000 7fdebf400700 1 -- 172.21.15.82:0/1468759744 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fdec4030ce0 con 0x55f082e53bc0 2024-05-08T05:53:23.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.904+0000 7fdeea917b80 10 client.15321 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:53:23.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.904+0000 7fdeea917b80 10 client.15321 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:53:23.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.904+0000 7fdeea917b80 20 client.15321 populate_metadata read hostname 'smithi082' 2024-05-08T05:53:23.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.904+0000 7fdeea917b80 1 --2- 172.21.15.82:0/1468759744 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55f082ed2600 0x55f082ed4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:23.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.905+0000 7fdeea917b80 4 client.15321 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-08T05:53:23.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.905+0000 7fdeea917b80 1 -- 172.21.15.82:0/1468759744 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f082e56bf0 con 0x55f082ed2600 2024-05-08T05:53:23.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.906+0000 7fdedd600700 1 --2- 172.21.15.82:0/1468759744 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55f082ed2600 0x55f082ed4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:23.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.907+0000 7fdebf400700 10 client.15321 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:53:23.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.907+0000 7fdedd600700 1 --2- 172.21.15.82:0/1468759744 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55f082ed2600 0x55f082ed4a20 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ada7cc21101c076 server_cookie=b6ab97f21c5d8a84 in_seq=0 out_seq=0 2024-05-08T05:53:23.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.907+0000 7fdebf400700 1 -- 172.21.15.82:0/1468759744 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55f082e56bf0 con 0x55f082ed2600 2024-05-08T05:53:23.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.907+0000 7fdebf400700 10 client.15321 handle_command_reply: tid=0 2024-05-08T05:53:23.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.907+0000 7fdeea917b80 1 client.15321 shutdown 2024-05-08T05:53:23.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.908+0000 7fdeea917b80 1 -- 172.21.15.82:0/1468759744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f082e53bc0 msgr2=0x55f082e60a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:23.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.908+0000 7fdeea917b80 1 --2- 172.21.15.82:0/1468759744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f082e53bc0 0x55f082e60a80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fdec400c010 tx=0x7fdec4005bb0 comp rx=0 tx=0).stop 2024-05-08T05:53:23.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.908+0000 7fdeea917b80 1 -- 172.21.15.82:0/1468759744 shutdown_connections 2024-05-08T05:53:23.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.908+0000 7fdeea917b80 1 --2- 172.21.15.82:0/1468759744 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55f082ed2600 0x55f082ed4a20 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:23.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.908+0000 7fdeea917b80 1 --2- 172.21.15.82:0/1468759744 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f082e544e0 0x55f082e6e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:23.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.908+0000 7fdeea917b80 1 --2- 172.21.15.82:0/1468759744 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f082e4e8f0 0x55f082e60540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:23.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.908+0000 7fdeea917b80 1 --2- 172.21.15.82:0/1468759744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f082e53bc0 0x55f082e60a80 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:23.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.908+0000 7fdeea917b80 1 -- 172.21.15.82:0/1468759744 >> 172.21.15.82:0/1468759744 conn(0x55f082dc66d0 msgr2=0x55f082e52eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:53:23.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.908+0000 7fdebf400700 0 client.15321 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:53:23.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.910+0000 7fdeea917b80 1 -- 172.21.15.82:0/1468759744 shutdown_connections 2024-05-08T05:53:23.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.910+0000 7fdeea917b80 1 -- 172.21.15.82:0/1468759744 wait complete. 2024-05-08T05:53:23.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.910+0000 7fdeea917b80 20 client.15321 trim_cache size 0 max 16384 2024-05-08T05:53:23.911 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T05:53:23.911 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "no active scrubs running", 2024-05-08T05:53:23.911 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": {} 2024-05-08T05:53:23.912 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T05:53:23.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.911+0000 7fdee0000700 1 -- 172.21.15.82:0/3021892345 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fdec00b29d0 msgr2=0x7fdec00b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:23.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.911+0000 7fdee0000700 1 --2- 172.21.15.82:0/3021892345 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fdec00b29d0 0x7fdec00b4e90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fdec4005c50 tx=0x7fdec400bfa0 comp rx=0 tx=0).stop 2024-05-08T05:53:23.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.911+0000 7fdee0000700 1 -- 172.21.15.82:0/3021892345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fded8109960 msgr2=0x7fded8074f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:23.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.911+0000 7fdee0000700 1 --2- 172.21.15.82:0/3021892345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fded8109960 0x7fded8074f10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdecc00c140 tx=0x7fdecc00c450 comp rx=0 tx=0).stop 2024-05-08T05:53:23.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.912+0000 7fdee0000700 1 -- 172.21.15.82:0/3021892345 shutdown_connections 2024-05-08T05:53:23.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.912+0000 7fdee0000700 1 --2- 172.21.15.82:0/3021892345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fded8109960 0x7fded8074f10 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:23.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.912+0000 7fdee0000700 1 --2- 172.21.15.82:0/3021892345 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fdec00b29d0 0x7fdec00b4e90 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:23.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.912+0000 7fdee0000700 1 --2- 172.21.15.82:0/3021892345 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fded8101880 0x7fded810c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:23.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.912+0000 7fdee0000700 1 --2- 172.21.15.82:0/3021892345 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fded8102230 0x7fded810ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:23.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.912+0000 7fdee0000700 1 -- 172.21.15.82:0/3021892345 >> 172.21.15.82:0/3021892345 conn(0x7fded80785a0 msgr2=0x7fded80ff630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:53:23.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.912+0000 7fdee0000700 1 -- 172.21.15.82:0/3021892345 shutdown_connections 2024-05-08T05:53:23.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:23.912+0000 7fdee0000700 1 -- 172.21.15.82:0/3021892345 wait complete. 2024-05-08T05:53:24.225 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:53:24 smithi082 ceph-mon[30098]: pgmap v541: 97 pgs: 97 active+clean; 1.1 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.0 MiB/s wr, 677 op/s 2024-05-08T05:53:24.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:53:24 smithi151 ceph-mon[34815]: pgmap v541: 97 pgs: 97 active+clean; 1.1 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.0 MiB/s wr, 677 op/s 2024-05-08T05:53:24.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:53:24 smithi134 ceph-mon[34132]: pgmap v541: 97 pgs: 97 active+clean; 1.1 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.0 MiB/s wr, 677 op/s 2024-05-08T05:53:25.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 155.0 s, 2282.0 tps, lat 43.291 ms stddev 48.476 2024-05-08T05:53:25.349 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-08T05:53:25.349 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T05:53:25.981 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:53:26.335 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:53:26 smithi082 ceph-mon[30098]: pgmap v542: 97 pgs: 97 active+clean; 1.1 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.3 MiB/s wr, 720 op/s 2024-05-08T05:53:26.335 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:53:26 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:53:26.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:53:26 smithi151 ceph-mon[34815]: pgmap v542: 97 pgs: 97 active+clean; 1.1 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.3 MiB/s wr, 720 op/s 2024-05-08T05:53:26.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:53:26 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:53:26.499 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:53:26 smithi134 ceph-mon[34132]: pgmap v542: 97 pgs: 97 active+clean; 1.1 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.3 MiB/s wr, 720 op/s 2024-05-08T05:53:26.499 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:53:26 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:53:28.156 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:53:28 smithi082 ceph-mon[30098]: pgmap v543: 97 pgs: 97 active+clean; 1.1 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.4 MiB/s wr, 714 op/s 2024-05-08T05:53:28.156 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:53:28 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:53:28.156 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:53:28 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:53:28.156 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:53:28 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:53:28.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:28.354+0000 7f20d0400700 1 -- 172.21.15.82:0/2990355062 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20c810ff50 msgr2=0x7f20c8112340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:28.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:28.354+0000 7f20d0400700 1 --2- 172.21.15.82:0/2990355062 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20c810ff50 0x7f20c8112340 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f20c000b0a0 tx=0x7f20c000b3b0 comp rx=0 tx=0).stop 2024-05-08T05:53:28.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:28.355+0000 7f20d0400700 1 -- 172.21.15.82:0/2990355062 shutdown_connections 2024-05-08T05:53:28.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:28.355+0000 7f20d0400700 1 --2- 172.21.15.82:0/2990355062 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20c810ff50 0x7f20c8112340 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:28.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:28.355+0000 7f20d0400700 1 --2- 172.21.15.82:0/2990355062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20c806b1b0 0x7f20c806b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:28.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:28.355+0000 7f20d0400700 1 --2- 172.21.15.82:0/2990355062 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20c806bad0 0x7f20c810fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:28.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:28.355+0000 7f20d0400700 1 -- 172.21.15.82:0/2990355062 >> 172.21.15.82:0/2990355062 conn(0x7f20c8079350 msgr2=0x7f20c8079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:53:28.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:28.355+0000 7f20d0400700 1 -- 172.21.15.82:0/2990355062 shutdown_connections 2024-05-08T05:53:28.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:28.355+0000 7f20d0400700 1 -- 172.21.15.82:0/2990355062 wait complete. 2024-05-08T05:53:28.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:28.356+0000 7f20d0400700 1 Processor -- start 2024-05-08T05:53:28.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:28.357+0000 7f20d0400700 1 -- start start 2024-05-08T05:53:28.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:28.357+0000 7f20d0400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20c806b1b0 0x7f20c819bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:28.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:28.357+0000 7f20d0400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20c806bad0 0x7f20c819c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:28.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:28.359+0000 7f20d0400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20c810ff50 0x7f20c81a0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:28.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:28.359+0000 7f20d0400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f20c81158c0 con 0x7f20c806b1b0 2024-05-08T05:53:28.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:28.359+0000 7f20d0400700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f20c8115740 con 0x7f20c810ff50 2024-05-08T05:53:28.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:28.359+0000 7f20d0400700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f20c8115a40 con 0x7f20c806bad0 2024-05-08T05:53:28.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:28.359+0000 7f20cd000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20c806bad0 0x7f20c819c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:28.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:28.358+0000 7f20cda00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20c806b1b0 0x7f20c819bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:28.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:28.359+0000 7f20cd000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20c806bad0 0x7f20c819c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:46192/0 (socket says 172.21.15.82:46192) 2024-05-08T05:53:28.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:28.359+0000 7f20cd000700 1 -- 172.21.15.82:0/3363875585 learned_addr learned my addr 172.21.15.82:0/3363875585 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:53:28.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:28.359+0000 7f20cd000700 1 -- 172.21.15.82:0/3363875585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20c810ff50 msgr2=0x7f20c81a0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:28.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:28.360+0000 7f20ce400700 1 --2- 172.21.15.82:0/3363875585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20c810ff50 0x7f20c81a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:28.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:28.360+0000 7f20cd000700 1 --2- 172.21.15.82:0/3363875585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20c810ff50 0x7f20c81a0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:28.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:28.360+0000 7f20cd000700 1 -- 172.21.15.82:0/3363875585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20c806b1b0 msgr2=0x7f20c819bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:28.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:28.360+0000 7f20cd000700 1 --2- 172.21.15.82:0/3363875585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20c806b1b0 0x7f20c819bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:28.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:28.360+0000 7f20cd000700 1 -- 172.21.15.82:0/3363875585 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20c81a0d70 con 0x7f20c806bad0 2024-05-08T05:53:28.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:28.361+0000 7f20cd000700 1 --2- 172.21.15.82:0/3363875585 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20c806bad0 0x7f20c819c2f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f20b400e9c0 tx=0x7f20b400ed80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:53:28.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:28.362+0000 7f20c6000700 1 -- 172.21.15.82:0/3363875585 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b400cbd0 con 0x7f20c806bad0 2024-05-08T05:53:28.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:28.362+0000 7f20c6000700 1 -- 172.21.15.82:0/3363875585 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f20b400cd70 con 0x7f20c806bad0 2024-05-08T05:53:28.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:28.362+0000 7f20c6000700 1 -- 172.21.15.82:0/3363875585 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20b4010430 con 0x7f20c806bad0 2024-05-08T05:53:28.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:28.362+0000 7f20d0400700 1 -- 172.21.15.82:0/3363875585 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20c81a1060 con 0x7f20c806bad0 2024-05-08T05:53:28.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:28.363+0000 7f20d0400700 1 -- 172.21.15.82:0/3363875585 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20c81a88e0 con 0x7f20c806bad0 2024-05-08T05:53:28.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:28.366+0000 7f20d0400700 1 -- 172.21.15.82:0/3363875585 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20c806a190 con 0x7f20c806bad0 2024-05-08T05:53:28.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:28.371+0000 7f20c6000700 1 -- 172.21.15.82:0/3363875585 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f20b4004750 con 0x7f20c806bad0 2024-05-08T05:53:28.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:28.374+0000 7f20c6000700 1 --2- 172.21.15.82:0/3363875585 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f20b00b29c0 0x7f20b00b4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:28.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:28.374+0000 7f20c6000700 1 -- 172.21.15.82:0/3363875585 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f20b40e2580 con 0x7f20c806bad0 2024-05-08T05:53:28.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:28.374+0000 7f20cda00700 1 --2- 172.21.15.82:0/3363875585 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f20b00b29c0 0x7f20b00b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:28.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:28.377+0000 7f20cda00700 1 --2- 172.21.15.82:0/3363875585 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f20b00b29c0 0x7f20b00b4e80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f20bc009bf0 tx=0x7f20bc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:53:28.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:53:28 smithi151 ceph-mon[34815]: pgmap v543: 97 pgs: 97 active+clean; 1.1 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.4 MiB/s wr, 714 op/s 2024-05-08T05:53:28.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:53:28 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:53:28.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:53:28 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:53:28.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:53:28 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:53:28.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:28.379+0000 7f20c6000700 1 -- 172.21.15.82:0/3363875585 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f20b40aa250 con 0x7f20c806bad0 2024-05-08T05:53:28.499 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:53:28 smithi134 ceph-mon[34132]: pgmap v543: 97 pgs: 97 active+clean; 1.1 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.4 MiB/s wr, 714 op/s 2024-05-08T05:53:28.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:53:28 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:53:28.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:53:28 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:53:28.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:53:28 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:53:28.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:28.808+0000 7f20d0400700 1 -- 172.21.15.82:0/3363875585 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f20c819d0c0 con 0x7f20c806bad0 2024-05-08T05:53:28.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:28.809+0000 7f20c6000700 1 -- 172.21.15.82:0/3363875585 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11948 (secure 0 0 0) 0x7f20b40a9b50 con 0x7f20c806bad0 2024-05-08T05:53:28.810 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:53:28.810 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14364,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3876883250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3876883250},{"type":"v1","addr":"172.21.15.82:6835","nonce":3876883250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1965070586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1965070586},{"type":"v1","addr":"172.21.15.82:6837","nonce":1965070586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":31,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T05:45:57.654009+0000","modified":"2024-05-08T05:53:20.165672+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24505,"mds_2":24487,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14397":{"gid":14397,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/1890720973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1890720973},{"type":"v1","addr":"172.21.15.82:6839","nonce":1890720973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14409":{"gid":14409,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/2957083305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":2957083305},{"type":"v1","addr":"172.21.15.82:6841","nonce":2957083305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6833/3827691638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3827691638},{"type":"v1","addr":"172.21.15.134:6833","nonce":3827691638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6833/3625067797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3625067797},{"type":"v1","addr":"172.21.15.151:6833","nonce":3625067797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/4074163402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4074163402},{"type":"v1","addr":"172.21.15.134:6835","nonce":4074163402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.134:6837/2212411710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2212411710},{"type":"v1","addr":"172.21.15.134:6837","nonce":2212411710}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":17,"addr":"172.21.15.151:6835/2093655929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2093655929},{"type":"v1","addr":"172.21.15.151:6835","nonce":2093655929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6837/4192404464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":4192404464},{"type":"v1","addr":"172.21.15.151:6837","nonce":4192404464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":14,"addr":"172.21.15.151:6839/2963754236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":2963754236},{"type":"v1","addr":"172.21.15.151:6839","nonce":2963754236}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.134:6839/1145270893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1145270893},{"type":"v1","addr":"172.21.15.134:6839","nonce":1145270893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24505,24506,24487,24475,24467]},"id":1}]} 2024-05-08T05:53:28.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:28.814+0000 7f20d0400700 1 -- 172.21.15.82:0/3363875585 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f20b00b29c0 msgr2=0x7f20b00b4e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:28.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:28.814+0000 7f20d0400700 1 --2- 172.21.15.82:0/3363875585 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f20b00b29c0 0x7f20b00b4e80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f20bc009bf0 tx=0x7f20bc009260 comp rx=0 tx=0).stop 2024-05-08T05:53:28.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:28.814+0000 7f20d0400700 1 -- 172.21.15.82:0/3363875585 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20c806bad0 msgr2=0x7f20c819c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:28.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:28.814+0000 7f20d0400700 1 --2- 172.21.15.82:0/3363875585 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20c806bad0 0x7f20c819c2f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f20b400e9c0 tx=0x7f20b400ed80 comp rx=0 tx=0).stop 2024-05-08T05:53:28.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:28.814+0000 7f20d0400700 1 -- 172.21.15.82:0/3363875585 shutdown_connections 2024-05-08T05:53:28.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:28.814+0000 7f20d0400700 1 --2- 172.21.15.82:0/3363875585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20c810ff50 0x7f20c81a0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:28.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:28.814+0000 7f20d0400700 1 --2- 172.21.15.82:0/3363875585 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f20b00b29c0 0x7f20b00b4e80 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:28.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:28.814+0000 7f20d0400700 1 --2- 172.21.15.82:0/3363875585 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f20c806b1b0 0x7f20c819bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:28.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:28.814+0000 7f20d0400700 1 --2- 172.21.15.82:0/3363875585 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20c806bad0 0x7f20c819c2f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:28.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:28.814+0000 7f20d0400700 1 -- 172.21.15.82:0/3363875585 >> 172.21.15.82:0/3363875585 conn(0x7f20c8079350 msgr2=0x7f20c81113a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:53:28.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:28.814+0000 7f20d0400700 1 -- 172.21.15.82:0/3363875585 shutdown_connections 2024-05-08T05:53:28.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:28.814+0000 7f20d0400700 1 -- 172.21.15.82:0/3363875585 wait complete. 2024-05-08T05:53:28.817 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 31 2024-05-08T05:53:29.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:53:29 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/3363875585' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:53:29.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:53:29 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/3363875585' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:53:29.499 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:53:29 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/3363875585' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:53:29.769 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-05-08T05:53:30.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 160.0 s, 2201.8 tps, lat 45.863 ms stddev 50.786 2024-05-08T05:53:30.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:53:30 smithi151 ceph-mon[34815]: pgmap v544: 97 pgs: 97 active+clean; 1.1 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.0 MiB/s wr, 674 op/s 2024-05-08T05:53:30.384 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:53:30.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:53:30 smithi082 ceph-mon[30098]: pgmap v544: 97 pgs: 97 active+clean; 1.1 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.0 MiB/s wr, 674 op/s 2024-05-08T05:53:30.499 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:53:30 smithi134 ceph-mon[34132]: pgmap v544: 97 pgs: 97 active+clean; 1.1 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.0 MiB/s wr, 674 op/s 2024-05-08T05:53:31.130 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:53:31 smithi082 ceph-mon[30098]: pgmap v545: 97 pgs: 97 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.6 MiB/s wr, 788 op/s 2024-05-08T05:53:31.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:53:31 smithi151 ceph-mon[34815]: pgmap v545: 97 pgs: 97 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.6 MiB/s wr, 788 op/s 2024-05-08T05:53:31.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:53:31 smithi134 ceph-mon[34132]: pgmap v545: 97 pgs: 97 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.6 MiB/s wr, 788 op/s 2024-05-08T05:53:33.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.175+0000 7f7f87000700 1 -- 172.21.15.82:0/2057698904 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f80106070 msgr2=0x7f7f80112580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:33.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.175+0000 7f7f87000700 1 --2- 172.21.15.82:0/2057698904 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f80106070 0x7f7f80112580 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f7f7800b0a0 tx=0x7f7f7800b3b0 comp rx=0 tx=0).stop 2024-05-08T05:53:33.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.175+0000 7f7f87000700 1 -- 172.21.15.82:0/2057698904 shutdown_connections 2024-05-08T05:53:33.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.175+0000 7f7f87000700 1 --2- 172.21.15.82:0/2057698904 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f80106070 0x7f7f80112580 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:33.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.175+0000 7f7f87000700 1 --2- 172.21.15.82:0/2057698904 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f8010b6b0 0x7f7f8010ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:33.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.175+0000 7f7f87000700 1 --2- 172.21.15.82:0/2057698904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f801056b0 0x7f7f80105b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:33.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.175+0000 7f7f87000700 1 -- 172.21.15.82:0/2057698904 >> 172.21.15.82:0/2057698904 conn(0x7f7f801011a0 msgr2=0x7f7f801035c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:53:33.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.175+0000 7f7f87000700 1 -- 172.21.15.82:0/2057698904 shutdown_connections 2024-05-08T05:53:33.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.176+0000 7f7f87000700 1 -- 172.21.15.82:0/2057698904 wait complete. 2024-05-08T05:53:33.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.177+0000 7f7f87000700 1 Processor -- start 2024-05-08T05:53:33.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.177+0000 7f7f87000700 1 -- start start 2024-05-08T05:53:33.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.178+0000 7f7f87000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f801056b0 0x7f7f801a1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:33.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.178+0000 7f7f87000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f80106070 0x7f7f801a1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:33.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.178+0000 7f7f87000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f8010b6b0 0x7f7f8019bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:33.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.178+0000 7f7f87000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7f801158f0 con 0x7f7f801056b0 2024-05-08T05:53:33.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.178+0000 7f7f87000700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7f80115770 con 0x7f7f8010b6b0 2024-05-08T05:53:33.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.178+0000 7f7f87000700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7f80115a70 con 0x7f7f80106070 2024-05-08T05:53:33.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.179+0000 7f7f85000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f8010b6b0 0x7f7f8019bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:33.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.179+0000 7f7f85000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f8010b6b0 0x7f7f8019bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:44836/0 (socket says 172.21.15.82:44836) 2024-05-08T05:53:33.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.179+0000 7f7f85000700 1 -- 172.21.15.82:0/2298818507 learned_addr learned my addr 172.21.15.82:0/2298818507 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:53:33.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.179+0000 7f7f85000700 1 -- 172.21.15.82:0/2298818507 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f80106070 msgr2=0x7f7f801a1e50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T05:53:33.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.179+0000 7f7f85000700 1 --2- 172.21.15.82:0/2298818507 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f80106070 0x7f7f801a1e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:33.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.179+0000 7f7f85000700 1 -- 172.21.15.82:0/2298818507 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f801056b0 msgr2=0x7f7f801a1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:33.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.179+0000 7f7f85000700 1 --2- 172.21.15.82:0/2298818507 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f801056b0 0x7f7f801a1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:33.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.179+0000 7f7f85000700 1 -- 172.21.15.82:0/2298818507 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f8019c230 con 0x7f7f8010b6b0 2024-05-08T05:53:33.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.179+0000 7f7f85000700 1 --2- 172.21.15.82:0/2298818507 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f8010b6b0 0x7f7f8019bad0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7f78009fd0 tx=0x7f7f78004e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:53:33.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.180+0000 7f7f7cc00700 1 -- 172.21.15.82:0/2298818507 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f78021070 con 0x7f7f8010b6b0 2024-05-08T05:53:33.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.180+0000 7f7f87000700 1 -- 172.21.15.82:0/2298818507 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f8019c4c0 con 0x7f7f8010b6b0 2024-05-08T05:53:33.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.180+0000 7f7f7cc00700 1 -- 172.21.15.82:0/2298818507 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f78007c80 con 0x7f7f8010b6b0 2024-05-08T05:53:33.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.180+0000 7f7f7cc00700 1 -- 172.21.15.82:0/2298818507 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f78005280 con 0x7f7f8010b6b0 2024-05-08T05:53:33.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.180+0000 7f7f87000700 1 -- 172.21.15.82:0/2298818507 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f801a87e0 con 0x7f7f8010b6b0 2024-05-08T05:53:33.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.185+0000 7f7f7cc00700 1 -- 172.21.15.82:0/2298818507 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f7f78024070 con 0x7f7f8010b6b0 2024-05-08T05:53:33.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.187+0000 7f7f7cc00700 1 --2- 172.21.15.82:0/2298818507 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7f640b2900 0x7f7f640b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:33.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.188+0000 7f7f7cc00700 1 -- 172.21.15.82:0/2298818507 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f7f7800f020 con 0x7f7f8010b6b0 2024-05-08T05:53:33.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.188+0000 7f7f7fe00700 1 --2- 172.21.15.82:0/2298818507 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7f640b2900 0x7f7f640b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:33.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.189+0000 7f7f7fe00700 1 --2- 172.21.15.82:0/2298818507 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7f640b2900 0x7f7f640b4dc0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7f7000a9b0 tx=0x7f7f70005c90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:53:33.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.191+0000 7f7f919d5b80 1 Processor -- start 2024-05-08T05:53:33.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.191+0000 7f7f919d5b80 1 -- start start 2024-05-08T05:53:33.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.191+0000 7f7f919d5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5628e6a28870 0x5628e6a28c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:33.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.191+0000 7f7f919d5b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5628e6a29190 0x5628e6a2cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:33.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.191+0000 7f7f919d5b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5628e6a2d1e0 0x5628e6a2d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:33.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.192+0000 7f7f919d5b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5628e6972a20 con 0x5628e6a2d1e0 2024-05-08T05:53:33.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.192+0000 7f7f919d5b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5628e6910760 con 0x5628e6a29190 2024-05-08T05:53:33.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.192+0000 7f7f919d5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5628e696e9e0 con 0x5628e6a28870 2024-05-08T05:53:33.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.192+0000 7f7f85000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5628e6a2d1e0 0x5628e6a2d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:33.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.192+0000 7f7f85000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5628e6a2d1e0 0x5628e6a2d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43994/0 (socket says 172.21.15.82:43994) 2024-05-08T05:53:33.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.192+0000 7f7f85000700 1 -- 172.21.15.82:0/615963696 learned_addr learned my addr 172.21.15.82:0/615963696 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:53:33.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.192+0000 7f7f7fe00700 1 --2- 172.21.15.82:0/615963696 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5628e6a28870 0x5628e6a28c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:33.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.192+0000 7f7f7f400700 1 --2- 172.21.15.82:0/615963696 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5628e6a29190 0x5628e6a2cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:33.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.193+0000 7f7f7fe00700 1 -- 172.21.15.82:0/615963696 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5628e6a29190 msgr2=0x5628e6a2cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:53:33.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.193+0000 7f7f7fe00700 1 --2- 172.21.15.82:0/615963696 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5628e6a29190 0x5628e6a2cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:33.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.193+0000 7f7f7fe00700 1 -- 172.21.15.82:0/615963696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5628e6a2d1e0 msgr2=0x5628e6a2d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:53:33.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.193+0000 7f7f7fe00700 1 --2- 172.21.15.82:0/615963696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5628e6a2d1e0 0x5628e6a2d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:33.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.193+0000 7f7f7fe00700 1 -- 172.21.15.82:0/615963696 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628e68bf8d0 con 0x5628e6a28870 2024-05-08T05:53:33.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.193+0000 7f7f85000700 1 --2- 172.21.15.82:0/615963696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5628e6a2d1e0 0x5628e6a2d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:53:33.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.193+0000 7f7f7f400700 1 --2- 172.21.15.82:0/615963696 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5628e6a29190 0x5628e6a2cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:53:33.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.193+0000 7f7f7fe00700 1 --2- 172.21.15.82:0/615963696 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5628e6a28870 0x5628e6a28c50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7f7000c5b0 tx=0x7f7f7000f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=595f11abfb8781fd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:53:33.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.193+0000 7f7f75600700 1 -- 172.21.15.82:0/615963696 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f7000ce20 con 0x5628e6a28870 2024-05-08T05:53:33.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.193+0000 7f7f75600700 1 -- 172.21.15.82:0/615963696 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f70015030 con 0x5628e6a28870 2024-05-08T05:53:33.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.194+0000 7f7f919d5b80 1 -- 172.21.15.82:0/615963696 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5628e6a28870 msgr2=0x5628e6a28c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:33.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.194+0000 7f7f919d5b80 1 --2- 172.21.15.82:0/615963696 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5628e6a28870 0x5628e6a28c50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7f7000c5b0 tx=0x7f7f7000f000 comp rx=0 tx=0).stop 2024-05-08T05:53:33.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.194+0000 7f7f919d5b80 1 -- 172.21.15.82:0/615963696 shutdown_connections 2024-05-08T05:53:33.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.194+0000 7f7f919d5b80 1 --2- 172.21.15.82:0/615963696 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5628e6a2d1e0 0x5628e6a2d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:33.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.194+0000 7f7f919d5b80 1 --2- 172.21.15.82:0/615963696 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5628e6a28870 0x5628e6a28c50 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:33.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.194+0000 7f7f919d5b80 1 --2- 172.21.15.82:0/615963696 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5628e6a29190 0x5628e6a2cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:33.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.194+0000 7f7f919d5b80 1 -- 172.21.15.82:0/615963696 >> 172.21.15.82:0/615963696 conn(0x5628e694eb60 msgr2=0x5628e6a1a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:53:33.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.195+0000 7f7f919d5b80 1 -- 172.21.15.82:0/615963696 shutdown_connections 2024-05-08T05:53:33.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.195+0000 7f7f919d5b80 1 -- 172.21.15.82:0/615963696 wait complete. 2024-05-08T05:53:33.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.196+0000 7f7f919d5b80 1 -- start start 2024-05-08T05:53:33.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.197+0000 7f7f919d5b80 1 Processor -- start 2024-05-08T05:53:33.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.198+0000 7f7f919d5b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5628e6a28870 0x5628e6a34510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:33.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.198+0000 7f7f919d5b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5628e6a29190 0x5628e6a318b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:33.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.198+0000 7f7f919d5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5628e6a2d1e0 0x5628e6a31df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:33.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.198+0000 7f7f919d5b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5628e6a353e0 con 0x5628e6a28870 2024-05-08T05:53:33.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.198+0000 7f7f919d5b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5628e68d8b20 con 0x5628e6a29190 2024-05-08T05:53:33.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.198+0000 7f7f919d5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5628e6a35560 con 0x5628e6a2d1e0 2024-05-08T05:53:33.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.198+0000 7f7f919d5b80 10 client.0 _ll_register_callbacks cb 0x5628e6919c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:53:33.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.198+0000 7f7f7f400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5628e6a29190 0x5628e6a318b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:33.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.198+0000 7f7f7f400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5628e6a29190 0x5628e6a318b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:44850/0 (socket says 172.21.15.82:44850) 2024-05-08T05:53:33.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.198+0000 7f7f7f400700 1 -- 172.21.15.82:0/3575270281 learned_addr learned my addr 172.21.15.82:0/3575270281 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:53:33.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.198+0000 7f7f7fe00700 1 --2- 172.21.15.82:0/3575270281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5628e6a28870 0x5628e6a34510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:33.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.198+0000 7f7f85000700 1 --2- 172.21.15.82:0/3575270281 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5628e6a2d1e0 0x5628e6a31df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:33.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.199+0000 7f7f7f400700 1 -- 172.21.15.82:0/3575270281 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5628e6a2d1e0 msgr2=0x5628e6a31df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:53:33.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.199+0000 7f7f7f400700 1 --2- 172.21.15.82:0/3575270281 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5628e6a2d1e0 0x5628e6a31df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:33.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.199+0000 7f7f7f400700 1 -- 172.21.15.82:0/3575270281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5628e6a28870 msgr2=0x5628e6a34510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:53:33.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.199+0000 7f7f7f400700 1 --2- 172.21.15.82:0/3575270281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5628e6a28870 0x5628e6a34510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:33.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.199+0000 7f7f7f400700 1 -- 172.21.15.82:0/3575270281 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628e6938420 con 0x5628e6a29190 2024-05-08T05:53:33.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.199+0000 7f7f7fe00700 1 --2- 172.21.15.82:0/3575270281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5628e6a28870 0x5628e6a34510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:53:33.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.199+0000 7f7f7f400700 1 --2- 172.21.15.82:0/3575270281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5628e6a29190 0x5628e6a318b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c009fd0 tx=0x7f7f6c00e750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebcd23712272d5ac server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:53:33.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.199+0000 7f7f6a000700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:53:33.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.199+0000 7f7f6a000700 1 -- 172.21.15.82:0/3575270281 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c016070 con 0x5628e6a29190 2024-05-08T05:53:33.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.199+0000 7f7f6a000700 1 -- 172.21.15.82:0/3575270281 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f7f6c011670 con 0x5628e6a29190 2024-05-08T05:53:33.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.200+0000 7f7f919d5b80 1 -- 172.21.15.82:0/3575270281 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f70015030 con 0x5628e6a29190 2024-05-08T05:53:33.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.200+0000 7f7f6a000700 1 -- 172.21.15.82:0/3575270281 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f7f6c020050 con 0x5628e6a29190 2024-05-08T05:53:33.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.200+0000 7f7f919d5b80 10 client.25493 fetch_fsmap learned FSMap version 31 2024-05-08T05:53:33.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.200+0000 7f7f919d5b80 1 -- 172.21.15.82:0/3575270281 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5628e6a3fbd0 con 0x5628e6a29190 2024-05-08T05:53:33.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.201+0000 7f7f6a000700 1 -- 172.21.15.82:0/3575270281 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f70015030 con 0x5628e6a29190 2024-05-08T05:53:33.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.201+0000 7f7f6a000700 1 -- 172.21.15.82:0/3575270281 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f7f6c00f040 con 0x5628e6a29190 2024-05-08T05:53:33.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.201+0000 7f7f919d5b80 10 client.25493 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:53:33.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.201+0000 7f7f919d5b80 10 client.25493 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-05-08T05:53:33.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.201+0000 7f7f919d5b80 20 client.25493 populate_metadata read hostname 'smithi082' 2024-05-08T05:53:33.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.201+0000 7f7f919d5b80 1 --2- 172.21.15.82:0/3575270281 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x5628e6a42260 0x5628e6a44670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:33.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.201+0000 7f7f919d5b80 4 client.25493 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:53:33.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.201+0000 7f7f919d5b80 1 -- 172.21.15.82:0/3575270281 --> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5628e69ed0a0 con 0x5628e6a42260 2024-05-08T05:53:33.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.202+0000 7f7f7fe00700 1 --2- 172.21.15.82:0/3575270281 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x5628e6a42260 0x5628e6a44670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:33.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.203+0000 7f7f6a000700 10 client.25493 ms_handle_connect on v2:172.21.15.134:6836/2212411710 2024-05-08T05:53:33.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.203+0000 7f7f7fe00700 1 --2- 172.21.15.82:0/3575270281 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x5628e6a42260 0x5628e6a44670 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=88607057455f5594 server_cookie=467589060318fc9b in_seq=0 out_seq=0 2024-05-08T05:53:33.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.204+0000 7f7f6a000700 1 -- 172.21.15.82:0/3575270281 <== mds.4 v2:172.21.15.134:6836/2212411710 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5628e69ed0a0 con 0x5628e6a42260 2024-05-08T05:53:33.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.204+0000 7f7f6a000700 10 client.25493 handle_command_reply: tid=0 2024-05-08T05:53:33.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.205+0000 7f7f919d5b80 1 client.25493 shutdown 2024-05-08T05:53:33.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.205+0000 7f7f919d5b80 1 -- 172.21.15.82:0/3575270281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5628e6a29190 msgr2=0x5628e6a318b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:33.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.205+0000 7f7f919d5b80 1 --2- 172.21.15.82:0/3575270281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5628e6a29190 0x5628e6a318b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c009fd0 tx=0x7f7f6c00e750 comp rx=0 tx=0).stop 2024-05-08T05:53:33.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.205+0000 7f7f919d5b80 1 -- 172.21.15.82:0/3575270281 shutdown_connections 2024-05-08T05:53:33.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.205+0000 7f7f919d5b80 1 --2- 172.21.15.82:0/3575270281 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x5628e6a42260 0x5628e6a44670 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:33.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.205+0000 7f7f919d5b80 1 --2- 172.21.15.82:0/3575270281 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5628e6a2d1e0 0x5628e6a31df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:33.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.205+0000 7f7f919d5b80 1 --2- 172.21.15.82:0/3575270281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5628e6a28870 0x5628e6a34510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:33.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.205+0000 7f7f919d5b80 1 --2- 172.21.15.82:0/3575270281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5628e6a29190 0x5628e6a318b0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:33.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.205+0000 7f7f6a000700 0 client.25493 ms_handle_reset on v2:172.21.15.134:6836/2212411710 2024-05-08T05:53:33.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.205+0000 7f7f919d5b80 1 -- 172.21.15.82:0/3575270281 >> 172.21.15.82:0/3575270281 conn(0x5628e694eb60 msgr2=0x5628e6a152b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:53:33.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.206+0000 7f7f919d5b80 1 -- 172.21.15.82:0/3575270281 shutdown_connections 2024-05-08T05:53:33.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.206+0000 7f7f919d5b80 1 -- 172.21.15.82:0/3575270281 wait complete. 2024-05-08T05:53:33.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.206+0000 7f7f919d5b80 20 client.25493 trim_cache size 0 max 16384 2024-05-08T05:53:33.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.235+0000 7f7f919d5b80 1 Processor -- start 2024-05-08T05:53:33.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.235+0000 7f7f919d5b80 1 -- start start 2024-05-08T05:53:33.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.235+0000 7f7f919d5b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5628e6a28870 0x5628e6a3e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:33.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.235+0000 7f7f919d5b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5628e6a29190 0x5628e6a3eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:33.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.235+0000 7f7f919d5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5628e6a2d1e0 0x5628e6a49f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:33.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.235+0000 7f7f919d5b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7f801ab870 con 0x5628e6a28870 2024-05-08T05:53:33.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.235+0000 7f7f919d5b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7f801ad3b0 con 0x5628e6a29190 2024-05-08T05:53:33.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.235+0000 7f7f919d5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7f801abf40 con 0x5628e6a2d1e0 2024-05-08T05:53:33.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.236+0000 7f7f85000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5628e6a2d1e0 0x5628e6a49f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:33.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.236+0000 7f7f85000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5628e6a2d1e0 0x5628e6a49f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:37558/0 (socket says 172.21.15.82:37558) 2024-05-08T05:53:33.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.236+0000 7f7f85000700 1 -- 172.21.15.82:0/2738583152 learned_addr learned my addr 172.21.15.82:0/2738583152 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:53:33.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.236+0000 7f7f7fe00700 1 --2- 172.21.15.82:0/2738583152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5628e6a28870 0x5628e6a3e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:33.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.236+0000 7f7f7f400700 1 --2- 172.21.15.82:0/2738583152 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5628e6a29190 0x5628e6a3eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:33.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.236+0000 7f7f85000700 1 -- 172.21.15.82:0/2738583152 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5628e6a29190 msgr2=0x5628e6a3eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:53:33.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.236+0000 7f7f85000700 1 --2- 172.21.15.82:0/2738583152 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5628e6a29190 0x5628e6a3eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:33.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.236+0000 7f7f85000700 1 -- 172.21.15.82:0/2738583152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5628e6a28870 msgr2=0x5628e6a3e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:53:33.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.236+0000 7f7f85000700 1 --2- 172.21.15.82:0/2738583152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5628e6a28870 0x5628e6a3e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:33.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.236+0000 7f7f85000700 1 -- 172.21.15.82:0/2738583152 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628e6a2fe20 con 0x5628e6a2d1e0 2024-05-08T05:53:33.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.237+0000 7f7f85000700 1 --2- 172.21.15.82:0/2738583152 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5628e6a2d1e0 0x5628e6a49f80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7f780a61d0 tx=0x7f7f780a9cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7653e051a00a4dad server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:53:33.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.237+0000 7f7f74c00700 1 -- 172.21.15.82:0/2738583152 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f780e7060 con 0x5628e6a2d1e0 2024-05-08T05:53:33.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.237+0000 7f7f74c00700 1 -- 172.21.15.82:0/2738583152 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f78009cb0 con 0x5628e6a2d1e0 2024-05-08T05:53:33.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.237+0000 7f7f74c00700 1 -- 172.21.15.82:0/2738583152 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f780ae160 con 0x5628e6a2d1e0 2024-05-08T05:53:33.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.238+0000 7f7f919d5b80 1 -- 172.21.15.82:0/2738583152 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5628e6a2d1e0 msgr2=0x5628e6a49f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:33.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.238+0000 7f7f919d5b80 1 --2- 172.21.15.82:0/2738583152 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5628e6a2d1e0 0x5628e6a49f80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7f780a61d0 tx=0x7f7f780a9cb0 comp rx=0 tx=0).stop 2024-05-08T05:53:33.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.239+0000 7f7f919d5b80 1 -- 172.21.15.82:0/2738583152 shutdown_connections 2024-05-08T05:53:33.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.239+0000 7f7f919d5b80 1 --2- 172.21.15.82:0/2738583152 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5628e6a2d1e0 0x5628e6a49f80 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:33.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.239+0000 7f7f919d5b80 1 --2- 172.21.15.82:0/2738583152 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5628e6a28870 0x5628e6a3e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:33.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.239+0000 7f7f919d5b80 1 --2- 172.21.15.82:0/2738583152 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5628e6a29190 0x5628e6a3eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:33.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.239+0000 7f7f919d5b80 1 -- 172.21.15.82:0/2738583152 >> 172.21.15.82:0/2738583152 conn(0x5628e694eb60 msgr2=0x5628e6a301a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:53:33.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.239+0000 7f7f919d5b80 1 -- 172.21.15.82:0/2738583152 shutdown_connections 2024-05-08T05:53:33.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.240+0000 7f7f919d5b80 1 -- 172.21.15.82:0/2738583152 wait complete. 2024-05-08T05:53:33.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.240+0000 7f7f919d5b80 1 -- start start 2024-05-08T05:53:33.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.240+0000 7f7f919d5b80 1 Processor -- start 2024-05-08T05:53:33.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.241+0000 7f7f919d5b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5628e6a28870 0x5628e6a2a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:33.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.241+0000 7f7f919d5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5628e6a29190 0x5628e6a2a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:33.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.241+0000 7f7f919d5b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5628e6a2d1e0 0x5628e6a398a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:33.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.242+0000 7f7f919d5b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7f801acce0 con 0x5628e6a2d1e0 2024-05-08T05:53:33.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.242+0000 7f7f919d5b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7f801ac610 con 0x5628e6a28870 2024-05-08T05:53:33.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.242+0000 7f7f919d5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8007b940 con 0x5628e6a29190 2024-05-08T05:53:33.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.242+0000 7f7f919d5b80 10 client.0 _ll_register_callbacks cb 0x5628e6919c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:53:33.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.242+0000 7f7f7fe00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5628e6a28870 0x5628e6a2a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:33.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.242+0000 7f7f7f400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5628e6a29190 0x5628e6a2a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:33.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.242+0000 7f7f7f400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5628e6a29190 0x5628e6a2a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:37572/0 (socket says 172.21.15.82:37572) 2024-05-08T05:53:33.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.242+0000 7f7f7f400700 1 -- 172.21.15.82:0/2891318610 learned_addr learned my addr 172.21.15.82:0/2891318610 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:53:33.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.242+0000 7f7f7f400700 1 -- 172.21.15.82:0/2891318610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5628e6a28870 msgr2=0x5628e6a2a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:53:33.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.243+0000 7f7f85000700 1 --2- 172.21.15.82:0/2891318610 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5628e6a2d1e0 0x5628e6a398a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:33.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.243+0000 7f7f7f400700 1 --2- 172.21.15.82:0/2891318610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5628e6a28870 0x5628e6a2a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:33.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.243+0000 7f7f7f400700 1 -- 172.21.15.82:0/2891318610 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5628e6a2d1e0 msgr2=0x5628e6a398a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:53:33.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.243+0000 7f7f7f400700 1 --2- 172.21.15.82:0/2891318610 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5628e6a2d1e0 0x5628e6a398a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:33.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.243+0000 7f7f7f400700 1 -- 172.21.15.82:0/2891318610 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628e6a39de0 con 0x5628e6a29190 2024-05-08T05:53:33.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.243+0000 7f7f7fe00700 1 --2- 172.21.15.82:0/2891318610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5628e6a28870 0x5628e6a2a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:53:33.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.243+0000 7f7f85000700 1 --2- 172.21.15.82:0/2891318610 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5628e6a2d1e0 0x5628e6a398a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:53:33.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.243+0000 7f7f7f400700 1 --2- 172.21.15.82:0/2891318610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5628e6a29190 0x5628e6a2a760 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c009630 tx=0x7f7f6c00ec00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78dc5bd6b2b3555e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:53:33.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.243+0000 7f7f6a000700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:53:33.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.244+0000 7f7f6a000700 1 -- 172.21.15.82:0/2891318610 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c016070 con 0x5628e6a29190 2024-05-08T05:53:33.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.244+0000 7f7f919d5b80 1 -- 172.21.15.82:0/2891318610 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f78009cb0 con 0x5628e6a29190 2024-05-08T05:53:33.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.245+0000 7f7f6a000700 1 -- 172.21.15.82:0/2891318610 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f7f6c0052d0 con 0x5628e6a29190 2024-05-08T05:53:33.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.245+0000 7f7f6a000700 1 -- 172.21.15.82:0/2891318610 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f7f6c005510 con 0x5628e6a29190 2024-05-08T05:53:33.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.246+0000 7f7f919d5b80 10 client.25519 fetch_fsmap learned FSMap version 31 2024-05-08T05:53:33.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.246+0000 7f7f919d5b80 1 -- 172.21.15.82:0/2891318610 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5628e6a3b0c0 con 0x5628e6a29190 2024-05-08T05:53:33.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.246+0000 7f7f6a000700 1 -- 172.21.15.82:0/2891318610 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f78009cb0 con 0x5628e6a29190 2024-05-08T05:53:33.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.246+0000 7f7f6a000700 1 -- 172.21.15.82:0/2891318610 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f7f6c003710 con 0x5628e6a29190 2024-05-08T05:53:33.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.246+0000 7f7f919d5b80 10 client.25519 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:53:33.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.246+0000 7f7f919d5b80 10 client.25519 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-05-08T05:53:33.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.246+0000 7f7f919d5b80 20 client.25519 populate_metadata read hostname 'smithi082' 2024-05-08T05:53:33.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.247+0000 7f7f919d5b80 1 --2- 172.21.15.82:0/2891318610 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x5628e6aace90 0x5628e6aaf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:33.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.247+0000 7f7f919d5b80 4 client.25519 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:53:33.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.247+0000 7f7f919d5b80 1 -- 172.21.15.82:0/2891318610 --> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5628e6980400 con 0x5628e6aace90 2024-05-08T05:53:33.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.247+0000 7f7f7fe00700 1 --2- 172.21.15.82:0/2891318610 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x5628e6aace90 0x5628e6aaf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:33.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.248+0000 7f7f6a000700 10 client.25519 ms_handle_connect on v2:172.21.15.134:6836/2212411710 2024-05-08T05:53:33.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.248+0000 7f7f7fe00700 1 --2- 172.21.15.82:0/2891318610 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x5628e6aace90 0x5628e6aaf2b0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8cf990fff5594626 server_cookie=1ba7c9bcdabc65a7 in_seq=0 out_seq=0 2024-05-08T05:53:33.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.248+0000 7f7f6a000700 1 -- 172.21.15.82:0/2891318610 <== mds.4 v2:172.21.15.134:6836/2212411710 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5628e6980400 con 0x5628e6aace90 2024-05-08T05:53:33.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.248+0000 7f7f6a000700 10 client.25519 handle_command_reply: tid=0 2024-05-08T05:53:33.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.248+0000 7f7f919d5b80 1 client.25519 shutdown 2024-05-08T05:53:33.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.249+0000 7f7f919d5b80 1 -- 172.21.15.82:0/2891318610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5628e6a29190 msgr2=0x5628e6a2a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:33.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.249+0000 7f7f919d5b80 1 --2- 172.21.15.82:0/2891318610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5628e6a29190 0x5628e6a2a760 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c009630 tx=0x7f7f6c00ec00 comp rx=0 tx=0).stop 2024-05-08T05:53:33.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.249+0000 7f7f919d5b80 1 -- 172.21.15.82:0/2891318610 shutdown_connections 2024-05-08T05:53:33.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.249+0000 7f7f919d5b80 1 --2- 172.21.15.82:0/2891318610 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x5628e6aace90 0x5628e6aaf2b0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:33.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.249+0000 7f7f919d5b80 1 --2- 172.21.15.82:0/2891318610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5628e6a28870 0x5628e6a2a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:33.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.249+0000 7f7f919d5b80 1 --2- 172.21.15.82:0/2891318610 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5628e6a2d1e0 0x5628e6a398a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:33.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.249+0000 7f7f919d5b80 1 --2- 172.21.15.82:0/2891318610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5628e6a29190 0x5628e6a2a760 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:33.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.249+0000 7f7f919d5b80 1 -- 172.21.15.82:0/2891318610 >> 172.21.15.82:0/2891318610 conn(0x5628e694eb60 msgr2=0x5628e6a14a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:53:33.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.249+0000 7f7f6a000700 0 client.25519 ms_handle_reset on v2:172.21.15.134:6836/2212411710 2024-05-08T05:53:33.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.249+0000 7f7f919d5b80 1 -- 172.21.15.82:0/2891318610 shutdown_connections 2024-05-08T05:53:33.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.249+0000 7f7f919d5b80 1 -- 172.21.15.82:0/2891318610 wait complete. 2024-05-08T05:53:33.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.250+0000 7f7f919d5b80 20 client.25519 trim_cache size 0 max 16384 2024-05-08T05:53:33.251 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T05:53:33.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.251+0000 7f7f87000700 1 -- 172.21.15.82:0/2298818507 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7f640b2900 msgr2=0x7f7f640b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:33.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.251+0000 7f7f87000700 1 --2- 172.21.15.82:0/2298818507 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7f640b2900 0x7f7f640b4dc0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7f7000a9b0 tx=0x7f7f70005c90 comp rx=0 tx=0).stop 2024-05-08T05:53:33.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.251+0000 7f7f87000700 1 -- 172.21.15.82:0/2298818507 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f8010b6b0 msgr2=0x7f7f8019bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:33.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.251+0000 7f7f87000700 1 --2- 172.21.15.82:0/2298818507 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f8010b6b0 0x7f7f8019bad0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7f78009fd0 tx=0x7f7f78004e70 comp rx=0 tx=0).stop 2024-05-08T05:53:33.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.251+0000 7f7f87000700 1 -- 172.21.15.82:0/2298818507 shutdown_connections 2024-05-08T05:53:33.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.251+0000 7f7f87000700 1 --2- 172.21.15.82:0/2298818507 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f8010b6b0 0x7f7f8019bad0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:33.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.251+0000 7f7f87000700 1 --2- 172.21.15.82:0/2298818507 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7f640b2900 0x7f7f640b4dc0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:33.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.251+0000 7f7f87000700 1 --2- 172.21.15.82:0/2298818507 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f801056b0 0x7f7f801a1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:33.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.251+0000 7f7f87000700 1 --2- 172.21.15.82:0/2298818507 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f80106070 0x7f7f801a1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:33.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.251+0000 7f7f87000700 1 -- 172.21.15.82:0/2298818507 >> 172.21.15.82:0/2298818507 conn(0x7f7f801011a0 msgr2=0x7f7f80101680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:53:33.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.251+0000 7f7f87000700 1 -- 172.21.15.82:0/2298818507 shutdown_connections 2024-05-08T05:53:33.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:33.251+0000 7f7f87000700 1 -- 172.21.15.82:0/2298818507 wait complete. 2024-05-08T05:53:33.491 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:53:33 smithi082 ceph-mon[30098]: pgmap v546: 97 pgs: 97 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 6.7 MiB/s wr, 649 op/s 2024-05-08T05:53:33.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:53:33 smithi151 ceph-mon[34815]: pgmap v546: 97 pgs: 97 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 6.7 MiB/s wr, 649 op/s 2024-05-08T05:53:33.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:53:33 smithi134 ceph-mon[34132]: pgmap v546: 97 pgs: 97 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 6.7 MiB/s wr, 649 op/s 2024-05-08T05:53:34.052 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-05-08T05:53:34.650 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:53:35.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 165.0 s, 2776.6 tps, lat 36.015 ms stddev 41.805 2024-05-08T05:53:35.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:53:35 smithi151 ceph-mon[34815]: pgmap v547: 97 pgs: 97 active+clean; 1.1 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 7.4 MiB/s wr, 699 op/s 2024-05-08T05:53:35.630 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:53:35 smithi082 ceph-mon[30098]: pgmap v547: 97 pgs: 97 active+clean; 1.1 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 7.4 MiB/s wr, 699 op/s 2024-05-08T05:53:35.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:53:35 smithi134 ceph-mon[34132]: pgmap v547: 97 pgs: 97 active+clean; 1.1 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 7.4 MiB/s wr, 699 op/s 2024-05-08T05:53:36.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.897+0000 7f7708600700 1 -- 172.21.15.82:0/1829514196 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77001056e0 msgr2=0x7f7700105b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:36.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.897+0000 7f7708600700 1 --2- 172.21.15.82:0/1829514196 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77001056e0 0x7f7700105b60 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f76ec009990 tx=0x7f76ec009ca0 comp rx=0 tx=0).stop 2024-05-08T05:53:36.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.897+0000 7f7708600700 1 -- 172.21.15.82:0/1829514196 shutdown_connections 2024-05-08T05:53:36.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.897+0000 7f7708600700 1 --2- 172.21.15.82:0/1829514196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77001060a0 0x7f77001125b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:36.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.897+0000 7f7708600700 1 --2- 172.21.15.82:0/1829514196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f770010b6e0 0x7f770010bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:36.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.897+0000 7f7708600700 1 --2- 172.21.15.82:0/1829514196 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77001056e0 0x7f7700105b60 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:36.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.897+0000 7f7708600700 1 -- 172.21.15.82:0/1829514196 >> 172.21.15.82:0/1829514196 conn(0x7f77001011d0 msgr2=0x7f77001035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:53:36.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.897+0000 7f7708600700 1 -- 172.21.15.82:0/1829514196 shutdown_connections 2024-05-08T05:53:36.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.897+0000 7f7708600700 1 -- 172.21.15.82:0/1829514196 wait complete. 2024-05-08T05:53:36.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.898+0000 7f7708600700 1 Processor -- start 2024-05-08T05:53:36.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.899+0000 7f7708600700 1 -- start start 2024-05-08T05:53:36.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.899+0000 7f7708600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77001056e0 0x7f7700112470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:36.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.899+0000 7f7708600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77001060a0 0x7f770010f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:36.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.899+0000 7f7708600700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f770010b6e0 0x7f770010fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:36.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.899+0000 7f7708600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7700115920 con 0x7f77001060a0 2024-05-08T05:53:36.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.899+0000 7f7708600700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f77001157a0 con 0x7f77001056e0 2024-05-08T05:53:36.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.899+0000 7f7708600700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7700115aa0 con 0x7f770010b6e0 2024-05-08T05:53:36.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.899+0000 7f7706600700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f770010b6e0 0x7f770010fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:36.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.900+0000 7f7706600700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f770010b6e0 0x7f770010fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:37588/0 (socket says 172.21.15.82:37588) 2024-05-08T05:53:36.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.900+0000 7f7706600700 1 -- 172.21.15.82:0/2185615510 learned_addr learned my addr 172.21.15.82:0/2185615510 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:53:36.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.900+0000 7f7705200700 1 --2- 172.21.15.82:0/2185615510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77001060a0 0x7f770010f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:36.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.900+0000 7f7705c00700 1 --2- 172.21.15.82:0/2185615510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77001056e0 0x7f7700112470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:36.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.900+0000 7f7706600700 1 -- 172.21.15.82:0/2185615510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77001056e0 msgr2=0x7f7700112470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:36.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.901+0000 7f7706600700 1 --2- 172.21.15.82:0/2185615510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77001056e0 0x7f7700112470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:36.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.901+0000 7f7706600700 1 -- 172.21.15.82:0/2185615510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77001060a0 msgr2=0x7f770010f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:36.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.901+0000 7f7706600700 1 --2- 172.21.15.82:0/2185615510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77001060a0 0x7f770010f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:36.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.901+0000 7f7706600700 1 -- 172.21.15.82:0/2185615510 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77001a1e20 con 0x7f770010b6e0 2024-05-08T05:53:36.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.901+0000 7f7706600700 1 --2- 172.21.15.82:0/2185615510 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f770010b6e0 0x7f770010fb30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f76f8007ee0 tx=0x7f76f800d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:53:36.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.902+0000 7f76fe000700 1 -- 172.21.15.82:0/2185615510 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f8004bb0 con 0x7f770010b6e0 2024-05-08T05:53:36.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.902+0000 7f76fe000700 1 -- 172.21.15.82:0/2185615510 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76f8004d50 con 0x7f770010b6e0 2024-05-08T05:53:36.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.902+0000 7f76fe000700 1 -- 172.21.15.82:0/2185615510 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f8005920 con 0x7f770010b6e0 2024-05-08T05:53:36.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.902+0000 7f7708600700 1 -- 172.21.15.82:0/2185615510 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77001a2110 con 0x7f770010b6e0 2024-05-08T05:53:36.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.903+0000 7f7708600700 1 -- 172.21.15.82:0/2185615510 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77001a25d0 con 0x7f770010b6e0 2024-05-08T05:53:36.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.910+0000 7f7712faab80 1 Processor -- start 2024-05-08T05:53:36.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.910+0000 7f76fe000700 1 -- 172.21.15.82:0/2185615510 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f76f801a020 con 0x7f770010b6e0 2024-05-08T05:53:36.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.912+0000 7f76fe000700 1 --2- 172.21.15.82:0/2185615510 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f76e80b2a50 0x7f76e80b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:36.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.912+0000 7f76fe000700 1 -- 172.21.15.82:0/2185615510 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f76f80e15a0 con 0x7f770010b6e0 2024-05-08T05:53:36.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.913+0000 7f7712faab80 1 -- start start 2024-05-08T05:53:36.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.913+0000 7f7712faab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f98d2f7060 0x55f98d2f7440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:36.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.913+0000 7f7712faab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f98d2f7980 0x55f98d2fb490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:36.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.913+0000 7f7705200700 1 --2- 172.21.15.82:0/2185615510 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f76e80b2a50 0x7f76e80b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:36.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.913+0000 7f7712faab80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f98d2fb9d0 0x55f98d2fbe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:36.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.913+0000 7f7712faab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f98d249a20 con 0x55f98d2f7980 2024-05-08T05:53:36.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.913+0000 7f7712faab80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f98d1e7760 con 0x55f98d2fb9d0 2024-05-08T05:53:36.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.913+0000 7f7712faab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55f98d2459e0 con 0x55f98d2f7060 2024-05-08T05:53:36.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.914+0000 7f7706600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f98d2fb9d0 0x55f98d2fbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:36.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.914+0000 7f7705c00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f98d2f7060 0x55f98d2f7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:36.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.914+0000 7f7706600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f98d2fb9d0 0x55f98d2fbe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:44904/0 (socket says 172.21.15.82:44904) 2024-05-08T05:53:36.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.914+0000 7f7706600700 1 -- 172.21.15.82:0/2447712600 learned_addr learned my addr 172.21.15.82:0/2447712600 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:53:36.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.914+0000 7f7705c00700 1 -- 172.21.15.82:0/2447712600 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f98d2fb9d0 msgr2=0x55f98d2fbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:53:36.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.914+0000 7f7705c00700 1 --2- 172.21.15.82:0/2447712600 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f98d2fb9d0 0x55f98d2fbe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:36.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.914+0000 7f7705c00700 1 -- 172.21.15.82:0/2447712600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f98d2f7980 msgr2=0x55f98d2fb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:53:36.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.914+0000 7f7705c00700 1 --2- 172.21.15.82:0/2447712600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f98d2f7980 0x55f98d2fb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:36.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.914+0000 7f7705c00700 1 -- 172.21.15.82:0/2447712600 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f98d1968d0 con 0x55f98d2f7060 2024-05-08T05:53:36.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.914+0000 7f7705c00700 1 --2- 172.21.15.82:0/2447712600 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f98d2f7060 0x55f98d2f7440 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f76f4009a20 tx=0x7f76f4009d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbcfdccb2814c32a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:53:36.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.915+0000 7f7705200700 1 --2- 172.21.15.82:0/2185615510 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f76e80b2a50 0x7f76e80b4f10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f76ec0098e0 tx=0x7f76ec009f40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:53:36.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.915+0000 7f76f2a00700 1 -- 172.21.15.82:0/2447712600 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f4017070 con 0x55f98d2f7060 2024-05-08T05:53:36.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.915+0000 7f76f2a00700 1 -- 172.21.15.82:0/2447712600 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76f400ed80 con 0x55f98d2f7060 2024-05-08T05:53:36.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.915+0000 7f76f2a00700 1 -- 172.21.15.82:0/2447712600 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f4013ce0 con 0x55f98d2f7060 2024-05-08T05:53:36.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.916+0000 7f7712faab80 1 -- 172.21.15.82:0/2447712600 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f98d2f7060 msgr2=0x55f98d2f7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:36.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.916+0000 7f7712faab80 1 --2- 172.21.15.82:0/2447712600 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f98d2f7060 0x55f98d2f7440 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f76f4009a20 tx=0x7f76f4009d30 comp rx=0 tx=0).stop 2024-05-08T05:53:36.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.916+0000 7f7712faab80 1 -- 172.21.15.82:0/2447712600 shutdown_connections 2024-05-08T05:53:36.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.916+0000 7f7712faab80 1 --2- 172.21.15.82:0/2447712600 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f98d2fb9d0 0x55f98d2fbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:36.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.916+0000 7f7712faab80 1 --2- 172.21.15.82:0/2447712600 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f98d2f7060 0x55f98d2f7440 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:36.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.916+0000 7f7712faab80 1 --2- 172.21.15.82:0/2447712600 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f98d2f7980 0x55f98d2fb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:36.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.916+0000 7f7712faab80 1 -- 172.21.15.82:0/2447712600 >> 172.21.15.82:0/2447712600 conn(0x55f98d225b60 msgr2=0x55f98d2f17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:53:36.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.917+0000 7f7712faab80 1 -- 172.21.15.82:0/2447712600 shutdown_connections 2024-05-08T05:53:36.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.917+0000 7f7712faab80 1 -- 172.21.15.82:0/2447712600 wait complete. 2024-05-08T05:53:36.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.917+0000 7f7712faab80 1 -- start start 2024-05-08T05:53:36.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.918+0000 7f7712faab80 1 Processor -- start 2024-05-08T05:53:36.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.918+0000 7f7712faab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f98d2f7060 0x55f98d302e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:36.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.918+0000 7f7712faab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f98d2f7980 0x55f98d300220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:36.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.918+0000 7f7712faab80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f98d2fb9d0 0x55f98d300760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:36.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.918+0000 7f7712faab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f98d303be0 con 0x55f98d2f7060 2024-05-08T05:53:36.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.918+0000 7f7712faab80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f98d1afb20 con 0x55f98d2fb9d0 2024-05-08T05:53:36.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.918+0000 7f7712faab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55f98d303d60 con 0x55f98d2f7980 2024-05-08T05:53:36.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.918+0000 7f7712faab80 10 client.0 _ll_register_callbacks cb 0x55f98d1f0c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:53:36.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.919+0000 7f7705c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f98d2f7060 0x55f98d302e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:36.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.919+0000 7f7705200700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f98d2f7980 0x55f98d300220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:36.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.919+0000 7f7705c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f98d2f7060 0x55f98d302e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44060/0 (socket says 172.21.15.82:44060) 2024-05-08T05:53:36.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.919+0000 7f7705c00700 1 -- 172.21.15.82:0/971057635 learned_addr learned my addr 172.21.15.82:0/971057635 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:53:36.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.919+0000 7f7706600700 1 --2- 172.21.15.82:0/971057635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f98d2fb9d0 0x55f98d300760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:36.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.919+0000 7f7705c00700 1 -- 172.21.15.82:0/971057635 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f98d2f7980 msgr2=0x55f98d300220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:53:36.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.919+0000 7f7705c00700 1 --2- 172.21.15.82:0/971057635 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f98d2f7980 0x55f98d300220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:36.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.919+0000 7f7705c00700 1 -- 172.21.15.82:0/971057635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f98d2fb9d0 msgr2=0x55f98d300760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:53:36.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.919+0000 7f7705c00700 1 --2- 172.21.15.82:0/971057635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f98d2fb9d0 0x55f98d300760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:36.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.919+0000 7f7705c00700 1 -- 172.21.15.82:0/971057635 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f98d20f420 con 0x55f98d2f7060 2024-05-08T05:53:36.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.919+0000 7f7705200700 1 --2- 172.21.15.82:0/971057635 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f98d2f7980 0x55f98d300220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:53:36.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.920+0000 7f7705c00700 1 --2- 172.21.15.82:0/971057635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f98d2f7060 0x55f98d302e80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f76f4013b50 tx=0x7f76f4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95f2905177f9d169 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:53:36.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.920+0000 7f76e7400700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T05:53:36.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.920+0000 7f76e7400700 1 -- 172.21.15.82:0/971057635 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f4029060 con 0x55f98d2f7060 2024-05-08T05:53:36.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.921+0000 7f76e7400700 1 -- 172.21.15.82:0/971057635 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f76f401c660 con 0x55f98d2f7060 2024-05-08T05:53:36.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.921+0000 7f7712faab80 1 -- 172.21.15.82:0/971057635 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f76f400ed80 con 0x55f98d2f7060 2024-05-08T05:53:36.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.921+0000 7f76e7400700 1 -- 172.21.15.82:0/971057635 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f76f4017040 con 0x55f98d2f7060 2024-05-08T05:53:36.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.921+0000 7f7712faab80 10 client.15342 fetch_fsmap learned FSMap version 31 2024-05-08T05:53:36.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.921+0000 7f7712faab80 1 -- 172.21.15.82:0/971057635 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55f98d30e290 con 0x55f98d2f7060 2024-05-08T05:53:36.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.921+0000 7f76e7400700 1 -- 172.21.15.82:0/971057635 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76f400ed80 con 0x55f98d2f7060 2024-05-08T05:53:36.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.922+0000 7f76e7400700 1 -- 172.21.15.82:0/971057635 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f76f402f3d0 con 0x55f98d2f7060 2024-05-08T05:53:36.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.922+0000 7f7712faab80 10 client.15342 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:53:36.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.922+0000 7f7712faab80 10 client.15342 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-05-08T05:53:36.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.922+0000 7f7712faab80 20 client.15342 populate_metadata read hostname 'smithi082' 2024-05-08T05:53:36.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.922+0000 7f7712faab80 1 --2- 172.21.15.82:0/971057635 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x55f98d310760 0x55f98d312b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:36.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.922+0000 7f7712faab80 4 client.15342 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:53:36.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.922+0000 7f7712faab80 1 -- 172.21.15.82:0/971057635 --> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f98d2c40a0 con 0x55f98d310760 2024-05-08T05:53:36.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.922+0000 7f7705200700 1 --2- 172.21.15.82:0/971057635 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x55f98d310760 0x55f98d312b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:36.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.924+0000 7f7705200700 1 --2- 172.21.15.82:0/971057635 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x55f98d310760 0x55f98d312b50 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d19e9ed8c32763e server_cookie=80624c84e9943b08 in_seq=0 out_seq=0 2024-05-08T05:53:36.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.924+0000 7f76e7400700 10 client.15342 ms_handle_connect on v2:172.21.15.151:6834/2093655929 2024-05-08T05:53:36.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.924+0000 7f76e7400700 1 -- 172.21.15.82:0/971057635 <== mds.3 v2:172.21.15.151:6834/2093655929 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f98d2c40a0 con 0x55f98d310760 2024-05-08T05:53:36.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.925+0000 7f76e7400700 10 client.15342 handle_command_reply: tid=0 2024-05-08T05:53:36.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.925+0000 7f7712faab80 1 client.15342 shutdown 2024-05-08T05:53:36.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.925+0000 7f7712faab80 1 -- 172.21.15.82:0/971057635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f98d2f7060 msgr2=0x55f98d302e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:36.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.925+0000 7f7712faab80 1 --2- 172.21.15.82:0/971057635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f98d2f7060 0x55f98d302e80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f76f4013b50 tx=0x7f76f4000bc0 comp rx=0 tx=0).stop 2024-05-08T05:53:36.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.926+0000 7f7712faab80 1 -- 172.21.15.82:0/971057635 shutdown_connections 2024-05-08T05:53:36.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.926+0000 7f7712faab80 1 --2- 172.21.15.82:0/971057635 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x55f98d310760 0x55f98d312b50 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:36.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.926+0000 7f7712faab80 1 --2- 172.21.15.82:0/971057635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f98d2fb9d0 0x55f98d300760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:36.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.926+0000 7f7712faab80 1 --2- 172.21.15.82:0/971057635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f98d2f7060 0x55f98d302e80 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:36.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.926+0000 7f7712faab80 1 --2- 172.21.15.82:0/971057635 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f98d2f7980 0x55f98d300220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:36.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.926+0000 7f7712faab80 1 -- 172.21.15.82:0/971057635 >> 172.21.15.82:0/971057635 conn(0x55f98d225b60 msgr2=0x55f98d2ec2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:53:36.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.926+0000 7f76e7400700 0 client.15342 ms_handle_reset on v2:172.21.15.151:6834/2093655929 2024-05-08T05:53:36.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.926+0000 7f7712faab80 1 -- 172.21.15.82:0/971057635 shutdown_connections 2024-05-08T05:53:36.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.926+0000 7f7712faab80 1 -- 172.21.15.82:0/971057635 wait complete. 2024-05-08T05:53:36.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.926+0000 7f7712faab80 20 client.15342 trim_cache size 0 max 16384 2024-05-08T05:53:36.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.952+0000 7f7712faab80 1 Processor -- start 2024-05-08T05:53:36.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.952+0000 7f7712faab80 1 -- start start 2024-05-08T05:53:36.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.952+0000 7f7712faab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f98d2f7060 0x55f98d318150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:36.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.952+0000 7f7712faab80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f98d2f7980 0x55f98d318690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:36.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.952+0000 7f7712faab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f98d2fb9d0 0x55f98d309010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:36.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.953+0000 7f7712faab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f77001bc870 con 0x55f98d2f7060 2024-05-08T05:53:36.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.953+0000 7f7712faab80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f77001be3b0 con 0x55f98d2f7980 2024-05-08T05:53:36.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.953+0000 7f7712faab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f77001bcf40 con 0x55f98d2fb9d0 2024-05-08T05:53:36.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.953+0000 7f7706600700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f98d2fb9d0 0x55f98d309010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:36.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.953+0000 7f7706600700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f98d2fb9d0 0x55f98d309010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:37614/0 (socket says 172.21.15.82:37614) 2024-05-08T05:53:36.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.953+0000 7f7706600700 1 -- 172.21.15.82:0/1830651278 learned_addr learned my addr 172.21.15.82:0/1830651278 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:53:36.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.953+0000 7f7705200700 1 --2- 172.21.15.82:0/1830651278 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f98d2f7980 0x55f98d318690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:36.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.953+0000 7f7705c00700 1 --2- 172.21.15.82:0/1830651278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f98d2f7060 0x55f98d318150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:36.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.954+0000 7f7706600700 1 -- 172.21.15.82:0/1830651278 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f98d2f7980 msgr2=0x55f98d318690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:53:36.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.954+0000 7f7706600700 1 --2- 172.21.15.82:0/1830651278 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f98d2f7980 0x55f98d318690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:36.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.954+0000 7f7706600700 1 -- 172.21.15.82:0/1830651278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f98d2f7060 msgr2=0x55f98d318150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:53:36.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.954+0000 7f7706600700 1 --2- 172.21.15.82:0/1830651278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f98d2f7060 0x55f98d318150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:36.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.954+0000 7f7706600700 1 -- 172.21.15.82:0/1830651278 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f98d2f29c0 con 0x55f98d2fb9d0 2024-05-08T05:53:36.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.954+0000 7f7706600700 1 --2- 172.21.15.82:0/1830651278 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f98d2fb9d0 0x55f98d309010 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f76f8004b80 tx=0x7f76f800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6e57b74ac860c27 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:53:36.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.955+0000 7f76f2000700 1 -- 172.21.15.82:0/1830651278 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f80c2070 con 0x55f98d2fb9d0 2024-05-08T05:53:36.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.955+0000 7f76f2000700 1 -- 172.21.15.82:0/1830651278 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f76f80b1310 con 0x55f98d2fb9d0 2024-05-08T05:53:36.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.955+0000 7f76f2000700 1 -- 172.21.15.82:0/1830651278 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76f80b19d0 con 0x55f98d2fb9d0 2024-05-08T05:53:36.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.956+0000 7f7712faab80 1 -- 172.21.15.82:0/1830651278 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f98d2fb9d0 msgr2=0x55f98d309010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:36.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.956+0000 7f7712faab80 1 --2- 172.21.15.82:0/1830651278 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f98d2fb9d0 0x55f98d309010 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f76f8004b80 tx=0x7f76f800b040 comp rx=0 tx=0).stop 2024-05-08T05:53:36.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.958+0000 7f7712faab80 1 -- 172.21.15.82:0/1830651278 shutdown_connections 2024-05-08T05:53:36.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.958+0000 7f7712faab80 1 --2- 172.21.15.82:0/1830651278 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f98d2fb9d0 0x55f98d309010 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:36.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.958+0000 7f7712faab80 1 --2- 172.21.15.82:0/1830651278 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f98d2f7060 0x55f98d318150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:36.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.958+0000 7f7712faab80 1 --2- 172.21.15.82:0/1830651278 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f98d2f7980 0x55f98d318690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:36.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.958+0000 7f7712faab80 1 -- 172.21.15.82:0/1830651278 >> 172.21.15.82:0/1830651278 conn(0x55f98d225b60 msgr2=0x55f98d312770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:53:36.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.960+0000 7f7712faab80 1 -- 172.21.15.82:0/1830651278 shutdown_connections 2024-05-08T05:53:36.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.960+0000 7f7712faab80 1 -- 172.21.15.82:0/1830651278 wait complete. 2024-05-08T05:53:36.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.961+0000 7f7712faab80 1 -- start start 2024-05-08T05:53:36.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.962+0000 7f7712faab80 1 Processor -- start 2024-05-08T05:53:36.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.963+0000 7f7712faab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f98d2f7060 0x55f98d309020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:36.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.963+0000 7f7712faab80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f98d2f7980 0x55f98d309560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:36.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.964+0000 7f7712faab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f98d2fb9d0 0x55f98d317140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:36.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.964+0000 7f7705200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f98d2f7980 0x55f98d309560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:36.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.964+0000 7f7712faab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f77001bdce0 con 0x55f98d2f7060 2024-05-08T05:53:36.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.964+0000 7f7712faab80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f77001bd610 con 0x55f98d2f7980 2024-05-08T05:53:36.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.964+0000 7f7712faab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f77001ba830 con 0x55f98d2fb9d0 2024-05-08T05:53:36.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.964+0000 7f7712faab80 10 client.0 _ll_register_callbacks cb 0x55f98d1f0c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:53:36.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.965+0000 7f7706600700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f98d2fb9d0 0x55f98d317140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:36.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.966+0000 7f7705c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f98d2f7060 0x55f98d309020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:36.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.966+0000 7f7705c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f98d2f7060 0x55f98d309020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44078/0 (socket says 172.21.15.82:44078) 2024-05-08T05:53:36.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.966+0000 7f7705200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f98d2f7980 0x55f98d309560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:44926/0 (socket says 172.21.15.82:44926) 2024-05-08T05:53:36.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.966+0000 7f7705200700 1 -- 172.21.15.82:0/2103637453 learned_addr learned my addr 172.21.15.82:0/2103637453 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:53:36.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.966+0000 7f7705200700 1 -- 172.21.15.82:0/2103637453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f98d2fb9d0 msgr2=0x55f98d317140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:53:36.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.966+0000 7f7705200700 1 --2- 172.21.15.82:0/2103637453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f98d2fb9d0 0x55f98d317140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:36.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.966+0000 7f7705200700 1 -- 172.21.15.82:0/2103637453 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f98d2f7060 msgr2=0x55f98d309020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:53:36.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.967+0000 7f7705200700 1 --2- 172.21.15.82:0/2103637453 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f98d2f7060 0x55f98d309020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:36.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.967+0000 7f7705200700 1 -- 172.21.15.82:0/2103637453 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f98d317810 con 0x55f98d2f7980 2024-05-08T05:53:36.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.968+0000 7f7705c00700 1 --2- 172.21.15.82:0/2103637453 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f98d2f7060 0x55f98d309020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:53:36.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.969+0000 7f7705200700 1 --2- 172.21.15.82:0/2103637453 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f98d2f7980 0x55f98d309560 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f76ec000c00 tx=0x7f76ec021000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f98b3876e0270981 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:53:36.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.969+0000 7f76e7400700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:53:36.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.971+0000 7f76e7400700 1 -- 172.21.15.82:0/2103637453 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76ec003e30 con 0x55f98d2f7980 2024-05-08T05:53:36.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.973+0000 7f7712faab80 1 -- 172.21.15.82:0/2103637453 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f98d257400 con 0x55f98d2f7980 2024-05-08T05:53:36.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.972+0000 7f76e7400700 1 -- 172.21.15.82:0/2103637453 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f76ec0050b0 con 0x55f98d2f7980 2024-05-08T05:53:36.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.975+0000 7f76e7400700 1 -- 172.21.15.82:0/2103637453 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f76ec0052b0 con 0x55f98d2f7980 2024-05-08T05:53:36.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.975+0000 7f7712faab80 10 client.25514 fetch_fsmap learned FSMap version 31 2024-05-08T05:53:36.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.975+0000 7f7712faab80 1 -- 172.21.15.82:0/2103637453 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55f98d37a710 con 0x55f98d2f7980 2024-05-08T05:53:36.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.976+0000 7f76e7400700 1 -- 172.21.15.82:0/2103637453 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55f98d257400 con 0x55f98d2f7980 2024-05-08T05:53:36.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.976+0000 7f76e7400700 1 -- 172.21.15.82:0/2103637453 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f76ec03c070 con 0x55f98d2f7980 2024-05-08T05:53:36.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.976+0000 7f7712faab80 10 client.25514 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:53:36.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.976+0000 7f7712faab80 10 client.25514 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-05-08T05:53:36.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.977+0000 7f7712faab80 20 client.25514 populate_metadata read hostname 'smithi082' 2024-05-08T05:53:36.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.977+0000 7f7712faab80 1 --2- 172.21.15.82:0/2103637453 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x55f98d37adb0 0x55f98d37d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:36.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.977+0000 7f7712faab80 4 client.25514 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:53:36.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.977+0000 7f7712faab80 1 -- 172.21.15.82:0/2103637453 --> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f98d2514a0 con 0x55f98d37adb0 2024-05-08T05:53:36.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.977+0000 7f7705c00700 1 --2- 172.21.15.82:0/2103637453 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x55f98d37adb0 0x55f98d37d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:36.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.978+0000 7f7705c00700 1 --2- 172.21.15.82:0/2103637453 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x55f98d37adb0 0x55f98d37d1d0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d1a58b8d504726f0 server_cookie=f4f8328e51a1561b in_seq=0 out_seq=0 2024-05-08T05:53:36.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.978+0000 7f76e7400700 10 client.25514 ms_handle_connect on v2:172.21.15.151:6834/2093655929 2024-05-08T05:53:36.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.979+0000 7f76e7400700 1 -- 172.21.15.82:0/2103637453 <== mds.3 v2:172.21.15.151:6834/2093655929 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f98d2514a0 con 0x55f98d37adb0 2024-05-08T05:53:36.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.979+0000 7f76e7400700 10 client.25514 handle_command_reply: tid=0 2024-05-08T05:53:36.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.979+0000 7f7712faab80 1 client.25514 shutdown 2024-05-08T05:53:36.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.980+0000 7f7712faab80 1 -- 172.21.15.82:0/2103637453 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f98d2f7980 msgr2=0x55f98d309560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:36.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.980+0000 7f7712faab80 1 --2- 172.21.15.82:0/2103637453 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f98d2f7980 0x55f98d309560 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f76ec000c00 tx=0x7f76ec021000 comp rx=0 tx=0).stop 2024-05-08T05:53:36.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.981+0000 7f7712faab80 1 -- 172.21.15.82:0/2103637453 shutdown_connections 2024-05-08T05:53:36.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.981+0000 7f7712faab80 1 --2- 172.21.15.82:0/2103637453 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x55f98d37adb0 0x55f98d37d1d0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:36.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.981+0000 7f7712faab80 1 --2- 172.21.15.82:0/2103637453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f98d2fb9d0 0x55f98d317140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:36.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.981+0000 7f7712faab80 1 --2- 172.21.15.82:0/2103637453 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f98d2f7060 0x55f98d309020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:36.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.981+0000 7f7712faab80 1 --2- 172.21.15.82:0/2103637453 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f98d2f7980 0x55f98d309560 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:36.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.981+0000 7f76e7400700 0 client.25514 ms_handle_reset on v2:172.21.15.151:6834/2093655929 2024-05-08T05:53:36.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.981+0000 7f7712faab80 1 -- 172.21.15.82:0/2103637453 >> 172.21.15.82:0/2103637453 conn(0x55f98d225b60 msgr2=0x55f98d2fd600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:53:36.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.984+0000 7f7712faab80 1 -- 172.21.15.82:0/2103637453 shutdown_connections 2024-05-08T05:53:36.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.985+0000 7f7712faab80 1 -- 172.21.15.82:0/2103637453 wait complete. 2024-05-08T05:53:36.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.985+0000 7f7712faab80 20 client.25514 trim_cache size 0 max 16384 2024-05-08T05:53:36.987 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T05:53:36.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.986+0000 7f7708600700 1 -- 172.21.15.82:0/2185615510 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f76e80b2a50 msgr2=0x7f76e80b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:36.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.986+0000 7f7708600700 1 --2- 172.21.15.82:0/2185615510 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f76e80b2a50 0x7f76e80b4f10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f76ec0098e0 tx=0x7f76ec009f40 comp rx=0 tx=0).stop 2024-05-08T05:53:36.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.986+0000 7f7708600700 1 -- 172.21.15.82:0/2185615510 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f770010b6e0 msgr2=0x7f770010fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:36.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.986+0000 7f7708600700 1 --2- 172.21.15.82:0/2185615510 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f770010b6e0 0x7f770010fb30 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f76f8007ee0 tx=0x7f76f800d3b0 comp rx=0 tx=0).stop 2024-05-08T05:53:36.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.987+0000 7f7708600700 1 -- 172.21.15.82:0/2185615510 shutdown_connections 2024-05-08T05:53:36.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.987+0000 7f7708600700 1 --2- 172.21.15.82:0/2185615510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77001056e0 0x7f7700112470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:36.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.987+0000 7f7708600700 1 --2- 172.21.15.82:0/2185615510 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f76e80b2a50 0x7f76e80b4f10 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:36.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.987+0000 7f7708600700 1 --2- 172.21.15.82:0/2185615510 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f770010b6e0 0x7f770010fb30 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:36.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.987+0000 7f7708600700 1 --2- 172.21.15.82:0/2185615510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f77001060a0 0x7f770010f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:36.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.987+0000 7f7708600700 1 -- 172.21.15.82:0/2185615510 >> 172.21.15.82:0/2185615510 conn(0x7f77001011d0 msgr2=0x7f77001017b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:53:36.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.987+0000 7f7708600700 1 -- 172.21.15.82:0/2185615510 shutdown_connections 2024-05-08T05:53:36.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:36.987+0000 7f7708600700 1 -- 172.21.15.82:0/2185615510 wait complete. 2024-05-08T05:53:37.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:53:37 smithi151 ceph-mon[34815]: pgmap v548: 97 pgs: 97 active+clean; 1.1 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 8.6 MiB/s wr, 729 op/s 2024-05-08T05:53:37.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:53:37 smithi082 ceph-mon[30098]: pgmap v548: 97 pgs: 97 active+clean; 1.1 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 8.6 MiB/s wr, 729 op/s 2024-05-08T05:53:37.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:53:37 smithi134 ceph-mon[34132]: pgmap v548: 97 pgs: 97 active+clean; 1.1 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 8.6 MiB/s wr, 729 op/s 2024-05-08T05:53:38.518 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-05-08T05:53:39.125 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:53:39.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:53:39 smithi151 ceph-mon[34815]: pgmap v549: 97 pgs: 97 active+clean; 1.1 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.8 MiB/s wr, 640 op/s 2024-05-08T05:53:39.630 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:53:39 smithi082 ceph-mon[30098]: pgmap v549: 97 pgs: 97 active+clean; 1.1 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.8 MiB/s wr, 640 op/s 2024-05-08T05:53:39.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:53:39 smithi134 ceph-mon[34132]: pgmap v549: 97 pgs: 97 active+clean; 1.1 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.8 MiB/s wr, 640 op/s 2024-05-08T05:53:40.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 170.0 s, 2703.6 tps, lat 37.036 ms stddev 43.356 2024-05-08T05:53:41.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.536+0000 7f801dc00700 1 -- 172.21.15.82:0/2988405619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80181060a0 msgr2=0x7f80181125b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:41.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.536+0000 7f801dc00700 1 --2- 172.21.15.82:0/2988405619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80181060a0 0x7f80181125b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f801000b0a0 tx=0x7f801000b3b0 comp rx=0 tx=0).stop 2024-05-08T05:53:41.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.536+0000 7f801dc00700 1 -- 172.21.15.82:0/2988405619 shutdown_connections 2024-05-08T05:53:41.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.536+0000 7f801dc00700 1 --2- 172.21.15.82:0/2988405619 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f801810b6e0 0x7f801810bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:41.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.536+0000 7f801dc00700 1 --2- 172.21.15.82:0/2988405619 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80181060a0 0x7f80181125b0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:41.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.536+0000 7f801dc00700 1 --2- 172.21.15.82:0/2988405619 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f80181056e0 0x7f8018105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:41.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.536+0000 7f801dc00700 1 -- 172.21.15.82:0/2988405619 >> 172.21.15.82:0/2988405619 conn(0x7f80181011d0 msgr2=0x7f80181035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:53:41.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.538+0000 7f801dc00700 1 -- 172.21.15.82:0/2988405619 shutdown_connections 2024-05-08T05:53:41.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.538+0000 7f801dc00700 1 -- 172.21.15.82:0/2988405619 wait complete. 2024-05-08T05:53:41.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.542+0000 7f801dc00700 1 Processor -- start 2024-05-08T05:53:41.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.542+0000 7f801dc00700 1 -- start start 2024-05-08T05:53:41.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.542+0000 7f801dc00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80181056e0 0x7f8018110320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:41.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.542+0000 7f801dc00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f80181060a0 0x7f8018110860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:41.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.542+0000 7f801dc00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f801810b6e0 0x7f8018111ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:41.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.542+0000 7f801dc00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8018077d90 con 0x7f80181056e0 2024-05-08T05:53:41.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.543+0000 7f801dc00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8018077c10 con 0x7f801810b6e0 2024-05-08T05:53:41.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.543+0000 7f801dc00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8018077f10 con 0x7f80181060a0 2024-05-08T05:53:41.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.543+0000 7f8016000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f80181060a0 0x7f8018110860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:41.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.543+0000 7f8016000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f80181060a0 0x7f8018110860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:37644/0 (socket says 172.21.15.82:37644) 2024-05-08T05:53:41.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.543+0000 7f8016000700 1 -- 172.21.15.82:0/4101962115 learned_addr learned my addr 172.21.15.82:0/4101962115 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:53:41.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.543+0000 7f8016a00700 1 --2- 172.21.15.82:0/4101962115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80181056e0 0x7f8018110320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:41.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.544+0000 7f8017400700 1 --2- 172.21.15.82:0/4101962115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f801810b6e0 0x7f8018111ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:41.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.544+0000 7f8016000700 1 -- 172.21.15.82:0/4101962115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f801810b6e0 msgr2=0x7f8018111ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:41.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.544+0000 7f8016000700 1 --2- 172.21.15.82:0/4101962115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f801810b6e0 0x7f8018111ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:41.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.544+0000 7f8016000700 1 -- 172.21.15.82:0/4101962115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80181056e0 msgr2=0x7f8018110320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:41.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.544+0000 7f8016000700 1 --2- 172.21.15.82:0/4101962115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80181056e0 0x7f8018110320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:41.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.544+0000 7f8016000700 1 -- 172.21.15.82:0/4101962115 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80181122a0 con 0x7f80181060a0 2024-05-08T05:53:41.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.545+0000 7f8016000700 1 --2- 172.21.15.82:0/4101962115 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f80181060a0 0x7f8018110860 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f800800d950 tx=0x7f800800dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:53:41.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.545+0000 7f800f400700 1 -- 172.21.15.82:0/4101962115 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8008016070 con 0x7f80181060a0 2024-05-08T05:53:41.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.545+0000 7f800f400700 1 -- 172.21.15.82:0/4101962115 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8008009df0 con 0x7f80181060a0 2024-05-08T05:53:41.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.545+0000 7f800f400700 1 -- 172.21.15.82:0/4101962115 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f800800f3c0 con 0x7f80181060a0 2024-05-08T05:53:41.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.545+0000 7f801dc00700 1 -- 172.21.15.82:0/4101962115 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8018112590 con 0x7f80181060a0 2024-05-08T05:53:41.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.546+0000 7f801dc00700 1 -- 172.21.15.82:0/4101962115 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80181154c0 con 0x7f80181060a0 2024-05-08T05:53:41.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.553+0000 7f800f400700 1 -- 172.21.15.82:0/4101962115 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f8008019070 con 0x7f80181060a0 2024-05-08T05:53:41.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.555+0000 7f80285aeb80 1 Processor -- start 2024-05-08T05:53:41.556 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:53:41 smithi082 ceph-mon[30098]: pgmap v550: 97 pgs: 97 active+clean; 1.1 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.6 MiB/s wr, 808 op/s 2024-05-08T05:53:41.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.556+0000 7f80285aeb80 1 -- start start 2024-05-08T05:53:41.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.556+0000 7f80285aeb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5617ce33d060 0x5617ce33d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:41.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.556+0000 7f800f400700 1 --2- 172.21.15.82:0/4101962115 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7ffc0b29c0 0x7f7ffc0b4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:41.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.556+0000 7f80285aeb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617ce33d980 0x5617ce341490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:41.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.556+0000 7f80285aeb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5617ce3419d0 0x5617ce341e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:41.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.556+0000 7f80285aeb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5617ce28fa20 con 0x5617ce33d980 2024-05-08T05:53:41.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.556+0000 7f80285aeb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5617ce22d760 con 0x5617ce33d060 2024-05-08T05:53:41.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.556+0000 7f80285aeb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5617ce28b9e0 con 0x5617ce3419d0 2024-05-08T05:53:41.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.556+0000 7f800f400700 1 -- 172.21.15.82:0/4101962115 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f80080e1e00 con 0x7f80181060a0 2024-05-08T05:53:41.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.557+0000 7f8017400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5617ce3419d0 0x5617ce341e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:41.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.557+0000 7f8016000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617ce33d980 0x5617ce341490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:41.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.557+0000 7f8017400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5617ce3419d0 0x5617ce341e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:37656/0 (socket says 172.21.15.82:37656) 2024-05-08T05:53:41.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.557+0000 7f8017400700 1 -- 172.21.15.82:0/2700155677 learned_addr learned my addr 172.21.15.82:0/2700155677 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:53:41.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.557+0000 7f8017400700 1 -- 172.21.15.82:0/2700155677 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5617ce33d060 msgr2=0x5617ce33d440 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T05:53:41.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.557+0000 7f8017400700 1 --2- 172.21.15.82:0/2700155677 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5617ce33d060 0x5617ce33d440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:41.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.557+0000 7f8017400700 1 -- 172.21.15.82:0/2700155677 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617ce33d980 msgr2=0x5617ce341490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:53:41.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.557+0000 7f8017400700 1 --2- 172.21.15.82:0/2700155677 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617ce33d980 0x5617ce341490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:41.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.557+0000 7f8017400700 1 -- 172.21.15.82:0/2700155677 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617ce1dc8d0 con 0x5617ce3419d0 2024-05-08T05:53:41.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.558+0000 7f8017400700 1 --2- 172.21.15.82:0/4101962115 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7ffc0b29c0 0x7f7ffc0b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:41.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.560+0000 7f8017400700 1 --2- 172.21.15.82:0/4101962115 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7ffc0b29c0 0x7f7ffc0b4e80 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8010021000 tx=0x7f8010023000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:53:41.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.560+0000 7f8017400700 1 --2- 172.21.15.82:0/2700155677 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5617ce3419d0 0x5617ce341e30 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f801000b830 tx=0x7f8010009380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a7fc1e70928a533 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:53:41.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.561+0000 7f8003e00700 1 -- 172.21.15.82:0/2700155677 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8010007840 con 0x5617ce3419d0 2024-05-08T05:53:41.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.561+0000 7f8003e00700 1 -- 172.21.15.82:0/2700155677 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8010005040 con 0x5617ce3419d0 2024-05-08T05:53:41.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.561+0000 7f8003e00700 1 -- 172.21.15.82:0/2700155677 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f801001d680 con 0x5617ce3419d0 2024-05-08T05:53:41.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.562+0000 7f80285aeb80 1 -- 172.21.15.82:0/2700155677 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5617ce3419d0 msgr2=0x5617ce341e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:41.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.562+0000 7f80285aeb80 1 --2- 172.21.15.82:0/2700155677 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5617ce3419d0 0x5617ce341e30 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f801000b830 tx=0x7f8010009380 comp rx=0 tx=0).stop 2024-05-08T05:53:41.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.563+0000 7f80285aeb80 1 -- 172.21.15.82:0/2700155677 shutdown_connections 2024-05-08T05:53:41.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.563+0000 7f80285aeb80 1 --2- 172.21.15.82:0/2700155677 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5617ce33d060 0x5617ce33d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:41.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.563+0000 7f80285aeb80 1 --2- 172.21.15.82:0/2700155677 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5617ce3419d0 0x5617ce341e30 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:41.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.563+0000 7f80285aeb80 1 --2- 172.21.15.82:0/2700155677 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617ce33d980 0x5617ce341490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:41.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.563+0000 7f80285aeb80 1 -- 172.21.15.82:0/2700155677 >> 172.21.15.82:0/2700155677 conn(0x5617ce26bb60 msgr2=0x5617ce3377a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:53:41.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.563+0000 7f80285aeb80 1 -- 172.21.15.82:0/2700155677 shutdown_connections 2024-05-08T05:53:41.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.564+0000 7f80285aeb80 1 -- 172.21.15.82:0/2700155677 wait complete. 2024-05-08T05:53:41.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.564+0000 7f80285aeb80 1 -- start start 2024-05-08T05:53:41.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.565+0000 7f80285aeb80 1 Processor -- start 2024-05-08T05:53:41.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.566+0000 7f80285aeb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617ce33d060 0x5617ce348f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:41.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.566+0000 7f80285aeb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5617ce33d980 0x5617ce3462d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:41.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.566+0000 7f80285aeb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5617ce3419d0 0x5617ce346810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:41.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.566+0000 7f80285aeb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5617ce349b80 con 0x5617ce33d060 2024-05-08T05:53:41.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.566+0000 7f8016000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5617ce33d980 0x5617ce3462d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:41.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.566+0000 7f80285aeb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5617ce1f5b20 con 0x5617ce33d980 2024-05-08T05:53:41.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.566+0000 7f8017400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5617ce3419d0 0x5617ce346810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:41.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.566+0000 7f8016000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5617ce33d980 0x5617ce3462d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:44978/0 (socket says 172.21.15.82:44978) 2024-05-08T05:53:41.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.566+0000 7f8016000700 1 -- 172.21.15.82:0/1589738878 learned_addr learned my addr 172.21.15.82:0/1589738878 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:53:41.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.566+0000 7f80285aeb80 1 -- 172.21.15.82:0/1589738878 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5617ce349d00 con 0x5617ce3419d0 2024-05-08T05:53:41.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.566+0000 7f80285aeb80 10 client.0 _ll_register_callbacks cb 0x5617ce236c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:53:41.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.566+0000 7f8016000700 1 -- 172.21.15.82:0/1589738878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5617ce3419d0 msgr2=0x5617ce346810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:53:41.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.566+0000 7f8016000700 1 --2- 172.21.15.82:0/1589738878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5617ce3419d0 0x5617ce346810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:41.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.567+0000 7f8016000700 1 -- 172.21.15.82:0/1589738878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617ce33d060 msgr2=0x5617ce348f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:53:41.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.567+0000 7f8016000700 1 --2- 172.21.15.82:0/1589738878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617ce33d060 0x5617ce348f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:41.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.567+0000 7f8016000700 1 -- 172.21.15.82:0/1589738878 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617ce255420 con 0x5617ce33d980 2024-05-08T05:53:41.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.567+0000 7f8016000700 1 --2- 172.21.15.82:0/1589738878 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5617ce33d980 0x5617ce3462d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f800800b2f0 tx=0x7f80080a9b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f2ee0f060aa756f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:53:41.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.567+0000 7f8000c00700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:53:41.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.567+0000 7f8000c00700 1 -- 172.21.15.82:0/1589738878 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8008020070 con 0x5617ce33d980 2024-05-08T05:53:41.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.567+0000 7f8000c00700 1 -- 172.21.15.82:0/1589738878 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f80080b1da0 con 0x5617ce33d980 2024-05-08T05:53:41.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.567+0000 7f80285aeb80 1 -- 172.21.15.82:0/1589738878 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8010005040 con 0x5617ce33d980 2024-05-08T05:53:41.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.568+0000 7f8000c00700 1 -- 172.21.15.82:0/1589738878 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f80080ad780 con 0x5617ce33d980 2024-05-08T05:53:41.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.568+0000 7f80285aeb80 10 client.25520 fetch_fsmap learned FSMap version 31 2024-05-08T05:53:41.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.568+0000 7f80285aeb80 1 -- 172.21.15.82:0/1589738878 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5617ce3544d0 con 0x5617ce33d980 2024-05-08T05:53:41.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.568+0000 7f8000c00700 1 -- 172.21.15.82:0/1589738878 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8010005040 con 0x5617ce33d980 2024-05-08T05:53:41.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.568+0000 7f8000c00700 1 -- 172.21.15.82:0/1589738878 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f80080a8630 con 0x5617ce33d980 2024-05-08T05:53:41.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.568+0000 7f80285aeb80 10 client.25520 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:53:41.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.568+0000 7f80285aeb80 10 client.25520 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-05-08T05:53:41.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.568+0000 7f80285aeb80 20 client.25520 populate_metadata read hostname 'smithi082' 2024-05-08T05:53:41.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.568+0000 7f80285aeb80 1 --2- 172.21.15.82:0/1589738878 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x5617ce356b10 0x5617ce358f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:41.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.568+0000 7f80285aeb80 4 client.25520 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:53:41.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.568+0000 7f80285aeb80 1 -- 172.21.15.82:0/1589738878 --> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5617ce30a0a0 con 0x5617ce356b10 2024-05-08T05:53:41.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.570+0000 7f8016a00700 1 --2- 172.21.15.82:0/1589738878 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x5617ce356b10 0x5617ce358f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:41.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.571+0000 7f8016a00700 1 --2- 172.21.15.82:0/1589738878 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x5617ce356b10 0x5617ce358f90 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f7c0113a6659baad server_cookie=5bf1d70ad4f42f17 in_seq=0 out_seq=0 2024-05-08T05:53:41.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.571+0000 7f8000c00700 10 client.25520 ms_handle_connect on v2:172.21.15.151:6836/4192404464 2024-05-08T05:53:41.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.572+0000 7f8000c00700 1 -- 172.21.15.82:0/1589738878 <== mds.2 v2:172.21.15.151:6836/4192404464 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5617ce30a0a0 con 0x5617ce356b10 2024-05-08T05:53:41.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.572+0000 7f8000c00700 10 client.25520 handle_command_reply: tid=0 2024-05-08T05:53:41.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.572+0000 7f80285aeb80 1 client.25520 shutdown 2024-05-08T05:53:41.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.573+0000 7f80285aeb80 1 -- 172.21.15.82:0/1589738878 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5617ce33d980 msgr2=0x5617ce3462d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:41.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.573+0000 7f80285aeb80 1 --2- 172.21.15.82:0/1589738878 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5617ce33d980 0x5617ce3462d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f800800b2f0 tx=0x7f80080a9b50 comp rx=0 tx=0).stop 2024-05-08T05:53:41.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.573+0000 7f80285aeb80 1 -- 172.21.15.82:0/1589738878 shutdown_connections 2024-05-08T05:53:41.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.573+0000 7f80285aeb80 1 --2- 172.21.15.82:0/1589738878 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x5617ce356b10 0x5617ce358f90 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:41.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.573+0000 7f80285aeb80 1 --2- 172.21.15.82:0/1589738878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5617ce3419d0 0x5617ce346810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:41.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.573+0000 7f80285aeb80 1 --2- 172.21.15.82:0/1589738878 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617ce33d060 0x5617ce348f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:41.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.573+0000 7f80285aeb80 1 --2- 172.21.15.82:0/1589738878 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5617ce33d980 0x5617ce3462d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:41.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.573+0000 7f80285aeb80 1 -- 172.21.15.82:0/1589738878 >> 172.21.15.82:0/1589738878 conn(0x5617ce26bb60 msgr2=0x5617ce3322b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:53:41.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.573+0000 7f8000c00700 0 client.25520 ms_handle_reset on v2:172.21.15.151:6836/4192404464 2024-05-08T05:53:41.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.574+0000 7f80285aeb80 1 -- 172.21.15.82:0/1589738878 shutdown_connections 2024-05-08T05:53:41.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.574+0000 7f80285aeb80 1 -- 172.21.15.82:0/1589738878 wait complete. 2024-05-08T05:53:41.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.574+0000 7f80285aeb80 20 client.25520 trim_cache size 0 max 16384 2024-05-08T05:53:41.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.599+0000 7f80285aeb80 1 Processor -- start 2024-05-08T05:53:41.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.599+0000 7f80285aeb80 1 -- start start 2024-05-08T05:53:41.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.599+0000 7f80285aeb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617ce33d060 0x5617ce3469a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:41.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.599+0000 7f80285aeb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5617ce33d980 0x5617ce343f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:41.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.600+0000 7f80285aeb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5617ce3419d0 0x5617ce352c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:41.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.600+0000 7f80285aeb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f801811c980 con 0x5617ce33d060 2024-05-08T05:53:41.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.600+0000 7f80285aeb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f80181be470 con 0x5617ce33d980 2024-05-08T05:53:41.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.600+0000 7f80285aeb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f801811d050 con 0x5617ce3419d0 2024-05-08T05:53:41.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.600+0000 7f8016000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5617ce33d980 0x5617ce343f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:41.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.600+0000 7f8017400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5617ce3419d0 0x5617ce352c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:41.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.600+0000 7f8016000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5617ce33d980 0x5617ce343f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:44980/0 (socket says 172.21.15.82:44980) 2024-05-08T05:53:41.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.600+0000 7f8016000700 1 -- 172.21.15.82:0/2959966712 learned_addr learned my addr 172.21.15.82:0/2959966712 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:53:41.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.600+0000 7f8017400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5617ce3419d0 0x5617ce352c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:37680/0 (socket says 172.21.15.82:37680) 2024-05-08T05:53:41.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.600+0000 7f8016000700 1 -- 172.21.15.82:0/2959966712 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5617ce3419d0 msgr2=0x5617ce352c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:53:41.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.600+0000 7f8016000700 1 --2- 172.21.15.82:0/2959966712 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5617ce3419d0 0x5617ce352c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:41.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.600+0000 7f8016000700 1 -- 172.21.15.82:0/2959966712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617ce33d060 msgr2=0x5617ce3469a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:53:41.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.600+0000 7f8016a00700 1 --2- 172.21.15.82:0/2959966712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617ce33d060 0x5617ce3469a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:41.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.600+0000 7f8016000700 1 --2- 172.21.15.82:0/2959966712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617ce33d060 0x5617ce3469a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:41.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.601+0000 7f8016000700 1 -- 172.21.15.82:0/2959966712 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5617ce342190 con 0x5617ce33d980 2024-05-08T05:53:41.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.601+0000 7f8016000700 1 --2- 172.21.15.82:0/2959966712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5617ce33d980 0x5617ce343f30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f80080a8ad0 tx=0x7f8008005910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d4172bef2a5550f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:53:41.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.601+0000 7f8003400700 1 -- 172.21.15.82:0/2959966712 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8008088070 con 0x5617ce33d980 2024-05-08T05:53:41.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.601+0000 7f8003400700 1 -- 172.21.15.82:0/2959966712 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80080b2230 con 0x5617ce33d980 2024-05-08T05:53:41.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.601+0000 7f8003400700 1 -- 172.21.15.82:0/2959966712 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8008020030 con 0x5617ce33d980 2024-05-08T05:53:41.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.602+0000 7f80285aeb80 1 -- 172.21.15.82:0/2959966712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5617ce33d980 msgr2=0x5617ce343f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:41.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.602+0000 7f80285aeb80 1 --2- 172.21.15.82:0/2959966712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5617ce33d980 0x5617ce343f30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f80080a8ad0 tx=0x7f8008005910 comp rx=0 tx=0).stop 2024-05-08T05:53:41.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.603+0000 7f80285aeb80 1 -- 172.21.15.82:0/2959966712 shutdown_connections 2024-05-08T05:53:41.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.603+0000 7f80285aeb80 1 --2- 172.21.15.82:0/2959966712 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5617ce3419d0 0x5617ce352c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:41.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.603+0000 7f80285aeb80 1 --2- 172.21.15.82:0/2959966712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617ce33d060 0x5617ce3469a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:41.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.603+0000 7f80285aeb80 1 --2- 172.21.15.82:0/2959966712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5617ce33d980 0x5617ce343f30 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:41.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.603+0000 7f80285aeb80 1 -- 172.21.15.82:0/2959966712 >> 172.21.15.82:0/2959966712 conn(0x5617ce26bb60 msgr2=0x5617ce346290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:53:41.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.603+0000 7f80285aeb80 1 -- 172.21.15.82:0/2959966712 shutdown_connections 2024-05-08T05:53:41.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.603+0000 7f80285aeb80 1 -- 172.21.15.82:0/2959966712 wait complete. 2024-05-08T05:53:41.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.604+0000 7f80285aeb80 1 -- start start 2024-05-08T05:53:41.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.604+0000 7f80285aeb80 1 Processor -- start 2024-05-08T05:53:41.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.605+0000 7f80285aeb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617ce33d060 0x5617ce34ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:41.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.606+0000 7f80285aeb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5617ce33d980 0x5617ce34f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:41.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.606+0000 7f80285aeb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5617ce3419d0 0x5617ce34bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:41.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.607+0000 7f80285aeb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f80181bdda0 con 0x5617ce33d060 2024-05-08T05:53:41.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.607+0000 7f8017400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5617ce3419d0 0x5617ce34bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:41.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.607+0000 7f8016000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5617ce33d980 0x5617ce34f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:41.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.607+0000 7f8016000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5617ce33d980 0x5617ce34f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:44988/0 (socket says 172.21.15.82:44988) 2024-05-08T05:53:41.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.607+0000 7f8016000700 1 -- 172.21.15.82:0/3952480505 learned_addr learned my addr 172.21.15.82:0/3952480505 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:53:41.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.607+0000 7f80285aeb80 1 -- 172.21.15.82:0/3952480505 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f801811d720 con 0x5617ce33d980 2024-05-08T05:53:41.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.607+0000 7f80285aeb80 1 -- 172.21.15.82:0/3952480505 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f801811a920 con 0x5617ce3419d0 2024-05-08T05:53:41.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.607+0000 7f80285aeb80 10 client.0 _ll_register_callbacks cb 0x5617ce236c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:53:41.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.607+0000 7f8016a00700 1 --2- 172.21.15.82:0/3952480505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617ce33d060 0x5617ce34ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:41.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.608+0000 7f8016000700 1 -- 172.21.15.82:0/3952480505 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5617ce3419d0 msgr2=0x5617ce34bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:53:41.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.608+0000 7f8016000700 1 --2- 172.21.15.82:0/3952480505 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5617ce3419d0 0x5617ce34bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:41.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.608+0000 7f8016000700 1 -- 172.21.15.82:0/3952480505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617ce33d060 msgr2=0x5617ce34ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:53:41.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.608+0000 7f8016000700 1 --2- 172.21.15.82:0/3952480505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617ce33d060 0x5617ce34ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:41.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.608+0000 7f8016000700 1 -- 172.21.15.82:0/3952480505 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5617ce34c4a0 con 0x5617ce33d980 2024-05-08T05:53:41.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.608+0000 7f8017400700 1 --2- 172.21.15.82:0/3952480505 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5617ce3419d0 0x5617ce34bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:53:41.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.608+0000 7f8016a00700 1 --2- 172.21.15.82:0/3952480505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617ce33d060 0x5617ce34ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:53:41.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.608+0000 7f8000c00700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:53:41.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.608+0000 7f8016000700 1 --2- 172.21.15.82:0/3952480505 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5617ce33d980 0x5617ce34f4d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f80080a6640 tx=0x7f80080a9b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fd905e5e2c22175 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:53:41.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.608+0000 7f8000c00700 1 -- 172.21.15.82:0/3952480505 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8008088070 con 0x5617ce33d980 2024-05-08T05:53:41.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.609+0000 7f8000c00700 1 -- 172.21.15.82:0/3952480505 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f80080a87e0 con 0x5617ce33d980 2024-05-08T05:53:41.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.609+0000 7f80285aeb80 1 -- 172.21.15.82:0/3952480505 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f80080b2230 con 0x5617ce33d980 2024-05-08T05:53:41.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.609+0000 7f8000c00700 1 -- 172.21.15.82:0/3952480505 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f8008020070 con 0x5617ce33d980 2024-05-08T05:53:41.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.609+0000 7f80285aeb80 10 client.25526 fetch_fsmap learned FSMap version 31 2024-05-08T05:53:41.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.609+0000 7f80285aeb80 1 -- 172.21.15.82:0/3952480505 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5617ce3c1c00 con 0x5617ce33d980 2024-05-08T05:53:41.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.609+0000 7f8000c00700 1 -- 172.21.15.82:0/3952480505 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f80080b2230 con 0x5617ce33d980 2024-05-08T05:53:41.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.610+0000 7f8000c00700 1 -- 172.21.15.82:0/3952480505 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f80080a4dc0 con 0x5617ce33d980 2024-05-08T05:53:41.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.610+0000 7f80285aeb80 10 client.25526 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:53:41.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.610+0000 7f80285aeb80 10 client.25526 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-05-08T05:53:41.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.610+0000 7f80285aeb80 20 client.25526 populate_metadata read hostname 'smithi082' 2024-05-08T05:53:41.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.610+0000 7f80285aeb80 1 --2- 172.21.15.82:0/3952480505 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x5617ce3c2070 0x5617ce3c4490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:41.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.610+0000 7f80285aeb80 4 client.25526 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:53:41.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.610+0000 7f80285aeb80 1 -- 172.21.15.82:0/3952480505 --> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5617ce29d400 con 0x5617ce3c2070 2024-05-08T05:53:41.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.611+0000 7f8016a00700 1 --2- 172.21.15.82:0/3952480505 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x5617ce3c2070 0x5617ce3c4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:41.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.611+0000 7f8016a00700 1 --2- 172.21.15.82:0/3952480505 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x5617ce3c2070 0x5617ce3c4490 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1d592f571f01d58d server_cookie=6002b03ba0f70e6d in_seq=0 out_seq=0 2024-05-08T05:53:41.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.611+0000 7f8000c00700 10 client.25526 ms_handle_connect on v2:172.21.15.151:6836/4192404464 2024-05-08T05:53:41.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.611+0000 7f8000c00700 1 -- 172.21.15.82:0/3952480505 <== mds.2 v2:172.21.15.151:6836/4192404464 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5617ce29d400 con 0x5617ce3c2070 2024-05-08T05:53:41.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.611+0000 7f8000c00700 10 client.25526 handle_command_reply: tid=0 2024-05-08T05:53:41.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.611+0000 7f80285aeb80 1 client.25526 shutdown 2024-05-08T05:53:41.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.612+0000 7f80285aeb80 1 -- 172.21.15.82:0/3952480505 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5617ce33d980 msgr2=0x5617ce34f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:41.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.612+0000 7f80285aeb80 1 --2- 172.21.15.82:0/3952480505 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5617ce33d980 0x5617ce34f4d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f80080a6640 tx=0x7f80080a9b50 comp rx=0 tx=0).stop 2024-05-08T05:53:41.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.612+0000 7f80285aeb80 1 -- 172.21.15.82:0/3952480505 shutdown_connections 2024-05-08T05:53:41.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.612+0000 7f80285aeb80 1 --2- 172.21.15.82:0/3952480505 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x5617ce3c2070 0x5617ce3c4490 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:41.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.612+0000 7f80285aeb80 1 --2- 172.21.15.82:0/3952480505 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5617ce3419d0 0x5617ce34bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:41.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.612+0000 7f80285aeb80 1 --2- 172.21.15.82:0/3952480505 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5617ce33d060 0x5617ce34ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:41.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.612+0000 7f80285aeb80 1 --2- 172.21.15.82:0/3952480505 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5617ce33d980 0x5617ce34f4d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:41.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.612+0000 7f80285aeb80 1 -- 172.21.15.82:0/3952480505 >> 172.21.15.82:0/3952480505 conn(0x5617ce26bb60 msgr2=0x5617ce331a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:53:41.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.612+0000 7f8000c00700 0 client.25526 ms_handle_reset on v2:172.21.15.151:6836/4192404464 2024-05-08T05:53:41.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.612+0000 7f80285aeb80 1 -- 172.21.15.82:0/3952480505 shutdown_connections 2024-05-08T05:53:41.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.613+0000 7f80285aeb80 1 -- 172.21.15.82:0/3952480505 wait complete. 2024-05-08T05:53:41.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.613+0000 7f80285aeb80 20 client.25526 trim_cache size 0 max 16384 2024-05-08T05:53:41.615 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T05:53:41.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.614+0000 7f801dc00700 1 -- 172.21.15.82:0/4101962115 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7ffc0b29c0 msgr2=0x7f7ffc0b4e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:41.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.614+0000 7f801dc00700 1 --2- 172.21.15.82:0/4101962115 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7ffc0b29c0 0x7f7ffc0b4e80 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8010021000 tx=0x7f8010023000 comp rx=0 tx=0).stop 2024-05-08T05:53:41.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.614+0000 7f801dc00700 1 -- 172.21.15.82:0/4101962115 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f80181060a0 msgr2=0x7f8018110860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:41.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.614+0000 7f801dc00700 1 --2- 172.21.15.82:0/4101962115 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f80181060a0 0x7f8018110860 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f800800d950 tx=0x7f800800dc60 comp rx=0 tx=0).stop 2024-05-08T05:53:41.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.615+0000 7f801dc00700 1 -- 172.21.15.82:0/4101962115 shutdown_connections 2024-05-08T05:53:41.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.615+0000 7f801dc00700 1 --2- 172.21.15.82:0/4101962115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f801810b6e0 0x7f8018111ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:41.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.615+0000 7f801dc00700 1 --2- 172.21.15.82:0/4101962115 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7ffc0b29c0 0x7f7ffc0b4e80 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:41.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.615+0000 7f801dc00700 1 --2- 172.21.15.82:0/4101962115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f80181056e0 0x7f8018110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:41.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.615+0000 7f801dc00700 1 --2- 172.21.15.82:0/4101962115 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f80181060a0 0x7f8018110860 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:41.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.615+0000 7f801dc00700 1 -- 172.21.15.82:0/4101962115 >> 172.21.15.82:0/4101962115 conn(0x7f80181011d0 msgr2=0x7f80181017d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:53:41.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.615+0000 7f801dc00700 1 -- 172.21.15.82:0/4101962115 shutdown_connections 2024-05-08T05:53:41.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:41.615+0000 7f801dc00700 1 -- 172.21.15.82:0/4101962115 wait complete. 2024-05-08T05:53:41.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:53:41 smithi151 ceph-mon[34815]: pgmap v550: 97 pgs: 97 active+clean; 1.1 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.6 MiB/s wr, 808 op/s 2024-05-08T05:53:41.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:53:41 smithi134 ceph-mon[34132]: pgmap v550: 97 pgs: 97 active+clean; 1.1 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.6 MiB/s wr, 808 op/s 2024-05-08T05:53:42.573 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-05-08T05:53:43.180 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:53:43.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:53:43 smithi151 ceph-mon[34815]: pgmap v551: 97 pgs: 97 active+clean; 1.1 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.4 MiB/s wr, 650 op/s 2024-05-08T05:53:43.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:53:43 smithi082 ceph-mon[30098]: pgmap v551: 97 pgs: 97 active+clean; 1.1 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.4 MiB/s wr, 650 op/s 2024-05-08T05:53:43.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:53:43 smithi134 ceph-mon[34132]: pgmap v551: 97 pgs: 97 active+clean; 1.1 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.4 MiB/s wr, 650 op/s 2024-05-08T05:53:45.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 175.0 s, 2850.7 tps, lat 34.971 ms stddev 40.630 2024-05-08T05:53:45.585 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:53:45 smithi082 ceph-mon[30098]: pgmap v552: 97 pgs: 97 active+clean; 1.1 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.8 MiB/s wr, 690 op/s 2024-05-08T05:53:45.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:53:45 smithi134 ceph-mon[34132]: pgmap v552: 97 pgs: 97 active+clean; 1.1 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.8 MiB/s wr, 690 op/s 2024-05-08T05:53:45.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:53:45 smithi151 ceph-mon[34815]: pgmap v552: 97 pgs: 97 active+clean; 1.1 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.8 MiB/s wr, 690 op/s 2024-05-08T05:53:46.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.255+0000 7f2b66a00700 1 -- 172.21.15.82:0/3626972942 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b6006bb40 msgr2=0x7f2b60110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:46.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.255+0000 7f2b66a00700 1 --2- 172.21.15.82:0/3626972942 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b6006bb40 0x7f2b60110330 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c009990 tx=0x7f2b4c009ca0 comp rx=0 tx=0).stop 2024-05-08T05:53:46.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.255+0000 7f2b66a00700 1 -- 172.21.15.82:0/3626972942 shutdown_connections 2024-05-08T05:53:46.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.255+0000 7f2b66a00700 1 --2- 172.21.15.82:0/3626972942 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b6006bb40 0x7f2b60110330 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:46.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.255+0000 7f2b66a00700 1 --2- 172.21.15.82:0/3626972942 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2b60109510 0x7f2b601098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:46.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.255+0000 7f2b66a00700 1 --2- 172.21.15.82:0/3626972942 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b6006b180 0x7f2b6006b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:46.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.255+0000 7f2b66a00700 1 -- 172.21.15.82:0/3626972942 >> 172.21.15.82:0/3626972942 conn(0x7f2b60079350 msgr2=0x7f2b60079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:53:46.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.256+0000 7f2b66a00700 1 -- 172.21.15.82:0/3626972942 shutdown_connections 2024-05-08T05:53:46.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.256+0000 7f2b66a00700 1 -- 172.21.15.82:0/3626972942 wait complete. 2024-05-08T05:53:46.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.258+0000 7f2b66a00700 1 Processor -- start 2024-05-08T05:53:46.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.258+0000 7f2b66a00700 1 -- start start 2024-05-08T05:53:46.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.261+0000 7f2b66a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b6006b180 0x7f2b6019be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:46.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.261+0000 7f2b66a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2b6006bb40 0x7f2b6019c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:46.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.261+0000 7f2b66a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b60109510 0x7f2b601a0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:46.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.261+0000 7f2b66a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2b60113720 con 0x7f2b6006b180 2024-05-08T05:53:46.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.261+0000 7f2b66a00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2b601135a0 con 0x7f2b60109510 2024-05-08T05:53:46.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.261+0000 7f2b66a00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2b601138a0 con 0x7f2b6006bb40 2024-05-08T05:53:46.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.262+0000 7f2b5f400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2b6006bb40 0x7f2b6019c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:46.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.262+0000 7f2b5f400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2b6006bb40 0x7f2b6019c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:58736/0 (socket says 172.21.15.82:58736) 2024-05-08T05:53:46.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.262+0000 7f2b5f400700 1 -- 172.21.15.82:0/307820966 learned_addr learned my addr 172.21.15.82:0/307820966 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:53:46.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.262+0000 7f2b5fe00700 1 --2- 172.21.15.82:0/307820966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b6006b180 0x7f2b6019be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:46.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.262+0000 7f2b64a00700 1 --2- 172.21.15.82:0/307820966 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b60109510 0x7f2b601a0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:46.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.263+0000 7f2b64a00700 1 -- 172.21.15.82:0/307820966 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2b6006bb40 msgr2=0x7f2b6019c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:46.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.263+0000 7f2b64a00700 1 --2- 172.21.15.82:0/307820966 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2b6006bb40 0x7f2b6019c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:46.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.263+0000 7f2b64a00700 1 -- 172.21.15.82:0/307820966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b6006b180 msgr2=0x7f2b6019be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:46.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.263+0000 7f2b64a00700 1 --2- 172.21.15.82:0/307820966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b6006b180 0x7f2b6019be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:46.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.263+0000 7f2b64a00700 1 -- 172.21.15.82:0/307820966 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b601a0e60 con 0x7f2b60109510 2024-05-08T05:53:46.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.263+0000 7f2b64a00700 1 --2- 172.21.15.82:0/307820966 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b60109510 0x7f2b601a0720 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c00b5c0 tx=0x7f2b4c0037c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:53:46.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.263+0000 7f2b5cc00700 1 -- 172.21.15.82:0/307820966 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b4c027070 con 0x7f2b60109510 2024-05-08T05:53:46.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.264+0000 7f2b5cc00700 1 -- 172.21.15.82:0/307820966 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b4c003f20 con 0x7f2b60109510 2024-05-08T05:53:46.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.264+0000 7f2b5cc00700 1 -- 172.21.15.82:0/307820966 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b4c022cb0 con 0x7f2b60109510 2024-05-08T05:53:46.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.264+0000 7f2b66a00700 1 -- 172.21.15.82:0/307820966 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b601a10f0 con 0x7f2b60109510 2024-05-08T05:53:46.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.264+0000 7f2b66a00700 1 -- 172.21.15.82:0/307820966 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b6010a270 con 0x7f2b60109510 2024-05-08T05:53:46.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.271+0000 7f2b5cc00700 1 -- 172.21.15.82:0/307820966 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f2b4c02a070 con 0x7f2b60109510 2024-05-08T05:53:46.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.273+0000 7f2b712acb80 1 Processor -- start 2024-05-08T05:53:46.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.274+0000 7f2b5cc00700 1 --2- 172.21.15.82:0/307820966 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2b440b2980 0x7f2b440b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:46.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.275+0000 7f2b5cc00700 1 -- 172.21.15.82:0/307820966 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2b4c0e3160 con 0x7f2b60109510 2024-05-08T05:53:46.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.275+0000 7f2b712acb80 1 -- start start 2024-05-08T05:53:46.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.276+0000 7f2b5f400700 1 --2- 172.21.15.82:0/307820966 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2b440b2980 0x7f2b440b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:46.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.276+0000 7f2b712acb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b1483cbc0 0x564b1483cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:46.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.276+0000 7f2b712acb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b1483d4e0 0x564b148372d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:46.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.276+0000 7f2b712acb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b148378f0 0x564b14837d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:46.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.276+0000 7f2b712acb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x564b14789a20 con 0x564b1483cbc0 2024-05-08T05:53:46.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.276+0000 7f2b712acb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564b14727760 con 0x564b148378f0 2024-05-08T05:53:46.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.276+0000 7f2b712acb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564b147859e0 con 0x564b1483d4e0 2024-05-08T05:53:46.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.276+0000 7f2b5f400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b1483d4e0 0x564b148372d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:46.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.276+0000 7f2b5f400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b1483d4e0 0x564b148372d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:58738/0 (socket says 172.21.15.82:58738) 2024-05-08T05:53:46.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.276+0000 7f2b5f400700 1 -- 172.21.15.82:0/248861949 learned_addr learned my addr 172.21.15.82:0/248861949 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:53:46.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.276+0000 7f2b64a00700 1 --2- 172.21.15.82:0/248861949 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b148378f0 0x564b14837d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:46.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.277+0000 7f2b5f400700 1 -- 172.21.15.82:0/248861949 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b148378f0 msgr2=0x564b14837d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:53:46.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.277+0000 7f2b5f400700 1 --2- 172.21.15.82:0/248861949 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b148378f0 0x564b14837d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:46.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.277+0000 7f2b5f400700 1 -- 172.21.15.82:0/248861949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b1483cbc0 msgr2=0x564b1483cfa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T05:53:46.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.277+0000 7f2b5fe00700 1 --2- 172.21.15.82:0/248861949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b1483cbc0 0x564b1483cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:46.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.278+0000 7f2b5f400700 1 --2- 172.21.15.82:0/248861949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b1483cbc0 0x564b1483cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:46.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.278+0000 7f2b5f400700 1 -- 172.21.15.82:0/248861949 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b146d68d0 con 0x564b1483d4e0 2024-05-08T05:53:46.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.278+0000 7f2b5fe00700 1 --2- 172.21.15.82:0/248861949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b1483cbc0 0x564b1483cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:53:46.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.278+0000 7f2b5f400700 1 --2- 172.21.15.82:0/307820966 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2b440b2980 0x7f2b440b4e40 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2b50009fd0 tx=0x7f2b50009f60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:53:46.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.278+0000 7f2b5f400700 1 --2- 172.21.15.82:0/248861949 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b1483d4e0 0x564b148372d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2b50017c10 tx=0x7f2b50004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3367afe7eafd4917 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:53:46.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.279+0000 7f2b55600700 1 -- 172.21.15.82:0/248861949 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b50027070 con 0x564b1483d4e0 2024-05-08T05:53:46.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.279+0000 7f2b55600700 1 -- 172.21.15.82:0/248861949 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b5001e030 con 0x564b1483d4e0 2024-05-08T05:53:46.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.279+0000 7f2b55600700 1 -- 172.21.15.82:0/248861949 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b50027070 con 0x564b1483d4e0 2024-05-08T05:53:46.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.280+0000 7f2b712acb80 1 -- 172.21.15.82:0/248861949 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b1483d4e0 msgr2=0x564b148372d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:46.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.280+0000 7f2b712acb80 1 --2- 172.21.15.82:0/248861949 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b1483d4e0 0x564b148372d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2b50017c10 tx=0x7f2b50004ad0 comp rx=0 tx=0).stop 2024-05-08T05:53:46.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.281+0000 7f2b712acb80 1 -- 172.21.15.82:0/248861949 shutdown_connections 2024-05-08T05:53:46.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.281+0000 7f2b712acb80 1 --2- 172.21.15.82:0/248861949 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b148378f0 0x564b14837d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:46.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.281+0000 7f2b712acb80 1 --2- 172.21.15.82:0/248861949 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b1483cbc0 0x564b1483cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:46.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.281+0000 7f2b712acb80 1 --2- 172.21.15.82:0/248861949 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b1483d4e0 0x564b148372d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:46.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.281+0000 7f2b712acb80 1 -- 172.21.15.82:0/248861949 >> 172.21.15.82:0/248861949 conn(0x564b147af6d0 msgr2=0x564b14831b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:53:46.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.282+0000 7f2b712acb80 1 -- 172.21.15.82:0/248861949 shutdown_connections 2024-05-08T05:53:46.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.282+0000 7f2b712acb80 1 -- 172.21.15.82:0/248861949 wait complete. 2024-05-08T05:53:46.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.283+0000 7f2b712acb80 1 -- start start 2024-05-08T05:53:46.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.283+0000 7f2b712acb80 1 Processor -- start 2024-05-08T05:53:46.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.285+0000 7f2b712acb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b148378f0 0x564b148431c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:46.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.285+0000 7f2b712acb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b1483cbc0 0x564b14840560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:46.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.285+0000 7f2b712acb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b1483d4e0 0x564b14840aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:46.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.285+0000 7f2b712acb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x564b14843ec0 con 0x564b148378f0 2024-05-08T05:53:46.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.285+0000 7f2b712acb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564b146efb20 con 0x564b1483d4e0 2024-05-08T05:53:46.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.286+0000 7f2b712acb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564b14844040 con 0x564b1483cbc0 2024-05-08T05:53:46.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.286+0000 7f2b64a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b1483d4e0 0x564b14840aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:46.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.286+0000 7f2b64a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b1483d4e0 0x564b14840aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:52988/0 (socket says 172.21.15.82:52988) 2024-05-08T05:53:46.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.286+0000 7f2b64a00700 1 -- 172.21.15.82:0/581609474 learned_addr learned my addr 172.21.15.82:0/581609474 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:53:46.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.286+0000 7f2b712acb80 10 client.0 _ll_register_callbacks cb 0x564b14730c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:53:46.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.286+0000 7f2b64a00700 1 -- 172.21.15.82:0/581609474 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b1483cbc0 msgr2=0x564b14840560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T05:53:46.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.286+0000 7f2b64a00700 1 --2- 172.21.15.82:0/581609474 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b1483cbc0 0x564b14840560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:46.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.286+0000 7f2b64a00700 1 -- 172.21.15.82:0/581609474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b148378f0 msgr2=0x564b148431c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T05:53:46.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.287+0000 7f2b5fe00700 1 --2- 172.21.15.82:0/581609474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b148378f0 0x564b148431c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:46.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.287+0000 7f2b64a00700 1 --2- 172.21.15.82:0/581609474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b148378f0 0x564b148431c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:46.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.287+0000 7f2b64a00700 1 -- 172.21.15.82:0/581609474 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b1474f420 con 0x564b1483d4e0 2024-05-08T05:53:46.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.287+0000 7f2b4a000700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:53:46.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.287+0000 7f2b64a00700 1 --2- 172.21.15.82:0/581609474 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b1483d4e0 0x564b14840aa0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c005b40 tx=0x7f2b4c022750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33eb8e660bf6140a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:53:46.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.287+0000 7f2b4a000700 1 -- 172.21.15.82:0/581609474 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b4c0b1e60 con 0x564b1483d4e0 2024-05-08T05:53:46.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.288+0000 7f2b4a000700 1 -- 172.21.15.82:0/581609474 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2b4c0b3100 con 0x564b1483d4e0 2024-05-08T05:53:46.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.288+0000 7f2b712acb80 1 -- 172.21.15.82:0/581609474 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b5001e030 con 0x564b1483d4e0 2024-05-08T05:53:46.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.288+0000 7f2b4a000700 1 -- 172.21.15.82:0/581609474 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f2b4c0aa2d0 con 0x564b1483d4e0 2024-05-08T05:53:46.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.288+0000 7f2b712acb80 10 client.25538 fetch_fsmap learned FSMap version 31 2024-05-08T05:53:46.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.289+0000 7f2b712acb80 1 -- 172.21.15.82:0/581609474 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x564b1484e690 con 0x564b1483d4e0 2024-05-08T05:53:46.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.289+0000 7f2b4a000700 1 -- 172.21.15.82:0/581609474 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b5001e030 con 0x564b1483d4e0 2024-05-08T05:53:46.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.289+0000 7f2b4a000700 1 -- 172.21.15.82:0/581609474 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f2b4c0bfb80 con 0x564b1483d4e0 2024-05-08T05:53:46.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.289+0000 7f2b712acb80 10 client.25538 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:53:46.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.289+0000 7f2b712acb80 10 client.25538 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-08T05:53:46.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.289+0000 7f2b712acb80 20 client.25538 populate_metadata read hostname 'smithi082' 2024-05-08T05:53:46.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.289+0000 7f2b712acb80 1 --2- 172.21.15.82:0/581609474 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x564b14850c00 0x564b148530c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:46.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.290+0000 7f2b712acb80 4 client.25538 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:53:46.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.290+0000 7f2b712acb80 1 -- 172.21.15.82:0/581609474 --> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564b14804140 con 0x564b14850c00 2024-05-08T05:53:46.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.290+0000 7f2b5fe00700 1 --2- 172.21.15.82:0/581609474 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x564b14850c00 0x564b148530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:46.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.291+0000 7f2b4a000700 10 client.25538 ms_handle_connect on v2:172.21.15.151:6838/2963754236 2024-05-08T05:53:46.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.291+0000 7f2b5fe00700 1 --2- 172.21.15.82:0/581609474 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x564b14850c00 0x564b148530c0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e07d730d1626a12a server_cookie=d4515dc482841293 in_seq=0 out_seq=0 2024-05-08T05:53:46.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.291+0000 7f2b4a000700 1 -- 172.21.15.82:0/581609474 <== mds.1 v2:172.21.15.151:6838/2963754236 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564b14804140 con 0x564b14850c00 2024-05-08T05:53:46.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.291+0000 7f2b4a000700 10 client.25538 handle_command_reply: tid=0 2024-05-08T05:53:46.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.292+0000 7f2b712acb80 1 client.25538 shutdown 2024-05-08T05:53:46.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.292+0000 7f2b712acb80 1 -- 172.21.15.82:0/581609474 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b1483d4e0 msgr2=0x564b14840aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:46.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.292+0000 7f2b712acb80 1 --2- 172.21.15.82:0/581609474 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b1483d4e0 0x564b14840aa0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c005b40 tx=0x7f2b4c022750 comp rx=0 tx=0).stop 2024-05-08T05:53:46.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.293+0000 7f2b712acb80 1 -- 172.21.15.82:0/581609474 shutdown_connections 2024-05-08T05:53:46.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.293+0000 7f2b712acb80 1 --2- 172.21.15.82:0/581609474 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x564b14850c00 0x564b148530c0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:46.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.293+0000 7f2b712acb80 1 --2- 172.21.15.82:0/581609474 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b1483d4e0 0x564b14840aa0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:46.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.293+0000 7f2b712acb80 1 --2- 172.21.15.82:0/581609474 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b148378f0 0x564b148431c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:46.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.293+0000 7f2b712acb80 1 --2- 172.21.15.82:0/581609474 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b1483cbc0 0x564b14840560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:46.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.293+0000 7f2b712acb80 1 -- 172.21.15.82:0/581609474 >> 172.21.15.82:0/581609474 conn(0x564b147af6d0 msgr2=0x564b14831190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:53:46.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.293+0000 7f2b4a000700 0 client.25538 ms_handle_reset on v2:172.21.15.151:6838/2963754236 2024-05-08T05:53:46.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.293+0000 7f2b712acb80 1 -- 172.21.15.82:0/581609474 shutdown_connections 2024-05-08T05:53:46.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.293+0000 7f2b712acb80 1 -- 172.21.15.82:0/581609474 wait complete. 2024-05-08T05:53:46.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.293+0000 7f2b712acb80 20 client.25538 trim_cache size 0 max 16384 2024-05-08T05:53:46.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.319+0000 7f2b712acb80 1 Processor -- start 2024-05-08T05:53:46.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.319+0000 7f2b712acb80 1 -- start start 2024-05-08T05:53:46.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.319+0000 7f2b712acb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b148378f0 0x564b148372d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:46.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.319+0000 7f2b712acb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b1483cbc0 0x564b1483ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:46.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.319+0000 7f2b712acb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b1483d4e0 0x564b1483e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:46.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.319+0000 7f2b712acb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2b601ab7c0 con 0x564b1483cbc0 2024-05-08T05:53:46.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.319+0000 7f2b712acb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2b601ad300 con 0x564b148378f0 2024-05-08T05:53:46.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.319+0000 7f2b712acb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2b601abe90 con 0x564b1483d4e0 2024-05-08T05:53:46.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.320+0000 7f2b5fe00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b148378f0 0x564b148372d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:46.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.320+0000 7f2b64a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b1483d4e0 0x564b1483e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:46.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.320+0000 7f2b5fe00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b148378f0 0x564b148372d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:53002/0 (socket says 172.21.15.82:53002) 2024-05-08T05:53:46.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.320+0000 7f2b5fe00700 1 -- 172.21.15.82:0/939310592 learned_addr learned my addr 172.21.15.82:0/939310592 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:53:46.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.320+0000 7f2b5f400700 1 --2- 172.21.15.82:0/939310592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b1483cbc0 0x564b1483ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:46.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.320+0000 7f2b5fe00700 1 -- 172.21.15.82:0/939310592 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b1483d4e0 msgr2=0x564b1483e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:53:46.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.320+0000 7f2b5fe00700 1 --2- 172.21.15.82:0/939310592 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b1483d4e0 0x564b1483e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:46.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.320+0000 7f2b5fe00700 1 -- 172.21.15.82:0/939310592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b1483cbc0 msgr2=0x564b1483ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:53:46.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.320+0000 7f2b5fe00700 1 --2- 172.21.15.82:0/939310592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b1483cbc0 0x564b1483ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:46.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.320+0000 7f2b5fe00700 1 -- 172.21.15.82:0/939310592 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b1483d1f0 con 0x564b148378f0 2024-05-08T05:53:46.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.321+0000 7f2b5fe00700 1 --2- 172.21.15.82:0/939310592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b148378f0 0x564b148372d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2b5801e6c0 tx=0x7f2b58011040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5eb62fd09b232d2a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:53:46.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.321+0000 7f2b54c00700 1 -- 172.21.15.82:0/939310592 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b58025030 con 0x564b148378f0 2024-05-08T05:53:46.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.321+0000 7f2b54c00700 1 -- 172.21.15.82:0/939310592 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b580217a0 con 0x564b148378f0 2024-05-08T05:53:46.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.322+0000 7f2b712acb80 1 -- 172.21.15.82:0/939310592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b148378f0 msgr2=0x564b148372d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:46.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.322+0000 7f2b712acb80 1 --2- 172.21.15.82:0/939310592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b148378f0 0x564b148372d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2b5801e6c0 tx=0x7f2b58011040 comp rx=0 tx=0).stop 2024-05-08T05:53:46.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.322+0000 7f2b54c00700 1 -- 172.21.15.82:0/939310592 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b5801fb50 con 0x564b148378f0 2024-05-08T05:53:46.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.323+0000 7f2b712acb80 1 -- 172.21.15.82:0/939310592 shutdown_connections 2024-05-08T05:53:46.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.323+0000 7f2b712acb80 1 --2- 172.21.15.82:0/939310592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b148378f0 0x564b148372d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:46.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.323+0000 7f2b712acb80 1 --2- 172.21.15.82:0/939310592 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b1483d4e0 0x564b1483e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:46.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.323+0000 7f2b712acb80 1 --2- 172.21.15.82:0/939310592 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b1483cbc0 0x564b1483ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:46.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.323+0000 7f2b712acb80 1 -- 172.21.15.82:0/939310592 >> 172.21.15.82:0/939310592 conn(0x564b147af6d0 msgr2=0x564b1483eeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:53:46.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.323+0000 7f2b712acb80 1 -- 172.21.15.82:0/939310592 shutdown_connections 2024-05-08T05:53:46.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.323+0000 7f2b712acb80 1 -- 172.21.15.82:0/939310592 wait complete. 2024-05-08T05:53:46.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.324+0000 7f2b712acb80 1 -- start start 2024-05-08T05:53:46.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.324+0000 7f2b712acb80 1 Processor -- start 2024-05-08T05:53:46.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.324+0000 7f2b712acb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b148378f0 0x564b14858580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:46.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.324+0000 7f2b712acb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b1483cbc0 0x564b14858ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:46.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.324+0000 7f2b712acb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b1483d4e0 0x564b148ba580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:46.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.324+0000 7f2b712acb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2b601acc30 con 0x564b148378f0 2024-05-08T05:53:46.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.324+0000 7f2b712acb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2b601ac560 con 0x564b1483d4e0 2024-05-08T05:53:46.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.324+0000 7f2b712acb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2b6010e220 con 0x564b1483cbc0 2024-05-08T05:53:46.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.325+0000 7f2b712acb80 10 client.0 _ll_register_callbacks cb 0x564b14730c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:53:46.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.325+0000 7f2b5f400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b1483cbc0 0x564b14858ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:46.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.325+0000 7f2b5f400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b1483cbc0 0x564b14858ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:58754/0 (socket says 172.21.15.82:58754) 2024-05-08T05:53:46.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.325+0000 7f2b5f400700 1 -- 172.21.15.82:0/4291008960 learned_addr learned my addr 172.21.15.82:0/4291008960 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:53:46.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.325+0000 7f2b5fe00700 1 --2- 172.21.15.82:0/4291008960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b148378f0 0x564b14858580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:46.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.325+0000 7f2b5f400700 1 -- 172.21.15.82:0/4291008960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b1483d4e0 msgr2=0x564b148ba580 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T05:53:46.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.325+0000 7f2b5f400700 1 --2- 172.21.15.82:0/4291008960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b1483d4e0 0x564b148ba580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:46.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.326+0000 7f2b5f400700 1 -- 172.21.15.82:0/4291008960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b148378f0 msgr2=0x564b14858580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:53:46.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.326+0000 7f2b5f400700 1 --2- 172.21.15.82:0/4291008960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b148378f0 0x564b14858580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:46.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.326+0000 7f2b5f400700 1 -- 172.21.15.82:0/4291008960 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b14843530 con 0x564b1483cbc0 2024-05-08T05:53:46.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.327+0000 7f2b5f400700 1 --2- 172.21.15.82:0/4291008960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b1483cbc0 0x564b14858ac0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2b5001f040 tx=0x7f2b500097a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b85473727fa679d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:53:46.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.327+0000 7f2b4a000700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:53:46.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.328+0000 7f2b4a000700 1 -- 172.21.15.82:0/4291008960 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b50027070 con 0x564b1483cbc0 2024-05-08T05:53:46.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.328+0000 7f2b712acb80 1 -- 172.21.15.82:0/4291008960 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b580217a0 con 0x564b1483cbc0 2024-05-08T05:53:46.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.329+0000 7f2b4a000700 1 -- 172.21.15.82:0/4291008960 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2b50013040 con 0x564b1483cbc0 2024-05-08T05:53:46.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.329+0000 7f2b4a000700 1 -- 172.21.15.82:0/4291008960 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f2b50027070 con 0x564b1483cbc0 2024-05-08T05:53:46.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.329+0000 7f2b712acb80 10 client.25567 fetch_fsmap learned FSMap version 31 2024-05-08T05:53:46.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.329+0000 7f2b712acb80 1 -- 172.21.15.82:0/4291008960 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x564b148bba50 con 0x564b1483cbc0 2024-05-08T05:53:46.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.329+0000 7f2b4a000700 1 -- 172.21.15.82:0/4291008960 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2b580217a0 con 0x564b1483cbc0 2024-05-08T05:53:46.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.330+0000 7f2b4a000700 1 -- 172.21.15.82:0/4291008960 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f2b5002da50 con 0x564b1483cbc0 2024-05-08T05:53:46.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.330+0000 7f2b712acb80 10 client.25567 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:53:46.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.330+0000 7f2b712acb80 10 client.25567 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-08T05:53:46.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.330+0000 7f2b712acb80 20 client.25567 populate_metadata read hostname 'smithi082' 2024-05-08T05:53:46.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.330+0000 7f2b712acb80 1 --2- 172.21.15.82:0/4291008960 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x564b148bbfc0 0x564b148be3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:46.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.330+0000 7f2b712acb80 4 client.25567 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:53:46.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.330+0000 7f2b712acb80 1 -- 172.21.15.82:0/4291008960 --> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564b14797400 con 0x564b148bbfc0 2024-05-08T05:53:46.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.331+0000 7f2b5fe00700 1 --2- 172.21.15.82:0/4291008960 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x564b148bbfc0 0x564b148be3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:46.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.332+0000 7f2b5fe00700 1 --2- 172.21.15.82:0/4291008960 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x564b148bbfc0 0x564b148be3e0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c7f5da111bab1983 server_cookie=df7413287d5eb8e7 in_seq=0 out_seq=0 2024-05-08T05:53:46.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.332+0000 7f2b4a000700 10 client.25567 ms_handle_connect on v2:172.21.15.151:6838/2963754236 2024-05-08T05:53:46.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.332+0000 7f2b4a000700 1 -- 172.21.15.82:0/4291008960 <== mds.1 v2:172.21.15.151:6838/2963754236 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564b14797400 con 0x564b148bbfc0 2024-05-08T05:53:46.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.332+0000 7f2b4a000700 10 client.25567 handle_command_reply: tid=0 2024-05-08T05:53:46.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.332+0000 7f2b712acb80 1 client.25567 shutdown 2024-05-08T05:53:46.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.333+0000 7f2b712acb80 1 -- 172.21.15.82:0/4291008960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b1483cbc0 msgr2=0x564b14858ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:46.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.333+0000 7f2b712acb80 1 --2- 172.21.15.82:0/4291008960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b1483cbc0 0x564b14858ac0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f2b5001f040 tx=0x7f2b500097a0 comp rx=0 tx=0).stop 2024-05-08T05:53:46.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.333+0000 7f2b712acb80 1 -- 172.21.15.82:0/4291008960 shutdown_connections 2024-05-08T05:53:46.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.333+0000 7f2b712acb80 1 --2- 172.21.15.82:0/4291008960 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x564b148bbfc0 0x564b148be3e0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:46.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.333+0000 7f2b712acb80 1 --2- 172.21.15.82:0/4291008960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b1483d4e0 0x564b148ba580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:46.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.333+0000 7f2b712acb80 1 --2- 172.21.15.82:0/4291008960 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b148378f0 0x564b14858580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:46.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.333+0000 7f2b712acb80 1 --2- 172.21.15.82:0/4291008960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b1483cbc0 0x564b14858ac0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:46.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.333+0000 7f2b712acb80 1 -- 172.21.15.82:0/4291008960 >> 172.21.15.82:0/4291008960 conn(0x564b147af6d0 msgr2=0x564b1483b740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:53:46.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.333+0000 7f2b4a000700 0 client.25567 ms_handle_reset on v2:172.21.15.151:6838/2963754236 2024-05-08T05:53:46.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.334+0000 7f2b712acb80 1 -- 172.21.15.82:0/4291008960 shutdown_connections 2024-05-08T05:53:46.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.334+0000 7f2b712acb80 1 -- 172.21.15.82:0/4291008960 wait complete. 2024-05-08T05:53:46.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.335+0000 7f2b712acb80 20 client.25567 trim_cache size 0 max 16384 2024-05-08T05:53:46.335 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T05:53:46.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.335+0000 7f2b66a00700 1 -- 172.21.15.82:0/307820966 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2b440b2980 msgr2=0x7f2b440b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:46.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.335+0000 7f2b66a00700 1 --2- 172.21.15.82:0/307820966 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2b440b2980 0x7f2b440b4e40 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2b50009fd0 tx=0x7f2b50009f60 comp rx=0 tx=0).stop 2024-05-08T05:53:46.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.335+0000 7f2b66a00700 1 -- 172.21.15.82:0/307820966 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b60109510 msgr2=0x7f2b601a0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:46.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.335+0000 7f2b66a00700 1 --2- 172.21.15.82:0/307820966 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b60109510 0x7f2b601a0720 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c00b5c0 tx=0x7f2b4c0037c0 comp rx=0 tx=0).stop 2024-05-08T05:53:46.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.336+0000 7f2b66a00700 1 -- 172.21.15.82:0/307820966 shutdown_connections 2024-05-08T05:53:46.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.336+0000 7f2b66a00700 1 --2- 172.21.15.82:0/307820966 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b60109510 0x7f2b601a0720 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:46.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.336+0000 7f2b66a00700 1 --2- 172.21.15.82:0/307820966 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2b440b2980 0x7f2b440b4e40 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:46.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.336+0000 7f2b66a00700 1 --2- 172.21.15.82:0/307820966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2b6006b180 0x7f2b6019be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:46.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.336+0000 7f2b66a00700 1 --2- 172.21.15.82:0/307820966 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2b6006bb40 0x7f2b6019c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:46.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.336+0000 7f2b66a00700 1 -- 172.21.15.82:0/307820966 >> 172.21.15.82:0/307820966 conn(0x7f2b60079350 msgr2=0x7f2b6010e680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:53:46.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.337+0000 7f2b66a00700 1 -- 172.21.15.82:0/307820966 shutdown_connections 2024-05-08T05:53:46.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:46.337+0000 7f2b66a00700 1 -- 172.21.15.82:0/307820966 wait complete. 2024-05-08T05:53:47.182 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-05-08T05:53:47.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:53:47 smithi082 ceph-mon[30098]: pgmap v553: 97 pgs: 97 active+clean; 1.1 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.5 MiB/s wr, 662 op/s 2024-05-08T05:53:47.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:53:47 smithi134 ceph-mon[34132]: pgmap v553: 97 pgs: 97 active+clean; 1.1 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.5 MiB/s wr, 662 op/s 2024-05-08T05:53:47.785 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:53:47.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:53:47 smithi151 ceph-mon[34815]: pgmap v553: 97 pgs: 97 active+clean; 1.1 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.5 MiB/s wr, 662 op/s 2024-05-08T05:53:49.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:53:49 smithi082 ceph-mon[30098]: pgmap v554: 97 pgs: 97 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.4 MiB/s wr, 648 op/s 2024-05-08T05:53:49.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:53:49 smithi134 ceph-mon[34132]: pgmap v554: 97 pgs: 97 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.4 MiB/s wr, 648 op/s 2024-05-08T05:53:49.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:53:49 smithi151 ceph-mon[34815]: pgmap v554: 97 pgs: 97 active+clean; 1.2 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.4 MiB/s wr, 648 op/s 2024-05-08T05:53:50.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 180.0 s, 2670.1 tps, lat 37.461 ms stddev 43.119 2024-05-08T05:53:50.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.745+0000 7f06abc00700 1 -- 172.21.15.82:0/1380932697 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06a410b6e0 msgr2=0x7f06a410bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:50.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.745+0000 7f06abc00700 1 --2- 172.21.15.82:0/1380932697 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06a410b6e0 0x7f06a410bac0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f068c009990 tx=0x7f068c009ca0 comp rx=0 tx=0).stop 2024-05-08T05:53:50.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.745+0000 7f06abc00700 1 -- 172.21.15.82:0/1380932697 shutdown_connections 2024-05-08T05:53:50.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.745+0000 7f06abc00700 1 --2- 172.21.15.82:0/1380932697 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06a410b6e0 0x7f06a410bac0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:50.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.745+0000 7f06abc00700 1 --2- 172.21.15.82:0/1380932697 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06a41060a0 0x7f06a41125b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:50.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.745+0000 7f06abc00700 1 --2- 172.21.15.82:0/1380932697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06a41056e0 0x7f06a4105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:50.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.745+0000 7f06abc00700 1 -- 172.21.15.82:0/1380932697 >> 172.21.15.82:0/1380932697 conn(0x7f06a41011d0 msgr2=0x7f06a41035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:53:50.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.745+0000 7f06abc00700 1 -- 172.21.15.82:0/1380932697 shutdown_connections 2024-05-08T05:53:50.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.745+0000 7f06abc00700 1 -- 172.21.15.82:0/1380932697 wait complete. 2024-05-08T05:53:50.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.746+0000 7f06abc00700 1 Processor -- start 2024-05-08T05:53:50.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.746+0000 7f06abc00700 1 -- start start 2024-05-08T05:53:50.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.747+0000 7f06abc00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06a41056e0 0x7f06a419bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:50.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.747+0000 7f06abc00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06a41060a0 0x7f06a419c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:50.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.747+0000 7f06abc00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06a410b6e0 0x7f06a41a0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:50.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.747+0000 7f06abc00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f06a4115920 con 0x7f06a41056e0 2024-05-08T05:53:50.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.747+0000 7f06abc00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f06a41157a0 con 0x7f06a410b6e0 2024-05-08T05:53:50.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.747+0000 7f06abc00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f06a4115aa0 con 0x7f06a41060a0 2024-05-08T05:53:50.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.747+0000 7f06a9c00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06a410b6e0 0x7f06a41a0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:50.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.747+0000 7f06a9c00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06a410b6e0 0x7f06a41a0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:53036/0 (socket says 172.21.15.82:53036) 2024-05-08T05:53:50.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.747+0000 7f06a9c00700 1 -- 172.21.15.82:0/1911878877 learned_addr learned my addr 172.21.15.82:0/1911878877 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:53:50.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.747+0000 7f06a9200700 1 --2- 172.21.15.82:0/1911878877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06a41056e0 0x7f06a419bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:50.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.748+0000 7f06a9c00700 1 -- 172.21.15.82:0/1911878877 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06a41060a0 msgr2=0x7f06a419c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:50.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.748+0000 7f069be00700 1 --2- 172.21.15.82:0/1911878877 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06a41060a0 0x7f06a419c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:50.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.748+0000 7f06a9c00700 1 --2- 172.21.15.82:0/1911878877 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06a41060a0 0x7f06a419c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:50.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.748+0000 7f06a9c00700 1 -- 172.21.15.82:0/1911878877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06a41056e0 msgr2=0x7f06a419bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:50.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.748+0000 7f06a9c00700 1 --2- 172.21.15.82:0/1911878877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06a41056e0 0x7f06a419bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:50.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.748+0000 7f06a9c00700 1 -- 172.21.15.82:0/1911878877 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06a41a0d40 con 0x7f06a410b6e0 2024-05-08T05:53:50.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.748+0000 7f06a9200700 1 --2- 172.21.15.82:0/1911878877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06a41056e0 0x7f06a419bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:53:50.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.748+0000 7f069be00700 1 --2- 172.21.15.82:0/1911878877 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06a41060a0 0x7f06a419c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:53:50.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.748+0000 7f06a9c00700 1 --2- 172.21.15.82:0/1911878877 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06a410b6e0 0x7f06a41a0600 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f069c007ee0 tx=0x7f069c00d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:53:50.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.748+0000 7f06a2000700 1 -- 172.21.15.82:0/1911878877 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f069c00ddd0 con 0x7f06a410b6e0 2024-05-08T05:53:50.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.748+0000 7f06a2000700 1 -- 172.21.15.82:0/1911878877 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f069c004020 con 0x7f06a410b6e0 2024-05-08T05:53:50.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.748+0000 7f06abc00700 1 -- 172.21.15.82:0/1911878877 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06a41a1030 con 0x7f06a410b6e0 2024-05-08T05:53:50.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.748+0000 7f06a2000700 1 -- 172.21.15.82:0/1911878877 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f069c015660 con 0x7f06a410b6e0 2024-05-08T05:53:50.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.749+0000 7f06abc00700 1 -- 172.21.15.82:0/1911878877 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06a41a88b0 con 0x7f06a410b6e0 2024-05-08T05:53:50.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.758+0000 7f06b651cb80 1 Processor -- start 2024-05-08T05:53:50.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.759+0000 7f06a2000700 1 -- 172.21.15.82:0/1911878877 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f069c0041d0 con 0x7f06a410b6e0 2024-05-08T05:53:50.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.760+0000 7f06b651cb80 1 -- start start 2024-05-08T05:53:50.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.760+0000 7f06b651cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab522eb2d0 0x55ab522eb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:50.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.761+0000 7f06b651cb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ab522e6ae0 0x55ab522e6f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:50.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.761+0000 7f06b651cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab522e74a0 0x55ab522f31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:50.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.761+0000 7f06b651cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55ab52230a20 con 0x55ab522e74a0 2024-05-08T05:53:50.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.761+0000 7f069be00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab522eb2d0 0x55ab522eb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:50.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.761+0000 7f069be00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab522eb2d0 0x55ab522eb6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:58782/0 (socket says 172.21.15.82:58782) 2024-05-08T05:53:50.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.761+0000 7f069be00700 1 -- 172.21.15.82:0/4227964416 learned_addr learned my addr 172.21.15.82:0/4227964416 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:53:50.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.761+0000 7f06b651cb80 1 -- 172.21.15.82:0/4227964416 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ab521ce760 con 0x55ab522e6ae0 2024-05-08T05:53:50.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.761+0000 7f06a9200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ab522e6ae0 0x55ab522e6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:50.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.761+0000 7f06b651cb80 1 -- 172.21.15.82:0/4227964416 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ab5222c9e0 con 0x55ab522eb2d0 2024-05-08T05:53:50.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.762+0000 7f06a9200700 1 -- 172.21.15.82:0/4227964416 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab522eb2d0 msgr2=0x55ab522eb6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:53:50.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.762+0000 7f06a9200700 1 --2- 172.21.15.82:0/4227964416 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab522eb2d0 0x55ab522eb6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:50.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.762+0000 7f06a9200700 1 -- 172.21.15.82:0/4227964416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab522e74a0 msgr2=0x55ab522f31f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T05:53:50.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.762+0000 7f06a9200700 1 --2- 172.21.15.82:0/4227964416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab522e74a0 0x55ab522f31f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:50.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.762+0000 7f06a9200700 1 -- 172.21.15.82:0/4227964416 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab5217d8d0 con 0x55ab522e6ae0 2024-05-08T05:53:50.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.762+0000 7f069be00700 1 --2- 172.21.15.82:0/4227964416 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab522eb2d0 0x55ab522eb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:53:50.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.762+0000 7f06a2000700 1 --2- 172.21.15.82:0/1911878877 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f06840b2900 0x7f06840b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:50.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.762+0000 7f06a2000700 1 -- 172.21.15.82:0/1911878877 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f069c0e1c90 con 0x7f06a410b6e0 2024-05-08T05:53:50.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.762+0000 7f06a9200700 1 --2- 172.21.15.82:0/4227964416 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ab522e6ae0 0x55ab522e6f60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f068c0098e0 tx=0x7f068c005c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f4555ada4e44708 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:53:50.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.763+0000 7f069a000700 1 -- 172.21.15.82:0/4227964416 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f068c00bd80 con 0x55ab522e6ae0 2024-05-08T05:53:50.763 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.763+0000 7f069a000700 1 -- 172.21.15.82:0/4227964416 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f068c026070 con 0x55ab522e6ae0 2024-05-08T05:53:50.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.763+0000 7f069a000700 1 -- 172.21.15.82:0/4227964416 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f068c00bd80 con 0x55ab522e6ae0 2024-05-08T05:53:50.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.764+0000 7f06b651cb80 1 -- 172.21.15.82:0/4227964416 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ab522e6ae0 msgr2=0x55ab522e6f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:50.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.764+0000 7f06b651cb80 1 --2- 172.21.15.82:0/4227964416 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ab522e6ae0 0x55ab522e6f60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f068c0098e0 tx=0x7f068c005c70 comp rx=0 tx=0).stop 2024-05-08T05:53:50.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.765+0000 7f06b651cb80 1 -- 172.21.15.82:0/4227964416 shutdown_connections 2024-05-08T05:53:50.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.765+0000 7f06b651cb80 1 --2- 172.21.15.82:0/4227964416 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab522e74a0 0x55ab522f31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:50.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.765+0000 7f06b651cb80 1 --2- 172.21.15.82:0/4227964416 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab522eb2d0 0x55ab522eb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:50.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.765+0000 7f06b651cb80 1 --2- 172.21.15.82:0/4227964416 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ab522e6ae0 0x55ab522e6f60 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:50.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.765+0000 7f06b651cb80 1 -- 172.21.15.82:0/4227964416 >> 172.21.15.82:0/4227964416 conn(0x55ab522566d0 msgr2=0x55ab522d8b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:53:50.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.765+0000 7f069be00700 1 --2- 172.21.15.82:0/1911878877 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f06840b2900 0x7f06840b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:50.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.766+0000 7f06b651cb80 1 -- 172.21.15.82:0/4227964416 shutdown_connections 2024-05-08T05:53:50.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.766+0000 7f06b651cb80 1 -- 172.21.15.82:0/4227964416 wait complete. 2024-05-08T05:53:50.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.767+0000 7f06b651cb80 1 -- start start 2024-05-08T05:53:50.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.768+0000 7f06b651cb80 1 Processor -- start 2024-05-08T05:53:50.768 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.768+0000 7f069be00700 1 --2- 172.21.15.82:0/1911878877 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f06840b2900 0x7f06840b4dc0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0694005fd0 tx=0x7f0694005ea0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:53:50.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.769+0000 7f06b651cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab522e6ae0 0x55ab522f2c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:50.769 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.769+0000 7f06b651cb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ab522e74a0 0x55ab522f31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:50.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.770+0000 7f06a9200700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab522e6ae0 0x55ab522f2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:50.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.770+0000 7f06a9200700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab522e6ae0 0x55ab522f2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:58786/0 (socket says 172.21.15.82:58786) 2024-05-08T05:53:50.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.770+0000 7f069be00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ab522e74a0 0x55ab522f31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:50.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.770+0000 7f069be00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ab522e74a0 0x55ab522f31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:53056/0 (socket says 172.21.15.82:53056) 2024-05-08T05:53:50.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.770+0000 7f06b651cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab522eb2d0 0x55ab522f0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:50.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.770+0000 7f06b651cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55ab522f3790 con 0x55ab522eb2d0 2024-05-08T05:53:50.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.770+0000 7f06b651cb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ab52196b20 con 0x55ab522e74a0 2024-05-08T05:53:50.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.770+0000 7f06b651cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ab522f3910 con 0x55ab522e6ae0 2024-05-08T05:53:50.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.770+0000 7f06b651cb80 10 client.0 _ll_register_callbacks cb 0x55ab521d7c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:53:50.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.771+0000 7f06a9200700 1 -- 172.21.15.82:0/1532340459 learned_addr learned my addr 172.21.15.82:0/1532340459 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:53:50.771 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.771+0000 7f069be00700 1 -- 172.21.15.82:0/1532340459 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab522e6ae0 msgr2=0x55ab522f2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:53:50.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.771+0000 7f069be00700 1 --2- 172.21.15.82:0/1532340459 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab522e6ae0 0x55ab522f2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:50.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.771+0000 7f069be00700 1 -- 172.21.15.82:0/1532340459 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab522eb2d0 msgr2=0x55ab522f0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:53:50.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.771+0000 7f069be00700 1 --2- 172.21.15.82:0/1532340459 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab522eb2d0 0x55ab522f0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:50.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.771+0000 7f069be00700 1 -- 172.21.15.82:0/1532340459 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab521f6420 con 0x55ab522e74a0 2024-05-08T05:53:50.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.771+0000 7f06a9200700 1 --2- 172.21.15.82:0/1532340459 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab522e6ae0 0x55ab522f2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:53:50.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.772+0000 7f069be00700 1 --2- 172.21.15.82:0/1532340459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ab522e74a0 0x55ab522f31c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f069400f750 tx=0x7f0694004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8375876324751f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:53:50.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.772+0000 7f0692a00700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:53:50.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.772+0000 7f0692a00700 1 -- 172.21.15.82:0/1532340459 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f069401c8f0 con 0x55ab522e74a0 2024-05-08T05:53:50.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.773+0000 7f0692a00700 1 -- 172.21.15.82:0/1532340459 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f069401ca90 con 0x55ab522e74a0 2024-05-08T05:53:50.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.773+0000 7f06b651cb80 1 -- 172.21.15.82:0/1532340459 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f068c026070 con 0x55ab522e74a0 2024-05-08T05:53:50.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.773+0000 7f0692a00700 1 -- 172.21.15.82:0/1532340459 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f069401cc90 con 0x55ab522e74a0 2024-05-08T05:53:50.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.773+0000 7f06b651cb80 10 client.25553 fetch_fsmap learned FSMap version 31 2024-05-08T05:53:50.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.773+0000 7f06b651cb80 1 -- 172.21.15.82:0/1532340459 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55ab522fde30 con 0x55ab522e74a0 2024-05-08T05:53:50.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.774+0000 7f0692a00700 1 -- 172.21.15.82:0/1532340459 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f068c026070 con 0x55ab522e74a0 2024-05-08T05:53:50.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.774+0000 7f0692a00700 1 -- 172.21.15.82:0/1532340459 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f069401a3b0 con 0x55ab522e74a0 2024-05-08T05:53:50.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.774+0000 7f06b651cb80 10 client.25553 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:53:50.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.774+0000 7f06b651cb80 10 client.25553 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:53:50.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.774+0000 7f06b651cb80 20 client.25553 populate_metadata read hostname 'smithi082' 2024-05-08T05:53:50.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.774+0000 7f06b651cb80 1 --2- 172.21.15.82:0/1532340459 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55ab52300470 0x55ab52302880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:50.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.774+0000 7f06b651cb80 4 client.25553 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:53:50.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.774+0000 7f06b651cb80 1 -- 172.21.15.82:0/1532340459 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ab522ab140 con 0x55ab52300470 2024-05-08T05:53:50.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.775+0000 7f06a9200700 1 --2- 172.21.15.82:0/1532340459 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55ab52300470 0x55ab52302880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:50.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.777+0000 7f06a9200700 1 --2- 172.21.15.82:0/1532340459 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55ab52300470 0x55ab52302880 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8c7e4e693eddf0a server_cookie=4c6de97c5641887c in_seq=0 out_seq=0 2024-05-08T05:53:50.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.777+0000 7f0692a00700 10 client.25553 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:53:50.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.779+0000 7f0692a00700 1 -- 172.21.15.82:0/1532340459 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55ab522ab140 con 0x55ab52300470 2024-05-08T05:53:50.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.779+0000 7f0692a00700 10 client.25553 handle_command_reply: tid=0 2024-05-08T05:53:50.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.780+0000 7f06b651cb80 1 client.25553 shutdown 2024-05-08T05:53:50.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.781+0000 7f06b651cb80 1 -- 172.21.15.82:0/1532340459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ab522e74a0 msgr2=0x55ab522f31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:50.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.781+0000 7f06b651cb80 1 --2- 172.21.15.82:0/1532340459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ab522e74a0 0x55ab522f31c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f069400f750 tx=0x7f0694004750 comp rx=0 tx=0).stop 2024-05-08T05:53:50.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.781+0000 7f06b651cb80 1 -- 172.21.15.82:0/1532340459 shutdown_connections 2024-05-08T05:53:50.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.781+0000 7f06b651cb80 1 --2- 172.21.15.82:0/1532340459 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab522eb2d0 0x55ab522f0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:50.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.781+0000 7f06b651cb80 1 --2- 172.21.15.82:0/1532340459 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab522e6ae0 0x55ab522f2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:50.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.781+0000 7f06b651cb80 1 --2- 172.21.15.82:0/1532340459 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55ab52300470 0x55ab52302880 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:50.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.781+0000 7f06b651cb80 1 --2- 172.21.15.82:0/1532340459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ab522e74a0 0x55ab522f31c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:50.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.781+0000 7f0692a00700 0 client.25553 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:53:50.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.781+0000 7f06b651cb80 1 -- 172.21.15.82:0/1532340459 >> 172.21.15.82:0/1532340459 conn(0x55ab522566d0 msgr2=0x55ab522ec950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:53:50.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.782+0000 7f06b651cb80 1 -- 172.21.15.82:0/1532340459 shutdown_connections 2024-05-08T05:53:50.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.783+0000 7f06b651cb80 1 -- 172.21.15.82:0/1532340459 wait complete. 2024-05-08T05:53:50.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.783+0000 7f06b651cb80 20 client.25553 trim_cache size 0 max 16384 2024-05-08T05:53:50.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.810+0000 7f06b651cb80 1 Processor -- start 2024-05-08T05:53:50.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.810+0000 7f06b651cb80 1 -- start start 2024-05-08T05:53:50.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.811+0000 7f06b651cb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ab522e6ae0 0x55ab522f0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:50.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.811+0000 7f06b651cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab522e74a0 0x55ab52308150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:50.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.811+0000 7f06b651cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab522eb2d0 0x55ab52308690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:50.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.811+0000 7f06b651cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f06a41ab810 con 0x55ab522eb2d0 2024-05-08T05:53:50.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.811+0000 7f06b651cb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f06a41ad350 con 0x55ab522e6ae0 2024-05-08T05:53:50.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.811+0000 7f06b651cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f06a41abee0 con 0x55ab522e74a0 2024-05-08T05:53:50.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.812+0000 7f06a9200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ab522e6ae0 0x55ab522f0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:50.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.812+0000 7f06a9200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ab522e6ae0 0x55ab522f0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:53066/0 (socket says 172.21.15.82:53066) 2024-05-08T05:53:50.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.813+0000 7f06a9c00700 1 --2- 172.21.15.82:0/1554712580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab522eb2d0 0x55ab52308690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:50.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.813+0000 7f069be00700 1 --2- 172.21.15.82:0/1554712580 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab522e74a0 0x55ab52308150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:50.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.812+0000 7f06a9200700 1 -- 172.21.15.82:0/1554712580 learned_addr learned my addr 172.21.15.82:0/1554712580 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:53:50.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.814+0000 7f06a9200700 1 -- 172.21.15.82:0/1554712580 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab522e74a0 msgr2=0x55ab52308150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:53:50.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.814+0000 7f06a9200700 1 --2- 172.21.15.82:0/1554712580 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab522e74a0 0x55ab52308150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:50.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.814+0000 7f06a9200700 1 -- 172.21.15.82:0/1554712580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab522eb2d0 msgr2=0x55ab52308690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:53:50.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.814+0000 7f06a9200700 1 --2- 172.21.15.82:0/1554712580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab522eb2d0 0x55ab52308690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:50.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.814+0000 7f06a9200700 1 -- 172.21.15.82:0/1554712580 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab522e7280 con 0x55ab522e6ae0 2024-05-08T05:53:50.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.815+0000 7f06a9200700 1 --2- 172.21.15.82:0/1554712580 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ab522e6ae0 0x55ab522f0ad0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f068c009990 tx=0x7f068c00b540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=759c01af53f70c1d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:53:50.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.815+0000 7f0699600700 1 -- 172.21.15.82:0/1554712580 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f068c00bd80 con 0x55ab522e6ae0 2024-05-08T05:53:50.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.815+0000 7f0699600700 1 -- 172.21.15.82:0/1554712580 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f068c026050 con 0x55ab522e6ae0 2024-05-08T05:53:50.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.815+0000 7f0699600700 1 -- 172.21.15.82:0/1554712580 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f068c00fad0 con 0x55ab522e6ae0 2024-05-08T05:53:50.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.816+0000 7f06b651cb80 1 -- 172.21.15.82:0/1554712580 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ab522e6ae0 msgr2=0x55ab522f0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:50.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.816+0000 7f06b651cb80 1 --2- 172.21.15.82:0/1554712580 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ab522e6ae0 0x55ab522f0ad0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f068c009990 tx=0x7f068c00b540 comp rx=0 tx=0).stop 2024-05-08T05:53:50.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.816+0000 7f06b651cb80 1 -- 172.21.15.82:0/1554712580 shutdown_connections 2024-05-08T05:53:50.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.816+0000 7f06b651cb80 1 --2- 172.21.15.82:0/1554712580 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ab522e6ae0 0x55ab522f0ad0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:50.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.816+0000 7f06b651cb80 1 --2- 172.21.15.82:0/1554712580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab522eb2d0 0x55ab52308690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:50.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.817+0000 7f06b651cb80 1 --2- 172.21.15.82:0/1554712580 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab522e74a0 0x55ab52308150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:50.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.817+0000 7f06b651cb80 1 -- 172.21.15.82:0/1554712580 >> 172.21.15.82:0/1554712580 conn(0x55ab522566d0 msgr2=0x55ab522d7900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:53:50.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.817+0000 7f06b651cb80 1 -- 172.21.15.82:0/1554712580 shutdown_connections 2024-05-08T05:53:50.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.817+0000 7f06b651cb80 1 -- 172.21.15.82:0/1554712580 wait complete. 2024-05-08T05:53:50.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.817+0000 7f06b651cb80 1 -- start start 2024-05-08T05:53:50.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.818+0000 7f06b651cb80 1 Processor -- start 2024-05-08T05:53:50.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.818+0000 7f06b651cb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ab522e74a0 0x55ab522f90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:50.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.818+0000 7f06b651cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab522eb2d0 0x55ab522e84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:50.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.818+0000 7f06b651cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab522e89f0 0x55ab522e8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:50.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.818+0000 7f06b651cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f06a41acc80 con 0x55ab522e89f0 2024-05-08T05:53:50.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.818+0000 7f06b651cb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f06a41ac5b0 con 0x55ab522e74a0 2024-05-08T05:53:50.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.818+0000 7f06b651cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f06a407b7d0 con 0x55ab522eb2d0 2024-05-08T05:53:50.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.818+0000 7f06b651cb80 10 client.0 _ll_register_callbacks cb 0x55ab521d7c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:53:50.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.819+0000 7f069be00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab522eb2d0 0x55ab522e84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:50.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.819+0000 7f069be00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab522eb2d0 0x55ab522e84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:58806/0 (socket says 172.21.15.82:58806) 2024-05-08T05:53:50.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.819+0000 7f069be00700 1 -- 172.21.15.82:0/3526885660 learned_addr learned my addr 172.21.15.82:0/3526885660 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:53:50.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.819+0000 7f06a9c00700 1 --2- 172.21.15.82:0/3526885660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab522e89f0 0x55ab522e8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:50.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.819+0000 7f069be00700 1 -- 172.21.15.82:0/3526885660 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ab522e74a0 msgr2=0x55ab522f90a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T05:53:50.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.819+0000 7f069be00700 1 --2- 172.21.15.82:0/3526885660 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ab522e74a0 0x55ab522f90a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:50.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.819+0000 7f069be00700 1 -- 172.21.15.82:0/3526885660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab522e89f0 msgr2=0x55ab522e8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:53:50.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.819+0000 7f069be00700 1 --2- 172.21.15.82:0/3526885660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab522e89f0 0x55ab522e8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:50.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.819+0000 7f069be00700 1 -- 172.21.15.82:0/3526885660 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab52369db0 con 0x55ab522eb2d0 2024-05-08T05:53:50.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.819+0000 7f06a9c00700 1 --2- 172.21.15.82:0/3526885660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab522e89f0 0x55ab522e8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:53:50.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.819+0000 7f069be00700 1 --2- 172.21.15.82:0/3526885660 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab522eb2d0 0x55ab522e84b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f069401a850 tx=0x7f069401a690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=667d4fa0bff9d744 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:53:50.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.819+0000 7f0692a00700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:53:50.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.820+0000 7f0692a00700 1 -- 172.21.15.82:0/3526885660 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0694034040 con 0x55ab522eb2d0 2024-05-08T05:53:50.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.820+0000 7f0692a00700 1 -- 172.21.15.82:0/3526885660 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f069401c6f0 con 0x55ab522eb2d0 2024-05-08T05:53:50.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.820+0000 7f06b651cb80 1 -- 172.21.15.82:0/3526885660 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f068c026050 con 0x55ab522eb2d0 2024-05-08T05:53:50.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.820+0000 7f0692a00700 1 -- 172.21.15.82:0/3526885660 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f069401cc90 con 0x55ab522eb2d0 2024-05-08T05:53:50.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.820+0000 7f06b651cb80 10 client.25579 fetch_fsmap learned FSMap version 31 2024-05-08T05:53:50.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.820+0000 7f06b651cb80 1 -- 172.21.15.82:0/3526885660 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55ab5236b070 con 0x55ab522eb2d0 2024-05-08T05:53:50.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.821+0000 7f0692a00700 1 -- 172.21.15.82:0/3526885660 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f068c026050 con 0x55ab522eb2d0 2024-05-08T05:53:50.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.821+0000 7f0692a00700 1 -- 172.21.15.82:0/3526885660 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f0694037070 con 0x55ab522eb2d0 2024-05-08T05:53:50.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.822+0000 7f06b651cb80 10 client.25579 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:53:50.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.822+0000 7f06b651cb80 10 client.25579 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:53:50.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.822+0000 7f06b651cb80 20 client.25579 populate_metadata read hostname 'smithi082' 2024-05-08T05:53:50.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.822+0000 7f06b651cb80 1 --2- 172.21.15.82:0/3526885660 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55ab5236b6b0 0x55ab5236dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:50.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.822+0000 7f06b651cb80 4 client.25579 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:53:50.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.822+0000 7f06b651cb80 1 -- 172.21.15.82:0/3526885660 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ab5223e400 con 0x55ab5236b6b0 2024-05-08T05:53:50.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.823+0000 7f06a9200700 1 --2- 172.21.15.82:0/3526885660 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55ab5236b6b0 0x55ab5236dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:50.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.824+0000 7f06a9200700 1 --2- 172.21.15.82:0/3526885660 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55ab5236b6b0 0x55ab5236dad0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d17cccfceafc1f81 server_cookie=55a8936c062c3fae in_seq=0 out_seq=0 2024-05-08T05:53:50.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.824+0000 7f0692a00700 10 client.25579 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:53:50.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.824+0000 7f0692a00700 1 -- 172.21.15.82:0/3526885660 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ab5223e400 con 0x55ab5236b6b0 2024-05-08T05:53:50.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.824+0000 7f0692a00700 10 client.25579 handle_command_reply: tid=0 2024-05-08T05:53:50.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.824+0000 7f06b651cb80 1 client.25579 shutdown 2024-05-08T05:53:50.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.825+0000 7f06b651cb80 1 -- 172.21.15.82:0/3526885660 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab522eb2d0 msgr2=0x55ab522e84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:50.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.825+0000 7f06b651cb80 1 --2- 172.21.15.82:0/3526885660 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab522eb2d0 0x55ab522e84b0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f069401a850 tx=0x7f069401a690 comp rx=0 tx=0).stop 2024-05-08T05:53:50.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.825+0000 7f06b651cb80 1 -- 172.21.15.82:0/3526885660 shutdown_connections 2024-05-08T05:53:50.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.825+0000 7f06b651cb80 1 --2- 172.21.15.82:0/3526885660 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55ab5236b6b0 0x55ab5236dad0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:50.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.825+0000 7f06b651cb80 1 --2- 172.21.15.82:0/3526885660 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ab522e74a0 0x55ab522f90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:50.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.825+0000 7f06b651cb80 1 --2- 172.21.15.82:0/3526885660 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab522e89f0 0x55ab522e8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:50.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.825+0000 7f06b651cb80 1 --2- 172.21.15.82:0/3526885660 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab522eb2d0 0x55ab522e84b0 secure :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f069401a850 tx=0x7f069401a690 comp rx=0 tx=0).stop 2024-05-08T05:53:50.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.825+0000 7f06b651cb80 1 -- 172.21.15.82:0/3526885660 >> 172.21.15.82:0/3526885660 conn(0x55ab522566d0 msgr2=0x55ab522ee500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:53:50.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.825+0000 7f0692a00700 0 client.25579 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:53:50.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.826+0000 7f06b651cb80 1 -- 172.21.15.82:0/3526885660 shutdown_connections 2024-05-08T05:53:50.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.826+0000 7f06b651cb80 1 -- 172.21.15.82:0/3526885660 wait complete. 2024-05-08T05:53:50.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.826+0000 7f06b651cb80 20 client.25579 trim_cache size 0 max 16384 2024-05-08T05:53:50.826 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T05:53:50.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.827+0000 7f06abc00700 1 -- 172.21.15.82:0/1911878877 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f06840b2900 msgr2=0x7f06840b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:50.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.827+0000 7f06abc00700 1 --2- 172.21.15.82:0/1911878877 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f06840b2900 0x7f06840b4dc0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0694005fd0 tx=0x7f0694005ea0 comp rx=0 tx=0).stop 2024-05-08T05:53:50.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.827+0000 7f06abc00700 1 -- 172.21.15.82:0/1911878877 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06a410b6e0 msgr2=0x7f06a41a0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:50.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.827+0000 7f06abc00700 1 --2- 172.21.15.82:0/1911878877 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06a410b6e0 0x7f06a41a0600 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f069c007ee0 tx=0x7f069c00d3b0 comp rx=0 tx=0).stop 2024-05-08T05:53:50.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.828+0000 7f06abc00700 1 -- 172.21.15.82:0/1911878877 shutdown_connections 2024-05-08T05:53:50.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.828+0000 7f06abc00700 1 --2- 172.21.15.82:0/1911878877 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06a410b6e0 0x7f06a41a0600 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:50.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.828+0000 7f06abc00700 1 --2- 172.21.15.82:0/1911878877 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f06840b2900 0x7f06840b4dc0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:50.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.828+0000 7f06abc00700 1 --2- 172.21.15.82:0/1911878877 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f06a41056e0 0x7f06a419bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:50.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.828+0000 7f06abc00700 1 --2- 172.21.15.82:0/1911878877 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06a41060a0 0x7f06a419c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:50.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.828+0000 7f06abc00700 1 -- 172.21.15.82:0/1911878877 >> 172.21.15.82:0/1911878877 conn(0x7f06a41011d0 msgr2=0x7f06a4101810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:53:50.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.829+0000 7f06abc00700 1 -- 172.21.15.82:0/1911878877 shutdown_connections 2024-05-08T05:53:50.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:50.829+0000 7f06abc00700 1 -- 172.21.15.82:0/1911878877 wait complete. 2024-05-08T05:53:51.681 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:53:51 smithi151 ceph-mon[34815]: pgmap v555: 97 pgs: 97 active+clean; 1.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 9.8 MiB/s wr, 831 op/s 2024-05-08T05:53:51.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:53:51 smithi082 ceph-mon[30098]: pgmap v555: 97 pgs: 97 active+clean; 1.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 9.8 MiB/s wr, 831 op/s 2024-05-08T05:53:51.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:53:51 smithi134 ceph-mon[34132]: pgmap v555: 97 pgs: 97 active+clean; 1.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 9.8 MiB/s wr, 831 op/s 2024-05-08T05:53:53.099 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-08T05:53:53.100 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-05-08T05:53:53.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:53:53 smithi082 ceph-mon[30098]: pgmap v556: 97 pgs: 97 active+clean; 1.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.3 MiB/s wr, 687 op/s 2024-05-08T05:53:53.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:53:53 smithi134 ceph-mon[34132]: pgmap v556: 97 pgs: 97 active+clean; 1.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.3 MiB/s wr, 687 op/s 2024-05-08T05:53:53.753 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:53:53.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:53:53 smithi151 ceph-mon[34815]: pgmap v556: 97 pgs: 97 active+clean; 1.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.3 MiB/s wr, 687 op/s 2024-05-08T05:53:55.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 185.0 s, 3150.1 tps, lat 31.718 ms stddev 34.887 2024-05-08T05:53:55.623 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:53:55 smithi082 ceph-mon[30098]: pgmap v557: 97 pgs: 97 active+clean; 1.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.6 MiB/s wr, 731 op/s 2024-05-08T05:53:55.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:53:55 smithi134 ceph-mon[34132]: pgmap v557: 97 pgs: 97 active+clean; 1.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.6 MiB/s wr, 731 op/s 2024-05-08T05:53:55.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:53:55 smithi151 ceph-mon[34815]: pgmap v557: 97 pgs: 97 active+clean; 1.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.6 MiB/s wr, 731 op/s 2024-05-08T05:53:56.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.318+0000 7f5a65000700 1 -- 172.21.15.82:0/53852277 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a60103520 msgr2=0x7f5a601039a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:56.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.318+0000 7f5a65000700 1 --2- 172.21.15.82:0/53852277 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a60103520 0x7f5a601039a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c009990 tx=0x7f5a4c009ca0 comp rx=0 tx=0).stop 2024-05-08T05:53:56.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.319+0000 7f5a65000700 1 -- 172.21.15.82:0/53852277 shutdown_connections 2024-05-08T05:53:56.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.319+0000 7f5a65000700 1 --2- 172.21.15.82:0/53852277 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a60103ee0 0x7f5a601103c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:56.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.319+0000 7f5a65000700 1 --2- 172.21.15.82:0/53852277 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a60109630 0x7f5a60109a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:56.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.319+0000 7f5a65000700 1 --2- 172.21.15.82:0/53852277 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a60103520 0x7f5a601039a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:56.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.319+0000 7f5a65000700 1 -- 172.21.15.82:0/53852277 >> 172.21.15.82:0/53852277 conn(0x7f5a6007a650 msgr2=0x7f5a6007aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:53:56.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.319+0000 7f5a65000700 1 -- 172.21.15.82:0/53852277 shutdown_connections 2024-05-08T05:53:56.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.320+0000 7f5a65000700 1 -- 172.21.15.82:0/53852277 wait complete. 2024-05-08T05:53:56.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.321+0000 7f5a65000700 1 Processor -- start 2024-05-08T05:53:56.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.321+0000 7f5a65000700 1 -- start start 2024-05-08T05:53:56.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.322+0000 7f5a65000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a60103520 0x7f5a60074c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:56.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.322+0000 7f5a65000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a60103ee0 0x7f5a60075150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:56.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.322+0000 7f5a65000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a60109630 0x7f5a6006def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:56.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.322+0000 7f5a65000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5a601136e0 con 0x7f5a60103520 2024-05-08T05:53:56.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.322+0000 7f5a65000700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5a60113560 con 0x7f5a60109630 2024-05-08T05:53:56.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.322+0000 7f5a65000700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5a60113860 con 0x7f5a60103ee0 2024-05-08T05:53:56.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.323+0000 7f5a5e800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a60109630 0x7f5a6006def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:56.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.323+0000 7f5a5de00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a60103520 0x7f5a60074c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:56.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.323+0000 7f5a5e800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a60109630 0x7f5a6006def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:42794/0 (socket says 172.21.15.82:42794) 2024-05-08T05:53:56.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.323+0000 7f5a5e800700 1 -- 172.21.15.82:0/1149003982 learned_addr learned my addr 172.21.15.82:0/1149003982 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:53:56.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.324+0000 7f5a5d400700 1 --2- 172.21.15.82:0/1149003982 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a60103ee0 0x7f5a60075150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:56.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.325+0000 7f5a5e800700 1 -- 172.21.15.82:0/1149003982 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a60103ee0 msgr2=0x7f5a60075150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:56.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.325+0000 7f5a5e800700 1 --2- 172.21.15.82:0/1149003982 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a60103ee0 0x7f5a60075150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:56.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.325+0000 7f5a5e800700 1 -- 172.21.15.82:0/1149003982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a60103520 msgr2=0x7f5a60074c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:56.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.325+0000 7f5a5e800700 1 --2- 172.21.15.82:0/1149003982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a60103520 0x7f5a60074c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:56.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.325+0000 7f5a5e800700 1 -- 172.21.15.82:0/1149003982 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a6006e5d0 con 0x7f5a60109630 2024-05-08T05:53:56.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.325+0000 7f5a5e800700 1 --2- 172.21.15.82:0/1149003982 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a60109630 0x7f5a6006def0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5a58007f10 tx=0x7f5a5800d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:53:56.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.326+0000 7f5a56a00700 1 -- 172.21.15.82:0/1149003982 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a58009e20 con 0x7f5a60109630 2024-05-08T05:53:56.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.326+0000 7f5a56a00700 1 -- 172.21.15.82:0/1149003982 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a5800dbd0 con 0x7f5a60109630 2024-05-08T05:53:56.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.326+0000 7f5a56a00700 1 -- 172.21.15.82:0/1149003982 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a58005990 con 0x7f5a60109630 2024-05-08T05:53:56.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.327+0000 7f5a65000700 1 -- 172.21.15.82:0/1149003982 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a6006e8c0 con 0x7f5a60109630 2024-05-08T05:53:56.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.328+0000 7f5a65000700 1 -- 172.21.15.82:0/1149003982 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a60072910 con 0x7f5a60109630 2024-05-08T05:53:56.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.334+0000 7f5a6f989b80 1 Processor -- start 2024-05-08T05:53:56.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.335+0000 7f5a56a00700 1 -- 172.21.15.82:0/1149003982 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f5a5801a070 con 0x7f5a60109630 2024-05-08T05:53:56.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.335+0000 7f5a6f989b80 1 -- start start 2024-05-08T05:53:56.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.335+0000 7f5a6f989b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5624026760e0 0x5624026764c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:56.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.335+0000 7f5a6f989b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562402676a00 0x56240267a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:56.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.336+0000 7f5a6f989b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56240267aa50 0x56240267aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:56.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.336+0000 7f5a6f989b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5624025c8aa0 con 0x56240267aa50 2024-05-08T05:53:56.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.336+0000 7f5a6f989b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5624025667e0 con 0x5624026760e0 2024-05-08T05:53:56.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.336+0000 7f5a6f989b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5624025c4a60 con 0x562402676a00 2024-05-08T05:53:56.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.336+0000 7f5a5d400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5624026760e0 0x5624026764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:56.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.336+0000 7f5a5de00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562402676a00 0x56240267a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:56.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.336+0000 7f5a5d400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5624026760e0 0x5624026764c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:42796/0 (socket says 172.21.15.82:42796) 2024-05-08T05:53:56.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.336+0000 7f5a5d400700 1 -- 172.21.15.82:0/1991678967 learned_addr learned my addr 172.21.15.82:0/1991678967 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:53:56.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.336+0000 7f5a56a00700 1 --2- 172.21.15.82:0/1149003982 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f5a440b29d0 0x7f5a440b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:56.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.336+0000 7f5a56a00700 1 -- 172.21.15.82:0/1149003982 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f5a580e0ff0 con 0x7f5a60109630 2024-05-08T05:53:56.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.336+0000 7f5a5de00700 1 -- 172.21.15.82:0/1991678967 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5624026760e0 msgr2=0x5624026764c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:53:56.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.336+0000 7f5a5de00700 1 --2- 172.21.15.82:0/1991678967 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5624026760e0 0x5624026764c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:56.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.336+0000 7f5a5de00700 1 -- 172.21.15.82:0/1991678967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56240267aa50 msgr2=0x56240267aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:53:56.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.336+0000 7f5a5de00700 1 --2- 172.21.15.82:0/1991678967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56240267aa50 0x56240267aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:56.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.336+0000 7f5a5de00700 1 -- 172.21.15.82:0/1991678967 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562402515950 con 0x562402676a00 2024-05-08T05:53:56.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.337+0000 7f5a5d400700 1 --2- 172.21.15.82:0/1991678967 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5624026760e0 0x5624026764c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:53:56.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.337+0000 7f5a5e800700 1 --2- 172.21.15.82:0/1149003982 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f5a440b29d0 0x7f5a440b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:56.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.337+0000 7f5a5de00700 1 --2- 172.21.15.82:0/1991678967 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562402676a00 0x56240267a510 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5a50009ae0 tx=0x7f5a50009df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aff84e3d6dd2d7f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:53:56.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.337+0000 7f5a4b400700 1 -- 172.21.15.82:0/1991678967 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a50016070 con 0x562402676a00 2024-05-08T05:53:56.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.337+0000 7f5a4b400700 1 -- 172.21.15.82:0/1991678967 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a50005020 con 0x562402676a00 2024-05-08T05:53:56.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.337+0000 7f5a4b400700 1 -- 172.21.15.82:0/1991678967 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a5000eab0 con 0x562402676a00 2024-05-08T05:53:56.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.338+0000 7f5a6f989b80 1 -- 172.21.15.82:0/1991678967 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562402676a00 msgr2=0x56240267a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:56.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.338+0000 7f5a5e800700 1 --2- 172.21.15.82:0/1149003982 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f5a440b29d0 0x7f5a440b4e90 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5a58005c30 tx=0x7f5a5800b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:53:56.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.338+0000 7f5a6f989b80 1 --2- 172.21.15.82:0/1991678967 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562402676a00 0x56240267a510 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5a50009ae0 tx=0x7f5a50009df0 comp rx=0 tx=0).stop 2024-05-08T05:53:56.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.338+0000 7f5a6f989b80 1 -- 172.21.15.82:0/1991678967 shutdown_connections 2024-05-08T05:53:56.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.338+0000 7f5a6f989b80 1 --2- 172.21.15.82:0/1991678967 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5624026760e0 0x5624026764c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:56.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.338+0000 7f5a6f989b80 1 --2- 172.21.15.82:0/1991678967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56240267aa50 0x56240267aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:56.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.338+0000 7f5a6f989b80 1 --2- 172.21.15.82:0/1991678967 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562402676a00 0x56240267a510 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:56.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.338+0000 7f5a6f989b80 1 -- 172.21.15.82:0/1991678967 >> 172.21.15.82:0/1991678967 conn(0x5624025a4be0 msgr2=0x562402670820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:53:56.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.339+0000 7f5a6f989b80 1 -- 172.21.15.82:0/1991678967 shutdown_connections 2024-05-08T05:53:56.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.339+0000 7f5a6f989b80 1 -- 172.21.15.82:0/1991678967 wait complete. 2024-05-08T05:53:56.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.339+0000 7f5a6f989b80 1 -- start start 2024-05-08T05:53:56.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.340+0000 7f5a6f989b80 1 Processor -- start 2024-05-08T05:53:56.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.340+0000 7f5a6f989b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5624026760e0 0x562402681ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:56.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.340+0000 7f5a6f989b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562402676a00 0x56240267f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:56.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.340+0000 7f5a6f989b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56240267aa50 0x56240267f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:56.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.340+0000 7f5a6f989b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x562402682c60 con 0x5624026760e0 2024-05-08T05:53:56.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.340+0000 7f5a6f989b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56240252eba0 con 0x562402676a00 2024-05-08T05:53:56.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.340+0000 7f5a6f989b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x562402682de0 con 0x56240267aa50 2024-05-08T05:53:56.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.340+0000 7f5a6f989b80 10 client.0 _ll_register_callbacks cb 0x56240256fcf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:53:56.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.340+0000 7f5a5de00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562402676a00 0x56240267f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:56.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.340+0000 7f5a5de00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562402676a00 0x56240267f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:42804/0 (socket says 172.21.15.82:42804) 2024-05-08T05:53:56.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.340+0000 7f5a5de00700 1 -- 172.21.15.82:0/28030534 learned_addr learned my addr 172.21.15.82:0/28030534 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:53:56.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.341+0000 7f5a5d400700 1 --2- 172.21.15.82:0/28030534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5624026760e0 0x562402681ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:56.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.341+0000 7f5a5d400700 1 --2- 172.21.15.82:0/28030534 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56240267aa50 0x56240267f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:56.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.341+0000 7f5a5de00700 1 -- 172.21.15.82:0/28030534 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56240267aa50 msgr2=0x56240267f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:53:56.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.341+0000 7f5a5de00700 1 --2- 172.21.15.82:0/28030534 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56240267aa50 0x56240267f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:56.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.341+0000 7f5a5de00700 1 -- 172.21.15.82:0/28030534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5624026760e0 msgr2=0x562402681ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:53:56.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.341+0000 7f5a5de00700 1 --2- 172.21.15.82:0/28030534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5624026760e0 0x562402681ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:56.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.341+0000 7f5a5de00700 1 -- 172.21.15.82:0/28030534 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56240258e4a0 con 0x562402676a00 2024-05-08T05:53:56.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.341+0000 7f5a5de00700 1 --2- 172.21.15.82:0/28030534 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562402676a00 0x56240267f240 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5a50005720 tx=0x7f5a5000eac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92b1a7af502ba93f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:53:56.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.341+0000 7f5a3fe00700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:53:56.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.342+0000 7f5a3fe00700 1 -- 172.21.15.82:0/28030534 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a50028060 con 0x562402676a00 2024-05-08T05:53:56.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.342+0000 7f5a3fe00700 1 -- 172.21.15.82:0/28030534 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f5a5000ee20 con 0x562402676a00 2024-05-08T05:53:56.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.342+0000 7f5a6f989b80 1 -- 172.21.15.82:0/28030534 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a50005020 con 0x562402676a00 2024-05-08T05:53:56.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.342+0000 7f5a3fe00700 1 -- 172.21.15.82:0/28030534 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f5a50016040 con 0x562402676a00 2024-05-08T05:53:56.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.342+0000 7f5a6f989b80 10 client.25568 fetch_fsmap learned FSMap version 31 2024-05-08T05:53:56.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.342+0000 7f5a6f989b80 1 -- 172.21.15.82:0/28030534 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56240268d500 con 0x562402676a00 2024-05-08T05:53:56.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.343+0000 7f5a3fe00700 1 -- 172.21.15.82:0/28030534 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a50005020 con 0x562402676a00 2024-05-08T05:53:56.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.343+0000 7f5a3fe00700 1 -- 172.21.15.82:0/28030534 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f5a5000f040 con 0x562402676a00 2024-05-08T05:53:56.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.343+0000 7f5a6f989b80 10 client.25568 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:53:56.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.343+0000 7f5a6f989b80 10 client.25568 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:53:56.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.343+0000 7f5a6f989b80 20 client.25568 populate_metadata read hostname 'smithi082' 2024-05-08T05:53:56.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.343+0000 7f5a6f989b80 1 --2- 172.21.15.82:0/28030534 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x56240268fae0 0x562402691ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:56.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.343+0000 7f5a6f989b80 4 client.25568 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:53:56.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.343+0000 7f5a6f989b80 1 -- 172.21.15.82:0/28030534 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562402643120 con 0x56240268fae0 2024-05-08T05:53:56.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.343+0000 7f5a5d400700 1 --2- 172.21.15.82:0/28030534 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x56240268fae0 0x562402691ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:56.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.344+0000 7f5a5d400700 1 --2- 172.21.15.82:0/28030534 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x56240268fae0 0x562402691ed0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b85a7f969975af4b server_cookie=1eaf5384166b52ee in_seq=0 out_seq=0 2024-05-08T05:53:56.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.344+0000 7f5a3fe00700 10 client.25568 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:53:56.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.345+0000 7f5a3fe00700 1 -- 172.21.15.82:0/28030534 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562402643120 con 0x56240268fae0 2024-05-08T05:53:56.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.345+0000 7f5a3fe00700 10 client.25568 handle_command_reply: tid=0 2024-05-08T05:53:56.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.345+0000 7f5a6f989b80 1 client.25568 shutdown 2024-05-08T05:53:56.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.345+0000 7f5a6f989b80 1 -- 172.21.15.82:0/28030534 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562402676a00 msgr2=0x56240267f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:56.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.345+0000 7f5a6f989b80 1 --2- 172.21.15.82:0/28030534 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562402676a00 0x56240267f240 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5a50005720 tx=0x7f5a5000eac0 comp rx=0 tx=0).stop 2024-05-08T05:53:56.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.345+0000 7f5a6f989b80 1 -- 172.21.15.82:0/28030534 shutdown_connections 2024-05-08T05:53:56.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.345+0000 7f5a6f989b80 1 --2- 172.21.15.82:0/28030534 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56240267aa50 0x56240267f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:56.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.345+0000 7f5a6f989b80 1 --2- 172.21.15.82:0/28030534 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5624026760e0 0x562402681ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:56.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.345+0000 7f5a6f989b80 1 --2- 172.21.15.82:0/28030534 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x56240268fae0 0x562402691ed0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:56.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.345+0000 7f5a6f989b80 1 --2- 172.21.15.82:0/28030534 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562402676a00 0x56240267f240 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:56.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.345+0000 7f5a6f989b80 1 -- 172.21.15.82:0/28030534 >> 172.21.15.82:0/28030534 conn(0x5624025a4be0 msgr2=0x56240266b330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:53:56.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.345+0000 7f5a3fe00700 0 client.25568 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:53:56.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.346+0000 7f5a6f989b80 1 -- 172.21.15.82:0/28030534 shutdown_connections 2024-05-08T05:53:56.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.346+0000 7f5a6f989b80 1 -- 172.21.15.82:0/28030534 wait complete. 2024-05-08T05:53:56.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.346+0000 7f5a6f989b80 20 client.25568 trim_cache size 0 max 16384 2024-05-08T05:53:56.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.368+0000 7f5a6f989b80 1 Processor -- start 2024-05-08T05:53:56.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.368+0000 7f5a6f989b80 1 -- start start 2024-05-08T05:53:56.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.368+0000 7f5a6f989b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5624026760e0 0x562402694ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:56.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.368+0000 7f5a6f989b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562402676a00 0x562402695430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:56.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.368+0000 7f5a6f989b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56240267aa50 0x56240267c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:56.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.368+0000 7f5a6f989b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5a601bc8f0 con 0x562402676a00 2024-05-08T05:53:56.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.368+0000 7f5a6f989b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5a601be430 con 0x56240267aa50 2024-05-08T05:53:56.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.368+0000 7f5a6f989b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5a601bcfc0 con 0x5624026760e0 2024-05-08T05:53:56.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.368+0000 7f5a5d400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5624026760e0 0x562402694ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:56.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.368+0000 7f5a5d400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5624026760e0 0x562402694ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:56018/0 (socket says 172.21.15.82:56018) 2024-05-08T05:53:56.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.368+0000 7f5a5d400700 1 -- 172.21.15.82:0/507651815 learned_addr learned my addr 172.21.15.82:0/507651815 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:53:56.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.368+0000 7f5a5d400700 1 --2- 172.21.15.82:0/507651815 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56240267aa50 0x56240267c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:56.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.368+0000 7f5a5de00700 1 --2- 172.21.15.82:0/507651815 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562402676a00 0x562402695430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:56.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.369+0000 7f5a5d400700 1 -- 172.21.15.82:0/507651815 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56240267aa50 msgr2=0x56240267c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:53:56.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.369+0000 7f5a5d400700 1 --2- 172.21.15.82:0/507651815 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56240267aa50 0x56240267c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:56.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.369+0000 7f5a5d400700 1 -- 172.21.15.82:0/507651815 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562402676a00 msgr2=0x562402695430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:53:56.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.369+0000 7f5a5d400700 1 --2- 172.21.15.82:0/507651815 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562402676a00 0x562402695430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:56.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.369+0000 7f5a5d400700 1 -- 172.21.15.82:0/507651815 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624026827f0 con 0x5624026760e0 2024-05-08T05:53:56.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.369+0000 7f5a5de00700 1 --2- 172.21.15.82:0/507651815 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562402676a00 0x562402695430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:53:56.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.369+0000 7f5a5d400700 1 --2- 172.21.15.82:0/507651815 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5624026760e0 0x562402694ef0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c009990 tx=0x7f5a4c019040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81f9afe5d73199b4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:53:56.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.370+0000 7f5a4aa00700 1 -- 172.21.15.82:0/507651815 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a4c005170 con 0x5624026760e0 2024-05-08T05:53:56.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.370+0000 7f5a4aa00700 1 -- 172.21.15.82:0/507651815 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a4c029410 con 0x5624026760e0 2024-05-08T05:53:56.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.370+0000 7f5a4aa00700 1 -- 172.21.15.82:0/507651815 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a4c00ba30 con 0x5624026760e0 2024-05-08T05:53:56.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.370+0000 7f5a6f989b80 1 -- 172.21.15.82:0/507651815 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5624026760e0 msgr2=0x562402694ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:56.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.370+0000 7f5a6f989b80 1 --2- 172.21.15.82:0/507651815 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5624026760e0 0x562402694ef0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c009990 tx=0x7f5a4c019040 comp rx=0 tx=0).stop 2024-05-08T05:53:56.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.370+0000 7f5a6f989b80 1 -- 172.21.15.82:0/507651815 shutdown_connections 2024-05-08T05:53:56.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.370+0000 7f5a6f989b80 1 --2- 172.21.15.82:0/507651815 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56240267aa50 0x56240267c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:56.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.370+0000 7f5a6f989b80 1 --2- 172.21.15.82:0/507651815 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5624026760e0 0x562402694ef0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:56.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.370+0000 7f5a6f989b80 1 --2- 172.21.15.82:0/507651815 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562402676a00 0x562402695430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:56.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.370+0000 7f5a6f989b80 1 -- 172.21.15.82:0/507651815 >> 172.21.15.82:0/507651815 conn(0x5624025a4be0 msgr2=0x56240266b330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:53:56.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.371+0000 7f5a6f989b80 1 -- 172.21.15.82:0/507651815 shutdown_connections 2024-05-08T05:53:56.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.371+0000 7f5a6f989b80 1 -- 172.21.15.82:0/507651815 wait complete. 2024-05-08T05:53:56.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.371+0000 7f5a6f989b80 1 -- start start 2024-05-08T05:53:56.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.371+0000 7f5a6f989b80 1 Processor -- start 2024-05-08T05:53:56.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.372+0000 7f5a6f989b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5624026760e0 0x562402693a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:56.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.372+0000 7f5a6f989b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562402676a00 0x562402693f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:56.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.372+0000 7f5a6f989b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56240267aa50 0x5624026944d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:56.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.372+0000 7f5a6f989b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5a601bdd60 con 0x562402676a00 2024-05-08T05:53:56.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.372+0000 7f5a6f989b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5a601bd690 con 0x5624026760e0 2024-05-08T05:53:56.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.372+0000 7f5a6f989b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5a601ba8c0 con 0x56240267aa50 2024-05-08T05:53:56.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.372+0000 7f5a6f989b80 10 client.0 _ll_register_callbacks cb 0x56240256fcf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:53:56.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.372+0000 7f5a5d400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5624026760e0 0x562402693a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:56.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.372+0000 7f5a5d400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5624026760e0 0x562402693a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:42832/0 (socket says 172.21.15.82:42832) 2024-05-08T05:53:56.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.372+0000 7f5a5d400700 1 -- 172.21.15.82:0/1508256095 learned_addr learned my addr 172.21.15.82:0/1508256095 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:53:56.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.372+0000 7f5a5de00700 1 --2- 172.21.15.82:0/1508256095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562402676a00 0x562402693f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:56.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.372+0000 7f5a5d400700 1 --2- 172.21.15.82:0/1508256095 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56240267aa50 0x5624026944d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:56.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.373+0000 7f5a5d400700 1 -- 172.21.15.82:0/1508256095 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56240267aa50 msgr2=0x5624026944d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:53:56.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.373+0000 7f5a5d400700 1 --2- 172.21.15.82:0/1508256095 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56240267aa50 0x5624026944d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:56.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.373+0000 7f5a5d400700 1 -- 172.21.15.82:0/1508256095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562402676a00 msgr2=0x562402693f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:53:56.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.373+0000 7f5a5d400700 1 --2- 172.21.15.82:0/1508256095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562402676a00 0x562402693f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:56.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.373+0000 7f5a5d400700 1 -- 172.21.15.82:0/1508256095 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624026fa010 con 0x5624026760e0 2024-05-08T05:53:56.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.373+0000 7f5a5de00700 1 --2- 172.21.15.82:0/1508256095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562402676a00 0x562402693f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:53:56.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.373+0000 7f5a5d400700 1 --2- 172.21.15.82:0/1508256095 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5624026760e0 0x562402693a50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c0098e0 tx=0x7f5a4c009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64fd4c44cf40c922 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:53:56.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.373+0000 7f5a3fe00700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:53:56.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.373+0000 7f5a3fe00700 1 -- 172.21.15.82:0/1508256095 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a4c005430 con 0x5624026760e0 2024-05-08T05:53:56.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.373+0000 7f5a3fe00700 1 -- 172.21.15.82:0/1508256095 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f5a4c0055d0 con 0x5624026760e0 2024-05-08T05:53:56.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.373+0000 7f5a6f989b80 1 -- 172.21.15.82:0/1508256095 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5a4c029410 con 0x5624026760e0 2024-05-08T05:53:56.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.374+0000 7f5a3fe00700 1 -- 172.21.15.82:0/1508256095 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f5a4c0057d0 con 0x5624026760e0 2024-05-08T05:53:56.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.374+0000 7f5a6f989b80 10 client.25574 fetch_fsmap learned FSMap version 31 2024-05-08T05:53:56.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.374+0000 7f5a6f989b80 1 -- 172.21.15.82:0/1508256095 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5624026fb350 con 0x5624026760e0 2024-05-08T05:53:56.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.374+0000 7f5a3fe00700 1 -- 172.21.15.82:0/1508256095 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5a4c029410 con 0x5624026760e0 2024-05-08T05:53:56.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.374+0000 7f5a3fe00700 1 -- 172.21.15.82:0/1508256095 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f5a4c043080 con 0x5624026760e0 2024-05-08T05:53:56.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.374+0000 7f5a6f989b80 10 client.25574 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:53:56.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.374+0000 7f5a6f989b80 10 client.25574 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:53:56.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.374+0000 7f5a6f989b80 20 client.25574 populate_metadata read hostname 'smithi082' 2024-05-08T05:53:56.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.374+0000 7f5a6f989b80 1 --2- 172.21.15.82:0/1508256095 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5624026fb8e0 0x5624026fdd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:53:56.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.374+0000 7f5a6f989b80 4 client.25574 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-08T05:53:56.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.374+0000 7f5a6f989b80 1 -- 172.21.15.82:0/1508256095 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5624025d6480 con 0x5624026fb8e0 2024-05-08T05:53:56.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.374+0000 7f5a5de00700 1 --2- 172.21.15.82:0/1508256095 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5624026fb8e0 0x5624026fdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:53:56.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.375+0000 7f5a3fe00700 10 client.25574 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:53:56.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.375+0000 7f5a5de00700 1 --2- 172.21.15.82:0/1508256095 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5624026fb8e0 0x5624026fdd00 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76d7d0f0ca4f7ad0 server_cookie=39fdae78939cd71d in_seq=0 out_seq=0 2024-05-08T05:53:56.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.376+0000 7f5a3fe00700 1 -- 172.21.15.82:0/1508256095 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5624025d6480 con 0x5624026fb8e0 2024-05-08T05:53:56.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.376+0000 7f5a3fe00700 10 client.25574 handle_command_reply: tid=0 2024-05-08T05:53:56.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.376+0000 7f5a6f989b80 1 client.25574 shutdown 2024-05-08T05:53:56.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.376+0000 7f5a6f989b80 1 -- 172.21.15.82:0/1508256095 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5624026760e0 msgr2=0x562402693a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:56.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.376+0000 7f5a6f989b80 1 --2- 172.21.15.82:0/1508256095 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5624026760e0 0x562402693a50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c0098e0 tx=0x7f5a4c009ca0 comp rx=0 tx=0).stop 2024-05-08T05:53:56.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.376+0000 7f5a6f989b80 1 -- 172.21.15.82:0/1508256095 shutdown_connections 2024-05-08T05:53:56.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.376+0000 7f5a6f989b80 1 --2- 172.21.15.82:0/1508256095 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5624026fb8e0 0x5624026fdd00 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:56.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.376+0000 7f5a6f989b80 1 --2- 172.21.15.82:0/1508256095 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5624026760e0 0x562402693a50 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:56.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.376+0000 7f5a6f989b80 1 --2- 172.21.15.82:0/1508256095 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56240267aa50 0x5624026944d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:56.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.376+0000 7f5a6f989b80 1 --2- 172.21.15.82:0/1508256095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562402676a00 0x562402693f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:56.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.376+0000 7f5a3fe00700 0 client.25574 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:53:56.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.376+0000 7f5a6f989b80 1 -- 172.21.15.82:0/1508256095 >> 172.21.15.82:0/1508256095 conn(0x5624025a4be0 msgr2=0x562402679340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:53:56.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.377+0000 7f5a6f989b80 1 -- 172.21.15.82:0/1508256095 shutdown_connections 2024-05-08T05:53:56.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.377+0000 7f5a6f989b80 1 -- 172.21.15.82:0/1508256095 wait complete. 2024-05-08T05:53:56.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.377+0000 7f5a6f989b80 20 client.25574 trim_cache size 0 max 16384 2024-05-08T05:53:56.379 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T05:53:56.379 INFO:teuthology.orchestra.run.smithi082.stdout: "return_code": 0, 2024-05-08T05:53:56.379 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_tag": "fd1883c0-4813-4138-81f5-c7c6d0faf3dd", 2024-05-08T05:53:56.379 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": "asynchronous" 2024-05-08T05:53:56.380 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T05:53:56.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.378+0000 7f5a65000700 1 -- 172.21.15.82:0/1149003982 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f5a440b29d0 msgr2=0x7f5a440b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:56.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.378+0000 7f5a65000700 1 --2- 172.21.15.82:0/1149003982 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f5a440b29d0 0x7f5a440b4e90 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5a58005c30 tx=0x7f5a5800b040 comp rx=0 tx=0).stop 2024-05-08T05:53:56.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.378+0000 7f5a65000700 1 -- 172.21.15.82:0/1149003982 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a60109630 msgr2=0x7f5a6006def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:53:56.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.378+0000 7f5a65000700 1 --2- 172.21.15.82:0/1149003982 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a60109630 0x7f5a6006def0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5a58007f10 tx=0x7f5a5800d3b0 comp rx=0 tx=0).stop 2024-05-08T05:53:56.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.378+0000 7f5a65000700 1 -- 172.21.15.82:0/1149003982 shutdown_connections 2024-05-08T05:53:56.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.378+0000 7f5a65000700 1 --2- 172.21.15.82:0/1149003982 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5a60109630 0x7f5a6006def0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:56.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.378+0000 7f5a65000700 1 --2- 172.21.15.82:0/1149003982 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f5a440b29d0 0x7f5a440b4e90 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:56.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.378+0000 7f5a65000700 1 --2- 172.21.15.82:0/1149003982 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5a60103520 0x7f5a60074c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:56.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.378+0000 7f5a65000700 1 --2- 172.21.15.82:0/1149003982 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a60103ee0 0x7f5a60075150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:53:56.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.378+0000 7f5a65000700 1 -- 172.21.15.82:0/1149003982 >> 172.21.15.82:0/1149003982 conn(0x7f5a6007a650 msgr2=0x7f5a60102000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:53:56.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.378+0000 7f5a65000700 1 -- 172.21.15.82:0/1149003982 shutdown_connections 2024-05-08T05:53:56.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:53:56.378+0000 7f5a65000700 1 -- 172.21.15.82:0/1149003982 wait complete. 2024-05-08T05:53:57.347 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-08T05:53:57.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:53:57 smithi082 ceph-mon[30098]: pgmap v558: 97 pgs: 97 active+clean; 1.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.7 MiB/s wr, 729 op/s 2024-05-08T05:53:57.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:53:57 smithi082 ceph-mon[30098]: scrub queued for path: / 2024-05-08T05:53:57.722 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:53:57 smithi082 ceph-mon[30098]: scrub summary: idle+waiting paths [/] 2024-05-08T05:53:57.722 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:53:57 smithi082 ceph-mon[30098]: scrub summary: active paths [/] 2024-05-08T05:53:57.722 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:53:57 smithi082 ceph-mon[30098]: scrub summary: active paths [/] 2024-05-08T05:53:57.722 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:53:57 smithi082 ceph-mon[30098]: scrub summary: idle+waiting paths [/] 2024-05-08T05:53:57.722 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:53:57 smithi082 ceph-mon[30098]: scrub summary: idle+waiting paths [/] 2024-05-08T05:53:57.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:53:57 smithi134 ceph-mon[34132]: pgmap v558: 97 pgs: 97 active+clean; 1.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.7 MiB/s wr, 729 op/s 2024-05-08T05:53:57.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:53:57 smithi134 ceph-mon[34132]: scrub queued for path: / 2024-05-08T05:53:57.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:53:57 smithi134 ceph-mon[34132]: scrub summary: idle+waiting paths [/] 2024-05-08T05:53:57.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:53:57 smithi134 ceph-mon[34132]: scrub summary: active paths [/] 2024-05-08T05:53:57.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:53:57 smithi134 ceph-mon[34132]: scrub summary: active paths [/] 2024-05-08T05:53:57.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:53:57 smithi134 ceph-mon[34132]: scrub summary: idle+waiting paths [/] 2024-05-08T05:53:57.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:53:57 smithi134 ceph-mon[34132]: scrub summary: idle+waiting paths [/] 2024-05-08T05:53:57.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:53:57 smithi151 ceph-mon[34815]: pgmap v558: 97 pgs: 97 active+clean; 1.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.7 MiB/s wr, 729 op/s 2024-05-08T05:53:57.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:53:57 smithi151 ceph-mon[34815]: scrub queued for path: / 2024-05-08T05:53:57.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:53:57 smithi151 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-05-08T05:53:57.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:53:57 smithi151 ceph-mon[34815]: scrub summary: active paths [/] 2024-05-08T05:53:57.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:53:57 smithi151 ceph-mon[34815]: scrub summary: active paths [/] 2024-05-08T05:53:57.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:53:57 smithi151 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-05-08T05:53:57.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:53:57 smithi151 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-05-08T05:53:57.949 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:53:59.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:53:59 smithi082 ceph-mon[30098]: pgmap v559: 97 pgs: 97 active+clean; 1.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.3 MiB/s wr, 775 op/s 2024-05-08T05:53:59.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:53:59 smithi134 ceph-mon[34132]: pgmap v559: 97 pgs: 97 active+clean; 1.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.3 MiB/s wr, 775 op/s 2024-05-08T05:53:59.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:53:59 smithi151 ceph-mon[34815]: pgmap v559: 97 pgs: 97 active+clean; 1.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.3 MiB/s wr, 775 op/s 2024-05-08T05:54:00.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.213+0000 7fa85ae00700 1 -- 172.21.15.82:0/444460073 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa854102550 msgr2=0x7fa854102930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:54:00.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.213+0000 7fa85ae00700 1 --2- 172.21.15.82:0/444460073 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa854102550 0x7fa854102930 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa8440099c0 tx=0x7fa844009cd0 comp rx=0 tx=0).stop 2024-05-08T05:54:00.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.213+0000 7fa85ae00700 1 -- 172.21.15.82:0/444460073 shutdown_connections 2024-05-08T05:54:00.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.213+0000 7fa85ae00700 1 --2- 172.21.15.82:0/444460073 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa854107630 0x7fa85410f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:00.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.213+0000 7fa85ae00700 1 --2- 172.21.15.82:0/444460073 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa854102550 0x7fa854102930 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:00.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.213+0000 7fa85ae00700 1 --2- 172.21.15.82:0/444460073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa854102f00 0x7fa854106f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:00.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.213+0000 7fa85ae00700 1 -- 172.21.15.82:0/444460073 >> 172.21.15.82:0/444460073 conn(0x7fa8540fde20 msgr2=0x7fa854100240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:54:00.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.213+0000 7fa85ae00700 1 -- 172.21.15.82:0/444460073 shutdown_connections 2024-05-08T05:54:00.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.213+0000 7fa85ae00700 1 -- 172.21.15.82:0/444460073 wait complete. 2024-05-08T05:54:00.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.215+0000 7fa85ae00700 1 Processor -- start 2024-05-08T05:54:00.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.215+0000 7fa85ae00700 1 -- start start 2024-05-08T05:54:00.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.215+0000 7fa85ae00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa854102550 0x7fa8541a00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:00.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.215+0000 7fa85ae00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa854102f00 0x7fa8541a0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:00.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.215+0000 7fa85ae00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa854107630 0x7fa8541a49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:00.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.215+0000 7fa85ae00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa8541114d0 con 0x7fa854102550 2024-05-08T05:54:00.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.216+0000 7fa85ae00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa854111350 con 0x7fa854107630 2024-05-08T05:54:00.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.216+0000 7fa85ae00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa854111650 con 0x7fa854102f00 2024-05-08T05:54:00.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.216+0000 7fa853400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa854102f00 0x7fa8541a0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:00.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.216+0000 7fa853400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa854102f00 0x7fa8541a0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:56044/0 (socket says 172.21.15.82:56044) 2024-05-08T05:54:00.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.216+0000 7fa853400700 1 -- 172.21.15.82:0/993980543 learned_addr learned my addr 172.21.15.82:0/993980543 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:54:00.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.216+0000 7fa858e00700 1 --2- 172.21.15.82:0/993980543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa854107630 0x7fa8541a49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:00.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.217+0000 7fa853400700 1 -- 172.21.15.82:0/993980543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa854107630 msgr2=0x7fa8541a49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:54:00.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.217+0000 7fa853400700 1 --2- 172.21.15.82:0/993980543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa854107630 0x7fa8541a49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:00.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.217+0000 7fa853400700 1 -- 172.21.15.82:0/993980543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa854102550 msgr2=0x7fa8541a00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:54:00.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.217+0000 7fa853400700 1 --2- 172.21.15.82:0/993980543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa854102550 0x7fa8541a00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:00.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.217+0000 7fa853400700 1 -- 172.21.15.82:0/993980543 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8541a5100 con 0x7fa854102f00 2024-05-08T05:54:00.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.218+0000 7fa853400700 1 --2- 172.21.15.82:0/993980543 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa854102f00 0x7fa8541a0630 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa84000c9e0 tx=0x7fa84000cda0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:54:00.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.219+0000 7fa850c00700 1 -- 172.21.15.82:0/993980543 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa840007aa0 con 0x7fa854102f00 2024-05-08T05:54:00.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.219+0000 7fa850c00700 1 -- 172.21.15.82:0/993980543 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa840007c40 con 0x7fa854102f00 2024-05-08T05:54:00.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.219+0000 7fa850c00700 1 -- 172.21.15.82:0/993980543 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa840018660 con 0x7fa854102f00 2024-05-08T05:54:00.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.219+0000 7fa85ae00700 1 -- 172.21.15.82:0/993980543 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8541a53f0 con 0x7fa854102f00 2024-05-08T05:54:00.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.219+0000 7fa85ae00700 1 -- 172.21.15.82:0/993980543 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8541acc70 con 0x7fa854102f00 2024-05-08T05:54:00.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.228+0000 7fa850c00700 1 -- 172.21.15.82:0/993980543 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fa840018800 con 0x7fa854102f00 2024-05-08T05:54:00.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.228+0000 7fa865866b80 1 Processor -- start 2024-05-08T05:54:00.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.229+0000 7fa865866b80 1 -- start start 2024-05-08T05:54:00.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.229+0000 7fa865866b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b011019e0 0x564b01101dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:00.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.229+0000 7fa865866b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b01102300 0x564b010fbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:00.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.229+0000 7fa865866b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b010fc600 0x564b010fca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:00.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.229+0000 7fa865866b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x564b0104ea20 con 0x564b010fc600 2024-05-08T05:54:00.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.229+0000 7fa865866b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564b00fec760 con 0x564b01102300 2024-05-08T05:54:00.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.229+0000 7fa865866b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564b0104a9e0 con 0x564b011019e0 2024-05-08T05:54:00.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.230+0000 7fa858e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b011019e0 0x564b01101dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:00.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.230+0000 7fa858e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b011019e0 0x564b01101dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:56046/0 (socket says 172.21.15.82:56046) 2024-05-08T05:54:00.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.230+0000 7fa858e00700 1 -- 172.21.15.82:0/813797667 learned_addr learned my addr 172.21.15.82:0/813797667 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:54:00.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.230+0000 7fa853e00700 1 --2- 172.21.15.82:0/813797667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b01102300 0x564b010fbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:00.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.230+0000 7fa858e00700 1 -- 172.21.15.82:0/813797667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b01102300 msgr2=0x564b010fbfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:54:00.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.230+0000 7fa858e00700 1 --2- 172.21.15.82:0/813797667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b01102300 0x564b010fbfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:00.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.230+0000 7fa858e00700 1 -- 172.21.15.82:0/813797667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b010fc600 msgr2=0x564b010fca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:54:00.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.230+0000 7fa853400700 1 --2- 172.21.15.82:0/813797667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b010fc600 0x564b010fca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:00.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.233+0000 7fa858e00700 1 --2- 172.21.15.82:0/813797667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b010fc600 0x564b010fca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:00.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.233+0000 7fa858e00700 1 -- 172.21.15.82:0/813797667 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b00f9b8d0 con 0x564b011019e0 2024-05-08T05:54:00.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.233+0000 7fa853400700 1 --2- 172.21.15.82:0/813797667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b010fc600 0x564b010fca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:54:00.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.233+0000 7fa850c00700 1 --2- 172.21.15.82:0/993980543 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fa8380b2940 0x7fa8380b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:00.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.234+0000 7fa850c00700 1 -- 172.21.15.82:0/993980543 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fa8400e2170 con 0x7fa854102f00 2024-05-08T05:54:00.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.234+0000 7fa858e00700 1 --2- 172.21.15.82:0/813797667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b011019e0 0x564b01101dc0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa84c009f20 tx=0x7fa84c009f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=327a149e8fd7c864 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:54:00.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.234+0000 7fa849600700 1 -- 172.21.15.82:0/813797667 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa84c01a070 con 0x564b011019e0 2024-05-08T05:54:00.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.234+0000 7fa849600700 1 -- 172.21.15.82:0/813797667 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa84c015410 con 0x564b011019e0 2024-05-08T05:54:00.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.234+0000 7fa849600700 1 -- 172.21.15.82:0/813797667 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa84c01a070 con 0x564b011019e0 2024-05-08T05:54:00.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.234+0000 7fa853e00700 1 --2- 172.21.15.82:0/993980543 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fa8380b2940 0x7fa8380b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:00.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.235+0000 7fa865866b80 1 -- 172.21.15.82:0/813797667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b011019e0 msgr2=0x564b01101dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:54:00.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.235+0000 7fa865866b80 1 --2- 172.21.15.82:0/813797667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b011019e0 0x564b01101dc0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa84c009f20 tx=0x7fa84c009f50 comp rx=0 tx=0).stop 2024-05-08T05:54:00.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.236+0000 7fa853e00700 1 --2- 172.21.15.82:0/993980543 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fa8380b2940 0x7fa8380b4e00 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa844009990 tx=0x7fa844000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:54:00.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.236+0000 7fa865866b80 1 -- 172.21.15.82:0/813797667 shutdown_connections 2024-05-08T05:54:00.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.236+0000 7fa865866b80 1 --2- 172.21.15.82:0/813797667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b010fc600 0x564b010fca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:00.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.236+0000 7fa865866b80 1 --2- 172.21.15.82:0/813797667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b011019e0 0x564b01101dc0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:00.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.236+0000 7fa865866b80 1 --2- 172.21.15.82:0/813797667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b01102300 0x564b010fbfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:00.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.236+0000 7fa865866b80 1 -- 172.21.15.82:0/813797667 >> 172.21.15.82:0/813797667 conn(0x564b0102ab60 msgr2=0x564b010f69b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:54:00.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.236+0000 7fa865866b80 1 -- 172.21.15.82:0/813797667 shutdown_connections 2024-05-08T05:54:00.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.237+0000 7fa865866b80 1 -- 172.21.15.82:0/813797667 wait complete. 2024-05-08T05:54:00.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.237+0000 7fa865866b80 1 -- start start 2024-05-08T05:54:00.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.237+0000 7fa865866b80 1 Processor -- start 2024-05-08T05:54:00.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.239+0000 7fa865866b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b010fc600 0x564b01107eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:00.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.239+0000 7fa865866b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b011019e0 0x564b01105250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:00.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.239+0000 7fa865866b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b01102300 0x564b01105790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:00.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.239+0000 7fa865866b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x564b01108db0 con 0x564b01102300 2024-05-08T05:54:00.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.239+0000 7fa865866b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564b00fb4b20 con 0x564b010fc600 2024-05-08T05:54:00.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.239+0000 7fa865866b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564b01108f30 con 0x564b011019e0 2024-05-08T05:54:00.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.239+0000 7fa853e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b010fc600 0x564b01107eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:00.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.239+0000 7fa865866b80 10 client.0 _ll_register_callbacks cb 0x564b00ff5c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:54:00.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.239+0000 7fa853e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b010fc600 0x564b01107eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:42874/0 (socket says 172.21.15.82:42874) 2024-05-08T05:54:00.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.239+0000 7fa858e00700 1 --2- 172.21.15.82:0/2380024761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b01102300 0x564b01105790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:00.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.239+0000 7fa853400700 1 --2- 172.21.15.82:0/2380024761 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b011019e0 0x564b01105250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:00.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.240+0000 7fa853e00700 1 -- 172.21.15.82:0/2380024761 learned_addr learned my addr 172.21.15.82:0/2380024761 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:54:00.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.240+0000 7fa853400700 1 -- 172.21.15.82:0/2380024761 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b010fc600 msgr2=0x564b01107eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:54:00.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.240+0000 7fa853400700 1 --2- 172.21.15.82:0/2380024761 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b010fc600 0x564b01107eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:00.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.240+0000 7fa853400700 1 -- 172.21.15.82:0/2380024761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b01102300 msgr2=0x564b01105790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:54:00.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.240+0000 7fa853400700 1 --2- 172.21.15.82:0/2380024761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b01102300 0x564b01105790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:00.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.240+0000 7fa853400700 1 -- 172.21.15.82:0/2380024761 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b01014420 con 0x564b011019e0 2024-05-08T05:54:00.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.241+0000 7fa853400700 1 --2- 172.21.15.82:0/2380024761 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b011019e0 0x564b01105250 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa8400dfcd0 tx=0x7fa84001f5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2378b5d985f3850e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:54:00.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.241+0000 7fa83e000700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:54:00.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.241+0000 7fa83e000700 1 -- 172.21.15.82:0/2380024761 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8400cc0f0 con 0x564b011019e0 2024-05-08T05:54:00.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.241+0000 7fa83e000700 1 -- 172.21.15.82:0/2380024761 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fa8400b2380 con 0x564b011019e0 2024-05-08T05:54:00.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.241+0000 7fa865866b80 1 -- 172.21.15.82:0/2380024761 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa84c015410 con 0x564b011019e0 2024-05-08T05:54:00.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.241+0000 7fa83e000700 1 -- 172.21.15.82:0/2380024761 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fa8400a9ea0 con 0x564b011019e0 2024-05-08T05:54:00.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.241+0000 7fa865866b80 10 client.25609 fetch_fsmap learned FSMap version 31 2024-05-08T05:54:00.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.241+0000 7fa865866b80 1 -- 172.21.15.82:0/2380024761 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x564b011134b0 con 0x564b011019e0 2024-05-08T05:54:00.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.242+0000 7fa83e000700 1 -- 172.21.15.82:0/2380024761 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa84c015410 con 0x564b011019e0 2024-05-08T05:54:00.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.242+0000 7fa83e000700 1 -- 172.21.15.82:0/2380024761 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fa840020030 con 0x564b011019e0 2024-05-08T05:54:00.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.243+0000 7fa865866b80 10 client.25609 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:54:00.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.243+0000 7fa865866b80 10 client.25609 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:54:00.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.243+0000 7fa865866b80 20 client.25609 populate_metadata read hostname 'smithi082' 2024-05-08T05:54:00.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.243+0000 7fa865866b80 1 --2- 172.21.15.82:0/2380024761 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x564b01115af0 0x564b01117ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:00.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.243+0000 7fa865866b80 4 client.25609 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:54:00.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.243+0000 7fa865866b80 1 -- 172.21.15.82:0/2380024761 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564b010c90a0 con 0x564b01115af0 2024-05-08T05:54:00.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.244+0000 7fa853e00700 1 --2- 172.21.15.82:0/2380024761 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x564b01115af0 0x564b01117ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:00.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.245+0000 7fa853e00700 1 --2- 172.21.15.82:0/2380024761 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x564b01115af0 0x564b01117ee0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb83f8c89c78472c server_cookie=dee80d712df9317 in_seq=0 out_seq=0 2024-05-08T05:54:00.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.245+0000 7fa83e000700 10 client.25609 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:54:00.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.246+0000 7fa83e000700 1 -- 172.21.15.82:0/2380024761 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564b010c90a0 con 0x564b01115af0 2024-05-08T05:54:00.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.246+0000 7fa83e000700 10 client.25609 handle_command_reply: tid=0 2024-05-08T05:54:00.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.246+0000 7fa865866b80 1 client.25609 shutdown 2024-05-08T05:54:00.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.246+0000 7fa865866b80 1 -- 172.21.15.82:0/2380024761 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b011019e0 msgr2=0x564b01105250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:54:00.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.246+0000 7fa865866b80 1 --2- 172.21.15.82:0/2380024761 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b011019e0 0x564b01105250 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa8400dfcd0 tx=0x7fa84001f5d0 comp rx=0 tx=0).stop 2024-05-08T05:54:00.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.247+0000 7fa865866b80 1 -- 172.21.15.82:0/2380024761 shutdown_connections 2024-05-08T05:54:00.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.247+0000 7fa865866b80 1 --2- 172.21.15.82:0/2380024761 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x564b01115af0 0x564b01117ee0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:00.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.247+0000 7fa865866b80 1 --2- 172.21.15.82:0/2380024761 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b010fc600 0x564b01107eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:00.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.247+0000 7fa865866b80 1 --2- 172.21.15.82:0/2380024761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b01102300 0x564b01105790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:00.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.247+0000 7fa865866b80 1 --2- 172.21.15.82:0/2380024761 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b011019e0 0x564b01105250 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:00.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.247+0000 7fa865866b80 1 -- 172.21.15.82:0/2380024761 >> 172.21.15.82:0/2380024761 conn(0x564b0102ab60 msgr2=0x564b010f1460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:54:00.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.247+0000 7fa83e000700 0 client.25609 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:54:00.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.247+0000 7fa865866b80 1 -- 172.21.15.82:0/2380024761 shutdown_connections 2024-05-08T05:54:00.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.247+0000 7fa865866b80 1 -- 172.21.15.82:0/2380024761 wait complete. 2024-05-08T05:54:00.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.248+0000 7fa865866b80 20 client.25609 trim_cache size 0 max 16384 2024-05-08T05:54:00.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 190.0 s, 2619.3 tps, lat 38.059 ms stddev 44.627 2024-05-08T05:54:00.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.291+0000 7fa865866b80 1 Processor -- start 2024-05-08T05:54:00.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.292+0000 7fa865866b80 1 -- start start 2024-05-08T05:54:00.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.292+0000 7fa865866b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b010fc600 0x564b01102df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:00.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.292+0000 7fa865866b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b01102300 0x564b0111d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:00.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.292+0000 7fa865866b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b01101420 0x564b0111dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:00.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.292+0000 7fa865866b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa8541b40d0 con 0x564b01102300 2024-05-08T05:54:00.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.292+0000 7fa865866b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa8541b5c10 con 0x564b01101420 2024-05-08T05:54:00.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.292+0000 7fa865866b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa8541b47a0 con 0x564b010fc600 2024-05-08T05:54:00.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.292+0000 7fa853e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b010fc600 0x564b01102df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:00.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.292+0000 7fa853e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b010fc600 0x564b01102df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:56070/0 (socket says 172.21.15.82:56070) 2024-05-08T05:54:00.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.292+0000 7fa853e00700 1 -- 172.21.15.82:0/1630926566 learned_addr learned my addr 172.21.15.82:0/1630926566 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:54:00.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.292+0000 7fa853400700 1 --2- 172.21.15.82:0/1630926566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b01102300 0x564b0111d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:00.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.292+0000 7fa858e00700 1 --2- 172.21.15.82:0/1630926566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b01101420 0x564b0111dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:00.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.293+0000 7fa853e00700 1 -- 172.21.15.82:0/1630926566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b01101420 msgr2=0x564b0111dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:54:00.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.293+0000 7fa853e00700 1 --2- 172.21.15.82:0/1630926566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b01101420 0x564b0111dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:00.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.293+0000 7fa853e00700 1 -- 172.21.15.82:0/1630926566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b01102300 msgr2=0x564b0111d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:54:00.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.293+0000 7fa853e00700 1 --2- 172.21.15.82:0/1630926566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b01102300 0x564b0111d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:00.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.293+0000 7fa853e00700 1 -- 172.21.15.82:0/1630926566 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b010f6760 con 0x564b010fc600 2024-05-08T05:54:00.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.293+0000 7fa853400700 1 --2- 172.21.15.82:0/1630926566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b01102300 0x564b0111d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:54:00.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.294+0000 7fa853e00700 1 --2- 172.21.15.82:0/1630926566 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b010fc600 0x564b01102df0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa844006010 tx=0x7fa84401a070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=315f481887701686 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:54:00.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.295+0000 7fa848c00700 1 -- 172.21.15.82:0/1630926566 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa84400b790 con 0x564b010fc600 2024-05-08T05:54:00.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.295+0000 7fa848c00700 1 -- 172.21.15.82:0/1630926566 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa84400bde0 con 0x564b010fc600 2024-05-08T05:54:00.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.295+0000 7fa848c00700 1 -- 172.21.15.82:0/1630926566 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa844023b30 con 0x564b010fc600 2024-05-08T05:54:00.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.296+0000 7fa865866b80 1 -- 172.21.15.82:0/1630926566 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b010fc600 msgr2=0x564b01102df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:54:00.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.296+0000 7fa865866b80 1 --2- 172.21.15.82:0/1630926566 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b010fc600 0x564b01102df0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa844006010 tx=0x7fa84401a070 comp rx=0 tx=0).stop 2024-05-08T05:54:00.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.296+0000 7fa865866b80 1 -- 172.21.15.82:0/1630926566 shutdown_connections 2024-05-08T05:54:00.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.296+0000 7fa865866b80 1 --2- 172.21.15.82:0/1630926566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b01101420 0x564b0111dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:00.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.296+0000 7fa865866b80 1 --2- 172.21.15.82:0/1630926566 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b010fc600 0x564b01102df0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:00.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.296+0000 7fa865866b80 1 --2- 172.21.15.82:0/1630926566 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b01102300 0x564b0111d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:00.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.296+0000 7fa865866b80 1 -- 172.21.15.82:0/1630926566 >> 172.21.15.82:0/1630926566 conn(0x564b0102ab60 msgr2=0x564b011026e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:54:00.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.297+0000 7fa865866b80 1 -- 172.21.15.82:0/1630926566 shutdown_connections 2024-05-08T05:54:00.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.297+0000 7fa865866b80 1 -- 172.21.15.82:0/1630926566 wait complete. 2024-05-08T05:54:00.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.297+0000 7fa865866b80 1 -- start start 2024-05-08T05:54:00.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.298+0000 7fa865866b80 1 Processor -- start 2024-05-08T05:54:00.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.299+0000 7fa865866b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b010fc600 0x564b0110d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:00.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.299+0000 7fa865866b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b01101420 0x564b0110d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:00.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.300+0000 7fa853e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b010fc600 0x564b0110d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:00.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.300+0000 7fa853e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b010fc600 0x564b0110d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:56084/0 (socket says 172.21.15.82:56084) 2024-05-08T05:54:00.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.300+0000 7fa865866b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b01102300 0x564b0110df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:00.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.300+0000 7fa865866b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa8541b5540 con 0x564b01102300 2024-05-08T05:54:00.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.300+0000 7fa865866b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa8541b4e70 con 0x564b01101420 2024-05-08T05:54:00.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.300+0000 7fa865866b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa8541b2070 con 0x564b010fc600 2024-05-08T05:54:00.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.300+0000 7fa865866b80 10 client.0 _ll_register_callbacks cb 0x564b00ff5c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:54:00.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.300+0000 7fa853e00700 1 -- 172.21.15.82:0/1718834349 learned_addr learned my addr 172.21.15.82:0/1718834349 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:54:00.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.301+0000 7fa853400700 1 --2- 172.21.15.82:0/1718834349 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b01101420 0x564b0110d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:00.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.301+0000 7fa853e00700 1 -- 172.21.15.82:0/1718834349 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b01101420 msgr2=0x564b0110d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:54:00.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.301+0000 7fa858e00700 1 --2- 172.21.15.82:0/1718834349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b01102300 0x564b0110df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:00.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.301+0000 7fa853e00700 1 --2- 172.21.15.82:0/1718834349 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b01101420 0x564b0110d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:00.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.301+0000 7fa853e00700 1 -- 172.21.15.82:0/1718834349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b01102300 msgr2=0x564b0110df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:54:00.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.302+0000 7fa853e00700 1 --2- 172.21.15.82:0/1718834349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b01102300 0x564b0110df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:00.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.302+0000 7fa853e00700 1 -- 172.21.15.82:0/1718834349 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b0110e720 con 0x564b010fc600 2024-05-08T05:54:00.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.302+0000 7fa858e00700 1 --2- 172.21.15.82:0/1718834349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b01102300 0x564b0110df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:54:00.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.303+0000 7fa853e00700 1 --2- 172.21.15.82:0/1718834349 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b010fc600 0x564b0110d3a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa844005850 tx=0x7fa844003cc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7664b8f7c3c8f39 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:54:00.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.303+0000 7fa83e000700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:54:00.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.303+0000 7fa83e000700 1 -- 172.21.15.82:0/1718834349 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa84403f060 con 0x564b010fc600 2024-05-08T05:54:00.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.303+0000 7fa83e000700 1 -- 172.21.15.82:0/1718834349 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fa8440239b0 con 0x564b010fc600 2024-05-08T05:54:00.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.304+0000 7fa865866b80 1 -- 172.21.15.82:0/1718834349 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa84400bde0 con 0x564b010fc600 2024-05-08T05:54:00.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.304+0000 7fa83e000700 1 -- 172.21.15.82:0/1718834349 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fa844023bb0 con 0x564b010fc600 2024-05-08T05:54:00.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.304+0000 7fa865866b80 10 client.25615 fetch_fsmap learned FSMap version 31 2024-05-08T05:54:00.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.304+0000 7fa865866b80 1 -- 172.21.15.82:0/1718834349 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x564b01191e70 con 0x564b010fc600 2024-05-08T05:54:00.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.305+0000 7fa83e000700 1 -- 172.21.15.82:0/1718834349 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa84400bde0 con 0x564b010fc600 2024-05-08T05:54:00.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.305+0000 7fa83e000700 1 -- 172.21.15.82:0/1718834349 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fa844031860 con 0x564b010fc600 2024-05-08T05:54:00.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.305+0000 7fa865866b80 10 client.25615 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:54:00.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.305+0000 7fa865866b80 10 client.25615 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:54:00.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.306+0000 7fa865866b80 20 client.25615 populate_metadata read hostname 'smithi082' 2024-05-08T05:54:00.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.306+0000 7fa865866b80 1 --2- 172.21.15.82:0/1718834349 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x564b01192410 0x564b01194830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:00.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.306+0000 7fa865866b80 4 client.25615 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-08T05:54:00.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.306+0000 7fa865866b80 1 -- 172.21.15.82:0/1718834349 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564b0105c400 con 0x564b01192410 2024-05-08T05:54:00.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.306+0000 7fa853400700 1 --2- 172.21.15.82:0/1718834349 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x564b01192410 0x564b01194830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:00.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.307+0000 7fa83e000700 10 client.25615 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:54:00.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.307+0000 7fa853400700 1 --2- 172.21.15.82:0/1718834349 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x564b01192410 0x564b01194830 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f57fe30d682b585c server_cookie=424f5f17489b8c43 in_seq=0 out_seq=0 2024-05-08T05:54:00.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.308+0000 7fa83e000700 1 -- 172.21.15.82:0/1718834349 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x564b0105c400 con 0x564b01192410 2024-05-08T05:54:00.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.308+0000 7fa83e000700 10 client.25615 handle_command_reply: tid=0 2024-05-08T05:54:00.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.308+0000 7fa865866b80 1 client.25615 shutdown 2024-05-08T05:54:00.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.308+0000 7fa865866b80 1 -- 172.21.15.82:0/1718834349 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b010fc600 msgr2=0x564b0110d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:54:00.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.308+0000 7fa865866b80 1 --2- 172.21.15.82:0/1718834349 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b010fc600 0x564b0110d3a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa844005850 tx=0x7fa844003cc0 comp rx=0 tx=0).stop 2024-05-08T05:54:00.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.308+0000 7fa865866b80 1 -- 172.21.15.82:0/1718834349 shutdown_connections 2024-05-08T05:54:00.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.308+0000 7fa865866b80 1 --2- 172.21.15.82:0/1718834349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b01102300 0x564b0110df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:00.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.308+0000 7fa865866b80 1 --2- 172.21.15.82:0/1718834349 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b010fc600 0x564b0110d3a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:00.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.308+0000 7fa865866b80 1 --2- 172.21.15.82:0/1718834349 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x564b01192410 0x564b01194830 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:00.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.308+0000 7fa865866b80 1 --2- 172.21.15.82:0/1718834349 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b01101420 0x564b0110d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:00.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.308+0000 7fa865866b80 1 -- 172.21.15.82:0/1718834349 >> 172.21.15.82:0/1718834349 conn(0x564b0102ab60 msgr2=0x564b010f0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:54:00.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.308+0000 7fa83e000700 0 client.25615 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:54:00.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.309+0000 7fa865866b80 1 -- 172.21.15.82:0/1718834349 shutdown_connections 2024-05-08T05:54:00.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.309+0000 7fa865866b80 1 -- 172.21.15.82:0/1718834349 wait complete. 2024-05-08T05:54:00.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.309+0000 7fa865866b80 20 client.25615 trim_cache size 0 max 16384 2024-05-08T05:54:00.310 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T05:54:00.310 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-08T05:54:00.310 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2024-05-08T05:54:00.310 INFO:teuthology.orchestra.run.smithi082.stdout: "fd1883c0-4813-4138-81f5-c7c6d0faf3dd": { 2024-05-08T05:54:00.310 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2024-05-08T05:54:00.310 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "fd1883c0-4813-4138-81f5-c7c6d0faf3dd", 2024-05-08T05:54:00.310 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2024-05-08T05:54:00.310 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T05:54:00.310 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T05:54:00.311 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T05:54:00.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.310+0000 7fa85ae00700 1 -- 172.21.15.82:0/993980543 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fa8380b2940 msgr2=0x7fa8380b4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:54:00.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.310+0000 7fa85ae00700 1 --2- 172.21.15.82:0/993980543 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fa8380b2940 0x7fa8380b4e00 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa844009990 tx=0x7fa844000bc0 comp rx=0 tx=0).stop 2024-05-08T05:54:00.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.310+0000 7fa85ae00700 1 -- 172.21.15.82:0/993980543 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa854102f00 msgr2=0x7fa8541a0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:54:00.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.310+0000 7fa85ae00700 1 --2- 172.21.15.82:0/993980543 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa854102f00 0x7fa8541a0630 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa84000c9e0 tx=0x7fa84000cda0 comp rx=0 tx=0).stop 2024-05-08T05:54:00.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.310+0000 7fa85ae00700 1 -- 172.21.15.82:0/993980543 shutdown_connections 2024-05-08T05:54:00.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.310+0000 7fa85ae00700 1 --2- 172.21.15.82:0/993980543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa854107630 0x7fa8541a49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:00.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.310+0000 7fa85ae00700 1 --2- 172.21.15.82:0/993980543 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fa8380b2940 0x7fa8380b4e00 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:00.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.310+0000 7fa85ae00700 1 --2- 172.21.15.82:0/993980543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa854102550 0x7fa8541a00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:00.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.310+0000 7fa85ae00700 1 --2- 172.21.15.82:0/993980543 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa854102f00 0x7fa8541a0630 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:00.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.310+0000 7fa85ae00700 1 -- 172.21.15.82:0/993980543 >> 172.21.15.82:0/993980543 conn(0x7fa8540fde20 msgr2=0x7fa8540fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:54:00.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.311+0000 7fa85ae00700 1 -- 172.21.15.82:0/993980543 shutdown_connections 2024-05-08T05:54:00.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:00.311+0000 7fa85ae00700 1 -- 172.21.15.82:0/993980543 wait complete. 2024-05-08T05:54:01.150 INFO:tasks.cephfs.filesystem:scrub status for tag:fd1883c0-4813-4138-81f5-c7c6d0faf3dd - {'path': '/', 'tag': 'fd1883c0-4813-4138-81f5-c7c6d0faf3dd', 'options': 'recursive,force'} 2024-05-08T05:54:01.431 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:54:01 smithi082 ceph-mon[30098]: pgmap v560: 97 pgs: 97 active+clean; 1.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 12 MiB/s wr, 837 op/s 2024-05-08T05:54:01.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:54:01 smithi134 ceph-mon[34132]: pgmap v560: 97 pgs: 97 active+clean; 1.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 12 MiB/s wr, 837 op/s 2024-05-08T05:54:01.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:54:01 smithi151 ceph-mon[34815]: pgmap v560: 97 pgs: 97 active+clean; 1.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 12 MiB/s wr, 837 op/s 2024-05-08T05:54:03.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:54:03 smithi082 ceph-mon[30098]: pgmap v561: 97 pgs: 97 active+clean; 1.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.9 MiB/s wr, 648 op/s 2024-05-08T05:54:03.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:54:03 smithi134 ceph-mon[34132]: pgmap v561: 97 pgs: 97 active+clean; 1.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.9 MiB/s wr, 648 op/s 2024-05-08T05:54:03.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:54:03 smithi151 ceph-mon[34815]: pgmap v561: 97 pgs: 97 active+clean; 1.2 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.9 MiB/s wr, 648 op/s 2024-05-08T05:54:05.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 195.0 s, 2978.0 tps, lat 33.678 ms stddev 40.331 2024-05-08T05:54:05.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:54:05 smithi082 ceph-mon[30098]: pgmap v562: 97 pgs: 97 active+clean; 1.2 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 9.2 MiB/s wr, 693 op/s 2024-05-08T05:54:05.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:54:05 smithi082 ceph-mon[30098]: scrub summary: idle 2024-05-08T05:54:05.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:54:05 smithi134 ceph-mon[34132]: pgmap v562: 97 pgs: 97 active+clean; 1.2 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 9.2 MiB/s wr, 693 op/s 2024-05-08T05:54:05.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:54:05 smithi134 ceph-mon[34132]: scrub summary: idle 2024-05-08T05:54:05.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:54:05 smithi151 ceph-mon[34815]: pgmap v562: 97 pgs: 97 active+clean; 1.2 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 9.2 MiB/s wr, 693 op/s 2024-05-08T05:54:05.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:54:05 smithi151 ceph-mon[34815]: scrub summary: idle 2024-05-08T05:54:06.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:54:06 smithi082 ceph-mon[30098]: scrub summary: idle 2024-05-08T05:54:06.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:54:06 smithi134 ceph-mon[34132]: scrub summary: idle 2024-05-08T05:54:06.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:54:06 smithi151 ceph-mon[34815]: scrub summary: idle 2024-05-08T05:54:07.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:54:07 smithi082 ceph-mon[30098]: pgmap v563: 97 pgs: 97 active+clean; 1.2 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 9.9 MiB/s wr, 736 op/s 2024-05-08T05:54:07.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:54:07 smithi134 ceph-mon[34132]: pgmap v563: 97 pgs: 97 active+clean; 1.2 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 9.9 MiB/s wr, 736 op/s 2024-05-08T05:54:07.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:54:07 smithi151 ceph-mon[34815]: pgmap v563: 97 pgs: 97 active+clean; 1.2 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 9.9 MiB/s wr, 736 op/s 2024-05-08T05:54:09.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:54:09 smithi082 ceph-mon[30098]: pgmap v564: 97 pgs: 97 active+clean; 1.2 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.5 MiB/s wr, 701 op/s 2024-05-08T05:54:09.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:54:09 smithi134 ceph-mon[34132]: pgmap v564: 97 pgs: 97 active+clean; 1.2 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.5 MiB/s wr, 701 op/s 2024-05-08T05:54:09.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:54:09 smithi151 ceph-mon[34815]: pgmap v564: 97 pgs: 97 active+clean; 1.2 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.5 MiB/s wr, 701 op/s 2024-05-08T05:54:10.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 200.0 s, 3018.0 tps, lat 33.154 ms stddev 37.670 2024-05-08T05:54:11.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:54:11 smithi082 ceph-mon[30098]: pgmap v565: 97 pgs: 97 active+clean; 1.2 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 MiB/s wr, 784 op/s 2024-05-08T05:54:11.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:54:11 smithi134 ceph-mon[34132]: pgmap v565: 97 pgs: 97 active+clean; 1.2 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 MiB/s wr, 784 op/s 2024-05-08T05:54:11.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:54:11 smithi151 ceph-mon[34815]: pgmap v565: 97 pgs: 97 active+clean; 1.2 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 10 MiB/s wr, 784 op/s 2024-05-08T05:54:13.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:54:13 smithi082 ceph-mon[30098]: pgmap v566: 97 pgs: 97 active+clean; 1.2 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.3 MiB/s wr, 721 op/s 2024-05-08T05:54:13.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:54:13 smithi134 ceph-mon[34132]: pgmap v566: 97 pgs: 97 active+clean; 1.2 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.3 MiB/s wr, 721 op/s 2024-05-08T05:54:13.881 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:54:13 smithi151 ceph-mon[34815]: pgmap v566: 97 pgs: 97 active+clean; 1.2 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.3 MiB/s wr, 721 op/s 2024-05-08T05:54:15.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 205.0 s, 2368.2 tps, lat 41.892 ms stddev 46.270 2024-05-08T05:54:15.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:54:15 smithi082 ceph-mon[30098]: pgmap v567: 97 pgs: 97 active+clean; 1.2 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 8.7 MiB/s wr, 770 op/s 2024-05-08T05:54:15.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:54:15 smithi134 ceph-mon[34132]: pgmap v567: 97 pgs: 97 active+clean; 1.2 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 8.7 MiB/s wr, 770 op/s 2024-05-08T05:54:15.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:54:15 smithi151 ceph-mon[34815]: pgmap v567: 97 pgs: 97 active+clean; 1.2 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 8.7 MiB/s wr, 770 op/s 2024-05-08T05:54:17.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:54:17 smithi134 ceph-mon[34132]: pgmap v568: 97 pgs: 97 active+clean; 1.2 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 8.7 MiB/s wr, 751 op/s 2024-05-08T05:54:17.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:54:17 smithi151 ceph-mon[34815]: pgmap v568: 97 pgs: 97 active+clean; 1.2 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 8.7 MiB/s wr, 751 op/s 2024-05-08T05:54:17.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:54:17 smithi082 ceph-mon[30098]: pgmap v568: 97 pgs: 97 active+clean; 1.2 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 8.7 MiB/s wr, 751 op/s 2024-05-08T05:54:19.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:54:19 smithi134 ceph-mon[34132]: pgmap v569: 97 pgs: 97 active+clean; 1.2 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.0 MiB/s wr, 688 op/s 2024-05-08T05:54:19.773 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:54:19 smithi082 ceph-mon[30098]: pgmap v569: 97 pgs: 97 active+clean; 1.2 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.0 MiB/s wr, 688 op/s 2024-05-08T05:54:19.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:54:19 smithi151 ceph-mon[34815]: pgmap v569: 97 pgs: 97 active+clean; 1.2 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.0 MiB/s wr, 688 op/s 2024-05-08T05:54:20.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 210.0 s, 2551.2 tps, lat 39.460 ms stddev 44.465 2024-05-08T05:54:21.689 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:54:21 smithi082 ceph-mon[30098]: pgmap v570: 97 pgs: 97 active+clean; 1.2 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.0 MiB/s wr, 788 op/s 2024-05-08T05:54:21.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:54:21 smithi134 ceph-mon[34132]: pgmap v570: 97 pgs: 97 active+clean; 1.2 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.0 MiB/s wr, 788 op/s 2024-05-08T05:54:21.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:54:21 smithi151 ceph-mon[34815]: pgmap v570: 97 pgs: 97 active+clean; 1.2 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.0 MiB/s wr, 788 op/s 2024-05-08T05:54:23.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:54:23 smithi134 ceph-mon[34132]: pgmap v571: 97 pgs: 97 active+clean; 1.2 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.7 MiB/s wr, 669 op/s 2024-05-08T05:54:23.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:54:23 smithi151 ceph-mon[34815]: pgmap v571: 97 pgs: 97 active+clean; 1.2 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.7 MiB/s wr, 669 op/s 2024-05-08T05:54:23.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:54:23 smithi082 ceph-mon[30098]: pgmap v571: 97 pgs: 97 active+clean; 1.2 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.7 MiB/s wr, 669 op/s 2024-05-08T05:54:25.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 215.0 s, 2377.6 tps, lat 41.973 ms stddev 50.000 2024-05-08T05:54:25.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:54:25 smithi134 ceph-mon[34132]: pgmap v572: 97 pgs: 97 active+clean; 1.2 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 5.9 MiB/s wr, 611 op/s 2024-05-08T05:54:25.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:54:25 smithi151 ceph-mon[34815]: pgmap v572: 97 pgs: 97 active+clean; 1.2 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 5.9 MiB/s wr, 611 op/s 2024-05-08T05:54:25.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:54:25 smithi082 ceph-mon[30098]: pgmap v572: 97 pgs: 97 active+clean; 1.2 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 5.9 MiB/s wr, 611 op/s 2024-05-08T05:54:27.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:54:27 smithi151 ceph-mon[34815]: pgmap v573: 97 pgs: 97 active+clean; 1.2 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 11 MiB/s wr, 733 op/s 2024-05-08T05:54:27.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:54:27 smithi082 ceph-mon[30098]: pgmap v573: 97 pgs: 97 active+clean; 1.2 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 11 MiB/s wr, 733 op/s 2024-05-08T05:54:27.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:54:27 smithi134 ceph-mon[34132]: pgmap v573: 97 pgs: 97 active+clean; 1.2 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 11 MiB/s wr, 733 op/s 2024-05-08T05:54:28.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:54:28 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:54:28.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:54:28 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:54:28.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:54:28 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:54:29.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:54:29 smithi151 ceph-mon[34815]: pgmap v574: 97 pgs: 97 active+clean; 1.2 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 14 MiB/s wr, 721 op/s 2024-05-08T05:54:29.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:54:29 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:54:29.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:54:29 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:54:29.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:54:29 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:54:29.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:54:29 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:54:29.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:54:29 smithi151 ceph-mon[34815]: Adjusting osd_memory_target on smithi134 to 176.2M 2024-05-08T05:54:29.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:54:29 smithi151 ceph-mon[34815]: Unable to set osd_memory_target on smithi134 to 184791040: error parsing value: Value '184791040' is below minimum 939524096 2024-05-08T05:54:29.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:54:29 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:54:29.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:54:29 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:54:29.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:54:29 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:54:29.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:54:29 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:54:29.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:54:29 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:54:29.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:54:29 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:54:29.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:54:29 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:54:29.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:54:29 smithi082 ceph-mon[30098]: pgmap v574: 97 pgs: 97 active+clean; 1.2 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 14 MiB/s wr, 721 op/s 2024-05-08T05:54:29.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:54:29 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:54:29.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:54:29 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:54:29.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:54:29 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:54:29.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:54:29 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:54:29.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:54:29 smithi082 ceph-mon[30098]: Adjusting osd_memory_target on smithi134 to 176.2M 2024-05-08T05:54:29.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:54:29 smithi082 ceph-mon[30098]: Unable to set osd_memory_target on smithi134 to 184791040: error parsing value: Value '184791040' is below minimum 939524096 2024-05-08T05:54:29.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:54:29 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:54:29.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:54:29 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:54:29.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:54:29 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:54:29.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:54:29 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:54:29.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:54:29 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:54:29.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:54:29 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:54:29.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:54:29 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:54:30.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:54:29 smithi134 ceph-mon[34132]: pgmap v574: 97 pgs: 97 active+clean; 1.2 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 14 MiB/s wr, 721 op/s 2024-05-08T05:54:30.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:54:29 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:54:30.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:54:29 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:54:30.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:54:29 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:54:30.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:54:29 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:54:30.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:54:29 smithi134 ceph-mon[34132]: Adjusting osd_memory_target on smithi134 to 176.2M 2024-05-08T05:54:30.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:54:29 smithi134 ceph-mon[34132]: Unable to set osd_memory_target on smithi134 to 184791040: error parsing value: Value '184791040' is below minimum 939524096 2024-05-08T05:54:30.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:54:29 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:54:30.002 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:54:29 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:54:30.002 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:54:29 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:54:30.002 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:54:29 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:54:30.002 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:54:29 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:54:30.002 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:54:29 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:54:30.002 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:54:29 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:54:30.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 220.0 s, 2145.8 tps, lat 46.509 ms stddev 59.151 2024-05-08T05:54:30.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:54:30 smithi151 ceph-mon[34815]: Adjusting osd_memory_target on smithi082 to 176.4M 2024-05-08T05:54:30.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:54:30 smithi151 ceph-mon[34815]: Unable to set osd_memory_target on smithi082 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-05-08T05:54:30.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:54:30 smithi082 ceph-mon[30098]: Adjusting osd_memory_target on smithi082 to 176.4M 2024-05-08T05:54:30.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:54:30 smithi082 ceph-mon[30098]: Unable to set osd_memory_target on smithi082 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-05-08T05:54:31.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:54:30 smithi134 ceph-mon[34132]: Adjusting osd_memory_target on smithi082 to 176.4M 2024-05-08T05:54:31.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:54:30 smithi134 ceph-mon[34132]: Unable to set osd_memory_target on smithi082 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-05-08T05:54:31.151 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-08T05:54:31.694 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:54:31.861 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:54:31 smithi082 ceph-mon[30098]: pgmap v575: 97 pgs: 97 active+clean; 1.3 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 24 MiB/s wr, 884 op/s 2024-05-08T05:54:31.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:54:31 smithi151 ceph-mon[34815]: pgmap v575: 97 pgs: 97 active+clean; 1.3 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 24 MiB/s wr, 884 op/s 2024-05-08T05:54:31.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:54:31 smithi134 ceph-mon[34132]: pgmap v575: 97 pgs: 97 active+clean; 1.3 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 24 MiB/s wr, 884 op/s 2024-05-08T05:54:33.796 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:54:33 smithi082 ceph-mon[30098]: pgmap v576: 97 pgs: 97 active+clean; 1.3 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 26 MiB/s wr, 802 op/s 2024-05-08T05:54:33.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:54:33 smithi151 ceph-mon[34815]: pgmap v576: 97 pgs: 97 active+clean; 1.3 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 26 MiB/s wr, 802 op/s 2024-05-08T05:54:33.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:54:33 smithi134 ceph-mon[34132]: pgmap v576: 97 pgs: 97 active+clean; 1.3 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 26 MiB/s wr, 802 op/s 2024-05-08T05:54:34.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.302+0000 7fd8d8c00700 1 -- 172.21.15.82:0/1415203332 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8d410f780 msgr2=0x7fd8d410a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:54:34.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.302+0000 7fd8d8c00700 1 --2- 172.21.15.82:0/1415203332 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8d410f780 0x7fd8d410a4a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd8c40099c0 tx=0x7fd8c4009cd0 comp rx=0 tx=0).stop 2024-05-08T05:54:34.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.303+0000 7fd8d8c00700 1 -- 172.21.15.82:0/1415203332 shutdown_connections 2024-05-08T05:54:34.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.303+0000 7fd8d8c00700 1 --2- 172.21.15.82:0/1415203332 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8d4114d80 0x7fd8d4117170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:34.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.303+0000 7fd8d8c00700 1 --2- 172.21.15.82:0/1415203332 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8d410f780 0x7fd8d410a4a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:34.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.303+0000 7fd8d8c00700 1 --2- 172.21.15.82:0/1415203332 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8d410a9e0 0x7fd8d410ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:34.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.303+0000 7fd8d8c00700 1 -- 172.21.15.82:0/1415203332 >> 172.21.15.82:0/1415203332 conn(0x7fd8d406e9f0 msgr2=0x7fd8d406ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:54:34.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.303+0000 7fd8d8c00700 1 -- 172.21.15.82:0/1415203332 shutdown_connections 2024-05-08T05:54:34.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.303+0000 7fd8d8c00700 1 -- 172.21.15.82:0/1415203332 wait complete. 2024-05-08T05:54:34.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.305+0000 7fd8d8c00700 1 Processor -- start 2024-05-08T05:54:34.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.305+0000 7fd8d8c00700 1 -- start start 2024-05-08T05:54:34.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.305+0000 7fd8d8c00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8d410a9e0 0x7fd8d41a2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:34.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.305+0000 7fd8d8c00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8d410f780 0x7fd8d41a28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:34.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.306+0000 7fd8d8c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8d4114d80 0x7fd8d41a6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:34.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.306+0000 7fd8d8c00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d411ae10 con 0x7fd8d4114d80 2024-05-08T05:54:34.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.306+0000 7fd8d8c00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d411ac90 con 0x7fd8d410f780 2024-05-08T05:54:34.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.306+0000 7fd8d8c00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d411af90 con 0x7fd8d410a9e0 2024-05-08T05:54:34.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.307+0000 7fd8d1e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8d410a9e0 0x7fd8d41a2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:34.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.307+0000 7fd8d1400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8d410f780 0x7fd8d41a28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:34.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.307+0000 7fd8d2800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8d4114d80 0x7fd8d41a6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:34.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.307+0000 7fd8d2800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8d4114d80 0x7fd8d41a6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43814/0 (socket says 172.21.15.82:43814) 2024-05-08T05:54:34.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.307+0000 7fd8d2800700 1 -- 172.21.15.82:0/2820214572 learned_addr learned my addr 172.21.15.82:0/2820214572 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:54:34.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.308+0000 7fd8d1400700 1 -- 172.21.15.82:0/2820214572 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8d410a9e0 msgr2=0x7fd8d41a2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:54:34.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.308+0000 7fd8d1400700 1 --2- 172.21.15.82:0/2820214572 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8d410a9e0 0x7fd8d41a2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:34.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.308+0000 7fd8d1400700 1 -- 172.21.15.82:0/2820214572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8d4114d80 msgr2=0x7fd8d41a6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:54:34.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.308+0000 7fd8d1400700 1 --2- 172.21.15.82:0/2820214572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8d4114d80 0x7fd8d41a6c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:34.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.308+0000 7fd8d1400700 1 -- 172.21.15.82:0/2820214572 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8d41a7370 con 0x7fd8d410f780 2024-05-08T05:54:34.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.309+0000 7fd8d1400700 1 --2- 172.21.15.82:0/2820214572 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8d410f780 0x7fd8d41a28a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd8c000e9f0 tx=0x7fd8c000ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:54:34.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.310+0000 7fd8caa00700 1 -- 172.21.15.82:0/2820214572 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c000cbd0 con 0x7fd8d410f780 2024-05-08T05:54:34.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.310+0000 7fd8caa00700 1 -- 172.21.15.82:0/2820214572 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8c00044d0 con 0x7fd8d410f780 2024-05-08T05:54:34.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.310+0000 7fd8caa00700 1 -- 172.21.15.82:0/2820214572 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c0005280 con 0x7fd8d410f780 2024-05-08T05:54:34.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.310+0000 7fd8d8c00700 1 -- 172.21.15.82:0/2820214572 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8d41a7660 con 0x7fd8d410f780 2024-05-08T05:54:34.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.310+0000 7fd8d8c00700 1 -- 172.21.15.82:0/2820214572 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8d4115160 con 0x7fd8d410f780 2024-05-08T05:54:34.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.317+0000 7fd8caa00700 1 -- 172.21.15.82:0/2820214572 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fd8c0005420 con 0x7fd8d410f780 2024-05-08T05:54:34.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.320+0000 7fd8caa00700 1 --2- 172.21.15.82:0/2820214572 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd8b80b2900 0x7fd8b80b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:34.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.321+0000 7fd8e3660b80 1 Processor -- start 2024-05-08T05:54:34.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.321+0000 7fd8caa00700 1 -- 172.21.15.82:0/2820214572 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd8c00e2110 con 0x7fd8d410f780 2024-05-08T05:54:34.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.322+0000 7fd8e3660b80 1 -- start start 2024-05-08T05:54:34.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.322+0000 7fd8d1e00700 1 --2- 172.21.15.82:0/2820214572 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd8b80b2900 0x7fd8b80b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:34.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.322+0000 7fd8e3660b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc04f75060 0x55dc04f75440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:34.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.322+0000 7fd8e3660b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc04f75980 0x55dc04f79490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:34.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.323+0000 7fd8e3660b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc04f799d0 0x55dc04f79e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:34.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.323+0000 7fd8e3660b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55dc04ec7a20 con 0x55dc04f75060 2024-05-08T05:54:34.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.323+0000 7fd8e3660b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55dc04e65760 con 0x55dc04f75980 2024-05-08T05:54:34.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.323+0000 7fd8e3660b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55dc04ec39e0 con 0x55dc04f799d0 2024-05-08T05:54:34.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.323+0000 7fd8d1400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc04f75980 0x55dc04f79490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:34.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.323+0000 7fd8d2800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc04f799d0 0x55dc04f79e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:34.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.323+0000 7fd8d1400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc04f75980 0x55dc04f79490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:49036/0 (socket says 172.21.15.82:49036) 2024-05-08T05:54:34.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.323+0000 7fd8d2800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc04f799d0 0x55dc04f79e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:56660/0 (socket says 172.21.15.82:56660) 2024-05-08T05:54:34.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.323+0000 7fd8d1400700 1 -- 172.21.15.82:0/3372712473 learned_addr learned my addr 172.21.15.82:0/3372712473 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:54:34.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.323+0000 7fd8d1e00700 1 --2- 172.21.15.82:0/3372712473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc04f75060 0x55dc04f75440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:34.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.324+0000 7fd8d2800700 1 -- 172.21.15.82:0/3372712473 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc04f75980 msgr2=0x55dc04f79490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:54:34.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.324+0000 7fd8d2800700 1 --2- 172.21.15.82:0/3372712473 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc04f75980 0x55dc04f79490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:34.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.324+0000 7fd8d2800700 1 -- 172.21.15.82:0/3372712473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc04f75060 msgr2=0x55dc04f75440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:54:34.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.324+0000 7fd8d2800700 1 --2- 172.21.15.82:0/3372712473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc04f75060 0x55dc04f75440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:34.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.324+0000 7fd8d2800700 1 -- 172.21.15.82:0/3372712473 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc04e148d0 con 0x55dc04f799d0 2024-05-08T05:54:34.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.324+0000 7fd8d2800700 1 --2- 172.21.15.82:0/3372712473 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc04f799d0 0x55dc04f79e30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc0093f0 tx=0x7fd8cc009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d761a405393ee33 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:54:34.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.324+0000 7fd8bf400700 1 -- 172.21.15.82:0/3372712473 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8cc007e60 con 0x55dc04f799d0 2024-05-08T05:54:34.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.324+0000 7fd8bf400700 1 -- 172.21.15.82:0/3372712473 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8cc004bb0 con 0x55dc04f799d0 2024-05-08T05:54:34.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.325+0000 7fd8bf400700 1 -- 172.21.15.82:0/3372712473 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8cc014640 con 0x55dc04f799d0 2024-05-08T05:54:34.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.325+0000 7fd8e3660b80 1 -- 172.21.15.82:0/3372712473 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc04f799d0 msgr2=0x55dc04f79e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:54:34.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.325+0000 7fd8e3660b80 1 --2- 172.21.15.82:0/3372712473 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc04f799d0 0x55dc04f79e30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc0093f0 tx=0x7fd8cc009920 comp rx=0 tx=0).stop 2024-05-08T05:54:34.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.325+0000 7fd8d1e00700 1 --2- 172.21.15.82:0/2820214572 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd8b80b2900 0x7fd8b80b4dc0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd8c4006010 tx=0x7fd8c4005c60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:54:34.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.326+0000 7fd8e3660b80 1 -- 172.21.15.82:0/3372712473 shutdown_connections 2024-05-08T05:54:34.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.326+0000 7fd8e3660b80 1 --2- 172.21.15.82:0/3372712473 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc04f799d0 0x55dc04f79e30 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:34.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.326+0000 7fd8e3660b80 1 --2- 172.21.15.82:0/3372712473 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc04f75060 0x55dc04f75440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:34.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.326+0000 7fd8e3660b80 1 --2- 172.21.15.82:0/3372712473 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc04f75980 0x55dc04f79490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:34.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.326+0000 7fd8e3660b80 1 -- 172.21.15.82:0/3372712473 >> 172.21.15.82:0/3372712473 conn(0x55dc04ea3b60 msgr2=0x55dc04f6f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:54:34.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.326+0000 7fd8e3660b80 1 -- 172.21.15.82:0/3372712473 shutdown_connections 2024-05-08T05:54:34.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.326+0000 7fd8e3660b80 1 -- 172.21.15.82:0/3372712473 wait complete. 2024-05-08T05:54:34.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.326+0000 7fd8e3660b80 1 -- start start 2024-05-08T05:54:34.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.327+0000 7fd8e3660b80 1 Processor -- start 2024-05-08T05:54:34.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.327+0000 7fd8e3660b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc04f75060 0x55dc04f80d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:34.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.327+0000 7fd8e3660b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc04f75980 0x55dc04f7e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:34.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.327+0000 7fd8e3660b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc04f799d0 0x55dc04f7e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:34.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.327+0000 7fd8e3660b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55dc04f8a490 con 0x55dc04f799d0 2024-05-08T05:54:34.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.327+0000 7fd8e3660b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55dc04e2db20 con 0x55dc04f75060 2024-05-08T05:54:34.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.327+0000 7fd8e3660b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55dc04f8a610 con 0x55dc04f75980 2024-05-08T05:54:34.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.327+0000 7fd8e3660b80 10 client.0 _ll_register_callbacks cb 0x55dc04e6ec70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:54:34.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.327+0000 7fd8d1400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc04f75980 0x55dc04f7e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:34.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.328+0000 7fd8d1400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc04f75980 0x55dc04f7e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:56670/0 (socket says 172.21.15.82:56670) 2024-05-08T05:54:34.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.328+0000 7fd8d1400700 1 -- 172.21.15.82:0/1643057860 learned_addr learned my addr 172.21.15.82:0/1643057860 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:54:34.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.328+0000 7fd8d1e00700 1 --2- 172.21.15.82:0/1643057860 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc04f75060 0x55dc04f80d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:34.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.328+0000 7fd8d2800700 1 --2- 172.21.15.82:0/1643057860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc04f799d0 0x55dc04f7e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:34.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.328+0000 7fd8d1400700 1 -- 172.21.15.82:0/1643057860 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc04f75060 msgr2=0x55dc04f80d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:54:34.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.328+0000 7fd8d1400700 1 --2- 172.21.15.82:0/1643057860 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc04f75060 0x55dc04f80d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:34.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.328+0000 7fd8d1400700 1 -- 172.21.15.82:0/1643057860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc04f799d0 msgr2=0x55dc04f7e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:54:34.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.328+0000 7fd8d1400700 1 --2- 172.21.15.82:0/1643057860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc04f799d0 0x55dc04f7e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:34.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.328+0000 7fd8d1400700 1 -- 172.21.15.82:0/1643057860 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc04e8d420 con 0x55dc04f75980 2024-05-08T05:54:34.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.328+0000 7fd8d1400700 1 --2- 172.21.15.82:0/1643057860 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc04f75980 0x55dc04f7e130 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd8c00dfc70 tx=0x7fd8c0004980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b0be1bfe5f6ec15 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:54:34.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.328+0000 7fd8b3e00700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:54:34.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.329+0000 7fd8b3e00700 1 -- 172.21.15.82:0/1643057860 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c001c040 con 0x55dc04f75980 2024-05-08T05:54:34.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.329+0000 7fd8b3e00700 1 -- 172.21.15.82:0/1643057860 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd8c00912c0 con 0x55dc04f75980 2024-05-08T05:54:34.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.329+0000 7fd8e3660b80 1 -- 172.21.15.82:0/1643057860 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8cc004bb0 con 0x55dc04f75980 2024-05-08T05:54:34.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.329+0000 7fd8b3e00700 1 -- 172.21.15.82:0/1643057860 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fd8c00c8070 con 0x55dc04f75980 2024-05-08T05:54:34.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.329+0000 7fd8e3660b80 10 client.25627 fetch_fsmap learned FSMap version 31 2024-05-08T05:54:34.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.329+0000 7fd8e3660b80 1 -- 172.21.15.82:0/1643057860 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55dc04f94b00 con 0x55dc04f75980 2024-05-08T05:54:34.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.330+0000 7fd8b3e00700 1 -- 172.21.15.82:0/1643057860 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8c0083e50 con 0x55dc04f75980 2024-05-08T05:54:34.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.331+0000 7fd8b3e00700 1 -- 172.21.15.82:0/1643057860 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fd8c00beb90 con 0x55dc04f75980 2024-05-08T05:54:34.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.332+0000 7fd8e3660b80 10 client.25627 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:54:34.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.332+0000 7fd8e3660b80 10 client.25627 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:54:34.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.332+0000 7fd8e3660b80 20 client.25627 populate_metadata read hostname 'smithi082' 2024-05-08T05:54:34.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.332+0000 7fd8e3660b80 1 --2- 172.21.15.82:0/1643057860 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55dc04f97090 0x55dc04f99480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:34.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.332+0000 7fd8e3660b80 4 client.25627 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:54:34.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.332+0000 7fd8e3660b80 1 -- 172.21.15.82:0/1643057860 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dc04f420a0 con 0x55dc04f97090 2024-05-08T05:54:34.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.332+0000 7fd8d1e00700 1 --2- 172.21.15.82:0/1643057860 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55dc04f97090 0x55dc04f99480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:34.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.333+0000 7fd8d1e00700 1 --2- 172.21.15.82:0/1643057860 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55dc04f97090 0x55dc04f99480 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f77d0e8088d663 server_cookie=a46615a5c298a829 in_seq=0 out_seq=0 2024-05-08T05:54:34.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.333+0000 7fd8b3e00700 10 client.25627 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:54:34.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.334+0000 7fd8b3e00700 1 -- 172.21.15.82:0/1643057860 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55dc04f420a0 con 0x55dc04f97090 2024-05-08T05:54:34.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.334+0000 7fd8b3e00700 10 client.25627 handle_command_reply: tid=0 2024-05-08T05:54:34.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.334+0000 7fd8e3660b80 1 client.25627 shutdown 2024-05-08T05:54:34.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.334+0000 7fd8e3660b80 1 -- 172.21.15.82:0/1643057860 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc04f75980 msgr2=0x55dc04f7e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:54:34.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.334+0000 7fd8e3660b80 1 --2- 172.21.15.82:0/1643057860 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc04f75980 0x55dc04f7e130 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd8c00dfc70 tx=0x7fd8c0004980 comp rx=0 tx=0).stop 2024-05-08T05:54:34.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.335+0000 7fd8e3660b80 1 -- 172.21.15.82:0/1643057860 shutdown_connections 2024-05-08T05:54:34.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.335+0000 7fd8e3660b80 1 --2- 172.21.15.82:0/1643057860 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55dc04f97090 0x55dc04f99480 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:34.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.335+0000 7fd8e3660b80 1 --2- 172.21.15.82:0/1643057860 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc04f75060 0x55dc04f80d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:34.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.335+0000 7fd8e3660b80 1 --2- 172.21.15.82:0/1643057860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc04f799d0 0x55dc04f7e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:34.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.335+0000 7fd8e3660b80 1 --2- 172.21.15.82:0/1643057860 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc04f75980 0x55dc04f7e130 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:34.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.335+0000 7fd8e3660b80 1 -- 172.21.15.82:0/1643057860 >> 172.21.15.82:0/1643057860 conn(0x55dc04ea3b60 msgr2=0x55dc04f6a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:54:34.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.335+0000 7fd8b3e00700 0 client.25627 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:54:34.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.335+0000 7fd8e3660b80 1 -- 172.21.15.82:0/1643057860 shutdown_connections 2024-05-08T05:54:34.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.335+0000 7fd8e3660b80 1 -- 172.21.15.82:0/1643057860 wait complete. 2024-05-08T05:54:34.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.336+0000 7fd8e3660b80 20 client.25627 trim_cache size 0 max 16384 2024-05-08T05:54:34.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.373+0000 7fd8e3660b80 1 Processor -- start 2024-05-08T05:54:34.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.373+0000 7fd8e3660b80 1 -- start start 2024-05-08T05:54:34.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.374+0000 7fd8e3660b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc04f75060 0x55dc04f935a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:34.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.374+0000 7fd8e3660b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc04f75980 0x55dc04f7bd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:34.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.374+0000 7fd8e3660b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc04f799d0 0x55dc04f6a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:34.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.374+0000 7fd8e3660b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d41b41b0 con 0x55dc04f75060 2024-05-08T05:54:34.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.374+0000 7fd8e3660b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d41b5cf0 con 0x55dc04f75980 2024-05-08T05:54:34.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.374+0000 7fd8e3660b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d41b4880 con 0x55dc04f799d0 2024-05-08T05:54:34.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.375+0000 7fd8d1e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc04f75060 0x55dc04f935a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:34.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.375+0000 7fd8d1e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc04f75060 0x55dc04f935a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43848/0 (socket says 172.21.15.82:43848) 2024-05-08T05:54:34.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.375+0000 7fd8d1e00700 1 -- 172.21.15.82:0/4112466038 learned_addr learned my addr 172.21.15.82:0/4112466038 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:54:34.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.375+0000 7fd8d2800700 1 --2- 172.21.15.82:0/4112466038 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc04f799d0 0x55dc04f6a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:34.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.375+0000 7fd8d1e00700 1 -- 172.21.15.82:0/4112466038 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc04f799d0 msgr2=0x55dc04f6a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:54:34.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.375+0000 7fd8d1e00700 1 --2- 172.21.15.82:0/4112466038 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc04f799d0 0x55dc04f6a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:34.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.375+0000 7fd8d1e00700 1 -- 172.21.15.82:0/4112466038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc04f75980 msgr2=0x55dc04f7bd90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T05:54:34.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.375+0000 7fd8d1e00700 1 --2- 172.21.15.82:0/4112466038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc04f75980 0x55dc04f7bd90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:34.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.375+0000 7fd8d1e00700 1 -- 172.21.15.82:0/4112466038 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc04f7e9c0 con 0x55dc04f75060 2024-05-08T05:54:34.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.376+0000 7fd8d1e00700 1 --2- 172.21.15.82:0/4112466038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc04f75060 0x55dc04f935a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd8c4005040 tx=0x7fd8c401e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64d8c5bc13da0c08 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:54:34.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.376+0000 7fd8bea00700 1 -- 172.21.15.82:0/4112466038 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c400bad0 con 0x55dc04f75060 2024-05-08T05:54:34.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.377+0000 7fd8bea00700 1 -- 172.21.15.82:0/4112466038 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8c400bc70 con 0x55dc04f75060 2024-05-08T05:54:34.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.377+0000 7fd8bea00700 1 -- 172.21.15.82:0/4112466038 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8c400f7b0 con 0x55dc04f75060 2024-05-08T05:54:34.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.378+0000 7fd8e3660b80 1 -- 172.21.15.82:0/4112466038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc04f75060 msgr2=0x55dc04f935a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:54:34.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.378+0000 7fd8e3660b80 1 --2- 172.21.15.82:0/4112466038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc04f75060 0x55dc04f935a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fd8c4005040 tx=0x7fd8c401e000 comp rx=0 tx=0).stop 2024-05-08T05:54:34.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.378+0000 7fd8e3660b80 1 -- 172.21.15.82:0/4112466038 shutdown_connections 2024-05-08T05:54:34.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.378+0000 7fd8e3660b80 1 --2- 172.21.15.82:0/4112466038 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc04f799d0 0x55dc04f6a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:34.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.378+0000 7fd8e3660b80 1 --2- 172.21.15.82:0/4112466038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc04f75060 0x55dc04f935a0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:34.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.378+0000 7fd8e3660b80 1 --2- 172.21.15.82:0/4112466038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc04f75980 0x55dc04f7bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:34.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.378+0000 7fd8e3660b80 1 -- 172.21.15.82:0/4112466038 >> 172.21.15.82:0/4112466038 conn(0x55dc04ea3b60 msgr2=0x55dc04f69a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:54:34.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.379+0000 7fd8e3660b80 1 -- 172.21.15.82:0/4112466038 shutdown_connections 2024-05-08T05:54:34.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.379+0000 7fd8e3660b80 1 -- 172.21.15.82:0/4112466038 wait complete. 2024-05-08T05:54:34.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.380+0000 7fd8e3660b80 1 -- start start 2024-05-08T05:54:34.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.380+0000 7fd8e3660b80 1 Processor -- start 2024-05-08T05:54:34.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.381+0000 7fd8e3660b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc04f75060 0x55dc04f8fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:34.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.381+0000 7fd8e3660b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc04f75980 0x55dc04f76380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:34.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.381+0000 7fd8e3660b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc04f799d0 0x55dc04f768c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:34.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.382+0000 7fd8d1e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc04f75060 0x55dc04f8fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:34.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.382+0000 7fd8d1e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc04f75060 0x55dc04f8fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:49068/0 (socket says 172.21.15.82:49068) 2024-05-08T05:54:34.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.382+0000 7fd8d2800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc04f799d0 0x55dc04f768c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:34.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.382+0000 7fd8d2800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc04f799d0 0x55dc04f768c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43860/0 (socket says 172.21.15.82:43860) 2024-05-08T05:54:34.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.382+0000 7fd8e3660b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d41b5620 con 0x55dc04f799d0 2024-05-08T05:54:34.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.382+0000 7fd8e3660b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d41b4f50 con 0x55dc04f75060 2024-05-08T05:54:34.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.382+0000 7fd8e3660b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd8d41b2150 con 0x55dc04f75980 2024-05-08T05:54:34.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.382+0000 7fd8d1e00700 1 -- 172.21.15.82:0/3370339446 learned_addr learned my addr 172.21.15.82:0/3370339446 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:54:34.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.382+0000 7fd8e3660b80 10 client.0 _ll_register_callbacks cb 0x55dc04e6ec70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:54:34.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.382+0000 7fd8d1400700 1 --2- 172.21.15.82:0/3370339446 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc04f75980 0x55dc04f76380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:34.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.383+0000 7fd8d2800700 1 -- 172.21.15.82:0/3370339446 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc04f75980 msgr2=0x55dc04f76380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:54:34.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.383+0000 7fd8d2800700 1 --2- 172.21.15.82:0/3370339446 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc04f75980 0x55dc04f76380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:34.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.383+0000 7fd8d2800700 1 -- 172.21.15.82:0/3370339446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc04f75060 msgr2=0x55dc04f8fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:54:34.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.383+0000 7fd8d2800700 1 --2- 172.21.15.82:0/3370339446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc04f75060 0x55dc04f8fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:34.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.383+0000 7fd8d2800700 1 -- 172.21.15.82:0/3370339446 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc04f76e00 con 0x55dc04f799d0 2024-05-08T05:54:34.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.383+0000 7fd8d1e00700 1 --2- 172.21.15.82:0/3370339446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc04f75060 0x55dc04f8fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:54:34.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.383+0000 7fd8d2800700 1 --2- 172.21.15.82:0/3370339446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc04f799d0 0x55dc04f768c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc007ac0 tx=0x7fd8cc0157d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d79195b1cfb973f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:54:34.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.383+0000 7fd8b3e00700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T05:54:34.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.384+0000 7fd8b3e00700 1 -- 172.21.15.82:0/3370339446 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8cc007e60 con 0x55dc04f799d0 2024-05-08T05:54:34.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.385+0000 7fd8e3660b80 1 -- 172.21.15.82:0/3370339446 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8c400bc70 con 0x55dc04f799d0 2024-05-08T05:54:34.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.385+0000 7fd8b3e00700 1 -- 172.21.15.82:0/3370339446 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd8cc004000 con 0x55dc04f799d0 2024-05-08T05:54:34.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.386+0000 7fd8b3e00700 1 -- 172.21.15.82:0/3370339446 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fd8cc004200 con 0x55dc04f799d0 2024-05-08T05:54:34.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.386+0000 7fd8e3660b80 10 client.15405 fetch_fsmap learned FSMap version 31 2024-05-08T05:54:34.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.386+0000 7fd8e3660b80 1 -- 172.21.15.82:0/3370339446 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55dc050028a0 con 0x55dc04f799d0 2024-05-08T05:54:34.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.387+0000 7fd8b3e00700 1 -- 172.21.15.82:0/3370339446 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd8c400bc70 con 0x55dc04f799d0 2024-05-08T05:54:34.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.387+0000 7fd8b3e00700 1 -- 172.21.15.82:0/3370339446 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fd8cc026030 con 0x55dc04f799d0 2024-05-08T05:54:34.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.387+0000 7fd8e3660b80 10 client.15405 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:54:34.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.387+0000 7fd8e3660b80 10 client.15405 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:54:34.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.387+0000 7fd8e3660b80 20 client.15405 populate_metadata read hostname 'smithi082' 2024-05-08T05:54:34.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.387+0000 7fd8e3660b80 1 --2- 172.21.15.82:0/3370339446 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55dc05002bb0 0x55dc05004fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:34.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.387+0000 7fd8e3660b80 4 client.15405 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-08T05:54:34.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.387+0000 7fd8e3660b80 1 -- 172.21.15.82:0/3370339446 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55dc04ed5400 con 0x55dc05002bb0 2024-05-08T05:54:34.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.388+0000 7fd8d1e00700 1 --2- 172.21.15.82:0/3370339446 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55dc05002bb0 0x55dc05004fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:34.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.389+0000 7fd8b3e00700 10 client.15405 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:54:34.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.390+0000 7fd8d1e00700 1 --2- 172.21.15.82:0/3370339446 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55dc05002bb0 0x55dc05004fd0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77fc66df579bde6d server_cookie=f97936d8a41eb7c3 in_seq=0 out_seq=0 2024-05-08T05:54:34.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.390+0000 7fd8b3e00700 1 -- 172.21.15.82:0/3370339446 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55dc04ed5400 con 0x55dc05002bb0 2024-05-08T05:54:34.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.390+0000 7fd8b3e00700 10 client.15405 handle_command_reply: tid=0 2024-05-08T05:54:34.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.390+0000 7fd8e3660b80 1 client.15405 shutdown 2024-05-08T05:54:34.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.390+0000 7fd8e3660b80 1 -- 172.21.15.82:0/3370339446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc04f799d0 msgr2=0x55dc04f768c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:54:34.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.390+0000 7fd8e3660b80 1 --2- 172.21.15.82:0/3370339446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc04f799d0 0x55dc04f768c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd8cc007ac0 tx=0x7fd8cc0157d0 comp rx=0 tx=0).stop 2024-05-08T05:54:34.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.391+0000 7fd8e3660b80 1 -- 172.21.15.82:0/3370339446 shutdown_connections 2024-05-08T05:54:34.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.391+0000 7fd8e3660b80 1 --2- 172.21.15.82:0/3370339446 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55dc05002bb0 0x55dc05004fd0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:34.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.391+0000 7fd8e3660b80 1 --2- 172.21.15.82:0/3370339446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dc04f75060 0x55dc04f8fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:34.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.391+0000 7fd8b3e00700 0 client.15405 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:54:34.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.391+0000 7fd8e3660b80 1 --2- 172.21.15.82:0/3370339446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dc04f799d0 0x55dc04f768c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:34.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.391+0000 7fd8e3660b80 1 --2- 172.21.15.82:0/3370339446 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc04f75980 0x55dc04f76380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:34.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.391+0000 7fd8e3660b80 1 -- 172.21.15.82:0/3370339446 >> 172.21.15.82:0/3370339446 conn(0x55dc04ea3b60 msgr2=0x55dc04f6a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:54:34.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.391+0000 7fd8e3660b80 1 -- 172.21.15.82:0/3370339446 shutdown_connections 2024-05-08T05:54:34.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.392+0000 7fd8e3660b80 1 -- 172.21.15.82:0/3370339446 wait complete. 2024-05-08T05:54:34.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.392+0000 7fd8e3660b80 20 client.15405 trim_cache size 0 max 16384 2024-05-08T05:54:34.393 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T05:54:34.394 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "no active scrubs running", 2024-05-08T05:54:34.394 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": {} 2024-05-08T05:54:34.394 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T05:54:34.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.393+0000 7fd8d8c00700 1 -- 172.21.15.82:0/2820214572 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd8b80b2900 msgr2=0x7fd8b80b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:54:34.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.393+0000 7fd8d8c00700 1 --2- 172.21.15.82:0/2820214572 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd8b80b2900 0x7fd8b80b4dc0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd8c4006010 tx=0x7fd8c4005c60 comp rx=0 tx=0).stop 2024-05-08T05:54:34.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.393+0000 7fd8d8c00700 1 -- 172.21.15.82:0/2820214572 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8d410f780 msgr2=0x7fd8d41a28a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:54:34.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.393+0000 7fd8d8c00700 1 --2- 172.21.15.82:0/2820214572 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8d410f780 0x7fd8d41a28a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd8c000e9f0 tx=0x7fd8c000ed00 comp rx=0 tx=0).stop 2024-05-08T05:54:34.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.393+0000 7fd8d8c00700 1 -- 172.21.15.82:0/2820214572 shutdown_connections 2024-05-08T05:54:34.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.393+0000 7fd8d8c00700 1 --2- 172.21.15.82:0/2820214572 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd8b80b2900 0x7fd8b80b4dc0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:34.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.393+0000 7fd8d8c00700 1 --2- 172.21.15.82:0/2820214572 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd8d4114d80 0x7fd8d41a6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:34.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.393+0000 7fd8d8c00700 1 --2- 172.21.15.82:0/2820214572 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8d410a9e0 0x7fd8d41a2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:34.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.393+0000 7fd8d8c00700 1 --2- 172.21.15.82:0/2820214572 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8d410f780 0x7fd8d41a28a0 secure :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd8c000e9f0 tx=0x7fd8c000ed00 comp rx=0 tx=0).stop 2024-05-08T05:54:34.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.393+0000 7fd8d8c00700 1 -- 172.21.15.82:0/2820214572 >> 172.21.15.82:0/2820214572 conn(0x7fd8d406e9f0 msgr2=0x7fd8d410bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:54:34.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.393+0000 7fd8d8c00700 1 -- 172.21.15.82:0/2820214572 shutdown_connections 2024-05-08T05:54:34.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:34.394+0000 7fd8d8c00700 1 -- 172.21.15.82:0/2820214572 wait complete. 2024-05-08T05:54:35.267 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 225.0 s, 2243.9 tps, lat 44.402 ms stddev 54.147 2024-05-08T05:54:35.301 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-08T05:54:35.302 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T05:54:35.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:54:35 smithi151 ceph-mon[34815]: pgmap v577: 97 pgs: 97 active+clean; 1.3 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 28 MiB/s wr, 754 op/s 2024-05-08T05:54:35.932 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:54:35.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:54:35 smithi082 ceph-mon[30098]: pgmap v577: 97 pgs: 97 active+clean; 1.3 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 28 MiB/s wr, 754 op/s 2024-05-08T05:54:36.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:54:35 smithi134 ceph-mon[34132]: pgmap v577: 97 pgs: 97 active+clean; 1.3 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 28 MiB/s wr, 754 op/s 2024-05-08T05:54:37.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:54:37 smithi151 ceph-mon[34815]: pgmap v578: 97 pgs: 97 active+clean; 1.4 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 37 MiB/s wr, 881 op/s 2024-05-08T05:54:37.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:54:37 smithi082 ceph-mon[30098]: pgmap v578: 97 pgs: 97 active+clean; 1.4 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 37 MiB/s wr, 881 op/s 2024-05-08T05:54:38.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:54:37 smithi134 ceph-mon[34132]: pgmap v578: 97 pgs: 97 active+clean; 1.4 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 37 MiB/s wr, 881 op/s 2024-05-08T05:54:38.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:38.978+0000 7f0aae800700 1 -- 172.21.15.82:0/285144118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0aa8104100 msgr2=0x7f0aa8108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:54:38.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:38.978+0000 7f0aae800700 1 --2- 172.21.15.82:0/285144118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0aa8104100 0x7f0aa8108120 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0a940099c0 tx=0x7f0a94009cd0 comp rx=0 tx=0).stop 2024-05-08T05:54:38.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:38.978+0000 7f0aae800700 1 -- 172.21.15.82:0/285144118 shutdown_connections 2024-05-08T05:54:38.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:38.978+0000 7f0aae800700 1 --2- 172.21.15.82:0/285144118 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0aa8108850 0x7f0aa81103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:38.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:38.978+0000 7f0aae800700 1 --2- 172.21.15.82:0/285144118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0aa8103750 0x7f0aa8103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:38.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:38.978+0000 7f0aae800700 1 --2- 172.21.15.82:0/285144118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0aa8104100 0x7f0aa8108120 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:38.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:38.978+0000 7f0aae800700 1 -- 172.21.15.82:0/285144118 >> 172.21.15.82:0/285144118 conn(0x7f0aa807a600 msgr2=0x7f0aa807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:54:38.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:38.978+0000 7f0aae800700 1 -- 172.21.15.82:0/285144118 shutdown_connections 2024-05-08T05:54:38.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:38.978+0000 7f0aae800700 1 -- 172.21.15.82:0/285144118 wait complete. 2024-05-08T05:54:38.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:38.980+0000 7f0aae800700 1 Processor -- start 2024-05-08T05:54:38.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:38.980+0000 7f0aae800700 1 -- start start 2024-05-08T05:54:38.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:38.981+0000 7f0aae800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0aa8103750 0x7f0aa819f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:38.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:38.981+0000 7f0aae800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0aa8104100 0x7f0aa819fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:38.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:38.981+0000 7f0aae800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0aa8108850 0x7f0aa8199a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:38.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:38.981+0000 7f0aae800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa8113660 con 0x7f0aa8103750 2024-05-08T05:54:38.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:38.981+0000 7f0aae800700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa81134e0 con 0x7f0aa8108850 2024-05-08T05:54:38.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:38.981+0000 7f0aae800700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0aa81137e0 con 0x7f0aa8104100 2024-05-08T05:54:38.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:38.981+0000 7f0aa6a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0aa8104100 0x7f0aa819fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:38.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:38.981+0000 7f0aa7e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0aa8108850 0x7f0aa8199a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:38.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:38.981+0000 7f0aa7400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0aa8103750 0x7f0aa819f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:38.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:38.981+0000 7f0aa6a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0aa8104100 0x7f0aa819fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:56710/0 (socket says 172.21.15.82:56710) 2024-05-08T05:54:38.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:38.981+0000 7f0aa7e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0aa8108850 0x7f0aa8199a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:49094/0 (socket says 172.21.15.82:49094) 2024-05-08T05:54:38.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:38.981+0000 7f0aa6a00700 1 -- 172.21.15.82:0/709827934 learned_addr learned my addr 172.21.15.82:0/709827934 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:54:38.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:38.982+0000 7f0aa6a00700 1 -- 172.21.15.82:0/709827934 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0aa8108850 msgr2=0x7f0aa8199a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:54:38.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:38.982+0000 7f0aa6a00700 1 --2- 172.21.15.82:0/709827934 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0aa8108850 0x7f0aa8199a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:38.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:38.982+0000 7f0aa6a00700 1 -- 172.21.15.82:0/709827934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0aa8103750 msgr2=0x7f0aa819f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:54:38.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:38.982+0000 7f0aa6a00700 1 --2- 172.21.15.82:0/709827934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0aa8103750 0x7f0aa819f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:38.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:38.982+0000 7f0aa6a00700 1 -- 172.21.15.82:0/709827934 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aa819a1c0 con 0x7f0aa8104100 2024-05-08T05:54:38.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:38.982+0000 7f0aa6a00700 1 --2- 172.21.15.82:0/709827934 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0aa8104100 0x7f0aa819fde0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0a94009990 tx=0x7f0a940047b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:54:38.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:38.983+0000 7f0a9fe00700 1 -- 172.21.15.82:0/709827934 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a94026070 con 0x7f0aa8104100 2024-05-08T05:54:38.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:38.983+0000 7f0a9fe00700 1 -- 172.21.15.82:0/709827934 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0a94003f20 con 0x7f0aa8104100 2024-05-08T05:54:38.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:38.983+0000 7f0a9fe00700 1 -- 172.21.15.82:0/709827934 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a9400fc00 con 0x7f0aa8104100 2024-05-08T05:54:38.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:38.983+0000 7f0aae800700 1 -- 172.21.15.82:0/709827934 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0aa819a450 con 0x7f0aa8104100 2024-05-08T05:54:38.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:38.983+0000 7f0aae800700 1 -- 172.21.15.82:0/709827934 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0aa80756d0 con 0x7f0aa8104100 2024-05-08T05:54:38.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:38.990+0000 7f0aae800700 1 -- 172.21.15.82:0/709827934 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0aa8104be0 con 0x7f0aa8104100 2024-05-08T05:54:38.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:38.992+0000 7f0a9fe00700 1 -- 172.21.15.82:0/709827934 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f0a94029070 con 0x7f0aa8104100 2024-05-08T05:54:38.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:38.995+0000 7f0a9fe00700 1 --2- 172.21.15.82:0/709827934 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f0a8c0b2a50 0x7f0a8c0b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:38.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:38.995+0000 7f0a9fe00700 1 -- 172.21.15.82:0/709827934 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f0a940e2aa0 con 0x7f0aa8104100 2024-05-08T05:54:38.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:38.996+0000 7f0aa7400700 1 --2- 172.21.15.82:0/709827934 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f0a8c0b2a50 0x7f0a8c0b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:38.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:38.997+0000 7f0aa7400700 1 --2- 172.21.15.82:0/709827934 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f0a8c0b2a50 0x7f0a8c0b4f10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0aa819aba0 tx=0x7f0a9800a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:54:39.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:39.002+0000 7f0a9fe00700 1 -- 172.21.15.82:0/709827934 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0a9405edf0 con 0x7f0aa8104100 2024-05-08T05:54:39.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:39.422+0000 7f0aae800700 1 -- 172.21.15.82:0/709827934 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0aa806a190 con 0x7f0aa8104100 2024-05-08T05:54:39.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:39.422+0000 7f0a9fe00700 1 -- 172.21.15.82:0/709827934 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11948 (secure 0 0 0) 0x7f0a94013070 con 0x7f0aa8104100 2024-05-08T05:54:39.423 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:54:39.423 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14364,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3876883250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3876883250},{"type":"v1","addr":"172.21.15.82:6835","nonce":3876883250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1965070586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1965070586},{"type":"v1","addr":"172.21.15.82:6837","nonce":1965070586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":31,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T05:45:57.654009+0000","modified":"2024-05-08T05:53:20.165672+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24505,"mds_2":24487,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14397":{"gid":14397,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/1890720973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1890720973},{"type":"v1","addr":"172.21.15.82:6839","nonce":1890720973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14409":{"gid":14409,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/2957083305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":2957083305},{"type":"v1","addr":"172.21.15.82:6841","nonce":2957083305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6833/3827691638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3827691638},{"type":"v1","addr":"172.21.15.134:6833","nonce":3827691638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6833/3625067797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3625067797},{"type":"v1","addr":"172.21.15.151:6833","nonce":3625067797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/4074163402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4074163402},{"type":"v1","addr":"172.21.15.134:6835","nonce":4074163402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.134:6837/2212411710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2212411710},{"type":"v1","addr":"172.21.15.134:6837","nonce":2212411710}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":17,"addr":"172.21.15.151:6835/2093655929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2093655929},{"type":"v1","addr":"172.21.15.151:6835","nonce":2093655929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6837/4192404464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":4192404464},{"type":"v1","addr":"172.21.15.151:6837","nonce":4192404464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":14,"addr":"172.21.15.151:6839/2963754236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":2963754236},{"type":"v1","addr":"172.21.15.151:6839","nonce":2963754236}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.134:6839/1145270893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1145270893},{"type":"v1","addr":"172.21.15.134:6839","nonce":1145270893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24505,24506,24487,24475,24467]},"id":1}]} 2024-05-08T05:54:39.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:39.426+0000 7f0aae800700 1 -- 172.21.15.82:0/709827934 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f0a8c0b2a50 msgr2=0x7f0a8c0b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:54:39.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:39.426+0000 7f0aae800700 1 --2- 172.21.15.82:0/709827934 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f0a8c0b2a50 0x7f0a8c0b4f10 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0aa819aba0 tx=0x7f0a9800a380 comp rx=0 tx=0).stop 2024-05-08T05:54:39.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:39.426+0000 7f0aae800700 1 -- 172.21.15.82:0/709827934 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0aa8104100 msgr2=0x7f0aa819fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:54:39.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:39.426+0000 7f0aae800700 1 --2- 172.21.15.82:0/709827934 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0aa8104100 0x7f0aa819fde0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0a94009990 tx=0x7f0a940047b0 comp rx=0 tx=0).stop 2024-05-08T05:54:39.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:39.426+0000 7f0aae800700 1 -- 172.21.15.82:0/709827934 shutdown_connections 2024-05-08T05:54:39.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:39.426+0000 7f0aae800700 1 --2- 172.21.15.82:0/709827934 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0aa8108850 0x7f0aa8199a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:39.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:39.426+0000 7f0aae800700 1 --2- 172.21.15.82:0/709827934 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f0a8c0b2a50 0x7f0a8c0b4f10 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:39.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:39.426+0000 7f0aae800700 1 --2- 172.21.15.82:0/709827934 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0aa8103750 0x7f0aa819f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:39.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:39.426+0000 7f0aae800700 1 --2- 172.21.15.82:0/709827934 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0aa8104100 0x7f0aa819fde0 secure :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0a94009990 tx=0x7f0a940047b0 comp rx=0 tx=0).stop 2024-05-08T05:54:39.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:39.426+0000 7f0aae800700 1 -- 172.21.15.82:0/709827934 >> 172.21.15.82:0/709827934 conn(0x7f0aa807a600 msgr2=0x7f0aa8102c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:54:39.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:39.428+0000 7f0aae800700 1 -- 172.21.15.82:0/709827934 shutdown_connections 2024-05-08T05:54:39.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:39.428+0000 7f0aae800700 1 -- 172.21.15.82:0/709827934 wait complete. 2024-05-08T05:54:39.430 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 31 2024-05-08T05:54:39.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:54:39 smithi082 ceph-mon[30098]: pgmap v579: 97 pgs: 97 active+clean; 1.4 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 33 MiB/s wr, 724 op/s 2024-05-08T05:54:39.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:54:39 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/709827934' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:54:39.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:54:39 smithi151 ceph-mon[34815]: pgmap v579: 97 pgs: 97 active+clean; 1.4 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 33 MiB/s wr, 724 op/s 2024-05-08T05:54:39.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:54:39 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/709827934' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:54:39.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:54:39 smithi134 ceph-mon[34132]: pgmap v579: 97 pgs: 97 active+clean; 1.4 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 33 MiB/s wr, 724 op/s 2024-05-08T05:54:40.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:54:39 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/709827934' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:54:40.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 230.0 s, 2045.6 tps, lat 49.034 ms stddev 64.910 2024-05-08T05:54:40.312 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-05-08T05:54:40.944 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:54:41.722 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:54:41 smithi082 ceph-mon[30098]: pgmap v580: 97 pgs: 97 active+clean; 1.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 34 MiB/s wr, 797 op/s 2024-05-08T05:54:41.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:54:41 smithi151 ceph-mon[34815]: pgmap v580: 97 pgs: 97 active+clean; 1.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 34 MiB/s wr, 797 op/s 2024-05-08T05:54:41.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:54:41 smithi134 ceph-mon[34132]: pgmap v580: 97 pgs: 97 active+clean; 1.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 34 MiB/s wr, 797 op/s 2024-05-08T05:54:43.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.244+0000 7fb607400700 1 -- 172.21.15.82:0/320113741 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb600102d60 msgr2=0x7fb60010f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:54:43.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.244+0000 7fb607400700 1 --2- 172.21.15.82:0/320113741 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb600102d60 0x7fb60010f250 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8009f90 tx=0x7fb5f800b330 comp rx=0 tx=0).stop 2024-05-08T05:54:43.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.244+0000 7fb607400700 1 -- 172.21.15.82:0/320113741 shutdown_connections 2024-05-08T05:54:43.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.244+0000 7fb607400700 1 --2- 172.21.15.82:0/320113741 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb600102d60 0x7fb60010f250 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:43.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.244+0000 7fb607400700 1 --2- 172.21.15.82:0/320113741 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb600108410 0x7fb6001087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:43.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.244+0000 7fb607400700 1 --2- 172.21.15.82:0/320113741 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6001023a0 0x7fb600102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:43.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.244+0000 7fb607400700 1 -- 172.21.15.82:0/320113741 >> 172.21.15.82:0/320113741 conn(0x7fb600079350 msgr2=0x7fb600079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:54:43.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.244+0000 7fb607400700 1 -- 172.21.15.82:0/320113741 shutdown_connections 2024-05-08T05:54:43.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.244+0000 7fb607400700 1 -- 172.21.15.82:0/320113741 wait complete. 2024-05-08T05:54:43.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.247+0000 7fb607400700 1 Processor -- start 2024-05-08T05:54:43.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.249+0000 7fb607400700 1 -- start start 2024-05-08T05:54:43.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.249+0000 7fb607400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb6001023a0 0x7fb6001a0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:43.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.249+0000 7fb607400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb600102d60 0x7fb6001a0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:43.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.249+0000 7fb607400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb600108410 0x7fb6001a4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:43.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.249+0000 7fb607400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb600112580 con 0x7fb600108410 2024-05-08T05:54:43.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.249+0000 7fb607400700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb600112400 con 0x7fb600102d60 2024-05-08T05:54:43.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.249+0000 7fb607400700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb600112700 con 0x7fb6001023a0 2024-05-08T05:54:43.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.249+0000 7fb604a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb6001023a0 0x7fb6001a0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:43.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.249+0000 7fb604a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb6001023a0 0x7fb6001a0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:44902/0 (socket says 172.21.15.82:44902) 2024-05-08T05:54:43.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.249+0000 7fb604a00700 1 -- 172.21.15.82:0/3450822658 learned_addr learned my addr 172.21.15.82:0/3450822658 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:54:43.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.250+0000 7fb605400700 1 --2- 172.21.15.82:0/3450822658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb600108410 0x7fb6001a4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:43.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.250+0000 7fb5ffe00700 1 --2- 172.21.15.82:0/3450822658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb600102d60 0x7fb6001a0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:43.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.250+0000 7fb604a00700 1 -- 172.21.15.82:0/3450822658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb600102d60 msgr2=0x7fb6001a0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:54:43.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.250+0000 7fb604a00700 1 --2- 172.21.15.82:0/3450822658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb600102d60 0x7fb6001a0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:43.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.250+0000 7fb604a00700 1 -- 172.21.15.82:0/3450822658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb600108410 msgr2=0x7fb6001a4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:54:43.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.250+0000 7fb604a00700 1 --2- 172.21.15.82:0/3450822658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb600108410 0x7fb6001a4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:43.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.250+0000 7fb604a00700 1 -- 172.21.15.82:0/3450822658 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6001a50d0 con 0x7fb6001023a0 2024-05-08T05:54:43.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.250+0000 7fb5ffe00700 1 --2- 172.21.15.82:0/3450822658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb600102d60 0x7fb6001a0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:54:43.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.250+0000 7fb605400700 1 --2- 172.21.15.82:0/3450822658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb600108410 0x7fb6001a4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:54:43.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.251+0000 7fb604a00700 1 --2- 172.21.15.82:0/3450822658 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb6001023a0 0x7fb6001a0430 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb5f400e9c0 tx=0x7fb5f400ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:54:43.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.251+0000 7fb5fd600700 1 -- 172.21.15.82:0/3450822658 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f400cbd0 con 0x7fb6001023a0 2024-05-08T05:54:43.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.251+0000 7fb5fd600700 1 -- 172.21.15.82:0/3450822658 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5f400cd70 con 0x7fb6001023a0 2024-05-08T05:54:43.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.251+0000 7fb5fd600700 1 -- 172.21.15.82:0/3450822658 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f4005580 con 0x7fb6001023a0 2024-05-08T05:54:43.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.251+0000 7fb607400700 1 -- 172.21.15.82:0/3450822658 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6001a53c0 con 0x7fb6001023a0 2024-05-08T05:54:43.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.251+0000 7fb607400700 1 -- 172.21.15.82:0/3450822658 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6001acc40 con 0x7fb6001023a0 2024-05-08T05:54:43.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.257+0000 7fb5fd600700 1 -- 172.21.15.82:0/3450822658 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fb5f4004750 con 0x7fb6001023a0 2024-05-08T05:54:43.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.260+0000 7fb611d7fb80 1 Processor -- start 2024-05-08T05:54:43.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.260+0000 7fb5fd600700 1 --2- 172.21.15.82:0/3450822658 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb5e80b2900 0x7fb5e80b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:43.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.260+0000 7fb5fd600700 1 -- 172.21.15.82:0/3450822658 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb5f40a5f70 con 0x7fb6001023a0 2024-05-08T05:54:43.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.261+0000 7fb611d7fb80 1 -- start start 2024-05-08T05:54:43.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.261+0000 7fb611d7fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557ae1014bc0 0x557ae1014fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:43.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.262+0000 7fb611d7fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ae10154e0 0x557ae100f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:43.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.262+0000 7fb611d7fb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557ae100f8f0 0x557ae100fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:43.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.262+0000 7fb604a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557ae1014bc0 0x557ae1014fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:43.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.262+0000 7fb604a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557ae1014bc0 0x557ae1014fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:44910/0 (socket says 172.21.15.82:44910) 2024-05-08T05:54:43.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.262+0000 7fb604a00700 1 -- 172.21.15.82:0/4095971211 learned_addr learned my addr 172.21.15.82:0/4095971211 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:54:43.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.262+0000 7fb611d7fb80 1 -- 172.21.15.82:0/4095971211 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x557ae0f61a20 con 0x557ae10154e0 2024-05-08T05:54:43.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.262+0000 7fb611d7fb80 1 -- 172.21.15.82:0/4095971211 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x557ae0eff760 con 0x557ae100f8f0 2024-05-08T05:54:43.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.262+0000 7fb611d7fb80 1 -- 172.21.15.82:0/4095971211 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x557ae0f5d9e0 con 0x557ae1014bc0 2024-05-08T05:54:43.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.262+0000 7fb604a00700 1 -- 172.21.15.82:0/4095971211 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557ae100f8f0 msgr2=0x557ae100fd70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T05:54:43.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.262+0000 7fb604a00700 1 --2- 172.21.15.82:0/4095971211 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557ae100f8f0 0x557ae100fd70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:43.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.262+0000 7fb604a00700 1 -- 172.21.15.82:0/4095971211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ae10154e0 msgr2=0x557ae100f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:54:43.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.262+0000 7fb604a00700 1 --2- 172.21.15.82:0/4095971211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ae10154e0 0x557ae100f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:43.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.262+0000 7fb604a00700 1 -- 172.21.15.82:0/4095971211 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ae0eae8d0 con 0x557ae1014bc0 2024-05-08T05:54:43.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.263+0000 7fb604a00700 1 --2- 172.21.15.82:0/4095971211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557ae1014bc0 0x557ae1014fa0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb5f40a6bf0 tx=0x7fb5f40b1040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=832dde78e41c4a6e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:54:43.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.263+0000 7fb5f2000700 1 -- 172.21.15.82:0/4095971211 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f40a6170 con 0x557ae1014bc0 2024-05-08T05:54:43.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.263+0000 7fb5f2000700 1 -- 172.21.15.82:0/4095971211 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5f40b2130 con 0x557ae1014bc0 2024-05-08T05:54:43.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.263+0000 7fb605400700 1 --2- 172.21.15.82:0/3450822658 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb5e80b2900 0x7fb5e80b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:43.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.263+0000 7fb5f2000700 1 -- 172.21.15.82:0/4095971211 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f40a6310 con 0x557ae1014bc0 2024-05-08T05:54:43.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.264+0000 7fb611d7fb80 1 -- 172.21.15.82:0/4095971211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557ae1014bc0 msgr2=0x557ae1014fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:54:43.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.264+0000 7fb611d7fb80 1 --2- 172.21.15.82:0/4095971211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557ae1014bc0 0x557ae1014fa0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb5f40a6bf0 tx=0x7fb5f40b1040 comp rx=0 tx=0).stop 2024-05-08T05:54:43.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.265+0000 7fb611d7fb80 1 -- 172.21.15.82:0/4095971211 shutdown_connections 2024-05-08T05:54:43.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.265+0000 7fb611d7fb80 1 --2- 172.21.15.82:0/4095971211 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557ae100f8f0 0x557ae100fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:43.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.265+0000 7fb611d7fb80 1 --2- 172.21.15.82:0/4095971211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557ae1014bc0 0x557ae1014fa0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:43.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.265+0000 7fb611d7fb80 1 --2- 172.21.15.82:0/4095971211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ae10154e0 0x557ae100f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:43.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.265+0000 7fb611d7fb80 1 -- 172.21.15.82:0/4095971211 >> 172.21.15.82:0/4095971211 conn(0x557ae0f876d0 msgr2=0x557ae1009b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:54:43.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.265+0000 7fb605400700 1 --2- 172.21.15.82:0/3450822658 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb5e80b2900 0x7fb5e80b4dc0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8009da0 tx=0x7fb5f8009700 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:54:43.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.265+0000 7fb611d7fb80 1 -- 172.21.15.82:0/4095971211 shutdown_connections 2024-05-08T05:54:43.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.265+0000 7fb611d7fb80 1 -- 172.21.15.82:0/4095971211 wait complete. 2024-05-08T05:54:43.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.265+0000 7fb611d7fb80 1 -- start start 2024-05-08T05:54:43.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.266+0000 7fb611d7fb80 1 Processor -- start 2024-05-08T05:54:43.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.266+0000 7fb611d7fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557ae100f8f0 0x557ae101b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:43.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.266+0000 7fb611d7fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ae1014bc0 0x557ae10185d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:43.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.266+0000 7fb611d7fb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557ae10154e0 0x557ae1018b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:43.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.266+0000 7fb611d7fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x557ae101be70 con 0x557ae1014bc0 2024-05-08T05:54:43.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.266+0000 7fb611d7fb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x557ae0ec7b20 con 0x557ae10154e0 2024-05-08T05:54:43.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.266+0000 7fb611d7fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x557ae101bff0 con 0x557ae100f8f0 2024-05-08T05:54:43.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.266+0000 7fb611d7fb80 10 client.0 _ll_register_callbacks cb 0x557ae0f08c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:54:43.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.266+0000 7fb604a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557ae100f8f0 0x557ae101b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:43.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.266+0000 7fb604a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557ae100f8f0 0x557ae101b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:44918/0 (socket says 172.21.15.82:44918) 2024-05-08T05:54:43.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.266+0000 7fb604a00700 1 -- 172.21.15.82:0/1315846364 learned_addr learned my addr 172.21.15.82:0/1315846364 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:54:43.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.267+0000 7fb604a00700 1 -- 172.21.15.82:0/1315846364 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557ae10154e0 msgr2=0x557ae1018b10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T05:54:43.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.267+0000 7fb604a00700 1 --2- 172.21.15.82:0/1315846364 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557ae10154e0 0x557ae1018b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:43.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.267+0000 7fb604a00700 1 -- 172.21.15.82:0/1315846364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ae1014bc0 msgr2=0x557ae10185d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:54:43.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.267+0000 7fb604a00700 1 --2- 172.21.15.82:0/1315846364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ae1014bc0 0x557ae10185d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:43.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.267+0000 7fb604a00700 1 -- 172.21.15.82:0/1315846364 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ae0f27420 con 0x557ae100f8f0 2024-05-08T05:54:43.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.267+0000 7fb604a00700 1 --2- 172.21.15.82:0/1315846364 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557ae100f8f0 0x557ae101b230 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb5f40a55f0 tx=0x7fb5f4005c70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eeec77e191b6d2e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:54:43.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.267+0000 7fb5e6a00700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:54:43.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.267+0000 7fb5e6a00700 1 -- 172.21.15.82:0/1315846364 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f40c2070 con 0x557ae100f8f0 2024-05-08T05:54:43.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.267+0000 7fb5e6a00700 1 -- 172.21.15.82:0/1315846364 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb5f40a5670 con 0x557ae100f8f0 2024-05-08T05:54:43.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.267+0000 7fb611d7fb80 1 -- 172.21.15.82:0/1315846364 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5f40b2130 con 0x557ae100f8f0 2024-05-08T05:54:43.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.268+0000 7fb5e6a00700 1 -- 172.21.15.82:0/1315846364 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fb5f40a64e0 con 0x557ae100f8f0 2024-05-08T05:54:43.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.268+0000 7fb611d7fb80 10 client.25648 fetch_fsmap learned FSMap version 31 2024-05-08T05:54:43.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.268+0000 7fb611d7fb80 1 -- 172.21.15.82:0/1315846364 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x557ae101be70 con 0x557ae100f8f0 2024-05-08T05:54:43.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.268+0000 7fb5e6a00700 1 -- 172.21.15.82:0/1315846364 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5f40b2130 con 0x557ae100f8f0 2024-05-08T05:54:43.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.269+0000 7fb5e6a00700 1 -- 172.21.15.82:0/1315846364 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fb5f40b22e0 con 0x557ae100f8f0 2024-05-08T05:54:43.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.269+0000 7fb611d7fb80 10 client.25648 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:54:43.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.269+0000 7fb611d7fb80 10 client.25648 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-05-08T05:54:43.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.269+0000 7fb611d7fb80 20 client.25648 populate_metadata read hostname 'smithi082' 2024-05-08T05:54:43.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.269+0000 7fb611d7fb80 1 --2- 172.21.15.82:0/1315846364 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x557ae1028a40 0x557ae102ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:43.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.269+0000 7fb611d7fb80 4 client.25648 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:54:43.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.269+0000 7fb611d7fb80 1 -- 172.21.15.82:0/1315846364 --> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557ae0fdc140 con 0x557ae1028a40 2024-05-08T05:54:43.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.269+0000 7fb5ffe00700 1 --2- 172.21.15.82:0/1315846364 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x557ae1028a40 0x557ae102ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:43.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.270+0000 7fb5ffe00700 1 --2- 172.21.15.82:0/1315846364 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x557ae1028a40 0x557ae102ae30 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=df30a88e6a551a1e server_cookie=8215a29eac7d822 in_seq=0 out_seq=0 2024-05-08T05:54:43.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.270+0000 7fb5e6a00700 10 client.25648 ms_handle_connect on v2:172.21.15.134:6836/2212411710 2024-05-08T05:54:43.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.270+0000 7fb5e6a00700 1 -- 172.21.15.82:0/1315846364 <== mds.4 v2:172.21.15.134:6836/2212411710 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557ae0fdc140 con 0x557ae1028a40 2024-05-08T05:54:43.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.271+0000 7fb5e6a00700 10 client.25648 handle_command_reply: tid=0 2024-05-08T05:54:43.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.271+0000 7fb611d7fb80 1 client.25648 shutdown 2024-05-08T05:54:43.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.271+0000 7fb611d7fb80 1 -- 172.21.15.82:0/1315846364 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557ae100f8f0 msgr2=0x557ae101b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:54:43.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.271+0000 7fb611d7fb80 1 --2- 172.21.15.82:0/1315846364 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557ae100f8f0 0x557ae101b230 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb5f40a55f0 tx=0x7fb5f4005c70 comp rx=0 tx=0).stop 2024-05-08T05:54:43.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.271+0000 7fb611d7fb80 1 -- 172.21.15.82:0/1315846364 shutdown_connections 2024-05-08T05:54:43.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.271+0000 7fb611d7fb80 1 --2- 172.21.15.82:0/1315846364 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x557ae1028a40 0x557ae102ae30 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:43.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.271+0000 7fb611d7fb80 1 --2- 172.21.15.82:0/1315846364 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557ae10154e0 0x557ae1018b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:43.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.271+0000 7fb611d7fb80 1 --2- 172.21.15.82:0/1315846364 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557ae100f8f0 0x557ae101b230 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:43.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.271+0000 7fb611d7fb80 1 --2- 172.21.15.82:0/1315846364 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ae1014bc0 0x557ae10185d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:43.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.271+0000 7fb611d7fb80 1 -- 172.21.15.82:0/1315846364 >> 172.21.15.82:0/1315846364 conn(0x557ae0f876d0 msgr2=0x557ae1009190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:54:43.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.272+0000 7fb5e6a00700 0 client.25648 ms_handle_reset on v2:172.21.15.134:6836/2212411710 2024-05-08T05:54:43.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.272+0000 7fb611d7fb80 1 -- 172.21.15.82:0/1315846364 shutdown_connections 2024-05-08T05:54:43.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.272+0000 7fb611d7fb80 1 -- 172.21.15.82:0/1315846364 wait complete. 2024-05-08T05:54:43.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.272+0000 7fb611d7fb80 20 client.25648 trim_cache size 0 max 16384 2024-05-08T05:54:43.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.295+0000 7fb611d7fb80 1 Processor -- start 2024-05-08T05:54:43.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.295+0000 7fb611d7fb80 1 -- start start 2024-05-08T05:54:43.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.296+0000 7fb611d7fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557ae1014bc0 0x557ae100f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:43.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.296+0000 7fb611d7fb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557ae10154e0 0x557ae1024f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:43.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.296+0000 7fb611d7fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ae101abe0 0x557ae1009910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:43.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.296+0000 7fb611d7fb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb6001b40b0 con 0x557ae101abe0 2024-05-08T05:54:43.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.296+0000 7fb611d7fb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb6001b5bf0 con 0x557ae10154e0 2024-05-08T05:54:43.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.296+0000 7fb611d7fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb6001b4780 con 0x557ae1014bc0 2024-05-08T05:54:43.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.296+0000 7fb604a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557ae1014bc0 0x557ae100f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:43.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.296+0000 7fb604a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557ae1014bc0 0x557ae100f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:44920/0 (socket says 172.21.15.82:44920) 2024-05-08T05:54:43.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.296+0000 7fb604a00700 1 -- 172.21.15.82:0/586971180 learned_addr learned my addr 172.21.15.82:0/586971180 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:54:43.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.296+0000 7fb605400700 1 --2- 172.21.15.82:0/586971180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ae101abe0 0x557ae1009910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:43.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.297+0000 7fb5ffe00700 1 --2- 172.21.15.82:0/586971180 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557ae10154e0 0x557ae1024f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:43.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.297+0000 7fb604a00700 1 -- 172.21.15.82:0/586971180 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557ae10154e0 msgr2=0x557ae1024f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:54:43.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.297+0000 7fb604a00700 1 --2- 172.21.15.82:0/586971180 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557ae10154e0 0x557ae1024f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:43.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.297+0000 7fb604a00700 1 -- 172.21.15.82:0/586971180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ae101abe0 msgr2=0x557ae1009910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:54:43.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.297+0000 7fb604a00700 1 --2- 172.21.15.82:0/586971180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ae101abe0 0x557ae1009910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:43.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.297+0000 7fb604a00700 1 -- 172.21.15.82:0/586971180 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ae100ffc0 con 0x557ae1014bc0 2024-05-08T05:54:43.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.297+0000 7fb605400700 1 --2- 172.21.15.82:0/586971180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ae101abe0 0x557ae1009910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:54:43.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.298+0000 7fb604a00700 1 --2- 172.21.15.82:0/586971180 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557ae1014bc0 0x557ae100f2d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb5f400f010 tx=0x7fb5f4005c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce92e821e343e436 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:54:43.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.298+0000 7fb5f1600700 1 -- 172.21.15.82:0/586971180 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f40c2070 con 0x557ae1014bc0 2024-05-08T05:54:43.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.298+0000 7fb5f1600700 1 -- 172.21.15.82:0/586971180 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5f40b27e0 con 0x557ae1014bc0 2024-05-08T05:54:43.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.298+0000 7fb5f1600700 1 -- 172.21.15.82:0/586971180 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f40a6680 con 0x557ae1014bc0 2024-05-08T05:54:43.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.300+0000 7fb611d7fb80 1 -- 172.21.15.82:0/586971180 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557ae1014bc0 msgr2=0x557ae100f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:54:43.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.300+0000 7fb611d7fb80 1 --2- 172.21.15.82:0/586971180 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557ae1014bc0 0x557ae100f2d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb5f400f010 tx=0x7fb5f4005c00 comp rx=0 tx=0).stop 2024-05-08T05:54:43.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.300+0000 7fb611d7fb80 1 -- 172.21.15.82:0/586971180 shutdown_connections 2024-05-08T05:54:43.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.300+0000 7fb611d7fb80 1 --2- 172.21.15.82:0/586971180 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ae101abe0 0x557ae1009910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:43.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.300+0000 7fb611d7fb80 1 --2- 172.21.15.82:0/586971180 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557ae1014bc0 0x557ae100f2d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:43.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.300+0000 7fb611d7fb80 1 --2- 172.21.15.82:0/586971180 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557ae10154e0 0x557ae1024f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:43.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.300+0000 7fb611d7fb80 1 -- 172.21.15.82:0/586971180 >> 172.21.15.82:0/586971180 conn(0x557ae0f876d0 msgr2=0x557ae1014040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:54:43.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.300+0000 7fb611d7fb80 1 -- 172.21.15.82:0/586971180 shutdown_connections 2024-05-08T05:54:43.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.300+0000 7fb611d7fb80 1 -- 172.21.15.82:0/586971180 wait complete. 2024-05-08T05:54:43.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.301+0000 7fb611d7fb80 1 -- start start 2024-05-08T05:54:43.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.301+0000 7fb611d7fb80 1 Processor -- start 2024-05-08T05:54:43.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.302+0000 7fb611d7fb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ae1014bc0 0x557ae102fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:43.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.302+0000 7fb611d7fb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557ae10154e0 0x557ae10303b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:43.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.303+0000 7fb611d7fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557ae101abe0 0x557ae10308f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:43.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.303+0000 7fb604a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ae1014bc0 0x557ae102fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:43.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.303+0000 7fb5ffe00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557ae10154e0 0x557ae10303b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:43.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.303+0000 7fb5ffe00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557ae10154e0 0x557ae10303b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:47766/0 (socket says 172.21.15.82:47766) 2024-05-08T05:54:43.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.303+0000 7fb604a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ae1014bc0 0x557ae102fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48020/0 (socket says 172.21.15.82:48020) 2024-05-08T05:54:43.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.303+0000 7fb604a00700 1 -- 172.21.15.82:0/9930684 learned_addr learned my addr 172.21.15.82:0/9930684 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:54:43.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.303+0000 7fb611d7fb80 1 -- 172.21.15.82:0/9930684 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb6001b5520 con 0x557ae1014bc0 2024-05-08T05:54:43.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.303+0000 7fb611d7fb80 1 -- 172.21.15.82:0/9930684 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb6001b4e50 con 0x557ae10154e0 2024-05-08T05:54:43.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.304+0000 7fb611d7fb80 1 -- 172.21.15.82:0/9930684 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb6001b2050 con 0x557ae101abe0 2024-05-08T05:54:43.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.304+0000 7fb611d7fb80 10 client.0 _ll_register_callbacks cb 0x557ae0f08c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:54:43.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.304+0000 7fb5ffe00700 1 -- 172.21.15.82:0/9930684 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557ae101abe0 msgr2=0x557ae10308f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:54:43.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.304+0000 7fb5ffe00700 1 --2- 172.21.15.82:0/9930684 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557ae101abe0 0x557ae10308f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:43.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.304+0000 7fb5ffe00700 1 -- 172.21.15.82:0/9930684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ae1014bc0 msgr2=0x557ae102fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:54:43.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.304+0000 7fb5ffe00700 1 --2- 172.21.15.82:0/9930684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ae1014bc0 0x557ae102fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:43.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.304+0000 7fb5ffe00700 1 -- 172.21.15.82:0/9930684 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ae1092270 con 0x557ae10154e0 2024-05-08T05:54:43.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.304+0000 7fb5ffe00700 1 --2- 172.21.15.82:0/9930684 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557ae10154e0 0x557ae10303b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x557ae102b4c0 tx=0x7fb5ec00be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=414e6d250286c548 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:54:43.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.304+0000 7fb5e6a00700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:54:43.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.305+0000 7fb5e6a00700 1 -- 172.21.15.82:0/9930684 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5ec017a60 con 0x557ae10154e0 2024-05-08T05:54:43.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.305+0000 7fb5e6a00700 1 -- 172.21.15.82:0/9930684 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb5ec020470 con 0x557ae10154e0 2024-05-08T05:54:43.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.305+0000 7fb611d7fb80 1 -- 172.21.15.82:0/9930684 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5f40b27e0 con 0x557ae10154e0 2024-05-08T05:54:43.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.305+0000 7fb5e6a00700 1 -- 172.21.15.82:0/9930684 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fb5ec020690 con 0x557ae10154e0 2024-05-08T05:54:43.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.305+0000 7fb611d7fb80 10 client.25613 fetch_fsmap learned FSMap version 31 2024-05-08T05:54:43.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.305+0000 7fb611d7fb80 1 -- 172.21.15.82:0/9930684 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x557ae1093550 con 0x557ae10154e0 2024-05-08T05:54:43.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.306+0000 7fb5e6a00700 1 -- 172.21.15.82:0/9930684 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb5f40b27e0 con 0x557ae10154e0 2024-05-08T05:54:43.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.306+0000 7fb5e6a00700 1 -- 172.21.15.82:0/9930684 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fb5ec00f990 con 0x557ae10154e0 2024-05-08T05:54:43.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.306+0000 7fb611d7fb80 10 client.25613 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:54:43.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.306+0000 7fb611d7fb80 10 client.25613 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-05-08T05:54:43.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.307+0000 7fb611d7fb80 20 client.25613 populate_metadata read hostname 'smithi082' 2024-05-08T05:54:43.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.307+0000 7fb611d7fb80 1 --2- 172.21.15.82:0/9930684 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x557ae1093c60 0x557ae1096080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:43.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.307+0000 7fb611d7fb80 4 client.25613 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:54:43.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.307+0000 7fb611d7fb80 1 -- 172.21.15.82:0/9930684 --> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557ae0f6f400 con 0x557ae1093c60 2024-05-08T05:54:43.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.307+0000 7fb604a00700 1 --2- 172.21.15.82:0/9930684 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x557ae1093c60 0x557ae1096080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:43.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.308+0000 7fb5e6a00700 10 client.25613 ms_handle_connect on v2:172.21.15.134:6836/2212411710 2024-05-08T05:54:43.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.308+0000 7fb604a00700 1 --2- 172.21.15.82:0/9930684 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x557ae1093c60 0x557ae1096080 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9e9bc7338ff99f45 server_cookie=8db8b6767cc8d28 in_seq=0 out_seq=0 2024-05-08T05:54:43.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.309+0000 7fb5e6a00700 1 -- 172.21.15.82:0/9930684 <== mds.4 v2:172.21.15.134:6836/2212411710 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557ae0f6f400 con 0x557ae1093c60 2024-05-08T05:54:43.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.309+0000 7fb5e6a00700 10 client.25613 handle_command_reply: tid=0 2024-05-08T05:54:43.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.309+0000 7fb611d7fb80 1 client.25613 shutdown 2024-05-08T05:54:43.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.309+0000 7fb611d7fb80 1 -- 172.21.15.82:0/9930684 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557ae10154e0 msgr2=0x557ae10303b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:54:43.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.309+0000 7fb611d7fb80 1 --2- 172.21.15.82:0/9930684 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557ae10154e0 0x557ae10303b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x557ae102b4c0 tx=0x7fb5ec00be20 comp rx=0 tx=0).stop 2024-05-08T05:54:43.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.309+0000 7fb611d7fb80 1 -- 172.21.15.82:0/9930684 shutdown_connections 2024-05-08T05:54:43.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.309+0000 7fb611d7fb80 1 --2- 172.21.15.82:0/9930684 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x557ae1093c60 0x557ae1096080 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:43.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.309+0000 7fb611d7fb80 1 --2- 172.21.15.82:0/9930684 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557ae101abe0 0x557ae10308f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:43.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.309+0000 7fb611d7fb80 1 --2- 172.21.15.82:0/9930684 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557ae1014bc0 0x557ae102fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:43.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.309+0000 7fb611d7fb80 1 --2- 172.21.15.82:0/9930684 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557ae10154e0 0x557ae10303b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:43.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.309+0000 7fb611d7fb80 1 -- 172.21.15.82:0/9930684 >> 172.21.15.82:0/9930684 conn(0x557ae0f876d0 msgr2=0x557ae10137b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:54:43.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.309+0000 7fb5e6a00700 0 client.25613 ms_handle_reset on v2:172.21.15.134:6836/2212411710 2024-05-08T05:54:43.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.310+0000 7fb611d7fb80 1 -- 172.21.15.82:0/9930684 shutdown_connections 2024-05-08T05:54:43.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.310+0000 7fb611d7fb80 1 -- 172.21.15.82:0/9930684 wait complete. 2024-05-08T05:54:43.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.310+0000 7fb611d7fb80 20 client.25613 trim_cache size 0 max 16384 2024-05-08T05:54:43.311 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T05:54:43.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.313+0000 7fb607400700 1 -- 172.21.15.82:0/3450822658 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb5e80b2900 msgr2=0x7fb5e80b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:54:43.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.313+0000 7fb607400700 1 --2- 172.21.15.82:0/3450822658 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb5e80b2900 0x7fb5e80b4dc0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb5f8009da0 tx=0x7fb5f8009700 comp rx=0 tx=0).stop 2024-05-08T05:54:43.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.313+0000 7fb607400700 1 -- 172.21.15.82:0/3450822658 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb6001023a0 msgr2=0x7fb6001a0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:54:43.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.313+0000 7fb607400700 1 --2- 172.21.15.82:0/3450822658 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb6001023a0 0x7fb6001a0430 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb5f400e9c0 tx=0x7fb5f400ecd0 comp rx=0 tx=0).stop 2024-05-08T05:54:43.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.313+0000 7fb607400700 1 -- 172.21.15.82:0/3450822658 shutdown_connections 2024-05-08T05:54:43.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.313+0000 7fb607400700 1 --2- 172.21.15.82:0/3450822658 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb5e80b2900 0x7fb5e80b4dc0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:43.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.313+0000 7fb607400700 1 --2- 172.21.15.82:0/3450822658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb600108410 0x7fb6001a4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:43.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.313+0000 7fb607400700 1 --2- 172.21.15.82:0/3450822658 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb6001023a0 0x7fb6001a0430 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:43.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.313+0000 7fb607400700 1 --2- 172.21.15.82:0/3450822658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb600102d60 0x7fb6001a0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:43.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.313+0000 7fb607400700 1 -- 172.21.15.82:0/3450822658 >> 172.21.15.82:0/3450822658 conn(0x7fb600079350 msgr2=0x7fb60006b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:54:43.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.314+0000 7fb607400700 1 -- 172.21.15.82:0/3450822658 shutdown_connections 2024-05-08T05:54:43.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:43.314+0000 7fb607400700 1 -- 172.21.15.82:0/3450822658 wait complete. 2024-05-08T05:54:43.869 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:54:43 smithi082 ceph-mon[30098]: pgmap v581: 97 pgs: 97 active+clean; 1.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 MiB/s wr, 643 op/s 2024-05-08T05:54:43.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:54:43 smithi151 ceph-mon[34815]: pgmap v581: 97 pgs: 97 active+clean; 1.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 MiB/s wr, 643 op/s 2024-05-08T05:54:43.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:54:43 smithi134 ceph-mon[34132]: pgmap v581: 97 pgs: 97 active+clean; 1.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 27 MiB/s wr, 643 op/s 2024-05-08T05:54:44.372 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-05-08T05:54:44.960 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:54:45.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 235.0 s, 2474.4 tps, lat 40.299 ms stddev 50.334 2024-05-08T05:54:45.750 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:54:45 smithi082 ceph-mon[30098]: pgmap v582: 97 pgs: 97 active+clean; 1.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 28 MiB/s wr, 653 op/s 2024-05-08T05:54:45.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:54:45 smithi151 ceph-mon[34815]: pgmap v582: 97 pgs: 97 active+clean; 1.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 28 MiB/s wr, 653 op/s 2024-05-08T05:54:45.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:54:45 smithi134 ceph-mon[34132]: pgmap v582: 97 pgs: 97 active+clean; 1.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 28 MiB/s wr, 653 op/s 2024-05-08T05:54:47.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.641+0000 7f2d63400700 1 -- 172.21.15.82:0/521546803 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d5c06b1b0 msgr2=0x7f2d5c06b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:54:47.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.641+0000 7f2d63400700 1 --2- 172.21.15.82:0/521546803 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d5c06b1b0 0x7f2d5c06b590 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2d500098f0 tx=0x7f2d50009c00 comp rx=0 tx=0).stop 2024-05-08T05:54:47.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.642+0000 7f2d63400700 1 -- 172.21.15.82:0/521546803 shutdown_connections 2024-05-08T05:54:47.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.642+0000 7f2d63400700 1 --2- 172.21.15.82:0/521546803 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d5c06b1b0 0x7f2d5c06b590 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:47.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.642+0000 7f2d63400700 1 --2- 172.21.15.82:0/521546803 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d5c10ff50 0x7f2d5c112340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:47.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.642+0000 7f2d63400700 1 --2- 172.21.15.82:0/521546803 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d5c06bad0 0x7f2d5c10fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:47.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.642+0000 7f2d63400700 1 -- 172.21.15.82:0/521546803 >> 172.21.15.82:0/521546803 conn(0x7f2d5c079350 msgr2=0x7f2d5c079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:54:47.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.642+0000 7f2d63400700 1 -- 172.21.15.82:0/521546803 shutdown_connections 2024-05-08T05:54:47.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.642+0000 7f2d63400700 1 -- 172.21.15.82:0/521546803 wait complete. 2024-05-08T05:54:47.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.644+0000 7f2d63400700 1 Processor -- start 2024-05-08T05:54:47.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.644+0000 7f2d63400700 1 -- start start 2024-05-08T05:54:47.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.644+0000 7f2d63400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d5c06b1b0 0x7f2d5c104680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:47.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.645+0000 7f2d63400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d5c06bad0 0x7f2d5c104bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:47.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.645+0000 7f2d63400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d5c10ff50 0x7f2d5c105100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:47.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.645+0000 7f2d63400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2d5c1158b0 con 0x7f2d5c10ff50 2024-05-08T05:54:47.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.645+0000 7f2d63400700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2d5c115730 con 0x7f2d5c06b1b0 2024-05-08T05:54:47.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.645+0000 7f2d63400700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2d5c115a30 con 0x7f2d5c06bad0 2024-05-08T05:54:47.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.645+0000 7f2d60a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d5c06b1b0 0x7f2d5c104680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:47.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.645+0000 7f2d60a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d5c06b1b0 0x7f2d5c104680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:47796/0 (socket says 172.21.15.82:47796) 2024-05-08T05:54:47.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.645+0000 7f2d60a00700 1 -- 172.21.15.82:0/2883164124 learned_addr learned my addr 172.21.15.82:0/2883164124 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:54:47.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.645+0000 7f2d5be00700 1 --2- 172.21.15.82:0/2883164124 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d5c06bad0 0x7f2d5c104bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:47.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.646+0000 7f2d60a00700 1 -- 172.21.15.82:0/2883164124 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d5c06bad0 msgr2=0x7f2d5c104bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:54:47.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.646+0000 7f2d60a00700 1 --2- 172.21.15.82:0/2883164124 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d5c06bad0 0x7f2d5c104bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:47.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.646+0000 7f2d60a00700 1 -- 172.21.15.82:0/2883164124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d5c10ff50 msgr2=0x7f2d5c105100 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T05:54:47.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.646+0000 7f2d61400700 1 --2- 172.21.15.82:0/2883164124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d5c10ff50 0x7f2d5c105100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:47.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.647+0000 7f2d60a00700 1 --2- 172.21.15.82:0/2883164124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d5c10ff50 0x7f2d5c105100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:47.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.647+0000 7f2d60a00700 1 -- 172.21.15.82:0/2883164124 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d5c1ac560 con 0x7f2d5c06b1b0 2024-05-08T05:54:47.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.647+0000 7f2d61400700 1 --2- 172.21.15.82:0/2883164124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d5c10ff50 0x7f2d5c105100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:54:47.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.647+0000 7f2d60a00700 1 --2- 172.21.15.82:0/2883164124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d5c06b1b0 0x7f2d5c104680 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2d5000fa70 tx=0x7f2d50005040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:54:47.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.648+0000 7f2d59600700 1 -- 172.21.15.82:0/2883164124 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d50025070 con 0x7f2d5c06b1b0 2024-05-08T05:54:47.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.648+0000 7f2d59600700 1 -- 172.21.15.82:0/2883164124 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d5000ba10 con 0x7f2d5c06b1b0 2024-05-08T05:54:47.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.648+0000 7f2d63400700 1 -- 172.21.15.82:0/2883164124 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d5c1ac7f0 con 0x7f2d5c06b1b0 2024-05-08T05:54:47.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.648+0000 7f2d59600700 1 -- 172.21.15.82:0/2883164124 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d50003c40 con 0x7f2d5c06b1b0 2024-05-08T05:54:47.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.648+0000 7f2d63400700 1 -- 172.21.15.82:0/2883164124 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d5c1acc40 con 0x7f2d5c06b1b0 2024-05-08T05:54:47.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.653+0000 7f2d59600700 1 -- 172.21.15.82:0/2883164124 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f2d50028070 con 0x7f2d5c06b1b0 2024-05-08T05:54:47.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.655+0000 7f2d59600700 1 --2- 172.21.15.82:0/2883164124 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2d440b29d0 0x7f2d440b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:47.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.655+0000 7f2d6dd89b80 1 Processor -- start 2024-05-08T05:54:47.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.655+0000 7f2d59600700 1 -- 172.21.15.82:0/2883164124 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2d500e2a40 con 0x7f2d5c06b1b0 2024-05-08T05:54:47.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.656+0000 7f2d5be00700 1 --2- 172.21.15.82:0/2883164124 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2d440b29d0 0x7f2d440b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:47.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.657+0000 7f2d5be00700 1 --2- 172.21.15.82:0/2883164124 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2d440b29d0 0x7f2d440b4e90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c105e40 tx=0x7f2d48009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:54:47.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.657+0000 7f2d6dd89b80 1 -- start start 2024-05-08T05:54:47.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.657+0000 7f2d6dd89b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a2d0cc060 0x561a2d0cc440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:47.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.657+0000 7f2d6dd89b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a2d0cc980 0x561a2d0d0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:47.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.658+0000 7f2d6dd89b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a2d0d09d0 0x561a2d0d0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:47.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.658+0000 7f2d6dd89b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x561a2d01ea20 con 0x561a2d0d09d0 2024-05-08T05:54:47.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.658+0000 7f2d6dd89b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x561a2cfbc760 con 0x561a2d0cc060 2024-05-08T05:54:47.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.658+0000 7f2d6dd89b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x561a2d01a9e0 con 0x561a2d0cc980 2024-05-08T05:54:47.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.658+0000 7f2d5be00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a2d0cc980 0x561a2d0d0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:47.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.658+0000 7f2d5be00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a2d0cc980 0x561a2d0d0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:44958/0 (socket says 172.21.15.82:44958) 2024-05-08T05:54:47.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.658+0000 7f2d5be00700 1 -- 172.21.15.82:0/1380032558 learned_addr learned my addr 172.21.15.82:0/1380032558 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:54:47.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.658+0000 7f2d60a00700 1 --2- 172.21.15.82:0/1380032558 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a2d0cc060 0x561a2d0cc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:47.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.659+0000 7f2d61400700 1 --2- 172.21.15.82:0/1380032558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a2d0d09d0 0x561a2d0d0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:47.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.659+0000 7f2d5be00700 1 -- 172.21.15.82:0/1380032558 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a2d0cc060 msgr2=0x561a2d0cc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:54:47.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.660+0000 7f2d5be00700 1 --2- 172.21.15.82:0/1380032558 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a2d0cc060 0x561a2d0cc440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:47.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.660+0000 7f2d5be00700 1 -- 172.21.15.82:0/1380032558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a2d0d09d0 msgr2=0x561a2d0d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:54:47.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.660+0000 7f2d5be00700 1 --2- 172.21.15.82:0/1380032558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a2d0d09d0 0x561a2d0d0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:47.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.660+0000 7f2d5be00700 1 -- 172.21.15.82:0/1380032558 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a2cf6b8d0 con 0x561a2d0cc980 2024-05-08T05:54:47.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.660+0000 7f2d60a00700 1 --2- 172.21.15.82:0/1380032558 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a2d0cc060 0x561a2d0cc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:54:47.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.660+0000 7f2d61400700 1 --2- 172.21.15.82:0/1380032558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a2d0d09d0 0x561a2d0d0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:54:47.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.660+0000 7f2d5be00700 1 --2- 172.21.15.82:0/1380032558 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a2d0cc980 0x561a2d0d0490 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2d48011de0 tx=0x7f2d48014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25e1bc6276a78621 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:54:47.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.661+0000 7f2d4e000700 1 -- 172.21.15.82:0/1380032558 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d4801f420 con 0x561a2d0cc980 2024-05-08T05:54:47.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.661+0000 7f2d4e000700 1 -- 172.21.15.82:0/1380032558 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d4801fa70 con 0x561a2d0cc980 2024-05-08T05:54:47.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.661+0000 7f2d4e000700 1 -- 172.21.15.82:0/1380032558 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d4801db70 con 0x561a2d0cc980 2024-05-08T05:54:47.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.662+0000 7f2d6dd89b80 1 -- 172.21.15.82:0/1380032558 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a2d0cc980 msgr2=0x561a2d0d0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:54:47.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.662+0000 7f2d6dd89b80 1 --2- 172.21.15.82:0/1380032558 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a2d0cc980 0x561a2d0d0490 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2d48011de0 tx=0x7f2d48014000 comp rx=0 tx=0).stop 2024-05-08T05:54:47.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.662+0000 7f2d6dd89b80 1 -- 172.21.15.82:0/1380032558 shutdown_connections 2024-05-08T05:54:47.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.662+0000 7f2d6dd89b80 1 --2- 172.21.15.82:0/1380032558 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a2d0cc060 0x561a2d0cc440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:47.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.662+0000 7f2d6dd89b80 1 --2- 172.21.15.82:0/1380032558 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a2d0d09d0 0x561a2d0d0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:47.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.662+0000 7f2d6dd89b80 1 --2- 172.21.15.82:0/1380032558 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a2d0cc980 0x561a2d0d0490 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:47.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.662+0000 7f2d6dd89b80 1 -- 172.21.15.82:0/1380032558 >> 172.21.15.82:0/1380032558 conn(0x561a2cffab60 msgr2=0x561a2d0c67a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:54:47.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.663+0000 7f2d6dd89b80 1 -- 172.21.15.82:0/1380032558 shutdown_connections 2024-05-08T05:54:47.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.664+0000 7f2d6dd89b80 1 -- 172.21.15.82:0/1380032558 wait complete. 2024-05-08T05:54:47.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.664+0000 7f2d6dd89b80 1 -- start start 2024-05-08T05:54:47.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.665+0000 7f2d6dd89b80 1 Processor -- start 2024-05-08T05:54:47.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.666+0000 7f2d6dd89b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a2d0cc060 0x561a2d0d7e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:47.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.666+0000 7f2d6dd89b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a2d0cc980 0x561a2d0d5250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:47.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.666+0000 7f2d60a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a2d0cc060 0x561a2d0d7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:47.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.667+0000 7f2d60a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a2d0cc060 0x561a2d0d7e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:47818/0 (socket says 172.21.15.82:47818) 2024-05-08T05:54:47.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.667+0000 7f2d6dd89b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a2d0d09d0 0x561a2d0d5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:47.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.667+0000 7f2d6dd89b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x561a2d0d8be0 con 0x561a2d0d09d0 2024-05-08T05:54:47.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.667+0000 7f2d6dd89b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x561a2cf84b20 con 0x561a2d0cc060 2024-05-08T05:54:47.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.667+0000 7f2d6dd89b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x561a2d0d8d60 con 0x561a2d0cc980 2024-05-08T05:54:47.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.667+0000 7f2d6dd89b80 10 client.0 _ll_register_callbacks cb 0x561a2cfc5c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:54:47.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.667+0000 7f2d60a00700 1 -- 172.21.15.82:0/2300325772 learned_addr learned my addr 172.21.15.82:0/2300325772 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:54:47.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.667+0000 7f2d61400700 1 --2- 172.21.15.82:0/2300325772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a2d0d09d0 0x561a2d0d5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:47.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.668+0000 7f2d60a00700 1 -- 172.21.15.82:0/2300325772 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a2d0cc980 msgr2=0x561a2d0d5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:54:47.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.668+0000 7f2d60a00700 1 --2- 172.21.15.82:0/2300325772 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a2d0cc980 0x561a2d0d5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:47.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.668+0000 7f2d60a00700 1 -- 172.21.15.82:0/2300325772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a2d0d09d0 msgr2=0x561a2d0d5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:54:47.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.669+0000 7f2d60a00700 1 --2- 172.21.15.82:0/2300325772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a2d0d09d0 0x561a2d0d5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:47.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.669+0000 7f2d60a00700 1 -- 172.21.15.82:0/2300325772 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a2cfe4420 con 0x561a2d0cc060 2024-05-08T05:54:47.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.669+0000 7f2d61400700 1 --2- 172.21.15.82:0/2300325772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a2d0d09d0 0x561a2d0d5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:54:47.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.669+0000 7f2d60a00700 1 --2- 172.21.15.82:0/2300325772 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a2d0cc060 0x561a2d0d7e60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2d500a6180 tx=0x7f2d5000bdb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f2cf13e2271299c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:54:47.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.669+0000 7f2d42a00700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:54:47.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.669+0000 7f2d42a00700 1 -- 172.21.15.82:0/2300325772 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d500aa800 con 0x561a2d0cc060 2024-05-08T05:54:47.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.669+0000 7f2d42a00700 1 -- 172.21.15.82:0/2300325772 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2d500aa570 con 0x561a2d0cc060 2024-05-08T05:54:47.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.670+0000 7f2d6dd89b80 1 -- 172.21.15.82:0/2300325772 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d4801fa70 con 0x561a2d0cc060 2024-05-08T05:54:47.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.670+0000 7f2d42a00700 1 -- 172.21.15.82:0/2300325772 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f2d500aa100 con 0x561a2d0cc060 2024-05-08T05:54:47.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.670+0000 7f2d6dd89b80 10 client.25622 fetch_fsmap learned FSMap version 31 2024-05-08T05:54:47.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.670+0000 7f2d6dd89b80 1 -- 172.21.15.82:0/2300325772 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x561a2d0e33c0 con 0x561a2d0cc060 2024-05-08T05:54:47.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.671+0000 7f2d42a00700 1 -- 172.21.15.82:0/2300325772 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d4801fa70 con 0x561a2d0cc060 2024-05-08T05:54:47.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.671+0000 7f2d42a00700 1 -- 172.21.15.82:0/2300325772 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f2d5001f030 con 0x561a2d0cc060 2024-05-08T05:54:47.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.672+0000 7f2d6dd89b80 10 client.25622 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:54:47.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.672+0000 7f2d6dd89b80 10 client.25622 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-05-08T05:54:47.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.672+0000 7f2d6dd89b80 20 client.25622 populate_metadata read hostname 'smithi082' 2024-05-08T05:54:47.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.672+0000 7f2d6dd89b80 1 --2- 172.21.15.82:0/2300325772 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x561a2d0e5a20 0x561a2d0e7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:47.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.672+0000 7f2d6dd89b80 4 client.25622 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:54:47.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.672+0000 7f2d6dd89b80 1 -- 172.21.15.82:0/2300325772 --> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561a2d0990a0 con 0x561a2d0e5a20 2024-05-08T05:54:47.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.672+0000 7f2d5be00700 1 --2- 172.21.15.82:0/2300325772 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x561a2d0e5a20 0x561a2d0e7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:47.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.673+0000 7f2d5be00700 1 --2- 172.21.15.82:0/2300325772 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x561a2d0e5a20 0x561a2d0e7e80 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1eabb3843a7f12ea server_cookie=943fb08f71c76c2 in_seq=0 out_seq=0 2024-05-08T05:54:47.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.673+0000 7f2d42a00700 10 client.25622 ms_handle_connect on v2:172.21.15.151:6834/2093655929 2024-05-08T05:54:47.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.674+0000 7f2d42a00700 1 -- 172.21.15.82:0/2300325772 <== mds.3 v2:172.21.15.151:6834/2093655929 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x561a2d0990a0 con 0x561a2d0e5a20 2024-05-08T05:54:47.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.674+0000 7f2d42a00700 10 client.25622 handle_command_reply: tid=0 2024-05-08T05:54:47.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.674+0000 7f2d6dd89b80 1 client.25622 shutdown 2024-05-08T05:54:47.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.674+0000 7f2d6dd89b80 1 -- 172.21.15.82:0/2300325772 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a2d0cc060 msgr2=0x561a2d0d7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:54:47.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.674+0000 7f2d6dd89b80 1 --2- 172.21.15.82:0/2300325772 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a2d0cc060 0x561a2d0d7e60 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2d500a6180 tx=0x7f2d5000bdb0 comp rx=0 tx=0).stop 2024-05-08T05:54:47.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.675+0000 7f2d6dd89b80 1 -- 172.21.15.82:0/2300325772 shutdown_connections 2024-05-08T05:54:47.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.675+0000 7f2d6dd89b80 1 --2- 172.21.15.82:0/2300325772 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x561a2d0e5a20 0x561a2d0e7e80 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:47.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.675+0000 7f2d6dd89b80 1 --2- 172.21.15.82:0/2300325772 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a2d0cc060 0x561a2d0d7e60 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:47.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.675+0000 7f2d6dd89b80 1 --2- 172.21.15.82:0/2300325772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a2d0d09d0 0x561a2d0d5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:47.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.675+0000 7f2d6dd89b80 1 --2- 172.21.15.82:0/2300325772 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a2d0cc980 0x561a2d0d5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:47.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.675+0000 7f2d6dd89b80 1 -- 172.21.15.82:0/2300325772 >> 172.21.15.82:0/2300325772 conn(0x561a2cffab60 msgr2=0x561a2d0c12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:54:47.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.675+0000 7f2d42a00700 0 client.25622 ms_handle_reset on v2:172.21.15.151:6834/2093655929 2024-05-08T05:54:47.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.675+0000 7f2d6dd89b80 1 -- 172.21.15.82:0/2300325772 shutdown_connections 2024-05-08T05:54:47.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.675+0000 7f2d6dd89b80 1 -- 172.21.15.82:0/2300325772 wait complete. 2024-05-08T05:54:47.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.676+0000 7f2d6dd89b80 20 client.25622 trim_cache size 0 max 16384 2024-05-08T05:54:47.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.707+0000 7f2d6dd89b80 1 Processor -- start 2024-05-08T05:54:47.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.707+0000 7f2d6dd89b80 1 -- start start 2024-05-08T05:54:47.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.707+0000 7f2d6dd89b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a2d0cc060 0x561a2d0e1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:47.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.707+0000 7f2d6dd89b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a2d0cc980 0x561a2d0ed750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:47.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.707+0000 7f2d6dd89b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a2d0d09d0 0x561a2d0edc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:47.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.707+0000 7f2d6dd89b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2d5c1b4070 con 0x561a2d0cc980 2024-05-08T05:54:47.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.707+0000 7f2d6dd89b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2d5c1b5bb0 con 0x561a2d0cc060 2024-05-08T05:54:47.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.707+0000 7f2d6dd89b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2d5c1b4740 con 0x561a2d0d09d0 2024-05-08T05:54:47.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.707+0000 7f2d5be00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a2d0cc980 0x561a2d0ed750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:47.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.707+0000 7f2d60a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a2d0cc060 0x561a2d0e1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:47.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.707+0000 7f2d60a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a2d0cc060 0x561a2d0e1c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:47828/0 (socket says 172.21.15.82:47828) 2024-05-08T05:54:47.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.707+0000 7f2d60a00700 1 -- 172.21.15.82:0/1753122517 learned_addr learned my addr 172.21.15.82:0/1753122517 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:54:47.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.708+0000 7f2d61400700 1 --2- 172.21.15.82:0/1753122517 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a2d0d09d0 0x561a2d0edc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:47.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.708+0000 7f2d60a00700 1 -- 172.21.15.82:0/1753122517 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a2d0d09d0 msgr2=0x561a2d0edc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:54:47.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.708+0000 7f2d60a00700 1 --2- 172.21.15.82:0/1753122517 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a2d0d09d0 0x561a2d0edc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:47.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.708+0000 7f2d60a00700 1 -- 172.21.15.82:0/1753122517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a2d0cc980 msgr2=0x561a2d0ed750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:54:47.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.708+0000 7f2d60a00700 1 --2- 172.21.15.82:0/1753122517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a2d0cc980 0x561a2d0ed750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:47.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.708+0000 7f2d60a00700 1 -- 172.21.15.82:0/1753122517 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a2d0d7aa0 con 0x561a2d0cc060 2024-05-08T05:54:47.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.708+0000 7f2d5be00700 1 --2- 172.21.15.82:0/1753122517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a2d0cc980 0x561a2d0ed750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:54:47.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.708+0000 7f2d61400700 1 --2- 172.21.15.82:0/1753122517 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a2d0d09d0 0x561a2d0edc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:54:47.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.708+0000 7f2d60a00700 1 --2- 172.21.15.82:0/1753122517 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a2d0cc060 0x561a2d0e1c70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2d500a9e00 tx=0x7f2d50009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa742fa759fc4ff5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:54:47.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.709+0000 7f2d4d600700 1 -- 172.21.15.82:0/1753122517 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d500aa800 con 0x561a2d0cc060 2024-05-08T05:54:47.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.709+0000 7f2d4d600700 1 -- 172.21.15.82:0/1753122517 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d500ae4b0 con 0x561a2d0cc060 2024-05-08T05:54:47.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.709+0000 7f2d4d600700 1 -- 172.21.15.82:0/1753122517 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d500a5a70 con 0x561a2d0cc060 2024-05-08T05:54:47.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.710+0000 7f2d6dd89b80 1 -- 172.21.15.82:0/1753122517 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a2d0cc060 msgr2=0x561a2d0e1c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:54:47.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.710+0000 7f2d6dd89b80 1 --2- 172.21.15.82:0/1753122517 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a2d0cc060 0x561a2d0e1c70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2d500a9e00 tx=0x7f2d50009c00 comp rx=0 tx=0).stop 2024-05-08T05:54:47.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.711+0000 7f2d6dd89b80 1 -- 172.21.15.82:0/1753122517 shutdown_connections 2024-05-08T05:54:47.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.711+0000 7f2d6dd89b80 1 --2- 172.21.15.82:0/1753122517 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a2d0cc060 0x561a2d0e1c70 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:47.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.711+0000 7f2d6dd89b80 1 --2- 172.21.15.82:0/1753122517 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a2d0d09d0 0x561a2d0edc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:47.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.711+0000 7f2d6dd89b80 1 --2- 172.21.15.82:0/1753122517 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a2d0cc980 0x561a2d0ed750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:47.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.711+0000 7f2d6dd89b80 1 -- 172.21.15.82:0/1753122517 >> 172.21.15.82:0/1753122517 conn(0x561a2cffab60 msgr2=0x561a2d0d3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:54:47.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.711+0000 7f2d6dd89b80 1 -- 172.21.15.82:0/1753122517 shutdown_connections 2024-05-08T05:54:47.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.711+0000 7f2d6dd89b80 1 -- 172.21.15.82:0/1753122517 wait complete. 2024-05-08T05:54:47.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.712+0000 7f2d6dd89b80 1 -- start start 2024-05-08T05:54:47.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.712+0000 7f2d6dd89b80 1 Processor -- start 2024-05-08T05:54:47.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.713+0000 7f2d6dd89b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a2d0cc060 0x561a2d0de490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:47.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.713+0000 7f2d6dd89b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a2d0cc980 0x561a2d0d1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:47.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.713+0000 7f2d6dd89b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a2d0d09d0 0x561a2d0d2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:47.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.713+0000 7f2d6dd89b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2d5c1b54e0 con 0x561a2d0cc980 2024-05-08T05:54:47.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.713+0000 7f2d6dd89b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2d5c1b4e10 con 0x561a2d0cc060 2024-05-08T05:54:47.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.713+0000 7f2d6dd89b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2d5c1b2030 con 0x561a2d0d09d0 2024-05-08T05:54:47.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.713+0000 7f2d6dd89b80 10 client.0 _ll_register_callbacks cb 0x561a2cfc5c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:54:47.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.713+0000 7f2d60a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a2d0cc060 0x561a2d0de490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:47.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.713+0000 7f2d60a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a2d0cc060 0x561a2d0de490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:47842/0 (socket says 172.21.15.82:47842) 2024-05-08T05:54:47.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.713+0000 7f2d61400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a2d0d09d0 0x561a2d0d2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:47.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.713+0000 7f2d5be00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a2d0cc980 0x561a2d0d1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:47.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.713+0000 7f2d61400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a2d0d09d0 0x561a2d0d2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:44976/0 (socket says 172.21.15.82:44976) 2024-05-08T05:54:47.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.713+0000 7f2d61400700 1 -- 172.21.15.82:0/347085322 learned_addr learned my addr 172.21.15.82:0/347085322 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:54:47.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.714+0000 7f2d61400700 1 -- 172.21.15.82:0/347085322 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a2d0cc060 msgr2=0x561a2d0de490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:54:47.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.714+0000 7f2d61400700 1 --2- 172.21.15.82:0/347085322 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a2d0cc060 0x561a2d0de490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:47.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.714+0000 7f2d61400700 1 -- 172.21.15.82:0/347085322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a2d0cc980 msgr2=0x561a2d0d1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:54:47.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.714+0000 7f2d61400700 1 --2- 172.21.15.82:0/347085322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a2d0cc980 0x561a2d0d1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:47.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.714+0000 7f2d61400700 1 -- 172.21.15.82:0/347085322 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a2d0d2a50 con 0x561a2d0d09d0 2024-05-08T05:54:47.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.714+0000 7f2d61400700 1 --2- 172.21.15.82:0/347085322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a2d0d09d0 0x561a2d0d2210 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2d54007c10 tx=0x7f2d540099e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff342aa376e9d5ac server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:54:47.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.715+0000 7f2d42a00700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:54:47.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.715+0000 7f2d42a00700 1 -- 172.21.15.82:0/347085322 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d54013890 con 0x561a2d0d09d0 2024-05-08T05:54:47.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.715+0000 7f2d42a00700 1 -- 172.21.15.82:0/347085322 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2d54013a30 con 0x561a2d0d09d0 2024-05-08T05:54:47.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.715+0000 7f2d6dd89b80 1 -- 172.21.15.82:0/347085322 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d500ae4b0 con 0x561a2d0d09d0 2024-05-08T05:54:47.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.715+0000 7f2d42a00700 1 -- 172.21.15.82:0/347085322 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f2d54013c30 con 0x561a2d0d09d0 2024-05-08T05:54:47.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.715+0000 7f2d6dd89b80 10 client.25666 fetch_fsmap learned FSMap version 31 2024-05-08T05:54:47.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.715+0000 7f2d6dd89b80 1 -- 172.21.15.82:0/347085322 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x561a2d150300 con 0x561a2d0d09d0 2024-05-08T05:54:47.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.716+0000 7f2d42a00700 1 -- 172.21.15.82:0/347085322 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2d500ae4b0 con 0x561a2d0d09d0 2024-05-08T05:54:47.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.717+0000 7f2d42a00700 1 -- 172.21.15.82:0/347085322 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f2d540214a0 con 0x561a2d0d09d0 2024-05-08T05:54:47.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.717+0000 7f2d6dd89b80 10 client.25666 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:54:47.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.717+0000 7f2d6dd89b80 10 client.25666 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-05-08T05:54:47.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.717+0000 7f2d6dd89b80 20 client.25666 populate_metadata read hostname 'smithi082' 2024-05-08T05:54:47.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.717+0000 7f2d6dd89b80 1 --2- 172.21.15.82:0/347085322 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x561a2d1509b0 0x561a2d152dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:47.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.717+0000 7f2d6dd89b80 4 client.25666 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:54:47.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.717+0000 7f2d6dd89b80 1 -- 172.21.15.82:0/347085322 --> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561a2d02c400 con 0x561a2d1509b0 2024-05-08T05:54:47.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.717+0000 7f2d60a00700 1 --2- 172.21.15.82:0/347085322 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x561a2d1509b0 0x561a2d152dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:47.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.718+0000 7f2d60a00700 1 --2- 172.21.15.82:0/347085322 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x561a2d1509b0 0x561a2d152dd0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5c43651aa839700b server_cookie=5214f505f3724087 in_seq=0 out_seq=0 2024-05-08T05:54:47.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.718+0000 7f2d42a00700 10 client.25666 ms_handle_connect on v2:172.21.15.151:6834/2093655929 2024-05-08T05:54:47.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.718+0000 7f2d42a00700 1 -- 172.21.15.82:0/347085322 <== mds.3 v2:172.21.15.151:6834/2093655929 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561a2d02c400 con 0x561a2d1509b0 2024-05-08T05:54:47.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.718+0000 7f2d42a00700 10 client.25666 handle_command_reply: tid=0 2024-05-08T05:54:47.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.718+0000 7f2d6dd89b80 1 client.25666 shutdown 2024-05-08T05:54:47.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.718+0000 7f2d6dd89b80 1 -- 172.21.15.82:0/347085322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a2d0d09d0 msgr2=0x561a2d0d2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:54:47.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.718+0000 7f2d6dd89b80 1 --2- 172.21.15.82:0/347085322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a2d0d09d0 0x561a2d0d2210 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2d54007c10 tx=0x7f2d540099e0 comp rx=0 tx=0).stop 2024-05-08T05:54:47.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.718+0000 7f2d6dd89b80 1 -- 172.21.15.82:0/347085322 shutdown_connections 2024-05-08T05:54:47.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.718+0000 7f2d6dd89b80 1 --2- 172.21.15.82:0/347085322 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x561a2d1509b0 0x561a2d152dd0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:47.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.718+0000 7f2d42a00700 0 client.25666 ms_handle_reset on v2:172.21.15.151:6834/2093655929 2024-05-08T05:54:47.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.718+0000 7f2d6dd89b80 1 --2- 172.21.15.82:0/347085322 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a2d0cc060 0x561a2d0de490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:47.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.718+0000 7f2d6dd89b80 1 --2- 172.21.15.82:0/347085322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a2d0d09d0 0x561a2d0d2210 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:47.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.718+0000 7f2d6dd89b80 1 --2- 172.21.15.82:0/347085322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561a2d0cc980 0x561a2d0d1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:47.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.718+0000 7f2d6dd89b80 1 -- 172.21.15.82:0/347085322 >> 172.21.15.82:0/347085322 conn(0x561a2cffab60 msgr2=0x561a2d0c0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:54:47.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.719+0000 7f2d6dd89b80 1 -- 172.21.15.82:0/347085322 shutdown_connections 2024-05-08T05:54:47.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.719+0000 7f2d6dd89b80 1 -- 172.21.15.82:0/347085322 wait complete. 2024-05-08T05:54:47.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.719+0000 7f2d6dd89b80 20 client.25666 trim_cache size 0 max 16384 2024-05-08T05:54:47.720 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T05:54:47.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.720+0000 7f2d63400700 1 -- 172.21.15.82:0/2883164124 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2d440b29d0 msgr2=0x7f2d440b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:54:47.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.720+0000 7f2d63400700 1 --2- 172.21.15.82:0/2883164124 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2d440b29d0 0x7f2d440b4e90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c105e40 tx=0x7f2d48009260 comp rx=0 tx=0).stop 2024-05-08T05:54:47.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.720+0000 7f2d63400700 1 -- 172.21.15.82:0/2883164124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d5c06b1b0 msgr2=0x7f2d5c104680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:54:47.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.720+0000 7f2d63400700 1 --2- 172.21.15.82:0/2883164124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d5c06b1b0 0x7f2d5c104680 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2d5000fa70 tx=0x7f2d50005040 comp rx=0 tx=0).stop 2024-05-08T05:54:47.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.720+0000 7f2d63400700 1 -- 172.21.15.82:0/2883164124 shutdown_connections 2024-05-08T05:54:47.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.720+0000 7f2d63400700 1 --2- 172.21.15.82:0/2883164124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d5c06b1b0 0x7f2d5c104680 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:47.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.720+0000 7f2d63400700 1 --2- 172.21.15.82:0/2883164124 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2d440b29d0 0x7f2d440b4e90 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:47.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.720+0000 7f2d63400700 1 --2- 172.21.15.82:0/2883164124 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2d5c10ff50 0x7f2d5c105100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:47.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.720+0000 7f2d63400700 1 --2- 172.21.15.82:0/2883164124 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d5c06bad0 0x7f2d5c104bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:47.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.720+0000 7f2d63400700 1 -- 172.21.15.82:0/2883164124 >> 172.21.15.82:0/2883164124 conn(0x7f2d5c079350 msgr2=0x7f2d5c1114e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:54:47.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.720+0000 7f2d63400700 1 -- 172.21.15.82:0/2883164124 shutdown_connections 2024-05-08T05:54:47.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:47.720+0000 7f2d63400700 1 -- 172.21.15.82:0/2883164124 wait complete. 2024-05-08T05:54:47.829 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:54:47 smithi082 ceph-mon[30098]: pgmap v583: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 30 MiB/s wr, 737 op/s 2024-05-08T05:54:47.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:54:47 smithi151 ceph-mon[34815]: pgmap v583: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 30 MiB/s wr, 737 op/s 2024-05-08T05:54:48.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:54:47 smithi134 ceph-mon[34132]: pgmap v583: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 30 MiB/s wr, 737 op/s 2024-05-08T05:54:48.779 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-05-08T05:54:49.397 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:54:49.824 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:54:49 smithi082 ceph-mon[30098]: pgmap v584: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 22 MiB/s wr, 637 op/s 2024-05-08T05:54:49.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:54:49 smithi151 ceph-mon[34815]: pgmap v584: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 22 MiB/s wr, 637 op/s 2024-05-08T05:54:50.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:54:49 smithi134 ceph-mon[34132]: pgmap v584: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 22 MiB/s wr, 637 op/s 2024-05-08T05:54:50.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 240.0 s, 2407.1 tps, lat 41.515 ms stddev 49.051 2024-05-08T05:54:51.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:54:51 smithi082 ceph-mon[30098]: pgmap v585: 97 pgs: 97 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 28 MiB/s wr, 798 op/s 2024-05-08T05:54:51.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:54:51 smithi151 ceph-mon[34815]: pgmap v585: 97 pgs: 97 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 28 MiB/s wr, 798 op/s 2024-05-08T05:54:51.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:54:51 smithi134 ceph-mon[34132]: pgmap v585: 97 pgs: 97 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 28 MiB/s wr, 798 op/s 2024-05-08T05:54:52.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.071+0000 7f7322400700 1 -- 172.21.15.82:0/3260358967 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f731c111c80 msgr2=0x7f731c10a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:54:52.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.071+0000 7f7322400700 1 --2- 172.21.15.82:0/3260358967 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f731c111c80 0x7f731c10a4a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f73040098f0 tx=0x7f7304009c00 comp rx=0 tx=0).stop 2024-05-08T05:54:52.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.072+0000 7f7322400700 1 -- 172.21.15.82:0/3260358967 shutdown_connections 2024-05-08T05:54:52.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.072+0000 7f7322400700 1 --2- 172.21.15.82:0/3260358967 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f731c11cc80 0x7f731c11f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:52.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.072+0000 7f7322400700 1 --2- 172.21.15.82:0/3260358967 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f731c111c80 0x7f731c10a4a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:52.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.072+0000 7f7322400700 1 --2- 172.21.15.82:0/3260358967 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f731c10a9e0 0x7f731c10ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:52.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.072+0000 7f7322400700 1 -- 172.21.15.82:0/3260358967 >> 172.21.15.82:0/3260358967 conn(0x7f731c06e610 msgr2=0x7f731c06ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:54:52.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.072+0000 7f7322400700 1 -- 172.21.15.82:0/3260358967 shutdown_connections 2024-05-08T05:54:52.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.072+0000 7f7322400700 1 -- 172.21.15.82:0/3260358967 wait complete. 2024-05-08T05:54:52.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.073+0000 7f7322400700 1 Processor -- start 2024-05-08T05:54:52.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.074+0000 7f7322400700 1 -- start start 2024-05-08T05:54:52.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.074+0000 7f7322400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f731c10a9e0 0x7f731c11b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:52.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.074+0000 7f7322400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f731c111c80 0x7f731c1143a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:52.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.075+0000 7f7322400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f731c11cc80 0x7f731c1148e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:52.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.075+0000 7f7322400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f731c122540 con 0x7f731c10a9e0 2024-05-08T05:54:52.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.075+0000 7f7322400700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f731c1223c0 con 0x7f731c111c80 2024-05-08T05:54:52.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.075+0000 7f7322400700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f731c1226c0 con 0x7f731c11cc80 2024-05-08T05:54:52.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.075+0000 7f731aa00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f731c111c80 0x7f731c1143a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:52.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.075+0000 7f731aa00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f731c111c80 0x7f731c1143a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:47862/0 (socket says 172.21.15.82:47862) 2024-05-08T05:54:52.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.075+0000 7f731aa00700 1 -- 172.21.15.82:0/1780425506 learned_addr learned my addr 172.21.15.82:0/1780425506 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:54:52.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.075+0000 7f731b400700 1 --2- 172.21.15.82:0/1780425506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f731c10a9e0 0x7f731c11b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:52.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.075+0000 7f731be00700 1 --2- 172.21.15.82:0/1780425506 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f731c11cc80 0x7f731c1148e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:52.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.075+0000 7f731aa00700 1 -- 172.21.15.82:0/1780425506 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f731c11cc80 msgr2=0x7f731c1148e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:54:52.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.075+0000 7f731aa00700 1 --2- 172.21.15.82:0/1780425506 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f731c11cc80 0x7f731c1148e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:52.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.075+0000 7f731aa00700 1 -- 172.21.15.82:0/1780425506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f731c10a9e0 msgr2=0x7f731c11b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:54:52.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.075+0000 7f731aa00700 1 --2- 172.21.15.82:0/1780425506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f731c10a9e0 0x7f731c11b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:52.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.075+0000 7f731aa00700 1 -- 172.21.15.82:0/1780425506 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f731c114ef0 con 0x7f731c111c80 2024-05-08T05:54:52.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.076+0000 7f731aa00700 1 --2- 172.21.15.82:0/1780425506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f731c111c80 0x7f731c1143a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f730c00e9c0 tx=0x7f730c00ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:54:52.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.076+0000 7f7313e00700 1 -- 172.21.15.82:0/1780425506 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f730c00cbd0 con 0x7f731c111c80 2024-05-08T05:54:52.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.076+0000 7f7322400700 1 -- 172.21.15.82:0/1780425506 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f731c1151e0 con 0x7f731c111c80 2024-05-08T05:54:52.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.076+0000 7f7313e00700 1 -- 172.21.15.82:0/1780425506 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f730c00cd70 con 0x7f731c111c80 2024-05-08T05:54:52.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.076+0000 7f7313e00700 1 -- 172.21.15.82:0/1780425506 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f730c005580 con 0x7f731c111c80 2024-05-08T05:54:52.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.076+0000 7f7322400700 1 -- 172.21.15.82:0/1780425506 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f731c119150 con 0x7f731c111c80 2024-05-08T05:54:52.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.081+0000 7f7313e00700 1 -- 172.21.15.82:0/1780425506 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f730c021440 con 0x7f731c111c80 2024-05-08T05:54:52.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.082+0000 7f7313e00700 1 --2- 172.21.15.82:0/1780425506 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f73000b2980 0x7f73000b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:52.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.083+0000 7f7313e00700 1 -- 172.21.15.82:0/1780425506 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f730c0e23f0 con 0x7f731c111c80 2024-05-08T05:54:52.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.083+0000 7f731b400700 1 --2- 172.21.15.82:0/1780425506 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f73000b2980 0x7f73000b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:52.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.084+0000 7f731b400700 1 --2- 172.21.15.82:0/1780425506 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f73000b2980 0x7f73000b4e40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7304009680 tx=0x7f7304019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:54:52.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.085+0000 7f732cdb0b80 1 Processor -- start 2024-05-08T05:54:52.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.085+0000 7f732cdb0b80 1 -- start start 2024-05-08T05:54:52.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.086+0000 7f732cdb0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d685298bc0 0x55d685298fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:52.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.086+0000 7f732cdb0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6852994e0 0x55d6852932d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:52.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.086+0000 7f732cdb0b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6852938f0 0x55d685293d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:52.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.086+0000 7f732cdb0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d6851e5a20 con 0x55d6852994e0 2024-05-08T05:54:52.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.086+0000 7f732cdb0b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d685183760 con 0x55d6852938f0 2024-05-08T05:54:52.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.086+0000 7f732cdb0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55d6851e19e0 con 0x55d685298bc0 2024-05-08T05:54:52.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.087+0000 7f731b400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d685298bc0 0x55d685298fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:52.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.087+0000 7f731b400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d685298bc0 0x55d685298fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:44994/0 (socket says 172.21.15.82:44994) 2024-05-08T05:54:52.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.087+0000 7f731b400700 1 -- 172.21.15.82:0/2385660246 learned_addr learned my addr 172.21.15.82:0/2385660246 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:54:52.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.087+0000 7f731be00700 1 --2- 172.21.15.82:0/2385660246 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6852938f0 0x55d685293d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:52.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.087+0000 7f731b400700 1 -- 172.21.15.82:0/2385660246 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6852938f0 msgr2=0x55d685293d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:54:52.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.087+0000 7f731b400700 1 --2- 172.21.15.82:0/2385660246 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6852938f0 0x55d685293d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:52.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.087+0000 7f731b400700 1 -- 172.21.15.82:0/2385660246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6852994e0 msgr2=0x55d6852932d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:54:52.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.087+0000 7f731b400700 1 --2- 172.21.15.82:0/2385660246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6852994e0 0x55d6852932d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:52.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.087+0000 7f731b400700 1 -- 172.21.15.82:0/2385660246 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6851328d0 con 0x55d685298bc0 2024-05-08T05:54:52.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.088+0000 7f731be00700 1 --2- 172.21.15.82:0/2385660246 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6852938f0 0x55d685293d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:54:52.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.088+0000 7f731b400700 1 --2- 172.21.15.82:0/2385660246 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d685298bc0 0x55d685298fa0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7304016000 tx=0x7f730401d000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f59e30d172b91f23 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:54:52.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.088+0000 7f7310c00700 1 -- 172.21.15.82:0/2385660246 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7304032070 con 0x55d685298bc0 2024-05-08T05:54:52.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.088+0000 7f7310c00700 1 -- 172.21.15.82:0/2385660246 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f73040054f0 con 0x55d685298bc0 2024-05-08T05:54:52.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.088+0000 7f7310c00700 1 -- 172.21.15.82:0/2385660246 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f730400b560 con 0x55d685298bc0 2024-05-08T05:54:52.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.090+0000 7f732cdb0b80 1 -- 172.21.15.82:0/2385660246 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d685298bc0 msgr2=0x55d685298fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:54:52.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.090+0000 7f732cdb0b80 1 --2- 172.21.15.82:0/2385660246 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d685298bc0 0x55d685298fa0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7304016000 tx=0x7f730401d000 comp rx=0 tx=0).stop 2024-05-08T05:54:52.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.090+0000 7f732cdb0b80 1 -- 172.21.15.82:0/2385660246 shutdown_connections 2024-05-08T05:54:52.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.090+0000 7f732cdb0b80 1 --2- 172.21.15.82:0/2385660246 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6852938f0 0x55d685293d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:52.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.090+0000 7f732cdb0b80 1 --2- 172.21.15.82:0/2385660246 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d685298bc0 0x55d685298fa0 secure :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7304016000 tx=0x7f730401d000 comp rx=0 tx=0).stop 2024-05-08T05:54:52.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.090+0000 7f732cdb0b80 1 --2- 172.21.15.82:0/2385660246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6852994e0 0x55d6852932d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:52.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.090+0000 7f732cdb0b80 1 -- 172.21.15.82:0/2385660246 >> 172.21.15.82:0/2385660246 conn(0x55d68520b6d0 msgr2=0x55d68528db00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:54:52.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.091+0000 7f732cdb0b80 1 -- 172.21.15.82:0/2385660246 shutdown_connections 2024-05-08T05:54:52.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.091+0000 7f732cdb0b80 1 -- 172.21.15.82:0/2385660246 wait complete. 2024-05-08T05:54:52.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.092+0000 7f732cdb0b80 1 -- start start 2024-05-08T05:54:52.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.092+0000 7f732cdb0b80 1 Processor -- start 2024-05-08T05:54:52.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.093+0000 7f732cdb0b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6852938f0 0x55d68529f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:52.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.093+0000 7f732cdb0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6852994e0 0x55d68529c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:52.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.093+0000 7f732cdb0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d68529cc00 0x55d68529d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:52.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.093+0000 7f731b400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6852938f0 0x55d68529f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:52.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.093+0000 7f731b400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6852938f0 0x55d68529f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:47878/0 (socket says 172.21.15.82:47878) 2024-05-08T05:54:52.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.093+0000 7f732cdb0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d68529fec0 con 0x55d68529cc00 2024-05-08T05:54:52.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.093+0000 7f732cdb0b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d68514bb20 con 0x55d6852938f0 2024-05-08T05:54:52.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.093+0000 7f732cdb0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55d6852a0040 con 0x55d6852994e0 2024-05-08T05:54:52.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.093+0000 7f731b400700 1 -- 172.21.15.82:0/3349851718 learned_addr learned my addr 172.21.15.82:0/3349851718 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:54:52.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.093+0000 7f732cdb0b80 10 client.0 _ll_register_callbacks cb 0x55d68518cc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:54:52.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.094+0000 7f731b400700 1 -- 172.21.15.82:0/3349851718 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6852994e0 msgr2=0x55d68529c6c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T05:54:52.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.094+0000 7f731b400700 1 --2- 172.21.15.82:0/3349851718 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6852994e0 0x55d68529c6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:52.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.094+0000 7f731b400700 1 -- 172.21.15.82:0/3349851718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d68529cc00 msgr2=0x55d68529d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:54:52.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.094+0000 7f731b400700 1 --2- 172.21.15.82:0/3349851718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d68529cc00 0x55d68529d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:52.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.094+0000 7f731b400700 1 -- 172.21.15.82:0/3349851718 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6851ab420 con 0x55d6852938f0 2024-05-08T05:54:52.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.095+0000 7f731b400700 1 --2- 172.21.15.82:0/3349851718 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6852938f0 0x55d68529f3c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f730402a040 tx=0x7f7304005270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13bccd52d1a528e4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:54:52.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.095+0000 7f7309600700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:54:52.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.095+0000 7f7309600700 1 -- 172.21.15.82:0/3349851718 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f730403b060 con 0x55d6852938f0 2024-05-08T05:54:52.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.095+0000 7f7309600700 1 -- 172.21.15.82:0/3349851718 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f730400b760 con 0x55d6852938f0 2024-05-08T05:54:52.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.096+0000 7f732cdb0b80 1 -- 172.21.15.82:0/3349851718 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73040054f0 con 0x55d6852938f0 2024-05-08T05:54:52.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.096+0000 7f7309600700 1 -- 172.21.15.82:0/3349851718 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f7304032040 con 0x55d6852938f0 2024-05-08T05:54:52.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.096+0000 7f732cdb0b80 10 client.25637 fetch_fsmap learned FSMap version 31 2024-05-08T05:54:52.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.096+0000 7f732cdb0b80 1 -- 172.21.15.82:0/3349851718 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55d6852aac50 con 0x55d6852938f0 2024-05-08T05:54:52.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.096+0000 7f7309600700 1 -- 172.21.15.82:0/3349851718 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f73040054f0 con 0x55d6852938f0 2024-05-08T05:54:52.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.097+0000 7f7309600700 1 -- 172.21.15.82:0/3349851718 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f730402d470 con 0x55d6852938f0 2024-05-08T05:54:52.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.097+0000 7f732cdb0b80 10 client.25637 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:54:52.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.097+0000 7f732cdb0b80 10 client.25637 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-05-08T05:54:52.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.097+0000 7f732cdb0b80 20 client.25637 populate_metadata read hostname 'smithi082' 2024-05-08T05:54:52.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.098+0000 7f732cdb0b80 1 --2- 172.21.15.82:0/3349851718 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55d6852ad120 0x55d6852af510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:52.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.098+0000 7f732cdb0b80 4 client.25637 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:54:52.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.098+0000 7f732cdb0b80 1 -- 172.21.15.82:0/3349851718 --> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d685260140 con 0x55d6852ad120 2024-05-08T05:54:52.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.098+0000 7f731aa00700 1 --2- 172.21.15.82:0/3349851718 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55d6852ad120 0x55d6852af510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:52.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.099+0000 7f731aa00700 1 --2- 172.21.15.82:0/3349851718 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55d6852ad120 0x55d6852af510 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=24ef7d08ba362724 server_cookie=29c163d187fbbd30 in_seq=0 out_seq=0 2024-05-08T05:54:52.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.099+0000 7f7309600700 10 client.25637 ms_handle_connect on v2:172.21.15.151:6836/4192404464 2024-05-08T05:54:52.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.100+0000 7f7309600700 1 -- 172.21.15.82:0/3349851718 <== mds.2 v2:172.21.15.151:6836/4192404464 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55d685260140 con 0x55d6852ad120 2024-05-08T05:54:52.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.100+0000 7f7309600700 10 client.25637 handle_command_reply: tid=0 2024-05-08T05:54:52.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.100+0000 7f732cdb0b80 1 client.25637 shutdown 2024-05-08T05:54:52.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.101+0000 7f732cdb0b80 1 -- 172.21.15.82:0/3349851718 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6852938f0 msgr2=0x55d68529f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:54:52.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.101+0000 7f732cdb0b80 1 --2- 172.21.15.82:0/3349851718 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6852938f0 0x55d68529f3c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f730402a040 tx=0x7f7304005270 comp rx=0 tx=0).stop 2024-05-08T05:54:52.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.101+0000 7f732cdb0b80 1 -- 172.21.15.82:0/3349851718 shutdown_connections 2024-05-08T05:54:52.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.101+0000 7f732cdb0b80 1 --2- 172.21.15.82:0/3349851718 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55d6852ad120 0x55d6852af510 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:52.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.101+0000 7f732cdb0b80 1 --2- 172.21.15.82:0/3349851718 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d6852938f0 0x55d68529f3c0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:52.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.101+0000 7f732cdb0b80 1 --2- 172.21.15.82:0/3349851718 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d68529cc00 0x55d68529d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:52.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.101+0000 7f732cdb0b80 1 --2- 172.21.15.82:0/3349851718 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6852994e0 0x55d68529c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:52.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.101+0000 7f732cdb0b80 1 -- 172.21.15.82:0/3349851718 >> 172.21.15.82:0/3349851718 conn(0x55d68520b6d0 msgr2=0x55d68528d190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:54:52.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.101+0000 7f7309600700 0 client.25637 ms_handle_reset on v2:172.21.15.151:6836/4192404464 2024-05-08T05:54:52.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.101+0000 7f732cdb0b80 1 -- 172.21.15.82:0/3349851718 shutdown_connections 2024-05-08T05:54:52.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.101+0000 7f732cdb0b80 1 -- 172.21.15.82:0/3349851718 wait complete. 2024-05-08T05:54:52.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.101+0000 7f732cdb0b80 20 client.25637 trim_cache size 0 max 16384 2024-05-08T05:54:52.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.126+0000 7f732cdb0b80 1 Processor -- start 2024-05-08T05:54:52.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.126+0000 7f732cdb0b80 1 -- start start 2024-05-08T05:54:52.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.126+0000 7f732cdb0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6852938f0 0x55d6852932d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:52.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.126+0000 7f732cdb0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6852994e0 0x55d685296d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:52.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.126+0000 7f732cdb0b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d68529cc00 0x55d68528d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:52.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.126+0000 7f732cdb0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f731c1c51c0 con 0x55d6852938f0 2024-05-08T05:54:52.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.126+0000 7f732cdb0b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f731c1c6d00 con 0x55d68529cc00 2024-05-08T05:54:52.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.126+0000 7f732cdb0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f731c1c5890 con 0x55d6852994e0 2024-05-08T05:54:52.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.127+0000 7f731be00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d68529cc00 0x55d68528d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:52.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.127+0000 7f731be00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d68529cc00 0x55d68528d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:47890/0 (socket says 172.21.15.82:47890) 2024-05-08T05:54:52.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.127+0000 7f731be00700 1 -- 172.21.15.82:0/3024086457 learned_addr learned my addr 172.21.15.82:0/3024086457 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:54:52.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.127+0000 7f731be00700 1 -- 172.21.15.82:0/3024086457 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6852994e0 msgr2=0x55d685296d90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T05:54:52.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.127+0000 7f731be00700 1 --2- 172.21.15.82:0/3024086457 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6852994e0 0x55d685296d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:52.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.127+0000 7f731be00700 1 -- 172.21.15.82:0/3024086457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6852938f0 msgr2=0x55d6852932d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:54:52.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.127+0000 7f731be00700 1 --2- 172.21.15.82:0/3024086457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6852938f0 0x55d6852932d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:52.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.127+0000 7f731be00700 1 -- 172.21.15.82:0/3024086457 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d685288ab0 con 0x55d68529cc00 2024-05-08T05:54:52.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.128+0000 7f731be00700 1 --2- 172.21.15.82:0/3024086457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d68529cc00 0x55d68528d910 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7314006070 tx=0x7f7314009ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72edf32bfc398cda server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:54:52.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.128+0000 7f730be00700 1 -- 172.21.15.82:0/3024086457 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7314019020 con 0x55d68529cc00 2024-05-08T05:54:52.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.128+0000 7f730be00700 1 -- 172.21.15.82:0/3024086457 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7314007500 con 0x55d68529cc00 2024-05-08T05:54:52.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.128+0000 7f730be00700 1 -- 172.21.15.82:0/3024086457 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7314015650 con 0x55d68529cc00 2024-05-08T05:54:52.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.129+0000 7f732cdb0b80 1 -- 172.21.15.82:0/3024086457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d68529cc00 msgr2=0x55d68528d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:54:52.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.129+0000 7f732cdb0b80 1 --2- 172.21.15.82:0/3024086457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d68529cc00 0x55d68528d910 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7314006070 tx=0x7f7314009ba0 comp rx=0 tx=0).stop 2024-05-08T05:54:52.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.129+0000 7f732cdb0b80 1 -- 172.21.15.82:0/3024086457 shutdown_connections 2024-05-08T05:54:52.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.129+0000 7f732cdb0b80 1 --2- 172.21.15.82:0/3024086457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d68529cc00 0x55d68528d910 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:52.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.129+0000 7f732cdb0b80 1 --2- 172.21.15.82:0/3024086457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6852938f0 0x55d6852932d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:52.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.129+0000 7f732cdb0b80 1 --2- 172.21.15.82:0/3024086457 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6852994e0 0x55d685296d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:52.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.129+0000 7f732cdb0b80 1 -- 172.21.15.82:0/3024086457 >> 172.21.15.82:0/3024086457 conn(0x55d68520b6d0 msgr2=0x55d685297ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:54:52.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.129+0000 7f732cdb0b80 1 -- 172.21.15.82:0/3024086457 shutdown_connections 2024-05-08T05:54:52.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.130+0000 7f732cdb0b80 1 -- 172.21.15.82:0/3024086457 wait complete. 2024-05-08T05:54:52.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.130+0000 7f732cdb0b80 1 -- start start 2024-05-08T05:54:52.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.131+0000 7f732cdb0b80 1 Processor -- start 2024-05-08T05:54:52.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.131+0000 7f732cdb0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6852938f0 0x55d6852b24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:52.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.131+0000 7f732cdb0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6852994e0 0x55d6852af880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:52.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.131+0000 7f732cdb0b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d68529cc00 0x55d6852afdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:52.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.132+0000 7f731b400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6852938f0 0x55d6852b24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:52.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.132+0000 7f731b400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6852938f0 0x55d6852b24e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:45024/0 (socket says 172.21.15.82:45024) 2024-05-08T05:54:52.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.132+0000 7f731aa00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6852994e0 0x55d6852af880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:52.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.132+0000 7f731b400700 1 -- 172.21.15.82:0/806300556 learned_addr learned my addr 172.21.15.82:0/806300556 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:54:52.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.132+0000 7f731be00700 1 --2- 172.21.15.82:0/806300556 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d68529cc00 0x55d6852afdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:52.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.132+0000 7f732cdb0b80 1 -- 172.21.15.82:0/806300556 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f731c1c6630 con 0x55d6852994e0 2024-05-08T05:54:52.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.132+0000 7f732cdb0b80 1 -- 172.21.15.82:0/806300556 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f731c1c5f60 con 0x55d68529cc00 2024-05-08T05:54:52.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.132+0000 7f732cdb0b80 1 -- 172.21.15.82:0/806300556 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f731c1c3160 con 0x55d6852938f0 2024-05-08T05:54:52.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.132+0000 7f732cdb0b80 10 client.0 _ll_register_callbacks cb 0x55d68518cc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:54:52.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.133+0000 7f731be00700 1 -- 172.21.15.82:0/806300556 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6852938f0 msgr2=0x55d6852b24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:54:52.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.133+0000 7f731be00700 1 --2- 172.21.15.82:0/806300556 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6852938f0 0x55d6852b24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:52.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.133+0000 7f731be00700 1 -- 172.21.15.82:0/806300556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6852994e0 msgr2=0x55d6852af880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:54:52.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.133+0000 7f731be00700 1 --2- 172.21.15.82:0/806300556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6852994e0 0x55d6852af880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:52.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.133+0000 7f731be00700 1 -- 172.21.15.82:0/806300556 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6852b0400 con 0x55d68529cc00 2024-05-08T05:54:52.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.133+0000 7f7309600700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:54:52.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.134+0000 7f731be00700 1 --2- 172.21.15.82:0/806300556 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d68529cc00 0x55d6852afdc0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7314009710 tx=0x7f73140078e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d3cca1bef0015eb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:54:52.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.134+0000 7f7309600700 1 -- 172.21.15.82:0/806300556 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7314003c20 con 0x55d68529cc00 2024-05-08T05:54:52.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.134+0000 7f732cdb0b80 1 -- 172.21.15.82:0/806300556 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7314007500 con 0x55d68529cc00 2024-05-08T05:54:52.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.134+0000 7f7309600700 1 -- 172.21.15.82:0/806300556 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f7314007bc0 con 0x55d68529cc00 2024-05-08T05:54:52.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.134+0000 7f7309600700 1 -- 172.21.15.82:0/806300556 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f7314019030 con 0x55d68529cc00 2024-05-08T05:54:52.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.135+0000 7f732cdb0b80 10 client.25643 fetch_fsmap learned FSMap version 31 2024-05-08T05:54:52.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.135+0000 7f732cdb0b80 1 -- 172.21.15.82:0/806300556 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55d6853174b0 con 0x55d68529cc00 2024-05-08T05:54:52.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.135+0000 7f7309600700 1 -- 172.21.15.82:0/806300556 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7314007500 con 0x55d68529cc00 2024-05-08T05:54:52.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.135+0000 7f7309600700 1 -- 172.21.15.82:0/806300556 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f7314025020 con 0x55d68529cc00 2024-05-08T05:54:52.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.135+0000 7f732cdb0b80 10 client.25643 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:54:52.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.135+0000 7f732cdb0b80 10 client.25643 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-05-08T05:54:52.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.135+0000 7f732cdb0b80 20 client.25643 populate_metadata read hostname 'smithi082' 2024-05-08T05:54:52.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.136+0000 7f732cdb0b80 1 --2- 172.21.15.82:0/806300556 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55d685317a10 0x55d685319e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:52.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.136+0000 7f732cdb0b80 4 client.25643 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:54:52.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.136+0000 7f732cdb0b80 1 -- 172.21.15.82:0/806300556 --> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d6851f3400 con 0x55d685317a10 2024-05-08T05:54:52.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.136+0000 7f731b400700 1 --2- 172.21.15.82:0/806300556 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55d685317a10 0x55d685319e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:52.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.136+0000 7f731b400700 1 --2- 172.21.15.82:0/806300556 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55d685317a10 0x55d685319e00 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4f6fe18fb6c4fa0f server_cookie=e199f51afef122c in_seq=0 out_seq=0 2024-05-08T05:54:52.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.136+0000 7f7309600700 10 client.25643 ms_handle_connect on v2:172.21.15.151:6836/4192404464 2024-05-08T05:54:52.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.137+0000 7f7309600700 1 -- 172.21.15.82:0/806300556 <== mds.2 v2:172.21.15.151:6836/4192404464 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d6851f3400 con 0x55d685317a10 2024-05-08T05:54:52.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.137+0000 7f7309600700 10 client.25643 handle_command_reply: tid=0 2024-05-08T05:54:52.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.137+0000 7f732cdb0b80 1 client.25643 shutdown 2024-05-08T05:54:52.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.137+0000 7f732cdb0b80 1 -- 172.21.15.82:0/806300556 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d68529cc00 msgr2=0x55d6852afdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:54:52.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.137+0000 7f732cdb0b80 1 --2- 172.21.15.82:0/806300556 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d68529cc00 0x55d6852afdc0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7314009710 tx=0x7f73140078e0 comp rx=0 tx=0).stop 2024-05-08T05:54:52.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.137+0000 7f732cdb0b80 1 -- 172.21.15.82:0/806300556 shutdown_connections 2024-05-08T05:54:52.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.137+0000 7f732cdb0b80 1 --2- 172.21.15.82:0/806300556 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55d685317a10 0x55d685319e00 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:52.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.137+0000 7f7309600700 0 client.25643 ms_handle_reset on v2:172.21.15.151:6836/4192404464 2024-05-08T05:54:52.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.137+0000 7f732cdb0b80 1 --2- 172.21.15.82:0/806300556 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d68529cc00 0x55d6852afdc0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:52.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.137+0000 7f732cdb0b80 1 --2- 172.21.15.82:0/806300556 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6852938f0 0x55d6852b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:52.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.137+0000 7f732cdb0b80 1 --2- 172.21.15.82:0/806300556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d6852994e0 0x55d6852af880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:52.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.137+0000 7f732cdb0b80 1 -- 172.21.15.82:0/806300556 >> 172.21.15.82:0/806300556 conn(0x55d68520b6d0 msgr2=0x55d68529aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:54:52.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.137+0000 7f732cdb0b80 1 -- 172.21.15.82:0/806300556 shutdown_connections 2024-05-08T05:54:52.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.137+0000 7f732cdb0b80 1 -- 172.21.15.82:0/806300556 wait complete. 2024-05-08T05:54:52.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.138+0000 7f732cdb0b80 20 client.25643 trim_cache size 0 max 16384 2024-05-08T05:54:52.155 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T05:54:52.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.139+0000 7f7322400700 1 -- 172.21.15.82:0/1780425506 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f73000b2980 msgr2=0x7f73000b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:54:52.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.139+0000 7f7322400700 1 --2- 172.21.15.82:0/1780425506 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f73000b2980 0x7f73000b4e40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7304009680 tx=0x7f7304019040 comp rx=0 tx=0).stop 2024-05-08T05:54:52.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.139+0000 7f7322400700 1 -- 172.21.15.82:0/1780425506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f731c111c80 msgr2=0x7f731c1143a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:54:52.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.139+0000 7f7322400700 1 --2- 172.21.15.82:0/1780425506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f731c111c80 0x7f731c1143a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f730c00e9c0 tx=0x7f730c00ecd0 comp rx=0 tx=0).stop 2024-05-08T05:54:52.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.139+0000 7f7322400700 1 -- 172.21.15.82:0/1780425506 shutdown_connections 2024-05-08T05:54:52.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.139+0000 7f7322400700 1 --2- 172.21.15.82:0/1780425506 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f73000b2980 0x7f73000b4e40 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:52.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.139+0000 7f7322400700 1 --2- 172.21.15.82:0/1780425506 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f731c11cc80 0x7f731c1148e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:52.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.139+0000 7f7322400700 1 --2- 172.21.15.82:0/1780425506 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f731c10a9e0 0x7f731c11b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:52.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.139+0000 7f7322400700 1 --2- 172.21.15.82:0/1780425506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f731c111c80 0x7f731c1143a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:52.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.139+0000 7f7322400700 1 -- 172.21.15.82:0/1780425506 >> 172.21.15.82:0/1780425506 conn(0x7f731c06e610 msgr2=0x7f731c072040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:54:52.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.144+0000 7f7322400700 1 -- 172.21.15.82:0/1780425506 shutdown_connections 2024-05-08T05:54:52.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:52.146+0000 7f7322400700 1 -- 172.21.15.82:0/1780425506 wait complete. 2024-05-08T05:54:53.744 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-05-08T05:54:53.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:54:53 smithi151 ceph-mon[34815]: pgmap v586: 97 pgs: 97 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 MiB/s wr, 722 op/s 2024-05-08T05:54:53.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:54:53 smithi082 ceph-mon[30098]: pgmap v586: 97 pgs: 97 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 MiB/s wr, 722 op/s 2024-05-08T05:54:54.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:54:53 smithi134 ceph-mon[34132]: pgmap v586: 97 pgs: 97 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 MiB/s wr, 722 op/s 2024-05-08T05:54:54.511 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:54:55.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 245.0 s, 1755.8 tps, lat 56.727 ms stddev 102.190 2024-05-08T05:54:56.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:54:55 smithi082 ceph-mon[30098]: pgmap v587: 97 pgs: 97 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 MiB/s wr, 706 op/s 2024-05-08T05:54:56.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:54:55 smithi134 ceph-mon[34132]: pgmap v587: 97 pgs: 97 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 MiB/s wr, 706 op/s 2024-05-08T05:54:56.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:54:55 smithi151 ceph-mon[34815]: pgmap v587: 97 pgs: 97 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 MiB/s wr, 706 op/s 2024-05-08T05:54:56.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:56.976+0000 7f1f2b600700 1 -- 172.21.15.82:0/2513600250 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f241023a0 msgr2=0x7f1f24102820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:54:56.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:56.976+0000 7f1f2b600700 1 --2- 172.21.15.82:0/2513600250 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f241023a0 0x7f1f24102820 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1f14009990 tx=0x7f1f14009ca0 comp rx=0 tx=0).stop 2024-05-08T05:54:56.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:56.977+0000 7f1f2b600700 1 -- 172.21.15.82:0/2513600250 shutdown_connections 2024-05-08T05:54:56.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:56.977+0000 7f1f2b600700 1 --2- 172.21.15.82:0/2513600250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f24102d60 0x7f1f2410f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:56.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:56.977+0000 7f1f2b600700 1 --2- 172.21.15.82:0/2513600250 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1f24108410 0x7f1f241087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:56.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:56.977+0000 7f1f2b600700 1 --2- 172.21.15.82:0/2513600250 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f241023a0 0x7f1f24102820 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:56.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:56.977+0000 7f1f2b600700 1 -- 172.21.15.82:0/2513600250 >> 172.21.15.82:0/2513600250 conn(0x7f1f24079350 msgr2=0x7f1f24079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:54:56.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:56.978+0000 7f1f2b600700 1 -- 172.21.15.82:0/2513600250 shutdown_connections 2024-05-08T05:54:56.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:56.978+0000 7f1f2b600700 1 -- 172.21.15.82:0/2513600250 wait complete. 2024-05-08T05:54:56.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:56.979+0000 7f1f2b600700 1 Processor -- start 2024-05-08T05:54:56.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:56.979+0000 7f1f2b600700 1 -- start start 2024-05-08T05:54:56.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:56.980+0000 7f1f2b600700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1f241023a0 0x7f1f2419b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:56.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:56.980+0000 7f1f2b600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f24102d60 0x7f1f24197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:56.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:56.980+0000 7f1f2b600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f24108410 0x7f1f24197f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:56.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:56.980+0000 7f1f23e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f24102d60 0x7f1f24197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:56.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:56.980+0000 7f1f2b600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1f24112580 con 0x7f1f24108410 2024-05-08T05:54:56.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:56.980+0000 7f1f2b600700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1f24112400 con 0x7f1f24102d60 2024-05-08T05:54:56.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:56.980+0000 7f1f2b600700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1f24112700 con 0x7f1f241023a0 2024-05-08T05:54:56.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:56.981+0000 7f1f23e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f24102d60 0x7f1f24197a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:56768/0 (socket says 172.21.15.82:56768) 2024-05-08T05:54:56.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:56.981+0000 7f1f23e00700 1 -- 172.21.15.82:0/1768164021 learned_addr learned my addr 172.21.15.82:0/1768164021 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:54:56.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:56.981+0000 7f1f29600700 1 --2- 172.21.15.82:0/1768164021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f24108410 0x7f1f24197f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:56.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:56.981+0000 7f1f23e00700 1 -- 172.21.15.82:0/1768164021 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1f241023a0 msgr2=0x7f1f2419b6f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T05:54:56.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:56.982+0000 7f1f28c00700 1 --2- 172.21.15.82:0/1768164021 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1f241023a0 0x7f1f2419b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:56.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:56.982+0000 7f1f23e00700 1 --2- 172.21.15.82:0/1768164021 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1f241023a0 0x7f1f2419b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:56.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:56.982+0000 7f1f23e00700 1 -- 172.21.15.82:0/1768164021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f24108410 msgr2=0x7f1f24197f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:54:56.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:56.982+0000 7f1f23e00700 1 --2- 172.21.15.82:0/1768164021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f24108410 0x7f1f24197f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:56.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:56.982+0000 7f1f23e00700 1 -- 172.21.15.82:0/1768164021 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f24198840 con 0x7f1f24102d60 2024-05-08T05:54:56.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:56.982+0000 7f1f28c00700 1 --2- 172.21.15.82:0/1768164021 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1f241023a0 0x7f1f2419b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:54:56.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:56.982+0000 7f1f29600700 1 --2- 172.21.15.82:0/1768164021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f24108410 0x7f1f24197f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:54:56.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:56.983+0000 7f1f23e00700 1 --2- 172.21.15.82:0/1768164021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f24102d60 0x7f1f24197a50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1f14005910 tx=0x7f1f1400b670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:54:56.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:56.983+0000 7f1f21600700 1 -- 172.21.15.82:0/1768164021 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f14027070 con 0x7f1f24102d60 2024-05-08T05:54:56.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:56.984+0000 7f1f21600700 1 -- 172.21.15.82:0/1768164021 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f14022470 con 0x7f1f24102d60 2024-05-08T05:54:56.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:56.984+0000 7f1f21600700 1 -- 172.21.15.82:0/1768164021 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f14017650 con 0x7f1f24102d60 2024-05-08T05:54:56.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:56.984+0000 7f1f2b600700 1 -- 172.21.15.82:0/1768164021 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f241ac720 con 0x7f1f24102d60 2024-05-08T05:54:56.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:56.984+0000 7f1f2b600700 1 -- 172.21.15.82:0/1768164021 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f241acbd0 con 0x7f1f24102d60 2024-05-08T05:54:56.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:56.992+0000 7f1f21600700 1 -- 172.21.15.82:0/1768164021 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f1f1402a070 con 0x7f1f24102d60 2024-05-08T05:54:56.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:56.996+0000 7f1f21600700 1 --2- 172.21.15.82:0/1768164021 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f1f0c0b2980 0x7f1f0c0b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:56.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:56.996+0000 7f1f21600700 1 -- 172.21.15.82:0/1768164021 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f1f140e31b0 con 0x7f1f24102d60 2024-05-08T05:54:56.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:56.997+0000 7f1f28c00700 1 --2- 172.21.15.82:0/1768164021 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f1f0c0b2980 0x7f1f0c0b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:56.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:56.998+0000 7f1f28c00700 1 --2- 172.21.15.82:0/1768164021 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f1f0c0b2980 0x7f1f0c0b4e40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1f18009bc0 tx=0x7f1f18009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:54:56.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:56.998+0000 7f1f35f34b80 1 Processor -- start 2024-05-08T05:54:57.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:56.999+0000 7f1f35f34b80 1 -- start start 2024-05-08T05:54:57.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:56.999+0000 7f1f35f34b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f128bbbbc0 0x55f128bbbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:57.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:56.999+0000 7f1f35f34b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f128bbc4e0 0x55f128bb62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:57.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:56.999+0000 7f1f35f34b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f128bb68f0 0x55f128bb6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:57.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:56.999+0000 7f1f35f34b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f128b08a20 con 0x55f128bb68f0 2024-05-08T05:54:57.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:56.999+0000 7f1f35f34b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f128aa6760 con 0x55f128bbbbc0 2024-05-08T05:54:57.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:56.999+0000 7f1f35f34b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55f128b049e0 con 0x55f128bbc4e0 2024-05-08T05:54:57.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.000+0000 7f1f29600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f128bb68f0 0x55f128bb6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:57.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.000+0000 7f1f29600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f128bb68f0 0x55f128bb6d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52560/0 (socket says 172.21.15.82:52560) 2024-05-08T05:54:57.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.000+0000 7f1f29600700 1 -- 172.21.15.82:0/626036695 learned_addr learned my addr 172.21.15.82:0/626036695 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:54:57.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.000+0000 7f1f23e00700 1 --2- 172.21.15.82:0/626036695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f128bbc4e0 0x55f128bb62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:57.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.000+0000 7f1f28c00700 1 --2- 172.21.15.82:0/626036695 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f128bbbbc0 0x55f128bbbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:57.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.000+0000 7f1f29600700 1 -- 172.21.15.82:0/626036695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f128bbc4e0 msgr2=0x55f128bb62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:54:57.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.000+0000 7f1f29600700 1 --2- 172.21.15.82:0/626036695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f128bbc4e0 0x55f128bb62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:57.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.000+0000 7f1f29600700 1 -- 172.21.15.82:0/626036695 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f128bbbbc0 msgr2=0x55f128bbbfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:54:57.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.000+0000 7f1f29600700 1 --2- 172.21.15.82:0/626036695 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f128bbbbc0 0x55f128bbbfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:57.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.000+0000 7f1f29600700 1 -- 172.21.15.82:0/626036695 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f128a558d0 con 0x55f128bb68f0 2024-05-08T05:54:57.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.000+0000 7f1f28c00700 1 --2- 172.21.15.82:0/626036695 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f128bbbbc0 0x55f128bbbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:54:57.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.000+0000 7f1f29600700 1 --2- 172.21.15.82:0/626036695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f128bb68f0 0x55f128bb6d70 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c009e60 tx=0x7f1f1c0077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63b64e239cb06f49 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:54:57.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.001+0000 7f1f12000700 1 -- 172.21.15.82:0/626036695 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f1c014610 con 0x55f128bb68f0 2024-05-08T05:54:57.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.001+0000 7f1f12000700 1 -- 172.21.15.82:0/626036695 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f1c019070 con 0x55f128bb68f0 2024-05-08T05:54:57.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.001+0000 7f1f12000700 1 -- 172.21.15.82:0/626036695 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f1c013a70 con 0x55f128bb68f0 2024-05-08T05:54:57.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.002+0000 7f1f35f34b80 1 -- 172.21.15.82:0/626036695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f128bb68f0 msgr2=0x55f128bb6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:54:57.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.002+0000 7f1f35f34b80 1 --2- 172.21.15.82:0/626036695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f128bb68f0 0x55f128bb6d70 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1f1c009e60 tx=0x7f1f1c0077e0 comp rx=0 tx=0).stop 2024-05-08T05:54:57.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.002+0000 7f1f35f34b80 1 -- 172.21.15.82:0/626036695 shutdown_connections 2024-05-08T05:54:57.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.003+0000 7f1f35f34b80 1 --2- 172.21.15.82:0/626036695 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f128bbbbc0 0x55f128bbbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:57.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.003+0000 7f1f35f34b80 1 --2- 172.21.15.82:0/626036695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f128bb68f0 0x55f128bb6d70 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:57.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.003+0000 7f1f35f34b80 1 --2- 172.21.15.82:0/626036695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f128bbc4e0 0x55f128bb62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:57.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.003+0000 7f1f35f34b80 1 -- 172.21.15.82:0/626036695 >> 172.21.15.82:0/626036695 conn(0x55f128b2e6d0 msgr2=0x55f128bb0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:54:57.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.003+0000 7f1f35f34b80 1 -- 172.21.15.82:0/626036695 shutdown_connections 2024-05-08T05:54:57.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.004+0000 7f1f35f34b80 1 -- 172.21.15.82:0/626036695 wait complete. 2024-05-08T05:54:57.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.004+0000 7f1f35f34b80 1 -- start start 2024-05-08T05:54:57.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.005+0000 7f1f35f34b80 1 Processor -- start 2024-05-08T05:54:57.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.006+0000 7f1f35f34b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f128bb68f0 0x55f128bc21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:57.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.006+0000 7f1f35f34b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f128bbbbc0 0x55f128bbf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:57.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.006+0000 7f1f35f34b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f128bbc4e0 0x55f128bbfa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:57.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.006+0000 7f1f35f34b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f128bc2f20 con 0x55f128bbc4e0 2024-05-08T05:54:57.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.006+0000 7f1f35f34b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f128a6eb20 con 0x55f128bbbbc0 2024-05-08T05:54:57.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.006+0000 7f1f35f34b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55f128bc30a0 con 0x55f128bb68f0 2024-05-08T05:54:57.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.006+0000 7f1f35f34b80 10 client.0 _ll_register_callbacks cb 0x55f128aafc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:54:57.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.006+0000 7f1f28c00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f128bb68f0 0x55f128bc21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:57.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.006+0000 7f1f28c00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f128bb68f0 0x55f128bc21a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:43112/0 (socket says 172.21.15.82:43112) 2024-05-08T05:54:57.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.006+0000 7f1f28c00700 1 -- 172.21.15.82:0/258080512 learned_addr learned my addr 172.21.15.82:0/258080512 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:54:57.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.006+0000 7f1f23e00700 1 --2- 172.21.15.82:0/258080512 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f128bbbbc0 0x55f128bbf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:57.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.006+0000 7f1f29600700 1 --2- 172.21.15.82:0/258080512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f128bbc4e0 0x55f128bbfa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:57.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.007+0000 7f1f28c00700 1 -- 172.21.15.82:0/258080512 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f128bbbbc0 msgr2=0x55f128bbf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:54:57.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.007+0000 7f1f28c00700 1 --2- 172.21.15.82:0/258080512 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f128bbbbc0 0x55f128bbf540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:57.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.007+0000 7f1f28c00700 1 -- 172.21.15.82:0/258080512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f128bbc4e0 msgr2=0x55f128bbfa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:54:57.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.007+0000 7f1f28c00700 1 --2- 172.21.15.82:0/258080512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f128bbc4e0 0x55f128bbfa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:57.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.007+0000 7f1f28c00700 1 -- 172.21.15.82:0/258080512 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f128ace420 con 0x55f128bb68f0 2024-05-08T05:54:57.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.007+0000 7f1f28c00700 1 --2- 172.21.15.82:0/258080512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f128bb68f0 0x55f128bc21a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1f1800ffc0 tx=0x7f1f18004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7baed92a39e63ae server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:54:57.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.007+0000 7f1f06a00700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:54:57.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.007+0000 7f1f06a00700 1 -- 172.21.15.82:0/258080512 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f1801f430 con 0x55f128bb68f0 2024-05-08T05:54:57.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.007+0000 7f1f06a00700 1 -- 172.21.15.82:0/258080512 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f1f1801f5d0 con 0x55f128bb68f0 2024-05-08T05:54:57.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.007+0000 7f1f35f34b80 1 -- 172.21.15.82:0/258080512 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f1c019070 con 0x55f128bb68f0 2024-05-08T05:54:57.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.008+0000 7f1f06a00700 1 -- 172.21.15.82:0/258080512 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f1f1801f7d0 con 0x55f128bb68f0 2024-05-08T05:54:57.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.008+0000 7f1f35f34b80 10 client.25687 fetch_fsmap learned FSMap version 31 2024-05-08T05:54:57.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.008+0000 7f1f35f34b80 1 -- 172.21.15.82:0/258080512 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55f128bcd7c0 con 0x55f128bb68f0 2024-05-08T05:54:57.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.010+0000 7f1f06a00700 1 -- 172.21.15.82:0/258080512 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f1c019070 con 0x55f128bb68f0 2024-05-08T05:54:57.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.010+0000 7f1f06a00700 1 -- 172.21.15.82:0/258080512 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f1f18027ba0 con 0x55f128bb68f0 2024-05-08T05:54:57.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.011+0000 7f1f35f34b80 10 client.25687 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:54:57.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.011+0000 7f1f35f34b80 10 client.25687 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-08T05:54:57.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.012+0000 7f1f35f34b80 20 client.25687 populate_metadata read hostname 'smithi082' 2024-05-08T05:54:57.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.012+0000 7f1f35f34b80 1 --2- 172.21.15.82:0/258080512 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x55f128bcfe00 0x55f128bd21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:57.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.012+0000 7f1f35f34b80 4 client.25687 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:54:57.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.012+0000 7f1f35f34b80 1 -- 172.21.15.82:0/258080512 --> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f128b83140 con 0x55f128bcfe00 2024-05-08T05:54:57.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.012+0000 7f1f23e00700 1 --2- 172.21.15.82:0/258080512 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x55f128bcfe00 0x55f128bd21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:57.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.013+0000 7f1f23e00700 1 --2- 172.21.15.82:0/258080512 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x55f128bcfe00 0x55f128bd21f0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7d0b1244cf8e5f74 server_cookie=94a507a26a9ec07d in_seq=0 out_seq=0 2024-05-08T05:54:57.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.013+0000 7f1f06a00700 10 client.25687 ms_handle_connect on v2:172.21.15.151:6838/2963754236 2024-05-08T05:54:57.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.014+0000 7f1f06a00700 1 -- 172.21.15.82:0/258080512 <== mds.1 v2:172.21.15.151:6838/2963754236 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f128b83140 con 0x55f128bcfe00 2024-05-08T05:54:57.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.014+0000 7f1f06a00700 10 client.25687 handle_command_reply: tid=0 2024-05-08T05:54:57.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.014+0000 7f1f35f34b80 1 client.25687 shutdown 2024-05-08T05:54:57.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.015+0000 7f1f35f34b80 1 -- 172.21.15.82:0/258080512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f128bb68f0 msgr2=0x55f128bc21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:54:57.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.015+0000 7f1f35f34b80 1 --2- 172.21.15.82:0/258080512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f128bb68f0 0x55f128bc21a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1f1800ffc0 tx=0x7f1f18004750 comp rx=0 tx=0).stop 2024-05-08T05:54:57.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.015+0000 7f1f35f34b80 1 -- 172.21.15.82:0/258080512 shutdown_connections 2024-05-08T05:54:57.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.015+0000 7f1f35f34b80 1 --2- 172.21.15.82:0/258080512 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x55f128bcfe00 0x55f128bd21f0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:57.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.015+0000 7f1f06a00700 0 client.25687 ms_handle_reset on v2:172.21.15.151:6838/2963754236 2024-05-08T05:54:57.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.015+0000 7f1f35f34b80 1 --2- 172.21.15.82:0/258080512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f128bbc4e0 0x55f128bbfa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:57.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.015+0000 7f1f35f34b80 1 --2- 172.21.15.82:0/258080512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f128bb68f0 0x55f128bc21a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:57.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.015+0000 7f1f35f34b80 1 --2- 172.21.15.82:0/258080512 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f128bbbbc0 0x55f128bbf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:57.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.016+0000 7f1f35f34b80 1 -- 172.21.15.82:0/258080512 >> 172.21.15.82:0/258080512 conn(0x55f128b2e6d0 msgr2=0x55f128bb0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:54:57.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.016+0000 7f1f35f34b80 1 -- 172.21.15.82:0/258080512 shutdown_connections 2024-05-08T05:54:57.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.016+0000 7f1f35f34b80 1 -- 172.21.15.82:0/258080512 wait complete. 2024-05-08T05:54:57.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.017+0000 7f1f35f34b80 20 client.25687 trim_cache size 0 max 16384 2024-05-08T05:54:57.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.044+0000 7f1f35f34b80 1 Processor -- start 2024-05-08T05:54:57.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.044+0000 7f1f35f34b80 1 -- start start 2024-05-08T05:54:57.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.045+0000 7f1f35f34b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f128bb68f0 0x55f128bb62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:57.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.045+0000 7f1f35f34b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f128bbbbc0 0x55f128bbe4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:57.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.045+0000 7f1f35f34b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f128bbc4e0 0x55f128bcbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:57.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.045+0000 7f1f23e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f128bbbbc0 0x55f128bbe4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:57.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.046+0000 7f1f29600700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f128bbc4e0 0x55f128bcbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:57.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.046+0000 7f1f23e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f128bbbbc0 0x55f128bbe4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:56810/0 (socket says 172.21.15.82:56810) 2024-05-08T05:54:57.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.046+0000 7f1f29600700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f128bbc4e0 0x55f128bcbfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:43128/0 (socket says 172.21.15.82:43128) 2024-05-08T05:54:57.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.046+0000 7f1f28c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f128bb68f0 0x55f128bb62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:57.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.046+0000 7f1f28c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f128bb68f0 0x55f128bb62d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52576/0 (socket says 172.21.15.82:52576) 2024-05-08T05:54:57.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.046+0000 7f1f35f34b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1f241b40b0 con 0x55f128bb68f0 2024-05-08T05:54:57.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.046+0000 7f1f35f34b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1f241b5bf0 con 0x55f128bbbbc0 2024-05-08T05:54:57.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.046+0000 7f1f35f34b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1f241b4780 con 0x55f128bbc4e0 2024-05-08T05:54:57.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.046+0000 7f1f23e00700 1 -- 172.21.15.82:0/4103430011 learned_addr learned my addr 172.21.15.82:0/4103430011 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:54:57.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.047+0000 7f1f23e00700 1 -- 172.21.15.82:0/4103430011 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f128bbc4e0 msgr2=0x55f128bcbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:54:57.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.047+0000 7f1f23e00700 1 --2- 172.21.15.82:0/4103430011 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f128bbc4e0 0x55f128bcbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:57.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.047+0000 7f1f23e00700 1 -- 172.21.15.82:0/4103430011 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f128bb68f0 msgr2=0x55f128bb62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:54:57.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.047+0000 7f1f23e00700 1 --2- 172.21.15.82:0/4103430011 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f128bb68f0 0x55f128bb62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:57.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.047+0000 7f1f23e00700 1 -- 172.21.15.82:0/4103430011 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f128bbc1f0 con 0x55f128bbbbc0 2024-05-08T05:54:57.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.047+0000 7f1f23e00700 1 --2- 172.21.15.82:0/4103430011 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f128bbbbc0 0x55f128bbe4c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1f14005f50 tx=0x7f1f140b3040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9454913826febf6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:54:57.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.047+0000 7f1f11600700 1 -- 172.21.15.82:0/4103430011 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f140cd0c0 con 0x55f128bbbbc0 2024-05-08T05:54:57.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.048+0000 7f1f11600700 1 -- 172.21.15.82:0/4103430011 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f140aebc0 con 0x55f128bbbbc0 2024-05-08T05:54:57.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.048+0000 7f1f11600700 1 -- 172.21.15.82:0/4103430011 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f140aaa70 con 0x55f128bbbbc0 2024-05-08T05:54:57.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.049+0000 7f1f35f34b80 1 -- 172.21.15.82:0/4103430011 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f128bbbbc0 msgr2=0x55f128bbe4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:54:57.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.049+0000 7f1f35f34b80 1 --2- 172.21.15.82:0/4103430011 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f128bbbbc0 0x55f128bbe4c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1f14005f50 tx=0x7f1f140b3040 comp rx=0 tx=0).stop 2024-05-08T05:54:57.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.049+0000 7f1f35f34b80 1 -- 172.21.15.82:0/4103430011 shutdown_connections 2024-05-08T05:54:57.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.049+0000 7f1f35f34b80 1 --2- 172.21.15.82:0/4103430011 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f128bbc4e0 0x55f128bcbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:57.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.049+0000 7f1f35f34b80 1 --2- 172.21.15.82:0/4103430011 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f128bb68f0 0x55f128bb62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:57.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.049+0000 7f1f35f34b80 1 --2- 172.21.15.82:0/4103430011 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f128bbbbc0 0x55f128bbe4c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:57.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.049+0000 7f1f35f34b80 1 -- 172.21.15.82:0/4103430011 >> 172.21.15.82:0/4103430011 conn(0x55f128b2e6d0 msgr2=0x55f128bba6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:54:57.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.049+0000 7f1f35f34b80 1 -- 172.21.15.82:0/4103430011 shutdown_connections 2024-05-08T05:54:57.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.050+0000 7f1f35f34b80 1 -- 172.21.15.82:0/4103430011 wait complete. 2024-05-08T05:54:57.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.050+0000 7f1f35f34b80 1 -- start start 2024-05-08T05:54:57.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.051+0000 7f1f35f34b80 1 Processor -- start 2024-05-08T05:54:57.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.051+0000 7f1f35f34b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f128bb68f0 0x55f128bc88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:57.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.051+0000 7f1f35f34b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f128bbbbc0 0x55f128bd7060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:57.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.052+0000 7f1f35f34b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f128bbc4e0 0x55f128bd75a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:57.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.052+0000 7f1f35f34b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1f241b5520 con 0x55f128bbc4e0 2024-05-08T05:54:57.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.052+0000 7f1f35f34b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1f241b4e50 con 0x55f128bb68f0 2024-05-08T05:54:57.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.052+0000 7f1f35f34b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1f241b2070 con 0x55f128bbbbc0 2024-05-08T05:54:57.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.052+0000 7f1f35f34b80 10 client.0 _ll_register_callbacks cb 0x55f128aafc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:54:57.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.052+0000 7f1f23e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f128bbbbc0 0x55f128bd7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:57.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.052+0000 7f1f28c00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f128bb68f0 0x55f128bc88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:57.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.052+0000 7f1f28c00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f128bb68f0 0x55f128bc88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:56826/0 (socket says 172.21.15.82:56826) 2024-05-08T05:54:57.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.052+0000 7f1f28c00700 1 -- 172.21.15.82:0/1023788316 learned_addr learned my addr 172.21.15.82:0/1023788316 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:54:57.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.053+0000 7f1f29600700 1 --2- 172.21.15.82:0/1023788316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f128bbc4e0 0x55f128bd75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:57.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.053+0000 7f1f23e00700 1 -- 172.21.15.82:0/1023788316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f128bb68f0 msgr2=0x55f128bc88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:54:57.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.053+0000 7f1f23e00700 1 --2- 172.21.15.82:0/1023788316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f128bb68f0 0x55f128bc88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:57.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.053+0000 7f1f23e00700 1 -- 172.21.15.82:0/1023788316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f128bbc4e0 msgr2=0x55f128bd75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:54:57.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.053+0000 7f1f23e00700 1 --2- 172.21.15.82:0/1023788316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f128bbc4e0 0x55f128bd75a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:57.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.053+0000 7f1f23e00700 1 -- 172.21.15.82:0/1023788316 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f128bd7de0 con 0x55f128bbbbc0 2024-05-08T05:54:57.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.054+0000 7f1f23e00700 1 --2- 172.21.15.82:0/1023788316 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f128bbbbc0 0x55f128bd7060 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x55f128bb1710 tx=0x7f1f1400b490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=278ae6d382459f7f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:54:57.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.054+0000 7f1f06a00700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:54:57.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.055+0000 7f1f06a00700 1 -- 172.21.15.82:0/1023788316 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f14022920 con 0x55f128bbbbc0 2024-05-08T05:54:57.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.055+0000 7f1f06a00700 1 -- 172.21.15.82:0/1023788316 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f1f140aaa70 con 0x55f128bbbbc0 2024-05-08T05:54:57.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.055+0000 7f1f35f34b80 1 -- 172.21.15.82:0/1023788316 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f140aebc0 con 0x55f128bbbbc0 2024-05-08T05:54:57.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.056+0000 7f1f06a00700 1 -- 172.21.15.82:0/1023788316 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f1f14022ac0 con 0x55f128bbbbc0 2024-05-08T05:54:57.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.056+0000 7f1f35f34b80 10 client.25693 fetch_fsmap learned FSMap version 31 2024-05-08T05:54:57.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.056+0000 7f1f35f34b80 1 -- 172.21.15.82:0/1023788316 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55f128c3a690 con 0x55f128bbbbc0 2024-05-08T05:54:57.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.056+0000 7f1f06a00700 1 -- 172.21.15.82:0/1023788316 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f140aebc0 con 0x55f128bbbbc0 2024-05-08T05:54:57.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.058+0000 7f1f06a00700 1 -- 172.21.15.82:0/1023788316 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f1f140b3150 con 0x55f128bbbbc0 2024-05-08T05:54:57.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.058+0000 7f1f35f34b80 10 client.25693 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:54:57.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.058+0000 7f1f35f34b80 10 client.25693 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-08T05:54:57.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.058+0000 7f1f35f34b80 20 client.25693 populate_metadata read hostname 'smithi082' 2024-05-08T05:54:57.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.058+0000 7f1f35f34b80 1 --2- 172.21.15.82:0/1023788316 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x55f128c3ab90 0x55f128c3cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:54:57.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.058+0000 7f1f35f34b80 4 client.25693 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:54:57.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.058+0000 7f1f35f34b80 1 -- 172.21.15.82:0/1023788316 --> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f128b16400 con 0x55f128c3ab90 2024-05-08T05:54:57.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.059+0000 7f1f28c00700 1 --2- 172.21.15.82:0/1023788316 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x55f128c3ab90 0x55f128c3cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:54:57.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.059+0000 7f1f28c00700 1 --2- 172.21.15.82:0/1023788316 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x55f128c3ab90 0x55f128c3cf80 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bb81817278afd01f server_cookie=c9021617abebc7f7 in_seq=0 out_seq=0 2024-05-08T05:54:57.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.059+0000 7f1f06a00700 10 client.25693 ms_handle_connect on v2:172.21.15.151:6838/2963754236 2024-05-08T05:54:57.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.060+0000 7f1f06a00700 1 -- 172.21.15.82:0/1023788316 <== mds.1 v2:172.21.15.151:6838/2963754236 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f128b16400 con 0x55f128c3ab90 2024-05-08T05:54:57.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.060+0000 7f1f06a00700 10 client.25693 handle_command_reply: tid=0 2024-05-08T05:54:57.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.060+0000 7f1f35f34b80 1 client.25693 shutdown 2024-05-08T05:54:57.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.060+0000 7f1f35f34b80 1 -- 172.21.15.82:0/1023788316 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f128bbbbc0 msgr2=0x55f128bd7060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:54:57.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.060+0000 7f1f35f34b80 1 --2- 172.21.15.82:0/1023788316 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f128bbbbc0 0x55f128bd7060 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x55f128bb1710 tx=0x7f1f1400b490 comp rx=0 tx=0).stop 2024-05-08T05:54:57.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.060+0000 7f1f35f34b80 1 -- 172.21.15.82:0/1023788316 shutdown_connections 2024-05-08T05:54:57.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.060+0000 7f1f35f34b80 1 --2- 172.21.15.82:0/1023788316 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x55f128c3ab90 0x55f128c3cf80 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:57.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.060+0000 7f1f35f34b80 1 --2- 172.21.15.82:0/1023788316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f128bb68f0 0x55f128bc88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:57.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.060+0000 7f1f35f34b80 1 --2- 172.21.15.82:0/1023788316 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f128bbc4e0 0x55f128bd75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:57.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.060+0000 7f1f35f34b80 1 --2- 172.21.15.82:0/1023788316 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f128bbbbc0 0x55f128bd7060 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:57.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.060+0000 7f1f35f34b80 1 -- 172.21.15.82:0/1023788316 >> 172.21.15.82:0/1023788316 conn(0x55f128b2e6d0 msgr2=0x55f128bbcfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:54:57.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.060+0000 7f1f06a00700 0 client.25693 ms_handle_reset on v2:172.21.15.151:6838/2963754236 2024-05-08T05:54:57.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.061+0000 7f1f35f34b80 1 -- 172.21.15.82:0/1023788316 shutdown_connections 2024-05-08T05:54:57.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.061+0000 7f1f35f34b80 1 -- 172.21.15.82:0/1023788316 wait complete. 2024-05-08T05:54:57.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.062+0000 7f1f35f34b80 20 client.25693 trim_cache size 0 max 16384 2024-05-08T05:54:57.063 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T05:54:57.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.063+0000 7f1f2b600700 1 -- 172.21.15.82:0/1768164021 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f1f0c0b2980 msgr2=0x7f1f0c0b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:54:57.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.063+0000 7f1f2b600700 1 --2- 172.21.15.82:0/1768164021 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f1f0c0b2980 0x7f1f0c0b4e40 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1f18009bc0 tx=0x7f1f18009260 comp rx=0 tx=0).stop 2024-05-08T05:54:57.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.063+0000 7f1f2b600700 1 -- 172.21.15.82:0/1768164021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f24102d60 msgr2=0x7f1f24197a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:54:57.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.063+0000 7f1f2b600700 1 --2- 172.21.15.82:0/1768164021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f24102d60 0x7f1f24197a50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1f14005910 tx=0x7f1f1400b670 comp rx=0 tx=0).stop 2024-05-08T05:54:57.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.063+0000 7f1f2b600700 1 -- 172.21.15.82:0/1768164021 shutdown_connections 2024-05-08T05:54:57.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.063+0000 7f1f2b600700 1 --2- 172.21.15.82:0/1768164021 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f1f0c0b2980 0x7f1f0c0b4e40 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:57.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.063+0000 7f1f2b600700 1 --2- 172.21.15.82:0/1768164021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f24108410 0x7f1f24197f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:57.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.063+0000 7f1f2b600700 1 --2- 172.21.15.82:0/1768164021 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1f241023a0 0x7f1f2419b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:57.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.063+0000 7f1f2b600700 1 --2- 172.21.15.82:0/1768164021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f24102d60 0x7f1f24197a50 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:54:57.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.063+0000 7f1f2b600700 1 -- 172.21.15.82:0/1768164021 >> 172.21.15.82:0/1768164021 conn(0x7f1f24079350 msgr2=0x7f1f240ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:54:57.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.064+0000 7f1f2b600700 1 -- 172.21.15.82:0/1768164021 shutdown_connections 2024-05-08T05:54:57.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:54:57.064+0000 7f1f2b600700 1 -- 172.21.15.82:0/1768164021 wait complete. 2024-05-08T05:54:58.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:54:57 smithi082 ceph-mon[30098]: pgmap v588: 97 pgs: 97 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 35 MiB/s wr, 1.18k op/s 2024-05-08T05:54:58.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:54:57 smithi134 ceph-mon[34132]: pgmap v588: 97 pgs: 97 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 35 MiB/s wr, 1.18k op/s 2024-05-08T05:54:58.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:54:57 smithi151 ceph-mon[34815]: pgmap v588: 97 pgs: 97 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 35 MiB/s wr, 1.18k op/s 2024-05-08T05:54:58.465 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-05-08T05:54:59.132 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:55:00.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:54:59 smithi082 ceph-mon[30098]: pgmap v589: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 39 MiB/s wr, 1.35k op/s 2024-05-08T05:55:00.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:54:59 smithi134 ceph-mon[34132]: pgmap v589: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 39 MiB/s wr, 1.35k op/s 2024-05-08T05:55:00.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 250.0 s, 3036.0 tps, lat 33.050 ms stddev 40.800 2024-05-08T05:55:00.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:54:59 smithi151 ceph-mon[34815]: pgmap v589: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 39 MiB/s wr, 1.35k op/s 2024-05-08T05:55:01.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.717+0000 7f52b9e00700 1 -- 172.21.15.82:0/2737016883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52b410b6e0 msgr2=0x7f52b410bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:01.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.717+0000 7f52b9e00700 1 --2- 172.21.15.82:0/2737016883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52b410b6e0 0x7f52b410bac0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f52ac00b0a0 tx=0x7f52ac00b3b0 comp rx=0 tx=0).stop 2024-05-08T05:55:01.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.718+0000 7f52b9e00700 1 -- 172.21.15.82:0/2737016883 shutdown_connections 2024-05-08T05:55:01.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.718+0000 7f52b9e00700 1 --2- 172.21.15.82:0/2737016883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52b410b6e0 0x7f52b410bac0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:01.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.718+0000 7f52b9e00700 1 --2- 172.21.15.82:0/2737016883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52b41060a0 0x7f52b41125b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:01.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.718+0000 7f52b9e00700 1 --2- 172.21.15.82:0/2737016883 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52b41056e0 0x7f52b4105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:01.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.718+0000 7f52b9e00700 1 -- 172.21.15.82:0/2737016883 >> 172.21.15.82:0/2737016883 conn(0x7f52b41011d0 msgr2=0x7f52b41035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:55:01.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.718+0000 7f52b9e00700 1 -- 172.21.15.82:0/2737016883 shutdown_connections 2024-05-08T05:55:01.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.719+0000 7f52b9e00700 1 -- 172.21.15.82:0/2737016883 wait complete. 2024-05-08T05:55:01.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.720+0000 7f52b9e00700 1 Processor -- start 2024-05-08T05:55:01.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.721+0000 7f52b9e00700 1 -- start start 2024-05-08T05:55:01.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.721+0000 7f52b9e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52b41056e0 0x7f52b419be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:01.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.721+0000 7f52b9e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52b41060a0 0x7f52b419c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:01.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.721+0000 7f52b9e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52b410b6e0 0x7f52b41a06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:01.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.721+0000 7f52b9e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f52b4115970 con 0x7f52b41060a0 2024-05-08T05:55:01.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.721+0000 7f52b9e00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f52b41157f0 con 0x7f52b410b6e0 2024-05-08T05:55:01.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.721+0000 7f52b9e00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f52b4115af0 con 0x7f52b41056e0 2024-05-08T05:55:01.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.722+0000 7f52b3400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52b410b6e0 0x7f52b41a06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:01.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.722+0000 7f52b3400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52b410b6e0 0x7f52b41a06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:56848/0 (socket says 172.21.15.82:56848) 2024-05-08T05:55:01.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.722+0000 7f52b3400700 1 -- 172.21.15.82:0/999964168 learned_addr learned my addr 172.21.15.82:0/999964168 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:55:01.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.722+0000 7f52b2a00700 1 --2- 172.21.15.82:0/999964168 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52b41056e0 0x7f52b419be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:01.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.722+0000 7f52b3400700 1 -- 172.21.15.82:0/999964168 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52b41056e0 msgr2=0x7f52b419be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:01.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.722+0000 7f52b3400700 1 --2- 172.21.15.82:0/999964168 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52b41056e0 0x7f52b419be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:01.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.722+0000 7f52b3400700 1 -- 172.21.15.82:0/999964168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52b41060a0 msgr2=0x7f52b419c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:01.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.722+0000 7f52b3400700 1 --2- 172.21.15.82:0/999964168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52b41060a0 0x7f52b419c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:01.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.723+0000 7f52b3400700 1 -- 172.21.15.82:0/999964168 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52b41a0e30 con 0x7f52b410b6e0 2024-05-08T05:55:01.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.723+0000 7f52b3400700 1 --2- 172.21.15.82:0/999964168 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52b410b6e0 0x7f52b41a06f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f52a000b550 tx=0x7f52a000b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:55:01.725 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.723+0000 7f52b8a00700 1 -- 172.21.15.82:0/999964168 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a0015020 con 0x7f52b410b6e0 2024-05-08T05:55:01.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.723+0000 7f52b9e00700 1 -- 172.21.15.82:0/999964168 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52b41a1120 con 0x7f52b410b6e0 2024-05-08T05:55:01.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.723+0000 7f52b8a00700 1 -- 172.21.15.82:0/999964168 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52a0011ce0 con 0x7f52b410b6e0 2024-05-08T05:55:01.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.724+0000 7f52b8a00700 1 -- 172.21.15.82:0/999964168 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a0010da0 con 0x7f52b410b6e0 2024-05-08T05:55:01.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.724+0000 7f52b9e00700 1 -- 172.21.15.82:0/999964168 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52b41a89a0 con 0x7f52b410b6e0 2024-05-08T05:55:01.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.730+0000 7f52b8a00700 1 -- 172.21.15.82:0/999964168 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f52a0018020 con 0x7f52b410b6e0 2024-05-08T05:55:01.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.730+0000 7f52c46f2b80 1 Processor -- start 2024-05-08T05:55:01.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.730+0000 7f52c46f2b80 1 -- start start 2024-05-08T05:55:01.733 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.731+0000 7f52c46f2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c68647a870 0x55c68647ac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:01.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.731+0000 7f52c46f2b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c68647b190 0x55c68647eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:01.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.731+0000 7f52c46f2b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c68647f1e0 0x55c68647f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:01.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.731+0000 7f52c46f2b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c6863c4a20 con 0x55c68647b190 2024-05-08T05:55:01.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.731+0000 7f52c46f2b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55c686362760 con 0x55c68647f1e0 2024-05-08T05:55:01.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.731+0000 7f52c46f2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55c6863c09e0 con 0x55c68647a870 2024-05-08T05:55:01.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.731+0000 7f52b2a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c68647b190 0x55c68647eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:01.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.732+0000 7f52b2a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c68647b190 0x55c68647eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52610/0 (socket says 172.21.15.82:52610) 2024-05-08T05:55:01.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.732+0000 7f52b2a00700 1 -- 172.21.15.82:0/1584033135 learned_addr learned my addr 172.21.15.82:0/1584033135 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:55:01.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.732+0000 7f52b2000700 1 --2- 172.21.15.82:0/1584033135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c68647a870 0x55c68647ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:01.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.732+0000 7f52b2000700 1 --2- 172.21.15.82:0/1584033135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c68647f1e0 0x55c68647f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:01.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.732+0000 7f52b8a00700 1 --2- 172.21.15.82:0/999964168 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f52980c3910 0x7f52980c5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:01.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.733+0000 7f52b3400700 1 --2- 172.21.15.82:0/999964168 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f52980c3910 0x7f52980c5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:01.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.733+0000 7f52b8a00700 1 -- 172.21.15.82:0/999964168 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f52a00e1950 con 0x7f52b410b6e0 2024-05-08T05:55:01.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.734+0000 7f52b2a00700 1 -- 172.21.15.82:0/1584033135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c68647a870 msgr2=0x55c68647ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:55:01.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.734+0000 7f52b2a00700 1 --2- 172.21.15.82:0/1584033135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c68647a870 0x55c68647ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:01.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.734+0000 7f52b2a00700 1 -- 172.21.15.82:0/1584033135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c68647f1e0 msgr2=0x55c68647f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:55:01.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.734+0000 7f52b2a00700 1 --2- 172.21.15.82:0/1584033135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c68647f1e0 0x55c68647f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:01.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.734+0000 7f52b2a00700 1 -- 172.21.15.82:0/1584033135 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c6863118d0 con 0x55c68647b190 2024-05-08T05:55:01.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.735+0000 7f52b3400700 1 --2- 172.21.15.82:0/999964168 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f52980c3910 0x7f52980c5dd0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f52a000b520 tx=0x7f52a0004750 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:55:01.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.735+0000 7f52b2a00700 1 --2- 172.21.15.82:0/1584033135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c68647b190 0x55c68647eca0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f52ac0092e0 tx=0x7f52ac009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45c5ec43f31e65d3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:55:01.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.735+0000 7f52a8c00700 1 -- 172.21.15.82:0/1584033135 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ac020070 con 0x55c68647b190 2024-05-08T05:55:01.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.736+0000 7f52a8c00700 1 -- 172.21.15.82:0/1584033135 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52ac003c00 con 0x55c68647b190 2024-05-08T05:55:01.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.736+0000 7f52a8c00700 1 -- 172.21.15.82:0/1584033135 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ac0052a0 con 0x55c68647b190 2024-05-08T05:55:01.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.737+0000 7f52c46f2b80 1 -- 172.21.15.82:0/1584033135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c68647b190 msgr2=0x55c68647eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:01.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.737+0000 7f52c46f2b80 1 --2- 172.21.15.82:0/1584033135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c68647b190 0x55c68647eca0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f52ac0092e0 tx=0x7f52ac009310 comp rx=0 tx=0).stop 2024-05-08T05:55:01.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.739+0000 7f52c46f2b80 1 -- 172.21.15.82:0/1584033135 shutdown_connections 2024-05-08T05:55:01.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.739+0000 7f52c46f2b80 1 --2- 172.21.15.82:0/1584033135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c68647f1e0 0x55c68647f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:01.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.739+0000 7f52c46f2b80 1 --2- 172.21.15.82:0/1584033135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c68647a870 0x55c68647ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:01.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.739+0000 7f52c46f2b80 1 --2- 172.21.15.82:0/1584033135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c68647b190 0x55c68647eca0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:01.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.739+0000 7f52c46f2b80 1 -- 172.21.15.82:0/1584033135 >> 172.21.15.82:0/1584033135 conn(0x55c6863a0b60 msgr2=0x55c68646c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:55:01.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.739+0000 7f52c46f2b80 1 -- 172.21.15.82:0/1584033135 shutdown_connections 2024-05-08T05:55:01.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.739+0000 7f52c46f2b80 1 -- 172.21.15.82:0/1584033135 wait complete. 2024-05-08T05:55:01.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.740+0000 7f52c46f2b80 1 -- start start 2024-05-08T05:55:01.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.740+0000 7f52c46f2b80 1 Processor -- start 2024-05-08T05:55:01.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.741+0000 7f52c46f2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c68647a870 0x55c686486660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:01.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.741+0000 7f52c46f2b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c68647b190 0x55c686483a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:01.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.741+0000 7f52c46f2b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c68647f1e0 0x55c686483f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:01.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.741+0000 7f52c46f2b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c686487390 con 0x55c68647f1e0 2024-05-08T05:55:01.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.741+0000 7f52c46f2b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55c68632ab20 con 0x55c68647b190 2024-05-08T05:55:01.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.741+0000 7f52c46f2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55c686487510 con 0x55c68647a870 2024-05-08T05:55:01.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.741+0000 7f52c46f2b80 10 client.0 _ll_register_callbacks cb 0x55c68636bc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:55:01.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.742+0000 7f52b2a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c68647b190 0x55c686483a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:01.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.742+0000 7f52b2a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c68647b190 0x55c686483a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:56856/0 (socket says 172.21.15.82:56856) 2024-05-08T05:55:01.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.742+0000 7f52b2a00700 1 -- 172.21.15.82:0/2303106639 learned_addr learned my addr 172.21.15.82:0/2303106639 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:55:01.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.742+0000 7f52b2000700 1 --2- 172.21.15.82:0/2303106639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c68647f1e0 0x55c686483f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:01.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.743+0000 7f52b2a00700 1 -- 172.21.15.82:0/2303106639 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c68647a870 msgr2=0x55c686486660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:55:01.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.743+0000 7f52b2a00700 1 --2- 172.21.15.82:0/2303106639 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c68647a870 0x55c686486660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:01.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.743+0000 7f52b2a00700 1 -- 172.21.15.82:0/2303106639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c68647f1e0 msgr2=0x55c686483f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:55:01.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.743+0000 7f52b2a00700 1 --2- 172.21.15.82:0/2303106639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c68647f1e0 0x55c686483f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:01.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.743+0000 7f52b2a00700 1 -- 172.21.15.82:0/2303106639 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c68638a420 con 0x55c68647b190 2024-05-08T05:55:01.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.743+0000 7f52b2000700 1 --2- 172.21.15.82:0/2303106639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c68647f1e0 0x55c686483f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:55:01.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.744+0000 7f52b2a00700 1 --2- 172.21.15.82:0/2303106639 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c68647b190 0x55c686483a00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f52ac009a20 tx=0x7f52ac007aa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ebf3ae41e6c0fdf server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:55:01.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.744+0000 7f529d600700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:55:01.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.744+0000 7f529d600700 1 -- 172.21.15.82:0/2303106639 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52ac020070 con 0x55c68647b190 2024-05-08T05:55:01.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.744+0000 7f529d600700 1 -- 172.21.15.82:0/2303106639 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f52ac003a00 con 0x55c68647b190 2024-05-08T05:55:01.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.744+0000 7f52c46f2b80 1 -- 172.21.15.82:0/2303106639 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52ac003c00 con 0x55c68647b190 2024-05-08T05:55:01.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.745+0000 7f529d600700 1 -- 172.21.15.82:0/2303106639 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f52ac006000 con 0x55c68647b190 2024-05-08T05:55:01.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.745+0000 7f52c46f2b80 10 client.25673 fetch_fsmap learned FSMap version 31 2024-05-08T05:55:01.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.745+0000 7f52c46f2b80 1 -- 172.21.15.82:0/2303106639 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55c686491c20 con 0x55c68647b190 2024-05-08T05:55:01.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.745+0000 7f529d600700 1 -- 172.21.15.82:0/2303106639 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52ac003c00 con 0x55c68647b190 2024-05-08T05:55:01.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.746+0000 7f529d600700 1 -- 172.21.15.82:0/2303106639 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f52ac011070 con 0x55c68647b190 2024-05-08T05:55:01.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.746+0000 7f52c46f2b80 10 client.25673 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:55:01.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.746+0000 7f52c46f2b80 10 client.25673 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:55:01.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.746+0000 7f52c46f2b80 20 client.25673 populate_metadata read hostname 'smithi082' 2024-05-08T05:55:01.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.746+0000 7f52c46f2b80 1 --2- 172.21.15.82:0/2303106639 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55c686494190 0x55c686496610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:01.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.746+0000 7f52c46f2b80 4 client.25673 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:55:01.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.746+0000 7f52c46f2b80 1 -- 172.21.15.82:0/2303106639 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c68643f0a0 con 0x55c686494190 2024-05-08T05:55:01.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.747+0000 7f52b2000700 1 --2- 172.21.15.82:0/2303106639 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55c686494190 0x55c686496610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:01.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.748+0000 7f52b2000700 1 --2- 172.21.15.82:0/2303106639 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55c686494190 0x55c686496610 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3200ad06ccf3ad2 server_cookie=3546b5b2956b970b in_seq=0 out_seq=0 2024-05-08T05:55:01.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.748+0000 7f529d600700 10 client.25673 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:55:01.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.749+0000 7f529d600700 1 -- 172.21.15.82:0/2303106639 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55c68643f0a0 con 0x55c686494190 2024-05-08T05:55:01.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.749+0000 7f529d600700 10 client.25673 handle_command_reply: tid=0 2024-05-08T05:55:01.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.749+0000 7f52c46f2b80 1 client.25673 shutdown 2024-05-08T05:55:01.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.751+0000 7f52c46f2b80 1 -- 172.21.15.82:0/2303106639 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c68647b190 msgr2=0x55c686483a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:01.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.751+0000 7f52c46f2b80 1 --2- 172.21.15.82:0/2303106639 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c68647b190 0x55c686483a00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f52ac009a20 tx=0x7f52ac007aa0 comp rx=0 tx=0).stop 2024-05-08T05:55:01.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.751+0000 7f52c46f2b80 1 -- 172.21.15.82:0/2303106639 shutdown_connections 2024-05-08T05:55:01.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.751+0000 7f52c46f2b80 1 --2- 172.21.15.82:0/2303106639 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c68647f1e0 0x55c686483f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:01.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.751+0000 7f52c46f2b80 1 --2- 172.21.15.82:0/2303106639 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c68647a870 0x55c686486660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:01.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.751+0000 7f52c46f2b80 1 --2- 172.21.15.82:0/2303106639 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55c686494190 0x55c686496610 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:01.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.751+0000 7f52c46f2b80 1 --2- 172.21.15.82:0/2303106639 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c68647b190 0x55c686483a00 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:01.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.751+0000 7f52c46f2b80 1 -- 172.21.15.82:0/2303106639 >> 172.21.15.82:0/2303106639 conn(0x55c6863a0b60 msgr2=0x55c6864672b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:55:01.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.751+0000 7f529d600700 0 client.25673 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:55:01.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.751+0000 7f52c46f2b80 1 -- 172.21.15.82:0/2303106639 shutdown_connections 2024-05-08T05:55:01.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.751+0000 7f52c46f2b80 1 -- 172.21.15.82:0/2303106639 wait complete. 2024-05-08T05:55:01.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.751+0000 7f52c46f2b80 20 client.25673 trim_cache size 0 max 16384 2024-05-08T05:55:01.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.778+0000 7f52c46f2b80 1 Processor -- start 2024-05-08T05:55:01.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.778+0000 7f52c46f2b80 1 -- start start 2024-05-08T05:55:01.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.779+0000 7f52c46f2b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c6863a0b60 0x55c686490450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:01.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.779+0000 7f52c46f2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c68647a870 0x55c686467130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:01.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.779+0000 7f52c46f2b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c68647b190 0x55c68647fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:01.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.779+0000 7f52c46f2b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f52b406fc60 con 0x55c68647b190 2024-05-08T05:55:01.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.779+0000 7f52c46f2b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f52b40717a0 con 0x55c6863a0b60 2024-05-08T05:55:01.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.779+0000 7f52c46f2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f52b4070330 con 0x55c68647a870 2024-05-08T05:55:01.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.780+0000 7f52b2a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c68647a870 0x55c686467130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:01.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.780+0000 7f52b2a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c68647a870 0x55c686467130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:43184/0 (socket says 172.21.15.82:43184) 2024-05-08T05:55:01.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.780+0000 7f52b2a00700 1 -- 172.21.15.82:0/1502071472 learned_addr learned my addr 172.21.15.82:0/1502071472 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:55:01.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.780+0000 7f52b2000700 1 --2- 172.21.15.82:0/1502071472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c68647b190 0x55c68647fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:01.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.780+0000 7f52b2000700 1 --2- 172.21.15.82:0/1502071472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c6863a0b60 0x55c686490450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:01.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.780+0000 7f52b2000700 1 -- 172.21.15.82:0/1502071472 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c68647a870 msgr2=0x55c686467130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:55:01.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.780+0000 7f52b2000700 1 --2- 172.21.15.82:0/1502071472 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c68647a870 0x55c686467130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:01.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.780+0000 7f52b2000700 1 -- 172.21.15.82:0/1502071472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c6863a0b60 msgr2=0x55c686490450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:55:01.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.780+0000 7f52b2000700 1 --2- 172.21.15.82:0/1502071472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c6863a0b60 0x55c686490450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:01.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.780+0000 7f52b2000700 1 -- 172.21.15.82:0/1502071472 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c686468f90 con 0x55c68647b190 2024-05-08T05:55:01.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.781+0000 7f52b2000700 1 --2- 172.21.15.82:0/1502071472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c68647b190 0x55c68647fba0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x55c686496c10 tx=0x7f52a4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74732c6e99092322 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:55:01.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.781+0000 7f529fe00700 1 -- 172.21.15.82:0/1502071472 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a4004220 con 0x55c68647b190 2024-05-08T05:55:01.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.781+0000 7f529fe00700 1 -- 172.21.15.82:0/1502071472 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52a40043c0 con 0x55c68647b190 2024-05-08T05:55:01.782 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.781+0000 7f529fe00700 1 -- 172.21.15.82:0/1502071472 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a40038e0 con 0x55c68647b190 2024-05-08T05:55:01.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.782+0000 7f52c46f2b80 1 -- 172.21.15.82:0/1502071472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c68647b190 msgr2=0x55c68647fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:01.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.782+0000 7f52c46f2b80 1 --2- 172.21.15.82:0/1502071472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c68647b190 0x55c68647fba0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x55c686496c10 tx=0x7f52a4004750 comp rx=0 tx=0).stop 2024-05-08T05:55:01.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.782+0000 7f52c46f2b80 1 -- 172.21.15.82:0/1502071472 shutdown_connections 2024-05-08T05:55:01.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.782+0000 7f52c46f2b80 1 --2- 172.21.15.82:0/1502071472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c6863a0b60 0x55c686490450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:01.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.782+0000 7f52c46f2b80 1 --2- 172.21.15.82:0/1502071472 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c68647b190 0x55c68647fba0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:01.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.782+0000 7f52c46f2b80 1 --2- 172.21.15.82:0/1502071472 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c68647a870 0x55c686467130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:01.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.782+0000 7f52c46f2b80 1 -- 172.21.15.82:0/1502071472 >> 172.21.15.82:0/1502071472 conn(0x55c686482ea0 msgr2=0x55c686466a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:55:01.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.783+0000 7f52c46f2b80 1 -- 172.21.15.82:0/1502071472 shutdown_connections 2024-05-08T05:55:01.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.783+0000 7f52c46f2b80 1 -- 172.21.15.82:0/1502071472 wait complete. 2024-05-08T05:55:01.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.783+0000 7f52c46f2b80 1 -- start start 2024-05-08T05:55:01.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.783+0000 7f52c46f2b80 1 Processor -- start 2024-05-08T05:55:01.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.784+0000 7f52c46f2b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c6863a0b60 0x55c68649b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:01.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.784+0000 7f52c46f2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c68647a870 0x55c68649bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:01.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.784+0000 7f52c46f2b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c68647b190 0x55c68649c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:01.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.784+0000 7f52c46f2b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f52b40710d0 con 0x55c68647b190 2024-05-08T05:55:01.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.784+0000 7f52c46f2b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f52b4070a00 con 0x55c6863a0b60 2024-05-08T05:55:01.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.784+0000 7f52c46f2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f52b407b7e0 con 0x55c68647a870 2024-05-08T05:55:01.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.784+0000 7f52c46f2b80 10 client.0 _ll_register_callbacks cb 0x55c68636bc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:55:01.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.784+0000 7f52b2000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c68647b190 0x55c68649c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:01.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.784+0000 7f52b2000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c68647b190 0x55c68649c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:52640/0 (socket says 172.21.15.82:52640) 2024-05-08T05:55:01.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.784+0000 7f52b2000700 1 -- 172.21.15.82:0/630741428 learned_addr learned my addr 172.21.15.82:0/630741428 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:55:01.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.785+0000 7f52b2a00700 1 --2- 172.21.15.82:0/630741428 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c68647a870 0x55c68649bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:01.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.785+0000 7f52b2000700 1 --2- 172.21.15.82:0/630741428 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c6863a0b60 0x55c68649b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:01.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.785+0000 7f52b2000700 1 -- 172.21.15.82:0/630741428 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c68647a870 msgr2=0x55c68649bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:55:01.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.785+0000 7f52b2000700 1 --2- 172.21.15.82:0/630741428 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c68647a870 0x55c68649bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:01.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.785+0000 7f52b2000700 1 -- 172.21.15.82:0/630741428 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c6863a0b60 msgr2=0x55c68649b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:55:01.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.785+0000 7f52b2000700 1 --2- 172.21.15.82:0/630741428 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c6863a0b60 0x55c68649b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:01.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.785+0000 7f52b2000700 1 -- 172.21.15.82:0/630741428 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c6864fdd40 con 0x55c68647b190 2024-05-08T05:55:01.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.785+0000 7f52b2000700 1 --2- 172.21.15.82:0/630741428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c68647b190 0x55c68649c450 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f52a4005e10 tx=0x7f52a4005d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f926cc5cdfe8e56 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:55:01.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.785+0000 7f529d600700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T05:55:01.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.786+0000 7f529d600700 1 -- 172.21.15.82:0/630741428 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a4011920 con 0x55c68647b190 2024-05-08T05:55:01.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.786+0000 7f529d600700 1 -- 172.21.15.82:0/630741428 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f52a4011ac0 con 0x55c68647b190 2024-05-08T05:55:01.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.786+0000 7f52c46f2b80 1 -- 172.21.15.82:0/630741428 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52a40043c0 con 0x55c68647b190 2024-05-08T05:55:01.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.786+0000 7f529d600700 1 -- 172.21.15.82:0/630741428 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f52a403e050 con 0x55c68647b190 2024-05-08T05:55:01.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.786+0000 7f52c46f2b80 10 client.15468 fetch_fsmap learned FSMap version 31 2024-05-08T05:55:01.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.786+0000 7f52c46f2b80 1 -- 172.21.15.82:0/630741428 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55c6864ff040 con 0x55c68647b190 2024-05-08T05:55:01.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.787+0000 7f529d600700 1 -- 172.21.15.82:0/630741428 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f52a40043c0 con 0x55c68647b190 2024-05-08T05:55:01.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.787+0000 7f529d600700 1 -- 172.21.15.82:0/630741428 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f52a4036020 con 0x55c68647b190 2024-05-08T05:55:01.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.787+0000 7f52c46f2b80 10 client.15468 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:55:01.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.787+0000 7f52c46f2b80 10 client.15468 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:55:01.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.787+0000 7f52c46f2b80 20 client.15468 populate_metadata read hostname 'smithi082' 2024-05-08T05:55:01.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.787+0000 7f52c46f2b80 1 --2- 172.21.15.82:0/630741428 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55c68647f1e0 0x55c6865015c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:01.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.787+0000 7f52c46f2b80 4 client.15468 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:55:01.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.787+0000 7f52c46f2b80 1 -- 172.21.15.82:0/630741428 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c6863d2400 con 0x55c68647f1e0 2024-05-08T05:55:01.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.788+0000 7f52b2a00700 1 --2- 172.21.15.82:0/630741428 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55c68647f1e0 0x55c6865015c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:01.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.788+0000 7f52b2a00700 1 --2- 172.21.15.82:0/630741428 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55c68647f1e0 0x55c6865015c0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=598c0f080e2ed2c3 server_cookie=46969a74f893d3d3 in_seq=0 out_seq=0 2024-05-08T05:55:01.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.788+0000 7f529d600700 10 client.15468 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:55:01.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.788+0000 7f529d600700 1 -- 172.21.15.82:0/630741428 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c6863d2400 con 0x55c68647f1e0 2024-05-08T05:55:01.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.789+0000 7f529d600700 10 client.15468 handle_command_reply: tid=0 2024-05-08T05:55:01.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.789+0000 7f52c46f2b80 1 client.15468 shutdown 2024-05-08T05:55:01.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.789+0000 7f52c46f2b80 1 -- 172.21.15.82:0/630741428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c68647b190 msgr2=0x55c68649c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:01.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.789+0000 7f52c46f2b80 1 --2- 172.21.15.82:0/630741428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c68647b190 0x55c68649c450 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f52a4005e10 tx=0x7f52a4005d80 comp rx=0 tx=0).stop 2024-05-08T05:55:01.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.789+0000 7f52c46f2b80 1 -- 172.21.15.82:0/630741428 shutdown_connections 2024-05-08T05:55:01.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.789+0000 7f52c46f2b80 1 --2- 172.21.15.82:0/630741428 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55c68647f1e0 0x55c6865015c0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:01.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.789+0000 7f529d600700 0 client.15468 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:55:01.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.789+0000 7f52c46f2b80 1 --2- 172.21.15.82:0/630741428 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c6863a0b60 0x55c68649b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:01.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.789+0000 7f52c46f2b80 1 --2- 172.21.15.82:0/630741428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c68647b190 0x55c68649c450 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:01.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.789+0000 7f52c46f2b80 1 --2- 172.21.15.82:0/630741428 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c68647a870 0x55c68649bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:01.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.789+0000 7f52c46f2b80 1 -- 172.21.15.82:0/630741428 >> 172.21.15.82:0/630741428 conn(0x55c686482ea0 msgr2=0x55c6864672b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:55:01.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.789+0000 7f52c46f2b80 1 -- 172.21.15.82:0/630741428 shutdown_connections 2024-05-08T05:55:01.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.789+0000 7f52c46f2b80 1 -- 172.21.15.82:0/630741428 wait complete. 2024-05-08T05:55:01.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.790+0000 7f52c46f2b80 20 client.15468 trim_cache size 0 max 16384 2024-05-08T05:55:01.792 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T05:55:01.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.790+0000 7f52b9e00700 1 -- 172.21.15.82:0/999964168 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f52980c3910 msgr2=0x7f52980c5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:01.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.790+0000 7f52b9e00700 1 --2- 172.21.15.82:0/999964168 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f52980c3910 0x7f52980c5dd0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f52a000b520 tx=0x7f52a0004750 comp rx=0 tx=0).stop 2024-05-08T05:55:01.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.790+0000 7f52b9e00700 1 -- 172.21.15.82:0/999964168 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52b410b6e0 msgr2=0x7f52b41a06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:01.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.790+0000 7f52b9e00700 1 --2- 172.21.15.82:0/999964168 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52b410b6e0 0x7f52b41a06f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f52a000b550 tx=0x7f52a000b860 comp rx=0 tx=0).stop 2024-05-08T05:55:01.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.791+0000 7f52b9e00700 1 -- 172.21.15.82:0/999964168 shutdown_connections 2024-05-08T05:55:01.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.791+0000 7f52b9e00700 1 --2- 172.21.15.82:0/999964168 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52b410b6e0 0x7f52b41a06f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:01.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.791+0000 7f52b9e00700 1 --2- 172.21.15.82:0/999964168 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f52980c3910 0x7f52980c5dd0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:01.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.791+0000 7f52b9e00700 1 --2- 172.21.15.82:0/999964168 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52b41056e0 0x7f52b419be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:01.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.791+0000 7f52b9e00700 1 --2- 172.21.15.82:0/999964168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f52b41060a0 0x7f52b419c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:01.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.791+0000 7f52b9e00700 1 -- 172.21.15.82:0/999964168 >> 172.21.15.82:0/999964168 conn(0x7f52b41011d0 msgr2=0x7f52b41018d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:55:01.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.791+0000 7f52b9e00700 1 -- 172.21.15.82:0/999964168 shutdown_connections 2024-05-08T05:55:01.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:01.791+0000 7f52b9e00700 1 -- 172.21.15.82:0/999964168 wait complete. 2024-05-08T05:55:02.194 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:55:01 smithi082 ceph-mon[30098]: pgmap v590: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 51 MiB/s wr, 1.74k op/s 2024-05-08T05:55:02.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:55:01 smithi134 ceph-mon[34132]: pgmap v590: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 51 MiB/s wr, 1.74k op/s 2024-05-08T05:55:02.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:55:01 smithi151 ceph-mon[34815]: pgmap v590: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 51 MiB/s wr, 1.74k op/s 2024-05-08T05:55:03.628 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-08T05:55:03.629 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-05-08T05:55:03.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:55:03 smithi082 ceph-mon[30098]: pgmap v591: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 45 MiB/s wr, 1.59k op/s 2024-05-08T05:55:04.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:55:03 smithi134 ceph-mon[34132]: pgmap v591: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 45 MiB/s wr, 1.59k op/s 2024-05-08T05:55:04.251 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:55:04.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:55:03 smithi151 ceph-mon[34815]: pgmap v591: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 45 MiB/s wr, 1.59k op/s 2024-05-08T05:55:05.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 255.0 s, 2662.4 tps, lat 37.712 ms stddev 46.471 2024-05-08T05:55:06.086 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:55:05 smithi082 ceph-mon[30098]: pgmap v592: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 43 MiB/s wr, 1.55k op/s 2024-05-08T05:55:06.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:55:05 smithi134 ceph-mon[34132]: pgmap v592: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 43 MiB/s wr, 1.55k op/s 2024-05-08T05:55:06.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:55:05 smithi151 ceph-mon[34815]: pgmap v592: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 43 MiB/s wr, 1.55k op/s 2024-05-08T05:55:07.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.036+0000 7f2df4c00700 1 -- 172.21.15.82:0/2947753594 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2df0109ad0 msgr2=0x7f2df0109f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:07.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.036+0000 7f2df4c00700 1 --2- 172.21.15.82:0/2947753594 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2df0109ad0 0x7f2df0109f50 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc009990 tx=0x7f2ddc009ca0 comp rx=0 tx=0).stop 2024-05-08T05:55:07.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.036+0000 7f2df4c00700 1 -- 172.21.15.82:0/2947753594 shutdown_connections 2024-05-08T05:55:07.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.036+0000 7f2df4c00700 1 --2- 172.21.15.82:0/2947753594 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2df010a490 0x7f2df01169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:07.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.036+0000 7f2df4c00700 1 --2- 172.21.15.82:0/2947753594 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2df010fb60 0x7f2df010ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:07.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.036+0000 7f2df4c00700 1 --2- 172.21.15.82:0/2947753594 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2df0109ad0 0x7f2df0109f50 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:07.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.036+0000 7f2df4c00700 1 -- 172.21.15.82:0/2947753594 >> 172.21.15.82:0/2947753594 conn(0x7f2df0076c70 msgr2=0x7f2df0079090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:55:07.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.036+0000 7f2df4c00700 1 -- 172.21.15.82:0/2947753594 shutdown_connections 2024-05-08T05:55:07.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.037+0000 7f2df4c00700 1 -- 172.21.15.82:0/2947753594 wait complete. 2024-05-08T05:55:07.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.038+0000 7f2df4c00700 1 Processor -- start 2024-05-08T05:55:07.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.038+0000 7f2df4c00700 1 -- start start 2024-05-08T05:55:07.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.039+0000 7f2df4c00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2df0109ad0 0x7f2df01a01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:07.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.039+0000 7f2df4c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2df010a490 0x7f2df01a0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:07.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.040+0000 7f2df4c00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2df010fb60 0x7f2df01a4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:07.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.040+0000 7f2df4c00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2df0119d20 con 0x7f2df010a490 2024-05-08T05:55:07.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.040+0000 7f2df4c00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2df0119ba0 con 0x7f2df0109ad0 2024-05-08T05:55:07.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.040+0000 7f2df4c00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2df0119ea0 con 0x7f2df010fb60 2024-05-08T05:55:07.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.040+0000 7f2dede00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2df0109ad0 0x7f2df01a01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:07.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.040+0000 7f2dee800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2df010fb60 0x7f2df01a4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:07.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.040+0000 7f2dee800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2df010fb60 0x7f2df01a4aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:57352/0 (socket says 172.21.15.82:57352) 2024-05-08T05:55:07.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.040+0000 7f2dee800700 1 -- 172.21.15.82:0/3987232707 learned_addr learned my addr 172.21.15.82:0/3987232707 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:55:07.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.040+0000 7f2ded400700 1 --2- 172.21.15.82:0/3987232707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2df010a490 0x7f2df01a0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:07.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.041+0000 7f2dee800700 1 -- 172.21.15.82:0/3987232707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2df0109ad0 msgr2=0x7f2df01a01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:07.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.041+0000 7f2dee800700 1 --2- 172.21.15.82:0/3987232707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2df0109ad0 0x7f2df01a01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:07.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.041+0000 7f2dee800700 1 -- 172.21.15.82:0/3987232707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2df010a490 msgr2=0x7f2df01a0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:07.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.041+0000 7f2dee800700 1 --2- 172.21.15.82:0/3987232707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2df010a490 0x7f2df01a0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:07.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.041+0000 7f2dee800700 1 -- 172.21.15.82:0/3987232707 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2df01a51e0 con 0x7f2df010fb60 2024-05-08T05:55:07.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.041+0000 7f2ded400700 1 --2- 172.21.15.82:0/3987232707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2df010a490 0x7f2df01a0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:55:07.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.043+0000 7f2dee800700 1 --2- 172.21.15.82:0/3987232707 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2df010fb60 0x7f2df01a4aa0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2de800ef30 tx=0x7f2de800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:55:07.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.044+0000 7f2de6a00700 1 -- 172.21.15.82:0/3987232707 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de80092e0 con 0x7f2df010fb60 2024-05-08T05:55:07.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.044+0000 7f2de6a00700 1 -- 172.21.15.82:0/3987232707 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2de8004bb0 con 0x7f2df010fb60 2024-05-08T05:55:07.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.044+0000 7f2de6a00700 1 -- 172.21.15.82:0/3987232707 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de8004280 con 0x7f2df010fb60 2024-05-08T05:55:07.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.044+0000 7f2df4c00700 1 -- 172.21.15.82:0/3987232707 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2df01a5470 con 0x7f2df010fb60 2024-05-08T05:55:07.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.044+0000 7f2df4c00700 1 -- 172.21.15.82:0/3987232707 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2df01acd50 con 0x7f2df010fb60 2024-05-08T05:55:07.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.053+0000 7f2dff4fcb80 1 Processor -- start 2024-05-08T05:55:07.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.053+0000 7f2de6a00700 1 -- 172.21.15.82:0/3987232707 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f2de801b030 con 0x7f2df010fb60 2024-05-08T05:55:07.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.053+0000 7f2dff4fcb80 1 -- start start 2024-05-08T05:55:07.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.053+0000 7f2dff4fcb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5642b6dd70e0 0x5642b6dd74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:07.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.053+0000 7f2dff4fcb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5642b6dd7a00 0x5642b6ddb510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:07.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.053+0000 7f2dff4fcb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642b6ddba50 0x5642b6ddbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:07.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.053+0000 7f2dff4fcb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5642b6d29aa0 con 0x5642b6dd7a00 2024-05-08T05:55:07.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.053+0000 7f2dff4fcb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5642b6cc77e0 con 0x5642b6dd70e0 2024-05-08T05:55:07.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.053+0000 7f2dff4fcb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5642b6d25a60 con 0x5642b6ddba50 2024-05-08T05:55:07.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.054+0000 7f2ded400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5642b6dd70e0 0x5642b6dd74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:07.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.054+0000 7f2ded400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5642b6dd70e0 0x5642b6dd74c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:35258/0 (socket says 172.21.15.82:35258) 2024-05-08T05:55:07.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.054+0000 7f2ded400700 1 -- 172.21.15.82:0/4215353229 learned_addr learned my addr 172.21.15.82:0/4215353229 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:55:07.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.054+0000 7f2dede00700 1 --2- 172.21.15.82:0/4215353229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5642b6dd7a00 0x5642b6ddb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:07.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.054+0000 7f2ded400700 1 --2- 172.21.15.82:0/4215353229 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642b6ddba50 0x5642b6ddbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:07.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.055+0000 7f2ded400700 1 -- 172.21.15.82:0/4215353229 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642b6ddba50 msgr2=0x5642b6ddbeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:55:07.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.055+0000 7f2ded400700 1 --2- 172.21.15.82:0/4215353229 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642b6ddba50 0x5642b6ddbeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:07.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.055+0000 7f2ded400700 1 -- 172.21.15.82:0/4215353229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5642b6dd7a00 msgr2=0x5642b6ddb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:55:07.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.055+0000 7f2ded400700 1 --2- 172.21.15.82:0/4215353229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5642b6dd7a00 0x5642b6ddb510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:07.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.055+0000 7f2ded400700 1 -- 172.21.15.82:0/4215353229 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642b6c76950 con 0x5642b6dd70e0 2024-05-08T05:55:07.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.055+0000 7f2dede00700 1 --2- 172.21.15.82:0/4215353229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5642b6dd7a00 0x5642b6ddb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:55:07.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.055+0000 7f2ded400700 1 --2- 172.21.15.82:0/4215353229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5642b6dd70e0 0x5642b6dd74c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc005390 tx=0x7f2ddc005ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66adca931ce7790f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:55:07.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.056+0000 7f2ddb400700 1 -- 172.21.15.82:0/4215353229 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc021070 con 0x5642b6dd70e0 2024-05-08T05:55:07.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.056+0000 7f2ddb400700 1 -- 172.21.15.82:0/4215353229 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ddc01f070 con 0x5642b6dd70e0 2024-05-08T05:55:07.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.056+0000 7f2ddb400700 1 -- 172.21.15.82:0/4215353229 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc003c90 con 0x5642b6dd70e0 2024-05-08T05:55:07.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.057+0000 7f2dff4fcb80 1 -- 172.21.15.82:0/4215353229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5642b6dd70e0 msgr2=0x5642b6dd74c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:07.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.057+0000 7f2dff4fcb80 1 --2- 172.21.15.82:0/4215353229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5642b6dd70e0 0x5642b6dd74c0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc005390 tx=0x7f2ddc005ab0 comp rx=0 tx=0).stop 2024-05-08T05:55:07.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.057+0000 7f2de6a00700 1 --2- 172.21.15.82:0/3987232707 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2dd40b2900 0x7f2dd40b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:07.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.058+0000 7f2de6a00700 1 -- 172.21.15.82:0/3987232707 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2de80e1d10 con 0x7f2df010fb60 2024-05-08T05:55:07.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.058+0000 7f2ded400700 1 --2- 172.21.15.82:0/3987232707 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2dd40b2900 0x7f2dd40b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:07.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.058+0000 7f2dff4fcb80 1 -- 172.21.15.82:0/4215353229 shutdown_connections 2024-05-08T05:55:07.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.058+0000 7f2dff4fcb80 1 --2- 172.21.15.82:0/4215353229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5642b6dd70e0 0x5642b6dd74c0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:07.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.058+0000 7f2dff4fcb80 1 --2- 172.21.15.82:0/4215353229 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642b6ddba50 0x5642b6ddbeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:07.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.058+0000 7f2dff4fcb80 1 --2- 172.21.15.82:0/4215353229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5642b6dd7a00 0x5642b6ddb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:07.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.058+0000 7f2dff4fcb80 1 -- 172.21.15.82:0/4215353229 >> 172.21.15.82:0/4215353229 conn(0x5642b6d05be0 msgr2=0x5642b6dd1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:55:07.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.058+0000 7f2dff4fcb80 1 -- 172.21.15.82:0/4215353229 shutdown_connections 2024-05-08T05:55:07.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.058+0000 7f2dff4fcb80 1 -- 172.21.15.82:0/4215353229 wait complete. 2024-05-08T05:55:07.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.059+0000 7f2dff4fcb80 1 -- start start 2024-05-08T05:55:07.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.059+0000 7f2ded400700 1 --2- 172.21.15.82:0/3987232707 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2dd40b2900 0x7f2dd40b4dc0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc011040 tx=0x7f2ddc005d00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:55:07.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.059+0000 7f2dff4fcb80 1 Processor -- start 2024-05-08T05:55:07.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.060+0000 7f2dff4fcb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5642b6dd70e0 0x5642b6de2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:07.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.060+0000 7f2dff4fcb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5642b6dd7a00 0x5642b6de0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:07.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.061+0000 7f2dff4fcb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642b6ddba50 0x5642b6de0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:07.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.061+0000 7f2dff4fcb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5642b6de3c00 con 0x5642b6dd70e0 2024-05-08T05:55:07.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.061+0000 7f2dff4fcb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5642b6c8fba0 con 0x5642b6dd7a00 2024-05-08T05:55:07.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.061+0000 7f2dff4fcb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5642b6de3d80 con 0x5642b6ddba50 2024-05-08T05:55:07.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.061+0000 7f2dff4fcb80 10 client.0 _ll_register_callbacks cb 0x5642b6cd0cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:55:07.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.061+0000 7f2ded400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5642b6dd7a00 0x5642b6de0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:07.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.061+0000 7f2ded400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5642b6dd7a00 0x5642b6de0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:35262/0 (socket says 172.21.15.82:35262) 2024-05-08T05:55:07.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.061+0000 7f2ded400700 1 -- 172.21.15.82:0/2392481447 learned_addr learned my addr 172.21.15.82:0/2392481447 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:55:07.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.061+0000 7f2dede00700 1 --2- 172.21.15.82:0/2392481447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5642b6dd70e0 0x5642b6de2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:07.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.062+0000 7f2dee800700 1 --2- 172.21.15.82:0/2392481447 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642b6ddba50 0x5642b6de0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:07.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.062+0000 7f2ded400700 1 -- 172.21.15.82:0/2392481447 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642b6ddba50 msgr2=0x5642b6de0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:55:07.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.062+0000 7f2ded400700 1 --2- 172.21.15.82:0/2392481447 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642b6ddba50 0x5642b6de0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:07.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.062+0000 7f2ded400700 1 -- 172.21.15.82:0/2392481447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5642b6dd70e0 msgr2=0x5642b6de2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:55:07.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.062+0000 7f2ded400700 1 --2- 172.21.15.82:0/2392481447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5642b6dd70e0 0x5642b6de2ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:07.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.062+0000 7f2ded400700 1 -- 172.21.15.82:0/2392481447 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642b6cef4a0 con 0x5642b6dd7a00 2024-05-08T05:55:07.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.063+0000 7f2ded400700 1 --2- 172.21.15.82:0/2392481447 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5642b6dd7a00 0x5642b6de0340 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc009990 tx=0x7f2ddc01f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=664617bf6e6b8d02 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:55:07.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.063+0000 7f2dcfe00700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:55:07.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.063+0000 7f2dcfe00700 1 -- 172.21.15.82:0/2392481447 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc039020 con 0x5642b6dd7a00 2024-05-08T05:55:07.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.064+0000 7f2dcfe00700 1 -- 172.21.15.82:0/2392481447 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2ddc028870 con 0x5642b6dd7a00 2024-05-08T05:55:07.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.064+0000 7f2dff4fcb80 1 -- 172.21.15.82:0/2392481447 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ddc01f070 con 0x5642b6dd7a00 2024-05-08T05:55:07.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.064+0000 7f2dcfe00700 1 -- 172.21.15.82:0/2392481447 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f2ddc021040 con 0x5642b6dd7a00 2024-05-08T05:55:07.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.064+0000 7f2dff4fcb80 10 client.25691 fetch_fsmap learned FSMap version 31 2024-05-08T05:55:07.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.064+0000 7f2dff4fcb80 1 -- 172.21.15.82:0/2392481447 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5642b6dee520 con 0x5642b6dd7a00 2024-05-08T05:55:07.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.065+0000 7f2dcfe00700 1 -- 172.21.15.82:0/2392481447 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2ddc01f070 con 0x5642b6dd7a00 2024-05-08T05:55:07.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.065+0000 7f2dcfe00700 1 -- 172.21.15.82:0/2392481447 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f2ddc00faa0 con 0x5642b6dd7a00 2024-05-08T05:55:07.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.065+0000 7f2dff4fcb80 10 client.25691 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:55:07.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.065+0000 7f2dff4fcb80 10 client.25691 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:55:07.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.065+0000 7f2dff4fcb80 20 client.25691 populate_metadata read hostname 'smithi082' 2024-05-08T05:55:07.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.065+0000 7f2dff4fcb80 1 --2- 172.21.15.82:0/2392481447 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5642b6df09f0 0x5642b6df2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:07.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.065+0000 7f2dff4fcb80 4 client.25691 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:55:07.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.065+0000 7f2dff4fcb80 1 -- 172.21.15.82:0/2392481447 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5642b6da4120 con 0x5642b6df09f0 2024-05-08T05:55:07.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.066+0000 7f2dede00700 1 --2- 172.21.15.82:0/2392481447 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5642b6df09f0 0x5642b6df2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:07.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.066+0000 7f2dcfe00700 10 client.25691 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:55:07.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.067+0000 7f2dede00700 1 --2- 172.21.15.82:0/2392481447 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5642b6df09f0 0x5642b6df2de0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a05605725dcb744 server_cookie=c5d82155498b7cff in_seq=0 out_seq=0 2024-05-08T05:55:07.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.068+0000 7f2dcfe00700 1 -- 172.21.15.82:0/2392481447 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5642b6da4120 con 0x5642b6df09f0 2024-05-08T05:55:07.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.068+0000 7f2dcfe00700 10 client.25691 handle_command_reply: tid=0 2024-05-08T05:55:07.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.068+0000 7f2dff4fcb80 1 client.25691 shutdown 2024-05-08T05:55:07.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.068+0000 7f2dff4fcb80 1 -- 172.21.15.82:0/2392481447 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5642b6dd7a00 msgr2=0x5642b6de0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:07.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.068+0000 7f2dff4fcb80 1 --2- 172.21.15.82:0/2392481447 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5642b6dd7a00 0x5642b6de0340 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc009990 tx=0x7f2ddc01f000 comp rx=0 tx=0).stop 2024-05-08T05:55:07.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.068+0000 7f2dff4fcb80 1 -- 172.21.15.82:0/2392481447 shutdown_connections 2024-05-08T05:55:07.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.068+0000 7f2dff4fcb80 1 --2- 172.21.15.82:0/2392481447 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642b6ddba50 0x5642b6de0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:07.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.068+0000 7f2dff4fcb80 1 --2- 172.21.15.82:0/2392481447 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5642b6dd70e0 0x5642b6de2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:07.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.068+0000 7f2dff4fcb80 1 --2- 172.21.15.82:0/2392481447 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5642b6df09f0 0x5642b6df2de0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:07.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.068+0000 7f2dff4fcb80 1 --2- 172.21.15.82:0/2392481447 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5642b6dd7a00 0x5642b6de0340 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:07.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.068+0000 7f2dff4fcb80 1 -- 172.21.15.82:0/2392481447 >> 172.21.15.82:0/2392481447 conn(0x5642b6d05be0 msgr2=0x5642b6dcc330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:55:07.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.068+0000 7f2dcfe00700 0 client.25691 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:55:07.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.069+0000 7f2dff4fcb80 1 -- 172.21.15.82:0/2392481447 shutdown_connections 2024-05-08T05:55:07.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.069+0000 7f2dff4fcb80 1 -- 172.21.15.82:0/2392481447 wait complete. 2024-05-08T05:55:07.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.069+0000 7f2dff4fcb80 20 client.25691 trim_cache size 0 max 16384 2024-05-08T05:55:07.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.103+0000 7f2dff4fcb80 1 Processor -- start 2024-05-08T05:55:07.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.103+0000 7f2dff4fcb80 1 -- start start 2024-05-08T05:55:07.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.104+0000 7f2dff4fcb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5642b6dd70e0 0x5642b6ddaa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:07.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.104+0000 7f2dff4fcb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5642b6dd7a00 0x5642b6ddaf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:07.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.105+0000 7f2dff4fcb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642b6ddba50 0x5642b6df5a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:07.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.105+0000 7f2dff4fcb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2df01b4140 con 0x5642b6dd70e0 2024-05-08T05:55:07.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.105+0000 7f2dff4fcb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2df01b5c80 con 0x5642b6dd7a00 2024-05-08T05:55:07.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.105+0000 7f2dff4fcb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2df01b4810 con 0x5642b6ddba50 2024-05-08T05:55:07.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.105+0000 7f2dee800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642b6ddba50 0x5642b6df5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:07.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.105+0000 7f2dee800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642b6ddba50 0x5642b6df5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:57366/0 (socket says 172.21.15.82:57366) 2024-05-08T05:55:07.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.105+0000 7f2dee800700 1 -- 172.21.15.82:0/155568832 learned_addr learned my addr 172.21.15.82:0/155568832 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:55:07.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.106+0000 7f2dee800700 1 -- 172.21.15.82:0/155568832 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5642b6dd7a00 msgr2=0x5642b6ddaf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:55:07.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.106+0000 7f2dee800700 1 --2- 172.21.15.82:0/155568832 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5642b6dd7a00 0x5642b6ddaf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:07.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.106+0000 7f2dee800700 1 -- 172.21.15.82:0/155568832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5642b6dd70e0 msgr2=0x5642b6ddaa50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T05:55:07.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.106+0000 7f2dede00700 1 --2- 172.21.15.82:0/155568832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5642b6dd70e0 0x5642b6ddaa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:07.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.106+0000 7f2dee800700 1 --2- 172.21.15.82:0/155568832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5642b6dd70e0 0x5642b6ddaa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:07.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.106+0000 7f2dee800700 1 -- 172.21.15.82:0/155568832 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642b6dce470 con 0x5642b6ddba50 2024-05-08T05:55:07.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.106+0000 7f2dee800700 1 --2- 172.21.15.82:0/155568832 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642b6ddba50 0x5642b6df5a30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2de80df820 tx=0x7f2de80a8ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c735e4d2a9af392d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:55:07.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.107+0000 7f2ddaa00700 1 -- 172.21.15.82:0/155568832 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de80a93d0 con 0x5642b6ddba50 2024-05-08T05:55:07.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.107+0000 7f2ddaa00700 1 -- 172.21.15.82:0/155568832 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2de80ad780 con 0x5642b6ddba50 2024-05-08T05:55:07.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.107+0000 7f2ddaa00700 1 -- 172.21.15.82:0/155568832 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de80a93d0 con 0x5642b6ddba50 2024-05-08T05:55:07.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.108+0000 7f2dff4fcb80 1 -- 172.21.15.82:0/155568832 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642b6ddba50 msgr2=0x5642b6df5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:07.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.108+0000 7f2dff4fcb80 1 --2- 172.21.15.82:0/155568832 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642b6ddba50 0x5642b6df5a30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f2de80df820 tx=0x7f2de80a8ee0 comp rx=0 tx=0).stop 2024-05-08T05:55:07.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.108+0000 7f2dff4fcb80 1 -- 172.21.15.82:0/155568832 shutdown_connections 2024-05-08T05:55:07.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.108+0000 7f2dff4fcb80 1 --2- 172.21.15.82:0/155568832 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642b6ddba50 0x5642b6df5a30 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:07.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.108+0000 7f2dff4fcb80 1 --2- 172.21.15.82:0/155568832 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5642b6dd70e0 0x5642b6ddaa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:07.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.108+0000 7f2dff4fcb80 1 --2- 172.21.15.82:0/155568832 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5642b6dd7a00 0x5642b6ddaf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:07.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.108+0000 7f2dff4fcb80 1 -- 172.21.15.82:0/155568832 >> 172.21.15.82:0/155568832 conn(0x5642b6d05be0 msgr2=0x5642b6dda340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:55:07.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.108+0000 7f2dff4fcb80 1 -- 172.21.15.82:0/155568832 shutdown_connections 2024-05-08T05:55:07.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.108+0000 7f2dff4fcb80 1 -- 172.21.15.82:0/155568832 wait complete. 2024-05-08T05:55:07.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.109+0000 7f2dff4fcb80 1 -- start start 2024-05-08T05:55:07.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.109+0000 7f2dff4fcb80 1 Processor -- start 2024-05-08T05:55:07.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.110+0000 7f2dff4fcb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5642b6dd70e0 0x5642b6e663c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:07.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.110+0000 7f2dff4fcb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5642b6dd7a00 0x5642b6e66900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:07.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.110+0000 7f2dff4fcb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642b6ddba50 0x5642b6e607e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:07.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.110+0000 7f2dff4fcb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2df01b55b0 con 0x5642b6dd7a00 2024-05-08T05:55:07.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.110+0000 7f2dff4fcb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2df01b4ee0 con 0x5642b6dd70e0 2024-05-08T05:55:07.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.110+0000 7f2dff4fcb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2df01b2100 con 0x5642b6ddba50 2024-05-08T05:55:07.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.110+0000 7f2dff4fcb80 10 client.0 _ll_register_callbacks cb 0x5642b6cd0cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:55:07.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.111+0000 7f2dede00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5642b6dd70e0 0x5642b6e663c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:07.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.113+0000 7f2dee800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642b6ddba50 0x5642b6e607e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:07.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.113+0000 7f2dee800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642b6ddba50 0x5642b6e607e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:57370/0 (socket says 172.21.15.82:57370) 2024-05-08T05:55:07.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.113+0000 7f2dee800700 1 -- 172.21.15.82:0/122777520 learned_addr learned my addr 172.21.15.82:0/122777520 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:55:07.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.114+0000 7f2dede00700 1 -- 172.21.15.82:0/122777520 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642b6ddba50 msgr2=0x5642b6e607e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:55:07.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.114+0000 7f2dede00700 1 --2- 172.21.15.82:0/122777520 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642b6ddba50 0x5642b6e607e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:07.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.114+0000 7f2dede00700 1 -- 172.21.15.82:0/122777520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5642b6dd7a00 msgr2=0x5642b6e66900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:55:07.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.114+0000 7f2dede00700 1 --2- 172.21.15.82:0/122777520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5642b6dd7a00 0x5642b6e66900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:07.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.114+0000 7f2dede00700 1 -- 172.21.15.82:0/122777520 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642b6de1260 con 0x5642b6dd70e0 2024-05-08T05:55:07.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.114+0000 7f2dee800700 1 --2- 172.21.15.82:0/122777520 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642b6ddba50 0x5642b6e607e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:55:07.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.115+0000 7f2dede00700 1 --2- 172.21.15.82:0/122777520 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5642b6dd70e0 0x5642b6e663c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x5642b6de3d90 tx=0x7f2de0009b10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=659b405150cbbae1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:55:07.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.115+0000 7f2dcfe00700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:55:07.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.115+0000 7f2dcfe00700 1 -- 172.21.15.82:0/122777520 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de001d880 con 0x5642b6dd70e0 2024-05-08T05:55:07.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.115+0000 7f2dcfe00700 1 -- 172.21.15.82:0/122777520 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2de001da20 con 0x5642b6dd70e0 2024-05-08T05:55:07.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.115+0000 7f2dff4fcb80 1 -- 172.21.15.82:0/122777520 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2de80ad780 con 0x5642b6dd70e0 2024-05-08T05:55:07.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.116+0000 7f2dcfe00700 1 -- 172.21.15.82:0/122777520 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f2de0004830 con 0x5642b6dd70e0 2024-05-08T05:55:07.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.116+0000 7f2dff4fcb80 10 client.25694 fetch_fsmap learned FSMap version 31 2024-05-08T05:55:07.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.116+0000 7f2dff4fcb80 1 -- 172.21.15.82:0/122777520 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5642b6e6dab0 con 0x5642b6dd70e0 2024-05-08T05:55:07.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.116+0000 7f2dcfe00700 1 -- 172.21.15.82:0/122777520 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2de80ad780 con 0x5642b6dd70e0 2024-05-08T05:55:07.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.116+0000 7f2dcfe00700 1 -- 172.21.15.82:0/122777520 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f2de0003680 con 0x5642b6dd70e0 2024-05-08T05:55:07.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.116+0000 7f2dff4fcb80 10 client.25694 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:55:07.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.116+0000 7f2dff4fcb80 10 client.25694 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:55:07.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.116+0000 7f2dff4fcb80 20 client.25694 populate_metadata read hostname 'smithi082' 2024-05-08T05:55:07.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.116+0000 7f2dff4fcb80 1 --2- 172.21.15.82:0/122777520 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5642b6e6e1c0 0x5642b6e705e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:07.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.117+0000 7f2dff4fcb80 4 client.25694 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-08T05:55:07.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.117+0000 7f2dff4fcb80 1 -- 172.21.15.82:0/122777520 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5642b6d37480 con 0x5642b6e6e1c0 2024-05-08T05:55:07.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.118+0000 7f2ded400700 1 --2- 172.21.15.82:0/122777520 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5642b6e6e1c0 0x5642b6e705e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:07.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.119+0000 7f2ded400700 1 --2- 172.21.15.82:0/122777520 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5642b6e6e1c0 0x5642b6e705e0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d255cf8f36079493 server_cookie=5770bc757707fac1 in_seq=0 out_seq=0 2024-05-08T05:55:07.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.119+0000 7f2dcfe00700 10 client.25694 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:55:07.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.125+0000 7f2dcfe00700 1 -- 172.21.15.82:0/122777520 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5642b6d37480 con 0x5642b6e6e1c0 2024-05-08T05:55:07.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.125+0000 7f2dcfe00700 10 client.25694 handle_command_reply: tid=0 2024-05-08T05:55:07.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.125+0000 7f2dff4fcb80 1 client.25694 shutdown 2024-05-08T05:55:07.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.125+0000 7f2dff4fcb80 1 -- 172.21.15.82:0/122777520 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5642b6dd70e0 msgr2=0x5642b6e663c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:07.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.125+0000 7f2dff4fcb80 1 --2- 172.21.15.82:0/122777520 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5642b6dd70e0 0x5642b6e663c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x5642b6de3d90 tx=0x7f2de0009b10 comp rx=0 tx=0).stop 2024-05-08T05:55:07.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.125+0000 7f2dff4fcb80 1 -- 172.21.15.82:0/122777520 shutdown_connections 2024-05-08T05:55:07.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.125+0000 7f2dff4fcb80 1 --2- 172.21.15.82:0/122777520 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5642b6e6e1c0 0x5642b6e705e0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:07.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.125+0000 7f2dff4fcb80 1 --2- 172.21.15.82:0/122777520 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5642b6dd70e0 0x5642b6e663c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:07.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.125+0000 7f2dff4fcb80 1 --2- 172.21.15.82:0/122777520 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642b6ddba50 0x5642b6e607e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:07.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.125+0000 7f2dff4fcb80 1 --2- 172.21.15.82:0/122777520 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5642b6dd7a00 0x5642b6e66900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:07.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.125+0000 7f2dff4fcb80 1 -- 172.21.15.82:0/122777520 >> 172.21.15.82:0/122777520 conn(0x5642b6d05be0 msgr2=0x5642b6ddabd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:55:07.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.125+0000 7f2dcfe00700 0 client.25694 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:55:07.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.127+0000 7f2dff4fcb80 1 -- 172.21.15.82:0/122777520 shutdown_connections 2024-05-08T05:55:07.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.127+0000 7f2dff4fcb80 1 -- 172.21.15.82:0/122777520 wait complete. 2024-05-08T05:55:07.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.127+0000 7f2dff4fcb80 20 client.25694 trim_cache size 0 max 16384 2024-05-08T05:55:07.129 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T05:55:07.129 INFO:teuthology.orchestra.run.smithi082.stdout: "return_code": 0, 2024-05-08T05:55:07.129 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_tag": "fb60ec75-700e-4c59-8940-b0150ebc609b", 2024-05-08T05:55:07.129 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": "asynchronous" 2024-05-08T05:55:07.129 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T05:55:07.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.128+0000 7f2df4c00700 1 -- 172.21.15.82:0/3987232707 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2dd40b2900 msgr2=0x7f2dd40b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:07.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.128+0000 7f2df4c00700 1 --2- 172.21.15.82:0/3987232707 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2dd40b2900 0x7f2dd40b4dc0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc011040 tx=0x7f2ddc005d00 comp rx=0 tx=0).stop 2024-05-08T05:55:07.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.129+0000 7f2df4c00700 1 -- 172.21.15.82:0/3987232707 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2df010fb60 msgr2=0x7f2df01a4aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:07.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.129+0000 7f2df4c00700 1 --2- 172.21.15.82:0/3987232707 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2df010fb60 0x7f2df01a4aa0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2de800ef30 tx=0x7f2de800c3a0 comp rx=0 tx=0).stop 2024-05-08T05:55:07.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.132+0000 7f2df4c00700 1 -- 172.21.15.82:0/3987232707 shutdown_connections 2024-05-08T05:55:07.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.132+0000 7f2df4c00700 1 --2- 172.21.15.82:0/3987232707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2df0109ad0 0x7f2df01a01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:07.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.132+0000 7f2df4c00700 1 --2- 172.21.15.82:0/3987232707 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2dd40b2900 0x7f2dd40b4dc0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:07.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.132+0000 7f2df4c00700 1 --2- 172.21.15.82:0/3987232707 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2df010fb60 0x7f2df01a4aa0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:07.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.132+0000 7f2df4c00700 1 --2- 172.21.15.82:0/3987232707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2df010a490 0x7f2df01a0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:07.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.132+0000 7f2df4c00700 1 -- 172.21.15.82:0/3987232707 >> 172.21.15.82:0/3987232707 conn(0x7f2df0076c70 msgr2=0x7f2df00774b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:55:07.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.132+0000 7f2df4c00700 1 -- 172.21.15.82:0/3987232707 shutdown_connections 2024-05-08T05:55:07.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:07.132+0000 7f2df4c00700 1 -- 172.21.15.82:0/3987232707 wait complete. 2024-05-08T05:55:08.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:55:07 smithi134 ceph-mon[34132]: pgmap v593: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 44 MiB/s wr, 1.67k op/s 2024-05-08T05:55:08.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:55:07 smithi134 ceph-mon[34132]: scrub queued for path: / 2024-05-08T05:55:08.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:55:07 smithi134 ceph-mon[34132]: scrub summary: idle+waiting paths [/] 2024-05-08T05:55:08.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:55:07 smithi134 ceph-mon[34132]: scrub summary: active paths [/] 2024-05-08T05:55:08.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:55:07 smithi151 ceph-mon[34815]: pgmap v593: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 44 MiB/s wr, 1.67k op/s 2024-05-08T05:55:08.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:55:07 smithi151 ceph-mon[34815]: scrub queued for path: / 2024-05-08T05:55:08.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:55:07 smithi151 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-05-08T05:55:08.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:55:07 smithi151 ceph-mon[34815]: scrub summary: active paths [/] 2024-05-08T05:55:08.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:55:07 smithi082 ceph-mon[30098]: pgmap v593: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 44 MiB/s wr, 1.67k op/s 2024-05-08T05:55:08.441 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:55:07 smithi082 ceph-mon[30098]: scrub queued for path: / 2024-05-08T05:55:08.442 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:55:07 smithi082 ceph-mon[30098]: scrub summary: idle+waiting paths [/] 2024-05-08T05:55:08.442 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:55:07 smithi082 ceph-mon[30098]: scrub summary: active paths [/] 2024-05-08T05:55:08.506 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-08T05:55:09.174 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:55:09.351 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:55:09 smithi082 ceph-mon[30098]: scrub summary: active paths [/] 2024-05-08T05:55:09.351 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:55:09 smithi082 ceph-mon[30098]: scrub summary: idle+waiting paths [/] 2024-05-08T05:55:09.351 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:55:09 smithi082 ceph-mon[30098]: scrub summary: idle+waiting paths [/] 2024-05-08T05:55:09.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:55:09 smithi151 ceph-mon[34815]: scrub summary: active paths [/] 2024-05-08T05:55:09.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:55:09 smithi151 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-05-08T05:55:09.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:55:09 smithi151 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-05-08T05:55:09.499 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:55:09 smithi134 ceph-mon[34132]: scrub summary: active paths [/] 2024-05-08T05:55:09.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:55:09 smithi134 ceph-mon[34132]: scrub summary: idle+waiting paths [/] 2024-05-08T05:55:09.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:55:09 smithi134 ceph-mon[34132]: scrub summary: idle+waiting paths [/] 2024-05-08T05:55:10.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:55:10 smithi082 ceph-mon[30098]: pgmap v594: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 28 MiB/s wr, 1.19k op/s 2024-05-08T05:55:10.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 260.0 s, 2398.0 tps, lat 41.672 ms stddev 50.437 2024-05-08T05:55:10.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:55:10 smithi151 ceph-mon[34815]: pgmap v594: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 28 MiB/s wr, 1.19k op/s 2024-05-08T05:55:10.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:55:10 smithi134 ceph-mon[34132]: pgmap v594: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 28 MiB/s wr, 1.19k op/s 2024-05-08T05:55:12.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.281+0000 7f7842000700 1 -- 172.21.15.82:0/1625856158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f783c103ee0 msgr2=0x7f783c110370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:12.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.281+0000 7f783a000700 1 -- 172.21.15.82:0/1625856158 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f783400bd70 con 0x7f783c103ee0 2024-05-08T05:55:12.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.281+0000 7f7842000700 1 --2- 172.21.15.82:0/1625856158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f783c103ee0 0x7f783c110370 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f783400b0a0 tx=0x7f783400b3b0 comp rx=0 tx=0).stop 2024-05-08T05:55:12.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.281+0000 7f7842000700 1 -- 172.21.15.82:0/1625856158 shutdown_connections 2024-05-08T05:55:12.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.281+0000 7f7842000700 1 --2- 172.21.15.82:0/1625856158 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f783c109530 0x7f783c109910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:12.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.281+0000 7f7842000700 1 --2- 172.21.15.82:0/1625856158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f783c103ee0 0x7f783c110370 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:12.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.281+0000 7f7842000700 1 --2- 172.21.15.82:0/1625856158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f783c103520 0x7f783c1039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:12.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.281+0000 7f7842000700 1 -- 172.21.15.82:0/1625856158 >> 172.21.15.82:0/1625856158 conn(0x7f783c07a570 msgr2=0x7f783c07a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:55:12.283 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:55:12 smithi082 ceph-mon[30098]: pgmap v595: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 22 MiB/s wr, 1.07k op/s 2024-05-08T05:55:12.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.282+0000 7f7842000700 1 -- 172.21.15.82:0/1625856158 shutdown_connections 2024-05-08T05:55:12.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.282+0000 7f7842000700 1 -- 172.21.15.82:0/1625856158 wait complete. 2024-05-08T05:55:12.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.286+0000 7f7842000700 1 Processor -- start 2024-05-08T05:55:12.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.286+0000 7f7842000700 1 -- start start 2024-05-08T05:55:12.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.287+0000 7f7842000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f783c103520 0x7f783c19f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:12.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.288+0000 7f7842000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f783c103ee0 0x7f783c19faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:12.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.288+0000 7f7842000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f783c109530 0x7f783c199630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:12.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.288+0000 7f783b400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f783c103520 0x7f783c19f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:12.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.288+0000 7f783b400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f783c103520 0x7f783c19f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37688/0 (socket says 172.21.15.82:37688) 2024-05-08T05:55:12.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.289+0000 7f783aa00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f783c103ee0 0x7f783c19faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:12.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.289+0000 7f783aa00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f783c103ee0 0x7f783c19faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:35288/0 (socket says 172.21.15.82:35288) 2024-05-08T05:55:12.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.290+0000 7f783be00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f783c109530 0x7f783c199630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:12.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.290+0000 7f783be00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f783c109530 0x7f783c199630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:57392/0 (socket says 172.21.15.82:57392) 2024-05-08T05:55:12.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.291+0000 7f7842000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f783c113700 con 0x7f783c103520 2024-05-08T05:55:12.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.291+0000 7f7842000700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f783c113580 con 0x7f783c103ee0 2024-05-08T05:55:12.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.291+0000 7f783b400700 1 -- 172.21.15.82:0/4290355902 learned_addr learned my addr 172.21.15.82:0/4290355902 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:55:12.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.291+0000 7f7842000700 1 -- 172.21.15.82:0/4290355902 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f783c113880 con 0x7f783c109530 2024-05-08T05:55:12.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.292+0000 7f783be00700 1 -- 172.21.15.82:0/4290355902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f783c103ee0 msgr2=0x7f783c19faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:12.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.292+0000 7f783be00700 1 --2- 172.21.15.82:0/4290355902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f783c103ee0 0x7f783c19faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:12.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.292+0000 7f783be00700 1 -- 172.21.15.82:0/4290355902 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f783c103520 msgr2=0x7f783c19f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:12.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.292+0000 7f783be00700 1 --2- 172.21.15.82:0/4290355902 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f783c103520 0x7f783c19f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:12.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.292+0000 7f783be00700 1 -- 172.21.15.82:0/4290355902 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f783c199f10 con 0x7f783c109530 2024-05-08T05:55:12.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.293+0000 7f783be00700 1 --2- 172.21.15.82:0/4290355902 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f783c109530 0x7f783c199630 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f783400b070 tx=0x7f7834008a30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:55:12.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.295+0000 7f783b400700 1 --2- 172.21.15.82:0/4290355902 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f783c103520 0x7f783c19f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:55:12.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.295+0000 7f7833e00700 1 -- 172.21.15.82:0/4290355902 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f783401f030 con 0x7f783c109530 2024-05-08T05:55:12.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.297+0000 7f7833e00700 1 -- 172.21.15.82:0/4290355902 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7834005570 con 0x7f783c109530 2024-05-08T05:55:12.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.297+0000 7f7842000700 1 -- 172.21.15.82:0/4290355902 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f783c19a1a0 con 0x7f783c109530 2024-05-08T05:55:12.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.297+0000 7f7842000700 1 -- 172.21.15.82:0/4290355902 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f783c1a6310 con 0x7f783c109530 2024-05-08T05:55:12.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.297+0000 7f7833e00700 1 -- 172.21.15.82:0/4290355902 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f783401b900 con 0x7f783c109530 2024-05-08T05:55:12.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.312+0000 7f7833e00700 1 -- 172.21.15.82:0/4290355902 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f7834022030 con 0x7f783c109530 2024-05-08T05:55:12.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.315+0000 7f784c91bb80 1 Processor -- start 2024-05-08T05:55:12.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.315+0000 7f7833e00700 1 --2- 172.21.15.82:0/4290355902 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f78200b2a00 0x7f78200b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:12.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.315+0000 7f7833e00700 1 -- 172.21.15.82:0/4290355902 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f78340e2dd0 con 0x7f783c109530 2024-05-08T05:55:12.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.316+0000 7f783aa00700 1 --2- 172.21.15.82:0/4290355902 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f78200b2a00 0x7f78200b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:12.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.317+0000 7f784c91bb80 1 -- start start 2024-05-08T05:55:12.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.317+0000 7f784c91bb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564068f6d460 0x564068f6d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:12.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.318+0000 7f784c91bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564068f6dd80 0x564068f5f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:12.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.318+0000 7f784c91bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564068f5f8f0 0x564068f5fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:12.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.318+0000 7f784c91bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x564068eb1a20 con 0x564068f5f8f0 2024-05-08T05:55:12.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.318+0000 7f784c91bb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564068e4f760 con 0x564068f6d460 2024-05-08T05:55:12.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.318+0000 7f784c91bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564068ead9e0 con 0x564068f6dd80 2024-05-08T05:55:12.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.318+0000 7f783be00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564068f5f8f0 0x564068f5fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:12.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.318+0000 7f783be00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564068f5f8f0 0x564068f5fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37702/0 (socket says 172.21.15.82:37702) 2024-05-08T05:55:12.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.318+0000 7f783be00700 1 -- 172.21.15.82:0/1970242127 learned_addr learned my addr 172.21.15.82:0/1970242127 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:55:12.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.319+0000 7f783be00700 1 -- 172.21.15.82:0/1970242127 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564068f6dd80 msgr2=0x564068f5f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:55:12.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.319+0000 7f783be00700 1 --2- 172.21.15.82:0/1970242127 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564068f6dd80 0x564068f5f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:12.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.319+0000 7f783be00700 1 -- 172.21.15.82:0/1970242127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564068f6d460 msgr2=0x564068f6d840 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T05:55:12.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.319+0000 7f783b400700 1 --2- 172.21.15.82:0/1970242127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564068f6d460 0x564068f6d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:12.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.319+0000 7f783be00700 1 --2- 172.21.15.82:0/1970242127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564068f6d460 0x564068f6d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:12.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.320+0000 7f783be00700 1 -- 172.21.15.82:0/1970242127 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564068dfe8d0 con 0x564068f5f8f0 2024-05-08T05:55:12.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.320+0000 7f783b400700 1 --2- 172.21.15.82:0/1970242127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564068f6d460 0x564068f6d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:55:12.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.320+0000 7f783aa00700 1 --2- 172.21.15.82:0/4290355902 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f78200b2a00 0x7f78200b4ec0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f783c19adf0 tx=0x7f782800a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:55:12.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.321+0000 7f783be00700 1 --2- 172.21.15.82:0/1970242127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564068f5f8f0 0x564068f5fd70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7834009fd0 tx=0x7f783400b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4d0a9d66b3c501b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:55:12.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.322+0000 7f7830c00700 1 -- 172.21.15.82:0/1970242127 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78340ae840 con 0x564068f5f8f0 2024-05-08T05:55:12.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.322+0000 7f7830c00700 1 -- 172.21.15.82:0/1970242127 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78340b3260 con 0x564068f5f8f0 2024-05-08T05:55:12.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.322+0000 7f7830c00700 1 -- 172.21.15.82:0/1970242127 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78340b3030 con 0x564068f5f8f0 2024-05-08T05:55:12.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.323+0000 7f784c91bb80 1 -- 172.21.15.82:0/1970242127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564068f5f8f0 msgr2=0x564068f5fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:12.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.323+0000 7f784c91bb80 1 --2- 172.21.15.82:0/1970242127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564068f5f8f0 0x564068f5fd70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7834009fd0 tx=0x7f783400b3b0 comp rx=0 tx=0).stop 2024-05-08T05:55:12.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.323+0000 7f784c91bb80 1 -- 172.21.15.82:0/1970242127 shutdown_connections 2024-05-08T05:55:12.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.323+0000 7f784c91bb80 1 --2- 172.21.15.82:0/1970242127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564068f6d460 0x564068f6d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:12.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.323+0000 7f784c91bb80 1 --2- 172.21.15.82:0/1970242127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564068f5f8f0 0x564068f5fd70 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:12.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.323+0000 7f784c91bb80 1 --2- 172.21.15.82:0/1970242127 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564068f6dd80 0x564068f5f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:12.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.323+0000 7f784c91bb80 1 -- 172.21.15.82:0/1970242127 >> 172.21.15.82:0/1970242127 conn(0x564068ed76d0 msgr2=0x564068f59b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:55:12.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.324+0000 7f784c91bb80 1 -- 172.21.15.82:0/1970242127 shutdown_connections 2024-05-08T05:55:12.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.324+0000 7f784c91bb80 1 -- 172.21.15.82:0/1970242127 wait complete. 2024-05-08T05:55:12.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.325+0000 7f784c91bb80 1 -- start start 2024-05-08T05:55:12.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.325+0000 7f784c91bb80 1 Processor -- start 2024-05-08T05:55:12.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.326+0000 7f784c91bb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564068f5f8f0 0x564068f73b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:12.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.326+0000 7f784c91bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564068f6d460 0x564068f70e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:12.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.326+0000 7f784c91bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564068f6dd80 0x564068f713a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:12.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.327+0000 7f783b400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564068f5f8f0 0x564068f73b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:12.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.327+0000 7f783b400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564068f5f8f0 0x564068f73b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:35308/0 (socket says 172.21.15.82:35308) 2024-05-08T05:55:12.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.327+0000 7f783b400700 1 -- 172.21.15.82:0/1803849214 learned_addr learned my addr 172.21.15.82:0/1803849214 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:55:12.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.327+0000 7f783be00700 1 --2- 172.21.15.82:0/1803849214 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564068f6dd80 0x564068f713a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:12.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.327+0000 7f783aa00700 1 --2- 172.21.15.82:0/1803849214 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564068f6d460 0x564068f70e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:12.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.327+0000 7f784c91bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x564068eb1a20 con 0x564068f6d460 2024-05-08T05:55:12.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.327+0000 7f784c91bb80 1 -- 172.21.15.82:0/1803849214 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564068e17b20 con 0x564068f5f8f0 2024-05-08T05:55:12.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.327+0000 7f784c91bb80 1 -- 172.21.15.82:0/1803849214 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564068f74560 con 0x564068f6dd80 2024-05-08T05:55:12.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.328+0000 7f784c91bb80 10 client.0 _ll_register_callbacks cb 0x564068e58c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:55:12.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.328+0000 7f783b400700 1 -- 172.21.15.82:0/1803849214 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564068f6dd80 msgr2=0x564068f713a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:55:12.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.328+0000 7f783b400700 1 --2- 172.21.15.82:0/1803849214 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564068f6dd80 0x564068f713a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:12.329 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.328+0000 7f783b400700 1 -- 172.21.15.82:0/1803849214 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564068f6d460 msgr2=0x564068f70e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:55:12.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.328+0000 7f783b400700 1 --2- 172.21.15.82:0/1803849214 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564068f6d460 0x564068f70e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:12.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.328+0000 7f783b400700 1 -- 172.21.15.82:0/1803849214 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564068e77420 con 0x564068f5f8f0 2024-05-08T05:55:12.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.328+0000 7f783aa00700 1 --2- 172.21.15.82:0/1803849214 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564068f6d460 0x564068f70e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:55:12.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.329+0000 7f783b400700 1 --2- 172.21.15.82:0/1803849214 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564068f5f8f0 0x564068f73b60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f782c00e810 tx=0x7f782c00eb20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e70356177c11607 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:55:12.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.329+0000 7f7825600700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:55:12.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.329+0000 7f7825600700 1 -- 172.21.15.82:0/1803849214 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f782c009990 con 0x564068f5f8f0 2024-05-08T05:55:12.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.329+0000 7f7825600700 1 -- 172.21.15.82:0/1803849214 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f782c009b30 con 0x564068f5f8f0 2024-05-08T05:55:12.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.329+0000 7f784c91bb80 1 -- 172.21.15.82:0/1803849214 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78340b3260 con 0x564068f5f8f0 2024-05-08T05:55:12.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.329+0000 7f7825600700 1 -- 172.21.15.82:0/1803849214 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f782c009d30 con 0x564068f5f8f0 2024-05-08T05:55:12.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.330+0000 7f784c91bb80 10 client.25700 fetch_fsmap learned FSMap version 31 2024-05-08T05:55:12.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.330+0000 7f784c91bb80 1 -- 172.21.15.82:0/1803849214 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x564068f7ee00 con 0x564068f5f8f0 2024-05-08T05:55:12.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.330+0000 7f7825600700 1 -- 172.21.15.82:0/1803849214 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f78340b3260 con 0x564068f5f8f0 2024-05-08T05:55:12.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.330+0000 7f7825600700 1 -- 172.21.15.82:0/1803849214 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f782c00f520 con 0x564068f5f8f0 2024-05-08T05:55:12.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.331+0000 7f784c91bb80 10 client.25700 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:55:12.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.331+0000 7f784c91bb80 10 client.25700 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:55:12.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.331+0000 7f784c91bb80 20 client.25700 populate_metadata read hostname 'smithi082' 2024-05-08T05:55:12.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.331+0000 7f784c91bb80 1 --2- 172.21.15.82:0/1803849214 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x564068f814e0 0x564068f83950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:12.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.331+0000 7f784c91bb80 4 client.25700 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:55:12.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.331+0000 7f784c91bb80 1 -- 172.21.15.82:0/1803849214 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564068f2c140 con 0x564068f814e0 2024-05-08T05:55:12.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.331+0000 7f783aa00700 1 --2- 172.21.15.82:0/1803849214 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x564068f814e0 0x564068f83950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:12.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.333+0000 7f783aa00700 1 --2- 172.21.15.82:0/1803849214 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x564068f814e0 0x564068f83950 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af65ba7dc1d8e1e1 server_cookie=e8ae91df971f49ea in_seq=0 out_seq=0 2024-05-08T05:55:12.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.333+0000 7f7825600700 10 client.25700 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:55:12.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.333+0000 7f7825600700 1 -- 172.21.15.82:0/1803849214 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564068f2c140 con 0x564068f814e0 2024-05-08T05:55:12.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.333+0000 7f7825600700 10 client.25700 handle_command_reply: tid=0 2024-05-08T05:55:12.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.334+0000 7f784c91bb80 1 client.25700 shutdown 2024-05-08T05:55:12.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.335+0000 7f784c91bb80 1 -- 172.21.15.82:0/1803849214 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564068f5f8f0 msgr2=0x564068f73b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:12.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.335+0000 7f784c91bb80 1 --2- 172.21.15.82:0/1803849214 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564068f5f8f0 0x564068f73b60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f782c00e810 tx=0x7f782c00eb20 comp rx=0 tx=0).stop 2024-05-08T05:55:12.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.335+0000 7f784c91bb80 1 -- 172.21.15.82:0/1803849214 shutdown_connections 2024-05-08T05:55:12.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.335+0000 7f784c91bb80 1 --2- 172.21.15.82:0/1803849214 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x564068f814e0 0x564068f83950 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:12.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.335+0000 7f784c91bb80 1 --2- 172.21.15.82:0/1803849214 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564068f5f8f0 0x564068f73b60 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:12.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.335+0000 7f784c91bb80 1 --2- 172.21.15.82:0/1803849214 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564068f6dd80 0x564068f713a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:12.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.335+0000 7f784c91bb80 1 --2- 172.21.15.82:0/1803849214 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564068f6d460 0x564068f70e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:12.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.335+0000 7f7825600700 0 client.25700 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:55:12.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.335+0000 7f784c91bb80 1 -- 172.21.15.82:0/1803849214 >> 172.21.15.82:0/1803849214 conn(0x564068ed76d0 msgr2=0x564068f598a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:55:12.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.335+0000 7f784c91bb80 1 -- 172.21.15.82:0/1803849214 shutdown_connections 2024-05-08T05:55:12.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.335+0000 7f784c91bb80 1 -- 172.21.15.82:0/1803849214 wait complete. 2024-05-08T05:55:12.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.336+0000 7f784c91bb80 20 client.25700 trim_cache size 0 max 16384 2024-05-08T05:55:12.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.371+0000 7f784c91bb80 1 Processor -- start 2024-05-08T05:55:12.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.371+0000 7f784c91bb80 1 -- start start 2024-05-08T05:55:12.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.372+0000 7f784c91bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564068f5f8f0 0x564068f5f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:12.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.372+0000 7f784c91bb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564068f6d460 0x564068f7d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:12.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.372+0000 7f784c91bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564068f6dd80 0x564068f69ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:12.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.372+0000 7f784c91bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f781c00d320 con 0x564068f5f8f0 2024-05-08T05:55:12.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.372+0000 7f784c91bb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f781c00ee60 con 0x564068f6d460 2024-05-08T05:55:12.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.372+0000 7f784c91bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f781c00d9f0 con 0x564068f6dd80 2024-05-08T05:55:12.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.373+0000 7f783aa00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564068f6d460 0x564068f7d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:12.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.373+0000 7f783aa00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564068f6d460 0x564068f7d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:35324/0 (socket says 172.21.15.82:35324) 2024-05-08T05:55:12.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.373+0000 7f783aa00700 1 -- 172.21.15.82:0/1530851452 learned_addr learned my addr 172.21.15.82:0/1530851452 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:55:12.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.373+0000 7f783b400700 1 --2- 172.21.15.82:0/1530851452 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564068f5f8f0 0x564068f5f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:12.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.373+0000 7f783be00700 1 --2- 172.21.15.82:0/1530851452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564068f6dd80 0x564068f69ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:12.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.374+0000 7f783aa00700 1 -- 172.21.15.82:0/1530851452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564068f6dd80 msgr2=0x564068f69ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:55:12.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.374+0000 7f783aa00700 1 --2- 172.21.15.82:0/1530851452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564068f6dd80 0x564068f69ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:12.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.374+0000 7f783aa00700 1 -- 172.21.15.82:0/1530851452 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564068f5f8f0 msgr2=0x564068f5f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:55:12.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.376+0000 7f783aa00700 1 --2- 172.21.15.82:0/1530851452 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564068f5f8f0 0x564068f5f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:12.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.376+0000 7f783aa00700 1 -- 172.21.15.82:0/1530851452 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564068f7da10 con 0x564068f6d460 2024-05-08T05:55:12.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.377+0000 7f783aa00700 1 --2- 172.21.15.82:0/1530851452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564068f6d460 0x564068f7d4d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f783c19ae80 tx=0x7f7828012000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17bca187e32fa350 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:55:12.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.378+0000 7f7827e00700 1 -- 172.21.15.82:0/1530851452 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7828016070 con 0x564068f6d460 2024-05-08T05:55:12.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.378+0000 7f7827e00700 1 -- 172.21.15.82:0/1530851452 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7828010810 con 0x564068f6d460 2024-05-08T05:55:12.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.378+0000 7f7827e00700 1 -- 172.21.15.82:0/1530851452 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7828005380 con 0x564068f6d460 2024-05-08T05:55:12.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:55:12 smithi151 ceph-mon[34815]: pgmap v595: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 22 MiB/s wr, 1.07k op/s 2024-05-08T05:55:12.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.379+0000 7f784c91bb80 1 -- 172.21.15.82:0/1530851452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564068f6d460 msgr2=0x564068f7d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:12.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.379+0000 7f784c91bb80 1 --2- 172.21.15.82:0/1530851452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564068f6d460 0x564068f7d4d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f783c19ae80 tx=0x7f7828012000 comp rx=0 tx=0).stop 2024-05-08T05:55:12.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.379+0000 7f784c91bb80 1 -- 172.21.15.82:0/1530851452 shutdown_connections 2024-05-08T05:55:12.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.379+0000 7f784c91bb80 1 --2- 172.21.15.82:0/1530851452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564068f6dd80 0x564068f69ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:12.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.379+0000 7f784c91bb80 1 --2- 172.21.15.82:0/1530851452 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564068f5f8f0 0x564068f5f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:12.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.379+0000 7f784c91bb80 1 --2- 172.21.15.82:0/1530851452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564068f6d460 0x564068f7d4d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:12.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.379+0000 7f784c91bb80 1 -- 172.21.15.82:0/1530851452 >> 172.21.15.82:0/1530851452 conn(0x564068ed76d0 msgr2=0x564068f6bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:55:12.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.379+0000 7f784c91bb80 1 -- 172.21.15.82:0/1530851452 shutdown_connections 2024-05-08T05:55:12.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.379+0000 7f784c91bb80 1 -- 172.21.15.82:0/1530851452 wait complete. 2024-05-08T05:55:12.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.380+0000 7f784c91bb80 1 -- start start 2024-05-08T05:55:12.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.381+0000 7f784c91bb80 1 Processor -- start 2024-05-08T05:55:12.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.382+0000 7f784c91bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564068f5f8f0 0x564068f79860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:12.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.382+0000 7f784c91bb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564068f6d460 0x564068f79da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:12.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.383+0000 7f783b400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564068f5f8f0 0x564068f79860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:12.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.383+0000 7f784c91bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564068f6dd80 0x564068f74810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:12.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.383+0000 7f783b400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564068f5f8f0 0x564068f79860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:37742/0 (socket says 172.21.15.82:37742) 2024-05-08T05:55:12.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.383+0000 7f784c91bb80 1 -- 172.21.15.82:0/2812206931 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f781c00e790 con 0x564068f5f8f0 2024-05-08T05:55:12.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.383+0000 7f784c91bb80 1 -- 172.21.15.82:0/2812206931 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f781c00e0c0 con 0x564068f6d460 2024-05-08T05:55:12.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.383+0000 7f784c91bb80 1 -- 172.21.15.82:0/2812206931 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f781c00b2c0 con 0x564068f6dd80 2024-05-08T05:55:12.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.383+0000 7f784c91bb80 10 client.0 _ll_register_callbacks cb 0x564068e58c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:55:12.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.383+0000 7f783b400700 1 -- 172.21.15.82:0/2812206931 learned_addr learned my addr 172.21.15.82:0/2812206931 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:55:12.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.383+0000 7f783be00700 1 --2- 172.21.15.82:0/2812206931 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564068f6dd80 0x564068f74810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:12.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.383+0000 7f783aa00700 1 --2- 172.21.15.82:0/2812206931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564068f6d460 0x564068f79da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:12.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.384+0000 7f783aa00700 1 -- 172.21.15.82:0/2812206931 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564068f6dd80 msgr2=0x564068f74810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:55:12.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.384+0000 7f783aa00700 1 --2- 172.21.15.82:0/2812206931 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564068f6dd80 0x564068f74810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:12.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.384+0000 7f783aa00700 1 -- 172.21.15.82:0/2812206931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564068f5f8f0 msgr2=0x564068f79860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:55:12.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.384+0000 7f783aa00700 1 --2- 172.21.15.82:0/2812206931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564068f5f8f0 0x564068f79860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:12.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.384+0000 7f783aa00700 1 -- 172.21.15.82:0/2812206931 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564068f75010 con 0x564068f6d460 2024-05-08T05:55:12.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.384+0000 7f783be00700 1 --2- 172.21.15.82:0/2812206931 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564068f6dd80 0x564068f74810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:55:12.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.384+0000 7f783b400700 1 --2- 172.21.15.82:0/2812206931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564068f5f8f0 0x564068f79860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:55:12.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.384+0000 7f783aa00700 1 --2- 172.21.15.82:0/2812206931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564068f6d460 0x564068f79da0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7828000c00 tx=0x7f7828010c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a951f85e63cce1b0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:55:12.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.384+0000 7f7825600700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:55:12.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.385+0000 7f7825600700 1 -- 172.21.15.82:0/2812206931 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7828004b60 con 0x564068f6d460 2024-05-08T05:55:12.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.385+0000 7f784c91bb80 1 -- 172.21.15.82:0/2812206931 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7828010810 con 0x564068f6d460 2024-05-08T05:55:12.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.385+0000 7f7825600700 1 -- 172.21.15.82:0/2812206931 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f7828004d00 con 0x564068f6d460 2024-05-08T05:55:12.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.385+0000 7f7825600700 1 -- 172.21.15.82:0/2812206931 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f7828005000 con 0x564068f6d460 2024-05-08T05:55:12.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.386+0000 7f784c91bb80 10 client.25706 fetch_fsmap learned FSMap version 31 2024-05-08T05:55:12.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.386+0000 7f784c91bb80 1 -- 172.21.15.82:0/2812206931 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x564068fec8a0 con 0x564068f6d460 2024-05-08T05:55:12.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.387+0000 7f7825600700 1 -- 172.21.15.82:0/2812206931 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7828010810 con 0x564068f6d460 2024-05-08T05:55:12.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.388+0000 7f7825600700 1 -- 172.21.15.82:0/2812206931 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f78280259d0 con 0x564068f6d460 2024-05-08T05:55:12.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.388+0000 7f784c91bb80 10 client.25706 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:55:12.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.388+0000 7f784c91bb80 10 client.25706 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:55:12.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.388+0000 7f784c91bb80 20 client.25706 populate_metadata read hostname 'smithi082' 2024-05-08T05:55:12.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.388+0000 7f784c91bb80 1 --2- 172.21.15.82:0/2812206931 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x564068fecf00 0x564068fef320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:12.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.388+0000 7f784c91bb80 4 client.25706 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-08T05:55:12.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.388+0000 7f784c91bb80 1 -- 172.21.15.82:0/2812206931 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564068ebf400 con 0x564068fecf00 2024-05-08T05:55:12.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.388+0000 7f783b400700 1 --2- 172.21.15.82:0/2812206931 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x564068fecf00 0x564068fef320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:12.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.389+0000 7f7825600700 10 client.25706 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:55:12.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.389+0000 7f783b400700 1 --2- 172.21.15.82:0/2812206931 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x564068fecf00 0x564068fef320 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df14923282c58f69 server_cookie=6fbce732f6eba89a in_seq=0 out_seq=0 2024-05-08T05:55:12.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.389+0000 7f7825600700 1 -- 172.21.15.82:0/2812206931 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x564068ebf400 con 0x564068fecf00 2024-05-08T05:55:12.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.389+0000 7f7825600700 10 client.25706 handle_command_reply: tid=0 2024-05-08T05:55:12.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.389+0000 7f784c91bb80 1 client.25706 shutdown 2024-05-08T05:55:12.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.390+0000 7f784c91bb80 1 -- 172.21.15.82:0/2812206931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564068f6d460 msgr2=0x564068f79da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:12.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.390+0000 7f784c91bb80 1 --2- 172.21.15.82:0/2812206931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564068f6d460 0x564068f79da0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7828000c00 tx=0x7f7828010c70 comp rx=0 tx=0).stop 2024-05-08T05:55:12.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.390+0000 7f784c91bb80 1 -- 172.21.15.82:0/2812206931 shutdown_connections 2024-05-08T05:55:12.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.390+0000 7f784c91bb80 1 --2- 172.21.15.82:0/2812206931 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564068f6dd80 0x564068f74810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:12.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.390+0000 7f784c91bb80 1 --2- 172.21.15.82:0/2812206931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564068f5f8f0 0x564068f79860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:12.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.390+0000 7f784c91bb80 1 --2- 172.21.15.82:0/2812206931 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x564068fecf00 0x564068fef320 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:12.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.390+0000 7f784c91bb80 1 --2- 172.21.15.82:0/2812206931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564068f6d460 0x564068f79da0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:12.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.390+0000 7f784c91bb80 1 -- 172.21.15.82:0/2812206931 >> 172.21.15.82:0/2812206931 conn(0x564068ed76d0 msgr2=0x564068f6c830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:55:12.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.390+0000 7f7825600700 0 client.25706 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:55:12.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.391+0000 7f784c91bb80 1 -- 172.21.15.82:0/2812206931 shutdown_connections 2024-05-08T05:55:12.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.391+0000 7f784c91bb80 1 -- 172.21.15.82:0/2812206931 wait complete. 2024-05-08T05:55:12.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.391+0000 7f784c91bb80 20 client.25706 trim_cache size 0 max 16384 2024-05-08T05:55:12.393 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T05:55:12.393 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-08T05:55:12.393 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2024-05-08T05:55:12.393 INFO:teuthology.orchestra.run.smithi082.stdout: "fb60ec75-700e-4c59-8940-b0150ebc609b": { 2024-05-08T05:55:12.393 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2024-05-08T05:55:12.393 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "fb60ec75-700e-4c59-8940-b0150ebc609b", 2024-05-08T05:55:12.393 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2024-05-08T05:55:12.393 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T05:55:12.393 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T05:55:12.393 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T05:55:12.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.392+0000 7f7842000700 1 -- 172.21.15.82:0/4290355902 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f78200b2a00 msgr2=0x7f78200b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:12.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.392+0000 7f7842000700 1 --2- 172.21.15.82:0/4290355902 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f78200b2a00 0x7f78200b4ec0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f783c19adf0 tx=0x7f782800a300 comp rx=0 tx=0).stop 2024-05-08T05:55:12.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.392+0000 7f7842000700 1 -- 172.21.15.82:0/4290355902 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f783c109530 msgr2=0x7f783c199630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:12.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.392+0000 7f7842000700 1 --2- 172.21.15.82:0/4290355902 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f783c109530 0x7f783c199630 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f783400b070 tx=0x7f7834008a30 comp rx=0 tx=0).stop 2024-05-08T05:55:12.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.393+0000 7f7842000700 1 -- 172.21.15.82:0/4290355902 shutdown_connections 2024-05-08T05:55:12.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.393+0000 7f7842000700 1 --2- 172.21.15.82:0/4290355902 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f78200b2a00 0x7f78200b4ec0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:12.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.393+0000 7f7842000700 1 --2- 172.21.15.82:0/4290355902 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f783c109530 0x7f783c199630 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:12.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.393+0000 7f7842000700 1 --2- 172.21.15.82:0/4290355902 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f783c103520 0x7f783c19f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:12.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.393+0000 7f7842000700 1 --2- 172.21.15.82:0/4290355902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f783c103ee0 0x7f783c19faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:12.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.393+0000 7f7842000700 1 -- 172.21.15.82:0/4290355902 >> 172.21.15.82:0/4290355902 conn(0x7f783c07a570 msgr2=0x7f783c1070a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:55:12.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.394+0000 7f7842000700 1 -- 172.21.15.82:0/4290355902 shutdown_connections 2024-05-08T05:55:12.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:12.394+0000 7f7842000700 1 -- 172.21.15.82:0/4290355902 wait complete. 2024-05-08T05:55:12.499 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:55:12 smithi134 ceph-mon[34132]: pgmap v595: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 22 MiB/s wr, 1.07k op/s 2024-05-08T05:55:13.255 INFO:tasks.cephfs.filesystem:scrub status for tag:fb60ec75-700e-4c59-8940-b0150ebc609b - {'path': '/', 'tag': 'fb60ec75-700e-4c59-8940-b0150ebc609b', 'options': 'recursive,force'} 2024-05-08T05:55:14.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:55:14 smithi151 ceph-mon[34815]: pgmap v596: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.3 MiB/s wr, 652 op/s 2024-05-08T05:55:14.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:55:14 smithi082 ceph-mon[30098]: pgmap v596: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.3 MiB/s wr, 652 op/s 2024-05-08T05:55:14.499 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:55:14 smithi134 ceph-mon[34132]: pgmap v596: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 9.3 MiB/s wr, 652 op/s 2024-05-08T05:55:15.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 265.0 s, 2263.0 tps, lat 43.863 ms stddev 51.402 2024-05-08T05:55:16.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:55:16 smithi151 ceph-mon[34815]: pgmap v597: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.1 MiB/s wr, 640 op/s 2024-05-08T05:55:16.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:55:16 smithi151 ceph-mon[34815]: scrub summary: idle 2024-05-08T05:55:16.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:55:16 smithi082 ceph-mon[30098]: pgmap v597: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.1 MiB/s wr, 640 op/s 2024-05-08T05:55:16.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:55:16 smithi082 ceph-mon[30098]: scrub summary: idle 2024-05-08T05:55:16.499 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:55:16 smithi134 ceph-mon[34132]: pgmap v597: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.1 MiB/s wr, 640 op/s 2024-05-08T05:55:16.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:55:16 smithi134 ceph-mon[34132]: scrub summary: idle 2024-05-08T05:55:17.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:55:17 smithi151 ceph-mon[34815]: scrub summary: idle 2024-05-08T05:55:17.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:55:17 smithi082 ceph-mon[30098]: scrub summary: idle 2024-05-08T05:55:17.499 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:55:17 smithi134 ceph-mon[34132]: scrub summary: idle 2024-05-08T05:55:18.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:55:18 smithi151 ceph-mon[34815]: pgmap v598: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 MiB/s wr, 760 op/s 2024-05-08T05:55:18.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:55:18 smithi082 ceph-mon[30098]: pgmap v598: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 MiB/s wr, 760 op/s 2024-05-08T05:55:18.499 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:55:18 smithi134 ceph-mon[34132]: pgmap v598: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 MiB/s wr, 760 op/s 2024-05-08T05:55:20.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 270.0 s, 2776.2 tps, lat 36.271 ms stddev 48.314 2024-05-08T05:55:20.301 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:55:20 smithi134 ceph-mon[34132]: pgmap v599: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.2 MiB/s wr, 634 op/s 2024-05-08T05:55:20.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:55:20 smithi151 ceph-mon[34815]: pgmap v599: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.2 MiB/s wr, 634 op/s 2024-05-08T05:55:20.397 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:55:20 smithi082 ceph-mon[30098]: pgmap v599: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.2 MiB/s wr, 634 op/s 2024-05-08T05:55:22.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:55:22 smithi151 ceph-mon[34815]: pgmap v600: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 788 op/s 2024-05-08T05:55:22.472 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:55:22 smithi082 ceph-mon[30098]: pgmap v600: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 788 op/s 2024-05-08T05:55:22.499 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:55:22 smithi134 ceph-mon[34132]: pgmap v600: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 10 MiB/s wr, 788 op/s 2024-05-08T05:55:23.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:55:23 smithi151 ceph-mon[34815]: pgmap v601: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.4 MiB/s wr, 668 op/s 2024-05-08T05:55:23.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:55:23 smithi082 ceph-mon[30098]: pgmap v601: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.4 MiB/s wr, 668 op/s 2024-05-08T05:55:23.499 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:55:23 smithi134 ceph-mon[34132]: pgmap v601: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.4 MiB/s wr, 668 op/s 2024-05-08T05:55:25.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 275.0 s, 2441.2 tps, lat 40.866 ms stddev 45.728 2024-05-08T05:55:25.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:55:25 smithi082 ceph-mon[30098]: pgmap v602: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.3 MiB/s wr, 659 op/s 2024-05-08T05:55:25.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:55:25 smithi134 ceph-mon[34132]: pgmap v602: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.3 MiB/s wr, 659 op/s 2024-05-08T05:55:25.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:55:25 smithi151 ceph-mon[34815]: pgmap v602: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.3 MiB/s wr, 659 op/s 2024-05-08T05:55:27.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:55:27 smithi082 ceph-mon[30098]: pgmap v603: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.8 MiB/s wr, 798 op/s 2024-05-08T05:55:27.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:55:27 smithi134 ceph-mon[34132]: pgmap v603: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.8 MiB/s wr, 798 op/s 2024-05-08T05:55:27.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:55:27 smithi151 ceph-mon[34815]: pgmap v603: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.8 MiB/s wr, 798 op/s 2024-05-08T05:55:29.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:55:29 smithi082 ceph-mon[30098]: pgmap v604: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 8.7 MiB/s wr, 706 op/s 2024-05-08T05:55:29.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:55:29 smithi134 ceph-mon[34132]: pgmap v604: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 8.7 MiB/s wr, 706 op/s 2024-05-08T05:55:29.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:55:29 smithi151 ceph-mon[34815]: pgmap v604: 97 pgs: 97 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 8.7 MiB/s wr, 706 op/s 2024-05-08T05:55:30.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 280.0 s, 2904.6 tps, lat 34.399 ms stddev 41.538 2024-05-08T05:55:30.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:55:30 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:55:30.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:55:30 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:55:30.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:55:30 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:55:30.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:55:30 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:55:30.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:55:30 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:55:30.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:55:30 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:55:30.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:55:30 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:55:30.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:55:30 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:55:30.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:55:30 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:55:30.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:55:30 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:55:30.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:55:30 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:55:30.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:55:30 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:55:30.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:55:30 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:55:30.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:55:30 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:55:30.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:55:30 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T05:55:31.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:55:31 smithi082 ceph-mon[30098]: pgmap v605: 97 pgs: 97 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 11 MiB/s wr, 882 op/s 2024-05-08T05:55:31.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:55:31 smithi082 ceph-mon[30098]: Adjusting osd_memory_target on smithi151 to 176.2M 2024-05-08T05:55:31.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:55:31 smithi082 ceph-mon[30098]: Unable to set osd_memory_target on smithi151 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-05-08T05:55:31.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:55:31 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:55:31.722 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:55:31 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:55:31.722 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:55:31 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:55:31.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:55:31 smithi134 ceph-mon[34132]: pgmap v605: 97 pgs: 97 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 11 MiB/s wr, 882 op/s 2024-05-08T05:55:31.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:55:31 smithi134 ceph-mon[34132]: Adjusting osd_memory_target on smithi151 to 176.2M 2024-05-08T05:55:31.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:55:31 smithi134 ceph-mon[34132]: Unable to set osd_memory_target on smithi151 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-05-08T05:55:31.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:55:31 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:55:31.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:55:31 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:55:31.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:55:31 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:55:31.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:55:31 smithi151 ceph-mon[34815]: pgmap v605: 97 pgs: 97 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 11 MiB/s wr, 882 op/s 2024-05-08T05:55:31.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:55:31 smithi151 ceph-mon[34815]: Adjusting osd_memory_target on smithi151 to 176.2M 2024-05-08T05:55:31.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:55:31 smithi151 ceph-mon[34815]: Unable to set osd_memory_target on smithi151 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-05-08T05:55:31.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:55:31 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:55:31.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:55:31 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:55:31.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:55:31 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:55:33.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:55:33 smithi082 ceph-mon[30098]: pgmap v606: 97 pgs: 97 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 8.4 MiB/s wr, 730 op/s 2024-05-08T05:55:33.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:55:33 smithi134 ceph-mon[34132]: pgmap v606: 97 pgs: 97 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 8.4 MiB/s wr, 730 op/s 2024-05-08T05:55:33.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:55:33 smithi151 ceph-mon[34815]: pgmap v606: 97 pgs: 97 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 8.4 MiB/s wr, 730 op/s 2024-05-08T05:55:35.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 285.0 s, 2600.2 tps, lat 38.477 ms stddev 46.927 2024-05-08T05:55:35.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:55:35 smithi082 ceph-mon[30098]: pgmap v607: 97 pgs: 97 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 8.1 MiB/s wr, 715 op/s 2024-05-08T05:55:35.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:55:35 smithi134 ceph-mon[34132]: pgmap v607: 97 pgs: 97 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 8.1 MiB/s wr, 715 op/s 2024-05-08T05:55:35.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:55:35 smithi151 ceph-mon[34815]: pgmap v607: 97 pgs: 97 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 8.1 MiB/s wr, 715 op/s 2024-05-08T05:55:37.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:55:37 smithi082 ceph-mon[30098]: pgmap v608: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.9 MiB/s wr, 867 op/s 2024-05-08T05:55:37.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:55:37 smithi134 ceph-mon[34132]: pgmap v608: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.9 MiB/s wr, 867 op/s 2024-05-08T05:55:37.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:55:37 smithi151 ceph-mon[34815]: pgmap v608: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 9.9 MiB/s wr, 867 op/s 2024-05-08T05:55:39.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:55:39 smithi082 ceph-mon[30098]: pgmap v609: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.8 MiB/s wr, 724 op/s 2024-05-08T05:55:39.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:55:39 smithi134 ceph-mon[34132]: pgmap v609: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.8 MiB/s wr, 724 op/s 2024-05-08T05:55:39.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:55:39 smithi151 ceph-mon[34815]: pgmap v609: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.8 MiB/s wr, 724 op/s 2024-05-08T05:55:40.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 290.0 s, 2699.0 tps, lat 37.037 ms stddev 44.257 2024-05-08T05:55:41.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:55:41 smithi082 ceph-mon[30098]: pgmap v610: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 9.7 MiB/s wr, 863 op/s 2024-05-08T05:55:41.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:55:41 smithi134 ceph-mon[34132]: pgmap v610: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 9.7 MiB/s wr, 863 op/s 2024-05-08T05:55:41.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:55:41 smithi151 ceph-mon[34815]: pgmap v610: 97 pgs: 97 active+clean; 1.5 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 9.7 MiB/s wr, 863 op/s 2024-05-08T05:55:43.256 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-08T05:55:43.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:55:43 smithi082 ceph-mon[30098]: pgmap v611: 97 pgs: 97 active+clean; 1.6 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 7.5 MiB/s wr, 675 op/s 2024-05-08T05:55:43.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:55:43 smithi134 ceph-mon[34132]: pgmap v611: 97 pgs: 97 active+clean; 1.6 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 7.5 MiB/s wr, 675 op/s 2024-05-08T05:55:43.865 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:55:43.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:55:43 smithi151 ceph-mon[34815]: pgmap v611: 97 pgs: 97 active+clean; 1.6 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 7.5 MiB/s wr, 675 op/s 2024-05-08T05:55:45.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 295.0 s, 2907.6 tps, lat 34.396 ms stddev 39.578 2024-05-08T05:55:45.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:55:45 smithi082 ceph-mon[30098]: pgmap v612: 97 pgs: 97 active+clean; 1.6 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 7.3 MiB/s wr, 642 op/s 2024-05-08T05:55:45.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:55:45 smithi134 ceph-mon[34132]: pgmap v612: 97 pgs: 97 active+clean; 1.6 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 7.3 MiB/s wr, 642 op/s 2024-05-08T05:55:45.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:55:45 smithi151 ceph-mon[34815]: pgmap v612: 97 pgs: 97 active+clean; 1.6 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 7.3 MiB/s wr, 642 op/s 2024-05-08T05:55:46.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.857+0000 7f95fea00700 1 -- 172.21.15.82:0/3895761190 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95f810b6e0 msgr2=0x7f95f810bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:46.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.857+0000 7f95fea00700 1 --2- 172.21.15.82:0/3895761190 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95f810b6e0 0x7f95f810bac0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f95f00098f0 tx=0x7f95f0009c00 comp rx=0 tx=0).stop 2024-05-08T05:55:46.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.858+0000 7f95fea00700 1 -- 172.21.15.82:0/3895761190 shutdown_connections 2024-05-08T05:55:46.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.858+0000 7f95fea00700 1 --2- 172.21.15.82:0/3895761190 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95f81060a0 0x7f95f81125b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:46.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.858+0000 7f95fea00700 1 --2- 172.21.15.82:0/3895761190 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95f810b6e0 0x7f95f810bac0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:46.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.858+0000 7f95fea00700 1 --2- 172.21.15.82:0/3895761190 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95f81056e0 0x7f95f8105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:46.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.858+0000 7f95fea00700 1 -- 172.21.15.82:0/3895761190 >> 172.21.15.82:0/3895761190 conn(0x7f95f81011d0 msgr2=0x7f95f81035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:55:46.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.860+0000 7f95fea00700 1 -- 172.21.15.82:0/3895761190 shutdown_connections 2024-05-08T05:55:46.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.860+0000 7f95fea00700 1 -- 172.21.15.82:0/3895761190 wait complete. 2024-05-08T05:55:46.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.861+0000 7f95fea00700 1 Processor -- start 2024-05-08T05:55:46.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.862+0000 7f95fea00700 1 -- start start 2024-05-08T05:55:46.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.863+0000 7f95fea00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95f81056e0 0x7f95f819bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:46.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.863+0000 7f95fea00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95f81060a0 0x7f95f819c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:46.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.863+0000 7f95fea00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95f810b6e0 0x7f95f81a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:46.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.863+0000 7f95fea00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f95f8115930 con 0x7f95f81060a0 2024-05-08T05:55:46.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.863+0000 7f95fea00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f95f81157b0 con 0x7f95f81056e0 2024-05-08T05:55:46.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.863+0000 7f95fea00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f95f8115ab0 con 0x7f95f810b6e0 2024-05-08T05:55:46.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.863+0000 7f95f7e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95f81056e0 0x7f95f819bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:46.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.863+0000 7f95f7e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95f81056e0 0x7f95f819bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:60180/0 (socket says 172.21.15.82:60180) 2024-05-08T05:55:46.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.863+0000 7f95f7e00700 1 -- 172.21.15.82:0/4194905884 learned_addr learned my addr 172.21.15.82:0/4194905884 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:55:46.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.864+0000 7f95f7400700 1 --2- 172.21.15.82:0/4194905884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95f81060a0 0x7f95f819c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:46.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.864+0000 7f95f7e00700 1 -- 172.21.15.82:0/4194905884 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95f810b6e0 msgr2=0x7f95f81a06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:46.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.864+0000 7f95fca00700 1 --2- 172.21.15.82:0/4194905884 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95f810b6e0 0x7f95f81a06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:46.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.864+0000 7f95f7e00700 1 --2- 172.21.15.82:0/4194905884 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95f810b6e0 0x7f95f81a06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:46.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.864+0000 7f95f7e00700 1 -- 172.21.15.82:0/4194905884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95f81060a0 msgr2=0x7f95f819c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:46.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.864+0000 7f95f7e00700 1 --2- 172.21.15.82:0/4194905884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95f81060a0 0x7f95f819c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:46.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.864+0000 7f95f7e00700 1 -- 172.21.15.82:0/4194905884 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95f81a0df0 con 0x7f95f81056e0 2024-05-08T05:55:46.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.864+0000 7f95fca00700 1 --2- 172.21.15.82:0/4194905884 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95f810b6e0 0x7f95f81a06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:55:46.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.864+0000 7f95f7e00700 1 --2- 172.21.15.82:0/4194905884 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95f81056e0 0x7f95f819bde0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f95f000b840 tx=0x7f95f000b920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:55:46.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.866+0000 7f95f4c00700 1 -- 172.21.15.82:0/4194905884 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f000be40 con 0x7f95f81056e0 2024-05-08T05:55:46.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.866+0000 7f95f4c00700 1 -- 172.21.15.82:0/4194905884 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95f00055c0 con 0x7f95f81056e0 2024-05-08T05:55:46.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.866+0000 7f95f4c00700 1 -- 172.21.15.82:0/4194905884 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f0017400 con 0x7f95f81056e0 2024-05-08T05:55:46.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.866+0000 7f95fea00700 1 -- 172.21.15.82:0/4194905884 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95f81a1080 con 0x7f95f81056e0 2024-05-08T05:55:46.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.866+0000 7f95fea00700 1 -- 172.21.15.82:0/4194905884 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95f81a8960 con 0x7f95f81056e0 2024-05-08T05:55:46.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.873+0000 7f95f4c00700 1 -- 172.21.15.82:0/4194905884 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f95f0003710 con 0x7f95f81056e0 2024-05-08T05:55:46.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.873+0000 7f960940bb80 1 Processor -- start 2024-05-08T05:55:46.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.873+0000 7f960940bb80 1 -- start start 2024-05-08T05:55:46.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.874+0000 7f960940bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55885488b060 0x55885488b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:46.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.875+0000 7f95fca00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55885488b060 0x55885488b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:46.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.875+0000 7f960940bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55885488b980 0x55885488f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:46.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.875+0000 7f960940bb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55885488f9d0 0x55885488fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:46.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.875+0000 7f960940bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5588547dda20 con 0x55885488b980 2024-05-08T05:55:46.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.875+0000 7f960940bb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55885477b760 con 0x55885488f9d0 2024-05-08T05:55:46.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.875+0000 7f960940bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5588547d99e0 con 0x55885488b060 2024-05-08T05:55:46.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.875+0000 7f95fca00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55885488b060 0x55885488b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:51596/0 (socket says 172.21.15.82:51596) 2024-05-08T05:55:46.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.875+0000 7f95fca00700 1 -- 172.21.15.82:0/2281397142 learned_addr learned my addr 172.21.15.82:0/2281397142 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:55:46.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.876+0000 7f95f7e00700 1 --2- 172.21.15.82:0/2281397142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55885488b980 0x55885488f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:46.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.876+0000 7f95f7400700 1 --2- 172.21.15.82:0/2281397142 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55885488f9d0 0x55885488fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:46.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.876+0000 7f95f4c00700 1 --2- 172.21.15.82:0/4194905884 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f95dc0b2a50 0x7f95dc0b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:46.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.877+0000 7f95f4c00700 1 -- 172.21.15.82:0/4194905884 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f95f00e3370 con 0x7f95f81056e0 2024-05-08T05:55:46.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.877+0000 7f95fca00700 1 --2- 172.21.15.82:0/4194905884 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f95dc0b2a50 0x7f95dc0b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:46.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.877+0000 7f95f7400700 1 -- 172.21.15.82:0/2281397142 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55885488b060 msgr2=0x55885488b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:55:46.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.877+0000 7f95f7400700 1 --2- 172.21.15.82:0/2281397142 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55885488b060 0x55885488b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:46.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.877+0000 7f95f7400700 1 -- 172.21.15.82:0/2281397142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55885488b980 msgr2=0x55885488f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:55:46.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.878+0000 7f95f7400700 1 --2- 172.21.15.82:0/2281397142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55885488b980 0x55885488f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:46.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.878+0000 7f95f7400700 1 -- 172.21.15.82:0/2281397142 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55885472a8d0 con 0x55885488f9d0 2024-05-08T05:55:46.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.878+0000 7f95f7e00700 1 --2- 172.21.15.82:0/2281397142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55885488b980 0x55885488f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:55:46.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.878+0000 7f95fca00700 1 --2- 172.21.15.82:0/2281397142 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55885488b060 0x55885488b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:55:46.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.878+0000 7f95f7400700 1 --2- 172.21.15.82:0/2281397142 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55885488f9d0 0x55885488fe30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f95e400bc40 tx=0x7f95e400bf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58ed03677d42543b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:55:46.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.878+0000 7f95ed600700 1 -- 172.21.15.82:0/2281397142 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e4015070 con 0x55885488f9d0 2024-05-08T05:55:46.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.878+0000 7f95ed600700 1 -- 172.21.15.82:0/2281397142 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95e401a460 con 0x55885488f9d0 2024-05-08T05:55:46.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.878+0000 7f95ed600700 1 -- 172.21.15.82:0/2281397142 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e40116a0 con 0x55885488f9d0 2024-05-08T05:55:46.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.879+0000 7f960940bb80 1 -- 172.21.15.82:0/2281397142 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55885488f9d0 msgr2=0x55885488fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:46.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.879+0000 7f960940bb80 1 --2- 172.21.15.82:0/2281397142 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55885488f9d0 0x55885488fe30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f95e400bc40 tx=0x7f95e400bf50 comp rx=0 tx=0).stop 2024-05-08T05:55:46.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.880+0000 7f95fca00700 1 --2- 172.21.15.82:0/4194905884 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f95dc0b2a50 0x7f95dc0b4f10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x5588548876a0 tx=0x7f95e8004b40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:55:46.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.880+0000 7f960940bb80 1 -- 172.21.15.82:0/2281397142 shutdown_connections 2024-05-08T05:55:46.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.880+0000 7f960940bb80 1 --2- 172.21.15.82:0/2281397142 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55885488f9d0 0x55885488fe30 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:46.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.880+0000 7f960940bb80 1 --2- 172.21.15.82:0/2281397142 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55885488b060 0x55885488b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:46.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.880+0000 7f960940bb80 1 --2- 172.21.15.82:0/2281397142 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55885488b980 0x55885488f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:46.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.880+0000 7f960940bb80 1 -- 172.21.15.82:0/2281397142 >> 172.21.15.82:0/2281397142 conn(0x5588547b9b60 msgr2=0x5588548857a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:55:46.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.880+0000 7f960940bb80 1 -- 172.21.15.82:0/2281397142 shutdown_connections 2024-05-08T05:55:46.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.880+0000 7f960940bb80 1 -- 172.21.15.82:0/2281397142 wait complete. 2024-05-08T05:55:46.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.881+0000 7f960940bb80 1 -- start start 2024-05-08T05:55:46.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.881+0000 7f960940bb80 1 Processor -- start 2024-05-08T05:55:46.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.882+0000 7f960940bb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55885488b060 0x55885489f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:46.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.882+0000 7f960940bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55885488b980 0x55885489ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:46.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.882+0000 7f960940bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55885488f9d0 0x55885489cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:46.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.882+0000 7f95f7e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55885488b060 0x55885489f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:46.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.882+0000 7f960940bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5588548a03f0 con 0x55885488f9d0 2024-05-08T05:55:46.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.882+0000 7f960940bb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558854743b20 con 0x55885488b060 2024-05-08T05:55:46.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.882+0000 7f960940bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5588548a0570 con 0x55885488b980 2024-05-08T05:55:46.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.882+0000 7f95f7e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55885488b060 0x55885489f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:60198/0 (socket says 172.21.15.82:60198) 2024-05-08T05:55:46.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.882+0000 7f95f7e00700 1 -- 172.21.15.82:0/2628690555 learned_addr learned my addr 172.21.15.82:0/2628690555 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:55:46.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.882+0000 7f960940bb80 10 client.0 _ll_register_callbacks cb 0x558854784c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:55:46.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.882+0000 7f95f7400700 1 --2- 172.21.15.82:0/2628690555 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55885488b980 0x55885489ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:46.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.882+0000 7f95fca00700 1 --2- 172.21.15.82:0/2628690555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55885488f9d0 0x55885489cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:46.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.883+0000 7f95fca00700 1 -- 172.21.15.82:0/2628690555 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55885488b980 msgr2=0x55885489ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:55:46.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.883+0000 7f95fca00700 1 --2- 172.21.15.82:0/2628690555 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55885488b980 0x55885489ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:46.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.883+0000 7f95fca00700 1 -- 172.21.15.82:0/2628690555 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55885488b060 msgr2=0x55885489f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:55:46.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.883+0000 7f95fca00700 1 --2- 172.21.15.82:0/2628690555 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55885488b060 0x55885489f6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:46.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.883+0000 7f95fca00700 1 -- 172.21.15.82:0/2628690555 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588547a3420 con 0x55885488f9d0 2024-05-08T05:55:46.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.884+0000 7f95f7e00700 1 --2- 172.21.15.82:0/2628690555 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55885488b060 0x55885489f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:55:46.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.884+0000 7f95fca00700 1 --2- 172.21.15.82:0/2628690555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55885488f9d0 0x55885489cf80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f95e800b010 tx=0x7f95e8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9da06eaaa903eba9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:55:46.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.884+0000 7f95e2000700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T05:55:46.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.887+0000 7f95e2000700 1 -- 172.21.15.82:0/2628690555 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e8004bb0 con 0x55885488f9d0 2024-05-08T05:55:46.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.887+0000 7f95e2000700 1 -- 172.21.15.82:0/2628690555 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f95e8004d50 con 0x55885488f9d0 2024-05-08T05:55:46.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.887+0000 7f960940bb80 1 -- 172.21.15.82:0/2628690555 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95e401a460 con 0x55885488f9d0 2024-05-08T05:55:46.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.891+0000 7f95e2000700 1 -- 172.21.15.82:0/2628690555 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f95e8009d70 con 0x55885488f9d0 2024-05-08T05:55:46.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.891+0000 7f960940bb80 10 client.15501 fetch_fsmap learned FSMap version 31 2024-05-08T05:55:46.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.891+0000 7f960940bb80 1 -- 172.21.15.82:0/2628690555 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5588548aad50 con 0x55885488f9d0 2024-05-08T05:55:46.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.892+0000 7f95e2000700 1 -- 172.21.15.82:0/2628690555 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95e401a460 con 0x55885488f9d0 2024-05-08T05:55:46.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.892+0000 7f95e2000700 1 -- 172.21.15.82:0/2628690555 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f95e8025a90 con 0x55885488f9d0 2024-05-08T05:55:46.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.893+0000 7f960940bb80 10 client.15501 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:55:46.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.893+0000 7f960940bb80 10 client.15501 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:55:46.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.893+0000 7f960940bb80 20 client.15501 populate_metadata read hostname 'smithi082' 2024-05-08T05:55:46.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.893+0000 7f960940bb80 1 --2- 172.21.15.82:0/2628690555 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5588548ad390 0x5588548af7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:46.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.893+0000 7f960940bb80 4 client.15501 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:55:46.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.893+0000 7f960940bb80 1 -- 172.21.15.82:0/2628690555 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5588548580a0 con 0x5588548ad390 2024-05-08T05:55:46.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.895+0000 7f95f7e00700 1 --2- 172.21.15.82:0/2628690555 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5588548ad390 0x5588548af7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:46.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.896+0000 7f95f7e00700 1 --2- 172.21.15.82:0/2628690555 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5588548ad390 0x5588548af7c0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7b47e6cb6e1c042 server_cookie=ce2472b1bd3d5fbf in_seq=0 out_seq=0 2024-05-08T05:55:46.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.896+0000 7f95e2000700 10 client.15501 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:55:46.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.897+0000 7f95e2000700 1 -- 172.21.15.82:0/2628690555 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5588548580a0 con 0x5588548ad390 2024-05-08T05:55:46.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.897+0000 7f95e2000700 10 client.15501 handle_command_reply: tid=0 2024-05-08T05:55:46.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.897+0000 7f960940bb80 1 client.15501 shutdown 2024-05-08T05:55:46.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.897+0000 7f960940bb80 1 -- 172.21.15.82:0/2628690555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55885488f9d0 msgr2=0x55885489cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:46.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.897+0000 7f960940bb80 1 --2- 172.21.15.82:0/2628690555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55885488f9d0 0x55885489cf80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f95e800b010 tx=0x7f95e8004ad0 comp rx=0 tx=0).stop 2024-05-08T05:55:46.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.897+0000 7f960940bb80 1 -- 172.21.15.82:0/2628690555 shutdown_connections 2024-05-08T05:55:46.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.897+0000 7f960940bb80 1 --2- 172.21.15.82:0/2628690555 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5588548ad390 0x5588548af7c0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:46.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.897+0000 7f960940bb80 1 --2- 172.21.15.82:0/2628690555 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55885488b060 0x55885489f6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:46.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.897+0000 7f960940bb80 1 --2- 172.21.15.82:0/2628690555 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55885488f9d0 0x55885489cf80 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:46.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.898+0000 7f960940bb80 1 --2- 172.21.15.82:0/2628690555 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55885488b980 0x55885489ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:46.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.898+0000 7f95e2000700 0 client.15501 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:55:46.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.898+0000 7f960940bb80 1 -- 172.21.15.82:0/2628690555 >> 172.21.15.82:0/2628690555 conn(0x5588547b9b60 msgr2=0x5588548802b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:55:46.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.898+0000 7f960940bb80 1 -- 172.21.15.82:0/2628690555 shutdown_connections 2024-05-08T05:55:46.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.898+0000 7f960940bb80 1 -- 172.21.15.82:0/2628690555 wait complete. 2024-05-08T05:55:46.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.899+0000 7f960940bb80 20 client.15501 trim_cache size 0 max 16384 2024-05-08T05:55:46.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.937+0000 7f960940bb80 1 Processor -- start 2024-05-08T05:55:46.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.938+0000 7f960940bb80 1 -- start start 2024-05-08T05:55:46.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.938+0000 7f960940bb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55885488b060 0x55885489f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:46.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.938+0000 7f960940bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55885488b980 0x55885489b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:46.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.938+0000 7f960940bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55885488f9d0 0x55885489b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:46.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.938+0000 7f960940bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f95f81ab900 con 0x55885488b980 2024-05-08T05:55:46.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.938+0000 7f960940bb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f95f81ad440 con 0x55885488b060 2024-05-08T05:55:46.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.938+0000 7f960940bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f95f81abfd0 con 0x55885488f9d0 2024-05-08T05:55:46.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.939+0000 7f95fca00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55885488f9d0 0x55885489b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:46.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.939+0000 7f95fca00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55885488f9d0 0x55885489b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:51612/0 (socket says 172.21.15.82:51612) 2024-05-08T05:55:46.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.939+0000 7f95f7e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55885488b060 0x55885489f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:46.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.939+0000 7f95f7e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55885488b060 0x55885489f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:60204/0 (socket says 172.21.15.82:60204) 2024-05-08T05:55:46.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.939+0000 7f95f7e00700 1 -- 172.21.15.82:0/3210487513 learned_addr learned my addr 172.21.15.82:0/3210487513 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:55:46.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.940+0000 7f95f7e00700 1 -- 172.21.15.82:0/3210487513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55885488f9d0 msgr2=0x55885489b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:55:46.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.940+0000 7f95f7e00700 1 --2- 172.21.15.82:0/3210487513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55885488f9d0 0x55885489b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:46.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.940+0000 7f95f7e00700 1 -- 172.21.15.82:0/3210487513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55885488b980 msgr2=0x55885489b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:55:46.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.940+0000 7f95f7e00700 1 --2- 172.21.15.82:0/3210487513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55885488b980 0x55885489b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:46.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.940+0000 7f95f7e00700 1 -- 172.21.15.82:0/3210487513 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588548914e0 con 0x55885488b060 2024-05-08T05:55:46.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.940+0000 7f95f7e00700 1 --2- 172.21.15.82:0/3210487513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55885488b060 0x55885489f6a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f95f00aa6d0 tx=0x7f95f00e0cf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57f0b5d0189f5eed server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:55:46.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.941+0000 7f95ecc00700 1 -- 172.21.15.82:0/3210487513 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f00a6160 con 0x55885488b060 2024-05-08T05:55:46.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.941+0000 7f95ecc00700 1 -- 172.21.15.82:0/3210487513 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f95f00b30e0 con 0x55885488b060 2024-05-08T05:55:46.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.941+0000 7f95ecc00700 1 -- 172.21.15.82:0/3210487513 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f00a6890 con 0x55885488b060 2024-05-08T05:55:46.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.942+0000 7f960940bb80 1 -- 172.21.15.82:0/3210487513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55885488b060 msgr2=0x55885489f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:46.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.942+0000 7f960940bb80 1 --2- 172.21.15.82:0/3210487513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55885488b060 0x55885489f6a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f95f00aa6d0 tx=0x7f95f00e0cf0 comp rx=0 tx=0).stop 2024-05-08T05:55:46.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.944+0000 7f960940bb80 1 -- 172.21.15.82:0/3210487513 shutdown_connections 2024-05-08T05:55:46.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.944+0000 7f960940bb80 1 --2- 172.21.15.82:0/3210487513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55885488b060 0x55885489f6a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:46.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.944+0000 7f960940bb80 1 --2- 172.21.15.82:0/3210487513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55885488f9d0 0x55885489b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:46.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.944+0000 7f960940bb80 1 --2- 172.21.15.82:0/3210487513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55885488b980 0x55885489b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:46.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.944+0000 7f960940bb80 1 -- 172.21.15.82:0/3210487513 >> 172.21.15.82:0/3210487513 conn(0x5588547b9b60 msgr2=0x558854885650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:55:46.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.944+0000 7f960940bb80 1 -- 172.21.15.82:0/3210487513 shutdown_connections 2024-05-08T05:55:46.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.944+0000 7f960940bb80 1 -- 172.21.15.82:0/3210487513 wait complete. 2024-05-08T05:55:46.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.945+0000 7f960940bb80 1 -- start start 2024-05-08T05:55:46.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.945+0000 7f960940bb80 1 Processor -- start 2024-05-08T05:55:46.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.946+0000 7f960940bb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55885488b060 0x55885489e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:46.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.947+0000 7f960940bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55885488b980 0x55885489e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:46.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.947+0000 7f960940bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55885488f9d0 0x55885489eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:46.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.948+0000 7f960940bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f95f81acd70 con 0x55885488f9d0 2024-05-08T05:55:46.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.948+0000 7f960940bb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f95f81ac6a0 con 0x55885488b060 2024-05-08T05:55:46.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.948+0000 7f960940bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f95f807b870 con 0x55885488b980 2024-05-08T05:55:46.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.948+0000 7f960940bb80 10 client.0 _ll_register_callbacks cb 0x558854784c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:55:46.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.948+0000 7f95f7400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55885488b980 0x55885489e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:46.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.948+0000 7f95f7400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55885488b980 0x55885489e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:51618/0 (socket says 172.21.15.82:51618) 2024-05-08T05:55:46.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.948+0000 7f95f7400700 1 -- 172.21.15.82:0/2951198033 learned_addr learned my addr 172.21.15.82:0/2951198033 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:55:46.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.948+0000 7f95fca00700 1 --2- 172.21.15.82:0/2951198033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55885488f9d0 0x55885489eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:46.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.947+0000 7f95f7e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55885488b060 0x55885489e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:46.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.950+0000 7f95f7400700 1 -- 172.21.15.82:0/2951198033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55885488b060 msgr2=0x55885489e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:55:46.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.950+0000 7f95f7400700 1 --2- 172.21.15.82:0/2951198033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55885488b060 0x55885489e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:46.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.950+0000 7f95f7400700 1 -- 172.21.15.82:0/2951198033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55885488f9d0 msgr2=0x55885489eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:55:46.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.950+0000 7f95f7400700 1 --2- 172.21.15.82:0/2951198033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55885488f9d0 0x55885489eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:46.951 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.950+0000 7f95f7400700 1 -- 172.21.15.82:0/2951198033 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588548a3b60 con 0x55885488b980 2024-05-08T05:55:46.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.950+0000 7f95fca00700 1 --2- 172.21.15.82:0/2951198033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55885488f9d0 0x55885489eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:55:46.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.952+0000 7f95e2000700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:55:46.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.952+0000 7f95f7400700 1 --2- 172.21.15.82:0/2951198033 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55885488b980 0x55885489e580 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f95e400bc40 tx=0x7f95e400fc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3434f4303044205f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:55:46.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.953+0000 7f95e2000700 1 -- 172.21.15.82:0/2951198033 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e4015040 con 0x55885488b980 2024-05-08T05:55:46.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.953+0000 7f95e2000700 1 -- 172.21.15.82:0/2951198033 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f95e4005250 con 0x55885488b980 2024-05-08T05:55:46.953 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.954+0000 7f960940bb80 1 -- 172.21.15.82:0/2951198033 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5588547eb400 con 0x55885488b980 2024-05-08T05:55:46.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.954+0000 7f95e2000700 1 -- 172.21.15.82:0/2951198033 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f95e4015040 con 0x55885488b980 2024-05-08T05:55:46.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.954+0000 7f960940bb80 10 client.25750 fetch_fsmap learned FSMap version 31 2024-05-08T05:55:46.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.954+0000 7f960940bb80 1 -- 172.21.15.82:0/2951198033 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x558854917f70 con 0x55885488b980 2024-05-08T05:55:46.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.955+0000 7f95e2000700 1 -- 172.21.15.82:0/2951198033 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5588547eb400 con 0x55885488b980 2024-05-08T05:55:46.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.955+0000 7f95e2000700 1 -- 172.21.15.82:0/2951198033 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f95e401a460 con 0x55885488b980 2024-05-08T05:55:46.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.955+0000 7f960940bb80 10 client.25750 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:55:46.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.955+0000 7f960940bb80 10 client.25750 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:55:46.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.955+0000 7f960940bb80 20 client.25750 populate_metadata read hostname 'smithi082' 2024-05-08T05:55:46.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.955+0000 7f960940bb80 1 --2- 172.21.15.82:0/2951198033 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x558854918500 0x55885491a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:46.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.955+0000 7f960940bb80 4 client.25750 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-08T05:55:46.955 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.955+0000 7f960940bb80 1 -- 172.21.15.82:0/2951198033 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5588547e54a0 con 0x558854918500 2024-05-08T05:55:46.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.956+0000 7f95f7e00700 1 --2- 172.21.15.82:0/2951198033 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x558854918500 0x55885491a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:46.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.956+0000 7f95e2000700 10 client.25750 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:55:46.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.958+0000 7f95f7e00700 1 --2- 172.21.15.82:0/2951198033 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x558854918500 0x55885491a920 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40ef0f1b99d6b9a7 server_cookie=9944a4976e13830d in_seq=0 out_seq=0 2024-05-08T05:55:46.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.958+0000 7f95e2000700 1 -- 172.21.15.82:0/2951198033 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5588547e54a0 con 0x558854918500 2024-05-08T05:55:46.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.958+0000 7f95e2000700 10 client.25750 handle_command_reply: tid=0 2024-05-08T05:55:46.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.958+0000 7f960940bb80 1 client.25750 shutdown 2024-05-08T05:55:46.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.960+0000 7f960940bb80 1 -- 172.21.15.82:0/2951198033 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55885488b980 msgr2=0x55885489e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:46.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.960+0000 7f960940bb80 1 --2- 172.21.15.82:0/2951198033 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55885488b980 0x55885489e580 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f95e400bc40 tx=0x7f95e400fc20 comp rx=0 tx=0).stop 2024-05-08T05:55:46.963 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.964+0000 7f960940bb80 1 -- 172.21.15.82:0/2951198033 shutdown_connections 2024-05-08T05:55:46.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.964+0000 7f960940bb80 1 --2- 172.21.15.82:0/2951198033 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x558854918500 0x55885491a920 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:46.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.964+0000 7f960940bb80 1 --2- 172.21.15.82:0/2951198033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55885488b060 0x55885489e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:46.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.964+0000 7f960940bb80 1 --2- 172.21.15.82:0/2951198033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55885488f9d0 0x55885489eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:46.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.964+0000 7f960940bb80 1 --2- 172.21.15.82:0/2951198033 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55885488b980 0x55885489e580 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:46.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.964+0000 7f960940bb80 1 -- 172.21.15.82:0/2951198033 >> 172.21.15.82:0/2951198033 conn(0x5588547b9b60 msgr2=0x558854899ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:55:46.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.964+0000 7f95e2000700 0 client.25750 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:55:46.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.964+0000 7f960940bb80 1 -- 172.21.15.82:0/2951198033 shutdown_connections 2024-05-08T05:55:46.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.964+0000 7f960940bb80 1 -- 172.21.15.82:0/2951198033 wait complete. 2024-05-08T05:55:46.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.965+0000 7f960940bb80 20 client.25750 trim_cache size 0 max 16384 2024-05-08T05:55:46.965 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T05:55:46.965 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "no active scrubs running", 2024-05-08T05:55:46.965 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": {} 2024-05-08T05:55:46.965 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T05:55:46.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.966+0000 7f95fea00700 1 -- 172.21.15.82:0/4194905884 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f95dc0b2a50 msgr2=0x7f95dc0b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:46.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.966+0000 7f95fea00700 1 --2- 172.21.15.82:0/4194905884 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f95dc0b2a50 0x7f95dc0b4f10 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x5588548876a0 tx=0x7f95e8004b40 comp rx=0 tx=0).stop 2024-05-08T05:55:46.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.967+0000 7f95fea00700 1 -- 172.21.15.82:0/4194905884 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95f81056e0 msgr2=0x7f95f819bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:46.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.967+0000 7f95fea00700 1 --2- 172.21.15.82:0/4194905884 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95f81056e0 0x7f95f819bde0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f95f000b840 tx=0x7f95f000b920 comp rx=0 tx=0).stop 2024-05-08T05:55:46.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.967+0000 7f95fea00700 1 -- 172.21.15.82:0/4194905884 shutdown_connections 2024-05-08T05:55:46.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.967+0000 7f95fea00700 1 --2- 172.21.15.82:0/4194905884 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95f81056e0 0x7f95f819bde0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:46.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.967+0000 7f95fea00700 1 --2- 172.21.15.82:0/4194905884 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f95dc0b2a50 0x7f95dc0b4f10 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:46.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.967+0000 7f95fea00700 1 --2- 172.21.15.82:0/4194905884 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95f810b6e0 0x7f95f81a06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:46.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.967+0000 7f95fea00700 1 --2- 172.21.15.82:0/4194905884 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f95f81060a0 0x7f95f819c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:46.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.967+0000 7f95fea00700 1 -- 172.21.15.82:0/4194905884 >> 172.21.15.82:0/4194905884 conn(0x7f95f81011d0 msgr2=0x7f95f8101a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:55:46.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.969+0000 7f95fea00700 1 -- 172.21.15.82:0/4194905884 shutdown_connections 2024-05-08T05:55:46.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:46.969+0000 7f95fea00700 1 -- 172.21.15.82:0/4194905884 wait complete. 2024-05-08T05:55:47.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:55:47 smithi082 ceph-mon[30098]: pgmap v613: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 9.1 MiB/s wr, 804 op/s 2024-05-08T05:55:47.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:55:47 smithi134 ceph-mon[34132]: pgmap v613: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 9.1 MiB/s wr, 804 op/s 2024-05-08T05:55:47.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:55:47 smithi151 ceph-mon[34815]: pgmap v613: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 195 KiB/s rd, 9.1 MiB/s wr, 804 op/s 2024-05-08T05:55:48.208 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-08T05:55:48.208 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T05:55:48.836 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:55:49.620 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:55:49 smithi082 ceph-mon[30098]: pgmap v614: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 7.4 MiB/s wr, 670 op/s 2024-05-08T05:55:49.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:55:49 smithi134 ceph-mon[34132]: pgmap v614: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 7.4 MiB/s wr, 670 op/s 2024-05-08T05:55:49.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:55:49 smithi151 ceph-mon[34815]: pgmap v614: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 7.4 MiB/s wr, 670 op/s 2024-05-08T05:55:50.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 300.0 s, 2461.6 tps, lat 40.380 ms stddev 45.563 2024-05-08T05:55:51.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:51.499+0000 7f3a59000700 1 -- 172.21.15.82:0/4025249781 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a54104100 msgr2=0x7f3a54108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:51.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:51.499+0000 7f3a59000700 1 --2- 172.21.15.82:0/4025249781 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a54104100 0x7f3a54108120 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3a40009920 tx=0x7f3a40009c30 comp rx=0 tx=0).stop 2024-05-08T05:55:51.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:51.499+0000 7f3a59000700 1 -- 172.21.15.82:0/4025249781 shutdown_connections 2024-05-08T05:55:51.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:51.499+0000 7f3a59000700 1 --2- 172.21.15.82:0/4025249781 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a54103750 0x7f3a54103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:51.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:51.499+0000 7f3a59000700 1 --2- 172.21.15.82:0/4025249781 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a54108850 0x7f3a541103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:51.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:51.499+0000 7f3a59000700 1 --2- 172.21.15.82:0/4025249781 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a54104100 0x7f3a54108120 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:51.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:51.499+0000 7f3a59000700 1 -- 172.21.15.82:0/4025249781 >> 172.21.15.82:0/4025249781 conn(0x7f3a5407a600 msgr2=0x7f3a5407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:55:51.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:51.499+0000 7f3a59000700 1 -- 172.21.15.82:0/4025249781 shutdown_connections 2024-05-08T05:55:51.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:51.499+0000 7f3a59000700 1 -- 172.21.15.82:0/4025249781 wait complete. 2024-05-08T05:55:51.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:51.500+0000 7f3a59000700 1 Processor -- start 2024-05-08T05:55:51.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:51.500+0000 7f3a59000700 1 -- start start 2024-05-08T05:55:51.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:51.501+0000 7f3a59000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a54103750 0x7f3a540757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:51.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:51.501+0000 7f3a59000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a54104100 0x7f3a54075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:51.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:51.501+0000 7f3a59000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a54108850 0x7f3a54076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:51.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:51.501+0000 7f3a59000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3a54113630 con 0x7f3a54104100 2024-05-08T05:55:51.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:51.501+0000 7f3a59000700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3a541134b0 con 0x7f3a54103750 2024-05-08T05:55:51.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:51.501+0000 7f3a59000700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3a541137b0 con 0x7f3a54108850 2024-05-08T05:55:51.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:51.501+0000 7f3a51e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a54103750 0x7f3a540757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:51.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:51.501+0000 7f3a51e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a54103750 0x7f3a540757a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:60240/0 (socket says 172.21.15.82:60240) 2024-05-08T05:55:51.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:51.501+0000 7f3a51e00700 1 -- 172.21.15.82:0/1333003386 learned_addr learned my addr 172.21.15.82:0/1333003386 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:55:51.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:51.501+0000 7f3a52800700 1 --2- 172.21.15.82:0/1333003386 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a54108850 0x7f3a54076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:51.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:51.501+0000 7f3a51400700 1 --2- 172.21.15.82:0/1333003386 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a54104100 0x7f3a54075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:51.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:51.501+0000 7f3a51e00700 1 -- 172.21.15.82:0/1333003386 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a54108850 msgr2=0x7f3a54076220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:51.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:51.501+0000 7f3a51e00700 1 --2- 172.21.15.82:0/1333003386 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a54108850 0x7f3a54076220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:51.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:51.502+0000 7f3a51e00700 1 -- 172.21.15.82:0/1333003386 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a54104100 msgr2=0x7f3a54075ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:51.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:51.502+0000 7f3a51e00700 1 --2- 172.21.15.82:0/1333003386 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a54104100 0x7f3a54075ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:51.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:51.502+0000 7f3a51e00700 1 -- 172.21.15.82:0/1333003386 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a541a8070 con 0x7f3a54103750 2024-05-08T05:55:51.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:51.502+0000 7f3a51400700 1 --2- 172.21.15.82:0/1333003386 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a54104100 0x7f3a54075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:55:51.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:51.502+0000 7f3a51e00700 1 --2- 172.21.15.82:0/1333003386 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a54103750 0x7f3a540757a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3a4400ec10 tx=0x7f3a4400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:55:51.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:51.503+0000 7f3a4aa00700 1 -- 172.21.15.82:0/1333003386 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a4400cd40 con 0x7f3a54103750 2024-05-08T05:55:51.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:51.503+0000 7f3a4aa00700 1 -- 172.21.15.82:0/1333003386 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3a440044d0 con 0x7f3a54103750 2024-05-08T05:55:51.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:51.503+0000 7f3a4aa00700 1 -- 172.21.15.82:0/1333003386 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a44010690 con 0x7f3a54103750 2024-05-08T05:55:51.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:51.503+0000 7f3a59000700 1 -- 172.21.15.82:0/1333003386 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a541a8360 con 0x7f3a54103750 2024-05-08T05:55:51.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:51.503+0000 7f3a59000700 1 -- 172.21.15.82:0/1333003386 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a541a8850 con 0x7f3a54103750 2024-05-08T05:55:51.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:51.506+0000 7f3a59000700 1 -- 172.21.15.82:0/1333003386 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a5406a190 con 0x7f3a54103750 2024-05-08T05:55:51.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:51.508+0000 7f3a4aa00700 1 -- 172.21.15.82:0/1333003386 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f3a44003e50 con 0x7f3a54103750 2024-05-08T05:55:51.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:51.511+0000 7f3a4aa00700 1 --2- 172.21.15.82:0/1333003386 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3a380b2900 0x7f3a380b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:51.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:51.511+0000 7f3a4aa00700 1 -- 172.21.15.82:0/1333003386 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f3a440e2850 con 0x7f3a54103750 2024-05-08T05:55:51.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:51.512+0000 7f3a51400700 1 --2- 172.21.15.82:0/1333003386 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3a380b2900 0x7f3a380b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:51.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:51.512+0000 7f3a51400700 1 --2- 172.21.15.82:0/1333003386 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3a380b2900 0x7f3a380b4dc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3a40009230 tx=0x7f3a40005b40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:55:51.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:51.515+0000 7f3a4aa00700 1 -- 172.21.15.82:0/1333003386 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f3a4401d060 con 0x7f3a54103750 2024-05-08T05:55:51.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:55:51 smithi082 ceph-mon[30098]: pgmap v615: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 9.2 MiB/s wr, 808 op/s 2024-05-08T05:55:51.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:55:51 smithi134 ceph-mon[34132]: pgmap v615: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 9.2 MiB/s wr, 808 op/s 2024-05-08T05:55:51.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:55:51 smithi151 ceph-mon[34815]: pgmap v615: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 9.2 MiB/s wr, 808 op/s 2024-05-08T05:55:51.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:51.955+0000 7f3a59000700 1 -- 172.21.15.82:0/1333003386 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3a5402e510 con 0x7f3a54103750 2024-05-08T05:55:51.957 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:51.956+0000 7f3a4aa00700 1 -- 172.21.15.82:0/1333003386 <== mon.2 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11948 (secure 0 0 0) 0x7f3a440aa580 con 0x7f3a54103750 2024-05-08T05:55:51.958 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:55:51.958 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14364,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3876883250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3876883250},{"type":"v1","addr":"172.21.15.82:6835","nonce":3876883250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1965070586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1965070586},{"type":"v1","addr":"172.21.15.82:6837","nonce":1965070586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":31,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T05:45:57.654009+0000","modified":"2024-05-08T05:53:20.165672+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24505,"mds_2":24487,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14397":{"gid":14397,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/1890720973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1890720973},{"type":"v1","addr":"172.21.15.82:6839","nonce":1890720973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14409":{"gid":14409,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/2957083305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":2957083305},{"type":"v1","addr":"172.21.15.82:6841","nonce":2957083305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6833/3827691638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3827691638},{"type":"v1","addr":"172.21.15.134:6833","nonce":3827691638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6833/3625067797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3625067797},{"type":"v1","addr":"172.21.15.151:6833","nonce":3625067797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/4074163402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4074163402},{"type":"v1","addr":"172.21.15.134:6835","nonce":4074163402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.134:6837/2212411710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2212411710},{"type":"v1","addr":"172.21.15.134:6837","nonce":2212411710}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":17,"addr":"172.21.15.151:6835/2093655929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2093655929},{"type":"v1","addr":"172.21.15.151:6835","nonce":2093655929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6837/4192404464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":4192404464},{"type":"v1","addr":"172.21.15.151:6837","nonce":4192404464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":14,"addr":"172.21.15.151:6839/2963754236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":2963754236},{"type":"v1","addr":"172.21.15.151:6839","nonce":2963754236}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.134:6839/1145270893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1145270893},{"type":"v1","addr":"172.21.15.134:6839","nonce":1145270893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24505,24506,24487,24475,24467]},"id":1}]} 2024-05-08T05:55:51.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:51.960+0000 7f3a59000700 1 -- 172.21.15.82:0/1333003386 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3a380b2900 msgr2=0x7f3a380b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:51.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:51.960+0000 7f3a59000700 1 --2- 172.21.15.82:0/1333003386 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3a380b2900 0x7f3a380b4dc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3a40009230 tx=0x7f3a40005b40 comp rx=0 tx=0).stop 2024-05-08T05:55:51.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:51.960+0000 7f3a59000700 1 -- 172.21.15.82:0/1333003386 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a54103750 msgr2=0x7f3a540757a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:51.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:51.960+0000 7f3a59000700 1 --2- 172.21.15.82:0/1333003386 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a54103750 0x7f3a540757a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3a4400ec10 tx=0x7f3a4400ef20 comp rx=0 tx=0).stop 2024-05-08T05:55:51.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:51.960+0000 7f3a59000700 1 -- 172.21.15.82:0/1333003386 shutdown_connections 2024-05-08T05:55:51.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:51.960+0000 7f3a59000700 1 --2- 172.21.15.82:0/1333003386 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a54103750 0x7f3a540757a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:51.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:51.960+0000 7f3a59000700 1 --2- 172.21.15.82:0/1333003386 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3a380b2900 0x7f3a380b4dc0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:51.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:51.960+0000 7f3a59000700 1 --2- 172.21.15.82:0/1333003386 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a54108850 0x7f3a54076220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:51.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:51.960+0000 7f3a59000700 1 --2- 172.21.15.82:0/1333003386 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3a54104100 0x7f3a54075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:51.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:51.960+0000 7f3a59000700 1 -- 172.21.15.82:0/1333003386 >> 172.21.15.82:0/1333003386 conn(0x7f3a5407a600 msgr2=0x7f3a54101780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:55:51.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:51.961+0000 7f3a59000700 1 -- 172.21.15.82:0/1333003386 shutdown_connections 2024-05-08T05:55:51.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:51.961+0000 7f3a59000700 1 -- 172.21.15.82:0/1333003386 wait complete. 2024-05-08T05:55:51.964 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 31 2024-05-08T05:55:52.748 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-05-08T05:55:52.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:55:52 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/1333003386' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:55:52.780 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:55:52 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/1333003386' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:55:52.817 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:55:52 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/1333003386' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:55:53.352 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:55:53.824 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:55:53 smithi082 ceph-mon[30098]: pgmap v616: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 7.0 MiB/s wr, 648 op/s 2024-05-08T05:55:53.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:55:53 smithi151 ceph-mon[34815]: pgmap v616: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 7.0 MiB/s wr, 648 op/s 2024-05-08T05:55:53.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:55:53 smithi134 ceph-mon[34132]: pgmap v616: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 7.0 MiB/s wr, 648 op/s 2024-05-08T05:55:55.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 305.0 s, 2461.3 tps, lat 40.892 ms stddev 53.696 2024-05-08T05:55:55.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.747+0000 7f64f5a00700 1 -- 172.21.15.82:0/3083124997 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64f01165f0 msgr2=0x7f64f01189e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:55.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.747+0000 7f64f5a00700 1 --2- 172.21.15.82:0/3083124997 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64f01165f0 0x7f64f01189e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f64e800b0d0 tx=0x7f64e800b3e0 comp rx=0 tx=0).stop 2024-05-08T05:55:55.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.747+0000 7f64f5a00700 1 -- 172.21.15.82:0/3083124997 shutdown_connections 2024-05-08T05:55:55.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.747+0000 7f64f5a00700 1 --2- 172.21.15.82:0/3083124997 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64f010a4a0 0x7f64f010a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:55.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.747+0000 7f64f5a00700 1 --2- 172.21.15.82:0/3083124997 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64f01165f0 0x7f64f01189e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:55.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.747+0000 7f64f5a00700 1 --2- 172.21.15.82:0/3083124997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64f010adc0 0x7f64f01160b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:55.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.747+0000 7f64f5a00700 1 -- 172.21.15.82:0/3083124997 >> 172.21.15.82:0/3083124997 conn(0x7f64f006e480 msgr2=0x7f64f006e890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:55:55.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.747+0000 7f64f5a00700 1 -- 172.21.15.82:0/3083124997 shutdown_connections 2024-05-08T05:55:55.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.747+0000 7f64f5a00700 1 -- 172.21.15.82:0/3083124997 wait complete. 2024-05-08T05:55:55.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.749+0000 7f64f5a00700 1 Processor -- start 2024-05-08T05:55:55.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.750+0000 7f64f5a00700 1 -- start start 2024-05-08T05:55:55.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.750+0000 7f64f5a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64f010a4a0 0x7f64f01a2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:55.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.750+0000 7f64f5a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64f010adc0 0x7f64f01a2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:55.752 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.750+0000 7f64f5a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64f01165f0 0x7f64f01a6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:55.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.750+0000 7f64f5a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f64f011be00 con 0x7f64f01165f0 2024-05-08T05:55:55.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.750+0000 7f64f5a00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f64f011bc80 con 0x7f64f010adc0 2024-05-08T05:55:55.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.750+0000 7f64f5a00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f64f011bf80 con 0x7f64f010a4a0 2024-05-08T05:55:55.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.751+0000 7f64efe00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64f010a4a0 0x7f64f01a2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:55.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.751+0000 7f64efe00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64f010a4a0 0x7f64f01a2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:43324/0 (socket says 172.21.15.82:43324) 2024-05-08T05:55:55.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.751+0000 7f64efe00700 1 -- 172.21.15.82:0/460710864 learned_addr learned my addr 172.21.15.82:0/460710864 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:55:55.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.751+0000 7f64ef400700 1 --2- 172.21.15.82:0/460710864 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64f010adc0 0x7f64f01a2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:55.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.751+0000 7f64f5000700 1 --2- 172.21.15.82:0/460710864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64f01165f0 0x7f64f01a6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:55.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.753+0000 7f64efe00700 1 -- 172.21.15.82:0/460710864 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64f010adc0 msgr2=0x7f64f01a2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:55.754 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.753+0000 7f64efe00700 1 --2- 172.21.15.82:0/460710864 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64f010adc0 0x7f64f01a2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:55.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.753+0000 7f64efe00700 1 -- 172.21.15.82:0/460710864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64f01165f0 msgr2=0x7f64f01a6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:55.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.753+0000 7f64efe00700 1 --2- 172.21.15.82:0/460710864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64f01165f0 0x7f64f01a6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:55.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.753+0000 7f64efe00700 1 -- 172.21.15.82:0/460710864 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64f01a7220 con 0x7f64f010a4a0 2024-05-08T05:55:55.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.755+0000 7f64efe00700 1 --2- 172.21.15.82:0/460710864 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64f010a4a0 0x7f64f01a2210 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f64e000e9c0 tx=0x7f64e000ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:55:55.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.755+0000 7f64ecc00700 1 -- 172.21.15.82:0/460710864 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e000cbd0 con 0x7f64f010a4a0 2024-05-08T05:55:55.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.755+0000 7f64ecc00700 1 -- 172.21.15.82:0/460710864 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64e000cd70 con 0x7f64f010a4a0 2024-05-08T05:55:55.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.755+0000 7f64ecc00700 1 -- 172.21.15.82:0/460710864 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e0005610 con 0x7f64f010a4a0 2024-05-08T05:55:55.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.757+0000 7f64f5a00700 1 -- 172.21.15.82:0/460710864 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64f01a7510 con 0x7f64f010a4a0 2024-05-08T05:55:55.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.758+0000 7f64f5a00700 1 -- 172.21.15.82:0/460710864 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64f01aed90 con 0x7f64f010a4a0 2024-05-08T05:55:55.759 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:55:55 smithi082 ceph-mon[30098]: pgmap v617: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 7.3 MiB/s wr, 674 op/s 2024-05-08T05:55:55.772 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.771+0000 7f6501922b80 1 Processor -- start 2024-05-08T05:55:55.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.773+0000 7f64ecc00700 1 -- 172.21.15.82:0/460710864 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f64e0004750 con 0x7f64f010a4a0 2024-05-08T05:55:55.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.775+0000 7f64ecc00700 1 --2- 172.21.15.82:0/460710864 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f64d40b2980 0x7f64d40b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:55.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.776+0000 7f64ecc00700 1 -- 172.21.15.82:0/460710864 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f64e00e2590 con 0x7f64f010a4a0 2024-05-08T05:55:55.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.776+0000 7f64f5000700 1 --2- 172.21.15.82:0/460710864 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f64d40b2980 0x7f64d40b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:55.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.778+0000 7f64f5000700 1 --2- 172.21.15.82:0/460710864 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f64d40b2980 0x7f64d40b4e40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f64e8009e60 tx=0x7f64e80096c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:55:55.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.780+0000 7f6501922b80 1 -- start start 2024-05-08T05:55:55.781 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.780+0000 7f6501922b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559dd6695dd0 0x559dd66961b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:55.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.781+0000 7f64efe00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559dd6695dd0 0x559dd66961b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:55.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.781+0000 7f64efe00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559dd6695dd0 0x559dd66961b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:43340/0 (socket says 172.21.15.82:43340) 2024-05-08T05:55:55.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.781+0000 7f6501922b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559dd66966f0 0x559dd66903f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:55.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.781+0000 7f64efe00700 1 -- 172.21.15.82:0/3904671106 learned_addr learned my addr 172.21.15.82:0/3904671106 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:55:55.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.781+0000 7f6501922b80 1 --2- 172.21.15.82:0/3904671106 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559dd6690a10 0x559dd6690e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:55.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.781+0000 7f6501922b80 1 -- 172.21.15.82:0/3904671106 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x559dd65dea20 con 0x559dd66966f0 2024-05-08T05:55:55.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.782+0000 7f6501922b80 1 -- 172.21.15.82:0/3904671106 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x559dd657c760 con 0x559dd6690a10 2024-05-08T05:55:55.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.782+0000 7f6501922b80 1 -- 172.21.15.82:0/3904671106 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x559dd65da9e0 con 0x559dd6695dd0 2024-05-08T05:55:55.783 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.782+0000 7f64f5000700 1 --2- 172.21.15.82:0/3904671106 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559dd6690a10 0x559dd6690e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:55.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.783+0000 7f64efe00700 1 -- 172.21.15.82:0/3904671106 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559dd6690a10 msgr2=0x559dd6690e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:55:55.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.783+0000 7f64efe00700 1 --2- 172.21.15.82:0/3904671106 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559dd6690a10 0x559dd6690e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:55.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.783+0000 7f64efe00700 1 -- 172.21.15.82:0/3904671106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559dd66966f0 msgr2=0x559dd66903f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:55:55.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.783+0000 7f64ef400700 1 --2- 172.21.15.82:0/3904671106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559dd66966f0 0x559dd66903f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:55.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.783+0000 7f64efe00700 1 --2- 172.21.15.82:0/3904671106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559dd66966f0 0x559dd66903f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:55.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.783+0000 7f64efe00700 1 -- 172.21.15.82:0/3904671106 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559dd652b8d0 con 0x559dd6695dd0 2024-05-08T05:55:55.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.783+0000 7f64f5000700 1 --2- 172.21.15.82:0/3904671106 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559dd6690a10 0x559dd6690e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:55:55.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.783+0000 7f64ef400700 1 --2- 172.21.15.82:0/3904671106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559dd66966f0 0x559dd66903f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:55:55.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.784+0000 7f64efe00700 1 --2- 172.21.15.82:0/3904671106 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559dd6695dd0 0x559dd66961b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f64e00a9af0 tx=0x7f64e00a9580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ab81b3daf2a600c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:55:55.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.784+0000 7f64e5600700 1 -- 172.21.15.82:0/3904671106 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e00c3070 con 0x559dd6695dd0 2024-05-08T05:55:55.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.784+0000 7f64e5600700 1 -- 172.21.15.82:0/3904671106 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64e00b2310 con 0x559dd6695dd0 2024-05-08T05:55:55.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.784+0000 7f64e5600700 1 -- 172.21.15.82:0/3904671106 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e00b2790 con 0x559dd6695dd0 2024-05-08T05:55:55.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.785+0000 7f6501922b80 1 -- 172.21.15.82:0/3904671106 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559dd6695dd0 msgr2=0x559dd66961b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:55.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.785+0000 7f6501922b80 1 --2- 172.21.15.82:0/3904671106 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559dd6695dd0 0x559dd66961b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f64e00a9af0 tx=0x7f64e00a9580 comp rx=0 tx=0).stop 2024-05-08T05:55:55.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.786+0000 7f6501922b80 1 -- 172.21.15.82:0/3904671106 shutdown_connections 2024-05-08T05:55:55.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.786+0000 7f6501922b80 1 --2- 172.21.15.82:0/3904671106 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559dd6690a10 0x559dd6690e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:55.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.786+0000 7f6501922b80 1 --2- 172.21.15.82:0/3904671106 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559dd6695dd0 0x559dd66961b0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:55.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.787+0000 7f6501922b80 1 --2- 172.21.15.82:0/3904671106 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559dd66966f0 0x559dd66903f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:55.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.787+0000 7f6501922b80 1 -- 172.21.15.82:0/3904671106 >> 172.21.15.82:0/3904671106 conn(0x559dd65bab60 msgr2=0x559dd66869b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:55:55.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.787+0000 7f6501922b80 1 -- 172.21.15.82:0/3904671106 shutdown_connections 2024-05-08T05:55:55.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.787+0000 7f6501922b80 1 -- 172.21.15.82:0/3904671106 wait complete. 2024-05-08T05:55:55.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.788+0000 7f6501922b80 1 -- start start 2024-05-08T05:55:55.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.791+0000 7f6501922b80 1 Processor -- start 2024-05-08T05:55:55.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.792+0000 7f6501922b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559dd6690a10 0x559dd669c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:55.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.792+0000 7f6501922b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559dd6695dd0 0x559dd6699760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:55.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.792+0000 7f6501922b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559dd66966f0 0x559dd6699ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:55.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.793+0000 7f64ef400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559dd6695dd0 0x559dd6699760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:55.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.793+0000 7f64ef400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559dd6695dd0 0x559dd6699760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:43356/0 (socket says 172.21.15.82:43356) 2024-05-08T05:55:55.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.793+0000 7f6501922b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x559dd669d1f0 con 0x559dd66966f0 2024-05-08T05:55:55.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.793+0000 7f6501922b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x559dd6544b20 con 0x559dd6690a10 2024-05-08T05:55:55.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.793+0000 7f6501922b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x559dd669d370 con 0x559dd6695dd0 2024-05-08T05:55:55.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.793+0000 7f6501922b80 10 client.0 _ll_register_callbacks cb 0x559dd6585c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:55:55.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.793+0000 7f64efe00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559dd6690a10 0x559dd669c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:55.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.793+0000 7f64efe00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559dd6690a10 0x559dd669c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:50062/0 (socket says 172.21.15.82:50062) 2024-05-08T05:55:55.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.793+0000 7f64efe00700 1 -- 172.21.15.82:0/2201345952 learned_addr learned my addr 172.21.15.82:0/2201345952 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:55:55.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.794+0000 7f64f5000700 1 --2- 172.21.15.82:0/2201345952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559dd66966f0 0x559dd6699ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:55.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.794+0000 7f64efe00700 1 -- 172.21.15.82:0/2201345952 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559dd6695dd0 msgr2=0x559dd6699760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:55:55.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.794+0000 7f64efe00700 1 --2- 172.21.15.82:0/2201345952 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559dd6695dd0 0x559dd6699760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:55.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.794+0000 7f64efe00700 1 -- 172.21.15.82:0/2201345952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559dd66966f0 msgr2=0x559dd6699ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:55:55.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.794+0000 7f64efe00700 1 --2- 172.21.15.82:0/2201345952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559dd66966f0 0x559dd6699ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:55.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.794+0000 7f64efe00700 1 -- 172.21.15.82:0/2201345952 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559dd65a4420 con 0x559dd6690a10 2024-05-08T05:55:55.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.794+0000 7f64ef400700 1 --2- 172.21.15.82:0/2201345952 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559dd6695dd0 0x559dd6699760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:55:55.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.794+0000 7f64efe00700 1 --2- 172.21.15.82:0/2201345952 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559dd6690a10 0x559dd669c3c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f64e0009880 tx=0x7f64e00b2810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=336c0fbba94a36be server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:55:55.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.795+0000 7f64da000700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:55:55.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.795+0000 7f64da000700 1 -- 172.21.15.82:0/2201345952 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e00ca070 con 0x559dd6690a10 2024-05-08T05:55:55.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.795+0000 7f64da000700 1 -- 172.21.15.82:0/2201345952 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f64e00e22c0 con 0x559dd6690a10 2024-05-08T05:55:55.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.795+0000 7f6501922b80 1 -- 172.21.15.82:0/2201345952 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f64e00b2310 con 0x559dd6690a10 2024-05-08T05:55:55.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.795+0000 7f64da000700 1 -- 172.21.15.82:0/2201345952 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f64e00c3070 con 0x559dd6690a10 2024-05-08T05:55:55.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.796+0000 7f6501922b80 10 client.25739 fetch_fsmap learned FSMap version 31 2024-05-08T05:55:55.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.796+0000 7f6501922b80 1 -- 172.21.15.82:0/2201345952 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x559dd66abd50 con 0x559dd6690a10 2024-05-08T05:55:55.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.796+0000 7f64da000700 1 -- 172.21.15.82:0/2201345952 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64e00b2310 con 0x559dd6690a10 2024-05-08T05:55:55.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.796+0000 7f64da000700 1 -- 172.21.15.82:0/2201345952 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f64e0004a40 con 0x559dd6690a10 2024-05-08T05:55:55.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.796+0000 7f6501922b80 10 client.25739 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:55:55.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.796+0000 7f6501922b80 10 client.25739 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-05-08T05:55:55.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.797+0000 7f6501922b80 20 client.25739 populate_metadata read hostname 'smithi082' 2024-05-08T05:55:55.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.797+0000 7f6501922b80 1 --2- 172.21.15.82:0/2201345952 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x559dd66ae220 0x559dd66b0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:55.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.797+0000 7f6501922b80 4 client.25739 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:55:55.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.797+0000 7f6501922b80 1 -- 172.21.15.82:0/2201345952 --> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559dd66590a0 con 0x559dd66ae220 2024-05-08T05:55:55.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.797+0000 7f64ef400700 1 --2- 172.21.15.82:0/2201345952 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x559dd66ae220 0x559dd66b0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:55.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.801+0000 7f64da000700 10 client.25739 ms_handle_connect on v2:172.21.15.134:6836/2212411710 2024-05-08T05:55:55.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.802+0000 7f64ef400700 1 --2- 172.21.15.82:0/2201345952 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x559dd66ae220 0x559dd66b0610 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=598fee138a702e9a server_cookie=b1cc6987ff19dce1 in_seq=0 out_seq=0 2024-05-08T05:55:55.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.803+0000 7f64da000700 1 -- 172.21.15.82:0/2201345952 <== mds.4 v2:172.21.15.134:6836/2212411710 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x559dd66590a0 con 0x559dd66ae220 2024-05-08T05:55:55.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.803+0000 7f64da000700 10 client.25739 handle_command_reply: tid=0 2024-05-08T05:55:55.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.803+0000 7f6501922b80 1 client.25739 shutdown 2024-05-08T05:55:55.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.804+0000 7f6501922b80 1 -- 172.21.15.82:0/2201345952 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559dd6690a10 msgr2=0x559dd669c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:55.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.804+0000 7f6501922b80 1 --2- 172.21.15.82:0/2201345952 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559dd6690a10 0x559dd669c3c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f64e0009880 tx=0x7f64e00b2810 comp rx=0 tx=0).stop 2024-05-08T05:55:55.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.805+0000 7f6501922b80 1 -- 172.21.15.82:0/2201345952 shutdown_connections 2024-05-08T05:55:55.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.805+0000 7f6501922b80 1 --2- 172.21.15.82:0/2201345952 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x559dd66ae220 0x559dd66b0610 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:55.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.805+0000 7f6501922b80 1 --2- 172.21.15.82:0/2201345952 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559dd6690a10 0x559dd669c3c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:55.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.805+0000 7f6501922b80 1 --2- 172.21.15.82:0/2201345952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559dd66966f0 0x559dd6699ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:55.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.805+0000 7f6501922b80 1 --2- 172.21.15.82:0/2201345952 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559dd6695dd0 0x559dd6699760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:55.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.805+0000 7f6501922b80 1 -- 172.21.15.82:0/2201345952 >> 172.21.15.82:0/2201345952 conn(0x559dd65bab60 msgr2=0x559dd6681460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:55:55.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.805+0000 7f64da000700 0 client.25739 ms_handle_reset on v2:172.21.15.134:6836/2212411710 2024-05-08T05:55:55.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.805+0000 7f6501922b80 1 -- 172.21.15.82:0/2201345952 shutdown_connections 2024-05-08T05:55:55.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.805+0000 7f6501922b80 1 -- 172.21.15.82:0/2201345952 wait complete. 2024-05-08T05:55:55.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.805+0000 7f6501922b80 20 client.25739 trim_cache size 0 max 16384 2024-05-08T05:55:55.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.833+0000 7f6501922b80 1 Processor -- start 2024-05-08T05:55:55.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.833+0000 7f6501922b80 1 -- start start 2024-05-08T05:55:55.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.833+0000 7f6501922b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559dd6690a10 0x559dd6699720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:55.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.833+0000 7f6501922b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559dd6695dd0 0x559dd6699c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:55.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.834+0000 7f6501922b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559dd66966f0 0x559dd6696ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:55.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.834+0000 7f6501922b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f64f01b40d0 con 0x559dd6695dd0 2024-05-08T05:55:55.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.834+0000 7f6501922b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f64f01b5c10 con 0x559dd66966f0 2024-05-08T05:55:55.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.834+0000 7f6501922b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f64f01b47a0 con 0x559dd6690a10 2024-05-08T05:55:55.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.834+0000 7f64efe00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559dd6690a10 0x559dd6699720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:55.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.834+0000 7f64efe00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559dd6690a10 0x559dd6699720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:43372/0 (socket says 172.21.15.82:43372) 2024-05-08T05:55:55.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.834+0000 7f64efe00700 1 -- 172.21.15.82:0/1600342695 learned_addr learned my addr 172.21.15.82:0/1600342695 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:55:55.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.834+0000 7f64ef400700 1 --2- 172.21.15.82:0/1600342695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559dd6695dd0 0x559dd6699c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:55.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.834+0000 7f64f5000700 1 --2- 172.21.15.82:0/1600342695 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559dd66966f0 0x559dd6696ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:55.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.835+0000 7f64efe00700 1 -- 172.21.15.82:0/1600342695 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559dd66966f0 msgr2=0x559dd6696ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:55:55.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.835+0000 7f64efe00700 1 --2- 172.21.15.82:0/1600342695 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559dd66966f0 0x559dd6696ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:55.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.835+0000 7f64efe00700 1 -- 172.21.15.82:0/1600342695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559dd6695dd0 msgr2=0x559dd6699c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:55:55.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.835+0000 7f64efe00700 1 --2- 172.21.15.82:0/1600342695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559dd6695dd0 0x559dd6699c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:55.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.835+0000 7f64efe00700 1 -- 172.21.15.82:0/1600342695 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559dd6686760 con 0x559dd6690a10 2024-05-08T05:55:55.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.835+0000 7f64efe00700 1 --2- 172.21.15.82:0/1600342695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559dd6690a10 0x559dd6699720 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f64e00a5be0 tx=0x7f64e0005000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=398034a8ba027222 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:55:55.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.835+0000 7f64e4c00700 1 -- 172.21.15.82:0/1600342695 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e00ca040 con 0x559dd6690a10 2024-05-08T05:55:55.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.835+0000 7f64e4c00700 1 -- 172.21.15.82:0/1600342695 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64e00aa260 con 0x559dd6690a10 2024-05-08T05:55:55.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.835+0000 7f64e4c00700 1 -- 172.21.15.82:0/1600342695 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e00a8ab0 con 0x559dd6690a10 2024-05-08T05:55:55.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.836+0000 7f6501922b80 1 -- 172.21.15.82:0/1600342695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559dd6690a10 msgr2=0x559dd6699720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:55.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.836+0000 7f6501922b80 1 --2- 172.21.15.82:0/1600342695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559dd6690a10 0x559dd6699720 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f64e00a5be0 tx=0x7f64e0005000 comp rx=0 tx=0).stop 2024-05-08T05:55:55.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.837+0000 7f6501922b80 1 -- 172.21.15.82:0/1600342695 shutdown_connections 2024-05-08T05:55:55.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.837+0000 7f6501922b80 1 --2- 172.21.15.82:0/1600342695 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559dd66966f0 0x559dd6696ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:55.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.837+0000 7f6501922b80 1 --2- 172.21.15.82:0/1600342695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559dd6690a10 0x559dd6699720 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:55.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.837+0000 7f6501922b80 1 --2- 172.21.15.82:0/1600342695 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559dd6695dd0 0x559dd6699c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:55.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.837+0000 7f6501922b80 1 -- 172.21.15.82:0/1600342695 >> 172.21.15.82:0/1600342695 conn(0x559dd65bab60 msgr2=0x559dd6686950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:55:55.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.837+0000 7f6501922b80 1 -- 172.21.15.82:0/1600342695 shutdown_connections 2024-05-08T05:55:55.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.838+0000 7f6501922b80 1 -- 172.21.15.82:0/1600342695 wait complete. 2024-05-08T05:55:55.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.838+0000 7f6501922b80 1 -- start start 2024-05-08T05:55:55.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.838+0000 7f6501922b80 1 Processor -- start 2024-05-08T05:55:55.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.839+0000 7f6501922b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559dd6690a10 0x559dd668f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:55.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.839+0000 7f6501922b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559dd6695dd0 0x559dd668c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:55.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.839+0000 7f6501922b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559dd66966f0 0x559dd668cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:55.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.839+0000 7f6501922b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f64f01b5540 con 0x559dd66966f0 2024-05-08T05:55:55.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.839+0000 7f6501922b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f64f01b4e70 con 0x559dd6695dd0 2024-05-08T05:55:55.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.839+0000 7f6501922b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f64f01b2070 con 0x559dd6690a10 2024-05-08T05:55:55.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.839+0000 7f6501922b80 10 client.0 _ll_register_callbacks cb 0x559dd6585c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:55:55.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.839+0000 7f64efe00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559dd6690a10 0x559dd668f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:55.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.839+0000 7f64efe00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559dd6690a10 0x559dd668f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:43386/0 (socket says 172.21.15.82:43386) 2024-05-08T05:55:55.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.839+0000 7f64efe00700 1 -- 172.21.15.82:0/882888137 learned_addr learned my addr 172.21.15.82:0/882888137 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:55:55.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.840+0000 7f64efe00700 1 -- 172.21.15.82:0/882888137 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559dd6695dd0 msgr2=0x559dd668c9c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T05:55:55.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.840+0000 7f64efe00700 1 --2- 172.21.15.82:0/882888137 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559dd6695dd0 0x559dd668c9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:55.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.840+0000 7f64efe00700 1 -- 172.21.15.82:0/882888137 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559dd66966f0 msgr2=0x559dd668cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:55:55.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.840+0000 7f64efe00700 1 --2- 172.21.15.82:0/882888137 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559dd66966f0 0x559dd668cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:55.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.840+0000 7f64efe00700 1 -- 172.21.15.82:0/882888137 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559dd668d470 con 0x559dd6690a10 2024-05-08T05:55:55.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.840+0000 7f64efe00700 1 --2- 172.21.15.82:0/882888137 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559dd6690a10 0x559dd668f620 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f64e0004e30 tx=0x7f64e00b2810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee2941e274a7b967 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:55:55.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.840+0000 7f64da000700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:55:55.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.840+0000 7f64da000700 1 -- 172.21.15.82:0/882888137 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e00b2310 con 0x559dd6690a10 2024-05-08T05:55:55.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.840+0000 7f64da000700 1 -- 172.21.15.82:0/882888137 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f64e00a54d0 con 0x559dd6690a10 2024-05-08T05:55:55.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.841+0000 7f6501922b80 1 -- 172.21.15.82:0/882888137 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f64e00aa260 con 0x559dd6690a10 2024-05-08T05:55:55.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.841+0000 7f64da000700 1 -- 172.21.15.82:0/882888137 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f64e00b29c0 con 0x559dd6690a10 2024-05-08T05:55:55.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.841+0000 7f6501922b80 10 client.25774 fetch_fsmap learned FSMap version 31 2024-05-08T05:55:55.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.841+0000 7f6501922b80 1 -- 172.21.15.82:0/882888137 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x559dd668d470 con 0x559dd6690a10 2024-05-08T05:55:55.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.841+0000 7f64da000700 1 -- 172.21.15.82:0/882888137 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f64e00aa260 con 0x559dd6690a10 2024-05-08T05:55:55.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.841+0000 7f64da000700 1 -- 172.21.15.82:0/882888137 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f64e00af0a0 con 0x559dd6690a10 2024-05-08T05:55:55.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.841+0000 7f6501922b80 10 client.25774 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:55:55.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.841+0000 7f6501922b80 10 client.25774 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-05-08T05:55:55.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.841+0000 7f6501922b80 20 client.25774 populate_metadata read hostname 'smithi082' 2024-05-08T05:55:55.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.841+0000 7f6501922b80 1 --2- 172.21.15.82:0/882888137 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x559dd6718640 0x559dd671aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:55.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.841+0000 7f6501922b80 4 client.25774 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:55:55.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.841+0000 7f6501922b80 1 -- 172.21.15.82:0/882888137 --> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559dd65ec400 con 0x559dd6718640 2024-05-08T05:55:55.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.842+0000 7f64ef400700 1 --2- 172.21.15.82:0/882888137 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x559dd6718640 0x559dd671aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:55.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.843+0000 7f64ef400700 1 --2- 172.21.15.82:0/882888137 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x559dd6718640 0x559dd671aa30 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=4b4d97b2790f84f0 server_cookie=69bf92cb99814cb in_seq=0 out_seq=0 2024-05-08T05:55:55.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.843+0000 7f64da000700 10 client.25774 ms_handle_connect on v2:172.21.15.134:6836/2212411710 2024-05-08T05:55:55.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.843+0000 7f64da000700 1 -- 172.21.15.82:0/882888137 <== mds.4 v2:172.21.15.134:6836/2212411710 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559dd65ec400 con 0x559dd6718640 2024-05-08T05:55:55.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.843+0000 7f64da000700 10 client.25774 handle_command_reply: tid=0 2024-05-08T05:55:55.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.843+0000 7f6501922b80 1 client.25774 shutdown 2024-05-08T05:55:55.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.844+0000 7f6501922b80 1 -- 172.21.15.82:0/882888137 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559dd6690a10 msgr2=0x559dd668f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:55.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.844+0000 7f6501922b80 1 --2- 172.21.15.82:0/882888137 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559dd6690a10 0x559dd668f620 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f64e0004e30 tx=0x7f64e00b2810 comp rx=0 tx=0).stop 2024-05-08T05:55:55.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.844+0000 7f6501922b80 1 -- 172.21.15.82:0/882888137 shutdown_connections 2024-05-08T05:55:55.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.844+0000 7f6501922b80 1 --2- 172.21.15.82:0/882888137 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x559dd6718640 0x559dd671aa30 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:55.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.844+0000 7f6501922b80 1 --2- 172.21.15.82:0/882888137 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559dd66966f0 0x559dd668cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:55.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.844+0000 7f6501922b80 1 --2- 172.21.15.82:0/882888137 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559dd6690a10 0x559dd668f620 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:55.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.844+0000 7f6501922b80 1 --2- 172.21.15.82:0/882888137 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559dd6695dd0 0x559dd668c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:55.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.844+0000 7f6501922b80 1 -- 172.21.15.82:0/882888137 >> 172.21.15.82:0/882888137 conn(0x559dd65bab60 msgr2=0x559dd6696ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:55:55.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.844+0000 7f64da000700 0 client.25774 ms_handle_reset on v2:172.21.15.134:6836/2212411710 2024-05-08T05:55:55.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.845+0000 7f6501922b80 1 -- 172.21.15.82:0/882888137 shutdown_connections 2024-05-08T05:55:55.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.845+0000 7f6501922b80 1 -- 172.21.15.82:0/882888137 wait complete. 2024-05-08T05:55:55.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.845+0000 7f6501922b80 20 client.25774 trim_cache size 0 max 16384 2024-05-08T05:55:55.846 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T05:55:55.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.847+0000 7f64f5a00700 1 -- 172.21.15.82:0/460710864 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f64d40b2980 msgr2=0x7f64d40b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:55.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.847+0000 7f64f5a00700 1 --2- 172.21.15.82:0/460710864 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f64d40b2980 0x7f64d40b4e40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f64e8009e60 tx=0x7f64e80096c0 comp rx=0 tx=0).stop 2024-05-08T05:55:55.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.847+0000 7f64f5a00700 1 -- 172.21.15.82:0/460710864 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64f010a4a0 msgr2=0x7f64f01a2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:55.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.847+0000 7f64f5a00700 1 --2- 172.21.15.82:0/460710864 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64f010a4a0 0x7f64f01a2210 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f64e000e9c0 tx=0x7f64e000ecd0 comp rx=0 tx=0).stop 2024-05-08T05:55:55.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.847+0000 7f64f5a00700 1 -- 172.21.15.82:0/460710864 shutdown_connections 2024-05-08T05:55:55.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.847+0000 7f64f5a00700 1 --2- 172.21.15.82:0/460710864 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f64d40b2980 0x7f64d40b4e40 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:55.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.847+0000 7f64f5a00700 1 --2- 172.21.15.82:0/460710864 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f64f01165f0 0x7f64f01a6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:55.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.847+0000 7f64f5a00700 1 --2- 172.21.15.82:0/460710864 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64f010a4a0 0x7f64f01a2210 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:55.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.847+0000 7f64f5a00700 1 --2- 172.21.15.82:0/460710864 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64f010adc0 0x7f64f01a2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:55.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.847+0000 7f64f5a00700 1 -- 172.21.15.82:0/460710864 >> 172.21.15.82:0/460710864 conn(0x7f64f006e480 msgr2=0x7f64f0072080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:55:55.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.848+0000 7f64f5a00700 1 -- 172.21.15.82:0/460710864 shutdown_connections 2024-05-08T05:55:55.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:55.848+0000 7f64f5a00700 1 -- 172.21.15.82:0/460710864 wait complete. 2024-05-08T05:55:55.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:55:55 smithi151 ceph-mon[34815]: pgmap v617: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 7.3 MiB/s wr, 674 op/s 2024-05-08T05:55:55.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:55:55 smithi134 ceph-mon[34132]: pgmap v617: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 7.3 MiB/s wr, 674 op/s 2024-05-08T05:55:56.689 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-05-08T05:55:57.286 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:55:57.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:55:57 smithi082 ceph-mon[30098]: pgmap v618: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 8.6 MiB/s wr, 805 op/s 2024-05-08T05:55:57.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:55:57 smithi151 ceph-mon[34815]: pgmap v618: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 8.6 MiB/s wr, 805 op/s 2024-05-08T05:55:57.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:55:57 smithi134 ceph-mon[34132]: pgmap v618: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 8.6 MiB/s wr, 805 op/s 2024-05-08T05:55:59.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.488+0000 7f333b000700 1 -- 172.21.15.82:0/2719669310 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3334075ff0 msgr2=0x7f333410f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:59.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.488+0000 7f333b000700 1 --2- 172.21.15.82:0/2719669310 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3334075ff0 0x7f333410f960 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3320009990 tx=0x7f3320009ca0 comp rx=0 tx=0).stop 2024-05-08T05:55:59.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.490+0000 7f333b000700 1 -- 172.21.15.82:0/2719669310 shutdown_connections 2024-05-08T05:55:59.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.490+0000 7f333b000700 1 --2- 172.21.15.82:0/2719669310 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f333410fea0 0x7f3334112290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:59.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.490+0000 7f333b000700 1 --2- 172.21.15.82:0/2719669310 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f33340756d0 0x7f3334075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:59.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.490+0000 7f333b000700 1 --2- 172.21.15.82:0/2719669310 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3334075ff0 0x7f333410f960 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:59.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.490+0000 7f333b000700 1 -- 172.21.15.82:0/2719669310 >> 172.21.15.82:0/2719669310 conn(0x7f333407a650 msgr2=0x7f333407aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:55:59.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.491+0000 7f333b000700 1 -- 172.21.15.82:0/2719669310 shutdown_connections 2024-05-08T05:55:59.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.493+0000 7f333b000700 1 -- 172.21.15.82:0/2719669310 wait complete. 2024-05-08T05:55:59.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.496+0000 7f333b000700 1 Processor -- start 2024-05-08T05:55:59.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.496+0000 7f333b000700 1 -- start start 2024-05-08T05:55:59.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.497+0000 7f333b000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33340756d0 0x7f333419be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:59.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.497+0000 7f333b000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3334075ff0 0x7f333419c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:59.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.497+0000 7f333b000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f333410fea0 0x7f33341a0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:59.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.497+0000 7f333b000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f33341158f0 con 0x7f33340756d0 2024-05-08T05:55:59.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.497+0000 7f333b000700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3334115770 con 0x7f3334075ff0 2024-05-08T05:55:59.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.497+0000 7f333b000700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3334115a70 con 0x7f333410fea0 2024-05-08T05:55:59.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.497+0000 7f3339000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f333410fea0 0x7f33341a0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:59.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.498+0000 7f3333400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3334075ff0 0x7f333419c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:59.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.498+0000 7f3339000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f333410fea0 0x7f33341a0700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:43412/0 (socket says 172.21.15.82:43412) 2024-05-08T05:55:59.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.498+0000 7f3333400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3334075ff0 0x7f333419c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:50110/0 (socket says 172.21.15.82:50110) 2024-05-08T05:55:59.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.498+0000 7f3333400700 1 -- 172.21.15.82:0/2007543222 learned_addr learned my addr 172.21.15.82:0/2007543222 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:55:59.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.499+0000 7f3339000700 1 -- 172.21.15.82:0/2007543222 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3334075ff0 msgr2=0x7f333419c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:59.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.499+0000 7f3339000700 1 --2- 172.21.15.82:0/2007543222 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3334075ff0 0x7f333419c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:59.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.499+0000 7f3339000700 1 -- 172.21.15.82:0/2007543222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33340756d0 msgr2=0x7f333419be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:59.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.499+0000 7f3339000700 1 --2- 172.21.15.82:0/2007543222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33340756d0 0x7f333419be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:59.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.499+0000 7f3339000700 1 -- 172.21.15.82:0/2007543222 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33341a0e40 con 0x7f333410fea0 2024-05-08T05:55:59.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.501+0000 7f3339000700 1 --2- 172.21.15.82:0/2007543222 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f333410fea0 0x7f33341a0700 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f333406bcd0 tx=0x7f332c00ef90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:55:59.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.501+0000 7f3330c00700 1 -- 172.21.15.82:0/2007543222 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332c0092e0 con 0x7f333410fea0 2024-05-08T05:55:59.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.501+0000 7f3330c00700 1 -- 172.21.15.82:0/2007543222 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f332c004bb0 con 0x7f333410fea0 2024-05-08T05:55:59.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.501+0000 7f3330c00700 1 -- 172.21.15.82:0/2007543222 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332c004020 con 0x7f333410fea0 2024-05-08T05:55:59.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.501+0000 7f333b000700 1 -- 172.21.15.82:0/2007543222 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33341a10d0 con 0x7f333410fea0 2024-05-08T05:55:59.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.502+0000 7f333b000700 1 -- 172.21.15.82:0/2007543222 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f333406cec0 con 0x7f333410fea0 2024-05-08T05:55:59.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.508+0000 7f33458a2b80 1 Processor -- start 2024-05-08T05:55:59.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.509+0000 7f3330c00700 1 -- 172.21.15.82:0/2007543222 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f332c01b030 con 0x7f333410fea0 2024-05-08T05:55:59.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.509+0000 7f33458a2b80 1 -- start start 2024-05-08T05:55:59.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.510+0000 7f33458a2b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648f10a2bc0 0x5648f10a2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:59.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.510+0000 7f33458a2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5648f10a34e0 0x5648f109d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:59.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.510+0000 7f33458a2b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648f109d8f0 0x5648f109dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:59.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.510+0000 7f33458a2b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5648f0fefa20 con 0x5648f10a2bc0 2024-05-08T05:55:59.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.510+0000 7f33458a2b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5648f0f8d760 con 0x5648f109d8f0 2024-05-08T05:55:59.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.510+0000 7f33458a2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5648f0feb9e0 con 0x5648f10a34e0 2024-05-08T05:55:59.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.510+0000 7f3333e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5648f10a34e0 0x5648f109d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:59.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.510+0000 7f3333e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5648f10a34e0 0x5648f109d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:43418/0 (socket says 172.21.15.82:43418) 2024-05-08T05:55:59.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.510+0000 7f3333e00700 1 -- 172.21.15.82:0/3870175948 learned_addr learned my addr 172.21.15.82:0/3870175948 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:55:59.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.511+0000 7f3333400700 1 --2- 172.21.15.82:0/3870175948 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648f109d8f0 0x5648f109dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:59.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.511+0000 7f3333400700 1 --2- 172.21.15.82:0/3870175948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648f10a2bc0 0x5648f10a2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:59.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.511+0000 7f3333e00700 1 -- 172.21.15.82:0/3870175948 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648f109d8f0 msgr2=0x5648f109dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:55:59.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.511+0000 7f3333e00700 1 --2- 172.21.15.82:0/3870175948 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648f109d8f0 0x5648f109dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:59.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.511+0000 7f3333e00700 1 -- 172.21.15.82:0/3870175948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648f10a2bc0 msgr2=0x5648f10a2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:55:59.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.512+0000 7f3333e00700 1 --2- 172.21.15.82:0/3870175948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648f10a2bc0 0x5648f10a2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:59.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.512+0000 7f3333e00700 1 -- 172.21.15.82:0/3870175948 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648f0f3c8d0 con 0x5648f10a34e0 2024-05-08T05:55:59.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.513+0000 7f3330c00700 1 --2- 172.21.15.82:0/2007543222 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f33180b2900 0x7f33180b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:59.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.513+0000 7f3333400700 1 --2- 172.21.15.82:0/3870175948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648f10a2bc0 0x5648f10a2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:55:59.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.513+0000 7f3330c00700 1 -- 172.21.15.82:0/2007543222 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f332c0e1b60 con 0x7f333410fea0 2024-05-08T05:55:59.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.514+0000 7f3333e00700 1 --2- 172.21.15.82:0/3870175948 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5648f10a34e0 0x5648f109d2d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f332400ab20 tx=0x7f332400ae30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8650f91842e19e41 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:55:59.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.514+0000 7f3333400700 1 --2- 172.21.15.82:0/2007543222 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f33180b2900 0x7f33180b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:59.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.515+0000 7f3329600700 1 -- 172.21.15.82:0/3870175948 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332400ccd0 con 0x5648f10a34e0 2024-05-08T05:55:59.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.515+0000 7f3329600700 1 -- 172.21.15.82:0/3870175948 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f332400f900 con 0x5648f10a34e0 2024-05-08T05:55:59.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.515+0000 7f3329600700 1 -- 172.21.15.82:0/3870175948 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33240188a0 con 0x5648f10a34e0 2024-05-08T05:55:59.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.517+0000 7f3333400700 1 --2- 172.21.15.82:0/2007543222 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f33180b2900 0x7f33180b4dc0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x5648f109e2b0 tx=0x7f3320005040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:55:59.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.517+0000 7f33458a2b80 1 -- 172.21.15.82:0/3870175948 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5648f10a34e0 msgr2=0x5648f109d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:59.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.517+0000 7f33458a2b80 1 --2- 172.21.15.82:0/3870175948 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5648f10a34e0 0x5648f109d2d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f332400ab20 tx=0x7f332400ae30 comp rx=0 tx=0).stop 2024-05-08T05:55:59.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.517+0000 7f33458a2b80 1 -- 172.21.15.82:0/3870175948 shutdown_connections 2024-05-08T05:55:59.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.518+0000 7f33458a2b80 1 --2- 172.21.15.82:0/3870175948 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648f109d8f0 0x5648f109dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:59.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.518+0000 7f33458a2b80 1 --2- 172.21.15.82:0/3870175948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648f10a2bc0 0x5648f10a2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:59.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.518+0000 7f33458a2b80 1 --2- 172.21.15.82:0/3870175948 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5648f10a34e0 0x5648f109d2d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:59.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.518+0000 7f33458a2b80 1 -- 172.21.15.82:0/3870175948 >> 172.21.15.82:0/3870175948 conn(0x5648f10156d0 msgr2=0x5648f1097b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:55:59.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.518+0000 7f33458a2b80 1 -- 172.21.15.82:0/3870175948 shutdown_connections 2024-05-08T05:55:59.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.518+0000 7f33458a2b80 1 -- 172.21.15.82:0/3870175948 wait complete. 2024-05-08T05:55:59.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.519+0000 7f33458a2b80 1 -- start start 2024-05-08T05:55:59.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.520+0000 7f33458a2b80 1 Processor -- start 2024-05-08T05:55:59.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.520+0000 7f33458a2b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648f109d8f0 0x5648f10a91f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:59.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.520+0000 7f33458a2b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648f10a2bc0 0x5648f10a6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:59.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.520+0000 7f33458a2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5648f10a34e0 0x5648f10a6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:59.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.521+0000 7f33458a2b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5648f10a9f20 con 0x5648f109d8f0 2024-05-08T05:55:59.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.521+0000 7f33458a2b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5648f0f55b20 con 0x5648f10a2bc0 2024-05-08T05:55:59.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.521+0000 7f33458a2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5648f10aa0a0 con 0x5648f10a34e0 2024-05-08T05:55:59.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.521+0000 7f33458a2b80 10 client.0 _ll_register_callbacks cb 0x5648f0f96c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:55:59.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.521+0000 7f3333e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648f109d8f0 0x5648f10a91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:59.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.521+0000 7f3333e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648f109d8f0 0x5648f10a91f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43580/0 (socket says 172.21.15.82:43580) 2024-05-08T05:55:59.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.521+0000 7f3333e00700 1 -- 172.21.15.82:0/108067845 learned_addr learned my addr 172.21.15.82:0/108067845 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:55:59.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.521+0000 7f3333400700 1 --2- 172.21.15.82:0/108067845 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648f10a2bc0 0x5648f10a6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:59.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.521+0000 7f3339000700 1 --2- 172.21.15.82:0/108067845 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5648f10a34e0 0x5648f10a6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:59.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.522+0000 7f3333e00700 1 -- 172.21.15.82:0/108067845 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5648f10a34e0 msgr2=0x5648f10a6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:55:59.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.522+0000 7f3333e00700 1 --2- 172.21.15.82:0/108067845 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5648f10a34e0 0x5648f10a6ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:59.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.522+0000 7f3333e00700 1 -- 172.21.15.82:0/108067845 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648f10a2bc0 msgr2=0x5648f10a6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:55:59.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.522+0000 7f3333e00700 1 --2- 172.21.15.82:0/108067845 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648f10a2bc0 0x5648f10a6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:59.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.522+0000 7f3333e00700 1 -- 172.21.15.82:0/108067845 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648f0fb5420 con 0x5648f109d8f0 2024-05-08T05:55:59.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.522+0000 7f3333400700 1 --2- 172.21.15.82:0/108067845 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648f10a2bc0 0x5648f10a6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:55:59.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.522+0000 7f3339000700 1 --2- 172.21.15.82:0/108067845 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5648f10a34e0 0x5648f10a6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:55:59.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.523+0000 7f3333e00700 1 --2- 172.21.15.82:0/108067845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648f109d8f0 0x5648f10a91f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f332400d010 tx=0x7f332400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9971f054a8ed6083 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:55:59.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.523+0000 7f331e000700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T05:55:59.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.526+0000 7f331e000700 1 -- 172.21.15.82:0/108067845 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332400fd80 con 0x5648f109d8f0 2024-05-08T05:55:59.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.526+0000 7f331e000700 1 -- 172.21.15.82:0/108067845 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f3324004020 con 0x5648f109d8f0 2024-05-08T05:55:59.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.526+0000 7f33458a2b80 1 -- 172.21.15.82:0/108067845 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f332400f900 con 0x5648f109d8f0 2024-05-08T05:55:59.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.526+0000 7f331e000700 1 -- 172.21.15.82:0/108067845 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f3324004220 con 0x5648f109d8f0 2024-05-08T05:55:59.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.526+0000 7f33458a2b80 10 client.15522 fetch_fsmap learned FSMap version 31 2024-05-08T05:55:59.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.527+0000 7f33458a2b80 1 -- 172.21.15.82:0/108067845 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5648f10b47b0 con 0x5648f109d8f0 2024-05-08T05:55:59.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.527+0000 7f331e000700 1 -- 172.21.15.82:0/108067845 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f332400f900 con 0x5648f109d8f0 2024-05-08T05:55:59.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.527+0000 7f331e000700 1 -- 172.21.15.82:0/108067845 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f33240039b0 con 0x5648f109d8f0 2024-05-08T05:55:59.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.527+0000 7f33458a2b80 10 client.15522 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:55:59.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.527+0000 7f33458a2b80 10 client.15522 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-05-08T05:55:59.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.527+0000 7f33458a2b80 20 client.15522 populate_metadata read hostname 'smithi082' 2024-05-08T05:55:59.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.527+0000 7f33458a2b80 1 --2- 172.21.15.82:0/108067845 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x5648f10b6d30 0x5648f10b9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:59.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.527+0000 7f33458a2b80 4 client.15522 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:55:59.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.527+0000 7f33458a2b80 1 -- 172.21.15.82:0/108067845 --> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5648f106a140 con 0x5648f10b6d30 2024-05-08T05:55:59.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.527+0000 7f3333400700 1 --2- 172.21.15.82:0/108067845 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x5648f10b6d30 0x5648f10b9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:59.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.528+0000 7f3333400700 1 --2- 172.21.15.82:0/108067845 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x5648f10b6d30 0x5648f10b9120 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=aafbbed73f6febb9 server_cookie=8f22945791ea0628 in_seq=0 out_seq=0 2024-05-08T05:55:59.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.528+0000 7f331e000700 10 client.15522 ms_handle_connect on v2:172.21.15.151:6834/2093655929 2024-05-08T05:55:59.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.529+0000 7f331e000700 1 -- 172.21.15.82:0/108067845 <== mds.3 v2:172.21.15.151:6834/2093655929 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5648f106a140 con 0x5648f10b6d30 2024-05-08T05:55:59.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.529+0000 7f331e000700 10 client.15522 handle_command_reply: tid=0 2024-05-08T05:55:59.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.529+0000 7f33458a2b80 1 client.15522 shutdown 2024-05-08T05:55:59.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.530+0000 7f33458a2b80 1 -- 172.21.15.82:0/108067845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648f109d8f0 msgr2=0x5648f10a91f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:59.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.530+0000 7f33458a2b80 1 --2- 172.21.15.82:0/108067845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648f109d8f0 0x5648f10a91f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f332400d010 tx=0x7f332400f730 comp rx=0 tx=0).stop 2024-05-08T05:55:59.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.530+0000 7f33458a2b80 1 -- 172.21.15.82:0/108067845 shutdown_connections 2024-05-08T05:55:59.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.530+0000 7f33458a2b80 1 --2- 172.21.15.82:0/108067845 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x5648f10b6d30 0x5648f10b9120 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:59.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.530+0000 7f33458a2b80 1 --2- 172.21.15.82:0/108067845 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5648f10a34e0 0x5648f10a6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:59.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.530+0000 7f33458a2b80 1 --2- 172.21.15.82:0/108067845 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648f109d8f0 0x5648f10a91f0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:59.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.530+0000 7f33458a2b80 1 --2- 172.21.15.82:0/108067845 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648f10a2bc0 0x5648f10a6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:59.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.530+0000 7f33458a2b80 1 -- 172.21.15.82:0/108067845 >> 172.21.15.82:0/108067845 conn(0x5648f10156d0 msgr2=0x5648f1097190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:55:59.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.530+0000 7f331e000700 0 client.15522 ms_handle_reset on v2:172.21.15.151:6834/2093655929 2024-05-08T05:55:59.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.531+0000 7f33458a2b80 1 -- 172.21.15.82:0/108067845 shutdown_connections 2024-05-08T05:55:59.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.531+0000 7f33458a2b80 1 -- 172.21.15.82:0/108067845 wait complete. 2024-05-08T05:55:59.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.531+0000 7f33458a2b80 20 client.15522 trim_cache size 0 max 16384 2024-05-08T05:55:59.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.554+0000 7f33458a2b80 1 Processor -- start 2024-05-08T05:55:59.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.554+0000 7f33458a2b80 1 -- start start 2024-05-08T05:55:59.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.555+0000 7f33458a2b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648f109d8f0 0x5648f109d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:59.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.555+0000 7f33458a2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5648f10a2bc0 0x5648f10a5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:59.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.555+0000 7f33458a2b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648f10a34e0 0x5648f1097910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:59.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.555+0000 7f33458a2b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f333406ffc0 con 0x5648f10a34e0 2024-05-08T05:55:59.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.555+0000 7f33458a2b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3334071b00 con 0x5648f109d8f0 2024-05-08T05:55:59.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.555+0000 7f33458a2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3334070690 con 0x5648f10a2bc0 2024-05-08T05:55:59.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.555+0000 7f3333e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648f109d8f0 0x5648f109d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:59.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.555+0000 7f3333e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648f109d8f0 0x5648f109d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:50124/0 (socket says 172.21.15.82:50124) 2024-05-08T05:55:59.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.555+0000 7f3333e00700 1 -- 172.21.15.82:0/37105787 learned_addr learned my addr 172.21.15.82:0/37105787 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:55:59.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.555+0000 7f3333400700 1 --2- 172.21.15.82:0/37105787 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5648f10a2bc0 0x5648f10a5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:59.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.555+0000 7f3339000700 1 --2- 172.21.15.82:0/37105787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648f10a34e0 0x5648f1097910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:59.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.556+0000 7f3333e00700 1 -- 172.21.15.82:0/37105787 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5648f10a2bc0 msgr2=0x5648f10a5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:55:59.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.556+0000 7f3333e00700 1 --2- 172.21.15.82:0/37105787 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5648f10a2bc0 0x5648f10a5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:59.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.556+0000 7f3333e00700 1 -- 172.21.15.82:0/37105787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648f10a34e0 msgr2=0x5648f1097910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:55:59.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.556+0000 7f3333e00700 1 --2- 172.21.15.82:0/37105787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648f10a34e0 0x5648f1097910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:59.557 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.556+0000 7f3333e00700 1 -- 172.21.15.82:0/37105787 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5648f10a31f0 con 0x5648f109d8f0 2024-05-08T05:55:59.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.556+0000 7f3333e00700 1 --2- 172.21.15.82:0/37105787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648f109d8f0 0x5648f109d2d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f332400afd0 tx=0x7f3324004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9aa53930c0090556 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:55:59.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.557+0000 7f3328c00700 1 -- 172.21.15.82:0/37105787 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3324003ff0 con 0x5648f109d8f0 2024-05-08T05:55:59.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.557+0000 7f3328c00700 1 -- 172.21.15.82:0/37105787 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3324003b30 con 0x5648f109d8f0 2024-05-08T05:55:59.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.557+0000 7f3328c00700 1 -- 172.21.15.82:0/37105787 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33240228d0 con 0x5648f109d8f0 2024-05-08T05:55:59.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.559+0000 7f33458a2b80 1 -- 172.21.15.82:0/37105787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648f109d8f0 msgr2=0x5648f109d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:59.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.559+0000 7f33458a2b80 1 --2- 172.21.15.82:0/37105787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648f109d8f0 0x5648f109d2d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f332400afd0 tx=0x7f3324004730 comp rx=0 tx=0).stop 2024-05-08T05:55:59.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.559+0000 7f33458a2b80 1 -- 172.21.15.82:0/37105787 shutdown_connections 2024-05-08T05:55:59.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.560+0000 7f33458a2b80 1 --2- 172.21.15.82:0/37105787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648f109d8f0 0x5648f109d2d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:59.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.560+0000 7f33458a2b80 1 --2- 172.21.15.82:0/37105787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648f10a34e0 0x5648f1097910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:59.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.560+0000 7f33458a2b80 1 --2- 172.21.15.82:0/37105787 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5648f10a2bc0 0x5648f10a5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:59.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.560+0000 7f33458a2b80 1 -- 172.21.15.82:0/37105787 >> 172.21.15.82:0/37105787 conn(0x5648f10156d0 msgr2=0x5648f10a1710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:55:59.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.560+0000 7f33458a2b80 1 -- 172.21.15.82:0/37105787 shutdown_connections 2024-05-08T05:55:59.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.560+0000 7f33458a2b80 1 -- 172.21.15.82:0/37105787 wait complete. 2024-05-08T05:55:59.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.561+0000 7f33458a2b80 1 -- start start 2024-05-08T05:55:59.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.561+0000 7f33458a2b80 1 Processor -- start 2024-05-08T05:55:59.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.561+0000 7f33458a2b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648f109d8f0 0x5648f10bc5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:59.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.561+0000 7f33458a2b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648f10a2bc0 0x5648f10b9940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:59.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.561+0000 7f33458a2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5648f10a34e0 0x5648f10b9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:59.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.561+0000 7f33458a2b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3334071430 con 0x5648f10a2bc0 2024-05-08T05:55:59.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.561+0000 7f33458a2b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3334070d60 con 0x5648f109d8f0 2024-05-08T05:55:59.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.561+0000 7f33458a2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3334107470 con 0x5648f10a34e0 2024-05-08T05:55:59.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.562+0000 7f33458a2b80 10 client.0 _ll_register_callbacks cb 0x5648f0f96c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:55:59.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.562+0000 7f3339000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5648f10a34e0 0x5648f10b9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:59.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.562+0000 7f3333e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648f109d8f0 0x5648f10bc5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:59.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.562+0000 7f3339000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5648f10a34e0 0x5648f10b9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:43436/0 (socket says 172.21.15.82:43436) 2024-05-08T05:55:59.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.562+0000 7f3339000700 1 -- 172.21.15.82:0/3356432698 learned_addr learned my addr 172.21.15.82:0/3356432698 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:55:59.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.562+0000 7f3333e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648f109d8f0 0x5648f10bc5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:50134/0 (socket says 172.21.15.82:50134) 2024-05-08T05:55:59.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.562+0000 7f3333400700 1 --2- 172.21.15.82:0/3356432698 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648f10a2bc0 0x5648f10b9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:59.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.562+0000 7f3339000700 1 -- 172.21.15.82:0/3356432698 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648f109d8f0 msgr2=0x5648f10bc5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:55:59.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.562+0000 7f3339000700 1 --2- 172.21.15.82:0/3356432698 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648f109d8f0 0x5648f10bc5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:59.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.562+0000 7f3339000700 1 -- 172.21.15.82:0/3356432698 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648f10a2bc0 msgr2=0x5648f10b9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:55:59.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.562+0000 7f3339000700 1 --2- 172.21.15.82:0/3356432698 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648f10a2bc0 0x5648f10b9940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:59.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.562+0000 7f3339000700 1 -- 172.21.15.82:0/3356432698 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5648f10ba590 con 0x5648f10a34e0 2024-05-08T05:55:59.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.562+0000 7f3333e00700 1 --2- 172.21.15.82:0/3356432698 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648f109d8f0 0x5648f10bc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:55:59.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.562+0000 7f3339000700 1 --2- 172.21.15.82:0/3356432698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5648f10a34e0 0x5648f10b9e80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f332c0a5250 tx=0x7f332c0b1e40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e813a85d24fda74 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:55:59.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.562+0000 7f331e000700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:55:59.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.563+0000 7f331e000700 1 -- 172.21.15.82:0/3356432698 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f332c0a8d30 con 0x5648f10a34e0 2024-05-08T05:55:59.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.563+0000 7f331e000700 1 -- 172.21.15.82:0/3356432698 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f332c0ad360 con 0x5648f10a34e0 2024-05-08T05:55:59.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.563+0000 7f33458a2b80 1 -- 172.21.15.82:0/3356432698 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3324003b30 con 0x5648f10a34e0 2024-05-08T05:55:59.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.563+0000 7f331e000700 1 -- 172.21.15.82:0/3356432698 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f332c0a9920 con 0x5648f10a34e0 2024-05-08T05:55:59.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.563+0000 7f33458a2b80 10 client.25789 fetch_fsmap learned FSMap version 31 2024-05-08T05:55:59.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.563+0000 7f33458a2b80 1 -- 172.21.15.82:0/3356432698 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5648f11211f0 con 0x5648f10a34e0 2024-05-08T05:55:59.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.563+0000 7f331e000700 1 -- 172.21.15.82:0/3356432698 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3324003b30 con 0x5648f10a34e0 2024-05-08T05:55:59.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.563+0000 7f331e000700 1 -- 172.21.15.82:0/3356432698 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f332c0a4cb0 con 0x5648f10a34e0 2024-05-08T05:55:59.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.563+0000 7f33458a2b80 10 client.25789 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:55:59.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.563+0000 7f33458a2b80 10 client.25789 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-05-08T05:55:59.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.563+0000 7f33458a2b80 20 client.25789 populate_metadata read hostname 'smithi082' 2024-05-08T05:55:59.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.564+0000 7f33458a2b80 1 --2- 172.21.15.82:0/3356432698 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x5648f1121850 0x5648f1123c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:55:59.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.564+0000 7f33458a2b80 4 client.25789 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:55:59.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.564+0000 7f33458a2b80 1 -- 172.21.15.82:0/3356432698 --> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5648f0ffd400 con 0x5648f1121850 2024-05-08T05:55:59.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.564+0000 7f3333e00700 1 --2- 172.21.15.82:0/3356432698 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x5648f1121850 0x5648f1123c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:55:59.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.565+0000 7f3333e00700 1 --2- 172.21.15.82:0/3356432698 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x5648f1121850 0x5648f1123c70 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=bae2d293975567ac server_cookie=a931391c187690d5 in_seq=0 out_seq=0 2024-05-08T05:55:59.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.565+0000 7f331e000700 10 client.25789 ms_handle_connect on v2:172.21.15.151:6834/2093655929 2024-05-08T05:55:59.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.565+0000 7f331e000700 1 -- 172.21.15.82:0/3356432698 <== mds.3 v2:172.21.15.151:6834/2093655929 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5648f0ffd400 con 0x5648f1121850 2024-05-08T05:55:59.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.565+0000 7f331e000700 10 client.25789 handle_command_reply: tid=0 2024-05-08T05:55:59.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.566+0000 7f33458a2b80 1 client.25789 shutdown 2024-05-08T05:55:59.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.566+0000 7f33458a2b80 1 -- 172.21.15.82:0/3356432698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5648f10a34e0 msgr2=0x5648f10b9e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:59.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.566+0000 7f33458a2b80 1 --2- 172.21.15.82:0/3356432698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5648f10a34e0 0x5648f10b9e80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f332c0a5250 tx=0x7f332c0b1e40 comp rx=0 tx=0).stop 2024-05-08T05:55:59.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.567+0000 7f33458a2b80 1 -- 172.21.15.82:0/3356432698 shutdown_connections 2024-05-08T05:55:59.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.567+0000 7f33458a2b80 1 --2- 172.21.15.82:0/3356432698 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x5648f1121850 0x5648f1123c70 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:59.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.567+0000 7f33458a2b80 1 --2- 172.21.15.82:0/3356432698 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648f109d8f0 0x5648f10bc5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:59.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.567+0000 7f33458a2b80 1 --2- 172.21.15.82:0/3356432698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5648f10a34e0 0x5648f10b9e80 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:59.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.567+0000 7f33458a2b80 1 --2- 172.21.15.82:0/3356432698 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5648f10a2bc0 0x5648f10b9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:59.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.567+0000 7f33458a2b80 1 -- 172.21.15.82:0/3356432698 >> 172.21.15.82:0/3356432698 conn(0x5648f10156d0 msgr2=0x5648f10a1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:55:59.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.567+0000 7f331e000700 0 client.25789 ms_handle_reset on v2:172.21.15.151:6834/2093655929 2024-05-08T05:55:59.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.568+0000 7f33458a2b80 1 -- 172.21.15.82:0/3356432698 shutdown_connections 2024-05-08T05:55:59.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.568+0000 7f33458a2b80 1 -- 172.21.15.82:0/3356432698 wait complete. 2024-05-08T05:55:59.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.568+0000 7f33458a2b80 20 client.25789 trim_cache size 0 max 16384 2024-05-08T05:55:59.572 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T05:55:59.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.570+0000 7f333b000700 1 -- 172.21.15.82:0/2007543222 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f33180b2900 msgr2=0x7f33180b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:59.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.570+0000 7f333b000700 1 --2- 172.21.15.82:0/2007543222 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f33180b2900 0x7f33180b4dc0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x5648f109e2b0 tx=0x7f3320005040 comp rx=0 tx=0).stop 2024-05-08T05:55:59.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.570+0000 7f333b000700 1 -- 172.21.15.82:0/2007543222 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f333410fea0 msgr2=0x7f33341a0700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:55:59.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.570+0000 7f333b000700 1 --2- 172.21.15.82:0/2007543222 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f333410fea0 0x7f33341a0700 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f333406bcd0 tx=0x7f332c00ef90 comp rx=0 tx=0).stop 2024-05-08T05:55:59.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.570+0000 7f333b000700 1 -- 172.21.15.82:0/2007543222 shutdown_connections 2024-05-08T05:55:59.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.570+0000 7f333b000700 1 --2- 172.21.15.82:0/2007543222 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f33180b2900 0x7f33180b4dc0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:59.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.570+0000 7f333b000700 1 --2- 172.21.15.82:0/2007543222 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f333410fea0 0x7f33341a0700 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:59.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.570+0000 7f333b000700 1 --2- 172.21.15.82:0/2007543222 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f33340756d0 0x7f333419be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:59.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.570+0000 7f333b000700 1 --2- 172.21.15.82:0/2007543222 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3334075ff0 0x7f333419c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:55:59.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.570+0000 7f333b000700 1 -- 172.21.15.82:0/2007543222 >> 172.21.15.82:0/2007543222 conn(0x7f333407a650 msgr2=0x7f3334100750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:55:59.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.572+0000 7f333b000700 1 -- 172.21.15.82:0/2007543222 shutdown_connections 2024-05-08T05:55:59.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:55:59.572+0000 7f333b000700 1 -- 172.21.15.82:0/2007543222 wait complete. 2024-05-08T05:55:59.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:55:59 smithi151 ceph-mon[34815]: pgmap v619: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.6 MiB/s wr, 646 op/s 2024-05-08T05:55:59.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:55:59 smithi082 ceph-mon[30098]: pgmap v619: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.6 MiB/s wr, 646 op/s 2024-05-08T05:56:00.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:55:59 smithi134 ceph-mon[34132]: pgmap v619: 97 pgs: 97 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.6 MiB/s wr, 646 op/s 2024-05-08T05:56:00.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 310.0 s, 2244.5 tps, lat 44.196 ms stddev 51.306 2024-05-08T05:56:00.634 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-05-08T05:56:01.232 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:56:01.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:56:01 smithi082 ceph-mon[30098]: pgmap v620: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 8.1 MiB/s wr, 782 op/s 2024-05-08T05:56:01.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:56:01 smithi151 ceph-mon[34815]: pgmap v620: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 8.1 MiB/s wr, 782 op/s 2024-05-08T05:56:02.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:56:01 smithi134 ceph-mon[34132]: pgmap v620: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 8.1 MiB/s wr, 782 op/s 2024-05-08T05:56:03.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.536+0000 7f687a000700 1 -- 172.21.15.82:0/679692795 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68741056e0 msgr2=0x7f6874105b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:56:03.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.536+0000 7f687a000700 1 --2- 172.21.15.82:0/679692795 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68741056e0 0x7f6874105b60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6860009990 tx=0x7f6860009ca0 comp rx=0 tx=0).stop 2024-05-08T05:56:03.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.536+0000 7f687a000700 1 -- 172.21.15.82:0/679692795 shutdown_connections 2024-05-08T05:56:03.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.536+0000 7f687a000700 1 --2- 172.21.15.82:0/679692795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f68741060a0 0x7f68741125b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:03.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.536+0000 7f687a000700 1 --2- 172.21.15.82:0/679692795 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f687410b6e0 0x7f687410bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:03.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.536+0000 7f687a000700 1 --2- 172.21.15.82:0/679692795 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68741056e0 0x7f6874105b60 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:03.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.536+0000 7f687a000700 1 -- 172.21.15.82:0/679692795 >> 172.21.15.82:0/679692795 conn(0x7f68741011d0 msgr2=0x7f68741035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:56:03.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.536+0000 7f687a000700 1 -- 172.21.15.82:0/679692795 shutdown_connections 2024-05-08T05:56:03.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.536+0000 7f687a000700 1 -- 172.21.15.82:0/679692795 wait complete. 2024-05-08T05:56:03.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.538+0000 7f687a000700 1 Processor -- start 2024-05-08T05:56:03.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.538+0000 7f687a000700 1 -- start start 2024-05-08T05:56:03.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.539+0000 7f687a000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68741056e0 0x7f6874112420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:03.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.539+0000 7f687a000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68741060a0 0x7f687410f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:03.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.539+0000 7f687a000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f687410b6e0 0x7f687410fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:03.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.539+0000 7f687a000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6874115970 con 0x7f68741056e0 2024-05-08T05:56:03.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.539+0000 7f687a000700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f68741157f0 con 0x7f687410b6e0 2024-05-08T05:56:03.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.539+0000 7f687a000700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6874115af0 con 0x7f68741060a0 2024-05-08T05:56:03.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.539+0000 7f6872a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68741060a0 0x7f687410f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:03.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.539+0000 7f6872a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68741060a0 0x7f687410f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:36788/0 (socket says 172.21.15.82:36788) 2024-05-08T05:56:03.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.539+0000 7f6872a00700 1 -- 172.21.15.82:0/3824975821 learned_addr learned my addr 172.21.15.82:0/3824975821 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:56:03.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.539+0000 7f6873e00700 1 --2- 172.21.15.82:0/3824975821 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f687410b6e0 0x7f687410fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:03.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.540+0000 7f6873400700 1 --2- 172.21.15.82:0/3824975821 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68741056e0 0x7f6874112420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:03.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.540+0000 7f6872a00700 1 -- 172.21.15.82:0/3824975821 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f687410b6e0 msgr2=0x7f687410fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:56:03.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.540+0000 7f6872a00700 1 --2- 172.21.15.82:0/3824975821 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f687410b6e0 0x7f687410fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:03.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.540+0000 7f6872a00700 1 -- 172.21.15.82:0/3824975821 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68741056e0 msgr2=0x7f6874112420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:56:03.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.540+0000 7f6872a00700 1 --2- 172.21.15.82:0/3824975821 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68741056e0 0x7f6874112420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:03.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.540+0000 7f6872a00700 1 -- 172.21.15.82:0/3824975821 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6874110310 con 0x7f68741060a0 2024-05-08T05:56:03.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.540+0000 7f6873400700 1 --2- 172.21.15.82:0/3824975821 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68741056e0 0x7f6874112420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:56:03.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.541+0000 7f6872a00700 1 --2- 172.21.15.82:0/3824975821 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68741060a0 0x7f687410f4d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6860000c00 tx=0x7f68600057c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:56:03.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.541+0000 7f686be00700 1 -- 172.21.15.82:0/3824975821 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6860027070 con 0x7f68741060a0 2024-05-08T05:56:03.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.541+0000 7f686be00700 1 -- 172.21.15.82:0/3824975821 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6860022470 con 0x7f68741060a0 2024-05-08T05:56:03.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.541+0000 7f687a000700 1 -- 172.21.15.82:0/3824975821 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68741a1ef0 con 0x7f68741060a0 2024-05-08T05:56:03.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.541+0000 7f686be00700 1 -- 172.21.15.82:0/3824975821 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6860017650 con 0x7f68741060a0 2024-05-08T05:56:03.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.541+0000 7f687a000700 1 -- 172.21.15.82:0/3824975821 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68741a2420 con 0x7f68741060a0 2024-05-08T05:56:03.550 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.547+0000 7f686be00700 1 -- 172.21.15.82:0/3824975821 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f686002a070 con 0x7f68741060a0 2024-05-08T05:56:03.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.549+0000 7f686be00700 1 --2- 172.21.15.82:0/3824975821 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f68580b2980 0x7f68580b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:03.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.550+0000 7f686be00700 1 -- 172.21.15.82:0/3824975821 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f68600e2e60 con 0x7f68741060a0 2024-05-08T05:56:03.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.550+0000 7f6873400700 1 --2- 172.21.15.82:0/3824975821 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f68580b2980 0x7f68580b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:03.551 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.551+0000 7f6873400700 1 --2- 172.21.15.82:0/3824975821 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f68580b2980 0x7f68580b4e40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6864009fd0 tx=0x7f6864009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:56:03.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.552+0000 7f68849d5b80 1 Processor -- start 2024-05-08T05:56:03.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.553+0000 7f68849d5b80 1 -- start start 2024-05-08T05:56:03.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.553+0000 7f68849d5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5620afbc1060 0x5620afbc1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:03.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.553+0000 7f68849d5b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5620afbc1980 0x5620afbc5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:03.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.553+0000 7f68849d5b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5620afbc59d0 0x5620afbc5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:03.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.553+0000 7f68849d5b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5620afb13a20 con 0x5620afbc1980 2024-05-08T05:56:03.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.553+0000 7f68849d5b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5620afab1760 con 0x5620afbc59d0 2024-05-08T05:56:03.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.553+0000 7f68849d5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5620afb0f9e0 con 0x5620afbc1060 2024-05-08T05:56:03.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.554+0000 7f6873400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5620afbc1060 0x5620afbc1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:03.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.554+0000 7f6873400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5620afbc1060 0x5620afbc1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:36800/0 (socket says 172.21.15.82:36800) 2024-05-08T05:56:03.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.554+0000 7f6873400700 1 -- 172.21.15.82:0/1798337750 learned_addr learned my addr 172.21.15.82:0/1798337750 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:56:03.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.555+0000 7f6873e00700 1 --2- 172.21.15.82:0/1798337750 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5620afbc59d0 0x5620afbc5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:03.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.555+0000 7f6873e00700 1 -- 172.21.15.82:0/1798337750 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5620afbc1060 msgr2=0x5620afbc1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:56:03.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.555+0000 7f6873e00700 1 --2- 172.21.15.82:0/1798337750 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5620afbc1060 0x5620afbc1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:03.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.555+0000 7f6873e00700 1 -- 172.21.15.82:0/1798337750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5620afbc1980 msgr2=0x5620afbc5490 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T05:56:03.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.555+0000 7f6873e00700 1 --2- 172.21.15.82:0/1798337750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5620afbc1980 0x5620afbc5490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:03.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.555+0000 7f6873e00700 1 -- 172.21.15.82:0/1798337750 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620afa608d0 con 0x5620afbc59d0 2024-05-08T05:56:03.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.556+0000 7f6873e00700 1 --2- 172.21.15.82:0/1798337750 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5620afbc59d0 0x5620afbc5e30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6874112ac0 tx=0x7f686c009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e85374addcfba6a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:56:03.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.558+0000 7f6868c00700 1 -- 172.21.15.82:0/1798337750 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f686c019020 con 0x5620afbc59d0 2024-05-08T05:56:03.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.558+0000 7f6868c00700 1 -- 172.21.15.82:0/1798337750 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f686c011e50 con 0x5620afbc59d0 2024-05-08T05:56:03.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.558+0000 7f6868c00700 1 -- 172.21.15.82:0/1798337750 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f686c007500 con 0x5620afbc59d0 2024-05-08T05:56:03.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.559+0000 7f68849d5b80 1 -- 172.21.15.82:0/1798337750 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5620afbc59d0 msgr2=0x5620afbc5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:56:03.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.559+0000 7f68849d5b80 1 --2- 172.21.15.82:0/1798337750 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5620afbc59d0 0x5620afbc5e30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6874112ac0 tx=0x7f686c009920 comp rx=0 tx=0).stop 2024-05-08T05:56:03.561 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.560+0000 7f68849d5b80 1 -- 172.21.15.82:0/1798337750 shutdown_connections 2024-05-08T05:56:03.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.561+0000 7f68849d5b80 1 --2- 172.21.15.82:0/1798337750 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5620afbc59d0 0x5620afbc5e30 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:03.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.561+0000 7f68849d5b80 1 --2- 172.21.15.82:0/1798337750 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5620afbc1060 0x5620afbc1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:03.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.561+0000 7f68849d5b80 1 --2- 172.21.15.82:0/1798337750 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5620afbc1980 0x5620afbc5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:03.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.561+0000 7f68849d5b80 1 -- 172.21.15.82:0/1798337750 >> 172.21.15.82:0/1798337750 conn(0x5620afaefb60 msgr2=0x5620afbbb7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:56:03.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.564+0000 7f68849d5b80 1 -- 172.21.15.82:0/1798337750 shutdown_connections 2024-05-08T05:56:03.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.565+0000 7f68849d5b80 1 -- 172.21.15.82:0/1798337750 wait complete. 2024-05-08T05:56:03.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.567+0000 7f68849d5b80 1 -- start start 2024-05-08T05:56:03.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.567+0000 7f68849d5b80 1 Processor -- start 2024-05-08T05:56:03.570 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:56:03 smithi082 ceph-mon[30098]: pgmap v621: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 6.6 MiB/s wr, 653 op/s 2024-05-08T05:56:03.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.569+0000 7f68849d5b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5620afbc1060 0x5620afbccf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:03.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.569+0000 7f68849d5b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5620afbc1980 0x5620afbca2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:03.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.569+0000 7f68849d5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5620afbc59d0 0x5620afbca7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:03.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.569+0000 7f68849d5b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5620afbcdbe0 con 0x5620afbc1980 2024-05-08T05:56:03.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.569+0000 7f68849d5b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5620afa79b20 con 0x5620afbc1060 2024-05-08T05:56:03.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.569+0000 7f68849d5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5620afbcdd60 con 0x5620afbc59d0 2024-05-08T05:56:03.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.569+0000 7f68849d5b80 10 client.0 _ll_register_callbacks cb 0x5620afabac70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:56:03.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.570+0000 7f6873e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5620afbc59d0 0x5620afbca7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:03.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.570+0000 7f6873e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5620afbc59d0 0x5620afbca7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:36808/0 (socket says 172.21.15.82:36808) 2024-05-08T05:56:03.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.570+0000 7f6873e00700 1 -- 172.21.15.82:0/1058774883 learned_addr learned my addr 172.21.15.82:0/1058774883 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:56:03.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.570+0000 7f6873e00700 1 -- 172.21.15.82:0/1058774883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5620afbc1060 msgr2=0x5620afbccf10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T05:56:03.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.570+0000 7f6873e00700 1 --2- 172.21.15.82:0/1058774883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5620afbc1060 0x5620afbccf10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:03.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.570+0000 7f6873e00700 1 -- 172.21.15.82:0/1058774883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5620afbc1980 msgr2=0x5620afbca2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:56:03.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.570+0000 7f6873e00700 1 --2- 172.21.15.82:0/1058774883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5620afbc1980 0x5620afbca2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:03.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.570+0000 7f6873e00700 1 -- 172.21.15.82:0/1058774883 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620afad9420 con 0x5620afbc59d0 2024-05-08T05:56:03.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.573+0000 7f6873e00700 1 --2- 172.21.15.82:0/1058774883 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5620afbc59d0 0x5620afbca7f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f686c004d00 tx=0x7f686c004de0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a37d44305c2f718 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:56:03.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.573+0000 7f685d600700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:56:03.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.573+0000 7f685d600700 1 -- 172.21.15.82:0/1058774883 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f686c019040 con 0x5620afbc59d0 2024-05-08T05:56:03.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.574+0000 7f68849d5b80 1 -- 172.21.15.82:0/1058774883 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f686c011e50 con 0x5620afbc59d0 2024-05-08T05:56:03.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.574+0000 7f685d600700 1 -- 172.21.15.82:0/1058774883 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f686c003e10 con 0x5620afbc59d0 2024-05-08T05:56:03.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.574+0000 7f685d600700 1 -- 172.21.15.82:0/1058774883 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f686c004010 con 0x5620afbc59d0 2024-05-08T05:56:03.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.574+0000 7f68849d5b80 10 client.25801 fetch_fsmap learned FSMap version 31 2024-05-08T05:56:03.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.574+0000 7f68849d5b80 1 -- 172.21.15.82:0/1058774883 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5620afbd8540 con 0x5620afbc59d0 2024-05-08T05:56:03.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.575+0000 7f685d600700 1 -- 172.21.15.82:0/1058774883 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f686c011e50 con 0x5620afbc59d0 2024-05-08T05:56:03.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.577+0000 7f685d600700 1 -- 172.21.15.82:0/1058774883 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f686c02a4e0 con 0x5620afbc59d0 2024-05-08T05:56:03.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.577+0000 7f68849d5b80 10 client.25801 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:56:03.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.577+0000 7f68849d5b80 10 client.25801 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-05-08T05:56:03.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.577+0000 7f68849d5b80 20 client.25801 populate_metadata read hostname 'smithi082' 2024-05-08T05:56:03.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.577+0000 7f68849d5b80 1 --2- 172.21.15.82:0/1058774883 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x5620afbdaa70 0x5620afbdce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:03.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.577+0000 7f68849d5b80 4 client.25801 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:56:03.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.577+0000 7f68849d5b80 1 -- 172.21.15.82:0/1058774883 --> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5620afb8e0a0 con 0x5620afbdaa70 2024-05-08T05:56:03.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.579+0000 7f6873400700 1 --2- 172.21.15.82:0/1058774883 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x5620afbdaa70 0x5620afbdce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:03.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.584+0000 7f685d600700 10 client.25801 ms_handle_connect on v2:172.21.15.151:6836/4192404464 2024-05-08T05:56:03.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.583+0000 7f6873400700 1 --2- 172.21.15.82:0/1058774883 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x5620afbdaa70 0x5620afbdce60 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d0a4f9a7bb74476c server_cookie=990897a6a218b3cb in_seq=0 out_seq=0 2024-05-08T05:56:03.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.587+0000 7f685d600700 1 -- 172.21.15.82:0/1058774883 <== mds.2 v2:172.21.15.151:6836/4192404464 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5620afb8e0a0 con 0x5620afbdaa70 2024-05-08T05:56:03.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.587+0000 7f685d600700 10 client.25801 handle_command_reply: tid=0 2024-05-08T05:56:03.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.587+0000 7f68849d5b80 1 client.25801 shutdown 2024-05-08T05:56:03.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.587+0000 7f68849d5b80 1 -- 172.21.15.82:0/1058774883 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5620afbc59d0 msgr2=0x5620afbca7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:56:03.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.587+0000 7f68849d5b80 1 --2- 172.21.15.82:0/1058774883 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5620afbc59d0 0x5620afbca7f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f686c004d00 tx=0x7f686c004de0 comp rx=0 tx=0).stop 2024-05-08T05:56:03.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.587+0000 7f68849d5b80 1 -- 172.21.15.82:0/1058774883 shutdown_connections 2024-05-08T05:56:03.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.587+0000 7f68849d5b80 1 --2- 172.21.15.82:0/1058774883 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x5620afbdaa70 0x5620afbdce60 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:03.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.587+0000 7f685d600700 0 client.25801 ms_handle_reset on v2:172.21.15.151:6836/4192404464 2024-05-08T05:56:03.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.587+0000 7f68849d5b80 1 --2- 172.21.15.82:0/1058774883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5620afbc1060 0x5620afbccf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:03.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.587+0000 7f68849d5b80 1 --2- 172.21.15.82:0/1058774883 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5620afbc59d0 0x5620afbca7f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:03.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.587+0000 7f68849d5b80 1 --2- 172.21.15.82:0/1058774883 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5620afbc1980 0x5620afbca2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:03.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.588+0000 7f68849d5b80 1 -- 172.21.15.82:0/1058774883 >> 172.21.15.82:0/1058774883 conn(0x5620afaefb60 msgr2=0x5620afbb62b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:56:03.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.588+0000 7f68849d5b80 1 -- 172.21.15.82:0/1058774883 shutdown_connections 2024-05-08T05:56:03.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.588+0000 7f68849d5b80 1 -- 172.21.15.82:0/1058774883 wait complete. 2024-05-08T05:56:03.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.588+0000 7f68849d5b80 20 client.25801 trim_cache size 0 max 16384 2024-05-08T05:56:03.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.620+0000 7f68849d5b80 1 Processor -- start 2024-05-08T05:56:03.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.620+0000 7f68849d5b80 1 -- start start 2024-05-08T05:56:03.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.621+0000 7f68849d5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5620afbc1060 0x5620afbc7f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:03.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.621+0000 7f68849d5b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5620afbc1980 0x5620afbd6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:03.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.621+0000 7f68849d5b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5620afbc59d0 0x5620afbb6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:03.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.621+0000 7f68849d5b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f68741a98a0 con 0x5620afbc59d0 2024-05-08T05:56:03.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.621+0000 7f68849d5b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f68741ab3e0 con 0x5620afbc1980 2024-05-08T05:56:03.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.621+0000 7f68849d5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f68741a9f70 con 0x5620afbc1060 2024-05-08T05:56:03.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.621+0000 7f6872a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5620afbc1980 0x5620afbd6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:03.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.621+0000 7f6872a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5620afbc1980 0x5620afbd6ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:44798/0 (socket says 172.21.15.82:44798) 2024-05-08T05:56:03.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.621+0000 7f6872a00700 1 -- 172.21.15.82:0/97002679 learned_addr learned my addr 172.21.15.82:0/97002679 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:56:03.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.621+0000 7f6873e00700 1 --2- 172.21.15.82:0/97002679 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5620afbc59d0 0x5620afbb6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:03.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.622+0000 7f6873400700 1 --2- 172.21.15.82:0/97002679 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5620afbc1060 0x5620afbc7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:03.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.622+0000 7f6872a00700 1 -- 172.21.15.82:0/97002679 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5620afbc1060 msgr2=0x5620afbc7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:56:03.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.622+0000 7f6872a00700 1 --2- 172.21.15.82:0/97002679 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5620afbc1060 0x5620afbc7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:03.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.622+0000 7f6872a00700 1 -- 172.21.15.82:0/97002679 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5620afbc59d0 msgr2=0x5620afbb6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:56:03.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.622+0000 7f6872a00700 1 --2- 172.21.15.82:0/97002679 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5620afbc59d0 0x5620afbb6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:03.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.622+0000 7f6872a00700 1 -- 172.21.15.82:0/97002679 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620afbbc9c0 con 0x5620afbc1980 2024-05-08T05:56:03.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.622+0000 7f6873400700 1 --2- 172.21.15.82:0/97002679 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5620afbc1060 0x5620afbc7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:56:03.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.622+0000 7f6873e00700 1 --2- 172.21.15.82:0/97002679 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5620afbc59d0 0x5620afbb6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:56:03.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.623+0000 7f6872a00700 1 --2- 172.21.15.82:0/97002679 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5620afbc1980 0x5620afbd6ca0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f68600093f0 tx=0x7f6860005f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bdb819370c218057 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:56:03.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.624+0000 7f685fe00700 1 -- 172.21.15.82:0/97002679 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68600aa920 con 0x5620afbc1980 2024-05-08T05:56:03.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.624+0000 7f685fe00700 1 -- 172.21.15.82:0/97002679 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f68600aabc0 con 0x5620afbc1980 2024-05-08T05:56:03.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.624+0000 7f685fe00700 1 -- 172.21.15.82:0/97002679 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68600b3060 con 0x5620afbc1980 2024-05-08T05:56:03.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.625+0000 7f68849d5b80 1 -- 172.21.15.82:0/97002679 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5620afbc1980 msgr2=0x5620afbd6ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:56:03.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.625+0000 7f68849d5b80 1 --2- 172.21.15.82:0/97002679 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5620afbc1980 0x5620afbd6ca0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f68600093f0 tx=0x7f6860005f10 comp rx=0 tx=0).stop 2024-05-08T05:56:03.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.626+0000 7f68849d5b80 1 -- 172.21.15.82:0/97002679 shutdown_connections 2024-05-08T05:56:03.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.626+0000 7f68849d5b80 1 --2- 172.21.15.82:0/97002679 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5620afbc59d0 0x5620afbb6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:03.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.626+0000 7f68849d5b80 1 --2- 172.21.15.82:0/97002679 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5620afbc1060 0x5620afbc7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:03.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.626+0000 7f68849d5b80 1 --2- 172.21.15.82:0/97002679 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5620afbc1980 0x5620afbd6ca0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:03.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.626+0000 7f68849d5b80 1 -- 172.21.15.82:0/97002679 >> 172.21.15.82:0/97002679 conn(0x5620afaefb60 msgr2=0x5620afbb5a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:56:03.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.626+0000 7f68849d5b80 1 -- 172.21.15.82:0/97002679 shutdown_connections 2024-05-08T05:56:03.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.627+0000 7f68849d5b80 1 -- 172.21.15.82:0/97002679 wait complete. 2024-05-08T05:56:03.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.628+0000 7f68849d5b80 1 -- start start 2024-05-08T05:56:03.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.628+0000 7f68849d5b80 1 Processor -- start 2024-05-08T05:56:03.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.630+0000 7f68849d5b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5620afbc1060 0x5620afbe1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:03.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.630+0000 7f68849d5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5620afbc1980 0x5620afbe2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:03.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.630+0000 7f6873400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5620afbc1060 0x5620afbe1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:03.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.631+0000 7f6873400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5620afbc1060 0x5620afbe1dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33558/0 (socket says 172.21.15.82:33558) 2024-05-08T05:56:03.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.631+0000 7f68849d5b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5620afbc59d0 0x5620afbe2850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:03.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.631+0000 7f68849d5b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f68741aad10 con 0x5620afbc1060 2024-05-08T05:56:03.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.631+0000 7f68849d5b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f68741aa640 con 0x5620afbc59d0 2024-05-08T05:56:03.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.631+0000 7f68849d5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f68741a7860 con 0x5620afbc1980 2024-05-08T05:56:03.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.631+0000 7f68849d5b80 10 client.0 _ll_register_callbacks cb 0x5620afabac70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:56:03.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.631+0000 7f6872a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5620afbc1980 0x5620afbe2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:03.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.631+0000 7f6872a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5620afbc1980 0x5620afbe2310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:36836/0 (socket says 172.21.15.82:36836) 2024-05-08T05:56:03.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.631+0000 7f6872a00700 1 -- 172.21.15.82:0/2977347269 learned_addr learned my addr 172.21.15.82:0/2977347269 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:56:03.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.631+0000 7f6873e00700 1 --2- 172.21.15.82:0/2977347269 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5620afbc59d0 0x5620afbe2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:03.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.632+0000 7f6872a00700 1 -- 172.21.15.82:0/2977347269 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5620afbc59d0 msgr2=0x5620afbe2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:56:03.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.632+0000 7f6872a00700 1 --2- 172.21.15.82:0/2977347269 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5620afbc59d0 0x5620afbe2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:03.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.632+0000 7f6872a00700 1 -- 172.21.15.82:0/2977347269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5620afbc1060 msgr2=0x5620afbe1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:56:03.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.632+0000 7f6872a00700 1 --2- 172.21.15.82:0/2977347269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5620afbc1060 0x5620afbe1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:03.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.632+0000 7f6872a00700 1 -- 172.21.15.82:0/2977347269 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620afc441f0 con 0x5620afbc1980 2024-05-08T05:56:03.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.632+0000 7f6873400700 1 --2- 172.21.15.82:0/2977347269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5620afbc1060 0x5620afbe1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:56:03.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.632+0000 7f6872a00700 1 --2- 172.21.15.82:0/2977347269 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5620afbc1980 0x5620afbe2310 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f68600a7850 tx=0x7f68600a9dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8590cba634132488 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:56:03.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.632+0000 7f685d600700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:56:03.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.632+0000 7f6873e00700 1 --2- 172.21.15.82:0/2977347269 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5620afbc59d0 0x5620afbe2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:56:03.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.633+0000 7f685d600700 1 -- 172.21.15.82:0/2977347269 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68600c3030 con 0x5620afbc1980 2024-05-08T05:56:03.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.633+0000 7f685d600700 1 -- 172.21.15.82:0/2977347269 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f686000fce0 con 0x5620afbc1980 2024-05-08T05:56:03.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.633+0000 7f68849d5b80 1 -- 172.21.15.82:0/2977347269 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68600aabc0 con 0x5620afbc1980 2024-05-08T05:56:03.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.634+0000 7f685d600700 1 -- 172.21.15.82:0/2977347269 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f68600aa4c0 con 0x5620afbc1980 2024-05-08T05:56:03.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.634+0000 7f68849d5b80 10 client.25804 fetch_fsmap learned FSMap version 31 2024-05-08T05:56:03.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.634+0000 7f68849d5b80 1 -- 172.21.15.82:0/2977347269 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5620afc453e0 con 0x5620afbc1980 2024-05-08T05:56:03.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.635+0000 7f685d600700 1 -- 172.21.15.82:0/2977347269 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f68600aabc0 con 0x5620afbc1980 2024-05-08T05:56:03.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.635+0000 7f685d600700 1 -- 172.21.15.82:0/2977347269 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f6860085b70 con 0x5620afbc1980 2024-05-08T05:56:03.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.635+0000 7f68849d5b80 10 client.25804 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:56:03.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.635+0000 7f68849d5b80 10 client.25804 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-05-08T05:56:03.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.635+0000 7f68849d5b80 20 client.25804 populate_metadata read hostname 'smithi082' 2024-05-08T05:56:03.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.635+0000 7f68849d5b80 1 --2- 172.21.15.82:0/2977347269 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x5620afc45920 0x5620afc47d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:03.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.635+0000 7f68849d5b80 4 client.25804 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:56:03.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.635+0000 7f68849d5b80 1 -- 172.21.15.82:0/2977347269 --> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5620afb21400 con 0x5620afc45920 2024-05-08T05:56:03.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.636+0000 7f6873400700 1 --2- 172.21.15.82:0/2977347269 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x5620afc45920 0x5620afc47d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:03.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.637+0000 7f685d600700 10 client.25804 ms_handle_connect on v2:172.21.15.151:6836/4192404464 2024-05-08T05:56:03.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.637+0000 7f6873400700 1 --2- 172.21.15.82:0/2977347269 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x5620afc45920 0x5620afc47d40 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bb8e2a11f6a22cc7 server_cookie=cb2a83697b8d1ee in_seq=0 out_seq=0 2024-05-08T05:56:03.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.638+0000 7f685d600700 1 -- 172.21.15.82:0/2977347269 <== mds.2 v2:172.21.15.151:6836/4192404464 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5620afb21400 con 0x5620afc45920 2024-05-08T05:56:03.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.638+0000 7f685d600700 10 client.25804 handle_command_reply: tid=0 2024-05-08T05:56:03.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.638+0000 7f68849d5b80 1 client.25804 shutdown 2024-05-08T05:56:03.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.638+0000 7f68849d5b80 1 -- 172.21.15.82:0/2977347269 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5620afbc1980 msgr2=0x5620afbe2310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:56:03.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.638+0000 7f68849d5b80 1 --2- 172.21.15.82:0/2977347269 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5620afbc1980 0x5620afbe2310 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f68600a7850 tx=0x7f68600a9dc0 comp rx=0 tx=0).stop 2024-05-08T05:56:03.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.638+0000 7f68849d5b80 1 -- 172.21.15.82:0/2977347269 shutdown_connections 2024-05-08T05:56:03.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.638+0000 7f68849d5b80 1 --2- 172.21.15.82:0/2977347269 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x5620afc45920 0x5620afc47d40 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:03.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.638+0000 7f68849d5b80 1 --2- 172.21.15.82:0/2977347269 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5620afbc59d0 0x5620afbe2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:03.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.638+0000 7f68849d5b80 1 --2- 172.21.15.82:0/2977347269 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5620afbc1060 0x5620afbe1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:03.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.638+0000 7f68849d5b80 1 --2- 172.21.15.82:0/2977347269 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5620afbc1980 0x5620afbe2310 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:03.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.638+0000 7f68849d5b80 1 -- 172.21.15.82:0/2977347269 >> 172.21.15.82:0/2977347269 conn(0x5620afaefb60 msgr2=0x5620afbb62b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:56:03.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.638+0000 7f685d600700 0 client.25804 ms_handle_reset on v2:172.21.15.151:6836/4192404464 2024-05-08T05:56:03.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.639+0000 7f68849d5b80 1 -- 172.21.15.82:0/2977347269 shutdown_connections 2024-05-08T05:56:03.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.639+0000 7f68849d5b80 1 -- 172.21.15.82:0/2977347269 wait complete. 2024-05-08T05:56:03.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.639+0000 7f68849d5b80 20 client.25804 trim_cache size 0 max 16384 2024-05-08T05:56:03.641 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T05:56:03.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.640+0000 7f687a000700 1 -- 172.21.15.82:0/3824975821 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f68580b2980 msgr2=0x7f68580b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:56:03.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.640+0000 7f687a000700 1 --2- 172.21.15.82:0/3824975821 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f68580b2980 0x7f68580b4e40 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6864009fd0 tx=0x7f6864009260 comp rx=0 tx=0).stop 2024-05-08T05:56:03.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.640+0000 7f687a000700 1 -- 172.21.15.82:0/3824975821 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68741060a0 msgr2=0x7f687410f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:56:03.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.640+0000 7f687a000700 1 --2- 172.21.15.82:0/3824975821 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68741060a0 0x7f687410f4d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6860000c00 tx=0x7f68600057c0 comp rx=0 tx=0).stop 2024-05-08T05:56:03.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.640+0000 7f687a000700 1 -- 172.21.15.82:0/3824975821 shutdown_connections 2024-05-08T05:56:03.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.640+0000 7f687a000700 1 --2- 172.21.15.82:0/3824975821 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f687410b6e0 0x7f687410fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:03.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.640+0000 7f687a000700 1 --2- 172.21.15.82:0/3824975821 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f68580b2980 0x7f68580b4e40 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:03.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.640+0000 7f687a000700 1 --2- 172.21.15.82:0/3824975821 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f68741056e0 0x7f6874112420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:03.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.640+0000 7f687a000700 1 --2- 172.21.15.82:0/3824975821 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68741060a0 0x7f687410f4d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:03.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.640+0000 7f687a000700 1 -- 172.21.15.82:0/3824975821 >> 172.21.15.82:0/3824975821 conn(0x7f68741011d0 msgr2=0x7f68741017e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:56:03.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.641+0000 7f687a000700 1 -- 172.21.15.82:0/3824975821 shutdown_connections 2024-05-08T05:56:03.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:03.641+0000 7f687a000700 1 -- 172.21.15.82:0/3824975821 wait complete. 2024-05-08T05:56:03.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:56:03 smithi151 ceph-mon[34815]: pgmap v621: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 6.6 MiB/s wr, 653 op/s 2024-05-08T05:56:04.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:56:03 smithi134 ceph-mon[34132]: pgmap v621: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 6.6 MiB/s wr, 653 op/s 2024-05-08T05:56:04.531 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-05-08T05:56:05.142 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:56:05.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 315.0 s, 2304.6 tps, lat 43.671 ms stddev 48.868 2024-05-08T05:56:05.598 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:56:05 smithi082 ceph-mon[30098]: pgmap v622: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.9 MiB/s wr, 690 op/s 2024-05-08T05:56:05.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:56:05 smithi151 ceph-mon[34815]: pgmap v622: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.9 MiB/s wr, 690 op/s 2024-05-08T05:56:05.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:56:05 smithi134 ceph-mon[34132]: pgmap v622: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.9 MiB/s wr, 690 op/s 2024-05-08T05:56:07.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:56:07 smithi082 ceph-mon[30098]: pgmap v623: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.6 MiB/s wr, 769 op/s 2024-05-08T05:56:07.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:56:07 smithi151 ceph-mon[34815]: pgmap v623: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.6 MiB/s wr, 769 op/s 2024-05-08T05:56:08.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:56:07 smithi134 ceph-mon[34132]: pgmap v623: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.6 MiB/s wr, 769 op/s 2024-05-08T05:56:08.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.248+0000 7f596be00700 1 -- 172.21.15.82:0/1777230321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5964106060 msgr2=0x7f5964112570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:56:08.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.248+0000 7f596be00700 1 --2- 172.21.15.82:0/1777230321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5964106060 0x7f5964112570 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f595c009f90 tx=0x7f595c00b330 comp rx=0 tx=0).stop 2024-05-08T05:56:08.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.248+0000 7f596be00700 1 -- 172.21.15.82:0/1777230321 shutdown_connections 2024-05-08T05:56:08.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.249+0000 7f596be00700 1 --2- 172.21.15.82:0/1777230321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5964106060 0x7f5964112570 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:08.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.249+0000 7f596be00700 1 --2- 172.21.15.82:0/1777230321 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f596410b6a0 0x7f596410ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:08.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.249+0000 7f596be00700 1 --2- 172.21.15.82:0/1777230321 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f59641056a0 0x7f5964105b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:08.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.249+0000 7f596be00700 1 -- 172.21.15.82:0/1777230321 >> 172.21.15.82:0/1777230321 conn(0x7f59641011b0 msgr2=0x7f59641035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:56:08.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.249+0000 7f596be00700 1 -- 172.21.15.82:0/1777230321 shutdown_connections 2024-05-08T05:56:08.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.249+0000 7f596be00700 1 -- 172.21.15.82:0/1777230321 wait complete. 2024-05-08T05:56:08.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.251+0000 7f596be00700 1 Processor -- start 2024-05-08T05:56:08.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.252+0000 7f596be00700 1 -- start start 2024-05-08T05:56:08.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.253+0000 7f596be00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59641056a0 0x7f5964112330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:08.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.253+0000 7f596be00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5964106060 0x7f596410f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:08.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.253+0000 7f596be00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f596410b6a0 0x7f596410fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:08.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.253+0000 7f5969400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59641056a0 0x7f5964112330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:08.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.253+0000 7f5969400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59641056a0 0x7f5964112330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:44824/0 (socket says 172.21.15.82:44824) 2024-05-08T05:56:08.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.253+0000 7f5968a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5964106060 0x7f596410f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:08.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.253+0000 7f5968a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5964106060 0x7f596410f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:36858/0 (socket says 172.21.15.82:36858) 2024-05-08T05:56:08.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.254+0000 7f596be00700 1 -- 172.21.15.82:0/1723949800 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f59641158e0 con 0x7f596410b6a0 2024-05-08T05:56:08.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.254+0000 7f596be00700 1 -- 172.21.15.82:0/1723949800 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5964115760 con 0x7f59641056a0 2024-05-08T05:56:08.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.254+0000 7f596be00700 1 -- 172.21.15.82:0/1723949800 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5964115a60 con 0x7f5964106060 2024-05-08T05:56:08.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.254+0000 7f5969e00700 1 --2- 172.21.15.82:0/1723949800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f596410b6a0 0x7f596410fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:08.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.254+0000 7f5969400700 1 -- 172.21.15.82:0/1723949800 learned_addr learned my addr 172.21.15.82:0/1723949800 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:56:08.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.254+0000 7f5968a00700 1 -- 172.21.15.82:0/1723949800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59641056a0 msgr2=0x7f5964112330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:56:08.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.254+0000 7f5968a00700 1 --2- 172.21.15.82:0/1723949800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59641056a0 0x7f5964112330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:08.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.254+0000 7f5968a00700 1 -- 172.21.15.82:0/1723949800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f596410b6a0 msgr2=0x7f596410fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:56:08.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.254+0000 7f5968a00700 1 --2- 172.21.15.82:0/1723949800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f596410b6a0 0x7f596410fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:08.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.254+0000 7f5968a00700 1 -- 172.21.15.82:0/1723949800 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5964110340 con 0x7f5964106060 2024-05-08T05:56:08.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.254+0000 7f5969e00700 1 --2- 172.21.15.82:0/1723949800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f596410b6a0 0x7f596410fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:56:08.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.254+0000 7f5969400700 1 --2- 172.21.15.82:0/1723949800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59641056a0 0x7f5964112330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:56:08.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.255+0000 7f5968a00700 1 --2- 172.21.15.82:0/1723949800 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5964106060 0x7f596410f500 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f595000eb90 tx=0x7f595000eea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:56:08.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.257+0000 7f5962000700 1 -- 172.21.15.82:0/1723949800 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595000ccf0 con 0x7f5964106060 2024-05-08T05:56:08.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.257+0000 7f5962000700 1 -- 172.21.15.82:0/1723949800 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f59500044d0 con 0x7f5964106060 2024-05-08T05:56:08.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.257+0000 7f5962000700 1 -- 172.21.15.82:0/1723949800 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5950010430 con 0x7f5964106060 2024-05-08T05:56:08.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.258+0000 7f596be00700 1 -- 172.21.15.82:0/1723949800 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59641a1e00 con 0x7f5964106060 2024-05-08T05:56:08.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.258+0000 7f596be00700 1 -- 172.21.15.82:0/1723949800 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59641a22f0 con 0x7f5964106060 2024-05-08T05:56:08.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.264+0000 7f5962000700 1 -- 172.21.15.82:0/1723949800 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f5950003680 con 0x7f5964106060 2024-05-08T05:56:08.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.265+0000 7f59766ebb80 1 Processor -- start 2024-05-08T05:56:08.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.265+0000 7f59766ebb80 1 -- start start 2024-05-08T05:56:08.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.266+0000 7f5962000700 1 --2- 172.21.15.82:0/1723949800 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f594c0b29d0 0x7f594c0b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:08.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.267+0000 7f59766ebb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d5888bbc0 0x558d5888bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:08.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.267+0000 7f59766ebb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d5888c4e0 0x558d588862d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:08.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.267+0000 7f59766ebb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558d588868f0 0x558d58886d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:08.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.267+0000 7f59766ebb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x558d587d8a20 con 0x558d588868f0 2024-05-08T05:56:08.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.267+0000 7f59766ebb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558d58776760 con 0x558d5888c4e0 2024-05-08T05:56:08.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.267+0000 7f59766ebb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x558d587d49e0 con 0x558d5888bbc0 2024-05-08T05:56:08.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.267+0000 7f5968a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d5888c4e0 0x558d588862d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:08.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.267+0000 7f5969400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d5888bbc0 0x558d5888bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:08.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.267+0000 7f5968a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d5888c4e0 0x558d588862d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:44836/0 (socket says 172.21.15.82:44836) 2024-05-08T05:56:08.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.267+0000 7f5968a00700 1 -- 172.21.15.82:0/1134561311 learned_addr learned my addr 172.21.15.82:0/1134561311 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:56:08.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.268+0000 7f5969400700 1 -- 172.21.15.82:0/1134561311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d5888c4e0 msgr2=0x558d588862d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:56:08.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.268+0000 7f5969400700 1 --2- 172.21.15.82:0/1134561311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d5888c4e0 0x558d588862d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:08.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.268+0000 7f5969400700 1 -- 172.21.15.82:0/1134561311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558d588868f0 msgr2=0x558d58886d70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T05:56:08.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.268+0000 7f5969400700 1 --2- 172.21.15.82:0/1134561311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558d588868f0 0x558d58886d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:08.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.268+0000 7f5969400700 1 -- 172.21.15.82:0/1134561311 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d587258d0 con 0x558d5888bbc0 2024-05-08T05:56:08.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.268+0000 7f5962000700 1 -- 172.21.15.82:0/1723949800 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f59500e2540 con 0x7f5964106060 2024-05-08T05:56:08.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.268+0000 7f5969e00700 1 --2- 172.21.15.82:0/1723949800 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f594c0b29d0 0x7f594c0b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:08.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.268+0000 7f5969400700 1 --2- 172.21.15.82:0/1134561311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d5888bbc0 0x558d5888bfa0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5964110c40 tx=0x7f59580117f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26262c378fa9d8f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:56:08.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.268+0000 7f5956a00700 1 -- 172.21.15.82:0/1134561311 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5958004230 con 0x558d5888bbc0 2024-05-08T05:56:08.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.269+0000 7f5956a00700 1 -- 172.21.15.82:0/1134561311 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5958004ce0 con 0x558d5888bbc0 2024-05-08T05:56:08.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.269+0000 7f5956a00700 1 -- 172.21.15.82:0/1134561311 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5958003680 con 0x558d5888bbc0 2024-05-08T05:56:08.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.270+0000 7f59766ebb80 1 -- 172.21.15.82:0/1134561311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d5888bbc0 msgr2=0x558d5888bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:56:08.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.270+0000 7f59766ebb80 1 --2- 172.21.15.82:0/1134561311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d5888bbc0 0x558d5888bfa0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5964110c40 tx=0x7f59580117f0 comp rx=0 tx=0).stop 2024-05-08T05:56:08.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.270+0000 7f5969e00700 1 --2- 172.21.15.82:0/1723949800 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f594c0b29d0 0x7f594c0b4e90 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f595c009790 tx=0x7f595c0096c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:56:08.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.270+0000 7f59766ebb80 1 -- 172.21.15.82:0/1134561311 shutdown_connections 2024-05-08T05:56:08.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.270+0000 7f59766ebb80 1 --2- 172.21.15.82:0/1134561311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558d588868f0 0x558d58886d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:08.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.270+0000 7f59766ebb80 1 --2- 172.21.15.82:0/1134561311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d5888bbc0 0x558d5888bfa0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:08.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.270+0000 7f59766ebb80 1 --2- 172.21.15.82:0/1134561311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d5888c4e0 0x558d588862d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:08.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.270+0000 7f59766ebb80 1 -- 172.21.15.82:0/1134561311 >> 172.21.15.82:0/1134561311 conn(0x558d587fe6d0 msgr2=0x558d58880b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:56:08.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.270+0000 7f59766ebb80 1 -- 172.21.15.82:0/1134561311 shutdown_connections 2024-05-08T05:56:08.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.270+0000 7f59766ebb80 1 -- 172.21.15.82:0/1134561311 wait complete. 2024-05-08T05:56:08.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.271+0000 7f59766ebb80 1 -- start start 2024-05-08T05:56:08.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.271+0000 7f59766ebb80 1 Processor -- start 2024-05-08T05:56:08.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.272+0000 7f59766ebb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d588868f0 0x558d588921c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:08.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.272+0000 7f59766ebb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d5888bbc0 0x558d5888f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:08.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.272+0000 7f59766ebb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558d5888c4e0 0x558d5888faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:08.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.272+0000 7f59766ebb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x558d58892f20 con 0x558d5888c4e0 2024-05-08T05:56:08.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.272+0000 7f59766ebb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558d5873eb20 con 0x558d588868f0 2024-05-08T05:56:08.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.272+0000 7f59766ebb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x558d588930a0 con 0x558d5888bbc0 2024-05-08T05:56:08.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.272+0000 7f59766ebb80 10 client.0 _ll_register_callbacks cb 0x558d5877fc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:56:08.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.272+0000 7f5969400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d588868f0 0x558d588921c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:08.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.272+0000 7f5968a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d5888bbc0 0x558d5888f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:08.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.272+0000 7f5969e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558d5888c4e0 0x558d5888faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:08.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.272+0000 7f5969400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d588868f0 0x558d588921c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:44850/0 (socket says 172.21.15.82:44850) 2024-05-08T05:56:08.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.272+0000 7f5969400700 1 -- 172.21.15.82:0/842073608 learned_addr learned my addr 172.21.15.82:0/842073608 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:56:08.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.273+0000 7f5969400700 1 -- 172.21.15.82:0/842073608 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d5888bbc0 msgr2=0x558d5888f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:56:08.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.273+0000 7f5969400700 1 --2- 172.21.15.82:0/842073608 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d5888bbc0 0x558d5888f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:08.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.273+0000 7f5969400700 1 -- 172.21.15.82:0/842073608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558d5888c4e0 msgr2=0x558d5888faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:56:08.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.273+0000 7f5969400700 1 --2- 172.21.15.82:0/842073608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558d5888c4e0 0x558d5888faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:08.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.273+0000 7f5969400700 1 -- 172.21.15.82:0/842073608 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d5879e420 con 0x558d588868f0 2024-05-08T05:56:08.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.273+0000 7f5969e00700 1 --2- 172.21.15.82:0/842073608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558d5888c4e0 0x558d5888faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:56:08.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.274+0000 7f5969400700 1 --2- 172.21.15.82:0/842073608 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d588868f0 0x558d588921c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f59580051c0 tx=0x7f59580056e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54de4587c5d60ef7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:56:08.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.274+0000 7f594b400700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:56:08.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.274+0000 7f594b400700 1 -- 172.21.15.82:0/842073608 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5958037070 con 0x558d588868f0 2024-05-08T05:56:08.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.275+0000 7f594b400700 1 -- 172.21.15.82:0/842073608 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f59580049e0 con 0x558d588868f0 2024-05-08T05:56:08.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.275+0000 7f59766ebb80 1 -- 172.21.15.82:0/842073608 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5958004ce0 con 0x558d588868f0 2024-05-08T05:56:08.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.275+0000 7f594b400700 1 -- 172.21.15.82:0/842073608 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f5958041050 con 0x558d588868f0 2024-05-08T05:56:08.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.275+0000 7f59766ebb80 10 client.25781 fetch_fsmap learned FSMap version 31 2024-05-08T05:56:08.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.275+0000 7f59766ebb80 1 -- 172.21.15.82:0/842073608 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x558d5889d780 con 0x558d588868f0 2024-05-08T05:56:08.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.276+0000 7f594b400700 1 -- 172.21.15.82:0/842073608 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5958004ce0 con 0x558d588868f0 2024-05-08T05:56:08.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.276+0000 7f594b400700 1 -- 172.21.15.82:0/842073608 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f595803c5e0 con 0x558d588868f0 2024-05-08T05:56:08.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.276+0000 7f59766ebb80 10 client.25781 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:56:08.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.276+0000 7f59766ebb80 10 client.25781 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-08T05:56:08.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.276+0000 7f59766ebb80 20 client.25781 populate_metadata read hostname 'smithi082' 2024-05-08T05:56:08.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.276+0000 7f59766ebb80 1 --2- 172.21.15.82:0/842073608 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x558d588a0070 0x558d588a24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:08.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.276+0000 7f59766ebb80 4 client.25781 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:56:08.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.276+0000 7f59766ebb80 1 -- 172.21.15.82:0/842073608 --> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558d58853140 con 0x558d588a0070 2024-05-08T05:56:08.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.276+0000 7f5968a00700 1 --2- 172.21.15.82:0/842073608 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x558d588a0070 0x558d588a24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:08.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.277+0000 7f5968a00700 1 --2- 172.21.15.82:0/842073608 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x558d588a0070 0x558d588a24c0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=11df4ad06dd4a5c1 server_cookie=5fe165270debdcde in_seq=0 out_seq=0 2024-05-08T05:56:08.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.277+0000 7f594b400700 10 client.25781 ms_handle_connect on v2:172.21.15.151:6838/2963754236 2024-05-08T05:56:08.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.277+0000 7f594b400700 1 -- 172.21.15.82:0/842073608 <== mds.1 v2:172.21.15.151:6838/2963754236 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x558d58853140 con 0x558d588a0070 2024-05-08T05:56:08.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.277+0000 7f594b400700 10 client.25781 handle_command_reply: tid=0 2024-05-08T05:56:08.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.278+0000 7f59766ebb80 1 client.25781 shutdown 2024-05-08T05:56:08.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.278+0000 7f59766ebb80 1 -- 172.21.15.82:0/842073608 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d588868f0 msgr2=0x558d588921c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:56:08.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.278+0000 7f59766ebb80 1 --2- 172.21.15.82:0/842073608 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d588868f0 0x558d588921c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f59580051c0 tx=0x7f59580056e0 comp rx=0 tx=0).stop 2024-05-08T05:56:08.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.279+0000 7f59766ebb80 1 -- 172.21.15.82:0/842073608 shutdown_connections 2024-05-08T05:56:08.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.279+0000 7f59766ebb80 1 --2- 172.21.15.82:0/842073608 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x558d588a0070 0x558d588a24c0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:08.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.279+0000 7f59766ebb80 1 --2- 172.21.15.82:0/842073608 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d588868f0 0x558d588921c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:08.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.279+0000 7f59766ebb80 1 --2- 172.21.15.82:0/842073608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558d5888c4e0 0x558d5888faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:08.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.279+0000 7f59766ebb80 1 --2- 172.21.15.82:0/842073608 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d5888bbc0 0x558d5888f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:08.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.279+0000 7f59766ebb80 1 -- 172.21.15.82:0/842073608 >> 172.21.15.82:0/842073608 conn(0x558d587fe6d0 msgr2=0x558d58880190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:56:08.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.279+0000 7f594b400700 0 client.25781 ms_handle_reset on v2:172.21.15.151:6838/2963754236 2024-05-08T05:56:08.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.279+0000 7f59766ebb80 1 -- 172.21.15.82:0/842073608 shutdown_connections 2024-05-08T05:56:08.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.279+0000 7f59766ebb80 1 -- 172.21.15.82:0/842073608 wait complete. 2024-05-08T05:56:08.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.280+0000 7f59766ebb80 20 client.25781 trim_cache size 0 max 16384 2024-05-08T05:56:08.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.304+0000 7f59766ebb80 1 Processor -- start 2024-05-08T05:56:08.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.304+0000 7f59766ebb80 1 -- start start 2024-05-08T05:56:08.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.304+0000 7f59766ebb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d588868f0 0x558d58891a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:08.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.304+0000 7f59766ebb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d5888bbc0 0x558d5889bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:08.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.304+0000 7f59766ebb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558d5888c4e0 0x558d5888cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:08.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.304+0000 7f59766ebb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5964073340 con 0x558d5888c4e0 2024-05-08T05:56:08.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.304+0000 7f59766ebb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5964074e80 con 0x558d5888bbc0 2024-05-08T05:56:08.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.304+0000 7f59766ebb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5964073a10 con 0x558d588868f0 2024-05-08T05:56:08.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.305+0000 7f5969400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d588868f0 0x558d58891a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:08.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.305+0000 7f5968a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d5888bbc0 0x558d5889bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:08.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.305+0000 7f5969400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d588868f0 0x558d58891a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:36882/0 (socket says 172.21.15.82:36882) 2024-05-08T05:56:08.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.305+0000 7f5969400700 1 -- 172.21.15.82:0/2805257038 learned_addr learned my addr 172.21.15.82:0/2805257038 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:56:08.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.305+0000 7f5968a00700 1 -- 172.21.15.82:0/2805257038 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d588868f0 msgr2=0x558d58891a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:56:08.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.305+0000 7f5968a00700 1 --2- 172.21.15.82:0/2805257038 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d588868f0 0x558d58891a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:08.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.305+0000 7f5968a00700 1 -- 172.21.15.82:0/2805257038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558d5888c4e0 msgr2=0x558d5888cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:56:08.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.305+0000 7f5968a00700 1 --2- 172.21.15.82:0/2805257038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558d5888c4e0 0x558d5888cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:08.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.305+0000 7f5968a00700 1 -- 172.21.15.82:0/2805257038 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558d58893050 con 0x558d5888bbc0 2024-05-08T05:56:08.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.305+0000 7f5968a00700 1 --2- 172.21.15.82:0/2805257038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d5888bbc0 0x558d5889bfb0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f59500a9b00 tx=0x7f59500c8040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7cf83aa5a5c5ae6b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:56:08.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.305+0000 7f5956000700 1 -- 172.21.15.82:0/2805257038 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59500c4460 con 0x558d5888bbc0 2024-05-08T05:56:08.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.306+0000 7f5956000700 1 -- 172.21.15.82:0/2805257038 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f59500b2310 con 0x558d5888bbc0 2024-05-08T05:56:08.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.306+0000 7f5956000700 1 -- 172.21.15.82:0/2805257038 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59500a9b70 con 0x558d5888bbc0 2024-05-08T05:56:08.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.306+0000 7f59766ebb80 1 -- 172.21.15.82:0/2805257038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d5888bbc0 msgr2=0x558d5889bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:56:08.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.307+0000 7f59766ebb80 1 --2- 172.21.15.82:0/2805257038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d5888bbc0 0x558d5889bfb0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f59500a9b00 tx=0x7f59500c8040 comp rx=0 tx=0).stop 2024-05-08T05:56:08.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.308+0000 7f59766ebb80 1 -- 172.21.15.82:0/2805257038 shutdown_connections 2024-05-08T05:56:08.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.308+0000 7f59766ebb80 1 --2- 172.21.15.82:0/2805257038 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558d5888c4e0 0x558d5888cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:08.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.308+0000 7f59766ebb80 1 --2- 172.21.15.82:0/2805257038 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d588868f0 0x558d58891a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:08.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.308+0000 7f59766ebb80 1 --2- 172.21.15.82:0/2805257038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d5888bbc0 0x558d5889bfb0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:08.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.308+0000 7f59766ebb80 1 -- 172.21.15.82:0/2805257038 >> 172.21.15.82:0/2805257038 conn(0x558d587fe6d0 msgr2=0x558d5888c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:56:08.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.308+0000 7f59766ebb80 1 -- 172.21.15.82:0/2805257038 shutdown_connections 2024-05-08T05:56:08.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.308+0000 7f59766ebb80 1 -- 172.21.15.82:0/2805257038 wait complete. 2024-05-08T05:56:08.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.309+0000 7f59766ebb80 1 -- start start 2024-05-08T05:56:08.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.309+0000 7f59766ebb80 1 Processor -- start 2024-05-08T05:56:08.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.310+0000 7f59766ebb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d588868f0 0x558d58898330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:08.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.310+0000 7f59766ebb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558d5888bbc0 0x558d58898870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:08.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.310+0000 7f59766ebb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d5888c4e0 0x558d588a6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:08.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.311+0000 7f59766ebb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f59640747b0 con 0x558d5888bbc0 2024-05-08T05:56:08.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.311+0000 7f5969e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d5888c4e0 0x558d588a6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:08.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.311+0000 7f5969e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d5888c4e0 0x558d588a6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:44868/0 (socket says 172.21.15.82:44868) 2024-05-08T05:56:08.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.311+0000 7f5969e00700 1 -- 172.21.15.82:0/4231854270 learned_addr learned my addr 172.21.15.82:0/4231854270 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:56:08.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.311+0000 7f59766ebb80 1 -- 172.21.15.82:0/4231854270 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f59640740e0 con 0x558d5888c4e0 2024-05-08T05:56:08.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.311+0000 7f5969400700 1 --2- 172.21.15.82:0/4231854270 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d588868f0 0x558d58898330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:08.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.311+0000 7f59766ebb80 1 -- 172.21.15.82:0/4231854270 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f59640712a0 con 0x558d588868f0 2024-05-08T05:56:08.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.312+0000 7f59766ebb80 10 client.0 _ll_register_callbacks cb 0x558d5877fc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:56:08.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.312+0000 7f5968a00700 1 --2- 172.21.15.82:0/4231854270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558d5888bbc0 0x558d58898870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:08.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.312+0000 7f5969e00700 1 -- 172.21.15.82:0/4231854270 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d588868f0 msgr2=0x558d58898330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:56:08.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.312+0000 7f5969e00700 1 --2- 172.21.15.82:0/4231854270 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d588868f0 0x558d58898330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:08.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.313+0000 7f5969e00700 1 -- 172.21.15.82:0/4231854270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558d5888bbc0 msgr2=0x558d58898870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:56:08.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.313+0000 7f5969e00700 1 --2- 172.21.15.82:0/4231854270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558d5888bbc0 0x558d58898870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:08.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.313+0000 7f5969e00700 1 -- 172.21.15.82:0/4231854270 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558d588a75d0 con 0x558d5888c4e0 2024-05-08T05:56:08.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.313+0000 7f5968a00700 1 --2- 172.21.15.82:0/4231854270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558d5888bbc0 0x558d58898870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:56:08.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.314+0000 7f5969e00700 1 --2- 172.21.15.82:0/4231854270 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d5888c4e0 0x558d588a6dc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f595c009f90 tx=0x7f595c007980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd7ff73a428335fb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:56:08.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.314+0000 7f594b400700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:56:08.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.315+0000 7f594b400700 1 -- 172.21.15.82:0/4231854270 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f595c02c070 con 0x558d5888c4e0 2024-05-08T05:56:08.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.315+0000 7f594b400700 1 -- 172.21.15.82:0/4231854270 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f595c01c850 con 0x558d5888c4e0 2024-05-08T05:56:08.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.315+0000 7f59766ebb80 1 -- 172.21.15.82:0/4231854270 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558d587e6400 con 0x558d5888c4e0 2024-05-08T05:56:08.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.316+0000 7f594b400700 1 -- 172.21.15.82:0/4231854270 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f595c020070 con 0x558d5888c4e0 2024-05-08T05:56:08.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.316+0000 7f59766ebb80 10 client.25787 fetch_fsmap learned FSMap version 31 2024-05-08T05:56:08.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.316+0000 7f59766ebb80 1 -- 172.21.15.82:0/4231854270 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x558d58909980 con 0x558d5888c4e0 2024-05-08T05:56:08.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.316+0000 7f594b400700 1 -- 172.21.15.82:0/4231854270 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x558d587e6400 con 0x558d5888c4e0 2024-05-08T05:56:08.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.318+0000 7f594b400700 1 -- 172.21.15.82:0/4231854270 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f595c011070 con 0x558d5888c4e0 2024-05-08T05:56:08.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.318+0000 7f59766ebb80 10 client.25787 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:56:08.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.318+0000 7f59766ebb80 10 client.25787 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-08T05:56:08.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.318+0000 7f59766ebb80 20 client.25787 populate_metadata read hostname 'smithi082' 2024-05-08T05:56:08.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.318+0000 7f59766ebb80 1 --2- 172.21.15.82:0/4231854270 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x558d58909f70 0x558d5890c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:08.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.318+0000 7f59766ebb80 4 client.25787 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:56:08.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.318+0000 7f59766ebb80 1 -- 172.21.15.82:0/4231854270 --> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558d587e04a0 con 0x558d58909f70 2024-05-08T05:56:08.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.318+0000 7f5969400700 1 --2- 172.21.15.82:0/4231854270 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x558d58909f70 0x558d5890c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:08.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.319+0000 7f5969400700 1 --2- 172.21.15.82:0/4231854270 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x558d58909f70 0x558d5890c390 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5c951d221104790a server_cookie=1f23c3c44d8485e5 in_seq=0 out_seq=0 2024-05-08T05:56:08.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.319+0000 7f594b400700 10 client.25787 ms_handle_connect on v2:172.21.15.151:6838/2963754236 2024-05-08T05:56:08.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.320+0000 7f594b400700 1 -- 172.21.15.82:0/4231854270 <== mds.1 v2:172.21.15.151:6838/2963754236 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558d587e04a0 con 0x558d58909f70 2024-05-08T05:56:08.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.320+0000 7f594b400700 10 client.25787 handle_command_reply: tid=0 2024-05-08T05:56:08.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.320+0000 7f59766ebb80 1 client.25787 shutdown 2024-05-08T05:56:08.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.320+0000 7f59766ebb80 1 -- 172.21.15.82:0/4231854270 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d5888c4e0 msgr2=0x558d588a6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:56:08.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.320+0000 7f59766ebb80 1 --2- 172.21.15.82:0/4231854270 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d5888c4e0 0x558d588a6dc0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f595c009f90 tx=0x7f595c007980 comp rx=0 tx=0).stop 2024-05-08T05:56:08.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.320+0000 7f59766ebb80 1 -- 172.21.15.82:0/4231854270 shutdown_connections 2024-05-08T05:56:08.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.321+0000 7f59766ebb80 1 --2- 172.21.15.82:0/4231854270 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x558d58909f70 0x558d5890c390 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:08.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.321+0000 7f59766ebb80 1 --2- 172.21.15.82:0/4231854270 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558d5888c4e0 0x558d588a6dc0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:08.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.321+0000 7f59766ebb80 1 --2- 172.21.15.82:0/4231854270 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d588868f0 0x558d58898330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:08.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.321+0000 7f59766ebb80 1 --2- 172.21.15.82:0/4231854270 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558d5888bbc0 0x558d58898870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:08.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.321+0000 7f59766ebb80 1 -- 172.21.15.82:0/4231854270 >> 172.21.15.82:0/4231854270 conn(0x558d587fe6d0 msgr2=0x558d5888a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:56:08.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.321+0000 7f594b400700 0 client.25787 ms_handle_reset on v2:172.21.15.151:6838/2963754236 2024-05-08T05:56:08.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.321+0000 7f59766ebb80 1 -- 172.21.15.82:0/4231854270 shutdown_connections 2024-05-08T05:56:08.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.321+0000 7f59766ebb80 1 -- 172.21.15.82:0/4231854270 wait complete. 2024-05-08T05:56:08.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.322+0000 7f59766ebb80 20 client.25787 trim_cache size 0 max 16384 2024-05-08T05:56:08.323 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T05:56:08.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.322+0000 7f596be00700 1 -- 172.21.15.82:0/1723949800 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f594c0b29d0 msgr2=0x7f594c0b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:56:08.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.322+0000 7f596be00700 1 --2- 172.21.15.82:0/1723949800 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f594c0b29d0 0x7f594c0b4e90 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f595c009790 tx=0x7f595c0096c0 comp rx=0 tx=0).stop 2024-05-08T05:56:08.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.322+0000 7f596be00700 1 -- 172.21.15.82:0/1723949800 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5964106060 msgr2=0x7f596410f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:56:08.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.322+0000 7f596be00700 1 --2- 172.21.15.82:0/1723949800 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5964106060 0x7f596410f500 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f595000eb90 tx=0x7f595000eea0 comp rx=0 tx=0).stop 2024-05-08T05:56:08.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.322+0000 7f596be00700 1 -- 172.21.15.82:0/1723949800 shutdown_connections 2024-05-08T05:56:08.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.322+0000 7f596be00700 1 --2- 172.21.15.82:0/1723949800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59641056a0 0x7f5964112330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:08.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.322+0000 7f596be00700 1 --2- 172.21.15.82:0/1723949800 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f594c0b29d0 0x7f594c0b4e90 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:08.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.322+0000 7f596be00700 1 --2- 172.21.15.82:0/1723949800 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f596410b6a0 0x7f596410fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:08.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.322+0000 7f596be00700 1 --2- 172.21.15.82:0/1723949800 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5964106060 0x7f596410f500 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:08.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.322+0000 7f596be00700 1 -- 172.21.15.82:0/1723949800 >> 172.21.15.82:0/1723949800 conn(0x7f59641011b0 msgr2=0x7f59641017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:56:08.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.323+0000 7f596be00700 1 -- 172.21.15.82:0/1723949800 shutdown_connections 2024-05-08T05:56:08.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:08.323+0000 7f596be00700 1 -- 172.21.15.82:0/1723949800 wait complete. 2024-05-08T05:56:09.271 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-05-08T05:56:09.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:56:09 smithi151 ceph-mon[34815]: pgmap v624: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.3 MiB/s wr, 651 op/s 2024-05-08T05:56:09.888 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:56:09.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:56:09 smithi082 ceph-mon[30098]: pgmap v624: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.3 MiB/s wr, 651 op/s 2024-05-08T05:56:09.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:56:09 smithi134 ceph-mon[34132]: pgmap v624: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.3 MiB/s wr, 651 op/s 2024-05-08T05:56:10.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 320.0 s, 2132.4 tps, lat 46.470 ms stddev 49.867 2024-05-08T05:56:11.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:56:11 smithi151 ceph-mon[34815]: pgmap v625: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 MiB/s wr, 768 op/s 2024-05-08T05:56:11.958 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:56:11 smithi082 ceph-mon[30098]: pgmap v625: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 MiB/s wr, 768 op/s 2024-05-08T05:56:11.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:56:11 smithi134 ceph-mon[34132]: pgmap v625: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 MiB/s wr, 768 op/s 2024-05-08T05:56:13.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.424+0000 7f080fa00700 1 -- 172.21.15.82:0/883774077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08081083d0 msgr2=0x7f080806b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:56:13.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.424+0000 7f080fa00700 1 --2- 172.21.15.82:0/883774077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08081083d0 0x7f080806b1b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f07fc0098f0 tx=0x7f07fc009c00 comp rx=0 tx=0).stop 2024-05-08T05:56:13.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.425+0000 7f080fa00700 1 -- 172.21.15.82:0/883774077 shutdown_connections 2024-05-08T05:56:13.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.425+0000 7f080fa00700 1 --2- 172.21.15.82:0/883774077 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0808105ee0 0x7f0808106370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:13.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.425+0000 7f080fa00700 1 --2- 172.21.15.82:0/883774077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08081083d0 0x7f080806b1b0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:13.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.425+0000 7f080fa00700 1 --2- 172.21.15.82:0/883774077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f080806b6f0 0x7f080806bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:13.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.425+0000 7f080fa00700 1 -- 172.21.15.82:0/883774077 >> 172.21.15.82:0/883774077 conn(0x7f0808079350 msgr2=0x7f0808079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:56:13.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.426+0000 7f080fa00700 1 -- 172.21.15.82:0/883774077 shutdown_connections 2024-05-08T05:56:13.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.426+0000 7f080fa00700 1 -- 172.21.15.82:0/883774077 wait complete. 2024-05-08T05:56:13.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.427+0000 7f080fa00700 1 Processor -- start 2024-05-08T05:56:13.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.427+0000 7f080fa00700 1 -- start start 2024-05-08T05:56:13.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.428+0000 7f080fa00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f080806b6f0 0x7f08081a01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:13.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.428+0000 7f080fa00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0808105ee0 0x7f08081a0720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:13.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.428+0000 7f080fa00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08081083d0 0x7f08081a4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:13.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.428+0000 7f080fa00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0808119c10 con 0x7f08081083d0 2024-05-08T05:56:13.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.428+0000 7f080fa00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0808119a90 con 0x7f0808105ee0 2024-05-08T05:56:13.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.428+0000 7f080fa00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0808119d90 con 0x7f080806b6f0 2024-05-08T05:56:13.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.428+0000 7f0807e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0808105ee0 0x7f08081a0720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:13.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.428+0000 7f0807e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0808105ee0 0x7f08081a0720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:58340/0 (socket says 172.21.15.82:58340) 2024-05-08T05:56:13.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.428+0000 7f0807e00700 1 -- 172.21.15.82:0/3528637509 learned_addr learned my addr 172.21.15.82:0/3528637509 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:56:13.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.428+0000 7f080da00700 1 --2- 172.21.15.82:0/3528637509 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08081083d0 0x7f08081a4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:13.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.428+0000 7f080d000700 1 --2- 172.21.15.82:0/3528637509 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f080806b6f0 0x7f08081a01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:13.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.429+0000 7f0807e00700 1 -- 172.21.15.82:0/3528637509 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f080806b6f0 msgr2=0x7f08081a01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:56:13.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.429+0000 7f0807e00700 1 --2- 172.21.15.82:0/3528637509 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f080806b6f0 0x7f08081a01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:13.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.429+0000 7f0807e00700 1 -- 172.21.15.82:0/3528637509 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08081083d0 msgr2=0x7f08081a4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:56:13.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.429+0000 7f0807e00700 1 --2- 172.21.15.82:0/3528637509 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08081083d0 0x7f08081a4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:13.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.429+0000 7f0807e00700 1 -- 172.21.15.82:0/3528637509 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08081a51f0 con 0x7f0808105ee0 2024-05-08T05:56:13.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.429+0000 7f0807e00700 1 --2- 172.21.15.82:0/3528637509 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0808105ee0 0x7f08081a0720 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f07f400ec10 tx=0x7f07f400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:56:13.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.430+0000 7f0805600700 1 -- 172.21.15.82:0/3528637509 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f400cc90 con 0x7f0808105ee0 2024-05-08T05:56:13.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.430+0000 7f0805600700 1 -- 172.21.15.82:0/3528637509 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f07f400ce30 con 0x7f0808105ee0 2024-05-08T05:56:13.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.430+0000 7f0805600700 1 -- 172.21.15.82:0/3528637509 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f4010430 con 0x7f0808105ee0 2024-05-08T05:56:13.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.430+0000 7f080fa00700 1 -- 172.21.15.82:0/3528637509 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08081a5480 con 0x7f0808105ee0 2024-05-08T05:56:13.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.430+0000 7f080fa00700 1 -- 172.21.15.82:0/3528637509 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08081acd60 con 0x7f0808105ee0 2024-05-08T05:56:13.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.435+0000 7f0805600700 1 -- 172.21.15.82:0/3528637509 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f07f4004000 con 0x7f0808105ee0 2024-05-08T05:56:13.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.436+0000 7f081a347b80 1 Processor -- start 2024-05-08T05:56:13.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.436+0000 7f081a347b80 1 -- start start 2024-05-08T05:56:13.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.436+0000 7f081a347b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a362e33060 0x55a362e33440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:13.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.436+0000 7f081a347b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a362e33980 0x55a362e37490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:13.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.436+0000 7f081a347b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a362e379d0 0x55a362e37e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:13.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.436+0000 7f081a347b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a362d85a20 con 0x55a362e33980 2024-05-08T05:56:13.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.436+0000 7f081a347b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a362d23760 con 0x55a362e379d0 2024-05-08T05:56:13.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.436+0000 7f081a347b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55a362d819e0 con 0x55a362e33060 2024-05-08T05:56:13.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.437+0000 7f080da00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a362e33060 0x55a362e33440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:13.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.437+0000 7f080d000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a362e33980 0x55a362e37490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:13.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.437+0000 7f080da00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a362e33060 0x55a362e33440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:55590/0 (socket says 172.21.15.82:55590) 2024-05-08T05:56:13.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.437+0000 7f080d000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a362e33980 0x55a362e37490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56642/0 (socket says 172.21.15.82:56642) 2024-05-08T05:56:13.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.437+0000 7f080da00700 1 -- 172.21.15.82:0/2794289610 learned_addr learned my addr 172.21.15.82:0/2794289610 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:56:13.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.437+0000 7f0807e00700 1 --2- 172.21.15.82:0/2794289610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a362e379d0 0x55a362e37e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:13.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.437+0000 7f080da00700 1 -- 172.21.15.82:0/2794289610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a362e379d0 msgr2=0x55a362e37e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:56:13.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.437+0000 7f080da00700 1 --2- 172.21.15.82:0/2794289610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a362e379d0 0x55a362e37e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:13.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.438+0000 7f080da00700 1 -- 172.21.15.82:0/2794289610 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a362e33980 msgr2=0x55a362e37490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:56:13.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.438+0000 7f080da00700 1 --2- 172.21.15.82:0/2794289610 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a362e33980 0x55a362e37490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:13.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.438+0000 7f080da00700 1 -- 172.21.15.82:0/2794289610 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a362cd28d0 con 0x55a362e33060 2024-05-08T05:56:13.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.438+0000 7f0807e00700 1 --2- 172.21.15.82:0/2794289610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a362e379d0 0x55a362e37e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:56:13.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.438+0000 7f0805600700 1 --2- 172.21.15.82:0/3528637509 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f07f00b2980 0x7f07f00b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:13.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.438+0000 7f080d000700 1 --2- 172.21.15.82:0/2794289610 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a362e33980 0x55a362e37490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:56:13.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.438+0000 7f0805600700 1 -- 172.21.15.82:0/3528637509 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f07f40e2450 con 0x7f0808105ee0 2024-05-08T05:56:13.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.438+0000 7f080da00700 1 --2- 172.21.15.82:0/2794289610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a362e33060 0x55a362e33440 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0800003fa0 tx=0x7f0800009ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4731067baa7e61d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:56:13.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.438+0000 7f07fa000700 1 -- 172.21.15.82:0/2794289610 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0800004bb0 con 0x55a362e33060 2024-05-08T05:56:13.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.438+0000 7f07fa000700 1 -- 172.21.15.82:0/2794289610 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0800004d50 con 0x55a362e33060 2024-05-08T05:56:13.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.438+0000 7f07fa000700 1 -- 172.21.15.82:0/2794289610 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0800007da0 con 0x55a362e33060 2024-05-08T05:56:13.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.439+0000 7f081a347b80 1 -- 172.21.15.82:0/2794289610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a362e33060 msgr2=0x55a362e33440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:56:13.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.439+0000 7f081a347b80 1 --2- 172.21.15.82:0/2794289610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a362e33060 0x55a362e33440 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f0800003fa0 tx=0x7f0800009ba0 comp rx=0 tx=0).stop 2024-05-08T05:56:13.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.440+0000 7f080d000700 1 --2- 172.21.15.82:0/3528637509 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f07f00b2980 0x7f07f00b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:13.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.441+0000 7f081a347b80 1 -- 172.21.15.82:0/2794289610 shutdown_connections 2024-05-08T05:56:13.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.441+0000 7f081a347b80 1 --2- 172.21.15.82:0/2794289610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a362e379d0 0x55a362e37e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:13.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.441+0000 7f081a347b80 1 --2- 172.21.15.82:0/2794289610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a362e33060 0x55a362e33440 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:13.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.441+0000 7f081a347b80 1 --2- 172.21.15.82:0/2794289610 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a362e33980 0x55a362e37490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:13.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.441+0000 7f081a347b80 1 -- 172.21.15.82:0/2794289610 >> 172.21.15.82:0/2794289610 conn(0x55a362d61b60 msgr2=0x55a362e2d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:56:13.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.441+0000 7f080d000700 1 --2- 172.21.15.82:0/3528637509 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f07f00b2980 0x7f07f00b4e40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f07fc0098c0 tx=0x7f07fc019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:56:13.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.442+0000 7f081a347b80 1 -- 172.21.15.82:0/2794289610 shutdown_connections 2024-05-08T05:56:13.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.442+0000 7f081a347b80 1 -- 172.21.15.82:0/2794289610 wait complete. 2024-05-08T05:56:13.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.442+0000 7f081a347b80 1 -- start start 2024-05-08T05:56:13.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.442+0000 7f081a347b80 1 Processor -- start 2024-05-08T05:56:13.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.443+0000 7f081a347b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a362e33060 0x55a362e3ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:13.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.443+0000 7f081a347b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a362e33980 0x55a362e3c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:13.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.443+0000 7f081a347b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a362e379d0 0x55a362e3c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:13.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.443+0000 7f081a347b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a362e3fbe0 con 0x55a362e379d0 2024-05-08T05:56:13.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.443+0000 7f081a347b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a362cebb20 con 0x55a362e33060 2024-05-08T05:56:13.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.443+0000 7f081a347b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55a362e3fd60 con 0x55a362e33980 2024-05-08T05:56:13.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.443+0000 7f081a347b80 10 client.0 _ll_register_callbacks cb 0x55a362d2cc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:56:13.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.444+0000 7f080d000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a362e33060 0x55a362e3ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:13.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.444+0000 7f0807e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a362e33980 0x55a362e3c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:13.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.444+0000 7f0807e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a362e33980 0x55a362e3c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:55592/0 (socket says 172.21.15.82:55592) 2024-05-08T05:56:13.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.444+0000 7f0807e00700 1 -- 172.21.15.82:0/1200600333 learned_addr learned my addr 172.21.15.82:0/1200600333 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:56:13.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.444+0000 7f080da00700 1 --2- 172.21.15.82:0/1200600333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a362e379d0 0x55a362e3c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:13.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.444+0000 7f0807e00700 1 -- 172.21.15.82:0/1200600333 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a362e33060 msgr2=0x55a362e3ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:56:13.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.444+0000 7f0807e00700 1 --2- 172.21.15.82:0/1200600333 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a362e33060 0x55a362e3ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:13.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.444+0000 7f0807e00700 1 -- 172.21.15.82:0/1200600333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a362e379d0 msgr2=0x55a362e3c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:56:13.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.444+0000 7f0807e00700 1 --2- 172.21.15.82:0/1200600333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a362e379d0 0x55a362e3c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:13.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.444+0000 7f0807e00700 1 -- 172.21.15.82:0/1200600333 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a362d4b420 con 0x55a362e33980 2024-05-08T05:56:13.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.444+0000 7f080da00700 1 --2- 172.21.15.82:0/1200600333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a362e379d0 0x55a362e3c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:56:13.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.445+0000 7f0807e00700 1 --2- 172.21.15.82:0/1200600333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a362e33980 0x55a362e3c250 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f07f40a5aa0 tx=0x7f07f40a9420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcbb65b4f33adab2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:56:13.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.445+0000 7f07eea00700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:56:13.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.445+0000 7f07eea00700 1 -- 172.21.15.82:0/1200600333 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f40aa120 con 0x55a362e33980 2024-05-08T05:56:13.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.445+0000 7f07eea00700 1 -- 172.21.15.82:0/1200600333 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f07f40a9c80 con 0x55a362e33980 2024-05-08T05:56:13.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.446+0000 7f081a347b80 1 -- 172.21.15.82:0/1200600333 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0800004d50 con 0x55a362e33980 2024-05-08T05:56:13.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.446+0000 7f07eea00700 1 -- 172.21.15.82:0/1200600333 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f07f40a9a20 con 0x55a362e33980 2024-05-08T05:56:13.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.446+0000 7f081a347b80 10 client.25834 fetch_fsmap learned FSMap version 31 2024-05-08T05:56:13.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.446+0000 7f081a347b80 1 -- 172.21.15.82:0/1200600333 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a362e4a420 con 0x55a362e33980 2024-05-08T05:56:13.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.446+0000 7f07eea00700 1 -- 172.21.15.82:0/1200600333 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0800004d50 con 0x55a362e33980 2024-05-08T05:56:13.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.447+0000 7f07eea00700 1 -- 172.21.15.82:0/1200600333 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f07f40b2410 con 0x55a362e33980 2024-05-08T05:56:13.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.447+0000 7f081a347b80 10 client.25834 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:56:13.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.447+0000 7f081a347b80 10 client.25834 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:56:13.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.447+0000 7f081a347b80 20 client.25834 populate_metadata read hostname 'smithi082' 2024-05-08T05:56:13.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.447+0000 7f081a347b80 1 --2- 172.21.15.82:0/1200600333 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55a362e4c9b0 0x55a362e4eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:13.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.447+0000 7f081a347b80 4 client.25834 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:56:13.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.447+0000 7f081a347b80 1 -- 172.21.15.82:0/1200600333 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a362e000a0 con 0x55a362e4c9b0 2024-05-08T05:56:13.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.448+0000 7f080d000700 1 --2- 172.21.15.82:0/1200600333 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55a362e4c9b0 0x55a362e4eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:13.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.449+0000 7f080d000700 1 --2- 172.21.15.82:0/1200600333 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55a362e4c9b0 0x55a362e4eda0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c33dc3890aee000 server_cookie=a5d96326ae9613f0 in_seq=0 out_seq=0 2024-05-08T05:56:13.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.449+0000 7f07eea00700 10 client.25834 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:56:13.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.449+0000 7f07eea00700 1 -- 172.21.15.82:0/1200600333 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a362e000a0 con 0x55a362e4c9b0 2024-05-08T05:56:13.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.449+0000 7f07eea00700 10 client.25834 handle_command_reply: tid=0 2024-05-08T05:56:13.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.449+0000 7f081a347b80 1 client.25834 shutdown 2024-05-08T05:56:13.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.450+0000 7f081a347b80 1 -- 172.21.15.82:0/1200600333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a362e33980 msgr2=0x55a362e3c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:56:13.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.450+0000 7f081a347b80 1 --2- 172.21.15.82:0/1200600333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a362e33980 0x55a362e3c250 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f07f40a5aa0 tx=0x7f07f40a9420 comp rx=0 tx=0).stop 2024-05-08T05:56:13.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.450+0000 7f081a347b80 1 -- 172.21.15.82:0/1200600333 shutdown_connections 2024-05-08T05:56:13.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.450+0000 7f081a347b80 1 --2- 172.21.15.82:0/1200600333 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55a362e4c9b0 0x55a362e4eda0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:13.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.450+0000 7f081a347b80 1 --2- 172.21.15.82:0/1200600333 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a362e33060 0x55a362e3ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:13.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.450+0000 7f07eea00700 0 client.25834 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:56:13.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.450+0000 7f081a347b80 1 --2- 172.21.15.82:0/1200600333 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a362e379d0 0x55a362e3c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:13.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.450+0000 7f081a347b80 1 --2- 172.21.15.82:0/1200600333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a362e33980 0x55a362e3c250 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:13.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.450+0000 7f081a347b80 1 -- 172.21.15.82:0/1200600333 >> 172.21.15.82:0/1200600333 conn(0x55a362d61b60 msgr2=0x55a362e282b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:56:13.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.450+0000 7f081a347b80 1 -- 172.21.15.82:0/1200600333 shutdown_connections 2024-05-08T05:56:13.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.450+0000 7f081a347b80 1 -- 172.21.15.82:0/1200600333 wait complete. 2024-05-08T05:56:13.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.451+0000 7f081a347b80 20 client.25834 trim_cache size 0 max 16384 2024-05-08T05:56:13.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.476+0000 7f081a347b80 1 Processor -- start 2024-05-08T05:56:13.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.476+0000 7f081a347b80 1 -- start start 2024-05-08T05:56:13.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.477+0000 7f081a347b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a362e33060 0x55a362e48c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:13.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.477+0000 7f081a347b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a362e33980 0x55a362e54650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:13.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.477+0000 7f081a347b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a362e379d0 0x55a362e54b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:13.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.477+0000 7f081a347b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f08081b4110 con 0x55a362e33980 2024-05-08T05:56:13.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.477+0000 7f081a347b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f08081b5c50 con 0x55a362e33060 2024-05-08T05:56:13.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.477+0000 7f081a347b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f08081b47e0 con 0x55a362e379d0 2024-05-08T05:56:13.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.477+0000 7f0807e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a362e33980 0x55a362e54650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:13.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.477+0000 7f080d000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a362e33060 0x55a362e48c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:13.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.477+0000 7f080d000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a362e33060 0x55a362e48c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:58364/0 (socket says 172.21.15.82:58364) 2024-05-08T05:56:13.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.477+0000 7f080d000700 1 -- 172.21.15.82:0/4150481460 learned_addr learned my addr 172.21.15.82:0/4150481460 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:56:13.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.478+0000 7f080da00700 1 --2- 172.21.15.82:0/4150481460 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a362e379d0 0x55a362e54b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:13.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.478+0000 7f0807e00700 1 -- 172.21.15.82:0/4150481460 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a362e379d0 msgr2=0x55a362e54b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:56:13.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.478+0000 7f0807e00700 1 --2- 172.21.15.82:0/4150481460 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a362e379d0 0x55a362e54b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:13.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.478+0000 7f0807e00700 1 -- 172.21.15.82:0/4150481460 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a362e33060 msgr2=0x55a362e48c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:56:13.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.478+0000 7f0807e00700 1 --2- 172.21.15.82:0/4150481460 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a362e33060 0x55a362e48c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:13.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.478+0000 7f0807e00700 1 -- 172.21.15.82:0/4150481460 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a362e2a3f0 con 0x55a362e33980 2024-05-08T05:56:13.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.478+0000 7f080d000700 1 --2- 172.21.15.82:0/4150481460 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a362e33060 0x55a362e48c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:56:13.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.478+0000 7f0807e00700 1 --2- 172.21.15.82:0/4150481460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a362e33980 0x55a362e54650 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f07f4000c00 tx=0x7f07f4016fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ae920e1333859f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:56:13.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.479+0000 7f07f9600700 1 -- 172.21.15.82:0/4150481460 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f40aa120 con 0x55a362e33980 2024-05-08T05:56:13.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.479+0000 7f07f9600700 1 -- 172.21.15.82:0/4150481460 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f07f40addd0 con 0x55a362e33980 2024-05-08T05:56:13.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.479+0000 7f07f9600700 1 -- 172.21.15.82:0/4150481460 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f40a9c80 con 0x55a362e33980 2024-05-08T05:56:13.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.480+0000 7f081a347b80 1 -- 172.21.15.82:0/4150481460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a362e33980 msgr2=0x55a362e54650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:56:13.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.480+0000 7f081a347b80 1 --2- 172.21.15.82:0/4150481460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a362e33980 0x55a362e54650 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f07f4000c00 tx=0x7f07f4016fe0 comp rx=0 tx=0).stop 2024-05-08T05:56:13.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.481+0000 7f081a347b80 1 -- 172.21.15.82:0/4150481460 shutdown_connections 2024-05-08T05:56:13.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.481+0000 7f081a347b80 1 --2- 172.21.15.82:0/4150481460 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a362e33060 0x55a362e48c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:13.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.481+0000 7f081a347b80 1 --2- 172.21.15.82:0/4150481460 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a362e379d0 0x55a362e54b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:13.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.481+0000 7f081a347b80 1 --2- 172.21.15.82:0/4150481460 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a362e33980 0x55a362e54650 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:13.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.481+0000 7f081a347b80 1 -- 172.21.15.82:0/4150481460 >> 172.21.15.82:0/4150481460 conn(0x55a362d61b60 msgr2=0x55a362e3ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:56:13.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.481+0000 7f081a347b80 1 -- 172.21.15.82:0/4150481460 shutdown_connections 2024-05-08T05:56:13.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.481+0000 7f081a347b80 1 -- 172.21.15.82:0/4150481460 wait complete. 2024-05-08T05:56:13.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.481+0000 7f081a347b80 1 -- start start 2024-05-08T05:56:13.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.482+0000 7f081a347b80 1 Processor -- start 2024-05-08T05:56:13.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.482+0000 7f081a347b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a362e33060 0x55a362e451d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:13.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.482+0000 7f081a347b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a362e33980 0x55a362e45710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:13.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.482+0000 7f081a347b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a362e379d0 0x55a362e53840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:13.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.482+0000 7f081a347b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f08081b5580 con 0x55a362e33980 2024-05-08T05:56:13.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.482+0000 7f080d000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a362e33060 0x55a362e451d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:13.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.482+0000 7f080d000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a362e33060 0x55a362e451d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:55612/0 (socket says 172.21.15.82:55612) 2024-05-08T05:56:13.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.482+0000 7f080d000700 1 -- 172.21.15.82:0/1247679305 learned_addr learned my addr 172.21.15.82:0/1247679305 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:56:13.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.482+0000 7f080da00700 1 --2- 172.21.15.82:0/1247679305 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a362e379d0 0x55a362e53840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:13.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.482+0000 7f081a347b80 1 -- 172.21.15.82:0/1247679305 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f08081b4eb0 con 0x55a362e379d0 2024-05-08T05:56:13.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.482+0000 7f081a347b80 1 -- 172.21.15.82:0/1247679305 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f08081b20b0 con 0x55a362e33060 2024-05-08T05:56:13.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.483+0000 7f0807e00700 1 --2- 172.21.15.82:0/1247679305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a362e33980 0x55a362e45710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:13.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.483+0000 7f081a347b80 10 client.0 _ll_register_callbacks cb 0x55a362d2cc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:56:13.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.483+0000 7f080d000700 1 -- 172.21.15.82:0/1247679305 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a362e379d0 msgr2=0x55a362e53840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:56:13.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.483+0000 7f080d000700 1 --2- 172.21.15.82:0/1247679305 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a362e379d0 0x55a362e53840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:13.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.483+0000 7f080d000700 1 -- 172.21.15.82:0/1247679305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a362e33980 msgr2=0x55a362e45710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:56:13.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.483+0000 7f080d000700 1 --2- 172.21.15.82:0/1247679305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a362e33980 0x55a362e45710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:13.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.483+0000 7f080d000700 1 -- 172.21.15.82:0/1247679305 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a362e54080 con 0x55a362e33060 2024-05-08T05:56:13.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.484+0000 7f080da00700 1 --2- 172.21.15.82:0/1247679305 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a362e379d0 0x55a362e53840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:56:13.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.484+0000 7f0807e00700 1 --2- 172.21.15.82:0/1247679305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a362e33980 0x55a362e45710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:56:13.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.484+0000 7f080d000700 1 --2- 172.21.15.82:0/1247679305 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a362e33060 0x55a362e451d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f07fc009810 tx=0x7f07fc009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af6620d17653722a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:56:13.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.484+0000 7f07eea00700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:56:13.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.484+0000 7f07eea00700 1 -- 172.21.15.82:0/1247679305 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07fc02b040 con 0x55a362e33060 2024-05-08T05:56:13.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.484+0000 7f07eea00700 1 -- 172.21.15.82:0/1247679305 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f07fc005660 con 0x55a362e33060 2024-05-08T05:56:13.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.484+0000 7f081a347b80 1 -- 172.21.15.82:0/1247679305 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f07f40addd0 con 0x55a362e33060 2024-05-08T05:56:13.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.484+0000 7f07eea00700 1 -- 172.21.15.82:0/1247679305 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f07fc017400 con 0x55a362e33060 2024-05-08T05:56:13.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.484+0000 7f081a347b80 10 client.25840 fetch_fsmap learned FSMap version 31 2024-05-08T05:56:13.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.484+0000 7f081a347b80 1 -- 172.21.15.82:0/1247679305 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a362eb6e60 con 0x55a362e33060 2024-05-08T05:56:13.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.485+0000 7f07eea00700 1 -- 172.21.15.82:0/1247679305 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f07fc039070 con 0x55a362e33060 2024-05-08T05:56:13.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.487+0000 7f07eea00700 1 -- 172.21.15.82:0/1247679305 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f07fc0046b0 con 0x55a362e33060 2024-05-08T05:56:13.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.487+0000 7f081a347b80 10 client.25840 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:56:13.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.487+0000 7f081a347b80 10 client.25840 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:56:13.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.487+0000 7f081a347b80 20 client.25840 populate_metadata read hostname 'smithi082' 2024-05-08T05:56:13.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.487+0000 7f081a347b80 1 --2- 172.21.15.82:0/1247679305 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55a362eb7540 0x55a362eb9960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:13.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.487+0000 7f081a347b80 4 client.25840 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:56:13.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.487+0000 7f081a347b80 1 -- 172.21.15.82:0/1247679305 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f07f40addd0 con 0x55a362eb7540 2024-05-08T05:56:13.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.487+0000 7f0807e00700 1 --2- 172.21.15.82:0/1247679305 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55a362eb7540 0x55a362eb9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:13.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.488+0000 7f0807e00700 1 --2- 172.21.15.82:0/1247679305 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55a362eb7540 0x55a362eb9960 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=efd736b3f537b42f server_cookie=349824270e7b2185 in_seq=0 out_seq=0 2024-05-08T05:56:13.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.488+0000 7f07eea00700 10 client.25840 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:56:13.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.488+0000 7f07eea00700 1 -- 172.21.15.82:0/1247679305 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f07f40addd0 con 0x55a362eb7540 2024-05-08T05:56:13.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.488+0000 7f07eea00700 10 client.25840 handle_command_reply: tid=0 2024-05-08T05:56:13.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.488+0000 7f081a347b80 1 client.25840 shutdown 2024-05-08T05:56:13.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.488+0000 7f081a347b80 1 -- 172.21.15.82:0/1247679305 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a362e33060 msgr2=0x55a362e451d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:56:13.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.488+0000 7f081a347b80 1 --2- 172.21.15.82:0/1247679305 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a362e33060 0x55a362e451d0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f07fc009810 tx=0x7f07fc009c00 comp rx=0 tx=0).stop 2024-05-08T05:56:13.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.489+0000 7f081a347b80 1 -- 172.21.15.82:0/1247679305 shutdown_connections 2024-05-08T05:56:13.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.489+0000 7f081a347b80 1 --2- 172.21.15.82:0/1247679305 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55a362eb7540 0x55a362eb9960 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:13.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.489+0000 7f081a347b80 1 --2- 172.21.15.82:0/1247679305 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a362e379d0 0x55a362e53840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:13.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.489+0000 7f081a347b80 1 --2- 172.21.15.82:0/1247679305 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a362e33060 0x55a362e451d0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:13.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.489+0000 7f07eea00700 0 client.25840 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:56:13.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.489+0000 7f081a347b80 1 --2- 172.21.15.82:0/1247679305 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a362e33980 0x55a362e45710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:13.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.489+0000 7f081a347b80 1 -- 172.21.15.82:0/1247679305 >> 172.21.15.82:0/1247679305 conn(0x55a362d61b60 msgr2=0x55a362e27a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:56:13.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.489+0000 7f081a347b80 1 -- 172.21.15.82:0/1247679305 shutdown_connections 2024-05-08T05:56:13.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.489+0000 7f081a347b80 1 -- 172.21.15.82:0/1247679305 wait complete. 2024-05-08T05:56:13.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.489+0000 7f081a347b80 20 client.25840 trim_cache size 0 max 16384 2024-05-08T05:56:13.491 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T05:56:13.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.490+0000 7f080fa00700 1 -- 172.21.15.82:0/3528637509 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f07f00b2980 msgr2=0x7f07f00b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:56:13.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.490+0000 7f080fa00700 1 --2- 172.21.15.82:0/3528637509 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f07f00b2980 0x7f07f00b4e40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f07fc0098c0 tx=0x7f07fc019040 comp rx=0 tx=0).stop 2024-05-08T05:56:13.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.490+0000 7f080fa00700 1 -- 172.21.15.82:0/3528637509 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0808105ee0 msgr2=0x7f08081a0720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:56:13.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.490+0000 7f080fa00700 1 --2- 172.21.15.82:0/3528637509 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0808105ee0 0x7f08081a0720 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f07f400ec10 tx=0x7f07f400ef20 comp rx=0 tx=0).stop 2024-05-08T05:56:13.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.491+0000 7f080fa00700 1 -- 172.21.15.82:0/3528637509 shutdown_connections 2024-05-08T05:56:13.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.491+0000 7f080fa00700 1 --2- 172.21.15.82:0/3528637509 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f07f00b2980 0x7f07f00b4e40 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:13.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.491+0000 7f080fa00700 1 --2- 172.21.15.82:0/3528637509 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f08081083d0 0x7f08081a4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:13.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.491+0000 7f080fa00700 1 --2- 172.21.15.82:0/3528637509 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f080806b6f0 0x7f08081a01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:13.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.491+0000 7f080fa00700 1 --2- 172.21.15.82:0/3528637509 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0808105ee0 0x7f08081a0720 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:13.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.491+0000 7f080fa00700 1 -- 172.21.15.82:0/3528637509 >> 172.21.15.82:0/3528637509 conn(0x7f0808079350 msgr2=0x7f0808101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:56:13.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.491+0000 7f080fa00700 1 -- 172.21.15.82:0/3528637509 shutdown_connections 2024-05-08T05:56:13.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:13.491+0000 7f080fa00700 1 -- 172.21.15.82:0/3528637509 wait complete. 2024-05-08T05:56:13.876 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:56:13 smithi082 ceph-mon[30098]: pgmap v626: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.9 MiB/s wr, 624 op/s 2024-05-08T05:56:13.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:56:13 smithi151 ceph-mon[34815]: pgmap v626: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.9 MiB/s wr, 624 op/s 2024-05-08T05:56:13.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:56:13 smithi134 ceph-mon[34132]: pgmap v626: 97 pgs: 97 active+clean; 1.6 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.9 MiB/s wr, 624 op/s 2024-05-08T05:56:15.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 325.0 s, 1962.4 tps, lat 51.220 ms stddev 60.844 2024-05-08T05:56:15.418 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-08T05:56:15.419 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-05-08T05:56:15.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:56:15 smithi151 ceph-mon[34815]: pgmap v627: 97 pgs: 97 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.5 MiB/s wr, 670 op/s 2024-05-08T05:56:15.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:56:15 smithi082 ceph-mon[30098]: pgmap v627: 97 pgs: 97 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.5 MiB/s wr, 670 op/s 2024-05-08T05:56:15.974 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:56:15.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:56:15 smithi134 ceph-mon[34132]: pgmap v627: 97 pgs: 97 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.5 MiB/s wr, 670 op/s 2024-05-08T05:56:17.854 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:56:17 smithi082 ceph-mon[30098]: pgmap v628: 97 pgs: 97 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.4 MiB/s wr, 683 op/s 2024-05-08T05:56:17.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:56:17 smithi151 ceph-mon[34815]: pgmap v628: 97 pgs: 97 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.4 MiB/s wr, 683 op/s 2024-05-08T05:56:18.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:56:17 smithi134 ceph-mon[34132]: pgmap v628: 97 pgs: 97 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.4 MiB/s wr, 683 op/s 2024-05-08T05:56:18.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.956+0000 7fd71ca00700 1 -- 172.21.15.82:0/3560769859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd718109510 msgr2=0x7fd7181098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:56:18.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.956+0000 7fd71ca00700 1 --2- 172.21.15.82:0/3560769859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd718109510 0x7fd7181098f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd71000b0a0 tx=0x7fd71000b3b0 comp rx=0 tx=0).stop 2024-05-08T05:56:18.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.957+0000 7fd71ca00700 1 -- 172.21.15.82:0/3560769859 shutdown_connections 2024-05-08T05:56:18.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.957+0000 7fd71ca00700 1 --2- 172.21.15.82:0/3560769859 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd718109510 0x7fd7181098f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:18.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.957+0000 7fd71ca00700 1 --2- 172.21.15.82:0/3560769859 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd71806bb40 0x7fd718110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:18.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.957+0000 7fd71ca00700 1 --2- 172.21.15.82:0/3560769859 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd71806b180 0x7fd71806b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:18.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.957+0000 7fd71ca00700 1 -- 172.21.15.82:0/3560769859 >> 172.21.15.82:0/3560769859 conn(0x7fd718079350 msgr2=0x7fd718079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:56:18.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.958+0000 7fd71ca00700 1 -- 172.21.15.82:0/3560769859 shutdown_connections 2024-05-08T05:56:18.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.958+0000 7fd71ca00700 1 -- 172.21.15.82:0/3560769859 wait complete. 2024-05-08T05:56:18.962 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.962+0000 7fd71ca00700 1 Processor -- start 2024-05-08T05:56:18.964 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.963+0000 7fd71ca00700 1 -- start start 2024-05-08T05:56:18.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.965+0000 7fd71ca00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd71806b180 0x7fd71819bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:18.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.965+0000 7fd71ca00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd71806bb40 0x7fd71819c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:18.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.966+0000 7fd71ca00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd718109510 0x7fd7181a0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:18.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.966+0000 7fd71ca00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd718103ad0 con 0x7fd71806b180 2024-05-08T05:56:18.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.966+0000 7fd71ca00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd718103950 con 0x7fd71806bb40 2024-05-08T05:56:18.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.966+0000 7fd71ca00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd718103c50 con 0x7fd718109510 2024-05-08T05:56:18.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.966+0000 7fd715e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd71806b180 0x7fd71819bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:18.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.966+0000 7fd715400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd71806bb40 0x7fd71819c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:18.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.966+0000 7fd715400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd71806bb40 0x7fd71819c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:58396/0 (socket says 172.21.15.82:58396) 2024-05-08T05:56:18.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.966+0000 7fd715e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd71806b180 0x7fd71819bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56680/0 (socket says 172.21.15.82:56680) 2024-05-08T05:56:18.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.966+0000 7fd715400700 1 -- 172.21.15.82:0/2802986004 learned_addr learned my addr 172.21.15.82:0/2802986004 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:56:18.968 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.966+0000 7fd716800700 1 --2- 172.21.15.82:0/2802986004 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd718109510 0x7fd7181a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:18.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.966+0000 7fd715400700 1 -- 172.21.15.82:0/2802986004 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd718109510 msgr2=0x7fd7181a0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:56:18.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.966+0000 7fd715400700 1 --2- 172.21.15.82:0/2802986004 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd718109510 0x7fd7181a0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:18.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.966+0000 7fd715400700 1 -- 172.21.15.82:0/2802986004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd71806b180 msgr2=0x7fd71819bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:56:18.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.967+0000 7fd715400700 1 --2- 172.21.15.82:0/2802986004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd71806b180 0x7fd71819bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:18.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.967+0000 7fd715400700 1 -- 172.21.15.82:0/2802986004 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7181a0db0 con 0x7fd71806bb40 2024-05-08T05:56:18.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.967+0000 7fd715400700 1 --2- 172.21.15.82:0/2802986004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd71806bb40 0x7fd71819c2e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd70000e9a0 tx=0x7fd70000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:56:18.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.969+0000 7fd70ea00700 1 -- 172.21.15.82:0/2802986004 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd70000cbd0 con 0x7fd71806bb40 2024-05-08T05:56:18.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.969+0000 7fd70ea00700 1 -- 172.21.15.82:0/2802986004 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd70000cd70 con 0x7fd71806bb40 2024-05-08T05:56:18.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.969+0000 7fd70ea00700 1 -- 172.21.15.82:0/2802986004 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd700018680 con 0x7fd71806bb40 2024-05-08T05:56:18.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.969+0000 7fd71ca00700 1 -- 172.21.15.82:0/2802986004 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7181a10a0 con 0x7fd71806bb40 2024-05-08T05:56:18.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.969+0000 7fd71ca00700 1 -- 172.21.15.82:0/2802986004 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7181a8920 con 0x7fd71806bb40 2024-05-08T05:56:18.977 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.977+0000 7fd727406b80 1 Processor -- start 2024-05-08T05:56:18.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.977+0000 7fd727406b80 1 -- start start 2024-05-08T05:56:18.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.978+0000 7fd727406b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563efcd7b450 0x563efcd7b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:18.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.978+0000 7fd727406b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563efcd7bd70 0x563efcd75b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:18.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.978+0000 7fd727406b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563efcd76180 0x563efcd76600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:18.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.978+0000 7fd727406b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x563efccbfaa0 con 0x563efcd7bd70 2024-05-08T05:56:18.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.978+0000 7fd727406b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x563efcc5d7e0 con 0x563efcd7b450 2024-05-08T05:56:18.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.978+0000 7fd727406b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x563efccbba60 con 0x563efcd76180 2024-05-08T05:56:18.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.978+0000 7fd70ea00700 1 -- 172.21.15.82:0/2802986004 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fd700018820 con 0x7fd71806bb40 2024-05-08T05:56:18.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.979+0000 7fd716800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563efcd7b450 0x563efcd7b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:18.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.979+0000 7fd716800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563efcd7b450 0x563efcd7b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:58410/0 (socket says 172.21.15.82:58410) 2024-05-08T05:56:18.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.979+0000 7fd716800700 1 -- 172.21.15.82:0/2473171627 learned_addr learned my addr 172.21.15.82:0/2473171627 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:56:18.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.979+0000 7fd716800700 1 -- 172.21.15.82:0/2473171627 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563efcd76180 msgr2=0x563efcd76600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:56:18.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.979+0000 7fd715400700 1 --2- 172.21.15.82:0/2473171627 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563efcd76180 0x563efcd76600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:18.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.979+0000 7fd715e00700 1 --2- 172.21.15.82:0/2473171627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563efcd7bd70 0x563efcd75b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:18.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.980+0000 7fd716800700 1 --2- 172.21.15.82:0/2473171627 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563efcd76180 0x563efcd76600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:18.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.980+0000 7fd716800700 1 -- 172.21.15.82:0/2473171627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563efcd7bd70 msgr2=0x563efcd75b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:56:18.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.980+0000 7fd716800700 1 --2- 172.21.15.82:0/2473171627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563efcd7bd70 0x563efcd75b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:18.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.980+0000 7fd716800700 1 -- 172.21.15.82:0/2473171627 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563efcc0c950 con 0x563efcd7b450 2024-05-08T05:56:18.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.980+0000 7fd715400700 1 --2- 172.21.15.82:0/2473171627 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563efcd76180 0x563efcd76600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:56:18.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.981+0000 7fd716800700 1 --2- 172.21.15.82:0/2473171627 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563efcd7b450 0x563efcd7b830 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd70800dbd0 tx=0x7fd70800dee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb938cc899b50f3c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:56:18.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.981+0000 7fd707400700 1 -- 172.21.15.82:0/2473171627 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd708015070 con 0x563efcd7b450 2024-05-08T05:56:18.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.982+0000 7fd70ea00700 1 --2- 172.21.15.82:0/2802986004 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd6fc0b2980 0x7fd6fc0b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:18.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.982+0000 7fd707400700 1 -- 172.21.15.82:0/2473171627 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd70801a460 con 0x563efcd7b450 2024-05-08T05:56:18.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.982+0000 7fd707400700 1 -- 172.21.15.82:0/2473171627 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd708015070 con 0x563efcd7b450 2024-05-08T05:56:18.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.982+0000 7fd70ea00700 1 -- 172.21.15.82:0/2802986004 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd7000e2320 con 0x7fd71806bb40 2024-05-08T05:56:18.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.983+0000 7fd715e00700 1 --2- 172.21.15.82:0/2802986004 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd6fc0b2980 0x7fd6fc0b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:18.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.984+0000 7fd727406b80 1 -- 172.21.15.82:0/2473171627 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563efcd7b450 msgr2=0x563efcd7b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:56:18.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.984+0000 7fd727406b80 1 --2- 172.21.15.82:0/2473171627 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563efcd7b450 0x563efcd7b830 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd70800dbd0 tx=0x7fd70800dee0 comp rx=0 tx=0).stop 2024-05-08T05:56:18.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.984+0000 7fd715e00700 1 --2- 172.21.15.82:0/2802986004 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd6fc0b2980 0x7fd6fc0b4e40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd7100062a0 tx=0x7fd710006210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:56:18.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.985+0000 7fd727406b80 1 -- 172.21.15.82:0/2473171627 shutdown_connections 2024-05-08T05:56:18.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.985+0000 7fd727406b80 1 --2- 172.21.15.82:0/2473171627 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563efcd7b450 0x563efcd7b830 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:18.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.985+0000 7fd727406b80 1 --2- 172.21.15.82:0/2473171627 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563efcd76180 0x563efcd76600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:18.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.985+0000 7fd727406b80 1 --2- 172.21.15.82:0/2473171627 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563efcd7bd70 0x563efcd75b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:18.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.985+0000 7fd727406b80 1 -- 172.21.15.82:0/2473171627 >> 172.21.15.82:0/2473171627 conn(0x563efcce5750 msgr2=0x563efcd67b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:56:18.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.985+0000 7fd727406b80 1 -- 172.21.15.82:0/2473171627 shutdown_connections 2024-05-08T05:56:18.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.985+0000 7fd727406b80 1 -- 172.21.15.82:0/2473171627 wait complete. 2024-05-08T05:56:18.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.986+0000 7fd727406b80 1 -- start start 2024-05-08T05:56:18.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.986+0000 7fd727406b80 1 Processor -- start 2024-05-08T05:56:18.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.987+0000 7fd727406b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563efcd76180 0x563efcd819f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:18.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.987+0000 7fd727406b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563efcd7b450 0x563efcd7ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:18.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.987+0000 7fd727406b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563efcd7bd70 0x563efcd7f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:18.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.987+0000 7fd727406b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x563efcd827b0 con 0x563efcd7bd70 2024-05-08T05:56:18.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.987+0000 7fd727406b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x563efcc25ba0 con 0x563efcd7b450 2024-05-08T05:56:18.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.987+0000 7fd727406b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x563efcd82930 con 0x563efcd76180 2024-05-08T05:56:18.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.987+0000 7fd727406b80 10 client.0 _ll_register_callbacks cb 0x563efcc66cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:56:18.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.988+0000 7fd715e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563efcd76180 0x563efcd819f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:18.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.988+0000 7fd715e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563efcd76180 0x563efcd819f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:55648/0 (socket says 172.21.15.82:55648) 2024-05-08T05:56:18.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.988+0000 7fd715e00700 1 -- 172.21.15.82:0/1088551556 learned_addr learned my addr 172.21.15.82:0/1088551556 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:56:18.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.988+0000 7fd715400700 1 --2- 172.21.15.82:0/1088551556 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563efcd7b450 0x563efcd7ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:18.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.988+0000 7fd716800700 1 --2- 172.21.15.82:0/1088551556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563efcd7bd70 0x563efcd7f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:18.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.989+0000 7fd715e00700 1 -- 172.21.15.82:0/1088551556 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563efcd7b450 msgr2=0x563efcd7ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:56:18.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.989+0000 7fd715e00700 1 --2- 172.21.15.82:0/1088551556 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563efcd7b450 0x563efcd7ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:18.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.989+0000 7fd715e00700 1 -- 172.21.15.82:0/1088551556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563efcd7bd70 msgr2=0x563efcd7f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:56:18.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.989+0000 7fd715e00700 1 --2- 172.21.15.82:0/1088551556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563efcd7bd70 0x563efcd7f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:18.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.989+0000 7fd715e00700 1 -- 172.21.15.82:0/1088551556 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563efcc854a0 con 0x563efcd76180 2024-05-08T05:56:18.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.989+0000 7fd715400700 1 --2- 172.21.15.82:0/1088551556 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563efcd7b450 0x563efcd7ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:56:18.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.989+0000 7fd716800700 1 --2- 172.21.15.82:0/1088551556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563efcd7bd70 0x563efcd7f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:56:18.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.989+0000 7fd715e00700 1 --2- 172.21.15.82:0/1088551556 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563efcd76180 0x563efcd819f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd710000f80 tx=0x7fd71000b3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81108570c313813 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:56:18.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.989+0000 7fd6fbe00700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:56:18.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.990+0000 7fd6fbe00700 1 -- 172.21.15.82:0/1088551556 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd71002d070 con 0x563efcd76180 2024-05-08T05:56:18.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.990+0000 7fd727406b80 1 -- 172.21.15.82:0/1088551556 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd70801a460 con 0x563efcd76180 2024-05-08T05:56:18.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.990+0000 7fd6fbe00700 1 -- 172.21.15.82:0/1088551556 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd710007a70 con 0x563efcd76180 2024-05-08T05:56:18.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.991+0000 7fd6fbe00700 1 -- 172.21.15.82:0/1088551556 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fd710039050 con 0x563efcd76180 2024-05-08T05:56:18.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.991+0000 7fd727406b80 10 client.25849 fetch_fsmap learned FSMap version 31 2024-05-08T05:56:18.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.991+0000 7fd727406b80 1 -- 172.21.15.82:0/1088551556 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x563efcd8cfd0 con 0x563efcd76180 2024-05-08T05:56:18.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.991+0000 7fd6fbe00700 1 -- 172.21.15.82:0/1088551556 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd70801a460 con 0x563efcd76180 2024-05-08T05:56:18.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.992+0000 7fd6fbe00700 1 -- 172.21.15.82:0/1088551556 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fd710011070 con 0x563efcd76180 2024-05-08T05:56:18.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.992+0000 7fd727406b80 10 client.25849 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:56:18.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.992+0000 7fd727406b80 10 client.25849 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:56:18.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.992+0000 7fd727406b80 20 client.25849 populate_metadata read hostname 'smithi082' 2024-05-08T05:56:18.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.992+0000 7fd727406b80 1 --2- 172.21.15.82:0/1088551556 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x563efcd8f560 0x563efcd91950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:18.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.992+0000 7fd727406b80 4 client.25849 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:56:18.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.992+0000 7fd727406b80 1 -- 172.21.15.82:0/1088551556 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563efcd3a1c0 con 0x563efcd8f560 2024-05-08T05:56:18.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.993+0000 7fd715400700 1 --2- 172.21.15.82:0/1088551556 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x563efcd8f560 0x563efcd91950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:18.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.994+0000 7fd6fbe00700 10 client.25849 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:56:18.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.994+0000 7fd715400700 1 --2- 172.21.15.82:0/1088551556 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x563efcd8f560 0x563efcd91950 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=962c4d96148494f1 server_cookie=ebae1c0db8b2c849 in_seq=0 out_seq=0 2024-05-08T05:56:18.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.995+0000 7fd6fbe00700 1 -- 172.21.15.82:0/1088551556 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x563efcd3a1c0 con 0x563efcd8f560 2024-05-08T05:56:18.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.995+0000 7fd6fbe00700 10 client.25849 handle_command_reply: tid=0 2024-05-08T05:56:18.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.996+0000 7fd727406b80 1 client.25849 shutdown 2024-05-08T05:56:18.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.996+0000 7fd727406b80 1 -- 172.21.15.82:0/1088551556 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563efcd76180 msgr2=0x563efcd819f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:56:18.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.996+0000 7fd727406b80 1 --2- 172.21.15.82:0/1088551556 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563efcd76180 0x563efcd819f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fd710000f80 tx=0x7fd71000b3b0 comp rx=0 tx=0).stop 2024-05-08T05:56:18.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.996+0000 7fd727406b80 1 -- 172.21.15.82:0/1088551556 shutdown_connections 2024-05-08T05:56:18.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.996+0000 7fd727406b80 1 --2- 172.21.15.82:0/1088551556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563efcd7bd70 0x563efcd7f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:18.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.996+0000 7fd727406b80 1 --2- 172.21.15.82:0/1088551556 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563efcd76180 0x563efcd819f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:18.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.996+0000 7fd727406b80 1 --2- 172.21.15.82:0/1088551556 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x563efcd8f560 0x563efcd91950 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:18.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.996+0000 7fd727406b80 1 --2- 172.21.15.82:0/1088551556 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563efcd7b450 0x563efcd7ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:18.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.996+0000 7fd6fbe00700 0 client.25849 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:56:18.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.996+0000 7fd727406b80 1 -- 172.21.15.82:0/1088551556 >> 172.21.15.82:0/1088551556 conn(0x563efcce5750 msgr2=0x563efcd67210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:56:18.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.997+0000 7fd727406b80 1 -- 172.21.15.82:0/1088551556 shutdown_connections 2024-05-08T05:56:18.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.997+0000 7fd727406b80 1 -- 172.21.15.82:0/1088551556 wait complete. 2024-05-08T05:56:18.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:18.997+0000 7fd727406b80 20 client.25849 trim_cache size 0 max 16384 2024-05-08T05:56:19.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.032+0000 7fd727406b80 1 Processor -- start 2024-05-08T05:56:19.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.033+0000 7fd727406b80 1 -- start start 2024-05-08T05:56:19.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.033+0000 7fd727406b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563efcd76180 0x563efcd8b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:19.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.033+0000 7fd727406b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563efcd7b450 0x563efcd7ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:19.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.034+0000 7fd727406b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563efcd7bd70 0x563efcd67990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:19.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.034+0000 7fd727406b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f400d2d0 con 0x563efcd7b450 2024-05-08T05:56:19.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.034+0000 7fd727406b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f400ee10 con 0x563efcd76180 2024-05-08T05:56:19.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.034+0000 7fd727406b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f400d9a0 con 0x563efcd7bd70 2024-05-08T05:56:19.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.034+0000 7fd715400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563efcd7b450 0x563efcd7ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:19.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.034+0000 7fd715400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563efcd7b450 0x563efcd7ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:56688/0 (socket says 172.21.15.82:56688) 2024-05-08T05:56:19.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.034+0000 7fd715400700 1 -- 172.21.15.82:0/1950017171 learned_addr learned my addr 172.21.15.82:0/1950017171 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:56:19.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.034+0000 7fd715e00700 1 --2- 172.21.15.82:0/1950017171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563efcd76180 0x563efcd8b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:19.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.034+0000 7fd716800700 1 --2- 172.21.15.82:0/1950017171 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563efcd7bd70 0x563efcd67990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:19.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.034+0000 7fd715400700 1 -- 172.21.15.82:0/1950017171 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563efcd7bd70 msgr2=0x563efcd67990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:56:19.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.034+0000 7fd715400700 1 --2- 172.21.15.82:0/1950017171 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563efcd7bd70 0x563efcd67990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:19.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.034+0000 7fd715400700 1 -- 172.21.15.82:0/1950017171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563efcd76180 msgr2=0x563efcd8b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:56:19.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.034+0000 7fd715400700 1 --2- 172.21.15.82:0/1950017171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563efcd76180 0x563efcd8b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:19.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.034+0000 7fd715400700 1 -- 172.21.15.82:0/1950017171 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563efcd75ea0 con 0x563efcd7b450 2024-05-08T05:56:19.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.034+0000 7fd715e00700 1 --2- 172.21.15.82:0/1950017171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563efcd76180 0x563efcd8b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:56:19.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.035+0000 7fd716800700 1 --2- 172.21.15.82:0/1950017171 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563efcd7bd70 0x563efcd67990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:56:19.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.035+0000 7fd715400700 1 --2- 172.21.15.82:0/1950017171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563efcd7b450 0x563efcd7ca10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd7000a5a50 tx=0x7fd70001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eff15ee55f58a719 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:56:19.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.036+0000 7fd706a00700 1 -- 172.21.15.82:0/1950017171 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7000b2090 con 0x563efcd7b450 2024-05-08T05:56:19.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.036+0000 7fd706a00700 1 -- 172.21.15.82:0/1950017171 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd7000a94e0 con 0x563efcd7b450 2024-05-08T05:56:19.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.036+0000 7fd706a00700 1 -- 172.21.15.82:0/1950017171 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7000a5340 con 0x563efcd7b450 2024-05-08T05:56:19.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.037+0000 7fd727406b80 1 -- 172.21.15.82:0/1950017171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563efcd7b450 msgr2=0x563efcd7ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:56:19.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.037+0000 7fd727406b80 1 --2- 172.21.15.82:0/1950017171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563efcd7b450 0x563efcd7ca10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd7000a5a50 tx=0x7fd70001f000 comp rx=0 tx=0).stop 2024-05-08T05:56:19.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.037+0000 7fd727406b80 1 -- 172.21.15.82:0/1950017171 shutdown_connections 2024-05-08T05:56:19.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.037+0000 7fd727406b80 1 --2- 172.21.15.82:0/1950017171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563efcd76180 0x563efcd8b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:19.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.037+0000 7fd727406b80 1 --2- 172.21.15.82:0/1950017171 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563efcd7bd70 0x563efcd67990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:19.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.037+0000 7fd727406b80 1 --2- 172.21.15.82:0/1950017171 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563efcd7b450 0x563efcd7ca10 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:19.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.037+0000 7fd727406b80 1 -- 172.21.15.82:0/1950017171 >> 172.21.15.82:0/1950017171 conn(0x563efcce5750 msgr2=0x563efcd7a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:56:19.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.038+0000 7fd727406b80 1 -- 172.21.15.82:0/1950017171 shutdown_connections 2024-05-08T05:56:19.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.038+0000 7fd727406b80 1 -- 172.21.15.82:0/1950017171 wait complete. 2024-05-08T05:56:19.041 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.038+0000 7fd727406b80 1 -- start start 2024-05-08T05:56:19.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.039+0000 7fd727406b80 1 Processor -- start 2024-05-08T05:56:19.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.040+0000 7fd727406b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563efcd76180 0x563efcd87e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:19.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.041+0000 7fd727406b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563efcd7b450 0x563efcd88340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:19.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.041+0000 7fd727406b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563efcd7bd70 0x563efcd84d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:19.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.041+0000 7fd727406b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f400e740 con 0x563efcd76180 2024-05-08T05:56:19.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.041+0000 7fd727406b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f400e070 con 0x563efcd7b450 2024-05-08T05:56:19.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.041+0000 7fd727406b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd6f400b270 con 0x563efcd7bd70 2024-05-08T05:56:19.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.041+0000 7fd716800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563efcd7bd70 0x563efcd84d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:19.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.041+0000 7fd716800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563efcd7bd70 0x563efcd84d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:55666/0 (socket says 172.21.15.82:55666) 2024-05-08T05:56:19.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.041+0000 7fd716800700 1 -- 172.21.15.82:0/3103591424 learned_addr learned my addr 172.21.15.82:0/3103591424 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:56:19.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.042+0000 7fd716800700 1 -- 172.21.15.82:0/3103591424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563efcd7b450 msgr2=0x563efcd88340 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T05:56:19.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.042+0000 7fd727406b80 10 client.0 _ll_register_callbacks cb 0x563efcc66cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:56:19.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.043+0000 7fd716800700 1 --2- 172.21.15.82:0/3103591424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563efcd7b450 0x563efcd88340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:19.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.043+0000 7fd716800700 1 -- 172.21.15.82:0/3103591424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563efcd76180 msgr2=0x563efcd87e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:56:19.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.043+0000 7fd716800700 1 --2- 172.21.15.82:0/3103591424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563efcd76180 0x563efcd87e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:19.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.043+0000 7fd716800700 1 -- 172.21.15.82:0/3103591424 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563efcd85570 con 0x563efcd7bd70 2024-05-08T05:56:19.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.043+0000 7fd727406b80 1 -- 172.21.15.82:0/3103591424 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd7000a94e0 con 0x563efcd7bd70 2024-05-08T05:56:19.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.044+0000 7fd6fbe00700 10 client.25855 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:56:19.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.044+0000 7fd716800700 1 --2- 172.21.15.82:0/3103591424 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563efcd7bd70 0x563efcd84d30 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd70800dbd0 tx=0x7fd70800fe10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3996514e110f28ea server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:56:19.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.044+0000 7fd6fbe00700 1 -- 172.21.15.82:0/3103591424 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd70802a060 con 0x563efcd7bd70 2024-05-08T05:56:19.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.045+0000 7fd6fbe00700 1 -- 172.21.15.82:0/3103591424 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd708005590 con 0x563efcd7bd70 2024-05-08T05:56:19.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.045+0000 7fd6fbe00700 1 -- 172.21.15.82:0/3103591424 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fd708015040 con 0x563efcd7bd70 2024-05-08T05:56:19.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.045+0000 7fd727406b80 10 client.25855 fetch_fsmap learned FSMap version 31 2024-05-08T05:56:19.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.045+0000 7fd727406b80 1 -- 172.21.15.82:0/3103591424 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({fsmap=31}) -- 0x563efcdfaa10 con 0x563efcd7bd70 2024-05-08T05:56:19.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.046+0000 7fd6fbe00700 1 -- 172.21.15.82:0/3103591424 <== mon.1 v2:172.21.15.151:3300/0 4 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fd7080046f0 con 0x563efcd7bd70 2024-05-08T05:56:19.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.046+0000 7fd727406b80 10 client.25855 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:56:19.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.046+0000 7fd727406b80 10 client.25855 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:56:19.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.046+0000 7fd727406b80 20 client.25855 populate_metadata read hostname 'smithi082' 2024-05-08T05:56:19.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.046+0000 7fd727406b80 1 --2- 172.21.15.82:0/3103591424 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x563efcdfad70 0x563efcdfd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:19.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.046+0000 7fd727406b80 4 client.25855 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-08T05:56:19.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.046+0000 7fd727406b80 1 -- 172.21.15.82:0/3103591424 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x563efcccd480 con 0x563efcdfad70 2024-05-08T05:56:19.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.050+0000 7fd715e00700 1 --2- 172.21.15.82:0/3103591424 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x563efcdfad70 0x563efcdfd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:19.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.050+0000 7fd715e00700 1 --2- 172.21.15.82:0/3103591424 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x563efcdfad70 0x563efcdfd1e0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94afb5a6e4c15b55 server_cookie=651c56553a602387 in_seq=0 out_seq=0 2024-05-08T05:56:19.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.050+0000 7fd6fbe00700 10 client.25855 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:56:19.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.054+0000 7fd6fbe00700 1 -- 172.21.15.82:0/3103591424 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563efcccd480 con 0x563efcdfad70 2024-05-08T05:56:19.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.054+0000 7fd6fbe00700 10 client.25855 handle_command_reply: tid=0 2024-05-08T05:56:19.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.054+0000 7fd727406b80 1 client.25855 shutdown 2024-05-08T05:56:19.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.055+0000 7fd727406b80 1 -- 172.21.15.82:0/3103591424 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563efcd7bd70 msgr2=0x563efcd84d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:56:19.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.055+0000 7fd727406b80 1 --2- 172.21.15.82:0/3103591424 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563efcd7bd70 0x563efcd84d30 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd70800dbd0 tx=0x7fd70800fe10 comp rx=0 tx=0).stop 2024-05-08T05:56:19.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.055+0000 7fd727406b80 1 -- 172.21.15.82:0/3103591424 shutdown_connections 2024-05-08T05:56:19.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.056+0000 7fd727406b80 1 --2- 172.21.15.82:0/3103591424 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563efcd7bd70 0x563efcd84d30 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:19.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.056+0000 7fd727406b80 1 --2- 172.21.15.82:0/3103591424 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563efcd76180 0x563efcd87e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:19.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.056+0000 7fd727406b80 1 --2- 172.21.15.82:0/3103591424 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x563efcdfad70 0x563efcdfd1e0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:19.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.056+0000 7fd727406b80 1 --2- 172.21.15.82:0/3103591424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563efcd7b450 0x563efcd88340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:19.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.056+0000 7fd6fbe00700 0 client.25855 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:56:19.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.056+0000 7fd727406b80 1 -- 172.21.15.82:0/3103591424 >> 172.21.15.82:0/3103591424 conn(0x563efcce5750 msgr2=0x563efcd7e660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:56:19.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.056+0000 7fd727406b80 1 -- 172.21.15.82:0/3103591424 shutdown_connections 2024-05-08T05:56:19.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.057+0000 7fd727406b80 1 -- 172.21.15.82:0/3103591424 wait complete. 2024-05-08T05:56:19.058 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T05:56:19.058 INFO:teuthology.orchestra.run.smithi082.stdout: "return_code": 0, 2024-05-08T05:56:19.058 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_tag": "2f26dbd1-d839-44fe-aa8a-fe5718241b3a", 2024-05-08T05:56:19.058 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": "asynchronous" 2024-05-08T05:56:19.058 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T05:56:19.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.057+0000 7fd727406b80 20 client.25855 trim_cache size 0 max 16384 2024-05-08T05:56:19.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.059+0000 7fd71ca00700 1 -- 172.21.15.82:0/2802986004 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd6fc0b2980 msgr2=0x7fd6fc0b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:56:19.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.059+0000 7fd71ca00700 1 --2- 172.21.15.82:0/2802986004 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd6fc0b2980 0x7fd6fc0b4e40 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd7100062a0 tx=0x7fd710006210 comp rx=0 tx=0).stop 2024-05-08T05:56:19.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.059+0000 7fd71ca00700 1 -- 172.21.15.82:0/2802986004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd71806bb40 msgr2=0x7fd71819c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:56:19.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.059+0000 7fd71ca00700 1 --2- 172.21.15.82:0/2802986004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd71806bb40 0x7fd71819c2e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd70000e9a0 tx=0x7fd70000ecb0 comp rx=0 tx=0).stop 2024-05-08T05:56:19.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.063+0000 7fd71ca00700 1 -- 172.21.15.82:0/2802986004 shutdown_connections 2024-05-08T05:56:19.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.063+0000 7fd71ca00700 1 --2- 172.21.15.82:0/2802986004 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd6fc0b2980 0x7fd6fc0b4e40 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:19.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.063+0000 7fd71ca00700 1 --2- 172.21.15.82:0/2802986004 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd718109510 0x7fd7181a0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:19.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.063+0000 7fd71ca00700 1 --2- 172.21.15.82:0/2802986004 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd71806b180 0x7fd71819bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:19.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.063+0000 7fd71ca00700 1 --2- 172.21.15.82:0/2802986004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd71806bb40 0x7fd71819c2e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:19.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.063+0000 7fd71ca00700 1 -- 172.21.15.82:0/2802986004 >> 172.21.15.82:0/2802986004 conn(0x7fd718079350 msgr2=0x7fd71810a300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:56:19.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.063+0000 7fd71ca00700 1 -- 172.21.15.82:0/2802986004 shutdown_connections 2024-05-08T05:56:19.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:19.063+0000 7fd71ca00700 1 -- 172.21.15.82:0/2802986004 wait complete. 2024-05-08T05:56:19.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:56:19 smithi151 ceph-mon[34815]: pgmap v629: 97 pgs: 97 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.9 MiB/s wr, 626 op/s 2024-05-08T05:56:19.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:56:19 smithi151 ceph-mon[34815]: scrub queued for path: / 2024-05-08T05:56:19.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:56:19 smithi151 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-05-08T05:56:19.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:56:19 smithi151 ceph-mon[34815]: scrub summary: active paths [/] 2024-05-08T05:56:19.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:56:19 smithi151 ceph-mon[34815]: scrub summary: active paths [/] 2024-05-08T05:56:19.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:56:19 smithi151 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-05-08T05:56:19.946 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:56:19 smithi082 ceph-mon[30098]: pgmap v629: 97 pgs: 97 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.9 MiB/s wr, 626 op/s 2024-05-08T05:56:19.946 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:56:19 smithi082 ceph-mon[30098]: scrub queued for path: / 2024-05-08T05:56:19.946 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:56:19 smithi082 ceph-mon[30098]: scrub summary: idle+waiting paths [/] 2024-05-08T05:56:19.946 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:56:19 smithi082 ceph-mon[30098]: scrub summary: active paths [/] 2024-05-08T05:56:19.946 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:56:19 smithi082 ceph-mon[30098]: scrub summary: active paths [/] 2024-05-08T05:56:19.946 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:56:19 smithi082 ceph-mon[30098]: scrub summary: idle+waiting paths [/] 2024-05-08T05:56:19.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:56:19 smithi134 ceph-mon[34132]: pgmap v629: 97 pgs: 97 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.9 MiB/s wr, 626 op/s 2024-05-08T05:56:20.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:56:19 smithi134 ceph-mon[34132]: scrub queued for path: / 2024-05-08T05:56:20.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:56:19 smithi134 ceph-mon[34132]: scrub summary: idle+waiting paths [/] 2024-05-08T05:56:20.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:56:19 smithi134 ceph-mon[34132]: scrub summary: active paths [/] 2024-05-08T05:56:20.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:56:19 smithi134 ceph-mon[34132]: scrub summary: active paths [/] 2024-05-08T05:56:20.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:56:19 smithi134 ceph-mon[34132]: scrub summary: idle+waiting paths [/] 2024-05-08T05:56:20.006 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-08T05:56:20.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 330.0 s, 2090.0 tps, lat 47.588 ms stddev 55.395 2024-05-08T05:56:20.629 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:56:20.870 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:56:20 smithi082 ceph-mon[30098]: scrub summary: idle+waiting paths [/] 2024-05-08T05:56:20.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:56:20 smithi151 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-05-08T05:56:20.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:56:20 smithi134 ceph-mon[34132]: scrub summary: idle+waiting paths [/] 2024-05-08T05:56:21.878 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:56:21 smithi082 ceph-mon[30098]: pgmap v630: 97 pgs: 97 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.7 MiB/s wr, 716 op/s 2024-05-08T05:56:21.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:56:21 smithi151 ceph-mon[34815]: pgmap v630: 97 pgs: 97 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.7 MiB/s wr, 716 op/s 2024-05-08T05:56:21.901 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:56:21 smithi134 ceph-mon[34132]: pgmap v630: 97 pgs: 97 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.7 MiB/s wr, 716 op/s 2024-05-08T05:56:23.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.110+0000 7f1472a00700 1 -- 172.21.15.82:0/417269060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f146c10ff50 msgr2=0x7f146c112340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:56:23.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.110+0000 7f1472a00700 1 --2- 172.21.15.82:0/417269060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f146c10ff50 0x7f146c112340 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f146400b0a0 tx=0x7f146400b3b0 comp rx=0 tx=0).stop 2024-05-08T05:56:23.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.110+0000 7f1472a00700 1 -- 172.21.15.82:0/417269060 shutdown_connections 2024-05-08T05:56:23.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.110+0000 7f1472a00700 1 --2- 172.21.15.82:0/417269060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f146c10ff50 0x7f146c112340 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:23.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.110+0000 7f1472a00700 1 --2- 172.21.15.82:0/417269060 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f146c06b1b0 0x7f146c06b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:23.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.110+0000 7f1472a00700 1 --2- 172.21.15.82:0/417269060 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f146c06bad0 0x7f146c10fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:23.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.110+0000 7f1472a00700 1 -- 172.21.15.82:0/417269060 >> 172.21.15.82:0/417269060 conn(0x7f146c079350 msgr2=0x7f146c079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:56:23.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.110+0000 7f1472a00700 1 -- 172.21.15.82:0/417269060 shutdown_connections 2024-05-08T05:56:23.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.111+0000 7f1472a00700 1 -- 172.21.15.82:0/417269060 wait complete. 2024-05-08T05:56:23.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.112+0000 7f1472a00700 1 Processor -- start 2024-05-08T05:56:23.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.112+0000 7f1472a00700 1 -- start start 2024-05-08T05:56:23.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.113+0000 7f1472a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f146c06b1b0 0x7f146c1a1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:23.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.113+0000 7f1472a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f146c06bad0 0x7f146c1a1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:23.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.113+0000 7f1472a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f146c10ff50 0x7f146c19bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:23.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.113+0000 7f1472a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f146c1158c0 con 0x7f146c06b1b0 2024-05-08T05:56:23.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.113+0000 7f1472a00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f146c115740 con 0x7f146c06bad0 2024-05-08T05:56:23.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.113+0000 7f1472a00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f146c115a40 con 0x7f146c10ff50 2024-05-08T05:56:23.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.113+0000 7f1470a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f146c10ff50 0x7f146c19bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:23.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.113+0000 7f146be00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f146c06b1b0 0x7f146c1a1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:23.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.113+0000 7f146b400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f146c06bad0 0x7f146c1a1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:23.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.113+0000 7f1470a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f146c10ff50 0x7f146c19bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:58082/0 (socket says 172.21.15.82:58082) 2024-05-08T05:56:23.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.113+0000 7f1470a00700 1 -- 172.21.15.82:0/4224670350 learned_addr learned my addr 172.21.15.82:0/4224670350 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:56:23.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.114+0000 7f1470a00700 1 -- 172.21.15.82:0/4224670350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f146c06bad0 msgr2=0x7f146c1a1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:56:23.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.114+0000 7f1470a00700 1 --2- 172.21.15.82:0/4224670350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f146c06bad0 0x7f146c1a1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:23.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.114+0000 7f1470a00700 1 -- 172.21.15.82:0/4224670350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f146c06b1b0 msgr2=0x7f146c1a1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:56:23.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.114+0000 7f1470a00700 1 --2- 172.21.15.82:0/4224670350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f146c06b1b0 0x7f146c1a1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:23.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.114+0000 7f1470a00700 1 -- 172.21.15.82:0/4224670350 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f146c19c440 con 0x7f146c10ff50 2024-05-08T05:56:23.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.115+0000 7f1470a00700 1 --2- 172.21.15.82:0/4224670350 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f146c10ff50 0x7f146c19bb60 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1464006070 tx=0x7f1464004cf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:56:23.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.115+0000 7f1468c00700 1 -- 172.21.15.82:0/4224670350 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1464021070 con 0x7f146c10ff50 2024-05-08T05:56:23.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.115+0000 7f1468c00700 1 -- 172.21.15.82:0/4224670350 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1464007b80 con 0x7f146c10ff50 2024-05-08T05:56:23.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.115+0000 7f1468c00700 1 -- 172.21.15.82:0/4224670350 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14640052a0 con 0x7f146c10ff50 2024-05-08T05:56:23.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.116+0000 7f1472a00700 1 -- 172.21.15.82:0/4224670350 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f146c19c6d0 con 0x7f146c10ff50 2024-05-08T05:56:23.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.117+0000 7f1472a00700 1 -- 172.21.15.82:0/4224670350 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f146c1045b0 con 0x7f146c10ff50 2024-05-08T05:56:23.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.123+0000 7f1468c00700 1 -- 172.21.15.82:0/4224670350 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f1464024070 con 0x7f146c10ff50 2024-05-08T05:56:23.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.123+0000 7f147d41ab80 1 Processor -- start 2024-05-08T05:56:23.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.124+0000 7f147d41ab80 1 -- start start 2024-05-08T05:56:23.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.124+0000 7f147d41ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611d99e7bc0 0x5611d99e7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:23.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.124+0000 7f147d41ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611d99e84e0 0x5611d99e22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:23.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.124+0000 7f147d41ab80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611d99e28f0 0x5611d99e2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:23.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.124+0000 7f147d41ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5611d9934a20 con 0x5611d99e84e0 2024-05-08T05:56:23.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.124+0000 7f147d41ab80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5611d98d2760 con 0x5611d99e28f0 2024-05-08T05:56:23.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.124+0000 7f147d41ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5611d99309e0 con 0x5611d99e7bc0 2024-05-08T05:56:23.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.124+0000 7f146b400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611d99e7bc0 0x5611d99e7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:23.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.124+0000 7f146b400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611d99e7bc0 0x5611d99e7fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:58094/0 (socket says 172.21.15.82:58094) 2024-05-08T05:56:23.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.124+0000 7f146b400700 1 -- 172.21.15.82:0/665856769 learned_addr learned my addr 172.21.15.82:0/665856769 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:56:23.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.124+0000 7f146b400700 1 --2- 172.21.15.82:0/665856769 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611d99e28f0 0x5611d99e2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:23.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.125+0000 7f146b400700 1 -- 172.21.15.82:0/665856769 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611d99e7bc0 msgr2=0x5611d99e7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:56:23.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.125+0000 7f146b400700 1 --2- 172.21.15.82:0/665856769 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611d99e7bc0 0x5611d99e7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:23.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.125+0000 7f146b400700 1 -- 172.21.15.82:0/665856769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611d99e84e0 msgr2=0x5611d99e22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:56:23.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.125+0000 7f146b400700 1 --2- 172.21.15.82:0/665856769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611d99e84e0 0x5611d99e22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:23.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.125+0000 7f146b400700 1 -- 172.21.15.82:0/665856769 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611d98818d0 con 0x5611d99e28f0 2024-05-08T05:56:23.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.125+0000 7f146b400700 1 --2- 172.21.15.82:0/665856769 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611d99e28f0 0x5611d99e2d70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1458009e20 tx=0x7f14580047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa57e209d61647d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:56:23.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.126+0000 7f1468c00700 1 --2- 172.21.15.82:0/4224670350 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f14500b2880 0x7f14500b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:23.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.126+0000 7f1468c00700 1 -- 172.21.15.82:0/4224670350 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f146400f070 con 0x7f146c10ff50 2024-05-08T05:56:23.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.126+0000 7f146be00700 1 --2- 172.21.15.82:0/4224670350 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f14500b2880 0x7f14500b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:23.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.127+0000 7f1461600700 1 -- 172.21.15.82:0/665856769 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1458009e50 con 0x5611d99e28f0 2024-05-08T05:56:23.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.128+0000 7f1461600700 1 -- 172.21.15.82:0/665856769 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1458009a90 con 0x5611d99e28f0 2024-05-08T05:56:23.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.129+0000 7f147d41ab80 1 -- 172.21.15.82:0/665856769 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611d99e28f0 msgr2=0x5611d99e2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:56:23.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.129+0000 7f147d41ab80 1 --2- 172.21.15.82:0/665856769 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611d99e28f0 0x5611d99e2d70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1458009e20 tx=0x7f14580047c0 comp rx=0 tx=0).stop 2024-05-08T05:56:23.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.129+0000 7f146be00700 1 --2- 172.21.15.82:0/4224670350 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f14500b2880 0x7f14500b4d40 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x5611d99e88e0 tx=0x7f145c00a7e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:56:23.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.130+0000 7f147d41ab80 1 -- 172.21.15.82:0/665856769 shutdown_connections 2024-05-08T05:56:23.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.130+0000 7f147d41ab80 1 --2- 172.21.15.82:0/665856769 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611d99e28f0 0x5611d99e2d70 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:23.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.130+0000 7f147d41ab80 1 --2- 172.21.15.82:0/665856769 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611d99e7bc0 0x5611d99e7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:23.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.130+0000 7f147d41ab80 1 --2- 172.21.15.82:0/665856769 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611d99e84e0 0x5611d99e22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:23.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.130+0000 7f147d41ab80 1 -- 172.21.15.82:0/665856769 >> 172.21.15.82:0/665856769 conn(0x5611d995a6d0 msgr2=0x5611d99dcb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:56:23.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.130+0000 7f147d41ab80 1 -- 172.21.15.82:0/665856769 shutdown_connections 2024-05-08T05:56:23.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.131+0000 7f147d41ab80 1 -- 172.21.15.82:0/665856769 wait complete. 2024-05-08T05:56:23.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.131+0000 7f147d41ab80 1 -- start start 2024-05-08T05:56:23.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.132+0000 7f147d41ab80 1 Processor -- start 2024-05-08T05:56:23.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.133+0000 7f147d41ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611d99e28f0 0x5611d99ee060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:23.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.133+0000 7f147d41ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611d99e7bc0 0x5611d99eb400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:23.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.133+0000 7f147d41ab80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611d99e84e0 0x5611d99eb940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:23.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.133+0000 7f147d41ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5611d99eef60 con 0x5611d99e28f0 2024-05-08T05:56:23.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.133+0000 7f147d41ab80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5611d989ab20 con 0x5611d99e84e0 2024-05-08T05:56:23.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.133+0000 7f147d41ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5611d99ef0e0 con 0x5611d99e7bc0 2024-05-08T05:56:23.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.133+0000 7f147d41ab80 10 client.0 _ll_register_callbacks cb 0x5611d98dbc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:56:23.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.133+0000 7f146b400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611d99e7bc0 0x5611d99eb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:23.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.133+0000 7f146b400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611d99e7bc0 0x5611d99eb400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:58098/0 (socket says 172.21.15.82:58098) 2024-05-08T05:56:23.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.133+0000 7f146b400700 1 -- 172.21.15.82:0/2548529568 learned_addr learned my addr 172.21.15.82:0/2548529568 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:56:23.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.133+0000 7f146be00700 1 --2- 172.21.15.82:0/2548529568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611d99e28f0 0x5611d99ee060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:23.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.133+0000 7f1470a00700 1 --2- 172.21.15.82:0/2548529568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611d99e84e0 0x5611d99eb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:23.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.134+0000 7f146b400700 1 -- 172.21.15.82:0/2548529568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611d99e84e0 msgr2=0x5611d99eb940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:56:23.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.134+0000 7f146b400700 1 --2- 172.21.15.82:0/2548529568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611d99e84e0 0x5611d99eb940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:23.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.134+0000 7f146b400700 1 -- 172.21.15.82:0/2548529568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611d99e28f0 msgr2=0x5611d99ee060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:56:23.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.134+0000 7f146b400700 1 --2- 172.21.15.82:0/2548529568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611d99e28f0 0x5611d99ee060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:23.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.134+0000 7f146b400700 1 -- 172.21.15.82:0/2548529568 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611d98fa420 con 0x5611d99e7bc0 2024-05-08T05:56:23.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.134+0000 7f1470a00700 1 --2- 172.21.15.82:0/2548529568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611d99e84e0 0x5611d99eb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:56:23.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.134+0000 7f146be00700 1 --2- 172.21.15.82:0/2548529568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611d99e28f0 0x5611d99ee060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:56:23.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.134+0000 7f146b400700 1 --2- 172.21.15.82:0/2548529568 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611d99e7bc0 0x5611d99eb400 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1458009df0 tx=0x7f1458022bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a057708e17e1e4b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:56:23.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.134+0000 7f1456000700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:56:23.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.134+0000 7f1456000700 1 -- 172.21.15.82:0/2548529568 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1458022e90 con 0x5611d99e7bc0 2024-05-08T05:56:23.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.134+0000 7f1456000700 1 -- 172.21.15.82:0/2548529568 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f145802a040 con 0x5611d99e7bc0 2024-05-08T05:56:23.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.135+0000 7f147d41ab80 1 -- 172.21.15.82:0/2548529568 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1458009a90 con 0x5611d99e7bc0 2024-05-08T05:56:23.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.135+0000 7f1456000700 1 -- 172.21.15.82:0/2548529568 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f14580045f0 con 0x5611d99e7bc0 2024-05-08T05:56:23.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.135+0000 7f147d41ab80 10 client.25867 fetch_fsmap learned FSMap version 31 2024-05-08T05:56:23.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.135+0000 7f147d41ab80 1 -- 172.21.15.82:0/2548529568 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5611d99f96b0 con 0x5611d99e7bc0 2024-05-08T05:56:23.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.136+0000 7f1456000700 1 -- 172.21.15.82:0/2548529568 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1458009a90 con 0x5611d99e7bc0 2024-05-08T05:56:23.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.136+0000 7f1456000700 1 -- 172.21.15.82:0/2548529568 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f1458023040 con 0x5611d99e7bc0 2024-05-08T05:56:23.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.136+0000 7f147d41ab80 10 client.25867 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:56:23.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.136+0000 7f147d41ab80 10 client.25867 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:56:23.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.136+0000 7f147d41ab80 20 client.25867 populate_metadata read hostname 'smithi082' 2024-05-08T05:56:23.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.136+0000 7f147d41ab80 1 --2- 172.21.15.82:0/2548529568 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5611d99fbbd0 0x5611d99fdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:23.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.136+0000 7f147d41ab80 4 client.25867 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:56:23.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.136+0000 7f147d41ab80 1 -- 172.21.15.82:0/2548529568 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5611d99af140 con 0x5611d99fbbd0 2024-05-08T05:56:23.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.138+0000 7f146be00700 1 --2- 172.21.15.82:0/2548529568 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5611d99fbbd0 0x5611d99fdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:23.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.139+0000 7f146be00700 1 --2- 172.21.15.82:0/2548529568 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5611d99fbbd0 0x5611d99fdfc0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cdef0fda5c3ac863 server_cookie=53fad1f81ff3f66d in_seq=0 out_seq=0 2024-05-08T05:56:23.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.139+0000 7f1456000700 10 client.25867 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:56:23.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.141+0000 7f1456000700 1 -- 172.21.15.82:0/2548529568 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5611d99af140 con 0x5611d99fbbd0 2024-05-08T05:56:23.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.141+0000 7f1456000700 10 client.25867 handle_command_reply: tid=0 2024-05-08T05:56:23.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.141+0000 7f147d41ab80 1 client.25867 shutdown 2024-05-08T05:56:23.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.141+0000 7f147d41ab80 1 -- 172.21.15.82:0/2548529568 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611d99e7bc0 msgr2=0x5611d99eb400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:56:23.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.141+0000 7f147d41ab80 1 --2- 172.21.15.82:0/2548529568 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611d99e7bc0 0x5611d99eb400 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1458009df0 tx=0x7f1458022bc0 comp rx=0 tx=0).stop 2024-05-08T05:56:23.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.142+0000 7f147d41ab80 1 -- 172.21.15.82:0/2548529568 shutdown_connections 2024-05-08T05:56:23.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.142+0000 7f147d41ab80 1 --2- 172.21.15.82:0/2548529568 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5611d99fbbd0 0x5611d99fdfc0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:23.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.142+0000 7f147d41ab80 1 --2- 172.21.15.82:0/2548529568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611d99e84e0 0x5611d99eb940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:23.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.142+0000 7f147d41ab80 1 --2- 172.21.15.82:0/2548529568 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611d99e28f0 0x5611d99ee060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:23.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.142+0000 7f147d41ab80 1 --2- 172.21.15.82:0/2548529568 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611d99e7bc0 0x5611d99eb400 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:23.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.142+0000 7f147d41ab80 1 -- 172.21.15.82:0/2548529568 >> 172.21.15.82:0/2548529568 conn(0x5611d995a6d0 msgr2=0x5611d99dc190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:56:23.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.142+0000 7f1456000700 0 client.25867 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:56:23.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.143+0000 7f147d41ab80 1 -- 172.21.15.82:0/2548529568 shutdown_connections 2024-05-08T05:56:23.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.143+0000 7f147d41ab80 1 -- 172.21.15.82:0/2548529568 wait complete. 2024-05-08T05:56:23.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.143+0000 7f147d41ab80 20 client.25867 trim_cache size 0 max 16384 2024-05-08T05:56:23.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.184+0000 7f147d41ab80 1 Processor -- start 2024-05-08T05:56:23.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.184+0000 7f147d41ab80 1 -- start start 2024-05-08T05:56:23.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.184+0000 7f147d41ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611d99e28f0 0x5611d99e22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:23.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.187+0000 7f147d41ab80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611d99e7bc0 0x5611d99e9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:23.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.187+0000 7f147d41ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611d99e84e0 0x5611d99dc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:23.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.187+0000 7f147d41ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f146c06ff10 con 0x5611d99e84e0 2024-05-08T05:56:23.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.187+0000 7f147d41ab80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f146c071a50 con 0x5611d99e7bc0 2024-05-08T05:56:23.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.187+0000 7f147d41ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f146c0705e0 con 0x5611d99e28f0 2024-05-08T05:56:23.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.187+0000 7f146be00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611d99e28f0 0x5611d99e22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:23.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.187+0000 7f146be00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611d99e28f0 0x5611d99e22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:58102/0 (socket says 172.21.15.82:58102) 2024-05-08T05:56:23.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.187+0000 7f146be00700 1 -- 172.21.15.82:0/450940732 learned_addr learned my addr 172.21.15.82:0/450940732 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:56:23.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.187+0000 7f146b400700 1 --2- 172.21.15.82:0/450940732 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611d99e7bc0 0x5611d99e9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:23.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.188+0000 7f1470a00700 1 --2- 172.21.15.82:0/450940732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611d99e84e0 0x5611d99dc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:23.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.188+0000 7f146be00700 1 -- 172.21.15.82:0/450940732 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611d99e7bc0 msgr2=0x5611d99e9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:56:23.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.188+0000 7f146be00700 1 --2- 172.21.15.82:0/450940732 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611d99e7bc0 0x5611d99e9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:23.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.189+0000 7f146be00700 1 -- 172.21.15.82:0/450940732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611d99e84e0 msgr2=0x5611d99dc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:56:23.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.189+0000 7f146be00700 1 --2- 172.21.15.82:0/450940732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611d99e84e0 0x5611d99dc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:23.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.189+0000 7f146be00700 1 -- 172.21.15.82:0/450940732 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611d99e9990 con 0x5611d99e28f0 2024-05-08T05:56:23.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.191+0000 7f146b400700 1 --2- 172.21.15.82:0/450940732 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611d99e7bc0 0x5611d99e9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:56:23.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.191+0000 7f1470a00700 1 --2- 172.21.15.82:0/450940732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611d99e84e0 0x5611d99dc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:56:23.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.192+0000 7f146be00700 1 --2- 172.21.15.82:0/450940732 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611d99e28f0 0x5611d99e22d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f145c004790 tx=0x7f145c012000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=749d0c4392add5df server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:56:23.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.194+0000 7f1460c00700 1 -- 172.21.15.82:0/450940732 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f145c016070 con 0x5611d99e28f0 2024-05-08T05:56:23.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.194+0000 7f1460c00700 1 -- 172.21.15.82:0/450940732 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f145c03c070 con 0x5611d99e28f0 2024-05-08T05:56:23.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.194+0000 7f1460c00700 1 -- 172.21.15.82:0/450940732 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f145c036a30 con 0x5611d99e28f0 2024-05-08T05:56:23.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.195+0000 7f147d41ab80 1 -- 172.21.15.82:0/450940732 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611d99e28f0 msgr2=0x5611d99e22d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:56:23.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.195+0000 7f147d41ab80 1 --2- 172.21.15.82:0/450940732 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611d99e28f0 0x5611d99e22d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f145c004790 tx=0x7f145c012000 comp rx=0 tx=0).stop 2024-05-08T05:56:23.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.196+0000 7f147d41ab80 1 -- 172.21.15.82:0/450940732 shutdown_connections 2024-05-08T05:56:23.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.196+0000 7f147d41ab80 1 --2- 172.21.15.82:0/450940732 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611d99e84e0 0x5611d99dc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:23.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.196+0000 7f147d41ab80 1 --2- 172.21.15.82:0/450940732 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611d99e28f0 0x5611d99e22d0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:23.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.196+0000 7f147d41ab80 1 --2- 172.21.15.82:0/450940732 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611d99e7bc0 0x5611d99e9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:23.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.196+0000 7f147d41ab80 1 -- 172.21.15.82:0/450940732 >> 172.21.15.82:0/450940732 conn(0x5611d995a6d0 msgr2=0x5611d99e8910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:56:23.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.197+0000 7f147d41ab80 1 -- 172.21.15.82:0/450940732 shutdown_connections 2024-05-08T05:56:23.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.197+0000 7f147d41ab80 1 -- 172.21.15.82:0/450940732 wait complete. 2024-05-08T05:56:23.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.198+0000 7f147d41ab80 1 -- start start 2024-05-08T05:56:23.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.198+0000 7f147d41ab80 1 Processor -- start 2024-05-08T05:56:23.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.199+0000 7f147d41ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611d99e28f0 0x5611d9a00aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:23.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.199+0000 7f147d41ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611d99e7bc0 0x5611d9a00fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:23.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.199+0000 7f147d41ab80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611d99e84e0 0x5611d99fdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:23.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.199+0000 7f147d41ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f146c071380 con 0x5611d99e7bc0 2024-05-08T05:56:23.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.199+0000 7f147d41ab80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f146c070cb0 con 0x5611d99e84e0 2024-05-08T05:56:23.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.199+0000 7f147d41ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f146c1087c0 con 0x5611d99e28f0 2024-05-08T05:56:23.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.199+0000 7f147d41ab80 10 client.0 _ll_register_callbacks cb 0x5611d99ec440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:56:23.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.199+0000 7f146be00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611d99e28f0 0x5611d9a00aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:23.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.199+0000 7f146be00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611d99e28f0 0x5611d9a00aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:58106/0 (socket says 172.21.15.82:58106) 2024-05-08T05:56:23.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.199+0000 7f146be00700 1 -- 172.21.15.82:0/3302123137 learned_addr learned my addr 172.21.15.82:0/3302123137 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:56:23.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.201+0000 7f146be00700 1 -- 172.21.15.82:0/3302123137 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611d99e84e0 msgr2=0x5611d99fdfc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T05:56:23.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.201+0000 7f146be00700 1 --2- 172.21.15.82:0/3302123137 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611d99e84e0 0x5611d99fdfc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:23.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.201+0000 7f146be00700 1 -- 172.21.15.82:0/3302123137 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611d99e7bc0 msgr2=0x5611d9a00fe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T05:56:23.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.201+0000 7f146be00700 1 --2- 172.21.15.82:0/3302123137 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611d99e7bc0 0x5611d9a00fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:23.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.201+0000 7f146be00700 1 -- 172.21.15.82:0/3302123137 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611d99fe7d0 con 0x5611d99e28f0 2024-05-08T05:56:23.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.202+0000 7f1456000700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:56:23.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.202+0000 7f146be00700 1 --2- 172.21.15.82:0/3302123137 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611d99e28f0 0x5611d9a00aa0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f145c005ea0 tx=0x7f145c00fec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e251cc06c71007a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:56:23.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.202+0000 7f1456000700 1 -- 172.21.15.82:0/3302123137 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f145c044070 con 0x5611d99e28f0 2024-05-08T05:56:23.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.203+0000 7f1456000700 1 -- 172.21.15.82:0/3302123137 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f145c036a00 con 0x5611d99e28f0 2024-05-08T05:56:23.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.203+0000 7f147d41ab80 1 -- 172.21.15.82:0/3302123137 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f145c03c070 con 0x5611d99e28f0 2024-05-08T05:56:23.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.204+0000 7f1456000700 1 -- 172.21.15.82:0/3302123137 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f145c04d050 con 0x5611d99e28f0 2024-05-08T05:56:23.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.204+0000 7f147d41ab80 10 client.25873 fetch_fsmap learned FSMap version 31 2024-05-08T05:56:23.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.204+0000 7f147d41ab80 1 -- 172.21.15.82:0/3302123137 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5611d9a65af0 con 0x5611d99e28f0 2024-05-08T05:56:23.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.204+0000 7f1456000700 1 -- 172.21.15.82:0/3302123137 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f145c03c070 con 0x5611d99e28f0 2024-05-08T05:56:23.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.205+0000 7f1456000700 1 -- 172.21.15.82:0/3302123137 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f145c036ce0 con 0x5611d99e28f0 2024-05-08T05:56:23.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.205+0000 7f147d41ab80 10 client.25873 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:56:23.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.205+0000 7f147d41ab80 10 client.25873 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:56:23.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.205+0000 7f147d41ab80 20 client.25873 populate_metadata read hostname 'smithi082' 2024-05-08T05:56:23.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.205+0000 7f147d41ab80 1 --2- 172.21.15.82:0/3302123137 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5611d9a661a0 0x5611d9a685c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:23.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.205+0000 7f147d41ab80 4 client.25873 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-08T05:56:23.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.205+0000 7f147d41ab80 1 -- 172.21.15.82:0/3302123137 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5611d9942400 con 0x5611d9a661a0 2024-05-08T05:56:23.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.206+0000 7f146b400700 1 --2- 172.21.15.82:0/3302123137 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5611d9a661a0 0x5611d9a685c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:23.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.208+0000 7f146b400700 1 --2- 172.21.15.82:0/3302123137 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5611d9a661a0 0x5611d9a685c0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78b3fcd57e6a1a45 server_cookie=4dda9462db1ee413 in_seq=0 out_seq=0 2024-05-08T05:56:23.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.208+0000 7f1456000700 10 client.25873 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:56:23.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.208+0000 7f1456000700 1 -- 172.21.15.82:0/3302123137 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5611d9942400 con 0x5611d9a661a0 2024-05-08T05:56:23.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.208+0000 7f1456000700 10 client.25873 handle_command_reply: tid=0 2024-05-08T05:56:23.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.208+0000 7f147d41ab80 1 client.25873 shutdown 2024-05-08T05:56:23.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.209+0000 7f147d41ab80 1 -- 172.21.15.82:0/3302123137 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611d99e28f0 msgr2=0x5611d9a00aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:56:23.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.209+0000 7f147d41ab80 1 --2- 172.21.15.82:0/3302123137 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611d99e28f0 0x5611d9a00aa0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f145c005ea0 tx=0x7f145c00fec0 comp rx=0 tx=0).stop 2024-05-08T05:56:23.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.211+0000 7f147d41ab80 1 -- 172.21.15.82:0/3302123137 shutdown_connections 2024-05-08T05:56:23.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.211+0000 7f147d41ab80 1 --2- 172.21.15.82:0/3302123137 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5611d9a661a0 0x5611d9a685c0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:23.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.211+0000 7f147d41ab80 1 --2- 172.21.15.82:0/3302123137 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611d99e84e0 0x5611d99fdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:23.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.211+0000 7f147d41ab80 1 --2- 172.21.15.82:0/3302123137 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611d99e28f0 0x5611d9a00aa0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:23.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.211+0000 7f147d41ab80 1 --2- 172.21.15.82:0/3302123137 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611d99e7bc0 0x5611d9a00fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:23.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.211+0000 7f147d41ab80 1 -- 172.21.15.82:0/3302123137 >> 172.21.15.82:0/3302123137 conn(0x5611d995a6d0 msgr2=0x5611d99e9d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:56:23.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.211+0000 7f1456000700 0 client.25873 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:56:23.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.211+0000 7f147d41ab80 1 -- 172.21.15.82:0/3302123137 shutdown_connections 2024-05-08T05:56:23.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.211+0000 7f147d41ab80 1 -- 172.21.15.82:0/3302123137 wait complete. 2024-05-08T05:56:23.213 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T05:56:23.213 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-08T05:56:23.213 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2024-05-08T05:56:23.213 INFO:teuthology.orchestra.run.smithi082.stdout: "2f26dbd1-d839-44fe-aa8a-fe5718241b3a": { 2024-05-08T05:56:23.213 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2024-05-08T05:56:23.213 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "2f26dbd1-d839-44fe-aa8a-fe5718241b3a", 2024-05-08T05:56:23.213 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2024-05-08T05:56:23.213 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T05:56:23.213 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T05:56:23.213 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T05:56:23.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.211+0000 7f147d41ab80 20 client.25873 trim_cache size 0 max 16384 2024-05-08T05:56:23.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.215+0000 7f1472a00700 1 -- 172.21.15.82:0/4224670350 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f14500b2880 msgr2=0x7f14500b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:56:23.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.215+0000 7f1472a00700 1 --2- 172.21.15.82:0/4224670350 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f14500b2880 0x7f14500b4d40 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x5611d99e88e0 tx=0x7f145c00a7e0 comp rx=0 tx=0).stop 2024-05-08T05:56:23.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.215+0000 7f1472a00700 1 -- 172.21.15.82:0/4224670350 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f146c10ff50 msgr2=0x7f146c19bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:56:23.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.215+0000 7f1472a00700 1 --2- 172.21.15.82:0/4224670350 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f146c10ff50 0x7f146c19bb60 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1464006070 tx=0x7f1464004cf0 comp rx=0 tx=0).stop 2024-05-08T05:56:23.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.215+0000 7f1472a00700 1 -- 172.21.15.82:0/4224670350 shutdown_connections 2024-05-08T05:56:23.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.215+0000 7f1472a00700 1 --2- 172.21.15.82:0/4224670350 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f14500b2880 0x7f14500b4d40 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:23.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.215+0000 7f1472a00700 1 --2- 172.21.15.82:0/4224670350 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f146c10ff50 0x7f146c19bb60 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:23.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.215+0000 7f1472a00700 1 --2- 172.21.15.82:0/4224670350 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f146c06b1b0 0x7f146c1a1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:23.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.215+0000 7f1472a00700 1 --2- 172.21.15.82:0/4224670350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f146c06bad0 0x7f146c1a1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:23.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.215+0000 7f1472a00700 1 -- 172.21.15.82:0/4224670350 >> 172.21.15.82:0/4224670350 conn(0x7f146c079350 msgr2=0x7f146c1113a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:56:23.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.215+0000 7f1472a00700 1 -- 172.21.15.82:0/4224670350 shutdown_connections 2024-05-08T05:56:23.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:23.215+0000 7f1472a00700 1 -- 172.21.15.82:0/4224670350 wait complete. 2024-05-08T05:56:23.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:56:23 smithi151 ceph-mon[34815]: pgmap v631: 97 pgs: 97 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.2 MiB/s wr, 617 op/s 2024-05-08T05:56:23.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:56:23 smithi082 ceph-mon[30098]: pgmap v631: 97 pgs: 97 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.2 MiB/s wr, 617 op/s 2024-05-08T05:56:24.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:56:23 smithi134 ceph-mon[34132]: pgmap v631: 97 pgs: 97 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.2 MiB/s wr, 617 op/s 2024-05-08T05:56:24.227 INFO:tasks.cephfs.filesystem:scrub status for tag:2f26dbd1-d839-44fe-aa8a-fe5718241b3a - {'path': '/', 'tag': '2f26dbd1-d839-44fe-aa8a-fe5718241b3a', 'options': 'recursive,force'} 2024-05-08T05:56:25.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 335.0 s, 2128.0 tps, lat 46.912 ms stddev 59.174 2024-05-08T05:56:25.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:56:25 smithi151 ceph-mon[34815]: pgmap v632: 97 pgs: 97 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.3 MiB/s wr, 643 op/s 2024-05-08T05:56:25.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:56:25 smithi151 ceph-mon[34815]: scrub summary: idle 2024-05-08T05:56:25.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:56:25 smithi082 ceph-mon[30098]: pgmap v632: 97 pgs: 97 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.3 MiB/s wr, 643 op/s 2024-05-08T05:56:25.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:56:25 smithi082 ceph-mon[30098]: scrub summary: idle 2024-05-08T05:56:26.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:56:25 smithi134 ceph-mon[34132]: pgmap v632: 97 pgs: 97 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.3 MiB/s wr, 643 op/s 2024-05-08T05:56:26.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:56:25 smithi134 ceph-mon[34132]: scrub summary: idle 2024-05-08T05:56:26.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:56:26 smithi082 ceph-mon[30098]: scrub summary: idle 2024-05-08T05:56:26.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:56:26 smithi134 ceph-mon[34132]: scrub summary: idle 2024-05-08T05:56:27.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:56:26 smithi151 ceph-mon[34815]: scrub summary: idle 2024-05-08T05:56:27.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:56:27 smithi082 ceph-mon[30098]: pgmap v633: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.5 MiB/s wr, 676 op/s 2024-05-08T05:56:27.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:56:27 smithi134 ceph-mon[34132]: pgmap v633: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.5 MiB/s wr, 676 op/s 2024-05-08T05:56:28.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:56:27 smithi151 ceph-mon[34815]: pgmap v633: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.5 MiB/s wr, 676 op/s 2024-05-08T05:56:29.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:56:29 smithi082 ceph-mon[30098]: pgmap v634: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.8 MiB/s wr, 672 op/s 2024-05-08T05:56:30.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:56:29 smithi134 ceph-mon[34132]: pgmap v634: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.8 MiB/s wr, 672 op/s 2024-05-08T05:56:30.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:56:29 smithi151 ceph-mon[34815]: pgmap v634: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.8 MiB/s wr, 672 op/s 2024-05-08T05:56:30.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 340.0 s, 2279.6 tps, lat 44.241 ms stddev 53.662 2024-05-08T05:56:31.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:56:31 smithi082 ceph-mon[30098]: pgmap v635: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.6 MiB/s wr, 770 op/s 2024-05-08T05:56:31.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:56:31 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:56:32.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:56:31 smithi134 ceph-mon[34132]: pgmap v635: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.6 MiB/s wr, 770 op/s 2024-05-08T05:56:32.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:56:31 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:56:32.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:56:31 smithi151 ceph-mon[34815]: pgmap v635: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.6 MiB/s wr, 770 op/s 2024-05-08T05:56:32.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:56:31 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:56:33.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:56:33 smithi082 ceph-mon[30098]: pgmap v636: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 6.8 MiB/s wr, 679 op/s 2024-05-08T05:56:33.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:56:33 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:56:33.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:56:33 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:56:33.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:56:33 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:56:34.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:56:33 smithi134 ceph-mon[34132]: pgmap v636: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 6.8 MiB/s wr, 679 op/s 2024-05-08T05:56:34.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:56:33 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:56:34.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:56:33 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:56:34.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:56:33 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:56:34.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:56:33 smithi151 ceph-mon[34815]: pgmap v636: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 6.8 MiB/s wr, 679 op/s 2024-05-08T05:56:34.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:56:33 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:56:34.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:56:33 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:56:34.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:56:33 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:56:35.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 345.0 s, 2850.0 tps, lat 34.845 ms stddev 39.105 2024-05-08T05:56:35.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:56:35 smithi082 ceph-mon[30098]: pgmap v637: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 6.5 MiB/s wr, 664 op/s 2024-05-08T05:56:36.015 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:56:35 smithi134 ceph-mon[34132]: pgmap v637: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 6.5 MiB/s wr, 664 op/s 2024-05-08T05:56:36.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:56:35 smithi151 ceph-mon[34815]: pgmap v637: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 6.5 MiB/s wr, 664 op/s 2024-05-08T05:56:37.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:56:37 smithi082 ceph-mon[30098]: pgmap v638: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 7.8 MiB/s wr, 785 op/s 2024-05-08T05:56:37.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:56:37 smithi134 ceph-mon[34132]: pgmap v638: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 7.8 MiB/s wr, 785 op/s 2024-05-08T05:56:38.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:56:37 smithi151 ceph-mon[34815]: pgmap v638: 97 pgs: 97 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 7.8 MiB/s wr, 785 op/s 2024-05-08T05:56:39.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:56:39 smithi082 ceph-mon[30098]: pgmap v639: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 6.8 MiB/s wr, 694 op/s 2024-05-08T05:56:40.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:56:39 smithi134 ceph-mon[34132]: pgmap v639: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 6.8 MiB/s wr, 694 op/s 2024-05-08T05:56:40.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:56:39 smithi151 ceph-mon[34815]: pgmap v639: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 6.8 MiB/s wr, 694 op/s 2024-05-08T05:56:40.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 350.0 s, 1724.5 tps, lat 58.178 ms stddev 73.938 2024-05-08T05:56:42.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:56:41 smithi082 ceph-mon[30098]: pgmap v640: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.4 MiB/s wr, 769 op/s 2024-05-08T05:56:42.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:56:41 smithi134 ceph-mon[34132]: pgmap v640: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.4 MiB/s wr, 769 op/s 2024-05-08T05:56:42.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:56:41 smithi151 ceph-mon[34815]: pgmap v640: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.4 MiB/s wr, 769 op/s 2024-05-08T05:56:44.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:56:43 smithi134 ceph-mon[34132]: pgmap v641: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.8 MiB/s wr, 618 op/s 2024-05-08T05:56:44.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:56:43 smithi151 ceph-mon[34815]: pgmap v641: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.8 MiB/s wr, 618 op/s 2024-05-08T05:56:44.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:56:43 smithi082 ceph-mon[30098]: pgmap v641: 97 pgs: 97 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.8 MiB/s wr, 618 op/s 2024-05-08T05:56:45.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 355.0 s, 2301.9 tps, lat 42.823 ms stddev 57.675 2024-05-08T05:56:46.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:56:45 smithi134 ceph-mon[34132]: pgmap v642: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.8 MiB/s wr, 670 op/s 2024-05-08T05:56:46.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:56:45 smithi151 ceph-mon[34815]: pgmap v642: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.8 MiB/s wr, 670 op/s 2024-05-08T05:56:46.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:56:45 smithi082 ceph-mon[30098]: pgmap v642: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.8 MiB/s wr, 670 op/s 2024-05-08T05:56:48.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:56:47 smithi134 ceph-mon[34132]: pgmap v643: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.6 MiB/s wr, 728 op/s 2024-05-08T05:56:48.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:56:47 smithi151 ceph-mon[34815]: pgmap v643: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.6 MiB/s wr, 728 op/s 2024-05-08T05:56:48.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:56:47 smithi082 ceph-mon[30098]: pgmap v643: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.6 MiB/s wr, 728 op/s 2024-05-08T05:56:50.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:56:49 smithi134 ceph-mon[34132]: pgmap v644: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.9 MiB/s wr, 634 op/s 2024-05-08T05:56:50.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 360.0 s, 1860.6 tps, lat 54.346 ms stddev 64.855 2024-05-08T05:56:50.271 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:56:49 smithi082 ceph-mon[30098]: pgmap v644: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.9 MiB/s wr, 634 op/s 2024-05-08T05:56:50.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:56:49 smithi151 ceph-mon[34815]: pgmap v644: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.9 MiB/s wr, 634 op/s 2024-05-08T05:56:52.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:56:51 smithi082 ceph-mon[30098]: pgmap v645: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.0 MiB/s wr, 745 op/s 2024-05-08T05:56:52.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:56:51 smithi134 ceph-mon[34132]: pgmap v645: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.0 MiB/s wr, 745 op/s 2024-05-08T05:56:52.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:56:51 smithi151 ceph-mon[34815]: pgmap v645: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.0 MiB/s wr, 745 op/s 2024-05-08T05:56:54.228 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-08T05:56:54.308 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:56:54 smithi082 ceph-mon[30098]: pgmap v646: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.0 MiB/s wr, 637 op/s 2024-05-08T05:56:54.382 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:56:54 smithi151 ceph-mon[34815]: pgmap v646: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.0 MiB/s wr, 637 op/s 2024-05-08T05:56:54.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:56:54 smithi134 ceph-mon[34132]: pgmap v646: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.0 MiB/s wr, 637 op/s 2024-05-08T05:56:54.813 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:56:55.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 365.0 s, 2007.0 tps, lat 49.855 ms stddev 58.665 2024-05-08T05:56:56.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:56:56 smithi082 ceph-mon[30098]: pgmap v647: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 7.3 MiB/s wr, 658 op/s 2024-05-08T05:56:56.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:56:56 smithi151 ceph-mon[34815]: pgmap v647: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 7.3 MiB/s wr, 658 op/s 2024-05-08T05:56:56.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:56:56 smithi134 ceph-mon[34132]: pgmap v647: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 7.3 MiB/s wr, 658 op/s 2024-05-08T05:56:57.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.335+0000 7fb9da600700 1 -- 172.21.15.82:0/4039380292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9d410ff50 msgr2=0x7fb9d4112340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:56:57.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.335+0000 7fb9da600700 1 --2- 172.21.15.82:0/4039380292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9d410ff50 0x7fb9d4112340 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb9c4009990 tx=0x7fb9c4009ca0 comp rx=0 tx=0).stop 2024-05-08T05:56:57.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.335+0000 7fb9da600700 1 -- 172.21.15.82:0/4039380292 shutdown_connections 2024-05-08T05:56:57.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.335+0000 7fb9da600700 1 --2- 172.21.15.82:0/4039380292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9d410ff50 0x7fb9d4112340 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:57.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.335+0000 7fb9da600700 1 --2- 172.21.15.82:0/4039380292 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9d406b1b0 0x7fb9d406b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:57.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.335+0000 7fb9da600700 1 --2- 172.21.15.82:0/4039380292 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9d406bad0 0x7fb9d410fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:57.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.335+0000 7fb9da600700 1 -- 172.21.15.82:0/4039380292 >> 172.21.15.82:0/4039380292 conn(0x7fb9d4079350 msgr2=0x7fb9d4079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:56:57.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.336+0000 7fb9da600700 1 -- 172.21.15.82:0/4039380292 shutdown_connections 2024-05-08T05:56:57.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.336+0000 7fb9da600700 1 -- 172.21.15.82:0/4039380292 wait complete. 2024-05-08T05:56:57.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.338+0000 7fb9da600700 1 Processor -- start 2024-05-08T05:56:57.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.338+0000 7fb9da600700 1 -- start start 2024-05-08T05:56:57.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.340+0000 7fb9da600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9d406b1b0 0x7fb9d41b28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:57.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.340+0000 7fb9da600700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9d406bad0 0x7fb9d41b2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:57.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.341+0000 7fb9da600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9d410ff50 0x7fb9d41abaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:57.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.341+0000 7fb9da600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d406d8d0 con 0x7fb9d410ff50 2024-05-08T05:56:57.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.341+0000 7fb9da600700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d406d750 con 0x7fb9d406b1b0 2024-05-08T05:56:57.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.341+0000 7fb9da600700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d406da50 con 0x7fb9d406bad0 2024-05-08T05:56:57.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.341+0000 7fb9d3400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9d406b1b0 0x7fb9d41b28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:57.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.341+0000 7fb9d3400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9d406b1b0 0x7fb9d41b28f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:39556/0 (socket says 172.21.15.82:39556) 2024-05-08T05:56:57.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.341+0000 7fb9d2a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9d406bad0 0x7fb9d41b2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:57.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.342+0000 7fb9d2a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9d406bad0 0x7fb9d41b2e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:39966/0 (socket says 172.21.15.82:39966) 2024-05-08T05:56:57.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.342+0000 7fb9d2a00700 1 -- 172.21.15.82:0/3636267178 learned_addr learned my addr 172.21.15.82:0/3636267178 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:56:57.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.342+0000 7fb9d3e00700 1 --2- 172.21.15.82:0/3636267178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9d410ff50 0x7fb9d41abaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:57.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.342+0000 7fb9d2a00700 1 -- 172.21.15.82:0/3636267178 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9d406b1b0 msgr2=0x7fb9d41b28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:56:57.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.342+0000 7fb9d2a00700 1 --2- 172.21.15.82:0/3636267178 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9d406b1b0 0x7fb9d41b28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:57.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.342+0000 7fb9d2a00700 1 -- 172.21.15.82:0/3636267178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9d410ff50 msgr2=0x7fb9d41abaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:56:57.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.342+0000 7fb9d2a00700 1 --2- 172.21.15.82:0/3636267178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9d410ff50 0x7fb9d41abaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:57.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.342+0000 7fb9d2a00700 1 -- 172.21.15.82:0/3636267178 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9d41ac3f0 con 0x7fb9d406bad0 2024-05-08T05:56:57.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.343+0000 7fb9d3e00700 1 --2- 172.21.15.82:0/3636267178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9d410ff50 0x7fb9d41abaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:56:57.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.343+0000 7fb9d2a00700 1 --2- 172.21.15.82:0/3636267178 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9d406bad0 0x7fb9d41b2e30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc0060b0 tx=0x7fb9cc007f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:56:57.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.345+0000 7fb9cbe00700 1 -- 172.21.15.82:0/3636267178 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc01a070 con 0x7fb9d406bad0 2024-05-08T05:56:57.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.345+0000 7fb9cbe00700 1 -- 172.21.15.82:0/3636267178 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb9cc00de20 con 0x7fb9d406bad0 2024-05-08T05:56:57.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.345+0000 7fb9cbe00700 1 -- 172.21.15.82:0/3636267178 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc014720 con 0x7fb9d406bad0 2024-05-08T05:56:57.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.345+0000 7fb9da600700 1 -- 172.21.15.82:0/3636267178 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9d41ac6e0 con 0x7fb9d406bad0 2024-05-08T05:56:57.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.345+0000 7fb9da600700 1 -- 172.21.15.82:0/3636267178 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9d41b06b0 con 0x7fb9d406bad0 2024-05-08T05:56:57.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.353+0000 7fb9cbe00700 1 -- 172.21.15.82:0/3636267178 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fb9cc01d070 con 0x7fb9d406bad0 2024-05-08T05:56:57.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.355+0000 7fb9e4f28b80 1 Processor -- start 2024-05-08T05:56:57.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.356+0000 7fb9e4f28b80 1 -- start start 2024-05-08T05:56:57.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.357+0000 7fb9cbe00700 1 --2- 172.21.15.82:0/3636267178 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb9b80b2a00 0x7fb9b80b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:57.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.358+0000 7fb9cbe00700 1 -- 172.21.15.82:0/3636267178 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb9cc0e1a00 con 0x7fb9d406bad0 2024-05-08T05:56:57.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.358+0000 7fb9e4f28b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e0ed49bc0 0x558e0ed49fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:57.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.358+0000 7fb9e4f28b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e0ed4a4e0 0x558e0ed442d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:57.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.358+0000 7fb9e4f28b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558e0ed448f0 0x558e0ed44d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:57.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.358+0000 7fb9e4f28b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x558e0ec96a20 con 0x558e0ed448f0 2024-05-08T05:56:57.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.358+0000 7fb9e4f28b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558e0ec34760 con 0x558e0ed4a4e0 2024-05-08T05:56:57.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.358+0000 7fb9e4f28b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x558e0ec929e0 con 0x558e0ed49bc0 2024-05-08T05:56:57.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.359+0000 7fb9d3400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e0ed49bc0 0x558e0ed49fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:57.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.359+0000 7fb9d3400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e0ed49bc0 0x558e0ed49fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:39978/0 (socket says 172.21.15.82:39978) 2024-05-08T05:56:57.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.359+0000 7fb9d3400700 1 -- 172.21.15.82:0/4219090887 learned_addr learned my addr 172.21.15.82:0/4219090887 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:56:57.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.359+0000 7fb9d3e00700 1 --2- 172.21.15.82:0/3636267178 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb9b80b2a00 0x7fb9b80b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:57.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.361+0000 7fb9d2a00700 1 --2- 172.21.15.82:0/4219090887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e0ed4a4e0 0x558e0ed442d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:57.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.361+0000 7fb9d3400700 1 -- 172.21.15.82:0/4219090887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e0ed4a4e0 msgr2=0x558e0ed442d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:56:57.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.362+0000 7fb9d3e00700 1 --2- 172.21.15.82:0/4219090887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558e0ed448f0 0x558e0ed44d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:57.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.362+0000 7fb9d3400700 1 --2- 172.21.15.82:0/4219090887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e0ed4a4e0 0x558e0ed442d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:57.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.362+0000 7fb9d3400700 1 -- 172.21.15.82:0/4219090887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558e0ed448f0 msgr2=0x558e0ed44d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:56:57.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.362+0000 7fb9d3400700 1 --2- 172.21.15.82:0/4219090887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558e0ed448f0 0x558e0ed44d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:57.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.362+0000 7fb9d3400700 1 -- 172.21.15.82:0/4219090887 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e0ebe38d0 con 0x558e0ed49bc0 2024-05-08T05:56:57.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.362+0000 7fb9d2a00700 1 --2- 172.21.15.82:0/4219090887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e0ed4a4e0 0x558e0ed442d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:56:57.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.363+0000 7fb9d3400700 1 --2- 172.21.15.82:0/4219090887 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e0ed49bc0 0x558e0ed49fa0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0009d10 tx=0x7fb9c00116c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae50e5ecc90d7d81 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:56:57.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.363+0000 7fb9d3e00700 1 --2- 172.21.15.82:0/3636267178 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb9b80b2a00 0x7fb9b80b4ec0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x558e0ed452b0 tx=0x7fb9c4005c00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:56:57.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.363+0000 7fb9c8c00700 1 -- 172.21.15.82:0/4219090887 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c0009e60 con 0x558e0ed49bc0 2024-05-08T05:56:57.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.363+0000 7fb9c8c00700 1 -- 172.21.15.82:0/4219090887 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb9c0012900 con 0x558e0ed49bc0 2024-05-08T05:56:57.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.365+0000 7fb9e4f28b80 1 -- 172.21.15.82:0/4219090887 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e0ed49bc0 msgr2=0x558e0ed49fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:56:57.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.365+0000 7fb9e4f28b80 1 --2- 172.21.15.82:0/4219090887 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e0ed49bc0 0x558e0ed49fa0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0009d10 tx=0x7fb9c00116c0 comp rx=0 tx=0).stop 2024-05-08T05:56:57.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.365+0000 7fb9e4f28b80 1 -- 172.21.15.82:0/4219090887 shutdown_connections 2024-05-08T05:56:57.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.365+0000 7fb9e4f28b80 1 --2- 172.21.15.82:0/4219090887 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558e0ed448f0 0x558e0ed44d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:57.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.365+0000 7fb9e4f28b80 1 --2- 172.21.15.82:0/4219090887 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e0ed49bc0 0x558e0ed49fa0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:57.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.365+0000 7fb9e4f28b80 1 --2- 172.21.15.82:0/4219090887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e0ed4a4e0 0x558e0ed442d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:57.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.366+0000 7fb9e4f28b80 1 -- 172.21.15.82:0/4219090887 >> 172.21.15.82:0/4219090887 conn(0x558e0ecbc6d0 msgr2=0x558e0ed3eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:56:57.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.368+0000 7fb9e4f28b80 1 -- 172.21.15.82:0/4219090887 shutdown_connections 2024-05-08T05:56:57.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.368+0000 7fb9e4f28b80 1 -- 172.21.15.82:0/4219090887 wait complete. 2024-05-08T05:56:57.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.369+0000 7fb9e4f28b80 1 -- start start 2024-05-08T05:56:57.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.369+0000 7fb9e4f28b80 1 Processor -- start 2024-05-08T05:56:57.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.372+0000 7fb9e4f28b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558e0ed448f0 0x558e0ed503a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:57.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.372+0000 7fb9e4f28b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e0ed4a4e0 0x558e0ed4d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:57.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.373+0000 7fb9d3400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558e0ed448f0 0x558e0ed503a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:57.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.373+0000 7fb9e4f28b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e0ed4dbe0 0x558e0ed4e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:57.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.373+0000 7fb9d3400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558e0ed448f0 0x558e0ed503a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:34298/0 (socket says 172.21.15.82:34298) 2024-05-08T05:56:57.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.373+0000 7fb9e4f28b80 1 -- 172.21.15.82:0/2092722093 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x558e0ed50fc0 con 0x558e0ed448f0 2024-05-08T05:56:57.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.373+0000 7fb9d3400700 1 -- 172.21.15.82:0/2092722093 learned_addr learned my addr 172.21.15.82:0/2092722093 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:56:57.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.373+0000 7fb9e4f28b80 1 -- 172.21.15.82:0/2092722093 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558e0ebfcb20 con 0x558e0ed4dbe0 2024-05-08T05:56:57.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.373+0000 7fb9e4f28b80 1 -- 172.21.15.82:0/2092722093 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x558e0ed51140 con 0x558e0ed4a4e0 2024-05-08T05:56:57.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.373+0000 7fb9d2a00700 1 --2- 172.21.15.82:0/2092722093 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e0ed4a4e0 0x558e0ed4d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:57.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.373+0000 7fb9d3e00700 1 --2- 172.21.15.82:0/2092722093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e0ed4dbe0 0x558e0ed4e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:57.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.374+0000 7fb9d3e00700 1 -- 172.21.15.82:0/2092722093 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e0ed4a4e0 msgr2=0x558e0ed4d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:56:57.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.374+0000 7fb9d3e00700 1 --2- 172.21.15.82:0/2092722093 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e0ed4a4e0 0x558e0ed4d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:57.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.374+0000 7fb9d3e00700 1 -- 172.21.15.82:0/2092722093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558e0ed448f0 msgr2=0x558e0ed503a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:56:57.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.374+0000 7fb9e4f28b80 10 client.0 _ll_register_callbacks cb 0x558e0ec3dc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:56:57.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.375+0000 7fb9d3e00700 1 --2- 172.21.15.82:0/2092722093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558e0ed448f0 0x558e0ed503a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:57.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.375+0000 7fb9d3e00700 1 -- 172.21.15.82:0/2092722093 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e0ec5c420 con 0x558e0ed4dbe0 2024-05-08T05:56:57.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.375+0000 7fb9e4f28b80 1 -- 172.21.15.82:0/2092722093 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558e0ed11140 con 0x558e0ed4dbe0 2024-05-08T05:56:57.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.375+0000 7fb9d3e00700 1 --2- 172.21.15.82:0/2092722093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e0ed4dbe0 0x558e0ed4e060 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb9c400b2e0 tx=0x7fb9c4005fb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b1015856daadcaf server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:56:57.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.376+0000 7fb9d3400700 1 --2- 172.21.15.82:0/2092722093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558e0ed448f0 0x558e0ed503a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:56:57.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.376+0000 7fb9bd600700 10 client.25844 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:56:57.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.376+0000 7fb9bd600700 1 -- 172.21.15.82:0/2092722093 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c4036050 con 0x558e0ed4dbe0 2024-05-08T05:56:57.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.376+0000 7fb9bd600700 1 -- 172.21.15.82:0/2092722093 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb9c4003c70 con 0x558e0ed4dbe0 2024-05-08T05:56:57.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.377+0000 7fb9bd600700 1 -- 172.21.15.82:0/2092722093 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fb9c4036050 con 0x558e0ed4dbe0 2024-05-08T05:56:57.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.377+0000 7fb9e4f28b80 10 client.25844 fetch_fsmap learned FSMap version 31 2024-05-08T05:56:57.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.377+0000 7fb9e4f28b80 1 -- 172.21.15.82:0/2092722093 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({fsmap=31}) -- 0x558e0ed5bde0 con 0x558e0ed4dbe0 2024-05-08T05:56:57.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.377+0000 7fb9bd600700 1 -- 172.21.15.82:0/2092722093 <== mon.2 v2:172.21.15.134:3300/0 4 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fb9c4039020 con 0x558e0ed4dbe0 2024-05-08T05:56:57.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.377+0000 7fb9e4f28b80 10 client.25844 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:56:57.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.377+0000 7fb9e4f28b80 10 client.25844 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:56:57.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.377+0000 7fb9e4f28b80 20 client.25844 populate_metadata read hostname 'smithi082' 2024-05-08T05:56:57.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.377+0000 7fb9e4f28b80 1 --2- 172.21.15.82:0/2092722093 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x558e0ed5e2b0 0x558e0ed606a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:57.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.377+0000 7fb9e4f28b80 4 client.25844 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:56:57.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.377+0000 7fb9e4f28b80 1 -- 172.21.15.82:0/2092722093 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558e0eca4400 con 0x558e0ed5e2b0 2024-05-08T05:56:57.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.378+0000 7fb9d3400700 1 --2- 172.21.15.82:0/2092722093 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x558e0ed5e2b0 0x558e0ed606a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:57.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.381+0000 7fb9d3400700 1 --2- 172.21.15.82:0/2092722093 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x558e0ed5e2b0 0x558e0ed606a0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=200ea4cac28fe637 server_cookie=365fdb96c51479b9 in_seq=0 out_seq=0 2024-05-08T05:56:57.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.381+0000 7fb9bd600700 10 client.25844 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:56:57.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.382+0000 7fb9bd600700 1 -- 172.21.15.82:0/2092722093 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x558e0eca4400 con 0x558e0ed5e2b0 2024-05-08T05:56:57.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.382+0000 7fb9bd600700 10 client.25844 handle_command_reply: tid=0 2024-05-08T05:56:57.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.382+0000 7fb9e4f28b80 1 client.25844 shutdown 2024-05-08T05:56:57.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.383+0000 7fb9e4f28b80 1 -- 172.21.15.82:0/2092722093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e0ed4dbe0 msgr2=0x558e0ed4e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:56:57.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.383+0000 7fb9e4f28b80 1 --2- 172.21.15.82:0/2092722093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e0ed4dbe0 0x558e0ed4e060 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb9c400b2e0 tx=0x7fb9c4005fb0 comp rx=0 tx=0).stop 2024-05-08T05:56:57.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.384+0000 7fb9e4f28b80 1 -- 172.21.15.82:0/2092722093 shutdown_connections 2024-05-08T05:56:57.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.384+0000 7fb9e4f28b80 1 --2- 172.21.15.82:0/2092722093 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x558e0ed5e2b0 0x558e0ed606a0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:57.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.384+0000 7fb9e4f28b80 1 --2- 172.21.15.82:0/2092722093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e0ed4dbe0 0x558e0ed4e060 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:57.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.384+0000 7fb9e4f28b80 1 --2- 172.21.15.82:0/2092722093 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558e0ed448f0 0x558e0ed503a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:57.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.384+0000 7fb9e4f28b80 1 --2- 172.21.15.82:0/2092722093 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e0ed4a4e0 0x558e0ed4d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:57.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.384+0000 7fb9e4f28b80 1 -- 172.21.15.82:0/2092722093 >> 172.21.15.82:0/2092722093 conn(0x558e0ecbc6d0 msgr2=0x558e0ed3e190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:56:57.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.384+0000 7fb9bd600700 0 client.25844 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:56:57.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.384+0000 7fb9e4f28b80 1 -- 172.21.15.82:0/2092722093 shutdown_connections 2024-05-08T05:56:57.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.384+0000 7fb9e4f28b80 1 -- 172.21.15.82:0/2092722093 wait complete. 2024-05-08T05:56:57.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.384+0000 7fb9e4f28b80 20 client.25844 trim_cache size 0 max 16384 2024-05-08T05:56:57.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.422+0000 7fb9e4f28b80 1 Processor -- start 2024-05-08T05:56:57.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.422+0000 7fb9e4f28b80 1 -- start start 2024-05-08T05:56:57.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.422+0000 7fb9e4f28b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558e0ed448f0 0x558e0ed442d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:57.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.422+0000 7fb9e4f28b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e0ed4a4e0 0x558e0ed49170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:57.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.422+0000 7fb9e4f28b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e0ed4dbe0 0x558e0ed4c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:57.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.422+0000 7fb9e4f28b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d41c5190 con 0x558e0ed448f0 2024-05-08T05:56:57.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.422+0000 7fb9e4f28b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d41c6cd0 con 0x558e0ed4dbe0 2024-05-08T05:56:57.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.422+0000 7fb9e4f28b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d41c5860 con 0x558e0ed4a4e0 2024-05-08T05:56:57.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.423+0000 7fb9d2a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e0ed4a4e0 0x558e0ed49170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:57.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.423+0000 7fb9d2a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e0ed4a4e0 0x558e0ed49170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:40002/0 (socket says 172.21.15.82:40002) 2024-05-08T05:56:57.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.423+0000 7fb9d2a00700 1 -- 172.21.15.82:0/73595875 learned_addr learned my addr 172.21.15.82:0/73595875 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:56:57.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.423+0000 7fb9d3e00700 1 --2- 172.21.15.82:0/73595875 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e0ed4dbe0 0x558e0ed4c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:57.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.423+0000 7fb9d3400700 1 --2- 172.21.15.82:0/73595875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558e0ed448f0 0x558e0ed442d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:57.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.424+0000 7fb9d3e00700 1 -- 172.21.15.82:0/73595875 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e0ed4a4e0 msgr2=0x558e0ed49170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:56:57.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.424+0000 7fb9d3e00700 1 --2- 172.21.15.82:0/73595875 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e0ed4a4e0 0x558e0ed49170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:57.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.424+0000 7fb9d3e00700 1 -- 172.21.15.82:0/73595875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558e0ed448f0 msgr2=0x558e0ed442d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:56:57.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.424+0000 7fb9d3e00700 1 --2- 172.21.15.82:0/73595875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558e0ed448f0 0x558e0ed442d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:57.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.424+0000 7fb9d3e00700 1 -- 172.21.15.82:0/73595875 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e0ed37290 con 0x558e0ed4dbe0 2024-05-08T05:56:57.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.425+0000 7fb9d3e00700 1 --2- 172.21.15.82:0/73595875 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e0ed4dbe0 0x558e0ed4c740 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb9c4009750 tx=0x7fb9c4029070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba82be99d156b305 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:56:57.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.425+0000 7fb9bfe00700 1 -- 172.21.15.82:0/73595875 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c400f530 con 0x558e0ed4dbe0 2024-05-08T05:56:57.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.425+0000 7fb9bfe00700 1 -- 172.21.15.82:0/73595875 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x558e0ed11140 con 0x558e0ed4dbe0 2024-05-08T05:56:57.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.425+0000 7fb9bfe00700 1 -- 172.21.15.82:0/73595875 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c403b7e0 con 0x558e0ed4dbe0 2024-05-08T05:56:57.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.426+0000 7fb9e4f28b80 1 -- 172.21.15.82:0/73595875 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e0ed4dbe0 msgr2=0x558e0ed4c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:56:57.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.426+0000 7fb9e4f28b80 1 --2- 172.21.15.82:0/73595875 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e0ed4dbe0 0x558e0ed4c740 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb9c4009750 tx=0x7fb9c4029070 comp rx=0 tx=0).stop 2024-05-08T05:56:57.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.427+0000 7fb9e4f28b80 1 -- 172.21.15.82:0/73595875 shutdown_connections 2024-05-08T05:56:57.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.427+0000 7fb9e4f28b80 1 --2- 172.21.15.82:0/73595875 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e0ed4dbe0 0x558e0ed4c740 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:57.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.427+0000 7fb9e4f28b80 1 --2- 172.21.15.82:0/73595875 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558e0ed448f0 0x558e0ed442d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:57.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.427+0000 7fb9e4f28b80 1 --2- 172.21.15.82:0/73595875 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e0ed4a4e0 0x558e0ed49170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:57.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.427+0000 7fb9e4f28b80 1 -- 172.21.15.82:0/73595875 >> 172.21.15.82:0/73595875 conn(0x558e0ecbc6d0 msgr2=0x558e0ed4c030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:56:57.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.427+0000 7fb9e4f28b80 1 -- 172.21.15.82:0/73595875 shutdown_connections 2024-05-08T05:56:57.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.427+0000 7fb9e4f28b80 1 -- 172.21.15.82:0/73595875 wait complete. 2024-05-08T05:56:57.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.428+0000 7fb9e4f28b80 1 -- start start 2024-05-08T05:56:57.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.428+0000 7fb9e4f28b80 1 Processor -- start 2024-05-08T05:56:57.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.429+0000 7fb9e4f28b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558e0ed448f0 0x558e0ed56420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:57.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.429+0000 7fb9e4f28b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e0ed4a4e0 0x558e0ed56960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:57.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.429+0000 7fb9e4f28b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e0ed4dbe0 0x558e0ed533f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:57.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.429+0000 7fb9e4f28b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d41c6600 con 0x558e0ed448f0 2024-05-08T05:56:57.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.429+0000 7fb9e4f28b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d41c5f30 con 0x558e0ed4a4e0 2024-05-08T05:56:57.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.429+0000 7fb9e4f28b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d410ebf0 con 0x558e0ed4dbe0 2024-05-08T05:56:57.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.429+0000 7fb9e4f28b80 10 client.0 _ll_register_callbacks cb 0x558e0ec3dc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:56:57.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.430+0000 7fb9d3e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e0ed4dbe0 0x558e0ed533f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:57.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.430+0000 7fb9d3e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e0ed4dbe0 0x558e0ed533f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:40016/0 (socket says 172.21.15.82:40016) 2024-05-08T05:56:57.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.430+0000 7fb9d3e00700 1 -- 172.21.15.82:0/1462455609 learned_addr learned my addr 172.21.15.82:0/1462455609 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:56:57.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.430+0000 7fb9d3400700 1 --2- 172.21.15.82:0/1462455609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558e0ed448f0 0x558e0ed56420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:57.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.430+0000 7fb9d2a00700 1 --2- 172.21.15.82:0/1462455609 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e0ed4a4e0 0x558e0ed56960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:57.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.430+0000 7fb9d3e00700 1 -- 172.21.15.82:0/1462455609 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e0ed4a4e0 msgr2=0x558e0ed56960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:56:57.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.430+0000 7fb9d3e00700 1 --2- 172.21.15.82:0/1462455609 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e0ed4a4e0 0x558e0ed56960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:57.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.430+0000 7fb9d3e00700 1 -- 172.21.15.82:0/1462455609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558e0ed448f0 msgr2=0x558e0ed56420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:56:57.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.430+0000 7fb9d3e00700 1 --2- 172.21.15.82:0/1462455609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558e0ed448f0 0x558e0ed56420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:57.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.430+0000 7fb9d3e00700 1 -- 172.21.15.82:0/1462455609 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e0ed53930 con 0x558e0ed4dbe0 2024-05-08T05:56:57.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.430+0000 7fb9d2a00700 1 --2- 172.21.15.82:0/1462455609 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e0ed4a4e0 0x558e0ed56960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:56:57.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.431+0000 7fb9d3e00700 1 --2- 172.21.15.82:0/1462455609 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e0ed4dbe0 0x558e0ed533f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb9c4011040 tx=0x7fb9c400fad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35020e0c5fc92ec9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:56:57.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.431+0000 7fb9bd600700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:56:57.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.431+0000 7fb9bd600700 1 -- 172.21.15.82:0/1462455609 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c4003c70 con 0x558e0ed4dbe0 2024-05-08T05:56:57.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.431+0000 7fb9bd600700 1 -- 172.21.15.82:0/1462455609 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb9c403b440 con 0x558e0ed4dbe0 2024-05-08T05:56:57.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.431+0000 7fb9e4f28b80 1 -- 172.21.15.82:0/1462455609 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x558e0ed11140 con 0x558e0ed4dbe0 2024-05-08T05:56:57.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.431+0000 7fb9bd600700 1 -- 172.21.15.82:0/1462455609 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fb9c403b640 con 0x558e0ed4dbe0 2024-05-08T05:56:57.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.431+0000 7fb9e4f28b80 10 client.25891 fetch_fsmap learned FSMap version 31 2024-05-08T05:56:57.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.431+0000 7fb9e4f28b80 1 -- 172.21.15.82:0/1462455609 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x558e0edc9320 con 0x558e0ed4dbe0 2024-05-08T05:56:57.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.431+0000 7fb9bd600700 1 -- 172.21.15.82:0/1462455609 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x558e0ed11140 con 0x558e0ed4dbe0 2024-05-08T05:56:57.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.432+0000 7fb9bd600700 1 -- 172.21.15.82:0/1462455609 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fb9c4039030 con 0x558e0ed4dbe0 2024-05-08T05:56:57.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.432+0000 7fb9e4f28b80 10 client.25891 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:56:57.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.432+0000 7fb9e4f28b80 10 client.25891 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:56:57.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.432+0000 7fb9e4f28b80 20 client.25891 populate_metadata read hostname 'smithi082' 2024-05-08T05:56:57.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.432+0000 7fb9e4f28b80 1 --2- 172.21.15.82:0/1462455609 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x558e0edc9970 0x558e0edcbd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:56:57.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.432+0000 7fb9e4f28b80 4 client.25891 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-08T05:56:57.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.432+0000 7fb9e4f28b80 1 -- 172.21.15.82:0/1462455609 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "scrub status"}) -- 0x558e0ec9e4a0 con 0x558e0edc9970 2024-05-08T05:56:57.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.432+0000 7fb9d3400700 1 --2- 172.21.15.82:0/1462455609 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x558e0edc9970 0x558e0edcbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:56:57.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.433+0000 7fb9d3400700 1 --2- 172.21.15.82:0/1462455609 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x558e0edc9970 0x558e0edcbd60 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a944e2eeae0c5f42 server_cookie=21892f0264b64246 in_seq=0 out_seq=0 2024-05-08T05:56:57.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.433+0000 7fb9bd600700 10 client.25891 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:56:57.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.433+0000 7fb9bd600700 1 -- 172.21.15.82:0/1462455609 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x558e0ec9e4a0 con 0x558e0edc9970 2024-05-08T05:56:57.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.433+0000 7fb9bd600700 10 client.25891 handle_command_reply: tid=0 2024-05-08T05:56:57.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.433+0000 7fb9e4f28b80 1 client.25891 shutdown 2024-05-08T05:56:57.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.434+0000 7fb9e4f28b80 1 -- 172.21.15.82:0/1462455609 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e0ed4dbe0 msgr2=0x558e0ed533f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:56:57.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.434+0000 7fb9e4f28b80 1 --2- 172.21.15.82:0/1462455609 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e0ed4dbe0 0x558e0ed533f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb9c4011040 tx=0x7fb9c400fad0 comp rx=0 tx=0).stop 2024-05-08T05:56:57.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.434+0000 7fb9e4f28b80 1 -- 172.21.15.82:0/1462455609 shutdown_connections 2024-05-08T05:56:57.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.434+0000 7fb9e4f28b80 1 --2- 172.21.15.82:0/1462455609 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558e0ed4dbe0 0x558e0ed533f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:57.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.434+0000 7fb9e4f28b80 1 --2- 172.21.15.82:0/1462455609 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558e0ed448f0 0x558e0ed56420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:57.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.434+0000 7fb9e4f28b80 1 --2- 172.21.15.82:0/1462455609 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x558e0edc9970 0x558e0edcbd60 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:57.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.434+0000 7fb9e4f28b80 1 --2- 172.21.15.82:0/1462455609 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e0ed4a4e0 0x558e0ed56960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:57.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.434+0000 7fb9e4f28b80 1 -- 172.21.15.82:0/1462455609 >> 172.21.15.82:0/1462455609 conn(0x558e0ecbc6d0 msgr2=0x558e0ed4b150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:56:57.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.434+0000 7fb9bd600700 0 client.25891 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:56:57.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.435+0000 7fb9e4f28b80 1 -- 172.21.15.82:0/1462455609 shutdown_connections 2024-05-08T05:56:57.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.435+0000 7fb9e4f28b80 1 -- 172.21.15.82:0/1462455609 wait complete. 2024-05-08T05:56:57.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.435+0000 7fb9e4f28b80 20 client.25891 trim_cache size 0 max 16384 2024-05-08T05:56:57.437 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T05:56:57.437 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "no active scrubs running", 2024-05-08T05:56:57.437 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": {} 2024-05-08T05:56:57.437 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T05:56:57.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.436+0000 7fb9da600700 1 -- 172.21.15.82:0/3636267178 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb9b80b2a00 msgr2=0x7fb9b80b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:56:57.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.436+0000 7fb9da600700 1 --2- 172.21.15.82:0/3636267178 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb9b80b2a00 0x7fb9b80b4ec0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x558e0ed452b0 tx=0x7fb9c4005c00 comp rx=0 tx=0).stop 2024-05-08T05:56:57.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.436+0000 7fb9da600700 1 -- 172.21.15.82:0/3636267178 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9d406bad0 msgr2=0x7fb9d41b2e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:56:57.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.436+0000 7fb9da600700 1 --2- 172.21.15.82:0/3636267178 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9d406bad0 0x7fb9d41b2e30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc0060b0 tx=0x7fb9cc007f90 comp rx=0 tx=0).stop 2024-05-08T05:56:57.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.436+0000 7fb9da600700 1 -- 172.21.15.82:0/3636267178 shutdown_connections 2024-05-08T05:56:57.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.436+0000 7fb9da600700 1 --2- 172.21.15.82:0/3636267178 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9d406b1b0 0x7fb9d41b28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:57.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.436+0000 7fb9da600700 1 --2- 172.21.15.82:0/3636267178 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb9b80b2a00 0x7fb9b80b4ec0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:57.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.436+0000 7fb9da600700 1 --2- 172.21.15.82:0/3636267178 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb9d410ff50 0x7fb9d41abaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:57.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.436+0000 7fb9da600700 1 --2- 172.21.15.82:0/3636267178 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9d406bad0 0x7fb9d41b2e30 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:56:57.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.436+0000 7fb9da600700 1 -- 172.21.15.82:0/3636267178 >> 172.21.15.82:0/3636267178 conn(0x7fb9d4079350 msgr2=0x7fb9d41113a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:56:57.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.436+0000 7fb9da600700 1 -- 172.21.15.82:0/3636267178 shutdown_connections 2024-05-08T05:56:57.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:56:57.436+0000 7fb9da600700 1 -- 172.21.15.82:0/3636267178 wait complete. 2024-05-08T05:56:58.295 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:56:58 smithi082 ceph-mon[30098]: pgmap v648: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.3 MiB/s wr, 689 op/s 2024-05-08T05:56:58.356 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-08T05:56:58.356 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T05:56:58.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:56:58 smithi151 ceph-mon[34815]: pgmap v648: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.3 MiB/s wr, 689 op/s 2024-05-08T05:56:58.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:56:58 smithi134 ceph-mon[34132]: pgmap v648: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.3 MiB/s wr, 689 op/s 2024-05-08T05:56:58.981 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:57:00.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 370.0 s, 2182.2 tps, lat 45.244 ms stddev 52.869 2024-05-08T05:57:00.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:57:00 smithi151 ceph-mon[34815]: pgmap v649: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.7 MiB/s wr, 645 op/s 2024-05-08T05:57:00.454 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:57:00 smithi082 ceph-mon[30098]: pgmap v649: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.7 MiB/s wr, 645 op/s 2024-05-08T05:57:00.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:57:00 smithi134 ceph-mon[34132]: pgmap v649: 97 pgs: 97 active+clean; 1.6 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.7 MiB/s wr, 645 op/s 2024-05-08T05:57:01.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:01.300+0000 7f8c99000700 1 -- 172.21.15.82:0/579261729 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c94104100 msgr2=0x7f8c94108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:01.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:01.300+0000 7f8c99000700 1 --2- 172.21.15.82:0/579261729 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c94104100 0x7f8c94108120 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8c80009990 tx=0x7f8c80009ca0 comp rx=0 tx=0).stop 2024-05-08T05:57:01.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:01.300+0000 7f8c99000700 1 -- 172.21.15.82:0/579261729 shutdown_connections 2024-05-08T05:57:01.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:01.300+0000 7f8c99000700 1 --2- 172.21.15.82:0/579261729 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c94103750 0x7f8c94103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:01.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:01.301+0000 7f8c99000700 1 --2- 172.21.15.82:0/579261729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c94108850 0x7f8c941103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:01.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:01.301+0000 7f8c99000700 1 --2- 172.21.15.82:0/579261729 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c94104100 0x7f8c94108120 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:01.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:01.301+0000 7f8c99000700 1 -- 172.21.15.82:0/579261729 >> 172.21.15.82:0/579261729 conn(0x7f8c9407a600 msgr2=0x7f8c9407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:57:01.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:01.301+0000 7f8c99000700 1 -- 172.21.15.82:0/579261729 shutdown_connections 2024-05-08T05:57:01.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:01.301+0000 7f8c99000700 1 -- 172.21.15.82:0/579261729 wait complete. 2024-05-08T05:57:01.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:01.302+0000 7f8c99000700 1 Processor -- start 2024-05-08T05:57:01.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:01.302+0000 7f8c99000700 1 -- start start 2024-05-08T05:57:01.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:01.302+0000 7f8c99000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c94103750 0x7f8c940757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:01.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:01.302+0000 7f8c99000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c94104100 0x7f8c94075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:01.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:01.302+0000 7f8c99000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c94108850 0x7f8c94076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:01.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:01.302+0000 7f8c99000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8c941136b0 con 0x7f8c94108850 2024-05-08T05:57:01.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:01.302+0000 7f8c99000700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8c94113530 con 0x7f8c94104100 2024-05-08T05:57:01.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:01.302+0000 7f8c99000700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8c94113830 con 0x7f8c94103750 2024-05-08T05:57:01.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:01.303+0000 7f8c91e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c94103750 0x7f8c940757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:01.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:01.303+0000 7f8c91e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c94103750 0x7f8c940757a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:40036/0 (socket says 172.21.15.82:40036) 2024-05-08T05:57:01.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:01.303+0000 7f8c91e00700 1 -- 172.21.15.82:0/3480408931 learned_addr learned my addr 172.21.15.82:0/3480408931 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:57:01.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:01.303+0000 7f8c92800700 1 --2- 172.21.15.82:0/3480408931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c94108850 0x7f8c94076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:01.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:01.303+0000 7f8c91400700 1 --2- 172.21.15.82:0/3480408931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c94104100 0x7f8c94075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:01.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:01.303+0000 7f8c91400700 1 -- 172.21.15.82:0/3480408931 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c94103750 msgr2=0x7f8c940757a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:01.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:01.303+0000 7f8c91400700 1 --2- 172.21.15.82:0/3480408931 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c94103750 0x7f8c940757a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:01.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:01.303+0000 7f8c91400700 1 -- 172.21.15.82:0/3480408931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c94108850 msgr2=0x7f8c94076220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:01.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:01.304+0000 7f8c91400700 1 --2- 172.21.15.82:0/3480408931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c94108850 0x7f8c94076220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:01.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:01.304+0000 7f8c91400700 1 -- 172.21.15.82:0/3480408931 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c941a7f50 con 0x7f8c94104100 2024-05-08T05:57:01.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:01.304+0000 7f8c92800700 1 --2- 172.21.15.82:0/3480408931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c94108850 0x7f8c94076220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:57:01.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:01.304+0000 7f8c91400700 1 --2- 172.21.15.82:0/3480408931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c94104100 0x7f8c94075ce0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8c8000b5c0 tx=0x7f8c800057c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:57:01.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:01.304+0000 7f8c8aa00700 1 -- 172.21.15.82:0/3480408931 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c80003b00 con 0x7f8c94104100 2024-05-08T05:57:01.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:01.304+0000 7f8c99000700 1 -- 172.21.15.82:0/3480408931 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c941a81e0 con 0x7f8c94104100 2024-05-08T05:57:01.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:01.304+0000 7f8c8aa00700 1 -- 172.21.15.82:0/3480408931 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8c80004150 con 0x7f8c94104100 2024-05-08T05:57:01.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:01.304+0000 7f8c8aa00700 1 -- 172.21.15.82:0/3480408931 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c8000fe50 con 0x7f8c94104100 2024-05-08T05:57:01.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:01.304+0000 7f8c99000700 1 -- 172.21.15.82:0/3480408931 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c941a8690 con 0x7f8c94104100 2024-05-08T05:57:01.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:01.305+0000 7f8c99000700 1 -- 172.21.15.82:0/3480408931 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c9406a190 con 0x7f8c94104100 2024-05-08T05:57:01.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:01.309+0000 7f8c8aa00700 1 -- 172.21.15.82:0/3480408931 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f8c8000f580 con 0x7f8c94104100 2024-05-08T05:57:01.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:01.311+0000 7f8c8aa00700 1 --2- 172.21.15.82:0/3480408931 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f8c780b2ae0 0x7f8c780b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:01.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:01.311+0000 7f8c8aa00700 1 -- 172.21.15.82:0/3480408931 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f8c800e3460 con 0x7f8c94104100 2024-05-08T05:57:01.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:01.311+0000 7f8c91e00700 1 --2- 172.21.15.82:0/3480408931 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f8c780b2ae0 0x7f8c780b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:01.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:01.311+0000 7f8c8aa00700 1 -- 172.21.15.82:0/3480408931 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f8c80013070 con 0x7f8c94104100 2024-05-08T05:57:01.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:01.314+0000 7f8c91e00700 1 --2- 172.21.15.82:0/3480408931 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f8c780b2ae0 0x7f8c780b4fa0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8c8400ad20 tx=0x7f8c84005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:57:01.753 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:01.752+0000 7f8c99000700 1 -- 172.21.15.82:0/3480408931 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8c94076cd0 con 0x7f8c94104100 2024-05-08T05:57:01.755 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:57:01.755 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14364,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3876883250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3876883250},{"type":"v1","addr":"172.21.15.82:6835","nonce":3876883250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1965070586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1965070586},{"type":"v1","addr":"172.21.15.82:6837","nonce":1965070586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":31,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T05:45:57.654009+0000","modified":"2024-05-08T05:53:20.165672+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24505,"mds_2":24487,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14397":{"gid":14397,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/1890720973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1890720973},{"type":"v1","addr":"172.21.15.82:6839","nonce":1890720973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14409":{"gid":14409,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/2957083305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":2957083305},{"type":"v1","addr":"172.21.15.82:6841","nonce":2957083305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6833/3827691638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3827691638},{"type":"v1","addr":"172.21.15.134:6833","nonce":3827691638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6833/3625067797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3625067797},{"type":"v1","addr":"172.21.15.151:6833","nonce":3625067797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/4074163402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4074163402},{"type":"v1","addr":"172.21.15.134:6835","nonce":4074163402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.134:6837/2212411710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2212411710},{"type":"v1","addr":"172.21.15.134:6837","nonce":2212411710}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":17,"addr":"172.21.15.151:6835/2093655929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2093655929},{"type":"v1","addr":"172.21.15.151:6835","nonce":2093655929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6837/4192404464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":4192404464},{"type":"v1","addr":"172.21.15.151:6837","nonce":4192404464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":14,"addr":"172.21.15.151:6839/2963754236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":2963754236},{"type":"v1","addr":"172.21.15.151:6839","nonce":2963754236}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.134:6839/1145270893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1145270893},{"type":"v1","addr":"172.21.15.134:6839","nonce":1145270893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24505,24506,24487,24475,24467]},"id":1}]} 2024-05-08T05:57:01.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:01.753+0000 7f8c8aa00700 1 -- 172.21.15.82:0/3480408931 <== mon.2 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11948 (secure 0 0 0) 0x7f8c94076cd0 con 0x7f8c94104100 2024-05-08T05:57:01.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:01.757+0000 7f8c99000700 1 -- 172.21.15.82:0/3480408931 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f8c780b2ae0 msgr2=0x7f8c780b4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:01.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:01.757+0000 7f8c99000700 1 --2- 172.21.15.82:0/3480408931 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f8c780b2ae0 0x7f8c780b4fa0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8c8400ad20 tx=0x7f8c84005f90 comp rx=0 tx=0).stop 2024-05-08T05:57:01.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:01.757+0000 7f8c99000700 1 -- 172.21.15.82:0/3480408931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c94104100 msgr2=0x7f8c94075ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:01.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:01.757+0000 7f8c99000700 1 --2- 172.21.15.82:0/3480408931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c94104100 0x7f8c94075ce0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8c8000b5c0 tx=0x7f8c800057c0 comp rx=0 tx=0).stop 2024-05-08T05:57:01.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:01.757+0000 7f8c99000700 1 -- 172.21.15.82:0/3480408931 shutdown_connections 2024-05-08T05:57:01.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:01.757+0000 7f8c99000700 1 --2- 172.21.15.82:0/3480408931 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f8c780b2ae0 0x7f8c780b4fa0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:01.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:01.757+0000 7f8c99000700 1 --2- 172.21.15.82:0/3480408931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8c94108850 0x7f8c94076220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:01.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:01.757+0000 7f8c99000700 1 --2- 172.21.15.82:0/3480408931 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c94103750 0x7f8c940757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:01.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:01.757+0000 7f8c99000700 1 --2- 172.21.15.82:0/3480408931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c94104100 0x7f8c94075ce0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:01.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:01.757+0000 7f8c99000700 1 -- 172.21.15.82:0/3480408931 >> 172.21.15.82:0/3480408931 conn(0x7f8c9407a600 msgr2=0x7f8c94101400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:57:01.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:01.757+0000 7f8c99000700 1 -- 172.21.15.82:0/3480408931 shutdown_connections 2024-05-08T05:57:01.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:01.758+0000 7f8c99000700 1 -- 172.21.15.82:0/3480408931 wait complete. 2024-05-08T05:57:01.762 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 31 2024-05-08T05:57:02.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:57:02 smithi151 ceph-mon[34815]: pgmap v650: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.3 MiB/s wr, 673 op/s 2024-05-08T05:57:02.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:57:02 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/3480408931' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:57:02.380 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:57:02 smithi082 ceph-mon[30098]: pgmap v650: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.3 MiB/s wr, 673 op/s 2024-05-08T05:57:02.380 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:57:02 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/3480408931' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:57:02.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:57:02 smithi134 ceph-mon[34132]: pgmap v650: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.3 MiB/s wr, 673 op/s 2024-05-08T05:57:02.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:57:02 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/3480408931' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:57:02.909 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-05-08T05:57:03.486 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:57:04.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:57:04 smithi151 ceph-mon[34815]: pgmap v651: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.6 MiB/s wr, 590 op/s 2024-05-08T05:57:04.412 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:57:04 smithi082 ceph-mon[30098]: pgmap v651: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.6 MiB/s wr, 590 op/s 2024-05-08T05:57:04.499 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:57:04 smithi134 ceph-mon[34132]: pgmap v651: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.6 MiB/s wr, 590 op/s 2024-05-08T05:57:05.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 375.0 s, 1862.6 tps, lat 54.267 ms stddev 63.078 2024-05-08T05:57:05.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.803+0000 7f4fb2a00700 1 -- 172.21.15.82:0/1085960605 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fac10fea0 msgr2=0x7f4fac112290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:05.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.803+0000 7f4fb2a00700 1 --2- 172.21.15.82:0/1085960605 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fac10fea0 0x7f4fac112290 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c00b0a0 tx=0x7f4f9c00b3b0 comp rx=0 tx=0).stop 2024-05-08T05:57:05.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.803+0000 7f4fb2a00700 1 -- 172.21.15.82:0/1085960605 shutdown_connections 2024-05-08T05:57:05.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.803+0000 7f4fb2a00700 1 --2- 172.21.15.82:0/1085960605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fac0756d0 0x7f4fac075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:05.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.803+0000 7f4fb2a00700 1 --2- 172.21.15.82:0/1085960605 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fac10fea0 0x7f4fac112290 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:05.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.803+0000 7f4fb2a00700 1 --2- 172.21.15.82:0/1085960605 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fac075ff0 0x7f4fac10f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:05.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.803+0000 7f4fb2a00700 1 -- 172.21.15.82:0/1085960605 >> 172.21.15.82:0/1085960605 conn(0x7f4fac07a600 msgr2=0x7f4fac07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:57:05.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.803+0000 7f4fb2a00700 1 -- 172.21.15.82:0/1085960605 shutdown_connections 2024-05-08T05:57:05.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.803+0000 7f4fb2a00700 1 -- 172.21.15.82:0/1085960605 wait complete. 2024-05-08T05:57:05.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.805+0000 7f4fb2a00700 1 Processor -- start 2024-05-08T05:57:05.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.805+0000 7f4fb2a00700 1 -- start start 2024-05-08T05:57:05.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.806+0000 7f4fb2a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fac0756d0 0x7f4fac1a2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:05.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.806+0000 7f4fb2a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fac075ff0 0x7f4fac1a0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:05.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.806+0000 7f4fabe00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fac0756d0 0x7f4fac1a2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:05.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.806+0000 7f4fabe00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fac0756d0 0x7f4fac1a2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:33854/0 (socket says 172.21.15.82:33854) 2024-05-08T05:57:05.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.806+0000 7f4fabe00700 1 -- 172.21.15.82:0/1214020286 learned_addr learned my addr 172.21.15.82:0/1214020286 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:57:05.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.807+0000 7f4fb2a00700 1 --2- 172.21.15.82:0/1214020286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fac10fea0 0x7f4fac1a1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:05.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.807+0000 7f4fb2a00700 1 -- 172.21.15.82:0/1214020286 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4fac1158f0 con 0x7f4fac10fea0 2024-05-08T05:57:05.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.807+0000 7f4fb2a00700 1 -- 172.21.15.82:0/1214020286 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4fac115770 con 0x7f4fac075ff0 2024-05-08T05:57:05.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.807+0000 7f4fab400700 1 --2- 172.21.15.82:0/1214020286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fac075ff0 0x7f4fac1a0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:05.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.807+0000 7f4fb2a00700 1 -- 172.21.15.82:0/1214020286 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f4fac115a70 con 0x7f4fac0756d0 2024-05-08T05:57:05.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.808+0000 7f4fb0a00700 1 --2- 172.21.15.82:0/1214020286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fac10fea0 0x7f4fac1a1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:05.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.811+0000 7f4fb0a00700 1 -- 172.21.15.82:0/1214020286 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fac0756d0 msgr2=0x7f4fac1a2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:05.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.811+0000 7f4fb0a00700 1 --2- 172.21.15.82:0/1214020286 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fac0756d0 0x7f4fac1a2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:05.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.811+0000 7f4fb0a00700 1 -- 172.21.15.82:0/1214020286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fac075ff0 msgr2=0x7f4fac1a0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:05.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.811+0000 7f4fb0a00700 1 --2- 172.21.15.82:0/1214020286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fac075ff0 0x7f4fac1a0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:05.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.811+0000 7f4fb0a00700 1 -- 172.21.15.82:0/1214020286 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fac1a1a50 con 0x7f4fac10fea0 2024-05-08T05:57:05.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.814+0000 7f4fab400700 1 --2- 172.21.15.82:0/1214020286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fac075ff0 0x7f4fac1a0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:57:05.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.814+0000 7f4fabe00700 1 --2- 172.21.15.82:0/1214020286 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fac0756d0 0x7f4fac1a2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:57:05.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.815+0000 7f4fb0a00700 1 --2- 172.21.15.82:0/1214020286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fac10fea0 0x7f4fac1a1320 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c0062a0 tx=0x7f4f9c004d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:57:05.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.815+0000 7f4fa8c00700 1 -- 172.21.15.82:0/1214020286 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c021070 con 0x7f4fac10fea0 2024-05-08T05:57:05.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.815+0000 7f4fb2a00700 1 -- 172.21.15.82:0/1214020286 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fac10e990 con 0x7f4fac10fea0 2024-05-08T05:57:05.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.816+0000 7f4fb2a00700 1 -- 172.21.15.82:0/1214020286 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fac10ef20 con 0x7f4fac10fea0 2024-05-08T05:57:05.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.816+0000 7f4fa8c00700 1 -- 172.21.15.82:0/1214020286 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f9c007e30 con 0x7f4fac10fea0 2024-05-08T05:57:05.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.816+0000 7f4fa8c00700 1 -- 172.21.15.82:0/1214020286 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c021070 con 0x7f4fac10fea0 2024-05-08T05:57:05.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.823+0000 7f4fa8c00700 1 -- 172.21.15.82:0/1214020286 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f4f9c004540 con 0x7f4fac10fea0 2024-05-08T05:57:05.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.825+0000 7f4fa8c00700 1 --2- 172.21.15.82:0/1214020286 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f4f900b2b80 0x7f4f900b5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:05.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.825+0000 7f4fa8c00700 1 -- 172.21.15.82:0/1214020286 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f4f9c00f020 con 0x7f4fac10fea0 2024-05-08T05:57:05.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.826+0000 7f4fabe00700 1 --2- 172.21.15.82:0/1214020286 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f4f900b2b80 0x7f4f900b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:05.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.827+0000 7f4fbd3c3b80 1 Processor -- start 2024-05-08T05:57:05.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.827+0000 7f4fbd3c3b80 1 -- start start 2024-05-08T05:57:05.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.827+0000 7f4fbd3c3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f371d19bc0 0x55f371d19fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:05.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.827+0000 7f4fbd3c3b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f371d1a4e0 0x55f371d142d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:05.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.827+0000 7f4fbd3c3b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f371d148f0 0x55f371d14d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:05.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.827+0000 7f4fbd3c3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f371c66a20 con 0x55f371d19bc0 2024-05-08T05:57:05.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.827+0000 7f4fbd3c3b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f371c04760 con 0x55f371d148f0 2024-05-08T05:57:05.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.827+0000 7f4fbd3c3b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55f371c629e0 con 0x55f371d1a4e0 2024-05-08T05:57:05.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.828+0000 7f4fb0a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f371d148f0 0x55f371d14d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:05.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.828+0000 7f4fabe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f371d19bc0 0x55f371d19fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:05.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.828+0000 7f4fb0a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f371d148f0 0x55f371d14d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:53946/0 (socket says 172.21.15.82:53946) 2024-05-08T05:57:05.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.828+0000 7f4fb0a00700 1 -- 172.21.15.82:0/2197036116 learned_addr learned my addr 172.21.15.82:0/2197036116 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:57:05.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.829+0000 7f4fab400700 1 --2- 172.21.15.82:0/2197036116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f371d1a4e0 0x55f371d142d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:05.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.829+0000 7f4fabe00700 1 --2- 172.21.15.82:0/1214020286 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f4f900b2b80 0x7f4f900b5040 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4fa40094f0 tx=0x7f4fa40146f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:57:05.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.829+0000 7f4fabe00700 1 -- 172.21.15.82:0/2197036116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f371d1a4e0 msgr2=0x55f371d142d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:57:05.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.829+0000 7f4fabe00700 1 --2- 172.21.15.82:0/2197036116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f371d1a4e0 0x55f371d142d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:05.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.829+0000 7f4fabe00700 1 -- 172.21.15.82:0/2197036116 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f371d148f0 msgr2=0x55f371d14d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:57:05.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.829+0000 7f4fabe00700 1 --2- 172.21.15.82:0/2197036116 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f371d148f0 0x55f371d14d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:05.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.829+0000 7f4fabe00700 1 -- 172.21.15.82:0/2197036116 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f371bb38d0 con 0x55f371d19bc0 2024-05-08T05:57:05.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.829+0000 7f4fab400700 1 --2- 172.21.15.82:0/2197036116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f371d1a4e0 0x55f371d142d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:57:05.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.830+0000 7f4fabe00700 1 --2- 172.21.15.82:0/2197036116 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f371d19bc0 0x55f371d19fa0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4009b90 tx=0x7f4fa401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c1b4ca1f81c617e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:57:05.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.830+0000 7f4fa1600700 1 -- 172.21.15.82:0/2197036116 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa4012c80 con 0x55f371d19bc0 2024-05-08T05:57:05.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.830+0000 7f4fa1600700 1 -- 172.21.15.82:0/2197036116 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4fa4012e20 con 0x55f371d19bc0 2024-05-08T05:57:05.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.830+0000 7f4fa1600700 1 -- 172.21.15.82:0/2197036116 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa401d5d0 con 0x55f371d19bc0 2024-05-08T05:57:05.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.831+0000 7f4fbd3c3b80 1 -- 172.21.15.82:0/2197036116 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f371d19bc0 msgr2=0x55f371d19fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:05.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.831+0000 7f4fbd3c3b80 1 --2- 172.21.15.82:0/2197036116 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f371d19bc0 0x55f371d19fa0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4009b90 tx=0x7f4fa401b000 comp rx=0 tx=0).stop 2024-05-08T05:57:05.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.832+0000 7f4fbd3c3b80 1 -- 172.21.15.82:0/2197036116 shutdown_connections 2024-05-08T05:57:05.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.832+0000 7f4fbd3c3b80 1 --2- 172.21.15.82:0/2197036116 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f371d148f0 0x55f371d14d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:05.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.832+0000 7f4fbd3c3b80 1 --2- 172.21.15.82:0/2197036116 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f371d19bc0 0x55f371d19fa0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:05.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.832+0000 7f4fbd3c3b80 1 --2- 172.21.15.82:0/2197036116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f371d1a4e0 0x55f371d142d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:05.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.832+0000 7f4fbd3c3b80 1 -- 172.21.15.82:0/2197036116 >> 172.21.15.82:0/2197036116 conn(0x55f371c8c6d0 msgr2=0x55f371d0eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:57:05.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.832+0000 7f4fbd3c3b80 1 -- 172.21.15.82:0/2197036116 shutdown_connections 2024-05-08T05:57:05.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.832+0000 7f4fbd3c3b80 1 -- 172.21.15.82:0/2197036116 wait complete. 2024-05-08T05:57:05.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.833+0000 7f4fbd3c3b80 1 -- start start 2024-05-08T05:57:05.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.833+0000 7f4fbd3c3b80 1 Processor -- start 2024-05-08T05:57:05.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.837+0000 7f4fbd3c3b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f371d148f0 0x55f371d20190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:05.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.837+0000 7f4fbd3c3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f371d19bc0 0x55f371d1d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:05.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.837+0000 7f4fbd3c3b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f371d1a4e0 0x55f371d1da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:05.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.837+0000 7f4fbd3c3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f371d20f20 con 0x55f371d19bc0 2024-05-08T05:57:05.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.837+0000 7f4fbd3c3b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f371bccb20 con 0x55f371d1a4e0 2024-05-08T05:57:05.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.837+0000 7f4fbd3c3b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55f371d210a0 con 0x55f371d148f0 2024-05-08T05:57:05.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.837+0000 7f4fbd3c3b80 10 client.0 _ll_register_callbacks cb 0x55f371c0dc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:57:05.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.838+0000 7f4fb0a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f371d1a4e0 0x55f371d1da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:05.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.838+0000 7f4fb0a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f371d1a4e0 0x55f371d1da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:53962/0 (socket says 172.21.15.82:53962) 2024-05-08T05:57:05.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.838+0000 7f4fb0a00700 1 -- 172.21.15.82:0/3850639513 learned_addr learned my addr 172.21.15.82:0/3850639513 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:57:05.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.838+0000 7f4fb0a00700 1 -- 172.21.15.82:0/3850639513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f371d148f0 msgr2=0x55f371d20190 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T05:57:05.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.839+0000 7f4fabe00700 1 --2- 172.21.15.82:0/3850639513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f371d148f0 0x55f371d20190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:05.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.839+0000 7f4fb0a00700 1 --2- 172.21.15.82:0/3850639513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f371d148f0 0x55f371d20190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:05.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.839+0000 7f4fb0a00700 1 -- 172.21.15.82:0/3850639513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f371d19bc0 msgr2=0x55f371d1d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:57:05.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.840+0000 7f4fab400700 1 --2- 172.21.15.82:0/3850639513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f371d19bc0 0x55f371d1d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:05.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.840+0000 7f4fb0a00700 1 --2- 172.21.15.82:0/3850639513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f371d19bc0 0x55f371d1d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:05.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.840+0000 7f4fb0a00700 1 -- 172.21.15.82:0/3850639513 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f371c2c420 con 0x55f371d1a4e0 2024-05-08T05:57:05.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.840+0000 7f4fabe00700 1 --2- 172.21.15.82:0/3850639513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f371d148f0 0x55f371d20190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:57:05.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.840+0000 7f4fb0a00700 1 --2- 172.21.15.82:0/3850639513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f371d1a4e0 0x55f371d1da70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c0a6960 tx=0x7f4f9c004200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28de87f8afe8248d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:57:05.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.840+0000 7f4f9a000700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:57:05.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.840+0000 7f4f9a000700 1 -- 172.21.15.82:0/3850639513 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c0aafe0 con 0x55f371d1a4e0 2024-05-08T05:57:05.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.841+0000 7f4fab400700 1 --2- 172.21.15.82:0/3850639513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f371d19bc0 0x55f371d1d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:57:05.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.841+0000 7f4f9a000700 1 -- 172.21.15.82:0/3850639513 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f4f9c0e0e40 con 0x55f371d1a4e0 2024-05-08T05:57:05.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.841+0000 7f4fbd3c3b80 1 -- 172.21.15.82:0/3850639513 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4fa4012e20 con 0x55f371d1a4e0 2024-05-08T05:57:05.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.841+0000 7f4f9a000700 1 -- 172.21.15.82:0/3850639513 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f4f9c004000 con 0x55f371d1a4e0 2024-05-08T05:57:05.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.842+0000 7f4fbd3c3b80 10 client.25859 fetch_fsmap learned FSMap version 31 2024-05-08T05:57:05.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.842+0000 7f4fbd3c3b80 1 -- 172.21.15.82:0/3850639513 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55f371d2b790 con 0x55f371d1a4e0 2024-05-08T05:57:05.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.842+0000 7f4f9a000700 1 -- 172.21.15.82:0/3850639513 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4f9c090e50 con 0x55f371d1a4e0 2024-05-08T05:57:05.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.842+0000 7f4f9a000700 1 -- 172.21.15.82:0/3850639513 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f4f9c011070 con 0x55f371d1a4e0 2024-05-08T05:57:05.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.842+0000 7f4fbd3c3b80 10 client.25859 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:57:05.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.842+0000 7f4fbd3c3b80 10 client.25859 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-05-08T05:57:05.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.842+0000 7f4fbd3c3b80 20 client.25859 populate_metadata read hostname 'smithi082' 2024-05-08T05:57:05.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.842+0000 7f4fbd3c3b80 1 --2- 172.21.15.82:0/3850639513 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x55f371d2dc60 0x55f371d300a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:05.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.842+0000 7f4fbd3c3b80 4 client.25859 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:57:05.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.842+0000 7f4fbd3c3b80 1 -- 172.21.15.82:0/3850639513 --> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f4fa4012e20 con 0x55f371d2dc60 2024-05-08T05:57:05.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.843+0000 7f4fabe00700 1 --2- 172.21.15.82:0/3850639513 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x55f371d2dc60 0x55f371d300a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:05.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.843+0000 7f4f9a000700 10 client.25859 ms_handle_connect on v2:172.21.15.134:6836/2212411710 2024-05-08T05:57:05.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.843+0000 7f4fabe00700 1 --2- 172.21.15.82:0/3850639513 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x55f371d2dc60 0x55f371d300a0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=dd5fd646085d35cc server_cookie=e9c9e9ea67145f3b in_seq=0 out_seq=0 2024-05-08T05:57:05.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.844+0000 7f4f9a000700 1 -- 172.21.15.82:0/3850639513 <== mds.4 v2:172.21.15.134:6836/2212411710 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7f4fa4012e20 con 0x55f371d2dc60 2024-05-08T05:57:05.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.844+0000 7f4f9a000700 10 client.25859 handle_command_reply: tid=0 2024-05-08T05:57:05.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.844+0000 7f4fbd3c3b80 1 client.25859 shutdown 2024-05-08T05:57:05.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.845+0000 7f4fbd3c3b80 1 -- 172.21.15.82:0/3850639513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f371d1a4e0 msgr2=0x55f371d1da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:05.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.845+0000 7f4fbd3c3b80 1 --2- 172.21.15.82:0/3850639513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f371d1a4e0 0x55f371d1da70 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c0a6960 tx=0x7f4f9c004200 comp rx=0 tx=0).stop 2024-05-08T05:57:05.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.845+0000 7f4fbd3c3b80 1 -- 172.21.15.82:0/3850639513 shutdown_connections 2024-05-08T05:57:05.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.845+0000 7f4fbd3c3b80 1 --2- 172.21.15.82:0/3850639513 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x55f371d2dc60 0x55f371d300a0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:05.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.845+0000 7f4fbd3c3b80 1 --2- 172.21.15.82:0/3850639513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f371d1a4e0 0x55f371d1da70 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:05.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.845+0000 7f4fbd3c3b80 1 --2- 172.21.15.82:0/3850639513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f371d148f0 0x55f371d20190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:05.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.845+0000 7f4fbd3c3b80 1 --2- 172.21.15.82:0/3850639513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f371d19bc0 0x55f371d1d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:05.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.845+0000 7f4f9a000700 0 client.25859 ms_handle_reset on v2:172.21.15.134:6836/2212411710 2024-05-08T05:57:05.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.845+0000 7f4fbd3c3b80 1 -- 172.21.15.82:0/3850639513 >> 172.21.15.82:0/3850639513 conn(0x55f371c8c6d0 msgr2=0x55f371d0e190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:57:05.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.846+0000 7f4fbd3c3b80 1 -- 172.21.15.82:0/3850639513 shutdown_connections 2024-05-08T05:57:05.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.846+0000 7f4fbd3c3b80 1 -- 172.21.15.82:0/3850639513 wait complete. 2024-05-08T05:57:05.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.846+0000 7f4fbd3c3b80 20 client.25859 trim_cache size 0 max 16384 2024-05-08T05:57:05.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.869+0000 7f4fbd3c3b80 1 Processor -- start 2024-05-08T05:57:05.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.870+0000 7f4fbd3c3b80 1 -- start start 2024-05-08T05:57:05.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.870+0000 7f4fbd3c3b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f371d148f0 0x55f371d29fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:05.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.870+0000 7f4fbd3c3b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f371d19bc0 0x55f371d10790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:05.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.870+0000 7f4fbd3c3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f371d1a4e0 0x55f371d0e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:05.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.870+0000 7f4fbd3c3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4fac1bc860 con 0x55f371d1a4e0 2024-05-08T05:57:05.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.870+0000 7f4fbd3c3b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4fac1be3a0 con 0x55f371d148f0 2024-05-08T05:57:05.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.870+0000 7f4fbd3c3b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f4fac1bcf30 con 0x55f371d19bc0 2024-05-08T05:57:05.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.870+0000 7f4fabe00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f371d148f0 0x55f371d29fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:05.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.870+0000 7f4fabe00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f371d148f0 0x55f371d29fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:53976/0 (socket says 172.21.15.82:53976) 2024-05-08T05:57:05.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.870+0000 7f4fabe00700 1 -- 172.21.15.82:0/3178451293 learned_addr learned my addr 172.21.15.82:0/3178451293 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:57:05.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.870+0000 7f4fab400700 1 --2- 172.21.15.82:0/3178451293 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f371d19bc0 0x55f371d10790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:05.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.871+0000 7f4fb0a00700 1 --2- 172.21.15.82:0/3178451293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f371d1a4e0 0x55f371d0e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:05.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.871+0000 7f4fabe00700 1 -- 172.21.15.82:0/3178451293 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f371d19bc0 msgr2=0x55f371d10790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:57:05.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.871+0000 7f4fabe00700 1 --2- 172.21.15.82:0/3178451293 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f371d19bc0 0x55f371d10790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:05.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.871+0000 7f4fabe00700 1 -- 172.21.15.82:0/3178451293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f371d1a4e0 msgr2=0x55f371d0e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:57:05.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.871+0000 7f4fabe00700 1 --2- 172.21.15.82:0/3178451293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f371d1a4e0 0x55f371d0e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:05.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.871+0000 7f4fabe00700 1 -- 172.21.15.82:0/3178451293 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f371d20e00 con 0x55f371d148f0 2024-05-08T05:57:05.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.871+0000 7f4fb0a00700 1 --2- 172.21.15.82:0/3178451293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f371d1a4e0 0x55f371d0e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:57:05.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.871+0000 7f4fabe00700 1 --2- 172.21.15.82:0/3178451293 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f371d148f0 0x55f371d29fe0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4014af0 tx=0x7f4fa401eda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79961a5474de9ee3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:57:05.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.872+0000 7f4fa0c00700 1 -- 172.21.15.82:0/3178451293 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa4005240 con 0x55f371d148f0 2024-05-08T05:57:05.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.872+0000 7f4fa0c00700 1 -- 172.21.15.82:0/3178451293 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4fa4012e10 con 0x55f371d148f0 2024-05-08T05:57:05.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.872+0000 7f4fa0c00700 1 -- 172.21.15.82:0/3178451293 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fa401e420 con 0x55f371d148f0 2024-05-08T05:57:05.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.873+0000 7f4fbd3c3b80 1 -- 172.21.15.82:0/3178451293 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f371d148f0 msgr2=0x55f371d29fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:05.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.873+0000 7f4fbd3c3b80 1 --2- 172.21.15.82:0/3178451293 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f371d148f0 0x55f371d29fe0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4fa4014af0 tx=0x7f4fa401eda0 comp rx=0 tx=0).stop 2024-05-08T05:57:05.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.873+0000 7f4fbd3c3b80 1 -- 172.21.15.82:0/3178451293 shutdown_connections 2024-05-08T05:57:05.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.873+0000 7f4fbd3c3b80 1 --2- 172.21.15.82:0/3178451293 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f371d148f0 0x55f371d29fe0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:05.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.873+0000 7f4fbd3c3b80 1 --2- 172.21.15.82:0/3178451293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f371d1a4e0 0x55f371d0e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:05.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.873+0000 7f4fbd3c3b80 1 --2- 172.21.15.82:0/3178451293 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f371d19bc0 0x55f371d10790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:05.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.873+0000 7f4fbd3c3b80 1 -- 172.21.15.82:0/3178451293 >> 172.21.15.82:0/3178451293 conn(0x55f371c8c6d0 msgr2=0x55f371d1be60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:57:05.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.873+0000 7f4fbd3c3b80 1 -- 172.21.15.82:0/3178451293 shutdown_connections 2024-05-08T05:57:05.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.874+0000 7f4fbd3c3b80 1 -- 172.21.15.82:0/3178451293 wait complete. 2024-05-08T05:57:05.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.875+0000 7f4fbd3c3b80 1 -- start start 2024-05-08T05:57:05.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.875+0000 7f4fbd3c3b80 1 Processor -- start 2024-05-08T05:57:05.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.877+0000 7f4fbd3c3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f371d148f0 0x55f371d26610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:05.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.877+0000 7f4fbd3c3b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f371d19bc0 0x55f371d34dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:05.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.877+0000 7f4fbd3c3b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f371d1a4e0 0x55f371d35310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:05.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.877+0000 7f4fbd3c3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4fac1bdcd0 con 0x55f371d148f0 2024-05-08T05:57:05.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.877+0000 7f4fbd3c3b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4fac1bd600 con 0x55f371d19bc0 2024-05-08T05:57:05.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.877+0000 7f4fbd3c3b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f4fac1ba800 con 0x55f371d1a4e0 2024-05-08T05:57:05.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.877+0000 7f4fbd3c3b80 10 client.0 _ll_register_callbacks cb 0x55f371c0dc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:57:05.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.878+0000 7f4fab400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f371d19bc0 0x55f371d34dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:05.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.878+0000 7f4fab400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f371d19bc0 0x55f371d34dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:53984/0 (socket says 172.21.15.82:53984) 2024-05-08T05:57:05.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.878+0000 7f4fb0a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f371d1a4e0 0x55f371d35310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:05.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.878+0000 7f4fabe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f371d148f0 0x55f371d26610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:05.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.878+0000 7f4fab400700 1 -- 172.21.15.82:0/84283808 learned_addr learned my addr 172.21.15.82:0/84283808 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:57:05.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.878+0000 7f4fb0a00700 1 -- 172.21.15.82:0/84283808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f371d19bc0 msgr2=0x55f371d34dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:57:05.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.878+0000 7f4fb0a00700 1 --2- 172.21.15.82:0/84283808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f371d19bc0 0x55f371d34dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:05.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.878+0000 7f4fb0a00700 1 -- 172.21.15.82:0/84283808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f371d148f0 msgr2=0x55f371d26610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:57:05.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.878+0000 7f4fb0a00700 1 --2- 172.21.15.82:0/84283808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f371d148f0 0x55f371d26610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:05.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.879+0000 7f4fb0a00700 1 -- 172.21.15.82:0/84283808 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f371d358d0 con 0x55f371d1a4e0 2024-05-08T05:57:05.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.879+0000 7f4fab400700 1 --2- 172.21.15.82:0/84283808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f371d19bc0 0x55f371d34dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:57:05.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.879+0000 7f4fabe00700 1 --2- 172.21.15.82:0/84283808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f371d148f0 0x55f371d26610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:57:05.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.879+0000 7f4fb0a00700 1 --2- 172.21.15.82:0/84283808 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f371d1a4e0 0x55f371d35310 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c00b780 tx=0x7f4f9c0b35c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee80d3b15d94cc97 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:57:05.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.879+0000 7f4f9a000700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:57:05.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.879+0000 7f4f9a000700 1 -- 172.21.15.82:0/84283808 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c0aa8e0 con 0x55f371d1a4e0 2024-05-08T05:57:05.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.879+0000 7f4f9a000700 1 -- 172.21.15.82:0/84283808 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f4f9c0cd0b0 con 0x55f371d1a4e0 2024-05-08T05:57:05.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.879+0000 7f4fbd3c3b80 1 -- 172.21.15.82:0/84283808 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f371ce1140 con 0x55f371d1a4e0 2024-05-08T05:57:05.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.879+0000 7f4f9a000700 1 -- 172.21.15.82:0/84283808 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f4f9c0aec90 con 0x55f371d1a4e0 2024-05-08T05:57:05.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.879+0000 7f4fbd3c3b80 10 client.25909 fetch_fsmap learned FSMap version 31 2024-05-08T05:57:05.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.879+0000 7f4fbd3c3b80 1 -- 172.21.15.82:0/84283808 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55f371d982a0 con 0x55f371d1a4e0 2024-05-08T05:57:05.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.880+0000 7f4f9a000700 1 -- 172.21.15.82:0/84283808 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55f371ce1140 con 0x55f371d1a4e0 2024-05-08T05:57:05.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.880+0000 7f4f9a000700 1 -- 172.21.15.82:0/84283808 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f4f9c011040 con 0x55f371d1a4e0 2024-05-08T05:57:05.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.880+0000 7f4fbd3c3b80 10 client.25909 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:57:05.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.880+0000 7f4fbd3c3b80 10 client.25909 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-05-08T05:57:05.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.880+0000 7f4fbd3c3b80 20 client.25909 populate_metadata read hostname 'smithi082' 2024-05-08T05:57:05.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.880+0000 7f4fbd3c3b80 1 --2- 172.21.15.82:0/84283808 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x55f371d98760 0x55f371d9ab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:05.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.880+0000 7f4fbd3c3b80 4 client.25909 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:57:05.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.880+0000 7f4fbd3c3b80 1 -- 172.21.15.82:0/84283808 --> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f371c74400 con 0x55f371d98760 2024-05-08T05:57:05.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.880+0000 7f4fabe00700 1 --2- 172.21.15.82:0/84283808 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x55f371d98760 0x55f371d9ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:05.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.881+0000 7f4fabe00700 1 --2- 172.21.15.82:0/84283808 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x55f371d98760 0x55f371d9ab50 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c6389b07c3b5027b server_cookie=8b764505d5c128 in_seq=0 out_seq=0 2024-05-08T05:57:05.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.881+0000 7f4f9a000700 10 client.25909 ms_handle_connect on v2:172.21.15.134:6836/2212411710 2024-05-08T05:57:05.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.882+0000 7f4f9a000700 1 -- 172.21.15.82:0/84283808 <== mds.4 v2:172.21.15.134:6836/2212411710 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f371c74400 con 0x55f371d98760 2024-05-08T05:57:05.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.882+0000 7f4f9a000700 10 client.25909 handle_command_reply: tid=0 2024-05-08T05:57:05.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.882+0000 7f4fbd3c3b80 1 client.25909 shutdown 2024-05-08T05:57:05.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.882+0000 7f4fbd3c3b80 1 -- 172.21.15.82:0/84283808 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f371d1a4e0 msgr2=0x55f371d35310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:05.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.882+0000 7f4fbd3c3b80 1 --2- 172.21.15.82:0/84283808 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f371d1a4e0 0x55f371d35310 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c00b780 tx=0x7f4f9c0b35c0 comp rx=0 tx=0).stop 2024-05-08T05:57:05.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.882+0000 7f4fbd3c3b80 1 -- 172.21.15.82:0/84283808 shutdown_connections 2024-05-08T05:57:05.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.882+0000 7f4fbd3c3b80 1 --2- 172.21.15.82:0/84283808 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x55f371d98760 0x55f371d9ab50 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:05.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.882+0000 7f4fbd3c3b80 1 --2- 172.21.15.82:0/84283808 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f371d1a4e0 0x55f371d35310 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:05.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.882+0000 7f4fbd3c3b80 1 --2- 172.21.15.82:0/84283808 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f371d148f0 0x55f371d26610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:05.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.882+0000 7f4f9a000700 0 client.25909 ms_handle_reset on v2:172.21.15.134:6836/2212411710 2024-05-08T05:57:05.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.882+0000 7f4fbd3c3b80 1 --2- 172.21.15.82:0/84283808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f371d19bc0 0x55f371d34dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:05.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.882+0000 7f4fbd3c3b80 1 -- 172.21.15.82:0/84283808 >> 172.21.15.82:0/84283808 conn(0x55f371c8c6d0 msgr2=0x55f371d186a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:57:05.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.882+0000 7f4fbd3c3b80 1 -- 172.21.15.82:0/84283808 shutdown_connections 2024-05-08T05:57:05.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.882+0000 7f4fbd3c3b80 1 -- 172.21.15.82:0/84283808 wait complete. 2024-05-08T05:57:05.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.882+0000 7f4fbd3c3b80 20 client.25909 trim_cache size 0 max 16384 2024-05-08T05:57:05.886 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T05:57:05.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.883+0000 7f4fb2a00700 1 -- 172.21.15.82:0/1214020286 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f4f900b2b80 msgr2=0x7f4f900b5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:05.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.883+0000 7f4fb2a00700 1 --2- 172.21.15.82:0/1214020286 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f4f900b2b80 0x7f4f900b5040 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f4fa40094f0 tx=0x7f4fa40146f0 comp rx=0 tx=0).stop 2024-05-08T05:57:05.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.883+0000 7f4fb2a00700 1 -- 172.21.15.82:0/1214020286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fac10fea0 msgr2=0x7f4fac1a1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:05.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.883+0000 7f4fb2a00700 1 --2- 172.21.15.82:0/1214020286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fac10fea0 0x7f4fac1a1320 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c0062a0 tx=0x7f4f9c004d30 comp rx=0 tx=0).stop 2024-05-08T05:57:05.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.883+0000 7f4fb2a00700 1 -- 172.21.15.82:0/1214020286 shutdown_connections 2024-05-08T05:57:05.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.883+0000 7f4fb2a00700 1 --2- 172.21.15.82:0/1214020286 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f4f900b2b80 0x7f4f900b5040 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:05.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.883+0000 7f4fb2a00700 1 --2- 172.21.15.82:0/1214020286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4fac10fea0 0x7f4fac1a1320 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:05.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.883+0000 7f4fb2a00700 1 --2- 172.21.15.82:0/1214020286 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fac0756d0 0x7f4fac1a2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:05.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.883+0000 7f4fb2a00700 1 --2- 172.21.15.82:0/1214020286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fac075ff0 0x7f4fac1a0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:05.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.883+0000 7f4fb2a00700 1 -- 172.21.15.82:0/1214020286 >> 172.21.15.82:0/1214020286 conn(0x7f4fac07a600 msgr2=0x7f4fac1057e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:57:05.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.884+0000 7f4fb2a00700 1 -- 172.21.15.82:0/1214020286 shutdown_connections 2024-05-08T05:57:05.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:05.884+0000 7f4fb2a00700 1 -- 172.21.15.82:0/1214020286 wait complete. 2024-05-08T05:57:06.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:57:06 smithi151 ceph-mon[34815]: pgmap v652: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 MiB/s wr, 659 op/s 2024-05-08T05:57:06.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:57:06 smithi082 ceph-mon[30098]: pgmap v652: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 MiB/s wr, 659 op/s 2024-05-08T05:57:06.499 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:57:06 smithi134 ceph-mon[34132]: pgmap v652: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 MiB/s wr, 659 op/s 2024-05-08T05:57:06.915 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-05-08T05:57:07.477 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:57:08.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:57:08 smithi082 ceph-mon[30098]: pgmap v653: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.9 MiB/s wr, 710 op/s 2024-05-08T05:57:08.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:57:08 smithi151 ceph-mon[34815]: pgmap v653: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.9 MiB/s wr, 710 op/s 2024-05-08T05:57:08.499 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:57:08 smithi134 ceph-mon[34132]: pgmap v653: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.9 MiB/s wr, 710 op/s 2024-05-08T05:57:10.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 380.0 s, 1792.0 tps, lat 55.400 ms stddev 59.674 2024-05-08T05:57:10.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:57:10 smithi151 ceph-mon[34815]: pgmap v654: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.0 MiB/s wr, 633 op/s 2024-05-08T05:57:10.472 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:57:10 smithi082 ceph-mon[30098]: pgmap v654: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.0 MiB/s wr, 633 op/s 2024-05-08T05:57:10.499 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:57:10 smithi134 ceph-mon[34132]: pgmap v654: 97 pgs: 97 active+clean; 1.6 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.0 MiB/s wr, 633 op/s 2024-05-08T05:57:10.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.833+0000 7f0944000700 1 -- 172.21.15.82:0/3156189248 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f093c10b6e0 msgr2=0x7f093c10bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:10.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.833+0000 7f0944000700 1 --2- 172.21.15.82:0/3156189248 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f093c10b6e0 0x7f093c10bac0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f0930009990 tx=0x7f0930009ca0 comp rx=0 tx=0).stop 2024-05-08T05:57:10.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.833+0000 7f0944000700 1 -- 172.21.15.82:0/3156189248 shutdown_connections 2024-05-08T05:57:10.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.833+0000 7f0944000700 1 --2- 172.21.15.82:0/3156189248 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f093c10b6e0 0x7f093c10bac0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:10.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.833+0000 7f0944000700 1 --2- 172.21.15.82:0/3156189248 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f093c1060a0 0x7f093c1125b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:10.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.833+0000 7f0944000700 1 --2- 172.21.15.82:0/3156189248 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f093c1056e0 0x7f093c105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:10.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.833+0000 7f0944000700 1 -- 172.21.15.82:0/3156189248 >> 172.21.15.82:0/3156189248 conn(0x7f093c1011d0 msgr2=0x7f093c1035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:57:10.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.833+0000 7f0944000700 1 -- 172.21.15.82:0/3156189248 shutdown_connections 2024-05-08T05:57:10.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.833+0000 7f0944000700 1 -- 172.21.15.82:0/3156189248 wait complete. 2024-05-08T05:57:10.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.834+0000 7f0944000700 1 Processor -- start 2024-05-08T05:57:10.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.835+0000 7f0944000700 1 -- start start 2024-05-08T05:57:10.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.835+0000 7f0944000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f093c1056e0 0x7f093c19bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:10.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.835+0000 7f0944000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f093c1060a0 0x7f093c19c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:10.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.835+0000 7f0944000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f093c10b6e0 0x7f093c1a06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:10.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.835+0000 7f0944000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f093c115920 con 0x7f093c10b6e0 2024-05-08T05:57:10.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.835+0000 7f0944000700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f093c1157a0 con 0x7f093c1056e0 2024-05-08T05:57:10.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.835+0000 7f0944000700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f093c115aa0 con 0x7f093c1060a0 2024-05-08T05:57:10.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.835+0000 7f0940c00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f093c1060a0 0x7f093c19c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:10.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.835+0000 7f0940c00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f093c1060a0 0x7f093c19c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:33896/0 (socket says 172.21.15.82:33896) 2024-05-08T05:57:10.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.835+0000 7f0940c00700 1 -- 172.21.15.82:0/2383508636 learned_addr learned my addr 172.21.15.82:0/2383508636 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:57:10.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.835+0000 7f0942000700 1 --2- 172.21.15.82:0/2383508636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f093c10b6e0 0x7f093c1a06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:10.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.835+0000 7f0941600700 1 --2- 172.21.15.82:0/2383508636 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f093c1056e0 0x7f093c19bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:10.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.836+0000 7f0940c00700 1 -- 172.21.15.82:0/2383508636 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f093c1056e0 msgr2=0x7f093c19bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:10.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.836+0000 7f0940c00700 1 --2- 172.21.15.82:0/2383508636 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f093c1056e0 0x7f093c19bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:10.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.836+0000 7f0940c00700 1 -- 172.21.15.82:0/2383508636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f093c10b6e0 msgr2=0x7f093c1a06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:10.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.836+0000 7f0940c00700 1 --2- 172.21.15.82:0/2383508636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f093c10b6e0 0x7f093c1a06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:10.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.836+0000 7f0940c00700 1 -- 172.21.15.82:0/2383508636 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f093c1a0de0 con 0x7f093c1060a0 2024-05-08T05:57:10.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.836+0000 7f0942000700 1 --2- 172.21.15.82:0/2383508636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f093c10b6e0 0x7f093c1a06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:57:10.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.836+0000 7f0940c00700 1 --2- 172.21.15.82:0/2383508636 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f093c1060a0 0x7f093c19c310 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f092800d980 tx=0x7f092800dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:57:10.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.837+0000 7f093a000700 1 -- 172.21.15.82:0/2383508636 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0928016070 con 0x7f093c1060a0 2024-05-08T05:57:10.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.837+0000 7f093a000700 1 -- 172.21.15.82:0/2383508636 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0928004830 con 0x7f093c1060a0 2024-05-08T05:57:10.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.837+0000 7f093a000700 1 -- 172.21.15.82:0/2383508636 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09280055e0 con 0x7f093c1060a0 2024-05-08T05:57:10.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.837+0000 7f0944000700 1 -- 172.21.15.82:0/2383508636 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f093c1a10d0 con 0x7f093c1060a0 2024-05-08T05:57:10.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.837+0000 7f0944000700 1 -- 172.21.15.82:0/2383508636 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f093c1a8950 con 0x7f093c1060a0 2024-05-08T05:57:10.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.841+0000 7f093a000700 1 -- 172.21.15.82:0/2383508636 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f0928004220 con 0x7f093c1060a0 2024-05-08T05:57:10.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.842+0000 7f094e974b80 1 Processor -- start 2024-05-08T05:57:10.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.842+0000 7f094e974b80 1 -- start start 2024-05-08T05:57:10.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.842+0000 7f093a000700 1 --2- 172.21.15.82:0/2383508636 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f09240b2980 0x7f09240b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:10.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.843+0000 7f093a000700 1 -- 172.21.15.82:0/2383508636 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f09280e1fa0 con 0x7f093c1060a0 2024-05-08T05:57:10.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.843+0000 7f094e974b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603bab65060 0x5603bab65440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:10.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.843+0000 7f094e974b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603bab65980 0x5603bab69490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:10.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.843+0000 7f094e974b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5603bab699d0 0x5603bab69e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:10.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.843+0000 7f094e974b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5603baab7a20 con 0x5603bab699d0 2024-05-08T05:57:10.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.843+0000 7f094e974b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5603baa55760 con 0x5603bab65980 2024-05-08T05:57:10.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.843+0000 7f094e974b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5603baab39e0 con 0x5603bab65060 2024-05-08T05:57:10.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.843+0000 7f0942000700 1 --2- 172.21.15.82:0/2383508636 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f09240b2980 0x7f09240b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:10.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.843+0000 7f0941600700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603bab65060 0x5603bab65440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:10.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.844+0000 7f0941600700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603bab65060 0x5603bab65440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:33898/0 (socket says 172.21.15.82:33898) 2024-05-08T05:57:10.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.844+0000 7f0941600700 1 -- 172.21.15.82:0/606458833 learned_addr learned my addr 172.21.15.82:0/606458833 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:57:10.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.844+0000 7f0940c00700 1 --2- 172.21.15.82:0/606458833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603bab65980 0x5603bab69490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:10.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.846+0000 7f0940c00700 1 -- 172.21.15.82:0/606458833 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603bab65060 msgr2=0x5603bab65440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:57:10.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.846+0000 7f0940c00700 1 --2- 172.21.15.82:0/606458833 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603bab65060 0x5603bab65440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:10.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.846+0000 7f0940c00700 1 -- 172.21.15.82:0/606458833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5603bab699d0 msgr2=0x5603bab69e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:57:10.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.846+0000 7f0940c00700 1 --2- 172.21.15.82:0/606458833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5603bab699d0 0x5603bab69e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:10.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.846+0000 7f0940c00700 1 -- 172.21.15.82:0/606458833 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603baa048d0 con 0x5603bab65980 2024-05-08T05:57:10.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.847+0000 7f0940c00700 1 --2- 172.21.15.82:0/606458833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603bab65980 0x5603bab69490 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f09280a67e0 tx=0x7f09280050b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=968a865a66cd8b9f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:57:10.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.847+0000 7f092ea00700 1 -- 172.21.15.82:0/606458833 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09280a9570 con 0x5603bab65980 2024-05-08T05:57:10.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.847+0000 7f092ea00700 1 -- 172.21.15.82:0/606458833 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09280ad920 con 0x5603bab65980 2024-05-08T05:57:10.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.847+0000 7f092ea00700 1 -- 172.21.15.82:0/606458833 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09280a9a30 con 0x5603bab65980 2024-05-08T05:57:10.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.848+0000 7f0942000700 1 --2- 172.21.15.82:0/2383508636 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f09240b2980 0x7f09240b4e40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0934009550 tx=0x7f093400b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:57:10.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.849+0000 7f094e974b80 1 -- 172.21.15.82:0/606458833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603bab65980 msgr2=0x5603bab69490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:10.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.849+0000 7f094e974b80 1 --2- 172.21.15.82:0/606458833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603bab65980 0x5603bab69490 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f09280a67e0 tx=0x7f09280050b0 comp rx=0 tx=0).stop 2024-05-08T05:57:10.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.849+0000 7f094e974b80 1 -- 172.21.15.82:0/606458833 shutdown_connections 2024-05-08T05:57:10.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.849+0000 7f094e974b80 1 --2- 172.21.15.82:0/606458833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5603bab699d0 0x5603bab69e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:10.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.849+0000 7f094e974b80 1 --2- 172.21.15.82:0/606458833 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603bab65060 0x5603bab65440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:10.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.849+0000 7f094e974b80 1 --2- 172.21.15.82:0/606458833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603bab65980 0x5603bab69490 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:10.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.849+0000 7f094e974b80 1 -- 172.21.15.82:0/606458833 >> 172.21.15.82:0/606458833 conn(0x5603baa93b60 msgr2=0x5603bab5f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:57:10.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.850+0000 7f094e974b80 1 -- 172.21.15.82:0/606458833 shutdown_connections 2024-05-08T05:57:10.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.850+0000 7f094e974b80 1 -- 172.21.15.82:0/606458833 wait complete. 2024-05-08T05:57:10.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.850+0000 7f094e974b80 1 -- start start 2024-05-08T05:57:10.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.850+0000 7f094e974b80 1 Processor -- start 2024-05-08T05:57:10.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.851+0000 7f094e974b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603bab65060 0x5603bab70f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:10.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.851+0000 7f094e974b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5603bab65980 0x5603bab6e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:10.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.851+0000 7f094e974b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603bab699d0 0x5603bab6e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:10.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.851+0000 7f094e974b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5603bab7a390 con 0x5603bab65980 2024-05-08T05:57:10.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.851+0000 7f094e974b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5603baa1db20 con 0x5603bab699d0 2024-05-08T05:57:10.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.851+0000 7f094e974b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5603bab7a510 con 0x5603bab65060 2024-05-08T05:57:10.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.851+0000 7f094e974b80 10 client.0 _ll_register_callbacks cb 0x5603baa5ec70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:57:10.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.851+0000 7f0940c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5603bab65980 0x5603bab6e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:10.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.851+0000 7f0940c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5603bab65980 0x5603bab6e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39572/0 (socket says 172.21.15.82:39572) 2024-05-08T05:57:10.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.851+0000 7f0940c00700 1 -- 172.21.15.82:0/1278462104 learned_addr learned my addr 172.21.15.82:0/1278462104 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:57:10.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.852+0000 7f0942000700 1 --2- 172.21.15.82:0/1278462104 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603bab699d0 0x5603bab6e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:10.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.852+0000 7f0941600700 1 --2- 172.21.15.82:0/1278462104 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603bab65060 0x5603bab70f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:10.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.852+0000 7f0940c00700 1 -- 172.21.15.82:0/1278462104 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603bab65060 msgr2=0x5603bab70f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:57:10.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.852+0000 7f0940c00700 1 --2- 172.21.15.82:0/1278462104 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603bab65060 0x5603bab70f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:10.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.852+0000 7f0940c00700 1 -- 172.21.15.82:0/1278462104 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603bab699d0 msgr2=0x5603bab6e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:57:10.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.852+0000 7f0940c00700 1 --2- 172.21.15.82:0/1278462104 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603bab699d0 0x5603bab6e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:10.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.852+0000 7f0940c00700 1 -- 172.21.15.82:0/1278462104 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603baa7d420 con 0x5603bab65980 2024-05-08T05:57:10.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.852+0000 7f0941600700 1 --2- 172.21.15.82:0/1278462104 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603bab65060 0x5603bab70f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:57:10.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.852+0000 7f0942000700 1 --2- 172.21.15.82:0/1278462104 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603bab699d0 0x5603bab6e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:57:10.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.852+0000 7f0940c00700 1 --2- 172.21.15.82:0/1278462104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5603bab65980 0x5603bab6e310 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0928012040 tx=0x7f0928004f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84b191b938e81e21 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:57:10.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.852+0000 7f0923400700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T05:57:10.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.852+0000 7f0923400700 1 -- 172.21.15.82:0/1278462104 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09280c7020 con 0x5603bab65980 2024-05-08T05:57:10.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.852+0000 7f0923400700 1 -- 172.21.15.82:0/1278462104 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f09280a97d0 con 0x5603bab65980 2024-05-08T05:57:10.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.853+0000 7f094e974b80 1 -- 172.21.15.82:0/1278462104 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f09280ad920 con 0x5603bab65980 2024-05-08T05:57:10.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.853+0000 7f0923400700 1 -- 172.21.15.82:0/1278462104 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f09280c3e60 con 0x5603bab65980 2024-05-08T05:57:10.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.853+0000 7f094e974b80 10 client.15621 fetch_fsmap learned FSMap version 31 2024-05-08T05:57:10.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.853+0000 7f094e974b80 1 -- 172.21.15.82:0/1278462104 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5603bab84d40 con 0x5603bab65980 2024-05-08T05:57:10.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.854+0000 7f0923400700 1 -- 172.21.15.82:0/1278462104 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f09280ad920 con 0x5603bab65980 2024-05-08T05:57:10.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.854+0000 7f0923400700 1 -- 172.21.15.82:0/1278462104 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f092800fcd0 con 0x5603bab65980 2024-05-08T05:57:10.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.854+0000 7f094e974b80 10 client.15621 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:57:10.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.854+0000 7f094e974b80 10 client.15621 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-05-08T05:57:10.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.854+0000 7f094e974b80 20 client.15621 populate_metadata read hostname 'smithi082' 2024-05-08T05:57:10.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.854+0000 7f094e974b80 1 --2- 172.21.15.82:0/1278462104 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x5603bab87210 0x5603bab89600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:10.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.854+0000 7f094e974b80 4 client.15621 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:57:10.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.854+0000 7f094e974b80 1 -- 172.21.15.82:0/1278462104 --> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5603bab320a0 con 0x5603bab87210 2024-05-08T05:57:10.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.855+0000 7f0941600700 1 --2- 172.21.15.82:0/1278462104 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x5603bab87210 0x5603bab89600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:10.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.856+0000 7f0941600700 1 --2- 172.21.15.82:0/1278462104 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x5603bab87210 0x5603bab89600 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e34a0b179717f692 server_cookie=12d29fd0b8aa7a60 in_seq=0 out_seq=0 2024-05-08T05:57:10.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.856+0000 7f0923400700 10 client.15621 ms_handle_connect on v2:172.21.15.151:6834/2093655929 2024-05-08T05:57:10.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.857+0000 7f0923400700 1 -- 172.21.15.82:0/1278462104 <== mds.3 v2:172.21.15.151:6834/2093655929 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5603bab320a0 con 0x5603bab87210 2024-05-08T05:57:10.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.857+0000 7f0923400700 10 client.15621 handle_command_reply: tid=0 2024-05-08T05:57:10.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.857+0000 7f094e974b80 1 client.15621 shutdown 2024-05-08T05:57:10.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.858+0000 7f094e974b80 1 -- 172.21.15.82:0/1278462104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5603bab65980 msgr2=0x5603bab6e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:10.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.858+0000 7f094e974b80 1 --2- 172.21.15.82:0/1278462104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5603bab65980 0x5603bab6e310 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0928012040 tx=0x7f0928004f10 comp rx=0 tx=0).stop 2024-05-08T05:57:10.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.858+0000 7f094e974b80 1 -- 172.21.15.82:0/1278462104 shutdown_connections 2024-05-08T05:57:10.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.858+0000 7f094e974b80 1 --2- 172.21.15.82:0/1278462104 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x5603bab87210 0x5603bab89600 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:10.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.858+0000 7f094e974b80 1 --2- 172.21.15.82:0/1278462104 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603bab699d0 0x5603bab6e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:10.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.858+0000 7f094e974b80 1 --2- 172.21.15.82:0/1278462104 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603bab65060 0x5603bab70f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:10.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.858+0000 7f094e974b80 1 --2- 172.21.15.82:0/1278462104 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5603bab65980 0x5603bab6e310 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:10.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.858+0000 7f094e974b80 1 -- 172.21.15.82:0/1278462104 >> 172.21.15.82:0/1278462104 conn(0x5603baa93b60 msgr2=0x5603bab5a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:57:10.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.858+0000 7f0923400700 0 client.15621 ms_handle_reset on v2:172.21.15.151:6834/2093655929 2024-05-08T05:57:10.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.858+0000 7f094e974b80 1 -- 172.21.15.82:0/1278462104 shutdown_connections 2024-05-08T05:57:10.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.858+0000 7f094e974b80 1 -- 172.21.15.82:0/1278462104 wait complete. 2024-05-08T05:57:10.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.858+0000 7f094e974b80 20 client.15621 trim_cache size 0 max 16384 2024-05-08T05:57:10.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.884+0000 7f094e974b80 1 Processor -- start 2024-05-08T05:57:10.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.884+0000 7f094e974b80 1 -- start start 2024-05-08T05:57:10.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.884+0000 7f094e974b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5603bab65060 0x5603bab5a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:10.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.884+0000 7f094e974b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603bab65980 0x5603bab63e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:10.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.884+0000 7f094e974b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603bab699d0 0x5603bab643b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:10.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.884+0000 7f094e974b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f093c1aba30 con 0x5603bab65060 2024-05-08T05:57:10.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.884+0000 7f094e974b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f093c1ad570 con 0x5603bab65980 2024-05-08T05:57:10.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.885+0000 7f094e974b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f093c1ac100 con 0x5603bab699d0 2024-05-08T05:57:10.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.886+0000 7f0942000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603bab699d0 0x5603bab643b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:10.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.886+0000 7f0942000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603bab699d0 0x5603bab643b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:33918/0 (socket says 172.21.15.82:33918) 2024-05-08T05:57:10.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.886+0000 7f0942000700 1 -- 172.21.15.82:0/2591179931 learned_addr learned my addr 172.21.15.82:0/2591179931 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:57:10.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.887+0000 7f0940c00700 1 --2- 172.21.15.82:0/2591179931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603bab65980 0x5603bab63e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:10.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.887+0000 7f0942000700 1 -- 172.21.15.82:0/2591179931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603bab65980 msgr2=0x5603bab63e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:57:10.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.887+0000 7f0942000700 1 --2- 172.21.15.82:0/2591179931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603bab65980 0x5603bab63e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:10.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.887+0000 7f0942000700 1 -- 172.21.15.82:0/2591179931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5603bab65060 msgr2=0x5603bab5a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:57:10.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.887+0000 7f0942000700 1 --2- 172.21.15.82:0/2591179931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5603bab65060 0x5603bab5a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:10.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.887+0000 7f0942000700 1 -- 172.21.15.82:0/2591179931 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603bab6c860 con 0x5603bab699d0 2024-05-08T05:57:10.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.887+0000 7f0942000700 1 --2- 172.21.15.82:0/2591179931 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603bab699d0 0x5603bab643b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0934004d10 tx=0x7f0934015000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfd6ddbb87967061 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:57:10.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.888+0000 7f092e000700 1 -- 172.21.15.82:0/2591179931 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0934004d40 con 0x5603bab699d0 2024-05-08T05:57:10.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.888+0000 7f092e000700 1 -- 172.21.15.82:0/2591179931 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f093401e050 con 0x5603bab699d0 2024-05-08T05:57:10.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.888+0000 7f092e000700 1 -- 172.21.15.82:0/2591179931 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0934004520 con 0x5603bab699d0 2024-05-08T05:57:10.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.889+0000 7f094e974b80 1 -- 172.21.15.82:0/2591179931 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603bab699d0 msgr2=0x5603bab643b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:10.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.889+0000 7f094e974b80 1 --2- 172.21.15.82:0/2591179931 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603bab699d0 0x5603bab643b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0934004d10 tx=0x7f0934015000 comp rx=0 tx=0).stop 2024-05-08T05:57:10.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.889+0000 7f094e974b80 1 -- 172.21.15.82:0/2591179931 shutdown_connections 2024-05-08T05:57:10.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.889+0000 7f094e974b80 1 --2- 172.21.15.82:0/2591179931 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603bab699d0 0x5603bab643b0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:10.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.889+0000 7f094e974b80 1 --2- 172.21.15.82:0/2591179931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5603bab65060 0x5603bab5a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:10.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.889+0000 7f094e974b80 1 --2- 172.21.15.82:0/2591179931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603bab65980 0x5603bab63e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:10.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.889+0000 7f094e974b80 1 -- 172.21.15.82:0/2591179931 >> 172.21.15.82:0/2591179931 conn(0x5603baa93b60 msgr2=0x5603bab59a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:57:10.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.890+0000 7f094e974b80 1 -- 172.21.15.82:0/2591179931 shutdown_connections 2024-05-08T05:57:10.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.890+0000 7f094e974b80 1 -- 172.21.15.82:0/2591179931 wait complete. 2024-05-08T05:57:10.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.890+0000 7f094e974b80 1 -- start start 2024-05-08T05:57:10.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.891+0000 7f094e974b80 1 Processor -- start 2024-05-08T05:57:10.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.892+0000 7f094e974b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603bab65060 0x5603bab8c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:10.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.892+0000 7f094e974b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5603bab65980 0x5603bab875f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:10.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.892+0000 7f094e974b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603bab699d0 0x5603bab87b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:10.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.892+0000 7f094e974b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f093c1acea0 con 0x5603bab65980 2024-05-08T05:57:10.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.892+0000 7f094e974b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f093c1ac7d0 con 0x5603bab699d0 2024-05-08T05:57:10.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.892+0000 7f094e974b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f093c07b930 con 0x5603bab65060 2024-05-08T05:57:10.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.892+0000 7f0940c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5603bab65980 0x5603bab875f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:10.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.892+0000 7f094e974b80 10 client.0 _ll_register_callbacks cb 0x5603baa5ec70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:57:10.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.892+0000 7f0940c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5603bab65980 0x5603bab875f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39592/0 (socket says 172.21.15.82:39592) 2024-05-08T05:57:10.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.893+0000 7f0940c00700 1 -- 172.21.15.82:0/155704909 learned_addr learned my addr 172.21.15.82:0/155704909 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:57:10.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.893+0000 7f0942000700 1 --2- 172.21.15.82:0/155704909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603bab699d0 0x5603bab87b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:10.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.893+0000 7f0940c00700 1 -- 172.21.15.82:0/155704909 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603bab65060 msgr2=0x5603bab8c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:57:10.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.893+0000 7f0940c00700 1 --2- 172.21.15.82:0/155704909 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603bab65060 0x5603bab8c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:10.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.893+0000 7f0940c00700 1 -- 172.21.15.82:0/155704909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603bab699d0 msgr2=0x5603bab87b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:57:10.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.893+0000 7f0940c00700 1 --2- 172.21.15.82:0/155704909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603bab699d0 0x5603bab87b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:10.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.893+0000 7f0940c00700 1 -- 172.21.15.82:0/155704909 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603bab88070 con 0x5603bab65980 2024-05-08T05:57:10.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.894+0000 7f0940c00700 1 --2- 172.21.15.82:0/155704909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5603bab65980 0x5603bab875f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f09280ca400 tx=0x7f0928000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=464d5343e3f6eab8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:57:10.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.894+0000 7f0923400700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T05:57:10.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.897+0000 7f0923400700 1 -- 172.21.15.82:0/155704909 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09280c7070 con 0x5603bab65980 2024-05-08T05:57:10.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.897+0000 7f094e974b80 1 -- 172.21.15.82:0/155704909 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f093401e050 con 0x5603bab65980 2024-05-08T05:57:10.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.897+0000 7f0923400700 1 -- 172.21.15.82:0/155704909 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f09280b2150 con 0x5603bab65980 2024-05-08T05:57:10.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.898+0000 7f0923400700 1 -- 172.21.15.82:0/155704909 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f09280ad920 con 0x5603bab65980 2024-05-08T05:57:10.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.898+0000 7f094e974b80 10 client.15624 fetch_fsmap learned FSMap version 31 2024-05-08T05:57:10.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.898+0000 7f094e974b80 1 -- 172.21.15.82:0/155704909 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5603bab785e0 con 0x5603bab65980 2024-05-08T05:57:10.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.904+0000 7f0923400700 1 -- 172.21.15.82:0/155704909 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f093401e050 con 0x5603bab65980 2024-05-08T05:57:10.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.904+0000 7f0923400700 1 -- 172.21.15.82:0/155704909 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f09280a4ee0 con 0x5603bab65980 2024-05-08T05:57:10.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.905+0000 7f094e974b80 10 client.15624 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:57:10.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.905+0000 7f094e974b80 10 client.15624 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-05-08T05:57:10.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.905+0000 7f094e974b80 20 client.15624 populate_metadata read hostname 'smithi082' 2024-05-08T05:57:10.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.905+0000 7f094e974b80 1 --2- 172.21.15.82:0/155704909 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x5603bab78b90 0x5603bab78fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:10.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.905+0000 7f094e974b80 4 client.15624 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:57:10.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.905+0000 7f094e974b80 1 -- 172.21.15.82:0/155704909 --> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5603baac5400 con 0x5603bab78b90 2024-05-08T05:57:10.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.905+0000 7f0941600700 1 --2- 172.21.15.82:0/155704909 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x5603bab78b90 0x5603bab78fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:10.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.906+0000 7f0941600700 1 --2- 172.21.15.82:0/155704909 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x5603bab78b90 0x5603bab78fa0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=672ffdd262c386ca server_cookie=94e5b4f9960460e5 in_seq=0 out_seq=0 2024-05-08T05:57:10.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.906+0000 7f0923400700 10 client.15624 ms_handle_connect on v2:172.21.15.151:6834/2093655929 2024-05-08T05:57:10.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.906+0000 7f0923400700 1 -- 172.21.15.82:0/155704909 <== mds.3 v2:172.21.15.151:6834/2093655929 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5603baac5400 con 0x5603bab78b90 2024-05-08T05:57:10.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.906+0000 7f0923400700 10 client.15624 handle_command_reply: tid=0 2024-05-08T05:57:10.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.906+0000 7f094e974b80 1 client.15624 shutdown 2024-05-08T05:57:10.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.907+0000 7f094e974b80 1 -- 172.21.15.82:0/155704909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5603bab65980 msgr2=0x5603bab875f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:10.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.907+0000 7f094e974b80 1 --2- 172.21.15.82:0/155704909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5603bab65980 0x5603bab875f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f09280ca400 tx=0x7f0928000bc0 comp rx=0 tx=0).stop 2024-05-08T05:57:10.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.908+0000 7f094e974b80 1 -- 172.21.15.82:0/155704909 shutdown_connections 2024-05-08T05:57:10.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.908+0000 7f094e974b80 1 --2- 172.21.15.82:0/155704909 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x5603bab78b90 0x5603bab78fa0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:10.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.908+0000 7f094e974b80 1 --2- 172.21.15.82:0/155704909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5603bab699d0 0x5603bab87b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:10.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.908+0000 7f094e974b80 1 --2- 172.21.15.82:0/155704909 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5603bab65060 0x5603bab8c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:10.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.908+0000 7f0923400700 0 client.15624 ms_handle_reset on v2:172.21.15.151:6834/2093655929 2024-05-08T05:57:10.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.908+0000 7f094e974b80 1 --2- 172.21.15.82:0/155704909 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5603bab65980 0x5603bab875f0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:10.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.908+0000 7f094e974b80 1 -- 172.21.15.82:0/155704909 >> 172.21.15.82:0/155704909 conn(0x5603baa93b60 msgr2=0x5603bab5a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:57:10.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.908+0000 7f094e974b80 1 -- 172.21.15.82:0/155704909 shutdown_connections 2024-05-08T05:57:10.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.909+0000 7f094e974b80 1 -- 172.21.15.82:0/155704909 wait complete. 2024-05-08T05:57:10.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.909+0000 7f094e974b80 20 client.15624 trim_cache size 0 max 16384 2024-05-08T05:57:10.910 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T05:57:10.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.910+0000 7f0944000700 1 -- 172.21.15.82:0/2383508636 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f09240b2980 msgr2=0x7f09240b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:10.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.910+0000 7f0944000700 1 --2- 172.21.15.82:0/2383508636 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f09240b2980 0x7f09240b4e40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f0934009550 tx=0x7f093400b040 comp rx=0 tx=0).stop 2024-05-08T05:57:10.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.910+0000 7f0944000700 1 -- 172.21.15.82:0/2383508636 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f093c1060a0 msgr2=0x7f093c19c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:10.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.910+0000 7f0944000700 1 --2- 172.21.15.82:0/2383508636 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f093c1060a0 0x7f093c19c310 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f092800d980 tx=0x7f092800dc90 comp rx=0 tx=0).stop 2024-05-08T05:57:10.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.910+0000 7f0944000700 1 -- 172.21.15.82:0/2383508636 shutdown_connections 2024-05-08T05:57:10.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.910+0000 7f0944000700 1 --2- 172.21.15.82:0/2383508636 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f093c1056e0 0x7f093c19bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:10.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.910+0000 7f0944000700 1 --2- 172.21.15.82:0/2383508636 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f09240b2980 0x7f09240b4e40 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:10.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.910+0000 7f0944000700 1 --2- 172.21.15.82:0/2383508636 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f093c10b6e0 0x7f093c1a06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:10.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.910+0000 7f0944000700 1 --2- 172.21.15.82:0/2383508636 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f093c1060a0 0x7f093c19c310 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:10.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.910+0000 7f0944000700 1 -- 172.21.15.82:0/2383508636 >> 172.21.15.82:0/2383508636 conn(0x7f093c1011d0 msgr2=0x7f093c101920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:57:10.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.913+0000 7f0944000700 1 -- 172.21.15.82:0/2383508636 shutdown_connections 2024-05-08T05:57:10.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:10.913+0000 7f0944000700 1 -- 172.21.15.82:0/2383508636 wait complete. 2024-05-08T05:57:11.817 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-05-08T05:57:12.322 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:57:12.383 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:57:12 smithi151 ceph-mon[34815]: pgmap v655: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 MiB/s wr, 705 op/s 2024-05-08T05:57:12.472 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:57:12 smithi082 ceph-mon[30098]: pgmap v655: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 MiB/s wr, 705 op/s 2024-05-08T05:57:12.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:57:12 smithi134 ceph-mon[34132]: pgmap v655: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 MiB/s wr, 705 op/s 2024-05-08T05:57:14.318 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:57:14 smithi082 ceph-mon[30098]: pgmap v656: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 7.3 MiB/s wr, 699 op/s 2024-05-08T05:57:14.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:57:14 smithi151 ceph-mon[34815]: pgmap v656: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 7.3 MiB/s wr, 699 op/s 2024-05-08T05:57:14.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:57:14 smithi134 ceph-mon[34132]: pgmap v656: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 7.3 MiB/s wr, 699 op/s 2024-05-08T05:57:14.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.655+0000 7f0641200700 1 -- 172.21.15.82:0/2926520669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f063c109510 msgr2=0x7f063c1098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:14.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.655+0000 7f0641200700 1 --2- 172.21.15.82:0/2926520669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f063c109510 0x7f063c1098f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f062c0098f0 tx=0x7f062c009c00 comp rx=0 tx=0).stop 2024-05-08T05:57:14.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.655+0000 7f0641200700 1 -- 172.21.15.82:0/2926520669 shutdown_connections 2024-05-08T05:57:14.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.655+0000 7f0641200700 1 --2- 172.21.15.82:0/2926520669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f063c109510 0x7f063c1098f0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:14.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.655+0000 7f0641200700 1 --2- 172.21.15.82:0/2926520669 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f063c06bb40 0x7f063c110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:14.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.655+0000 7f0641200700 1 --2- 172.21.15.82:0/2926520669 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f063c06b180 0x7f063c06b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:14.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.655+0000 7f0641200700 1 -- 172.21.15.82:0/2926520669 >> 172.21.15.82:0/2926520669 conn(0x7f063c079350 msgr2=0x7f063c079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:57:14.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.655+0000 7f0641200700 1 -- 172.21.15.82:0/2926520669 shutdown_connections 2024-05-08T05:57:14.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.655+0000 7f0641200700 1 -- 172.21.15.82:0/2926520669 wait complete. 2024-05-08T05:57:14.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.656+0000 7f0641200700 1 Processor -- start 2024-05-08T05:57:14.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.657+0000 7f0641200700 1 -- start start 2024-05-08T05:57:14.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.657+0000 7f0641200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f063c06b180 0x7f063c074d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:14.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.657+0000 7f0641200700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f063c06bb40 0x7f063c06de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:14.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.657+0000 7f0641200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f063c109510 0x7f063c06e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:14.659 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.658+0000 7f0639e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f063c06b180 0x7f063c074d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:14.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.658+0000 7f0639e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f063c06b180 0x7f063c074d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44906/0 (socket says 172.21.15.82:44906) 2024-05-08T05:57:14.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.658+0000 7f0639e00700 1 -- 172.21.15.82:0/3743822541 learned_addr learned my addr 172.21.15.82:0/3743822541 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:57:14.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.658+0000 7f0641200700 1 -- 172.21.15.82:0/3743822541 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f063c113690 con 0x7f063c06b180 2024-05-08T05:57:14.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.658+0000 7f063a800700 1 --2- 172.21.15.82:0/3743822541 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f063c109510 0x7f063c06e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:14.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.658+0000 7f0641200700 1 -- 172.21.15.82:0/3743822541 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f063c113510 con 0x7f063c109510 2024-05-08T05:57:14.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.658+0000 7f0641200700 1 -- 172.21.15.82:0/3743822541 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f063c113810 con 0x7f063c06bb40 2024-05-08T05:57:14.660 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.658+0000 7f0639400700 1 --2- 172.21.15.82:0/3743822541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f063c06bb40 0x7f063c06de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:14.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.659+0000 7f063a800700 1 -- 172.21.15.82:0/3743822541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f063c06bb40 msgr2=0x7f063c06de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:14.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.659+0000 7f063a800700 1 --2- 172.21.15.82:0/3743822541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f063c06bb40 0x7f063c06de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:14.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.659+0000 7f063a800700 1 -- 172.21.15.82:0/3743822541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f063c06b180 msgr2=0x7f063c074d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:14.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.659+0000 7f063a800700 1 --2- 172.21.15.82:0/3743822541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f063c06b180 0x7f063c074d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:14.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.659+0000 7f063a800700 1 -- 172.21.15.82:0/3743822541 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f063c06ea60 con 0x7f063c109510 2024-05-08T05:57:14.661 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.659+0000 7f063a800700 1 --2- 172.21.15.82:0/3743822541 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f063c109510 0x7f063c06e360 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f063400efc0 tx=0x7f063400c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:57:14.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.660+0000 7f0632a00700 1 -- 172.21.15.82:0/3743822541 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06340092e0 con 0x7f063c109510 2024-05-08T05:57:14.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.660+0000 7f0632a00700 1 -- 172.21.15.82:0/3743822541 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0634004bb0 con 0x7f063c109510 2024-05-08T05:57:14.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.660+0000 7f0632a00700 1 -- 172.21.15.82:0/3743822541 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0634004080 con 0x7f063c109510 2024-05-08T05:57:14.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.660+0000 7f0641200700 1 -- 172.21.15.82:0/3743822541 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f063c0728c0 con 0x7f063c109510 2024-05-08T05:57:14.662 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.660+0000 7f0641200700 1 -- 172.21.15.82:0/3743822541 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f063c072db0 con 0x7f063c109510 2024-05-08T05:57:14.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.665+0000 7f0632a00700 1 -- 172.21.15.82:0/3743822541 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f063401b030 con 0x7f063c109510 2024-05-08T05:57:14.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.667+0000 7f064ba96b80 1 Processor -- start 2024-05-08T05:57:14.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.667+0000 7f0632a00700 1 --2- 172.21.15.82:0/3743822541 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f06200b2a50 0x7f06200b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:14.668 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.667+0000 7f064ba96b80 1 -- start start 2024-05-08T05:57:14.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.667+0000 7f0632a00700 1 -- 172.21.15.82:0/3743822541 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f06340e1b90 con 0x7f063c109510 2024-05-08T05:57:14.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.667+0000 7f0639400700 1 --2- 172.21.15.82:0/3743822541 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f06200b2a50 0x7f06200b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:14.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.667+0000 7f064ba96b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a43ebe0bc0 0x55a43ebe0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:14.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.667+0000 7f064ba96b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a43ebe14e0 0x55a43ebdb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:14.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.667+0000 7f064ba96b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a43ebdb8f0 0x55a43ebdbd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:14.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.668+0000 7f064ba96b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a43eb2da20 con 0x55a43ebe0bc0 2024-05-08T05:57:14.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.668+0000 7f064ba96b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a43eacb760 con 0x55a43ebe14e0 2024-05-08T05:57:14.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.668+0000 7f064ba96b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55a43eb299e0 con 0x55a43ebdb8f0 2024-05-08T05:57:14.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.668+0000 7f0639400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a43ebe14e0 0x55a43ebdb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:14.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.668+0000 7f0639400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a43ebe14e0 0x55a43ebdb2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:54770/0 (socket says 172.21.15.82:54770) 2024-05-08T05:57:14.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.668+0000 7f0639400700 1 -- 172.21.15.82:0/2643739442 learned_addr learned my addr 172.21.15.82:0/2643739442 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:57:14.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.668+0000 7f0639400700 1 --2- 172.21.15.82:0/3743822541 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f06200b2a50 0x7f06200b4f10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0628009750 tx=0x7f0628009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:57:14.669 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.668+0000 7f063a800700 1 --2- 172.21.15.82:0/2643739442 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a43ebdb8f0 0x55a43ebdbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:14.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.668+0000 7f0639e00700 1 --2- 172.21.15.82:0/2643739442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a43ebe0bc0 0x55a43ebe0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:14.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.668+0000 7f0639400700 1 -- 172.21.15.82:0/2643739442 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a43ebdb8f0 msgr2=0x55a43ebdbd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:57:14.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.668+0000 7f0639400700 1 --2- 172.21.15.82:0/2643739442 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a43ebdb8f0 0x55a43ebdbd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:14.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.668+0000 7f0639400700 1 -- 172.21.15.82:0/2643739442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a43ebe0bc0 msgr2=0x55a43ebe0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:57:14.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.668+0000 7f0639400700 1 --2- 172.21.15.82:0/2643739442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a43ebe0bc0 0x55a43ebe0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:14.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.668+0000 7f0639400700 1 -- 172.21.15.82:0/2643739442 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a43ea7a8d0 con 0x55a43ebe14e0 2024-05-08T05:57:14.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.668+0000 7f063a800700 1 --2- 172.21.15.82:0/2643739442 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a43ebdb8f0 0x55a43ebdbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:57:14.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.668+0000 7f0639e00700 1 --2- 172.21.15.82:0/2643739442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a43ebe0bc0 0x55a43ebe0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:57:14.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.669+0000 7f0639400700 1 --2- 172.21.15.82:0/2643739442 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a43ebe14e0 0x55a43ebdb2d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0628011f80 tx=0x7f0628014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37d8d4d41996bddd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:57:14.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.669+0000 7f0627400700 1 -- 172.21.15.82:0/2643739442 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f062801f420 con 0x55a43ebe14e0 2024-05-08T05:57:14.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.669+0000 7f0627400700 1 -- 172.21.15.82:0/2643739442 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f062801fa70 con 0x55a43ebe14e0 2024-05-08T05:57:14.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.669+0000 7f0627400700 1 -- 172.21.15.82:0/2643739442 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0628027850 con 0x55a43ebe14e0 2024-05-08T05:57:14.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.670+0000 7f064ba96b80 1 -- 172.21.15.82:0/2643739442 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a43ebe14e0 msgr2=0x55a43ebdb2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:14.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.670+0000 7f064ba96b80 1 --2- 172.21.15.82:0/2643739442 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a43ebe14e0 0x55a43ebdb2d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0628011f80 tx=0x7f0628014000 comp rx=0 tx=0).stop 2024-05-08T05:57:14.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.670+0000 7f064ba96b80 1 -- 172.21.15.82:0/2643739442 shutdown_connections 2024-05-08T05:57:14.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.670+0000 7f064ba96b80 1 --2- 172.21.15.82:0/2643739442 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a43ebdb8f0 0x55a43ebdbd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:14.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.670+0000 7f064ba96b80 1 --2- 172.21.15.82:0/2643739442 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a43ebe0bc0 0x55a43ebe0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:14.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.670+0000 7f064ba96b80 1 --2- 172.21.15.82:0/2643739442 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a43ebe14e0 0x55a43ebdb2d0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:14.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.670+0000 7f064ba96b80 1 -- 172.21.15.82:0/2643739442 >> 172.21.15.82:0/2643739442 conn(0x55a43eb536d0 msgr2=0x55a43ebd5b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:57:14.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.670+0000 7f064ba96b80 1 -- 172.21.15.82:0/2643739442 shutdown_connections 2024-05-08T05:57:14.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.670+0000 7f064ba96b80 1 -- 172.21.15.82:0/2643739442 wait complete. 2024-05-08T05:57:14.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.671+0000 7f064ba96b80 1 -- start start 2024-05-08T05:57:14.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.671+0000 7f064ba96b80 1 Processor -- start 2024-05-08T05:57:14.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.672+0000 7f064ba96b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a43ebdb8f0 0x55a43ebe7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:14.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.672+0000 7f064ba96b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a43ebe0bc0 0x55a43ebe4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:14.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.672+0000 7f064ba96b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a43ebe14e0 0x55a43ebe4960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:14.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.672+0000 7f064ba96b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a43ebe7f20 con 0x55a43ebe0bc0 2024-05-08T05:57:14.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.672+0000 7f064ba96b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a43ea93b20 con 0x55a43ebdb8f0 2024-05-08T05:57:14.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.672+0000 7f064ba96b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55a43ebe80a0 con 0x55a43ebe14e0 2024-05-08T05:57:14.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.672+0000 7f064ba96b80 10 client.0 _ll_register_callbacks cb 0x55a43ead4c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:57:14.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.673+0000 7f0639e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a43ebdb8f0 0x55a43ebe7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:14.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.673+0000 7f0639e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a43ebdb8f0 0x55a43ebe7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:54784/0 (socket says 172.21.15.82:54784) 2024-05-08T05:57:14.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.673+0000 7f0639e00700 1 -- 172.21.15.82:0/2922546405 learned_addr learned my addr 172.21.15.82:0/2922546405 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:57:14.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.673+0000 7f0639400700 1 --2- 172.21.15.82:0/2922546405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a43ebe0bc0 0x55a43ebe4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:14.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.674+0000 7f063a800700 1 --2- 172.21.15.82:0/2922546405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a43ebe14e0 0x55a43ebe4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:14.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.674+0000 7f0639e00700 1 -- 172.21.15.82:0/2922546405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a43ebe14e0 msgr2=0x55a43ebe4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:57:14.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.674+0000 7f0639e00700 1 --2- 172.21.15.82:0/2922546405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a43ebe14e0 0x55a43ebe4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:14.676 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.674+0000 7f0639e00700 1 -- 172.21.15.82:0/2922546405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a43ebe0bc0 msgr2=0x55a43ebe4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:57:14.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.674+0000 7f0639e00700 1 --2- 172.21.15.82:0/2922546405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a43ebe0bc0 0x55a43ebe4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:14.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.674+0000 7f0639e00700 1 -- 172.21.15.82:0/2922546405 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a43eaf3420 con 0x55a43ebdb8f0 2024-05-08T05:57:14.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.674+0000 7f063a800700 1 --2- 172.21.15.82:0/2922546405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a43ebe14e0 0x55a43ebe4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:57:14.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.674+0000 7f0639400700 1 --2- 172.21.15.82:0/2922546405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a43ebe0bc0 0x55a43ebe4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:57:14.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.675+0000 7f0639e00700 1 --2- 172.21.15.82:0/2922546405 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a43ebdb8f0 0x55a43ebe7080 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f062c00ffd0 tx=0x7f062c00f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be456f93882dcd25 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:57:14.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.675+0000 7f061be00700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:57:14.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.675+0000 7f061be00700 1 -- 172.21.15.82:0/2922546405 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f062c026060 con 0x55a43ebdb8f0 2024-05-08T05:57:14.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.675+0000 7f061be00700 1 -- 172.21.15.82:0/2922546405 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f062c005240 con 0x55a43ebdb8f0 2024-05-08T05:57:14.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.675+0000 7f064ba96b80 1 -- 172.21.15.82:0/2922546405 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f062801fa70 con 0x55a43ebdb8f0 2024-05-08T05:57:14.677 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.676+0000 7f061be00700 1 -- 172.21.15.82:0/2922546405 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f062c005440 con 0x55a43ebdb8f0 2024-05-08T05:57:14.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.676+0000 7f064ba96b80 10 client.25892 fetch_fsmap learned FSMap version 31 2024-05-08T05:57:14.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.676+0000 7f064ba96b80 1 -- 172.21.15.82:0/2922546405 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a43ebe83d0 con 0x55a43ebdb8f0 2024-05-08T05:57:14.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.676+0000 7f061be00700 1 -- 172.21.15.82:0/2922546405 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f062801fa70 con 0x55a43ebdb8f0 2024-05-08T05:57:14.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.677+0000 7f061be00700 1 -- 172.21.15.82:0/2922546405 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f062c020070 con 0x55a43ebdb8f0 2024-05-08T05:57:14.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.677+0000 7f064ba96b80 10 client.25892 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:57:14.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.677+0000 7f064ba96b80 10 client.25892 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-05-08T05:57:14.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.677+0000 7f064ba96b80 20 client.25892 populate_metadata read hostname 'smithi082' 2024-05-08T05:57:14.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.677+0000 7f064ba96b80 1 --2- 172.21.15.82:0/2922546405 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55a43ebeaa10 0x55a43ebeae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:14.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.677+0000 7f064ba96b80 4 client.25892 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:57:14.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.677+0000 7f064ba96b80 1 -- 172.21.15.82:0/2922546405 --> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a43eba8140 con 0x55a43ebeaa10 2024-05-08T05:57:14.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.677+0000 7f0639400700 1 --2- 172.21.15.82:0/2922546405 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55a43ebeaa10 0x55a43ebeae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:14.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.678+0000 7f0639400700 1 --2- 172.21.15.82:0/2922546405 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55a43ebeaa10 0x55a43ebeae80 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cac639470c9f4402 server_cookie=be4394de14b9b42c in_seq=0 out_seq=0 2024-05-08T05:57:14.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.678+0000 7f061be00700 10 client.25892 ms_handle_connect on v2:172.21.15.151:6836/4192404464 2024-05-08T05:57:14.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.679+0000 7f061be00700 1 -- 172.21.15.82:0/2922546405 <== mds.2 v2:172.21.15.151:6836/4192404464 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a43eba8140 con 0x55a43ebeaa10 2024-05-08T05:57:14.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.679+0000 7f061be00700 10 client.25892 handle_command_reply: tid=0 2024-05-08T05:57:14.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.679+0000 7f064ba96b80 1 client.25892 shutdown 2024-05-08T05:57:14.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.680+0000 7f064ba96b80 1 -- 172.21.15.82:0/2922546405 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a43ebdb8f0 msgr2=0x55a43ebe7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:14.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.680+0000 7f064ba96b80 1 --2- 172.21.15.82:0/2922546405 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a43ebdb8f0 0x55a43ebe7080 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f062c00ffd0 tx=0x7f062c00f690 comp rx=0 tx=0).stop 2024-05-08T05:57:14.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.680+0000 7f064ba96b80 1 -- 172.21.15.82:0/2922546405 shutdown_connections 2024-05-08T05:57:14.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.680+0000 7f064ba96b80 1 --2- 172.21.15.82:0/2922546405 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55a43ebeaa10 0x55a43ebeae80 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:14.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.680+0000 7f064ba96b80 1 --2- 172.21.15.82:0/2922546405 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a43ebdb8f0 0x55a43ebe7080 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:14.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.680+0000 7f064ba96b80 1 --2- 172.21.15.82:0/2922546405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a43ebe14e0 0x55a43ebe4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:14.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.680+0000 7f064ba96b80 1 --2- 172.21.15.82:0/2922546405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a43ebe0bc0 0x55a43ebe4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:14.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.680+0000 7f061be00700 0 client.25892 ms_handle_reset on v2:172.21.15.151:6836/4192404464 2024-05-08T05:57:14.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.680+0000 7f064ba96b80 1 -- 172.21.15.82:0/2922546405 >> 172.21.15.82:0/2922546405 conn(0x55a43eb536d0 msgr2=0x55a43ebd5190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:57:14.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.681+0000 7f064ba96b80 1 -- 172.21.15.82:0/2922546405 shutdown_connections 2024-05-08T05:57:14.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.681+0000 7f064ba96b80 1 -- 172.21.15.82:0/2922546405 wait complete. 2024-05-08T05:57:14.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.682+0000 7f064ba96b80 20 client.25892 trim_cache size 0 max 16384 2024-05-08T05:57:14.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.703+0000 7f064ba96b80 1 Processor -- start 2024-05-08T05:57:14.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.703+0000 7f064ba96b80 1 -- start start 2024-05-08T05:57:14.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.703+0000 7f064ba96b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a43ebdb8f0 0x55a43ebdb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:14.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.703+0000 7f064ba96b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a43ebe0bc0 0x55a43ebe3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:14.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.703+0000 7f064ba96b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a43ebe14e0 0x55a43ebd5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:14.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.703+0000 7f064ba96b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f061c00d320 con 0x55a43ebdb8f0 2024-05-08T05:57:14.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.703+0000 7f064ba96b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f061c00ee60 con 0x55a43ebe14e0 2024-05-08T05:57:14.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.703+0000 7f064ba96b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f061c00d9f0 con 0x55a43ebe0bc0 2024-05-08T05:57:14.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.704+0000 7f0639e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a43ebdb8f0 0x55a43ebdb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:14.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.704+0000 7f063a800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a43ebe14e0 0x55a43ebd5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:14.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.704+0000 7f0639e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a43ebdb8f0 0x55a43ebdb2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44930/0 (socket says 172.21.15.82:44930) 2024-05-08T05:57:14.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.704+0000 7f0639e00700 1 -- 172.21.15.82:0/1387019394 learned_addr learned my addr 172.21.15.82:0/1387019394 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:57:14.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.704+0000 7f0639400700 1 --2- 172.21.15.82:0/1387019394 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a43ebe0bc0 0x55a43ebe3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:14.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.704+0000 7f063a800700 1 -- 172.21.15.82:0/1387019394 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a43ebe0bc0 msgr2=0x55a43ebe3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:57:14.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.704+0000 7f063a800700 1 --2- 172.21.15.82:0/1387019394 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a43ebe0bc0 0x55a43ebe3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:14.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.704+0000 7f063a800700 1 -- 172.21.15.82:0/1387019394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a43ebdb8f0 msgr2=0x55a43ebdb2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:57:14.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.704+0000 7f063a800700 1 --2- 172.21.15.82:0/1387019394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a43ebdb8f0 0x55a43ebdb2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:14.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.704+0000 7f063a800700 1 -- 172.21.15.82:0/1387019394 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a43ebd0ab0 con 0x55a43ebe14e0 2024-05-08T05:57:14.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.705+0000 7f063a800700 1 --2- 172.21.15.82:0/1387019394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a43ebe14e0 0x55a43ebd5910 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f06340df640 tx=0x7f0634004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcdb2a0c7de20025 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:57:14.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.705+0000 7f0626a00700 1 -- 172.21.15.82:0/1387019394 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06340a98f0 con 0x55a43ebe14e0 2024-05-08T05:57:14.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.705+0000 7f0626a00700 1 -- 172.21.15.82:0/1387019394 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06340a91f0 con 0x55a43ebe14e0 2024-05-08T05:57:14.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.705+0000 7f0626a00700 1 -- 172.21.15.82:0/1387019394 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06340ad3a0 con 0x55a43ebe14e0 2024-05-08T05:57:14.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.706+0000 7f064ba96b80 1 -- 172.21.15.82:0/1387019394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a43ebe14e0 msgr2=0x55a43ebd5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:14.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.706+0000 7f064ba96b80 1 --2- 172.21.15.82:0/1387019394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a43ebe14e0 0x55a43ebd5910 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f06340df640 tx=0x7f0634004ad0 comp rx=0 tx=0).stop 2024-05-08T05:57:14.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.706+0000 7f064ba96b80 1 -- 172.21.15.82:0/1387019394 shutdown_connections 2024-05-08T05:57:14.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.706+0000 7f064ba96b80 1 --2- 172.21.15.82:0/1387019394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a43ebe14e0 0x55a43ebd5910 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:14.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.706+0000 7f064ba96b80 1 --2- 172.21.15.82:0/1387019394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a43ebdb8f0 0x55a43ebdb2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:14.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.706+0000 7f064ba96b80 1 --2- 172.21.15.82:0/1387019394 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a43ebe0bc0 0x55a43ebe3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:14.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.706+0000 7f064ba96b80 1 -- 172.21.15.82:0/1387019394 >> 172.21.15.82:0/1387019394 conn(0x55a43eb536d0 msgr2=0x55a43ebe5a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:57:14.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.707+0000 7f064ba96b80 1 -- 172.21.15.82:0/1387019394 shutdown_connections 2024-05-08T05:57:14.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.707+0000 7f064ba96b80 1 -- 172.21.15.82:0/1387019394 wait complete. 2024-05-08T05:57:14.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.708+0000 7f064ba96b80 1 -- start start 2024-05-08T05:57:14.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.708+0000 7f064ba96b80 1 Processor -- start 2024-05-08T05:57:14.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.708+0000 7f064ba96b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a43ebdb8f0 0x55a43ec029f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:14.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.708+0000 7f064ba96b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a43ebe0bc0 0x55a43ec02f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:14.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.709+0000 7f064ba96b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a43ebe14e0 0x55a43ec5edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:14.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.709+0000 7f064ba96b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f061c00e790 con 0x55a43ebe0bc0 2024-05-08T05:57:14.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.709+0000 7f064ba96b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f061c00e0c0 con 0x55a43ebdb8f0 2024-05-08T05:57:14.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.709+0000 7f064ba96b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f061c00b2c0 con 0x55a43ebe14e0 2024-05-08T05:57:14.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.709+0000 7f064ba96b80 10 client.0 _ll_register_callbacks cb 0x55a43ead4c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:57:14.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.709+0000 7f0639e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a43ebdb8f0 0x55a43ec029f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:14.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.709+0000 7f0639e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a43ebdb8f0 0x55a43ec029f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:54800/0 (socket says 172.21.15.82:54800) 2024-05-08T05:57:14.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.709+0000 7f0639e00700 1 -- 172.21.15.82:0/3901362422 learned_addr learned my addr 172.21.15.82:0/3901362422 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:57:14.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.709+0000 7f063a800700 1 --2- 172.21.15.82:0/3901362422 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a43ebe14e0 0x55a43ec5edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:14.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.709+0000 7f0639400700 1 --2- 172.21.15.82:0/3901362422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a43ebe0bc0 0x55a43ec02f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:14.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.710+0000 7f0639e00700 1 -- 172.21.15.82:0/3901362422 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a43ebe14e0 msgr2=0x55a43ec5edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:57:14.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.710+0000 7f0639e00700 1 --2- 172.21.15.82:0/3901362422 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a43ebe14e0 0x55a43ec5edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:14.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.710+0000 7f0639e00700 1 -- 172.21.15.82:0/3901362422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a43ebe0bc0 msgr2=0x55a43ec02f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:57:14.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.710+0000 7f0639e00700 1 --2- 172.21.15.82:0/3901362422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a43ebe0bc0 0x55a43ec02f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:14.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.710+0000 7f0639e00700 1 -- 172.21.15.82:0/3901362422 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a43ec5f5e0 con 0x55a43ebdb8f0 2024-05-08T05:57:14.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.710+0000 7f0639400700 1 --2- 172.21.15.82:0/3901362422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a43ebe0bc0 0x55a43ec02f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:57:14.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.710+0000 7f0639e00700 1 --2- 172.21.15.82:0/3901362422 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a43ebdb8f0 0x55a43ec029f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f062c0095d0 tx=0x7f062c005810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5df42edc1c91c836 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:57:14.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.710+0000 7f061be00700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:57:14.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.710+0000 7f061be00700 1 -- 172.21.15.82:0/3901362422 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f062c031020 con 0x55a43ebdb8f0 2024-05-08T05:57:14.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.710+0000 7f061be00700 1 -- 172.21.15.82:0/3901362422 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f062c00bae0 con 0x55a43ebdb8f0 2024-05-08T05:57:14.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.710+0000 7f064ba96b80 1 -- 172.21.15.82:0/3901362422 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06340a91f0 con 0x55a43ebdb8f0 2024-05-08T05:57:14.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.711+0000 7f061be00700 1 -- 172.21.15.82:0/3901362422 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f062c026040 con 0x55a43ebdb8f0 2024-05-08T05:57:14.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.711+0000 7f064ba96b80 10 client.25898 fetch_fsmap learned FSMap version 31 2024-05-08T05:57:14.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.711+0000 7f064ba96b80 1 -- 172.21.15.82:0/3901362422 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a43ec67930 con 0x55a43ebdb8f0 2024-05-08T05:57:14.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.711+0000 7f061be00700 1 -- 172.21.15.82:0/3901362422 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f06340a91f0 con 0x55a43ebdb8f0 2024-05-08T05:57:14.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.711+0000 7f061be00700 1 -- 172.21.15.82:0/3901362422 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f062c020070 con 0x55a43ebdb8f0 2024-05-08T05:57:14.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.711+0000 7f064ba96b80 10 client.25898 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:57:14.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.711+0000 7f064ba96b80 10 client.25898 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-05-08T05:57:14.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.711+0000 7f064ba96b80 20 client.25898 populate_metadata read hostname 'smithi082' 2024-05-08T05:57:14.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.711+0000 7f064ba96b80 1 --2- 172.21.15.82:0/3901362422 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55a43ec67f80 0x55a43ec6a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:14.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.711+0000 7f064ba96b80 4 client.25898 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:57:14.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.711+0000 7f064ba96b80 1 -- 172.21.15.82:0/3901362422 --> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a43eb3b400 con 0x55a43ec67f80 2024-05-08T05:57:14.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.712+0000 7f0639400700 1 --2- 172.21.15.82:0/3901362422 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55a43ec67f80 0x55a43ec6a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:14.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.712+0000 7f0639400700 1 --2- 172.21.15.82:0/3901362422 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55a43ec67f80 0x55a43ec6a3a0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5f11459b519e1990 server_cookie=9cfe9730a8f833bf in_seq=0 out_seq=0 2024-05-08T05:57:14.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.712+0000 7f061be00700 10 client.25898 ms_handle_connect on v2:172.21.15.151:6836/4192404464 2024-05-08T05:57:14.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.712+0000 7f061be00700 1 -- 172.21.15.82:0/3901362422 <== mds.2 v2:172.21.15.151:6836/4192404464 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a43eb3b400 con 0x55a43ec67f80 2024-05-08T05:57:14.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.712+0000 7f061be00700 10 client.25898 handle_command_reply: tid=0 2024-05-08T05:57:14.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.712+0000 7f064ba96b80 1 client.25898 shutdown 2024-05-08T05:57:14.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.713+0000 7f064ba96b80 1 -- 172.21.15.82:0/3901362422 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a43ebdb8f0 msgr2=0x55a43ec029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:14.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.713+0000 7f064ba96b80 1 --2- 172.21.15.82:0/3901362422 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a43ebdb8f0 0x55a43ec029f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f062c0095d0 tx=0x7f062c005810 comp rx=0 tx=0).stop 2024-05-08T05:57:14.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.713+0000 7f064ba96b80 1 -- 172.21.15.82:0/3901362422 shutdown_connections 2024-05-08T05:57:14.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.713+0000 7f064ba96b80 1 --2- 172.21.15.82:0/3901362422 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55a43ec67f80 0x55a43ec6a3a0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:14.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.713+0000 7f064ba96b80 1 --2- 172.21.15.82:0/3901362422 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a43ebdb8f0 0x55a43ec029f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:14.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.713+0000 7f064ba96b80 1 --2- 172.21.15.82:0/3901362422 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a43ebe14e0 0x55a43ec5edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:14.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.713+0000 7f064ba96b80 1 --2- 172.21.15.82:0/3901362422 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a43ebe0bc0 0x55a43ec02f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:14.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.713+0000 7f064ba96b80 1 -- 172.21.15.82:0/3901362422 >> 172.21.15.82:0/3901362422 conn(0x55a43eb536d0 msgr2=0x55a43ebe62b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:57:14.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.713+0000 7f061be00700 0 client.25898 ms_handle_reset on v2:172.21.15.151:6836/4192404464 2024-05-08T05:57:14.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.713+0000 7f064ba96b80 1 -- 172.21.15.82:0/3901362422 shutdown_connections 2024-05-08T05:57:14.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.714+0000 7f064ba96b80 1 -- 172.21.15.82:0/3901362422 wait complete. 2024-05-08T05:57:14.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.715+0000 7f064ba96b80 20 client.25898 trim_cache size 0 max 16384 2024-05-08T05:57:14.716 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T05:57:14.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.717+0000 7f0641200700 1 -- 172.21.15.82:0/3743822541 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f06200b2a50 msgr2=0x7f06200b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:14.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.717+0000 7f0641200700 1 --2- 172.21.15.82:0/3743822541 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f06200b2a50 0x7f06200b4f10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0628009750 tx=0x7f0628009310 comp rx=0 tx=0).stop 2024-05-08T05:57:14.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.717+0000 7f0641200700 1 -- 172.21.15.82:0/3743822541 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f063c109510 msgr2=0x7f063c06e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:14.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.717+0000 7f0641200700 1 --2- 172.21.15.82:0/3743822541 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f063c109510 0x7f063c06e360 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f063400efc0 tx=0x7f063400c3a0 comp rx=0 tx=0).stop 2024-05-08T05:57:14.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.717+0000 7f0641200700 1 -- 172.21.15.82:0/3743822541 shutdown_connections 2024-05-08T05:57:14.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.717+0000 7f0641200700 1 --2- 172.21.15.82:0/3743822541 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f063c109510 0x7f063c06e360 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:14.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.717+0000 7f0641200700 1 --2- 172.21.15.82:0/3743822541 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f06200b2a50 0x7f06200b4f10 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:14.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.717+0000 7f0641200700 1 --2- 172.21.15.82:0/3743822541 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f063c06b180 0x7f063c074d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:14.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.717+0000 7f0641200700 1 --2- 172.21.15.82:0/3743822541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f063c06bb40 0x7f063c06de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:14.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.717+0000 7f0641200700 1 -- 172.21.15.82:0/3743822541 >> 172.21.15.82:0/3743822541 conn(0x7f063c079350 msgr2=0x7f063c101270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:57:14.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.718+0000 7f0641200700 1 -- 172.21.15.82:0/3743822541 shutdown_connections 2024-05-08T05:57:14.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:14.718+0000 7f0641200700 1 -- 172.21.15.82:0/3743822541 wait complete. 2024-05-08T05:57:15.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 385.0 s, 1378.2 tps, lat 71.630 ms stddev 87.845 2024-05-08T05:57:15.629 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-05-08T05:57:16.172 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:57:16.371 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:57:16 smithi082 ceph-mon[30098]: pgmap v657: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 7.3 MiB/s wr, 687 op/s 2024-05-08T05:57:16.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:57:16 smithi151 ceph-mon[34815]: pgmap v657: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 7.3 MiB/s wr, 687 op/s 2024-05-08T05:57:16.499 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:57:16 smithi134 ceph-mon[34132]: pgmap v657: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 7.3 MiB/s wr, 687 op/s 2024-05-08T05:57:18.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:57:18 smithi082 ceph-mon[30098]: pgmap v658: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 8.1 MiB/s wr, 722 op/s 2024-05-08T05:57:18.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:57:18 smithi151 ceph-mon[34815]: pgmap v658: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 8.1 MiB/s wr, 722 op/s 2024-05-08T05:57:18.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.496+0000 7fc042600700 1 -- 172.21.15.82:0/2303302758 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc03c075ff0 msgr2=0x7fc03c114130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:18.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.496+0000 7fc042600700 1 --2- 172.21.15.82:0/2303302758 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc03c075ff0 0x7fc03c114130 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc0280098f0 tx=0x7fc028009c00 comp rx=0 tx=0).stop 2024-05-08T05:57:18.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.497+0000 7fc042600700 1 -- 172.21.15.82:0/2303302758 shutdown_connections 2024-05-08T05:57:18.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.497+0000 7fc042600700 1 --2- 172.21.15.82:0/2303302758 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc03c0756d0 0x7fc03c075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:18.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.497+0000 7fc042600700 1 --2- 172.21.15.82:0/2303302758 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc03c114670 0x7fc03c116a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:18.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.497+0000 7fc042600700 1 --2- 172.21.15.82:0/2303302758 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc03c075ff0 0x7fc03c114130 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:18.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.497+0000 7fc042600700 1 -- 172.21.15.82:0/2303302758 >> 172.21.15.82:0/2303302758 conn(0x7fc03c07a600 msgr2=0x7fc03c07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:57:18.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.497+0000 7fc042600700 1 -- 172.21.15.82:0/2303302758 shutdown_connections 2024-05-08T05:57:18.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.497+0000 7fc042600700 1 -- 172.21.15.82:0/2303302758 wait complete. 2024-05-08T05:57:18.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:57:18 smithi134 ceph-mon[34132]: pgmap v658: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 8.1 MiB/s wr, 722 op/s 2024-05-08T05:57:18.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.498+0000 7fc042600700 1 Processor -- start 2024-05-08T05:57:18.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.498+0000 7fc042600700 1 -- start start 2024-05-08T05:57:18.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.498+0000 7fc042600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc03c0756d0 0x7fc03c1a01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:18.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.498+0000 7fc042600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc03c075ff0 0x7fc03c1a0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:18.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.498+0000 7fc042600700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc03c114670 0x7fc03c1a4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:18.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.498+0000 7fc042600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc03c119d00 con 0x7fc03c075ff0 2024-05-08T05:57:18.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.498+0000 7fc042600700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc03c119b80 con 0x7fc03c0756d0 2024-05-08T05:57:18.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.498+0000 7fc042600700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc03c119e80 con 0x7fc03c114670 2024-05-08T05:57:18.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.499+0000 7fc03b400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc03c0756d0 0x7fc03c1a01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:18.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.499+0000 7fc03b400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc03c0756d0 0x7fc03c1a01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:54816/0 (socket says 172.21.15.82:54816) 2024-05-08T05:57:18.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.499+0000 7fc03b400700 1 -- 172.21.15.82:0/2801355229 learned_addr learned my addr 172.21.15.82:0/2801355229 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:57:18.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.499+0000 7fc03aa00700 1 --2- 172.21.15.82:0/2801355229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc03c075ff0 0x7fc03c1a0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:18.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.499+0000 7fc03be00700 1 --2- 172.21.15.82:0/2801355229 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc03c114670 0x7fc03c1a4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:18.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.499+0000 7fc03b400700 1 -- 172.21.15.82:0/2801355229 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc03c114670 msgr2=0x7fc03c1a4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:18.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.499+0000 7fc03b400700 1 --2- 172.21.15.82:0/2801355229 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc03c114670 0x7fc03c1a4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:18.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.499+0000 7fc03b400700 1 -- 172.21.15.82:0/2801355229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc03c075ff0 msgr2=0x7fc03c1a0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:18.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.499+0000 7fc03b400700 1 --2- 172.21.15.82:0/2801355229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc03c075ff0 0x7fc03c1a0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:18.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.499+0000 7fc03b400700 1 -- 172.21.15.82:0/2801355229 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc03c1a5200 con 0x7fc03c0756d0 2024-05-08T05:57:18.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.499+0000 7fc03be00700 1 --2- 172.21.15.82:0/2801355229 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc03c114670 0x7fc03c1a4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:57:18.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.500+0000 7fc03b400700 1 --2- 172.21.15.82:0/2801355229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc03c0756d0 0x7fc03c1a01f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc02c00e3c0 tx=0x7fc02c00e6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:57:18.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.500+0000 7fc033e00700 1 -- 172.21.15.82:0/2801355229 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc02c0090d0 con 0x7fc03c0756d0 2024-05-08T05:57:18.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.500+0000 7fc033e00700 1 -- 172.21.15.82:0/2801355229 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc02c009270 con 0x7fc03c0756d0 2024-05-08T05:57:18.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.500+0000 7fc033e00700 1 -- 172.21.15.82:0/2801355229 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc02c004680 con 0x7fc03c0756d0 2024-05-08T05:57:18.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.500+0000 7fc042600700 1 -- 172.21.15.82:0/2801355229 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc03c1a5490 con 0x7fc03c0756d0 2024-05-08T05:57:18.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.500+0000 7fc042600700 1 -- 172.21.15.82:0/2801355229 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc03c1acd70 con 0x7fc03c0756d0 2024-05-08T05:57:18.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.507+0000 7fc04cf5bb80 1 Processor -- start 2024-05-08T05:57:18.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.507+0000 7fc04cf5bb80 1 -- start start 2024-05-08T05:57:18.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.507+0000 7fc04cf5bb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b06bf5060 0x564b06bf5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:18.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.507+0000 7fc04cf5bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b06bf5980 0x564b06bf9490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:18.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.507+0000 7fc04cf5bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b06bf99d0 0x564b06bf9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:18.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.508+0000 7fc04cf5bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x564b06b47a20 con 0x564b06bf99d0 2024-05-08T05:57:18.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.508+0000 7fc04cf5bb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564b06ae5760 con 0x564b06bf5060 2024-05-08T05:57:18.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.508+0000 7fc04cf5bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564b06b439e0 con 0x564b06bf5980 2024-05-08T05:57:18.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.508+0000 7fc03aa00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b06bf99d0 0x564b06bf9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:18.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.508+0000 7fc03aa00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b06bf99d0 0x564b06bf9e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44990/0 (socket says 172.21.15.82:44990) 2024-05-08T05:57:18.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.508+0000 7fc03aa00700 1 -- 172.21.15.82:0/4130835117 learned_addr learned my addr 172.21.15.82:0/4130835117 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:57:18.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.508+0000 7fc03be00700 1 --2- 172.21.15.82:0/4130835117 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b06bf5060 0x564b06bf5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:18.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.508+0000 7fc033e00700 1 -- 172.21.15.82:0/2801355229 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fc02c01b030 con 0x7fc03c0756d0 2024-05-08T05:57:18.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.508+0000 7fc03aa00700 1 -- 172.21.15.82:0/4130835117 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b06bf5980 msgr2=0x564b06bf9490 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T05:57:18.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.508+0000 7fc03aa00700 1 --2- 172.21.15.82:0/4130835117 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b06bf5980 0x564b06bf9490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:18.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.508+0000 7fc03aa00700 1 -- 172.21.15.82:0/4130835117 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b06bf5060 msgr2=0x564b06bf5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:57:18.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.508+0000 7fc03aa00700 1 --2- 172.21.15.82:0/4130835117 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b06bf5060 0x564b06bf5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:18.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.508+0000 7fc03aa00700 1 -- 172.21.15.82:0/4130835117 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b06a948d0 con 0x564b06bf99d0 2024-05-08T05:57:18.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.509+0000 7fc03aa00700 1 --2- 172.21.15.82:0/4130835117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b06bf99d0 0x564b06bf9e30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc0280098f0 tx=0x7fc028009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=157057c6af648c2b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:57:18.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.509+0000 7fc030c00700 1 -- 172.21.15.82:0/4130835117 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc028026070 con 0x564b06bf99d0 2024-05-08T05:57:18.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.509+0000 7fc030c00700 1 -- 172.21.15.82:0/4130835117 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc02800f910 con 0x564b06bf99d0 2024-05-08T05:57:18.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.509+0000 7fc030c00700 1 -- 172.21.15.82:0/4130835117 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0280038e0 con 0x564b06bf99d0 2024-05-08T05:57:18.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.510+0000 7fc04cf5bb80 1 -- 172.21.15.82:0/4130835117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b06bf99d0 msgr2=0x564b06bf9e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:18.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.510+0000 7fc04cf5bb80 1 --2- 172.21.15.82:0/4130835117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b06bf99d0 0x564b06bf9e30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fc0280098f0 tx=0x7fc028009f70 comp rx=0 tx=0).stop 2024-05-08T05:57:18.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.511+0000 7fc04cf5bb80 1 -- 172.21.15.82:0/4130835117 shutdown_connections 2024-05-08T05:57:18.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.511+0000 7fc04cf5bb80 1 --2- 172.21.15.82:0/4130835117 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b06bf5060 0x564b06bf5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:18.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.511+0000 7fc04cf5bb80 1 --2- 172.21.15.82:0/4130835117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b06bf99d0 0x564b06bf9e30 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:18.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.511+0000 7fc04cf5bb80 1 --2- 172.21.15.82:0/4130835117 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b06bf5980 0x564b06bf9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:18.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.511+0000 7fc04cf5bb80 1 -- 172.21.15.82:0/4130835117 >> 172.21.15.82:0/4130835117 conn(0x564b06b23b60 msgr2=0x564b06bef7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:57:18.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.511+0000 7fc033e00700 1 --2- 172.21.15.82:0/2801355229 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc0200b2940 0x7fc0200b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:18.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.511+0000 7fc04cf5bb80 1 -- 172.21.15.82:0/4130835117 shutdown_connections 2024-05-08T05:57:18.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.511+0000 7fc04cf5bb80 1 -- 172.21.15.82:0/4130835117 wait complete. 2024-05-08T05:57:18.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.512+0000 7fc033e00700 1 -- 172.21.15.82:0/2801355229 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fc02c0e1b60 con 0x7fc03c0756d0 2024-05-08T05:57:18.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.512+0000 7fc04cf5bb80 1 -- start start 2024-05-08T05:57:18.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.512+0000 7fc04cf5bb80 1 Processor -- start 2024-05-08T05:57:18.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.512+0000 7fc03aa00700 1 --2- 172.21.15.82:0/2801355229 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc0200b2940 0x7fc0200b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:18.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.513+0000 7fc04cf5bb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b06bf5060 0x564b06c00e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:18.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.513+0000 7fc04cf5bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b06bf5980 0x564b06bfe1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:18.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.513+0000 7fc04cf5bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b06bf99d0 0x564b06bfe700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:18.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.513+0000 7fc03aa00700 1 --2- 172.21.15.82:0/2801355229 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc0200b2940 0x7fc0200b4e00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc0280053e0 tx=0x7fc028009c00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:57:18.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.513+0000 7fc03b400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b06bf5060 0x564b06c00e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:18.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.513+0000 7fc03b400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b06bf5060 0x564b06c00e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:54838/0 (socket says 172.21.15.82:54838) 2024-05-08T05:57:18.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.513+0000 7fc03b400700 1 -- 172.21.15.82:0/2353766570 learned_addr learned my addr 172.21.15.82:0/2353766570 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:57:18.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.513+0000 7fc04cf5bb80 1 -- 172.21.15.82:0/2353766570 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x564b06c01b80 con 0x564b06bf99d0 2024-05-08T05:57:18.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.513+0000 7fc04cf5bb80 1 -- 172.21.15.82:0/2353766570 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564b06aadb20 con 0x564b06bf5060 2024-05-08T05:57:18.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.513+0000 7fc03aa00700 1 --2- 172.21.15.82:0/2353766570 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b06bf5980 0x564b06bfe1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:18.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.513+0000 7fc04cf5bb80 1 -- 172.21.15.82:0/2353766570 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564b06c01d00 con 0x564b06bf5980 2024-05-08T05:57:18.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.513+0000 7fc04cf5bb80 10 client.0 _ll_register_callbacks cb 0x564b06aeec70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:57:18.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.514+0000 7fc03be00700 1 --2- 172.21.15.82:0/2353766570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b06bf99d0 0x564b06bfe700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:18.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.514+0000 7fc03aa00700 1 -- 172.21.15.82:0/2353766570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b06bf5060 msgr2=0x564b06c00e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:57:18.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.514+0000 7fc03aa00700 1 --2- 172.21.15.82:0/2353766570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b06bf5060 0x564b06c00e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:18.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.514+0000 7fc03aa00700 1 -- 172.21.15.82:0/2353766570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b06bf99d0 msgr2=0x564b06bfe700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:57:18.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.514+0000 7fc03aa00700 1 --2- 172.21.15.82:0/2353766570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b06bf99d0 0x564b06bfe700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:18.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.514+0000 7fc03aa00700 1 -- 172.21.15.82:0/2353766570 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b06b0d420 con 0x564b06bf5980 2024-05-08T05:57:18.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.514+0000 7fc03be00700 1 --2- 172.21.15.82:0/2353766570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b06bf99d0 0x564b06bfe700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:57:18.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.514+0000 7fc03aa00700 1 --2- 172.21.15.82:0/2353766570 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b06bf5980 0x564b06bfe1c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc0280098c0 tx=0x7fc0280054e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11907313fea4d373 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:57:18.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.514+0000 7fc025600700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:57:18.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.514+0000 7fc025600700 1 -- 172.21.15.82:0/2353766570 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc028026040 con 0x564b06bf5980 2024-05-08T05:57:18.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.514+0000 7fc025600700 1 -- 172.21.15.82:0/2353766570 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fc02800bb50 con 0x564b06bf5980 2024-05-08T05:57:18.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.514+0000 7fc04cf5bb80 1 -- 172.21.15.82:0/2353766570 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc02800f910 con 0x564b06bf5980 2024-05-08T05:57:18.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.515+0000 7fc025600700 1 -- 172.21.15.82:0/2353766570 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fc02800bd50 con 0x564b06bf5980 2024-05-08T05:57:18.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.515+0000 7fc04cf5bb80 10 client.25945 fetch_fsmap learned FSMap version 31 2024-05-08T05:57:18.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.515+0000 7fc04cf5bb80 1 -- 172.21.15.82:0/2353766570 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x564b06c01b80 con 0x564b06bf5980 2024-05-08T05:57:18.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.515+0000 7fc025600700 1 -- 172.21.15.82:0/2353766570 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc02800f910 con 0x564b06bf5980 2024-05-08T05:57:18.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.515+0000 7fc025600700 1 -- 172.21.15.82:0/2353766570 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fc028020070 con 0x564b06bf5980 2024-05-08T05:57:18.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.515+0000 7fc04cf5bb80 10 client.25945 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:57:18.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.515+0000 7fc04cf5bb80 10 client.25945 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-08T05:57:18.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.515+0000 7fc04cf5bb80 20 client.25945 populate_metadata read hostname 'smithi082' 2024-05-08T05:57:18.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.515+0000 7fc04cf5bb80 1 --2- 172.21.15.82:0/2353766570 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x564b06c0e6d0 0x564b06c10ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:18.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.515+0000 7fc04cf5bb80 4 client.25945 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:57:18.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.515+0000 7fc04cf5bb80 1 -- 172.21.15.82:0/2353766570 --> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564b06bc20a0 con 0x564b06c0e6d0 2024-05-08T05:57:18.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.516+0000 7fc03b400700 1 --2- 172.21.15.82:0/2353766570 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x564b06c0e6d0 0x564b06c10ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:18.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.517+0000 7fc03b400700 1 --2- 172.21.15.82:0/2353766570 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x564b06c0e6d0 0x564b06c10ac0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7019f022ad62ccb4 server_cookie=9633cffaee69f52b in_seq=0 out_seq=0 2024-05-08T05:57:18.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.517+0000 7fc025600700 10 client.25945 ms_handle_connect on v2:172.21.15.151:6838/2963754236 2024-05-08T05:57:18.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.518+0000 7fc025600700 1 -- 172.21.15.82:0/2353766570 <== mds.1 v2:172.21.15.151:6838/2963754236 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564b06bc20a0 con 0x564b06c0e6d0 2024-05-08T05:57:18.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.518+0000 7fc025600700 10 client.25945 handle_command_reply: tid=0 2024-05-08T05:57:18.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.518+0000 7fc04cf5bb80 1 client.25945 shutdown 2024-05-08T05:57:18.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.519+0000 7fc04cf5bb80 1 -- 172.21.15.82:0/2353766570 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b06bf5980 msgr2=0x564b06bfe1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:18.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.519+0000 7fc04cf5bb80 1 --2- 172.21.15.82:0/2353766570 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b06bf5980 0x564b06bfe1c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc0280098c0 tx=0x7fc0280054e0 comp rx=0 tx=0).stop 2024-05-08T05:57:18.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.524+0000 7fc04cf5bb80 1 -- 172.21.15.82:0/2353766570 shutdown_connections 2024-05-08T05:57:18.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.524+0000 7fc04cf5bb80 1 --2- 172.21.15.82:0/2353766570 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x564b06c0e6d0 0x564b06c10ac0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:18.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.524+0000 7fc04cf5bb80 1 --2- 172.21.15.82:0/2353766570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b06bf5060 0x564b06c00e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:18.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.524+0000 7fc04cf5bb80 1 --2- 172.21.15.82:0/2353766570 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b06bf99d0 0x564b06bfe700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:18.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.524+0000 7fc04cf5bb80 1 --2- 172.21.15.82:0/2353766570 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b06bf5980 0x564b06bfe1c0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:18.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.524+0000 7fc04cf5bb80 1 -- 172.21.15.82:0/2353766570 >> 172.21.15.82:0/2353766570 conn(0x564b06b23b60 msgr2=0x564b06bea2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:57:18.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.524+0000 7fc025600700 0 client.25945 ms_handle_reset on v2:172.21.15.151:6838/2963754236 2024-05-08T05:57:18.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.528+0000 7fc04cf5bb80 1 -- 172.21.15.82:0/2353766570 shutdown_connections 2024-05-08T05:57:18.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.529+0000 7fc04cf5bb80 1 -- 172.21.15.82:0/2353766570 wait complete. 2024-05-08T05:57:18.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.530+0000 7fc04cf5bb80 20 client.25945 trim_cache size 0 max 16384 2024-05-08T05:57:18.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.570+0000 7fc04cf5bb80 1 Processor -- start 2024-05-08T05:57:18.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.570+0000 7fc04cf5bb80 1 -- start start 2024-05-08T05:57:18.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.571+0000 7fc04cf5bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b06bf5060 0x564b06bfbe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:18.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.571+0000 7fc04cf5bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b06bf5980 0x564b06bff870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:18.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.571+0000 7fc04cf5bb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b06bf99d0 0x564b06bffdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:18.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.571+0000 7fc04cf5bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc03c1b4190 con 0x564b06bf5060 2024-05-08T05:57:18.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.571+0000 7fc04cf5bb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc03c1b5cd0 con 0x564b06bf99d0 2024-05-08T05:57:18.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.571+0000 7fc04cf5bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc03c1b4860 con 0x564b06bf5980 2024-05-08T05:57:18.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.571+0000 7fc03b400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b06bf5060 0x564b06bfbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:18.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.572+0000 7fc03b400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b06bf5060 0x564b06bfbe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45000/0 (socket says 172.21.15.82:45000) 2024-05-08T05:57:18.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.572+0000 7fc03b400700 1 -- 172.21.15.82:0/4263909511 learned_addr learned my addr 172.21.15.82:0/4263909511 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:57:18.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.572+0000 7fc03aa00700 1 --2- 172.21.15.82:0/4263909511 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b06bf5980 0x564b06bff870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:18.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.572+0000 7fc03b400700 1 -- 172.21.15.82:0/4263909511 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b06bf5980 msgr2=0x564b06bff870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:57:18.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.572+0000 7fc03b400700 1 --2- 172.21.15.82:0/4263909511 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b06bf5980 0x564b06bff870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:18.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.572+0000 7fc03be00700 1 --2- 172.21.15.82:0/4263909511 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b06bf99d0 0x564b06bffdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:18.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.572+0000 7fc03b400700 1 -- 172.21.15.82:0/4263909511 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b06bf99d0 msgr2=0x564b06bffdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:57:18.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.573+0000 7fc03b400700 1 --2- 172.21.15.82:0/4263909511 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b06bf99d0 0x564b06bffdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:18.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.573+0000 7fc03b400700 1 -- 172.21.15.82:0/4263909511 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b06bebf90 con 0x564b06bf5060 2024-05-08T05:57:18.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.573+0000 7fc03b400700 1 --2- 172.21.15.82:0/4263909511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b06bf5060 0x564b06bfbe20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc02c009fd0 tx=0x7fc02c009420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e609633d4c9c07f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:57:18.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.574+0000 7fc027e00700 1 -- 172.21.15.82:0/4263909511 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc02c0a98c0 con 0x564b06bf5060 2024-05-08T05:57:18.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.574+0000 7fc027e00700 1 -- 172.21.15.82:0/4263909511 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc02c0a91c0 con 0x564b06bf5060 2024-05-08T05:57:18.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.574+0000 7fc027e00700 1 -- 172.21.15.82:0/4263909511 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc02c0a98c0 con 0x564b06bf5060 2024-05-08T05:57:18.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.575+0000 7fc04cf5bb80 1 -- 172.21.15.82:0/4263909511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b06bf5060 msgr2=0x564b06bfbe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:18.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.575+0000 7fc04cf5bb80 1 --2- 172.21.15.82:0/4263909511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b06bf5060 0x564b06bfbe20 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fc02c009fd0 tx=0x7fc02c009420 comp rx=0 tx=0).stop 2024-05-08T05:57:18.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.575+0000 7fc04cf5bb80 1 -- 172.21.15.82:0/4263909511 shutdown_connections 2024-05-08T05:57:18.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.575+0000 7fc04cf5bb80 1 --2- 172.21.15.82:0/4263909511 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b06bf99d0 0x564b06bffdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:18.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.575+0000 7fc04cf5bb80 1 --2- 172.21.15.82:0/4263909511 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b06bf5060 0x564b06bfbe20 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:18.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.575+0000 7fc04cf5bb80 1 --2- 172.21.15.82:0/4263909511 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b06bf5980 0x564b06bff870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:18.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.575+0000 7fc04cf5bb80 1 -- 172.21.15.82:0/4263909511 >> 172.21.15.82:0/4263909511 conn(0x564b06b23b60 msgr2=0x564b06bea2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:57:18.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.576+0000 7fc04cf5bb80 1 -- 172.21.15.82:0/4263909511 shutdown_connections 2024-05-08T05:57:18.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.576+0000 7fc04cf5bb80 1 -- 172.21.15.82:0/4263909511 wait complete. 2024-05-08T05:57:18.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.576+0000 7fc04cf5bb80 1 -- start start 2024-05-08T05:57:18.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.577+0000 7fc04cf5bb80 1 Processor -- start 2024-05-08T05:57:18.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.578+0000 7fc04cf5bb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b06bf5060 0x564b06c075f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:18.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.578+0000 7fc04cf5bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b06bf5980 0x564b06c15710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:18.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.578+0000 7fc04cf5bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b06bf99d0 0x564b06c15c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:18.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.578+0000 7fc03b400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b06bf5060 0x564b06c075f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:18.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.578+0000 7fc03b400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b06bf5060 0x564b06c075f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:54860/0 (socket says 172.21.15.82:54860) 2024-05-08T05:57:18.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.579+0000 7fc04cf5bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc03c1b5600 con 0x564b06bf5980 2024-05-08T05:57:18.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.579+0000 7fc04cf5bb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc03c1b4f30 con 0x564b06bf5060 2024-05-08T05:57:18.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.579+0000 7fc04cf5bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc03c1b2130 con 0x564b06bf99d0 2024-05-08T05:57:18.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.579+0000 7fc03b400700 1 -- 172.21.15.82:0/3297550794 learned_addr learned my addr 172.21.15.82:0/3297550794 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:57:18.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.579+0000 7fc03be00700 1 --2- 172.21.15.82:0/3297550794 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b06bf99d0 0x564b06c15c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:18.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.580+0000 7fc04cf5bb80 10 client.0 _ll_register_callbacks cb 0x564b06aeec70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:57:18.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.580+0000 7fc03aa00700 1 --2- 172.21.15.82:0/3297550794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b06bf5980 0x564b06c15710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:18.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.580+0000 7fc03b400700 1 -- 172.21.15.82:0/3297550794 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b06bf99d0 msgr2=0x564b06c15c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:57:18.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.580+0000 7fc03b400700 1 --2- 172.21.15.82:0/3297550794 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b06bf99d0 0x564b06c15c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:18.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.580+0000 7fc03b400700 1 -- 172.21.15.82:0/3297550794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b06bf5980 msgr2=0x564b06c15710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:57:18.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.580+0000 7fc03b400700 1 --2- 172.21.15.82:0/3297550794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b06bf5980 0x564b06c15710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:18.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.580+0000 7fc03b400700 1 -- 172.21.15.82:0/3297550794 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b06c16470 con 0x564b06bf5060 2024-05-08T05:57:18.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.582+0000 7fc03b400700 1 --2- 172.21.15.82:0/3297550794 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b06bf5060 0x564b06c075f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc02c0a5240 tx=0x7fc02c0df720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ed1cd9da4de5f79 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:57:18.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.582+0000 7fc025600700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:57:18.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.582+0000 7fc025600700 1 -- 172.21.15.82:0/3297550794 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc02c0a98c0 con 0x564b06bf5060 2024-05-08T05:57:18.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.582+0000 7fc025600700 1 -- 172.21.15.82:0/3297550794 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fc02c0b1b00 con 0x564b06bf5060 2024-05-08T05:57:18.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.582+0000 7fc04cf5bb80 1 -- 172.21.15.82:0/3297550794 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc02c0a91c0 con 0x564b06bf5060 2024-05-08T05:57:18.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.582+0000 7fc025600700 1 -- 172.21.15.82:0/3297550794 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fc02c0ad360 con 0x564b06bf5060 2024-05-08T05:57:18.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.583+0000 7fc04cf5bb80 10 client.25913 fetch_fsmap learned FSMap version 31 2024-05-08T05:57:18.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.583+0000 7fc04cf5bb80 1 -- 172.21.15.82:0/3297550794 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x564b06c78d30 con 0x564b06bf5060 2024-05-08T05:57:18.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.584+0000 7fc025600700 1 -- 172.21.15.82:0/3297550794 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc02c0a91c0 con 0x564b06bf5060 2024-05-08T05:57:18.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.584+0000 7fc025600700 1 -- 172.21.15.82:0/3297550794 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fc02c0dfad0 con 0x564b06bf5060 2024-05-08T05:57:18.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.585+0000 7fc04cf5bb80 10 client.25913 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:57:18.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.585+0000 7fc04cf5bb80 10 client.25913 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-08T05:57:18.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.585+0000 7fc04cf5bb80 20 client.25913 populate_metadata read hostname 'smithi082' 2024-05-08T05:57:18.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.585+0000 7fc04cf5bb80 1 --2- 172.21.15.82:0/3297550794 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x564b06c79400 0x564b06c7b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:18.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.585+0000 7fc04cf5bb80 4 client.25913 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:57:18.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.585+0000 7fc04cf5bb80 1 -- 172.21.15.82:0/3297550794 --> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564b06b55400 con 0x564b06c79400 2024-05-08T05:57:18.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.585+0000 7fc03aa00700 1 --2- 172.21.15.82:0/3297550794 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x564b06c79400 0x564b06c7b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:18.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.586+0000 7fc03aa00700 1 --2- 172.21.15.82:0/3297550794 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x564b06c79400 0x564b06c7b820 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8952cde1914c4016 server_cookie=49baea6675fb875b in_seq=0 out_seq=0 2024-05-08T05:57:18.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.586+0000 7fc025600700 10 client.25913 ms_handle_connect on v2:172.21.15.151:6838/2963754236 2024-05-08T05:57:18.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.586+0000 7fc025600700 1 -- 172.21.15.82:0/3297550794 <== mds.1 v2:172.21.15.151:6838/2963754236 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564b06b55400 con 0x564b06c79400 2024-05-08T05:57:18.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.586+0000 7fc025600700 10 client.25913 handle_command_reply: tid=0 2024-05-08T05:57:18.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.586+0000 7fc04cf5bb80 1 client.25913 shutdown 2024-05-08T05:57:18.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.587+0000 7fc04cf5bb80 1 -- 172.21.15.82:0/3297550794 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b06bf5060 msgr2=0x564b06c075f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:18.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.587+0000 7fc04cf5bb80 1 --2- 172.21.15.82:0/3297550794 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b06bf5060 0x564b06c075f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc02c0a5240 tx=0x7fc02c0df720 comp rx=0 tx=0).stop 2024-05-08T05:57:18.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.587+0000 7fc04cf5bb80 1 -- 172.21.15.82:0/3297550794 shutdown_connections 2024-05-08T05:57:18.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.587+0000 7fc04cf5bb80 1 --2- 172.21.15.82:0/3297550794 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x564b06c79400 0x564b06c7b820 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:18.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.587+0000 7fc04cf5bb80 1 --2- 172.21.15.82:0/3297550794 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564b06bf5060 0x564b06c075f0 secure :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc02c0a5240 tx=0x7fc02c0df720 comp rx=0 tx=0).stop 2024-05-08T05:57:18.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.587+0000 7fc04cf5bb80 1 --2- 172.21.15.82:0/3297550794 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b06bf99d0 0x564b06c15c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:18.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.587+0000 7fc04cf5bb80 1 --2- 172.21.15.82:0/3297550794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564b06bf5980 0x564b06c15710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:18.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.587+0000 7fc04cf5bb80 1 -- 172.21.15.82:0/3297550794 >> 172.21.15.82:0/3297550794 conn(0x564b06b23b60 msgr2=0x564b06bfc9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:57:18.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.587+0000 7fc025600700 0 client.25913 ms_handle_reset on v2:172.21.15.151:6838/2963754236 2024-05-08T05:57:18.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.587+0000 7fc04cf5bb80 1 -- 172.21.15.82:0/3297550794 shutdown_connections 2024-05-08T05:57:18.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.588+0000 7fc04cf5bb80 1 -- 172.21.15.82:0/3297550794 wait complete. 2024-05-08T05:57:18.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.588+0000 7fc04cf5bb80 20 client.25913 trim_cache size 0 max 16384 2024-05-08T05:57:18.591 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T05:57:18.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.590+0000 7fc042600700 1 -- 172.21.15.82:0/2801355229 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc0200b2940 msgr2=0x7fc0200b4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:18.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.590+0000 7fc042600700 1 --2- 172.21.15.82:0/2801355229 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc0200b2940 0x7fc0200b4e00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fc0280053e0 tx=0x7fc028009c00 comp rx=0 tx=0).stop 2024-05-08T05:57:18.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.590+0000 7fc042600700 1 -- 172.21.15.82:0/2801355229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc03c0756d0 msgr2=0x7fc03c1a01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:18.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.590+0000 7fc042600700 1 --2- 172.21.15.82:0/2801355229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc03c0756d0 0x7fc03c1a01f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc02c00e3c0 tx=0x7fc02c00e6d0 comp rx=0 tx=0).stop 2024-05-08T05:57:18.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.593+0000 7fc042600700 1 -- 172.21.15.82:0/2801355229 shutdown_connections 2024-05-08T05:57:18.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.593+0000 7fc042600700 1 --2- 172.21.15.82:0/2801355229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc03c0756d0 0x7fc03c1a01f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:18.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.593+0000 7fc042600700 1 --2- 172.21.15.82:0/2801355229 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc0200b2940 0x7fc0200b4e00 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:18.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.593+0000 7fc042600700 1 --2- 172.21.15.82:0/2801355229 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc03c114670 0x7fc03c1a4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:18.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.593+0000 7fc042600700 1 --2- 172.21.15.82:0/2801355229 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc03c075ff0 0x7fc03c1a0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:18.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.593+0000 7fc042600700 1 -- 172.21.15.82:0/2801355229 >> 172.21.15.82:0/2801355229 conn(0x7fc03c07a600 msgr2=0x7fc03c110110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:57:18.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.593+0000 7fc042600700 1 -- 172.21.15.82:0/2801355229 shutdown_connections 2024-05-08T05:57:18.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:18.593+0000 7fc042600700 1 -- 172.21.15.82:0/2801355229 wait complete. 2024-05-08T05:57:19.452 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-05-08T05:57:19.987 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:57:20.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 390.0 s, 1505.2 tps, lat 67.683 ms stddev 74.315 2024-05-08T05:57:20.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:57:20 smithi151 ceph-mon[34815]: pgmap v659: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 7.5 MiB/s wr, 659 op/s 2024-05-08T05:57:20.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:57:20 smithi082 ceph-mon[30098]: pgmap v659: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 7.5 MiB/s wr, 659 op/s 2024-05-08T05:57:20.499 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:57:20 smithi134 ceph-mon[34132]: pgmap v659: 97 pgs: 97 active+clean; 1.6 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 7.5 MiB/s wr, 659 op/s 2024-05-08T05:57:21.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:57:21 smithi151 ceph-mon[34815]: pgmap v660: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.4 MiB/s wr, 758 op/s 2024-05-08T05:57:21.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:57:21 smithi082 ceph-mon[30098]: pgmap v660: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.4 MiB/s wr, 758 op/s 2024-05-08T05:57:21.499 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:57:21 smithi134 ceph-mon[34132]: pgmap v660: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 8.4 MiB/s wr, 758 op/s 2024-05-08T05:57:22.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.511+0000 7fbaab200700 1 -- 172.21.15.82:0/3556126115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbaac103d90 msgr2=0x7fbaac1102a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:22.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.511+0000 7fbaab200700 1 --2- 172.21.15.82:0/3556126115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbaac103d90 0x7fbaac1102a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fbaa400b0a0 tx=0x7fbaa400b3b0 comp rx=0 tx=0).stop 2024-05-08T05:57:22.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.512+0000 7fbaab200700 1 -- 172.21.15.82:0/3556126115 shutdown_connections 2024-05-08T05:57:22.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.512+0000 7fbaab200700 1 --2- 172.21.15.82:0/3556126115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbaac103d90 0x7fbaac1102a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:22.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.512+0000 7fbaab200700 1 --2- 172.21.15.82:0/3556126115 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbaac109460 0x7fbaac109840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:22.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.512+0000 7fbaab200700 1 --2- 172.21.15.82:0/3556126115 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbaac1033d0 0x7fbaac103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:22.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.512+0000 7fbaab200700 1 -- 172.21.15.82:0/3556126115 >> 172.21.15.82:0/3556126115 conn(0x7fbaac0fef20 msgr2=0x7fbaac101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:57:22.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.513+0000 7fbaab200700 1 -- 172.21.15.82:0/3556126115 shutdown_connections 2024-05-08T05:57:22.514 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.513+0000 7fbaab200700 1 -- 172.21.15.82:0/3556126115 wait complete. 2024-05-08T05:57:22.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.515+0000 7fbaab200700 1 Processor -- start 2024-05-08T05:57:22.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.515+0000 7fbaab200700 1 -- start start 2024-05-08T05:57:22.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.515+0000 7fbaab200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbaac1033d0 0x7fbaac1a1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:22.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.515+0000 7fbaab200700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbaac103d90 0x7fbaac1a1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:22.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.516+0000 7fbaab200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbaac109460 0x7fbaac19ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:22.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.516+0000 7fbaab200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbaac113570 con 0x7fbaac109460 2024-05-08T05:57:22.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.516+0000 7fbaab200700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbaac1133f0 con 0x7fbaac1033d0 2024-05-08T05:57:22.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.516+0000 7fbaab200700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fbaac1136f0 con 0x7fbaac103d90 2024-05-08T05:57:22.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.516+0000 7fbaaa800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbaac109460 0x7fbaac19ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:22.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.516+0000 7fbaa9400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbaac103d90 0x7fbaac1a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:22.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.516+0000 7fbaaa800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbaac109460 0x7fbaac19ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45014/0 (socket says 172.21.15.82:45014) 2024-05-08T05:57:22.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.516+0000 7fbaaa800700 1 -- 172.21.15.82:0/1195433174 learned_addr learned my addr 172.21.15.82:0/1195433174 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:57:22.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.516+0000 7fbaa9e00700 1 --2- 172.21.15.82:0/1195433174 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbaac1033d0 0x7fbaac1a1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:22.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.517+0000 7fbaaa800700 1 -- 172.21.15.82:0/1195433174 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbaac103d90 msgr2=0x7fbaac1a1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:22.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.517+0000 7fbaaa800700 1 --2- 172.21.15.82:0/1195433174 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbaac103d90 0x7fbaac1a1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:22.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.517+0000 7fbaaa800700 1 -- 172.21.15.82:0/1195433174 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbaac1033d0 msgr2=0x7fbaac1a1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:22.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.517+0000 7fbaaa800700 1 --2- 172.21.15.82:0/1195433174 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbaac1033d0 0x7fbaac1a1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:22.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.517+0000 7fbaaa800700 1 -- 172.21.15.82:0/1195433174 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaac19c170 con 0x7fbaac109460 2024-05-08T05:57:22.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.517+0000 7fbaa9e00700 1 --2- 172.21.15.82:0/1195433174 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbaac1033d0 0x7fbaac1a1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:57:22.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.517+0000 7fbaa9400700 1 --2- 172.21.15.82:0/1195433174 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbaac103d90 0x7fbaac1a1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:57:22.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.517+0000 7fbaaa800700 1 --2- 172.21.15.82:0/1195433174 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbaac109460 0x7fbaac19ba10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fbaa40062a0 tx=0x7fbaa4004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:57:22.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.517+0000 7fbaa2a00700 1 -- 172.21.15.82:0/1195433174 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa4021070 con 0x7fbaac109460 2024-05-08T05:57:22.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.517+0000 7fbaa2a00700 1 -- 172.21.15.82:0/1195433174 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbaa4007e30 con 0x7fbaac109460 2024-05-08T05:57:22.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.517+0000 7fbaa2a00700 1 -- 172.21.15.82:0/1195433174 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa4004780 con 0x7fbaac109460 2024-05-08T05:57:22.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.517+0000 7fbaab200700 1 -- 172.21.15.82:0/1195433174 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaac19c400 con 0x7fbaac109460 2024-05-08T05:57:22.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.517+0000 7fbaab200700 1 -- 172.21.15.82:0/1195433174 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaac1a8720 con 0x7fbaac109460 2024-05-08T05:57:22.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.523+0000 7fbaa2a00700 1 -- 172.21.15.82:0/1195433174 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fbaa4007980 con 0x7fbaac109460 2024-05-08T05:57:22.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.524+0000 7fbabb436b80 1 Processor -- start 2024-05-08T05:57:22.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.524+0000 7fbaa2a00700 1 --2- 172.21.15.82:0/1195433174 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fba900b2900 0x7fba900b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:22.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.524+0000 7fbaa2a00700 1 -- 172.21.15.82:0/1195433174 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fbaa400f020 con 0x7fbaac109460 2024-05-08T05:57:22.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.524+0000 7fbaa9400700 1 --2- 172.21.15.82:0/1195433174 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fba900b2900 0x7fba900b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:22.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.524+0000 7fbabb436b80 1 -- start start 2024-05-08T05:57:22.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.525+0000 7fbabb436b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9d5c759e0 0x55a9d5c75dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:22.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.525+0000 7fbabb436b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9d5c76300 0x55a9d5c6ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:22.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.525+0000 7fbabb436b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a9d5c70600 0x55a9d5c70a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:22.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.525+0000 7fbabb436b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a9d5bc2a20 con 0x55a9d5c70600 2024-05-08T05:57:22.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.525+0000 7fbabb436b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a9d5b60760 con 0x55a9d5c76300 2024-05-08T05:57:22.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.525+0000 7fbabb436b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55a9d5bbe9e0 con 0x55a9d5c759e0 2024-05-08T05:57:22.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.525+0000 7fbaa9400700 1 --2- 172.21.15.82:0/1195433174 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fba900b2900 0x7fba900b4dc0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fbaac110750 tx=0x7fba98009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:57:22.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.525+0000 7fbaa9400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9d5c76300 0x55a9d5c6ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:22.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.525+0000 7fbaa9400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9d5c76300 0x55a9d5c6ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:54898/0 (socket says 172.21.15.82:54898) 2024-05-08T05:57:22.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.525+0000 7fbaa9400700 1 -- 172.21.15.82:0/3067128881 learned_addr learned my addr 172.21.15.82:0/3067128881 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:57:22.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.525+0000 7fbaaa800700 1 --2- 172.21.15.82:0/3067128881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a9d5c70600 0x55a9d5c70a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:22.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.526+0000 7fbaa9e00700 1 --2- 172.21.15.82:0/3067128881 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9d5c759e0 0x55a9d5c75dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:22.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.526+0000 7fbaa9400700 1 -- 172.21.15.82:0/3067128881 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9d5c759e0 msgr2=0x55a9d5c75dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:57:22.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.526+0000 7fbaa9400700 1 --2- 172.21.15.82:0/3067128881 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9d5c759e0 0x55a9d5c75dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:22.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.526+0000 7fbaa9400700 1 -- 172.21.15.82:0/3067128881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a9d5c70600 msgr2=0x55a9d5c70a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:57:22.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.526+0000 7fbaa9400700 1 --2- 172.21.15.82:0/3067128881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a9d5c70600 0x55a9d5c70a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:22.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.526+0000 7fbaa9400700 1 -- 172.21.15.82:0/3067128881 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9d5b0f8d0 con 0x55a9d5c76300 2024-05-08T05:57:22.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.528+0000 7fbaa9400700 1 --2- 172.21.15.82:0/3067128881 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9d5c76300 0x55a9d5c6ffe0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fba98004390 tx=0x7fba98014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38219aad6bde3b87 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:57:22.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.529+0000 7fba97400700 1 -- 172.21.15.82:0/3067128881 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba98003dc0 con 0x55a9d5c76300 2024-05-08T05:57:22.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.529+0000 7fba97400700 1 -- 172.21.15.82:0/3067128881 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba980268b0 con 0x55a9d5c76300 2024-05-08T05:57:22.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.530+0000 7fba97400700 1 -- 172.21.15.82:0/3067128881 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba9801e920 con 0x55a9d5c76300 2024-05-08T05:57:22.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.530+0000 7fbabb436b80 1 -- 172.21.15.82:0/3067128881 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9d5c76300 msgr2=0x55a9d5c6ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:22.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.530+0000 7fbabb436b80 1 --2- 172.21.15.82:0/3067128881 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9d5c76300 0x55a9d5c6ffe0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fba98004390 tx=0x7fba98014000 comp rx=0 tx=0).stop 2024-05-08T05:57:22.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.531+0000 7fbabb436b80 1 -- 172.21.15.82:0/3067128881 shutdown_connections 2024-05-08T05:57:22.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.531+0000 7fbabb436b80 1 --2- 172.21.15.82:0/3067128881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a9d5c70600 0x55a9d5c70a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:22.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.531+0000 7fbabb436b80 1 --2- 172.21.15.82:0/3067128881 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9d5c759e0 0x55a9d5c75dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:22.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.531+0000 7fbabb436b80 1 --2- 172.21.15.82:0/3067128881 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9d5c76300 0x55a9d5c6ffe0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:22.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.531+0000 7fbabb436b80 1 -- 172.21.15.82:0/3067128881 >> 172.21.15.82:0/3067128881 conn(0x55a9d5b9eb60 msgr2=0x55a9d5c6a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:57:22.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.531+0000 7fbabb436b80 1 -- 172.21.15.82:0/3067128881 shutdown_connections 2024-05-08T05:57:22.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.531+0000 7fbabb436b80 1 -- 172.21.15.82:0/3067128881 wait complete. 2024-05-08T05:57:22.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.532+0000 7fbabb436b80 1 -- start start 2024-05-08T05:57:22.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.532+0000 7fbabb436b80 1 Processor -- start 2024-05-08T05:57:22.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.533+0000 7fbabb436b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a9d5c70600 0x55a9d5c7be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:22.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.533+0000 7fbabb436b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9d5c759e0 0x55a9d5c7c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:22.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.533+0000 7fbabb436b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9d5c76300 0x55a9d5c793c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:22.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.533+0000 7fbabb436b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a9d5c7ce50 con 0x55a9d5c70600 2024-05-08T05:57:22.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.533+0000 7fbabb436b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a9d5b28b20 con 0x55a9d5c759e0 2024-05-08T05:57:22.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.533+0000 7fbabb436b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55a9d5c7cfd0 con 0x55a9d5c76300 2024-05-08T05:57:22.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.533+0000 7fbabb436b80 10 client.0 _ll_register_callbacks cb 0x55a9d5b69c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:57:22.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.533+0000 7fbaa9e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a9d5c70600 0x55a9d5c7be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:22.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.533+0000 7fbaa9e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a9d5c70600 0x55a9d5c7be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:45020/0 (socket says 172.21.15.82:45020) 2024-05-08T05:57:22.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.533+0000 7fbaa9e00700 1 -- 172.21.15.82:0/2688674380 learned_addr learned my addr 172.21.15.82:0/2688674380 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:57:22.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.533+0000 7fbaaa800700 1 --2- 172.21.15.82:0/2688674380 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9d5c76300 0x55a9d5c793c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:22.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.533+0000 7fbaa9400700 1 --2- 172.21.15.82:0/2688674380 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9d5c759e0 0x55a9d5c7c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:22.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.534+0000 7fbaa9e00700 1 -- 172.21.15.82:0/2688674380 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9d5c76300 msgr2=0x55a9d5c793c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:57:22.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.534+0000 7fbaa9e00700 1 --2- 172.21.15.82:0/2688674380 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9d5c76300 0x55a9d5c793c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:22.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.534+0000 7fbaa9e00700 1 -- 172.21.15.82:0/2688674380 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9d5c759e0 msgr2=0x55a9d5c7c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:57:22.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.534+0000 7fbaa9e00700 1 --2- 172.21.15.82:0/2688674380 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9d5c759e0 0x55a9d5c7c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:22.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.534+0000 7fbaa9e00700 1 -- 172.21.15.82:0/2688674380 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9d5b88420 con 0x55a9d5c70600 2024-05-08T05:57:22.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.534+0000 7fbaa9e00700 1 --2- 172.21.15.82:0/2688674380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a9d5c70600 0x55a9d5c7be20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fba9c010670 tx=0x7fba9c010980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8ec2af64e4359a1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:57:22.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.534+0000 7fba8be00700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T05:57:22.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.535+0000 7fba8be00700 1 -- 172.21.15.82:0/2688674380 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba9c016070 con 0x55a9d5c70600 2024-05-08T05:57:22.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.535+0000 7fba8be00700 1 -- 172.21.15.82:0/2688674380 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fba9c004220 con 0x55a9d5c70600 2024-05-08T05:57:22.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.535+0000 7fbabb436b80 1 -- 172.21.15.82:0/2688674380 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba980268b0 con 0x55a9d5c70600 2024-05-08T05:57:22.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.535+0000 7fba8be00700 1 -- 172.21.15.82:0/2688674380 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fba9c004420 con 0x55a9d5c70600 2024-05-08T05:57:22.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.535+0000 7fbabb436b80 10 client.15666 fetch_fsmap learned FSMap version 31 2024-05-08T05:57:22.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.535+0000 7fbabb436b80 1 -- 172.21.15.82:0/2688674380 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a9d5c87540 con 0x55a9d5c70600 2024-05-08T05:57:22.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.536+0000 7fba8be00700 1 -- 172.21.15.82:0/2688674380 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba980268b0 con 0x55a9d5c70600 2024-05-08T05:57:22.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.536+0000 7fba8be00700 1 -- 172.21.15.82:0/2688674380 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fba9c00f040 con 0x55a9d5c70600 2024-05-08T05:57:22.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.536+0000 7fbabb436b80 10 client.15666 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:57:22.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.536+0000 7fbabb436b80 10 client.15666 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:57:22.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.536+0000 7fbabb436b80 20 client.15666 populate_metadata read hostname 'smithi082' 2024-05-08T05:57:22.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.536+0000 7fbabb436b80 1 --2- 172.21.15.82:0/2688674380 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55a9d5c89c20 0x55a9d5c8c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:22.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.536+0000 7fbabb436b80 4 client.15666 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:57:22.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.536+0000 7fbabb436b80 1 -- 172.21.15.82:0/2688674380 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a9d5c3d0a0 con 0x55a9d5c89c20 2024-05-08T05:57:22.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.537+0000 7fbaa9400700 1 --2- 172.21.15.82:0/2688674380 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55a9d5c89c20 0x55a9d5c8c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:22.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.538+0000 7fba8be00700 10 client.15666 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:57:22.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.538+0000 7fbaa9400700 1 --2- 172.21.15.82:0/2688674380 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55a9d5c89c20 0x55a9d5c8c090 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5909bbe3b82ec1f server_cookie=ed5ae0309d01651f in_seq=0 out_seq=0 2024-05-08T05:57:22.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.538+0000 7fba8be00700 1 -- 172.21.15.82:0/2688674380 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a9d5c3d0a0 con 0x55a9d5c89c20 2024-05-08T05:57:22.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.538+0000 7fba8be00700 10 client.15666 handle_command_reply: tid=0 2024-05-08T05:57:22.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.539+0000 7fbabb436b80 1 client.15666 shutdown 2024-05-08T05:57:22.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.539+0000 7fbabb436b80 1 -- 172.21.15.82:0/2688674380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a9d5c70600 msgr2=0x55a9d5c7be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:22.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.539+0000 7fbabb436b80 1 --2- 172.21.15.82:0/2688674380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a9d5c70600 0x55a9d5c7be20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fba9c010670 tx=0x7fba9c010980 comp rx=0 tx=0).stop 2024-05-08T05:57:22.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.539+0000 7fbabb436b80 1 -- 172.21.15.82:0/2688674380 shutdown_connections 2024-05-08T05:57:22.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.539+0000 7fbabb436b80 1 --2- 172.21.15.82:0/2688674380 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9d5c76300 0x55a9d5c793c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:22.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.539+0000 7fbabb436b80 1 --2- 172.21.15.82:0/2688674380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a9d5c70600 0x55a9d5c7be20 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:22.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.539+0000 7fbabb436b80 1 --2- 172.21.15.82:0/2688674380 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55a9d5c89c20 0x55a9d5c8c090 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:22.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.539+0000 7fbabb436b80 1 --2- 172.21.15.82:0/2688674380 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9d5c759e0 0x55a9d5c7c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:22.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.539+0000 7fba8be00700 0 client.15666 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:57:22.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.539+0000 7fbabb436b80 1 -- 172.21.15.82:0/2688674380 >> 172.21.15.82:0/2688674380 conn(0x55a9d5b9eb60 msgr2=0x55a9d5c65460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:57:22.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.539+0000 7fbabb436b80 1 -- 172.21.15.82:0/2688674380 shutdown_connections 2024-05-08T05:57:22.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.539+0000 7fbabb436b80 1 -- 172.21.15.82:0/2688674380 wait complete. 2024-05-08T05:57:22.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.540+0000 7fbabb436b80 20 client.15666 trim_cache size 0 max 16384 2024-05-08T05:57:22.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.560+0000 7fbabb436b80 1 Processor -- start 2024-05-08T05:57:22.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.561+0000 7fbabb436b80 1 -- start start 2024-05-08T05:57:22.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.561+0000 7fbabb436b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9d5c70600 0x55a9d5c6ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:22.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.561+0000 7fbabb436b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9d5c759e0 0x55a9d5c919a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:22.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.561+0000 7fbabb436b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a9d5c76300 0x55a9d5c91ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:22.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.561+0000 7fbabb436b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbaac1afbd0 con 0x55a9d5c76300 2024-05-08T05:57:22.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.561+0000 7fbabb436b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbaac1b1710 con 0x55a9d5c70600 2024-05-08T05:57:22.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.561+0000 7fbabb436b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fbaac1b02a0 con 0x55a9d5c759e0 2024-05-08T05:57:22.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.562+0000 7fbaa9e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9d5c70600 0x55a9d5c6ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:22.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.562+0000 7fbaaa800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a9d5c76300 0x55a9d5c91ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:22.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.562+0000 7fbaa9e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9d5c70600 0x55a9d5c6ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:54914/0 (socket says 172.21.15.82:54914) 2024-05-08T05:57:22.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.562+0000 7fbaa9e00700 1 -- 172.21.15.82:0/1382548409 learned_addr learned my addr 172.21.15.82:0/1382548409 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:57:22.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.562+0000 7fbaa9400700 1 --2- 172.21.15.82:0/1382548409 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9d5c759e0 0x55a9d5c919a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:22.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.562+0000 7fbaa9400700 1 -- 172.21.15.82:0/1382548409 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9d5c70600 msgr2=0x55a9d5c6ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:57:22.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.562+0000 7fbaa9400700 1 --2- 172.21.15.82:0/1382548409 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9d5c70600 0x55a9d5c6ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:22.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.562+0000 7fbaa9400700 1 -- 172.21.15.82:0/1382548409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a9d5c76300 msgr2=0x55a9d5c91ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:57:22.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.562+0000 7fbaa9400700 1 --2- 172.21.15.82:0/1382548409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a9d5c76300 0x55a9d5c91ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:22.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.562+0000 7fbaa9400700 1 -- 172.21.15.82:0/1382548409 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9d5c6aeb0 con 0x55a9d5c759e0 2024-05-08T05:57:22.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.563+0000 7fbaa9400700 1 --2- 172.21.15.82:0/1382548409 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9d5c759e0 0x55a9d5c919a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x55a9d5c7a790 tx=0x7fba9801e500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34f63d9cd0b5e002 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:57:22.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.563+0000 7fba96a00700 1 -- 172.21.15.82:0/1382548409 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba98005230 con 0x55a9d5c759e0 2024-05-08T05:57:22.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.564+0000 7fba96a00700 1 -- 172.21.15.82:0/1382548409 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba98004bc0 con 0x55a9d5c759e0 2024-05-08T05:57:22.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.564+0000 7fba96a00700 1 -- 172.21.15.82:0/1382548409 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba9801e570 con 0x55a9d5c759e0 2024-05-08T05:57:22.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.565+0000 7fbabb436b80 1 -- 172.21.15.82:0/1382548409 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9d5c759e0 msgr2=0x55a9d5c919a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:22.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.565+0000 7fbabb436b80 1 --2- 172.21.15.82:0/1382548409 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9d5c759e0 0x55a9d5c919a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x55a9d5c7a790 tx=0x7fba9801e500 comp rx=0 tx=0).stop 2024-05-08T05:57:22.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.565+0000 7fbabb436b80 1 -- 172.21.15.82:0/1382548409 shutdown_connections 2024-05-08T05:57:22.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.565+0000 7fbabb436b80 1 --2- 172.21.15.82:0/1382548409 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9d5c70600 0x55a9d5c6ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:22.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.565+0000 7fbabb436b80 1 --2- 172.21.15.82:0/1382548409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a9d5c76300 0x55a9d5c91ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:22.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.565+0000 7fbabb436b80 1 --2- 172.21.15.82:0/1382548409 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9d5c759e0 0x55a9d5c919a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:22.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.565+0000 7fbabb436b80 1 -- 172.21.15.82:0/1382548409 >> 172.21.15.82:0/1382548409 conn(0x55a9d5b9eb60 msgr2=0x55a9d5c77ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:57:22.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.565+0000 7fbabb436b80 1 -- 172.21.15.82:0/1382548409 shutdown_connections 2024-05-08T05:57:22.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.565+0000 7fbabb436b80 1 -- 172.21.15.82:0/1382548409 wait complete. 2024-05-08T05:57:22.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.566+0000 7fbabb436b80 1 -- start start 2024-05-08T05:57:22.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.566+0000 7fbabb436b80 1 Processor -- start 2024-05-08T05:57:22.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.567+0000 7fbabb436b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9d5c70600 0x55a9d5c82860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:22.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.567+0000 7fbabb436b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a9d5c759e0 0x55a9d5c90f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:22.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.567+0000 7fbabb436b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9d5c76300 0x55a9d5c914d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:22.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.567+0000 7fbabb436b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbaac1b1040 con 0x55a9d5c759e0 2024-05-08T05:57:22.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.567+0000 7fbabb436b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbaac1b0970 con 0x55a9d5c76300 2024-05-08T05:57:22.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.567+0000 7fbabb436b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fbaac1adb70 con 0x55a9d5c70600 2024-05-08T05:57:22.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.567+0000 7fbabb436b80 10 client.0 _ll_register_callbacks cb 0x55a9d5b69c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:57:22.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.567+0000 7fbaaa800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9d5c76300 0x55a9d5c914d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:22.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.567+0000 7fbaaa800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9d5c76300 0x55a9d5c914d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:54922/0 (socket says 172.21.15.82:54922) 2024-05-08T05:57:22.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.567+0000 7fbaaa800700 1 -- 172.21.15.82:0/2646188799 learned_addr learned my addr 172.21.15.82:0/2646188799 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:57:22.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.567+0000 7fbaa9400700 1 --2- 172.21.15.82:0/2646188799 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a9d5c759e0 0x55a9d5c90f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:22.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.567+0000 7fbaaa800700 1 -- 172.21.15.82:0/2646188799 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9d5c70600 msgr2=0x55a9d5c82860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:57:22.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.567+0000 7fbaaa800700 1 --2- 172.21.15.82:0/2646188799 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9d5c70600 0x55a9d5c82860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:22.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.567+0000 7fbaaa800700 1 -- 172.21.15.82:0/2646188799 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a9d5c759e0 msgr2=0x55a9d5c90f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:57:22.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.567+0000 7fbaaa800700 1 --2- 172.21.15.82:0/2646188799 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a9d5c759e0 0x55a9d5c90f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:22.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.567+0000 7fbaaa800700 1 -- 172.21.15.82:0/2646188799 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9d5c91d60 con 0x55a9d5c76300 2024-05-08T05:57:22.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.568+0000 7fbaa9400700 1 --2- 172.21.15.82:0/2646188799 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a9d5c759e0 0x55a9d5c90f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:57:22.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.568+0000 7fbaaa800700 1 --2- 172.21.15.82:0/2646188799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9d5c76300 0x55a9d5c914d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbaa40a6da0 tx=0x7fbaa4004f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6ca05ae374de67ee server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:57:22.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.568+0000 7fba8be00700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:57:22.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.568+0000 7fba8be00700 1 -- 172.21.15.82:0/2646188799 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaa4003e00 con 0x55a9d5c76300 2024-05-08T05:57:22.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.568+0000 7fba8be00700 1 -- 172.21.15.82:0/2646188799 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fbaa40aa190 con 0x55a9d5c76300 2024-05-08T05:57:22.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.568+0000 7fbabb436b80 1 -- 172.21.15.82:0/2646188799 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba98004bc0 con 0x55a9d5c76300 2024-05-08T05:57:22.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.568+0000 7fba8be00700 1 -- 172.21.15.82:0/2646188799 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fbaa40b3430 con 0x55a9d5c76300 2024-05-08T05:57:22.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.568+0000 7fbabb436b80 10 client.25925 fetch_fsmap learned FSMap version 31 2024-05-08T05:57:22.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.568+0000 7fbabb436b80 1 -- 172.21.15.82:0/2646188799 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a9d5cfce70 con 0x55a9d5c76300 2024-05-08T05:57:22.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.568+0000 7fba8be00700 1 -- 172.21.15.82:0/2646188799 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fba98004bc0 con 0x55a9d5c76300 2024-05-08T05:57:22.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.569+0000 7fba8be00700 1 -- 172.21.15.82:0/2646188799 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fbaa4011070 con 0x55a9d5c76300 2024-05-08T05:57:22.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.569+0000 7fbabb436b80 10 client.25925 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:57:22.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.569+0000 7fbabb436b80 10 client.25925 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:57:22.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.569+0000 7fbabb436b80 20 client.25925 populate_metadata read hostname 'smithi082' 2024-05-08T05:57:22.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.569+0000 7fbabb436b80 1 --2- 172.21.15.82:0/2646188799 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55a9d5cfd520 0x55a9d5cff9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:22.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.569+0000 7fbabb436b80 4 client.25925 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:57:22.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.569+0000 7fbabb436b80 1 -- 172.21.15.82:0/2646188799 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a9d5bd0400 con 0x55a9d5cfd520 2024-05-08T05:57:22.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.570+0000 7fbaa9e00700 1 --2- 172.21.15.82:0/2646188799 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55a9d5cfd520 0x55a9d5cff9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:22.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.570+0000 7fbaa9e00700 1 --2- 172.21.15.82:0/2646188799 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55a9d5cfd520 0x55a9d5cff9a0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a577753af587caf9 server_cookie=bf36ed96e177c3fa in_seq=0 out_seq=0 2024-05-08T05:57:22.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.570+0000 7fba8be00700 10 client.25925 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:57:22.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.570+0000 7fba8be00700 1 -- 172.21.15.82:0/2646188799 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a9d5bd0400 con 0x55a9d5cfd520 2024-05-08T05:57:22.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.570+0000 7fba8be00700 10 client.25925 handle_command_reply: tid=0 2024-05-08T05:57:22.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.570+0000 7fbabb436b80 1 client.25925 shutdown 2024-05-08T05:57:22.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.571+0000 7fbabb436b80 1 -- 172.21.15.82:0/2646188799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9d5c76300 msgr2=0x55a9d5c914d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:22.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.571+0000 7fbabb436b80 1 --2- 172.21.15.82:0/2646188799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9d5c76300 0x55a9d5c914d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbaa40a6da0 tx=0x7fbaa4004f60 comp rx=0 tx=0).stop 2024-05-08T05:57:22.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.571+0000 7fbabb436b80 1 -- 172.21.15.82:0/2646188799 shutdown_connections 2024-05-08T05:57:22.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.571+0000 7fbabb436b80 1 --2- 172.21.15.82:0/2646188799 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55a9d5cfd520 0x55a9d5cff9a0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:22.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.571+0000 7fbabb436b80 1 --2- 172.21.15.82:0/2646188799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9d5c76300 0x55a9d5c914d0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:22.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.571+0000 7fbabb436b80 1 --2- 172.21.15.82:0/2646188799 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a9d5c70600 0x55a9d5c82860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:22.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.571+0000 7fba8be00700 0 client.25925 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:57:22.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.571+0000 7fbabb436b80 1 --2- 172.21.15.82:0/2646188799 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a9d5c759e0 0x55a9d5c90f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:22.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.571+0000 7fbabb436b80 1 -- 172.21.15.82:0/2646188799 >> 172.21.15.82:0/2646188799 conn(0x55a9d5b9eb60 msgr2=0x55a9d5c766e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:57:22.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.571+0000 7fbabb436b80 1 -- 172.21.15.82:0/2646188799 shutdown_connections 2024-05-08T05:57:22.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.571+0000 7fbabb436b80 1 -- 172.21.15.82:0/2646188799 wait complete. 2024-05-08T05:57:22.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.571+0000 7fbabb436b80 20 client.25925 trim_cache size 0 max 16384 2024-05-08T05:57:22.576 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T05:57:22.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.573+0000 7fbaab200700 1 -- 172.21.15.82:0/1195433174 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fba900b2900 msgr2=0x7fba900b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:22.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.573+0000 7fbaab200700 1 --2- 172.21.15.82:0/1195433174 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fba900b2900 0x7fba900b4dc0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fbaac110750 tx=0x7fba98009260 comp rx=0 tx=0).stop 2024-05-08T05:57:22.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.573+0000 7fbaab200700 1 -- 172.21.15.82:0/1195433174 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbaac109460 msgr2=0x7fbaac19ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:22.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.573+0000 7fbaab200700 1 --2- 172.21.15.82:0/1195433174 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbaac109460 0x7fbaac19ba10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fbaa40062a0 tx=0x7fbaa4004c80 comp rx=0 tx=0).stop 2024-05-08T05:57:22.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.574+0000 7fbaab200700 1 -- 172.21.15.82:0/1195433174 shutdown_connections 2024-05-08T05:57:22.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.574+0000 7fbaab200700 1 --2- 172.21.15.82:0/1195433174 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbaac1033d0 0x7fbaac1a1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:22.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.574+0000 7fbaab200700 1 --2- 172.21.15.82:0/1195433174 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fba900b2900 0x7fba900b4dc0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:22.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.574+0000 7fbaab200700 1 --2- 172.21.15.82:0/1195433174 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbaac109460 0x7fbaac19ba10 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:22.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.574+0000 7fbaab200700 1 --2- 172.21.15.82:0/1195433174 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbaac103d90 0x7fbaac1a1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:22.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.574+0000 7fbaab200700 1 -- 172.21.15.82:0/1195433174 >> 172.21.15.82:0/1195433174 conn(0x7fbaac0fef20 msgr2=0x7fbaac0ff460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:57:22.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.574+0000 7fbaab200700 1 -- 172.21.15.82:0/1195433174 shutdown_connections 2024-05-08T05:57:22.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:22.575+0000 7fbaab200700 1 -- 172.21.15.82:0/1195433174 wait complete. 2024-05-08T05:57:23.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:57:23 smithi082 ceph-mon[30098]: pgmap v661: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.7 MiB/s wr, 676 op/s 2024-05-08T05:57:23.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:57:23 smithi134 ceph-mon[34132]: pgmap v661: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.7 MiB/s wr, 676 op/s 2024-05-08T05:57:23.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:57:23 smithi151 ceph-mon[34815]: pgmap v661: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.7 MiB/s wr, 676 op/s 2024-05-08T05:57:24.491 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-08T05:57:24.491 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-05-08T05:57:25.086 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:57:25.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 395.0 s, 1938.4 tps, lat 51.575 ms stddev 56.916 2024-05-08T05:57:25.560 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:57:25 smithi082 ceph-mon[30098]: pgmap v662: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.0 MiB/s wr, 640 op/s 2024-05-08T05:57:25.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:57:25 smithi134 ceph-mon[34132]: pgmap v662: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.0 MiB/s wr, 640 op/s 2024-05-08T05:57:25.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:57:25 smithi151 ceph-mon[34815]: pgmap v662: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.0 MiB/s wr, 640 op/s 2024-05-08T05:57:27.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.440+0000 7f0b24a00700 1 -- 172.21.15.82:0/3278422280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b201055d0 msgr2=0x7f0b20105a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:27.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.440+0000 7f0b24a00700 1 --2- 172.21.15.82:0/3278422280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b201055d0 0x7f0b20105a50 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0b10009990 tx=0x7f0b10009ca0 comp rx=0 tx=0).stop 2024-05-08T05:57:27.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.441+0000 7f0b24a00700 1 -- 172.21.15.82:0/3278422280 shutdown_connections 2024-05-08T05:57:27.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.441+0000 7f0b24a00700 1 --2- 172.21.15.82:0/3278422280 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b2010b660 0x7f0b2010ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:27.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.441+0000 7f0b24a00700 1 --2- 172.21.15.82:0/3278422280 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b20105f90 0x7f0b201124a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:27.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.441+0000 7f0b24a00700 1 --2- 172.21.15.82:0/3278422280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b201055d0 0x7f0b20105a50 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:27.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.441+0000 7f0b24a00700 1 -- 172.21.15.82:0/3278422280 >> 172.21.15.82:0/3278422280 conn(0x7f0b20101080 msgr2=0x7f0b201034a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:57:27.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.441+0000 7f0b24a00700 1 -- 172.21.15.82:0/3278422280 shutdown_connections 2024-05-08T05:57:27.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.441+0000 7f0b24a00700 1 -- 172.21.15.82:0/3278422280 wait complete. 2024-05-08T05:57:27.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.442+0000 7f0b24a00700 1 Processor -- start 2024-05-08T05:57:27.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.443+0000 7f0b24a00700 1 -- start start 2024-05-08T05:57:27.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.444+0000 7f0b24a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b201055d0 0x7f0b2019bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:27.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.444+0000 7f0b24a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b20105f90 0x7f0b2019c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:27.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.444+0000 7f0b24a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b2010b660 0x7f0b201a0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:27.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.444+0000 7f0b1e800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b201055d0 0x7f0b2019bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:27.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.444+0000 7f0b1e800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b201055d0 0x7f0b2019bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:49168/0 (socket says 172.21.15.82:49168) 2024-05-08T05:57:27.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.444+0000 7f0b24a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0b201158e0 con 0x7f0b20105f90 2024-05-08T05:57:27.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.444+0000 7f0b24a00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0b20115760 con 0x7f0b2010b660 2024-05-08T05:57:27.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.444+0000 7f0b24a00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0b20115a60 con 0x7f0b201055d0 2024-05-08T05:57:27.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.444+0000 7f0b1de00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b20105f90 0x7f0b2019c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:27.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.445+0000 7f0b1f200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b2010b660 0x7f0b201a0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:27.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.445+0000 7f0b1de00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b20105f90 0x7f0b2019c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40806/0 (socket says 172.21.15.82:40806) 2024-05-08T05:57:27.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.445+0000 7f0b1de00700 1 -- 172.21.15.82:0/3419440217 learned_addr learned my addr 172.21.15.82:0/3419440217 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:57:27.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.445+0000 7f0b1f200700 1 -- 172.21.15.82:0/3419440217 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b201055d0 msgr2=0x7f0b2019bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:27.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.445+0000 7f0b1f200700 1 --2- 172.21.15.82:0/3419440217 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b201055d0 0x7f0b2019bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:27.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.445+0000 7f0b1f200700 1 -- 172.21.15.82:0/3419440217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b20105f90 msgr2=0x7f0b2019c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:27.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.445+0000 7f0b1f200700 1 --2- 172.21.15.82:0/3419440217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b20105f90 0x7f0b2019c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:27.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.445+0000 7f0b1f200700 1 -- 172.21.15.82:0/3419440217 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b201a0da0 con 0x7f0b2010b660 2024-05-08T05:57:27.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.446+0000 7f0b1f200700 1 --2- 172.21.15.82:0/3419440217 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b2010b660 0x7f0b201a0660 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0b1800be20 tx=0x7f0b18009ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:57:27.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.449+0000 7f0b17400700 1 -- 172.21.15.82:0/3419440217 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b18019070 con 0x7f0b2010b660 2024-05-08T05:57:27.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.449+0000 7f0b17400700 1 -- 172.21.15.82:0/3419440217 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b1800cb90 con 0x7f0b2010b660 2024-05-08T05:57:27.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.449+0000 7f0b17400700 1 -- 172.21.15.82:0/3419440217 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b180125a0 con 0x7f0b2010b660 2024-05-08T05:57:27.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.449+0000 7f0b24a00700 1 -- 172.21.15.82:0/3419440217 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b201a1090 con 0x7f0b2010b660 2024-05-08T05:57:27.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.449+0000 7f0b24a00700 1 -- 172.21.15.82:0/3419440217 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b201a8910 con 0x7f0b2010b660 2024-05-08T05:57:27.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.460+0000 7f0b17400700 1 -- 172.21.15.82:0/3419440217 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f0b1801c070 con 0x7f0b2010b660 2024-05-08T05:57:27.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.460+0000 7f0b2fcabb80 1 Processor -- start 2024-05-08T05:57:27.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.463+0000 7f0b2fcabb80 1 -- start start 2024-05-08T05:57:27.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.464+0000 7f0b2fcabb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5581e530ee20 0x5581e530f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:27.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.464+0000 7f0b2fcabb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581e530f740 0x5581e53094b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:27.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.464+0000 7f0b2fcabb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5581e5309ad0 0x5581e5309f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:27.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.464+0000 7f0b2fcabb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5581e525baa0 con 0x5581e5309ad0 2024-05-08T05:57:27.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.464+0000 7f0b2fcabb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5581e51f97e0 con 0x5581e530ee20 2024-05-08T05:57:27.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.464+0000 7f0b2fcabb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5581e5257a60 con 0x5581e530f740 2024-05-08T05:57:27.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.464+0000 7f0b1de00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5581e530ee20 0x5581e530f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:27.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.465+0000 7f0b1de00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5581e530ee20 0x5581e530f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:39848/0 (socket says 172.21.15.82:39848) 2024-05-08T05:57:27.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.465+0000 7f0b1de00700 1 -- 172.21.15.82:0/190968659 learned_addr learned my addr 172.21.15.82:0/190968659 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:57:27.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.465+0000 7f0b1de00700 1 --2- 172.21.15.82:0/190968659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5581e5309ad0 0x5581e5309f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:27.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.466+0000 7f0b1e800700 1 --2- 172.21.15.82:0/190968659 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581e530f740 0x5581e53094b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:27.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.467+0000 7f0b17400700 1 --2- 172.21.15.82:0/3419440217 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f0b040b29d0 0x7f0b040b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:27.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.468+0000 7f0b1de00700 1 -- 172.21.15.82:0/190968659 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581e530f740 msgr2=0x5581e53094b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:57:27.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.468+0000 7f0b1de00700 1 --2- 172.21.15.82:0/190968659 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581e530f740 0x5581e53094b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:27.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.468+0000 7f0b1de00700 1 -- 172.21.15.82:0/190968659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5581e5309ad0 msgr2=0x5581e5309f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:57:27.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.468+0000 7f0b1de00700 1 --2- 172.21.15.82:0/190968659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5581e5309ad0 0x5581e5309f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:27.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.468+0000 7f0b1de00700 1 -- 172.21.15.82:0/190968659 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581e51a8950 con 0x5581e530ee20 2024-05-08T05:57:27.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.468+0000 7f0b17400700 1 -- 172.21.15.82:0/3419440217 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f0b180e1790 con 0x7f0b2010b660 2024-05-08T05:57:27.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.468+0000 7f0b1f200700 1 --2- 172.21.15.82:0/3419440217 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f0b040b29d0 0x7f0b040b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:27.469 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.469+0000 7f0b1de00700 1 --2- 172.21.15.82:0/190968659 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5581e530ee20 0x5581e530f200 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0b10009750 tx=0x7f0b1001a040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebc117e7f519e3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:57:27.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.469+0000 7f0b1f200700 1 --2- 172.21.15.82:0/3419440217 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f0b040b29d0 0x7f0b040b4e90 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0b180df2a0 tx=0x7f0b18004ad0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:57:27.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.470+0000 7f0b0be00700 1 -- 172.21.15.82:0/190968659 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b100039b0 con 0x5581e530ee20 2024-05-08T05:57:27.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.470+0000 7f0b0be00700 1 -- 172.21.15.82:0/190968659 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b1000b8d0 con 0x5581e530ee20 2024-05-08T05:57:27.470 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.470+0000 7f0b0be00700 1 -- 172.21.15.82:0/190968659 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b10005330 con 0x5581e530ee20 2024-05-08T05:57:27.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.471+0000 7f0b2fcabb80 1 -- 172.21.15.82:0/190968659 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5581e530ee20 msgr2=0x5581e530f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:27.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.472+0000 7f0b2fcabb80 1 --2- 172.21.15.82:0/190968659 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5581e530ee20 0x5581e530f200 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f0b10009750 tx=0x7f0b1001a040 comp rx=0 tx=0).stop 2024-05-08T05:57:27.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.472+0000 7f0b2fcabb80 1 -- 172.21.15.82:0/190968659 shutdown_connections 2024-05-08T05:57:27.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.472+0000 7f0b2fcabb80 1 --2- 172.21.15.82:0/190968659 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5581e530ee20 0x5581e530f200 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:27.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.472+0000 7f0b2fcabb80 1 --2- 172.21.15.82:0/190968659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5581e5309ad0 0x5581e5309f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:27.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.472+0000 7f0b2fcabb80 1 --2- 172.21.15.82:0/190968659 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581e530f740 0x5581e53094b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:27.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.472+0000 7f0b2fcabb80 1 -- 172.21.15.82:0/190968659 >> 172.21.15.82:0/190968659 conn(0x5581e5281750 msgr2=0x5581e5303d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:57:27.472 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.473+0000 7f0b2fcabb80 1 -- 172.21.15.82:0/190968659 shutdown_connections 2024-05-08T05:57:27.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.473+0000 7f0b2fcabb80 1 -- 172.21.15.82:0/190968659 wait complete. 2024-05-08T05:57:27.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.473+0000 7f0b2fcabb80 1 -- start start 2024-05-08T05:57:27.473 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.474+0000 7f0b2fcabb80 1 Processor -- start 2024-05-08T05:57:27.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.474+0000 7f0b2fcabb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581e5309ad0 0x5581e5315490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:27.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.474+0000 7f0b2fcabb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5581e530ee20 0x5581e5312830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:27.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.474+0000 7f0b2fcabb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5581e530f740 0x5581e5312d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:27.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.474+0000 7f0b2fcabb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5581e531e980 con 0x5581e530ee20 2024-05-08T05:57:27.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.474+0000 7f0b2fcabb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5581e51c1ba0 con 0x5581e530f740 2024-05-08T05:57:27.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.474+0000 7f0b2fcabb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5581e531eb00 con 0x5581e5309ad0 2024-05-08T05:57:27.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.474+0000 7f0b2fcabb80 10 client.0 _ll_register_callbacks cb 0x5581e5202cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:57:27.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.475+0000 7f0b1de00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581e5309ad0 0x5581e5315490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:27.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.475+0000 7f0b1de00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581e5309ad0 0x5581e5315490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:49188/0 (socket says 172.21.15.82:49188) 2024-05-08T05:57:27.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.475+0000 7f0b1de00700 1 -- 172.21.15.82:0/3295042919 learned_addr learned my addr 172.21.15.82:0/3295042919 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:57:27.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.475+0000 7f0b1de00700 1 --2- 172.21.15.82:0/3295042919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5581e530f740 0x5581e5312d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:27.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.476+0000 7f0b1de00700 1 -- 172.21.15.82:0/3295042919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5581e530f740 msgr2=0x5581e5312d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:57:27.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.476+0000 7f0b1de00700 1 --2- 172.21.15.82:0/3295042919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5581e530f740 0x5581e5312d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:27.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.476+0000 7f0b1de00700 1 -- 172.21.15.82:0/3295042919 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5581e530ee20 msgr2=0x5581e5312830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:57:27.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.476+0000 7f0b1de00700 1 --2- 172.21.15.82:0/3295042919 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5581e530ee20 0x5581e5312830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:27.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.476+0000 7f0b1de00700 1 -- 172.21.15.82:0/3295042919 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581e52214a0 con 0x5581e5309ad0 2024-05-08T05:57:27.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.476+0000 7f0b1de00700 1 --2- 172.21.15.82:0/3295042919 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581e5309ad0 0x5581e5315490 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0b10009ce0 tx=0x7f0b10005e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=770b4fc5b3192397 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:57:27.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.476+0000 7f0b08c00700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:57:27.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.477+0000 7f0b08c00700 1 -- 172.21.15.82:0/3295042919 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b10003bc0 con 0x5581e5309ad0 2024-05-08T05:57:27.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.477+0000 7f0b08c00700 1 -- 172.21.15.82:0/3295042919 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f0b10021040 con 0x5581e5309ad0 2024-05-08T05:57:27.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.478+0000 7f0b2fcabb80 1 -- 172.21.15.82:0/3295042919 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b1000b8d0 con 0x5581e5309ad0 2024-05-08T05:57:27.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.478+0000 7f0b08c00700 1 -- 172.21.15.82:0/3295042919 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f0b100050d0 con 0x5581e5309ad0 2024-05-08T05:57:27.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.479+0000 7f0b2fcabb80 10 client.25978 fetch_fsmap learned FSMap version 31 2024-05-08T05:57:27.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.479+0000 7f0b2fcabb80 1 -- 172.21.15.82:0/3295042919 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5581e531e980 con 0x5581e5309ad0 2024-05-08T05:57:27.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.479+0000 7f0b08c00700 1 -- 172.21.15.82:0/3295042919 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b1000b8d0 con 0x5581e5309ad0 2024-05-08T05:57:27.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.479+0000 7f0b08c00700 1 -- 172.21.15.82:0/3295042919 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f0b10024070 con 0x5581e5309ad0 2024-05-08T05:57:27.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.480+0000 7f0b2fcabb80 10 client.25978 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:57:27.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.480+0000 7f0b2fcabb80 10 client.25978 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:57:27.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.480+0000 7f0b2fcabb80 20 client.25978 populate_metadata read hostname 'smithi082' 2024-05-08T05:57:27.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.480+0000 7f0b2fcabb80 1 --2- 172.21.15.82:0/3295042919 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5581e532b530 0x5581e532d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:27.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.480+0000 7f0b2fcabb80 4 client.25978 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:57:27.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.480+0000 7f0b2fcabb80 1 -- 172.21.15.82:0/3295042919 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5581e52d61c0 con 0x5581e532b530 2024-05-08T05:57:27.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.480+0000 7f0b1e800700 1 --2- 172.21.15.82:0/3295042919 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5581e532b530 0x5581e532d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:27.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.481+0000 7f0b08c00700 10 client.25978 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:57:27.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.481+0000 7f0b1e800700 1 --2- 172.21.15.82:0/3295042919 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5581e532b530 0x5581e532d920 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e090eb2112399306 server_cookie=877c2151aef0ac93 in_seq=0 out_seq=0 2024-05-08T05:57:27.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.482+0000 7f0b08c00700 1 -- 172.21.15.82:0/3295042919 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5581e52d61c0 con 0x5581e532b530 2024-05-08T05:57:27.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.482+0000 7f0b08c00700 10 client.25978 handle_command_reply: tid=0 2024-05-08T05:57:27.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.482+0000 7f0b2fcabb80 1 client.25978 shutdown 2024-05-08T05:57:27.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.482+0000 7f0b2fcabb80 1 -- 172.21.15.82:0/3295042919 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581e5309ad0 msgr2=0x5581e5315490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:27.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.482+0000 7f0b2fcabb80 1 --2- 172.21.15.82:0/3295042919 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581e5309ad0 0x5581e5315490 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0b10009ce0 tx=0x7f0b10005e80 comp rx=0 tx=0).stop 2024-05-08T05:57:27.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.482+0000 7f0b2fcabb80 1 -- 172.21.15.82:0/3295042919 shutdown_connections 2024-05-08T05:57:27.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.482+0000 7f0b2fcabb80 1 --2- 172.21.15.82:0/3295042919 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5581e532b530 0x5581e532d920 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:27.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.482+0000 7f0b2fcabb80 1 --2- 172.21.15.82:0/3295042919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5581e530f740 0x5581e5312d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:27.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.482+0000 7f0b2fcabb80 1 --2- 172.21.15.82:0/3295042919 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581e5309ad0 0x5581e5315490 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:27.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.482+0000 7f0b2fcabb80 1 --2- 172.21.15.82:0/3295042919 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5581e530ee20 0x5581e5312830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:27.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.482+0000 7f0b2fcabb80 1 -- 172.21.15.82:0/3295042919 >> 172.21.15.82:0/3295042919 conn(0x5581e5281750 msgr2=0x5581e52fe7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:57:27.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.482+0000 7f0b08c00700 0 client.25978 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:57:27.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.483+0000 7f0b2fcabb80 1 -- 172.21.15.82:0/3295042919 shutdown_connections 2024-05-08T05:57:27.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.483+0000 7f0b2fcabb80 1 -- 172.21.15.82:0/3295042919 wait complete. 2024-05-08T05:57:27.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.483+0000 7f0b2fcabb80 20 client.25978 trim_cache size 0 max 16384 2024-05-08T05:57:27.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.517+0000 7f0b2fcabb80 1 Processor -- start 2024-05-08T05:57:27.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.517+0000 7f0b2fcabb80 1 -- start start 2024-05-08T05:57:27.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.518+0000 7f0b2fcabb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5581e5309ad0 0x5581e53094b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:27.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.518+0000 7f0b2fcabb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5581e530ee20 0x5581e5327a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:27.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.518+0000 7f0b2fcabb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581e530f740 0x5581e53119b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:27.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.518+0000 7f0b2fcabb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0b201ab880 con 0x5581e5309ad0 2024-05-08T05:57:27.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.518+0000 7f0b2fcabb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0b201ad3c0 con 0x5581e530ee20 2024-05-08T05:57:27.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.518+0000 7f0b2fcabb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0b201abf50 con 0x5581e530f740 2024-05-08T05:57:27.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.519+0000 7f0b1de00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5581e5309ad0 0x5581e53094b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:27.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.519+0000 7f0b1de00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5581e5309ad0 0x5581e53094b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40838/0 (socket says 172.21.15.82:40838) 2024-05-08T05:57:27.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.519+0000 7f0b1de00700 1 -- 172.21.15.82:0/264952108 learned_addr learned my addr 172.21.15.82:0/264952108 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:57:27.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.519+0000 7f0b1de00700 1 --2- 172.21.15.82:0/264952108 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581e530f740 0x5581e53119b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:27.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.519+0000 7f0b1e800700 1 --2- 172.21.15.82:0/264952108 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5581e530ee20 0x5581e5327a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:27.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.519+0000 7f0b1de00700 1 -- 172.21.15.82:0/264952108 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581e530f740 msgr2=0x5581e53119b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:57:27.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.519+0000 7f0b1de00700 1 --2- 172.21.15.82:0/264952108 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581e530f740 0x5581e53119b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:27.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.519+0000 7f0b1de00700 1 -- 172.21.15.82:0/264952108 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5581e530ee20 msgr2=0x5581e5327a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:57:27.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.519+0000 7f0b1de00700 1 --2- 172.21.15.82:0/264952108 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5581e530ee20 0x5581e5327a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:27.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.519+0000 7f0b1de00700 1 -- 172.21.15.82:0/264952108 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581e5304b40 con 0x5581e5309ad0 2024-05-08T05:57:27.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.519+0000 7f0b1e800700 1 --2- 172.21.15.82:0/264952108 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5581e530ee20 0x5581e5327a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:57:27.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.520+0000 7f0b1de00700 1 --2- 172.21.15.82:0/264952108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5581e5309ad0 0x5581e53094b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0b1000bb70 tx=0x7f0b1000bb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62caf5ffea8e87ef server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:57:27.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.520+0000 7f0b0b400700 1 -- 172.21.15.82:0/264952108 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b10003bc0 con 0x5581e5309ad0 2024-05-08T05:57:27.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.520+0000 7f0b0b400700 1 -- 172.21.15.82:0/264952108 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b1000b6a0 con 0x5581e5309ad0 2024-05-08T05:57:27.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.520+0000 7f0b0b400700 1 -- 172.21.15.82:0/264952108 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b10028660 con 0x5581e5309ad0 2024-05-08T05:57:27.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.521+0000 7f0b2fcabb80 1 -- 172.21.15.82:0/264952108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5581e5309ad0 msgr2=0x5581e53094b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:27.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.521+0000 7f0b2fcabb80 1 --2- 172.21.15.82:0/264952108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5581e5309ad0 0x5581e53094b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0b1000bb70 tx=0x7f0b1000bb00 comp rx=0 tx=0).stop 2024-05-08T05:57:27.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.522+0000 7f0b2fcabb80 1 -- 172.21.15.82:0/264952108 shutdown_connections 2024-05-08T05:57:27.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.522+0000 7f0b2fcabb80 1 --2- 172.21.15.82:0/264952108 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581e530f740 0x5581e53119b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:27.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.522+0000 7f0b2fcabb80 1 --2- 172.21.15.82:0/264952108 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5581e5309ad0 0x5581e53094b0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:27.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.522+0000 7f0b2fcabb80 1 --2- 172.21.15.82:0/264952108 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5581e530ee20 0x5581e5327a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:27.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.522+0000 7f0b2fcabb80 1 -- 172.21.15.82:0/264952108 >> 172.21.15.82:0/264952108 conn(0x5581e5281750 msgr2=0x5581e5313ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:57:27.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.522+0000 7f0b2fcabb80 1 -- 172.21.15.82:0/264952108 shutdown_connections 2024-05-08T05:57:27.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.523+0000 7f0b2fcabb80 1 -- 172.21.15.82:0/264952108 wait complete. 2024-05-08T05:57:27.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.523+0000 7f0b2fcabb80 1 -- start start 2024-05-08T05:57:27.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.523+0000 7f0b2fcabb80 1 Processor -- start 2024-05-08T05:57:27.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.524+0000 7f0b2fcabb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5581e5309ad0 0x5581e5332770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:27.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.524+0000 7f0b2fcabb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5581e530ee20 0x5581e5332cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:27.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.524+0000 7f0b2fcabb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581e530f740 0x5581e53331f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:27.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.524+0000 7f0b2fcabb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0b201accf0 con 0x5581e5309ad0 2024-05-08T05:57:27.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.524+0000 7f0b2fcabb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0b201ac620 con 0x5581e530ee20 2024-05-08T05:57:27.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.524+0000 7f0b2fcabb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0b2007b700 con 0x5581e530f740 2024-05-08T05:57:27.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.524+0000 7f0b1de00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5581e5309ad0 0x5581e5332770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:27.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.524+0000 7f0b2fcabb80 10 client.0 _ll_register_callbacks cb 0x5581e5202cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:57:27.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.524+0000 7f0b1de00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5581e5309ad0 0x5581e5332770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40850/0 (socket says 172.21.15.82:40850) 2024-05-08T05:57:27.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.524+0000 7f0b1de00700 1 -- 172.21.15.82:0/2525414838 learned_addr learned my addr 172.21.15.82:0/2525414838 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:57:27.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.525+0000 7f0b1de00700 1 --2- 172.21.15.82:0/2525414838 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581e530f740 0x5581e53331f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:27.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.525+0000 7f0b1e800700 1 --2- 172.21.15.82:0/2525414838 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5581e530ee20 0x5581e5332cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:27.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.525+0000 7f0b1de00700 1 -- 172.21.15.82:0/2525414838 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581e530f740 msgr2=0x5581e53331f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:57:27.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.525+0000 7f0b1de00700 1 --2- 172.21.15.82:0/2525414838 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581e530f740 0x5581e53331f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:27.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.525+0000 7f0b1de00700 1 -- 172.21.15.82:0/2525414838 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5581e530ee20 msgr2=0x5581e5332cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:57:27.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.525+0000 7f0b1de00700 1 --2- 172.21.15.82:0/2525414838 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5581e530ee20 0x5581e5332cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:27.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.525+0000 7f0b1de00700 1 -- 172.21.15.82:0/2525414838 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581e5394b60 con 0x5581e5309ad0 2024-05-08T05:57:27.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.525+0000 7f0b1e800700 1 --2- 172.21.15.82:0/2525414838 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5581e530ee20 0x5581e5332cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:57:27.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.525+0000 7f0b1de00700 1 --2- 172.21.15.82:0/2525414838 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5581e5309ad0 0x5581e5332770 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0b10028c40 tx=0x7f0b10003c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d14acf9247db5f05 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:57:27.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.525+0000 7f0b08c00700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T05:57:27.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.526+0000 7f0b08c00700 1 -- 172.21.15.82:0/2525414838 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b10049070 con 0x5581e5309ad0 2024-05-08T05:57:27.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.526+0000 7f0b08c00700 1 -- 172.21.15.82:0/2525414838 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f0b10028740 con 0x5581e5309ad0 2024-05-08T05:57:27.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.526+0000 7f0b2fcabb80 1 -- 172.21.15.82:0/2525414838 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b1000b6a0 con 0x5581e5309ad0 2024-05-08T05:57:27.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.526+0000 7f0b08c00700 1 -- 172.21.15.82:0/2525414838 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f0b1000f500 con 0x5581e5309ad0 2024-05-08T05:57:27.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.526+0000 7f0b2fcabb80 10 client.15684 fetch_fsmap learned FSMap version 31 2024-05-08T05:57:27.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.526+0000 7f0b2fcabb80 1 -- 172.21.15.82:0/2525414838 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5581e5395e70 con 0x5581e5309ad0 2024-05-08T05:57:27.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.527+0000 7f0b08c00700 1 -- 172.21.15.82:0/2525414838 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0b1000b6a0 con 0x5581e5309ad0 2024-05-08T05:57:27.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.527+0000 7f0b08c00700 1 -- 172.21.15.82:0/2525414838 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f0b1004c030 con 0x5581e5309ad0 2024-05-08T05:57:27.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.527+0000 7f0b2fcabb80 10 client.15684 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:57:27.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.527+0000 7f0b2fcabb80 10 client.15684 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:57:27.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.527+0000 7f0b2fcabb80 20 client.15684 populate_metadata read hostname 'smithi082' 2024-05-08T05:57:27.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.527+0000 7f0b2fcabb80 1 --2- 172.21.15.82:0/2525414838 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5581e5396300 0x5581e5398720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:27.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.527+0000 7f0b2fcabb80 4 client.15684 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-08T05:57:27.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.527+0000 7f0b2fcabb80 1 -- 172.21.15.82:0/2525414838 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5581e5269480 con 0x5581e5396300 2024-05-08T05:57:27.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.527+0000 7f0b1e800700 1 --2- 172.21.15.82:0/2525414838 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5581e5396300 0x5581e5398720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:27.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.528+0000 7f0b1e800700 1 --2- 172.21.15.82:0/2525414838 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5581e5396300 0x5581e5398720 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=438939233de8b8fd server_cookie=d8bfe072d7552910 in_seq=0 out_seq=0 2024-05-08T05:57:27.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.528+0000 7f0b08c00700 10 client.15684 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:57:27.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.529+0000 7f0b08c00700 1 -- 172.21.15.82:0/2525414838 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5581e5269480 con 0x5581e5396300 2024-05-08T05:57:27.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.529+0000 7f0b08c00700 10 client.15684 handle_command_reply: tid=0 2024-05-08T05:57:27.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.529+0000 7f0b2fcabb80 1 client.15684 shutdown 2024-05-08T05:57:27.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.529+0000 7f0b2fcabb80 1 -- 172.21.15.82:0/2525414838 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5581e5309ad0 msgr2=0x5581e5332770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:27.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.529+0000 7f0b2fcabb80 1 --2- 172.21.15.82:0/2525414838 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5581e5309ad0 0x5581e5332770 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0b10028c40 tx=0x7f0b10003c40 comp rx=0 tx=0).stop 2024-05-08T05:57:27.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.529+0000 7f0b2fcabb80 1 -- 172.21.15.82:0/2525414838 shutdown_connections 2024-05-08T05:57:27.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.529+0000 7f0b2fcabb80 1 --2- 172.21.15.82:0/2525414838 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581e530f740 0x5581e53331f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:27.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.529+0000 7f0b2fcabb80 1 --2- 172.21.15.82:0/2525414838 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5581e5309ad0 0x5581e5332770 secure :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0b10028c40 tx=0x7f0b10003c40 comp rx=0 tx=0).stop 2024-05-08T05:57:27.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.529+0000 7f0b2fcabb80 1 --2- 172.21.15.82:0/2525414838 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5581e5396300 0x5581e5398720 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:27.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.529+0000 7f0b2fcabb80 1 --2- 172.21.15.82:0/2525414838 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5581e530ee20 0x5581e5332cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:27.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.530+0000 7f0b2fcabb80 1 -- 172.21.15.82:0/2525414838 >> 172.21.15.82:0/2525414838 conn(0x5581e5281750 msgr2=0x5581e53146c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:57:27.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.530+0000 7f0b08c00700 0 client.15684 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:57:27.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.530+0000 7f0b2fcabb80 1 -- 172.21.15.82:0/2525414838 shutdown_connections 2024-05-08T05:57:27.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.530+0000 7f0b2fcabb80 1 -- 172.21.15.82:0/2525414838 wait complete. 2024-05-08T05:57:27.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.530+0000 7f0b2fcabb80 20 client.15684 trim_cache size 0 max 16384 2024-05-08T05:57:27.532 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T05:57:27.532 INFO:teuthology.orchestra.run.smithi082.stdout: "return_code": 0, 2024-05-08T05:57:27.532 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_tag": "e6a368f9-f78c-4115-b460-5322eada59b8", 2024-05-08T05:57:27.532 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": "asynchronous" 2024-05-08T05:57:27.532 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T05:57:27.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.532+0000 7f0b24a00700 1 -- 172.21.15.82:0/3419440217 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f0b040b29d0 msgr2=0x7f0b040b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:27.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.532+0000 7f0b24a00700 1 --2- 172.21.15.82:0/3419440217 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f0b040b29d0 0x7f0b040b4e90 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0b180df2a0 tx=0x7f0b18004ad0 comp rx=0 tx=0).stop 2024-05-08T05:57:27.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.532+0000 7f0b24a00700 1 -- 172.21.15.82:0/3419440217 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b2010b660 msgr2=0x7f0b201a0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:27.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.532+0000 7f0b24a00700 1 --2- 172.21.15.82:0/3419440217 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b2010b660 0x7f0b201a0660 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0b1800be20 tx=0x7f0b18009ed0 comp rx=0 tx=0).stop 2024-05-08T05:57:27.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.532+0000 7f0b24a00700 1 -- 172.21.15.82:0/3419440217 shutdown_connections 2024-05-08T05:57:27.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.532+0000 7f0b24a00700 1 --2- 172.21.15.82:0/3419440217 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b2010b660 0x7f0b201a0660 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:27.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.532+0000 7f0b24a00700 1 --2- 172.21.15.82:0/3419440217 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f0b040b29d0 0x7f0b040b4e90 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:27.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.532+0000 7f0b24a00700 1 --2- 172.21.15.82:0/3419440217 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b201055d0 0x7f0b2019bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:27.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.532+0000 7f0b24a00700 1 --2- 172.21.15.82:0/3419440217 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0b20105f90 0x7f0b2019c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:27.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.532+0000 7f0b24a00700 1 -- 172.21.15.82:0/3419440217 >> 172.21.15.82:0/3419440217 conn(0x7f0b20101080 msgr2=0x7f0b20102850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:57:27.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.532+0000 7f0b24a00700 1 -- 172.21.15.82:0/3419440217 shutdown_connections 2024-05-08T05:57:27.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:27.533+0000 7f0b24a00700 1 -- 172.21.15.82:0/3419440217 wait complete. 2024-05-08T05:57:27.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:57:27 smithi082 ceph-mon[30098]: pgmap v663: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.2 MiB/s wr, 696 op/s 2024-05-08T05:57:27.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:57:27 smithi134 ceph-mon[34132]: pgmap v663: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.2 MiB/s wr, 696 op/s 2024-05-08T05:57:27.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:57:27 smithi151 ceph-mon[34815]: pgmap v663: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.2 MiB/s wr, 696 op/s 2024-05-08T05:57:28.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:57:28 smithi134 ceph-mon[34132]: scrub queued for path: / 2024-05-08T05:57:28.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:57:28 smithi134 ceph-mon[34132]: scrub summary: idle+waiting paths [/] 2024-05-08T05:57:28.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:57:28 smithi134 ceph-mon[34132]: scrub summary: active paths [/] 2024-05-08T05:57:28.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:57:28 smithi134 ceph-mon[34132]: scrub summary: active paths [/] 2024-05-08T05:57:28.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:57:28 smithi134 ceph-mon[34132]: scrub summary: idle+waiting paths [/] 2024-05-08T05:57:28.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:57:28 smithi134 ceph-mon[34132]: scrub summary: idle+waiting paths [/] 2024-05-08T05:57:28.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:57:28 smithi151 ceph-mon[34815]: scrub queued for path: / 2024-05-08T05:57:28.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:57:28 smithi151 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-05-08T05:57:28.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:57:28 smithi151 ceph-mon[34815]: scrub summary: active paths [/] 2024-05-08T05:57:28.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:57:28 smithi151 ceph-mon[34815]: scrub summary: active paths [/] 2024-05-08T05:57:28.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:57:28 smithi151 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-05-08T05:57:28.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:57:28 smithi151 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-05-08T05:57:28.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:57:28 smithi082 ceph-mon[30098]: scrub queued for path: / 2024-05-08T05:57:28.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:57:28 smithi082 ceph-mon[30098]: scrub summary: idle+waiting paths [/] 2024-05-08T05:57:28.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:57:28 smithi082 ceph-mon[30098]: scrub summary: active paths [/] 2024-05-08T05:57:28.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:57:28 smithi082 ceph-mon[30098]: scrub summary: active paths [/] 2024-05-08T05:57:28.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:57:28 smithi082 ceph-mon[30098]: scrub summary: idle+waiting paths [/] 2024-05-08T05:57:28.951 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:57:28 smithi082 ceph-mon[30098]: scrub summary: idle+waiting paths [/] 2024-05-08T05:57:29.010 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-08T05:57:29.597 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:57:29.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:57:29 smithi134 ceph-mon[34132]: pgmap v664: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.6 MiB/s wr, 601 op/s 2024-05-08T05:57:29.758 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:57:29 smithi082 ceph-mon[30098]: pgmap v664: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.6 MiB/s wr, 601 op/s 2024-05-08T05:57:29.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:57:29 smithi151 ceph-mon[34815]: pgmap v664: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.6 MiB/s wr, 601 op/s 2024-05-08T05:57:30.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 400.0 s, 1936.2 tps, lat 51.769 ms stddev 58.269 2024-05-08T05:57:31.670 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:57:31 smithi082 ceph-mon[30098]: pgmap v665: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.7 MiB/s wr, 709 op/s 2024-05-08T05:57:31.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:57:31 smithi134 ceph-mon[34132]: pgmap v665: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.7 MiB/s wr, 709 op/s 2024-05-08T05:57:31.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:57:31 smithi151 ceph-mon[34815]: pgmap v665: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.7 MiB/s wr, 709 op/s 2024-05-08T05:57:32.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.153+0000 7f5446600700 1 -- 172.21.15.82:0/2816065963 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5440103750 msgr2=0x7f5440103b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:32.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.153+0000 7f5446600700 1 --2- 172.21.15.82:0/2816065963 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5440103750 0x7f5440103b30 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f54300099c0 tx=0x7f5430009cd0 comp rx=0 tx=0).stop 2024-05-08T05:57:32.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.154+0000 7f5446600700 1 -- 172.21.15.82:0/2816065963 shutdown_connections 2024-05-08T05:57:32.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.154+0000 7f5446600700 1 --2- 172.21.15.82:0/2816065963 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5440103750 0x7f5440103b30 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:32.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.154+0000 7f5446600700 1 --2- 172.21.15.82:0/2816065963 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5440108850 0x7f54401103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:32.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.154+0000 7f5446600700 1 --2- 172.21.15.82:0/2816065963 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5440104100 0x7f5440108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:32.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.154+0000 7f5446600700 1 -- 172.21.15.82:0/2816065963 >> 172.21.15.82:0/2816065963 conn(0x7f544007a600 msgr2=0x7f544007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:57:32.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.154+0000 7f5446600700 1 -- 172.21.15.82:0/2816065963 shutdown_connections 2024-05-08T05:57:32.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.155+0000 7f5446600700 1 -- 172.21.15.82:0/2816065963 wait complete. 2024-05-08T05:57:32.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.156+0000 7f5446600700 1 Processor -- start 2024-05-08T05:57:32.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.157+0000 7f5446600700 1 -- start start 2024-05-08T05:57:32.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.158+0000 7f5446600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5440103750 0x7f54400757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:32.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.158+0000 7f5446600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5440104100 0x7f5440075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:32.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.158+0000 7f5446600700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5440108850 0x7f5440076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:32.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.158+0000 7f5446600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5440113700 con 0x7f5440103750 2024-05-08T05:57:32.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.158+0000 7f5446600700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5440113580 con 0x7f5440104100 2024-05-08T05:57:32.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.158+0000 7f5446600700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5440113880 con 0x7f5440108850 2024-05-08T05:57:32.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.160+0000 7f543ea00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5440104100 0x7f5440075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:32.160 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.161+0000 7f543fe00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5440108850 0x7f5440076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:32.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.161+0000 7f543ea00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5440104100 0x7f5440075ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:39896/0 (socket says 172.21.15.82:39896) 2024-05-08T05:57:32.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.161+0000 7f543fe00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5440108850 0x7f5440076220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:49218/0 (socket says 172.21.15.82:49218) 2024-05-08T05:57:32.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.161+0000 7f543ea00700 1 -- 172.21.15.82:0/2160034117 learned_addr learned my addr 172.21.15.82:0/2160034117 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:57:32.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.161+0000 7f543fe00700 1 -- 172.21.15.82:0/2160034117 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5440104100 msgr2=0x7f5440075ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:32.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.161+0000 7f543fe00700 1 --2- 172.21.15.82:0/2160034117 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5440104100 0x7f5440075ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:32.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.161+0000 7f543fe00700 1 -- 172.21.15.82:0/2160034117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5440103750 msgr2=0x7f54400757a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:32.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.161+0000 7f543fe00700 1 --2- 172.21.15.82:0/2160034117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5440103750 0x7f54400757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:32.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.161+0000 7f543fe00700 1 -- 172.21.15.82:0/2160034117 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54401ac540 con 0x7f5440108850 2024-05-08T05:57:32.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.164+0000 7f543fe00700 1 --2- 172.21.15.82:0/2160034117 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5440108850 0x7f5440076220 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f543800efc0 tx=0x7f543800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:57:32.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.166+0000 7f5437e00700 1 -- 172.21.15.82:0/2160034117 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54380092e0 con 0x7f5440108850 2024-05-08T05:57:32.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.166+0000 7f5437e00700 1 -- 172.21.15.82:0/2160034117 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5438004bb0 con 0x7f5440108850 2024-05-08T05:57:32.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.167+0000 7f5437e00700 1 -- 172.21.15.82:0/2160034117 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5438004280 con 0x7f5440108850 2024-05-08T05:57:32.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.167+0000 7f5446600700 1 -- 172.21.15.82:0/2160034117 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54401ac7d0 con 0x7f5440108850 2024-05-08T05:57:32.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.167+0000 7f5446600700 1 -- 172.21.15.82:0/2160034117 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54401acd10 con 0x7f5440108850 2024-05-08T05:57:32.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.177+0000 7f5437e00700 1 -- 172.21.15.82:0/2160034117 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f543801b030 con 0x7f5440108850 2024-05-08T05:57:32.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.181+0000 7f5437e00700 1 --2- 172.21.15.82:0/2160034117 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f54240b2980 0x7f54240b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:32.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.181+0000 7f5437e00700 1 -- 172.21.15.82:0/2160034117 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f54380e1dc0 con 0x7f5440108850 2024-05-08T05:57:32.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.183+0000 7f5450ea8b80 1 Processor -- start 2024-05-08T05:57:32.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.183+0000 7f543f400700 1 --2- 172.21.15.82:0/2160034117 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f54240b2980 0x7f54240b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:32.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.185+0000 7f5450ea8b80 1 -- start start 2024-05-08T05:57:32.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.185+0000 7f5450ea8b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56463a662060 0x56463a662440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:32.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.185+0000 7f5450ea8b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56463a662980 0x56463a666490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:32.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.185+0000 7f5450ea8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56463a6669d0 0x56463a666e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:32.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.185+0000 7f5450ea8b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56463a5b4a20 con 0x56463a6669d0 2024-05-08T05:57:32.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.185+0000 7f5450ea8b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56463a552760 con 0x56463a662980 2024-05-08T05:57:32.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.185+0000 7f5450ea8b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56463a5b09e0 con 0x56463a662060 2024-05-08T05:57:32.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.186+0000 7f543f400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56463a662060 0x56463a662440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:32.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.186+0000 7f543fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56463a6669d0 0x56463a666e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:32.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.186+0000 7f543fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56463a6669d0 0x56463a666e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40880/0 (socket says 172.21.15.82:40880) 2024-05-08T05:57:32.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.186+0000 7f543fe00700 1 -- 172.21.15.82:0/2296003705 learned_addr learned my addr 172.21.15.82:0/2296003705 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:57:32.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.187+0000 7f543fe00700 1 -- 172.21.15.82:0/2296003705 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56463a662060 msgr2=0x56463a662440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:57:32.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.187+0000 7f543fe00700 1 --2- 172.21.15.82:0/2296003705 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56463a662060 0x56463a662440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:32.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.187+0000 7f543fe00700 1 -- 172.21.15.82:0/2296003705 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56463a662980 msgr2=0x56463a666490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:57:32.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.187+0000 7f543fe00700 1 --2- 172.21.15.82:0/2296003705 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56463a662980 0x56463a666490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:32.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.187+0000 7f543fe00700 1 -- 172.21.15.82:0/2296003705 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56463a5018d0 con 0x56463a6669d0 2024-05-08T05:57:32.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.187+0000 7f543f400700 1 --2- 172.21.15.82:0/2296003705 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56463a662060 0x56463a662440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:57:32.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.188+0000 7f543fe00700 1 --2- 172.21.15.82:0/2296003705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56463a6669d0 0x56463a666e30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f54380aa030 tx=0x7f54380a9f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff78ae1919fd380f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:57:32.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.188+0000 7f543f400700 1 --2- 172.21.15.82:0/2160034117 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f54240b2980 0x7f54240b4e40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f54300098e0 tx=0x7f5430009e80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:57:32.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.192+0000 7f5434c00700 1 -- 172.21.15.82:0/2296003705 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54380ae6e0 con 0x56463a6669d0 2024-05-08T05:57:32.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.192+0000 7f5434c00700 1 -- 172.21.15.82:0/2296003705 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54380b3100 con 0x56463a6669d0 2024-05-08T05:57:32.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.192+0000 7f5434c00700 1 -- 172.21.15.82:0/2296003705 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54380a5f00 con 0x56463a6669d0 2024-05-08T05:57:32.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.193+0000 7f5450ea8b80 1 -- 172.21.15.82:0/2296003705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56463a6669d0 msgr2=0x56463a666e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:32.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.193+0000 7f5450ea8b80 1 --2- 172.21.15.82:0/2296003705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56463a6669d0 0x56463a666e30 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f54380aa030 tx=0x7f54380a9f10 comp rx=0 tx=0).stop 2024-05-08T05:57:32.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.193+0000 7f5450ea8b80 1 -- 172.21.15.82:0/2296003705 shutdown_connections 2024-05-08T05:57:32.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.193+0000 7f5450ea8b80 1 --2- 172.21.15.82:0/2296003705 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56463a6669d0 0x56463a666e30 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:32.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.193+0000 7f5450ea8b80 1 --2- 172.21.15.82:0/2296003705 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56463a662060 0x56463a662440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:32.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.193+0000 7f5450ea8b80 1 --2- 172.21.15.82:0/2296003705 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56463a662980 0x56463a666490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:32.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.193+0000 7f5450ea8b80 1 -- 172.21.15.82:0/2296003705 >> 172.21.15.82:0/2296003705 conn(0x56463a590b60 msgr2=0x56463a65c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:57:32.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.193+0000 7f5450ea8b80 1 -- 172.21.15.82:0/2296003705 shutdown_connections 2024-05-08T05:57:32.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.193+0000 7f5450ea8b80 1 -- 172.21.15.82:0/2296003705 wait complete. 2024-05-08T05:57:32.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.194+0000 7f5450ea8b80 1 -- start start 2024-05-08T05:57:32.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.195+0000 7f5450ea8b80 1 Processor -- start 2024-05-08T05:57:32.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.196+0000 7f5450ea8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56463a662060 0x56463a66df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:32.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.196+0000 7f5450ea8b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56463a662980 0x56463a66b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:32.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.196+0000 7f5450ea8b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56463a6669d0 0x56463a66b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:32.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.196+0000 7f543f400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56463a662060 0x56463a66df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:32.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.197+0000 7f543fe00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56463a6669d0 0x56463a66b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:32.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.197+0000 7f543ea00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56463a662980 0x56463a66b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:32.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.197+0000 7f543fe00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56463a6669d0 0x56463a66b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:39908/0 (socket says 172.21.15.82:39908) 2024-05-08T05:57:32.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.197+0000 7f543ea00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56463a662980 0x56463a66b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:49230/0 (socket says 172.21.15.82:49230) 2024-05-08T05:57:32.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.198+0000 7f543fe00700 1 -- 172.21.15.82:0/22976052 learned_addr learned my addr 172.21.15.82:0/22976052 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:57:32.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.198+0000 7f5450ea8b80 1 -- 172.21.15.82:0/22976052 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56463a66eb80 con 0x56463a662060 2024-05-08T05:57:32.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.198+0000 7f5450ea8b80 1 -- 172.21.15.82:0/22976052 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56463a51ab20 con 0x56463a6669d0 2024-05-08T05:57:32.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.198+0000 7f5450ea8b80 1 -- 172.21.15.82:0/22976052 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56463a66ed00 con 0x56463a662980 2024-05-08T05:57:32.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.199+0000 7f5450ea8b80 10 client.0 _ll_register_callbacks cb 0x56463a55bc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:57:32.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.199+0000 7f543fe00700 1 -- 172.21.15.82:0/22976052 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56463a662980 msgr2=0x56463a66b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:57:32.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.199+0000 7f543fe00700 1 --2- 172.21.15.82:0/22976052 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56463a662980 0x56463a66b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:32.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.199+0000 7f543fe00700 1 -- 172.21.15.82:0/22976052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56463a662060 msgr2=0x56463a66df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:57:32.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.199+0000 7f543fe00700 1 --2- 172.21.15.82:0/22976052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56463a662060 0x56463a66df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:32.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.199+0000 7f543fe00700 1 -- 172.21.15.82:0/22976052 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56463a57a420 con 0x56463a6669d0 2024-05-08T05:57:32.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.200+0000 7f543fe00700 1 --2- 172.21.15.82:0/22976052 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56463a6669d0 0x56463a66b800 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f54380aabe0 tx=0x7f5438004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d105109282f528bd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:57:32.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.201+0000 7f5429600700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:57:32.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.201+0000 7f5429600700 1 -- 172.21.15.82:0/22976052 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54380a6920 con 0x56463a6669d0 2024-05-08T05:57:32.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.201+0000 7f5429600700 1 -- 172.21.15.82:0/22976052 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f54380df8f0 con 0x56463a6669d0 2024-05-08T05:57:32.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.201+0000 7f5450ea8b80 1 -- 172.21.15.82:0/22976052 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f54380b3100 con 0x56463a6669d0 2024-05-08T05:57:32.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.202+0000 7f5429600700 1 -- 172.21.15.82:0/22976052 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f54380c4b90 con 0x56463a6669d0 2024-05-08T05:57:32.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.202+0000 7f5450ea8b80 10 client.25949 fetch_fsmap learned FSMap version 31 2024-05-08T05:57:32.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.202+0000 7f5450ea8b80 1 -- 172.21.15.82:0/22976052 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56463a679420 con 0x56463a6669d0 2024-05-08T05:57:32.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.203+0000 7f5429600700 1 -- 172.21.15.82:0/22976052 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f54380b3100 con 0x56463a6669d0 2024-05-08T05:57:32.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.203+0000 7f5429600700 1 -- 172.21.15.82:0/22976052 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f54380a91c0 con 0x56463a6669d0 2024-05-08T05:57:32.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.204+0000 7f5450ea8b80 10 client.25949 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:57:32.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.204+0000 7f5450ea8b80 10 client.25949 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:57:32.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.204+0000 7f5450ea8b80 20 client.25949 populate_metadata read hostname 'smithi082' 2024-05-08T05:57:32.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.204+0000 7f5450ea8b80 1 --2- 172.21.15.82:0/22976052 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x56463a67b8f0 0x56463a67dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:32.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.204+0000 7f5450ea8b80 4 client.25949 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:57:32.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.204+0000 7f5450ea8b80 1 -- 172.21.15.82:0/22976052 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56463a62f0a0 con 0x56463a67b8f0 2024-05-08T05:57:32.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.205+0000 7f543f400700 1 --2- 172.21.15.82:0/22976052 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x56463a67b8f0 0x56463a67dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:32.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.207+0000 7f543f400700 1 --2- 172.21.15.82:0/22976052 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x56463a67b8f0 0x56463a67dce0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77d63eaa46011ff4 server_cookie=3f04d515b0709e4d in_seq=0 out_seq=0 2024-05-08T05:57:32.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.207+0000 7f5429600700 10 client.25949 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:57:32.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.208+0000 7f5429600700 1 -- 172.21.15.82:0/22976052 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7f543000b950 con 0x56463a67b8f0 2024-05-08T05:57:32.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.208+0000 7f5429600700 10 client.25949 handle_command_reply: tid=0 2024-05-08T05:57:32.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.208+0000 7f5450ea8b80 1 client.25949 shutdown 2024-05-08T05:57:32.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.209+0000 7f5450ea8b80 1 -- 172.21.15.82:0/22976052 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56463a6669d0 msgr2=0x56463a66b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:32.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.209+0000 7f5450ea8b80 1 --2- 172.21.15.82:0/22976052 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56463a6669d0 0x56463a66b800 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f54380aabe0 tx=0x7f5438004ad0 comp rx=0 tx=0).stop 2024-05-08T05:57:32.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.209+0000 7f5450ea8b80 1 -- 172.21.15.82:0/22976052 shutdown_connections 2024-05-08T05:57:32.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.209+0000 7f5450ea8b80 1 --2- 172.21.15.82:0/22976052 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x56463a67b8f0 0x56463a67dce0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:32.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.209+0000 7f5450ea8b80 1 --2- 172.21.15.82:0/22976052 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56463a6669d0 0x56463a66b800 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:32.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.209+0000 7f5450ea8b80 1 --2- 172.21.15.82:0/22976052 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56463a662060 0x56463a66df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:32.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.209+0000 7f5450ea8b80 1 --2- 172.21.15.82:0/22976052 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56463a662980 0x56463a66b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:32.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.209+0000 7f5429600700 0 client.25949 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:57:32.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.209+0000 7f5450ea8b80 1 -- 172.21.15.82:0/22976052 >> 172.21.15.82:0/22976052 conn(0x56463a590b60 msgr2=0x56463a6572b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:57:32.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.209+0000 7f5450ea8b80 1 -- 172.21.15.82:0/22976052 shutdown_connections 2024-05-08T05:57:32.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.209+0000 7f5450ea8b80 1 -- 172.21.15.82:0/22976052 wait complete. 2024-05-08T05:57:32.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.210+0000 7f5450ea8b80 20 client.25949 trim_cache size 0 max 16384 2024-05-08T05:57:32.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.247+0000 7f5450ea8b80 1 Processor -- start 2024-05-08T05:57:32.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.247+0000 7f5450ea8b80 1 -- start start 2024-05-08T05:57:32.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.248+0000 7f5450ea8b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56463a662060 0x56463a667700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:32.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.248+0000 7f5450ea8b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56463a662980 0x56463a677c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:32.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.248+0000 7f5450ea8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56463a6669d0 0x56463a683280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:32.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.248+0000 7f5450ea8b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f54401b4370 con 0x56463a6669d0 2024-05-08T05:57:32.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.248+0000 7f5450ea8b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f54401b5eb0 con 0x56463a662060 2024-05-08T05:57:32.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.248+0000 7f5450ea8b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f54401b4a40 con 0x56463a662980 2024-05-08T05:57:32.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.248+0000 7f543f400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56463a662060 0x56463a667700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:32.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.248+0000 7f543f400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56463a662060 0x56463a667700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:39912/0 (socket says 172.21.15.82:39912) 2024-05-08T05:57:32.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.248+0000 7f543f400700 1 -- 172.21.15.82:0/850839964 learned_addr learned my addr 172.21.15.82:0/850839964 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:57:32.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.249+0000 7f543ea00700 1 --2- 172.21.15.82:0/850839964 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56463a662980 0x56463a677c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:32.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.249+0000 7f543fe00700 1 --2- 172.21.15.82:0/850839964 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56463a6669d0 0x56463a683280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:32.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.249+0000 7f543f400700 1 -- 172.21.15.82:0/850839964 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56463a662980 msgr2=0x56463a677c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:57:32.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.249+0000 7f543f400700 1 --2- 172.21.15.82:0/850839964 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56463a662980 0x56463a677c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:32.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.249+0000 7f543f400700 1 -- 172.21.15.82:0/850839964 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56463a6669d0 msgr2=0x56463a683280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:57:32.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.249+0000 7f543f400700 1 --2- 172.21.15.82:0/850839964 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56463a6669d0 0x56463a683280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:32.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.249+0000 7f543f400700 1 -- 172.21.15.82:0/850839964 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56463a668f30 con 0x56463a662060 2024-05-08T05:57:32.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.249+0000 7f543f400700 1 --2- 172.21.15.82:0/850839964 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56463a662060 0x56463a667700 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5430006010 tx=0x7f543001f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ee1a56884defd18 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:57:32.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.250+0000 7f542be00700 1 -- 172.21.15.82:0/850839964 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5430032670 con 0x56463a662060 2024-05-08T05:57:32.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.250+0000 7f542be00700 1 -- 172.21.15.82:0/850839964 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5430037070 con 0x56463a662060 2024-05-08T05:57:32.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.250+0000 7f542be00700 1 -- 172.21.15.82:0/850839964 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5430026410 con 0x56463a662060 2024-05-08T05:57:32.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.251+0000 7f5450ea8b80 1 -- 172.21.15.82:0/850839964 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56463a662060 msgr2=0x56463a667700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:32.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.251+0000 7f5450ea8b80 1 --2- 172.21.15.82:0/850839964 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56463a662060 0x56463a667700 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5430006010 tx=0x7f543001f000 comp rx=0 tx=0).stop 2024-05-08T05:57:32.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.251+0000 7f5450ea8b80 1 -- 172.21.15.82:0/850839964 shutdown_connections 2024-05-08T05:57:32.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.251+0000 7f5450ea8b80 1 --2- 172.21.15.82:0/850839964 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56463a662060 0x56463a667700 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:32.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.251+0000 7f5450ea8b80 1 --2- 172.21.15.82:0/850839964 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56463a6669d0 0x56463a683280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:32.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.251+0000 7f5450ea8b80 1 --2- 172.21.15.82:0/850839964 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56463a662980 0x56463a677c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:32.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.251+0000 7f5450ea8b80 1 -- 172.21.15.82:0/850839964 >> 172.21.15.82:0/850839964 conn(0x56463a590b60 msgr2=0x56463a669bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:57:32.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.251+0000 7f5450ea8b80 1 -- 172.21.15.82:0/850839964 shutdown_connections 2024-05-08T05:57:32.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.251+0000 7f5450ea8b80 1 -- 172.21.15.82:0/850839964 wait complete. 2024-05-08T05:57:32.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.252+0000 7f5450ea8b80 1 -- start start 2024-05-08T05:57:32.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.252+0000 7f5450ea8b80 1 Processor -- start 2024-05-08T05:57:32.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.253+0000 7f5450ea8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56463a662060 0x56463a674250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:32.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.253+0000 7f5450ea8b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56463a662980 0x56463a670f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:32.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.253+0000 7f5450ea8b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56463a6669d0 0x56463a6714a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:32.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.253+0000 7f5450ea8b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f54401b57e0 con 0x56463a662060 2024-05-08T05:57:32.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.253+0000 7f5450ea8b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f54401b5110 con 0x56463a6669d0 2024-05-08T05:57:32.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.253+0000 7f5450ea8b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f54401b2310 con 0x56463a662980 2024-05-08T05:57:32.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.253+0000 7f5450ea8b80 10 client.0 _ll_register_callbacks cb 0x56463a55bc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:57:32.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.253+0000 7f543fe00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56463a6669d0 0x56463a6714a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:32.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.253+0000 7f543f400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56463a662060 0x56463a674250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:32.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.253+0000 7f543f400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56463a662060 0x56463a674250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:40902/0 (socket says 172.21.15.82:40902) 2024-05-08T05:57:32.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.253+0000 7f543f400700 1 -- 172.21.15.82:0/1194335842 learned_addr learned my addr 172.21.15.82:0/1194335842 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:57:32.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.253+0000 7f543ea00700 1 --2- 172.21.15.82:0/1194335842 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56463a662980 0x56463a670f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:32.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.254+0000 7f543fe00700 1 -- 172.21.15.82:0/1194335842 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56463a662980 msgr2=0x56463a670f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:57:32.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.254+0000 7f543fe00700 1 --2- 172.21.15.82:0/1194335842 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56463a662980 0x56463a670f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:32.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.254+0000 7f543fe00700 1 -- 172.21.15.82:0/1194335842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56463a662060 msgr2=0x56463a674250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:57:32.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.254+0000 7f543fe00700 1 --2- 172.21.15.82:0/1194335842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56463a662060 0x56463a674250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:32.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.254+0000 7f543fe00700 1 -- 172.21.15.82:0/1194335842 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56463a6719e0 con 0x56463a6669d0 2024-05-08T05:57:32.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.255+0000 7f543fe00700 1 --2- 172.21.15.82:0/1194335842 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56463a6669d0 0x56463a6714a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f543800c7a0 tx=0x7f54380aa4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf674677acec9836 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:57:32.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.255+0000 7f5429600700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:57:32.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.255+0000 7f5429600700 1 -- 172.21.15.82:0/1194335842 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54380a6920 con 0x56463a6669d0 2024-05-08T05:57:32.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.256+0000 7f5429600700 1 -- 172.21.15.82:0/1194335842 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f54380a9000 con 0x56463a6669d0 2024-05-08T05:57:32.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.256+0000 7f5450ea8b80 1 -- 172.21.15.82:0/1194335842 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5430037070 con 0x56463a6669d0 2024-05-08T05:57:32.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.256+0000 7f543f400700 1 --2- 172.21.15.82:0/1194335842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56463a662060 0x56463a674250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:57:32.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.256+0000 7f5429600700 1 -- 172.21.15.82:0/1194335842 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f54380a9e40 con 0x56463a6669d0 2024-05-08T05:57:32.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.256+0000 7f5450ea8b80 10 client.25955 fetch_fsmap learned FSMap version 31 2024-05-08T05:57:32.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.257+0000 7f5450ea8b80 1 -- 172.21.15.82:0/1194335842 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56463a6f7ba0 con 0x56463a6669d0 2024-05-08T05:57:32.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.257+0000 7f5429600700 1 -- 172.21.15.82:0/1194335842 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5430037070 con 0x56463a6669d0 2024-05-08T05:57:32.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.258+0000 7f5429600700 1 -- 172.21.15.82:0/1194335842 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f54380a9200 con 0x56463a6669d0 2024-05-08T05:57:32.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.258+0000 7f5450ea8b80 10 client.25955 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:57:32.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.258+0000 7f5450ea8b80 10 client.25955 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:57:32.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.258+0000 7f5450ea8b80 20 client.25955 populate_metadata read hostname 'smithi082' 2024-05-08T05:57:32.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.258+0000 7f5450ea8b80 1 --2- 172.21.15.82:0/1194335842 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x56463a6f8060 0x56463a6fa450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:57:32.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.258+0000 7f5450ea8b80 4 client.25955 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-08T05:57:32.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.258+0000 7f5450ea8b80 1 -- 172.21.15.82:0/1194335842 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56463a5c2400 con 0x56463a6f8060 2024-05-08T05:57:32.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.258+0000 7f543f400700 1 --2- 172.21.15.82:0/1194335842 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x56463a6f8060 0x56463a6fa450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:57:32.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.259+0000 7f543f400700 1 --2- 172.21.15.82:0/1194335842 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x56463a6f8060 0x56463a6fa450 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a3f1a61c0bfde08 server_cookie=d532251e4983106 in_seq=0 out_seq=0 2024-05-08T05:57:32.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.259+0000 7f5429600700 10 client.25955 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:57:32.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.259+0000 7f5429600700 1 -- 172.21.15.82:0/1194335842 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x56463a5c2400 con 0x56463a6f8060 2024-05-08T05:57:32.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.259+0000 7f5429600700 10 client.25955 handle_command_reply: tid=0 2024-05-08T05:57:32.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.259+0000 7f5450ea8b80 1 client.25955 shutdown 2024-05-08T05:57:32.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.260+0000 7f5450ea8b80 1 -- 172.21.15.82:0/1194335842 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56463a6669d0 msgr2=0x56463a6714a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:32.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.260+0000 7f5450ea8b80 1 --2- 172.21.15.82:0/1194335842 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56463a6669d0 0x56463a6714a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f543800c7a0 tx=0x7f54380aa4b0 comp rx=0 tx=0).stop 2024-05-08T05:57:32.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.260+0000 7f5450ea8b80 1 -- 172.21.15.82:0/1194335842 shutdown_connections 2024-05-08T05:57:32.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.260+0000 7f5450ea8b80 1 --2- 172.21.15.82:0/1194335842 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x56463a6f8060 0x56463a6fa450 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:32.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.260+0000 7f5450ea8b80 1 --2- 172.21.15.82:0/1194335842 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56463a6669d0 0x56463a6714a0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:32.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.260+0000 7f5450ea8b80 1 --2- 172.21.15.82:0/1194335842 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56463a662060 0x56463a674250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:32.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.260+0000 7f5450ea8b80 1 --2- 172.21.15.82:0/1194335842 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56463a662980 0x56463a670f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:32.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.260+0000 7f5450ea8b80 1 -- 172.21.15.82:0/1194335842 >> 172.21.15.82:0/1194335842 conn(0x56463a590b60 msgr2=0x56463a656a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:57:32.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.260+0000 7f5429600700 0 client.25955 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:57:32.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.260+0000 7f5450ea8b80 1 -- 172.21.15.82:0/1194335842 shutdown_connections 2024-05-08T05:57:32.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.260+0000 7f5450ea8b80 1 -- 172.21.15.82:0/1194335842 wait complete. 2024-05-08T05:57:32.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.260+0000 7f5450ea8b80 20 client.25955 trim_cache size 0 max 16384 2024-05-08T05:57:32.261 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T05:57:32.261 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-08T05:57:32.261 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2024-05-08T05:57:32.261 INFO:teuthology.orchestra.run.smithi082.stdout: "e6a368f9-f78c-4115-b460-5322eada59b8": { 2024-05-08T05:57:32.262 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2024-05-08T05:57:32.262 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "e6a368f9-f78c-4115-b460-5322eada59b8", 2024-05-08T05:57:32.262 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2024-05-08T05:57:32.262 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T05:57:32.262 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T05:57:32.262 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T05:57:32.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.261+0000 7f5446600700 1 -- 172.21.15.82:0/2160034117 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f54240b2980 msgr2=0x7f54240b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:32.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.261+0000 7f5446600700 1 --2- 172.21.15.82:0/2160034117 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f54240b2980 0x7f54240b4e40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f54300098e0 tx=0x7f5430009e80 comp rx=0 tx=0).stop 2024-05-08T05:57:32.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.261+0000 7f5446600700 1 -- 172.21.15.82:0/2160034117 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5440108850 msgr2=0x7f5440076220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:57:32.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.261+0000 7f5446600700 1 --2- 172.21.15.82:0/2160034117 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5440108850 0x7f5440076220 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f543800efc0 tx=0x7f543800c3a0 comp rx=0 tx=0).stop 2024-05-08T05:57:32.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.261+0000 7f5446600700 1 -- 172.21.15.82:0/2160034117 shutdown_connections 2024-05-08T05:57:32.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.261+0000 7f5446600700 1 --2- 172.21.15.82:0/2160034117 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f54240b2980 0x7f54240b4e40 secure :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f54300098e0 tx=0x7f5430009e80 comp rx=0 tx=0).stop 2024-05-08T05:57:32.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.261+0000 7f5446600700 1 --2- 172.21.15.82:0/2160034117 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5440108850 0x7f5440076220 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:32.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.261+0000 7f5446600700 1 --2- 172.21.15.82:0/2160034117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5440103750 0x7f54400757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:32.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.261+0000 7f5446600700 1 --2- 172.21.15.82:0/2160034117 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5440104100 0x7f5440075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:57:32.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.261+0000 7f5446600700 1 -- 172.21.15.82:0/2160034117 >> 172.21.15.82:0/2160034117 conn(0x7f544007a600 msgr2=0x7f54401099a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:57:32.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.262+0000 7f5446600700 1 -- 172.21.15.82:0/2160034117 shutdown_connections 2024-05-08T05:57:32.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:57:32.262+0000 7f5446600700 1 -- 172.21.15.82:0/2160034117 wait complete. 2024-05-08T05:57:33.199 INFO:tasks.cephfs.filesystem:scrub status for tag:e6a368f9-f78c-4115-b460-5322eada59b8 - {'path': '/', 'tag': 'e6a368f9-f78c-4115-b460-5322eada59b8', 'options': 'recursive,force'} 2024-05-08T05:57:33.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:57:33 smithi151 ceph-mon[34815]: pgmap v666: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.7 MiB/s wr, 603 op/s 2024-05-08T05:57:33.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:57:33 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:57:33.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:57:33 smithi082 ceph-mon[30098]: pgmap v666: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.7 MiB/s wr, 603 op/s 2024-05-08T05:57:33.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:57:33 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:57:34.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:57:33 smithi134 ceph-mon[34132]: pgmap v666: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.7 MiB/s wr, 603 op/s 2024-05-08T05:57:34.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:57:33 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:57:35.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 405.0 s, 1646.2 tps, lat 60.639 ms stddev 67.290 2024-05-08T05:57:35.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:57:35 smithi151 ceph-mon[34815]: pgmap v667: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 6.3 MiB/s wr, 656 op/s 2024-05-08T05:57:35.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:57:35 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:57:35.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:57:35 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:57:35.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:57:35 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:57:35.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:57:35 smithi151 ceph-mon[34815]: scrub summary: idle 2024-05-08T05:57:35.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:57:35 smithi082 ceph-mon[30098]: pgmap v667: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 6.3 MiB/s wr, 656 op/s 2024-05-08T05:57:35.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:57:35 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:57:35.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:57:35 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:57:35.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:57:35 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:57:35.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:57:35 smithi082 ceph-mon[30098]: scrub summary: idle 2024-05-08T05:57:36.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:57:35 smithi134 ceph-mon[34132]: pgmap v667: 97 pgs: 97 active+clean; 1.6 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 6.3 MiB/s wr, 656 op/s 2024-05-08T05:57:36.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:57:35 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:57:36.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:57:35 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:57:36.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:57:35 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:57:36.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:57:35 smithi134 ceph-mon[34132]: scrub summary: idle 2024-05-08T05:57:36.873 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:57:36 smithi082 ceph-mon[30098]: scrub summary: idle 2024-05-08T05:57:36.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:57:36 smithi151 ceph-mon[34815]: scrub summary: idle 2024-05-08T05:57:37.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:57:36 smithi134 ceph-mon[34132]: scrub summary: idle 2024-05-08T05:57:37.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:57:37 smithi151 ceph-mon[34815]: pgmap v668: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 6.3 MiB/s wr, 676 op/s 2024-05-08T05:57:37.895 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:57:37 smithi082 ceph-mon[30098]: pgmap v668: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 6.3 MiB/s wr, 676 op/s 2024-05-08T05:57:37.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:57:37 smithi134 ceph-mon[34132]: pgmap v668: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 6.3 MiB/s wr, 676 op/s 2024-05-08T05:57:39.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:57:39 smithi151 ceph-mon[34815]: pgmap v669: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.7 MiB/s wr, 616 op/s 2024-05-08T05:57:39.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:57:39 smithi082 ceph-mon[30098]: pgmap v669: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.7 MiB/s wr, 616 op/s 2024-05-08T05:57:39.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:57:39 smithi134 ceph-mon[34132]: pgmap v669: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.7 MiB/s wr, 616 op/s 2024-05-08T05:57:40.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 410.0 s, 2219.0 tps, lat 45.265 ms stddev 51.207 2024-05-08T05:57:41.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:57:41 smithi151 ceph-mon[34815]: pgmap v670: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.2 MiB/s wr, 686 op/s 2024-05-08T05:57:41.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:57:41 smithi082 ceph-mon[30098]: pgmap v670: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.2 MiB/s wr, 686 op/s 2024-05-08T05:57:42.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:57:41 smithi134 ceph-mon[34132]: pgmap v670: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.2 MiB/s wr, 686 op/s 2024-05-08T05:57:43.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:57:43 smithi151 ceph-mon[34815]: pgmap v671: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.1 MiB/s wr, 640 op/s 2024-05-08T05:57:43.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:57:43 smithi082 ceph-mon[30098]: pgmap v671: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.1 MiB/s wr, 640 op/s 2024-05-08T05:57:44.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:57:43 smithi134 ceph-mon[34132]: pgmap v671: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.1 MiB/s wr, 640 op/s 2024-05-08T05:57:45.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 415.0 s, 2640.2 tps, lat 37.625 ms stddev 43.073 2024-05-08T05:57:45.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:57:45 smithi151 ceph-mon[34815]: pgmap v672: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.6 MiB/s wr, 678 op/s 2024-05-08T05:57:45.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:57:45 smithi082 ceph-mon[30098]: pgmap v672: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.6 MiB/s wr, 678 op/s 2024-05-08T05:57:46.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:57:45 smithi134 ceph-mon[34132]: pgmap v672: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.6 MiB/s wr, 678 op/s 2024-05-08T05:57:47.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:57:47 smithi151 ceph-mon[34815]: pgmap v673: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.4 MiB/s wr, 681 op/s 2024-05-08T05:57:47.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:57:47 smithi082 ceph-mon[30098]: pgmap v673: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.4 MiB/s wr, 681 op/s 2024-05-08T05:57:48.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:57:47 smithi134 ceph-mon[34132]: pgmap v673: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.4 MiB/s wr, 681 op/s 2024-05-08T05:57:49.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:57:49 smithi082 ceph-mon[30098]: pgmap v674: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.2 MiB/s wr, 629 op/s 2024-05-08T05:57:49.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:57:49 smithi151 ceph-mon[34815]: pgmap v674: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.2 MiB/s wr, 629 op/s 2024-05-08T05:57:50.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:57:49 smithi134 ceph-mon[34132]: pgmap v674: 97 pgs: 97 active+clean; 1.6 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.2 MiB/s wr, 629 op/s 2024-05-08T05:57:50.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 420.0 s, 2074.6 tps, lat 47.893 ms stddev 57.847 2024-05-08T05:57:51.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:57:51 smithi151 ceph-mon[34815]: pgmap v675: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.6 MiB/s wr, 766 op/s 2024-05-08T05:57:51.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:57:51 smithi082 ceph-mon[30098]: pgmap v675: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.6 MiB/s wr, 766 op/s 2024-05-08T05:57:51.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:57:51 smithi134 ceph-mon[34132]: pgmap v675: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.6 MiB/s wr, 766 op/s 2024-05-08T05:57:53.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:57:53 smithi151 ceph-mon[34815]: pgmap v676: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.8 MiB/s wr, 673 op/s 2024-05-08T05:57:53.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:57:53 smithi082 ceph-mon[30098]: pgmap v676: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.8 MiB/s wr, 673 op/s 2024-05-08T05:57:53.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:57:53 smithi134 ceph-mon[34132]: pgmap v676: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.8 MiB/s wr, 673 op/s 2024-05-08T05:57:55.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 425.0 s, 2100.2 tps, lat 47.539 ms stddev 56.678 2024-05-08T05:57:55.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:57:55 smithi151 ceph-mon[34815]: pgmap v677: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.1 MiB/s wr, 631 op/s 2024-05-08T05:57:55.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:57:55 smithi082 ceph-mon[30098]: pgmap v677: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.1 MiB/s wr, 631 op/s 2024-05-08T05:57:55.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:57:55 smithi134 ceph-mon[34132]: pgmap v677: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.1 MiB/s wr, 631 op/s 2024-05-08T05:57:57.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:57:57 smithi151 ceph-mon[34815]: pgmap v678: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.1 MiB/s wr, 706 op/s 2024-05-08T05:57:57.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:57:57 smithi082 ceph-mon[30098]: pgmap v678: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.1 MiB/s wr, 706 op/s 2024-05-08T05:57:58.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:57:57 smithi134 ceph-mon[34132]: pgmap v678: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.1 MiB/s wr, 706 op/s 2024-05-08T05:57:59.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:57:59 smithi151 ceph-mon[34815]: pgmap v679: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.9 MiB/s wr, 676 op/s 2024-05-08T05:57:59.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:57:59 smithi082 ceph-mon[30098]: pgmap v679: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.9 MiB/s wr, 676 op/s 2024-05-08T05:57:59.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:57:59 smithi134 ceph-mon[34132]: pgmap v679: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.9 MiB/s wr, 676 op/s 2024-05-08T05:58:00.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 430.0 s, 1795.6 tps, lat 55.932 ms stddev 61.551 2024-05-08T05:58:01.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:58:01 smithi151 ceph-mon[34815]: pgmap v680: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.2 MiB/s wr, 743 op/s 2024-05-08T05:58:01.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:58:01 smithi082 ceph-mon[30098]: pgmap v680: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.2 MiB/s wr, 743 op/s 2024-05-08T05:58:01.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:58:01 smithi134 ceph-mon[34132]: pgmap v680: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.2 MiB/s wr, 743 op/s 2024-05-08T05:58:03.200 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-08T05:58:03.790 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:58:03.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:58:03 smithi151 ceph-mon[34815]: pgmap v681: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.2 MiB/s wr, 638 op/s 2024-05-08T05:58:03.952 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:58:03 smithi082 ceph-mon[30098]: pgmap v681: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.2 MiB/s wr, 638 op/s 2024-05-08T05:58:04.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:58:03 smithi134 ceph-mon[34132]: pgmap v681: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.2 MiB/s wr, 638 op/s 2024-05-08T05:58:05.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 435.0 s, 1528.8 tps, lat 65.450 ms stddev 77.338 2024-05-08T05:58:05.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:58:05 smithi082 ceph-mon[30098]: pgmap v682: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 6.8 MiB/s wr, 679 op/s 2024-05-08T05:58:05.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:58:05 smithi151 ceph-mon[34815]: pgmap v682: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 6.8 MiB/s wr, 679 op/s 2024-05-08T05:58:06.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:58:05 smithi134 ceph-mon[34132]: pgmap v682: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 6.8 MiB/s wr, 679 op/s 2024-05-08T05:58:06.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.367+0000 7f1575e00700 1 -- 172.21.15.82:0/2523658207 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15700756d0 msgr2=0x7f1570075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:06.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.367+0000 7f1575e00700 1 --2- 172.21.15.82:0/2523658207 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15700756d0 0x7f1570075ab0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1568009f90 tx=0x7f156800b330 comp rx=0 tx=0).stop 2024-05-08T05:58:06.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.368+0000 7f1575e00700 1 -- 172.21.15.82:0/2523658207 shutdown_connections 2024-05-08T05:58:06.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.368+0000 7f1575e00700 1 --2- 172.21.15.82:0/2523658207 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15700756d0 0x7f1570075ab0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:06.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.368+0000 7f1575e00700 1 --2- 172.21.15.82:0/2523658207 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f157010ff00 0x7f15701122f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:06.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.368+0000 7f1575e00700 1 --2- 172.21.15.82:0/2523658207 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1570075ff0 0x7f157010f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:06.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.368+0000 7f1575e00700 1 -- 172.21.15.82:0/2523658207 >> 172.21.15.82:0/2523658207 conn(0x7f157007a600 msgr2=0x7f157007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:58:06.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.368+0000 7f1575e00700 1 -- 172.21.15.82:0/2523658207 shutdown_connections 2024-05-08T05:58:06.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.368+0000 7f1575e00700 1 -- 172.21.15.82:0/2523658207 wait complete. 2024-05-08T05:58:06.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.372+0000 7f1575e00700 1 Processor -- start 2024-05-08T05:58:06.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.372+0000 7f1575e00700 1 -- start start 2024-05-08T05:58:06.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.373+0000 7f1575e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15700756d0 0x7f1570107270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:06.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.373+0000 7f1575e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1570075ff0 0x7f15701077b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:06.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.373+0000 7f1575e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f157010ff00 0x7f157010bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:06.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.373+0000 7f1575e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1570105d60 con 0x7f157010ff00 2024-05-08T05:58:06.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.373+0000 7f1575e00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1570105be0 con 0x7f15700756d0 2024-05-08T05:58:06.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.373+0000 7f1575e00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1570105ee0 con 0x7f1570075ff0 2024-05-08T05:58:06.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.373+0000 7f156ea00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15700756d0 0x7f1570107270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:06.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.373+0000 7f156f400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f157010ff00 0x7f157010bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:06.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.373+0000 7f156e000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1570075ff0 0x7f15701077b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:06.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.373+0000 7f156f400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f157010ff00 0x7f157010bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54868/0 (socket says 172.21.15.82:54868) 2024-05-08T05:58:06.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.373+0000 7f156f400700 1 -- 172.21.15.82:0/689637761 learned_addr learned my addr 172.21.15.82:0/689637761 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:58:06.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.373+0000 7f156ea00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15700756d0 0x7f1570107270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:47842/0 (socket says 172.21.15.82:47842) 2024-05-08T05:58:06.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.374+0000 7f156ea00700 1 -- 172.21.15.82:0/689637761 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1570075ff0 msgr2=0x7f15701077b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:06.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.374+0000 7f156ea00700 1 --2- 172.21.15.82:0/689637761 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1570075ff0 0x7f15701077b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:06.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.374+0000 7f156ea00700 1 -- 172.21.15.82:0/689637761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f157010ff00 msgr2=0x7f157010bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:06.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.374+0000 7f156ea00700 1 --2- 172.21.15.82:0/689637761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f157010ff00 0x7f157010bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:06.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.374+0000 7f156ea00700 1 -- 172.21.15.82:0/689637761 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f157010c1b0 con 0x7f15700756d0 2024-05-08T05:58:06.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.374+0000 7f156f400700 1 --2- 172.21.15.82:0/689637761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f157010ff00 0x7f157010bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:58:06.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.376+0000 7f156ea00700 1 --2- 172.21.15.82:0/689637761 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15700756d0 0x7f1570107270 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1568009f90 tx=0x7f156800cd00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:58:06.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.376+0000 7f1574a00700 1 -- 172.21.15.82:0/689637761 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1568021070 con 0x7f15700756d0 2024-05-08T05:58:06.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.376+0000 7f1574a00700 1 -- 172.21.15.82:0/689637761 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1568007b80 con 0x7f15700756d0 2024-05-08T05:58:06.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.377+0000 7f1575e00700 1 -- 172.21.15.82:0/689637761 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f157010c440 con 0x7f15700756d0 2024-05-08T05:58:06.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.377+0000 7f1574a00700 1 -- 172.21.15.82:0/689637761 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15680052a0 con 0x7f15700756d0 2024-05-08T05:58:06.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.377+0000 7f1575e00700 1 -- 172.21.15.82:0/689637761 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15701aced0 con 0x7f15700756d0 2024-05-08T05:58:06.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.383+0000 7f1574a00700 1 -- 172.21.15.82:0/689637761 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f1568024070 con 0x7f15700756d0 2024-05-08T05:58:06.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.385+0000 7f1580708b80 1 Processor -- start 2024-05-08T05:58:06.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.385+0000 7f1580708b80 1 -- start start 2024-05-08T05:58:06.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.386+0000 7f1574a00700 1 --2- 172.21.15.82:0/689637761 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f15540b2900 0x7f15540b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:06.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.386+0000 7f1580708b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcaf4cabc0 0x55fcaf4cafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:06.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.386+0000 7f1580708b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fcaf4cb4e0 0x55fcaf4c52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:06.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.386+0000 7f1580708b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fcaf4c58f0 0x55fcaf4c5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:06.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.386+0000 7f1580708b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55fcaf417a20 con 0x55fcaf4cabc0 2024-05-08T05:58:06.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.386+0000 7f1580708b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55fcaf3b5760 con 0x55fcaf4c58f0 2024-05-08T05:58:06.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.386+0000 7f1580708b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55fcaf4139e0 con 0x55fcaf4cb4e0 2024-05-08T05:58:06.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.386+0000 7f1574a00700 1 -- 172.21.15.82:0/689637761 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f156800f020 con 0x7f15700756d0 2024-05-08T05:58:06.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.386+0000 7f156e000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fcaf4cb4e0 0x55fcaf4c52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:06.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.387+0000 7f156e000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fcaf4cb4e0 0x55fcaf4c52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:49340/0 (socket says 172.21.15.82:49340) 2024-05-08T05:58:06.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.387+0000 7f156e000700 1 -- 172.21.15.82:0/2898814831 learned_addr learned my addr 172.21.15.82:0/2898814831 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:58:06.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.387+0000 7f156e000700 1 -- 172.21.15.82:0/2898814831 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fcaf4c58f0 msgr2=0x55fcaf4c5d70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T05:58:06.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.387+0000 7f156e000700 1 --2- 172.21.15.82:0/2898814831 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fcaf4c58f0 0x55fcaf4c5d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:06.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.387+0000 7f156e000700 1 -- 172.21.15.82:0/2898814831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcaf4cabc0 msgr2=0x55fcaf4cafa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:06.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.387+0000 7f156e000700 1 --2- 172.21.15.82:0/2898814831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcaf4cabc0 0x55fcaf4cafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:06.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.387+0000 7f156e000700 1 -- 172.21.15.82:0/2898814831 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcaf3648d0 con 0x55fcaf4cb4e0 2024-05-08T05:58:06.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.387+0000 7f156e000700 1 --2- 172.21.15.82:0/2898814831 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fcaf4cb4e0 0x55fcaf4c52d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f15600077c0 tx=0x7f1560007ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1aee638e45db0ff8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:58:06.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.387+0000 7f1564c00700 1 -- 172.21.15.82:0/2898814831 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15600125f0 con 0x55fcaf4cb4e0 2024-05-08T05:58:06.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.388+0000 7f1564c00700 1 -- 172.21.15.82:0/2898814831 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1560018070 con 0x55fcaf4cb4e0 2024-05-08T05:58:06.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.388+0000 7f1564c00700 1 -- 172.21.15.82:0/2898814831 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1560013c00 con 0x55fcaf4cb4e0 2024-05-08T05:58:06.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.388+0000 7f156f400700 1 --2- 172.21.15.82:0/689637761 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f15540b2900 0x7f15540b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:06.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.388+0000 7f1580708b80 1 -- 172.21.15.82:0/2898814831 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fcaf4cb4e0 msgr2=0x55fcaf4c52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:06.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.388+0000 7f1580708b80 1 --2- 172.21.15.82:0/2898814831 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fcaf4cb4e0 0x55fcaf4c52d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f15600077c0 tx=0x7f1560007ad0 comp rx=0 tx=0).stop 2024-05-08T05:58:06.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.389+0000 7f1580708b80 1 -- 172.21.15.82:0/2898814831 shutdown_connections 2024-05-08T05:58:06.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.389+0000 7f1580708b80 1 --2- 172.21.15.82:0/2898814831 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fcaf4c58f0 0x55fcaf4c5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:06.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.389+0000 7f1580708b80 1 --2- 172.21.15.82:0/2898814831 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcaf4cabc0 0x55fcaf4cafa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:06.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.389+0000 7f1580708b80 1 --2- 172.21.15.82:0/2898814831 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fcaf4cb4e0 0x55fcaf4c52d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:06.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.389+0000 7f1580708b80 1 -- 172.21.15.82:0/2898814831 >> 172.21.15.82:0/2898814831 conn(0x55fcaf43d6d0 msgr2=0x55fcaf4bfb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:58:06.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.389+0000 7f1580708b80 1 -- 172.21.15.82:0/2898814831 shutdown_connections 2024-05-08T05:58:06.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.390+0000 7f1580708b80 1 -- 172.21.15.82:0/2898814831 wait complete. 2024-05-08T05:58:06.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.390+0000 7f1580708b80 1 -- start start 2024-05-08T05:58:06.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.391+0000 7f1580708b80 1 Processor -- start 2024-05-08T05:58:06.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.391+0000 7f156f400700 1 --2- 172.21.15.82:0/689637761 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f15540b2900 0x7f15540b4dc0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x55fcaf4c62b0 tx=0x7f155c015040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:58:06.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.391+0000 7f1580708b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fcaf4c58f0 0x55fcaf4d11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:06.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.392+0000 7f1580708b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcaf4cabc0 0x55fcaf4ce540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:06.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.392+0000 7f1580708b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fcaf4cb4e0 0x55fcaf4cea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:06.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.392+0000 7f1580708b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55fcaf4d1f20 con 0x55fcaf4cabc0 2024-05-08T05:58:06.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.392+0000 7f1580708b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55fcaf37db20 con 0x55fcaf4c58f0 2024-05-08T05:58:06.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.392+0000 7f1580708b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55fcaf4d20a0 con 0x55fcaf4cb4e0 2024-05-08T05:58:06.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.392+0000 7f1580708b80 10 client.0 _ll_register_callbacks cb 0x55fcaf3bec70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:58:06.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.392+0000 7f156f400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fcaf4cb4e0 0x55fcaf4cea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:06.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.392+0000 7f156f400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fcaf4cb4e0 0x55fcaf4cea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:49350/0 (socket says 172.21.15.82:49350) 2024-05-08T05:58:06.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.392+0000 7f156f400700 1 -- 172.21.15.82:0/3925307752 learned_addr learned my addr 172.21.15.82:0/3925307752 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:58:06.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.392+0000 7f156ea00700 1 --2- 172.21.15.82:0/3925307752 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fcaf4c58f0 0x55fcaf4d11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:06.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.392+0000 7f156e000700 1 --2- 172.21.15.82:0/3925307752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcaf4cabc0 0x55fcaf4ce540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:06.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.393+0000 7f156f400700 1 -- 172.21.15.82:0/3925307752 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fcaf4c58f0 msgr2=0x55fcaf4d11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:06.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.393+0000 7f156f400700 1 --2- 172.21.15.82:0/3925307752 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fcaf4c58f0 0x55fcaf4d11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:06.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.393+0000 7f156f400700 1 -- 172.21.15.82:0/3925307752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcaf4cabc0 msgr2=0x55fcaf4ce540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:06.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.393+0000 7f156f400700 1 --2- 172.21.15.82:0/3925307752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcaf4cabc0 0x55fcaf4ce540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:06.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.393+0000 7f156f400700 1 -- 172.21.15.82:0/3925307752 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcaf3dd420 con 0x55fcaf4cb4e0 2024-05-08T05:58:06.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.393+0000 7f156f400700 1 --2- 172.21.15.82:0/3925307752 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fcaf4cb4e0 0x55fcaf4cea80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f155c009c50 tx=0x7f155c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d67cdd41e5542794 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:58:06.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.394+0000 7f1559600700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:58:06.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.394+0000 7f1559600700 1 -- 172.21.15.82:0/3925307752 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f155c02e020 con 0x55fcaf4cb4e0 2024-05-08T05:58:06.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.394+0000 7f1559600700 1 -- 172.21.15.82:0/3925307752 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f155c020ba0 con 0x55fcaf4cb4e0 2024-05-08T05:58:06.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.394+0000 7f1580708b80 1 -- 172.21.15.82:0/3925307752 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1560018070 con 0x55fcaf4cb4e0 2024-05-08T05:58:06.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.394+0000 7f1559600700 1 -- 172.21.15.82:0/3925307752 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f155c026040 con 0x55fcaf4cb4e0 2024-05-08T05:58:06.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.394+0000 7f1580708b80 10 client.26008 fetch_fsmap learned FSMap version 31 2024-05-08T05:58:06.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.394+0000 7f1580708b80 1 -- 172.21.15.82:0/3925307752 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55fcaf4dc840 con 0x55fcaf4cb4e0 2024-05-08T05:58:06.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.395+0000 7f1559600700 1 -- 172.21.15.82:0/3925307752 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f155c020de0 con 0x55fcaf4cb4e0 2024-05-08T05:58:06.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.395+0000 7f1559600700 1 -- 172.21.15.82:0/3925307752 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f155c03b020 con 0x55fcaf4cb4e0 2024-05-08T05:58:06.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.396+0000 7f1580708b80 10 client.26008 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:58:06.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.396+0000 7f1580708b80 10 client.26008 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:58:06.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.396+0000 7f1580708b80 20 client.26008 populate_metadata read hostname 'smithi082' 2024-05-08T05:58:06.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.396+0000 7f1580708b80 1 --2- 172.21.15.82:0/3925307752 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55fcaf4dee80 0x55fcaf4e12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:06.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.396+0000 7f1580708b80 4 client.26008 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:58:06.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.396+0000 7f1580708b80 1 -- 172.21.15.82:0/3925307752 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f1560018070 con 0x55fcaf4dee80 2024-05-08T05:58:06.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.396+0000 7f156ea00700 1 --2- 172.21.15.82:0/3925307752 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55fcaf4dee80 0x55fcaf4e12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:06.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.397+0000 7f156ea00700 1 --2- 172.21.15.82:0/3925307752 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55fcaf4dee80 0x55fcaf4e12a0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33508126875cc090 server_cookie=74a43e8ac37cf512 in_seq=0 out_seq=0 2024-05-08T05:58:06.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.397+0000 7f1559600700 10 client.26008 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:58:06.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.398+0000 7f1559600700 1 -- 172.21.15.82:0/3925307752 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7f1560018070 con 0x55fcaf4dee80 2024-05-08T05:58:06.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.398+0000 7f1559600700 10 client.26008 handle_command_reply: tid=0 2024-05-08T05:58:06.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.399+0000 7f1580708b80 1 client.26008 shutdown 2024-05-08T05:58:06.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.399+0000 7f1580708b80 1 -- 172.21.15.82:0/3925307752 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fcaf4cb4e0 msgr2=0x55fcaf4cea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:06.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.399+0000 7f1580708b80 1 --2- 172.21.15.82:0/3925307752 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fcaf4cb4e0 0x55fcaf4cea80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f155c009c50 tx=0x7f155c004750 comp rx=0 tx=0).stop 2024-05-08T05:58:06.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.399+0000 7f1580708b80 1 -- 172.21.15.82:0/3925307752 shutdown_connections 2024-05-08T05:58:06.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.399+0000 7f1580708b80 1 --2- 172.21.15.82:0/3925307752 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55fcaf4dee80 0x55fcaf4e12a0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:06.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.399+0000 7f1580708b80 1 --2- 172.21.15.82:0/3925307752 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fcaf4c58f0 0x55fcaf4d11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:06.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.399+0000 7f1559600700 0 client.26008 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:58:06.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.399+0000 7f1580708b80 1 --2- 172.21.15.82:0/3925307752 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fcaf4cb4e0 0x55fcaf4cea80 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:06.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.399+0000 7f1580708b80 1 --2- 172.21.15.82:0/3925307752 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcaf4cabc0 0x55fcaf4ce540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:06.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.399+0000 7f1580708b80 1 -- 172.21.15.82:0/3925307752 >> 172.21.15.82:0/3925307752 conn(0x55fcaf43d6d0 msgr2=0x55fcaf4bf190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:58:06.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.400+0000 7f1580708b80 1 -- 172.21.15.82:0/3925307752 shutdown_connections 2024-05-08T05:58:06.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.400+0000 7f1580708b80 1 -- 172.21.15.82:0/3925307752 wait complete. 2024-05-08T05:58:06.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.400+0000 7f1580708b80 20 client.26008 trim_cache size 0 max 16384 2024-05-08T05:58:06.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.433+0000 7f1580708b80 1 Processor -- start 2024-05-08T05:58:06.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.433+0000 7f1580708b80 1 -- start start 2024-05-08T05:58:06.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.433+0000 7f1580708b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fcaf4c58f0 0x55fcaf4c52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:06.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.433+0000 7f1580708b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fcaf4cabc0 0x55fcaf4dafe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:06.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.433+0000 7f1580708b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcaf4cb4e0 0x55fcaf4cc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:06.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.433+0000 7f1580708b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f15701b4030 con 0x55fcaf4cb4e0 2024-05-08T05:58:06.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.433+0000 7f1580708b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f15701b5b70 con 0x55fcaf4cabc0 2024-05-08T05:58:06.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.433+0000 7f1580708b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f15701b4700 con 0x55fcaf4c58f0 2024-05-08T05:58:06.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.434+0000 7f156ea00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fcaf4c58f0 0x55fcaf4c52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:06.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.434+0000 7f156ea00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fcaf4c58f0 0x55fcaf4c52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:49364/0 (socket says 172.21.15.82:49364) 2024-05-08T05:58:06.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.434+0000 7f156ea00700 1 -- 172.21.15.82:0/854281061 learned_addr learned my addr 172.21.15.82:0/854281061 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:58:06.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.434+0000 7f156f400700 1 --2- 172.21.15.82:0/854281061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcaf4cb4e0 0x55fcaf4cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:06.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.435+0000 7f156e000700 1 --2- 172.21.15.82:0/854281061 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fcaf4cabc0 0x55fcaf4dafe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:06.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.435+0000 7f156f400700 1 -- 172.21.15.82:0/854281061 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fcaf4c58f0 msgr2=0x55fcaf4c52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:06.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.435+0000 7f156f400700 1 --2- 172.21.15.82:0/854281061 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fcaf4c58f0 0x55fcaf4c52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:06.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.435+0000 7f156f400700 1 -- 172.21.15.82:0/854281061 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fcaf4cabc0 msgr2=0x55fcaf4dafe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:06.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.435+0000 7f156f400700 1 --2- 172.21.15.82:0/854281061 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fcaf4cabc0 0x55fcaf4dafe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:06.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.435+0000 7f156f400700 1 -- 172.21.15.82:0/854281061 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcaf4cc560 con 0x55fcaf4cb4e0 2024-05-08T05:58:06.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.435+0000 7f156f400700 1 --2- 172.21.15.82:0/854281061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcaf4cb4e0 0x55fcaf4cc020 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f155c009c50 tx=0x7f155c009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fa9744cdd80afb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:58:06.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.436+0000 7f155be00700 1 -- 172.21.15.82:0/854281061 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f155c026040 con 0x55fcaf4cb4e0 2024-05-08T05:58:06.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.437+0000 7f155be00700 1 -- 172.21.15.82:0/854281061 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f155c033810 con 0x55fcaf4cb4e0 2024-05-08T05:58:06.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.437+0000 7f155be00700 1 -- 172.21.15.82:0/854281061 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f155c005380 con 0x55fcaf4cb4e0 2024-05-08T05:58:06.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.438+0000 7f1580708b80 1 -- 172.21.15.82:0/854281061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcaf4cb4e0 msgr2=0x55fcaf4cc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:06.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.438+0000 7f1580708b80 1 --2- 172.21.15.82:0/854281061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcaf4cb4e0 0x55fcaf4cc020 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f155c009c50 tx=0x7f155c009310 comp rx=0 tx=0).stop 2024-05-08T05:58:06.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.438+0000 7f1580708b80 1 -- 172.21.15.82:0/854281061 shutdown_connections 2024-05-08T05:58:06.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.438+0000 7f1580708b80 1 --2- 172.21.15.82:0/854281061 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcaf4cb4e0 0x55fcaf4cc020 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:06.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.438+0000 7f1580708b80 1 --2- 172.21.15.82:0/854281061 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fcaf4c58f0 0x55fcaf4c52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:06.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.438+0000 7f1580708b80 1 --2- 172.21.15.82:0/854281061 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fcaf4cabc0 0x55fcaf4dafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:06.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.438+0000 7f1580708b80 1 -- 172.21.15.82:0/854281061 >> 172.21.15.82:0/854281061 conn(0x55fcaf43d6d0 msgr2=0x55fcaf4cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:58:06.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.438+0000 7f1580708b80 1 -- 172.21.15.82:0/854281061 shutdown_connections 2024-05-08T05:58:06.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.440+0000 7f1580708b80 1 -- 172.21.15.82:0/854281061 wait complete. 2024-05-08T05:58:06.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.440+0000 7f1580708b80 1 -- start start 2024-05-08T05:58:06.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.440+0000 7f1580708b80 1 Processor -- start 2024-05-08T05:58:06.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.441+0000 7f1580708b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fcaf4c58f0 0x55fcaf4e6740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:06.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.441+0000 7f1580708b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fcaf4cabc0 0x55fcaf4e6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:06.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.442+0000 7f1580708b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcaf4cb4e0 0x55fcaf5486e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:06.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.442+0000 7f1580708b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f15701b54a0 con 0x55fcaf4cb4e0 2024-05-08T05:58:06.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.442+0000 7f156ea00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fcaf4c58f0 0x55fcaf4e6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:06.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.442+0000 7f1580708b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f15701b4dd0 con 0x55fcaf4cabc0 2024-05-08T05:58:06.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.442+0000 7f156ea00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fcaf4c58f0 0x55fcaf4e6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:49366/0 (socket says 172.21.15.82:49366) 2024-05-08T05:58:06.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.442+0000 7f156ea00700 1 -- 172.21.15.82:0/3883483457 learned_addr learned my addr 172.21.15.82:0/3883483457 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:58:06.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.442+0000 7f1580708b80 1 -- 172.21.15.82:0/3883483457 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f15701b1f90 con 0x55fcaf4c58f0 2024-05-08T05:58:06.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.442+0000 7f156e000700 1 --2- 172.21.15.82:0/3883483457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fcaf4cabc0 0x55fcaf4e6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:06.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.442+0000 7f1580708b80 10 client.0 _ll_register_callbacks cb 0x55fcaf3bec70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:58:06.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.442+0000 7f156f400700 1 --2- 172.21.15.82:0/3883483457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcaf4cb4e0 0x55fcaf5486e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:06.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.442+0000 7f156e000700 1 -- 172.21.15.82:0/3883483457 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fcaf4c58f0 msgr2=0x55fcaf4e6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:06.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.442+0000 7f156e000700 1 --2- 172.21.15.82:0/3883483457 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fcaf4c58f0 0x55fcaf4e6740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:06.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.442+0000 7f156e000700 1 -- 172.21.15.82:0/3883483457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcaf4cb4e0 msgr2=0x55fcaf5486e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:06.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.442+0000 7f156e000700 1 --2- 172.21.15.82:0/3883483457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcaf4cb4e0 0x55fcaf5486e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:06.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.442+0000 7f156e000700 1 -- 172.21.15.82:0/3883483457 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcaf548c20 con 0x55fcaf4cabc0 2024-05-08T05:58:06.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.443+0000 7f156e000700 1 --2- 172.21.15.82:0/3883483457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fcaf4cabc0 0x55fcaf4e6c80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f15600048a0 tx=0x7f1560012a10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2db3a4d2a3460e86 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:58:06.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.443+0000 7f1559600700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:58:06.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.443+0000 7f1559600700 1 -- 172.21.15.82:0/3883483457 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1560012e40 con 0x55fcaf4cabc0 2024-05-08T05:58:06.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.443+0000 7f1580708b80 1 -- 172.21.15.82:0/3883483457 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f155c033810 con 0x55fcaf4cabc0 2024-05-08T05:58:06.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.443+0000 7f1559600700 1 -- 172.21.15.82:0/3883483457 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f1560013480 con 0x55fcaf4cabc0 2024-05-08T05:58:06.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.444+0000 7f1559600700 1 -- 172.21.15.82:0/3883483457 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f1560013680 con 0x55fcaf4cabc0 2024-05-08T05:58:06.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.444+0000 7f1580708b80 10 client.25970 fetch_fsmap learned FSMap version 31 2024-05-08T05:58:06.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.444+0000 7f1580708b80 1 -- 172.21.15.82:0/3883483457 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55fcaf549e00 con 0x55fcaf4cabc0 2024-05-08T05:58:06.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.444+0000 7f1559600700 1 -- 172.21.15.82:0/3883483457 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f155c033810 con 0x55fcaf4cabc0 2024-05-08T05:58:06.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.444+0000 7f1559600700 1 -- 172.21.15.82:0/3883483457 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f1560025070 con 0x55fcaf4cabc0 2024-05-08T05:58:06.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.444+0000 7f1580708b80 10 client.25970 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:58:06.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.444+0000 7f1580708b80 10 client.25970 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:58:06.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.444+0000 7f1580708b80 20 client.25970 populate_metadata read hostname 'smithi082' 2024-05-08T05:58:06.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.444+0000 7f1580708b80 1 --2- 172.21.15.82:0/3883483457 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55fcaf4dee80 0x55fcaf54c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:06.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.444+0000 7f1580708b80 4 client.25970 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-08T05:58:06.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.444+0000 7f1580708b80 1 -- 172.21.15.82:0/3883483457 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55fcaf492140 con 0x55fcaf4dee80 2024-05-08T05:58:06.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.445+0000 7f156ea00700 1 --2- 172.21.15.82:0/3883483457 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55fcaf4dee80 0x55fcaf54c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:06.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.445+0000 7f1559600700 10 client.25970 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:58:06.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.445+0000 7f156ea00700 1 --2- 172.21.15.82:0/3883483457 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55fcaf4dee80 0x55fcaf54c280 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c909e591ad592f43 server_cookie=7158f9ac4b7d2de0 in_seq=0 out_seq=0 2024-05-08T05:58:06.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.445+0000 7f1559600700 1 -- 172.21.15.82:0/3883483457 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55fcaf492140 con 0x55fcaf4dee80 2024-05-08T05:58:06.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.445+0000 7f1559600700 10 client.25970 handle_command_reply: tid=0 2024-05-08T05:58:06.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.445+0000 7f1580708b80 1 client.25970 shutdown 2024-05-08T05:58:06.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.446+0000 7f1580708b80 1 -- 172.21.15.82:0/3883483457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fcaf4cabc0 msgr2=0x55fcaf4e6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:06.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.446+0000 7f1580708b80 1 --2- 172.21.15.82:0/3883483457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fcaf4cabc0 0x55fcaf4e6c80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f15600048a0 tx=0x7f1560012a10 comp rx=0 tx=0).stop 2024-05-08T05:58:06.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.446+0000 7f1580708b80 1 -- 172.21.15.82:0/3883483457 shutdown_connections 2024-05-08T05:58:06.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.446+0000 7f1580708b80 1 --2- 172.21.15.82:0/3883483457 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55fcaf4cb4e0 0x55fcaf5486e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:06.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.446+0000 7f1580708b80 1 --2- 172.21.15.82:0/3883483457 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fcaf4c58f0 0x55fcaf4e6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:06.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.446+0000 7f1580708b80 1 --2- 172.21.15.82:0/3883483457 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55fcaf4dee80 0x55fcaf54c280 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:06.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.446+0000 7f1580708b80 1 --2- 172.21.15.82:0/3883483457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fcaf4cabc0 0x55fcaf4e6c80 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:06.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.446+0000 7f1580708b80 1 -- 172.21.15.82:0/3883483457 >> 172.21.15.82:0/3883483457 conn(0x55fcaf43d6d0 msgr2=0x55fcaf4c96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:58:06.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.446+0000 7f1559600700 0 client.25970 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:58:06.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.447+0000 7f1580708b80 1 -- 172.21.15.82:0/3883483457 shutdown_connections 2024-05-08T05:58:06.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.447+0000 7f1580708b80 1 -- 172.21.15.82:0/3883483457 wait complete. 2024-05-08T05:58:06.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.447+0000 7f1580708b80 20 client.25970 trim_cache size 0 max 16384 2024-05-08T05:58:06.450 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T05:58:06.450 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "no active scrubs running", 2024-05-08T05:58:06.450 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": {} 2024-05-08T05:58:06.450 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T05:58:06.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.450+0000 7f1575e00700 1 -- 172.21.15.82:0/689637761 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f15540b2900 msgr2=0x7f15540b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:06.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.450+0000 7f1575e00700 1 --2- 172.21.15.82:0/689637761 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f15540b2900 0x7f15540b4dc0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x55fcaf4c62b0 tx=0x7f155c015040 comp rx=0 tx=0).stop 2024-05-08T05:58:06.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.450+0000 7f1575e00700 1 -- 172.21.15.82:0/689637761 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15700756d0 msgr2=0x7f1570107270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:06.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.450+0000 7f1575e00700 1 --2- 172.21.15.82:0/689637761 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15700756d0 0x7f1570107270 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1568009f90 tx=0x7f156800cd00 comp rx=0 tx=0).stop 2024-05-08T05:58:06.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.450+0000 7f1575e00700 1 -- 172.21.15.82:0/689637761 shutdown_connections 2024-05-08T05:58:06.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.450+0000 7f1575e00700 1 --2- 172.21.15.82:0/689637761 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15700756d0 0x7f1570107270 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:06.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.450+0000 7f1575e00700 1 --2- 172.21.15.82:0/689637761 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f15540b2900 0x7f15540b4dc0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:06.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.450+0000 7f1575e00700 1 --2- 172.21.15.82:0/689637761 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f157010ff00 0x7f157010bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:06.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.450+0000 7f1575e00700 1 --2- 172.21.15.82:0/689637761 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1570075ff0 0x7f15701077b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:06.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.450+0000 7f1575e00700 1 -- 172.21.15.82:0/689637761 >> 172.21.15.82:0/689637761 conn(0x7f157007a600 msgr2=0x7f1570100ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:58:06.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.451+0000 7f1575e00700 1 -- 172.21.15.82:0/689637761 shutdown_connections 2024-05-08T05:58:06.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:06.451+0000 7f1575e00700 1 -- 172.21.15.82:0/689637761 wait complete. 2024-05-08T05:58:07.495 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-08T05:58:07.496 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T05:58:07.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:58:07 smithi082 ceph-mon[30098]: pgmap v683: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 6.9 MiB/s wr, 705 op/s 2024-05-08T05:58:07.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:58:07 smithi151 ceph-mon[34815]: pgmap v683: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 6.9 MiB/s wr, 705 op/s 2024-05-08T05:58:07.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:58:07 smithi134 ceph-mon[34132]: pgmap v683: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 6.9 MiB/s wr, 705 op/s 2024-05-08T05:58:08.070 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:58:09.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:58:09 smithi151 ceph-mon[34815]: pgmap v684: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.6 MiB/s wr, 608 op/s 2024-05-08T05:58:09.941 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:58:09 smithi082 ceph-mon[30098]: pgmap v684: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.6 MiB/s wr, 608 op/s 2024-05-08T05:58:10.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:58:09 smithi134 ceph-mon[34132]: pgmap v684: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 5.6 MiB/s wr, 608 op/s 2024-05-08T05:58:10.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 440.0 s, 1306.2 tps, lat 76.641 ms stddev 88.633 2024-05-08T05:58:10.755 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:10.753+0000 7f5838000700 1 -- 172.21.15.82:0/3787698062 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58301023a0 msgr2=0x7f5830102820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:10.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:10.753+0000 7f5838000700 1 --2- 172.21.15.82:0/3787698062 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58301023a0 0x7f5830102820 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f582400b0a0 tx=0x7f582400b3b0 comp rx=0 tx=0).stop 2024-05-08T05:58:10.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:10.754+0000 7f5838000700 1 -- 172.21.15.82:0/3787698062 shutdown_connections 2024-05-08T05:58:10.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:10.754+0000 7f5838000700 1 --2- 172.21.15.82:0/3787698062 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5830102d60 0x7f583010f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:10.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:10.754+0000 7f5838000700 1 --2- 172.21.15.82:0/3787698062 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5830108410 0x7f58301087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:10.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:10.754+0000 7f5838000700 1 --2- 172.21.15.82:0/3787698062 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f58301023a0 0x7f5830102820 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:10.756 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:10.754+0000 7f5838000700 1 -- 172.21.15.82:0/3787698062 >> 172.21.15.82:0/3787698062 conn(0x7f5830079350 msgr2=0x7f5830079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:58:10.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:10.757+0000 7f5838000700 1 -- 172.21.15.82:0/3787698062 shutdown_connections 2024-05-08T05:58:10.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:10.757+0000 7f5838000700 1 -- 172.21.15.82:0/3787698062 wait complete. 2024-05-08T05:58:10.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:10.758+0000 7f5838000700 1 Processor -- start 2024-05-08T05:58:10.759 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:10.758+0000 7f5838000700 1 -- start start 2024-05-08T05:58:10.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:10.759+0000 7f5838000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58301023a0 0x7f5830117d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:10.760 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:10.760+0000 7f5838000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5830102d60 0x7f5830111e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:10.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:10.760+0000 7f5838000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5830108410 0x7f5830112350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:10.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:10.760+0000 7f5834c00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5830102d60 0x7f5830111e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:10.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:10.760+0000 7f5834c00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5830102d60 0x7f5830111e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:47882/0 (socket says 172.21.15.82:47882) 2024-05-08T05:58:10.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:10.761+0000 7f5838000700 1 -- 172.21.15.82:0/3205316168 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5830110760 con 0x7f58301023a0 2024-05-08T05:58:10.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:10.761+0000 7f5838000700 1 -- 172.21.15.82:0/3205316168 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f58301105e0 con 0x7f5830102d60 2024-05-08T05:58:10.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:10.761+0000 7f5838000700 1 -- 172.21.15.82:0/3205316168 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f58301108e0 con 0x7f5830108410 2024-05-08T05:58:10.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:10.761+0000 7f5834c00700 1 -- 172.21.15.82:0/3205316168 learned_addr learned my addr 172.21.15.82:0/3205316168 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:58:10.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:10.761+0000 7f5836000700 1 --2- 172.21.15.82:0/3205316168 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5830108410 0x7f5830112350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:10.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:10.761+0000 7f5835600700 1 --2- 172.21.15.82:0/3205316168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58301023a0 0x7f5830117d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:10.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:10.763+0000 7f5836000700 1 -- 172.21.15.82:0/3205316168 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5830102d60 msgr2=0x7f5830111e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:10.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:10.763+0000 7f5836000700 1 --2- 172.21.15.82:0/3205316168 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5830102d60 0x7f5830111e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:10.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:10.763+0000 7f5836000700 1 -- 172.21.15.82:0/3205316168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58301023a0 msgr2=0x7f5830117d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:10.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:10.763+0000 7f5836000700 1 --2- 172.21.15.82:0/3205316168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58301023a0 0x7f5830117d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:10.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:10.763+0000 7f5836000700 1 -- 172.21.15.82:0/3205316168 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5830112a50 con 0x7f5830108410 2024-05-08T05:58:10.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:10.763+0000 7f5835600700 1 --2- 172.21.15.82:0/3205316168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58301023a0 0x7f5830117d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:58:10.764 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:10.763+0000 7f5836000700 1 --2- 172.21.15.82:0/3205316168 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5830108410 0x7f5830112350 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f582800b3f0 tx=0x7f582800b700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:58:10.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:10.764+0000 7f582e000700 1 -- 172.21.15.82:0/3205316168 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5828015020 con 0x7f5830108410 2024-05-08T05:58:10.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:10.764+0000 7f582e000700 1 -- 172.21.15.82:0/3205316168 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5828011ce0 con 0x7f5830108410 2024-05-08T05:58:10.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:10.764+0000 7f582e000700 1 -- 172.21.15.82:0/3205316168 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5828010c40 con 0x7f5830108410 2024-05-08T05:58:10.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:10.764+0000 7f5838000700 1 -- 172.21.15.82:0/3205316168 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5830072ea0 con 0x7f5830108410 2024-05-08T05:58:10.765 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:10.765+0000 7f5838000700 1 -- 172.21.15.82:0/3205316168 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5830073360 con 0x7f5830108410 2024-05-08T05:58:10.767 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:10.766+0000 7f5838000700 1 -- 172.21.15.82:0/3205316168 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5830103ac0 con 0x7f5830108410 2024-05-08T05:58:10.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:10.771+0000 7f582e000700 1 -- 172.21.15.82:0/3205316168 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f5828018020 con 0x7f5830108410 2024-05-08T05:58:10.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:10.773+0000 7f582e000700 1 --2- 172.21.15.82:0/3205316168 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f58180b2a50 0x7f58180b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:10.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:10.773+0000 7f582e000700 1 -- 172.21.15.82:0/3205316168 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f58280e1e50 con 0x7f5830108410 2024-05-08T05:58:10.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:10.775+0000 7f5835600700 1 --2- 172.21.15.82:0/3205316168 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f58180b2a50 0x7f58180b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:10.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:10.776+0000 7f5835600700 1 --2- 172.21.15.82:0/3205316168 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f58180b2a50 0x7f58180b4f10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f581c009cb0 tx=0x7f581c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:58:10.780 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:10.779+0000 7f582e000700 1 -- 172.21.15.82:0/3205316168 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f582801f020 con 0x7f5830108410 2024-05-08T05:58:11.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:11.229+0000 7f5838000700 1 -- 172.21.15.82:0/3205316168 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5830113340 con 0x7f5830108410 2024-05-08T05:58:11.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:11.231+0000 7f582e000700 1 -- 172.21.15.82:0/3205316168 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11948 (secure 0 0 0) 0x7f58280a9ba0 con 0x7f5830108410 2024-05-08T05:58:11.232 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:58:11.232 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14364,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3876883250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3876883250},{"type":"v1","addr":"172.21.15.82:6835","nonce":3876883250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1965070586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1965070586},{"type":"v1","addr":"172.21.15.82:6837","nonce":1965070586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":31,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T05:45:57.654009+0000","modified":"2024-05-08T05:53:20.165672+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24505,"mds_2":24487,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14397":{"gid":14397,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/1890720973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1890720973},{"type":"v1","addr":"172.21.15.82:6839","nonce":1890720973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14409":{"gid":14409,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/2957083305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":2957083305},{"type":"v1","addr":"172.21.15.82:6841","nonce":2957083305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6833/3827691638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3827691638},{"type":"v1","addr":"172.21.15.134:6833","nonce":3827691638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6833/3625067797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3625067797},{"type":"v1","addr":"172.21.15.151:6833","nonce":3625067797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/4074163402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4074163402},{"type":"v1","addr":"172.21.15.134:6835","nonce":4074163402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.134:6837/2212411710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2212411710},{"type":"v1","addr":"172.21.15.134:6837","nonce":2212411710}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":17,"addr":"172.21.15.151:6835/2093655929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2093655929},{"type":"v1","addr":"172.21.15.151:6835","nonce":2093655929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6837/4192404464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":4192404464},{"type":"v1","addr":"172.21.15.151:6837","nonce":4192404464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":14,"addr":"172.21.15.151:6839/2963754236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":2963754236},{"type":"v1","addr":"172.21.15.151:6839","nonce":2963754236}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.134:6839/1145270893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1145270893},{"type":"v1","addr":"172.21.15.134:6839","nonce":1145270893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24505,24506,24487,24475,24467]},"id":1}]} 2024-05-08T05:58:11.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:11.233+0000 7f5838000700 1 -- 172.21.15.82:0/3205316168 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f58180b2a50 msgr2=0x7f58180b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:11.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:11.233+0000 7f5838000700 1 --2- 172.21.15.82:0/3205316168 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f58180b2a50 0x7f58180b4f10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f581c009cb0 tx=0x7f581c009260 comp rx=0 tx=0).stop 2024-05-08T05:58:11.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:11.233+0000 7f5838000700 1 -- 172.21.15.82:0/3205316168 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5830108410 msgr2=0x7f5830112350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:11.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:11.233+0000 7f5838000700 1 --2- 172.21.15.82:0/3205316168 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5830108410 0x7f5830112350 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f582800b3f0 tx=0x7f582800b700 comp rx=0 tx=0).stop 2024-05-08T05:58:11.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:11.234+0000 7f5838000700 1 -- 172.21.15.82:0/3205316168 shutdown_connections 2024-05-08T05:58:11.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:11.234+0000 7f5838000700 1 --2- 172.21.15.82:0/3205316168 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f58180b2a50 0x7f58180b4f10 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:11.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:11.234+0000 7f5838000700 1 --2- 172.21.15.82:0/3205316168 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5830108410 0x7f5830112350 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:11.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:11.234+0000 7f5838000700 1 --2- 172.21.15.82:0/3205316168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f58301023a0 0x7f5830117d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:11.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:11.234+0000 7f5838000700 1 --2- 172.21.15.82:0/3205316168 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5830102d60 0x7f5830111e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:11.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:11.234+0000 7f5838000700 1 -- 172.21.15.82:0/3205316168 >> 172.21.15.82:0/3205316168 conn(0x7f5830079350 msgr2=0x7f5830100ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:58:11.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:11.234+0000 7f5838000700 1 -- 172.21.15.82:0/3205316168 shutdown_connections 2024-05-08T05:58:11.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:11.234+0000 7f5838000700 1 -- 172.21.15.82:0/3205316168 wait complete. 2024-05-08T05:58:11.238 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 31 2024-05-08T05:58:11.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:58:11 smithi151 ceph-mon[34815]: pgmap v685: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 6.1 MiB/s wr, 674 op/s 2024-05-08T05:58:11.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:58:11 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/3205316168' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:58:11.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:58:11 smithi082 ceph-mon[30098]: pgmap v685: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 6.1 MiB/s wr, 674 op/s 2024-05-08T05:58:11.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:58:11 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/3205316168' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:58:12.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:58:11 smithi134 ceph-mon[34132]: pgmap v685: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 6.1 MiB/s wr, 674 op/s 2024-05-08T05:58:12.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:58:11 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/3205316168' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:58:12.205 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-05-08T05:58:12.818 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:58:13.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:58:13 smithi151 ceph-mon[34815]: pgmap v686: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 6.4 MiB/s wr, 618 op/s 2024-05-08T05:58:13.912 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:58:13 smithi082 ceph-mon[30098]: pgmap v686: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 6.4 MiB/s wr, 618 op/s 2024-05-08T05:58:13.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:58:13 smithi134 ceph-mon[34132]: pgmap v686: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 6.4 MiB/s wr, 618 op/s 2024-05-08T05:58:15.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.214+0000 7f8b22a00700 1 -- 172.21.15.82:0/794283482 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8b1c0756d0 msgr2=0x7f8b1c075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:15.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.214+0000 7f8b22a00700 1 --2- 172.21.15.82:0/794283482 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8b1c0756d0 0x7f8b1c075ab0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c009990 tx=0x7f8b0c009ca0 comp rx=0 tx=0).stop 2024-05-08T05:58:15.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.214+0000 7f8b22a00700 1 -- 172.21.15.82:0/794283482 shutdown_connections 2024-05-08T05:58:15.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.214+0000 7f8b22a00700 1 --2- 172.21.15.82:0/794283482 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b1c114670 0x7f8b1c116a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:15.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.214+0000 7f8b22a00700 1 --2- 172.21.15.82:0/794283482 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8b1c0756d0 0x7f8b1c075ab0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:15.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.214+0000 7f8b22a00700 1 --2- 172.21.15.82:0/794283482 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b1c075ff0 0x7f8b1c114130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:15.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.214+0000 7f8b22a00700 1 -- 172.21.15.82:0/794283482 >> 172.21.15.82:0/794283482 conn(0x7f8b1c07a600 msgr2=0x7f8b1c07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:58:15.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.215+0000 7f8b22a00700 1 -- 172.21.15.82:0/794283482 shutdown_connections 2024-05-08T05:58:15.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.215+0000 7f8b22a00700 1 -- 172.21.15.82:0/794283482 wait complete. 2024-05-08T05:58:15.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.216+0000 7f8b22a00700 1 Processor -- start 2024-05-08T05:58:15.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.216+0000 7f8b22a00700 1 -- start start 2024-05-08T05:58:15.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.216+0000 7f8b22a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8b1c0756d0 0x7f8b1c1a01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:15.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.217+0000 7f8b22a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b1c075ff0 0x7f8b1c1a0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:15.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.217+0000 7f8b22a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b1c114670 0x7f8b1c1a4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:15.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.217+0000 7f8b22a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8b1c119ca0 con 0x7f8b1c075ff0 2024-05-08T05:58:15.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.217+0000 7f8b22a00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8b1c119b20 con 0x7f8b1c114670 2024-05-08T05:58:15.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.217+0000 7f8b22a00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8b1c119e20 con 0x7f8b1c0756d0 2024-05-08T05:58:15.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.217+0000 7f8b1be00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8b1c0756d0 0x7f8b1c1a01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:15.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.217+0000 7f8b20a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b1c114670 0x7f8b1c1a4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:15.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.217+0000 7f8b20a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b1c114670 0x7f8b1c1a4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:57606/0 (socket says 172.21.15.82:57606) 2024-05-08T05:58:15.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.217+0000 7f8b20a00700 1 -- 172.21.15.82:0/3505452032 learned_addr learned my addr 172.21.15.82:0/3505452032 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:58:15.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.218+0000 7f8b20a00700 1 -- 172.21.15.82:0/3505452032 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8b1c0756d0 msgr2=0x7f8b1c1a01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:15.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.218+0000 7f8b20a00700 1 --2- 172.21.15.82:0/3505452032 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8b1c0756d0 0x7f8b1c1a01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:15.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.218+0000 7f8b20a00700 1 -- 172.21.15.82:0/3505452032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b1c075ff0 msgr2=0x7f8b1c1a0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:15.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.218+0000 7f8b20a00700 1 --2- 172.21.15.82:0/3505452032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b1c075ff0 0x7f8b1c1a0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:15.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.218+0000 7f8b20a00700 1 -- 172.21.15.82:0/3505452032 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b1c1a5200 con 0x7f8b1c114670 2024-05-08T05:58:15.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.218+0000 7f8b20a00700 1 --2- 172.21.15.82:0/3505452032 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b1c114670 0x7f8b1c1a4ac0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8b14007ec0 tx=0x7f8b1400d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:58:15.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.219+0000 7f8b18c00700 1 -- 172.21.15.82:0/3505452032 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b14004bb0 con 0x7f8b1c114670 2024-05-08T05:58:15.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.219+0000 7f8b18c00700 1 -- 172.21.15.82:0/3505452032 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b14004d50 con 0x7f8b1c114670 2024-05-08T05:58:15.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.219+0000 7f8b22a00700 1 -- 172.21.15.82:0/3505452032 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b1c1a54f0 con 0x7f8b1c114670 2024-05-08T05:58:15.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.219+0000 7f8b18c00700 1 -- 172.21.15.82:0/3505452032 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b14004550 con 0x7f8b1c114670 2024-05-08T05:58:15.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.219+0000 7f8b22a00700 1 -- 172.21.15.82:0/3505452032 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b1c1acd70 con 0x7f8b1c114670 2024-05-08T05:58:15.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.223+0000 7f8b18c00700 1 -- 172.21.15.82:0/3505452032 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f8b1401a030 con 0x7f8b1c114670 2024-05-08T05:58:15.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.225+0000 7f8b18c00700 1 --2- 172.21.15.82:0/3505452032 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f8b000b2880 0x7f8b000b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:15.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.225+0000 7f8b18c00700 1 -- 172.21.15.82:0/3505452032 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f8b140e17b0 con 0x7f8b1c114670 2024-05-08T05:58:15.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.228+0000 7f8b2d324b80 1 Processor -- start 2024-05-08T05:58:15.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.229+0000 7f8b1be00700 1 --2- 172.21.15.82:0/3505452032 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f8b000b2880 0x7f8b000b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:15.229 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.229+0000 7f8b2d324b80 1 -- start start 2024-05-08T05:58:15.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.229+0000 7f8b2d324b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ed99a6060 0x558ed99a6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:15.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.229+0000 7f8b2d324b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ed99a6980 0x558ed99aa490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:15.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.230+0000 7f8b2d324b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ed99aa9d0 0x558ed99aae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:15.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.230+0000 7f8b2d324b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x558ed98f8a20 con 0x558ed99a6980 2024-05-08T05:58:15.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.230+0000 7f8b2d324b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558ed9896760 con 0x558ed99aa9d0 2024-05-08T05:58:15.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.230+0000 7f8b2d324b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x558ed98f49e0 con 0x558ed99a6060 2024-05-08T05:58:15.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.230+0000 7f8b1b400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ed99a6980 0x558ed99aa490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:15.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.230+0000 7f8b1b400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ed99a6980 0x558ed99aa490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53884/0 (socket says 172.21.15.82:53884) 2024-05-08T05:58:15.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.230+0000 7f8b1b400700 1 -- 172.21.15.82:0/2365444747 learned_addr learned my addr 172.21.15.82:0/2365444747 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:58:15.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.230+0000 7f8b20a00700 1 --2- 172.21.15.82:0/2365444747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ed99aa9d0 0x558ed99aae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:15.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.231+0000 7f8b1b400700 1 -- 172.21.15.82:0/2365444747 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ed99a6060 msgr2=0x558ed99a6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:15.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.231+0000 7f8b1b400700 1 --2- 172.21.15.82:0/2365444747 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ed99a6060 0x558ed99a6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:15.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.231+0000 7f8b1b400700 1 -- 172.21.15.82:0/2365444747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ed99aa9d0 msgr2=0x558ed99aae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:15.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.231+0000 7f8b1b400700 1 --2- 172.21.15.82:0/2365444747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ed99aa9d0 0x558ed99aae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:15.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.231+0000 7f8b1b400700 1 -- 172.21.15.82:0/2365444747 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ed98458d0 con 0x558ed99a6980 2024-05-08T05:58:15.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.231+0000 7f8b1b400700 1 --2- 172.21.15.82:0/2365444747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ed99a6980 0x558ed99aa490 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8b08009c70 tx=0x7f8b08009f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eb8e112dc9f1fd7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:58:15.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.231+0000 7f8b11600700 1 -- 172.21.15.82:0/2365444747 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b0800eb60 con 0x558ed99a6980 2024-05-08T05:58:15.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.231+0000 7f8b11600700 1 -- 172.21.15.82:0/2365444747 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b08004ce0 con 0x558ed99a6980 2024-05-08T05:58:15.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.231+0000 7f8b1be00700 1 --2- 172.21.15.82:0/3505452032 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f8b000b2880 0x7f8b000b4d40 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c006010 tx=0x7f8b0c01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:58:15.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.231+0000 7f8b11600700 1 -- 172.21.15.82:0/2365444747 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b08005650 con 0x558ed99a6980 2024-05-08T05:58:15.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.232+0000 7f8b2d324b80 1 -- 172.21.15.82:0/2365444747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ed99a6980 msgr2=0x558ed99aa490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:15.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.232+0000 7f8b2d324b80 1 --2- 172.21.15.82:0/2365444747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ed99a6980 0x558ed99aa490 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f8b08009c70 tx=0x7f8b08009f80 comp rx=0 tx=0).stop 2024-05-08T05:58:15.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.232+0000 7f8b2d324b80 1 -- 172.21.15.82:0/2365444747 shutdown_connections 2024-05-08T05:58:15.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.232+0000 7f8b2d324b80 1 --2- 172.21.15.82:0/2365444747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ed99aa9d0 0x558ed99aae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:15.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.232+0000 7f8b2d324b80 1 --2- 172.21.15.82:0/2365444747 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ed99a6060 0x558ed99a6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:15.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.232+0000 7f8b2d324b80 1 --2- 172.21.15.82:0/2365444747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ed99a6980 0x558ed99aa490 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:15.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.232+0000 7f8b2d324b80 1 -- 172.21.15.82:0/2365444747 >> 172.21.15.82:0/2365444747 conn(0x558ed98d4b60 msgr2=0x558ed99a07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:58:15.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.233+0000 7f8b2d324b80 1 -- 172.21.15.82:0/2365444747 shutdown_connections 2024-05-08T05:58:15.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.233+0000 7f8b2d324b80 1 -- 172.21.15.82:0/2365444747 wait complete. 2024-05-08T05:58:15.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.233+0000 7f8b2d324b80 1 -- start start 2024-05-08T05:58:15.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.233+0000 7f8b2d324b80 1 Processor -- start 2024-05-08T05:58:15.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.234+0000 7f8b2d324b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ed99a6060 0x558ed99b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:15.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.234+0000 7f8b2d324b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ed99a6980 0x558ed99af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:15.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.235+0000 7f8b1be00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ed99a6060 0x558ed99b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:15.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.235+0000 7f8b1be00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ed99a6060 0x558ed99b1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:45066/0 (socket says 172.21.15.82:45066) 2024-05-08T05:58:15.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.235+0000 7f8b1be00700 1 -- 172.21.15.82:0/1316427556 learned_addr learned my addr 172.21.15.82:0/1316427556 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:58:15.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.235+0000 7f8b2d324b80 1 --2- 172.21.15.82:0/1316427556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ed99aa9d0 0x558ed99af800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:15.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.235+0000 7f8b2d324b80 1 -- 172.21.15.82:0/1316427556 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x558ed99b2be0 con 0x558ed99aa9d0 2024-05-08T05:58:15.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.235+0000 7f8b2d324b80 1 -- 172.21.15.82:0/1316427556 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558ed985eb20 con 0x558ed99a6980 2024-05-08T05:58:15.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.235+0000 7f8b2d324b80 1 -- 172.21.15.82:0/1316427556 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x558ed99b2d60 con 0x558ed99a6060 2024-05-08T05:58:15.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.235+0000 7f8b2d324b80 10 client.0 _ll_register_callbacks cb 0x558ed989fc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:58:15.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.235+0000 7f8b1b400700 1 --2- 172.21.15.82:0/1316427556 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ed99a6980 0x558ed99af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:15.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.236+0000 7f8b20a00700 1 --2- 172.21.15.82:0/1316427556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ed99aa9d0 0x558ed99af800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:15.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.236+0000 7f8b1be00700 1 -- 172.21.15.82:0/1316427556 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ed99a6980 msgr2=0x558ed99af2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:15.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.236+0000 7f8b1be00700 1 --2- 172.21.15.82:0/1316427556 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ed99a6980 0x558ed99af2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:15.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.236+0000 7f8b1be00700 1 -- 172.21.15.82:0/1316427556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ed99aa9d0 msgr2=0x558ed99af800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:15.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.236+0000 7f8b1be00700 1 --2- 172.21.15.82:0/1316427556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ed99aa9d0 0x558ed99af800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:15.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.236+0000 7f8b1be00700 1 -- 172.21.15.82:0/1316427556 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ed98be420 con 0x558ed99a6060 2024-05-08T05:58:15.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.236+0000 7f8b20a00700 1 --2- 172.21.15.82:0/1316427556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ed99aa9d0 0x558ed99af800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:58:15.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.236+0000 7f8b1be00700 1 --2- 172.21.15.82:0/1316427556 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ed99a6060 0x558ed99b1f20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c005300 tx=0x7f8b0c009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9764d3d9db9031da server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:58:15.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.237+0000 7f8b06000700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:58:15.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.237+0000 7f8b06000700 1 -- 172.21.15.82:0/1316427556 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c0056c0 con 0x558ed99a6060 2024-05-08T05:58:15.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.237+0000 7f8b06000700 1 -- 172.21.15.82:0/1316427556 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f8b0c00f460 con 0x558ed99a6060 2024-05-08T05:58:15.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.237+0000 7f8b2d324b80 1 -- 172.21.15.82:0/1316427556 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b08004ce0 con 0x558ed99a6060 2024-05-08T05:58:15.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.237+0000 7f8b06000700 1 -- 172.21.15.82:0/1316427556 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f8b0c00f660 con 0x558ed99a6060 2024-05-08T05:58:15.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.237+0000 7f8b2d324b80 10 client.26026 fetch_fsmap learned FSMap version 31 2024-05-08T05:58:15.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.237+0000 7f8b2d324b80 1 -- 172.21.15.82:0/1316427556 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x558ed99bd510 con 0x558ed99a6060 2024-05-08T05:58:15.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.237+0000 7f8b06000700 1 -- 172.21.15.82:0/1316427556 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b08004ce0 con 0x558ed99a6060 2024-05-08T05:58:15.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.238+0000 7f8b06000700 1 -- 172.21.15.82:0/1316427556 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f8b0c02d020 con 0x558ed99a6060 2024-05-08T05:58:15.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.238+0000 7f8b2d324b80 10 client.26026 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:58:15.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.238+0000 7f8b2d324b80 10 client.26026 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-05-08T05:58:15.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.238+0000 7f8b2d324b80 20 client.26026 populate_metadata read hostname 'smithi082' 2024-05-08T05:58:15.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.238+0000 7f8b2d324b80 1 --2- 172.21.15.82:0/1316427556 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x558ed99bfb50 0x558ed99c1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:15.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.238+0000 7f8b2d324b80 4 client.26026 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:58:15.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.238+0000 7f8b2d324b80 1 -- 172.21.15.82:0/1316427556 --> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558ed99730a0 con 0x558ed99bfb50 2024-05-08T05:58:15.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.238+0000 7f8b1b400700 1 --2- 172.21.15.82:0/1316427556 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x558ed99bfb50 0x558ed99c1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:15.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.239+0000 7f8b1b400700 1 --2- 172.21.15.82:0/1316427556 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x558ed99bfb50 0x558ed99c1f60 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b69323f311f085b5 server_cookie=45c5d3bae688f193 in_seq=0 out_seq=0 2024-05-08T05:58:15.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.239+0000 7f8b06000700 10 client.26026 ms_handle_connect on v2:172.21.15.134:6836/2212411710 2024-05-08T05:58:15.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.240+0000 7f8b06000700 1 -- 172.21.15.82:0/1316427556 <== mds.4 v2:172.21.15.134:6836/2212411710 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x558ed99730a0 con 0x558ed99bfb50 2024-05-08T05:58:15.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.240+0000 7f8b06000700 10 client.26026 handle_command_reply: tid=0 2024-05-08T05:58:15.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.240+0000 7f8b2d324b80 1 client.26026 shutdown 2024-05-08T05:58:15.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.240+0000 7f8b2d324b80 1 -- 172.21.15.82:0/1316427556 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ed99a6060 msgr2=0x558ed99b1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:15.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.240+0000 7f8b2d324b80 1 --2- 172.21.15.82:0/1316427556 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ed99a6060 0x558ed99b1f20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c005300 tx=0x7f8b0c009310 comp rx=0 tx=0).stop 2024-05-08T05:58:15.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.240+0000 7f8b2d324b80 1 -- 172.21.15.82:0/1316427556 shutdown_connections 2024-05-08T05:58:15.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.240+0000 7f8b2d324b80 1 --2- 172.21.15.82:0/1316427556 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x558ed99bfb50 0x558ed99c1f60 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:15.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.240+0000 7f8b2d324b80 1 --2- 172.21.15.82:0/1316427556 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ed99aa9d0 0x558ed99af800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:15.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.240+0000 7f8b2d324b80 1 --2- 172.21.15.82:0/1316427556 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ed99a6060 0x558ed99b1f20 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:15.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.240+0000 7f8b2d324b80 1 --2- 172.21.15.82:0/1316427556 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ed99a6980 0x558ed99af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:15.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.241+0000 7f8b2d324b80 1 -- 172.21.15.82:0/1316427556 >> 172.21.15.82:0/1316427556 conn(0x558ed98d4b60 msgr2=0x558ed999b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:58:15.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.241+0000 7f8b06000700 0 client.26026 ms_handle_reset on v2:172.21.15.134:6836/2212411710 2024-05-08T05:58:15.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.243+0000 7f8b2d324b80 1 -- 172.21.15.82:0/1316427556 shutdown_connections 2024-05-08T05:58:15.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.243+0000 7f8b2d324b80 1 -- 172.21.15.82:0/1316427556 wait complete. 2024-05-08T05:58:15.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.243+0000 7f8b2d324b80 20 client.26026 trim_cache size 0 max 16384 2024-05-08T05:58:15.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 445.0 s, 1606.6 tps, lat 61.812 ms stddev 76.792 2024-05-08T05:58:15.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.268+0000 7f8b2d324b80 1 Processor -- start 2024-05-08T05:58:15.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.268+0000 7f8b2d324b80 1 -- start start 2024-05-08T05:58:15.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.268+0000 7f8b2d324b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ed99a6060 0x558ed99bbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:15.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.268+0000 7f8b2d324b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ed99a6980 0x558ed99c7870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:15.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.268+0000 7f8b2d324b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ed99aa9d0 0x558ed99c7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:15.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.269+0000 7f8b2d324b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8b1c1b42b0 con 0x558ed99aa9d0 2024-05-08T05:58:15.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.269+0000 7f8b2d324b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8b1c1b5df0 con 0x558ed99a6060 2024-05-08T05:58:15.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.269+0000 7f8b2d324b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8b1c1b4980 con 0x558ed99a6980 2024-05-08T05:58:15.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.269+0000 7f8b1be00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ed99a6060 0x558ed99bbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:15.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.269+0000 7f8b1be00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ed99a6060 0x558ed99bbc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:57630/0 (socket says 172.21.15.82:57630) 2024-05-08T05:58:15.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.269+0000 7f8b1be00700 1 -- 172.21.15.82:0/89650848 learned_addr learned my addr 172.21.15.82:0/89650848 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:58:15.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.269+0000 7f8b20a00700 1 --2- 172.21.15.82:0/89650848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ed99aa9d0 0x558ed99c7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:15.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.269+0000 7f8b1b400700 1 --2- 172.21.15.82:0/89650848 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ed99a6980 0x558ed99c7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:15.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.270+0000 7f8b20a00700 1 -- 172.21.15.82:0/89650848 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ed99a6980 msgr2=0x558ed99c7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:15.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.270+0000 7f8b20a00700 1 --2- 172.21.15.82:0/89650848 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ed99a6980 0x558ed99c7870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:15.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.270+0000 7f8b20a00700 1 -- 172.21.15.82:0/89650848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ed99a6060 msgr2=0x558ed99bbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:15.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.270+0000 7f8b20a00700 1 --2- 172.21.15.82:0/89650848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ed99a6060 0x558ed99bbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:15.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.270+0000 7f8b20a00700 1 -- 172.21.15.82:0/89650848 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ed999cf90 con 0x558ed99aa9d0 2024-05-08T05:58:15.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.270+0000 7f8b1b400700 1 --2- 172.21.15.82:0/89650848 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ed99a6980 0x558ed99c7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:58:15.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.271+0000 7f8b20a00700 1 --2- 172.21.15.82:0/89650848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ed99aa9d0 0x558ed99c7db0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8b140a8b10 tx=0x7f8b1400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73166a8cbd02b20e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:58:15.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.272+0000 7f8b10c00700 1 -- 172.21.15.82:0/89650848 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b140ad1c0 con 0x558ed99aa9d0 2024-05-08T05:58:15.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.272+0000 7f8b10c00700 1 -- 172.21.15.82:0/89650848 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b140b1be0 con 0x558ed99aa9d0 2024-05-08T05:58:15.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.272+0000 7f8b10c00700 1 -- 172.21.15.82:0/89650848 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b140a92d0 con 0x558ed99aa9d0 2024-05-08T05:58:15.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.274+0000 7f8b2d324b80 1 -- 172.21.15.82:0/89650848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ed99aa9d0 msgr2=0x558ed99c7db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:15.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.274+0000 7f8b2d324b80 1 --2- 172.21.15.82:0/89650848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ed99aa9d0 0x558ed99c7db0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8b140a8b10 tx=0x7f8b1400b040 comp rx=0 tx=0).stop 2024-05-08T05:58:15.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.274+0000 7f8b2d324b80 1 -- 172.21.15.82:0/89650848 shutdown_connections 2024-05-08T05:58:15.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.274+0000 7f8b2d324b80 1 --2- 172.21.15.82:0/89650848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ed99a6060 0x558ed99bbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:15.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.274+0000 7f8b2d324b80 1 --2- 172.21.15.82:0/89650848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ed99aa9d0 0x558ed99c7db0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:15.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.274+0000 7f8b2d324b80 1 --2- 172.21.15.82:0/89650848 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ed99a6980 0x558ed99c7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:15.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.274+0000 7f8b2d324b80 1 -- 172.21.15.82:0/89650848 >> 172.21.15.82:0/89650848 conn(0x558ed98d4b60 msgr2=0x558ed99adbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:58:15.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.275+0000 7f8b2d324b80 1 -- 172.21.15.82:0/89650848 shutdown_connections 2024-05-08T05:58:15.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.275+0000 7f8b2d324b80 1 -- 172.21.15.82:0/89650848 wait complete. 2024-05-08T05:58:15.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.276+0000 7f8b2d324b80 1 -- start start 2024-05-08T05:58:15.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.277+0000 7f8b2d324b80 1 Processor -- start 2024-05-08T05:58:15.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.278+0000 7f8b2d324b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ed99a6060 0x558ed99b7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:15.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.278+0000 7f8b2d324b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ed99a6980 0x558ed99b8530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:15.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.278+0000 7f8b2d324b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ed99aa9d0 0x558ed99ab8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:15.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.278+0000 7f8b2d324b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8b1c1b5720 con 0x558ed99aa9d0 2024-05-08T05:58:15.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.278+0000 7f8b2d324b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8b1c1b5050 con 0x558ed99a6980 2024-05-08T05:58:15.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.278+0000 7f8b2d324b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8b1c1b2250 con 0x558ed99a6060 2024-05-08T05:58:15.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.278+0000 7f8b2d324b80 10 client.0 _ll_register_callbacks cb 0x558ed989fc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:58:15.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.278+0000 7f8b1be00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ed99a6060 0x558ed99b7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:15.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.278+0000 7f8b1be00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ed99a6060 0x558ed99b7ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:45084/0 (socket says 172.21.15.82:45084) 2024-05-08T05:58:15.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.278+0000 7f8b1be00700 1 -- 172.21.15.82:0/713060625 learned_addr learned my addr 172.21.15.82:0/713060625 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:58:15.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.278+0000 7f8b1b400700 1 --2- 172.21.15.82:0/713060625 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ed99a6980 0x558ed99b8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:15.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.279+0000 7f8b20a00700 1 --2- 172.21.15.82:0/713060625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ed99aa9d0 0x558ed99ab8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:15.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.279+0000 7f8b1be00700 1 -- 172.21.15.82:0/713060625 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ed99a6980 msgr2=0x558ed99b8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:15.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.279+0000 7f8b1be00700 1 --2- 172.21.15.82:0/713060625 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ed99a6980 0x558ed99b8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:15.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.279+0000 7f8b1be00700 1 -- 172.21.15.82:0/713060625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ed99aa9d0 msgr2=0x558ed99ab8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:15.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.279+0000 7f8b1be00700 1 --2- 172.21.15.82:0/713060625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ed99aa9d0 0x558ed99ab8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:15.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.279+0000 7f8b1be00700 1 -- 172.21.15.82:0/713060625 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ed99ac010 con 0x558ed99a6060 2024-05-08T05:58:15.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.280+0000 7f8b1be00700 1 --2- 172.21.15.82:0/713060625 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ed99a6060 0x558ed99b7ff0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c025a00 tx=0x7f8b0c005bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d60fd1fff91e138 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:58:15.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.280+0000 7f8b06000700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:58:15.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.280+0000 7f8b06000700 1 -- 172.21.15.82:0/713060625 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b0c025630 con 0x558ed99a6060 2024-05-08T05:58:15.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.280+0000 7f8b06000700 1 -- 172.21.15.82:0/713060625 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f8b0c00f800 con 0x558ed99a6060 2024-05-08T05:58:15.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.280+0000 7f8b2d324b80 1 -- 172.21.15.82:0/713060625 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b140b1be0 con 0x558ed99a6060 2024-05-08T05:58:15.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.281+0000 7f8b06000700 1 -- 172.21.15.82:0/713060625 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f8b0c00fa00 con 0x558ed99a6060 2024-05-08T05:58:15.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.281+0000 7f8b2d324b80 10 client.26032 fetch_fsmap learned FSMap version 31 2024-05-08T05:58:15.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.281+0000 7f8b2d324b80 1 -- 172.21.15.82:0/713060625 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x558ed9a3ae70 con 0x558ed99a6060 2024-05-08T05:58:15.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.281+0000 7f8b06000700 1 -- 172.21.15.82:0/713060625 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8b140b1be0 con 0x558ed99a6060 2024-05-08T05:58:15.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.282+0000 7f8b06000700 1 -- 172.21.15.82:0/713060625 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f8b0c02d040 con 0x558ed99a6060 2024-05-08T05:58:15.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.282+0000 7f8b2d324b80 10 client.26032 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:58:15.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.282+0000 7f8b2d324b80 10 client.26032 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-05-08T05:58:15.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.282+0000 7f8b2d324b80 20 client.26032 populate_metadata read hostname 'smithi082' 2024-05-08T05:58:15.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.282+0000 7f8b2d324b80 1 --2- 172.21.15.82:0/713060625 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x558ed9a3b460 0x558ed9a3d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:15.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.282+0000 7f8b2d324b80 4 client.26032 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:58:15.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.282+0000 7f8b2d324b80 1 -- 172.21.15.82:0/713060625 --> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558ed9906400 con 0x558ed9a3b460 2024-05-08T05:58:15.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.282+0000 7f8b1b400700 1 --2- 172.21.15.82:0/713060625 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x558ed9a3b460 0x558ed9a3d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:15.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.283+0000 7f8b1b400700 1 --2- 172.21.15.82:0/713060625 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x558ed9a3b460 0x558ed9a3d880 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=335865ca93a4c400 server_cookie=4f6b1ea045a453f5 in_seq=0 out_seq=0 2024-05-08T05:58:15.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.283+0000 7f8b06000700 10 client.26032 ms_handle_connect on v2:172.21.15.134:6836/2212411710 2024-05-08T05:58:15.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.284+0000 7f8b06000700 1 -- 172.21.15.82:0/713060625 <== mds.4 v2:172.21.15.134:6836/2212411710 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558ed9906400 con 0x558ed9a3b460 2024-05-08T05:58:15.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.284+0000 7f8b06000700 10 client.26032 handle_command_reply: tid=0 2024-05-08T05:58:15.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.284+0000 7f8b2d324b80 1 client.26032 shutdown 2024-05-08T05:58:15.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.285+0000 7f8b2d324b80 1 -- 172.21.15.82:0/713060625 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ed99a6060 msgr2=0x558ed99b7ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:15.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.285+0000 7f8b2d324b80 1 --2- 172.21.15.82:0/713060625 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ed99a6060 0x558ed99b7ff0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c025a00 tx=0x7f8b0c005bc0 comp rx=0 tx=0).stop 2024-05-08T05:58:15.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.285+0000 7f8b2d324b80 1 -- 172.21.15.82:0/713060625 shutdown_connections 2024-05-08T05:58:15.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.285+0000 7f8b2d324b80 1 --2- 172.21.15.82:0/713060625 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x558ed9a3b460 0x558ed9a3d880 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:15.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.285+0000 7f8b2d324b80 1 --2- 172.21.15.82:0/713060625 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x558ed99aa9d0 0x558ed99ab8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:15.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.285+0000 7f8b2d324b80 1 --2- 172.21.15.82:0/713060625 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ed99a6060 0x558ed99b7ff0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:15.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.285+0000 7f8b06000700 0 client.26032 ms_handle_reset on v2:172.21.15.134:6836/2212411710 2024-05-08T05:58:15.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.285+0000 7f8b2d324b80 1 --2- 172.21.15.82:0/713060625 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558ed99a6980 0x558ed99b8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:15.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.285+0000 7f8b2d324b80 1 -- 172.21.15.82:0/713060625 >> 172.21.15.82:0/713060625 conn(0x558ed98d4b60 msgr2=0x558ed999aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:58:15.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.286+0000 7f8b2d324b80 1 -- 172.21.15.82:0/713060625 shutdown_connections 2024-05-08T05:58:15.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.286+0000 7f8b2d324b80 1 -- 172.21.15.82:0/713060625 wait complete. 2024-05-08T05:58:15.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.286+0000 7f8b2d324b80 20 client.26032 trim_cache size 0 max 16384 2024-05-08T05:58:15.287 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T05:58:15.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.287+0000 7f8b22a00700 1 -- 172.21.15.82:0/3505452032 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f8b000b2880 msgr2=0x7f8b000b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:15.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.287+0000 7f8b22a00700 1 --2- 172.21.15.82:0/3505452032 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f8b000b2880 0x7f8b000b4d40 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c006010 tx=0x7f8b0c01a040 comp rx=0 tx=0).stop 2024-05-08T05:58:15.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.287+0000 7f8b22a00700 1 -- 172.21.15.82:0/3505452032 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b1c114670 msgr2=0x7f8b1c1a4ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:15.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.287+0000 7f8b22a00700 1 --2- 172.21.15.82:0/3505452032 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b1c114670 0x7f8b1c1a4ac0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8b14007ec0 tx=0x7f8b1400d3b0 comp rx=0 tx=0).stop 2024-05-08T05:58:15.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.287+0000 7f8b22a00700 1 -- 172.21.15.82:0/3505452032 shutdown_connections 2024-05-08T05:58:15.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.287+0000 7f8b22a00700 1 --2- 172.21.15.82:0/3505452032 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b1c114670 0x7f8b1c1a4ac0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:15.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.287+0000 7f8b22a00700 1 --2- 172.21.15.82:0/3505452032 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f8b000b2880 0x7f8b000b4d40 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:15.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.287+0000 7f8b22a00700 1 --2- 172.21.15.82:0/3505452032 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8b1c0756d0 0x7f8b1c1a01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:15.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.287+0000 7f8b22a00700 1 --2- 172.21.15.82:0/3505452032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8b1c075ff0 0x7f8b1c1a0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:15.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.287+0000 7f8b22a00700 1 -- 172.21.15.82:0/3505452032 >> 172.21.15.82:0/3505452032 conn(0x7f8b1c07a600 msgr2=0x7f8b1c110110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:58:15.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.288+0000 7f8b22a00700 1 -- 172.21.15.82:0/3505452032 shutdown_connections 2024-05-08T05:58:15.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:15.288+0000 7f8b22a00700 1 -- 172.21.15.82:0/3505452032 wait complete. 2024-05-08T05:58:15.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:58:15 smithi082 ceph-mon[30098]: pgmap v687: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 7.4 MiB/s wr, 630 op/s 2024-05-08T05:58:16.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:58:15 smithi134 ceph-mon[34132]: pgmap v687: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 7.4 MiB/s wr, 630 op/s 2024-05-08T05:58:16.100 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-05-08T05:58:16.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:58:15 smithi151 ceph-mon[34815]: pgmap v687: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 7.4 MiB/s wr, 630 op/s 2024-05-08T05:58:16.717 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:58:17.917 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:58:17 smithi082 ceph-mon[30098]: pgmap v688: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 10 MiB/s wr, 704 op/s 2024-05-08T05:58:18.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:58:17 smithi134 ceph-mon[34132]: pgmap v688: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 10 MiB/s wr, 704 op/s 2024-05-08T05:58:18.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:58:17 smithi151 ceph-mon[34815]: pgmap v688: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 10 MiB/s wr, 704 op/s 2024-05-08T05:58:19.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.273+0000 7fdb21c00700 1 -- 172.21.15.82:0/3659570806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb1c103520 msgr2=0x7fdb1c1039a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:19.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.273+0000 7fdb21c00700 1 --2- 172.21.15.82:0/3659570806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb1c103520 0x7fdb1c1039a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c009990 tx=0x7fdb0c009ca0 comp rx=0 tx=0).stop 2024-05-08T05:58:19.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.273+0000 7fdb21c00700 1 -- 172.21.15.82:0/3659570806 shutdown_connections 2024-05-08T05:58:19.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.273+0000 7fdb21c00700 1 --2- 172.21.15.82:0/3659570806 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb1c109530 0x7fdb1c109910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:19.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.273+0000 7fdb21c00700 1 --2- 172.21.15.82:0/3659570806 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb1c103ee0 0x7fdb1c110370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:19.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.273+0000 7fdb21c00700 1 --2- 172.21.15.82:0/3659570806 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb1c103520 0x7fdb1c1039a0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:19.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.273+0000 7fdb21c00700 1 -- 172.21.15.82:0/3659570806 >> 172.21.15.82:0/3659570806 conn(0x7fdb1c07a570 msgr2=0x7fdb1c07a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:58:19.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.273+0000 7fdb21c00700 1 -- 172.21.15.82:0/3659570806 shutdown_connections 2024-05-08T05:58:19.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.274+0000 7fdb21c00700 1 -- 172.21.15.82:0/3659570806 wait complete. 2024-05-08T05:58:19.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.275+0000 7fdb21c00700 1 Processor -- start 2024-05-08T05:58:19.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.276+0000 7fdb21c00700 1 -- start start 2024-05-08T05:58:19.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.276+0000 7fdb21c00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb1c103520 0x7fdb1c074fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:19.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.276+0000 7fdb21c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb1c103ee0 0x7fdb1c06cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:19.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.277+0000 7fdb21c00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb1c109530 0x7fdb1c06d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:19.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.277+0000 7fdb21c00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdb1c113670 con 0x7fdb1c103ee0 2024-05-08T05:58:19.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.277+0000 7fdb21c00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdb1c1134f0 con 0x7fdb1c103520 2024-05-08T05:58:19.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.277+0000 7fdb21c00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fdb1c1137f0 con 0x7fdb1c109530 2024-05-08T05:58:19.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.277+0000 7fdb1b400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb1c109530 0x7fdb1c06d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:19.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.277+0000 7fdb1b400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb1c109530 0x7fdb1c06d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:45104/0 (socket says 172.21.15.82:45104) 2024-05-08T05:58:19.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.277+0000 7fdb1b400700 1 -- 172.21.15.82:0/1972087632 learned_addr learned my addr 172.21.15.82:0/1972087632 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:58:19.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.277+0000 7fdb1aa00700 1 --2- 172.21.15.82:0/1972087632 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb1c103520 0x7fdb1c074fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:19.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.277+0000 7fdb1b400700 1 -- 172.21.15.82:0/1972087632 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb1c103520 msgr2=0x7fdb1c074fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:19.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.277+0000 7fdb1b400700 1 --2- 172.21.15.82:0/1972087632 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb1c103520 0x7fdb1c074fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:19.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.277+0000 7fdb1b400700 1 -- 172.21.15.82:0/1972087632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb1c103ee0 msgr2=0x7fdb1c06cf90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T05:58:19.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.278+0000 7fdb1a000700 1 --2- 172.21.15.82:0/1972087632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb1c103ee0 0x7fdb1c06cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:19.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.278+0000 7fdb1b400700 1 --2- 172.21.15.82:0/1972087632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb1c103ee0 0x7fdb1c06cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:19.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.278+0000 7fdb1b400700 1 -- 172.21.15.82:0/1972087632 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb1c06dd40 con 0x7fdb1c109530 2024-05-08T05:58:19.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.278+0000 7fdb1b400700 1 --2- 172.21.15.82:0/1972087632 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb1c109530 0x7fdb1c06d4d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fdb1400ef30 tx=0x7fdb1400c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:58:19.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.278+0000 7fdb1aa00700 1 --2- 172.21.15.82:0/1972087632 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb1c103520 0x7fdb1c074fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:58:19.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.278+0000 7fdb13400700 1 -- 172.21.15.82:0/1972087632 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb140092e0 con 0x7fdb1c109530 2024-05-08T05:58:19.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.279+0000 7fdb13400700 1 -- 172.21.15.82:0/1972087632 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb14004bb0 con 0x7fdb1c109530 2024-05-08T05:58:19.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.279+0000 7fdb21c00700 1 -- 172.21.15.82:0/1972087632 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb1c1b0ad0 con 0x7fdb1c109530 2024-05-08T05:58:19.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.279+0000 7fdb13400700 1 -- 172.21.15.82:0/1972087632 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb14004280 con 0x7fdb1c109530 2024-05-08T05:58:19.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.279+0000 7fdb1a000700 1 --2- 172.21.15.82:0/1972087632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb1c103ee0 0x7fdb1c06cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:58:19.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.279+0000 7fdb21c00700 1 -- 172.21.15.82:0/1972087632 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb1c1b0f20 con 0x7fdb1c109530 2024-05-08T05:58:19.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.285+0000 7fdb2c619b80 1 Processor -- start 2024-05-08T05:58:19.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.285+0000 7fdb13400700 1 -- 172.21.15.82:0/1972087632 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fdb1401b030 con 0x7fdb1c109530 2024-05-08T05:58:19.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.286+0000 7fdb2c619b80 1 -- start start 2024-05-08T05:58:19.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.286+0000 7fdb2c619b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649fde9ebc0 0x5649fde9efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:19.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.286+0000 7fdb2c619b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649fde9f4e0 0x5649fde992d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:19.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.286+0000 7fdb2c619b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649fde998f0 0x5649fde99d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:19.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.286+0000 7fdb2c619b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5649fddeba20 con 0x5649fde998f0 2024-05-08T05:58:19.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.286+0000 7fdb2c619b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5649fdd89760 con 0x5649fde9ebc0 2024-05-08T05:58:19.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.286+0000 7fdb2c619b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5649fdde79e0 con 0x5649fde9f4e0 2024-05-08T05:58:19.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.288+0000 7fdb13400700 1 --2- 172.21.15.82:0/1972087632 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fdb000b2980 0x7fdb000b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:19.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.288+0000 7fdb13400700 1 -- 172.21.15.82:0/1972087632 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fdb140e1eb0 con 0x7fdb1c109530 2024-05-08T05:58:19.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.288+0000 7fdb1b400700 1 --2- 172.21.15.82:0/1972087632 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fdb000b2980 0x7fdb000b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:19.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.289+0000 7fdb1aa00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649fde9f4e0 0x5649fde992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:19.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.289+0000 7fdb1b400700 1 --2- 172.21.15.82:0/1972087632 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fdb000b2980 0x7fdb000b4e40 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fdb14004fd0 tx=0x7fdb14009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:58:19.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.289+0000 7fdb1aa00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649fde9f4e0 0x5649fde992d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:45110/0 (socket says 172.21.15.82:45110) 2024-05-08T05:58:19.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.289+0000 7fdb1aa00700 1 -- 172.21.15.82:0/129697586 learned_addr learned my addr 172.21.15.82:0/129697586 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:58:19.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.290+0000 7fdb1a000700 1 --2- 172.21.15.82:0/129697586 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649fde998f0 0x5649fde99d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:19.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.291+0000 7fdb1a000700 1 --2- 172.21.15.82:0/129697586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649fde9ebc0 0x5649fde9efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:19.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.292+0000 7fdb1aa00700 1 -- 172.21.15.82:0/129697586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649fde9ebc0 msgr2=0x5649fde9efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:19.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.292+0000 7fdb1aa00700 1 --2- 172.21.15.82:0/129697586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649fde9ebc0 0x5649fde9efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:19.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.292+0000 7fdb1aa00700 1 -- 172.21.15.82:0/129697586 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649fde998f0 msgr2=0x5649fde99d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:19.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.292+0000 7fdb1aa00700 1 --2- 172.21.15.82:0/129697586 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649fde998f0 0x5649fde99d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:19.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.292+0000 7fdb1aa00700 1 -- 172.21.15.82:0/129697586 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649fdd388d0 con 0x5649fde9f4e0 2024-05-08T05:58:19.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.293+0000 7fdb1aa00700 1 --2- 172.21.15.82:0/129697586 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649fde9f4e0 0x5649fde992d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdb08009ca0 tx=0x7fdb0800f360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9d58ee69fdea1a6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:58:19.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.293+0000 7fdb07e00700 1 -- 172.21.15.82:0/129697586 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb0800fbe0 con 0x5649fde9f4e0 2024-05-08T05:58:19.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.293+0000 7fdb07e00700 1 -- 172.21.15.82:0/129697586 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb080044e0 con 0x5649fde9f4e0 2024-05-08T05:58:19.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.293+0000 7fdb07e00700 1 -- 172.21.15.82:0/129697586 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb08011440 con 0x5649fde9f4e0 2024-05-08T05:58:19.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.294+0000 7fdb2c619b80 1 -- 172.21.15.82:0/129697586 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649fde9f4e0 msgr2=0x5649fde992d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:19.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.294+0000 7fdb2c619b80 1 --2- 172.21.15.82:0/129697586 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649fde9f4e0 0x5649fde992d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdb08009ca0 tx=0x7fdb0800f360 comp rx=0 tx=0).stop 2024-05-08T05:58:19.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.295+0000 7fdb2c619b80 1 -- 172.21.15.82:0/129697586 shutdown_connections 2024-05-08T05:58:19.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.295+0000 7fdb2c619b80 1 --2- 172.21.15.82:0/129697586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649fde9ebc0 0x5649fde9efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:19.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.295+0000 7fdb2c619b80 1 --2- 172.21.15.82:0/129697586 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649fde998f0 0x5649fde99d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:19.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.295+0000 7fdb2c619b80 1 --2- 172.21.15.82:0/129697586 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649fde9f4e0 0x5649fde992d0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:19.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.295+0000 7fdb2c619b80 1 -- 172.21.15.82:0/129697586 >> 172.21.15.82:0/129697586 conn(0x5649fde116d0 msgr2=0x5649fde93b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:58:19.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.295+0000 7fdb2c619b80 1 -- 172.21.15.82:0/129697586 shutdown_connections 2024-05-08T05:58:19.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.295+0000 7fdb2c619b80 1 -- 172.21.15.82:0/129697586 wait complete. 2024-05-08T05:58:19.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.296+0000 7fdb2c619b80 1 -- start start 2024-05-08T05:58:19.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.296+0000 7fdb2c619b80 1 Processor -- start 2024-05-08T05:58:19.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.297+0000 7fdb2c619b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649fde998f0 0x5649fdea51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:19.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.297+0000 7fdb2c619b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649fde9ebc0 0x5649fdea2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:19.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.297+0000 7fdb2c619b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649fde9f4e0 0x5649fdea2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:19.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.297+0000 7fdb2c619b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5649fdea5f20 con 0x5649fde9f4e0 2024-05-08T05:58:19.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.297+0000 7fdb2c619b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5649fdd51b20 con 0x5649fde9ebc0 2024-05-08T05:58:19.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.297+0000 7fdb2c619b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5649fdea60a0 con 0x5649fde998f0 2024-05-08T05:58:19.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.297+0000 7fdb2c619b80 10 client.0 _ll_register_callbacks cb 0x5649fdd92c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:58:19.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.297+0000 7fdb1aa00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649fde9ebc0 0x5649fdea2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:19.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.297+0000 7fdb1a000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649fde998f0 0x5649fdea51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:19.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.297+0000 7fdb1aa00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649fde9ebc0 0x5649fdea2550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:57690/0 (socket says 172.21.15.82:57690) 2024-05-08T05:58:19.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.297+0000 7fdb1aa00700 1 -- 172.21.15.82:0/3653717544 learned_addr learned my addr 172.21.15.82:0/3653717544 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:58:19.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.297+0000 7fdb1a000700 1 --2- 172.21.15.82:0/3653717544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649fde9f4e0 0x5649fdea2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:19.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.298+0000 7fdb1aa00700 1 -- 172.21.15.82:0/3653717544 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649fde998f0 msgr2=0x5649fdea51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:19.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.298+0000 7fdb1aa00700 1 --2- 172.21.15.82:0/3653717544 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649fde998f0 0x5649fdea51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:19.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.298+0000 7fdb1aa00700 1 -- 172.21.15.82:0/3653717544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649fde9f4e0 msgr2=0x5649fdea2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:19.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.298+0000 7fdb1aa00700 1 --2- 172.21.15.82:0/3653717544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649fde9f4e0 0x5649fdea2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:19.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.298+0000 7fdb1aa00700 1 -- 172.21.15.82:0/3653717544 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649fddb1420 con 0x5649fde9ebc0 2024-05-08T05:58:19.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.298+0000 7fdb1a000700 1 --2- 172.21.15.82:0/3653717544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649fde9f4e0 0x5649fdea2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:58:19.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.298+0000 7fdb1aa00700 1 --2- 172.21.15.82:0/3653717544 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649fde9ebc0 0x5649fdea2550 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fdb0800f6b0 tx=0x7fdb080038b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=829838ff252d4836 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:58:19.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.298+0000 7fdb04c00700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:58:19.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.298+0000 7fdb04c00700 1 -- 172.21.15.82:0/3653717544 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb0802a060 con 0x5649fde9ebc0 2024-05-08T05:58:19.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.298+0000 7fdb04c00700 1 -- 172.21.15.82:0/3653717544 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fdb0800fbf0 con 0x5649fde9ebc0 2024-05-08T05:58:19.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.298+0000 7fdb2c619b80 1 -- 172.21.15.82:0/3653717544 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb080044e0 con 0x5649fde9ebc0 2024-05-08T05:58:19.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.298+0000 7fdb04c00700 1 -- 172.21.15.82:0/3653717544 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fdb0800fdf0 con 0x5649fde9ebc0 2024-05-08T05:58:19.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.298+0000 7fdb2c619b80 10 client.26003 fetch_fsmap learned FSMap version 31 2024-05-08T05:58:19.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.298+0000 7fdb2c619b80 1 -- 172.21.15.82:0/3653717544 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5649fdeb8f90 con 0x5649fde9ebc0 2024-05-08T05:58:19.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.299+0000 7fdb04c00700 1 -- 172.21.15.82:0/3653717544 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb080044e0 con 0x5649fde9ebc0 2024-05-08T05:58:19.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.299+0000 7fdb04c00700 1 -- 172.21.15.82:0/3653717544 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fdb08004be0 con 0x5649fde9ebc0 2024-05-08T05:58:19.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.299+0000 7fdb2c619b80 10 client.26003 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:58:19.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.299+0000 7fdb2c619b80 10 client.26003 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-05-08T05:58:19.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.299+0000 7fdb2c619b80 20 client.26003 populate_metadata read hostname 'smithi082' 2024-05-08T05:58:19.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.299+0000 7fdb2c619b80 1 --2- 172.21.15.82:0/3653717544 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x5649fdebb570 0x5649fdebd960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:19.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.299+0000 7fdb2c619b80 4 client.26003 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:58:19.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.299+0000 7fdb2c619b80 1 -- 172.21.15.82:0/3653717544 --> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5649fde66140 con 0x5649fdebb570 2024-05-08T05:58:19.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.299+0000 7fdb1a000700 1 --2- 172.21.15.82:0/3653717544 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x5649fdebb570 0x5649fdebd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:19.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.300+0000 7fdb04c00700 10 client.26003 ms_handle_connect on v2:172.21.15.151:6834/2093655929 2024-05-08T05:58:19.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.300+0000 7fdb1a000700 1 --2- 172.21.15.82:0/3653717544 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x5649fdebb570 0x5649fdebd960 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=68847ce582373e4b server_cookie=bdad57a807f91e50 in_seq=0 out_seq=0 2024-05-08T05:58:19.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.301+0000 7fdb04c00700 1 -- 172.21.15.82:0/3653717544 <== mds.3 v2:172.21.15.151:6834/2093655929 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5649fde66140 con 0x5649fdebb570 2024-05-08T05:58:19.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.301+0000 7fdb04c00700 10 client.26003 handle_command_reply: tid=0 2024-05-08T05:58:19.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.301+0000 7fdb2c619b80 1 client.26003 shutdown 2024-05-08T05:58:19.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.302+0000 7fdb2c619b80 1 -- 172.21.15.82:0/3653717544 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649fde9ebc0 msgr2=0x5649fdea2550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:19.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.302+0000 7fdb2c619b80 1 --2- 172.21.15.82:0/3653717544 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649fde9ebc0 0x5649fdea2550 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fdb0800f6b0 tx=0x7fdb080038b0 comp rx=0 tx=0).stop 2024-05-08T05:58:19.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.302+0000 7fdb2c619b80 1 -- 172.21.15.82:0/3653717544 shutdown_connections 2024-05-08T05:58:19.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.302+0000 7fdb2c619b80 1 --2- 172.21.15.82:0/3653717544 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x5649fdebb570 0x5649fdebd960 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:19.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.302+0000 7fdb2c619b80 1 --2- 172.21.15.82:0/3653717544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649fde9f4e0 0x5649fdea2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:19.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.302+0000 7fdb2c619b80 1 --2- 172.21.15.82:0/3653717544 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649fde998f0 0x5649fdea51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:19.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.302+0000 7fdb2c619b80 1 --2- 172.21.15.82:0/3653717544 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649fde9ebc0 0x5649fdea2550 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:19.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.302+0000 7fdb2c619b80 1 -- 172.21.15.82:0/3653717544 >> 172.21.15.82:0/3653717544 conn(0x5649fde116d0 msgr2=0x5649fde93190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:58:19.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.302+0000 7fdb04c00700 0 client.26003 ms_handle_reset on v2:172.21.15.151:6834/2093655929 2024-05-08T05:58:19.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.303+0000 7fdb2c619b80 1 -- 172.21.15.82:0/3653717544 shutdown_connections 2024-05-08T05:58:19.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.303+0000 7fdb2c619b80 1 -- 172.21.15.82:0/3653717544 wait complete. 2024-05-08T05:58:19.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.303+0000 7fdb2c619b80 20 client.26003 trim_cache size 0 max 16384 2024-05-08T05:58:19.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.324+0000 7fdb2c619b80 1 Processor -- start 2024-05-08T05:58:19.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.324+0000 7fdb2c619b80 1 -- start start 2024-05-08T05:58:19.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.325+0000 7fdb2c619b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649fde116d0 0x5649fde992d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:19.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.325+0000 7fdb2c619b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649fde998f0 0x5649fdeb7840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:19.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.325+0000 7fdb2c619b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649fde9ebc0 0x5649fdea15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:19.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.325+0000 7fdb2c619b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdb1c1b4160 con 0x5649fde998f0 2024-05-08T05:58:19.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.325+0000 7fdb2c619b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdb1c1b5ca0 con 0x5649fde116d0 2024-05-08T05:58:19.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.325+0000 7fdb2c619b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fdb1c1b4830 con 0x5649fde9ebc0 2024-05-08T05:58:19.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.325+0000 7fdb1aa00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649fde998f0 0x5649fdeb7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:19.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.325+0000 7fdb1a000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649fde116d0 0x5649fde992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:19.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.325+0000 7fdb1a000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649fde116d0 0x5649fde992d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:57704/0 (socket says 172.21.15.82:57704) 2024-05-08T05:58:19.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.325+0000 7fdb1a000700 1 -- 172.21.15.82:0/3671521997 learned_addr learned my addr 172.21.15.82:0/3671521997 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:58:19.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.325+0000 7fdb1aa00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649fde998f0 0x5649fdeb7840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53964/0 (socket says 172.21.15.82:53964) 2024-05-08T05:58:19.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.325+0000 7fdb1a000700 1 --2- 172.21.15.82:0/3671521997 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649fde9ebc0 0x5649fdea15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:19.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.325+0000 7fdb1a000700 1 -- 172.21.15.82:0/3671521997 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649fde9ebc0 msgr2=0x5649fdea15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:19.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.325+0000 7fdb1a000700 1 --2- 172.21.15.82:0/3671521997 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649fde9ebc0 0x5649fdea15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:19.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.325+0000 7fdb1a000700 1 -- 172.21.15.82:0/3671521997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649fde998f0 msgr2=0x5649fdeb7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:19.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.325+0000 7fdb1a000700 1 --2- 172.21.15.82:0/3671521997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649fde998f0 0x5649fdeb7840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:19.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.326+0000 7fdb1a000700 1 -- 172.21.15.82:0/3671521997 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649fde8eab0 con 0x5649fde116d0 2024-05-08T05:58:19.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.326+0000 7fdb1a000700 1 --2- 172.21.15.82:0/3671521997 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649fde116d0 0x5649fde992d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c006010 tx=0x7fdb0c005ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74d2debd2cf11b5b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:58:19.327 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.326+0000 7fdb07400700 1 -- 172.21.15.82:0/3671521997 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c021040 con 0x5649fde116d0 2024-05-08T05:58:19.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.327+0000 7fdb07400700 1 -- 172.21.15.82:0/3671521997 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb0c022040 con 0x5649fde116d0 2024-05-08T05:58:19.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.327+0000 7fdb07400700 1 -- 172.21.15.82:0/3671521997 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c02a480 con 0x5649fde116d0 2024-05-08T05:58:19.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.328+0000 7fdb2c619b80 1 -- 172.21.15.82:0/3671521997 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649fde116d0 msgr2=0x5649fde992d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:19.328 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.328+0000 7fdb2c619b80 1 --2- 172.21.15.82:0/3671521997 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649fde116d0 0x5649fde992d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c006010 tx=0x7fdb0c005ec0 comp rx=0 tx=0).stop 2024-05-08T05:58:19.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.329+0000 7fdb2c619b80 1 -- 172.21.15.82:0/3671521997 shutdown_connections 2024-05-08T05:58:19.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.330+0000 7fdb2c619b80 1 --2- 172.21.15.82:0/3671521997 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649fde116d0 0x5649fde992d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:19.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.330+0000 7fdb2c619b80 1 --2- 172.21.15.82:0/3671521997 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649fde9ebc0 0x5649fdea15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:19.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.330+0000 7fdb2c619b80 1 --2- 172.21.15.82:0/3671521997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649fde998f0 0x5649fdeb7840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:19.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.330+0000 7fdb2c619b80 1 -- 172.21.15.82:0/3671521997 >> 172.21.15.82:0/3671521997 conn(0x5649fde90750 msgr2=0x5649fde9ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:58:19.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.330+0000 7fdb2c619b80 1 -- 172.21.15.82:0/3671521997 shutdown_connections 2024-05-08T05:58:19.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.330+0000 7fdb2c619b80 1 -- 172.21.15.82:0/3671521997 wait complete. 2024-05-08T05:58:19.330 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.330+0000 7fdb2c619b80 1 -- start start 2024-05-08T05:58:19.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.331+0000 7fdb2c619b80 1 Processor -- start 2024-05-08T05:58:19.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.331+0000 7fdb2c619b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649fde116d0 0x5649fdeb3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:19.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.331+0000 7fdb2c619b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649fde998f0 0x5649fdeb41a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:19.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.331+0000 7fdb2c619b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649fde9ebc0 0x5649fdeaf250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:19.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.331+0000 7fdb2c619b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdb1c1b55d0 con 0x5649fde116d0 2024-05-08T05:58:19.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.331+0000 7fdb2c619b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdb1c1b4f00 con 0x5649fde9ebc0 2024-05-08T05:58:19.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.331+0000 7fdb2c619b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fdb1c10e320 con 0x5649fde998f0 2024-05-08T05:58:19.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.331+0000 7fdb2c619b80 10 client.0 _ll_register_callbacks cb 0x5649fdd92c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:58:19.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.332+0000 7fdb1a000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649fde116d0 0x5649fdeb3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:19.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.332+0000 7fdb1a000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649fde116d0 0x5649fdeb3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53968/0 (socket says 172.21.15.82:53968) 2024-05-08T05:58:19.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.332+0000 7fdb1a000700 1 -- 172.21.15.82:0/1806890471 learned_addr learned my addr 172.21.15.82:0/1806890471 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:58:19.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.332+0000 7fdb1aa00700 1 --2- 172.21.15.82:0/1806890471 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649fde998f0 0x5649fdeb41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:19.332 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.332+0000 7fdb1a000700 1 --2- 172.21.15.82:0/1806890471 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649fde9ebc0 0x5649fdeaf250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:19.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.332+0000 7fdb1aa00700 1 -- 172.21.15.82:0/1806890471 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649fde9ebc0 msgr2=0x5649fdeaf250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:19.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.332+0000 7fdb1aa00700 1 --2- 172.21.15.82:0/1806890471 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649fde9ebc0 0x5649fdeaf250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:19.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.332+0000 7fdb1aa00700 1 -- 172.21.15.82:0/1806890471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649fde116d0 msgr2=0x5649fdeb3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:19.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.332+0000 7fdb1aa00700 1 --2- 172.21.15.82:0/1806890471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649fde116d0 0x5649fdeb3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:19.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.332+0000 7fdb1aa00700 1 -- 172.21.15.82:0/1806890471 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5649fdeafa60 con 0x5649fde998f0 2024-05-08T05:58:19.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.332+0000 7fdb1aa00700 1 --2- 172.21.15.82:0/1806890471 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649fde998f0 0x5649fdeb41a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x5649fdea5ef0 tx=0x7fdb08009c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f07a92523c6dfe3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:58:19.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.332+0000 7fdb04c00700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:58:19.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.333+0000 7fdb04c00700 1 -- 172.21.15.82:0/1806890471 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb08035070 con 0x5649fde998f0 2024-05-08T05:58:19.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.333+0000 7fdb04c00700 1 -- 172.21.15.82:0/1806890471 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fdb0800fbf0 con 0x5649fde998f0 2024-05-08T05:58:19.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.333+0000 7fdb2c619b80 1 -- 172.21.15.82:0/1806890471 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb0c022040 con 0x5649fde998f0 2024-05-08T05:58:19.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.334+0000 7fdb04c00700 1 -- 172.21.15.82:0/1806890471 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fdb0802a040 con 0x5649fde998f0 2024-05-08T05:58:19.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.334+0000 7fdb2c619b80 10 client.26050 fetch_fsmap learned FSMap version 31 2024-05-08T05:58:19.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.334+0000 7fdb2c619b80 1 -- 172.21.15.82:0/1806890471 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5649fdf25690 con 0x5649fde998f0 2024-05-08T05:58:19.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.335+0000 7fdb04c00700 1 -- 172.21.15.82:0/1806890471 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdb0c022040 con 0x5649fde998f0 2024-05-08T05:58:19.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.335+0000 7fdb04c00700 1 -- 172.21.15.82:0/1806890471 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fdb08031650 con 0x5649fde998f0 2024-05-08T05:58:19.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.335+0000 7fdb2c619b80 10 client.26050 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:58:19.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.335+0000 7fdb2c619b80 10 client.26050 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-05-08T05:58:19.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.335+0000 7fdb2c619b80 20 client.26050 populate_metadata read hostname 'smithi082' 2024-05-08T05:58:19.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.335+0000 7fdb2c619b80 1 --2- 172.21.15.82:0/1806890471 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x5649fde9f4e0 0x5649fdf27d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:19.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.335+0000 7fdb2c619b80 4 client.26050 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:58:19.335 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.335+0000 7fdb2c619b80 1 -- 172.21.15.82:0/1806890471 --> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5649fddf9400 con 0x5649fde9f4e0 2024-05-08T05:58:19.336 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.335+0000 7fdb1a000700 1 --2- 172.21.15.82:0/1806890471 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x5649fde9f4e0 0x5649fdf27d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:19.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.336+0000 7fdb04c00700 10 client.26050 ms_handle_connect on v2:172.21.15.151:6834/2093655929 2024-05-08T05:58:19.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.336+0000 7fdb1a000700 1 --2- 172.21.15.82:0/1806890471 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x5649fde9f4e0 0x5649fdf27d50 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e881e8432f6b2cff server_cookie=18ac3c35449922ed in_seq=0 out_seq=0 2024-05-08T05:58:19.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.336+0000 7fdb04c00700 1 -- 172.21.15.82:0/1806890471 <== mds.3 v2:172.21.15.151:6834/2093655929 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5649fddf9400 con 0x5649fde9f4e0 2024-05-08T05:58:19.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.336+0000 7fdb04c00700 10 client.26050 handle_command_reply: tid=0 2024-05-08T05:58:19.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.336+0000 7fdb2c619b80 1 client.26050 shutdown 2024-05-08T05:58:19.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.337+0000 7fdb2c619b80 1 -- 172.21.15.82:0/1806890471 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649fde998f0 msgr2=0x5649fdeb41a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:19.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.337+0000 7fdb2c619b80 1 --2- 172.21.15.82:0/1806890471 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649fde998f0 0x5649fdeb41a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x5649fdea5ef0 tx=0x7fdb08009c60 comp rx=0 tx=0).stop 2024-05-08T05:58:19.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.337+0000 7fdb2c619b80 1 -- 172.21.15.82:0/1806890471 shutdown_connections 2024-05-08T05:58:19.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.337+0000 7fdb2c619b80 1 --2- 172.21.15.82:0/1806890471 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x5649fde9f4e0 0x5649fdf27d50 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:19.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.337+0000 7fdb2c619b80 1 --2- 172.21.15.82:0/1806890471 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5649fde9ebc0 0x5649fdeaf250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:19.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.337+0000 7fdb04c00700 0 client.26050 ms_handle_reset on v2:172.21.15.151:6834/2093655929 2024-05-08T05:58:19.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.337+0000 7fdb2c619b80 1 --2- 172.21.15.82:0/1806890471 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5649fde116d0 0x5649fdeb3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:19.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.337+0000 7fdb2c619b80 1 --2- 172.21.15.82:0/1806890471 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649fde998f0 0x5649fdeb41a0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:19.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.337+0000 7fdb2c619b80 1 -- 172.21.15.82:0/1806890471 >> 172.21.15.82:0/1806890471 conn(0x5649fde90750 msgr2=0x5649fde9df60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:58:19.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.337+0000 7fdb2c619b80 1 -- 172.21.15.82:0/1806890471 shutdown_connections 2024-05-08T05:58:19.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.337+0000 7fdb2c619b80 1 -- 172.21.15.82:0/1806890471 wait complete. 2024-05-08T05:58:19.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.337+0000 7fdb2c619b80 20 client.26050 trim_cache size 0 max 16384 2024-05-08T05:58:19.338 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T05:58:19.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.338+0000 7fdb21c00700 1 -- 172.21.15.82:0/1972087632 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fdb000b2980 msgr2=0x7fdb000b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:19.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.338+0000 7fdb21c00700 1 --2- 172.21.15.82:0/1972087632 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fdb000b2980 0x7fdb000b4e40 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fdb14004fd0 tx=0x7fdb14009040 comp rx=0 tx=0).stop 2024-05-08T05:58:19.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.338+0000 7fdb21c00700 1 -- 172.21.15.82:0/1972087632 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb1c109530 msgr2=0x7fdb1c06d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:19.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.338+0000 7fdb21c00700 1 --2- 172.21.15.82:0/1972087632 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb1c109530 0x7fdb1c06d4d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fdb1400ef30 tx=0x7fdb1400c450 comp rx=0 tx=0).stop 2024-05-08T05:58:19.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.339+0000 7fdb21c00700 1 -- 172.21.15.82:0/1972087632 shutdown_connections 2024-05-08T05:58:19.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.339+0000 7fdb21c00700 1 --2- 172.21.15.82:0/1972087632 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb1c103520 0x7fdb1c074fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:19.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.339+0000 7fdb21c00700 1 --2- 172.21.15.82:0/1972087632 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fdb000b2980 0x7fdb000b4e40 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:19.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.339+0000 7fdb21c00700 1 --2- 172.21.15.82:0/1972087632 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb1c109530 0x7fdb1c06d4d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:19.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.339+0000 7fdb21c00700 1 --2- 172.21.15.82:0/1972087632 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdb1c103ee0 0x7fdb1c06cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:19.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.339+0000 7fdb21c00700 1 -- 172.21.15.82:0/1972087632 >> 172.21.15.82:0/1972087632 conn(0x7fdb1c07a570 msgr2=0x7fdb1c075960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:58:19.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.340+0000 7fdb21c00700 1 -- 172.21.15.82:0/1972087632 shutdown_connections 2024-05-08T05:58:19.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:19.340+0000 7fdb21c00700 1 -- 172.21.15.82:0/1972087632 wait complete. 2024-05-08T05:58:19.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:58:19 smithi082 ceph-mon[30098]: pgmap v689: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 MiB/s wr, 684 op/s 2024-05-08T05:58:20.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:58:19 smithi134 ceph-mon[34132]: pgmap v689: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 MiB/s wr, 684 op/s 2024-05-08T05:58:20.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:58:19 smithi151 ceph-mon[34815]: pgmap v689: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 12 MiB/s wr, 684 op/s 2024-05-08T05:58:20.181 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-05-08T05:58:20.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 450.0 s, 1713.6 tps, lat 58.474 ms stddev 70.376 2024-05-08T05:58:20.816 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:58:21.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:58:21 smithi082 ceph-mon[30098]: pgmap v690: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 17 MiB/s wr, 790 op/s 2024-05-08T05:58:22.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:58:21 smithi134 ceph-mon[34132]: pgmap v690: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 17 MiB/s wr, 790 op/s 2024-05-08T05:58:22.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:58:21 smithi151 ceph-mon[34815]: pgmap v690: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 17 MiB/s wr, 790 op/s 2024-05-08T05:58:23.414 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.414+0000 7f1f4f200700 1 -- 172.21.15.82:0/1760658153 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1f5010de00 msgr2=0x7f1f5010e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:23.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.414+0000 7f1f4f200700 1 --2- 172.21.15.82:0/1760658153 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1f5010de00 0x7f1f5010e280 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1f380098f0 tx=0x7f1f38009c00 comp rx=0 tx=0).stop 2024-05-08T05:58:23.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.415+0000 7f1f4f200700 1 -- 172.21.15.82:0/1760658153 shutdown_connections 2024-05-08T05:58:23.415 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.415+0000 7f1f4f200700 1 --2- 172.21.15.82:0/1760658153 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f50113eb0 0x7f1f50114290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:23.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.415+0000 7f1f4f200700 1 --2- 172.21.15.82:0/1760658153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f5010e7c0 0x7f1f5011ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:23.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.416+0000 7f1f4f200700 1 --2- 172.21.15.82:0/1760658153 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1f5010de00 0x7f1f5010e280 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:23.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.416+0000 7f1f4f200700 1 -- 172.21.15.82:0/1760658153 >> 172.21.15.82:0/1760658153 conn(0x7f1f5006e430 msgr2=0x7f1f5010c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:58:23.416 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.417+0000 7f1f4f200700 1 -- 172.21.15.82:0/1760658153 shutdown_connections 2024-05-08T05:58:23.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.417+0000 7f1f4f200700 1 -- 172.21.15.82:0/1760658153 wait complete. 2024-05-08T05:58:23.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.420+0000 7f1f4f200700 1 Processor -- start 2024-05-08T05:58:23.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.420+0000 7f1f4f200700 1 -- start start 2024-05-08T05:58:23.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.421+0000 7f1f4f200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f5010de00 0x7f1f501a4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:23.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.421+0000 7f1f4f200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f5010e7c0 0x7f1f501a4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:23.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.421+0000 7f1f4f200700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1f50113eb0 0x7f1f501a8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:23.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.421+0000 7f1f4f200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5011dfc0 con 0x7f1f5010e7c0 2024-05-08T05:58:23.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.421+0000 7f1f4f200700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5011de40 con 0x7f1f5010de00 2024-05-08T05:58:23.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.421+0000 7f1f4f200700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1f5011e140 con 0x7f1f50113eb0 2024-05-08T05:58:23.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.421+0000 7f1f4de00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f5010de00 0x7f1f501a4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:23.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.422+0000 7f1f4de00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f5010de00 0x7f1f501a4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:59956/0 (socket says 172.21.15.82:59956) 2024-05-08T05:58:23.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.422+0000 7f1f4de00700 1 -- 172.21.15.82:0/1371806715 learned_addr learned my addr 172.21.15.82:0/1371806715 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:58:23.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.422+0000 7f1f4e800700 1 --2- 172.21.15.82:0/1371806715 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1f50113eb0 0x7f1f501a8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:23.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.422+0000 7f1f47e00700 1 --2- 172.21.15.82:0/1371806715 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f5010e7c0 0x7f1f501a4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:23.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.422+0000 7f1f4de00700 1 -- 172.21.15.82:0/1371806715 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1f50113eb0 msgr2=0x7f1f501a8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:23.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.422+0000 7f1f4de00700 1 --2- 172.21.15.82:0/1371806715 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1f50113eb0 0x7f1f501a8e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:23.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.422+0000 7f1f4de00700 1 -- 172.21.15.82:0/1371806715 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f5010e7c0 msgr2=0x7f1f501a4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:23.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.422+0000 7f1f4de00700 1 --2- 172.21.15.82:0/1371806715 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f5010e7c0 0x7f1f501a4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:23.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.422+0000 7f1f4de00700 1 -- 172.21.15.82:0/1371806715 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f501a95a0 con 0x7f1f5010de00 2024-05-08T05:58:23.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.422+0000 7f1f47e00700 1 --2- 172.21.15.82:0/1371806715 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f5010e7c0 0x7f1f501a4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:58:23.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.423+0000 7f1f4de00700 1 --2- 172.21.15.82:0/1371806715 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f5010de00 0x7f1f501a4590 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1f40007fa0 tx=0x7f1f4000d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:58:23.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.427+0000 7f1f46a00700 1 -- 172.21.15.82:0/1371806715 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f4001a070 con 0x7f1f5010de00 2024-05-08T05:58:23.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.427+0000 7f1f46a00700 1 -- 172.21.15.82:0/1371806715 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f4000dda0 con 0x7f1f5010de00 2024-05-08T05:58:23.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.427+0000 7f1f46a00700 1 -- 172.21.15.82:0/1371806715 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f400146d0 con 0x7f1f5010de00 2024-05-08T05:58:23.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.427+0000 7f1f4f200700 1 -- 172.21.15.82:0/1371806715 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f501a9890 con 0x7f1f5010de00 2024-05-08T05:58:23.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.427+0000 7f1f4f200700 1 -- 172.21.15.82:0/1371806715 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f501b1110 con 0x7f1f5010de00 2024-05-08T05:58:23.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.432+0000 7f1f46a00700 1 -- 172.21.15.82:0/1371806715 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f1f400159d0 con 0x7f1f5010de00 2024-05-08T05:58:23.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.434+0000 7f1f46a00700 1 --2- 172.21.15.82:0/1371806715 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f1f340b2a50 0x7f1f340b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:23.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.435+0000 7f1f46a00700 1 -- 172.21.15.82:0/1371806715 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f1f400e1950 con 0x7f1f5010de00 2024-05-08T05:58:23.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.435+0000 7f1f47e00700 1 --2- 172.21.15.82:0/1371806715 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f1f340b2a50 0x7f1f340b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:23.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.435+0000 7f1f47e00700 1 --2- 172.21.15.82:0/1371806715 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f1f340b2a50 0x7f1f340b4f10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1f5010c160 tx=0x7f1f38019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:58:23.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.437+0000 7f1f5fc55b80 1 Processor -- start 2024-05-08T05:58:23.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.437+0000 7f1f5fc55b80 1 -- start start 2024-05-08T05:58:23.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.438+0000 7f1f5fc55b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637f2ff89e0 0x5637f2ff8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:23.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.438+0000 7f1f5fc55b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5637f2ff9300 0x5637f2ff2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:23.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.438+0000 7f1f5fc55b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637f2ff3600 0x5637f2ff3a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:23.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.438+0000 7f1f5fc55b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5637f2f45a20 con 0x5637f2ff3600 2024-05-08T05:58:23.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.438+0000 7f1f5fc55b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5637f2ee3760 con 0x5637f2ff9300 2024-05-08T05:58:23.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.438+0000 7f1f5fc55b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5637f2f419e0 con 0x5637f2ff89e0 2024-05-08T05:58:23.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.439+0000 7f1f47e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5637f2ff9300 0x5637f2ff2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:23.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.439+0000 7f1f47e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5637f2ff9300 0x5637f2ff2fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:59972/0 (socket says 172.21.15.82:59972) 2024-05-08T05:58:23.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.439+0000 7f1f47e00700 1 -- 172.21.15.82:0/3468570097 learned_addr learned my addr 172.21.15.82:0/3468570097 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:58:23.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.439+0000 7f1f4de00700 1 --2- 172.21.15.82:0/3468570097 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637f2ff89e0 0x5637f2ff8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:23.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.440+0000 7f1f4de00700 1 -- 172.21.15.82:0/3468570097 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5637f2ff9300 msgr2=0x5637f2ff2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:23.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.440+0000 7f1f4de00700 1 --2- 172.21.15.82:0/3468570097 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5637f2ff9300 0x5637f2ff2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:23.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.440+0000 7f1f4de00700 1 -- 172.21.15.82:0/3468570097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637f2ff3600 msgr2=0x5637f2ff3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:23.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.440+0000 7f1f4de00700 1 --2- 172.21.15.82:0/3468570097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637f2ff3600 0x5637f2ff3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:23.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.440+0000 7f1f4de00700 1 -- 172.21.15.82:0/3468570097 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637f2e928d0 con 0x5637f2ff89e0 2024-05-08T05:58:23.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.440+0000 7f1f4de00700 1 --2- 172.21.15.82:0/3468570097 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637f2ff89e0 0x5637f2ff8dc0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1f400095b0 tx=0x7f1f4000df50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f4ace7f934cfbd1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:58:23.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.440+0000 7f1f3f400700 1 -- 172.21.15.82:0/3468570097 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f400ad2d0 con 0x5637f2ff89e0 2024-05-08T05:58:23.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.440+0000 7f1f3f400700 1 -- 172.21.15.82:0/3468570097 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f400b1d80 con 0x5637f2ff89e0 2024-05-08T05:58:23.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.440+0000 7f1f3f400700 1 -- 172.21.15.82:0/3468570097 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f400b1b50 con 0x5637f2ff89e0 2024-05-08T05:58:23.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.441+0000 7f1f5fc55b80 1 -- 172.21.15.82:0/3468570097 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637f2ff89e0 msgr2=0x5637f2ff8dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:23.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.441+0000 7f1f5fc55b80 1 --2- 172.21.15.82:0/3468570097 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637f2ff89e0 0x5637f2ff8dc0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1f400095b0 tx=0x7f1f4000df50 comp rx=0 tx=0).stop 2024-05-08T05:58:23.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.442+0000 7f1f5fc55b80 1 -- 172.21.15.82:0/3468570097 shutdown_connections 2024-05-08T05:58:23.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.442+0000 7f1f5fc55b80 1 --2- 172.21.15.82:0/3468570097 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637f2ff3600 0x5637f2ff3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:23.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.442+0000 7f1f5fc55b80 1 --2- 172.21.15.82:0/3468570097 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637f2ff89e0 0x5637f2ff8dc0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:23.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.442+0000 7f1f5fc55b80 1 --2- 172.21.15.82:0/3468570097 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5637f2ff9300 0x5637f2ff2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:23.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.442+0000 7f1f5fc55b80 1 -- 172.21.15.82:0/3468570097 >> 172.21.15.82:0/3468570097 conn(0x5637f2f21b60 msgr2=0x5637f2fed9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:58:23.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.442+0000 7f1f5fc55b80 1 -- 172.21.15.82:0/3468570097 shutdown_connections 2024-05-08T05:58:23.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.442+0000 7f1f5fc55b80 1 -- 172.21.15.82:0/3468570097 wait complete. 2024-05-08T05:58:23.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.443+0000 7f1f5fc55b80 1 -- start start 2024-05-08T05:58:23.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.443+0000 7f1f5fc55b80 1 Processor -- start 2024-05-08T05:58:23.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.444+0000 7f1f5fc55b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5637f2ff3600 0x5637f2ffeff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:23.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.444+0000 7f1f5fc55b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637f2ff89e0 0x5637f2ffc390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:23.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.444+0000 7f1f5fc55b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637f2ff9300 0x5637f2ffc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:23.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.444+0000 7f1f5fc55b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5637f2fffdb0 con 0x5637f2ff89e0 2024-05-08T05:58:23.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.444+0000 7f1f5fc55b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5637f2eabb20 con 0x5637f2ff3600 2024-05-08T05:58:23.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.444+0000 7f1f5fc55b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5637f2ffff30 con 0x5637f2ff9300 2024-05-08T05:58:23.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.444+0000 7f1f5fc55b80 10 client.0 _ll_register_callbacks cb 0x5637f2eecc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:58:23.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.445+0000 7f1f4de00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5637f2ff3600 0x5637f2ffeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:23.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.445+0000 7f1f4de00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5637f2ff3600 0x5637f2ffeff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:59974/0 (socket says 172.21.15.82:59974) 2024-05-08T05:58:23.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.445+0000 7f1f4de00700 1 -- 172.21.15.82:0/3457572165 learned_addr learned my addr 172.21.15.82:0/3457572165 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:58:23.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.445+0000 7f1f4e800700 1 --2- 172.21.15.82:0/3457572165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637f2ff9300 0x5637f2ffc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:23.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.445+0000 7f1f4de00700 1 -- 172.21.15.82:0/3457572165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637f2ff9300 msgr2=0x5637f2ffc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:23.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.445+0000 7f1f4de00700 1 --2- 172.21.15.82:0/3457572165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637f2ff9300 0x5637f2ffc8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:23.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.445+0000 7f1f4de00700 1 -- 172.21.15.82:0/3457572165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637f2ff89e0 msgr2=0x5637f2ffc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:23.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.445+0000 7f1f4de00700 1 --2- 172.21.15.82:0/3457572165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637f2ff89e0 0x5637f2ffc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:23.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.445+0000 7f1f4de00700 1 -- 172.21.15.82:0/3457572165 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637f2f0b420 con 0x5637f2ff3600 2024-05-08T05:58:23.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.446+0000 7f1f4de00700 1 --2- 172.21.15.82:0/3457572165 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5637f2ff3600 0x5637f2ffeff0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1f400a8c20 tx=0x7f1f400b1c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f3aa531897dbebc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:58:23.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.446+0000 7f1f33e00700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:58:23.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.446+0000 7f1f33e00700 1 -- 172.21.15.82:0/3457572165 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f400ad2d0 con 0x5637f2ff3600 2024-05-08T05:58:23.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.446+0000 7f1f33e00700 1 -- 172.21.15.82:0/3457572165 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f1f400a5510 con 0x5637f2ff3600 2024-05-08T05:58:23.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.446+0000 7f1f5fc55b80 1 -- 172.21.15.82:0/3457572165 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1f400b1d80 con 0x5637f2ff3600 2024-05-08T05:58:23.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.447+0000 7f1f33e00700 1 -- 172.21.15.82:0/3457572165 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f1f400a8390 con 0x5637f2ff3600 2024-05-08T05:58:23.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.447+0000 7f1f5fc55b80 10 client.26021 fetch_fsmap learned FSMap version 31 2024-05-08T05:58:23.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.447+0000 7f1f5fc55b80 1 -- 172.21.15.82:0/3457572165 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5637f300a600 con 0x5637f2ff3600 2024-05-08T05:58:23.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.447+0000 7f1f33e00700 1 -- 172.21.15.82:0/3457572165 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f400b1d80 con 0x5637f2ff3600 2024-05-08T05:58:23.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.447+0000 7f1f33e00700 1 -- 172.21.15.82:0/3457572165 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f1f400ac030 con 0x5637f2ff3600 2024-05-08T05:58:23.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.448+0000 7f1f5fc55b80 10 client.26021 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:58:23.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.448+0000 7f1f5fc55b80 10 client.26021 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-05-08T05:58:23.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.448+0000 7f1f5fc55b80 20 client.26021 populate_metadata read hostname 'smithi082' 2024-05-08T05:58:23.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.448+0000 7f1f5fc55b80 1 --2- 172.21.15.82:0/3457572165 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x5637f300cad0 0x5637f300eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:23.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.448+0000 7f1f5fc55b80 4 client.26021 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:58:23.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.448+0000 7f1f5fc55b80 1 -- 172.21.15.82:0/3457572165 --> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5637f2fc00a0 con 0x5637f300cad0 2024-05-08T05:58:23.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.448+0000 7f1f47e00700 1 --2- 172.21.15.82:0/3457572165 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x5637f300cad0 0x5637f300eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:23.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.449+0000 7f1f47e00700 1 --2- 172.21.15.82:0/3457572165 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x5637f300cad0 0x5637f300eec0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d089630295644c9e server_cookie=2e100b058647b2a3 in_seq=0 out_seq=0 2024-05-08T05:58:23.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.449+0000 7f1f33e00700 10 client.26021 ms_handle_connect on v2:172.21.15.151:6836/4192404464 2024-05-08T05:58:23.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.450+0000 7f1f33e00700 1 -- 172.21.15.82:0/3457572165 <== mds.2 v2:172.21.15.151:6836/4192404464 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5637f2fc00a0 con 0x5637f300cad0 2024-05-08T05:58:23.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.450+0000 7f1f33e00700 10 client.26021 handle_command_reply: tid=0 2024-05-08T05:58:23.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.450+0000 7f1f5fc55b80 1 client.26021 shutdown 2024-05-08T05:58:23.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.451+0000 7f1f5fc55b80 1 -- 172.21.15.82:0/3457572165 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5637f2ff3600 msgr2=0x5637f2ffeff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:23.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.451+0000 7f1f5fc55b80 1 --2- 172.21.15.82:0/3457572165 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5637f2ff3600 0x5637f2ffeff0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1f400a8c20 tx=0x7f1f400b1c50 comp rx=0 tx=0).stop 2024-05-08T05:58:23.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.451+0000 7f1f5fc55b80 1 -- 172.21.15.82:0/3457572165 shutdown_connections 2024-05-08T05:58:23.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.451+0000 7f1f5fc55b80 1 --2- 172.21.15.82:0/3457572165 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x5637f300cad0 0x5637f300eec0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:23.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.451+0000 7f1f5fc55b80 1 --2- 172.21.15.82:0/3457572165 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5637f2ff3600 0x5637f2ffeff0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:23.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.451+0000 7f1f5fc55b80 1 --2- 172.21.15.82:0/3457572165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637f2ff9300 0x5637f2ffc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:23.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.451+0000 7f1f5fc55b80 1 --2- 172.21.15.82:0/3457572165 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637f2ff89e0 0x5637f2ffc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:23.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.451+0000 7f1f5fc55b80 1 -- 172.21.15.82:0/3457572165 >> 172.21.15.82:0/3457572165 conn(0x5637f2f21b60 msgr2=0x5637f2fe8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:58:23.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.451+0000 7f1f33e00700 0 client.26021 ms_handle_reset on v2:172.21.15.151:6836/4192404464 2024-05-08T05:58:23.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.451+0000 7f1f5fc55b80 1 -- 172.21.15.82:0/3457572165 shutdown_connections 2024-05-08T05:58:23.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.452+0000 7f1f5fc55b80 1 -- 172.21.15.82:0/3457572165 wait complete. 2024-05-08T05:58:23.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.452+0000 7f1f5fc55b80 20 client.26021 trim_cache size 0 max 16384 2024-05-08T05:58:23.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.479+0000 7f1f5fc55b80 1 Processor -- start 2024-05-08T05:58:23.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.479+0000 7f1f5fc55b80 1 -- start start 2024-05-08T05:58:23.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.479+0000 7f1f5fc55b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5637f2ff3600 0x5637f2ff9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:23.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.479+0000 7f1f5fc55b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637f2ff89e0 0x5637f3011ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:23.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.479+0000 7f1f5fc55b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637f2ff9300 0x5637f3012420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:23.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.479+0000 7f1f5fc55b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1f501b8590 con 0x5637f2ff9300 2024-05-08T05:58:23.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.479+0000 7f1f5fc55b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1f501ba0d0 con 0x5637f2ff3600 2024-05-08T05:58:23.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.479+0000 7f1f5fc55b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1f501b8c60 con 0x5637f2ff89e0 2024-05-08T05:58:23.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.480+0000 7f1f47e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637f2ff89e0 0x5637f3011ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:23.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.480+0000 7f1f4de00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5637f2ff3600 0x5637f2ff9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:23.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.480+0000 7f1f4de00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5637f2ff3600 0x5637f2ff9df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:59988/0 (socket says 172.21.15.82:59988) 2024-05-08T05:58:23.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.480+0000 7f1f4de00700 1 -- 172.21.15.82:0/4243400054 learned_addr learned my addr 172.21.15.82:0/4243400054 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:58:23.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.480+0000 7f1f4de00700 1 -- 172.21.15.82:0/4243400054 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637f2ff89e0 msgr2=0x5637f3011ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:23.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.480+0000 7f1f4de00700 1 --2- 172.21.15.82:0/4243400054 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637f2ff89e0 0x5637f3011ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:23.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.480+0000 7f1f4de00700 1 -- 172.21.15.82:0/4243400054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637f2ff9300 msgr2=0x5637f3012420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:23.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.480+0000 7f1f4e800700 1 --2- 172.21.15.82:0/4243400054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637f2ff9300 0x5637f3012420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:23.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.481+0000 7f1f4de00700 1 --2- 172.21.15.82:0/4243400054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637f2ff9300 0x5637f3012420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:23.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.481+0000 7f1f4de00700 1 -- 172.21.15.82:0/4243400054 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637f2ffec30 con 0x5637f2ff3600 2024-05-08T05:58:23.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.481+0000 7f1f4e800700 1 --2- 172.21.15.82:0/4243400054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637f2ff9300 0x5637f3012420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:58:23.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.482+0000 7f1f4de00700 1 --2- 172.21.15.82:0/4243400054 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5637f2ff3600 0x5637f2ff9df0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f1f400b1fd0 tx=0x7f1f4000df50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa91464044f5234d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:58:23.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.482+0000 7f1f3ea00700 1 -- 172.21.15.82:0/4243400054 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f400a4de0 con 0x5637f2ff3600 2024-05-08T05:58:23.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.482+0000 7f1f3ea00700 1 -- 172.21.15.82:0/4243400054 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1f400be0f0 con 0x5637f2ff3600 2024-05-08T05:58:23.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.482+0000 7f1f3ea00700 1 -- 172.21.15.82:0/4243400054 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f400a4b80 con 0x5637f2ff3600 2024-05-08T05:58:23.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.483+0000 7f1f5fc55b80 1 -- 172.21.15.82:0/4243400054 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5637f2ff3600 msgr2=0x5637f2ff9df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:23.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.483+0000 7f1f5fc55b80 1 --2- 172.21.15.82:0/4243400054 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5637f2ff3600 0x5637f2ff9df0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f1f400b1fd0 tx=0x7f1f4000df50 comp rx=0 tx=0).stop 2024-05-08T05:58:23.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.484+0000 7f1f5fc55b80 1 -- 172.21.15.82:0/4243400054 shutdown_connections 2024-05-08T05:58:23.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.484+0000 7f1f5fc55b80 1 --2- 172.21.15.82:0/4243400054 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5637f2ff3600 0x5637f2ff9df0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:23.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.484+0000 7f1f5fc55b80 1 --2- 172.21.15.82:0/4243400054 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637f2ff9300 0x5637f3012420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:23.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.484+0000 7f1f5fc55b80 1 --2- 172.21.15.82:0/4243400054 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637f2ff89e0 0x5637f3011ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:23.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.484+0000 7f1f5fc55b80 1 -- 172.21.15.82:0/4243400054 >> 172.21.15.82:0/4243400054 conn(0x5637f2f21b60 msgr2=0x5637f2ff96e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:58:23.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.484+0000 7f1f5fc55b80 1 -- 172.21.15.82:0/4243400054 shutdown_connections 2024-05-08T05:58:23.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.484+0000 7f1f5fc55b80 1 -- 172.21.15.82:0/4243400054 wait complete. 2024-05-08T05:58:23.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.484+0000 7f1f5fc55b80 1 -- start start 2024-05-08T05:58:23.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.484+0000 7f1f5fc55b80 1 Processor -- start 2024-05-08T05:58:23.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.485+0000 7f1f5fc55b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637f2ff3600 0x5637f300fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:23.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.485+0000 7f1f5fc55b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5637f2ff89e0 0x5637f3010160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:23.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.485+0000 7f1f5fc55b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637f2ff9300 0x5637f307e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:23.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.485+0000 7f1f5fc55b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1f501b9a00 con 0x5637f2ff3600 2024-05-08T05:58:23.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.485+0000 7f1f5fc55b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1f501b9330 con 0x5637f2ff89e0 2024-05-08T05:58:23.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.485+0000 7f1f5fc55b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1f501b6530 con 0x5637f2ff9300 2024-05-08T05:58:23.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.485+0000 7f1f5fc55b80 10 client.0 _ll_register_callbacks cb 0x5637f2eecc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:58:23.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.485+0000 7f1f47e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5637f2ff89e0 0x5637f3010160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:23.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.486+0000 7f1f47e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5637f2ff89e0 0x5637f3010160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:59992/0 (socket says 172.21.15.82:59992) 2024-05-08T05:58:23.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.486+0000 7f1f47e00700 1 -- 172.21.15.82:0/2110267997 learned_addr learned my addr 172.21.15.82:0/2110267997 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:58:23.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.486+0000 7f1f4de00700 1 --2- 172.21.15.82:0/2110267997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637f2ff3600 0x5637f300fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:23.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.486+0000 7f1f4e800700 1 --2- 172.21.15.82:0/2110267997 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637f2ff9300 0x5637f307e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:23.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.486+0000 7f1f47e00700 1 -- 172.21.15.82:0/2110267997 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637f2ff9300 msgr2=0x5637f307e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:23.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.486+0000 7f1f47e00700 1 --2- 172.21.15.82:0/2110267997 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637f2ff9300 0x5637f307e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:23.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.486+0000 7f1f47e00700 1 -- 172.21.15.82:0/2110267997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637f2ff3600 msgr2=0x5637f300fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:23.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.486+0000 7f1f47e00700 1 --2- 172.21.15.82:0/2110267997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637f2ff3600 0x5637f300fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:23.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.486+0000 7f1f47e00700 1 -- 172.21.15.82:0/2110267997 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637f3010a50 con 0x5637f2ff89e0 2024-05-08T05:58:23.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.486+0000 7f1f4de00700 1 --2- 172.21.15.82:0/2110267997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637f2ff3600 0x5637f300fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:58:23.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.487+0000 7f1f47e00700 1 --2- 172.21.15.82:0/2110267997 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5637f2ff89e0 0x5637f3010160 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1f38000c00 tx=0x7f1f38009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6512798aab8ab174 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:58:23.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.487+0000 7f1f33e00700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:58:23.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.487+0000 7f1f33e00700 1 -- 172.21.15.82:0/2110267997 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f38005610 con 0x5637f2ff89e0 2024-05-08T05:58:23.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.487+0000 7f1f33e00700 1 -- 172.21.15.82:0/2110267997 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f1f38003680 con 0x5637f2ff89e0 2024-05-08T05:58:23.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.487+0000 7f1f5fc55b80 1 -- 172.21.15.82:0/2110267997 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5637f2f53400 con 0x5637f2ff89e0 2024-05-08T05:58:23.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.487+0000 7f1f33e00700 1 -- 172.21.15.82:0/2110267997 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f1f38003880 con 0x5637f2ff89e0 2024-05-08T05:58:23.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.487+0000 7f1f5fc55b80 10 client.26027 fetch_fsmap learned FSMap version 31 2024-05-08T05:58:23.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.487+0000 7f1f5fc55b80 1 -- 172.21.15.82:0/2110267997 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5637f307fe10 con 0x5637f2ff89e0 2024-05-08T05:58:23.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.487+0000 7f1f33e00700 1 -- 172.21.15.82:0/2110267997 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x5637f2f53400 con 0x5637f2ff89e0 2024-05-08T05:58:23.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.488+0000 7f1f33e00700 1 -- 172.21.15.82:0/2110267997 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f1f3800bc90 con 0x5637f2ff89e0 2024-05-08T05:58:23.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.488+0000 7f1f5fc55b80 10 client.26027 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:58:23.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.488+0000 7f1f5fc55b80 10 client.26027 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-05-08T05:58:23.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.488+0000 7f1f5fc55b80 20 client.26027 populate_metadata read hostname 'smithi082' 2024-05-08T05:58:23.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.488+0000 7f1f5fc55b80 1 --2- 172.21.15.82:0/2110267997 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x5637f30805a0 0x5637f30829c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:23.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.489+0000 7f1f5fc55b80 4 client.26027 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:58:23.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.489+0000 7f1f5fc55b80 1 -- 172.21.15.82:0/2110267997 --> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5637f2f4d4a0 con 0x5637f30805a0 2024-05-08T05:58:23.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.489+0000 7f1f4de00700 1 --2- 172.21.15.82:0/2110267997 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x5637f30805a0 0x5637f30829c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:23.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.490+0000 7f1f33e00700 10 client.26027 ms_handle_connect on v2:172.21.15.151:6836/4192404464 2024-05-08T05:58:23.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.490+0000 7f1f4de00700 1 --2- 172.21.15.82:0/2110267997 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x5637f30805a0 0x5637f30829c0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=39ba1c18ec2da8bd server_cookie=877557e6b3e8b29e in_seq=0 out_seq=0 2024-05-08T05:58:23.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.491+0000 7f1f33e00700 1 -- 172.21.15.82:0/2110267997 <== mds.2 v2:172.21.15.151:6836/4192404464 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5637f2f4d4a0 con 0x5637f30805a0 2024-05-08T05:58:23.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.491+0000 7f1f33e00700 10 client.26027 handle_command_reply: tid=0 2024-05-08T05:58:23.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.491+0000 7f1f5fc55b80 1 client.26027 shutdown 2024-05-08T05:58:23.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.491+0000 7f1f5fc55b80 1 -- 172.21.15.82:0/2110267997 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5637f2ff89e0 msgr2=0x5637f3010160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:23.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.491+0000 7f1f5fc55b80 1 --2- 172.21.15.82:0/2110267997 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5637f2ff89e0 0x5637f3010160 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1f38000c00 tx=0x7f1f38009260 comp rx=0 tx=0).stop 2024-05-08T05:58:23.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.491+0000 7f1f5fc55b80 1 -- 172.21.15.82:0/2110267997 shutdown_connections 2024-05-08T05:58:23.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.491+0000 7f1f5fc55b80 1 --2- 172.21.15.82:0/2110267997 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x5637f30805a0 0x5637f30829c0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:23.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.491+0000 7f1f5fc55b80 1 --2- 172.21.15.82:0/2110267997 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637f2ff9300 0x5637f307e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:23.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.491+0000 7f1f5fc55b80 1 --2- 172.21.15.82:0/2110267997 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5637f2ff3600 0x5637f300fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:23.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.491+0000 7f1f5fc55b80 1 --2- 172.21.15.82:0/2110267997 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5637f2ff89e0 0x5637f3010160 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:23.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.491+0000 7f1f5fc55b80 1 -- 172.21.15.82:0/2110267997 >> 172.21.15.82:0/2110267997 conn(0x5637f2f21b60 msgr2=0x5637f2ff9f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:58:23.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.491+0000 7f1f33e00700 0 client.26027 ms_handle_reset on v2:172.21.15.151:6836/4192404464 2024-05-08T05:58:23.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.492+0000 7f1f5fc55b80 1 -- 172.21.15.82:0/2110267997 shutdown_connections 2024-05-08T05:58:23.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.492+0000 7f1f5fc55b80 1 -- 172.21.15.82:0/2110267997 wait complete. 2024-05-08T05:58:23.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.492+0000 7f1f5fc55b80 20 client.26027 trim_cache size 0 max 16384 2024-05-08T05:58:23.493 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T05:58:23.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.493+0000 7f1f4f200700 1 -- 172.21.15.82:0/1371806715 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f1f340b2a50 msgr2=0x7f1f340b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:23.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.493+0000 7f1f4f200700 1 --2- 172.21.15.82:0/1371806715 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f1f340b2a50 0x7f1f340b4f10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f1f5010c160 tx=0x7f1f38019040 comp rx=0 tx=0).stop 2024-05-08T05:58:23.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.493+0000 7f1f4f200700 1 -- 172.21.15.82:0/1371806715 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f5010de00 msgr2=0x7f1f501a4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:23.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.493+0000 7f1f4f200700 1 --2- 172.21.15.82:0/1371806715 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f5010de00 0x7f1f501a4590 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1f40007fa0 tx=0x7f1f4000d3b0 comp rx=0 tx=0).stop 2024-05-08T05:58:23.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.493+0000 7f1f4f200700 1 -- 172.21.15.82:0/1371806715 shutdown_connections 2024-05-08T05:58:23.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.493+0000 7f1f4f200700 1 --2- 172.21.15.82:0/1371806715 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f5010de00 0x7f1f501a4590 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:23.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.493+0000 7f1f4f200700 1 --2- 172.21.15.82:0/1371806715 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f1f340b2a50 0x7f1f340b4f10 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:23.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.493+0000 7f1f4f200700 1 --2- 172.21.15.82:0/1371806715 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1f50113eb0 0x7f1f501a8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:23.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.493+0000 7f1f4f200700 1 --2- 172.21.15.82:0/1371806715 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1f5010e7c0 0x7f1f501a4ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:23.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.493+0000 7f1f4f200700 1 -- 172.21.15.82:0/1371806715 >> 172.21.15.82:0/1371806715 conn(0x7f1f5006e430 msgr2=0x7f1f5010c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:58:23.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.493+0000 7f1f4f200700 1 -- 172.21.15.82:0/1371806715 shutdown_connections 2024-05-08T05:58:23.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:23.493+0000 7f1f4f200700 1 -- 172.21.15.82:0/1371806715 wait complete. 2024-05-08T05:58:23.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:58:23 smithi082 ceph-mon[30098]: pgmap v691: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 18 MiB/s wr, 695 op/s 2024-05-08T05:58:23.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:58:23 smithi134 ceph-mon[34132]: pgmap v691: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 18 MiB/s wr, 695 op/s 2024-05-08T05:58:24.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:58:23 smithi151 ceph-mon[34815]: pgmap v691: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 18 MiB/s wr, 695 op/s 2024-05-08T05:58:25.054 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-05-08T05:58:25.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 455.0 s, 2010.0 tps, lat 49.304 ms stddev 64.972 2024-05-08T05:58:25.675 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:58:25.930 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:58:25 smithi151 ceph-mon[34815]: pgmap v692: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 18 MiB/s wr, 689 op/s 2024-05-08T05:58:25.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:58:25 smithi082 ceph-mon[30098]: pgmap v692: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 18 MiB/s wr, 689 op/s 2024-05-08T05:58:26.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:58:25 smithi134 ceph-mon[34132]: pgmap v692: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 18 MiB/s wr, 689 op/s 2024-05-08T05:58:27.898 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:58:27 smithi082 ceph-mon[30098]: pgmap v693: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 21 MiB/s wr, 792 op/s 2024-05-08T05:58:27.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:58:27 smithi134 ceph-mon[34132]: pgmap v693: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 21 MiB/s wr, 792 op/s 2024-05-08T05:58:28.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:58:27 smithi151 ceph-mon[34815]: pgmap v693: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 21 MiB/s wr, 792 op/s 2024-05-08T05:58:28.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.474+0000 7f8995a00700 1 -- 172.21.15.82:0/206380895 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8990103750 msgr2=0x7f8990103b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:28.474 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.474+0000 7f8995a00700 1 --2- 172.21.15.82:0/206380895 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8990103750 0x7f8990103b30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f89780099c0 tx=0x7f8978009cd0 comp rx=0 tx=0).stop 2024-05-08T05:58:28.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.474+0000 7f8995a00700 1 -- 172.21.15.82:0/206380895 shutdown_connections 2024-05-08T05:58:28.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.474+0000 7f8995a00700 1 --2- 172.21.15.82:0/206380895 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8990108850 0x7f89901103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:28.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.474+0000 7f8995a00700 1 --2- 172.21.15.82:0/206380895 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8990103750 0x7f8990103b30 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:28.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.474+0000 7f8995a00700 1 --2- 172.21.15.82:0/206380895 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8990104100 0x7f8990108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:28.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.474+0000 7f8995a00700 1 -- 172.21.15.82:0/206380895 >> 172.21.15.82:0/206380895 conn(0x7f899007a600 msgr2=0x7f899007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:58:28.475 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.474+0000 7f8995a00700 1 -- 172.21.15.82:0/206380895 shutdown_connections 2024-05-08T05:58:28.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.474+0000 7f8995a00700 1 -- 172.21.15.82:0/206380895 wait complete. 2024-05-08T05:58:28.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.476+0000 7f8995a00700 1 Processor -- start 2024-05-08T05:58:28.476 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.476+0000 7f8995a00700 1 -- start start 2024-05-08T05:58:28.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.477+0000 7f8995a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8990104100 0x7f89901a0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:28.477 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.477+0000 7f8995a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8990108850 0x7f899010f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:28.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.478+0000 7f8995a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f899010fd30 0x7f89901101e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:28.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.478+0000 7f898e000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8990108850 0x7f899010f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:28.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.478+0000 7f898e000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8990108850 0x7f899010f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:33866/0 (socket says 172.21.15.82:33866) 2024-05-08T05:58:28.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.478+0000 7f898e000700 1 -- 172.21.15.82:0/226175349 learned_addr learned my addr 172.21.15.82:0/226175349 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:58:28.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.478+0000 7f898ea00700 1 --2- 172.21.15.82:0/226175349 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8990104100 0x7f89901a0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:28.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.478+0000 7f8995a00700 1 -- 172.21.15.82:0/226175349 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8990113670 con 0x7f899010fd30 2024-05-08T05:58:28.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.478+0000 7f8995a00700 1 -- 172.21.15.82:0/226175349 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f89901134f0 con 0x7f8990104100 2024-05-08T05:58:28.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.478+0000 7f8995a00700 1 -- 172.21.15.82:0/226175349 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f89901137f0 con 0x7f8990108850 2024-05-08T05:58:28.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.478+0000 7f898f400700 1 --2- 172.21.15.82:0/226175349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f899010fd30 0x7f89901101e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:28.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.479+0000 7f898e000700 1 -- 172.21.15.82:0/226175349 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8990104100 msgr2=0x7f89901a0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:28.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.479+0000 7f898e000700 1 --2- 172.21.15.82:0/226175349 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8990104100 0x7f89901a0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:28.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.479+0000 7f898e000700 1 -- 172.21.15.82:0/226175349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f899010fd30 msgr2=0x7f89901101e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:28.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.479+0000 7f898e000700 1 --2- 172.21.15.82:0/226175349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f899010fd30 0x7f89901101e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:28.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.479+0000 7f898e000700 1 -- 172.21.15.82:0/226175349 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f899019c460 con 0x7f8990108850 2024-05-08T05:58:28.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.479+0000 7f898f400700 1 --2- 172.21.15.82:0/226175349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f899010fd30 0x7f89901101e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:58:28.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.480+0000 7f898e000700 1 --2- 172.21.15.82:0/226175349 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8990108850 0x7f899010f7f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f898000e9a0 tx=0x7f898000ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:58:28.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.480+0000 7f8987400700 1 -- 172.21.15.82:0/226175349 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f898000cbd0 con 0x7f8990108850 2024-05-08T05:58:28.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.480+0000 7f8995a00700 1 -- 172.21.15.82:0/226175349 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f899019c750 con 0x7f8990108850 2024-05-08T05:58:28.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.480+0000 7f8995a00700 1 -- 172.21.15.82:0/226175349 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f899019cce0 con 0x7f8990108850 2024-05-08T05:58:28.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.481+0000 7f8987400700 1 -- 172.21.15.82:0/226175349 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f898000cd70 con 0x7f8990108850 2024-05-08T05:58:28.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.481+0000 7f8987400700 1 -- 172.21.15.82:0/226175349 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f898000cbd0 con 0x7f8990108850 2024-05-08T05:58:28.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.487+0000 7f8987400700 1 -- 172.21.15.82:0/226175349 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f8980018510 con 0x7f8990108850 2024-05-08T05:58:28.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.487+0000 7f89a045eb80 1 Processor -- start 2024-05-08T05:58:28.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.487+0000 7f89a045eb80 1 -- start start 2024-05-08T05:58:28.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.487+0000 7f89a045eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5638c192a060 0x5638c192a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:28.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.487+0000 7f89a045eb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5638c192a980 0x5638c192e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:28.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.488+0000 7f898f400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5638c192a060 0x5638c192a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:28.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.488+0000 7f898f400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5638c192a060 0x5638c192a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:33882/0 (socket says 172.21.15.82:33882) 2024-05-08T05:58:28.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.488+0000 7f89a045eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638c192e9d0 0x5638c192ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:28.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.488+0000 7f89a045eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5638c187ca20 con 0x5638c192e9d0 2024-05-08T05:58:28.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.488+0000 7f89a045eb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5638c181a760 con 0x5638c192a980 2024-05-08T05:58:28.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.488+0000 7f89a045eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5638c18789e0 con 0x5638c192a060 2024-05-08T05:58:28.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.488+0000 7f898f400700 1 -- 172.21.15.82:0/2355949577 learned_addr learned my addr 172.21.15.82:0/2355949577 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:58:28.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.488+0000 7f898ea00700 1 --2- 172.21.15.82:0/2355949577 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5638c192a980 0x5638c192e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:28.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.488+0000 7f898f400700 1 -- 172.21.15.82:0/2355949577 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5638c192a980 msgr2=0x5638c192e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:28.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.488+0000 7f898f400700 1 --2- 172.21.15.82:0/2355949577 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5638c192a980 0x5638c192e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:28.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.488+0000 7f898f400700 1 -- 172.21.15.82:0/2355949577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638c192e9d0 msgr2=0x5638c192ee30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T05:58:28.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.489+0000 7f898f400700 1 --2- 172.21.15.82:0/2355949577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638c192e9d0 0x5638c192ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:28.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.489+0000 7f898f400700 1 -- 172.21.15.82:0/2355949577 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638c17c98d0 con 0x5638c192a060 2024-05-08T05:58:28.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.489+0000 7f898f400700 1 --2- 172.21.15.82:0/2355949577 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5638c192a060 0x5638c192a440 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f89880087c0 tx=0x7f8988008ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb94ca233c761ae6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:58:28.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.489+0000 7f897fe00700 1 -- 172.21.15.82:0/2355949577 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8988003c00 con 0x5638c192a060 2024-05-08T05:58:28.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.489+0000 7f897fe00700 1 -- 172.21.15.82:0/2355949577 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8988003da0 con 0x5638c192a060 2024-05-08T05:58:28.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.489+0000 7f897fe00700 1 -- 172.21.15.82:0/2355949577 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8988012a00 con 0x5638c192a060 2024-05-08T05:58:28.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.490+0000 7f8987400700 1 --2- 172.21.15.82:0/226175349 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f89740b2b80 0x7f89740b5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:28.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.490+0000 7f8987400700 1 -- 172.21.15.82:0/226175349 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f89800e2490 con 0x7f8990108850 2024-05-08T05:58:28.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.490+0000 7f898ea00700 1 --2- 172.21.15.82:0/226175349 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f89740b2b80 0x7f89740b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:28.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.490+0000 7f89a045eb80 1 -- 172.21.15.82:0/2355949577 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5638c192a060 msgr2=0x5638c192a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:28.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.490+0000 7f89a045eb80 1 --2- 172.21.15.82:0/2355949577 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5638c192a060 0x5638c192a440 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f89880087c0 tx=0x7f8988008ad0 comp rx=0 tx=0).stop 2024-05-08T05:58:28.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.491+0000 7f89a045eb80 1 -- 172.21.15.82:0/2355949577 shutdown_connections 2024-05-08T05:58:28.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.491+0000 7f89a045eb80 1 --2- 172.21.15.82:0/2355949577 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638c192e9d0 0x5638c192ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:28.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.491+0000 7f89a045eb80 1 --2- 172.21.15.82:0/2355949577 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5638c192a060 0x5638c192a440 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:28.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.491+0000 7f89a045eb80 1 --2- 172.21.15.82:0/2355949577 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5638c192a980 0x5638c192e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:28.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.491+0000 7f89a045eb80 1 -- 172.21.15.82:0/2355949577 >> 172.21.15.82:0/2355949577 conn(0x5638c1858b60 msgr2=0x5638c19247a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:58:28.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.491+0000 7f89a045eb80 1 -- 172.21.15.82:0/2355949577 shutdown_connections 2024-05-08T05:58:28.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.492+0000 7f89a045eb80 1 -- 172.21.15.82:0/2355949577 wait complete. 2024-05-08T05:58:28.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.492+0000 7f898ea00700 1 --2- 172.21.15.82:0/226175349 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f89740b2b80 0x7f89740b5040 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f897800b580 tx=0x7f897801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:58:28.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.492+0000 7f89a045eb80 1 -- start start 2024-05-08T05:58:28.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.492+0000 7f89a045eb80 1 Processor -- start 2024-05-08T05:58:28.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.493+0000 7f89a045eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5638c192a060 0x5638c1935e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:28.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.493+0000 7f89a045eb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5638c192a980 0x5638c19331a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:28.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.493+0000 7f89a045eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638c192e9d0 0x5638c19336e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:28.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.493+0000 7f89a045eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5638c1936be0 con 0x5638c192e9d0 2024-05-08T05:58:28.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.493+0000 7f89a045eb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5638c17e2b20 con 0x5638c192a980 2024-05-08T05:58:28.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.493+0000 7f89a045eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5638c1936d60 con 0x5638c192a060 2024-05-08T05:58:28.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.493+0000 7f89a045eb80 10 client.0 _ll_register_callbacks cb 0x5638c1823c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:58:28.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.493+0000 7f898ea00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5638c192a060 0x5638c1935e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:28.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.493+0000 7f898ea00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5638c192a060 0x5638c1935e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:33896/0 (socket says 172.21.15.82:33896) 2024-05-08T05:58:28.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.493+0000 7f898ea00700 1 -- 172.21.15.82:0/3587812336 learned_addr learned my addr 172.21.15.82:0/3587812336 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:58:28.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.494+0000 7f898e000700 1 --2- 172.21.15.82:0/3587812336 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5638c192a980 0x5638c19331a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:28.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.494+0000 7f898f400700 1 --2- 172.21.15.82:0/3587812336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638c192e9d0 0x5638c19336e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:28.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.494+0000 7f898ea00700 1 -- 172.21.15.82:0/3587812336 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5638c192a980 msgr2=0x5638c19331a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:28.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.494+0000 7f898ea00700 1 --2- 172.21.15.82:0/3587812336 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5638c192a980 0x5638c19331a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:28.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.494+0000 7f898ea00700 1 -- 172.21.15.82:0/3587812336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638c192e9d0 msgr2=0x5638c19336e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:28.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.494+0000 7f898ea00700 1 --2- 172.21.15.82:0/3587812336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638c192e9d0 0x5638c19336e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:28.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.494+0000 7f898ea00700 1 -- 172.21.15.82:0/3587812336 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638c1842420 con 0x5638c192a060 2024-05-08T05:58:28.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.494+0000 7f898ea00700 1 --2- 172.21.15.82:0/3587812336 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5638c192a060 0x5638c1935e00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8978005f50 tx=0x7f8978009cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86fd4f5e24d8612e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:58:28.495 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.494+0000 7f897cc00700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:58:28.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.495+0000 7f897cc00700 1 -- 172.21.15.82:0/3587812336 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8978035060 con 0x5638c192a060 2024-05-08T05:58:28.496 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.495+0000 7f897cc00700 1 -- 172.21.15.82:0/3587812336 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f897800b790 con 0x5638c192a060 2024-05-08T05:58:28.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.495+0000 7f89a045eb80 1 -- 172.21.15.82:0/3587812336 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8988003da0 con 0x5638c192a060 2024-05-08T05:58:28.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.495+0000 7f897cc00700 1 -- 172.21.15.82:0/3587812336 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f897800b990 con 0x5638c192a060 2024-05-08T05:58:28.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.495+0000 7f89a045eb80 10 client.26077 fetch_fsmap learned FSMap version 31 2024-05-08T05:58:28.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.495+0000 7f89a045eb80 1 -- 172.21.15.82:0/3587812336 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5638c1941490 con 0x5638c192a060 2024-05-08T05:58:28.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.495+0000 7f897cc00700 1 -- 172.21.15.82:0/3587812336 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8988003da0 con 0x5638c192a060 2024-05-08T05:58:28.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.496+0000 7f897cc00700 1 -- 172.21.15.82:0/3587812336 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f8978025bd0 con 0x5638c192a060 2024-05-08T05:58:28.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.496+0000 7f89a045eb80 10 client.26077 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:58:28.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.497+0000 7f89a045eb80 10 client.26077 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-08T05:58:28.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.497+0000 7f89a045eb80 20 client.26077 populate_metadata read hostname 'smithi082' 2024-05-08T05:58:28.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.497+0000 7f89a045eb80 1 --2- 172.21.15.82:0/3587812336 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x5638c19439b0 0x5638c1945dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:28.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.497+0000 7f89a045eb80 4 client.26077 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:58:28.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.497+0000 7f89a045eb80 1 -- 172.21.15.82:0/3587812336 --> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5638c18f70a0 con 0x5638c19439b0 2024-05-08T05:58:28.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.497+0000 7f898e000700 1 --2- 172.21.15.82:0/3587812336 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x5638c19439b0 0x5638c1945dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:28.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.498+0000 7f898e000700 1 --2- 172.21.15.82:0/3587812336 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x5638c19439b0 0x5638c1945dd0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=86c418ee4d735493 server_cookie=d58652e175418a3 in_seq=0 out_seq=0 2024-05-08T05:58:28.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.498+0000 7f897cc00700 10 client.26077 ms_handle_connect on v2:172.21.15.151:6838/2963754236 2024-05-08T05:58:28.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.498+0000 7f897cc00700 1 -- 172.21.15.82:0/3587812336 <== mds.1 v2:172.21.15.151:6838/2963754236 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5638c18f70a0 con 0x5638c19439b0 2024-05-08T05:58:28.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.498+0000 7f897cc00700 10 client.26077 handle_command_reply: tid=0 2024-05-08T05:58:28.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.499+0000 7f89a045eb80 1 client.26077 shutdown 2024-05-08T05:58:28.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.499+0000 7f89a045eb80 1 -- 172.21.15.82:0/3587812336 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5638c192a060 msgr2=0x5638c1935e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:28.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.499+0000 7f89a045eb80 1 --2- 172.21.15.82:0/3587812336 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5638c192a060 0x5638c1935e00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8978005f50 tx=0x7f8978009cd0 comp rx=0 tx=0).stop 2024-05-08T05:58:28.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.501+0000 7f89a045eb80 1 -- 172.21.15.82:0/3587812336 shutdown_connections 2024-05-08T05:58:28.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.501+0000 7f89a045eb80 1 --2- 172.21.15.82:0/3587812336 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x5638c19439b0 0x5638c1945dd0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:28.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.501+0000 7f897cc00700 0 client.26077 ms_handle_reset on v2:172.21.15.151:6838/2963754236 2024-05-08T05:58:28.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.501+0000 7f89a045eb80 1 --2- 172.21.15.82:0/3587812336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638c192e9d0 0x5638c19336e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:28.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.501+0000 7f89a045eb80 1 --2- 172.21.15.82:0/3587812336 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5638c192a060 0x5638c1935e00 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:28.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.501+0000 7f89a045eb80 1 --2- 172.21.15.82:0/3587812336 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5638c192a980 0x5638c19331a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:28.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.501+0000 7f89a045eb80 1 -- 172.21.15.82:0/3587812336 >> 172.21.15.82:0/3587812336 conn(0x5638c1858b60 msgr2=0x5638c191f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:58:28.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.501+0000 7f89a045eb80 1 -- 172.21.15.82:0/3587812336 shutdown_connections 2024-05-08T05:58:28.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.501+0000 7f89a045eb80 1 -- 172.21.15.82:0/3587812336 wait complete. 2024-05-08T05:58:28.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.502+0000 7f89a045eb80 20 client.26077 trim_cache size 0 max 16384 2024-05-08T05:58:28.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.527+0000 7f89a045eb80 1 Processor -- start 2024-05-08T05:58:28.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.527+0000 7f89a045eb80 1 -- start start 2024-05-08T05:58:28.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.527+0000 7f89a045eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5638c192a060 0x5638c1935e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:28.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.527+0000 7f89a045eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638c192a980 0x5638c1932a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:28.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.527+0000 7f89a045eb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5638c192e9d0 0x5638c1924600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:28.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.527+0000 7f89a045eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f896c00d330 con 0x5638c192a980 2024-05-08T05:58:28.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.527+0000 7f89a045eb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f896c00ee70 con 0x5638c192e9d0 2024-05-08T05:58:28.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.527+0000 7f89a045eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f896c00da00 con 0x5638c192a060 2024-05-08T05:58:28.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.528+0000 7f898ea00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5638c192a060 0x5638c1935e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:28.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.528+0000 7f898ea00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5638c192a060 0x5638c1935e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:33900/0 (socket says 172.21.15.82:33900) 2024-05-08T05:58:28.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.528+0000 7f898ea00700 1 -- 172.21.15.82:0/1015657759 learned_addr learned my addr 172.21.15.82:0/1015657759 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:58:28.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.529+0000 7f898ea00700 1 -- 172.21.15.82:0/1015657759 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5638c192e9d0 msgr2=0x5638c1924600 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T05:58:28.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.529+0000 7f898ea00700 1 --2- 172.21.15.82:0/1015657759 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5638c192e9d0 0x5638c1924600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:28.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.529+0000 7f898ea00700 1 -- 172.21.15.82:0/1015657759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638c192a980 msgr2=0x5638c1932a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:28.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.529+0000 7f898ea00700 1 --2- 172.21.15.82:0/1015657759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638c192a980 0x5638c1932a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:28.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.529+0000 7f898ea00700 1 -- 172.21.15.82:0/1015657759 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638c192e7f0 con 0x5638c192a060 2024-05-08T05:58:28.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.530+0000 7f898ea00700 1 --2- 172.21.15.82:0/1015657759 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5638c192a060 0x5638c1935e00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8978000c00 tx=0x7f8978005e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a90df36901a28a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:58:28.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.530+0000 7f897f400700 1 -- 172.21.15.82:0/1015657759 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f897803f080 con 0x5638c192a060 2024-05-08T05:58:28.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.530+0000 7f897f400700 1 -- 172.21.15.82:0/1015657759 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f897803a5e0 con 0x5638c192a060 2024-05-08T05:58:28.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.530+0000 7f897f400700 1 -- 172.21.15.82:0/1015657759 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8978025810 con 0x5638c192a060 2024-05-08T05:58:28.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.531+0000 7f89a045eb80 1 -- 172.21.15.82:0/1015657759 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5638c192a060 msgr2=0x5638c1935e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:28.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.531+0000 7f89a045eb80 1 --2- 172.21.15.82:0/1015657759 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5638c192a060 0x5638c1935e00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8978000c00 tx=0x7f8978005e80 comp rx=0 tx=0).stop 2024-05-08T05:58:28.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.531+0000 7f89a045eb80 1 -- 172.21.15.82:0/1015657759 shutdown_connections 2024-05-08T05:58:28.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.531+0000 7f89a045eb80 1 --2- 172.21.15.82:0/1015657759 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5638c192e9d0 0x5638c1924600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:28.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.531+0000 7f89a045eb80 1 --2- 172.21.15.82:0/1015657759 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5638c192a060 0x5638c1935e00 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:28.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.531+0000 7f89a045eb80 1 --2- 172.21.15.82:0/1015657759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638c192a980 0x5638c1932a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:28.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.531+0000 7f89a045eb80 1 -- 172.21.15.82:0/1015657759 >> 172.21.15.82:0/1015657759 conn(0x5638c1858b60 msgr2=0x5638c191e2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:58:28.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.531+0000 7f89a045eb80 1 -- 172.21.15.82:0/1015657759 shutdown_connections 2024-05-08T05:58:28.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.532+0000 7f89a045eb80 1 -- 172.21.15.82:0/1015657759 wait complete. 2024-05-08T05:58:28.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.532+0000 7f89a045eb80 1 -- start start 2024-05-08T05:58:28.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.532+0000 7f89a045eb80 1 Processor -- start 2024-05-08T05:58:28.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.533+0000 7f89a045eb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5638c192a060 0x5638c192c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:28.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.533+0000 7f89a045eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5638c192a980 0x5638c192cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:28.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.533+0000 7f89a045eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638c192e9d0 0x5638c19ab280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:28.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.533+0000 7f89a045eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f896c00e7a0 con 0x5638c192e9d0 2024-05-08T05:58:28.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.533+0000 7f89a045eb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f896c00e0d0 con 0x5638c192a060 2024-05-08T05:58:28.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.533+0000 7f89a045eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f896c00b2d0 con 0x5638c192a980 2024-05-08T05:58:28.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.533+0000 7f89a045eb80 10 client.0 _ll_register_callbacks cb 0x5638c1823c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:58:28.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.533+0000 7f898e000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5638c192a980 0x5638c192cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:28.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.534+0000 7f898e000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5638c192a980 0x5638c192cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:33916/0 (socket says 172.21.15.82:33916) 2024-05-08T05:58:28.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.534+0000 7f898f400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638c192e9d0 0x5638c19ab280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:28.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.534+0000 7f898e000700 1 -- 172.21.15.82:0/2018297817 learned_addr learned my addr 172.21.15.82:0/2018297817 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:58:28.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.534+0000 7f898ea00700 1 --2- 172.21.15.82:0/2018297817 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5638c192a060 0x5638c192c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:28.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.534+0000 7f898e000700 1 -- 172.21.15.82:0/2018297817 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5638c192a060 msgr2=0x5638c192c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:28.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.534+0000 7f898e000700 1 --2- 172.21.15.82:0/2018297817 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5638c192a060 0x5638c192c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:28.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.534+0000 7f898e000700 1 -- 172.21.15.82:0/2018297817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638c192e9d0 msgr2=0x5638c19ab280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:28.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.534+0000 7f898e000700 1 --2- 172.21.15.82:0/2018297817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638c192e9d0 0x5638c19ab280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:28.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.534+0000 7f898e000700 1 -- 172.21.15.82:0/2018297817 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638c19ab7c0 con 0x5638c192a980 2024-05-08T05:58:28.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.534+0000 7f898f400700 1 --2- 172.21.15.82:0/2018297817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638c192e9d0 0x5638c19ab280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:58:28.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.535+0000 7f898e000700 1 --2- 172.21.15.82:0/2018297817 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5638c192a980 0x5638c192cab0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f89800a9760 tx=0x7f8980009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=639c40a7c0421556 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:58:28.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.535+0000 7f897cc00700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:58:28.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.535+0000 7f897cc00700 1 -- 172.21.15.82:0/2018297817 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f898008ac70 con 0x5638c192a980 2024-05-08T05:58:28.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.535+0000 7f89a045eb80 1 -- 172.21.15.82:0/2018297817 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f897803a5e0 con 0x5638c192a980 2024-05-08T05:58:28.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.535+0000 7f897cc00700 1 -- 172.21.15.82:0/2018297817 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f89800a9ed0 con 0x5638c192a980 2024-05-08T05:58:28.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.535+0000 7f897cc00700 1 -- 172.21.15.82:0/2018297817 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f89800c3050 con 0x5638c192a980 2024-05-08T05:58:28.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.535+0000 7f89a045eb80 10 client.26083 fetch_fsmap learned FSMap version 31 2024-05-08T05:58:28.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.535+0000 7f89a045eb80 1 -- 172.21.15.82:0/2018297817 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5638c1930290 con 0x5638c192a980 2024-05-08T05:58:28.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.536+0000 7f897cc00700 1 -- 172.21.15.82:0/2018297817 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89800a5040 con 0x5638c192a980 2024-05-08T05:58:28.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.536+0000 7f897cc00700 1 -- 172.21.15.82:0/2018297817 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f89800b2430 con 0x5638c192a980 2024-05-08T05:58:28.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.537+0000 7f89a045eb80 10 client.26083 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:58:28.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.537+0000 7f89a045eb80 10 client.26083 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-08T05:58:28.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.537+0000 7f89a045eb80 20 client.26083 populate_metadata read hostname 'smithi082' 2024-05-08T05:58:28.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.537+0000 7f89a045eb80 1 --2- 172.21.15.82:0/2018297817 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x5638c193b070 0x5638c193b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:28.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.538+0000 7f89a045eb80 4 client.26083 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:58:28.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.538+0000 7f89a045eb80 1 -- 172.21.15.82:0/2018297817 --> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f897803a5e0 con 0x5638c193b070 2024-05-08T05:58:28.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.538+0000 7f898ea00700 1 --2- 172.21.15.82:0/2018297817 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x5638c193b070 0x5638c193b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:28.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.539+0000 7f898ea00700 1 --2- 172.21.15.82:0/2018297817 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x5638c193b070 0x5638c193b480 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b9637a0f7e3a0255 server_cookie=423bf4b1538c98b3 in_seq=0 out_seq=0 2024-05-08T05:58:28.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.539+0000 7f897cc00700 10 client.26083 ms_handle_connect on v2:172.21.15.151:6838/2963754236 2024-05-08T05:58:28.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.539+0000 7f897cc00700 1 -- 172.21.15.82:0/2018297817 <== mds.1 v2:172.21.15.151:6838/2963754236 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f897803a5e0 con 0x5638c193b070 2024-05-08T05:58:28.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.539+0000 7f897cc00700 10 client.26083 handle_command_reply: tid=0 2024-05-08T05:58:28.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.539+0000 7f89a045eb80 1 client.26083 shutdown 2024-05-08T05:58:28.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.539+0000 7f89a045eb80 1 -- 172.21.15.82:0/2018297817 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5638c192a980 msgr2=0x5638c192cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:28.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.539+0000 7f89a045eb80 1 --2- 172.21.15.82:0/2018297817 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5638c192a980 0x5638c192cab0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f89800a9760 tx=0x7f8980009840 comp rx=0 tx=0).stop 2024-05-08T05:58:28.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.540+0000 7f89a045eb80 1 -- 172.21.15.82:0/2018297817 shutdown_connections 2024-05-08T05:58:28.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.540+0000 7f89a045eb80 1 --2- 172.21.15.82:0/2018297817 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x5638c193b070 0x5638c193b480 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:28.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.540+0000 7f89a045eb80 1 --2- 172.21.15.82:0/2018297817 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5638c192a060 0x5638c192c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:28.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.540+0000 7f89a045eb80 1 --2- 172.21.15.82:0/2018297817 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5638c192e9d0 0x5638c19ab280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:28.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.540+0000 7f89a045eb80 1 --2- 172.21.15.82:0/2018297817 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5638c192a980 0x5638c192cab0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:28.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.540+0000 7f89a045eb80 1 -- 172.21.15.82:0/2018297817 >> 172.21.15.82:0/2018297817 conn(0x5638c1858b60 msgr2=0x5638c19318e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:58:28.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.540+0000 7f897cc00700 0 client.26083 ms_handle_reset on v2:172.21.15.151:6838/2963754236 2024-05-08T05:58:28.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.540+0000 7f89a045eb80 1 -- 172.21.15.82:0/2018297817 shutdown_connections 2024-05-08T05:58:28.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.540+0000 7f89a045eb80 1 -- 172.21.15.82:0/2018297817 wait complete. 2024-05-08T05:58:28.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.540+0000 7f89a045eb80 20 client.26083 trim_cache size 0 max 16384 2024-05-08T05:58:28.541 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T05:58:28.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.541+0000 7f8995a00700 1 -- 172.21.15.82:0/226175349 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f89740b2b80 msgr2=0x7f89740b5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:28.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.541+0000 7f8995a00700 1 --2- 172.21.15.82:0/226175349 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f89740b2b80 0x7f89740b5040 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f897800b580 tx=0x7f897801a040 comp rx=0 tx=0).stop 2024-05-08T05:58:28.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.541+0000 7f8995a00700 1 -- 172.21.15.82:0/226175349 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8990108850 msgr2=0x7f899010f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:28.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.541+0000 7f8995a00700 1 --2- 172.21.15.82:0/226175349 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8990108850 0x7f899010f7f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f898000e9a0 tx=0x7f898000ed60 comp rx=0 tx=0).stop 2024-05-08T05:58:28.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.542+0000 7f8995a00700 1 -- 172.21.15.82:0/226175349 shutdown_connections 2024-05-08T05:58:28.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.542+0000 7f8995a00700 1 --2- 172.21.15.82:0/226175349 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8990104100 0x7f89901a0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:28.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.542+0000 7f8995a00700 1 --2- 172.21.15.82:0/226175349 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f89740b2b80 0x7f89740b5040 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:28.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.542+0000 7f8995a00700 1 --2- 172.21.15.82:0/226175349 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f899010fd30 0x7f89901101e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:28.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.542+0000 7f8995a00700 1 --2- 172.21.15.82:0/226175349 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8990108850 0x7f899010f7f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:28.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.542+0000 7f8995a00700 1 -- 172.21.15.82:0/226175349 >> 172.21.15.82:0/226175349 conn(0x7f899007a600 msgr2=0x7f89901016e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:58:28.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.543+0000 7f8995a00700 1 -- 172.21.15.82:0/226175349 shutdown_connections 2024-05-08T05:58:28.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:28.543+0000 7f8995a00700 1 -- 172.21.15.82:0/226175349 wait complete. 2024-05-08T05:58:29.431 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-05-08T05:58:29.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:58:29 smithi082 ceph-mon[30098]: pgmap v694: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 18 MiB/s wr, 682 op/s 2024-05-08T05:58:30.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:58:29 smithi134 ceph-mon[34132]: pgmap v694: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 18 MiB/s wr, 682 op/s 2024-05-08T05:58:30.017 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:58:30.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:58:29 smithi151 ceph-mon[34815]: pgmap v694: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 18 MiB/s wr, 682 op/s 2024-05-08T05:58:30.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 460.0 s, 1762.8 tps, lat 57.341 ms stddev 73.191 2024-05-08T05:58:31.877 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:58:31 smithi082 ceph-mon[30098]: pgmap v695: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 20 MiB/s wr, 766 op/s 2024-05-08T05:58:32.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:58:31 smithi134 ceph-mon[34132]: pgmap v695: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 20 MiB/s wr, 766 op/s 2024-05-08T05:58:32.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:58:31 smithi151 ceph-mon[34815]: pgmap v695: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 20 MiB/s wr, 766 op/s 2024-05-08T05:58:32.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.802+0000 7f0689a00700 1 -- 172.21.15.82:0/3259659388 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06841023a0 msgr2=0x7f0684102820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:32.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.802+0000 7f0689a00700 1 --2- 172.21.15.82:0/3259659388 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06841023a0 0x7f0684102820 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f067400b0a0 tx=0x7f067400b3b0 comp rx=0 tx=0).stop 2024-05-08T05:58:32.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.802+0000 7f0689a00700 1 -- 172.21.15.82:0/3259659388 shutdown_connections 2024-05-08T05:58:32.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.802+0000 7f0689a00700 1 --2- 172.21.15.82:0/3259659388 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0684102d60 0x7f068410f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:32.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.802+0000 7f0689a00700 1 --2- 172.21.15.82:0/3259659388 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0684108410 0x7f06841087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:32.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.802+0000 7f0689a00700 1 --2- 172.21.15.82:0/3259659388 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06841023a0 0x7f0684102820 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:32.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.802+0000 7f0689a00700 1 -- 172.21.15.82:0/3259659388 >> 172.21.15.82:0/3259659388 conn(0x7f0684079350 msgr2=0x7f0684079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:58:32.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.802+0000 7f0689a00700 1 -- 172.21.15.82:0/3259659388 shutdown_connections 2024-05-08T05:58:32.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.802+0000 7f0689a00700 1 -- 172.21.15.82:0/3259659388 wait complete. 2024-05-08T05:58:32.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.805+0000 7f0689a00700 1 Processor -- start 2024-05-08T05:58:32.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.805+0000 7f0689a00700 1 -- start start 2024-05-08T05:58:32.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.806+0000 7f0689a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06841023a0 0x7f068410f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:32.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.806+0000 7f0689a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0684102d60 0x7f068410b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:32.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.807+0000 7f0689a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0684108410 0x7f068410ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:32.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.807+0000 7f0689a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0684111470 con 0x7f0684102d60 2024-05-08T05:58:32.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.807+0000 7f0689a00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f06841112f0 con 0x7f06841023a0 2024-05-08T05:58:32.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.807+0000 7f0689a00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f06841115f0 con 0x7f0684108410 2024-05-08T05:58:32.808 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.807+0000 7f0682000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0684102d60 0x7f068410b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:32.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.807+0000 7f0682a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06841023a0 0x7f068410f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:32.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.807+0000 7f0682a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06841023a0 0x7f068410f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:60082/0 (socket says 172.21.15.82:60082) 2024-05-08T05:58:32.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.807+0000 7f0682a00700 1 -- 172.21.15.82:0/200539629 learned_addr learned my addr 172.21.15.82:0/200539629 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:58:32.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.808+0000 7f0682a00700 1 -- 172.21.15.82:0/200539629 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0684108410 msgr2=0x7f068410ba00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-08T05:58:32.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.808+0000 7f0682a00700 1 --2- 172.21.15.82:0/200539629 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0684108410 0x7f068410ba00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:32.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.808+0000 7f0682a00700 1 -- 172.21.15.82:0/200539629 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0684102d60 msgr2=0x7f068410b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:32.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.808+0000 7f0682a00700 1 --2- 172.21.15.82:0/200539629 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0684102d60 0x7f068410b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:32.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.808+0000 7f0682a00700 1 -- 172.21.15.82:0/200539629 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06841ac440 con 0x7f06841023a0 2024-05-08T05:58:32.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.810+0000 7f0682000700 1 --2- 172.21.15.82:0/200539629 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0684102d60 0x7f068410b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:58:32.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.810+0000 7f0682a00700 1 --2- 172.21.15.82:0/200539629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06841023a0 0x7f068410f240 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f066c00c9b0 tx=0x7f066c00ccc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:58:32.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.811+0000 7f067b400700 1 -- 172.21.15.82:0/200539629 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f066c007b00 con 0x7f06841023a0 2024-05-08T05:58:32.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.812+0000 7f067b400700 1 -- 172.21.15.82:0/200539629 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f066c007ca0 con 0x7f06841023a0 2024-05-08T05:58:32.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.812+0000 7f067b400700 1 -- 172.21.15.82:0/200539629 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f066c018660 con 0x7f06841023a0 2024-05-08T05:58:32.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.812+0000 7f0689a00700 1 -- 172.21.15.82:0/200539629 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06841ac730 con 0x7f06841023a0 2024-05-08T05:58:32.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.813+0000 7f0689a00700 1 -- 172.21.15.82:0/200539629 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06841acbf0 con 0x7f06841023a0 2024-05-08T05:58:32.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.827+0000 7f067b400700 1 -- 172.21.15.82:0/200539629 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f066c004830 con 0x7f06841023a0 2024-05-08T05:58:32.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.828+0000 7f0694404b80 1 Processor -- start 2024-05-08T05:58:32.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.829+0000 7f0694404b80 1 -- start start 2024-05-08T05:58:32.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.831+0000 7f067b400700 1 --2- 172.21.15.82:0/200539629 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f06680b2a50 0x7f06680b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:32.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.831+0000 7f0694404b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555e18e09bc0 0x555e18e09fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:32.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.831+0000 7f067b400700 1 -- 172.21.15.82:0/200539629 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f066c0e2110 con 0x7f06841023a0 2024-05-08T05:58:32.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.831+0000 7f0683400700 1 --2- 172.21.15.82:0/200539629 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f06680b2a50 0x7f06680b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:32.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.832+0000 7f0694404b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555e18e0a4e0 0x555e18e042d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:32.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.832+0000 7f0694404b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555e18e048f0 0x555e18e04d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:32.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.832+0000 7f0694404b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x555e18d56a20 con 0x555e18e0a4e0 2024-05-08T05:58:32.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.832+0000 7f0694404b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x555e18cf4760 con 0x555e18e09bc0 2024-05-08T05:58:32.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.832+0000 7f0694404b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x555e18d529e0 con 0x555e18e048f0 2024-05-08T05:58:32.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.832+0000 7f0682a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555e18e09bc0 0x555e18e09fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:32.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.832+0000 7f0682a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555e18e09bc0 0x555e18e09fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:39290/0 (socket says 172.21.15.82:39290) 2024-05-08T05:58:32.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.832+0000 7f0682a00700 1 -- 172.21.15.82:0/2445635564 learned_addr learned my addr 172.21.15.82:0/2445635564 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:58:32.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.832+0000 7f0682a00700 1 -- 172.21.15.82:0/2445635564 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555e18e048f0 msgr2=0x555e18e04d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:32.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.832+0000 7f0682a00700 1 --2- 172.21.15.82:0/2445635564 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555e18e048f0 0x555e18e04d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:32.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.832+0000 7f0682a00700 1 -- 172.21.15.82:0/2445635564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555e18e0a4e0 msgr2=0x555e18e042d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T05:58:32.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.833+0000 7f0682a00700 1 --2- 172.21.15.82:0/2445635564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555e18e0a4e0 0x555e18e042d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:32.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.833+0000 7f0682a00700 1 -- 172.21.15.82:0/2445635564 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e18ca38d0 con 0x555e18e09bc0 2024-05-08T05:58:32.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.833+0000 7f0683400700 1 --2- 172.21.15.82:0/200539629 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f06680b2a50 0x7f06680b4f10 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f067c00b9c0 tx=0x7f067c00bd80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:58:32.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.834+0000 7f0682a00700 1 --2- 172.21.15.82:0/2445635564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555e18e09bc0 0x555e18e09fa0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f066c0aa5d0 tx=0x7f066c0aa510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91008c0eb1d647f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:58:32.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.834+0000 7f0673e00700 1 -- 172.21.15.82:0/2445635564 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f066c0c3070 con 0x555e18e09bc0 2024-05-08T05:58:32.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.834+0000 7f0673e00700 1 -- 172.21.15.82:0/2445635564 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f066c0aad40 con 0x555e18e09bc0 2024-05-08T05:58:32.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.834+0000 7f0673e00700 1 -- 172.21.15.82:0/2445635564 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f066c0aab30 con 0x555e18e09bc0 2024-05-08T05:58:32.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.835+0000 7f0694404b80 1 -- 172.21.15.82:0/2445635564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555e18e09bc0 msgr2=0x555e18e09fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:32.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.835+0000 7f0694404b80 1 --2- 172.21.15.82:0/2445635564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555e18e09bc0 0x555e18e09fa0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f066c0aa5d0 tx=0x7f066c0aa510 comp rx=0 tx=0).stop 2024-05-08T05:58:32.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.836+0000 7f0694404b80 1 -- 172.21.15.82:0/2445635564 shutdown_connections 2024-05-08T05:58:32.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.836+0000 7f0694404b80 1 --2- 172.21.15.82:0/2445635564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555e18e09bc0 0x555e18e09fa0 secure :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f066c0aa5d0 tx=0x7f066c0aa510 comp rx=0 tx=0).stop 2024-05-08T05:58:32.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.836+0000 7f0694404b80 1 --2- 172.21.15.82:0/2445635564 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555e18e048f0 0x555e18e04d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:32.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.836+0000 7f0694404b80 1 --2- 172.21.15.82:0/2445635564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555e18e0a4e0 0x555e18e042d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:32.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.836+0000 7f0694404b80 1 -- 172.21.15.82:0/2445635564 >> 172.21.15.82:0/2445635564 conn(0x555e18d7c6d0 msgr2=0x555e18dfeb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:58:32.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.836+0000 7f0694404b80 1 -- 172.21.15.82:0/2445635564 shutdown_connections 2024-05-08T05:58:32.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.836+0000 7f0694404b80 1 -- 172.21.15.82:0/2445635564 wait complete. 2024-05-08T05:58:32.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.837+0000 7f0694404b80 1 -- start start 2024-05-08T05:58:32.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.837+0000 7f0694404b80 1 Processor -- start 2024-05-08T05:58:32.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.838+0000 7f0694404b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555e18e048f0 0x555e18e10390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:32.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.838+0000 7f0694404b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555e18e0a4e0 0x555e18e0d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:32.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.838+0000 7f0694404b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555e18e0dbd0 0x555e18e0e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:32.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.838+0000 7f0694404b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x555e18e10f20 con 0x555e18e0dbd0 2024-05-08T05:58:32.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.838+0000 7f0694404b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x555e18cbcb20 con 0x555e18e048f0 2024-05-08T05:58:32.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.838+0000 7f0694404b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x555e18e110a0 con 0x555e18e0a4e0 2024-05-08T05:58:32.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.838+0000 7f0694404b80 10 client.0 _ll_register_callbacks cb 0x555e18cfdc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:58:32.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.838+0000 7f0682a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555e18e048f0 0x555e18e10390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:32.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.838+0000 7f0682a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555e18e048f0 0x555e18e10390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:39294/0 (socket says 172.21.15.82:39294) 2024-05-08T05:58:32.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.838+0000 7f0682a00700 1 -- 172.21.15.82:0/3761958825 learned_addr learned my addr 172.21.15.82:0/3761958825 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:58:32.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.839+0000 7f0682000700 1 --2- 172.21.15.82:0/3761958825 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555e18e0a4e0 0x555e18e0d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:32.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.839+0000 7f0682000700 1 -- 172.21.15.82:0/3761958825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555e18e048f0 msgr2=0x555e18e10390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:32.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.839+0000 7f0682000700 1 --2- 172.21.15.82:0/3761958825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555e18e048f0 0x555e18e10390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:32.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.839+0000 7f0682000700 1 -- 172.21.15.82:0/3761958825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555e18e0dbd0 msgr2=0x555e18e0e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:32.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.839+0000 7f0682000700 1 --2- 172.21.15.82:0/3761958825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555e18e0dbd0 0x555e18e0e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:32.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.839+0000 7f0682000700 1 -- 172.21.15.82:0/3761958825 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e18d1c420 con 0x555e18e0a4e0 2024-05-08T05:58:32.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.840+0000 7f0682000700 1 --2- 172.21.15.82:0/3761958825 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555e18e0a4e0 0x555e18e0d690 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0674000f80 tx=0x7f06740052e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e24babe1a2d7cdf1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:58:32.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.840+0000 7f0670c00700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:58:32.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.840+0000 7f0670c00700 1 -- 172.21.15.82:0/3761958825 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0674005910 con 0x555e18e0a4e0 2024-05-08T05:58:32.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.840+0000 7f0670c00700 1 -- 172.21.15.82:0/3761958825 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f06740074a0 con 0x555e18e0a4e0 2024-05-08T05:58:32.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.840+0000 7f0694404b80 1 -- 172.21.15.82:0/3761958825 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f066c0aad40 con 0x555e18e0a4e0 2024-05-08T05:58:32.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.841+0000 7f0670c00700 1 -- 172.21.15.82:0/3761958825 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f0674009ca0 con 0x555e18e0a4e0 2024-05-08T05:58:32.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.841+0000 7f0694404b80 10 client.26089 fetch_fsmap learned FSMap version 31 2024-05-08T05:58:32.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.841+0000 7f0694404b80 1 -- 172.21.15.82:0/3761958825 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x555e18e1bd40 con 0x555e18e0a4e0 2024-05-08T05:58:32.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.841+0000 7f0670c00700 1 -- 172.21.15.82:0/3761958825 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f066c0aad40 con 0x555e18e0a4e0 2024-05-08T05:58:32.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.841+0000 7f0670c00700 1 -- 172.21.15.82:0/3761958825 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f0674011070 con 0x555e18e0a4e0 2024-05-08T05:58:32.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.842+0000 7f0694404b80 10 client.26089 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:58:32.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.842+0000 7f0694404b80 10 client.26089 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:58:32.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.842+0000 7f0694404b80 20 client.26089 populate_metadata read hostname 'smithi082' 2024-05-08T05:58:32.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.842+0000 7f0694404b80 1 --2- 172.21.15.82:0/3761958825 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x555e18e1e750 0x555e18e20b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:32.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.842+0000 7f0694404b80 4 client.26089 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:58:32.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.842+0000 7f0694404b80 1 -- 172.21.15.82:0/3761958825 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555e18dd1140 con 0x555e18e1e750 2024-05-08T05:58:32.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.842+0000 7f0682a00700 1 --2- 172.21.15.82:0/3761958825 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x555e18e1e750 0x555e18e20b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:32.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.843+0000 7f0682a00700 1 --2- 172.21.15.82:0/3761958825 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x555e18e1e750 0x555e18e20b70 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dfe0a48b2b2668f5 server_cookie=4deb9add165b3168 in_seq=0 out_seq=0 2024-05-08T05:58:32.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.843+0000 7f0670c00700 10 client.26089 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:58:32.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.843+0000 7f0670c00700 1 -- 172.21.15.82:0/3761958825 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x555e18dd1140 con 0x555e18e1e750 2024-05-08T05:58:32.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.843+0000 7f0670c00700 10 client.26089 handle_command_reply: tid=0 2024-05-08T05:58:32.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.844+0000 7f0694404b80 1 client.26089 shutdown 2024-05-08T05:58:32.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.844+0000 7f0694404b80 1 -- 172.21.15.82:0/3761958825 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555e18e0a4e0 msgr2=0x555e18e0d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:32.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.844+0000 7f0694404b80 1 --2- 172.21.15.82:0/3761958825 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555e18e0a4e0 0x555e18e0d690 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0674000f80 tx=0x7f06740052e0 comp rx=0 tx=0).stop 2024-05-08T05:58:32.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.844+0000 7f0694404b80 1 -- 172.21.15.82:0/3761958825 shutdown_connections 2024-05-08T05:58:32.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.844+0000 7f0694404b80 1 --2- 172.21.15.82:0/3761958825 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x555e18e1e750 0x555e18e20b70 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:32.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.844+0000 7f0694404b80 1 --2- 172.21.15.82:0/3761958825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555e18e048f0 0x555e18e10390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:32.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.844+0000 7f0694404b80 1 --2- 172.21.15.82:0/3761958825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555e18e0dbd0 0x555e18e0e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:32.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.844+0000 7f0694404b80 1 --2- 172.21.15.82:0/3761958825 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555e18e0a4e0 0x555e18e0d690 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:32.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.844+0000 7f0694404b80 1 -- 172.21.15.82:0/3761958825 >> 172.21.15.82:0/3761958825 conn(0x555e18d7c6d0 msgr2=0x555e18dfe190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:58:32.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.844+0000 7f0670c00700 0 client.26089 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:58:32.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.845+0000 7f0694404b80 1 -- 172.21.15.82:0/3761958825 shutdown_connections 2024-05-08T05:58:32.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.845+0000 7f0694404b80 1 -- 172.21.15.82:0/3761958825 wait complete. 2024-05-08T05:58:32.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.845+0000 7f0694404b80 20 client.26089 trim_cache size 0 max 16384 2024-05-08T05:58:32.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.872+0000 7f0694404b80 1 Processor -- start 2024-05-08T05:58:32.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.874+0000 7f0694404b80 1 -- start start 2024-05-08T05:58:32.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.874+0000 7f0694404b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555e18e048f0 0x555e18e042d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:32.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.874+0000 7f0694404b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555e18e0a4e0 0x555e18e07d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:32.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.874+0000 7f0694404b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555e18e0dbd0 0x555e18e08f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:32.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.874+0000 7f0694404b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f06841b3fc0 con 0x555e18e048f0 2024-05-08T05:58:32.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.874+0000 7f0694404b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f06841b5b00 con 0x555e18e0a4e0 2024-05-08T05:58:32.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.874+0000 7f0694404b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f06841b4690 con 0x555e18e0dbd0 2024-05-08T05:58:32.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.875+0000 7f0682000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555e18e0a4e0 0x555e18e07d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:32.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.875+0000 7f0683400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555e18e0dbd0 0x555e18e08f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:32.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.875+0000 7f0682000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555e18e0a4e0 0x555e18e07d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:39302/0 (socket says 172.21.15.82:39302) 2024-05-08T05:58:32.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.875+0000 7f0682000700 1 -- 172.21.15.82:0/4206680957 learned_addr learned my addr 172.21.15.82:0/4206680957 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:58:32.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.875+0000 7f0682a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555e18e048f0 0x555e18e042d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:32.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.875+0000 7f0682000700 1 -- 172.21.15.82:0/4206680957 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555e18e0dbd0 msgr2=0x555e18e08f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:32.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.875+0000 7f0682000700 1 --2- 172.21.15.82:0/4206680957 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555e18e0dbd0 0x555e18e08f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:32.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.875+0000 7f0682000700 1 -- 172.21.15.82:0/4206680957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555e18e048f0 msgr2=0x555e18e042d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:32.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.875+0000 7f0682000700 1 --2- 172.21.15.82:0/4206680957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555e18e048f0 0x555e18e042d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:32.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.875+0000 7f0682000700 1 -- 172.21.15.82:0/4206680957 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e18e211d0 con 0x555e18e0a4e0 2024-05-08T05:58:32.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.876+0000 7f0682000700 1 --2- 172.21.15.82:0/4206680957 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555e18e0a4e0 0x555e18e07d80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f067400d010 tx=0x7f06740097d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6d8e04a35796bb9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:58:32.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.876+0000 7f0673400700 1 -- 172.21.15.82:0/4206680957 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0674025e60 con 0x555e18e0a4e0 2024-05-08T05:58:32.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.876+0000 7f0673400700 1 -- 172.21.15.82:0/4206680957 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0674034020 con 0x555e18e0a4e0 2024-05-08T05:58:32.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.876+0000 7f0673400700 1 -- 172.21.15.82:0/4206680957 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0674007640 con 0x555e18e0a4e0 2024-05-08T05:58:32.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.877+0000 7f0694404b80 1 -- 172.21.15.82:0/4206680957 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555e18e0a4e0 msgr2=0x555e18e07d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:32.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.877+0000 7f0694404b80 1 --2- 172.21.15.82:0/4206680957 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555e18e0a4e0 0x555e18e07d80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f067400d010 tx=0x7f06740097d0 comp rx=0 tx=0).stop 2024-05-08T05:58:32.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.877+0000 7f0694404b80 1 -- 172.21.15.82:0/4206680957 shutdown_connections 2024-05-08T05:58:32.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.877+0000 7f0694404b80 1 --2- 172.21.15.82:0/4206680957 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555e18e0dbd0 0x555e18e08f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:32.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.877+0000 7f0694404b80 1 --2- 172.21.15.82:0/4206680957 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555e18e048f0 0x555e18e042d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:32.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.877+0000 7f0694404b80 1 --2- 172.21.15.82:0/4206680957 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555e18e0a4e0 0x555e18e07d80 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:32.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.877+0000 7f0694404b80 1 -- 172.21.15.82:0/4206680957 >> 172.21.15.82:0/4206680957 conn(0x555e18d7c6d0 msgr2=0x555e18e08810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:58:32.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.878+0000 7f0694404b80 1 -- 172.21.15.82:0/4206680957 shutdown_connections 2024-05-08T05:58:32.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.878+0000 7f0694404b80 1 -- 172.21.15.82:0/4206680957 wait complete. 2024-05-08T05:58:32.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.879+0000 7f0694404b80 1 -- start start 2024-05-08T05:58:32.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.879+0000 7f0694404b80 1 Processor -- start 2024-05-08T05:58:32.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.880+0000 7f0694404b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555e18e048f0 0x555e18e165f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:32.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.880+0000 7f0694404b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555e18e0a4e0 0x555e18e257f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:32.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.880+0000 7f0694404b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555e18e0dbd0 0x555e18e25d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:32.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.880+0000 7f0694404b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f06841b5430 con 0x555e18e0dbd0 2024-05-08T05:58:32.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.880+0000 7f0694404b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f06841b4d60 con 0x555e18e048f0 2024-05-08T05:58:32.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.880+0000 7f0694404b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f06841b1f60 con 0x555e18e0a4e0 2024-05-08T05:58:32.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.880+0000 7f0694404b80 10 client.0 _ll_register_callbacks cb 0x555e18cfdc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:58:32.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.881+0000 7f0682a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555e18e048f0 0x555e18e165f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:32.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.881+0000 7f0682a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555e18e048f0 0x555e18e165f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:39306/0 (socket says 172.21.15.82:39306) 2024-05-08T05:58:32.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.881+0000 7f0682a00700 1 -- 172.21.15.82:0/3905052674 learned_addr learned my addr 172.21.15.82:0/3905052674 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:58:32.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.881+0000 7f0683400700 1 --2- 172.21.15.82:0/3905052674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555e18e0dbd0 0x555e18e25d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:32.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.881+0000 7f0682000700 1 --2- 172.21.15.82:0/3905052674 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555e18e0a4e0 0x555e18e257f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:32.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.882+0000 7f0683400700 1 -- 172.21.15.82:0/3905052674 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555e18e0a4e0 msgr2=0x555e18e257f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:32.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.882+0000 7f0683400700 1 --2- 172.21.15.82:0/3905052674 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555e18e0a4e0 0x555e18e257f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:32.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.882+0000 7f0683400700 1 -- 172.21.15.82:0/3905052674 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555e18e048f0 msgr2=0x555e18e165f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:32.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.882+0000 7f0683400700 1 --2- 172.21.15.82:0/3905052674 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555e18e048f0 0x555e18e165f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:32.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.882+0000 7f0683400700 1 -- 172.21.15.82:0/3905052674 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e18e1a9a0 con 0x555e18e0dbd0 2024-05-08T05:58:32.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.882+0000 7f0682a00700 1 --2- 172.21.15.82:0/3905052674 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555e18e048f0 0x555e18e165f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:58:32.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.882+0000 7f0683400700 1 --2- 172.21.15.82:0/3905052674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555e18e0dbd0 0x555e18e25d30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f067c00bfd0 tx=0x7f067c012480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=132ce6f305297090 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:58:32.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.883+0000 7f0670c00700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T05:58:32.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.884+0000 7f0670c00700 1 -- 172.21.15.82:0/3905052674 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f067c024020 con 0x555e18e0dbd0 2024-05-08T05:58:32.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.884+0000 7f0670c00700 1 -- 172.21.15.82:0/3905052674 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f067c012ce0 con 0x555e18e0dbd0 2024-05-08T05:58:32.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.884+0000 7f0694404b80 1 -- 172.21.15.82:0/3905052674 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0674034020 con 0x555e18e0dbd0 2024-05-08T05:58:32.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.885+0000 7f0670c00700 1 -- 172.21.15.82:0/3905052674 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f067c020420 con 0x555e18e0dbd0 2024-05-08T05:58:32.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.885+0000 7f0694404b80 10 client.15771 fetch_fsmap learned FSMap version 31 2024-05-08T05:58:32.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.885+0000 7f0694404b80 1 -- 172.21.15.82:0/3905052674 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x555e18e88bb0 con 0x555e18e0dbd0 2024-05-08T05:58:32.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.886+0000 7f0670c00700 1 -- 172.21.15.82:0/3905052674 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0674034020 con 0x555e18e0dbd0 2024-05-08T05:58:32.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.886+0000 7f0670c00700 1 -- 172.21.15.82:0/3905052674 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f067c00f580 con 0x555e18e0dbd0 2024-05-08T05:58:32.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.886+0000 7f0694404b80 10 client.15771 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:58:32.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.886+0000 7f0694404b80 10 client.15771 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:58:32.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.886+0000 7f0694404b80 20 client.15771 populate_metadata read hostname 'smithi082' 2024-05-08T05:58:32.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.886+0000 7f0694404b80 1 --2- 172.21.15.82:0/3905052674 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x555e18e892f0 0x555e18e8b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:32.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.886+0000 7f0694404b80 4 client.15771 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:58:32.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.886+0000 7f0694404b80 1 -- 172.21.15.82:0/3905052674 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555e18d64400 con 0x555e18e892f0 2024-05-08T05:58:32.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.887+0000 7f0682a00700 1 --2- 172.21.15.82:0/3905052674 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x555e18e892f0 0x555e18e8b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:32.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.887+0000 7f0682a00700 1 --2- 172.21.15.82:0/3905052674 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x555e18e892f0 0x555e18e8b710 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae3f5f004bf17792 server_cookie=e90d9f37d66d2dbb in_seq=0 out_seq=0 2024-05-08T05:58:32.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.887+0000 7f0670c00700 10 client.15771 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:58:32.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.888+0000 7f0670c00700 1 -- 172.21.15.82:0/3905052674 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555e18d64400 con 0x555e18e892f0 2024-05-08T05:58:32.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.888+0000 7f0670c00700 10 client.15771 handle_command_reply: tid=0 2024-05-08T05:58:32.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.888+0000 7f0694404b80 1 client.15771 shutdown 2024-05-08T05:58:32.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.889+0000 7f0694404b80 1 -- 172.21.15.82:0/3905052674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555e18e0dbd0 msgr2=0x555e18e25d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:32.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.889+0000 7f0694404b80 1 --2- 172.21.15.82:0/3905052674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555e18e0dbd0 0x555e18e25d30 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f067c00bfd0 tx=0x7f067c012480 comp rx=0 tx=0).stop 2024-05-08T05:58:32.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.889+0000 7f0694404b80 1 -- 172.21.15.82:0/3905052674 shutdown_connections 2024-05-08T05:58:32.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.889+0000 7f0694404b80 1 --2- 172.21.15.82:0/3905052674 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x555e18e892f0 0x555e18e8b710 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:32.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.889+0000 7f0694404b80 1 --2- 172.21.15.82:0/3905052674 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555e18e048f0 0x555e18e165f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:32.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.889+0000 7f0694404b80 1 --2- 172.21.15.82:0/3905052674 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555e18e0dbd0 0x555e18e25d30 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:32.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.889+0000 7f0694404b80 1 --2- 172.21.15.82:0/3905052674 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555e18e0a4e0 0x555e18e257f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:32.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.889+0000 7f0694404b80 1 -- 172.21.15.82:0/3905052674 >> 172.21.15.82:0/3905052674 conn(0x555e18d7c6d0 msgr2=0x555e18e0a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:58:32.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.889+0000 7f0670c00700 0 client.15771 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:58:32.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.890+0000 7f0694404b80 1 -- 172.21.15.82:0/3905052674 shutdown_connections 2024-05-08T05:58:32.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.890+0000 7f0694404b80 1 -- 172.21.15.82:0/3905052674 wait complete. 2024-05-08T05:58:32.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.890+0000 7f0694404b80 20 client.15771 trim_cache size 0 max 16384 2024-05-08T05:58:32.891 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T05:58:32.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.892+0000 7f0689a00700 1 -- 172.21.15.82:0/200539629 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f06680b2a50 msgr2=0x7f06680b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:32.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.892+0000 7f0689a00700 1 --2- 172.21.15.82:0/200539629 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f06680b2a50 0x7f06680b4f10 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f067c00b9c0 tx=0x7f067c00bd80 comp rx=0 tx=0).stop 2024-05-08T05:58:32.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.892+0000 7f0689a00700 1 -- 172.21.15.82:0/200539629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06841023a0 msgr2=0x7f068410f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:32.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.892+0000 7f0689a00700 1 --2- 172.21.15.82:0/200539629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06841023a0 0x7f068410f240 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f066c00c9b0 tx=0x7f066c00ccc0 comp rx=0 tx=0).stop 2024-05-08T05:58:32.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.892+0000 7f0689a00700 1 -- 172.21.15.82:0/200539629 shutdown_connections 2024-05-08T05:58:32.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.892+0000 7f0689a00700 1 --2- 172.21.15.82:0/200539629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f06841023a0 0x7f068410f240 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:32.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.892+0000 7f0689a00700 1 --2- 172.21.15.82:0/200539629 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f06680b2a50 0x7f06680b4f10 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:32.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.892+0000 7f0689a00700 1 --2- 172.21.15.82:0/200539629 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0684108410 0x7f068410ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:32.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.892+0000 7f0689a00700 1 --2- 172.21.15.82:0/200539629 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0684102d60 0x7f068410b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:32.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.892+0000 7f0689a00700 1 -- 172.21.15.82:0/200539629 >> 172.21.15.82:0/200539629 conn(0x7f0684079350 msgr2=0x7f0684100ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:58:32.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.892+0000 7f0689a00700 1 -- 172.21.15.82:0/200539629 shutdown_connections 2024-05-08T05:58:32.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:32.893+0000 7f0689a00700 1 -- 172.21.15.82:0/200539629 wait complete. 2024-05-08T05:58:33.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:58:33 smithi082 ceph-mon[30098]: pgmap v696: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 16 MiB/s wr, 660 op/s 2024-05-08T05:58:33.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:58:33 smithi134 ceph-mon[34132]: pgmap v696: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 16 MiB/s wr, 660 op/s 2024-05-08T05:58:34.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:58:33 smithi151 ceph-mon[34815]: pgmap v696: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 16 MiB/s wr, 660 op/s 2024-05-08T05:58:34.845 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-08T05:58:34.846 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-05-08T05:58:35.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 465.0 s, 1737.0 tps, lat 57.353 ms stddev 71.943 2024-05-08T05:58:35.461 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:58:35.959 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:58:35 smithi082 ceph-mon[30098]: pgmap v697: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 15 MiB/s wr, 654 op/s 2024-05-08T05:58:35.959 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:58:35 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:58:35.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:58:35 smithi134 ceph-mon[34132]: pgmap v697: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 15 MiB/s wr, 654 op/s 2024-05-08T05:58:36.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:58:35 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:58:36.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:58:35 smithi151 ceph-mon[34815]: pgmap v697: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 15 MiB/s wr, 654 op/s 2024-05-08T05:58:36.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:58:35 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:58:37.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:58:37 smithi151 ceph-mon[34815]: pgmap v698: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 17 MiB/s wr, 766 op/s 2024-05-08T05:58:37.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:58:37 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:58:37.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:58:37 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:58:37.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:58:37 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:58:37.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:58:37 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:58:37.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:58:37 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:58:37.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:58:37 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:58:37.912 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:58:37 smithi082 ceph-mon[30098]: pgmap v698: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 17 MiB/s wr, 766 op/s 2024-05-08T05:58:37.912 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:58:37 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:58:37.912 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:58:37 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:58:37.913 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:58:37 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:58:37.913 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:58:37 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:58:37.913 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:58:37 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:58:37.913 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:58:37 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:58:38.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:58:37 smithi134 ceph-mon[34132]: pgmap v698: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 17 MiB/s wr, 766 op/s 2024-05-08T05:58:38.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:58:37 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:58:38.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:58:37 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:58:38.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:58:37 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:58:38.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:58:37 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:58:38.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:58:37 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:58:38.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:58:37 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:58:38.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.026+0000 7f81b5400700 1 -- 172.21.15.82:0/2735484885 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81b0102d60 msgr2=0x7f81b010f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:38.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.026+0000 7f81b5400700 1 --2- 172.21.15.82:0/2735484885 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81b0102d60 0x7f81b010f250 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f81a800b0a0 tx=0x7f81a800b3b0 comp rx=0 tx=0).stop 2024-05-08T05:58:38.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.028+0000 7f81b5400700 1 -- 172.21.15.82:0/2735484885 shutdown_connections 2024-05-08T05:58:38.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.028+0000 7f81b5400700 1 --2- 172.21.15.82:0/2735484885 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81b0102d60 0x7f81b010f250 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:38.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.028+0000 7f81b5400700 1 --2- 172.21.15.82:0/2735484885 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81b0108410 0x7f81b01087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:38.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.028+0000 7f81b5400700 1 --2- 172.21.15.82:0/2735484885 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81b01023a0 0x7f81b0102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:38.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.028+0000 7f81b5400700 1 -- 172.21.15.82:0/2735484885 >> 172.21.15.82:0/2735484885 conn(0x7f81b0079350 msgr2=0x7f81b0079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:58:38.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.029+0000 7f81b5400700 1 -- 172.21.15.82:0/2735484885 shutdown_connections 2024-05-08T05:58:38.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.029+0000 7f81b5400700 1 -- 172.21.15.82:0/2735484885 wait complete. 2024-05-08T05:58:38.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.031+0000 7f81b5400700 1 Processor -- start 2024-05-08T05:58:38.032 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.031+0000 7f81b5400700 1 -- start start 2024-05-08T05:58:38.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.032+0000 7f81b5400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81b01023a0 0x7f81b01a0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:38.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.032+0000 7f81b5400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81b0102d60 0x7f81b01a0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:38.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.032+0000 7f81b5400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81b0108410 0x7f81b01a48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:38.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.032+0000 7f81b5400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f81b0112580 con 0x7f81b01023a0 2024-05-08T05:58:38.033 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.032+0000 7f81b5400700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f81b0112400 con 0x7f81b0108410 2024-05-08T05:58:38.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.032+0000 7f81b5400700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f81b0112700 con 0x7f81b0102d60 2024-05-08T05:58:38.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.033+0000 7f81ade00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81b0102d60 0x7f81b01a0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:38.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.033+0000 7f81ade00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81b0102d60 0x7f81b01a0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:54004/0 (socket says 172.21.15.82:54004) 2024-05-08T05:58:38.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.033+0000 7f81ade00700 1 -- 172.21.15.82:0/2799794289 learned_addr learned my addr 172.21.15.82:0/2799794289 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:58:38.034 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.033+0000 7f81af200700 1 --2- 172.21.15.82:0/2799794289 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81b0108410 0x7f81b01a48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:38.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.033+0000 7f81af200700 1 -- 172.21.15.82:0/2799794289 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81b0102d60 msgr2=0x7f81b01a0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:38.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.033+0000 7f81af200700 1 --2- 172.21.15.82:0/2799794289 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81b0102d60 0x7f81b01a0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:38.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.033+0000 7f81af200700 1 -- 172.21.15.82:0/2799794289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81b01023a0 msgr2=0x7f81b01a0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:38.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.033+0000 7f81af200700 1 --2- 172.21.15.82:0/2799794289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81b01023a0 0x7f81b01a0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:38.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.033+0000 7f81af200700 1 -- 172.21.15.82:0/2799794289 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81b01a5030 con 0x7f81b0108410 2024-05-08T05:58:38.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.034+0000 7f81af200700 1 --2- 172.21.15.82:0/2799794289 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81b0108410 0x7f81b01a48f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f81a8006070 tx=0x7f81a8009700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:58:38.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.034+0000 7f81a7400700 1 -- 172.21.15.82:0/2799794289 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a8021070 con 0x7f81b0108410 2024-05-08T05:58:38.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.035+0000 7f81a7400700 1 -- 172.21.15.82:0/2799794289 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81a8003c00 con 0x7f81b0108410 2024-05-08T05:58:38.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.035+0000 7f81b5400700 1 -- 172.21.15.82:0/2799794289 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81b01a52c0 con 0x7f81b0108410 2024-05-08T05:58:38.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.035+0000 7f81b5400700 1 -- 172.21.15.82:0/2799794289 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81b01acba0 con 0x7f81b0108410 2024-05-08T05:58:38.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.035+0000 7f81a7400700 1 -- 172.21.15.82:0/2799794289 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a8004720 con 0x7f81b0108410 2024-05-08T05:58:38.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.040+0000 7f81a7400700 1 -- 172.21.15.82:0/2799794289 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f81a801d450 con 0x7f81b0108410 2024-05-08T05:58:38.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.042+0000 7f81bfdcfb80 1 Processor -- start 2024-05-08T05:58:38.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.042+0000 7f81bfdcfb80 1 -- start start 2024-05-08T05:58:38.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.043+0000 7f81bfdcfb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56181303e0e0 0x56181303e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:38.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.043+0000 7f81bfdcfb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56181303ea00 0x561813042510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:38.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.043+0000 7f81bfdcfb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561813042a50 0x561813042eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:38.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.043+0000 7f81bfdcfb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x561812f90aa0 con 0x56181303e0e0 2024-05-08T05:58:38.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.043+0000 7f81bfdcfb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x561812f2e7e0 con 0x56181303ea00 2024-05-08T05:58:38.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.043+0000 7f81bfdcfb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x561812f8ca60 con 0x561813042a50 2024-05-08T05:58:38.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.043+0000 7f81a7400700 1 --2- 172.21.15.82:0/2799794289 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f81940b2a10 0x7f81940b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:38.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.043+0000 7f81a7400700 1 -- 172.21.15.82:0/2799794289 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f81a800f070 con 0x7f81b0108410 2024-05-08T05:58:38.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.044+0000 7f81af200700 1 --2- 172.21.15.82:0/2799794289 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f81940b2a10 0x7f81940b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:38.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.044+0000 7f81ade00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56181303e0e0 0x56181303e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:38.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.044+0000 7f81ade00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561813042a50 0x561813042eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:38.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.044+0000 7f81ade00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561813042a50 0x561813042eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:54016/0 (socket says 172.21.15.82:54016) 2024-05-08T05:58:38.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.044+0000 7f81ade00700 1 -- 172.21.15.82:0/2815484304 learned_addr learned my addr 172.21.15.82:0/2815484304 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:58:38.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.044+0000 7f81ae800700 1 --2- 172.21.15.82:0/2815484304 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56181303ea00 0x561813042510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:38.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.045+0000 7f81ade00700 1 -- 172.21.15.82:0/2815484304 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56181303ea00 msgr2=0x561813042510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:38.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.045+0000 7f81ade00700 1 --2- 172.21.15.82:0/2815484304 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56181303ea00 0x561813042510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:38.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.045+0000 7f81ade00700 1 -- 172.21.15.82:0/2815484304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56181303e0e0 msgr2=0x56181303e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:38.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.045+0000 7f81ade00700 1 --2- 172.21.15.82:0/2815484304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56181303e0e0 0x56181303e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:38.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.045+0000 7f81ade00700 1 -- 172.21.15.82:0/2815484304 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561812edd950 con 0x561813042a50 2024-05-08T05:58:38.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.045+0000 7f81af200700 1 --2- 172.21.15.82:0/2799794289 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f81940b2a10 0x7f81940b4ed0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f81a8009a20 tx=0x7f81a8009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:58:38.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.045+0000 7f81ade00700 1 --2- 172.21.15.82:0/2815484304 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561813042a50 0x561813042eb0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f819c005950 tx=0x7f819c005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af7de02b241b8ea1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:58:38.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.046+0000 7f819be00700 1 -- 172.21.15.82:0/2815484304 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f819c011110 con 0x561813042a50 2024-05-08T05:58:38.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.046+0000 7f819be00700 1 -- 172.21.15.82:0/2815484304 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f819c00ea70 con 0x561813042a50 2024-05-08T05:58:38.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.046+0000 7f819be00700 1 -- 172.21.15.82:0/2815484304 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f819c00f820 con 0x561813042a50 2024-05-08T05:58:38.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.047+0000 7f81bfdcfb80 1 -- 172.21.15.82:0/2815484304 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561813042a50 msgr2=0x561813042eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:38.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.047+0000 7f81bfdcfb80 1 --2- 172.21.15.82:0/2815484304 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561813042a50 0x561813042eb0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f819c005950 tx=0x7f819c005f90 comp rx=0 tx=0).stop 2024-05-08T05:58:38.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.049+0000 7f81bfdcfb80 1 -- 172.21.15.82:0/2815484304 shutdown_connections 2024-05-08T05:58:38.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.049+0000 7f81bfdcfb80 1 --2- 172.21.15.82:0/2815484304 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561813042a50 0x561813042eb0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:38.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.049+0000 7f81bfdcfb80 1 --2- 172.21.15.82:0/2815484304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56181303e0e0 0x56181303e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:38.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.049+0000 7f81bfdcfb80 1 --2- 172.21.15.82:0/2815484304 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56181303ea00 0x561813042510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:38.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.049+0000 7f81bfdcfb80 1 -- 172.21.15.82:0/2815484304 >> 172.21.15.82:0/2815484304 conn(0x561812f6cbe0 msgr2=0x561813038820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:58:38.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.050+0000 7f81bfdcfb80 1 -- 172.21.15.82:0/2815484304 shutdown_connections 2024-05-08T05:58:38.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.050+0000 7f81bfdcfb80 1 -- 172.21.15.82:0/2815484304 wait complete. 2024-05-08T05:58:38.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.051+0000 7f81bfdcfb80 1 -- start start 2024-05-08T05:58:38.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.051+0000 7f81bfdcfb80 1 Processor -- start 2024-05-08T05:58:38.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.052+0000 7f81bfdcfb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56181303e0e0 0x561813049f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:38.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.053+0000 7f81bfdcfb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56181303ea00 0x5618130472f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:38.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.053+0000 7f81bfdcfb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561813042a50 0x561813047830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:38.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.053+0000 7f81bfdcfb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56181304ac60 con 0x561813042a50 2024-05-08T05:58:38.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.053+0000 7f81bfdcfb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x561812ef6ba0 con 0x56181303ea00 2024-05-08T05:58:38.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.053+0000 7f81bfdcfb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56181304ade0 con 0x56181303e0e0 2024-05-08T05:58:38.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.053+0000 7f81ade00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56181303e0e0 0x561813049f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:38.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.053+0000 7f81ade00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56181303e0e0 0x561813049f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:54032/0 (socket says 172.21.15.82:54032) 2024-05-08T05:58:38.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.053+0000 7f81ade00700 1 -- 172.21.15.82:0/4058815735 learned_addr learned my addr 172.21.15.82:0/4058815735 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:58:38.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.053+0000 7f81ae800700 1 --2- 172.21.15.82:0/4058815735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56181303ea00 0x5618130472f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:38.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.053+0000 7f81ade00700 1 --2- 172.21.15.82:0/4058815735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561813042a50 0x561813047830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:38.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.054+0000 7f81bfdcfb80 10 client.0 _ll_register_callbacks cb 0x561812f37cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:58:38.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.054+0000 7f81ade00700 1 -- 172.21.15.82:0/4058815735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56181303ea00 msgr2=0x5618130472f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:38.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.054+0000 7f81ade00700 1 --2- 172.21.15.82:0/4058815735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56181303ea00 0x5618130472f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:38.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.054+0000 7f81ade00700 1 -- 172.21.15.82:0/4058815735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561813042a50 msgr2=0x561813047830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:38.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.054+0000 7f81ade00700 1 --2- 172.21.15.82:0/4058815735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561813042a50 0x561813047830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:38.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.054+0000 7f81ade00700 1 -- 172.21.15.82:0/4058815735 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561812f564a0 con 0x56181303e0e0 2024-05-08T05:58:38.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.054+0000 7f81ade00700 1 --2- 172.21.15.82:0/4058815735 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56181303e0e0 0x561813049f50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f819c011410 tx=0x7f819c00f420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57ed49ae574cf8bb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:58:38.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.054+0000 7f8198c00700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:58:38.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.054+0000 7f8198c00700 1 -- 172.21.15.82:0/4058815735 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f819c00e7d0 con 0x56181303e0e0 2024-05-08T05:58:38.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.055+0000 7f81bfdcfb80 1 -- 172.21.15.82:0/4058815735 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f819c00ea70 con 0x56181303e0e0 2024-05-08T05:58:38.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.055+0000 7f8198c00700 1 -- 172.21.15.82:0/4058815735 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f819c027040 con 0x56181303e0e0 2024-05-08T05:58:38.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.055+0000 7f8198c00700 1 -- 172.21.15.82:0/4058815735 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f819c00f4c0 con 0x56181303e0e0 2024-05-08T05:58:38.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.055+0000 7f81bfdcfb80 10 client.26104 fetch_fsmap learned FSMap version 31 2024-05-08T05:58:38.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.055+0000 7f81bfdcfb80 1 -- 172.21.15.82:0/4058815735 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x561813055570 con 0x56181303e0e0 2024-05-08T05:58:38.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.056+0000 7f8198c00700 1 -- 172.21.15.82:0/4058815735 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f819c00ea70 con 0x56181303e0e0 2024-05-08T05:58:38.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.056+0000 7f8198c00700 1 -- 172.21.15.82:0/4058815735 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f819c01e480 con 0x56181303e0e0 2024-05-08T05:58:38.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.056+0000 7f81bfdcfb80 10 client.26104 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:58:38.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.056+0000 7f81bfdcfb80 10 client.26104 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:58:38.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.056+0000 7f81bfdcfb80 20 client.26104 populate_metadata read hostname 'smithi082' 2024-05-08T05:58:38.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.056+0000 7f81bfdcfb80 1 --2- 172.21.15.82:0/4058815735 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x561813057a40 0x561813059e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:38.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.056+0000 7f81bfdcfb80 4 client.26104 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:58:38.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.056+0000 7f81bfdcfb80 1 -- 172.21.15.82:0/4058815735 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56181300b120 con 0x561813057a40 2024-05-08T05:58:38.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.058+0000 7f81ae800700 1 --2- 172.21.15.82:0/4058815735 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x561813057a40 0x561813059e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:38.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.061+0000 7f8198c00700 10 client.26104 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:58:38.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.061+0000 7f81ae800700 1 --2- 172.21.15.82:0/4058815735 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x561813057a40 0x561813059e30 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4f811c440cf771f server_cookie=183c9a52847d2ddc in_seq=0 out_seq=0 2024-05-08T05:58:38.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.062+0000 7f8198c00700 1 -- 172.21.15.82:0/4058815735 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56181300b120 con 0x561813057a40 2024-05-08T05:58:38.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.062+0000 7f8198c00700 10 client.26104 handle_command_reply: tid=0 2024-05-08T05:58:38.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.062+0000 7f81bfdcfb80 1 client.26104 shutdown 2024-05-08T05:58:38.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.062+0000 7f81bfdcfb80 1 -- 172.21.15.82:0/4058815735 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56181303e0e0 msgr2=0x561813049f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:38.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.062+0000 7f81bfdcfb80 1 --2- 172.21.15.82:0/4058815735 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56181303e0e0 0x561813049f50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f819c011410 tx=0x7f819c00f420 comp rx=0 tx=0).stop 2024-05-08T05:58:38.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.062+0000 7f81bfdcfb80 1 -- 172.21.15.82:0/4058815735 shutdown_connections 2024-05-08T05:58:38.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.062+0000 7f81bfdcfb80 1 --2- 172.21.15.82:0/4058815735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561813042a50 0x561813047830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:38.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.062+0000 7f81bfdcfb80 1 --2- 172.21.15.82:0/4058815735 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56181303e0e0 0x561813049f50 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:38.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.062+0000 7f81bfdcfb80 1 --2- 172.21.15.82:0/4058815735 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x561813057a40 0x561813059e30 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:38.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.062+0000 7f81bfdcfb80 1 --2- 172.21.15.82:0/4058815735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56181303ea00 0x5618130472f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:38.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.062+0000 7f81bfdcfb80 1 -- 172.21.15.82:0/4058815735 >> 172.21.15.82:0/4058815735 conn(0x561812f6cbe0 msgr2=0x561813033330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:58:38.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.062+0000 7f8198c00700 0 client.26104 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:58:38.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.063+0000 7f81bfdcfb80 1 -- 172.21.15.82:0/4058815735 shutdown_connections 2024-05-08T05:58:38.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.063+0000 7f81bfdcfb80 1 -- 172.21.15.82:0/4058815735 wait complete. 2024-05-08T05:58:38.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.064+0000 7f81bfdcfb80 20 client.26104 trim_cache size 0 max 16384 2024-05-08T05:58:38.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.104+0000 7f81bfdcfb80 1 Processor -- start 2024-05-08T05:58:38.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.104+0000 7f81bfdcfb80 1 -- start start 2024-05-08T05:58:38.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.104+0000 7f81bfdcfb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56181303e0e0 0x561813044f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:38.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.105+0000 7f81bfdcfb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56181303ea00 0x561813053d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:38.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.105+0000 7f81bfdcfb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561813042a50 0x56181303d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:38.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.105+0000 7f81bfdcfb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f819000d340 con 0x56181303ea00 2024-05-08T05:58:38.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.105+0000 7f81bfdcfb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f819000ee80 con 0x56181303e0e0 2024-05-08T05:58:38.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.105+0000 7f81bfdcfb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f819000da10 con 0x561813042a50 2024-05-08T05:58:38.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.105+0000 7f81ade00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56181303e0e0 0x561813044f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:38.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.105+0000 7f81ade00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56181303e0e0 0x561813044f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:39350/0 (socket says 172.21.15.82:39350) 2024-05-08T05:58:38.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.105+0000 7f81ade00700 1 -- 172.21.15.82:0/279394118 learned_addr learned my addr 172.21.15.82:0/279394118 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:58:38.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.105+0000 7f81ae800700 1 --2- 172.21.15.82:0/279394118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56181303ea00 0x561813053d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:38.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.106+0000 7f81ade00700 1 --2- 172.21.15.82:0/279394118 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561813042a50 0x56181303d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:38.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.106+0000 7f81ade00700 1 -- 172.21.15.82:0/279394118 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561813042a50 msgr2=0x56181303d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:38.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.106+0000 7f81ade00700 1 --2- 172.21.15.82:0/279394118 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561813042a50 0x56181303d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:38.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.106+0000 7f81ade00700 1 -- 172.21.15.82:0/279394118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56181303ea00 msgr2=0x561813053d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:38.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.106+0000 7f81ade00700 1 --2- 172.21.15.82:0/279394118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56181303ea00 0x561813053d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:38.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.106+0000 7f81ade00700 1 -- 172.21.15.82:0/279394118 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561813039910 con 0x56181303e0e0 2024-05-08T05:58:38.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.106+0000 7f81ade00700 1 --2- 172.21.15.82:0/279394118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56181303e0e0 0x561813044f70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f819c011750 tx=0x7f819c0116e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c699947e7f650445 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:58:38.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.107+0000 7f819b400700 1 -- 172.21.15.82:0/279394118 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f819c032030 con 0x56181303e0e0 2024-05-08T05:58:38.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.107+0000 7f819b400700 1 -- 172.21.15.82:0/279394118 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f819c015070 con 0x56181303e0e0 2024-05-08T05:58:38.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.107+0000 7f819b400700 1 -- 172.21.15.82:0/279394118 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f819c01e4d0 con 0x56181303e0e0 2024-05-08T05:58:38.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.108+0000 7f81bfdcfb80 1 -- 172.21.15.82:0/279394118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56181303e0e0 msgr2=0x561813044f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:38.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.108+0000 7f81bfdcfb80 1 --2- 172.21.15.82:0/279394118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56181303e0e0 0x561813044f70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f819c011750 tx=0x7f819c0116e0 comp rx=0 tx=0).stop 2024-05-08T05:58:38.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.108+0000 7f81bfdcfb80 1 -- 172.21.15.82:0/279394118 shutdown_connections 2024-05-08T05:58:38.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.108+0000 7f81bfdcfb80 1 --2- 172.21.15.82:0/279394118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56181303e0e0 0x561813044f70 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:38.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.108+0000 7f81bfdcfb80 1 --2- 172.21.15.82:0/279394118 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561813042a50 0x56181303d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:38.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.108+0000 7f81bfdcfb80 1 --2- 172.21.15.82:0/279394118 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56181303ea00 0x561813053d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:38.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.108+0000 7f81bfdcfb80 1 -- 172.21.15.82:0/279394118 >> 172.21.15.82:0/279394118 conn(0x561812f6cbe0 msgr2=0x56181303cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:58:38.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.109+0000 7f81bfdcfb80 1 -- 172.21.15.82:0/279394118 shutdown_connections 2024-05-08T05:58:38.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.109+0000 7f81bfdcfb80 1 -- 172.21.15.82:0/279394118 wait complete. 2024-05-08T05:58:38.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.109+0000 7f81bfdcfb80 1 -- start start 2024-05-08T05:58:38.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.110+0000 7f81bfdcfb80 1 Processor -- start 2024-05-08T05:58:38.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.110+0000 7f81bfdcfb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56181303e0e0 0x56181304b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:38.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.110+0000 7f81bfdcfb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56181303ea00 0x56181304b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:38.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.110+0000 7f81bfdcfb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561813042a50 0x56181304bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:38.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.110+0000 7f81bfdcfb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f819000e7b0 con 0x56181303ea00 2024-05-08T05:58:38.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.110+0000 7f81bfdcfb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f819000e0e0 con 0x561813042a50 2024-05-08T05:58:38.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.110+0000 7f81bfdcfb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f819000b2e0 con 0x56181303e0e0 2024-05-08T05:58:38.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.111+0000 7f81bfdcfb80 10 client.0 _ll_register_callbacks cb 0x561812f37cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:58:38.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.111+0000 7f81ae800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56181303ea00 0x56181304b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:38.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.111+0000 7f81ae800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56181303ea00 0x56181304b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38090/0 (socket says 172.21.15.82:38090) 2024-05-08T05:58:38.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.111+0000 7f81ae800700 1 -- 172.21.15.82:0/2232473510 learned_addr learned my addr 172.21.15.82:0/2232473510 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:58:38.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.111+0000 7f81ade00700 1 --2- 172.21.15.82:0/2232473510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561813042a50 0x56181304bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:38.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.112+0000 7f81ae800700 1 -- 172.21.15.82:0/2232473510 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56181303e0e0 msgr2=0x56181304b0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T05:58:38.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.112+0000 7f81ade00700 1 --2- 172.21.15.82:0/2232473510 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56181303e0e0 0x56181304b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:38.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.112+0000 7f81ae800700 1 --2- 172.21.15.82:0/2232473510 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56181303e0e0 0x56181304b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:38.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.112+0000 7f81ae800700 1 -- 172.21.15.82:0/2232473510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561813042a50 msgr2=0x56181304bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:38.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.112+0000 7f81ae800700 1 --2- 172.21.15.82:0/2232473510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561813042a50 0x56181304bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:38.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.112+0000 7f81ae800700 1 -- 172.21.15.82:0/2232473510 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5618130d3260 con 0x56181303ea00 2024-05-08T05:58:38.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.112+0000 7f81ade00700 1 --2- 172.21.15.82:0/2232473510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561813042a50 0x56181304bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:58:38.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.113+0000 7f81ae800700 1 --2- 172.21.15.82:0/2232473510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56181303ea00 0x56181304b600 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x56181305a510 tx=0x7f81a001a510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f7074afa2382cc7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:58:38.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.113+0000 7f8198c00700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T05:58:38.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.113+0000 7f8198c00700 1 -- 172.21.15.82:0/2232473510 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81a0004c40 con 0x56181303ea00 2024-05-08T05:58:38.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.114+0000 7f8198c00700 1 -- 172.21.15.82:0/2232473510 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f81a0004de0 con 0x56181303ea00 2024-05-08T05:58:38.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.114+0000 7f81bfdcfb80 1 -- 172.21.15.82:0/2232473510 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f819c015070 con 0x56181303ea00 2024-05-08T05:58:38.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.115+0000 7f8198c00700 1 -- 172.21.15.82:0/2232473510 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f81a0004020 con 0x56181303ea00 2024-05-08T05:58:38.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.115+0000 7f81bfdcfb80 10 client.15783 fetch_fsmap learned FSMap version 31 2024-05-08T05:58:38.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.115+0000 7f81bfdcfb80 1 -- 172.21.15.82:0/2232473510 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5618130d4600 con 0x56181303ea00 2024-05-08T05:58:38.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.116+0000 7f8198c00700 1 -- 172.21.15.82:0/2232473510 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f81a0005050 con 0x56181303ea00 2024-05-08T05:58:38.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.116+0000 7f8198c00700 1 -- 172.21.15.82:0/2232473510 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f81a00038c0 con 0x56181303ea00 2024-05-08T05:58:38.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.116+0000 7f81bfdcfb80 10 client.15783 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:58:38.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.116+0000 7f81bfdcfb80 10 client.15783 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:58:38.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.116+0000 7f81bfdcfb80 20 client.15783 populate_metadata read hostname 'smithi082' 2024-05-08T05:58:38.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.116+0000 7f81bfdcfb80 1 --2- 172.21.15.82:0/2232473510 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5618130d4c70 0x5618130d7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:38.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.116+0000 7f81bfdcfb80 4 client.15783 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-08T05:58:38.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.116+0000 7f81bfdcfb80 1 -- 172.21.15.82:0/2232473510 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x7f819c015070 con 0x5618130d4c70 2024-05-08T05:58:38.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.117+0000 7f81ade00700 1 --2- 172.21.15.82:0/2232473510 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5618130d4c70 0x5618130d7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:38.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.117+0000 7f8198c00700 10 client.15783 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:58:38.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.118+0000 7f81ade00700 1 --2- 172.21.15.82:0/2232473510 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5618130d4c70 0x5618130d7090 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e821a5aad183e307 server_cookie=6b3cf77f324a937 in_seq=0 out_seq=0 2024-05-08T05:58:38.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.120+0000 7f8198c00700 1 -- 172.21.15.82:0/2232473510 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x7f819c015070 con 0x5618130d4c70 2024-05-08T05:58:38.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.120+0000 7f8198c00700 10 client.15783 handle_command_reply: tid=0 2024-05-08T05:58:38.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.120+0000 7f81bfdcfb80 1 client.15783 shutdown 2024-05-08T05:58:38.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.120+0000 7f81bfdcfb80 1 -- 172.21.15.82:0/2232473510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56181303ea00 msgr2=0x56181304b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:38.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.120+0000 7f81bfdcfb80 1 --2- 172.21.15.82:0/2232473510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56181303ea00 0x56181304b600 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x56181305a510 tx=0x7f81a001a510 comp rx=0 tx=0).stop 2024-05-08T05:58:38.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.123+0000 7f81bfdcfb80 1 -- 172.21.15.82:0/2232473510 shutdown_connections 2024-05-08T05:58:38.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.123+0000 7f81bfdcfb80 1 --2- 172.21.15.82:0/2232473510 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5618130d4c70 0x5618130d7090 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:38.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.123+0000 7f81bfdcfb80 1 --2- 172.21.15.82:0/2232473510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561813042a50 0x56181304bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:38.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.123+0000 7f81bfdcfb80 1 --2- 172.21.15.82:0/2232473510 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56181303e0e0 0x56181304b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:38.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.123+0000 7f81bfdcfb80 1 --2- 172.21.15.82:0/2232473510 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56181303ea00 0x56181304b600 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:38.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.123+0000 7f81bfdcfb80 1 -- 172.21.15.82:0/2232473510 >> 172.21.15.82:0/2232473510 conn(0x561812f6cbe0 msgr2=0x56181303d780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:58:38.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.123+0000 7f8198c00700 0 client.15783 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:58:38.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.124+0000 7f81bfdcfb80 1 -- 172.21.15.82:0/2232473510 shutdown_connections 2024-05-08T05:58:38.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.124+0000 7f81bfdcfb80 1 -- 172.21.15.82:0/2232473510 wait complete. 2024-05-08T05:58:38.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.124+0000 7f81bfdcfb80 20 client.15783 trim_cache size 0 max 16384 2024-05-08T05:58:38.126 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T05:58:38.126 INFO:teuthology.orchestra.run.smithi082.stdout: "return_code": 0, 2024-05-08T05:58:38.126 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_tag": "f9403793-4a6c-4bd1-a15f-ddd5334b3985", 2024-05-08T05:58:38.126 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": "asynchronous" 2024-05-08T05:58:38.126 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T05:58:38.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.125+0000 7f81b5400700 1 -- 172.21.15.82:0/2799794289 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f81940b2a10 msgr2=0x7f81940b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:38.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.125+0000 7f81b5400700 1 --2- 172.21.15.82:0/2799794289 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f81940b2a10 0x7f81940b4ed0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f81a8009a20 tx=0x7f81a8009040 comp rx=0 tx=0).stop 2024-05-08T05:58:38.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.125+0000 7f81b5400700 1 -- 172.21.15.82:0/2799794289 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81b0108410 msgr2=0x7f81b01a48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:38.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.125+0000 7f81b5400700 1 --2- 172.21.15.82:0/2799794289 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81b0108410 0x7f81b01a48f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f81a8006070 tx=0x7f81a8009700 comp rx=0 tx=0).stop 2024-05-08T05:58:38.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.126+0000 7f81b5400700 1 -- 172.21.15.82:0/2799794289 shutdown_connections 2024-05-08T05:58:38.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.126+0000 7f81b5400700 1 --2- 172.21.15.82:0/2799794289 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81b0108410 0x7f81b01a48f0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:38.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.126+0000 7f81b5400700 1 --2- 172.21.15.82:0/2799794289 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f81940b2a10 0x7f81940b4ed0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:38.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.126+0000 7f81b5400700 1 --2- 172.21.15.82:0/2799794289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f81b01023a0 0x7f81b01a0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:38.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.126+0000 7f81b5400700 1 --2- 172.21.15.82:0/2799794289 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81b0102d60 0x7f81b01a0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:38.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.126+0000 7f81b5400700 1 -- 172.21.15.82:0/2799794289 >> 172.21.15.82:0/2799794289 conn(0x7f81b0079350 msgr2=0x7f81b006b1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:58:38.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.127+0000 7f81b5400700 1 -- 172.21.15.82:0/2799794289 shutdown_connections 2024-05-08T05:58:38.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:38.127+0000 7f81b5400700 1 -- 172.21.15.82:0/2799794289 wait complete. 2024-05-08T05:58:38.831 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:58:38 smithi082 ceph-mon[30098]: scrub queued for path: / 2024-05-08T05:58:38.831 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:58:38 smithi082 ceph-mon[30098]: scrub summary: idle+waiting paths [/] 2024-05-08T05:58:38.831 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:58:38 smithi082 ceph-mon[30098]: scrub summary: active paths [/] 2024-05-08T05:58:38.831 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:58:38 smithi082 ceph-mon[30098]: scrub summary: active paths [/] 2024-05-08T05:58:38.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:58:38 smithi151 ceph-mon[34815]: scrub queued for path: / 2024-05-08T05:58:38.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:58:38 smithi151 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-05-08T05:58:38.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:58:38 smithi151 ceph-mon[34815]: scrub summary: active paths [/] 2024-05-08T05:58:38.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:58:38 smithi151 ceph-mon[34815]: scrub summary: active paths [/] 2024-05-08T05:58:39.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:58:38 smithi134 ceph-mon[34132]: scrub queued for path: / 2024-05-08T05:58:39.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:58:38 smithi134 ceph-mon[34132]: scrub summary: idle+waiting paths [/] 2024-05-08T05:58:39.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:58:38 smithi134 ceph-mon[34132]: scrub summary: active paths [/] 2024-05-08T05:58:39.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:58:38 smithi134 ceph-mon[34132]: scrub summary: active paths [/] 2024-05-08T05:58:39.319 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-08T05:58:39.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:58:39 smithi151 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-05-08T05:58:39.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:58:39 smithi151 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-05-08T05:58:39.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:58:39 smithi151 ceph-mon[34815]: pgmap v699: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 12 MiB/s wr, 601 op/s 2024-05-08T05:58:39.969 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:58:39 smithi082 ceph-mon[30098]: scrub summary: idle+waiting paths [/] 2024-05-08T05:58:39.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:58:39 smithi082 ceph-mon[30098]: scrub summary: idle+waiting paths [/] 2024-05-08T05:58:39.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:58:39 smithi082 ceph-mon[30098]: pgmap v699: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 12 MiB/s wr, 601 op/s 2024-05-08T05:58:39.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:58:39 smithi134 ceph-mon[34132]: scrub summary: idle+waiting paths [/] 2024-05-08T05:58:40.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:58:39 smithi134 ceph-mon[34132]: scrub summary: idle+waiting paths [/] 2024-05-08T05:58:40.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:58:39 smithi134 ceph-mon[34132]: pgmap v699: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 12 MiB/s wr, 601 op/s 2024-05-08T05:58:40.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 470.0 s, 1556.0 tps, lat 64.346 ms stddev 80.516 2024-05-08T05:58:40.373 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:58:42.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:58:42 smithi151 ceph-mon[34815]: pgmap v700: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 MiB/s wr, 732 op/s 2024-05-08T05:58:42.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:58:42 smithi082 ceph-mon[30098]: pgmap v700: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 MiB/s wr, 732 op/s 2024-05-08T05:58:42.499 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:58:42 smithi134 ceph-mon[34132]: pgmap v700: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 MiB/s wr, 732 op/s 2024-05-08T05:58:43.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.772+0000 7fb450800700 1 -- 172.21.15.82:0/4218080381 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4481083d0 msgr2=0x7fb44806b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:43.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.772+0000 7fb450800700 1 --2- 172.21.15.82:0/4218080381 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4481083d0 0x7fb44806b1b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb444009f90 tx=0x7fb44400b330 comp rx=0 tx=0).stop 2024-05-08T05:58:43.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.772+0000 7fb450800700 1 -- 172.21.15.82:0/4218080381 shutdown_connections 2024-05-08T05:58:43.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.772+0000 7fb450800700 1 --2- 172.21.15.82:0/4218080381 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4481083d0 0x7fb44806b1b0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:43.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.772+0000 7fb450800700 1 --2- 172.21.15.82:0/4218080381 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb448105ee0 0x7fb448106370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:43.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.772+0000 7fb450800700 1 --2- 172.21.15.82:0/4218080381 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb44806b6f0 0x7fb44806bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:43.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.772+0000 7fb450800700 1 -- 172.21.15.82:0/4218080381 >> 172.21.15.82:0/4218080381 conn(0x7fb448079350 msgr2=0x7fb448079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:58:43.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.772+0000 7fb450800700 1 -- 172.21.15.82:0/4218080381 shutdown_connections 2024-05-08T05:58:43.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.772+0000 7fb450800700 1 -- 172.21.15.82:0/4218080381 wait complete. 2024-05-08T05:58:43.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.774+0000 7fb450800700 1 Processor -- start 2024-05-08T05:58:43.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.774+0000 7fb450800700 1 -- start start 2024-05-08T05:58:43.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.774+0000 7fb450800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb44806b6f0 0x7fb4481a0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:43.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.774+0000 7fb450800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb448105ee0 0x7fb4481a06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:43.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.774+0000 7fb450800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4481083d0 0x7fb4481a4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:43.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.774+0000 7fb450800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb448119c60 con 0x7fb44806b6f0 2024-05-08T05:58:43.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.774+0000 7fb450800700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb448119ae0 con 0x7fb448105ee0 2024-05-08T05:58:43.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.774+0000 7fb450800700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb448119de0 con 0x7fb4481083d0 2024-05-08T05:58:43.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.775+0000 7fb44d400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb448105ee0 0x7fb4481a06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:43.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.775+0000 7fb44d400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb448105ee0 0x7fb4481a06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:56564/0 (socket says 172.21.15.82:56564) 2024-05-08T05:58:43.776 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.775+0000 7fb44d400700 1 -- 172.21.15.82:0/3814643157 learned_addr learned my addr 172.21.15.82:0/3814643157 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:58:43.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.775+0000 7fb44e800700 1 --2- 172.21.15.82:0/3814643157 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4481083d0 0x7fb4481a4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:43.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.775+0000 7fb44de00700 1 --2- 172.21.15.82:0/3814643157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb44806b6f0 0x7fb4481a0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:43.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.775+0000 7fb44d400700 1 -- 172.21.15.82:0/3814643157 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4481083d0 msgr2=0x7fb4481a4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:43.777 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.775+0000 7fb44d400700 1 --2- 172.21.15.82:0/3814643157 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4481083d0 0x7fb4481a4a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:43.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.775+0000 7fb44d400700 1 -- 172.21.15.82:0/3814643157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb44806b6f0 msgr2=0x7fb4481a0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:43.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.775+0000 7fb44d400700 1 --2- 172.21.15.82:0/3814643157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb44806b6f0 0x7fb4481a0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:43.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.775+0000 7fb44d400700 1 -- 172.21.15.82:0/3814643157 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4481a51a0 con 0x7fb448105ee0 2024-05-08T05:58:43.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.775+0000 7fb44e800700 1 --2- 172.21.15.82:0/3814643157 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4481083d0 0x7fb4481a4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:58:43.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.775+0000 7fb44de00700 1 --2- 172.21.15.82:0/3814643157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb44806b6f0 0x7fb4481a0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:58:43.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.776+0000 7fb44d400700 1 --2- 172.21.15.82:0/3814643157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb448105ee0 0x7fb4481a06d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb43800d980 tx=0x7fb43800dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:58:43.778 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.776+0000 7fb442a00700 1 -- 172.21.15.82:0/3814643157 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb438016070 con 0x7fb448105ee0 2024-05-08T05:58:43.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.776+0000 7fb450800700 1 -- 172.21.15.82:0/3814643157 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4481a5490 con 0x7fb448105ee0 2024-05-08T05:58:43.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.776+0000 7fb442a00700 1 -- 172.21.15.82:0/3814643157 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb438004830 con 0x7fb448105ee0 2024-05-08T05:58:43.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.776+0000 7fb442a00700 1 -- 172.21.15.82:0/3814643157 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4380054c0 con 0x7fb448105ee0 2024-05-08T05:58:43.779 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.776+0000 7fb450800700 1 -- 172.21.15.82:0/3814643157 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4481acd10 con 0x7fb448105ee0 2024-05-08T05:58:43.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.784+0000 7fb45b0ffb80 1 Processor -- start 2024-05-08T05:58:43.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.784+0000 7fb45b0ffb80 1 -- start start 2024-05-08T05:58:43.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.784+0000 7fb442a00700 1 -- 172.21.15.82:0/3814643157 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fb438004220 con 0x7fb448105ee0 2024-05-08T05:58:43.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.785+0000 7fb45b0ffb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561798c82060 0x561798c82440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:43.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.785+0000 7fb45b0ffb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561798c82980 0x561798c86490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:43.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.785+0000 7fb45b0ffb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561798c869d0 0x561798c86e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:43.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.785+0000 7fb45b0ffb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x561798bd4a20 con 0x561798c82060 2024-05-08T05:58:43.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.785+0000 7fb45b0ffb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x561798b72760 con 0x561798c82980 2024-05-08T05:58:43.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.785+0000 7fb45b0ffb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x561798bd09e0 con 0x561798c869d0 2024-05-08T05:58:43.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.786+0000 7fb44d400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561798c869d0 0x561798c86e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:43.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.786+0000 7fb44d400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561798c869d0 0x561798c86e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:57686/0 (socket says 172.21.15.82:57686) 2024-05-08T05:58:43.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.786+0000 7fb44d400700 1 -- 172.21.15.82:0/301555549 learned_addr learned my addr 172.21.15.82:0/301555549 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:58:43.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.787+0000 7fb44d400700 1 -- 172.21.15.82:0/301555549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561798c82980 msgr2=0x561798c86490 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T05:58:43.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.787+0000 7fb44e800700 1 --2- 172.21.15.82:0/301555549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561798c82060 0x561798c82440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:43.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.787+0000 7fb442a00700 1 --2- 172.21.15.82:0/3814643157 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb4300b2980 0x7fb4300b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:43.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.787+0000 7fb44de00700 1 --2- 172.21.15.82:0/301555549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561798c82980 0x561798c86490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:43.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.787+0000 7fb442a00700 1 -- 172.21.15.82:0/3814643157 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb4380e1640 con 0x7fb448105ee0 2024-05-08T05:58:43.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.788+0000 7fb44d400700 1 --2- 172.21.15.82:0/301555549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561798c82980 0x561798c86490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:43.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.788+0000 7fb44d400700 1 -- 172.21.15.82:0/301555549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561798c82060 msgr2=0x561798c82440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:43.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.788+0000 7fb44d400700 1 --2- 172.21.15.82:0/301555549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561798c82060 0x561798c82440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:43.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.788+0000 7fb44d400700 1 -- 172.21.15.82:0/301555549 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561798b218d0 con 0x561798c869d0 2024-05-08T05:58:43.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.788+0000 7fb44de00700 1 --2- 172.21.15.82:0/301555549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561798c82980 0x561798c86490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:58:43.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.788+0000 7fb44d400700 1 --2- 172.21.15.82:0/301555549 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561798c869d0 0x561798c86e30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb4380a8ba0 tx=0x7fb438004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccebbb17dce6499 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:58:43.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.789+0000 7fb44e800700 1 --2- 172.21.15.82:0/3814643157 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb4300b2980 0x7fb4300b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:43.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.789+0000 7fb437400700 1 -- 172.21.15.82:0/301555549 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4380a89e0 con 0x561798c869d0 2024-05-08T05:58:43.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.789+0000 7fb437400700 1 -- 172.21.15.82:0/301555549 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb438090030 con 0x561798c869d0 2024-05-08T05:58:43.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.789+0000 7fb437400700 1 -- 172.21.15.82:0/301555549 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4380a89e0 con 0x561798c869d0 2024-05-08T05:58:43.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.790+0000 7fb44e800700 1 --2- 172.21.15.82:0/3814643157 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb4300b2980 0x7fb4300b4e40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb43c005950 tx=0x7fb43c004750 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:58:43.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.790+0000 7fb45b0ffb80 1 -- 172.21.15.82:0/301555549 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561798c869d0 msgr2=0x561798c86e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:43.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.790+0000 7fb45b0ffb80 1 --2- 172.21.15.82:0/301555549 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561798c869d0 0x561798c86e30 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb4380a8ba0 tx=0x7fb438004750 comp rx=0 tx=0).stop 2024-05-08T05:58:43.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.792+0000 7fb45b0ffb80 1 -- 172.21.15.82:0/301555549 shutdown_connections 2024-05-08T05:58:43.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.792+0000 7fb45b0ffb80 1 --2- 172.21.15.82:0/301555549 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561798c869d0 0x561798c86e30 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:43.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.792+0000 7fb45b0ffb80 1 --2- 172.21.15.82:0/301555549 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561798c82060 0x561798c82440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:43.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.792+0000 7fb45b0ffb80 1 --2- 172.21.15.82:0/301555549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561798c82980 0x561798c86490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:43.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.792+0000 7fb45b0ffb80 1 -- 172.21.15.82:0/301555549 >> 172.21.15.82:0/301555549 conn(0x561798bb0b60 msgr2=0x561798c7c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:58:43.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.792+0000 7fb45b0ffb80 1 -- 172.21.15.82:0/301555549 shutdown_connections 2024-05-08T05:58:43.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.793+0000 7fb45b0ffb80 1 -- 172.21.15.82:0/301555549 wait complete. 2024-05-08T05:58:43.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.793+0000 7fb45b0ffb80 1 -- start start 2024-05-08T05:58:43.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.793+0000 7fb45b0ffb80 1 Processor -- start 2024-05-08T05:58:43.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.794+0000 7fb45b0ffb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561798c82060 0x561798c8dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:43.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.794+0000 7fb45b0ffb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561798c82980 0x561798c8b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:43.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.794+0000 7fb45b0ffb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561798c869d0 0x561798c8b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:43.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.794+0000 7fb45b0ffb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x561798c8eb80 con 0x561798c82980 2024-05-08T05:58:43.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.794+0000 7fb45b0ffb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x561798b3ab20 con 0x561798c82060 2024-05-08T05:58:43.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.794+0000 7fb45b0ffb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x561798c8ed00 con 0x561798c869d0 2024-05-08T05:58:43.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.794+0000 7fb45b0ffb80 10 client.0 _ll_register_callbacks cb 0x561798b7bc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:58:43.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.795+0000 7fb44e800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561798c869d0 0x561798c8b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:43.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.795+0000 7fb44de00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561798c82060 0x561798c8dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:43.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.795+0000 7fb44e800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561798c869d0 0x561798c8b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:57700/0 (socket says 172.21.15.82:57700) 2024-05-08T05:58:43.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.795+0000 7fb44e800700 1 -- 172.21.15.82:0/2541269063 learned_addr learned my addr 172.21.15.82:0/2541269063 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:58:43.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.795+0000 7fb44de00700 1 -- 172.21.15.82:0/2541269063 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561798c869d0 msgr2=0x561798c8b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:43.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.795+0000 7fb44de00700 1 --2- 172.21.15.82:0/2541269063 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561798c869d0 0x561798c8b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:43.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.795+0000 7fb44de00700 1 -- 172.21.15.82:0/2541269063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561798c82980 msgr2=0x561798c8b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:43.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.795+0000 7fb44de00700 1 --2- 172.21.15.82:0/2541269063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561798c82980 0x561798c8b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:43.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.795+0000 7fb44de00700 1 -- 172.21.15.82:0/2541269063 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561798b9a420 con 0x561798c82060 2024-05-08T05:58:43.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.796+0000 7fb44e800700 1 --2- 172.21.15.82:0/2541269063 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561798c869d0 0x561798c8b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:58:43.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.796+0000 7fb44de00700 1 --2- 172.21.15.82:0/2541269063 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561798c82060 0x561798c8dee0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb44400b770 tx=0x7fb44400bcd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ee1bed671e9d23 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:58:43.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.796+0000 7fb42be00700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:58:43.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.797+0000 7fb42be00700 1 -- 172.21.15.82:0/2541269063 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb444020030 con 0x561798c82060 2024-05-08T05:58:43.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.798+0000 7fb42be00700 1 -- 172.21.15.82:0/2541269063 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb444004c60 con 0x561798c82060 2024-05-08T05:58:43.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.798+0000 7fb45b0ffb80 1 -- 172.21.15.82:0/2541269063 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb438090030 con 0x561798c82060 2024-05-08T05:58:43.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.798+0000 7fb42be00700 1 -- 172.21.15.82:0/2541269063 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fb444004e60 con 0x561798c82060 2024-05-08T05:58:43.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.798+0000 7fb45b0ffb80 10 client.26087 fetch_fsmap learned FSMap version 31 2024-05-08T05:58:43.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.798+0000 7fb45b0ffb80 1 -- 172.21.15.82:0/2541269063 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x561798c991e0 con 0x561798c82060 2024-05-08T05:58:43.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.799+0000 7fb42be00700 1 -- 172.21.15.82:0/2541269063 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb438090030 con 0x561798c82060 2024-05-08T05:58:43.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.799+0000 7fb42be00700 1 -- 172.21.15.82:0/2541269063 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fb444011070 con 0x561798c82060 2024-05-08T05:58:43.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.799+0000 7fb45b0ffb80 10 client.26087 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:58:43.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.799+0000 7fb45b0ffb80 10 client.26087 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:58:43.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.799+0000 7fb45b0ffb80 20 client.26087 populate_metadata read hostname 'smithi082' 2024-05-08T05:58:43.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.799+0000 7fb45b0ffb80 1 --2- 172.21.15.82:0/2541269063 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x561798c9b870 0x561798c9dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:43.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.799+0000 7fb45b0ffb80 4 client.26087 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:58:43.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.799+0000 7fb45b0ffb80 1 -- 172.21.15.82:0/2541269063 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561798c4f0a0 con 0x561798c9b870 2024-05-08T05:58:43.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.800+0000 7fb44d400700 1 --2- 172.21.15.82:0/2541269063 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x561798c9b870 0x561798c9dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:43.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.800+0000 7fb44d400700 1 --2- 172.21.15.82:0/2541269063 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x561798c9b870 0x561798c9dca0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7441f7bd5d15d9d server_cookie=203ccde06ef15e4 in_seq=0 out_seq=0 2024-05-08T05:58:43.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.800+0000 7fb42be00700 10 client.26087 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:58:43.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.801+0000 7fb42be00700 1 -- 172.21.15.82:0/2541269063 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x561798c4f0a0 con 0x561798c9b870 2024-05-08T05:58:43.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.801+0000 7fb42be00700 10 client.26087 handle_command_reply: tid=0 2024-05-08T05:58:43.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.801+0000 7fb45b0ffb80 1 client.26087 shutdown 2024-05-08T05:58:43.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.802+0000 7fb45b0ffb80 1 -- 172.21.15.82:0/2541269063 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561798c82060 msgr2=0x561798c8dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:43.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.802+0000 7fb45b0ffb80 1 --2- 172.21.15.82:0/2541269063 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561798c82060 0x561798c8dee0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb44400b770 tx=0x7fb44400bcd0 comp rx=0 tx=0).stop 2024-05-08T05:58:43.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.802+0000 7fb45b0ffb80 1 -- 172.21.15.82:0/2541269063 shutdown_connections 2024-05-08T05:58:43.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.802+0000 7fb45b0ffb80 1 --2- 172.21.15.82:0/2541269063 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x561798c9b870 0x561798c9dca0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:43.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.802+0000 7fb42be00700 0 client.26087 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:58:43.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.802+0000 7fb45b0ffb80 1 --2- 172.21.15.82:0/2541269063 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561798c82060 0x561798c8dee0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:43.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.802+0000 7fb45b0ffb80 1 --2- 172.21.15.82:0/2541269063 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561798c869d0 0x561798c8b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:43.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.802+0000 7fb45b0ffb80 1 --2- 172.21.15.82:0/2541269063 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561798c82980 0x561798c8b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:43.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.802+0000 7fb45b0ffb80 1 -- 172.21.15.82:0/2541269063 >> 172.21.15.82:0/2541269063 conn(0x561798bb0b60 msgr2=0x561798c772b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:58:43.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.803+0000 7fb45b0ffb80 1 -- 172.21.15.82:0/2541269063 shutdown_connections 2024-05-08T05:58:43.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.803+0000 7fb45b0ffb80 1 -- 172.21.15.82:0/2541269063 wait complete. 2024-05-08T05:58:43.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.803+0000 7fb45b0ffb80 20 client.26087 trim_cache size 0 max 16384 2024-05-08T05:58:43.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.841+0000 7fb45b0ffb80 1 Processor -- start 2024-05-08T05:58:43.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.841+0000 7fb45b0ffb80 1 -- start start 2024-05-08T05:58:43.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.842+0000 7fb45b0ffb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561798c82060 0x561798c97c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:43.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.842+0000 7fb45b0ffb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561798c82980 0x561798c77130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:43.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.842+0000 7fb45b0ffb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561798c869d0 0x561798c88480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:43.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.842+0000 7fb45b0ffb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb4481b41a0 con 0x561798c82060 2024-05-08T05:58:43.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.842+0000 7fb45b0ffb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb4481b5ce0 con 0x561798c82980 2024-05-08T05:58:43.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.842+0000 7fb45b0ffb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb4481b4870 con 0x561798c869d0 2024-05-08T05:58:43.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.843+0000 7fb44d400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561798c82980 0x561798c77130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:43.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.845+0000 7fb44e800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561798c869d0 0x561798c88480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:43.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.845+0000 7fb44e800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561798c869d0 0x561798c88480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:57716/0 (socket says 172.21.15.82:57716) 2024-05-08T05:58:43.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.845+0000 7fb44e800700 1 -- 172.21.15.82:0/3385147135 learned_addr learned my addr 172.21.15.82:0/3385147135 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:58:43.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.845+0000 7fb44e800700 1 -- 172.21.15.82:0/3385147135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561798c82980 msgr2=0x561798c77130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:43.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.845+0000 7fb44e800700 1 --2- 172.21.15.82:0/3385147135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561798c82980 0x561798c77130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:43.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.845+0000 7fb44e800700 1 -- 172.21.15.82:0/3385147135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561798c82060 msgr2=0x561798c97c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:43.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.845+0000 7fb44e800700 1 --2- 172.21.15.82:0/3385147135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561798c82060 0x561798c97c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:43.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.845+0000 7fb44e800700 1 -- 172.21.15.82:0/3385147135 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561798c9e320 con 0x561798c869d0 2024-05-08T05:58:43.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.846+0000 7fb44e800700 1 --2- 172.21.15.82:0/3385147135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561798c869d0 0x561798c88480 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb43c003ec0 tx=0x7fb43c014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3ed22bb83520d092 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:58:43.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.848+0000 7fb436a00700 1 -- 172.21.15.82:0/3385147135 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb43c011be0 con 0x561798c869d0 2024-05-08T05:58:43.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.850+0000 7fb436a00700 1 -- 172.21.15.82:0/3385147135 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb43c011d80 con 0x561798c869d0 2024-05-08T05:58:43.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.850+0000 7fb436a00700 1 -- 172.21.15.82:0/3385147135 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb43c01a670 con 0x561798c869d0 2024-05-08T05:58:43.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.851+0000 7fb45b0ffb80 1 -- 172.21.15.82:0/3385147135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561798c869d0 msgr2=0x561798c88480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:43.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.851+0000 7fb45b0ffb80 1 --2- 172.21.15.82:0/3385147135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561798c869d0 0x561798c88480 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb43c003ec0 tx=0x7fb43c014000 comp rx=0 tx=0).stop 2024-05-08T05:58:43.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.851+0000 7fb45b0ffb80 1 -- 172.21.15.82:0/3385147135 shutdown_connections 2024-05-08T05:58:43.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.851+0000 7fb45b0ffb80 1 --2- 172.21.15.82:0/3385147135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561798c869d0 0x561798c88480 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:43.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.851+0000 7fb45b0ffb80 1 --2- 172.21.15.82:0/3385147135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561798c82060 0x561798c97c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:43.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.851+0000 7fb45b0ffb80 1 --2- 172.21.15.82:0/3385147135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561798c82980 0x561798c77130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:43.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.851+0000 7fb45b0ffb80 1 -- 172.21.15.82:0/3385147135 >> 172.21.15.82:0/3385147135 conn(0x561798bb0b60 msgr2=0x561798c76a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:58:43.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.851+0000 7fb45b0ffb80 1 -- 172.21.15.82:0/3385147135 shutdown_connections 2024-05-08T05:58:43.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.851+0000 7fb45b0ffb80 1 -- 172.21.15.82:0/3385147135 wait complete. 2024-05-08T05:58:43.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.852+0000 7fb45b0ffb80 1 -- start start 2024-05-08T05:58:43.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.852+0000 7fb45b0ffb80 1 Processor -- start 2024-05-08T05:58:43.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.853+0000 7fb45b0ffb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561798c82060 0x561798c93f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:43.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.853+0000 7fb45b0ffb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561798c82980 0x561798c944d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:43.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.853+0000 7fb45b0ffb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561798c869d0 0x561798c90f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:43.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.853+0000 7fb45b0ffb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb4481b5610 con 0x561798c82980 2024-05-08T05:58:43.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.853+0000 7fb45b0ffb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb4481b4f40 con 0x561798c82060 2024-05-08T05:58:43.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.853+0000 7fb45b0ffb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb4481b2140 con 0x561798c869d0 2024-05-08T05:58:43.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.853+0000 7fb45b0ffb80 10 client.0 _ll_register_callbacks cb 0x561798b7bc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:58:43.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.853+0000 7fb44de00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561798c82060 0x561798c93f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:43.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.854+0000 7fb44de00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561798c82060 0x561798c93f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:56594/0 (socket says 172.21.15.82:56594) 2024-05-08T05:58:43.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.854+0000 7fb44de00700 1 -- 172.21.15.82:0/2331387089 learned_addr learned my addr 172.21.15.82:0/2331387089 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:58:43.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.854+0000 7fb44e800700 1 --2- 172.21.15.82:0/2331387089 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561798c869d0 0x561798c90f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:43.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.854+0000 7fb44de00700 1 -- 172.21.15.82:0/2331387089 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561798c869d0 msgr2=0x561798c90f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:43.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.854+0000 7fb44de00700 1 --2- 172.21.15.82:0/2331387089 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561798c869d0 0x561798c90f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:43.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.854+0000 7fb44de00700 1 -- 172.21.15.82:0/2331387089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561798c82980 msgr2=0x561798c944d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:58:43.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.854+0000 7fb44de00700 1 --2- 172.21.15.82:0/2331387089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561798c82980 0x561798c944d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:43.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.854+0000 7fb44de00700 1 -- 172.21.15.82:0/2331387089 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561798c914a0 con 0x561798c82060 2024-05-08T05:58:43.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.855+0000 7fb44de00700 1 --2- 172.21.15.82:0/2331387089 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561798c82060 0x561798c93f90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb444002230 tx=0x7fb444004d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4efdfe0a4e6c2629 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:58:43.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.855+0000 7fb42be00700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:58:43.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.856+0000 7fb42be00700 1 -- 172.21.15.82:0/2331387089 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb444020070 con 0x561798c82060 2024-05-08T05:58:43.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.856+0000 7fb42be00700 1 -- 172.21.15.82:0/2331387089 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb44400f020 con 0x561798c82060 2024-05-08T05:58:43.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.856+0000 7fb45b0ffb80 1 -- 172.21.15.82:0/2331387089 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb43c011d80 con 0x561798c82060 2024-05-08T05:58:43.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.858+0000 7fb42be00700 1 -- 172.21.15.82:0/2331387089 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fb444020070 con 0x561798c82060 2024-05-08T05:58:43.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.858+0000 7fb45b0ffb80 10 client.26090 fetch_fsmap learned FSMap version 31 2024-05-08T05:58:43.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.858+0000 7fb45b0ffb80 1 -- 172.21.15.82:0/2331387089 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x561798d06920 con 0x561798c82060 2024-05-08T05:58:43.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.862+0000 7fb42be00700 1 -- 172.21.15.82:0/2331387089 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb444007890 con 0x561798c82060 2024-05-08T05:58:43.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.862+0000 7fb42be00700 1 -- 172.21.15.82:0/2331387089 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fb444011040 con 0x561798c82060 2024-05-08T05:58:43.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.862+0000 7fb45b0ffb80 10 client.26090 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:58:43.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.862+0000 7fb45b0ffb80 10 client.26090 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:58:43.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.862+0000 7fb45b0ffb80 20 client.26090 populate_metadata read hostname 'smithi082' 2024-05-08T05:58:43.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.862+0000 7fb45b0ffb80 1 --2- 172.21.15.82:0/2331387089 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x561798d07080 0x561798d094a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:58:43.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.863+0000 7fb45b0ffb80 4 client.26090 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-08T05:58:43.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.863+0000 7fb45b0ffb80 1 -- 172.21.15.82:0/2331387089 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fb43c011d80 con 0x561798d07080 2024-05-08T05:58:43.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.863+0000 7fb44d400700 1 --2- 172.21.15.82:0/2331387089 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x561798d07080 0x561798d094a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:58:43.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.864+0000 7fb44d400700 1 --2- 172.21.15.82:0/2331387089 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x561798d07080 0x561798d094a0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e521fb269f633e9 server_cookie=e77164616d28a839 in_seq=0 out_seq=0 2024-05-08T05:58:43.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.864+0000 7fb42be00700 10 client.26090 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:58:43.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.864+0000 7fb42be00700 1 -- 172.21.15.82:0/2331387089 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7fb43c011d80 con 0x561798d07080 2024-05-08T05:58:43.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.864+0000 7fb42be00700 10 client.26090 handle_command_reply: tid=0 2024-05-08T05:58:43.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.864+0000 7fb45b0ffb80 1 client.26090 shutdown 2024-05-08T05:58:43.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.867+0000 7fb45b0ffb80 1 -- 172.21.15.82:0/2331387089 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561798c82060 msgr2=0x561798c93f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:43.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.867+0000 7fb45b0ffb80 1 --2- 172.21.15.82:0/2331387089 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561798c82060 0x561798c93f90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb444002230 tx=0x7fb444004d70 comp rx=0 tx=0).stop 2024-05-08T05:58:43.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.867+0000 7fb45b0ffb80 1 -- 172.21.15.82:0/2331387089 shutdown_connections 2024-05-08T05:58:43.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.867+0000 7fb45b0ffb80 1 --2- 172.21.15.82:0/2331387089 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x561798d07080 0x561798d094a0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:43.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.867+0000 7fb45b0ffb80 1 --2- 172.21.15.82:0/2331387089 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561798c82060 0x561798c93f90 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:43.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.867+0000 7fb45b0ffb80 1 --2- 172.21.15.82:0/2331387089 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561798c869d0 0x561798c90f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:43.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.867+0000 7fb42be00700 0 client.26090 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:58:43.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.867+0000 7fb45b0ffb80 1 --2- 172.21.15.82:0/2331387089 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561798c82980 0x561798c944d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:43.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.867+0000 7fb45b0ffb80 1 -- 172.21.15.82:0/2331387089 >> 172.21.15.82:0/2331387089 conn(0x561798bb0b60 msgr2=0x561798c772b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:58:43.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.867+0000 7fb45b0ffb80 1 -- 172.21.15.82:0/2331387089 shutdown_connections 2024-05-08T05:58:43.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.867+0000 7fb45b0ffb80 1 -- 172.21.15.82:0/2331387089 wait complete. 2024-05-08T05:58:43.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.867+0000 7fb45b0ffb80 20 client.26090 trim_cache size 0 max 16384 2024-05-08T05:58:43.871 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T05:58:43.871 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-08T05:58:43.871 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2024-05-08T05:58:43.871 INFO:teuthology.orchestra.run.smithi082.stdout: "f9403793-4a6c-4bd1-a15f-ddd5334b3985": { 2024-05-08T05:58:43.871 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2024-05-08T05:58:43.871 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "f9403793-4a6c-4bd1-a15f-ddd5334b3985", 2024-05-08T05:58:43.871 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2024-05-08T05:58:43.871 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T05:58:43.871 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T05:58:43.871 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T05:58:43.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.871+0000 7fb450800700 1 -- 172.21.15.82:0/3814643157 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb4300b2980 msgr2=0x7fb4300b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:43.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.871+0000 7fb450800700 1 --2- 172.21.15.82:0/3814643157 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb4300b2980 0x7fb4300b4e40 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fb43c005950 tx=0x7fb43c004750 comp rx=0 tx=0).stop 2024-05-08T05:58:43.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.871+0000 7fb450800700 1 -- 172.21.15.82:0/3814643157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb448105ee0 msgr2=0x7fb4481a06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:58:43.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.871+0000 7fb450800700 1 --2- 172.21.15.82:0/3814643157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb448105ee0 0x7fb4481a06d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb43800d980 tx=0x7fb43800dc90 comp rx=0 tx=0).stop 2024-05-08T05:58:43.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.872+0000 7fb450800700 1 -- 172.21.15.82:0/3814643157 shutdown_connections 2024-05-08T05:58:43.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.872+0000 7fb450800700 1 --2- 172.21.15.82:0/3814643157 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb4300b2980 0x7fb4300b4e40 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:43.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.872+0000 7fb450800700 1 --2- 172.21.15.82:0/3814643157 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4481083d0 0x7fb4481a4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:43.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.872+0000 7fb450800700 1 --2- 172.21.15.82:0/3814643157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb44806b6f0 0x7fb4481a0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:43.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.872+0000 7fb450800700 1 --2- 172.21.15.82:0/3814643157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb448105ee0 0x7fb4481a06d0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:58:43.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.872+0000 7fb450800700 1 -- 172.21.15.82:0/3814643157 >> 172.21.15.82:0/3814643157 conn(0x7fb448079350 msgr2=0x7fb448101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:58:43.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.873+0000 7fb450800700 1 -- 172.21.15.82:0/3814643157 shutdown_connections 2024-05-08T05:58:43.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:58:43.873+0000 7fb450800700 1 -- 172.21.15.82:0/3814643157 wait complete. 2024-05-08T05:58:44.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:58:44 smithi082 ceph-mon[30098]: pgmap v701: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 625 op/s 2024-05-08T05:58:44.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:58:44 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:58:44.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:58:44 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:58:44.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:58:44 smithi151 ceph-mon[34815]: pgmap v701: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 625 op/s 2024-05-08T05:58:44.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:58:44 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:58:44.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:58:44 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:58:44.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:58:44 smithi134 ceph-mon[34132]: pgmap v701: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 625 op/s 2024-05-08T05:58:44.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:58:44 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:58:44.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:58:44 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:58:44.798 INFO:tasks.cephfs.filesystem:scrub status for tag:f9403793-4a6c-4bd1-a15f-ddd5334b3985 - {'path': '/', 'tag': 'f9403793-4a6c-4bd1-a15f-ddd5334b3985', 'options': 'recursive,force'} 2024-05-08T05:58:45.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 475.0 s, 1649.8 tps, lat 60.789 ms stddev 75.291 2024-05-08T05:58:46.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:58:46 smithi151 ceph-mon[34815]: pgmap v702: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 611 op/s 2024-05-08T05:58:46.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:58:46 smithi151 ceph-mon[34815]: scrub summary: idle 2024-05-08T05:58:46.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:58:46 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:58:46.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:58:46 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:58:46.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:58:46 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:58:46.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:58:46 smithi082 ceph-mon[30098]: pgmap v702: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 611 op/s 2024-05-08T05:58:46.472 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:58:46 smithi082 ceph-mon[30098]: scrub summary: idle 2024-05-08T05:58:46.472 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:58:46 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:58:46.472 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:58:46 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:58:46.472 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:58:46 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:58:46.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:58:46 smithi134 ceph-mon[34132]: pgmap v702: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 611 op/s 2024-05-08T05:58:46.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:58:46 smithi134 ceph-mon[34132]: scrub summary: idle 2024-05-08T05:58:46.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:58:46 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:58:46.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:58:46 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:58:46.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:58:46 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:58:47.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:58:47 smithi151 ceph-mon[34815]: scrub summary: idle 2024-05-08T05:58:47.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:58:47 smithi082 ceph-mon[30098]: scrub summary: idle 2024-05-08T05:58:47.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:58:47 smithi134 ceph-mon[34132]: scrub summary: idle 2024-05-08T05:58:48.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:58:48 smithi151 ceph-mon[34815]: pgmap v703: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 12 MiB/s wr, 715 op/s 2024-05-08T05:58:48.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:58:48 smithi082 ceph-mon[30098]: pgmap v703: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 12 MiB/s wr, 715 op/s 2024-05-08T05:58:48.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:58:48 smithi134 ceph-mon[34132]: pgmap v703: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 12 MiB/s wr, 715 op/s 2024-05-08T05:58:50.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 480.0 s, 1629.6 tps, lat 61.430 ms stddev 130.794 2024-05-08T05:58:50.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:58:50 smithi151 ceph-mon[34815]: pgmap v704: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 9.3 MiB/s wr, 576 op/s 2024-05-08T05:58:50.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:58:50 smithi082 ceph-mon[30098]: pgmap v704: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 9.3 MiB/s wr, 576 op/s 2024-05-08T05:58:50.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:58:50 smithi134 ceph-mon[34132]: pgmap v704: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 9.3 MiB/s wr, 576 op/s 2024-05-08T05:58:52.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:58:52 smithi151 ceph-mon[34815]: pgmap v705: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 MiB/s wr, 1.26k op/s 2024-05-08T05:58:52.472 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:58:52 smithi082 ceph-mon[30098]: pgmap v705: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 MiB/s wr, 1.26k op/s 2024-05-08T05:58:52.499 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:58:52 smithi134 ceph-mon[34132]: pgmap v705: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 MiB/s wr, 1.26k op/s 2024-05-08T05:58:54.315 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:58:54 smithi134 ceph-mon[34132]: pgmap v706: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 29 MiB/s wr, 1.40k op/s 2024-05-08T05:58:54.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:58:54 smithi151 ceph-mon[34815]: pgmap v706: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 29 MiB/s wr, 1.40k op/s 2024-05-08T05:58:54.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:58:54 smithi082 ceph-mon[30098]: pgmap v706: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 29 MiB/s wr, 1.40k op/s 2024-05-08T05:58:55.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 485.0 s, 2287.2 tps, lat 43.672 ms stddev 48.347 2024-05-08T05:58:56.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:58:56 smithi151 ceph-mon[34815]: pgmap v707: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 34 MiB/s wr, 1.62k op/s 2024-05-08T05:58:56.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:58:56 smithi082 ceph-mon[30098]: pgmap v707: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 34 MiB/s wr, 1.62k op/s 2024-05-08T05:58:56.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:58:56 smithi134 ceph-mon[34132]: pgmap v707: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 34 MiB/s wr, 1.62k op/s 2024-05-08T05:58:58.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:58:58 smithi151 ceph-mon[34815]: pgmap v708: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 38 MiB/s wr, 1.88k op/s 2024-05-08T05:58:58.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:58:58 smithi082 ceph-mon[30098]: pgmap v708: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 38 MiB/s wr, 1.88k op/s 2024-05-08T05:58:58.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:58:58 smithi134 ceph-mon[34132]: pgmap v708: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 38 MiB/s wr, 1.88k op/s 2024-05-08T05:59:00.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 490.0 s, 1986.4 tps, lat 50.249 ms stddev 57.029 2024-05-08T05:59:00.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:59:00 smithi151 ceph-mon[34815]: pgmap v709: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 35 MiB/s wr, 1.75k op/s 2024-05-08T05:59:00.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:59:00 smithi082 ceph-mon[30098]: pgmap v709: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 35 MiB/s wr, 1.75k op/s 2024-05-08T05:59:00.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:59:00 smithi134 ceph-mon[34132]: pgmap v709: 97 pgs: 97 active+clean; 1.6 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 35 MiB/s wr, 1.75k op/s 2024-05-08T05:59:02.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:59:02 smithi151 ceph-mon[34815]: pgmap v710: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 38 MiB/s wr, 1.92k op/s 2024-05-08T05:59:02.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:59:02 smithi082 ceph-mon[30098]: pgmap v710: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 38 MiB/s wr, 1.92k op/s 2024-05-08T05:59:02.499 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:59:02 smithi134 ceph-mon[34132]: pgmap v710: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 38 MiB/s wr, 1.92k op/s 2024-05-08T05:59:04.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:59:04 smithi151 ceph-mon[34815]: pgmap v711: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 23 MiB/s wr, 1.26k op/s 2024-05-08T05:59:04.472 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:59:04 smithi082 ceph-mon[30098]: pgmap v711: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 23 MiB/s wr, 1.26k op/s 2024-05-08T05:59:04.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:59:04 smithi134 ceph-mon[34132]: pgmap v711: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 23 MiB/s wr, 1.26k op/s 2024-05-08T05:59:05.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 495.0 s, 2024.0 tps, lat 49.609 ms stddev 55.797 2024-05-08T05:59:06.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:59:06 smithi151 ceph-mon[34815]: pgmap v712: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 17 MiB/s wr, 1.01k op/s 2024-05-08T05:59:06.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:59:06 smithi082 ceph-mon[30098]: pgmap v712: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 17 MiB/s wr, 1.01k op/s 2024-05-08T05:59:06.499 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:59:06 smithi134 ceph-mon[34132]: pgmap v712: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 17 MiB/s wr, 1.01k op/s 2024-05-08T05:59:08.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:59:08 smithi082 ceph-mon[30098]: pgmap v713: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 13 MiB/s wr, 906 op/s 2024-05-08T05:59:08.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:59:08 smithi151 ceph-mon[34815]: pgmap v713: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 13 MiB/s wr, 906 op/s 2024-05-08T05:59:08.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:59:08 smithi134 ceph-mon[34132]: pgmap v713: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 13 MiB/s wr, 906 op/s 2024-05-08T05:59:10.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 500.0 s, 1788.2 tps, lat 55.699 ms stddev 72.151 2024-05-08T05:59:10.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:59:10 smithi151 ceph-mon[34815]: pgmap v714: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.2 MiB/s wr, 635 op/s 2024-05-08T05:59:10.472 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:59:10 smithi082 ceph-mon[30098]: pgmap v714: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.2 MiB/s wr, 635 op/s 2024-05-08T05:59:10.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:59:10 smithi134 ceph-mon[34132]: pgmap v714: 97 pgs: 97 active+clean; 1.6 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.2 MiB/s wr, 635 op/s 2024-05-08T05:59:12.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:59:12 smithi151 ceph-mon[34815]: pgmap v715: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 MiB/s wr, 788 op/s 2024-05-08T05:59:12.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:59:12 smithi082 ceph-mon[30098]: pgmap v715: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 MiB/s wr, 788 op/s 2024-05-08T05:59:12.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:59:12 smithi134 ceph-mon[34132]: pgmap v715: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 10 MiB/s wr, 788 op/s 2024-05-08T05:59:14.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:59:14 smithi082 ceph-mon[30098]: pgmap v716: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.5 MiB/s wr, 662 op/s 2024-05-08T05:59:14.499 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:59:14 smithi134 ceph-mon[34132]: pgmap v716: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.5 MiB/s wr, 662 op/s 2024-05-08T05:59:14.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:59:14 smithi151 ceph-mon[34815]: pgmap v716: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.5 MiB/s wr, 662 op/s 2024-05-08T05:59:14.799 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-08T05:59:15.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 505.0 s, 1978.4 tps, lat 50.586 ms stddev 62.262 2024-05-08T05:59:15.454 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:59:15.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:59:15 smithi082 ceph-mon[30098]: pgmap v717: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 7.6 MiB/s wr, 628 op/s 2024-05-08T05:59:15.499 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:59:15 smithi134 ceph-mon[34132]: pgmap v717: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 7.6 MiB/s wr, 628 op/s 2024-05-08T05:59:15.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:59:15 smithi151 ceph-mon[34815]: pgmap v717: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 7.6 MiB/s wr, 628 op/s 2024-05-08T05:59:17.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:59:17 smithi134 ceph-mon[34132]: pgmap v718: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.7 MiB/s wr, 742 op/s 2024-05-08T05:59:17.764 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:59:17 smithi082 ceph-mon[30098]: pgmap v718: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.7 MiB/s wr, 742 op/s 2024-05-08T05:59:17.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:59:17 smithi151 ceph-mon[34815]: pgmap v718: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.7 MiB/s wr, 742 op/s 2024-05-08T05:59:18.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.174+0000 7f9a82800700 1 -- 172.21.15.82:0/2242097985 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a7c06b180 msgr2=0x7f9a7c06b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:18.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.174+0000 7f9a82800700 1 --2- 172.21.15.82:0/2242097985 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a7c06b180 0x7f9a7c06b600 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f9a64009990 tx=0x7f9a64009ca0 comp rx=0 tx=0).stop 2024-05-08T05:59:18.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.174+0000 7f9a82800700 1 -- 172.21.15.82:0/2242097985 shutdown_connections 2024-05-08T05:59:18.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.174+0000 7f9a82800700 1 --2- 172.21.15.82:0/2242097985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a7c06bb40 0x7f9a7c110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:18.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.174+0000 7f9a82800700 1 --2- 172.21.15.82:0/2242097985 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a7c109510 0x7f9a7c1098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:18.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.174+0000 7f9a82800700 1 --2- 172.21.15.82:0/2242097985 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a7c06b180 0x7f9a7c06b600 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:18.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.174+0000 7f9a82800700 1 -- 172.21.15.82:0/2242097985 >> 172.21.15.82:0/2242097985 conn(0x7f9a7c079350 msgr2=0x7f9a7c079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:59:18.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.175+0000 7f9a82800700 1 -- 172.21.15.82:0/2242097985 shutdown_connections 2024-05-08T05:59:18.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.175+0000 7f9a82800700 1 -- 172.21.15.82:0/2242097985 wait complete. 2024-05-08T05:59:18.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.177+0000 7f9a82800700 1 Processor -- start 2024-05-08T05:59:18.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.178+0000 7f9a82800700 1 -- start start 2024-05-08T05:59:18.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.179+0000 7f9a82800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a7c06b180 0x7f9a7c19f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:18.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.179+0000 7f9a82800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a7c06bb40 0x7f9a7c19fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:18.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.179+0000 7f9a82800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a7c109510 0x7f9a7c199a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:18.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.179+0000 7f9a82800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7c1136f0 con 0x7f9a7c06b180 2024-05-08T05:59:18.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.179+0000 7f9a82800700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7c113570 con 0x7f9a7c06bb40 2024-05-08T05:59:18.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.179+0000 7f9a82800700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7c113870 con 0x7f9a7c109510 2024-05-08T05:59:18.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.179+0000 7f9a7be00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a7c109510 0x7f9a7c199a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:18.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.180+0000 7f9a7be00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a7c109510 0x7f9a7c199a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:52016/0 (socket says 172.21.15.82:52016) 2024-05-08T05:59:18.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.180+0000 7f9a7be00700 1 -- 172.21.15.82:0/1798623078 learned_addr learned my addr 172.21.15.82:0/1798623078 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:59:18.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.180+0000 7f9a7b400700 1 --2- 172.21.15.82:0/1798623078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a7c06b180 0x7f9a7c19f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:18.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.180+0000 7f9a72a00700 1 --2- 172.21.15.82:0/1798623078 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a7c06bb40 0x7f9a7c19fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:18.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.180+0000 7f9a7be00700 1 -- 172.21.15.82:0/1798623078 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a7c06bb40 msgr2=0x7f9a7c19fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:18.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.180+0000 7f9a7be00700 1 --2- 172.21.15.82:0/1798623078 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a7c06bb40 0x7f9a7c19fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:18.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.180+0000 7f9a7be00700 1 -- 172.21.15.82:0/1798623078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a7c06b180 msgr2=0x7f9a7c19f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:18.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.180+0000 7f9a7be00700 1 --2- 172.21.15.82:0/1798623078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a7c06b180 0x7f9a7c19f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:18.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.180+0000 7f9a7be00700 1 -- 172.21.15.82:0/1798623078 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a7c19a170 con 0x7f9a7c109510 2024-05-08T05:59:18.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.181+0000 7f9a7be00700 1 --2- 172.21.15.82:0/1798623078 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a7c109510 0x7f9a7c199a10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9a74009f60 tx=0x7f9a74009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:59:18.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.181+0000 7f9a78c00700 1 -- 172.21.15.82:0/1798623078 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a7401d070 con 0x7f9a7c109510 2024-05-08T05:59:18.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.182+0000 7f9a78c00700 1 -- 172.21.15.82:0/1798623078 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9a74010e20 con 0x7f9a7c109510 2024-05-08T05:59:18.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.182+0000 7f9a82800700 1 -- 172.21.15.82:0/1798623078 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a7c19a460 con 0x7f9a7c109510 2024-05-08T05:59:18.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.182+0000 7f9a78c00700 1 -- 172.21.15.82:0/1798623078 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a74016340 con 0x7f9a7c109510 2024-05-08T05:59:18.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.182+0000 7f9a82800700 1 -- 172.21.15.82:0/1798623078 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a7c1023a0 con 0x7f9a7c109510 2024-05-08T05:59:18.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.186+0000 7f9a78c00700 1 -- 172.21.15.82:0/1798623078 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f9a74020070 con 0x7f9a7c109510 2024-05-08T05:59:18.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.188+0000 7f9a78c00700 1 --2- 172.21.15.82:0/1798623078 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9a600b2980 0x7f9a600b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:18.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.189+0000 7f9a78c00700 1 -- 172.21.15.82:0/1798623078 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f9a740e5380 con 0x7f9a7c109510 2024-05-08T05:59:18.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.189+0000 7f9a8d1a0b80 1 Processor -- start 2024-05-08T05:59:18.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.189+0000 7f9a7b400700 1 --2- 172.21.15.82:0/1798623078 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9a600b2980 0x7f9a600b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:18.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.190+0000 7f9a8d1a0b80 1 -- start start 2024-05-08T05:59:18.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.191+0000 7f9a7b400700 1 --2- 172.21.15.82:0/1798623078 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9a600b2980 0x7f9a600b4e40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c19ab50 tx=0x7f9a6c00b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:59:18.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.191+0000 7f9a8d1a0b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b6c8dc5870 0x55b6c8dc5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:18.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.191+0000 7f9a8d1a0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b6c8dc6190 0x55b6c8dc9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:18.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.191+0000 7f9a8d1a0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6c8dca1e0 0x55b6c8dca640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:18.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.191+0000 7f9a8d1a0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b6c8d0fa20 con 0x55b6c8dc6190 2024-05-08T05:59:18.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.191+0000 7f9a8d1a0b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b6c8cad760 con 0x55b6c8dc5870 2024-05-08T05:59:18.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.191+0000 7f9a8d1a0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55b6c8d0b9e0 con 0x55b6c8dca1e0 2024-05-08T05:59:18.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.191+0000 7f9a7b400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b6c8dc5870 0x55b6c8dc5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:18.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.192+0000 7f9a7b400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b6c8dc5870 0x55b6c8dc5c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:51056/0 (socket says 172.21.15.82:51056) 2024-05-08T05:59:18.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.192+0000 7f9a7b400700 1 -- 172.21.15.82:0/3368166787 learned_addr learned my addr 172.21.15.82:0/3368166787 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:59:18.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.192+0000 7f9a7b400700 1 -- 172.21.15.82:0/3368166787 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6c8dca1e0 msgr2=0x55b6c8dca640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:18.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.192+0000 7f9a7be00700 1 --2- 172.21.15.82:0/3368166787 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6c8dca1e0 0x55b6c8dca640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:18.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.192+0000 7f9a7b400700 1 --2- 172.21.15.82:0/3368166787 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6c8dca1e0 0x55b6c8dca640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:18.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.192+0000 7f9a7b400700 1 -- 172.21.15.82:0/3368166787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b6c8dc6190 msgr2=0x55b6c8dc9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:18.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.192+0000 7f9a7b400700 1 --2- 172.21.15.82:0/3368166787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b6c8dc6190 0x55b6c8dc9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:18.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.192+0000 7f9a7b400700 1 -- 172.21.15.82:0/3368166787 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6c8c5c8d0 con 0x55b6c8dc5870 2024-05-08T05:59:18.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.193+0000 7f9a7be00700 1 --2- 172.21.15.82:0/3368166787 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6c8dca1e0 0x55b6c8dca640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:59:18.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.193+0000 7f9a7b400700 1 --2- 172.21.15.82:0/3368166787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b6c8dc5870 0x55b6c8dc5c50 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c0176e0 tx=0x7f9a6c014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe47543380b88859 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:59:18.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.193+0000 7f9a70c00700 1 -- 172.21.15.82:0/3368166787 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c004db0 con 0x55b6c8dc5870 2024-05-08T05:59:18.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.193+0000 7f9a70c00700 1 -- 172.21.15.82:0/3368166787 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9a6c01b070 con 0x55b6c8dc5870 2024-05-08T05:59:18.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.193+0000 7f9a70c00700 1 -- 172.21.15.82:0/3368166787 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c0054b0 con 0x55b6c8dc5870 2024-05-08T05:59:18.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.194+0000 7f9a8d1a0b80 1 -- 172.21.15.82:0/3368166787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b6c8dc5870 msgr2=0x55b6c8dc5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:18.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.194+0000 7f9a8d1a0b80 1 --2- 172.21.15.82:0/3368166787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b6c8dc5870 0x55b6c8dc5c50 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c0176e0 tx=0x7f9a6c014000 comp rx=0 tx=0).stop 2024-05-08T05:59:18.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.195+0000 7f9a8d1a0b80 1 -- 172.21.15.82:0/3368166787 shutdown_connections 2024-05-08T05:59:18.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.195+0000 7f9a8d1a0b80 1 --2- 172.21.15.82:0/3368166787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b6c8dc5870 0x55b6c8dc5c50 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:18.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.195+0000 7f9a8d1a0b80 1 --2- 172.21.15.82:0/3368166787 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6c8dca1e0 0x55b6c8dca640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:18.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.195+0000 7f9a8d1a0b80 1 --2- 172.21.15.82:0/3368166787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b6c8dc6190 0x55b6c8dc9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:18.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.195+0000 7f9a8d1a0b80 1 -- 172.21.15.82:0/3368166787 >> 172.21.15.82:0/3368166787 conn(0x55b6c8cebb60 msgr2=0x55b6c8db77a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:59:18.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.195+0000 7f9a8d1a0b80 1 -- 172.21.15.82:0/3368166787 shutdown_connections 2024-05-08T05:59:18.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.195+0000 7f9a8d1a0b80 1 -- 172.21.15.82:0/3368166787 wait complete. 2024-05-08T05:59:18.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.196+0000 7f9a8d1a0b80 1 -- start start 2024-05-08T05:59:18.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.196+0000 7f9a8d1a0b80 1 Processor -- start 2024-05-08T05:59:18.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.197+0000 7f9a8d1a0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b6c8dc5870 0x55b6c8dd1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:18.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.197+0000 7f9a8d1a0b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b6c8dc6190 0x55b6c8dcea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:18.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.197+0000 7f9a8d1a0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6c8dca1e0 0x55b6c8dcef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:18.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.197+0000 7f9a8d1a0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b6c8dd23f0 con 0x55b6c8dc5870 2024-05-08T05:59:18.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.197+0000 7f9a8d1a0b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b6c8c75b20 con 0x55b6c8dc6190 2024-05-08T05:59:18.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.197+0000 7f9a8d1a0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55b6c8dd2570 con 0x55b6c8dca1e0 2024-05-08T05:59:18.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.197+0000 7f9a8d1a0b80 10 client.0 _ll_register_callbacks cb 0x55b6c8cb6c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:59:18.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.198+0000 7f9a72a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b6c8dc6190 0x55b6c8dcea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:18.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.198+0000 7f9a72a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b6c8dc6190 0x55b6c8dcea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:51062/0 (socket says 172.21.15.82:51062) 2024-05-08T05:59:18.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.198+0000 7f9a72a00700 1 -- 172.21.15.82:0/2991385863 learned_addr learned my addr 172.21.15.82:0/2991385863 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:59:18.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.198+0000 7f9a7b400700 1 --2- 172.21.15.82:0/2991385863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b6c8dc5870 0x55b6c8dd1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:18.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.198+0000 7f9a72a00700 1 -- 172.21.15.82:0/2991385863 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6c8dca1e0 msgr2=0x55b6c8dcef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:18.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.198+0000 7f9a72a00700 1 --2- 172.21.15.82:0/2991385863 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6c8dca1e0 0x55b6c8dcef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:18.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.198+0000 7f9a72a00700 1 -- 172.21.15.82:0/2991385863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b6c8dc5870 msgr2=0x55b6c8dd1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:18.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.198+0000 7f9a72a00700 1 --2- 172.21.15.82:0/2991385863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b6c8dc5870 0x55b6c8dd1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:18.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.198+0000 7f9a72a00700 1 -- 172.21.15.82:0/2991385863 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6c8cd5420 con 0x55b6c8dc6190 2024-05-08T05:59:18.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.198+0000 7f9a72a00700 1 --2- 172.21.15.82:0/2991385863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b6c8dc6190 0x55b6c8dcea20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9a64000c00 tx=0x7f9a64005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bbd50c8a511fc46 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:59:18.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.199+0000 7f9a69600700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:59:18.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.199+0000 7f9a69600700 1 -- 172.21.15.82:0/2991385863 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a64027060 con 0x55b6c8dc6190 2024-05-08T05:59:18.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.199+0000 7f9a69600700 1 -- 172.21.15.82:0/2991385863 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f9a64003680 con 0x55b6c8dc6190 2024-05-08T05:59:18.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.199+0000 7f9a8d1a0b80 1 -- 172.21.15.82:0/2991385863 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a6c01b070 con 0x55b6c8dc6190 2024-05-08T05:59:18.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.199+0000 7f9a69600700 1 -- 172.21.15.82:0/2991385863 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f9a64005da0 con 0x55b6c8dc6190 2024-05-08T05:59:18.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.199+0000 7f9a8d1a0b80 10 client.26102 fetch_fsmap learned FSMap version 31 2024-05-08T05:59:18.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.199+0000 7f9a8d1a0b80 1 -- 172.21.15.82:0/2991385863 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55b6c8dbb1a0 con 0x55b6c8dc6190 2024-05-08T05:59:18.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.200+0000 7f9a69600700 1 -- 172.21.15.82:0/2991385863 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9a6c01b070 con 0x55b6c8dc6190 2024-05-08T05:59:18.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.201+0000 7f9a69600700 1 -- 172.21.15.82:0/2991385863 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f9a64021070 con 0x55b6c8dc6190 2024-05-08T05:59:18.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.202+0000 7f9a8d1a0b80 10 client.26102 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:59:18.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.202+0000 7f9a8d1a0b80 10 client.26102 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:59:18.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.202+0000 7f9a8d1a0b80 20 client.26102 populate_metadata read hostname 'smithi082' 2024-05-08T05:59:18.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.202+0000 7f9a8d1a0b80 1 --2- 172.21.15.82:0/2991385863 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55b6c8dbd730 0x55b6c8dbfb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:18.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.202+0000 7f9a8d1a0b80 4 client.26102 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:59:18.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.202+0000 7f9a8d1a0b80 1 -- 172.21.15.82:0/2991385863 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b6c8d8a0a0 con 0x55b6c8dbd730 2024-05-08T05:59:18.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.203+0000 7f9a7b400700 1 --2- 172.21.15.82:0/2991385863 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55b6c8dbd730 0x55b6c8dbfb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:18.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.203+0000 7f9a69600700 10 client.26102 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:59:18.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.203+0000 7f9a7b400700 1 --2- 172.21.15.82:0/2991385863 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55b6c8dbd730 0x55b6c8dbfb90 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2758ee4fe1de590 server_cookie=73157740403c3870 in_seq=0 out_seq=0 2024-05-08T05:59:18.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.204+0000 7f9a69600700 1 -- 172.21.15.82:0/2991385863 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55b6c8d8a0a0 con 0x55b6c8dbd730 2024-05-08T05:59:18.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.204+0000 7f9a69600700 10 client.26102 handle_command_reply: tid=0 2024-05-08T05:59:18.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.204+0000 7f9a8d1a0b80 1 client.26102 shutdown 2024-05-08T05:59:18.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.205+0000 7f9a8d1a0b80 1 -- 172.21.15.82:0/2991385863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b6c8dc6190 msgr2=0x55b6c8dcea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:18.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.205+0000 7f9a8d1a0b80 1 --2- 172.21.15.82:0/2991385863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b6c8dc6190 0x55b6c8dcea20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9a64000c00 tx=0x7f9a64005800 comp rx=0 tx=0).stop 2024-05-08T05:59:18.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.205+0000 7f9a8d1a0b80 1 -- 172.21.15.82:0/2991385863 shutdown_connections 2024-05-08T05:59:18.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.205+0000 7f9a8d1a0b80 1 --2- 172.21.15.82:0/2991385863 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6c8dca1e0 0x55b6c8dcef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:18.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.205+0000 7f9a8d1a0b80 1 --2- 172.21.15.82:0/2991385863 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b6c8dc5870 0x55b6c8dd1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:18.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.205+0000 7f9a8d1a0b80 1 --2- 172.21.15.82:0/2991385863 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55b6c8dbd730 0x55b6c8dbfb90 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:18.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.205+0000 7f9a8d1a0b80 1 --2- 172.21.15.82:0/2991385863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b6c8dc6190 0x55b6c8dcea20 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:18.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.205+0000 7f9a8d1a0b80 1 -- 172.21.15.82:0/2991385863 >> 172.21.15.82:0/2991385863 conn(0x55b6c8cebb60 msgr2=0x55b6c8db22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:59:18.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.205+0000 7f9a69600700 0 client.26102 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:59:18.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.205+0000 7f9a8d1a0b80 1 -- 172.21.15.82:0/2991385863 shutdown_connections 2024-05-08T05:59:18.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.205+0000 7f9a8d1a0b80 1 -- 172.21.15.82:0/2991385863 wait complete. 2024-05-08T05:59:18.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.206+0000 7f9a8d1a0b80 20 client.26102 trim_cache size 0 max 16384 2024-05-08T05:59:18.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.237+0000 7f9a8d1a0b80 1 Processor -- start 2024-05-08T05:59:18.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.237+0000 7f9a8d1a0b80 1 -- start start 2024-05-08T05:59:18.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.237+0000 7f9a8d1a0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6c8dc5870 0x55b6c8dcc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:18.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.237+0000 7f9a8d1a0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b6c8dc6190 0x55b6c8df18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:18.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.237+0000 7f9a8d1a0b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b6c8dca1e0 0x55b6c8df1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:18.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.237+0000 7f9a8d1a0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7c1aba60 con 0x55b6c8dc6190 2024-05-08T05:59:18.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.237+0000 7f9a8d1a0b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7c1ad5a0 con 0x55b6c8dca1e0 2024-05-08T05:59:18.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.237+0000 7f9a8d1a0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7c1ac130 con 0x55b6c8dc5870 2024-05-08T05:59:18.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.238+0000 7f9a7b400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6c8dc5870 0x55b6c8dcc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:18.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.238+0000 7f9a7b400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6c8dc5870 0x55b6c8dcc3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:52052/0 (socket says 172.21.15.82:52052) 2024-05-08T05:59:18.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.238+0000 7f9a7b400700 1 -- 172.21.15.82:0/1620316487 learned_addr learned my addr 172.21.15.82:0/1620316487 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:59:18.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.238+0000 7f9a72a00700 1 --2- 172.21.15.82:0/1620316487 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b6c8dc6190 0x55b6c8df18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:18.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.238+0000 7f9a7be00700 1 --2- 172.21.15.82:0/1620316487 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b6c8dca1e0 0x55b6c8df1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:18.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.238+0000 7f9a7b400700 1 -- 172.21.15.82:0/1620316487 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b6c8dca1e0 msgr2=0x55b6c8df1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:18.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.238+0000 7f9a7b400700 1 --2- 172.21.15.82:0/1620316487 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b6c8dca1e0 0x55b6c8df1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:18.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.238+0000 7f9a7b400700 1 -- 172.21.15.82:0/1620316487 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b6c8dc6190 msgr2=0x55b6c8df18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:18.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.238+0000 7f9a7b400700 1 --2- 172.21.15.82:0/1620316487 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b6c8dc6190 0x55b6c8df18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:18.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.238+0000 7f9a7b400700 1 -- 172.21.15.82:0/1620316487 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6c8db8610 con 0x55b6c8dc5870 2024-05-08T05:59:18.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.239+0000 7f9a7b400700 1 --2- 172.21.15.82:0/1620316487 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6c8dc5870 0x55b6c8dcc3a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c017d80 tx=0x7f9a6c005050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9302e738fb5429f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:59:18.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.239+0000 7f9a6be00700 1 -- 172.21.15.82:0/1620316487 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c015820 con 0x55b6c8dc5870 2024-05-08T05:59:18.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.239+0000 7f9a6be00700 1 -- 172.21.15.82:0/1620316487 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9a6c01b070 con 0x55b6c8dc5870 2024-05-08T05:59:18.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.239+0000 7f9a6be00700 1 -- 172.21.15.82:0/1620316487 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c005880 con 0x55b6c8dc5870 2024-05-08T05:59:18.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.240+0000 7f9a8d1a0b80 1 -- 172.21.15.82:0/1620316487 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6c8dc5870 msgr2=0x55b6c8dcc3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:18.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.240+0000 7f9a8d1a0b80 1 --2- 172.21.15.82:0/1620316487 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6c8dc5870 0x55b6c8dcc3a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c017d80 tx=0x7f9a6c005050 comp rx=0 tx=0).stop 2024-05-08T05:59:18.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.240+0000 7f9a8d1a0b80 1 -- 172.21.15.82:0/1620316487 shutdown_connections 2024-05-08T05:59:18.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.240+0000 7f9a8d1a0b80 1 --2- 172.21.15.82:0/1620316487 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b6c8dca1e0 0x55b6c8df1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:18.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.240+0000 7f9a8d1a0b80 1 --2- 172.21.15.82:0/1620316487 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6c8dc5870 0x55b6c8dcc3a0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:18.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.240+0000 7f9a8d1a0b80 1 --2- 172.21.15.82:0/1620316487 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b6c8dc6190 0x55b6c8df18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:18.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.241+0000 7f9a8d1a0b80 1 -- 172.21.15.82:0/1620316487 >> 172.21.15.82:0/1620316487 conn(0x55b6c8cebb60 msgr2=0x55b6c8dcbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:59:18.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.241+0000 7f9a8d1a0b80 1 -- 172.21.15.82:0/1620316487 shutdown_connections 2024-05-08T05:59:18.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.241+0000 7f9a8d1a0b80 1 -- 172.21.15.82:0/1620316487 wait complete. 2024-05-08T05:59:18.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.241+0000 7f9a8d1a0b80 1 -- start start 2024-05-08T05:59:18.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.242+0000 7f9a8d1a0b80 1 Processor -- start 2024-05-08T05:59:18.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.243+0000 7f9a8d1a0b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b6c8dc5870 0x55b6c8dd3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:18.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.243+0000 7f9a8d1a0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6c8dc6190 0x55b6c8dd4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:18.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.243+0000 7f9a8d1a0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b6c8dca1e0 0x55b6c8e51480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:18.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.244+0000 7f9a8d1a0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7c1aced0 con 0x55b6c8dca1e0 2024-05-08T05:59:18.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.244+0000 7f9a7b400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b6c8dc5870 0x55b6c8dd3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:18.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.244+0000 7f9a8d1a0b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7c1ac800 con 0x55b6c8dc5870 2024-05-08T05:59:18.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.244+0000 7f9a8d1a0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7c1a9a00 con 0x55b6c8dc6190 2024-05-08T05:59:18.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.244+0000 7f9a8d1a0b80 10 client.0 _ll_register_callbacks cb 0x55b6c8cb6c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:59:18.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.244+0000 7f9a7b400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b6c8dc5870 0x55b6c8dd3b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:51070/0 (socket says 172.21.15.82:51070) 2024-05-08T05:59:18.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.244+0000 7f9a72a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6c8dc6190 0x55b6c8dd4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:18.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.244+0000 7f9a7b400700 1 -- 172.21.15.82:0/4141040214 learned_addr learned my addr 172.21.15.82:0/4141040214 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:59:18.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.244+0000 7f9a7be00700 1 --2- 172.21.15.82:0/4141040214 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b6c8dca1e0 0x55b6c8e51480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:18.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.245+0000 7f9a7b400700 1 -- 172.21.15.82:0/4141040214 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6c8dc6190 msgr2=0x55b6c8dd4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:18.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.245+0000 7f9a7b400700 1 --2- 172.21.15.82:0/4141040214 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6c8dc6190 0x55b6c8dd4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:18.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.245+0000 7f9a7b400700 1 -- 172.21.15.82:0/4141040214 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b6c8dca1e0 msgr2=0x55b6c8e51480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:18.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.245+0000 7f9a7b400700 1 --2- 172.21.15.82:0/4141040214 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b6c8dca1e0 0x55b6c8e51480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:18.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.245+0000 7f9a7b400700 1 -- 172.21.15.82:0/4141040214 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6c8db43f0 con 0x55b6c8dc5870 2024-05-08T05:59:18.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.245+0000 7f9a7be00700 1 --2- 172.21.15.82:0/4141040214 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b6c8dca1e0 0x55b6c8e51480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:59:18.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.246+0000 7f9a69600700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:59:18.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.246+0000 7f9a7b400700 1 --2- 172.21.15.82:0/4141040214 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b6c8dc5870 0x55b6c8dd3b50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c004e90 tx=0x7f9a6c004cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=430ea9f4e336898e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:59:18.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.246+0000 7f9a69600700 1 -- 172.21.15.82:0/4141040214 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a6c044060 con 0x55b6c8dc5870 2024-05-08T05:59:18.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.246+0000 7f9a69600700 1 -- 172.21.15.82:0/4141040214 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f9a6c03c050 con 0x55b6c8dc5870 2024-05-08T05:59:18.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.246+0000 7f9a8d1a0b80 1 -- 172.21.15.82:0/4141040214 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9a6c01b070 con 0x55b6c8dc5870 2024-05-08T05:59:18.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.247+0000 7f9a69600700 1 -- 172.21.15.82:0/4141040214 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f9a6c044060 con 0x55b6c8dc5870 2024-05-08T05:59:18.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.247+0000 7f9a8d1a0b80 10 client.26108 fetch_fsmap learned FSMap version 31 2024-05-08T05:59:18.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.247+0000 7f9a8d1a0b80 1 -- 172.21.15.82:0/4141040214 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55b6c8e52b90 con 0x55b6c8dc5870 2024-05-08T05:59:18.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.247+0000 7f9a69600700 1 -- 172.21.15.82:0/4141040214 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9a6c01b070 con 0x55b6c8dc5870 2024-05-08T05:59:18.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.248+0000 7f9a69600700 1 -- 172.21.15.82:0/4141040214 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f9a6c03e030 con 0x55b6c8dc5870 2024-05-08T05:59:18.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.248+0000 7f9a8d1a0b80 10 client.26108 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:59:18.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.248+0000 7f9a8d1a0b80 10 client.26108 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:59:18.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.248+0000 7f9a8d1a0b80 20 client.26108 populate_metadata read hostname 'smithi082' 2024-05-08T05:59:18.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.248+0000 7f9a8d1a0b80 1 --2- 172.21.15.82:0/4141040214 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55b6c8e52fe0 0x55b6c8e553d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:18.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.248+0000 7f9a8d1a0b80 4 client.26108 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-08T05:59:18.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.248+0000 7f9a8d1a0b80 1 -- 172.21.15.82:0/4141040214 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b6c8d1d400 con 0x55b6c8e52fe0 2024-05-08T05:59:18.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.249+0000 7f9a72a00700 1 --2- 172.21.15.82:0/4141040214 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55b6c8e52fe0 0x55b6c8e553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:18.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.249+0000 7f9a72a00700 1 --2- 172.21.15.82:0/4141040214 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55b6c8e52fe0 0x55b6c8e553d0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24b76e0c7a56de13 server_cookie=b12d5950ebd30758 in_seq=0 out_seq=0 2024-05-08T05:59:18.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.249+0000 7f9a69600700 10 client.26108 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:59:18.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.250+0000 7f9a69600700 1 -- 172.21.15.82:0/4141040214 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55b6c8d1d400 con 0x55b6c8e52fe0 2024-05-08T05:59:18.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.250+0000 7f9a69600700 10 client.26108 handle_command_reply: tid=0 2024-05-08T05:59:18.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.250+0000 7f9a8d1a0b80 1 client.26108 shutdown 2024-05-08T05:59:18.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.250+0000 7f9a8d1a0b80 1 -- 172.21.15.82:0/4141040214 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b6c8dc5870 msgr2=0x55b6c8dd3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:18.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.250+0000 7f9a8d1a0b80 1 --2- 172.21.15.82:0/4141040214 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b6c8dc5870 0x55b6c8dd3b50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9a6c004e90 tx=0x7f9a6c004cd0 comp rx=0 tx=0).stop 2024-05-08T05:59:18.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.251+0000 7f9a8d1a0b80 1 -- 172.21.15.82:0/4141040214 shutdown_connections 2024-05-08T05:59:18.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.251+0000 7f9a8d1a0b80 1 --2- 172.21.15.82:0/4141040214 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55b6c8e52fe0 0x55b6c8e553d0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:18.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.251+0000 7f9a8d1a0b80 1 --2- 172.21.15.82:0/4141040214 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b6c8dc5870 0x55b6c8dd3b50 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:18.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.251+0000 7f9a8d1a0b80 1 --2- 172.21.15.82:0/4141040214 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b6c8dca1e0 0x55b6c8e51480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:18.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.251+0000 7f9a8d1a0b80 1 --2- 172.21.15.82:0/4141040214 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6c8dc6190 0x55b6c8dd4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:18.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.251+0000 7f9a8d1a0b80 1 -- 172.21.15.82:0/4141040214 >> 172.21.15.82:0/4141040214 conn(0x55b6c8cebb60 msgr2=0x55b6c8db22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:59:18.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.251+0000 7f9a69600700 0 client.26108 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:59:18.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.251+0000 7f9a8d1a0b80 1 -- 172.21.15.82:0/4141040214 shutdown_connections 2024-05-08T05:59:18.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.251+0000 7f9a8d1a0b80 1 -- 172.21.15.82:0/4141040214 wait complete. 2024-05-08T05:59:18.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.251+0000 7f9a8d1a0b80 20 client.26108 trim_cache size 0 max 16384 2024-05-08T05:59:18.252 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T05:59:18.252 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "no active scrubs running", 2024-05-08T05:59:18.252 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": {} 2024-05-08T05:59:18.252 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T05:59:18.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.252+0000 7f9a82800700 1 -- 172.21.15.82:0/1798623078 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9a600b2980 msgr2=0x7f9a600b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:18.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.252+0000 7f9a82800700 1 --2- 172.21.15.82:0/1798623078 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9a600b2980 0x7f9a600b4e40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c19ab50 tx=0x7f9a6c00b040 comp rx=0 tx=0).stop 2024-05-08T05:59:18.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.252+0000 7f9a82800700 1 -- 172.21.15.82:0/1798623078 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a7c109510 msgr2=0x7f9a7c199a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:18.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.252+0000 7f9a82800700 1 --2- 172.21.15.82:0/1798623078 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a7c109510 0x7f9a7c199a10 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9a74009f60 tx=0x7f9a74009f90 comp rx=0 tx=0).stop 2024-05-08T05:59:18.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.253+0000 7f9a82800700 1 -- 172.21.15.82:0/1798623078 shutdown_connections 2024-05-08T05:59:18.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.253+0000 7f9a82800700 1 --2- 172.21.15.82:0/1798623078 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9a600b2980 0x7f9a600b4e40 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:18.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.253+0000 7f9a82800700 1 --2- 172.21.15.82:0/1798623078 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a7c109510 0x7f9a7c199a10 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:18.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.253+0000 7f9a82800700 1 --2- 172.21.15.82:0/1798623078 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9a7c06b180 0x7f9a7c19f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:18.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.253+0000 7f9a82800700 1 --2- 172.21.15.82:0/1798623078 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a7c06bb40 0x7f9a7c19fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:18.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.253+0000 7f9a82800700 1 -- 172.21.15.82:0/1798623078 >> 172.21.15.82:0/1798623078 conn(0x7f9a7c079350 msgr2=0x7f9a7c1011c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:59:18.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.253+0000 7f9a82800700 1 -- 172.21.15.82:0/1798623078 shutdown_connections 2024-05-08T05:59:18.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:18.253+0000 7f9a82800700 1 -- 172.21.15.82:0/1798623078 wait complete. 2024-05-08T05:59:19.051 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-08T05:59:19.051 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T05:59:19.680 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:59:19.867 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:59:19 smithi082 ceph-mon[30098]: pgmap v719: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.9 MiB/s wr, 595 op/s 2024-05-08T05:59:19.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:59:19 smithi151 ceph-mon[34815]: pgmap v719: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.9 MiB/s wr, 595 op/s 2024-05-08T05:59:20.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:59:19 smithi134 ceph-mon[34132]: pgmap v719: 97 pgs: 97 active+clean; 1.6 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.9 MiB/s wr, 595 op/s 2024-05-08T05:59:20.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 510.0 s, 1971.6 tps, lat 50.367 ms stddev 61.236 2024-05-08T05:59:21.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:59:21 smithi082 ceph-mon[30098]: pgmap v720: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.7 MiB/s wr, 780 op/s 2024-05-08T05:59:21.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:59:21 smithi151 ceph-mon[34815]: pgmap v720: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.7 MiB/s wr, 780 op/s 2024-05-08T05:59:22.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:59:21 smithi134 ceph-mon[34132]: pgmap v720: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.7 MiB/s wr, 780 op/s 2024-05-08T05:59:22.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:22.350+0000 7ff087200700 1 -- 172.21.15.82:0/2103741221 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff088102b30 msgr2=0x7ff08810f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:22.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:22.350+0000 7ff087200700 1 --2- 172.21.15.82:0/2103741221 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff088102b30 0x7ff08810f7f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7ff074009990 tx=0x7ff074009ca0 comp rx=0 tx=0).stop 2024-05-08T05:59:22.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:22.350+0000 7ff087200700 1 -- 172.21.15.82:0/2103741221 shutdown_connections 2024-05-08T05:59:22.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:22.350+0000 7ff087200700 1 --2- 172.21.15.82:0/2103741221 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff08810fd30 0x7ff088112120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:22.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:22.350+0000 7ff087200700 1 --2- 172.21.15.82:0/2103741221 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff088102180 0x7ff088102560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:22.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:22.350+0000 7ff087200700 1 --2- 172.21.15.82:0/2103741221 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff088102b30 0x7ff08810f7f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:22.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:22.350+0000 7ff087200700 1 -- 172.21.15.82:0/2103741221 >> 172.21.15.82:0/2103741221 conn(0x7ff0880fddc0 msgr2=0x7ff0881001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:59:22.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:22.350+0000 7ff087200700 1 -- 172.21.15.82:0/2103741221 shutdown_connections 2024-05-08T05:59:22.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:22.350+0000 7ff087200700 1 -- 172.21.15.82:0/2103741221 wait complete. 2024-05-08T05:59:22.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:22.351+0000 7ff087200700 1 Processor -- start 2024-05-08T05:59:22.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:22.352+0000 7ff087200700 1 -- start start 2024-05-08T05:59:22.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:22.352+0000 7ff087200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff088102180 0x7ff0881a1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:22.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:22.352+0000 7ff087200700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff088102b30 0x7ff0881a1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:22.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:22.352+0000 7ff087200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff08810fd30 0x7ff08819bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:22.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:22.353+0000 7ff086800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff08810fd30 0x7ff08819bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:22.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:22.353+0000 7ff086800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff08810fd30 0x7ff08819bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:51094/0 (socket says 172.21.15.82:51094) 2024-05-08T05:59:22.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:22.353+0000 7ff086800700 1 -- 172.21.15.82:0/1234901176 learned_addr learned my addr 172.21.15.82:0/1234901176 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:59:22.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:22.353+0000 7ff085400700 1 --2- 172.21.15.82:0/1234901176 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff088102b30 0x7ff0881a1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:22.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:22.353+0000 7ff087200700 1 -- 172.21.15.82:0/1234901176 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff0881157e0 con 0x7ff088102180 2024-05-08T05:59:22.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:22.353+0000 7ff087200700 1 -- 172.21.15.82:0/1234901176 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff088115660 con 0x7ff08810fd30 2024-05-08T05:59:22.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:22.353+0000 7ff087200700 1 -- 172.21.15.82:0/1234901176 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff088115960 con 0x7ff088102b30 2024-05-08T05:59:22.353 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:22.353+0000 7ff085e00700 1 --2- 172.21.15.82:0/1234901176 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff088102180 0x7ff0881a1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:22.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:22.354+0000 7ff086800700 1 -- 172.21.15.82:0/1234901176 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff088102b30 msgr2=0x7ff0881a1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:22.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:22.354+0000 7ff086800700 1 --2- 172.21.15.82:0/1234901176 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff088102b30 0x7ff0881a1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:22.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:22.354+0000 7ff086800700 1 -- 172.21.15.82:0/1234901176 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff088102180 msgr2=0x7ff0881a1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:22.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:22.354+0000 7ff086800700 1 --2- 172.21.15.82:0/1234901176 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff088102180 0x7ff0881a1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:22.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:22.354+0000 7ff086800700 1 -- 172.21.15.82:0/1234901176 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff08819c400 con 0x7ff08810fd30 2024-05-08T05:59:22.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:22.354+0000 7ff085e00700 1 --2- 172.21.15.82:0/1234901176 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff088102180 0x7ff0881a1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:59:22.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:22.354+0000 7ff086800700 1 --2- 172.21.15.82:0/1234901176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff08810fd30 0x7ff08819bb20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff08000ef90 tx=0x7ff08000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:59:22.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:22.354+0000 7ff07ea00700 1 -- 172.21.15.82:0/1234901176 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0800092e0 con 0x7ff08810fd30 2024-05-08T05:59:22.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:22.355+0000 7ff07ea00700 1 -- 172.21.15.82:0/1234901176 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff080004bb0 con 0x7ff08810fd30 2024-05-08T05:59:22.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:22.355+0000 7ff07ea00700 1 -- 172.21.15.82:0/1234901176 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff080004280 con 0x7ff08810fd30 2024-05-08T05:59:22.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:22.355+0000 7ff087200700 1 -- 172.21.15.82:0/1234901176 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff08819c690 con 0x7ff08810fd30 2024-05-08T05:59:22.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:22.355+0000 7ff087200700 1 -- 172.21.15.82:0/1234901176 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0881a8800 con 0x7ff08810fd30 2024-05-08T05:59:22.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:22.356+0000 7ff087200700 1 -- 172.21.15.82:0/1234901176 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff08806ba00 con 0x7ff08810fd30 2024-05-08T05:59:22.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:22.359+0000 7ff07ea00700 1 -- 172.21.15.82:0/1234901176 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7ff08001b030 con 0x7ff08810fd30 2024-05-08T05:59:22.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:22.361+0000 7ff07ea00700 1 --2- 172.21.15.82:0/1234901176 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff06c0b2900 0x7ff06c0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:22.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:22.361+0000 7ff07ea00700 1 -- 172.21.15.82:0/1234901176 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7ff0800e1c70 con 0x7ff08810fd30 2024-05-08T05:59:22.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:22.361+0000 7ff085e00700 1 --2- 172.21.15.82:0/1234901176 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff06c0b2900 0x7ff06c0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:22.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:22.362+0000 7ff085e00700 1 --2- 172.21.15.82:0/1234901176 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff06c0b2900 0x7ff06c0b4dc0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff078009cb0 tx=0x7ff078009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:59:22.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:22.366+0000 7ff07ea00700 1 -- 172.21.15.82:0/1234901176 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff080022020 con 0x7ff08810fd30 2024-05-08T05:59:22.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:22.834+0000 7ff087200700 1 -- 172.21.15.82:0/1234901176 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff08802e510 con 0x7ff08810fd30 2024-05-08T05:59:22.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:22.835+0000 7ff07ea00700 1 -- 172.21.15.82:0/1234901176 <== mon.2 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11948 (secure 0 0 0) 0x7ff080010040 con 0x7ff08810fd30 2024-05-08T05:59:22.839 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T05:59:22.840 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14364,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3876883250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3876883250},{"type":"v1","addr":"172.21.15.82:6835","nonce":3876883250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1965070586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1965070586},{"type":"v1","addr":"172.21.15.82:6837","nonce":1965070586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":31,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T05:45:57.654009+0000","modified":"2024-05-08T05:53:20.165672+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24505,"mds_2":24487,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14397":{"gid":14397,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/1890720973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1890720973},{"type":"v1","addr":"172.21.15.82:6839","nonce":1890720973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14409":{"gid":14409,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/2957083305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":2957083305},{"type":"v1","addr":"172.21.15.82:6841","nonce":2957083305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6833/3827691638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3827691638},{"type":"v1","addr":"172.21.15.134:6833","nonce":3827691638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6833/3625067797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3625067797},{"type":"v1","addr":"172.21.15.151:6833","nonce":3625067797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/4074163402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4074163402},{"type":"v1","addr":"172.21.15.134:6835","nonce":4074163402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.134:6837/2212411710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2212411710},{"type":"v1","addr":"172.21.15.134:6837","nonce":2212411710}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":17,"addr":"172.21.15.151:6835/2093655929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2093655929},{"type":"v1","addr":"172.21.15.151:6835","nonce":2093655929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6837/4192404464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":4192404464},{"type":"v1","addr":"172.21.15.151:6837","nonce":4192404464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":14,"addr":"172.21.15.151:6839/2963754236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":2963754236},{"type":"v1","addr":"172.21.15.151:6839","nonce":2963754236}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.134:6839/1145270893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1145270893},{"type":"v1","addr":"172.21.15.134:6839","nonce":1145270893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24505,24506,24487,24475,24467]},"id":1}]} 2024-05-08T05:59:22.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:22.842+0000 7ff087200700 1 -- 172.21.15.82:0/1234901176 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff06c0b2900 msgr2=0x7ff06c0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:22.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:22.842+0000 7ff087200700 1 --2- 172.21.15.82:0/1234901176 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff06c0b2900 0x7ff06c0b4dc0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff078009cb0 tx=0x7ff078009260 comp rx=0 tx=0).stop 2024-05-08T05:59:22.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:22.842+0000 7ff087200700 1 -- 172.21.15.82:0/1234901176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff08810fd30 msgr2=0x7ff08819bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:22.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:22.842+0000 7ff087200700 1 --2- 172.21.15.82:0/1234901176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff08810fd30 0x7ff08819bb20 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff08000ef90 tx=0x7ff08000c3a0 comp rx=0 tx=0).stop 2024-05-08T05:59:22.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:22.842+0000 7ff087200700 1 -- 172.21.15.82:0/1234901176 shutdown_connections 2024-05-08T05:59:22.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:22.842+0000 7ff087200700 1 --2- 172.21.15.82:0/1234901176 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff08810fd30 0x7ff08819bb20 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:22.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:22.842+0000 7ff087200700 1 --2- 172.21.15.82:0/1234901176 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff06c0b2900 0x7ff06c0b4dc0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:22.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:22.842+0000 7ff087200700 1 --2- 172.21.15.82:0/1234901176 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff088102180 0x7ff0881a1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:22.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:22.842+0000 7ff087200700 1 --2- 172.21.15.82:0/1234901176 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff088102b30 0x7ff0881a1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:22.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:22.842+0000 7ff087200700 1 -- 172.21.15.82:0/1234901176 >> 172.21.15.82:0/1234901176 conn(0x7ff0880fddc0 msgr2=0x7ff0881001b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:59:22.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:22.843+0000 7ff087200700 1 -- 172.21.15.82:0/1234901176 shutdown_connections 2024-05-08T05:59:22.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:22.843+0000 7ff087200700 1 -- 172.21.15.82:0/1234901176 wait complete. 2024-05-08T05:59:22.845 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 31 2024-05-08T05:59:23.693 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-05-08T05:59:23.766 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:59:23 smithi082 ceph-mon[30098]: pgmap v721: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.6 MiB/s wr, 613 op/s 2024-05-08T05:59:23.767 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:59:23 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/1234901176' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:59:23.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:59:23 smithi151 ceph-mon[34815]: pgmap v721: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.6 MiB/s wr, 613 op/s 2024-05-08T05:59:23.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:59:23 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/1234901176' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:59:23.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:59:23 smithi134 ceph-mon[34132]: pgmap v721: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.6 MiB/s wr, 613 op/s 2024-05-08T05:59:24.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:59:23 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/1234901176' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T05:59:24.344 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:59:25.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 515.0 s, 2066.4 tps, lat 48.573 ms stddev 63.676 2024-05-08T05:59:25.670 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:59:25 smithi082 ceph-mon[30098]: pgmap v722: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.3 MiB/s wr, 608 op/s 2024-05-08T05:59:25.801 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:59:25 smithi134 ceph-mon[34132]: pgmap v722: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.3 MiB/s wr, 608 op/s 2024-05-08T05:59:25.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:59:25 smithi151 ceph-mon[34815]: pgmap v722: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.3 MiB/s wr, 608 op/s 2024-05-08T05:59:26.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.572+0000 7f672a200700 1 -- 172.21.15.82:0/1076042380 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6724109510 msgr2=0x7f67241098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:26.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.572+0000 7f672a200700 1 --2- 172.21.15.82:0/1076042380 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6724109510 0x7f67241098f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f6710009990 tx=0x7f6710009ca0 comp rx=0 tx=0).stop 2024-05-08T05:59:26.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.572+0000 7f672a200700 1 -- 172.21.15.82:0/1076042380 shutdown_connections 2024-05-08T05:59:26.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.572+0000 7f672a200700 1 --2- 172.21.15.82:0/1076042380 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6724109510 0x7f67241098f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:26.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.572+0000 7f672a200700 1 --2- 172.21.15.82:0/1076042380 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f672406bb40 0x7f6724110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:26.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.572+0000 7f672a200700 1 --2- 172.21.15.82:0/1076042380 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f672406b180 0x7f672406b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:26.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.572+0000 7f672a200700 1 -- 172.21.15.82:0/1076042380 >> 172.21.15.82:0/1076042380 conn(0x7f6724079350 msgr2=0x7f6724079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:59:26.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.572+0000 7f672a200700 1 -- 172.21.15.82:0/1076042380 shutdown_connections 2024-05-08T05:59:26.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.572+0000 7f672a200700 1 -- 172.21.15.82:0/1076042380 wait complete. 2024-05-08T05:59:26.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.575+0000 7f672a200700 1 Processor -- start 2024-05-08T05:59:26.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.575+0000 7f672a200700 1 -- start start 2024-05-08T05:59:26.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.575+0000 7f672a200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f672406b180 0x7f67241a01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:26.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.575+0000 7f672a200700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f672406bb40 0x7f67241a06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:26.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.576+0000 7f672a200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6724109510 0x7f67241a4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:26.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.576+0000 7f672a200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f6724111570 con 0x7f672406b180 2024-05-08T05:59:26.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.576+0000 7f672a200700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f67241113f0 con 0x7f6724109510 2024-05-08T05:59:26.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.576+0000 7f672a200700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f67241116f0 con 0x7f672406bb40 2024-05-08T05:59:26.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.576+0000 7f6722a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f672406bb40 0x7f67241a06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:26.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.576+0000 7f6722a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f672406bb40 0x7f67241a06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:53776/0 (socket says 172.21.15.82:53776) 2024-05-08T05:59:26.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.576+0000 7f6722a00700 1 -- 172.21.15.82:0/440323327 learned_addr learned my addr 172.21.15.82:0/440323327 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:59:26.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.576+0000 7f6723e00700 1 --2- 172.21.15.82:0/440323327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6724109510 0x7f67241a4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:26.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.577+0000 7f6723400700 1 --2- 172.21.15.82:0/440323327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f672406b180 0x7f67241a01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:26.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.578+0000 7f6722a00700 1 -- 172.21.15.82:0/440323327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6724109510 msgr2=0x7f67241a4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:26.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.578+0000 7f6722a00700 1 --2- 172.21.15.82:0/440323327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6724109510 0x7f67241a4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:26.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.578+0000 7f6722a00700 1 -- 172.21.15.82:0/440323327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f672406b180 msgr2=0x7f67241a01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:26.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.578+0000 7f6722a00700 1 --2- 172.21.15.82:0/440323327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f672406b180 0x7f67241a01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:26.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.578+0000 7f6722a00700 1 -- 172.21.15.82:0/440323327 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67241a51c0 con 0x7f672406bb40 2024-05-08T05:59:26.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.578+0000 7f6723e00700 1 --2- 172.21.15.82:0/440323327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6724109510 0x7f67241a4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:59:26.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.578+0000 7f6722a00700 1 --2- 172.21.15.82:0/440323327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f672406bb40 0x7f67241a06f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f671400eb30 tx=0x7f671400ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:59:26.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.579+0000 7f6723400700 1 --2- 172.21.15.82:0/440323327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f672406b180 0x7f67241a01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:59:26.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.579+0000 7f671be00700 1 -- 172.21.15.82:0/440323327 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f671400cc90 con 0x7f672406bb40 2024-05-08T05:59:26.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.579+0000 7f672a200700 1 -- 172.21.15.82:0/440323327 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67241a54b0 con 0x7f672406bb40 2024-05-08T05:59:26.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.579+0000 7f671be00700 1 -- 172.21.15.82:0/440323327 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f67140044d0 con 0x7f672406bb40 2024-05-08T05:59:26.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.579+0000 7f671be00700 1 -- 172.21.15.82:0/440323327 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f671400cc90 con 0x7f672406bb40 2024-05-08T05:59:26.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.580+0000 7f672a200700 1 -- 172.21.15.82:0/440323327 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6724196a00 con 0x7f672406bb40 2024-05-08T05:59:26.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.589+0000 7f6734ab5b80 1 Processor -- start 2024-05-08T05:59:26.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.590+0000 7f6734ab5b80 1 -- start start 2024-05-08T05:59:26.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.591+0000 7f671be00700 1 -- 172.21.15.82:0/440323327 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f6714003cb0 con 0x7f672406bb40 2024-05-08T05:59:26.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.591+0000 7f6734ab5b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611cdc3d060 0x5611cdc3d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:26.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.592+0000 7f6734ab5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611cdc3d980 0x5611cdc41490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:26.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.593+0000 7f6734ab5b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611cdc419d0 0x5611cdc41e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:26.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.593+0000 7f6734ab5b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5611cdb8fa20 con 0x5611cdc3d060 2024-05-08T05:59:26.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.593+0000 7f6734ab5b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5611cdb2d760 con 0x5611cdc419d0 2024-05-08T05:59:26.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.593+0000 7f6734ab5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5611cdb8b9e0 con 0x5611cdc3d980 2024-05-08T05:59:26.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.593+0000 7f6723e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611cdc3d060 0x5611cdc3d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:26.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.593+0000 7f6723e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611cdc3d060 0x5611cdc3d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43756/0 (socket says 172.21.15.82:43756) 2024-05-08T05:59:26.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.593+0000 7f6723e00700 1 -- 172.21.15.82:0/2878517293 learned_addr learned my addr 172.21.15.82:0/2878517293 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:59:26.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.595+0000 7f6723400700 1 --2- 172.21.15.82:0/2878517293 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611cdc3d980 0x5611cdc41490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:26.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.595+0000 7f6723400700 1 -- 172.21.15.82:0/2878517293 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611cdc419d0 msgr2=0x5611cdc41e30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T05:59:26.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.595+0000 7f6723400700 1 --2- 172.21.15.82:0/2878517293 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611cdc419d0 0x5611cdc41e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:26.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.595+0000 7f6723400700 1 -- 172.21.15.82:0/2878517293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611cdc3d060 msgr2=0x5611cdc3d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:26.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.595+0000 7f6723400700 1 --2- 172.21.15.82:0/2878517293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611cdc3d060 0x5611cdc3d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:26.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.595+0000 7f6723400700 1 -- 172.21.15.82:0/2878517293 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611cdadc8d0 con 0x5611cdc3d980 2024-05-08T05:59:26.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.595+0000 7f671be00700 1 --2- 172.21.15.82:0/440323327 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f67080b2bb0 0x7f67080b5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:26.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.596+0000 7f6723400700 1 --2- 172.21.15.82:0/2878517293 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611cdc3d980 0x5611cdc41490 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6710000c00 tx=0x7f67100096c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8aa1fea678252960 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:59:26.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.596+0000 7f671be00700 1 -- 172.21.15.82:0/440323327 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f67140e2020 con 0x7f672406bb40 2024-05-08T05:59:26.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.596+0000 7f6718c00700 1 -- 172.21.15.82:0/2878517293 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6710026070 con 0x5611cdc3d980 2024-05-08T05:59:26.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.596+0000 7f6718c00700 1 -- 172.21.15.82:0/2878517293 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6710005430 con 0x5611cdc3d980 2024-05-08T05:59:26.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.596+0000 7f6718c00700 1 -- 172.21.15.82:0/2878517293 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6710003a40 con 0x5611cdc3d980 2024-05-08T05:59:26.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.597+0000 7f6723e00700 1 --2- 172.21.15.82:0/440323327 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f67080b2bb0 0x7f67080b5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:26.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.598+0000 7f6734ab5b80 1 -- 172.21.15.82:0/2878517293 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611cdc3d980 msgr2=0x5611cdc41490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:26.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.598+0000 7f6734ab5b80 1 --2- 172.21.15.82:0/2878517293 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611cdc3d980 0x5611cdc41490 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6710000c00 tx=0x7f67100096c0 comp rx=0 tx=0).stop 2024-05-08T05:59:26.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.598+0000 7f6723e00700 1 --2- 172.21.15.82:0/440323327 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f67080b2bb0 0x7f67080b5070 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f671c009440 tx=0x7f671c00d040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:59:26.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.599+0000 7f6734ab5b80 1 -- 172.21.15.82:0/2878517293 shutdown_connections 2024-05-08T05:59:26.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.599+0000 7f6734ab5b80 1 --2- 172.21.15.82:0/2878517293 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611cdc419d0 0x5611cdc41e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:26.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.599+0000 7f6734ab5b80 1 --2- 172.21.15.82:0/2878517293 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611cdc3d060 0x5611cdc3d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:26.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.599+0000 7f6734ab5b80 1 --2- 172.21.15.82:0/2878517293 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611cdc3d980 0x5611cdc41490 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:26.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.599+0000 7f6734ab5b80 1 -- 172.21.15.82:0/2878517293 >> 172.21.15.82:0/2878517293 conn(0x5611cdb6bb60 msgr2=0x5611cdc377a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:59:26.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.599+0000 7f6734ab5b80 1 -- 172.21.15.82:0/2878517293 shutdown_connections 2024-05-08T05:59:26.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.599+0000 7f6734ab5b80 1 -- 172.21.15.82:0/2878517293 wait complete. 2024-05-08T05:59:26.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.601+0000 7f6734ab5b80 1 -- start start 2024-05-08T05:59:26.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.601+0000 7f6734ab5b80 1 Processor -- start 2024-05-08T05:59:26.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.603+0000 7f6734ab5b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611cdc3d060 0x5611cdc48dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:26.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.603+0000 7f6734ab5b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611cdc3d980 0x5611cdc461c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:26.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.603+0000 7f6734ab5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611cdc419d0 0x5611cdc46700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:26.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.603+0000 7f6734ab5b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5611cdc49b80 con 0x5611cdc3d980 2024-05-08T05:59:26.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.603+0000 7f6734ab5b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5611cdaf5b20 con 0x5611cdc3d060 2024-05-08T05:59:26.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.603+0000 7f6734ab5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5611cdc49d00 con 0x5611cdc419d0 2024-05-08T05:59:26.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.603+0000 7f6734ab5b80 10 client.0 _ll_register_callbacks cb 0x5611cdb36c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:59:26.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.604+0000 7f6723e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611cdc419d0 0x5611cdc46700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:26.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.604+0000 7f6723e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611cdc419d0 0x5611cdc46700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:53796/0 (socket says 172.21.15.82:53796) 2024-05-08T05:59:26.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.604+0000 7f6723e00700 1 -- 172.21.15.82:0/2081408156 learned_addr learned my addr 172.21.15.82:0/2081408156 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:59:26.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.604+0000 7f6723400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611cdc3d060 0x5611cdc48dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:26.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.604+0000 7f6722a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611cdc3d980 0x5611cdc461c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:26.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.605+0000 7f6723e00700 1 -- 172.21.15.82:0/2081408156 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611cdc3d060 msgr2=0x5611cdc48dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:26.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.605+0000 7f6723e00700 1 --2- 172.21.15.82:0/2081408156 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611cdc3d060 0x5611cdc48dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:26.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.605+0000 7f6723e00700 1 -- 172.21.15.82:0/2081408156 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611cdc3d980 msgr2=0x5611cdc461c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:26.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.605+0000 7f6723e00700 1 --2- 172.21.15.82:0/2081408156 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611cdc3d980 0x5611cdc461c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:26.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.605+0000 7f6723e00700 1 -- 172.21.15.82:0/2081408156 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611cdb55420 con 0x5611cdc419d0 2024-05-08T05:59:26.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.606+0000 7f6723e00700 1 --2- 172.21.15.82:0/2081408156 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611cdc419d0 0x5611cdc46700 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f671c018bd0 tx=0x7f671c004be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7902dac2f0c6c9bd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:59:26.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.606+0000 7f670d600700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:59:26.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.606+0000 7f670d600700 1 -- 172.21.15.82:0/2081408156 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f671c028060 con 0x5611cdc419d0 2024-05-08T05:59:26.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.607+0000 7f670d600700 1 -- 172.21.15.82:0/2081408156 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f671c016d20 con 0x5611cdc419d0 2024-05-08T05:59:26.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.607+0000 7f6734ab5b80 1 -- 172.21.15.82:0/2081408156 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6710005430 con 0x5611cdc419d0 2024-05-08T05:59:26.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.607+0000 7f670d600700 1 -- 172.21.15.82:0/2081408156 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f671c0233f0 con 0x5611cdc419d0 2024-05-08T05:59:26.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.607+0000 7f6734ab5b80 10 client.26155 fetch_fsmap learned FSMap version 31 2024-05-08T05:59:26.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.607+0000 7f6734ab5b80 1 -- 172.21.15.82:0/2081408156 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5611cdc54470 con 0x5611cdc419d0 2024-05-08T05:59:26.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.607+0000 7f670d600700 1 -- 172.21.15.82:0/2081408156 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f6710005430 con 0x5611cdc419d0 2024-05-08T05:59:26.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.608+0000 7f670d600700 1 -- 172.21.15.82:0/2081408156 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f671c022070 con 0x5611cdc419d0 2024-05-08T05:59:26.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.608+0000 7f6734ab5b80 10 client.26155 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:59:26.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.608+0000 7f6734ab5b80 10 client.26155 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-05-08T05:59:26.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.608+0000 7f6734ab5b80 20 client.26155 populate_metadata read hostname 'smithi082' 2024-05-08T05:59:26.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.608+0000 7f6734ab5b80 1 --2- 172.21.15.82:0/2081408156 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x5611cdc56a00 0x5611cdc58df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:26.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.608+0000 7f6734ab5b80 4 client.26155 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:59:26.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.608+0000 7f6734ab5b80 1 -- 172.21.15.82:0/2081408156 --> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5611cdc0a0a0 con 0x5611cdc56a00 2024-05-08T05:59:26.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.609+0000 7f6723400700 1 --2- 172.21.15.82:0/2081408156 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x5611cdc56a00 0x5611cdc58df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:26.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.609+0000 7f670d600700 10 client.26155 ms_handle_connect on v2:172.21.15.134:6836/2212411710 2024-05-08T05:59:26.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.610+0000 7f6723400700 1 --2- 172.21.15.82:0/2081408156 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x5611cdc56a00 0x5611cdc58df0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=eb183e895d06b6e server_cookie=5c8df31a64703ab2 in_seq=0 out_seq=0 2024-05-08T05:59:26.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.611+0000 7f670d600700 1 -- 172.21.15.82:0/2081408156 <== mds.4 v2:172.21.15.134:6836/2212411710 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5611cdc0a0a0 con 0x5611cdc56a00 2024-05-08T05:59:26.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.611+0000 7f670d600700 10 client.26155 handle_command_reply: tid=0 2024-05-08T05:59:26.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.611+0000 7f6734ab5b80 1 client.26155 shutdown 2024-05-08T05:59:26.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.612+0000 7f6734ab5b80 1 -- 172.21.15.82:0/2081408156 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611cdc419d0 msgr2=0x5611cdc46700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:26.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.612+0000 7f6734ab5b80 1 --2- 172.21.15.82:0/2081408156 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611cdc419d0 0x5611cdc46700 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f671c018bd0 tx=0x7f671c004be0 comp rx=0 tx=0).stop 2024-05-08T05:59:26.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.612+0000 7f6734ab5b80 1 -- 172.21.15.82:0/2081408156 shutdown_connections 2024-05-08T05:59:26.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.612+0000 7f6734ab5b80 1 --2- 172.21.15.82:0/2081408156 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x5611cdc56a00 0x5611cdc58df0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:26.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.612+0000 7f6734ab5b80 1 --2- 172.21.15.82:0/2081408156 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611cdc3d060 0x5611cdc48dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:26.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.612+0000 7f6734ab5b80 1 --2- 172.21.15.82:0/2081408156 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611cdc419d0 0x5611cdc46700 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:26.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.612+0000 7f6734ab5b80 1 --2- 172.21.15.82:0/2081408156 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611cdc3d980 0x5611cdc461c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:26.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.612+0000 7f6734ab5b80 1 -- 172.21.15.82:0/2081408156 >> 172.21.15.82:0/2081408156 conn(0x5611cdb6bb60 msgr2=0x5611cdc322b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:59:26.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.612+0000 7f670d600700 0 client.26155 ms_handle_reset on v2:172.21.15.134:6836/2212411710 2024-05-08T05:59:26.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.612+0000 7f6734ab5b80 1 -- 172.21.15.82:0/2081408156 shutdown_connections 2024-05-08T05:59:26.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.612+0000 7f6734ab5b80 1 -- 172.21.15.82:0/2081408156 wait complete. 2024-05-08T05:59:26.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.614+0000 7f6734ab5b80 20 client.26155 trim_cache size 0 max 16384 2024-05-08T05:59:26.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.639+0000 7f6734ab5b80 1 Processor -- start 2024-05-08T05:59:26.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.640+0000 7f6734ab5b80 1 -- start start 2024-05-08T05:59:26.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.640+0000 7f6734ab5b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611cdc3d060 0x5611cdc46750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:26.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.640+0000 7f6734ab5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611cdc3d980 0x5611cdc52ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:26.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.640+0000 7f6734ab5b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611cdc419d0 0x5611cdc42c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:26.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.640+0000 7f6734ab5b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f670400d450 con 0x5611cdc3d060 2024-05-08T05:59:26.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.640+0000 7f6734ab5b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f670400ef90 con 0x5611cdc419d0 2024-05-08T05:59:26.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.640+0000 7f6734ab5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f670400db20 con 0x5611cdc3d980 2024-05-08T05:59:26.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.641+0000 7f6722a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611cdc3d980 0x5611cdc52ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:26.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.641+0000 7f6722a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611cdc3d980 0x5611cdc52ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:53798/0 (socket says 172.21.15.82:53798) 2024-05-08T05:59:26.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.641+0000 7f6722a00700 1 -- 172.21.15.82:0/3769425386 learned_addr learned my addr 172.21.15.82:0/3769425386 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:59:26.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.641+0000 7f6723e00700 1 --2- 172.21.15.82:0/3769425386 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611cdc419d0 0x5611cdc42c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:26.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.641+0000 7f6723400700 1 --2- 172.21.15.82:0/3769425386 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611cdc3d060 0x5611cdc46750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:26.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.641+0000 7f6722a00700 1 -- 172.21.15.82:0/3769425386 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611cdc419d0 msgr2=0x5611cdc42c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:26.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.641+0000 7f6722a00700 1 --2- 172.21.15.82:0/3769425386 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611cdc419d0 0x5611cdc42c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:26.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.641+0000 7f6722a00700 1 -- 172.21.15.82:0/3769425386 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611cdc3d060 msgr2=0x5611cdc46750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:26.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.642+0000 7f6722a00700 1 --2- 172.21.15.82:0/3769425386 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611cdc3d060 0x5611cdc46750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:26.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.642+0000 7f6722a00700 1 -- 172.21.15.82:0/3769425386 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611cdc343f0 con 0x5611cdc3d980 2024-05-08T05:59:26.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.642+0000 7f6723400700 1 --2- 172.21.15.82:0/3769425386 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611cdc3d060 0x5611cdc46750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:59:26.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.642+0000 7f6722a00700 1 --2- 172.21.15.82:0/3769425386 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611cdc3d980 0x5611cdc52ca0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f67140a92f0 tx=0x7f67140a8de0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6bb67392ffe35839 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:59:26.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.643+0000 7f670fe00700 1 -- 172.21.15.82:0/3769425386 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67140c3070 con 0x5611cdc3d980 2024-05-08T05:59:26.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.643+0000 7f670fe00700 1 -- 172.21.15.82:0/3769425386 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f67140a9cf0 con 0x5611cdc3d980 2024-05-08T05:59:26.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.643+0000 7f670fe00700 1 -- 172.21.15.82:0/3769425386 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67140a9850 con 0x5611cdc3d980 2024-05-08T05:59:26.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.644+0000 7f6734ab5b80 1 -- 172.21.15.82:0/3769425386 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611cdc3d980 msgr2=0x5611cdc52ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:26.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.644+0000 7f6734ab5b80 1 --2- 172.21.15.82:0/3769425386 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611cdc3d980 0x5611cdc52ca0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f67140a92f0 tx=0x7f67140a8de0 comp rx=0 tx=0).stop 2024-05-08T05:59:26.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.644+0000 7f6734ab5b80 1 -- 172.21.15.82:0/3769425386 shutdown_connections 2024-05-08T05:59:26.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.644+0000 7f6734ab5b80 1 --2- 172.21.15.82:0/3769425386 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611cdc419d0 0x5611cdc42c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:26.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.644+0000 7f6734ab5b80 1 --2- 172.21.15.82:0/3769425386 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611cdc3d060 0x5611cdc46750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:26.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.644+0000 7f6734ab5b80 1 --2- 172.21.15.82:0/3769425386 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611cdc3d980 0x5611cdc52ca0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:26.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.644+0000 7f6734ab5b80 1 -- 172.21.15.82:0/3769425386 >> 172.21.15.82:0/3769425386 conn(0x5611cdb6bb60 msgr2=0x5611cdc42500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:59:26.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.645+0000 7f6734ab5b80 1 -- 172.21.15.82:0/3769425386 shutdown_connections 2024-05-08T05:59:26.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.645+0000 7f6734ab5b80 1 -- 172.21.15.82:0/3769425386 wait complete. 2024-05-08T05:59:26.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.646+0000 7f6734ab5b80 1 -- start start 2024-05-08T05:59:26.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.646+0000 7f6734ab5b80 1 Processor -- start 2024-05-08T05:59:26.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.647+0000 7f6734ab5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611cdc3d060 0x5611cdc4f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:26.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.647+0000 7f6734ab5b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611cdc3d980 0x5611cdc3f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:26.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.647+0000 7f6734ab5b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611cdc419d0 0x5611cdc3f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:26.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.648+0000 7f6722a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611cdc3d980 0x5611cdc3f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:26.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.648+0000 7f6722a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611cdc3d980 0x5611cdc3f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:50172/0 (socket says 172.21.15.82:50172) 2024-05-08T05:59:26.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.648+0000 7f6722a00700 1 -- 172.21.15.82:0/405836483 learned_addr learned my addr 172.21.15.82:0/405836483 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:59:26.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.649+0000 7f6734ab5b80 1 -- 172.21.15.82:0/405836483 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f670400e8c0 con 0x5611cdc419d0 2024-05-08T05:59:26.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.649+0000 7f6734ab5b80 1 -- 172.21.15.82:0/405836483 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f670400e1f0 con 0x5611cdc3d980 2024-05-08T05:59:26.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.649+0000 7f6734ab5b80 1 -- 172.21.15.82:0/405836483 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f670400b3f0 con 0x5611cdc3d060 2024-05-08T05:59:26.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.649+0000 7f6734ab5b80 10 client.0 _ll_register_callbacks cb 0x5611cdb36c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:59:26.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.649+0000 7f6723400700 1 --2- 172.21.15.82:0/405836483 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611cdc3d060 0x5611cdc4f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:26.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.649+0000 7f6723400700 1 -- 172.21.15.82:0/405836483 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611cdc3d980 msgr2=0x5611cdc3f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:26.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.649+0000 7f6723400700 1 --2- 172.21.15.82:0/405836483 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611cdc3d980 0x5611cdc3f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:26.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.649+0000 7f6723400700 1 -- 172.21.15.82:0/405836483 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611cdc419d0 msgr2=0x5611cdc3f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:26.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.649+0000 7f6723400700 1 --2- 172.21.15.82:0/405836483 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611cdc419d0 0x5611cdc3f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:26.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.649+0000 7f6723400700 1 -- 172.21.15.82:0/405836483 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611cdc5dd50 con 0x5611cdc3d060 2024-05-08T05:59:26.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.650+0000 7f6723400700 1 --2- 172.21.15.82:0/405836483 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611cdc3d060 0x5611cdc4f480 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f671000bf20 tx=0x7f6710005e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3bb11650df9ca6f1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:59:26.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.650+0000 7f670d600700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:59:26.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.651+0000 7f670d600700 1 -- 172.21.15.82:0/405836483 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6710026040 con 0x5611cdc3d060 2024-05-08T05:59:26.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.651+0000 7f670d600700 1 -- 172.21.15.82:0/405836483 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f6710005430 con 0x5611cdc3d060 2024-05-08T05:59:26.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.651+0000 7f6734ab5b80 1 -- 172.21.15.82:0/405836483 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67140a9cf0 con 0x5611cdc3d060 2024-05-08T05:59:26.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.651+0000 7f670d600700 1 -- 172.21.15.82:0/405836483 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f671000b720 con 0x5611cdc3d060 2024-05-08T05:59:26.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.651+0000 7f6734ab5b80 10 client.26161 fetch_fsmap learned FSMap version 31 2024-05-08T05:59:26.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.651+0000 7f6734ab5b80 1 -- 172.21.15.82:0/405836483 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5611cdcc1370 con 0x5611cdc3d060 2024-05-08T05:59:26.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.651+0000 7f670d600700 1 -- 172.21.15.82:0/405836483 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f67140a9cf0 con 0x5611cdc3d060 2024-05-08T05:59:26.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.651+0000 7f670d600700 1 -- 172.21.15.82:0/405836483 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f671002d460 con 0x5611cdc3d060 2024-05-08T05:59:26.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.652+0000 7f6734ab5b80 10 client.26161 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:59:26.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.652+0000 7f6734ab5b80 10 client.26161 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-05-08T05:59:26.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.652+0000 7f6734ab5b80 20 client.26161 populate_metadata read hostname 'smithi082' 2024-05-08T05:59:26.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.652+0000 7f6734ab5b80 1 --2- 172.21.15.82:0/405836483 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x5611cdcc1660 0x5611cdcc3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:26.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.652+0000 7f6734ab5b80 4 client.26161 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:59:26.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.652+0000 7f6734ab5b80 1 -- 172.21.15.82:0/405836483 --> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5611cdb9d400 con 0x5611cdcc1660 2024-05-08T05:59:26.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.652+0000 7f6722a00700 1 --2- 172.21.15.82:0/405836483 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x5611cdcc1660 0x5611cdcc3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:26.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.653+0000 7f670d600700 10 client.26161 ms_handle_connect on v2:172.21.15.134:6836/2212411710 2024-05-08T05:59:26.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.653+0000 7f6722a00700 1 --2- 172.21.15.82:0/405836483 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x5611cdcc1660 0x5611cdcc3a50 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=249252b5f29fb36c server_cookie=52f8ff68e6adeb0f in_seq=0 out_seq=0 2024-05-08T05:59:26.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.653+0000 7f670d600700 1 -- 172.21.15.82:0/405836483 <== mds.4 v2:172.21.15.134:6836/2212411710 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5611cdb9d400 con 0x5611cdcc1660 2024-05-08T05:59:26.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.653+0000 7f670d600700 10 client.26161 handle_command_reply: tid=0 2024-05-08T05:59:26.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.654+0000 7f6734ab5b80 1 client.26161 shutdown 2024-05-08T05:59:26.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.655+0000 7f6734ab5b80 1 -- 172.21.15.82:0/405836483 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611cdc3d060 msgr2=0x5611cdc4f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:26.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.655+0000 7f6734ab5b80 1 --2- 172.21.15.82:0/405836483 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611cdc3d060 0x5611cdc4f480 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f671000bf20 tx=0x7f6710005e80 comp rx=0 tx=0).stop 2024-05-08T05:59:26.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.655+0000 7f6734ab5b80 1 -- 172.21.15.82:0/405836483 shutdown_connections 2024-05-08T05:59:26.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.655+0000 7f6734ab5b80 1 --2- 172.21.15.82:0/405836483 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x5611cdcc1660 0x5611cdcc3a50 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:26.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.655+0000 7f6734ab5b80 1 --2- 172.21.15.82:0/405836483 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5611cdc419d0 0x5611cdc3f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:26.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.655+0000 7f6734ab5b80 1 --2- 172.21.15.82:0/405836483 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611cdc3d060 0x5611cdc4f480 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:26.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.655+0000 7f6734ab5b80 1 --2- 172.21.15.82:0/405836483 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611cdc3d980 0x5611cdc3f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:26.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.655+0000 7f6734ab5b80 1 -- 172.21.15.82:0/405836483 >> 172.21.15.82:0/405836483 conn(0x5611cdb6bb60 msgr2=0x5611cdc31a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:59:26.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.655+0000 7f670d600700 0 client.26161 ms_handle_reset on v2:172.21.15.134:6836/2212411710 2024-05-08T05:59:26.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.655+0000 7f6734ab5b80 1 -- 172.21.15.82:0/405836483 shutdown_connections 2024-05-08T05:59:26.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.656+0000 7f6734ab5b80 1 -- 172.21.15.82:0/405836483 wait complete. 2024-05-08T05:59:26.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.656+0000 7f6734ab5b80 20 client.26161 trim_cache size 0 max 16384 2024-05-08T05:59:26.656 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T05:59:26.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.657+0000 7f672a200700 1 -- 172.21.15.82:0/440323327 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f67080b2bb0 msgr2=0x7f67080b5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:26.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.657+0000 7f672a200700 1 --2- 172.21.15.82:0/440323327 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f67080b2bb0 0x7f67080b5070 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f671c009440 tx=0x7f671c00d040 comp rx=0 tx=0).stop 2024-05-08T05:59:26.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.657+0000 7f672a200700 1 -- 172.21.15.82:0/440323327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f672406bb40 msgr2=0x7f67241a06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:26.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.657+0000 7f672a200700 1 --2- 172.21.15.82:0/440323327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f672406bb40 0x7f67241a06f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f671400eb30 tx=0x7f671400ee40 comp rx=0 tx=0).stop 2024-05-08T05:59:26.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.657+0000 7f672a200700 1 -- 172.21.15.82:0/440323327 shutdown_connections 2024-05-08T05:59:26.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.657+0000 7f672a200700 1 --2- 172.21.15.82:0/440323327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6724109510 0x7f67241a4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:26.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.657+0000 7f672a200700 1 --2- 172.21.15.82:0/440323327 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f67080b2bb0 0x7f67080b5070 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:26.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.657+0000 7f672a200700 1 --2- 172.21.15.82:0/440323327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f672406b180 0x7f67241a01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:26.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.657+0000 7f672a200700 1 --2- 172.21.15.82:0/440323327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f672406bb40 0x7f67241a06f0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:26.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.657+0000 7f672a200700 1 -- 172.21.15.82:0/440323327 >> 172.21.15.82:0/440323327 conn(0x7f6724079350 msgr2=0x7f6724100fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:59:26.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.658+0000 7f672a200700 1 -- 172.21.15.82:0/440323327 shutdown_connections 2024-05-08T05:59:26.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:26.658+0000 7f672a200700 1 -- 172.21.15.82:0/440323327 wait complete. 2024-05-08T05:59:27.719 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-05-08T05:59:27.807 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:59:27 smithi082 ceph-mon[30098]: pgmap v723: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.4 MiB/s wr, 766 op/s 2024-05-08T05:59:27.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:59:27 smithi151 ceph-mon[34815]: pgmap v723: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.4 MiB/s wr, 766 op/s 2024-05-08T05:59:28.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:59:27 smithi134 ceph-mon[34132]: pgmap v723: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.4 MiB/s wr, 766 op/s 2024-05-08T05:59:28.321 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:59:29.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:59:29 smithi151 ceph-mon[34815]: pgmap v724: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.3 MiB/s wr, 610 op/s 2024-05-08T05:59:29.890 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:59:29 smithi082 ceph-mon[30098]: pgmap v724: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.3 MiB/s wr, 610 op/s 2024-05-08T05:59:30.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:59:29 smithi134 ceph-mon[34132]: pgmap v724: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.3 MiB/s wr, 610 op/s 2024-05-08T05:59:30.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 520.0 s, 1920.0 tps, lat 52.039 ms stddev 62.239 2024-05-08T05:59:30.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.811+0000 7f874b600700 1 -- 172.21.15.82:0/3257914244 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f874410b6e0 msgr2=0x7f874410bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:30.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.811+0000 7f874b600700 1 --2- 172.21.15.82:0/3257914244 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f874410b6e0 0x7f874410bac0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f873c009f90 tx=0x7f873c00b330 comp rx=0 tx=0).stop 2024-05-08T05:59:30.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.811+0000 7f874b600700 1 -- 172.21.15.82:0/3257914244 shutdown_connections 2024-05-08T05:59:30.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.811+0000 7f874b600700 1 --2- 172.21.15.82:0/3257914244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f87441060a0 0x7f87441125b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:30.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.811+0000 7f874b600700 1 --2- 172.21.15.82:0/3257914244 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f874410b6e0 0x7f874410bac0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:30.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.811+0000 7f874b600700 1 --2- 172.21.15.82:0/3257914244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87441056e0 0x7f8744105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:30.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.811+0000 7f874b600700 1 -- 172.21.15.82:0/3257914244 >> 172.21.15.82:0/3257914244 conn(0x7f87441011d0 msgr2=0x7f87441035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:59:30.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.812+0000 7f874b600700 1 -- 172.21.15.82:0/3257914244 shutdown_connections 2024-05-08T05:59:30.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.812+0000 7f874b600700 1 -- 172.21.15.82:0/3257914244 wait complete. 2024-05-08T05:59:30.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.815+0000 7f874b600700 1 Processor -- start 2024-05-08T05:59:30.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.815+0000 7f874b600700 1 -- start start 2024-05-08T05:59:30.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.816+0000 7f874b600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87441056e0 0x7f87440779b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:30.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.816+0000 7f874b600700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87441060a0 0x7f8744077ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:30.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.816+0000 7f874b600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f874410b6e0 0x7f8744078430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:30.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.816+0000 7f874b600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8744115920 con 0x7f874410b6e0 2024-05-08T05:59:30.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.816+0000 7f874b600700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f87441157a0 con 0x7f87441056e0 2024-05-08T05:59:30.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.816+0000 7f874b600700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8744115aa0 con 0x7f87441060a0 2024-05-08T05:59:30.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.816+0000 7f8748c00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87441056e0 0x7f87440779b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:30.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.817+0000 7f8748c00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87441056e0 0x7f87440779b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:50198/0 (socket says 172.21.15.82:50198) 2024-05-08T05:59:30.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.817+0000 7f8748c00700 1 -- 172.21.15.82:0/951192646 learned_addr learned my addr 172.21.15.82:0/951192646 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:59:30.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.817+0000 7f8749600700 1 --2- 172.21.15.82:0/951192646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f874410b6e0 0x7f8744078430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:30.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.817+0000 7f8748c00700 1 -- 172.21.15.82:0/951192646 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87441060a0 msgr2=0x7f8744077ef0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-08T05:59:30.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.817+0000 7f8748c00700 1 --2- 172.21.15.82:0/951192646 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87441060a0 0x7f8744077ef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:30.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.817+0000 7f8748c00700 1 -- 172.21.15.82:0/951192646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f874410b6e0 msgr2=0x7f8744078430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:30.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.817+0000 7f8748c00700 1 --2- 172.21.15.82:0/951192646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f874410b6e0 0x7f8744078430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:30.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.817+0000 7f8748c00700 1 -- 172.21.15.82:0/951192646 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87441ac460 con 0x7f87441056e0 2024-05-08T05:59:30.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.817+0000 7f8749600700 1 --2- 172.21.15.82:0/951192646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f874410b6e0 0x7f8744078430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:59:30.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.818+0000 7f8748c00700 1 --2- 172.21.15.82:0/951192646 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87441056e0 0x7f87440779b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f873c00cd80 tx=0x7f873c00ce60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:59:30.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.818+0000 7f8741600700 1 -- 172.21.15.82:0/951192646 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f873c021020 con 0x7f87441056e0 2024-05-08T05:59:30.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.818+0000 7f874b600700 1 -- 172.21.15.82:0/951192646 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87441ac6f0 con 0x7f87441056e0 2024-05-08T05:59:30.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.818+0000 7f874b600700 1 -- 172.21.15.82:0/951192646 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87441acbf0 con 0x7f87441056e0 2024-05-08T05:59:30.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.818+0000 7f8741600700 1 -- 172.21.15.82:0/951192646 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f873c007420 con 0x7f87441056e0 2024-05-08T05:59:30.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.818+0000 7f8741600700 1 -- 172.21.15.82:0/951192646 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f873c01de20 con 0x7f87441056e0 2024-05-08T05:59:30.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.826+0000 7f8741600700 1 -- 172.21.15.82:0/951192646 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f873c024020 con 0x7f87441056e0 2024-05-08T05:59:30.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.827+0000 7f8755fa7b80 1 Processor -- start 2024-05-08T05:59:30.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.829+0000 7f8741600700 1 --2- 172.21.15.82:0/951192646 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f87280b2980 0x7f87280b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:30.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.829+0000 7f8741600700 1 -- 172.21.15.82:0/951192646 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f873c00f020 con 0x7f87441056e0 2024-05-08T05:59:30.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.830+0000 7f8755fa7b80 1 -- start start 2024-05-08T05:59:30.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.831+0000 7f8755fa7b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55602fd78060 0x55602fd78440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:30.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.831+0000 7f8755fa7b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55602fd78980 0x55602fd7c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:30.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.831+0000 7f8755fa7b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55602fd7c9d0 0x55602fd7ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:30.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.831+0000 7f8755fa7b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55602fccaa20 con 0x55602fd78060 2024-05-08T05:59:30.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.831+0000 7f8755fa7b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55602fc68760 con 0x55602fd7c9d0 2024-05-08T05:59:30.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.831+0000 7f8755fa7b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55602fcc69e0 con 0x55602fd78980 2024-05-08T05:59:30.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.831+0000 7f8749600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55602fd7c9d0 0x55602fd7ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:30.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.831+0000 7f8749600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55602fd7c9d0 0x55602fd7ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:50214/0 (socket says 172.21.15.82:50214) 2024-05-08T05:59:30.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.831+0000 7f8749600700 1 -- 172.21.15.82:0/628224985 learned_addr learned my addr 172.21.15.82:0/628224985 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:59:30.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.832+0000 7f8749600700 1 -- 172.21.15.82:0/628224985 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55602fd78980 msgr2=0x55602fd7c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:30.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.832+0000 7f8749600700 1 --2- 172.21.15.82:0/628224985 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55602fd78980 0x55602fd7c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:30.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.832+0000 7f8749600700 1 -- 172.21.15.82:0/628224985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55602fd78060 msgr2=0x55602fd78440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T05:59:30.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.832+0000 7f8749600700 1 --2- 172.21.15.82:0/628224985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55602fd78060 0x55602fd78440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:30.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.832+0000 7f8749600700 1 -- 172.21.15.82:0/628224985 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55602fc178d0 con 0x55602fd7c9d0 2024-05-08T05:59:30.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.832+0000 7f8749600700 1 --2- 172.21.15.82:0/951192646 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f87280b2980 0x7f87280b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:30.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.832+0000 7f8749600700 1 --2- 172.21.15.82:0/628224985 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55602fd7c9d0 0x55602fd7ce30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8734009ce0 tx=0x7f87340113e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd08ffb37f75f60 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:59:30.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.834+0000 7f873a000700 1 -- 172.21.15.82:0/628224985 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8734011db0 con 0x55602fd7c9d0 2024-05-08T05:59:30.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.834+0000 7f8749600700 1 --2- 172.21.15.82:0/951192646 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f87280b2980 0x7f87280b4e40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8734005950 tx=0x7f8734017000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:59:30.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.835+0000 7f873a000700 1 -- 172.21.15.82:0/628224985 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8734021070 con 0x55602fd7c9d0 2024-05-08T05:59:30.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.835+0000 7f873a000700 1 -- 172.21.15.82:0/628224985 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f873401c650 con 0x55602fd7c9d0 2024-05-08T05:59:30.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.837+0000 7f8755fa7b80 1 -- 172.21.15.82:0/628224985 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55602fd7c9d0 msgr2=0x55602fd7ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:30.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.838+0000 7f8755fa7b80 1 --2- 172.21.15.82:0/628224985 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55602fd7c9d0 0x55602fd7ce30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8734009ce0 tx=0x7f87340113e0 comp rx=0 tx=0).stop 2024-05-08T05:59:30.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.839+0000 7f8755fa7b80 1 -- 172.21.15.82:0/628224985 shutdown_connections 2024-05-08T05:59:30.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.839+0000 7f8755fa7b80 1 --2- 172.21.15.82:0/628224985 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55602fd7c9d0 0x55602fd7ce30 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:30.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.839+0000 7f8755fa7b80 1 --2- 172.21.15.82:0/628224985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55602fd78060 0x55602fd78440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:30.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.839+0000 7f8755fa7b80 1 --2- 172.21.15.82:0/628224985 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55602fd78980 0x55602fd7c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:30.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.840+0000 7f8755fa7b80 1 -- 172.21.15.82:0/628224985 >> 172.21.15.82:0/628224985 conn(0x55602fca6b60 msgr2=0x55602fd727a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:59:30.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.840+0000 7f8755fa7b80 1 -- 172.21.15.82:0/628224985 shutdown_connections 2024-05-08T05:59:30.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.840+0000 7f8755fa7b80 1 -- 172.21.15.82:0/628224985 wait complete. 2024-05-08T05:59:30.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.841+0000 7f8755fa7b80 1 -- start start 2024-05-08T05:59:30.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.843+0000 7f8755fa7b80 1 Processor -- start 2024-05-08T05:59:30.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.845+0000 7f8755fa7b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55602fd78060 0x55602fd83e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:30.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.845+0000 7f8755fa7b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55602fd78980 0x55602fd81250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:30.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.847+0000 7f8748c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55602fd78060 0x55602fd83e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:30.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.847+0000 7f8755fa7b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55602fd7c9d0 0x55602fd81790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:30.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.847+0000 7f8748c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55602fd78060 0x55602fd83e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:43806/0 (socket says 172.21.15.82:43806) 2024-05-08T05:59:30.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.847+0000 7f8748c00700 1 -- 172.21.15.82:0/3105883256 learned_addr learned my addr 172.21.15.82:0/3105883256 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:59:30.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.847+0000 7f8755fa7b80 1 -- 172.21.15.82:0/3105883256 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55602fd849c0 con 0x55602fd78060 2024-05-08T05:59:30.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.847+0000 7f8755fa7b80 1 -- 172.21.15.82:0/3105883256 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55602fc30b20 con 0x55602fd7c9d0 2024-05-08T05:59:30.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.847+0000 7f8755fa7b80 1 -- 172.21.15.82:0/3105883256 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55602fd84b40 con 0x55602fd78980 2024-05-08T05:59:30.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.847+0000 7f8755fa7b80 10 client.0 _ll_register_callbacks cb 0x55602fc71c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:59:30.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.847+0000 7f8748c00700 1 -- 172.21.15.82:0/3105883256 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55602fd78980 msgr2=0x55602fd81250 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T05:59:30.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.847+0000 7f8748c00700 1 --2- 172.21.15.82:0/3105883256 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55602fd78980 0x55602fd81250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:30.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.847+0000 7f8748c00700 1 -- 172.21.15.82:0/3105883256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55602fd7c9d0 msgr2=0x55602fd81790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T05:59:30.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.847+0000 7f8748c00700 1 --2- 172.21.15.82:0/3105883256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55602fd7c9d0 0x55602fd81790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:30.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.848+0000 7f8748c00700 1 -- 172.21.15.82:0/3105883256 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55602fc90420 con 0x55602fd78060 2024-05-08T05:59:30.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.850+0000 7f8748c00700 1 --2- 172.21.15.82:0/3105883256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55602fd78060 0x55602fd83e60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f873c0a69d0 tx=0x7f873c0aa850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c24ea9eaebb37515 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:59:30.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.850+0000 7f872ea00700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T05:59:30.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.852+0000 7f872ea00700 1 -- 172.21.15.82:0/3105883256 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f873c0a60e0 con 0x55602fd78060 2024-05-08T05:59:30.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.852+0000 7f872ea00700 1 -- 172.21.15.82:0/3105883256 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f873c0b10b0 con 0x55602fd78060 2024-05-08T05:59:30.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.852+0000 7f8755fa7b80 1 -- 172.21.15.82:0/3105883256 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8734021070 con 0x55602fd78060 2024-05-08T05:59:30.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.852+0000 7f872ea00700 1 -- 172.21.15.82:0/3105883256 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f873c0aa460 con 0x55602fd78060 2024-05-08T05:59:30.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.852+0000 7f8755fa7b80 10 client.15816 fetch_fsmap learned FSMap version 31 2024-05-08T05:59:30.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.852+0000 7f8755fa7b80 1 -- 172.21.15.82:0/3105883256 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55602fd849c0 con 0x55602fd78060 2024-05-08T05:59:30.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.855+0000 7f872ea00700 1 -- 172.21.15.82:0/3105883256 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8734021070 con 0x55602fd78060 2024-05-08T05:59:30.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.855+0000 7f872ea00700 1 -- 172.21.15.82:0/3105883256 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f873c02e060 con 0x55602fd78060 2024-05-08T05:59:30.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.855+0000 7f8755fa7b80 10 client.15816 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:59:30.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.855+0000 7f8755fa7b80 10 client.15816 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-05-08T05:59:30.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.855+0000 7f8755fa7b80 20 client.15816 populate_metadata read hostname 'smithi082' 2024-05-08T05:59:30.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.855+0000 7f8755fa7b80 1 --2- 172.21.15.82:0/3105883256 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x55602fd914a0 0x55602fd938b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:30.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.855+0000 7f8755fa7b80 4 client.15816 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:59:30.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.855+0000 7f8755fa7b80 1 -- 172.21.15.82:0/3105883256 --> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55602fd450a0 con 0x55602fd914a0 2024-05-08T05:59:30.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.858+0000 7f8743e00700 1 --2- 172.21.15.82:0/3105883256 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x55602fd914a0 0x55602fd938b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:30.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.861+0000 7f8743e00700 1 --2- 172.21.15.82:0/3105883256 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x55602fd914a0 0x55602fd938b0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=af660301e709a5af server_cookie=cefe6a5005f699e in_seq=0 out_seq=0 2024-05-08T05:59:30.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.861+0000 7f872ea00700 10 client.15816 ms_handle_connect on v2:172.21.15.151:6834/2093655929 2024-05-08T05:59:30.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.862+0000 7f872ea00700 1 -- 172.21.15.82:0/3105883256 <== mds.3 v2:172.21.15.151:6834/2093655929 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55602fd450a0 con 0x55602fd914a0 2024-05-08T05:59:30.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.862+0000 7f872ea00700 10 client.15816 handle_command_reply: tid=0 2024-05-08T05:59:30.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.862+0000 7f8755fa7b80 1 client.15816 shutdown 2024-05-08T05:59:30.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.863+0000 7f8755fa7b80 1 -- 172.21.15.82:0/3105883256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55602fd78060 msgr2=0x55602fd83e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:30.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.863+0000 7f8755fa7b80 1 --2- 172.21.15.82:0/3105883256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55602fd78060 0x55602fd83e60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f873c0a69d0 tx=0x7f873c0aa850 comp rx=0 tx=0).stop 2024-05-08T05:59:30.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.863+0000 7f8755fa7b80 1 -- 172.21.15.82:0/3105883256 shutdown_connections 2024-05-08T05:59:30.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.863+0000 7f8755fa7b80 1 --2- 172.21.15.82:0/3105883256 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x55602fd914a0 0x55602fd938b0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:30.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.864+0000 7f8755fa7b80 1 --2- 172.21.15.82:0/3105883256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55602fd7c9d0 0x55602fd81790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:30.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.864+0000 7f8755fa7b80 1 --2- 172.21.15.82:0/3105883256 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55602fd78060 0x55602fd83e60 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:30.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.864+0000 7f8755fa7b80 1 --2- 172.21.15.82:0/3105883256 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55602fd78980 0x55602fd81250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:30.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.864+0000 7f8755fa7b80 1 -- 172.21.15.82:0/3105883256 >> 172.21.15.82:0/3105883256 conn(0x55602fca6b60 msgr2=0x55602fd6d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:59:30.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.864+0000 7f872ea00700 0 client.15816 ms_handle_reset on v2:172.21.15.151:6834/2093655929 2024-05-08T05:59:30.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.864+0000 7f8755fa7b80 1 -- 172.21.15.82:0/3105883256 shutdown_connections 2024-05-08T05:59:30.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.864+0000 7f8755fa7b80 1 -- 172.21.15.82:0/3105883256 wait complete. 2024-05-08T05:59:30.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.865+0000 7f8755fa7b80 20 client.15816 trim_cache size 0 max 16384 2024-05-08T05:59:30.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.901+0000 7f8755fa7b80 1 Processor -- start 2024-05-08T05:59:30.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.901+0000 7f8755fa7b80 1 -- start start 2024-05-08T05:59:30.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.902+0000 7f8755fa7b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55602fd78060 0x55602fd8db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:30.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.902+0000 7f8755fa7b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55602fd78980 0x55602fd951a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:30.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.902+0000 7f8755fa7b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55602fd7c9d0 0x55602fd7ed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:30.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.902+0000 7f8755fa7b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f872402f410 con 0x55602fd78060 2024-05-08T05:59:30.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.902+0000 7f8755fa7b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8724030f50 con 0x55602fd7c9d0 2024-05-08T05:59:30.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.902+0000 7f8755fa7b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f872402fae0 con 0x55602fd78980 2024-05-08T05:59:30.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.902+0000 7f8749600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55602fd7c9d0 0x55602fd7ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:30.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.902+0000 7f8749600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55602fd7c9d0 0x55602fd7ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:50222/0 (socket says 172.21.15.82:50222) 2024-05-08T05:59:30.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.902+0000 7f8749600700 1 -- 172.21.15.82:0/2851037041 learned_addr learned my addr 172.21.15.82:0/2851037041 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:59:30.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.902+0000 7f8743e00700 1 --2- 172.21.15.82:0/2851037041 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55602fd78980 0x55602fd951a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:30.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.903+0000 7f8749600700 1 -- 172.21.15.82:0/2851037041 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55602fd78980 msgr2=0x55602fd951a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:30.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.903+0000 7f8748c00700 1 --2- 172.21.15.82:0/2851037041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55602fd78060 0x55602fd8db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:30.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.903+0000 7f8749600700 1 --2- 172.21.15.82:0/2851037041 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55602fd78980 0x55602fd951a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:30.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.903+0000 7f8749600700 1 -- 172.21.15.82:0/2851037041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55602fd78060 msgr2=0x55602fd8db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:30.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.903+0000 7f8749600700 1 --2- 172.21.15.82:0/2851037041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55602fd78060 0x55602fd8db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:30.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.904+0000 7f8749600700 1 -- 172.21.15.82:0/2851037041 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55602fd84900 con 0x55602fd7c9d0 2024-05-08T05:59:30.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.904+0000 7f8749600700 1 --2- 172.21.15.82:0/2851037041 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55602fd7c9d0 0x55602fd7ed30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8734009340 tx=0x7f8734005ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c590bf8c2df464d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:59:30.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.905+0000 7f8743e00700 1 --2- 172.21.15.82:0/2851037041 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55602fd78980 0x55602fd951a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:59:30.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.905+0000 7f8739600700 1 -- 172.21.15.82:0/2851037041 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f873401c5f0 con 0x55602fd7c9d0 2024-05-08T05:59:30.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.905+0000 7f8739600700 1 -- 172.21.15.82:0/2851037041 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8734021030 con 0x55602fd7c9d0 2024-05-08T05:59:30.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.905+0000 7f8739600700 1 -- 172.21.15.82:0/2851037041 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8734004710 con 0x55602fd7c9d0 2024-05-08T05:59:30.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.906+0000 7f8755fa7b80 1 -- 172.21.15.82:0/2851037041 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55602fd7c9d0 msgr2=0x55602fd7ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:30.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.906+0000 7f8755fa7b80 1 --2- 172.21.15.82:0/2851037041 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55602fd7c9d0 0x55602fd7ed30 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8734009340 tx=0x7f8734005ce0 comp rx=0 tx=0).stop 2024-05-08T05:59:30.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.907+0000 7f8755fa7b80 1 -- 172.21.15.82:0/2851037041 shutdown_connections 2024-05-08T05:59:30.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.907+0000 7f8755fa7b80 1 --2- 172.21.15.82:0/2851037041 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55602fd7c9d0 0x55602fd7ed30 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:30.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.907+0000 7f8755fa7b80 1 --2- 172.21.15.82:0/2851037041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55602fd78060 0x55602fd8db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:30.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.907+0000 7f8755fa7b80 1 --2- 172.21.15.82:0/2851037041 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55602fd78980 0x55602fd951a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:30.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.907+0000 7f8755fa7b80 1 -- 172.21.15.82:0/2851037041 >> 172.21.15.82:0/2851037041 conn(0x55602fca6b60 msgr2=0x55602fd7e620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:59:30.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.910+0000 7f8755fa7b80 1 -- 172.21.15.82:0/2851037041 shutdown_connections 2024-05-08T05:59:30.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.910+0000 7f8755fa7b80 1 -- 172.21.15.82:0/2851037041 wait complete. 2024-05-08T05:59:30.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.910+0000 7f8755fa7b80 1 -- start start 2024-05-08T05:59:30.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.911+0000 7f8755fa7b80 1 Processor -- start 2024-05-08T05:59:30.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.911+0000 7f8755fa7b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55602fd78060 0x55602fd89eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:30.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.911+0000 7f8755fa7b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55602fd78980 0x55602fd8a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:30.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.911+0000 7f8755fa7b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55602fd7c9d0 0x55602fd94920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:30.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.911+0000 7f8755fa7b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8724030880 con 0x55602fd7c9d0 2024-05-08T05:59:30.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.911+0000 7f8755fa7b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f87240301b0 con 0x55602fd78060 2024-05-08T05:59:30.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.911+0000 7f8755fa7b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f872402d3b0 con 0x55602fd78980 2024-05-08T05:59:30.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.911+0000 7f8755fa7b80 10 client.0 _ll_register_callbacks cb 0x55602fc71c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:59:30.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.912+0000 7f8748c00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55602fd78060 0x55602fd89eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:30.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.912+0000 7f8748c00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55602fd78060 0x55602fd89eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:50234/0 (socket says 172.21.15.82:50234) 2024-05-08T05:59:30.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.913+0000 7f8748c00700 1 -- 172.21.15.82:0/1477389707 learned_addr learned my addr 172.21.15.82:0/1477389707 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:59:30.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.914+0000 7f8748c00700 1 -- 172.21.15.82:0/1477389707 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55602fd78980 msgr2=0x55602fd8a3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T05:59:30.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.914+0000 7f8748c00700 1 --2- 172.21.15.82:0/1477389707 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55602fd78980 0x55602fd8a3f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:30.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.914+0000 7f8748c00700 1 -- 172.21.15.82:0/1477389707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55602fd7c9d0 msgr2=0x55602fd94920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:30.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.914+0000 7f8748c00700 1 --2- 172.21.15.82:0/1477389707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55602fd7c9d0 0x55602fd94920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:30.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.914+0000 7f8748c00700 1 -- 172.21.15.82:0/1477389707 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55602fd95070 con 0x55602fd78060 2024-05-08T05:59:30.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.915+0000 7f8748c00700 1 --2- 172.21.15.82:0/1477389707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55602fd78060 0x55602fd89eb0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f873c0b3290 tx=0x7f873c0b3310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2c11357d8ba60d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:59:30.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.915+0000 7f872ea00700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:59:30.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.916+0000 7f872ea00700 1 -- 172.21.15.82:0/1477389707 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f873c0ab050 con 0x55602fd78060 2024-05-08T05:59:30.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.916+0000 7f872ea00700 1 -- 172.21.15.82:0/1477389707 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f873c01d470 con 0x55602fd78060 2024-05-08T05:59:30.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.916+0000 7f8755fa7b80 1 -- 172.21.15.82:0/1477389707 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8734021030 con 0x55602fd78060 2024-05-08T05:59:30.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.916+0000 7f872ea00700 1 -- 172.21.15.82:0/1477389707 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f873c0aa950 con 0x55602fd78060 2024-05-08T05:59:30.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.917+0000 7f8755fa7b80 10 client.26144 fetch_fsmap learned FSMap version 31 2024-05-08T05:59:30.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.917+0000 7f8755fa7b80 1 -- 172.21.15.82:0/1477389707 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55602fd95070 con 0x55602fd78060 2024-05-08T05:59:30.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.917+0000 7f872ea00700 1 -- 172.21.15.82:0/1477389707 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8734021030 con 0x55602fd78060 2024-05-08T05:59:30.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.917+0000 7f872ea00700 1 -- 172.21.15.82:0/1477389707 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f873c011070 con 0x55602fd78060 2024-05-08T05:59:30.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.918+0000 7f8755fa7b80 10 client.26144 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:59:30.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.918+0000 7f8755fa7b80 10 client.26144 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-05-08T05:59:30.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.918+0000 7f8755fa7b80 20 client.26144 populate_metadata read hostname 'smithi082' 2024-05-08T05:59:30.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.918+0000 7f8755fa7b80 1 --2- 172.21.15.82:0/1477389707 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x55602fe0d5a0 0x55602fe0f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:30.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.918+0000 7f8755fa7b80 4 client.26144 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:59:30.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.918+0000 7f8755fa7b80 1 -- 172.21.15.82:0/1477389707 --> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55602fcd8400 con 0x55602fe0d5a0 2024-05-08T05:59:30.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.919+0000 7f8743e00700 1 --2- 172.21.15.82:0/1477389707 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x55602fe0d5a0 0x55602fe0f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:30.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.920+0000 7f872ea00700 10 client.26144 ms_handle_connect on v2:172.21.15.151:6834/2093655929 2024-05-08T05:59:30.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.920+0000 7f8743e00700 1 --2- 172.21.15.82:0/1477389707 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x55602fe0d5a0 0x55602fe0f990 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4cc29a2d4526ed57 server_cookie=e066b1b2eaa16d69 in_seq=0 out_seq=0 2024-05-08T05:59:30.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.920+0000 7f872ea00700 1 -- 172.21.15.82:0/1477389707 <== mds.3 v2:172.21.15.151:6834/2093655929 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55602fcd8400 con 0x55602fe0d5a0 2024-05-08T05:59:30.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.920+0000 7f872ea00700 10 client.26144 handle_command_reply: tid=0 2024-05-08T05:59:30.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.920+0000 7f8755fa7b80 1 client.26144 shutdown 2024-05-08T05:59:30.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.922+0000 7f8755fa7b80 1 -- 172.21.15.82:0/1477389707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55602fd78060 msgr2=0x55602fd89eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:30.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.922+0000 7f8755fa7b80 1 --2- 172.21.15.82:0/1477389707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55602fd78060 0x55602fd89eb0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f873c0b3290 tx=0x7f873c0b3310 comp rx=0 tx=0).stop 2024-05-08T05:59:30.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.922+0000 7f8755fa7b80 1 -- 172.21.15.82:0/1477389707 shutdown_connections 2024-05-08T05:59:30.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.922+0000 7f8755fa7b80 1 --2- 172.21.15.82:0/1477389707 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x55602fe0d5a0 0x55602fe0f990 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:30.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.922+0000 7f872ea00700 0 client.26144 ms_handle_reset on v2:172.21.15.151:6834/2093655929 2024-05-08T05:59:30.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.922+0000 7f8755fa7b80 1 --2- 172.21.15.82:0/1477389707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55602fd78060 0x55602fd89eb0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:30.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.922+0000 7f8755fa7b80 1 --2- 172.21.15.82:0/1477389707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55602fd7c9d0 0x55602fd94920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:30.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.922+0000 7f8755fa7b80 1 --2- 172.21.15.82:0/1477389707 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55602fd78980 0x55602fd8a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:30.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.922+0000 7f8755fa7b80 1 -- 172.21.15.82:0/1477389707 >> 172.21.15.82:0/1477389707 conn(0x55602fca6b60 msgr2=0x55602fd6ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:59:30.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.922+0000 7f8755fa7b80 1 -- 172.21.15.82:0/1477389707 shutdown_connections 2024-05-08T05:59:30.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.923+0000 7f8755fa7b80 1 -- 172.21.15.82:0/1477389707 wait complete. 2024-05-08T05:59:30.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.923+0000 7f8755fa7b80 20 client.26144 trim_cache size 0 max 16384 2024-05-08T05:59:30.924 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T05:59:30.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.924+0000 7f874b600700 1 -- 172.21.15.82:0/951192646 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f87280b2980 msgr2=0x7f87280b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:30.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.924+0000 7f874b600700 1 --2- 172.21.15.82:0/951192646 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f87280b2980 0x7f87280b4e40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8734005950 tx=0x7f8734017000 comp rx=0 tx=0).stop 2024-05-08T05:59:30.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.924+0000 7f874b600700 1 -- 172.21.15.82:0/951192646 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87441056e0 msgr2=0x7f87440779b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:30.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.924+0000 7f874b600700 1 --2- 172.21.15.82:0/951192646 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87441056e0 0x7f87440779b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f873c00cd80 tx=0x7f873c00ce60 comp rx=0 tx=0).stop 2024-05-08T05:59:30.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.924+0000 7f874b600700 1 -- 172.21.15.82:0/951192646 shutdown_connections 2024-05-08T05:59:30.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.924+0000 7f874b600700 1 --2- 172.21.15.82:0/951192646 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87441056e0 0x7f87440779b0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:30.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.924+0000 7f874b600700 1 --2- 172.21.15.82:0/951192646 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f87280b2980 0x7f87280b4e40 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:30.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.924+0000 7f874b600700 1 --2- 172.21.15.82:0/951192646 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f874410b6e0 0x7f8744078430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:30.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.924+0000 7f874b600700 1 --2- 172.21.15.82:0/951192646 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87441060a0 0x7f8744077ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:30.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.924+0000 7f874b600700 1 -- 172.21.15.82:0/951192646 >> 172.21.15.82:0/951192646 conn(0x7f87441011d0 msgr2=0x7f8744101970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:59:30.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.924+0000 7f874b600700 1 -- 172.21.15.82:0/951192646 shutdown_connections 2024-05-08T05:59:30.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:30.924+0000 7f874b600700 1 -- 172.21.15.82:0/951192646 wait complete. 2024-05-08T05:59:31.641 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:59:31 smithi082 ceph-mon[30098]: pgmap v725: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.1 MiB/s wr, 776 op/s 2024-05-08T05:59:31.706 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-05-08T05:59:31.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:59:31 smithi151 ceph-mon[34815]: pgmap v725: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.1 MiB/s wr, 776 op/s 2024-05-08T05:59:32.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:59:31 smithi134 ceph-mon[34132]: pgmap v725: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 9.1 MiB/s wr, 776 op/s 2024-05-08T05:59:32.377 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:59:33.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:59:33 smithi151 ceph-mon[34815]: pgmap v726: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.3 MiB/s wr, 582 op/s 2024-05-08T05:59:33.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:59:33 smithi082 ceph-mon[30098]: pgmap v726: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.3 MiB/s wr, 582 op/s 2024-05-08T05:59:33.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:59:33 smithi134 ceph-mon[34132]: pgmap v726: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.3 MiB/s wr, 582 op/s 2024-05-08T05:59:35.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 525.0 s, 1944.8 tps, lat 51.050 ms stddev 58.919 2024-05-08T05:59:35.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.583+0000 7f035f800700 1 -- 172.21.15.82:0/54795933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f035806bb40 msgr2=0x7f0358110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:35.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.583+0000 7f035f800700 1 --2- 172.21.15.82:0/54795933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f035806bb40 0x7f0358110330 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0350009990 tx=0x7f0350009ca0 comp rx=0 tx=0).stop 2024-05-08T05:59:35.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.584+0000 7f035f800700 1 -- 172.21.15.82:0/54795933 shutdown_connections 2024-05-08T05:59:35.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.584+0000 7f035f800700 1 --2- 172.21.15.82:0/54795933 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0358109510 0x7f03581098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:35.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.584+0000 7f035f800700 1 --2- 172.21.15.82:0/54795933 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f035806bb40 0x7f0358110330 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:35.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.584+0000 7f035f800700 1 --2- 172.21.15.82:0/54795933 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f035806b180 0x7f035806b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:35.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.584+0000 7f035f800700 1 -- 172.21.15.82:0/54795933 >> 172.21.15.82:0/54795933 conn(0x7f0358079350 msgr2=0x7f0358079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:59:35.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.586+0000 7f035f800700 1 -- 172.21.15.82:0/54795933 shutdown_connections 2024-05-08T05:59:35.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.586+0000 7f035f800700 1 -- 172.21.15.82:0/54795933 wait complete. 2024-05-08T05:59:35.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.587+0000 7f035f800700 1 Processor -- start 2024-05-08T05:59:35.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.588+0000 7f035f800700 1 -- start start 2024-05-08T05:59:35.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.589+0000 7f035f800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f035806b180 0x7f0358074ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:35.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.589+0000 7f035f800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f035806bb40 0x7f035806dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:35.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.590+0000 7f035ce00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f035806b180 0x7f0358074ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:35.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.590+0000 7f0357e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f035806bb40 0x7f035806dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:35.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.590+0000 7f0357e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f035806bb40 0x7f035806dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:41470/0 (socket says 172.21.15.82:41470) 2024-05-08T05:59:35.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.590+0000 7f0357e00700 1 -- 172.21.15.82:0/210951206 learned_addr learned my addr 172.21.15.82:0/210951206 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:59:35.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.590+0000 7f035f800700 1 --2- 172.21.15.82:0/210951206 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0358109510 0x7f035806e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:35.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.591+0000 7f035f800700 1 -- 172.21.15.82:0/210951206 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0358115870 con 0x7f035806b180 2024-05-08T05:59:35.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.591+0000 7f035f800700 1 -- 172.21.15.82:0/210951206 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f03581156f0 con 0x7f0358109510 2024-05-08T05:59:35.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.591+0000 7f035d800700 1 --2- 172.21.15.82:0/210951206 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0358109510 0x7f035806e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:35.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.591+0000 7f035f800700 1 -- 172.21.15.82:0/210951206 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f03581159f0 con 0x7f035806bb40 2024-05-08T05:59:35.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.592+0000 7f0357e00700 1 -- 172.21.15.82:0/210951206 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0358109510 msgr2=0x7f035806e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:35.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.592+0000 7f0357e00700 1 --2- 172.21.15.82:0/210951206 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0358109510 0x7f035806e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:35.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.592+0000 7f0357e00700 1 -- 172.21.15.82:0/210951206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f035806b180 msgr2=0x7f0358074ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:35.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.592+0000 7f0357e00700 1 --2- 172.21.15.82:0/210951206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f035806b180 0x7f0358074ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:35.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.592+0000 7f0357e00700 1 -- 172.21.15.82:0/210951206 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f035806e8d0 con 0x7f035806bb40 2024-05-08T05:59:35.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.593+0000 7f0357e00700 1 --2- 172.21.15.82:0/210951206 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f035806bb40 0x7f035806dd80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f034000e9a0 tx=0x7f034000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:59:35.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.593+0000 7f0355600700 1 -- 172.21.15.82:0/210951206 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f034000ca10 con 0x7f035806bb40 2024-05-08T05:59:35.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.594+0000 7f035f800700 1 -- 172.21.15.82:0/210951206 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f035806ebc0 con 0x7f035806bb40 2024-05-08T05:59:35.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.594+0000 7f0355600700 1 -- 172.21.15.82:0/210951206 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f034000cbb0 con 0x7f035806bb40 2024-05-08T05:59:35.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.594+0000 7f0355600700 1 -- 172.21.15.82:0/210951206 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f034000ca10 con 0x7f035806bb40 2024-05-08T05:59:35.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.594+0000 7f035f800700 1 -- 172.21.15.82:0/210951206 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0358072b90 con 0x7f035806bb40 2024-05-08T05:59:35.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.600+0000 7f0355600700 1 -- 172.21.15.82:0/210951206 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f0340018420 con 0x7f035806bb40 2024-05-08T05:59:35.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.601+0000 7f036a209b80 1 Processor -- start 2024-05-08T05:59:35.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.602+0000 7f036a209b80 1 -- start start 2024-05-08T05:59:35.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.602+0000 7f0355600700 1 --2- 172.21.15.82:0/210951206 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f033c0b2b00 0x7f033c0b4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:35.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.603+0000 7f036a209b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dacfe2c870 0x55dacfe2cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:35.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.603+0000 7f036a209b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dacfe2d190 0x55dacfe30ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:35.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.603+0000 7f036a209b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dacfe311e0 0x55dacfe31640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:35.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.603+0000 7f036a209b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55dacfd76a20 con 0x55dacfe2c870 2024-05-08T05:59:35.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.603+0000 7f036a209b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55dacfd14760 con 0x55dacfe311e0 2024-05-08T05:59:35.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.603+0000 7f036a209b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55dacfd729e0 con 0x55dacfe2d190 2024-05-08T05:59:35.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.603+0000 7f035d800700 1 --2- 172.21.15.82:0/210951206 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f033c0b2b00 0x7f033c0b4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:35.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.604+0000 7f0355600700 1 -- 172.21.15.82:0/210951206 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f03400e1f10 con 0x7f035806bb40 2024-05-08T05:59:35.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.604+0000 7f035d800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dacfe311e0 0x55dacfe31640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:35.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.604+0000 7f035d800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dacfe311e0 0x55dacfe31640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:58662/0 (socket says 172.21.15.82:58662) 2024-05-08T05:59:35.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.604+0000 7f035d800700 1 -- 172.21.15.82:0/3566715782 learned_addr learned my addr 172.21.15.82:0/3566715782 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:59:35.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.604+0000 7f0357e00700 1 --2- 172.21.15.82:0/3566715782 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dacfe2d190 0x55dacfe30ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:35.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.604+0000 7f035ce00700 1 --2- 172.21.15.82:0/3566715782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dacfe2c870 0x55dacfe2cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:35.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.604+0000 7f0357e00700 1 -- 172.21.15.82:0/3566715782 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dacfe311e0 msgr2=0x55dacfe31640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:35.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.604+0000 7f0357e00700 1 --2- 172.21.15.82:0/3566715782 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dacfe311e0 0x55dacfe31640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:35.606 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.604+0000 7f0357e00700 1 -- 172.21.15.82:0/3566715782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dacfe2c870 msgr2=0x55dacfe2cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:35.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.605+0000 7f035d800700 1 --2- 172.21.15.82:0/210951206 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f033c0b2b00 0x7f033c0b4fc0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0350009990 tx=0x7f03500051f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:59:35.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.605+0000 7f0357e00700 1 --2- 172.21.15.82:0/3566715782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dacfe2c870 0x55dacfe2cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:35.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.605+0000 7f0357e00700 1 -- 172.21.15.82:0/3566715782 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dacfcc38d0 con 0x55dacfe2d190 2024-05-08T05:59:35.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.605+0000 7f035ce00700 1 --2- 172.21.15.82:0/3566715782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dacfe2c870 0x55dacfe2cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:59:35.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.605+0000 7f0357e00700 1 --2- 172.21.15.82:0/3566715782 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dacfe2d190 0x55dacfe30ca0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0340000c00 tx=0x7f03400a9f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9737a8a13163c9d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:59:35.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.605+0000 7f034e000700 1 -- 172.21.15.82:0/3566715782 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03400a9ff0 con 0x55dacfe2d190 2024-05-08T05:59:35.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.605+0000 7f034e000700 1 -- 172.21.15.82:0/3566715782 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f03400b2480 con 0x55dacfe2d190 2024-05-08T05:59:35.607 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.605+0000 7f034e000700 1 -- 172.21.15.82:0/3566715782 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0340090a50 con 0x55dacfe2d190 2024-05-08T05:59:35.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.606+0000 7f036a209b80 1 -- 172.21.15.82:0/3566715782 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dacfe2d190 msgr2=0x55dacfe30ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:35.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.606+0000 7f036a209b80 1 --2- 172.21.15.82:0/3566715782 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dacfe2d190 0x55dacfe30ca0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0340000c00 tx=0x7f03400a9f50 comp rx=0 tx=0).stop 2024-05-08T05:59:35.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.607+0000 7f036a209b80 1 -- 172.21.15.82:0/3566715782 shutdown_connections 2024-05-08T05:59:35.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.607+0000 7f036a209b80 1 --2- 172.21.15.82:0/3566715782 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dacfe311e0 0x55dacfe31640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:35.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.607+0000 7f036a209b80 1 --2- 172.21.15.82:0/3566715782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dacfe2c870 0x55dacfe2cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:35.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.607+0000 7f036a209b80 1 --2- 172.21.15.82:0/3566715782 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dacfe2d190 0x55dacfe30ca0 secure :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0340000c00 tx=0x7f03400a9f50 comp rx=0 tx=0).stop 2024-05-08T05:59:35.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.607+0000 7f036a209b80 1 -- 172.21.15.82:0/3566715782 >> 172.21.15.82:0/3566715782 conn(0x55dacfd52b60 msgr2=0x55dacfe1e7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:59:35.608 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.607+0000 7f036a209b80 1 -- 172.21.15.82:0/3566715782 shutdown_connections 2024-05-08T05:59:35.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.607+0000 7f036a209b80 1 -- 172.21.15.82:0/3566715782 wait complete. 2024-05-08T05:59:35.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.608+0000 7f036a209b80 1 -- start start 2024-05-08T05:59:35.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.608+0000 7f036a209b80 1 Processor -- start 2024-05-08T05:59:35.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.610+0000 7f036a209b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dacfe2c870 0x55dacfe38840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:35.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.610+0000 7f036a209b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dacfe311e0 0x55dacfe35b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:35.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.610+0000 7f036a209b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dacfe36080 0x55dacfe36500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:35.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.610+0000 7f036a209b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55dacfe393f0 con 0x55dacfe2c870 2024-05-08T05:59:35.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.610+0000 7f036a209b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55dacfcdcb20 con 0x55dacfe36080 2024-05-08T05:59:35.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.610+0000 7f036a209b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55dacfe39570 con 0x55dacfe311e0 2024-05-08T05:59:35.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.610+0000 7f0357e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dacfe311e0 0x55dacfe35b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:35.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.610+0000 7f0357e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dacfe311e0 0x55dacfe35b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:41478/0 (socket says 172.21.15.82:41478) 2024-05-08T05:59:35.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.610+0000 7f0357e00700 1 -- 172.21.15.82:0/2319640266 learned_addr learned my addr 172.21.15.82:0/2319640266 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:59:35.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.611+0000 7f035d800700 1 --2- 172.21.15.82:0/2319640266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dacfe36080 0x55dacfe36500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:35.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.611+0000 7f036a209b80 10 client.0 _ll_register_callbacks cb 0x55dacfd1dc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:59:35.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.611+0000 7f035d800700 1 -- 172.21.15.82:0/2319640266 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dacfe311e0 msgr2=0x55dacfe35b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:35.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.611+0000 7f035d800700 1 --2- 172.21.15.82:0/2319640266 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dacfe311e0 0x55dacfe35b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:35.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.611+0000 7f035d800700 1 -- 172.21.15.82:0/2319640266 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dacfe2c870 msgr2=0x55dacfe38840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:35.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.611+0000 7f035d800700 1 --2- 172.21.15.82:0/2319640266 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dacfe2c870 0x55dacfe38840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:35.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.611+0000 7f035d800700 1 -- 172.21.15.82:0/2319640266 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dacfd3c420 con 0x55dacfe36080 2024-05-08T05:59:35.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.612+0000 7f035d800700 1 --2- 172.21.15.82:0/2319640266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dacfe36080 0x55dacfe36500 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f03500098e0 tx=0x7f0350009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4096099972495a12 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:59:35.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.612+0000 7f0346a00700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:59:35.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.612+0000 7f0346a00700 1 -- 172.21.15.82:0/2319640266 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0350021040 con 0x55dacfe36080 2024-05-08T05:59:35.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.613+0000 7f0346a00700 1 -- 172.21.15.82:0/2319640266 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f035000f460 con 0x55dacfe36080 2024-05-08T05:59:35.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.613+0000 7f036a209b80 1 -- 172.21.15.82:0/2319640266 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f03400b2480 con 0x55dacfe36080 2024-05-08T05:59:35.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.613+0000 7f0346a00700 1 -- 172.21.15.82:0/2319640266 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f035000f6a0 con 0x55dacfe36080 2024-05-08T05:59:35.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.614+0000 7f036a209b80 10 client.26156 fetch_fsmap learned FSMap version 31 2024-05-08T05:59:35.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.614+0000 7f036a209b80 1 -- 172.21.15.82:0/2319640266 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55dacfe44160 con 0x55dacfe36080 2024-05-08T05:59:35.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.614+0000 7f0346a00700 1 -- 172.21.15.82:0/2319640266 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f03400b2480 con 0x55dacfe36080 2024-05-08T05:59:35.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.614+0000 7f0346a00700 1 -- 172.21.15.82:0/2319640266 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f0350027040 con 0x55dacfe36080 2024-05-08T05:59:35.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.614+0000 7f036a209b80 10 client.26156 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:59:35.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.614+0000 7f036a209b80 10 client.26156 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-05-08T05:59:35.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.614+0000 7f036a209b80 20 client.26156 populate_metadata read hostname 'smithi082' 2024-05-08T05:59:35.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.614+0000 7f036a209b80 1 --2- 172.21.15.82:0/2319640266 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55dacfe467a0 0x55dacfe48bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:35.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.614+0000 7f036a209b80 4 client.26156 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:59:35.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.614+0000 7f036a209b80 1 -- 172.21.15.82:0/2319640266 --> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dacfdf10a0 con 0x55dacfe467a0 2024-05-08T05:59:35.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.615+0000 7f035ce00700 1 --2- 172.21.15.82:0/2319640266 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55dacfe467a0 0x55dacfe48bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:35.616 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:59:35 smithi082 ceph-mon[30098]: pgmap v727: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 7.2 MiB/s wr, 643 op/s 2024-05-08T05:59:35.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.615+0000 7f035ce00700 1 --2- 172.21.15.82:0/2319640266 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55dacfe467a0 0x55dacfe48bd0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9a364381d83d734e server_cookie=28291ff8273fd22e in_seq=0 out_seq=0 2024-05-08T05:59:35.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.615+0000 7f0346a00700 10 client.26156 ms_handle_connect on v2:172.21.15.151:6836/4192404464 2024-05-08T05:59:35.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.616+0000 7f0346a00700 1 -- 172.21.15.82:0/2319640266 <== mds.2 v2:172.21.15.151:6836/4192404464 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55dacfdf10a0 con 0x55dacfe467a0 2024-05-08T05:59:35.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.616+0000 7f0346a00700 10 client.26156 handle_command_reply: tid=0 2024-05-08T05:59:35.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.616+0000 7f036a209b80 1 client.26156 shutdown 2024-05-08T05:59:35.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.616+0000 7f036a209b80 1 -- 172.21.15.82:0/2319640266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dacfe36080 msgr2=0x55dacfe36500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:35.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.616+0000 7f036a209b80 1 --2- 172.21.15.82:0/2319640266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dacfe36080 0x55dacfe36500 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f03500098e0 tx=0x7f0350009ca0 comp rx=0 tx=0).stop 2024-05-08T05:59:35.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.617+0000 7f036a209b80 1 -- 172.21.15.82:0/2319640266 shutdown_connections 2024-05-08T05:59:35.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.617+0000 7f036a209b80 1 --2- 172.21.15.82:0/2319640266 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55dacfe467a0 0x55dacfe48bd0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:35.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.617+0000 7f036a209b80 1 --2- 172.21.15.82:0/2319640266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dacfe36080 0x55dacfe36500 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:35.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.617+0000 7f036a209b80 1 --2- 172.21.15.82:0/2319640266 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dacfe2c870 0x55dacfe38840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:35.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.617+0000 7f036a209b80 1 --2- 172.21.15.82:0/2319640266 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dacfe311e0 0x55dacfe35b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:35.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.617+0000 7f036a209b80 1 -- 172.21.15.82:0/2319640266 >> 172.21.15.82:0/2319640266 conn(0x55dacfd52b60 msgr2=0x55dacfe192b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:59:35.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.617+0000 7f0346a00700 0 client.26156 ms_handle_reset on v2:172.21.15.151:6836/4192404464 2024-05-08T05:59:35.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.617+0000 7f036a209b80 1 -- 172.21.15.82:0/2319640266 shutdown_connections 2024-05-08T05:59:35.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.618+0000 7f036a209b80 1 -- 172.21.15.82:0/2319640266 wait complete. 2024-05-08T05:59:35.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.618+0000 7f036a209b80 20 client.26156 trim_cache size 0 max 16384 2024-05-08T05:59:35.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.648+0000 7f036a209b80 1 Processor -- start 2024-05-08T05:59:35.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.648+0000 7f036a209b80 1 -- start start 2024-05-08T05:59:35.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.649+0000 7f036a209b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dacfe2c870 0x55dacfe33590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:35.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.649+0000 7f036a209b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dacfe311e0 0x55dacfe4e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:35.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.649+0000 7f036a209b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dacfe36080 0x55dacfe4e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:35.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.649+0000 7f036a209b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f03581b4110 con 0x55dacfe2c870 2024-05-08T05:59:35.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.649+0000 7f036a209b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f03581b5c50 con 0x55dacfe311e0 2024-05-08T05:59:35.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.649+0000 7f036a209b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f03581b47e0 con 0x55dacfe36080 2024-05-08T05:59:35.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.651+0000 7f035ce00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dacfe2c870 0x55dacfe33590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:35.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.651+0000 7f035ce00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dacfe2c870 0x55dacfe33590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39696/0 (socket says 172.21.15.82:39696) 2024-05-08T05:59:35.652 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.652+0000 7f035ce00700 1 -- 172.21.15.82:0/2793203241 learned_addr learned my addr 172.21.15.82:0/2793203241 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:59:35.653 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.653+0000 7f035d800700 1 --2- 172.21.15.82:0/2793203241 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dacfe36080 0x55dacfe4e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:35.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.653+0000 7f035ce00700 1 -- 172.21.15.82:0/2793203241 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dacfe36080 msgr2=0x55dacfe4e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:35.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.653+0000 7f035ce00700 1 --2- 172.21.15.82:0/2793203241 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dacfe36080 0x55dacfe4e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:35.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.653+0000 7f035ce00700 1 -- 172.21.15.82:0/2793203241 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dacfe311e0 msgr2=0x55dacfe4e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:35.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.653+0000 7f035ce00700 1 --2- 172.21.15.82:0/2793203241 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dacfe311e0 0x55dacfe4e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:35.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.653+0000 7f035ce00700 1 -- 172.21.15.82:0/2793203241 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dacfe1b3f0 con 0x55dacfe2c870 2024-05-08T05:59:35.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.655+0000 7f035ce00700 1 --2- 172.21.15.82:0/2793203241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dacfe2c870 0x55dacfe33590 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0348000f80 tx=0x7f0348007600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40c9902fdf0d4548 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:59:35.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.659+0000 7f034d600700 1 -- 172.21.15.82:0/2793203241 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0348007c30 con 0x55dacfe2c870 2024-05-08T05:59:35.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.659+0000 7f034d600700 1 -- 172.21.15.82:0/2793203241 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0348020030 con 0x55dacfe2c870 2024-05-08T05:59:35.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.659+0000 7f034d600700 1 -- 172.21.15.82:0/2793203241 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0348005020 con 0x55dacfe2c870 2024-05-08T05:59:35.663 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.660+0000 7f036a209b80 1 -- 172.21.15.82:0/2793203241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dacfe2c870 msgr2=0x55dacfe33590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:35.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.660+0000 7f036a209b80 1 --2- 172.21.15.82:0/2793203241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dacfe2c870 0x55dacfe33590 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0348000f80 tx=0x7f0348007600 comp rx=0 tx=0).stop 2024-05-08T05:59:35.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.660+0000 7f036a209b80 1 -- 172.21.15.82:0/2793203241 shutdown_connections 2024-05-08T05:59:35.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.660+0000 7f036a209b80 1 --2- 172.21.15.82:0/2793203241 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dacfe36080 0x55dacfe4e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:35.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.660+0000 7f036a209b80 1 --2- 172.21.15.82:0/2793203241 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dacfe2c870 0x55dacfe33590 secure :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0348000f80 tx=0x7f0348007600 comp rx=0 tx=0).stop 2024-05-08T05:59:35.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.660+0000 7f036a209b80 1 --2- 172.21.15.82:0/2793203241 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dacfe311e0 0x55dacfe4e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:35.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.660+0000 7f036a209b80 1 -- 172.21.15.82:0/2793203241 >> 172.21.15.82:0/2793203241 conn(0x55dacfd52b60 msgr2=0x55dacfe32e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:59:35.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.663+0000 7f036a209b80 1 -- 172.21.15.82:0/2793203241 shutdown_connections 2024-05-08T05:59:35.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.663+0000 7f036a209b80 1 -- 172.21.15.82:0/2793203241 wait complete. 2024-05-08T05:59:35.664 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.663+0000 7f036a209b80 1 -- start start 2024-05-08T05:59:35.665 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.664+0000 7f036a209b80 1 Processor -- start 2024-05-08T05:59:35.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.665+0000 7f036a209b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dacfe311e0 0x55dacfeac730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:35.666 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.665+0000 7f036a209b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dacfe36080 0x55dacfe3e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:35.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.665+0000 7f036a209b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dacfe3ed40 0x55dacfe4da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:35.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.665+0000 7f035ce00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dacfe311e0 0x55dacfeac730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:35.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.665+0000 7f035ce00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dacfe311e0 0x55dacfeac730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:41490/0 (socket says 172.21.15.82:41490) 2024-05-08T05:59:35.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.666+0000 7f0357e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dacfe36080 0x55dacfe3e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:35.667 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.666+0000 7f0357e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dacfe36080 0x55dacfe3e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:58686/0 (socket says 172.21.15.82:58686) 2024-05-08T05:59:35.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.669+0000 7f035ce00700 1 -- 172.21.15.82:0/1203358582 learned_addr learned my addr 172.21.15.82:0/1203358582 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:59:35.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.669+0000 7f036a209b80 1 -- 172.21.15.82:0/1203358582 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f03581b5580 con 0x55dacfe3ed40 2024-05-08T05:59:35.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.669+0000 7f036a209b80 1 -- 172.21.15.82:0/1203358582 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f03581b4eb0 con 0x55dacfe36080 2024-05-08T05:59:35.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.669+0000 7f036a209b80 1 -- 172.21.15.82:0/1203358582 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f03581b20b0 con 0x55dacfe311e0 2024-05-08T05:59:35.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.669+0000 7f036a209b80 10 client.0 _ll_register_callbacks cb 0x55dacfd1dc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:59:35.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.669+0000 7f035d800700 1 --2- 172.21.15.82:0/1203358582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dacfe3ed40 0x55dacfe4da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:35.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.670+0000 7f035ce00700 1 -- 172.21.15.82:0/1203358582 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dacfe36080 msgr2=0x55dacfe3e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:35.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.670+0000 7f035ce00700 1 --2- 172.21.15.82:0/1203358582 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dacfe36080 0x55dacfe3e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:35.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.670+0000 7f035ce00700 1 -- 172.21.15.82:0/1203358582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dacfe3ed40 msgr2=0x55dacfe4da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:35.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.670+0000 7f035ce00700 1 --2- 172.21.15.82:0/1203358582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dacfe3ed40 0x55dacfe4da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:35.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.670+0000 7f035ce00700 1 -- 172.21.15.82:0/1203358582 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dacfe3f1c0 con 0x55dacfe311e0 2024-05-08T05:59:35.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.672+0000 7f035ce00700 1 --2- 172.21.15.82:0/1203358582 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dacfe311e0 0x55dacfeac730 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f034801c7e0 tx=0x7f0348007e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b9b5d617bb44dd7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:59:35.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.673+0000 7f0346a00700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:59:35.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.673+0000 7f0346a00700 1 -- 172.21.15.82:0/1203358582 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0348004d10 con 0x55dacfe311e0 2024-05-08T05:59:35.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.673+0000 7f036a209b80 1 -- 172.21.15.82:0/1203358582 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0348020030 con 0x55dacfe311e0 2024-05-08T05:59:35.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.673+0000 7f0346a00700 1 -- 172.21.15.82:0/1203358582 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f034801c050 con 0x55dacfe311e0 2024-05-08T05:59:35.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.673+0000 7f0346a00700 1 -- 172.21.15.82:0/1203358582 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f034801c250 con 0x55dacfe311e0 2024-05-08T05:59:35.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.673+0000 7f036a209b80 10 client.26185 fetch_fsmap learned FSMap version 31 2024-05-08T05:59:35.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.673+0000 7f036a209b80 1 -- 172.21.15.82:0/1203358582 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55dacfe253f0 con 0x55dacfe311e0 2024-05-08T05:59:35.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.673+0000 7f0346a00700 1 -- 172.21.15.82:0/1203358582 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0348020030 con 0x55dacfe311e0 2024-05-08T05:59:35.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.674+0000 7f0346a00700 1 -- 172.21.15.82:0/1203358582 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f03480040d0 con 0x55dacfe311e0 2024-05-08T05:59:35.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.674+0000 7f036a209b80 10 client.26185 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:59:35.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.674+0000 7f036a209b80 10 client.26185 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-05-08T05:59:35.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.674+0000 7f036a209b80 20 client.26185 populate_metadata read hostname 'smithi082' 2024-05-08T05:59:35.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.674+0000 7f036a209b80 1 --2- 172.21.15.82:0/1203358582 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55dacfe258b0 0x55dacfe27cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:35.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.674+0000 7f036a209b80 4 client.26185 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:59:35.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.674+0000 7f036a209b80 1 -- 172.21.15.82:0/1203358582 --> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55dacfd84400 con 0x55dacfe258b0 2024-05-08T05:59:35.678 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.678+0000 7f0357e00700 1 --2- 172.21.15.82:0/1203358582 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55dacfe258b0 0x55dacfe27cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:35.680 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.680+0000 7f0357e00700 1 --2- 172.21.15.82:0/1203358582 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55dacfe258b0 0x55dacfe27cd0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a25a1a590989dc73 server_cookie=c5aedf0ca0b33a60 in_seq=0 out_seq=0 2024-05-08T05:59:35.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.680+0000 7f0346a00700 10 client.26185 ms_handle_connect on v2:172.21.15.151:6836/4192404464 2024-05-08T05:59:35.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.680+0000 7f0346a00700 1 -- 172.21.15.82:0/1203358582 <== mds.2 v2:172.21.15.151:6836/4192404464 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55dacfd84400 con 0x55dacfe258b0 2024-05-08T05:59:35.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.680+0000 7f0346a00700 10 client.26185 handle_command_reply: tid=0 2024-05-08T05:59:35.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.680+0000 7f036a209b80 1 client.26185 shutdown 2024-05-08T05:59:35.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.681+0000 7f036a209b80 1 -- 172.21.15.82:0/1203358582 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dacfe311e0 msgr2=0x55dacfeac730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:35.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.681+0000 7f036a209b80 1 --2- 172.21.15.82:0/1203358582 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dacfe311e0 0x55dacfeac730 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f034801c7e0 tx=0x7f0348007e20 comp rx=0 tx=0).stop 2024-05-08T05:59:35.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.682+0000 7f036a209b80 1 -- 172.21.15.82:0/1203358582 shutdown_connections 2024-05-08T05:59:35.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.682+0000 7f036a209b80 1 --2- 172.21.15.82:0/1203358582 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55dacfe258b0 0x55dacfe27cd0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:35.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.682+0000 7f036a209b80 1 --2- 172.21.15.82:0/1203358582 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55dacfe3ed40 0x55dacfe4da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:35.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.682+0000 7f036a209b80 1 --2- 172.21.15.82:0/1203358582 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dacfe311e0 0x55dacfeac730 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:35.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.682+0000 7f036a209b80 1 --2- 172.21.15.82:0/1203358582 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dacfe36080 0x55dacfe3e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:35.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.682+0000 7f036a209b80 1 -- 172.21.15.82:0/1203358582 >> 172.21.15.82:0/1203358582 conn(0x55dacfd52b60 msgr2=0x55dacfe18a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:59:35.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.682+0000 7f0346a00700 0 client.26185 ms_handle_reset on v2:172.21.15.151:6836/4192404464 2024-05-08T05:59:35.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.682+0000 7f036a209b80 1 -- 172.21.15.82:0/1203358582 shutdown_connections 2024-05-08T05:59:35.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.682+0000 7f036a209b80 1 -- 172.21.15.82:0/1203358582 wait complete. 2024-05-08T05:59:35.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.682+0000 7f036a209b80 20 client.26185 trim_cache size 0 max 16384 2024-05-08T05:59:35.684 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T05:59:35.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.685+0000 7f035f800700 1 -- 172.21.15.82:0/210951206 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f033c0b2b00 msgr2=0x7f033c0b4fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:35.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.685+0000 7f035f800700 1 --2- 172.21.15.82:0/210951206 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f033c0b2b00 0x7f033c0b4fc0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0350009990 tx=0x7f03500051f0 comp rx=0 tx=0).stop 2024-05-08T05:59:35.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.685+0000 7f035f800700 1 -- 172.21.15.82:0/210951206 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f035806bb40 msgr2=0x7f035806dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:35.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.685+0000 7f035f800700 1 --2- 172.21.15.82:0/210951206 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f035806bb40 0x7f035806dd80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f034000e9a0 tx=0x7f034000ecb0 comp rx=0 tx=0).stop 2024-05-08T05:59:35.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.686+0000 7f035f800700 1 -- 172.21.15.82:0/210951206 shutdown_connections 2024-05-08T05:59:35.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.686+0000 7f035f800700 1 --2- 172.21.15.82:0/210951206 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0358109510 0x7f035806e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:35.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.686+0000 7f035f800700 1 --2- 172.21.15.82:0/210951206 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f033c0b2b00 0x7f033c0b4fc0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:35.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.686+0000 7f035f800700 1 --2- 172.21.15.82:0/210951206 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f035806b180 0x7f0358074ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:35.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.686+0000 7f035f800700 1 --2- 172.21.15.82:0/210951206 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f035806bb40 0x7f035806dd80 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:35.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.686+0000 7f035f800700 1 -- 172.21.15.82:0/210951206 >> 172.21.15.82:0/210951206 conn(0x7f0358079350 msgr2=0x7f0358101100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:59:35.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.686+0000 7f035f800700 1 -- 172.21.15.82:0/210951206 shutdown_connections 2024-05-08T05:59:35.688 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:35.687+0000 7f035f800700 1 -- 172.21.15.82:0/210951206 wait complete. 2024-05-08T05:59:35.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:59:35 smithi151 ceph-mon[34815]: pgmap v727: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 7.2 MiB/s wr, 643 op/s 2024-05-08T05:59:35.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:59:35 smithi134 ceph-mon[34132]: pgmap v727: 97 pgs: 97 active+clean; 1.6 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 7.2 MiB/s wr, 643 op/s 2024-05-08T05:59:36.663 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-05-08T05:59:37.286 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:59:37.722 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:59:37 smithi082 ceph-mon[30098]: pgmap v728: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 8.2 MiB/s wr, 754 op/s 2024-05-08T05:59:37.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:59:37 smithi151 ceph-mon[34815]: pgmap v728: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 8.2 MiB/s wr, 754 op/s 2024-05-08T05:59:38.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:59:37 smithi134 ceph-mon[34132]: pgmap v728: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 8.2 MiB/s wr, 754 op/s 2024-05-08T05:59:39.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.623+0000 7f83b7e00700 1 -- 172.21.15.82:0/3701982427 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83b0105ee0 msgr2=0x7f83b0106370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:39.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.623+0000 7f83b7e00700 1 --2- 172.21.15.82:0/3701982427 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83b0105ee0 0x7f83b0106370 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f83a8009f90 tx=0x7f83a800b330 comp rx=0 tx=0).stop 2024-05-08T05:59:39.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.623+0000 7f83b7e00700 1 -- 172.21.15.82:0/3701982427 shutdown_connections 2024-05-08T05:59:39.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.623+0000 7f83b7e00700 1 --2- 172.21.15.82:0/3701982427 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83b0105ee0 0x7f83b0106370 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:39.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.623+0000 7f83b7e00700 1 --2- 172.21.15.82:0/3701982427 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83b01083d0 0x7f83b006b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:39.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.623+0000 7f83b7e00700 1 --2- 172.21.15.82:0/3701982427 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83b006b6f0 0x7f83b006bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:39.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.623+0000 7f83b7e00700 1 -- 172.21.15.82:0/3701982427 >> 172.21.15.82:0/3701982427 conn(0x7f83b0079350 msgr2=0x7f83b0079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:59:39.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.624+0000 7f83b7e00700 1 -- 172.21.15.82:0/3701982427 shutdown_connections 2024-05-08T05:59:39.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.624+0000 7f83b7e00700 1 -- 172.21.15.82:0/3701982427 wait complete. 2024-05-08T05:59:39.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.625+0000 7f83b7e00700 1 Processor -- start 2024-05-08T05:59:39.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.626+0000 7f83b7e00700 1 -- start start 2024-05-08T05:59:39.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.626+0000 7f83b7e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83b006b6f0 0x7f83b01a00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:39.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.626+0000 7f83b7e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83b0105ee0 0x7f83b01a0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:39.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.626+0000 7f83b7e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83b01083d0 0x7f83b01a49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:39.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.626+0000 7f83b7e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f83b0119c10 con 0x7f83b006b6f0 2024-05-08T05:59:39.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.626+0000 7f83b7e00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f83b0119a90 con 0x7f83b01083d0 2024-05-08T05:59:39.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.626+0000 7f83b7e00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f83b0119d90 con 0x7f83b0105ee0 2024-05-08T05:59:39.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.627+0000 7f83b4a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83b0105ee0 0x7f83b01a0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:39.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.627+0000 7f83b4a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83b0105ee0 0x7f83b01a0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:41494/0 (socket says 172.21.15.82:41494) 2024-05-08T05:59:39.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.627+0000 7f83b4a00700 1 -- 172.21.15.82:0/1547794122 learned_addr learned my addr 172.21.15.82:0/1547794122 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:59:39.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.627+0000 7f83b5400700 1 --2- 172.21.15.82:0/1547794122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83b006b6f0 0x7f83b01a00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:39.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.627+0000 7f83b5e00700 1 --2- 172.21.15.82:0/1547794122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83b01083d0 0x7f83b01a49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:39.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.628+0000 7f83b4a00700 1 -- 172.21.15.82:0/1547794122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83b01083d0 msgr2=0x7f83b01a49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:39.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.628+0000 7f83b4a00700 1 --2- 172.21.15.82:0/1547794122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83b01083d0 0x7f83b01a49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:39.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.628+0000 7f83b4a00700 1 -- 172.21.15.82:0/1547794122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83b006b6f0 msgr2=0x7f83b01a00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:39.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.628+0000 7f83b4a00700 1 --2- 172.21.15.82:0/1547794122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83b006b6f0 0x7f83b01a00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:39.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.628+0000 7f83b4a00700 1 -- 172.21.15.82:0/1547794122 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83b01a50f0 con 0x7f83b0105ee0 2024-05-08T05:59:39.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.628+0000 7f83b5e00700 1 --2- 172.21.15.82:0/1547794122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83b01083d0 0x7f83b01a49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:59:39.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.629+0000 7f83b4a00700 1 --2- 172.21.15.82:0/1547794122 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83b0105ee0 0x7f83b01a0620 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f839c00ec10 tx=0x7f839c00ef20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:59:39.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.629+0000 7f83ae000700 1 -- 172.21.15.82:0/1547794122 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839c00cd40 con 0x7f83b0105ee0 2024-05-08T05:59:39.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.629+0000 7f83ae000700 1 -- 172.21.15.82:0/1547794122 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f839c0044d0 con 0x7f83b0105ee0 2024-05-08T05:59:39.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.629+0000 7f83ae000700 1 -- 172.21.15.82:0/1547794122 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839c010690 con 0x7f83b0105ee0 2024-05-08T05:59:39.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.629+0000 7f83b7e00700 1 -- 172.21.15.82:0/1547794122 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83b01a53e0 con 0x7f83b0105ee0 2024-05-08T05:59:39.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.630+0000 7f83b7e00700 1 -- 172.21.15.82:0/1547794122 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83b01acc60 con 0x7f83b0105ee0 2024-05-08T05:59:39.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.635+0000 7f83ae000700 1 -- 172.21.15.82:0/1547794122 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f839c004020 con 0x7f83b0105ee0 2024-05-08T05:59:39.638 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:59:39 smithi082 ceph-mon[30098]: pgmap v729: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 6.2 MiB/s wr, 603 op/s 2024-05-08T05:59:39.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.637+0000 7f83ae000700 1 --2- 172.21.15.82:0/1547794122 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f83980b2880 0x7f83980b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:39.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.638+0000 7f83ae000700 1 -- 172.21.15.82:0/1547794122 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f839c0e2580 con 0x7f83b0105ee0 2024-05-08T05:59:39.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.638+0000 7f83b5400700 1 --2- 172.21.15.82:0/1547794122 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f83980b2880 0x7f83980b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:39.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.639+0000 7f83c275ab80 1 Processor -- start 2024-05-08T05:59:39.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.639+0000 7f83b5400700 1 --2- 172.21.15.82:0/1547794122 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f83980b2880 0x7f83980b4d40 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f83a4005950 tx=0x7f83a400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:59:39.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.639+0000 7f83c275ab80 1 -- start start 2024-05-08T05:59:39.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.640+0000 7f83c275ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599d19fd060 0x5599d19fd440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:39.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.640+0000 7f83c275ab80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5599d19fd980 0x5599d1a01490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:39.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.640+0000 7f83c275ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599d1a019d0 0x5599d1a01e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:39.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.640+0000 7f83c275ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5599d194fa20 con 0x5599d1a019d0 2024-05-08T05:59:39.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.640+0000 7f83c275ab80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5599d18ed760 con 0x5599d19fd980 2024-05-08T05:59:39.641 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.641+0000 7f83c275ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5599d194b9e0 con 0x5599d19fd060 2024-05-08T05:59:39.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.641+0000 7f83b4a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5599d19fd980 0x5599d1a01490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:39.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.641+0000 7f83b4a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5599d19fd980 0x5599d1a01490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:58722/0 (socket says 172.21.15.82:58722) 2024-05-08T05:59:39.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.641+0000 7f83b4a00700 1 -- 172.21.15.82:0/77180575 learned_addr learned my addr 172.21.15.82:0/77180575 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:59:39.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.641+0000 7f83b5400700 1 --2- 172.21.15.82:0/77180575 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599d19fd060 0x5599d19fd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:39.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.641+0000 7f83b4a00700 1 -- 172.21.15.82:0/77180575 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599d19fd060 msgr2=0x5599d19fd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:39.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.641+0000 7f83b4a00700 1 --2- 172.21.15.82:0/77180575 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599d19fd060 0x5599d19fd440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:39.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.641+0000 7f83b4a00700 1 -- 172.21.15.82:0/77180575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599d1a019d0 msgr2=0x5599d1a01e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:39.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.641+0000 7f83b4a00700 1 --2- 172.21.15.82:0/77180575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599d1a019d0 0x5599d1a01e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:39.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.641+0000 7f83b4a00700 1 -- 172.21.15.82:0/77180575 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599d189c8d0 con 0x5599d19fd980 2024-05-08T05:59:39.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.642+0000 7f83b4a00700 1 --2- 172.21.15.82:0/77180575 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5599d19fd980 0x5599d1a01490 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f839c0a98b0 tx=0x7f839c0a9980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c8991f94578548d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:59:39.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.642+0000 7f83a2a00700 1 -- 172.21.15.82:0/77180575 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839c0c3070 con 0x5599d19fd980 2024-05-08T05:59:39.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.642+0000 7f83a2a00700 1 -- 172.21.15.82:0/77180575 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f839c0b2360 con 0x5599d19fd980 2024-05-08T05:59:39.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.643+0000 7f83a2a00700 1 -- 172.21.15.82:0/77180575 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839c0cae60 con 0x5599d19fd980 2024-05-08T05:59:39.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.643+0000 7f83c275ab80 1 -- 172.21.15.82:0/77180575 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5599d19fd980 msgr2=0x5599d1a01490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:39.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.643+0000 7f83c275ab80 1 --2- 172.21.15.82:0/77180575 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5599d19fd980 0x5599d1a01490 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f839c0a98b0 tx=0x7f839c0a9980 comp rx=0 tx=0).stop 2024-05-08T05:59:39.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.643+0000 7f83c275ab80 1 -- 172.21.15.82:0/77180575 shutdown_connections 2024-05-08T05:59:39.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.643+0000 7f83c275ab80 1 --2- 172.21.15.82:0/77180575 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599d1a019d0 0x5599d1a01e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:39.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.643+0000 7f83c275ab80 1 --2- 172.21.15.82:0/77180575 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599d19fd060 0x5599d19fd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:39.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.643+0000 7f83c275ab80 1 --2- 172.21.15.82:0/77180575 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5599d19fd980 0x5599d1a01490 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:39.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.643+0000 7f83c275ab80 1 -- 172.21.15.82:0/77180575 >> 172.21.15.82:0/77180575 conn(0x5599d192bb60 msgr2=0x5599d19f77a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:59:39.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.643+0000 7f83c275ab80 1 -- 172.21.15.82:0/77180575 shutdown_connections 2024-05-08T05:59:39.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.644+0000 7f83c275ab80 1 -- 172.21.15.82:0/77180575 wait complete. 2024-05-08T05:59:39.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.644+0000 7f83c275ab80 1 -- start start 2024-05-08T05:59:39.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.644+0000 7f83c275ab80 1 Processor -- start 2024-05-08T05:59:39.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.645+0000 7f83c275ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599d19fd060 0x5599d1a08e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:39.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.645+0000 7f83c275ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599d19fd980 0x5599d1a061f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:39.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.645+0000 7f83c275ab80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5599d1a019d0 0x5599d1a06730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:39.646 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.645+0000 7f83c275ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5599d1a09c80 con 0x5599d19fd060 2024-05-08T05:59:39.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.645+0000 7f83c275ab80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5599d18b5b20 con 0x5599d1a019d0 2024-05-08T05:59:39.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.645+0000 7f83c275ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5599d1a09e00 con 0x5599d19fd980 2024-05-08T05:59:39.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.645+0000 7f83c275ab80 10 client.0 _ll_register_callbacks cb 0x5599d18f6c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:59:39.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.645+0000 7f83b5e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5599d1a019d0 0x5599d1a06730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:39.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.646+0000 7f83b5e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5599d1a019d0 0x5599d1a06730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:58736/0 (socket says 172.21.15.82:58736) 2024-05-08T05:59:39.647 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.646+0000 7f83b5e00700 1 -- 172.21.15.82:0/2559511675 learned_addr learned my addr 172.21.15.82:0/2559511675 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:59:39.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.646+0000 7f83b4a00700 1 --2- 172.21.15.82:0/2559511675 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599d19fd980 0x5599d1a061f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:39.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.646+0000 7f83b4a00700 1 -- 172.21.15.82:0/2559511675 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5599d1a019d0 msgr2=0x5599d1a06730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:39.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.646+0000 7f83b4a00700 1 --2- 172.21.15.82:0/2559511675 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5599d1a019d0 0x5599d1a06730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:39.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.646+0000 7f83b4a00700 1 -- 172.21.15.82:0/2559511675 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599d19fd060 msgr2=0x5599d1a08e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:39.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.646+0000 7f83b4a00700 1 --2- 172.21.15.82:0/2559511675 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599d19fd060 0x5599d1a08e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:39.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.646+0000 7f83b4a00700 1 -- 172.21.15.82:0/2559511675 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599d1915420 con 0x5599d19fd980 2024-05-08T05:59:39.648 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.647+0000 7f83b4a00700 1 --2- 172.21.15.82:0/2559511675 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599d19fd980 0x5599d1a061f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f839c00c660 tx=0x7f839c0a5470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7731f5a70562f9e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:59:39.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.647+0000 7f8397400700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T05:59:39.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.647+0000 7f8397400700 1 -- 172.21.15.82:0/2559511675 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839c06d020 con 0x5599d19fd980 2024-05-08T05:59:39.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.647+0000 7f8397400700 1 -- 172.21.15.82:0/2559511675 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f839c0aa020 con 0x5599d19fd980 2024-05-08T05:59:39.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.647+0000 7f83c275ab80 1 -- 172.21.15.82:0/2559511675 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f839c0b2360 con 0x5599d19fd980 2024-05-08T05:59:39.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.649+0000 7f8397400700 1 -- 172.21.15.82:0/2559511675 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f839c0c3070 con 0x5599d19fd980 2024-05-08T05:59:39.649 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.649+0000 7f83c275ab80 10 client.26197 fetch_fsmap learned FSMap version 31 2024-05-08T05:59:39.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.649+0000 7f83c275ab80 1 -- 172.21.15.82:0/2559511675 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5599d1a09c80 con 0x5599d19fd980 2024-05-08T05:59:39.650 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.649+0000 7f8397400700 1 -- 172.21.15.82:0/2559511675 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f839c0b2360 con 0x5599d19fd980 2024-05-08T05:59:39.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.649+0000 7f8397400700 1 -- 172.21.15.82:0/2559511675 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f839c0b2580 con 0x5599d19fd980 2024-05-08T05:59:39.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.649+0000 7f83c275ab80 10 client.26197 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:59:39.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.649+0000 7f83c275ab80 10 client.26197 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-08T05:59:39.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.649+0000 7f83c275ab80 20 client.26197 populate_metadata read hostname 'smithi082' 2024-05-08T05:59:39.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.649+0000 7f83c275ab80 1 --2- 172.21.15.82:0/2559511675 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x5599d1a16aa0 0x5599d1a18f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:39.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.649+0000 7f83c275ab80 4 client.26197 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:59:39.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.649+0000 7f83c275ab80 1 -- 172.21.15.82:0/2559511675 --> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5599d19ca0a0 con 0x5599d1a16aa0 2024-05-08T05:59:39.651 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.650+0000 7f83b5400700 1 --2- 172.21.15.82:0/2559511675 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x5599d1a16aa0 0x5599d1a18f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:39.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.654+0000 7f83b5400700 1 --2- 172.21.15.82:0/2559511675 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x5599d1a16aa0 0x5599d1a18f40 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=dfe2fbb15e6c0bf3 server_cookie=83eacbc9c829579a in_seq=0 out_seq=0 2024-05-08T05:59:39.654 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.654+0000 7f8397400700 10 client.26197 ms_handle_connect on v2:172.21.15.151:6838/2963754236 2024-05-08T05:59:39.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.654+0000 7f8397400700 1 -- 172.21.15.82:0/2559511675 <== mds.1 v2:172.21.15.151:6838/2963754236 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5599d19ca0a0 con 0x5599d1a16aa0 2024-05-08T05:59:39.655 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.655+0000 7f8397400700 10 client.26197 handle_command_reply: tid=0 2024-05-08T05:59:39.656 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.655+0000 7f83c275ab80 1 client.26197 shutdown 2024-05-08T05:59:39.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.656+0000 7f83c275ab80 1 -- 172.21.15.82:0/2559511675 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599d19fd980 msgr2=0x5599d1a061f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:39.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.656+0000 7f83c275ab80 1 --2- 172.21.15.82:0/2559511675 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599d19fd980 0x5599d1a061f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f839c00c660 tx=0x7f839c0a5470 comp rx=0 tx=0).stop 2024-05-08T05:59:39.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.656+0000 7f83c275ab80 1 -- 172.21.15.82:0/2559511675 shutdown_connections 2024-05-08T05:59:39.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.656+0000 7f83c275ab80 1 --2- 172.21.15.82:0/2559511675 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x5599d1a16aa0 0x5599d1a18f40 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:39.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.656+0000 7f83c275ab80 1 --2- 172.21.15.82:0/2559511675 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5599d1a019d0 0x5599d1a06730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:39.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.656+0000 7f83c275ab80 1 --2- 172.21.15.82:0/2559511675 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599d19fd060 0x5599d1a08e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:39.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.656+0000 7f83c275ab80 1 --2- 172.21.15.82:0/2559511675 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599d19fd980 0x5599d1a061f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:39.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.656+0000 7f83c275ab80 1 -- 172.21.15.82:0/2559511675 >> 172.21.15.82:0/2559511675 conn(0x5599d192bb60 msgr2=0x5599d19f22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:59:39.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.656+0000 7f8397400700 0 client.26197 ms_handle_reset on v2:172.21.15.151:6838/2963754236 2024-05-08T05:59:39.657 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.656+0000 7f83c275ab80 1 -- 172.21.15.82:0/2559511675 shutdown_connections 2024-05-08T05:59:39.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.656+0000 7f83c275ab80 1 -- 172.21.15.82:0/2559511675 wait complete. 2024-05-08T05:59:39.658 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.657+0000 7f83c275ab80 20 client.26197 trim_cache size 0 max 16384 2024-05-08T05:59:39.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.685+0000 7f83c275ab80 1 Processor -- start 2024-05-08T05:59:39.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.685+0000 7f83c275ab80 1 -- start start 2024-05-08T05:59:39.686 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.685+0000 7f83c275ab80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5599d19fd060 0x5599d1a03e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:39.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.685+0000 7f83c275ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599d19fd980 0x5599d1a12d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:39.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.685+0000 7f83c275ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599d1a019d0 0x5599d1a04b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:39.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.685+0000 7f83c275ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f83b01b4270 con 0x5599d19fd980 2024-05-08T05:59:39.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.685+0000 7f83c275ab80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f83b01b5db0 con 0x5599d19fd060 2024-05-08T05:59:39.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.685+0000 7f83c275ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f83b01b4940 con 0x5599d1a019d0 2024-05-08T05:59:39.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.686+0000 7f83b5400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5599d19fd060 0x5599d1a03e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:39.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.686+0000 7f83b5e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599d1a019d0 0x5599d1a04b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:39.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.686+0000 7f83b5e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599d1a019d0 0x5599d1a04b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:41524/0 (socket says 172.21.15.82:41524) 2024-05-08T05:59:39.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.686+0000 7f83b5e00700 1 -- 172.21.15.82:0/3256109931 learned_addr learned my addr 172.21.15.82:0/3256109931 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:59:39.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.686+0000 7f83b5e00700 1 -- 172.21.15.82:0/3256109931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5599d19fd060 msgr2=0x5599d1a03e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:39.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.686+0000 7f83b5e00700 1 --2- 172.21.15.82:0/3256109931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5599d19fd060 0x5599d1a03e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:39.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.686+0000 7f83b5e00700 1 -- 172.21.15.82:0/3256109931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599d19fd980 msgr2=0x5599d1a12d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:39.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.686+0000 7f83b5e00700 1 --2- 172.21.15.82:0/3256109931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599d19fd980 0x5599d1a12d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:39.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.686+0000 7f83b5e00700 1 -- 172.21.15.82:0/3256109931 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599d1a16880 con 0x5599d1a019d0 2024-05-08T05:59:39.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.687+0000 7f83b5e00700 1 --2- 172.21.15.82:0/3256109931 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599d1a019d0 0x5599d1a04b00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f83a8009af0 tx=0x7f83a8009470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fc45973a889a05d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:59:39.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.687+0000 7f83a2000700 1 -- 172.21.15.82:0/3256109931 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a8004e30 con 0x5599d1a019d0 2024-05-08T05:59:39.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.687+0000 7f83a2000700 1 -- 172.21.15.82:0/3256109931 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83a8005040 con 0x5599d1a019d0 2024-05-08T05:59:39.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.687+0000 7f83a2000700 1 -- 172.21.15.82:0/3256109931 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a8026680 con 0x5599d1a019d0 2024-05-08T05:59:39.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.688+0000 7f83c275ab80 1 -- 172.21.15.82:0/3256109931 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599d1a019d0 msgr2=0x5599d1a04b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:39.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.688+0000 7f83c275ab80 1 --2- 172.21.15.82:0/3256109931 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599d1a019d0 0x5599d1a04b00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f83a8009af0 tx=0x7f83a8009470 comp rx=0 tx=0).stop 2024-05-08T05:59:39.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.689+0000 7f83c275ab80 1 -- 172.21.15.82:0/3256109931 shutdown_connections 2024-05-08T05:59:39.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.689+0000 7f83c275ab80 1 --2- 172.21.15.82:0/3256109931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5599d19fd060 0x5599d1a03e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:39.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.689+0000 7f83c275ab80 1 --2- 172.21.15.82:0/3256109931 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599d1a019d0 0x5599d1a04b00 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:39.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.689+0000 7f83c275ab80 1 --2- 172.21.15.82:0/3256109931 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599d19fd980 0x5599d1a12d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:39.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.689+0000 7f83c275ab80 1 -- 172.21.15.82:0/3256109931 >> 172.21.15.82:0/3256109931 conn(0x5599d192bb60 msgr2=0x5599d1a061b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:59:39.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.689+0000 7f83c275ab80 1 -- 172.21.15.82:0/3256109931 shutdown_connections 2024-05-08T05:59:39.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.689+0000 7f83c275ab80 1 -- 172.21.15.82:0/3256109931 wait complete. 2024-05-08T05:59:39.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.690+0000 7f83c275ab80 1 -- start start 2024-05-08T05:59:39.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.690+0000 7f83c275ab80 1 Processor -- start 2024-05-08T05:59:39.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.691+0000 7f83c275ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599d19fd060 0x5599d1a0f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:39.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.691+0000 7f83c275ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599d19fd980 0x5599d1a1dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:39.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.691+0000 7f83c275ab80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5599d1a019d0 0x5599d1a1e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:39.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.691+0000 7f83c275ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f83b01b56e0 con 0x5599d19fd060 2024-05-08T05:59:39.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.691+0000 7f83c275ab80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f83b01b5010 con 0x5599d1a019d0 2024-05-08T05:59:39.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.691+0000 7f83c275ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f83b01b2210 con 0x5599d19fd980 2024-05-08T05:59:39.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.691+0000 7f83c275ab80 10 client.0 _ll_register_callbacks cb 0x5599d18f6c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:59:39.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.691+0000 7f83b5e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5599d1a019d0 0x5599d1a1e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:39.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.691+0000 7f83b5e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5599d1a019d0 0x5599d1a1e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:58754/0 (socket says 172.21.15.82:58754) 2024-05-08T05:59:39.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.691+0000 7f83b5e00700 1 -- 172.21.15.82:0/1011163799 learned_addr learned my addr 172.21.15.82:0/1011163799 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:59:39.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.691+0000 7f83b4a00700 1 --2- 172.21.15.82:0/1011163799 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599d19fd980 0x5599d1a1dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:39.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.692+0000 7f83b5400700 1 --2- 172.21.15.82:0/1011163799 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599d19fd060 0x5599d1a0f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:39.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.692+0000 7f83b5e00700 1 -- 172.21.15.82:0/1011163799 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599d19fd980 msgr2=0x5599d1a1dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:39.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.692+0000 7f83b5e00700 1 --2- 172.21.15.82:0/1011163799 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599d19fd980 0x5599d1a1dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:39.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.692+0000 7f83b5e00700 1 -- 172.21.15.82:0/1011163799 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599d19fd060 msgr2=0x5599d1a0f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:39.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.692+0000 7f83b5e00700 1 --2- 172.21.15.82:0/1011163799 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599d19fd060 0x5599d1a0f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:39.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.692+0000 7f83b5e00700 1 -- 172.21.15.82:0/1011163799 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599d19f43f0 con 0x5599d1a019d0 2024-05-08T05:59:39.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.694+0000 7f83b5e00700 1 --2- 172.21.15.82:0/1011163799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5599d1a019d0 0x5599d1a1e140 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f83a800b900 tx=0x7f83a80096c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db50749f90f2c60e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:59:39.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.694+0000 7f8397400700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:59:39.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.694+0000 7f8397400700 1 -- 172.21.15.82:0/1011163799 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a8005400 con 0x5599d1a019d0 2024-05-08T05:59:39.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.695+0000 7f8397400700 1 -- 172.21.15.82:0/1011163799 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f83a80055a0 con 0x5599d1a019d0 2024-05-08T05:59:39.698 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.698+0000 7f83c275ab80 1 -- 172.21.15.82:0/1011163799 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f83a8005040 con 0x5599d1a019d0 2024-05-08T05:59:39.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.698+0000 7f8397400700 1 -- 172.21.15.82:0/1011163799 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f83a80057a0 con 0x5599d1a019d0 2024-05-08T05:59:39.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.699+0000 7f83c275ab80 10 client.26177 fetch_fsmap learned FSMap version 31 2024-05-08T05:59:39.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.699+0000 7f83c275ab80 1 -- 172.21.15.82:0/1011163799 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5599d1a81020 con 0x5599d1a019d0 2024-05-08T05:59:39.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.699+0000 7f8397400700 1 -- 172.21.15.82:0/1011163799 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f83a80268d0 con 0x5599d1a019d0 2024-05-08T05:59:39.700 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.700+0000 7f8397400700 1 -- 172.21.15.82:0/1011163799 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f83a8011070 con 0x5599d1a019d0 2024-05-08T05:59:39.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.703+0000 7f83c275ab80 10 client.26177 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:59:39.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.703+0000 7f83c275ab80 10 client.26177 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-08T05:59:39.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.703+0000 7f83c275ab80 20 client.26177 populate_metadata read hostname 'smithi082' 2024-05-08T05:59:39.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.703+0000 7f83c275ab80 1 --2- 172.21.15.82:0/1011163799 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x5599d1a81570 0x5599d1a83990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:39.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.703+0000 7f83c275ab80 4 client.26177 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:59:39.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.703+0000 7f83c275ab80 1 -- 172.21.15.82:0/1011163799 --> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f83a8005040 con 0x5599d1a81570 2024-05-08T05:59:39.704 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.703+0000 7f83b5400700 1 --2- 172.21.15.82:0/1011163799 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x5599d1a81570 0x5599d1a83990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:39.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.704+0000 7f8397400700 10 client.26177 ms_handle_connect on v2:172.21.15.151:6838/2963754236 2024-05-08T05:59:39.705 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.704+0000 7f83b5400700 1 --2- 172.21.15.82:0/1011163799 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x5599d1a81570 0x5599d1a83990 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9126fd5068e7cb34 server_cookie=862ce16dc0568753 in_seq=0 out_seq=0 2024-05-08T05:59:39.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.705+0000 7f8397400700 1 -- 172.21.15.82:0/1011163799 <== mds.1 v2:172.21.15.151:6838/2963754236 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f83a8005040 con 0x5599d1a81570 2024-05-08T05:59:39.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.705+0000 7f8397400700 10 client.26177 handle_command_reply: tid=0 2024-05-08T05:59:39.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.705+0000 7f83c275ab80 1 client.26177 shutdown 2024-05-08T05:59:39.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.706+0000 7f83c275ab80 1 -- 172.21.15.82:0/1011163799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5599d1a019d0 msgr2=0x5599d1a1e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:39.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.706+0000 7f83c275ab80 1 --2- 172.21.15.82:0/1011163799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5599d1a019d0 0x5599d1a1e140 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f83a800b900 tx=0x7f83a80096c0 comp rx=0 tx=0).stop 2024-05-08T05:59:39.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.707+0000 7f83c275ab80 1 -- 172.21.15.82:0/1011163799 shutdown_connections 2024-05-08T05:59:39.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.707+0000 7f83c275ab80 1 --2- 172.21.15.82:0/1011163799 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x5599d1a81570 0x5599d1a83990 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:39.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.707+0000 7f83c275ab80 1 --2- 172.21.15.82:0/1011163799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5599d1a019d0 0x5599d1a1e140 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:39.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.707+0000 7f83c275ab80 1 --2- 172.21.15.82:0/1011163799 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5599d19fd060 0x5599d1a0f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:39.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.707+0000 7f83c275ab80 1 --2- 172.21.15.82:0/1011163799 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599d19fd980 0x5599d1a1dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:39.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.707+0000 7f8397400700 0 client.26177 ms_handle_reset on v2:172.21.15.151:6838/2963754236 2024-05-08T05:59:39.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.707+0000 7f83c275ab80 1 -- 172.21.15.82:0/1011163799 >> 172.21.15.82:0/1011163799 conn(0x5599d192bb60 msgr2=0x5599d19f1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:59:39.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.707+0000 7f83c275ab80 1 -- 172.21.15.82:0/1011163799 shutdown_connections 2024-05-08T05:59:39.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.707+0000 7f83c275ab80 1 -- 172.21.15.82:0/1011163799 wait complete. 2024-05-08T05:59:39.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.707+0000 7f83c275ab80 20 client.26177 trim_cache size 0 max 16384 2024-05-08T05:59:39.709 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T05:59:39.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.710+0000 7f83b7e00700 1 -- 172.21.15.82:0/1547794122 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f83980b2880 msgr2=0x7f83980b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:39.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.710+0000 7f83b7e00700 1 --2- 172.21.15.82:0/1547794122 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f83980b2880 0x7f83980b4d40 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f83a4005950 tx=0x7f83a400b410 comp rx=0 tx=0).stop 2024-05-08T05:59:39.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.710+0000 7f83b7e00700 1 -- 172.21.15.82:0/1547794122 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83b0105ee0 msgr2=0x7f83b01a0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:39.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.710+0000 7f83b7e00700 1 --2- 172.21.15.82:0/1547794122 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83b0105ee0 0x7f83b01a0620 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f839c00ec10 tx=0x7f839c00ef20 comp rx=0 tx=0).stop 2024-05-08T05:59:39.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.710+0000 7f83b7e00700 1 -- 172.21.15.82:0/1547794122 shutdown_connections 2024-05-08T05:59:39.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.710+0000 7f83b7e00700 1 --2- 172.21.15.82:0/1547794122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83b01083d0 0x7f83b01a49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:39.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.710+0000 7f83b7e00700 1 --2- 172.21.15.82:0/1547794122 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f83980b2880 0x7f83980b4d40 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:39.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.710+0000 7f83b7e00700 1 --2- 172.21.15.82:0/1547794122 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f83b006b6f0 0x7f83b01a00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:39.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.710+0000 7f83b7e00700 1 --2- 172.21.15.82:0/1547794122 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83b0105ee0 0x7f83b01a0620 secure :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f839c00ec10 tx=0x7f839c00ef20 comp rx=0 tx=0).stop 2024-05-08T05:59:39.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.710+0000 7f83b7e00700 1 -- 172.21.15.82:0/1547794122 >> 172.21.15.82:0/1547794122 conn(0x7f83b0079350 msgr2=0x7f83b0104ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:59:39.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.713+0000 7f83b7e00700 1 -- 172.21.15.82:0/1547794122 shutdown_connections 2024-05-08T05:59:39.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:39.713+0000 7f83b7e00700 1 -- 172.21.15.82:0/1547794122 wait complete. 2024-05-08T05:59:39.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:59:39 smithi151 ceph-mon[34815]: pgmap v729: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 6.2 MiB/s wr, 603 op/s 2024-05-08T05:59:40.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:59:39 smithi134 ceph-mon[34132]: pgmap v729: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 6.2 MiB/s wr, 603 op/s 2024-05-08T05:59:40.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 530.0 s, 1602.0 tps, lat 62.773 ms stddev 80.781 2024-05-08T05:59:40.677 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-05-08T05:59:41.291 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:59:41.785 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:59:41 smithi082 ceph-mon[30098]: pgmap v730: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.0 MiB/s wr, 770 op/s 2024-05-08T05:59:41.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:59:41 smithi151 ceph-mon[34815]: pgmap v730: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.0 MiB/s wr, 770 op/s 2024-05-08T05:59:42.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:59:41 smithi134 ceph-mon[34132]: pgmap v730: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.0 MiB/s wr, 770 op/s 2024-05-08T05:59:43.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:59:43 smithi082 ceph-mon[30098]: pgmap v731: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.6 MiB/s wr, 625 op/s 2024-05-08T05:59:43.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.760+0000 7f9675a00700 1 -- 172.21.15.82:0/4006466975 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f96701056e0 msgr2=0x7f9670105b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:43.785 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.760+0000 7f9675a00700 1 --2- 172.21.15.82:0/4006466975 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f96701056e0 0x7f9670105b60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f965c009990 tx=0x7f965c009ca0 comp rx=0 tx=0).stop 2024-05-08T05:59:43.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.760+0000 7f9675a00700 1 -- 172.21.15.82:0/4006466975 shutdown_connections 2024-05-08T05:59:43.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.760+0000 7f9675a00700 1 --2- 172.21.15.82:0/4006466975 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96701060a0 0x7f96701125b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:43.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.760+0000 7f9675a00700 1 --2- 172.21.15.82:0/4006466975 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f967010b6e0 0x7f967010bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:43.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.760+0000 7f9675a00700 1 --2- 172.21.15.82:0/4006466975 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f96701056e0 0x7f9670105b60 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:43.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.760+0000 7f9675a00700 1 -- 172.21.15.82:0/4006466975 >> 172.21.15.82:0/4006466975 conn(0x7f96701011d0 msgr2=0x7f96701035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:59:43.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.760+0000 7f9675a00700 1 -- 172.21.15.82:0/4006466975 shutdown_connections 2024-05-08T05:59:43.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.760+0000 7f9675a00700 1 -- 172.21.15.82:0/4006466975 wait complete. 2024-05-08T05:59:43.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.762+0000 7f9675a00700 1 Processor -- start 2024-05-08T05:59:43.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.762+0000 7f9675a00700 1 -- start start 2024-05-08T05:59:43.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.763+0000 7f9675a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f96701056e0 0x7f9670112480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:43.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.763+0000 7f9675a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96701060a0 0x7f967010f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:43.786 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.763+0000 7f9675a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f967010b6e0 0x7f967010fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:43.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.764+0000 7f9675a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9670115920 con 0x7f96701060a0 2024-05-08T05:59:43.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.764+0000 7f9675a00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f96701157a0 con 0x7f967010b6e0 2024-05-08T05:59:43.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.764+0000 7f9675a00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9670115aa0 con 0x7f96701056e0 2024-05-08T05:59:43.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.764+0000 7f966ea00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f96701056e0 0x7f9670112480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:43.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.764+0000 7f966ea00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f96701056e0 0x7f9670112480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:57512/0 (socket says 172.21.15.82:57512) 2024-05-08T05:59:43.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.764+0000 7f966ea00700 1 -- 172.21.15.82:0/2570487666 learned_addr learned my addr 172.21.15.82:0/2570487666 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:59:43.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.764+0000 7f966e000700 1 --2- 172.21.15.82:0/2570487666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96701060a0 0x7f967010f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:43.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.764+0000 7f966f400700 1 --2- 172.21.15.82:0/2570487666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f967010b6e0 0x7f967010fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:43.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.764+0000 7f966ea00700 1 -- 172.21.15.82:0/2570487666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f967010b6e0 msgr2=0x7f967010fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:43.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.764+0000 7f966ea00700 1 --2- 172.21.15.82:0/2570487666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f967010b6e0 0x7f967010fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:43.787 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.764+0000 7f966ea00700 1 -- 172.21.15.82:0/2570487666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96701060a0 msgr2=0x7f967010f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:43.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.764+0000 7f966ea00700 1 --2- 172.21.15.82:0/2570487666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96701060a0 0x7f967010f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:43.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.764+0000 7f966ea00700 1 -- 172.21.15.82:0/2570487666 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96701a1e00 con 0x7f96701056e0 2024-05-08T05:59:43.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.765+0000 7f966e000700 1 --2- 172.21.15.82:0/2570487666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96701060a0 0x7f967010f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:59:43.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.765+0000 7f966ea00700 1 --2- 172.21.15.82:0/2570487666 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f96701056e0 0x7f9670112480 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f966000e9a0 tx=0x7f966000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:59:43.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.765+0000 7f9667400700 1 -- 172.21.15.82:0/2570487666 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f966000cbd0 con 0x7f96701056e0 2024-05-08T05:59:43.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.765+0000 7f9667400700 1 -- 172.21.15.82:0/2570487666 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f966000cd70 con 0x7f96701056e0 2024-05-08T05:59:43.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.765+0000 7f9667400700 1 -- 172.21.15.82:0/2570487666 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9660018680 con 0x7f96701056e0 2024-05-08T05:59:43.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.765+0000 7f9675a00700 1 -- 172.21.15.82:0/2570487666 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96701a20f0 con 0x7f96701056e0 2024-05-08T05:59:43.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.766+0000 7f9675a00700 1 -- 172.21.15.82:0/2570487666 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96701a25e0 con 0x7f96701056e0 2024-05-08T05:59:43.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.772+0000 7f9667400700 1 -- 172.21.15.82:0/2570487666 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f9660010430 con 0x7f96701056e0 2024-05-08T05:59:43.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.775+0000 7f9667400700 1 --2- 172.21.15.82:0/2570487666 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f96540b2900 0x7f96540b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:43.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.775+0000 7f9667400700 1 -- 172.21.15.82:0/2570487666 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f96600e2340 con 0x7f96701056e0 2024-05-08T05:59:43.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.775+0000 7f9680337b80 1 Processor -- start 2024-05-08T05:59:43.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.775+0000 7f966e000700 1 --2- 172.21.15.82:0/2570487666 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f96540b2900 0x7f96540b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:43.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.775+0000 7f9680337b80 1 -- start start 2024-05-08T05:59:43.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.776+0000 7f9680337b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b37beebbc0 0x55b37beebfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:43.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.776+0000 7f9680337b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b37beec4e0 0x55b37bee62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:43.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.776+0000 7f9680337b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b37bee68f0 0x55b37bee6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:43.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.776+0000 7f9680337b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b37be38a20 con 0x55b37beebbc0 2024-05-08T05:59:43.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.776+0000 7f9680337b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b37bdd6760 con 0x55b37beec4e0 2024-05-08T05:59:43.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.776+0000 7f9680337b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55b37be349e0 con 0x55b37bee68f0 2024-05-08T05:59:43.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.777+0000 7f966e000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b37beec4e0 0x55b37bee62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:43.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.777+0000 7f966e000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b37beec4e0 0x55b37bee62d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:32910/0 (socket says 172.21.15.82:32910) 2024-05-08T05:59:43.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.777+0000 7f966e000700 1 -- 172.21.15.82:0/3551500759 learned_addr learned my addr 172.21.15.82:0/3551500759 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:59:43.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.777+0000 7f966ea00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b37beebbc0 0x55b37beebfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:43.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.777+0000 7f966e000700 1 --2- 172.21.15.82:0/2570487666 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f96540b2900 0x7f96540b4dc0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f965c00b2e0 tx=0x7f965c01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:59:43.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.777+0000 7f966f400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b37bee68f0 0x55b37bee6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:43.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.778+0000 7f966e000700 1 -- 172.21.15.82:0/3551500759 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b37bee68f0 msgr2=0x55b37bee6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:43.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.778+0000 7f966e000700 1 --2- 172.21.15.82:0/3551500759 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b37bee68f0 0x55b37bee6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:43.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.778+0000 7f966e000700 1 -- 172.21.15.82:0/3551500759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b37beebbc0 msgr2=0x55b37beebfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:43.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.778+0000 7f966e000700 1 --2- 172.21.15.82:0/3551500759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b37beebbc0 0x55b37beebfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:43.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.778+0000 7f966e000700 1 -- 172.21.15.82:0/3551500759 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b37bd858d0 con 0x55b37beec4e0 2024-05-08T05:59:43.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.778+0000 7f966ea00700 1 --2- 172.21.15.82:0/3551500759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b37beebbc0 0x55b37beebfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:59:43.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.779+0000 7f966e000700 1 --2- 172.21.15.82:0/3551500759 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b37beec4e0 0x55b37bee62d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f965c015000 tx=0x7f965c01e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=37d2b21a740bc7b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:59:43.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.779+0000 7f965be00700 1 -- 172.21.15.82:0/3551500759 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f965c00f870 con 0x55b37beec4e0 2024-05-08T05:59:43.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.779+0000 7f965be00700 1 -- 172.21.15.82:0/3551500759 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f965c02f460 con 0x55b37beec4e0 2024-05-08T05:59:43.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.779+0000 7f965be00700 1 -- 172.21.15.82:0/3551500759 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f965c023600 con 0x55b37beec4e0 2024-05-08T05:59:43.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.780+0000 7f9680337b80 1 -- 172.21.15.82:0/3551500759 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b37beec4e0 msgr2=0x55b37bee62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:43.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.780+0000 7f9680337b80 1 --2- 172.21.15.82:0/3551500759 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b37beec4e0 0x55b37bee62d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f965c015000 tx=0x7f965c01e000 comp rx=0 tx=0).stop 2024-05-08T05:59:43.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.780+0000 7f9680337b80 1 -- 172.21.15.82:0/3551500759 shutdown_connections 2024-05-08T05:59:43.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.780+0000 7f9680337b80 1 --2- 172.21.15.82:0/3551500759 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b37bee68f0 0x55b37bee6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:43.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.780+0000 7f9680337b80 1 --2- 172.21.15.82:0/3551500759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b37beebbc0 0x55b37beebfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:43.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.780+0000 7f9680337b80 1 --2- 172.21.15.82:0/3551500759 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b37beec4e0 0x55b37bee62d0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:43.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.780+0000 7f9680337b80 1 -- 172.21.15.82:0/3551500759 >> 172.21.15.82:0/3551500759 conn(0x55b37be5e6d0 msgr2=0x55b37bee0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:59:43.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.780+0000 7f9680337b80 1 -- 172.21.15.82:0/3551500759 shutdown_connections 2024-05-08T05:59:43.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.780+0000 7f9680337b80 1 -- 172.21.15.82:0/3551500759 wait complete. 2024-05-08T05:59:43.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.781+0000 7f9680337b80 1 -- start start 2024-05-08T05:59:43.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.782+0000 7f9680337b80 1 Processor -- start 2024-05-08T05:59:43.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.783+0000 7f9680337b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b37bee68f0 0x55b37bef21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:43.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.783+0000 7f9680337b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b37beebbc0 0x55b37beef540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:43.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.783+0000 7f9680337b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b37beec4e0 0x55b37beefa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:43.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.783+0000 7f966ea00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b37bee68f0 0x55b37bef21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:43.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.783+0000 7f966ea00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b37bee68f0 0x55b37bef21a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:32924/0 (socket says 172.21.15.82:32924) 2024-05-08T05:59:43.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.783+0000 7f966e000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b37beebbc0 0x55b37beef540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:43.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.783+0000 7f9680337b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55b37bef2ec0 con 0x55b37beec4e0 2024-05-08T05:59:43.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.783+0000 7f966ea00700 1 -- 172.21.15.82:0/2127861656 learned_addr learned my addr 172.21.15.82:0/2127861656 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:59:43.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.783+0000 7f9680337b80 1 -- 172.21.15.82:0/2127861656 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b37bd9eb20 con 0x55b37bee68f0 2024-05-08T05:59:43.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.783+0000 7f9680337b80 1 -- 172.21.15.82:0/2127861656 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55b37bef3040 con 0x55b37beebbc0 2024-05-08T05:59:43.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.783+0000 7f9680337b80 10 client.0 _ll_register_callbacks cb 0x55b37bddfc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:59:43.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.783+0000 7f966f400700 1 --2- 172.21.15.82:0/2127861656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b37beec4e0 0x55b37beefa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:43.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.784+0000 7f966ea00700 1 -- 172.21.15.82:0/2127861656 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b37beebbc0 msgr2=0x55b37beef540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:43.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.784+0000 7f966ea00700 1 --2- 172.21.15.82:0/2127861656 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b37beebbc0 0x55b37beef540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:43.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.784+0000 7f966ea00700 1 -- 172.21.15.82:0/2127861656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b37beec4e0 msgr2=0x55b37beefa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:43.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.784+0000 7f966ea00700 1 --2- 172.21.15.82:0/2127861656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b37beec4e0 0x55b37beefa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:43.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.784+0000 7f966ea00700 1 -- 172.21.15.82:0/2127861656 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b37bdfe420 con 0x55b37bee68f0 2024-05-08T05:59:43.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.785+0000 7f966e000700 1 --2- 172.21.15.82:0/2127861656 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b37beebbc0 0x55b37beef540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:59:43.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.785+0000 7f966ea00700 1 --2- 172.21.15.82:0/2127861656 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b37bee68f0 0x55b37bef21a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f96600e01c0 tx=0x7f96600a9eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4db3c361f2f2f6a1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:59:43.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.785+0000 7f9658c00700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:59:43.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.786+0000 7f9658c00700 1 -- 172.21.15.82:0/2127861656 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96600a9480 con 0x55b37bee68f0 2024-05-08T05:59:43.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.786+0000 7f9658c00700 1 -- 172.21.15.82:0/2127861656 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f9660010930 con 0x55b37bee68f0 2024-05-08T05:59:43.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.786+0000 7f9680337b80 1 -- 172.21.15.82:0/2127861656 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f965c02f460 con 0x55b37bee68f0 2024-05-08T05:59:43.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.787+0000 7f9658c00700 1 -- 172.21.15.82:0/2127861656 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f96600aa070 con 0x55b37bee68f0 2024-05-08T05:59:43.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.787+0000 7f9680337b80 10 client.26189 fetch_fsmap learned FSMap version 31 2024-05-08T05:59:43.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.787+0000 7f9680337b80 1 -- 172.21.15.82:0/2127861656 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55b37befd790 con 0x55b37bee68f0 2024-05-08T05:59:43.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.788+0000 7f9658c00700 1 -- 172.21.15.82:0/2127861656 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f965c02f460 con 0x55b37bee68f0 2024-05-08T05:59:43.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.788+0000 7f9658c00700 1 -- 172.21.15.82:0/2127861656 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f96600a52e0 con 0x55b37bee68f0 2024-05-08T05:59:43.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.788+0000 7f9680337b80 10 client.26189 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:59:43.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.788+0000 7f9680337b80 10 client.26189 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:59:43.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.789+0000 7f9680337b80 20 client.26189 populate_metadata read hostname 'smithi082' 2024-05-08T05:59:43.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.789+0000 7f9680337b80 1 --2- 172.21.15.82:0/2127861656 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55b37beffd20 0x55b37bf02110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:43.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.789+0000 7f9680337b80 4 client.26189 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:59:43.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.789+0000 7f9680337b80 1 -- 172.21.15.82:0/2127861656 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b37beb3140 con 0x55b37beffd20 2024-05-08T05:59:43.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.789+0000 7f966e000700 1 --2- 172.21.15.82:0/2127861656 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55b37beffd20 0x55b37bf02110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:43.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.790+0000 7f966e000700 1 --2- 172.21.15.82:0/2127861656 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55b37beffd20 0x55b37bf02110 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80cea1bdf88108f1 server_cookie=a919161fb7953e3f in_seq=0 out_seq=0 2024-05-08T05:59:43.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.790+0000 7f9658c00700 10 client.26189 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:59:43.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.791+0000 7f9658c00700 1 -- 172.21.15.82:0/2127861656 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55b37beb3140 con 0x55b37beffd20 2024-05-08T05:59:43.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.791+0000 7f9658c00700 10 client.26189 handle_command_reply: tid=0 2024-05-08T05:59:43.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.791+0000 7f9680337b80 1 client.26189 shutdown 2024-05-08T05:59:43.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.792+0000 7f9680337b80 1 -- 172.21.15.82:0/2127861656 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b37bee68f0 msgr2=0x55b37bef21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:43.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.792+0000 7f9680337b80 1 --2- 172.21.15.82:0/2127861656 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b37bee68f0 0x55b37bef21a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f96600e01c0 tx=0x7f96600a9eb0 comp rx=0 tx=0).stop 2024-05-08T05:59:43.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.793+0000 7f9680337b80 1 -- 172.21.15.82:0/2127861656 shutdown_connections 2024-05-08T05:59:43.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.793+0000 7f9680337b80 1 --2- 172.21.15.82:0/2127861656 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55b37beffd20 0x55b37bf02110 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:43.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.793+0000 7f9680337b80 1 --2- 172.21.15.82:0/2127861656 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b37bee68f0 0x55b37bef21a0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:43.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.793+0000 7f9680337b80 1 --2- 172.21.15.82:0/2127861656 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b37beec4e0 0x55b37beefa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:43.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.793+0000 7f9680337b80 1 --2- 172.21.15.82:0/2127861656 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b37beebbc0 0x55b37beef540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:43.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.793+0000 7f9658c00700 0 client.26189 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:59:43.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.793+0000 7f9680337b80 1 -- 172.21.15.82:0/2127861656 >> 172.21.15.82:0/2127861656 conn(0x55b37be5e6d0 msgr2=0x55b37bee0190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:59:43.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.793+0000 7f9680337b80 1 -- 172.21.15.82:0/2127861656 shutdown_connections 2024-05-08T05:59:43.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.793+0000 7f9680337b80 1 -- 172.21.15.82:0/2127861656 wait complete. 2024-05-08T05:59:43.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.794+0000 7f9680337b80 20 client.26189 trim_cache size 0 max 16384 2024-05-08T05:59:43.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.820+0000 7f9680337b80 1 Processor -- start 2024-05-08T05:59:43.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.820+0000 7f9680337b80 1 -- start start 2024-05-08T05:59:43.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.821+0000 7f9680337b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b37bee68f0 0x55b37bee62d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:43.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.821+0000 7f9680337b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b37beebbc0 0x55b37beed1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:43.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.821+0000 7f9680337b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b37beec4e0 0x55b37beee4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:43.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.821+0000 7f9680337b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f96701bc990 con 0x55b37beec4e0 2024-05-08T05:59:43.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.821+0000 7f9680337b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f96701be4d0 con 0x55b37beebbc0 2024-05-08T05:59:43.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.821+0000 7f9680337b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f96701bd060 con 0x55b37bee68f0 2024-05-08T05:59:43.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.822+0000 7f966ea00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b37bee68f0 0x55b37bee62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:43.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.822+0000 7f966ea00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b37bee68f0 0x55b37bee62d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:57536/0 (socket says 172.21.15.82:57536) 2024-05-08T05:59:43.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.822+0000 7f966ea00700 1 -- 172.21.15.82:0/4083485244 learned_addr learned my addr 172.21.15.82:0/4083485244 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:59:43.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.822+0000 7f966e000700 1 --2- 172.21.15.82:0/4083485244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b37beebbc0 0x55b37beed1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:43.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.822+0000 7f966f400700 1 --2- 172.21.15.82:0/4083485244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b37beec4e0 0x55b37beee4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:43.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.824+0000 7f966ea00700 1 -- 172.21.15.82:0/4083485244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b37beebbc0 msgr2=0x55b37beed1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:43.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.824+0000 7f966ea00700 1 --2- 172.21.15.82:0/4083485244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b37beebbc0 0x55b37beed1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:43.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.824+0000 7f966ea00700 1 -- 172.21.15.82:0/4083485244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b37beec4e0 msgr2=0x55b37beee4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:43.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.824+0000 7f966ea00700 1 --2- 172.21.15.82:0/4083485244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b37beec4e0 0x55b37beee4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:43.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.824+0000 7f966ea00700 1 -- 172.21.15.82:0/4083485244 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b37bf02770 con 0x55b37bee68f0 2024-05-08T05:59:43.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.824+0000 7f966ea00700 1 --2- 172.21.15.82:0/4083485244 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b37bee68f0 0x55b37bee62d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f966000e970 tx=0x7f96600a9870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e2f4a17ec971a25 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:59:43.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.824+0000 7f965b400700 1 -- 172.21.15.82:0/4083485244 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96600a9970 con 0x55b37bee68f0 2024-05-08T05:59:43.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.824+0000 7f965b400700 1 -- 172.21.15.82:0/4083485244 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9660087070 con 0x55b37bee68f0 2024-05-08T05:59:43.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.824+0000 7f965b400700 1 -- 172.21.15.82:0/4083485244 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9660010930 con 0x55b37bee68f0 2024-05-08T05:59:43.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.825+0000 7f9680337b80 1 -- 172.21.15.82:0/4083485244 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b37bee68f0 msgr2=0x55b37bee62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:43.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.825+0000 7f9680337b80 1 --2- 172.21.15.82:0/4083485244 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b37bee68f0 0x55b37bee62d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f966000e970 tx=0x7f96600a9870 comp rx=0 tx=0).stop 2024-05-08T05:59:43.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.825+0000 7f9680337b80 1 -- 172.21.15.82:0/4083485244 shutdown_connections 2024-05-08T05:59:43.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.825+0000 7f9680337b80 1 --2- 172.21.15.82:0/4083485244 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b37beec4e0 0x55b37beee4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:43.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.825+0000 7f9680337b80 1 --2- 172.21.15.82:0/4083485244 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b37bee68f0 0x55b37bee62d0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:43.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.825+0000 7f9680337b80 1 --2- 172.21.15.82:0/4083485244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b37beebbc0 0x55b37beed1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:43.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.825+0000 7f9680337b80 1 -- 172.21.15.82:0/4083485244 >> 172.21.15.82:0/4083485244 conn(0x55b37be5e6d0 msgr2=0x55b37beea6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:59:43.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.826+0000 7f9680337b80 1 -- 172.21.15.82:0/4083485244 shutdown_connections 2024-05-08T05:59:43.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.826+0000 7f9680337b80 1 -- 172.21.15.82:0/4083485244 wait complete. 2024-05-08T05:59:43.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.826+0000 7f9680337b80 1 -- start start 2024-05-08T05:59:43.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.826+0000 7f9680337b80 1 Processor -- start 2024-05-08T05:59:43.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.827+0000 7f9680337b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b37bee68f0 0x55b37bef85c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:43.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.827+0000 7f9680337b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b37beebbc0 0x55b37bf06d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:43.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.827+0000 7f9680337b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b37beec4e0 0x55b37bf072d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:43.828 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.827+0000 7f966ea00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b37bee68f0 0x55b37bef85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:43.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.828+0000 7f966ea00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b37bee68f0 0x55b37bef85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:32946/0 (socket says 172.21.15.82:32946) 2024-05-08T05:59:43.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.828+0000 7f966e000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b37beebbc0 0x55b37bf06d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:43.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.828+0000 7f966e000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b37beebbc0 0x55b37bf06d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:57552/0 (socket says 172.21.15.82:57552) 2024-05-08T05:59:43.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.828+0000 7f9680337b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f96701bde00 con 0x55b37beec4e0 2024-05-08T05:59:43.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.828+0000 7f9680337b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f96701bd730 con 0x55b37bee68f0 2024-05-08T05:59:43.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.828+0000 7f9680337b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f96701ba950 con 0x55b37beebbc0 2024-05-08T05:59:43.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.828+0000 7f9680337b80 10 client.0 _ll_register_callbacks cb 0x55b37bddfc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:59:43.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.828+0000 7f966f400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b37beec4e0 0x55b37bf072d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:43.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.828+0000 7f966ea00700 1 -- 172.21.15.82:0/342792790 learned_addr learned my addr 172.21.15.82:0/342792790 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:59:43.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.829+0000 7f966f400700 1 -- 172.21.15.82:0/342792790 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b37beebbc0 msgr2=0x55b37bf06d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:43.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.829+0000 7f966f400700 1 --2- 172.21.15.82:0/342792790 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b37beebbc0 0x55b37bf06d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:43.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.829+0000 7f966f400700 1 -- 172.21.15.82:0/342792790 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b37bee68f0 msgr2=0x55b37bef85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:43.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.829+0000 7f966f400700 1 --2- 172.21.15.82:0/342792790 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b37bee68f0 0x55b37bef85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:43.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.829+0000 7f966f400700 1 -- 172.21.15.82:0/342792790 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b37bf02480 con 0x55b37beec4e0 2024-05-08T05:59:43.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.829+0000 7f966e000700 1 --2- 172.21.15.82:0/342792790 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b37beebbc0 0x55b37bf06d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:59:43.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.829+0000 7f966ea00700 1 --2- 172.21.15.82:0/342792790 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b37bee68f0 0x55b37bef85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:59:43.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.829+0000 7f966f400700 1 --2- 172.21.15.82:0/342792790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b37beec4e0 0x55b37bf072d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9668015fb0 tx=0x7f9668018700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=370fb0fdf21bdf33 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:59:43.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.829+0000 7f9658c00700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T05:59:43.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.830+0000 7f9658c00700 1 -- 172.21.15.82:0/342792790 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9668004bb0 con 0x55b37beec4e0 2024-05-08T05:59:43.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.830+0000 7f9658c00700 1 -- 172.21.15.82:0/342792790 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f9668004d50 con 0x55b37beec4e0 2024-05-08T05:59:43.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.830+0000 7f9680337b80 1 -- 172.21.15.82:0/342792790 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9660087070 con 0x55b37beec4e0 2024-05-08T05:59:43.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.831+0000 7f9658c00700 1 -- 172.21.15.82:0/342792790 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f9668022470 con 0x55b37beec4e0 2024-05-08T05:59:43.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.831+0000 7f9680337b80 10 client.15849 fetch_fsmap learned FSMap version 31 2024-05-08T05:59:43.832 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.831+0000 7f9680337b80 1 -- 172.21.15.82:0/342792790 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55b37bf6a1d0 con 0x55b37beec4e0 2024-05-08T05:59:43.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.832+0000 7f9658c00700 1 -- 172.21.15.82:0/342792790 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9660087070 con 0x55b37beec4e0 2024-05-08T05:59:43.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.832+0000 7f9658c00700 1 -- 172.21.15.82:0/342792790 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f966802c6d0 con 0x55b37beec4e0 2024-05-08T05:59:43.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.832+0000 7f9680337b80 10 client.15849 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:59:43.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.832+0000 7f9680337b80 10 client.15849 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:59:43.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.832+0000 7f9680337b80 20 client.15849 populate_metadata read hostname 'smithi082' 2024-05-08T05:59:43.833 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.832+0000 7f9680337b80 1 --2- 172.21.15.82:0/342792790 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55b37bf6a8f0 0x55b37bf6cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:43.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.832+0000 7f9680337b80 4 client.15849 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T05:59:43.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.832+0000 7f9680337b80 1 -- 172.21.15.82:0/342792790 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b37be46400 con 0x55b37bf6a8f0 2024-05-08T05:59:43.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.833+0000 7f966ea00700 1 --2- 172.21.15.82:0/342792790 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55b37bf6a8f0 0x55b37bf6cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:43.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.834+0000 7f966ea00700 1 --2- 172.21.15.82:0/342792790 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55b37bf6a8f0 0x55b37bf6cd10 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab23ebae59ff28ae server_cookie=d44994e284785b37 in_seq=0 out_seq=0 2024-05-08T05:59:43.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.834+0000 7f9658c00700 10 client.15849 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:59:43.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.834+0000 7f9658c00700 1 -- 172.21.15.82:0/342792790 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b37be46400 con 0x55b37bf6a8f0 2024-05-08T05:59:43.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.834+0000 7f9658c00700 10 client.15849 handle_command_reply: tid=0 2024-05-08T05:59:43.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.834+0000 7f9680337b80 1 client.15849 shutdown 2024-05-08T05:59:43.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.834+0000 7f9680337b80 1 -- 172.21.15.82:0/342792790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b37beec4e0 msgr2=0x55b37bf072d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:43.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.834+0000 7f9680337b80 1 --2- 172.21.15.82:0/342792790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b37beec4e0 0x55b37bf072d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9668015fb0 tx=0x7f9668018700 comp rx=0 tx=0).stop 2024-05-08T05:59:43.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.834+0000 7f9680337b80 1 -- 172.21.15.82:0/342792790 shutdown_connections 2024-05-08T05:59:43.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.834+0000 7f9680337b80 1 --2- 172.21.15.82:0/342792790 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55b37bf6a8f0 0x55b37bf6cd10 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:43.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.834+0000 7f9680337b80 1 --2- 172.21.15.82:0/342792790 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b37bee68f0 0x55b37bef85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:43.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.834+0000 7f9680337b80 1 --2- 172.21.15.82:0/342792790 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55b37beec4e0 0x55b37bf072d0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:43.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.834+0000 7f9658c00700 0 client.15849 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:59:43.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.834+0000 7f9680337b80 1 --2- 172.21.15.82:0/342792790 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b37beebbc0 0x55b37bf06d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:43.836 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.834+0000 7f9680337b80 1 -- 172.21.15.82:0/342792790 >> 172.21.15.82:0/342792790 conn(0x55b37be5e6d0 msgr2=0x55b37beed020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:59:43.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.835+0000 7f9680337b80 1 -- 172.21.15.82:0/342792790 shutdown_connections 2024-05-08T05:59:43.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.835+0000 7f9680337b80 1 -- 172.21.15.82:0/342792790 wait complete. 2024-05-08T05:59:43.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.835+0000 7f9680337b80 20 client.15849 trim_cache size 0 max 16384 2024-05-08T05:59:43.837 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T05:59:43.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.836+0000 7f9675a00700 1 -- 172.21.15.82:0/2570487666 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f96540b2900 msgr2=0x7f96540b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:43.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.836+0000 7f9675a00700 1 --2- 172.21.15.82:0/2570487666 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f96540b2900 0x7f96540b4dc0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f965c00b2e0 tx=0x7f965c01a040 comp rx=0 tx=0).stop 2024-05-08T05:59:43.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.836+0000 7f9675a00700 1 -- 172.21.15.82:0/2570487666 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f96701056e0 msgr2=0x7f9670112480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:43.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.836+0000 7f9675a00700 1 --2- 172.21.15.82:0/2570487666 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f96701056e0 0x7f9670112480 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f966000e9a0 tx=0x7f966000ecb0 comp rx=0 tx=0).stop 2024-05-08T05:59:43.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.836+0000 7f9675a00700 1 -- 172.21.15.82:0/2570487666 shutdown_connections 2024-05-08T05:59:43.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.836+0000 7f9675a00700 1 --2- 172.21.15.82:0/2570487666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f967010b6e0 0x7f967010fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:43.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.836+0000 7f9675a00700 1 --2- 172.21.15.82:0/2570487666 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f96540b2900 0x7f96540b4dc0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:43.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.836+0000 7f9675a00700 1 --2- 172.21.15.82:0/2570487666 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f96701056e0 0x7f9670112480 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:43.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.836+0000 7f9675a00700 1 --2- 172.21.15.82:0/2570487666 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f96701060a0 0x7f967010f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:43.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.836+0000 7f9675a00700 1 -- 172.21.15.82:0/2570487666 >> 172.21.15.82:0/2570487666 conn(0x7f96701011d0 msgr2=0x7f9670101810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:59:43.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.837+0000 7f9675a00700 1 -- 172.21.15.82:0/2570487666 shutdown_connections 2024-05-08T05:59:43.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:43.837+0000 7f9675a00700 1 -- 172.21.15.82:0/2570487666 wait complete. 2024-05-08T05:59:43.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:59:43 smithi151 ceph-mon[34815]: pgmap v731: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.6 MiB/s wr, 625 op/s 2024-05-08T05:59:44.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:59:43 smithi134 ceph-mon[34132]: pgmap v731: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.6 MiB/s wr, 625 op/s 2024-05-08T05:59:45.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 535.0 s, 2328.2 tps, lat 43.093 ms stddev 50.348 2024-05-08T05:59:45.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:59:45 smithi151 ceph-mon[34815]: pgmap v732: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.9 MiB/s wr, 659 op/s 2024-05-08T05:59:45.897 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-08T05:59:45.897 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-05-08T05:59:45.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:59:45 smithi082 ceph-mon[30098]: pgmap v732: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.9 MiB/s wr, 659 op/s 2024-05-08T05:59:45.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:59:45 smithi134 ceph-mon[34132]: pgmap v732: 97 pgs: 97 active+clean; 1.6 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.9 MiB/s wr, 659 op/s 2024-05-08T05:59:46.579 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:59:46.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:59:46 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:59:46.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:59:46 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:59:46.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:59:46 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:59:46.911 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:59:46 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:59:46.912 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:59:46 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:59:46.912 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:59:46 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:59:47.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:59:46 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T05:59:47.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:59:46 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:59:47.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:59:46 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:59:48.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:59:47 smithi151 ceph-mon[34815]: pgmap v733: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.5 MiB/s wr, 735 op/s 2024-05-08T05:59:48.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:59:47 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:59:48.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:59:47 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:59:48.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:59:47 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:59:48.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:59:47 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:59:48.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:59:47 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:59:48.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:59:47 smithi082 ceph-mon[30098]: pgmap v733: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.5 MiB/s wr, 735 op/s 2024-05-08T05:59:48.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:59:47 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:59:48.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:59:47 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:59:48.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:59:47 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:59:48.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:59:47 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:59:48.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:59:47 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:59:48.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:59:47 smithi134 ceph-mon[34132]: pgmap v733: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.5 MiB/s wr, 735 op/s 2024-05-08T05:59:48.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:59:47 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:59:48.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:59:47 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:59:48.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:59:47 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T05:59:48.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:59:47 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T05:59:48.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:59:47 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T05:59:49.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.977+0000 7ff9ade00700 1 -- 172.21.15.82:0/352249793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9a81033d0 msgr2=0x7ff9a8103850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:49.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.977+0000 7ff9ade00700 1 --2- 172.21.15.82:0/352249793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9a81033d0 0x7ff9a8103850 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff994009990 tx=0x7ff994009ca0 comp rx=0 tx=0).stop 2024-05-08T05:59:49.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.977+0000 7ff9ade00700 1 -- 172.21.15.82:0/352249793 shutdown_connections 2024-05-08T05:59:49.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.977+0000 7ff9ade00700 1 --2- 172.21.15.82:0/352249793 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9a8103d90 0x7ff9a81102a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:49.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.977+0000 7ff9ade00700 1 --2- 172.21.15.82:0/352249793 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff9a8109460 0x7ff9a8109840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:49.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.977+0000 7ff9ade00700 1 --2- 172.21.15.82:0/352249793 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9a81033d0 0x7ff9a8103850 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:49.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.977+0000 7ff9ade00700 1 -- 172.21.15.82:0/352249793 >> 172.21.15.82:0/352249793 conn(0x7ff9a80fef20 msgr2=0x7ff9a8101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:59:49.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.977+0000 7ff9ade00700 1 -- 172.21.15.82:0/352249793 shutdown_connections 2024-05-08T05:59:49.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.978+0000 7ff9ade00700 1 -- 172.21.15.82:0/352249793 wait complete. 2024-05-08T05:59:49.980 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.979+0000 7ff9ade00700 1 Processor -- start 2024-05-08T05:59:49.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.979+0000 7ff9ade00700 1 -- start start 2024-05-08T05:59:49.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.979+0000 7ff9ade00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9a81033d0 0x7ff9a819d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:49.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.979+0000 7ff9ade00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff9a8103d90 0x7ff9a819db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:49.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.979+0000 7ff9ade00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9a8109460 0x7ff9a8197760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:49.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.979+0000 7ff9ade00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a8111460 con 0x7ff9a81033d0 2024-05-08T05:59:49.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.980+0000 7ff9ade00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a81112e0 con 0x7ff9a8109460 2024-05-08T05:59:49.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.980+0000 7ff9ade00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a81115e0 con 0x7ff9a8103d90 2024-05-08T05:59:49.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.980+0000 7ff9aca00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9a81033d0 0x7ff9a819d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:49.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.980+0000 7ff9a7e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff9a8103d90 0x7ff9a819db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:49.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.980+0000 7ff9ad400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9a8109460 0x7ff9a8197760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:49.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.980+0000 7ff9ad400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9a8109460 0x7ff9a8197760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:32950/0 (socket says 172.21.15.82:32950) 2024-05-08T05:59:49.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.980+0000 7ff9ad400700 1 -- 172.21.15.82:0/3815746747 learned_addr learned my addr 172.21.15.82:0/3815746747 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:59:49.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.980+0000 7ff9a7e00700 1 --2- 172.21.15.82:0/3815746747 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff9a8103d90 0x7ff9a819db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:57574/0 (socket says 172.21.15.82:57574) 2024-05-08T05:59:49.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.980+0000 7ff9ad400700 1 -- 172.21.15.82:0/3815746747 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff9a8103d90 msgr2=0x7ff9a819db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:49.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.980+0000 7ff9ad400700 1 --2- 172.21.15.82:0/3815746747 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff9a8103d90 0x7ff9a819db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:49.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.980+0000 7ff9ad400700 1 -- 172.21.15.82:0/3815746747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9a81033d0 msgr2=0x7ff9a819d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:49.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.980+0000 7ff9ad400700 1 --2- 172.21.15.82:0/3815746747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9a81033d0 0x7ff9a819d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:49.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.980+0000 7ff9ad400700 1 -- 172.21.15.82:0/3815746747 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9a8198040 con 0x7ff9a8109460 2024-05-08T05:59:49.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.981+0000 7ff9ad400700 1 --2- 172.21.15.82:0/3815746747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9a8109460 0x7ff9a8197760 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff9a000ef30 tx=0x7ff9a000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:59:49.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.981+0000 7ff9a5600700 1 -- 172.21.15.82:0/3815746747 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a00092e0 con 0x7ff9a8109460 2024-05-08T05:59:49.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.981+0000 7ff9a5600700 1 -- 172.21.15.82:0/3815746747 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff9a0004bb0 con 0x7ff9a8109460 2024-05-08T05:59:49.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.981+0000 7ff9ade00700 1 -- 172.21.15.82:0/3815746747 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9a81982d0 con 0x7ff9a8109460 2024-05-08T05:59:49.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.981+0000 7ff9a5600700 1 -- 172.21.15.82:0/3815746747 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a0004280 con 0x7ff9a8109460 2024-05-08T05:59:49.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.981+0000 7ff9ade00700 1 -- 172.21.15.82:0/3815746747 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9a81a45c0 con 0x7ff9a8109460 2024-05-08T05:59:49.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.989+0000 7ff9b9cc6b80 1 Processor -- start 2024-05-08T05:59:49.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.989+0000 7ff9a5600700 1 -- 172.21.15.82:0/3815746747 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7ff9a001b030 con 0x7ff9a8109460 2024-05-08T05:59:49.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.990+0000 7ff9b9cc6b80 1 -- start start 2024-05-08T05:59:49.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.990+0000 7ff9b9cc6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563247829a60 0x563247829e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:49.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.990+0000 7ff9b9cc6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56324782a380 0x563247824060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:49.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.990+0000 7ff9b9cc6b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563247824680 0x563247824b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:49.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.990+0000 7ff9b9cc6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x563247776aa0 con 0x563247829a60 2024-05-08T05:59:49.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.990+0000 7ff9b9cc6b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5632477147e0 con 0x563247824680 2024-05-08T05:59:49.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.990+0000 7ff9b9cc6b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x563247772a60 con 0x56324782a380 2024-05-08T05:59:49.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.991+0000 7ff9a7e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563247824680 0x563247824b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:49.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.991+0000 7ff9a7e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563247829a60 0x563247829e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:49.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.991+0000 7ff9a7e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563247829a60 0x563247829e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50224/0 (socket says 172.21.15.82:50224) 2024-05-08T05:59:49.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.991+0000 7ff9a7e00700 1 -- 172.21.15.82:0/193696041 learned_addr learned my addr 172.21.15.82:0/193696041 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:59:49.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.991+0000 7ff9aca00700 1 --2- 172.21.15.82:0/193696041 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56324782a380 0x563247824060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:49.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.992+0000 7ff9aca00700 1 -- 172.21.15.82:0/193696041 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563247824680 msgr2=0x563247824b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:49.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.992+0000 7ff9aca00700 1 --2- 172.21.15.82:0/193696041 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563247824680 0x563247824b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:49.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.992+0000 7ff9aca00700 1 -- 172.21.15.82:0/193696041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563247829a60 msgr2=0x563247829e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:49.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.992+0000 7ff9aca00700 1 --2- 172.21.15.82:0/193696041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563247829a60 0x563247829e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:49.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.992+0000 7ff9aca00700 1 -- 172.21.15.82:0/193696041 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5632476c3950 con 0x56324782a380 2024-05-08T05:59:49.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.992+0000 7ff9a7e00700 1 --2- 172.21.15.82:0/193696041 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563247824680 0x563247824b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T05:59:49.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.992+0000 7ff9aca00700 1 --2- 172.21.15.82:0/193696041 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56324782a380 0x563247824060 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff99c00da00 tx=0x7ff99c00d670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa64c68572bb8611 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:59:49.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.993+0000 7ff99a000700 1 -- 172.21.15.82:0/193696041 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff99c00bd10 con 0x56324782a380 2024-05-08T05:59:49.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.993+0000 7ff99a000700 1 -- 172.21.15.82:0/193696041 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff99c01e070 con 0x56324782a380 2024-05-08T05:59:49.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.993+0000 7ff99a000700 1 -- 172.21.15.82:0/193696041 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff99c018760 con 0x56324782a380 2024-05-08T05:59:49.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.993+0000 7ff9a5600700 1 --2- 172.21.15.82:0/3815746747 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff9900b2900 0x7ff9900b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:49.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.993+0000 7ff9a5600700 1 -- 172.21.15.82:0/3815746747 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7ff9a00e1d40 con 0x7ff9a8109460 2024-05-08T05:59:49.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.994+0000 7ff9b9cc6b80 1 -- 172.21.15.82:0/193696041 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56324782a380 msgr2=0x563247824060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:49.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.994+0000 7ff9b9cc6b80 1 --2- 172.21.15.82:0/193696041 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56324782a380 0x563247824060 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff99c00da00 tx=0x7ff99c00d670 comp rx=0 tx=0).stop 2024-05-08T05:59:49.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.994+0000 7ff9b9cc6b80 1 -- 172.21.15.82:0/193696041 shutdown_connections 2024-05-08T05:59:49.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.994+0000 7ff9b9cc6b80 1 --2- 172.21.15.82:0/193696041 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563247824680 0x563247824b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:49.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.994+0000 7ff9b9cc6b80 1 --2- 172.21.15.82:0/193696041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563247829a60 0x563247829e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:49.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.994+0000 7ff9b9cc6b80 1 --2- 172.21.15.82:0/193696041 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56324782a380 0x563247824060 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:49.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.994+0000 7ff9b9cc6b80 1 -- 172.21.15.82:0/193696041 >> 172.21.15.82:0/193696041 conn(0x563247752be0 msgr2=0x56324781ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:59:49.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.994+0000 7ff9a7e00700 1 --2- 172.21.15.82:0/3815746747 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff9900b2900 0x7ff9900b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:49.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.994+0000 7ff9b9cc6b80 1 -- 172.21.15.82:0/193696041 shutdown_connections 2024-05-08T05:59:49.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.994+0000 7ff9b9cc6b80 1 -- 172.21.15.82:0/193696041 wait complete. 2024-05-08T05:59:49.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.995+0000 7ff9b9cc6b80 1 -- start start 2024-05-08T05:59:49.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.995+0000 7ff9a7e00700 1 --2- 172.21.15.82:0/3815746747 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff9900b2900 0x7ff9900b4dc0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x563247825040 tx=0x7ff99401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:59:49.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.995+0000 7ff9b9cc6b80 1 Processor -- start 2024-05-08T05:59:49.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.996+0000 7ff9b9cc6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563247824680 0x56324782ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:49.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.996+0000 7ff9b9cc6b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563247829a60 0x56324782d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:49.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.996+0000 7ff9b9cc6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56324782a380 0x56324782d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:49.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.996+0000 7ff9b9cc6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x563247841e40 con 0x563247824680 2024-05-08T05:59:49.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.996+0000 7ff9b9cc6b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5632476dcba0 con 0x563247829a60 2024-05-08T05:59:49.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.996+0000 7ff9b9cc6b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x563247841fc0 con 0x56324782a380 2024-05-08T05:59:49.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.996+0000 7ff9b9cc6b80 10 client.0 _ll_register_callbacks cb 0x56324771dcf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:59:49.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.996+0000 7ff9a7e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563247829a60 0x56324782d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:49.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.996+0000 7ff9a7e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563247829a60 0x56324782d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:32976/0 (socket says 172.21.15.82:32976) 2024-05-08T05:59:49.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.996+0000 7ff9a7e00700 1 -- 172.21.15.82:0/3676711155 learned_addr learned my addr 172.21.15.82:0/3676711155 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:59:49.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.996+0000 7ff9ad400700 1 --2- 172.21.15.82:0/3676711155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56324782a380 0x56324782d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:49.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.996+0000 7ff9aca00700 1 --2- 172.21.15.82:0/3676711155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563247824680 0x56324782ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:49.999 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.997+0000 7ff9a7e00700 1 -- 172.21.15.82:0/3676711155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56324782a380 msgr2=0x56324782d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:50.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.997+0000 7ff9a7e00700 1 --2- 172.21.15.82:0/3676711155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56324782a380 0x56324782d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:50.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.997+0000 7ff9a7e00700 1 -- 172.21.15.82:0/3676711155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563247824680 msgr2=0x56324782ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:50.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.997+0000 7ff9a7e00700 1 --2- 172.21.15.82:0/3676711155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563247824680 0x56324782ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:50.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.997+0000 7ff9a7e00700 1 -- 172.21.15.82:0/3676711155 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56324773c4a0 con 0x563247829a60 2024-05-08T05:59:50.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.997+0000 7ff9a7e00700 1 --2- 172.21.15.82:0/3676711155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563247829a60 0x56324782d2c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff99400b890 tx=0x7ff994009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=985c3743baf22d7c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:59:50.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.997+0000 7ff98ea00700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:59:50.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.997+0000 7ff98ea00700 1 -- 172.21.15.82:0/3676711155 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff994038060 con 0x563247829a60 2024-05-08T05:59:50.001 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.997+0000 7ff98ea00700 1 -- 172.21.15.82:0/3676711155 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7ff9940039d0 con 0x563247829a60 2024-05-08T05:59:50.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.998+0000 7ff9b9cc6b80 1 -- 172.21.15.82:0/3676711155 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff99c01e070 con 0x563247829a60 2024-05-08T05:59:50.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.998+0000 7ff98ea00700 1 -- 172.21.15.82:0/3676711155 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7ff994003c10 con 0x563247829a60 2024-05-08T05:59:50.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.998+0000 7ff9b9cc6b80 10 client.26207 fetch_fsmap learned FSMap version 31 2024-05-08T05:59:50.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.998+0000 7ff9b9cc6b80 1 -- 172.21.15.82:0/3676711155 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x563247854d10 con 0x563247829a60 2024-05-08T05:59:50.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.998+0000 7ff98ea00700 1 -- 172.21.15.82:0/3676711155 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff99c01e070 con 0x563247829a60 2024-05-08T05:59:50.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.998+0000 7ff98ea00700 1 -- 172.21.15.82:0/3676711155 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7ff994028420 con 0x563247829a60 2024-05-08T05:59:50.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.999+0000 7ff9b9cc6b80 10 client.26207 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:59:50.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.999+0000 7ff9b9cc6b80 10 client.26207 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:59:50.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.999+0000 7ff9b9cc6b80 20 client.26207 populate_metadata read hostname 'smithi082' 2024-05-08T05:59:50.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.999+0000 7ff9b9cc6b80 1 --2- 172.21.15.82:0/3676711155 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5632478571e0 0x5632478595d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:50.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.999+0000 7ff9b9cc6b80 4 client.26207 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:59:50.002 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:49.999+0000 7ff9b9cc6b80 1 -- 172.21.15.82:0/3676711155 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5632477f1120 con 0x5632478571e0 2024-05-08T05:59:50.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.000+0000 7ff9aca00700 1 --2- 172.21.15.82:0/3676711155 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5632478571e0 0x5632478595d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:50.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.001+0000 7ff9aca00700 1 --2- 172.21.15.82:0/3676711155 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5632478571e0 0x5632478595d0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f6192ecc0658a6a server_cookie=444f11c5b4f48041 in_seq=0 out_seq=0 2024-05-08T05:59:50.003 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.001+0000 7ff98ea00700 10 client.26207 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:59:50.003 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:59:49 smithi082 ceph-mon[30098]: pgmap v734: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.7 MiB/s wr, 580 op/s 2024-05-08T05:59:50.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.001+0000 7ff98ea00700 1 -- 172.21.15.82:0/3676711155 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5632477f1120 con 0x5632478571e0 2024-05-08T05:59:50.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.001+0000 7ff98ea00700 10 client.26207 handle_command_reply: tid=0 2024-05-08T05:59:50.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.001+0000 7ff9b9cc6b80 1 client.26207 shutdown 2024-05-08T05:59:50.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.002+0000 7ff9b9cc6b80 1 -- 172.21.15.82:0/3676711155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563247829a60 msgr2=0x56324782d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:50.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.002+0000 7ff9b9cc6b80 1 --2- 172.21.15.82:0/3676711155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563247829a60 0x56324782d2c0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff99400b890 tx=0x7ff994009ca0 comp rx=0 tx=0).stop 2024-05-08T05:59:50.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.002+0000 7ff9b9cc6b80 1 -- 172.21.15.82:0/3676711155 shutdown_connections 2024-05-08T05:59:50.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.002+0000 7ff9b9cc6b80 1 --2- 172.21.15.82:0/3676711155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56324782a380 0x56324782d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:50.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.002+0000 7ff9b9cc6b80 1 --2- 172.21.15.82:0/3676711155 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563247824680 0x56324782ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:50.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.002+0000 7ff9b9cc6b80 1 --2- 172.21.15.82:0/3676711155 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5632478571e0 0x5632478595d0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:50.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.002+0000 7ff9b9cc6b80 1 --2- 172.21.15.82:0/3676711155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563247829a60 0x56324782d2c0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:50.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.002+0000 7ff9b9cc6b80 1 -- 172.21.15.82:0/3676711155 >> 172.21.15.82:0/3676711155 conn(0x563247752be0 msgr2=0x5632478194e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:59:50.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.002+0000 7ff98ea00700 0 client.26207 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:59:50.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.002+0000 7ff9b9cc6b80 1 -- 172.21.15.82:0/3676711155 shutdown_connections 2024-05-08T05:59:50.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.002+0000 7ff9b9cc6b80 1 -- 172.21.15.82:0/3676711155 wait complete. 2024-05-08T05:59:50.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.002+0000 7ff9b9cc6b80 20 client.26207 trim_cache size 0 max 16384 2024-05-08T05:59:50.042 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.041+0000 7ff9b9cc6b80 1 Processor -- start 2024-05-08T05:59:50.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.042+0000 7ff9b9cc6b80 1 -- start start 2024-05-08T05:59:50.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.042+0000 7ff9b9cc6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563247824680 0x563247824060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:50.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.042+0000 7ff9b9cc6b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563247829a60 0x56324782ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:50.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.042+0000 7ff9b9cc6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56324782a380 0x56324782c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:50.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.042+0000 7ff9b9cc6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a8073f30 con 0x563247824680 2024-05-08T05:59:50.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.042+0000 7ff9b9cc6b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a81a4b30 con 0x563247829a60 2024-05-08T05:59:50.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.042+0000 7ff9b9cc6b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a8074600 con 0x56324782a380 2024-05-08T05:59:50.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.043+0000 7ff9a7e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563247829a60 0x56324782ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:50.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.043+0000 7ff9ad400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56324782a380 0x56324782c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:50.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.043+0000 7ff9ad400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56324782a380 0x56324782c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:57600/0 (socket says 172.21.15.82:57600) 2024-05-08T05:59:50.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.043+0000 7ff9ad400700 1 -- 172.21.15.82:0/672963917 learned_addr learned my addr 172.21.15.82:0/672963917 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:59:50.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.044+0000 7ff9ad400700 1 -- 172.21.15.82:0/672963917 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563247829a60 msgr2=0x56324782ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:50.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.044+0000 7ff9ad400700 1 --2- 172.21.15.82:0/672963917 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563247829a60 0x56324782ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:50.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.044+0000 7ff9ad400700 1 -- 172.21.15.82:0/672963917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563247824680 msgr2=0x563247824060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:50.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.044+0000 7ff9ad400700 1 --2- 172.21.15.82:0/672963917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563247824680 0x563247824060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:50.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.044+0000 7ff9ad400700 1 -- 172.21.15.82:0/672963917 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563247830290 con 0x56324782a380 2024-05-08T05:59:50.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.046+0000 7ff9ad400700 1 --2- 172.21.15.82:0/672963917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56324782a380 0x56324782c440 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff9a00a9100 tx=0x7ff9a000c9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=286ef3c7f6d27c96 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:59:50.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.046+0000 7ff999600700 1 -- 172.21.15.82:0/672963917 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a00a9b00 con 0x56324782a380 2024-05-08T05:59:50.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.046+0000 7ff999600700 1 -- 172.21.15.82:0/672963917 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff9a00a9400 con 0x56324782a380 2024-05-08T05:59:50.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.046+0000 7ff999600700 1 -- 172.21.15.82:0/672963917 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9a0003a00 con 0x56324782a380 2024-05-08T05:59:50.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.047+0000 7ff9b9cc6b80 1 -- 172.21.15.82:0/672963917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56324782a380 msgr2=0x56324782c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:50.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.047+0000 7ff9b9cc6b80 1 --2- 172.21.15.82:0/672963917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56324782a380 0x56324782c440 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7ff9a00a9100 tx=0x7ff9a000c9f0 comp rx=0 tx=0).stop 2024-05-08T05:59:50.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.047+0000 7ff9b9cc6b80 1 -- 172.21.15.82:0/672963917 shutdown_connections 2024-05-08T05:59:50.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.048+0000 7ff9b9cc6b80 1 --2- 172.21.15.82:0/672963917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56324782a380 0x56324782c440 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:50.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.048+0000 7ff9b9cc6b80 1 --2- 172.21.15.82:0/672963917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563247824680 0x563247824060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:50.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.048+0000 7ff9b9cc6b80 1 --2- 172.21.15.82:0/672963917 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563247829a60 0x56324782ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:50.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.048+0000 7ff9b9cc6b80 1 -- 172.21.15.82:0/672963917 >> 172.21.15.82:0/672963917 conn(0x563247752be0 msgr2=0x563247818c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:59:50.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.048+0000 7ff9b9cc6b80 1 -- 172.21.15.82:0/672963917 shutdown_connections 2024-05-08T05:59:50.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.048+0000 7ff9b9cc6b80 1 -- 172.21.15.82:0/672963917 wait complete. 2024-05-08T05:59:50.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.049+0000 7ff9b9cc6b80 1 -- start start 2024-05-08T05:59:50.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.049+0000 7ff9b9cc6b80 1 Processor -- start 2024-05-08T05:59:50.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.050+0000 7ff9b9cc6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563247824680 0x5632478bcf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:50.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.050+0000 7ff9b9cc6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563247829a60 0x5632478bd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:50.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.051+0000 7ff9b9cc6b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56324782a380 0x5632478bbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:50.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.051+0000 7ff9aca00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563247824680 0x5632478bcf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:50.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.051+0000 7ff9aca00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563247824680 0x5632478bcf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:57606/0 (socket says 172.21.15.82:57606) 2024-05-08T05:59:50.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.051+0000 7ff9ad400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56324782a380 0x5632478bbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:50.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.051+0000 7ff9ad400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56324782a380 0x5632478bbbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:32982/0 (socket says 172.21.15.82:32982) 2024-05-08T05:59:50.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.051+0000 7ff9ad400700 1 -- 172.21.15.82:0/3858565702 learned_addr learned my addr 172.21.15.82:0/3858565702 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:59:50.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.052+0000 7ff9b9cc6b80 1 -- 172.21.15.82:0/3858565702 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a80753a0 con 0x563247829a60 2024-05-08T05:59:50.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.052+0000 7ff9b9cc6b80 1 -- 172.21.15.82:0/3858565702 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a8074cd0 con 0x56324782a380 2024-05-08T05:59:50.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.052+0000 7ff9b9cc6b80 1 -- 172.21.15.82:0/3858565702 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff9a8071ef0 con 0x563247824680 2024-05-08T05:59:50.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.052+0000 7ff9b9cc6b80 10 client.0 _ll_register_callbacks cb 0x56324771dcf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:59:50.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.052+0000 7ff9a7e00700 1 --2- 172.21.15.82:0/3858565702 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563247829a60 0x5632478bd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:50.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.054+0000 7ff9a7e00700 1 -- 172.21.15.82:0/3858565702 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563247824680 msgr2=0x5632478bcf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:50.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.054+0000 7ff9a7e00700 1 --2- 172.21.15.82:0/3858565702 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563247824680 0x5632478bcf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:50.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.054+0000 7ff9a7e00700 1 -- 172.21.15.82:0/3858565702 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56324782a380 msgr2=0x5632478bbbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:50.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.054+0000 7ff9a7e00700 1 --2- 172.21.15.82:0/3858565702 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56324782a380 0x5632478bbbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:50.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.055+0000 7ff9a7e00700 1 -- 172.21.15.82:0/3858565702 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5632478bc420 con 0x563247829a60 2024-05-08T05:59:50.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.056+0000 7ff9a7e00700 1 --2- 172.21.15.82:0/3858565702 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563247829a60 0x5632478bd4d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff994028840 tx=0x7ff99400bfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33a684aca40757a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:59:50.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.056+0000 7ff98ea00700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T05:59:50.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.057+0000 7ff98ea00700 1 -- 172.21.15.82:0/3858565702 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff994028e60 con 0x563247829a60 2024-05-08T05:59:50.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.057+0000 7ff98ea00700 1 -- 172.21.15.82:0/3858565702 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7ff994021070 con 0x563247829a60 2024-05-08T05:59:50.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.057+0000 7ff9b9cc6b80 1 -- 172.21.15.82:0/3858565702 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff9a00a9400 con 0x563247829a60 2024-05-08T05:59:50.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.058+0000 7ff98ea00700 1 -- 172.21.15.82:0/3858565702 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7ff994028420 con 0x563247829a60 2024-05-08T05:59:50.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.058+0000 7ff9b9cc6b80 10 client.15864 fetch_fsmap learned FSMap version 31 2024-05-08T05:59:50.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.058+0000 7ff9b9cc6b80 1 -- 172.21.15.82:0/3858565702 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56324784cee0 con 0x563247829a60 2024-05-08T05:59:50.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.059+0000 7ff98ea00700 1 -- 172.21.15.82:0/3858565702 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff9a00a9400 con 0x563247829a60 2024-05-08T05:59:50.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.060+0000 7ff98ea00700 1 -- 172.21.15.82:0/3858565702 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7ff994046450 con 0x563247829a60 2024-05-08T05:59:50.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.060+0000 7ff9b9cc6b80 10 client.15864 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:59:50.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.060+0000 7ff9b9cc6b80 10 client.15864 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:59:50.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.060+0000 7ff9b9cc6b80 20 client.15864 populate_metadata read hostname 'smithi082' 2024-05-08T05:59:50.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.060+0000 7ff9b9cc6b80 1 --2- 172.21.15.82:0/3858565702 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x56324784d540 0x56324784f930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:50.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.060+0000 7ff9b9cc6b80 4 client.15864 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-08T05:59:50.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.060+0000 7ff9b9cc6b80 1 -- 172.21.15.82:0/3858565702 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x563247784480 con 0x56324784d540 2024-05-08T05:59:50.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.060+0000 7ff9aca00700 1 --2- 172.21.15.82:0/3858565702 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x56324784d540 0x56324784f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:50.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.061+0000 7ff98ea00700 10 client.15864 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:59:50.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.061+0000 7ff9aca00700 1 --2- 172.21.15.82:0/3858565702 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x56324784d540 0x56324784f930 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dadbe885cb9139b8 server_cookie=4031eeb89b98b347 in_seq=0 out_seq=0 2024-05-08T05:59:50.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.064+0000 7ff98ea00700 1 -- 172.21.15.82:0/3858565702 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x563247784480 con 0x56324784d540 2024-05-08T05:59:50.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.065+0000 7ff98ea00700 10 client.15864 handle_command_reply: tid=0 2024-05-08T05:59:50.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.065+0000 7ff9b9cc6b80 1 client.15864 shutdown 2024-05-08T05:59:50.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.065+0000 7ff9b9cc6b80 1 -- 172.21.15.82:0/3858565702 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563247829a60 msgr2=0x5632478bd4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:50.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.065+0000 7ff9b9cc6b80 1 --2- 172.21.15.82:0/3858565702 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563247829a60 0x5632478bd4d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff994028840 tx=0x7ff99400bfa0 comp rx=0 tx=0).stop 2024-05-08T05:59:50.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.067+0000 7ff9b9cc6b80 1 -- 172.21.15.82:0/3858565702 shutdown_connections 2024-05-08T05:59:50.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.067+0000 7ff9b9cc6b80 1 --2- 172.21.15.82:0/3858565702 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x56324784d540 0x56324784f930 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:50.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.067+0000 7ff9b9cc6b80 1 --2- 172.21.15.82:0/3858565702 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56324782a380 0x5632478bbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:50.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.067+0000 7ff98ea00700 0 client.15864 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:59:50.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.067+0000 7ff9b9cc6b80 1 --2- 172.21.15.82:0/3858565702 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563247824680 0x5632478bcf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:50.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.067+0000 7ff9b9cc6b80 1 --2- 172.21.15.82:0/3858565702 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563247829a60 0x5632478bd4d0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:50.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.067+0000 7ff9b9cc6b80 1 -- 172.21.15.82:0/3858565702 >> 172.21.15.82:0/3858565702 conn(0x563247752be0 msgr2=0x5632478194e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:59:50.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.068+0000 7ff9b9cc6b80 1 -- 172.21.15.82:0/3858565702 shutdown_connections 2024-05-08T05:59:50.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.068+0000 7ff9b9cc6b80 1 -- 172.21.15.82:0/3858565702 wait complete. 2024-05-08T05:59:50.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.068+0000 7ff9b9cc6b80 20 client.15864 trim_cache size 0 max 16384 2024-05-08T05:59:50.069 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T05:59:50.069 INFO:teuthology.orchestra.run.smithi082.stdout: "return_code": 0, 2024-05-08T05:59:50.069 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_tag": "be7741ed-49fd-42e9-89bf-b80968c4fc25", 2024-05-08T05:59:50.069 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": "asynchronous" 2024-05-08T05:59:50.069 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T05:59:50.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.069+0000 7ff9ade00700 1 -- 172.21.15.82:0/3815746747 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff9900b2900 msgr2=0x7ff9900b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:50.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.069+0000 7ff9ade00700 1 --2- 172.21.15.82:0/3815746747 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff9900b2900 0x7ff9900b4dc0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x563247825040 tx=0x7ff99401a040 comp rx=0 tx=0).stop 2024-05-08T05:59:50.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.069+0000 7ff9ade00700 1 -- 172.21.15.82:0/3815746747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9a8109460 msgr2=0x7ff9a8197760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:50.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.069+0000 7ff9ade00700 1 --2- 172.21.15.82:0/3815746747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9a8109460 0x7ff9a8197760 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7ff9a000ef30 tx=0x7ff9a000c3a0 comp rx=0 tx=0).stop 2024-05-08T05:59:50.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.069+0000 7ff9ade00700 1 -- 172.21.15.82:0/3815746747 shutdown_connections 2024-05-08T05:59:50.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.069+0000 7ff9ade00700 1 --2- 172.21.15.82:0/3815746747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9a8109460 0x7ff9a8197760 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:50.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.069+0000 7ff9ade00700 1 --2- 172.21.15.82:0/3815746747 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff9900b2900 0x7ff9900b4dc0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:50.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.069+0000 7ff9ade00700 1 --2- 172.21.15.82:0/3815746747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff9a81033d0 0x7ff9a819d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:50.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.069+0000 7ff9ade00700 1 --2- 172.21.15.82:0/3815746747 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff9a8103d90 0x7ff9a819db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:50.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.069+0000 7ff9ade00700 1 -- 172.21.15.82:0/3815746747 >> 172.21.15.82:0/3815746747 conn(0x7ff9a80fef20 msgr2=0x7ff9a80ff7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:59:50.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.070+0000 7ff9ade00700 1 -- 172.21.15.82:0/3815746747 shutdown_connections 2024-05-08T05:59:50.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:50.070+0000 7ff9ade00700 1 -- 172.21.15.82:0/3815746747 wait complete. 2024-05-08T05:59:50.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:59:49 smithi151 ceph-mon[34815]: pgmap v734: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.7 MiB/s wr, 580 op/s 2024-05-08T05:59:50.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:59:49 smithi134 ceph-mon[34132]: pgmap v734: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.7 MiB/s wr, 580 op/s 2024-05-08T05:59:50.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 540.0 s, 1499.0 tps, lat 65.128 ms stddev 71.658 2024-05-08T05:59:50.978 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-08T05:59:51.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:59:50 smithi151 ceph-mon[34815]: scrub queued for path: / 2024-05-08T05:59:51.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:59:50 smithi151 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-05-08T05:59:51.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:59:50 smithi151 ceph-mon[34815]: scrub summary: active paths [/] 2024-05-08T05:59:51.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:59:50 smithi151 ceph-mon[34815]: scrub summary: active paths [/] 2024-05-08T05:59:51.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:59:50 smithi082 ceph-mon[30098]: scrub queued for path: / 2024-05-08T05:59:51.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:59:50 smithi082 ceph-mon[30098]: scrub summary: idle+waiting paths [/] 2024-05-08T05:59:51.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:59:50 smithi082 ceph-mon[30098]: scrub summary: active paths [/] 2024-05-08T05:59:51.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:59:50 smithi082 ceph-mon[30098]: scrub summary: active paths [/] 2024-05-08T05:59:51.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:59:50 smithi134 ceph-mon[34132]: scrub queued for path: / 2024-05-08T05:59:51.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:59:50 smithi134 ceph-mon[34132]: scrub summary: idle+waiting paths [/] 2024-05-08T05:59:51.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:59:50 smithi134 ceph-mon[34132]: scrub summary: active paths [/] 2024-05-08T05:59:51.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:59:50 smithi134 ceph-mon[34132]: scrub summary: active paths [/] 2024-05-08T05:59:51.566 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T05:59:52.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:59:51 smithi151 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-05-08T05:59:52.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:59:51 smithi151 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-05-08T05:59:52.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:59:51 smithi151 ceph-mon[34815]: pgmap v735: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.9 MiB/s wr, 747 op/s 2024-05-08T05:59:52.166 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:59:51 smithi082 ceph-mon[30098]: scrub summary: idle+waiting paths [/] 2024-05-08T05:59:52.166 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:59:51 smithi082 ceph-mon[30098]: scrub summary: idle+waiting paths [/] 2024-05-08T05:59:52.166 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:59:51 smithi082 ceph-mon[30098]: pgmap v735: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.9 MiB/s wr, 747 op/s 2024-05-08T05:59:52.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:59:51 smithi134 ceph-mon[34132]: scrub summary: idle+waiting paths [/] 2024-05-08T05:59:52.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:59:51 smithi134 ceph-mon[34132]: scrub summary: idle+waiting paths [/] 2024-05-08T05:59:52.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:59:51 smithi134 ceph-mon[34132]: pgmap v735: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.9 MiB/s wr, 747 op/s 2024-05-08T05:59:54.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:59:53 smithi082 ceph-mon[30098]: pgmap v736: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.2 MiB/s wr, 595 op/s 2024-05-08T05:59:54.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:59:53 smithi134 ceph-mon[34132]: pgmap v736: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.2 MiB/s wr, 595 op/s 2024-05-08T05:59:54.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:59:53 smithi151 ceph-mon[34815]: pgmap v736: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.2 MiB/s wr, 595 op/s 2024-05-08T05:59:55.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.046+0000 7f722ee00700 1 -- 172.21.15.82:0/3979250177 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f722810c760 msgr2=0x7f7228114eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:55.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.046+0000 7f722ee00700 1 --2- 172.21.15.82:0/3979250177 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f722810c760 0x7f7228114eb0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7218009990 tx=0x7f7218009ca0 comp rx=0 tx=0).stop 2024-05-08T05:59:55.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.046+0000 7f722ee00700 1 -- 172.21.15.82:0/3979250177 shutdown_connections 2024-05-08T05:59:55.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.046+0000 7f722ee00700 1 --2- 172.21.15.82:0/3979250177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72281153f0 0x7f72281177e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:55.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.046+0000 7f722ee00700 1 --2- 172.21.15.82:0/3979250177 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f722810be40 0x7f722810c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:55.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.046+0000 7f722ee00700 1 --2- 172.21.15.82:0/3979250177 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f722810c760 0x7f7228114eb0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:55.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.046+0000 7f722ee00700 1 -- 172.21.15.82:0/3979250177 >> 172.21.15.82:0/3979250177 conn(0x7f722806e610 msgr2=0x7f722806ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:59:55.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.048+0000 7f722ee00700 1 -- 172.21.15.82:0/3979250177 shutdown_connections 2024-05-08T05:59:55.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.048+0000 7f722ee00700 1 -- 172.21.15.82:0/3979250177 wait complete. 2024-05-08T05:59:55.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.050+0000 7f722ee00700 1 Processor -- start 2024-05-08T05:59:55.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.051+0000 7f722ee00700 1 -- start start 2024-05-08T05:59:55.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.051+0000 7f722ee00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f722810be40 0x7f72281a4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:55.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.051+0000 7f722ee00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f722810c760 0x7f72281a4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:55.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.051+0000 7f722ee00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72281153f0 0x7f72281a8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:55.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.051+0000 7f722ee00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f722811ae20 con 0x7f72281153f0 2024-05-08T05:59:55.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.051+0000 7f722ee00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f722811aca0 con 0x7f722810be40 2024-05-08T05:59:55.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.051+0000 7f722ee00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f722811afa0 con 0x7f722810c760 2024-05-08T05:59:55.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.052+0000 7f7227400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f722810c760 0x7f72281a4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:55.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.052+0000 7f7227400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f722810c760 0x7f72281a4b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:41814/0 (socket says 172.21.15.82:41814) 2024-05-08T05:59:55.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.052+0000 7f7227400700 1 -- 172.21.15.82:0/2189282553 learned_addr learned my addr 172.21.15.82:0/2189282553 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:59:55.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.052+0000 7f7227e00700 1 --2- 172.21.15.82:0/2189282553 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f722810be40 0x7f72281a4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:55.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.052+0000 7f7227400700 1 -- 172.21.15.82:0/2189282553 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f722810be40 msgr2=0x7f72281a4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:55.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.052+0000 7f7227400700 1 --2- 172.21.15.82:0/2189282553 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f722810be40 0x7f72281a4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:55.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.052+0000 7f7227400700 1 -- 172.21.15.82:0/2189282553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72281153f0 msgr2=0x7f72281a8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:55.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.052+0000 7f7227400700 1 --2- 172.21.15.82:0/2189282553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72281153f0 0x7f72281a8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:55.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.052+0000 7f7227400700 1 -- 172.21.15.82:0/2189282553 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72281a9600 con 0x7f722810c760 2024-05-08T05:59:55.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.053+0000 7f7227400700 1 --2- 172.21.15.82:0/2189282553 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f722810c760 0x7f72281a4b80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7218005910 tx=0x7f72180047b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:59:55.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.054+0000 7f7224c00700 1 -- 172.21.15.82:0/2189282553 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7218027070 con 0x7f722810c760 2024-05-08T05:59:55.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.054+0000 7f7224c00700 1 -- 172.21.15.82:0/2189282553 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7218003fa0 con 0x7f722810c760 2024-05-08T05:59:55.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.054+0000 7f7224c00700 1 -- 172.21.15.82:0/2189282553 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7218022dd0 con 0x7f722810c760 2024-05-08T05:59:55.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.055+0000 7f722ee00700 1 -- 172.21.15.82:0/2189282553 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72281a9890 con 0x7f722810c760 2024-05-08T05:59:55.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.055+0000 7f722ee00700 1 -- 172.21.15.82:0/2189282553 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72281b1170 con 0x7f722810c760 2024-05-08T05:59:55.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.062+0000 7f7224c00700 1 -- 172.21.15.82:0/2189282553 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f721802a070 con 0x7f722810c760 2024-05-08T05:59:55.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.064+0000 7f7224c00700 1 --2- 172.21.15.82:0/2189282553 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f720c0b2980 0x7f720c0b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:55.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.064+0000 7f7224c00700 1 -- 172.21.15.82:0/2189282553 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f72180e2fd0 con 0x7f722810c760 2024-05-08T05:59:55.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.065+0000 7f7239768b80 1 Processor -- start 2024-05-08T05:59:55.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.065+0000 7f7227e00700 1 --2- 172.21.15.82:0/2189282553 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f720c0b2980 0x7f720c0b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:55.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.067+0000 7f7239768b80 1 -- start start 2024-05-08T05:59:55.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.067+0000 7f7227e00700 1 --2- 172.21.15.82:0/2189282553 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f720c0b2980 0x7f720c0b4e40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f721400ac50 tx=0x7f721400a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:59:55.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.068+0000 7f7239768b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0c3547bc0 0x55f0c3547fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:55.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.069+0000 7f7239768b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0c35484e0 0x55f0c35422d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:55.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.069+0000 7f7239768b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0c35428f0 0x55f0c3542d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:55.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.069+0000 7f7227e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0c3547bc0 0x55f0c3547fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:55.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.069+0000 7f7227e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0c3547bc0 0x55f0c3547fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:59562/0 (socket says 172.21.15.82:59562) 2024-05-08T05:59:55.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.070+0000 7f7227400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0c35484e0 0x55f0c35422d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:55.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.070+0000 7f7227400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0c35484e0 0x55f0c35422d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33432/0 (socket says 172.21.15.82:33432) 2024-05-08T05:59:55.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.070+0000 7f7239768b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f0c3494a20 con 0x55f0c35484e0 2024-05-08T05:59:55.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.070+0000 7f7239768b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f0c3432760 con 0x55f0c3547bc0 2024-05-08T05:59:55.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.070+0000 7f7239768b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55f0c34909e0 con 0x55f0c35428f0 2024-05-08T05:59:55.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.070+0000 7f7227e00700 1 -- 172.21.15.82:0/3903647525 learned_addr learned my addr 172.21.15.82:0/3903647525 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:59:55.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.070+0000 7f722ce00700 1 --2- 172.21.15.82:0/3903647525 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0c35428f0 0x55f0c3542d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:55.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.071+0000 7f7227400700 1 -- 172.21.15.82:0/3903647525 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0c35428f0 msgr2=0x55f0c3542d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:55.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.071+0000 7f7227400700 1 --2- 172.21.15.82:0/3903647525 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0c35428f0 0x55f0c3542d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:55.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.071+0000 7f7227400700 1 -- 172.21.15.82:0/3903647525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0c3547bc0 msgr2=0x55f0c3547fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:55.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.071+0000 7f7227400700 1 --2- 172.21.15.82:0/3903647525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0c3547bc0 0x55f0c3547fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:55.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.071+0000 7f7227400700 1 -- 172.21.15.82:0/3903647525 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0c33e18d0 con 0x55f0c35484e0 2024-05-08T05:59:55.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.071+0000 7f7227400700 1 --2- 172.21.15.82:0/3903647525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0c35484e0 0x55f0c35422d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f7218000c00 tx=0x7f7218022470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43cc5d202cbb9764 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:59:55.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.072+0000 7f721d600700 1 -- 172.21.15.82:0/3903647525 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72180aea70 con 0x55f0c35484e0 2024-05-08T05:59:55.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.072+0000 7f721d600700 1 -- 172.21.15.82:0/3903647525 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72180b3490 con 0x55f0c35484e0 2024-05-08T05:59:55.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.072+0000 7f721d600700 1 -- 172.21.15.82:0/3903647525 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72180aa920 con 0x55f0c35484e0 2024-05-08T05:59:55.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.073+0000 7f7239768b80 1 -- 172.21.15.82:0/3903647525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0c35484e0 msgr2=0x55f0c35422d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:55.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.073+0000 7f7239768b80 1 --2- 172.21.15.82:0/3903647525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0c35484e0 0x55f0c35422d0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f7218000c00 tx=0x7f7218022470 comp rx=0 tx=0).stop 2024-05-08T05:59:55.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.073+0000 7f7239768b80 1 -- 172.21.15.82:0/3903647525 shutdown_connections 2024-05-08T05:59:55.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.073+0000 7f7239768b80 1 --2- 172.21.15.82:0/3903647525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0c3547bc0 0x55f0c3547fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:55.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.073+0000 7f7239768b80 1 --2- 172.21.15.82:0/3903647525 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0c35428f0 0x55f0c3542d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:55.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.073+0000 7f7239768b80 1 --2- 172.21.15.82:0/3903647525 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0c35484e0 0x55f0c35422d0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:55.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.073+0000 7f7239768b80 1 -- 172.21.15.82:0/3903647525 >> 172.21.15.82:0/3903647525 conn(0x55f0c34ba6d0 msgr2=0x55f0c353cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:59:55.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.074+0000 7f7239768b80 1 -- 172.21.15.82:0/3903647525 shutdown_connections 2024-05-08T05:59:55.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.074+0000 7f7239768b80 1 -- 172.21.15.82:0/3903647525 wait complete. 2024-05-08T05:59:55.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.074+0000 7f7239768b80 1 -- start start 2024-05-08T05:59:55.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.074+0000 7f7239768b80 1 Processor -- start 2024-05-08T05:59:55.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.075+0000 7f7239768b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0c35428f0 0x55f0c354e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:55.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.075+0000 7f7239768b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0c3547bc0 0x55f0c354b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:55.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.075+0000 7f7239768b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0c35484e0 0x55f0c354bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:55.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.075+0000 7f7239768b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f0c354ece0 con 0x55f0c35484e0 2024-05-08T05:59:55.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.075+0000 7f7239768b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f0c33fab20 con 0x55f0c35428f0 2024-05-08T05:59:55.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.075+0000 7f7239768b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55f0c354ee60 con 0x55f0c3547bc0 2024-05-08T05:59:55.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.075+0000 7f7239768b80 10 client.0 _ll_register_callbacks cb 0x55f0c343bc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:59:55.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.076+0000 7f722ce00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0c35484e0 0x55f0c354bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:55.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.076+0000 7f722ce00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0c35484e0 0x55f0c354bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33446/0 (socket says 172.21.15.82:33446) 2024-05-08T05:59:55.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.076+0000 7f722ce00700 1 -- 172.21.15.82:0/3857321211 learned_addr learned my addr 172.21.15.82:0/3857321211 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:59:55.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.077+0000 7f7227e00700 1 --2- 172.21.15.82:0/3857321211 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0c35428f0 0x55f0c354e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:55.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.077+0000 7f7227400700 1 --2- 172.21.15.82:0/3857321211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0c3547bc0 0x55f0c354b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:55.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.077+0000 7f722ce00700 1 -- 172.21.15.82:0/3857321211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0c3547bc0 msgr2=0x55f0c354b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:55.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.077+0000 7f722ce00700 1 --2- 172.21.15.82:0/3857321211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0c3547bc0 0x55f0c354b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:55.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.078+0000 7f722ce00700 1 -- 172.21.15.82:0/3857321211 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0c35428f0 msgr2=0x55f0c354e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:55.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.078+0000 7f722ce00700 1 --2- 172.21.15.82:0/3857321211 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0c35428f0 0x55f0c354e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:55.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.078+0000 7f722ce00700 1 -- 172.21.15.82:0/3857321211 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0c345a420 con 0x55f0c35484e0 2024-05-08T05:59:55.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.078+0000 7f7227e00700 1 --2- 172.21.15.82:0/3857321211 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0c35428f0 0x55f0c354e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T05:59:55.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.078+0000 7f722ce00700 1 --2- 172.21.15.82:0/3857321211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0c35484e0 0x55f0c354bab0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7220008b60 tx=0x7f7220008e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d60737900f882ba7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:59:55.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.078+0000 7f7212000700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T05:59:55.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.079+0000 7f7212000700 1 -- 172.21.15.82:0/3857321211 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f722000ea90 con 0x55f0c35484e0 2024-05-08T05:59:55.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.079+0000 7f7212000700 1 -- 172.21.15.82:0/3857321211 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f722000ec30 con 0x55f0c35484e0 2024-05-08T05:59:55.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.079+0000 7f7239768b80 1 -- 172.21.15.82:0/3857321211 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f72180b3490 con 0x55f0c35484e0 2024-05-08T05:59:55.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.079+0000 7f7212000700 1 -- 172.21.15.82:0/3857321211 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f722000ee30 con 0x55f0c35484e0 2024-05-08T05:59:55.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.079+0000 7f7239768b80 10 client.15870 fetch_fsmap learned FSMap version 31 2024-05-08T05:59:55.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.079+0000 7f7239768b80 1 -- 172.21.15.82:0/3857321211 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55f0c3561d00 con 0x55f0c35484e0 2024-05-08T05:59:55.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.080+0000 7f7212000700 1 -- 172.21.15.82:0/3857321211 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f72180b3490 con 0x55f0c35484e0 2024-05-08T05:59:55.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.081+0000 7f7212000700 1 -- 172.21.15.82:0/3857321211 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f722001c470 con 0x55f0c35484e0 2024-05-08T05:59:55.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.081+0000 7f7239768b80 10 client.15870 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:59:55.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.081+0000 7f7239768b80 10 client.15870 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:59:55.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.081+0000 7f7239768b80 20 client.15870 populate_metadata read hostname 'smithi082' 2024-05-08T05:59:55.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.081+0000 7f7239768b80 1 --2- 172.21.15.82:0/3857321211 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55f0c3564340 0x55f0c3566730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:55.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.081+0000 7f7239768b80 4 client.15870 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T05:59:55.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.081+0000 7f7239768b80 1 -- 172.21.15.82:0/3857321211 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f0c350f140 con 0x55f0c3564340 2024-05-08T05:59:55.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.082+0000 7f7227e00700 1 --2- 172.21.15.82:0/3857321211 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55f0c3564340 0x55f0c3566730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:55.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.083+0000 7f7227e00700 1 --2- 172.21.15.82:0/3857321211 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55f0c3564340 0x55f0c3566730 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c5b809a654497ad server_cookie=28e8822d4dd35544 in_seq=0 out_seq=0 2024-05-08T05:59:55.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.083+0000 7f7212000700 10 client.15870 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:59:55.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.084+0000 7f7212000700 1 -- 172.21.15.82:0/3857321211 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f0c350f140 con 0x55f0c3564340 2024-05-08T05:59:55.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.084+0000 7f7212000700 10 client.15870 handle_command_reply: tid=0 2024-05-08T05:59:55.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.085+0000 7f7239768b80 1 client.15870 shutdown 2024-05-08T05:59:55.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.085+0000 7f7239768b80 1 -- 172.21.15.82:0/3857321211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0c35484e0 msgr2=0x55f0c354bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:55.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.085+0000 7f7239768b80 1 --2- 172.21.15.82:0/3857321211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0c35484e0 0x55f0c354bab0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7220008b60 tx=0x7f7220008e70 comp rx=0 tx=0).stop 2024-05-08T05:59:55.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.085+0000 7f7239768b80 1 -- 172.21.15.82:0/3857321211 shutdown_connections 2024-05-08T05:59:55.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.085+0000 7f7239768b80 1 --2- 172.21.15.82:0/3857321211 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55f0c3564340 0x55f0c3566730 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:55.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.085+0000 7f7239768b80 1 --2- 172.21.15.82:0/3857321211 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0c35428f0 0x55f0c354e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:55.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.085+0000 7f7239768b80 1 --2- 172.21.15.82:0/3857321211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0c35484e0 0x55f0c354bab0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:55.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.085+0000 7f7239768b80 1 --2- 172.21.15.82:0/3857321211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0c3547bc0 0x55f0c354b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:55.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.085+0000 7f7239768b80 1 -- 172.21.15.82:0/3857321211 >> 172.21.15.82:0/3857321211 conn(0x55f0c34ba6d0 msgr2=0x55f0c353c190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:59:55.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.086+0000 7f7212000700 0 client.15870 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:59:55.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.086+0000 7f7239768b80 1 -- 172.21.15.82:0/3857321211 shutdown_connections 2024-05-08T05:59:55.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.086+0000 7f7239768b80 1 -- 172.21.15.82:0/3857321211 wait complete. 2024-05-08T05:59:55.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.086+0000 7f7239768b80 20 client.15870 trim_cache size 0 max 16384 2024-05-08T05:59:55.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.118+0000 7f7239768b80 1 Processor -- start 2024-05-08T05:59:55.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.118+0000 7f7239768b80 1 -- start start 2024-05-08T05:59:55.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.119+0000 7f7239768b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0c35428f0 0x55f0c35422d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:55.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.119+0000 7f7239768b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0c3547bc0 0x55f0c3560540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:55.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.119+0000 7f7239768b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0c35484e0 0x55f0c354a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:55.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.119+0000 7f7239768b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f72281b40e0 con 0x55f0c35484e0 2024-05-08T05:59:55.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.119+0000 7f7239768b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f72281b5c20 con 0x55f0c3547bc0 2024-05-08T05:59:55.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.119+0000 7f7239768b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f72281b47b0 con 0x55f0c35428f0 2024-05-08T05:59:55.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.119+0000 7f7227400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0c3547bc0 0x55f0c3560540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:55.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.119+0000 7f7227400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0c3547bc0 0x55f0c3560540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:59572/0 (socket says 172.21.15.82:59572) 2024-05-08T05:59:55.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.119+0000 7f7227400700 1 -- 172.21.15.82:0/339632045 learned_addr learned my addr 172.21.15.82:0/339632045 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:59:55.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.120+0000 7f722ce00700 1 --2- 172.21.15.82:0/339632045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0c35484e0 0x55f0c354a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:55.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.120+0000 7f7227e00700 1 --2- 172.21.15.82:0/339632045 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0c35428f0 0x55f0c35422d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:55.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.120+0000 7f7227400700 1 -- 172.21.15.82:0/339632045 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0c35428f0 msgr2=0x55f0c35422d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:55.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.120+0000 7f7227400700 1 --2- 172.21.15.82:0/339632045 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0c35428f0 0x55f0c35422d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:55.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.120+0000 7f7227400700 1 -- 172.21.15.82:0/339632045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0c35484e0 msgr2=0x55f0c354a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:55.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.120+0000 7f7227400700 1 --2- 172.21.15.82:0/339632045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0c35484e0 0x55f0c354a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:55.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.120+0000 7f7227400700 1 -- 172.21.15.82:0/339632045 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0c3537ab0 con 0x55f0c3547bc0 2024-05-08T05:59:55.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.120+0000 7f722ce00700 1 --2- 172.21.15.82:0/339632045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0c35484e0 0x55f0c354a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:59:55.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.120+0000 7f7227400700 1 --2- 172.21.15.82:0/339632045 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0c3547bc0 0x55f0c3560540 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7218009750 tx=0x7f72180aa280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=349c0c648f73bbd0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:59:55.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.120+0000 7f721cc00700 1 -- 172.21.15.82:0/339632045 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72180aea70 con 0x55f0c3547bc0 2024-05-08T05:59:55.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.121+0000 7f721cc00700 1 -- 172.21.15.82:0/339632045 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7218092110 con 0x55f0c3547bc0 2024-05-08T05:59:55.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.121+0000 7f721cc00700 1 -- 172.21.15.82:0/339632045 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72180aab80 con 0x55f0c3547bc0 2024-05-08T05:59:55.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.121+0000 7f7239768b80 1 -- 172.21.15.82:0/339632045 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0c3547bc0 msgr2=0x55f0c3560540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:55.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.121+0000 7f7239768b80 1 --2- 172.21.15.82:0/339632045 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0c3547bc0 0x55f0c3560540 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f7218009750 tx=0x7f72180aa280 comp rx=0 tx=0).stop 2024-05-08T05:59:55.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.122+0000 7f7239768b80 1 -- 172.21.15.82:0/339632045 shutdown_connections 2024-05-08T05:59:55.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.122+0000 7f7239768b80 1 --2- 172.21.15.82:0/339632045 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0c35484e0 0x55f0c354a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:55.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.122+0000 7f7239768b80 1 --2- 172.21.15.82:0/339632045 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0c35428f0 0x55f0c35422d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:55.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.122+0000 7f7239768b80 1 --2- 172.21.15.82:0/339632045 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0c3547bc0 0x55f0c3560540 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:55.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.122+0000 7f7239768b80 1 -- 172.21.15.82:0/339632045 >> 172.21.15.82:0/339632045 conn(0x55f0c34ba6d0 msgr2=0x55f0c3549ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:59:55.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.122+0000 7f7239768b80 1 -- 172.21.15.82:0/339632045 shutdown_connections 2024-05-08T05:59:55.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.122+0000 7f7239768b80 1 -- 172.21.15.82:0/339632045 wait complete. 2024-05-08T05:59:55.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.122+0000 7f7239768b80 1 -- start start 2024-05-08T05:59:55.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.123+0000 7f7239768b80 1 Processor -- start 2024-05-08T05:59:55.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.125+0000 7f7239768b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0c35428f0 0x55f0c355caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:55.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.125+0000 7f7239768b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0c3547bc0 0x55f0c355cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:55.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.125+0000 7f7239768b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0c35484e0 0x55f0c3559910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:55.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.125+0000 7f7239768b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f72281b5550 con 0x55f0c35428f0 2024-05-08T05:59:55.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.125+0000 7f7239768b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f72281b4e80 con 0x55f0c35484e0 2024-05-08T05:59:55.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.125+0000 7f7239768b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7228110d40 con 0x55f0c3547bc0 2024-05-08T05:59:55.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.125+0000 7f7239768b80 10 client.0 _ll_register_callbacks cb 0x55f0c343bc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T05:59:55.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.125+0000 7f722ce00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0c35484e0 0x55f0c3559910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:55.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.125+0000 7f722ce00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0c35484e0 0x55f0c3559910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:59578/0 (socket says 172.21.15.82:59578) 2024-05-08T05:59:55.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.125+0000 7f722ce00700 1 -- 172.21.15.82:0/2649844077 learned_addr learned my addr 172.21.15.82:0/2649844077 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T05:59:55.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.126+0000 7f722ce00700 1 -- 172.21.15.82:0/2649844077 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0c3547bc0 msgr2=0x55f0c355cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:55.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.126+0000 7f7227400700 1 --2- 172.21.15.82:0/2649844077 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0c3547bc0 0x55f0c355cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:55.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.126+0000 7f722ce00700 1 --2- 172.21.15.82:0/2649844077 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0c3547bc0 0x55f0c355cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:55.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.126+0000 7f722ce00700 1 -- 172.21.15.82:0/2649844077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0c35428f0 msgr2=0x55f0c355caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T05:59:55.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.126+0000 7f722ce00700 1 --2- 172.21.15.82:0/2649844077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0c35428f0 0x55f0c355caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:55.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.126+0000 7f722ce00700 1 -- 172.21.15.82:0/2649844077 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0c354e540 con 0x55f0c35484e0 2024-05-08T05:59:55.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.127+0000 7f722ce00700 1 --2- 172.21.15.82:0/2649844077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0c35484e0 0x55f0c3559910 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7220000f80 tx=0x7f722001ce60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=235358b95c7ef802 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T05:59:55.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.127+0000 7f7212000700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T05:59:55.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.127+0000 7f7227400700 1 --2- 172.21.15.82:0/2649844077 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0c3547bc0 0x55f0c355cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T05:59:55.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.127+0000 7f7212000700 1 -- 172.21.15.82:0/2649844077 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f722002b020 con 0x55f0c35484e0 2024-05-08T05:59:55.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.127+0000 7f7212000700 1 -- 172.21.15.82:0/2649844077 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f722001c550 con 0x55f0c35484e0 2024-05-08T05:59:55.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.127+0000 7f7239768b80 1 -- 172.21.15.82:0/2649844077 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7218092110 con 0x55f0c35484e0 2024-05-08T05:59:55.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.127+0000 7f7212000700 1 -- 172.21.15.82:0/2649844077 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f722000e890 con 0x55f0c35484e0 2024-05-08T05:59:55.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.127+0000 7f7239768b80 10 client.26228 fetch_fsmap learned FSMap version 31 2024-05-08T05:59:55.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.127+0000 7f7239768b80 1 -- 172.21.15.82:0/2649844077 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55f0c3542f20 con 0x55f0c35484e0 2024-05-08T05:59:55.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.128+0000 7f7212000700 1 -- 172.21.15.82:0/2649844077 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7218092110 con 0x55f0c35484e0 2024-05-08T05:59:55.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.128+0000 7f7212000700 1 -- 172.21.15.82:0/2649844077 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f7220004140 con 0x55f0c35484e0 2024-05-08T05:59:55.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.128+0000 7f7239768b80 10 client.26228 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T05:59:55.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.128+0000 7f7239768b80 10 client.26228 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T05:59:55.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.128+0000 7f7239768b80 20 client.26228 populate_metadata read hostname 'smithi082' 2024-05-08T05:59:55.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.128+0000 7f7239768b80 1 --2- 172.21.15.82:0/2649844077 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55f0c35cfa90 0x55f0c35d1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T05:59:55.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.128+0000 7f7239768b80 4 client.26228 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-08T05:59:55.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.128+0000 7f7239768b80 1 -- 172.21.15.82:0/2649844077 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f0c34a2400 con 0x55f0c35cfa90 2024-05-08T05:59:55.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.129+0000 7f7227e00700 1 --2- 172.21.15.82:0/2649844077 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55f0c35cfa90 0x55f0c35d1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T05:59:55.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.129+0000 7f7227e00700 1 --2- 172.21.15.82:0/2649844077 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55f0c35cfa90 0x55f0c35d1eb0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4efa36bd5e5822e3 server_cookie=d258564201b01d54 in_seq=0 out_seq=0 2024-05-08T05:59:55.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.129+0000 7f7212000700 10 client.26228 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T05:59:55.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.130+0000 7f7212000700 1 -- 172.21.15.82:0/2649844077 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55f0c34a2400 con 0x55f0c35cfa90 2024-05-08T05:59:55.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.130+0000 7f7212000700 10 client.26228 handle_command_reply: tid=0 2024-05-08T05:59:55.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.130+0000 7f7239768b80 1 client.26228 shutdown 2024-05-08T05:59:55.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.130+0000 7f7239768b80 1 -- 172.21.15.82:0/2649844077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0c35484e0 msgr2=0x55f0c3559910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:55.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.130+0000 7f7239768b80 1 --2- 172.21.15.82:0/2649844077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0c35484e0 0x55f0c3559910 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7220000f80 tx=0x7f722001ce60 comp rx=0 tx=0).stop 2024-05-08T05:59:55.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.131+0000 7f7239768b80 1 -- 172.21.15.82:0/2649844077 shutdown_connections 2024-05-08T05:59:55.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.131+0000 7f7239768b80 1 --2- 172.21.15.82:0/2649844077 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55f0c35cfa90 0x55f0c35d1eb0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:55.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.131+0000 7f7239768b80 1 --2- 172.21.15.82:0/2649844077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0c35484e0 0x55f0c3559910 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:55.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.131+0000 7f7239768b80 1 --2- 172.21.15.82:0/2649844077 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0c35428f0 0x55f0c355caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:55.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.131+0000 7f7239768b80 1 --2- 172.21.15.82:0/2649844077 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0c3547bc0 0x55f0c355cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:55.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.131+0000 7f7239768b80 1 -- 172.21.15.82:0/2649844077 >> 172.21.15.82:0/2649844077 conn(0x55f0c34ba6d0 msgr2=0x55f0c3546ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:59:55.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.131+0000 7f7212000700 0 client.26228 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T05:59:55.133 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T05:59:55.133 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-08T05:59:55.133 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2024-05-08T05:59:55.133 INFO:teuthology.orchestra.run.smithi082.stdout: "be7741ed-49fd-42e9-89bf-b80968c4fc25": { 2024-05-08T05:59:55.133 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2024-05-08T05:59:55.133 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "be7741ed-49fd-42e9-89bf-b80968c4fc25", 2024-05-08T05:59:55.133 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2024-05-08T05:59:55.133 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T05:59:55.133 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T05:59:55.133 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T05:59:55.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.131+0000 7f7239768b80 1 -- 172.21.15.82:0/2649844077 shutdown_connections 2024-05-08T05:59:55.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.131+0000 7f7239768b80 1 -- 172.21.15.82:0/2649844077 wait complete. 2024-05-08T05:59:55.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.132+0000 7f7239768b80 20 client.26228 trim_cache size 0 max 16384 2024-05-08T05:59:55.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.132+0000 7f722ee00700 1 -- 172.21.15.82:0/2189282553 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f720c0b2980 msgr2=0x7f720c0b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:55.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.132+0000 7f722ee00700 1 --2- 172.21.15.82:0/2189282553 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f720c0b2980 0x7f720c0b4e40 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f721400ac50 tx=0x7f721400a380 comp rx=0 tx=0).stop 2024-05-08T05:59:55.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.132+0000 7f722ee00700 1 -- 172.21.15.82:0/2189282553 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f722810c760 msgr2=0x7f72281a4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T05:59:55.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.132+0000 7f722ee00700 1 --2- 172.21.15.82:0/2189282553 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f722810c760 0x7f72281a4b80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f7218005910 tx=0x7f72180047b0 comp rx=0 tx=0).stop 2024-05-08T05:59:55.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.133+0000 7f722ee00700 1 -- 172.21.15.82:0/2189282553 shutdown_connections 2024-05-08T05:59:55.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.133+0000 7f722ee00700 1 --2- 172.21.15.82:0/2189282553 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f722810be40 0x7f72281a4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:55.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.133+0000 7f722ee00700 1 --2- 172.21.15.82:0/2189282553 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f720c0b2980 0x7f720c0b4e40 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:55.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.133+0000 7f722ee00700 1 --2- 172.21.15.82:0/2189282553 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f72281153f0 0x7f72281a8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:55.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.133+0000 7f722ee00700 1 --2- 172.21.15.82:0/2189282553 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f722810c760 0x7f72281a4b80 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T05:59:55.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.133+0000 7f722ee00700 1 -- 172.21.15.82:0/2189282553 >> 172.21.15.82:0/2189282553 conn(0x7f722806e610 msgr2=0x7f72281159b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T05:59:55.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.133+0000 7f722ee00700 1 -- 172.21.15.82:0/2189282553 shutdown_connections 2024-05-08T05:59:55.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T05:59:55.133+0000 7f722ee00700 1 -- 172.21.15.82:0/2189282553 wait complete. 2024-05-08T05:59:55.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 545.0 s, 1494.8 tps, lat 67.152 ms stddev 79.808 2024-05-08T05:59:55.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:59:55 smithi082 ceph-mon[30098]: pgmap v737: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.4 MiB/s wr, 613 op/s 2024-05-08T05:59:56.204 INFO:tasks.cephfs.filesystem:scrub status for tag:be7741ed-49fd-42e9-89bf-b80968c4fc25 - {'path': '/', 'tag': 'be7741ed-49fd-42e9-89bf-b80968c4fc25', 'options': 'recursive,force'} 2024-05-08T05:59:56.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:59:55 smithi134 ceph-mon[34132]: pgmap v737: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.4 MiB/s wr, 613 op/s 2024-05-08T05:59:56.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:59:55 smithi151 ceph-mon[34815]: pgmap v737: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.4 MiB/s wr, 613 op/s 2024-05-08T05:59:58.180 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:59:57 smithi151 ceph-mon[34815]: pgmap v738: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.5 MiB/s wr, 713 op/s 2024-05-08T05:59:58.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:59:57 smithi082 ceph-mon[30098]: pgmap v738: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.5 MiB/s wr, 713 op/s 2024-05-08T05:59:58.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:59:57 smithi134 ceph-mon[34132]: pgmap v738: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.5 MiB/s wr, 713 op/s 2024-05-08T05:59:59.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 05:59:59 smithi082 ceph-mon[30098]: pgmap v739: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.0 MiB/s wr, 578 op/s 2024-05-08T06:00:00.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 05:59:59 smithi134 ceph-mon[34132]: pgmap v739: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.0 MiB/s wr, 578 op/s 2024-05-08T06:00:00.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 550.0 s, 2446.8 tps, lat 41.686 ms stddev 53.679 2024-05-08T06:00:00.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 05:59:59 smithi151 ceph-mon[34815]: pgmap v739: 97 pgs: 97 active+clean; 1.6 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.0 MiB/s wr, 578 op/s 2024-05-08T06:00:01.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:00:00 smithi082 ceph-mon[30098]: overall HEALTH_OK 2024-05-08T06:00:01.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:00:00 smithi082 ceph-mon[30098]: scrub summary: idle 2024-05-08T06:00:01.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:00:00 smithi134 ceph-mon[34132]: overall HEALTH_OK 2024-05-08T06:00:01.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:00:00 smithi134 ceph-mon[34132]: scrub summary: idle 2024-05-08T06:00:01.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:00:00 smithi151 ceph-mon[34815]: overall HEALTH_OK 2024-05-08T06:00:01.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:00:00 smithi151 ceph-mon[34815]: scrub summary: idle 2024-05-08T06:00:02.210 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:00:01 smithi151 ceph-mon[34815]: scrub summary: idle 2024-05-08T06:00:02.210 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:00:01 smithi151 ceph-mon[34815]: pgmap v740: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.6 MiB/s wr, 741 op/s 2024-05-08T06:00:02.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:00:01 smithi082 ceph-mon[30098]: scrub summary: idle 2024-05-08T06:00:02.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:00:01 smithi082 ceph-mon[30098]: pgmap v740: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.6 MiB/s wr, 741 op/s 2024-05-08T06:00:02.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:00:01 smithi134 ceph-mon[34132]: scrub summary: idle 2024-05-08T06:00:02.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:00:01 smithi134 ceph-mon[34132]: pgmap v740: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.6 MiB/s wr, 741 op/s 2024-05-08T06:00:04.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:00:03 smithi082 ceph-mon[30098]: pgmap v741: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 6.0 MiB/s wr, 604 op/s 2024-05-08T06:00:04.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:00:03 smithi134 ceph-mon[34132]: pgmap v741: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 6.0 MiB/s wr, 604 op/s 2024-05-08T06:00:04.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:00:03 smithi151 ceph-mon[34815]: pgmap v741: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 6.0 MiB/s wr, 604 op/s 2024-05-08T06:00:05.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 555.0 s, 2020.5 tps, lat 49.263 ms stddev 54.202 2024-05-08T06:00:06.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:00:05 smithi082 ceph-mon[30098]: pgmap v742: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 6.1 MiB/s wr, 612 op/s 2024-05-08T06:00:06.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:00:05 smithi134 ceph-mon[34132]: pgmap v742: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 6.1 MiB/s wr, 612 op/s 2024-05-08T06:00:06.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:00:05 smithi151 ceph-mon[34815]: pgmap v742: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 6.1 MiB/s wr, 612 op/s 2024-05-08T06:00:08.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:00:07 smithi082 ceph-mon[30098]: pgmap v743: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 7.4 MiB/s wr, 748 op/s 2024-05-08T06:00:08.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:00:07 smithi134 ceph-mon[34132]: pgmap v743: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 7.4 MiB/s wr, 748 op/s 2024-05-08T06:00:08.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:00:07 smithi151 ceph-mon[34815]: pgmap v743: 97 pgs: 97 active+clean; 1.6 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 7.4 MiB/s wr, 748 op/s 2024-05-08T06:00:10.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:00:09 smithi082 ceph-mon[30098]: pgmap v744: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.1 MiB/s wr, 623 op/s 2024-05-08T06:00:10.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:00:09 smithi134 ceph-mon[34132]: pgmap v744: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.1 MiB/s wr, 623 op/s 2024-05-08T06:00:10.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 560.0 s, 1873.7 tps, lat 53.199 ms stddev 64.145 2024-05-08T06:00:10.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:00:09 smithi151 ceph-mon[34815]: pgmap v744: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.1 MiB/s wr, 623 op/s 2024-05-08T06:00:12.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:00:11 smithi082 ceph-mon[30098]: pgmap v745: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 7.6 MiB/s wr, 787 op/s 2024-05-08T06:00:12.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:00:11 smithi134 ceph-mon[34132]: pgmap v745: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 7.6 MiB/s wr, 787 op/s 2024-05-08T06:00:12.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:00:11 smithi151 ceph-mon[34815]: pgmap v745: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 7.6 MiB/s wr, 787 op/s 2024-05-08T06:00:14.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:00:13 smithi082 ceph-mon[30098]: pgmap v746: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 6.8 MiB/s wr, 672 op/s 2024-05-08T06:00:14.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:00:13 smithi134 ceph-mon[34132]: pgmap v746: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 6.8 MiB/s wr, 672 op/s 2024-05-08T06:00:14.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:00:13 smithi151 ceph-mon[34815]: pgmap v746: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 6.8 MiB/s wr, 672 op/s 2024-05-08T06:00:15.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 565.0 s, 1600.8 tps, lat 62.504 ms stddev 72.670 2024-05-08T06:00:16.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:00:15 smithi134 ceph-mon[34132]: pgmap v747: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.4 MiB/s wr, 654 op/s 2024-05-08T06:00:16.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:00:15 smithi151 ceph-mon[34815]: pgmap v747: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.4 MiB/s wr, 654 op/s 2024-05-08T06:00:16.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:00:15 smithi082 ceph-mon[30098]: pgmap v747: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.4 MiB/s wr, 654 op/s 2024-05-08T06:00:18.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:00:17 smithi134 ceph-mon[34132]: pgmap v748: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.1 MiB/s wr, 742 op/s 2024-05-08T06:00:18.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:00:17 smithi151 ceph-mon[34815]: pgmap v748: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.1 MiB/s wr, 742 op/s 2024-05-08T06:00:18.464 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:00:17 smithi082 ceph-mon[30098]: pgmap v748: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.1 MiB/s wr, 742 op/s 2024-05-08T06:00:20.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:00:19 smithi134 ceph-mon[34132]: pgmap v749: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.7 MiB/s wr, 601 op/s 2024-05-08T06:00:20.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 570.0 s, 1845.0 tps, lat 54.260 ms stddev 64.437 2024-05-08T06:00:20.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:00:19 smithi151 ceph-mon[34815]: pgmap v749: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.7 MiB/s wr, 601 op/s 2024-05-08T06:00:20.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:00:19 smithi082 ceph-mon[30098]: pgmap v749: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.7 MiB/s wr, 601 op/s 2024-05-08T06:00:22.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:00:21 smithi134 ceph-mon[34132]: pgmap v750: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 MiB/s wr, 711 op/s 2024-05-08T06:00:22.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:00:21 smithi151 ceph-mon[34815]: pgmap v750: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 MiB/s wr, 711 op/s 2024-05-08T06:00:22.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:00:21 smithi082 ceph-mon[30098]: pgmap v750: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.5 MiB/s wr, 711 op/s 2024-05-08T06:00:24.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:00:23 smithi134 ceph-mon[34132]: pgmap v751: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.5 MiB/s wr, 582 op/s 2024-05-08T06:00:24.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:00:23 smithi151 ceph-mon[34815]: pgmap v751: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.5 MiB/s wr, 582 op/s 2024-05-08T06:00:24.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:00:23 smithi082 ceph-mon[30098]: pgmap v751: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.5 MiB/s wr, 582 op/s 2024-05-08T06:00:25.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 575.0 s, 1507.2 tps, lat 66.276 ms stddev 78.357 2024-05-08T06:00:26.205 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-08T06:00:26.287 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:00:26 smithi082 ceph-mon[30098]: pgmap v752: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 5.5 MiB/s wr, 601 op/s 2024-05-08T06:00:26.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:00:26 smithi151 ceph-mon[34815]: pgmap v752: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 5.5 MiB/s wr, 601 op/s 2024-05-08T06:00:26.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:00:26 smithi134 ceph-mon[34132]: pgmap v752: 97 pgs: 97 active+clean; 1.6 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 5.5 MiB/s wr, 601 op/s 2024-05-08T06:00:26.818 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:00:28.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:00:28 smithi082 ceph-mon[30098]: pgmap v753: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 MiB/s wr, 699 op/s 2024-05-08T06:00:28.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:00:28 smithi151 ceph-mon[34815]: pgmap v753: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 MiB/s wr, 699 op/s 2024-05-08T06:00:28.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:00:28 smithi134 ceph-mon[34132]: pgmap v753: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.6 MiB/s wr, 699 op/s 2024-05-08T06:00:29.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.113+0000 7fbe7ce00700 1 -- 172.21.15.82:0/1250172580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe78104100 msgr2=0x7fbe78108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:29.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.113+0000 7fbe7ce00700 1 --2- 172.21.15.82:0/1250172580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe78104100 0x7fbe78108120 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fbe640099c0 tx=0x7fbe64009cd0 comp rx=0 tx=0).stop 2024-05-08T06:00:29.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.113+0000 7fbe7ce00700 1 -- 172.21.15.82:0/1250172580 shutdown_connections 2024-05-08T06:00:29.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.113+0000 7fbe7ce00700 1 --2- 172.21.15.82:0/1250172580 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe78108850 0x7fbe781103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:29.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.113+0000 7fbe7ce00700 1 --2- 172.21.15.82:0/1250172580 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe78103750 0x7fbe78103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:29.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.113+0000 7fbe7ce00700 1 --2- 172.21.15.82:0/1250172580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe78104100 0x7fbe78108120 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:29.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.113+0000 7fbe7ce00700 1 -- 172.21.15.82:0/1250172580 >> 172.21.15.82:0/1250172580 conn(0x7fbe7807a600 msgr2=0x7fbe7807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:00:29.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.113+0000 7fbe7ce00700 1 -- 172.21.15.82:0/1250172580 shutdown_connections 2024-05-08T06:00:29.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.113+0000 7fbe7ce00700 1 -- 172.21.15.82:0/1250172580 wait complete. 2024-05-08T06:00:29.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.114+0000 7fbe7ce00700 1 Processor -- start 2024-05-08T06:00:29.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.114+0000 7fbe7ce00700 1 -- start start 2024-05-08T06:00:29.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.115+0000 7fbe7ce00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe78103750 0x7fbe7819f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:29.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.115+0000 7fbe7ce00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe78104100 0x7fbe7819fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:29.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.115+0000 7fbe7ce00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe78108850 0x7fbe78199960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:29.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.115+0000 7fbe7ce00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbe78113660 con 0x7fbe78104100 2024-05-08T06:00:29.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.115+0000 7fbe7ce00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbe781134e0 con 0x7fbe78103750 2024-05-08T06:00:29.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.115+0000 7fbe7ce00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fbe781137e0 con 0x7fbe78108850 2024-05-08T06:00:29.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.115+0000 7fbe76800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe78108850 0x7fbe78199960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:29.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.115+0000 7fbe76800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe78108850 0x7fbe78199960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:37210/0 (socket says 172.21.15.82:37210) 2024-05-08T06:00:29.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.115+0000 7fbe76800700 1 -- 172.21.15.82:0/1286525916 learned_addr learned my addr 172.21.15.82:0/1286525916 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:00:29.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.115+0000 7fbe75400700 1 --2- 172.21.15.82:0/1286525916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe78104100 0x7fbe7819fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:29.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.115+0000 7fbe75e00700 1 --2- 172.21.15.82:0/1286525916 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe78103750 0x7fbe7819f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:29.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.117+0000 7fbe75e00700 1 -- 172.21.15.82:0/1286525916 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe78108850 msgr2=0x7fbe78199960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:29.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.117+0000 7fbe75e00700 1 --2- 172.21.15.82:0/1286525916 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe78108850 0x7fbe78199960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:29.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.117+0000 7fbe75e00700 1 -- 172.21.15.82:0/1286525916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe78104100 msgr2=0x7fbe7819fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:29.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.117+0000 7fbe75e00700 1 --2- 172.21.15.82:0/1286525916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe78104100 0x7fbe7819fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:29.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.117+0000 7fbe75e00700 1 -- 172.21.15.82:0/1286525916 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe7819a0c0 con 0x7fbe78103750 2024-05-08T06:00:29.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.118+0000 7fbe76800700 1 --2- 172.21.15.82:0/1286525916 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe78108850 0x7fbe78199960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:00:29.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.118+0000 7fbe75400700 1 --2- 172.21.15.82:0/1286525916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe78104100 0x7fbe7819fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:00:29.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.118+0000 7fbe75e00700 1 --2- 172.21.15.82:0/1286525916 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe78103750 0x7fbe7819f750 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fbe6800e9f0 tx=0x7fbe6800ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:00:29.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.119+0000 7fbe6ea00700 1 -- 172.21.15.82:0/1286525916 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe6800c9c0 con 0x7fbe78103750 2024-05-08T06:00:29.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.119+0000 7fbe6ea00700 1 -- 172.21.15.82:0/1286525916 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe6800cb60 con 0x7fbe78103750 2024-05-08T06:00:29.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.119+0000 7fbe6ea00700 1 -- 172.21.15.82:0/1286525916 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe68018680 con 0x7fbe78103750 2024-05-08T06:00:29.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.119+0000 7fbe7ce00700 1 -- 172.21.15.82:0/1286525916 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe7819a3b0 con 0x7fbe78103750 2024-05-08T06:00:29.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.120+0000 7fbe7ce00700 1 -- 172.21.15.82:0/1286525916 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe781a6620 con 0x7fbe78103750 2024-05-08T06:00:29.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.123+0000 7fbe6ea00700 1 -- 172.21.15.82:0/1286525916 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fbe68010430 con 0x7fbe78103750 2024-05-08T06:00:29.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.124+0000 7fbe6ea00700 1 --2- 172.21.15.82:0/1286525916 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fbe5c0b29d0 0x7fbe5c0b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:29.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.124+0000 7fbe87824b80 1 Processor -- start 2024-05-08T06:00:29.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.125+0000 7fbe87824b80 1 -- start start 2024-05-08T06:00:29.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.125+0000 7fbe6ea00700 1 -- 172.21.15.82:0/1286525916 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fbe680e22e0 con 0x7fbe78103750 2024-05-08T06:00:29.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.125+0000 7fbe75400700 1 --2- 172.21.15.82:0/1286525916 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fbe5c0b29d0 0x7fbe5c0b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:29.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.125+0000 7fbe87824b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594310e1060 0x5594310e1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:29.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.125+0000 7fbe87824b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594310e1980 0x5594310e5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:29.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.125+0000 7fbe87824b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594310e59d0 0x5594310e5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:29.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.125+0000 7fbe87824b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x559431033a20 con 0x5594310e59d0 2024-05-08T06:00:29.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.125+0000 7fbe87824b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x559430fd1760 con 0x5594310e1060 2024-05-08T06:00:29.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.125+0000 7fbe87824b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55943102f9e0 con 0x5594310e1980 2024-05-08T06:00:29.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.125+0000 7fbe75e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594310e1060 0x5594310e1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:29.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.125+0000 7fbe75e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594310e1060 0x5594310e1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:60924/0 (socket says 172.21.15.82:60924) 2024-05-08T06:00:29.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.125+0000 7fbe75e00700 1 -- 172.21.15.82:0/3071146432 learned_addr learned my addr 172.21.15.82:0/3071146432 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:00:29.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.126+0000 7fbe75400700 1 --2- 172.21.15.82:0/3071146432 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594310e1980 0x5594310e5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:29.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.126+0000 7fbe76800700 1 --2- 172.21.15.82:0/3071146432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594310e59d0 0x5594310e5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:29.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.126+0000 7fbe75e00700 1 -- 172.21.15.82:0/3071146432 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594310e1980 msgr2=0x5594310e5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:00:29.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.126+0000 7fbe75e00700 1 --2- 172.21.15.82:0/3071146432 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594310e1980 0x5594310e5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:29.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.126+0000 7fbe75e00700 1 -- 172.21.15.82:0/3071146432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594310e59d0 msgr2=0x5594310e5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:00:29.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.126+0000 7fbe75e00700 1 --2- 172.21.15.82:0/3071146432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594310e59d0 0x5594310e5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:29.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.126+0000 7fbe75e00700 1 -- 172.21.15.82:0/3071146432 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559430f808d0 con 0x5594310e1060 2024-05-08T06:00:29.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.126+0000 7fbe75400700 1 --2- 172.21.15.82:0/1286525916 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fbe5c0b29d0 0x7fbe5c0b4e90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fbe78103070 tx=0x7fbe64009610 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:00:29.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.126+0000 7fbe75e00700 1 --2- 172.21.15.82:0/3071146432 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594310e1060 0x5594310e1440 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fbe680a9840 tx=0x7fbe680a9310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ddb157e9d564f1e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:00:29.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.127+0000 7fbe63400700 1 -- 172.21.15.82:0/3071146432 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe680a98b0 con 0x5594310e1060 2024-05-08T06:00:29.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.127+0000 7fbe63400700 1 -- 172.21.15.82:0/3071146432 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe680adc60 con 0x5594310e1060 2024-05-08T06:00:29.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.127+0000 7fbe63400700 1 -- 172.21.15.82:0/3071146432 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe680b24e0 con 0x5594310e1060 2024-05-08T06:00:29.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.128+0000 7fbe87824b80 1 -- 172.21.15.82:0/3071146432 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594310e1060 msgr2=0x5594310e1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:29.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.128+0000 7fbe87824b80 1 --2- 172.21.15.82:0/3071146432 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594310e1060 0x5594310e1440 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fbe680a9840 tx=0x7fbe680a9310 comp rx=0 tx=0).stop 2024-05-08T06:00:29.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.129+0000 7fbe87824b80 1 -- 172.21.15.82:0/3071146432 shutdown_connections 2024-05-08T06:00:29.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.129+0000 7fbe87824b80 1 --2- 172.21.15.82:0/3071146432 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594310e1060 0x5594310e1440 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:29.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.129+0000 7fbe87824b80 1 --2- 172.21.15.82:0/3071146432 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594310e59d0 0x5594310e5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:29.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.129+0000 7fbe87824b80 1 --2- 172.21.15.82:0/3071146432 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594310e1980 0x5594310e5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:29.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.129+0000 7fbe87824b80 1 -- 172.21.15.82:0/3071146432 >> 172.21.15.82:0/3071146432 conn(0x55943100fb60 msgr2=0x5594310db7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:00:29.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.129+0000 7fbe87824b80 1 -- 172.21.15.82:0/3071146432 shutdown_connections 2024-05-08T06:00:29.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.129+0000 7fbe87824b80 1 -- 172.21.15.82:0/3071146432 wait complete. 2024-05-08T06:00:29.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.130+0000 7fbe87824b80 1 -- start start 2024-05-08T06:00:29.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.130+0000 7fbe87824b80 1 Processor -- start 2024-05-08T06:00:29.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.131+0000 7fbe87824b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594310e1060 0x5594310ece00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:29.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.131+0000 7fbe87824b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594310e1980 0x5594310ea210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:29.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.131+0000 7fbe87824b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594310e59d0 0x5594310ea750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:29.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.131+0000 7fbe87824b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5594310edb80 con 0x5594310e1980 2024-05-08T06:00:29.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.131+0000 7fbe87824b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x559430f99b20 con 0x5594310e59d0 2024-05-08T06:00:29.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.131+0000 7fbe87824b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5594310edd00 con 0x5594310e1060 2024-05-08T06:00:29.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.131+0000 7fbe87824b80 10 client.0 _ll_register_callbacks cb 0x559430fdac70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:00:29.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.131+0000 7fbe75400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594310e1980 0x5594310ea210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:29.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.131+0000 7fbe75400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594310e1980 0x5594310ea210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:60476/0 (socket says 172.21.15.82:60476) 2024-05-08T06:00:29.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.131+0000 7fbe75400700 1 -- 172.21.15.82:0/4279227838 learned_addr learned my addr 172.21.15.82:0/4279227838 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:00:29.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.131+0000 7fbe76800700 1 --2- 172.21.15.82:0/4279227838 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594310e59d0 0x5594310ea750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:29.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.131+0000 7fbe75e00700 1 --2- 172.21.15.82:0/4279227838 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594310e1060 0x5594310ece00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:29.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.131+0000 7fbe76800700 1 -- 172.21.15.82:0/4279227838 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594310e1060 msgr2=0x5594310ece00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:00:29.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.131+0000 7fbe76800700 1 --2- 172.21.15.82:0/4279227838 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594310e1060 0x5594310ece00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:29.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.131+0000 7fbe76800700 1 -- 172.21.15.82:0/4279227838 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594310e1980 msgr2=0x5594310ea210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:00:29.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.131+0000 7fbe76800700 1 --2- 172.21.15.82:0/4279227838 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594310e1980 0x5594310ea210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:29.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.132+0000 7fbe76800700 1 -- 172.21.15.82:0/4279227838 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559430ff9420 con 0x5594310e59d0 2024-05-08T06:00:29.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.132+0000 7fbe75400700 1 --2- 172.21.15.82:0/4279227838 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594310e1980 0x5594310ea210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:00:29.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.132+0000 7fbe76800700 1 --2- 172.21.15.82:0/4279227838 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594310e59d0 0x5594310ea750 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fbe70007c10 tx=0x7fbe70007f20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4663e1b9f562bc91 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:00:29.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.132+0000 7fbe57e00700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T06:00:29.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.132+0000 7fbe57e00700 1 -- 172.21.15.82:0/4279227838 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe70013d40 con 0x5594310e59d0 2024-05-08T06:00:29.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.132+0000 7fbe57e00700 1 -- 172.21.15.82:0/4279227838 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fbe70003a00 con 0x5594310e59d0 2024-05-08T06:00:29.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.132+0000 7fbe87824b80 1 -- 172.21.15.82:0/4279227838 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe680adc60 con 0x5594310e59d0 2024-05-08T06:00:29.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.133+0000 7fbe57e00700 1 -- 172.21.15.82:0/4279227838 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fbe70003c40 con 0x5594310e59d0 2024-05-08T06:00:29.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.133+0000 7fbe87824b80 10 client.26240 fetch_fsmap learned FSMap version 31 2024-05-08T06:00:29.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.133+0000 7fbe87824b80 1 -- 172.21.15.82:0/4279227838 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5594310f8480 con 0x5594310e59d0 2024-05-08T06:00:29.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.133+0000 7fbe57e00700 1 -- 172.21.15.82:0/4279227838 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe680adc60 con 0x5594310e59d0 2024-05-08T06:00:29.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.133+0000 7fbe57e00700 1 -- 172.21.15.82:0/4279227838 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fbe7001d410 con 0x5594310e59d0 2024-05-08T06:00:29.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.133+0000 7fbe87824b80 10 client.26240 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:00:29.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.133+0000 7fbe87824b80 10 client.26240 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T06:00:29.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.133+0000 7fbe87824b80 20 client.26240 populate_metadata read hostname 'smithi082' 2024-05-08T06:00:29.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.133+0000 7fbe87824b80 1 --2- 172.21.15.82:0/4279227838 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5594310fab10 0x5594310fcf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:29.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.133+0000 7fbe87824b80 4 client.26240 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:00:29.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.133+0000 7fbe87824b80 1 -- 172.21.15.82:0/4279227838 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5594310ae0a0 con 0x5594310fab10 2024-05-08T06:00:29.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.133+0000 7fbe75e00700 1 --2- 172.21.15.82:0/4279227838 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5594310fab10 0x5594310fcf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:29.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.134+0000 7fbe57e00700 10 client.26240 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T06:00:29.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.134+0000 7fbe75e00700 1 --2- 172.21.15.82:0/4279227838 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5594310fab10 0x5594310fcf00 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b9506fcfba94324 server_cookie=86303240f3a81efa in_seq=0 out_seq=0 2024-05-08T06:00:29.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.135+0000 7fbe57e00700 1 -- 172.21.15.82:0/4279227838 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5594310ae0a0 con 0x5594310fab10 2024-05-08T06:00:29.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.135+0000 7fbe57e00700 10 client.26240 handle_command_reply: tid=0 2024-05-08T06:00:29.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.135+0000 7fbe87824b80 1 client.26240 shutdown 2024-05-08T06:00:29.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.135+0000 7fbe87824b80 1 -- 172.21.15.82:0/4279227838 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594310e59d0 msgr2=0x5594310ea750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:29.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.135+0000 7fbe87824b80 1 --2- 172.21.15.82:0/4279227838 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594310e59d0 0x5594310ea750 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fbe70007c10 tx=0x7fbe70007f20 comp rx=0 tx=0).stop 2024-05-08T06:00:29.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.136+0000 7fbe87824b80 1 -- 172.21.15.82:0/4279227838 shutdown_connections 2024-05-08T06:00:29.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.136+0000 7fbe87824b80 1 --2- 172.21.15.82:0/4279227838 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5594310fab10 0x5594310fcf00 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:29.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.136+0000 7fbe87824b80 1 --2- 172.21.15.82:0/4279227838 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594310e59d0 0x5594310ea750 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:29.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.136+0000 7fbe87824b80 1 --2- 172.21.15.82:0/4279227838 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594310e1060 0x5594310ece00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:29.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.136+0000 7fbe87824b80 1 --2- 172.21.15.82:0/4279227838 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594310e1980 0x5594310ea210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:29.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.136+0000 7fbe87824b80 1 -- 172.21.15.82:0/4279227838 >> 172.21.15.82:0/4279227838 conn(0x55943100fb60 msgr2=0x5594310db760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:00:29.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.136+0000 7fbe57e00700 0 client.26240 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T06:00:29.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.137+0000 7fbe87824b80 1 -- 172.21.15.82:0/4279227838 shutdown_connections 2024-05-08T06:00:29.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.137+0000 7fbe87824b80 1 -- 172.21.15.82:0/4279227838 wait complete. 2024-05-08T06:00:29.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.137+0000 7fbe87824b80 20 client.26240 trim_cache size 0 max 16384 2024-05-08T06:00:29.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.163+0000 7fbe87824b80 1 Processor -- start 2024-05-08T06:00:29.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.163+0000 7fbe87824b80 1 -- start start 2024-05-08T06:00:29.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.164+0000 7fbe87824b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55943100fb60 0x5594310e7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:29.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.164+0000 7fbe87824b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594310e1060 0x5594310f6c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:29.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.164+0000 7fbe87824b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594310e1980 0x5594310e0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:29.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.164+0000 7fbe87824b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbe781ab910 con 0x5594310e1980 2024-05-08T06:00:29.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.164+0000 7fbe87824b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbe781ad450 con 0x55943100fb60 2024-05-08T06:00:29.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.164+0000 7fbe87824b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fbe781abfe0 con 0x5594310e1060 2024-05-08T06:00:29.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.165+0000 7fbe75400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594310e1060 0x5594310f6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:29.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.165+0000 7fbe75e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55943100fb60 0x5594310e7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:29.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.165+0000 7fbe75400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594310e1060 0x5594310f6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:37236/0 (socket says 172.21.15.82:37236) 2024-05-08T06:00:29.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.165+0000 7fbe75400700 1 -- 172.21.15.82:0/404285908 learned_addr learned my addr 172.21.15.82:0/404285908 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:00:29.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.166+0000 7fbe76800700 1 --2- 172.21.15.82:0/404285908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594310e1980 0x5594310e0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:29.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.166+0000 7fbe75400700 1 -- 172.21.15.82:0/404285908 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55943100fb60 msgr2=0x5594310e7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:00:29.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.166+0000 7fbe75400700 1 --2- 172.21.15.82:0/404285908 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55943100fb60 0x5594310e7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:29.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.166+0000 7fbe75400700 1 -- 172.21.15.82:0/404285908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594310e1980 msgr2=0x5594310e0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:00:29.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.166+0000 7fbe75400700 1 --2- 172.21.15.82:0/404285908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594310e1980 0x5594310e0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:29.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.166+0000 7fbe75400700 1 -- 172.21.15.82:0/404285908 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594310d83f0 con 0x5594310e1060 2024-05-08T06:00:29.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.167+0000 7fbe75400700 1 --2- 172.21.15.82:0/404285908 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594310e1060 0x5594310f6c10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fbe64029040 tx=0x7fbe6402a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a79cb37d23279240 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:00:29.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.167+0000 7fbe62a00700 1 -- 172.21.15.82:0/404285908 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe64038070 con 0x5594310e1060 2024-05-08T06:00:29.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.168+0000 7fbe62a00700 1 -- 172.21.15.82:0/404285908 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe64033440 con 0x5594310e1060 2024-05-08T06:00:29.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.168+0000 7fbe62a00700 1 -- 172.21.15.82:0/404285908 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe640106b0 con 0x5594310e1060 2024-05-08T06:00:29.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.168+0000 7fbe87824b80 1 -- 172.21.15.82:0/404285908 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594310e1060 msgr2=0x5594310f6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:29.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.168+0000 7fbe87824b80 1 --2- 172.21.15.82:0/404285908 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594310e1060 0x5594310f6c10 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fbe64029040 tx=0x7fbe6402a000 comp rx=0 tx=0).stop 2024-05-08T06:00:29.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.168+0000 7fbe87824b80 1 -- 172.21.15.82:0/404285908 shutdown_connections 2024-05-08T06:00:29.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.168+0000 7fbe87824b80 1 --2- 172.21.15.82:0/404285908 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55943100fb60 0x5594310e7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:29.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.168+0000 7fbe87824b80 1 --2- 172.21.15.82:0/404285908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594310e1980 0x5594310e0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:29.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.168+0000 7fbe87824b80 1 --2- 172.21.15.82:0/404285908 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594310e1060 0x5594310f6c10 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:29.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.168+0000 7fbe87824b80 1 -- 172.21.15.82:0/404285908 >> 172.21.15.82:0/404285908 conn(0x5594310d6640 msgr2=0x5594310dfe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:00:29.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.169+0000 7fbe87824b80 1 -- 172.21.15.82:0/404285908 shutdown_connections 2024-05-08T06:00:29.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.169+0000 7fbe87824b80 1 -- 172.21.15.82:0/404285908 wait complete. 2024-05-08T06:00:29.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.169+0000 7fbe87824b80 1 -- start start 2024-05-08T06:00:29.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.169+0000 7fbe87824b80 1 Processor -- start 2024-05-08T06:00:29.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.170+0000 7fbe87824b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55943100fb60 0x5594310f2f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:29.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.170+0000 7fbe87824b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594310e1060 0x5594310f34d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:29.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.170+0000 7fbe87824b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594310e1980 0x55943115e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:29.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.170+0000 7fbe87824b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fbe781acd80 con 0x5594310e1980 2024-05-08T06:00:29.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.170+0000 7fbe87824b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbe781ac6b0 con 0x5594310e1060 2024-05-08T06:00:29.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.170+0000 7fbe87824b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fbe781a98b0 con 0x55943100fb60 2024-05-08T06:00:29.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.170+0000 7fbe87824b80 10 client.0 _ll_register_callbacks cb 0x559430fdac70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:00:29.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.170+0000 7fbe75e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55943100fb60 0x5594310f2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:29.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.170+0000 7fbe75e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55943100fb60 0x5594310f2f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:37238/0 (socket says 172.21.15.82:37238) 2024-05-08T06:00:29.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.170+0000 7fbe75e00700 1 -- 172.21.15.82:0/2185378671 learned_addr learned my addr 172.21.15.82:0/2185378671 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:00:29.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.170+0000 7fbe75400700 1 --2- 172.21.15.82:0/2185378671 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594310e1060 0x5594310f34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:29.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.170+0000 7fbe75e00700 1 -- 172.21.15.82:0/2185378671 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594310e1060 msgr2=0x5594310f34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:00:29.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.170+0000 7fbe76800700 1 --2- 172.21.15.82:0/2185378671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594310e1980 0x55943115e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:29.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.171+0000 7fbe75e00700 1 --2- 172.21.15.82:0/2185378671 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594310e1060 0x5594310f34d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:29.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.171+0000 7fbe75e00700 1 -- 172.21.15.82:0/2185378671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594310e1980 msgr2=0x55943115e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:00:29.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.171+0000 7fbe75e00700 1 --2- 172.21.15.82:0/2185378671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594310e1980 0x55943115e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:29.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.171+0000 7fbe75e00700 1 -- 172.21.15.82:0/2185378671 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594310dc610 con 0x55943100fb60 2024-05-08T06:00:29.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.171+0000 7fbe75400700 1 --2- 172.21.15.82:0/2185378671 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594310e1060 0x5594310f34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:00:29.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.171+0000 7fbe75e00700 1 --2- 172.21.15.82:0/2185378671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55943100fb60 0x5594310f2f90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbe680a6b20 tx=0x7fbe680aa120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=372f58a62e0d8f89 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:00:29.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.171+0000 7fbe57e00700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T06:00:29.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.171+0000 7fbe76800700 1 --2- 172.21.15.82:0/2185378671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594310e1980 0x55943115e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:00:29.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.171+0000 7fbe57e00700 1 -- 172.21.15.82:0/2185378671 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe680c2070 con 0x55943100fb60 2024-05-08T06:00:29.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.171+0000 7fbe57e00700 1 -- 172.21.15.82:0/2185378671 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fbe680aabe0 con 0x55943100fb60 2024-05-08T06:00:29.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.171+0000 7fbe87824b80 1 -- 172.21.15.82:0/2185378671 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe64033440 con 0x55943100fb60 2024-05-08T06:00:29.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.172+0000 7fbe57e00700 1 -- 172.21.15.82:0/2185378671 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fbe680aade0 con 0x55943100fb60 2024-05-08T06:00:29.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.172+0000 7fbe87824b80 10 client.26269 fetch_fsmap learned FSMap version 31 2024-05-08T06:00:29.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.172+0000 7fbe87824b80 1 -- 172.21.15.82:0/2185378671 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55943117f200 con 0x55943100fb60 2024-05-08T06:00:29.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.172+0000 7fbe57e00700 1 -- 172.21.15.82:0/2185378671 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fbe64033440 con 0x55943100fb60 2024-05-08T06:00:29.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.173+0000 7fbe57e00700 1 -- 172.21.15.82:0/2185378671 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fbe680cab60 con 0x55943100fb60 2024-05-08T06:00:29.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.173+0000 7fbe87824b80 10 client.26269 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:00:29.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.173+0000 7fbe87824b80 10 client.26269 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T06:00:29.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.173+0000 7fbe87824b80 20 client.26269 populate_metadata read hostname 'smithi082' 2024-05-08T06:00:29.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.173+0000 7fbe87824b80 1 --2- 172.21.15.82:0/2185378671 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5594310e59d0 0x5594311814a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:29.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.173+0000 7fbe87824b80 4 client.26269 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-08T06:00:29.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.173+0000 7fbe87824b80 1 -- 172.21.15.82:0/2185378671 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559431041400 con 0x5594310e59d0 2024-05-08T06:00:29.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.174+0000 7fbe75400700 1 --2- 172.21.15.82:0/2185378671 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5594310e59d0 0x5594311814a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:29.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.174+0000 7fbe75400700 1 --2- 172.21.15.82:0/2185378671 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5594310e59d0 0x5594311814a0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ae1b827467bcf25 server_cookie=a4fcd5db9287da60 in_seq=0 out_seq=0 2024-05-08T06:00:29.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.174+0000 7fbe57e00700 10 client.26269 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T06:00:29.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.175+0000 7fbe57e00700 1 -- 172.21.15.82:0/2185378671 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x559431041400 con 0x5594310e59d0 2024-05-08T06:00:29.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.175+0000 7fbe57e00700 10 client.26269 handle_command_reply: tid=0 2024-05-08T06:00:29.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.175+0000 7fbe87824b80 1 client.26269 shutdown 2024-05-08T06:00:29.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.175+0000 7fbe87824b80 1 -- 172.21.15.82:0/2185378671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55943100fb60 msgr2=0x5594310f2f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:29.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.175+0000 7fbe87824b80 1 --2- 172.21.15.82:0/2185378671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55943100fb60 0x5594310f2f90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbe680a6b20 tx=0x7fbe680aa120 comp rx=0 tx=0).stop 2024-05-08T06:00:29.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.175+0000 7fbe87824b80 1 -- 172.21.15.82:0/2185378671 shutdown_connections 2024-05-08T06:00:29.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.175+0000 7fbe87824b80 1 --2- 172.21.15.82:0/2185378671 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5594310e1980 0x55943115e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:29.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.175+0000 7fbe87824b80 1 --2- 172.21.15.82:0/2185378671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55943100fb60 0x5594310f2f90 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:29.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.175+0000 7fbe87824b80 1 --2- 172.21.15.82:0/2185378671 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5594310e59d0 0x5594311814a0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:29.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.176+0000 7fbe87824b80 1 --2- 172.21.15.82:0/2185378671 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5594310e1060 0x5594310f34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:29.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.176+0000 7fbe57e00700 0 client.26269 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T06:00:29.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.176+0000 7fbe87824b80 1 -- 172.21.15.82:0/2185378671 >> 172.21.15.82:0/2185378671 conn(0x5594310d6640 msgr2=0x5594310e0700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:00:29.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.176+0000 7fbe87824b80 1 -- 172.21.15.82:0/2185378671 shutdown_connections 2024-05-08T06:00:29.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.176+0000 7fbe87824b80 1 -- 172.21.15.82:0/2185378671 wait complete. 2024-05-08T06:00:29.178 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.176+0000 7fbe87824b80 20 client.26269 trim_cache size 0 max 16384 2024-05-08T06:00:29.178 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T06:00:29.178 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "no active scrubs running", 2024-05-08T06:00:29.178 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": {} 2024-05-08T06:00:29.178 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T06:00:29.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.177+0000 7fbe7ce00700 1 -- 172.21.15.82:0/1286525916 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fbe5c0b29d0 msgr2=0x7fbe5c0b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:29.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.177+0000 7fbe7ce00700 1 --2- 172.21.15.82:0/1286525916 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fbe5c0b29d0 0x7fbe5c0b4e90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fbe78103070 tx=0x7fbe64009610 comp rx=0 tx=0).stop 2024-05-08T06:00:29.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.177+0000 7fbe7ce00700 1 -- 172.21.15.82:0/1286525916 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe78103750 msgr2=0x7fbe7819f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:29.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.177+0000 7fbe7ce00700 1 --2- 172.21.15.82:0/1286525916 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe78103750 0x7fbe7819f750 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fbe6800e9f0 tx=0x7fbe6800ed00 comp rx=0 tx=0).stop 2024-05-08T06:00:29.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.178+0000 7fbe7ce00700 1 -- 172.21.15.82:0/1286525916 shutdown_connections 2024-05-08T06:00:29.179 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.178+0000 7fbe7ce00700 1 --2- 172.21.15.82:0/1286525916 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe78103750 0x7fbe7819f750 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:29.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.178+0000 7fbe7ce00700 1 --2- 172.21.15.82:0/1286525916 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fbe5c0b29d0 0x7fbe5c0b4e90 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:29.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.178+0000 7fbe7ce00700 1 --2- 172.21.15.82:0/1286525916 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe78108850 0x7fbe78199960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:29.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.178+0000 7fbe7ce00700 1 --2- 172.21.15.82:0/1286525916 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fbe78104100 0x7fbe7819fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:29.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.178+0000 7fbe7ce00700 1 -- 172.21.15.82:0/1286525916 >> 172.21.15.82:0/1286525916 conn(0x7fbe7807a600 msgr2=0x7fbe781017c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:00:29.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.178+0000 7fbe7ce00700 1 -- 172.21.15.82:0/1286525916 shutdown_connections 2024-05-08T06:00:29.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:29.178+0000 7fbe7ce00700 1 -- 172.21.15.82:0/1286525916 wait complete. 2024-05-08T06:00:30.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 580.0 s, 1322.4 tps, lat 74.751 ms stddev 98.934 2024-05-08T06:00:30.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:00:30 smithi151 ceph-mon[34815]: pgmap v754: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.8 MiB/s wr, 593 op/s 2024-05-08T06:00:30.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:00:30 smithi082 ceph-mon[30098]: pgmap v754: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.8 MiB/s wr, 593 op/s 2024-05-08T06:00:30.499 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:00:30 smithi134 ceph-mon[34132]: pgmap v754: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.8 MiB/s wr, 593 op/s 2024-05-08T06:00:30.737 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-08T06:00:30.738 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T06:00:31.339 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:00:32.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:00:32 smithi082 ceph-mon[30098]: pgmap v755: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 7.3 MiB/s wr, 724 op/s 2024-05-08T06:00:32.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:00:32 smithi151 ceph-mon[34815]: pgmap v755: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 7.3 MiB/s wr, 724 op/s 2024-05-08T06:00:32.499 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:00:32 smithi134 ceph-mon[34132]: pgmap v755: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 7.3 MiB/s wr, 724 op/s 2024-05-08T06:00:33.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:33.505+0000 7feea2000700 1 -- 172.21.15.82:0/1375793886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee9c106050 msgr2=0x7fee9c112560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:33.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:33.505+0000 7feea2000700 1 --2- 172.21.15.82:0/1375793886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee9c106050 0x7fee9c112560 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fee9400b0a0 tx=0x7fee9400b3b0 comp rx=0 tx=0).stop 2024-05-08T06:00:33.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:33.505+0000 7feea2000700 1 -- 172.21.15.82:0/1375793886 shutdown_connections 2024-05-08T06:00:33.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:33.505+0000 7feea2000700 1 --2- 172.21.15.82:0/1375793886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee9c106050 0x7fee9c112560 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:33.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:33.505+0000 7feea2000700 1 --2- 172.21.15.82:0/1375793886 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee9c10b690 0x7fee9c10ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:33.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:33.505+0000 7feea2000700 1 --2- 172.21.15.82:0/1375793886 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee9c105690 0x7fee9c105b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:33.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:33.505+0000 7feea2000700 1 -- 172.21.15.82:0/1375793886 >> 172.21.15.82:0/1375793886 conn(0x7fee9c101180 msgr2=0x7fee9c1035a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:00:33.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:33.506+0000 7feea2000700 1 -- 172.21.15.82:0/1375793886 shutdown_connections 2024-05-08T06:00:33.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:33.506+0000 7feea2000700 1 -- 172.21.15.82:0/1375793886 wait complete. 2024-05-08T06:00:33.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:33.508+0000 7feea2000700 1 Processor -- start 2024-05-08T06:00:33.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:33.508+0000 7feea2000700 1 -- start start 2024-05-08T06:00:33.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:33.508+0000 7feea2000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee9c105690 0x7fee9c19bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:33.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:33.508+0000 7feea2000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee9c106050 0x7fee9c19c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:33.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:33.508+0000 7feea2000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee9c10b690 0x7fee9c1a05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:33.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:33.508+0000 7feea2000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fee9c115920 con 0x7fee9c105690 2024-05-08T06:00:33.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:33.508+0000 7feea2000700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fee9c1157a0 con 0x7fee9c10b690 2024-05-08T06:00:33.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:33.508+0000 7feea2000700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fee9c115aa0 con 0x7fee9c106050 2024-05-08T06:00:33.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:33.508+0000 7fee9b400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee9c105690 0x7fee9c19bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:33.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:33.508+0000 7fee9aa00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee9c106050 0x7fee9c19c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:33.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:33.508+0000 7fee9be00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee9c10b690 0x7fee9c1a05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:33.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:33.508+0000 7fee9aa00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee9c106050 0x7fee9c19c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:35436/0 (socket says 172.21.15.82:35436) 2024-05-08T06:00:33.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:33.508+0000 7fee9aa00700 1 -- 172.21.15.82:0/4185303033 learned_addr learned my addr 172.21.15.82:0/4185303033 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:00:33.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:33.509+0000 7fee9be00700 1 -- 172.21.15.82:0/4185303033 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee9c106050 msgr2=0x7fee9c19c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:33.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:33.509+0000 7fee9be00700 1 --2- 172.21.15.82:0/4185303033 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee9c106050 0x7fee9c19c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:33.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:33.509+0000 7fee9be00700 1 -- 172.21.15.82:0/4185303033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee9c105690 msgr2=0x7fee9c19bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:33.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:33.509+0000 7fee9be00700 1 --2- 172.21.15.82:0/4185303033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee9c105690 0x7fee9c19bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:33.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:33.509+0000 7fee9be00700 1 -- 172.21.15.82:0/4185303033 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee9c1a0d30 con 0x7fee9c10b690 2024-05-08T06:00:33.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:33.509+0000 7fee9b400700 1 --2- 172.21.15.82:0/4185303033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee9c105690 0x7fee9c19bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:00:33.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:33.510+0000 7fee9be00700 1 --2- 172.21.15.82:0/4185303033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee9c10b690 0x7fee9c1a05f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fee9400b070 tx=0x7fee94004c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:00:33.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:33.511+0000 7fee93e00700 1 -- 172.21.15.82:0/4185303033 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee94021070 con 0x7fee9c10b690 2024-05-08T06:00:33.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:33.511+0000 7fee93e00700 1 -- 172.21.15.82:0/4185303033 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fee94007e30 con 0x7fee9c10b690 2024-05-08T06:00:33.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:33.511+0000 7fee93e00700 1 -- 172.21.15.82:0/4185303033 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee940045f0 con 0x7fee9c10b690 2024-05-08T06:00:33.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:33.512+0000 7feea2000700 1 -- 172.21.15.82:0/4185303033 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee9c1a0fc0 con 0x7fee9c10b690 2024-05-08T06:00:33.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:33.512+0000 7feea2000700 1 -- 172.21.15.82:0/4185303033 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee9c1a88a0 con 0x7fee9c10b690 2024-05-08T06:00:33.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:33.513+0000 7feea2000700 1 -- 172.21.15.82:0/4185303033 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee9c106dd0 con 0x7fee9c10b690 2024-05-08T06:00:33.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:33.515+0000 7fee93e00700 1 -- 172.21.15.82:0/4185303033 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fee94007980 con 0x7fee9c10b690 2024-05-08T06:00:33.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:33.518+0000 7fee93e00700 1 --2- 172.21.15.82:0/4185303033 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fee800b29d0 0x7fee800b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:33.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:33.518+0000 7fee93e00700 1 -- 172.21.15.82:0/4185303033 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fee940e2fa0 con 0x7fee9c10b690 2024-05-08T06:00:33.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:33.519+0000 7fee9b400700 1 --2- 172.21.15.82:0/4185303033 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fee800b29d0 0x7fee800b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:33.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:33.519+0000 7fee9b400700 1 --2- 172.21.15.82:0/4185303033 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fee800b29d0 0x7fee800b4e90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fee8c009fd0 tx=0x7fee8c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:00:33.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:33.521+0000 7fee93e00700 1 -- 172.21.15.82:0/4185303033 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fee940aad00 con 0x7fee9c10b690 2024-05-08T06:00:33.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:33.947+0000 7feea2000700 1 -- 172.21.15.82:0/4185303033 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fee9c10dc40 con 0x7fee9c10b690 2024-05-08T06:00:33.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:33.947+0000 7fee93e00700 1 -- 172.21.15.82:0/4185303033 <== mon.2 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11948 (secure 0 0 0) 0x7fee940aa600 con 0x7fee9c10b690 2024-05-08T06:00:33.949 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T06:00:33.949 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14364,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3876883250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3876883250},{"type":"v1","addr":"172.21.15.82:6835","nonce":3876883250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1965070586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1965070586},{"type":"v1","addr":"172.21.15.82:6837","nonce":1965070586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":31,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T05:45:57.654009+0000","modified":"2024-05-08T05:53:20.165672+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24505,"mds_2":24487,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14397":{"gid":14397,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/1890720973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1890720973},{"type":"v1","addr":"172.21.15.82:6839","nonce":1890720973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14409":{"gid":14409,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/2957083305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":2957083305},{"type":"v1","addr":"172.21.15.82:6841","nonce":2957083305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6833/3827691638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3827691638},{"type":"v1","addr":"172.21.15.134:6833","nonce":3827691638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6833/3625067797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3625067797},{"type":"v1","addr":"172.21.15.151:6833","nonce":3625067797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/4074163402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4074163402},{"type":"v1","addr":"172.21.15.134:6835","nonce":4074163402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.134:6837/2212411710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2212411710},{"type":"v1","addr":"172.21.15.134:6837","nonce":2212411710}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":17,"addr":"172.21.15.151:6835/2093655929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2093655929},{"type":"v1","addr":"172.21.15.151:6835","nonce":2093655929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6837/4192404464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":4192404464},{"type":"v1","addr":"172.21.15.151:6837","nonce":4192404464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":14,"addr":"172.21.15.151:6839/2963754236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":2963754236},{"type":"v1","addr":"172.21.15.151:6839","nonce":2963754236}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.134:6839/1145270893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1145270893},{"type":"v1","addr":"172.21.15.134:6839","nonce":1145270893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24505,24506,24487,24475,24467]},"id":1}]} 2024-05-08T06:00:33.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:33.957+0000 7feea2000700 1 -- 172.21.15.82:0/4185303033 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fee800b29d0 msgr2=0x7fee800b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:33.958 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:33.957+0000 7feea2000700 1 --2- 172.21.15.82:0/4185303033 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fee800b29d0 0x7fee800b4e90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fee8c009fd0 tx=0x7fee8c009260 comp rx=0 tx=0).stop 2024-05-08T06:00:33.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:33.957+0000 7feea2000700 1 -- 172.21.15.82:0/4185303033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee9c10b690 msgr2=0x7fee9c1a05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:33.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:33.957+0000 7feea2000700 1 --2- 172.21.15.82:0/4185303033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee9c10b690 0x7fee9c1a05f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fee9400b070 tx=0x7fee94004c80 comp rx=0 tx=0).stop 2024-05-08T06:00:33.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:33.958+0000 7feea2000700 1 -- 172.21.15.82:0/4185303033 shutdown_connections 2024-05-08T06:00:33.959 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:33.958+0000 7feea2000700 1 --2- 172.21.15.82:0/4185303033 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee9c10b690 0x7fee9c1a05f0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:33.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:33.958+0000 7feea2000700 1 --2- 172.21.15.82:0/4185303033 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fee800b29d0 0x7fee800b4e90 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:33.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:33.958+0000 7feea2000700 1 --2- 172.21.15.82:0/4185303033 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fee9c105690 0x7fee9c19bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:33.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:33.958+0000 7feea2000700 1 --2- 172.21.15.82:0/4185303033 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee9c106050 0x7fee9c19c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:33.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:33.958+0000 7feea2000700 1 -- 172.21.15.82:0/4185303033 >> 172.21.15.82:0/4185303033 conn(0x7fee9c101180 msgr2=0x7fee9c101760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:00:33.960 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:33.959+0000 7feea2000700 1 -- 172.21.15.82:0/4185303033 shutdown_connections 2024-05-08T06:00:33.961 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:33.960+0000 7feea2000700 1 -- 172.21.15.82:0/4185303033 wait complete. 2024-05-08T06:00:33.968 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 31 2024-05-08T06:00:34.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:00:34 smithi082 ceph-mon[30098]: pgmap v756: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.3 MiB/s wr, 606 op/s 2024-05-08T06:00:34.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:00:34 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/4185303033' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:00:34.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:00:34 smithi151 ceph-mon[34815]: pgmap v756: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.3 MiB/s wr, 606 op/s 2024-05-08T06:00:34.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:00:34 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/4185303033' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:00:34.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:00:34 smithi134 ceph-mon[34132]: pgmap v756: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.3 MiB/s wr, 606 op/s 2024-05-08T06:00:34.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:00:34 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/4185303033' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:00:34.817 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-05-08T06:00:35.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 585.0 s, 1385.2 tps, lat 72.559 ms stddev 84.631 2024-05-08T06:00:35.363 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:00:36.208 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:00:36 smithi082 ceph-mon[30098]: pgmap v757: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 6.0 MiB/s wr, 596 op/s 2024-05-08T06:00:36.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:00:36 smithi151 ceph-mon[34815]: pgmap v757: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 6.0 MiB/s wr, 596 op/s 2024-05-08T06:00:36.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:00:36 smithi134 ceph-mon[34132]: pgmap v757: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 6.0 MiB/s wr, 596 op/s 2024-05-08T06:00:38.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.093+0000 7fb7aea00700 1 -- 172.21.15.82:0/3280955797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7a8075ff0 msgr2=0x7fb7a8114190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:38.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.093+0000 7fb7aea00700 1 --2- 172.21.15.82:0/3280955797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7a8075ff0 0x7fb7a8114190 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb7900098f0 tx=0x7fb790009c00 comp rx=0 tx=0).stop 2024-05-08T06:00:38.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.094+0000 7fb7aea00700 1 -- 172.21.15.82:0/3280955797 shutdown_connections 2024-05-08T06:00:38.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.094+0000 7fb7aea00700 1 --2- 172.21.15.82:0/3280955797 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7a81146d0 0x7fb7a8116ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:38.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.094+0000 7fb7aea00700 1 --2- 172.21.15.82:0/3280955797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7a80756d0 0x7fb7a8075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:38.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.094+0000 7fb7aea00700 1 --2- 172.21.15.82:0/3280955797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7a8075ff0 0x7fb7a8114190 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:38.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.094+0000 7fb7aea00700 1 -- 172.21.15.82:0/3280955797 >> 172.21.15.82:0/3280955797 conn(0x7fb7a807a600 msgr2=0x7fb7a807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:00:38.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.095+0000 7fb7aea00700 1 -- 172.21.15.82:0/3280955797 shutdown_connections 2024-05-08T06:00:38.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.095+0000 7fb7aea00700 1 -- 172.21.15.82:0/3280955797 wait complete. 2024-05-08T06:00:38.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.098+0000 7fb7aea00700 1 Processor -- start 2024-05-08T06:00:38.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.099+0000 7fb7aea00700 1 -- start start 2024-05-08T06:00:38.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.102+0000 7fb7aea00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7a80756d0 0x7fb7a81a0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:38.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.102+0000 7fb7aea00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7a8075ff0 0x7fb7a81a0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:38.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.102+0000 7fb7aea00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7a81146d0 0x7fb7a81a4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:38.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.102+0000 7fb7aea00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a8119da0 con 0x7fb7a8075ff0 2024-05-08T06:00:38.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.102+0000 7fb7aea00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a8119c20 con 0x7fb7a81146d0 2024-05-08T06:00:38.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.102+0000 7fb7aea00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a8119f20 con 0x7fb7a80756d0 2024-05-08T06:00:38.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.102+0000 7fb7aca00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7a81146d0 0x7fb7a81a4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:38.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.102+0000 7fb7aca00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7a81146d0 0x7fb7a81a4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:35854/0 (socket says 172.21.15.82:35854) 2024-05-08T06:00:38.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.102+0000 7fb7aca00700 1 -- 172.21.15.82:0/3675331311 learned_addr learned my addr 172.21.15.82:0/3675331311 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:00:38.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.102+0000 7fb7a7e00700 1 --2- 172.21.15.82:0/3675331311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7a80756d0 0x7fb7a81a0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:38.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.103+0000 7fb7aca00700 1 -- 172.21.15.82:0/3675331311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7a80756d0 msgr2=0x7fb7a81a0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:38.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.103+0000 7fb7aca00700 1 --2- 172.21.15.82:0/3675331311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7a80756d0 0x7fb7a81a0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:38.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.103+0000 7fb7aca00700 1 -- 172.21.15.82:0/3675331311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7a8075ff0 msgr2=0x7fb7a81a0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:38.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.103+0000 7fb7aca00700 1 --2- 172.21.15.82:0/3675331311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7a8075ff0 0x7fb7a81a0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:38.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.103+0000 7fb7aca00700 1 -- 172.21.15.82:0/3675331311 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7a81a5240 con 0x7fb7a81146d0 2024-05-08T06:00:38.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.103+0000 7fb7aca00700 1 --2- 172.21.15.82:0/3675331311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7a81146d0 0x7fb7a81a4b00 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb7a000d750 tx=0x7fb7a000db10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:00:38.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.104+0000 7fb7a5600700 1 -- 172.21.15.82:0/3675331311 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7a0016070 con 0x7fb7a81146d0 2024-05-08T06:00:38.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.104+0000 7fb7a5600700 1 -- 172.21.15.82:0/3675331311 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb7a0005020 con 0x7fb7a81146d0 2024-05-08T06:00:38.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.104+0000 7fb7aea00700 1 -- 172.21.15.82:0/3675331311 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7a81a5530 con 0x7fb7a81146d0 2024-05-08T06:00:38.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.104+0000 7fb7a5600700 1 -- 172.21.15.82:0/3675331311 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7a0009a30 con 0x7fb7a81146d0 2024-05-08T06:00:38.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.104+0000 7fb7aea00700 1 -- 172.21.15.82:0/3675331311 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7a81acdb0 con 0x7fb7a81146d0 2024-05-08T06:00:38.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.114+0000 7fb7a5600700 1 -- 172.21.15.82:0/3675331311 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fb7a00051d0 con 0x7fb7a81146d0 2024-05-08T06:00:38.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.118+0000 7fb7a5600700 1 --2- 172.21.15.82:0/3675331311 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb78c0b2940 0x7fb78c0b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:38.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.119+0000 7fb7a5600700 1 -- 172.21.15.82:0/3675331311 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb7a00e1d30 con 0x7fb7a81146d0 2024-05-08T06:00:38.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.119+0000 7fb7a7e00700 1 --2- 172.21.15.82:0/3675331311 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb78c0b2940 0x7fb78c0b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:38.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.121+0000 7fb7a7e00700 1 --2- 172.21.15.82:0/3675331311 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb78c0b2940 0x7fb78c0b4e00 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb798009f20 tx=0x7fb7980094f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:00:38.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.122+0000 7fb7b92f0b80 1 Processor -- start 2024-05-08T06:00:38.123 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:00:38 smithi082 ceph-mon[30098]: pgmap v758: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 6.2 MiB/s wr, 647 op/s 2024-05-08T06:00:38.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.122+0000 7fb7b92f0b80 1 -- start start 2024-05-08T06:00:38.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.123+0000 7fb7b92f0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646b05dd060 0x5646b05dd440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:38.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.123+0000 7fb7b92f0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646b05dd980 0x5646b05e1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:38.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.123+0000 7fb7b92f0b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5646b05e19d0 0x5646b05e1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:38.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.123+0000 7fb79f400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646b05dd980 0x5646b05e1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:38.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.123+0000 7fb79f400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646b05dd980 0x5646b05e1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:35482/0 (socket says 172.21.15.82:35482) 2024-05-08T06:00:38.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.124+0000 7fb7a7e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646b05dd060 0x5646b05dd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:38.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.124+0000 7fb7b92f0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5646b052fa20 con 0x5646b05dd060 2024-05-08T06:00:38.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.124+0000 7fb7b92f0b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5646b04cd760 con 0x5646b05e19d0 2024-05-08T06:00:38.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.124+0000 7fb7b92f0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5646b052b9e0 con 0x5646b05dd980 2024-05-08T06:00:38.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.124+0000 7fb79f400700 1 -- 172.21.15.82:0/1012950640 learned_addr learned my addr 172.21.15.82:0/1012950640 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:00:38.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.125+0000 7fb7aca00700 1 --2- 172.21.15.82:0/1012950640 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5646b05e19d0 0x5646b05e1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:38.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.125+0000 7fb79f400700 1 -- 172.21.15.82:0/1012950640 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5646b05e19d0 msgr2=0x5646b05e1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:00:38.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.125+0000 7fb79f400700 1 --2- 172.21.15.82:0/1012950640 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5646b05e19d0 0x5646b05e1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:38.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.125+0000 7fb79f400700 1 -- 172.21.15.82:0/1012950640 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646b05dd060 msgr2=0x5646b05dd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:00:38.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.125+0000 7fb79f400700 1 --2- 172.21.15.82:0/1012950640 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646b05dd060 0x5646b05dd440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:38.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.125+0000 7fb79f400700 1 -- 172.21.15.82:0/1012950640 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646b047c8d0 con 0x5646b05dd980 2024-05-08T06:00:38.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.125+0000 7fb7aca00700 1 --2- 172.21.15.82:0/1012950640 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5646b05e19d0 0x5646b05e1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:00:38.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.125+0000 7fb79f400700 1 --2- 172.21.15.82:0/1012950640 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646b05dd980 0x5646b05e1490 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb790009810 tx=0x7fb790009400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b5c21a7cddb72c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:00:38.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.126+0000 7fb79d600700 1 -- 172.21.15.82:0/1012950640 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb790005070 con 0x5646b05dd980 2024-05-08T06:00:38.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.126+0000 7fb79d600700 1 -- 172.21.15.82:0/1012950640 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb790003680 con 0x5646b05dd980 2024-05-08T06:00:38.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.126+0000 7fb79d600700 1 -- 172.21.15.82:0/1012950640 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb79000b870 con 0x5646b05dd980 2024-05-08T06:00:38.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.127+0000 7fb7b92f0b80 1 -- 172.21.15.82:0/1012950640 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646b05dd980 msgr2=0x5646b05e1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:38.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.127+0000 7fb7b92f0b80 1 --2- 172.21.15.82:0/1012950640 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646b05dd980 0x5646b05e1490 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb790009810 tx=0x7fb790009400 comp rx=0 tx=0).stop 2024-05-08T06:00:38.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.127+0000 7fb7b92f0b80 1 -- 172.21.15.82:0/1012950640 shutdown_connections 2024-05-08T06:00:38.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.127+0000 7fb7b92f0b80 1 --2- 172.21.15.82:0/1012950640 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5646b05e19d0 0x5646b05e1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:38.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.127+0000 7fb7b92f0b80 1 --2- 172.21.15.82:0/1012950640 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646b05dd060 0x5646b05dd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:38.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.127+0000 7fb7b92f0b80 1 --2- 172.21.15.82:0/1012950640 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646b05dd980 0x5646b05e1490 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:38.128 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.127+0000 7fb7b92f0b80 1 -- 172.21.15.82:0/1012950640 >> 172.21.15.82:0/1012950640 conn(0x5646b050bb60 msgr2=0x5646b05d77a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:00:38.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.128+0000 7fb7b92f0b80 1 -- 172.21.15.82:0/1012950640 shutdown_connections 2024-05-08T06:00:38.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.128+0000 7fb7b92f0b80 1 -- 172.21.15.82:0/1012950640 wait complete. 2024-05-08T06:00:38.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.129+0000 7fb7b92f0b80 1 -- start start 2024-05-08T06:00:38.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.129+0000 7fb7b92f0b80 1 Processor -- start 2024-05-08T06:00:38.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.130+0000 7fb7b92f0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646b05dd060 0x5646b05e8e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:38.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.130+0000 7fb7b92f0b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5646b05dd980 0x5646b05e61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:38.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.130+0000 7fb7b92f0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646b05e19d0 0x5646b05e6720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:38.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.130+0000 7fb7b92f0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5646b05e9b80 con 0x5646b05dd060 2024-05-08T06:00:38.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.130+0000 7fb7b92f0b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5646b0495b20 con 0x5646b05dd980 2024-05-08T06:00:38.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.130+0000 7fb7b92f0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5646b05e9d00 con 0x5646b05e19d0 2024-05-08T06:00:38.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.130+0000 7fb7b92f0b80 10 client.0 _ll_register_callbacks cb 0x5646b04d6c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:00:38.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.130+0000 7fb79f400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5646b05dd980 0x5646b05e61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:38.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.131+0000 7fb79f400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5646b05dd980 0x5646b05e61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:35874/0 (socket says 172.21.15.82:35874) 2024-05-08T06:00:38.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.131+0000 7fb79f400700 1 -- 172.21.15.82:0/2563353465 learned_addr learned my addr 172.21.15.82:0/2563353465 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:00:38.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.131+0000 7fb7aca00700 1 --2- 172.21.15.82:0/2563353465 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646b05e19d0 0x5646b05e6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:38.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.131+0000 7fb7a7e00700 1 --2- 172.21.15.82:0/2563353465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646b05dd060 0x5646b05e8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:38.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.131+0000 7fb7aca00700 1 -- 172.21.15.82:0/2563353465 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5646b05dd980 msgr2=0x5646b05e61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:00:38.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.131+0000 7fb7aca00700 1 --2- 172.21.15.82:0/2563353465 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5646b05dd980 0x5646b05e61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:38.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.131+0000 7fb7aca00700 1 -- 172.21.15.82:0/2563353465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646b05dd060 msgr2=0x5646b05e8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:00:38.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.131+0000 7fb7aca00700 1 --2- 172.21.15.82:0/2563353465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646b05dd060 0x5646b05e8e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:38.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.131+0000 7fb7aca00700 1 -- 172.21.15.82:0/2563353465 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646b04f5420 con 0x5646b05e19d0 2024-05-08T06:00:38.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.132+0000 7fb7aca00700 1 --2- 172.21.15.82:0/2563353465 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646b05e19d0 0x5646b05e6720 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb7a00df890 tx=0x7fb7a00a8f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ea83739b0e46eee server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:00:38.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.132+0000 7fb796000700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T06:00:38.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.132+0000 7fb796000700 1 -- 172.21.15.82:0/2563353465 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7a001f040 con 0x5646b05e19d0 2024-05-08T06:00:38.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.132+0000 7fb796000700 1 -- 172.21.15.82:0/2563353465 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb7a00a97d0 con 0x5646b05e19d0 2024-05-08T06:00:38.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.132+0000 7fb7b92f0b80 1 -- 172.21.15.82:0/2563353465 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb790003680 con 0x5646b05e19d0 2024-05-08T06:00:38.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.133+0000 7fb796000700 1 -- 172.21.15.82:0/2563353465 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fb7a00ad710 con 0x5646b05e19d0 2024-05-08T06:00:38.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.133+0000 7fb7b92f0b80 10 client.26287 fetch_fsmap learned FSMap version 31 2024-05-08T06:00:38.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.133+0000 7fb7b92f0b80 1 -- 172.21.15.82:0/2563353465 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5646b05f4400 con 0x5646b05e19d0 2024-05-08T06:00:38.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.133+0000 7fb796000700 1 -- 172.21.15.82:0/2563353465 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb790003680 con 0x5646b05e19d0 2024-05-08T06:00:38.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.133+0000 7fb796000700 1 -- 172.21.15.82:0/2563353465 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fb7a00a4cd0 con 0x5646b05e19d0 2024-05-08T06:00:38.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.133+0000 7fb7b92f0b80 10 client.26287 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:00:38.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.133+0000 7fb7b92f0b80 10 client.26287 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-05-08T06:00:38.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.134+0000 7fb7b92f0b80 20 client.26287 populate_metadata read hostname 'smithi082' 2024-05-08T06:00:38.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.134+0000 7fb7b92f0b80 1 --2- 172.21.15.82:0/2563353465 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x5646b05f6a40 0x5646b05f8e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:38.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.134+0000 7fb7b92f0b80 4 client.26287 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:00:38.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.134+0000 7fb7b92f0b80 1 -- 172.21.15.82:0/2563353465 --> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5646b05aa0a0 con 0x5646b05f6a40 2024-05-08T06:00:38.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.134+0000 7fb7a7e00700 1 --2- 172.21.15.82:0/2563353465 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x5646b05f6a40 0x5646b05f8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:38.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.135+0000 7fb7a7e00700 1 --2- 172.21.15.82:0/2563353465 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x5646b05f6a40 0x5646b05f8e30 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a4785b76219a8801 server_cookie=14db354b33a3615f in_seq=0 out_seq=0 2024-05-08T06:00:38.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.135+0000 7fb796000700 10 client.26287 ms_handle_connect on v2:172.21.15.134:6836/2212411710 2024-05-08T06:00:38.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.136+0000 7fb796000700 1 -- 172.21.15.82:0/2563353465 <== mds.4 v2:172.21.15.134:6836/2212411710 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5646b05aa0a0 con 0x5646b05f6a40 2024-05-08T06:00:38.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.136+0000 7fb796000700 10 client.26287 handle_command_reply: tid=0 2024-05-08T06:00:38.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.136+0000 7fb7b92f0b80 1 client.26287 shutdown 2024-05-08T06:00:38.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.136+0000 7fb7b92f0b80 1 -- 172.21.15.82:0/2563353465 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646b05e19d0 msgr2=0x5646b05e6720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:38.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.136+0000 7fb7b92f0b80 1 --2- 172.21.15.82:0/2563353465 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646b05e19d0 0x5646b05e6720 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb7a00df890 tx=0x7fb7a00a8f60 comp rx=0 tx=0).stop 2024-05-08T06:00:38.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.137+0000 7fb7b92f0b80 1 -- 172.21.15.82:0/2563353465 shutdown_connections 2024-05-08T06:00:38.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.137+0000 7fb7b92f0b80 1 --2- 172.21.15.82:0/2563353465 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x5646b05f6a40 0x5646b05f8e30 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:38.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.137+0000 7fb7b92f0b80 1 --2- 172.21.15.82:0/2563353465 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646b05e19d0 0x5646b05e6720 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:38.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.137+0000 7fb7b92f0b80 1 --2- 172.21.15.82:0/2563353465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646b05dd060 0x5646b05e8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:38.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.137+0000 7fb7b92f0b80 1 --2- 172.21.15.82:0/2563353465 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5646b05dd980 0x5646b05e61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:38.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.137+0000 7fb7b92f0b80 1 -- 172.21.15.82:0/2563353465 >> 172.21.15.82:0/2563353465 conn(0x5646b050bb60 msgr2=0x5646b05d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:00:38.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.137+0000 7fb796000700 0 client.26287 ms_handle_reset on v2:172.21.15.134:6836/2212411710 2024-05-08T06:00:38.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.137+0000 7fb7b92f0b80 1 -- 172.21.15.82:0/2563353465 shutdown_connections 2024-05-08T06:00:38.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.137+0000 7fb7b92f0b80 1 -- 172.21.15.82:0/2563353465 wait complete. 2024-05-08T06:00:38.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.138+0000 7fb7b92f0b80 20 client.26287 trim_cache size 0 max 16384 2024-05-08T06:00:38.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.160+0000 7fb7b92f0b80 1 Processor -- start 2024-05-08T06:00:38.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.161+0000 7fb7b92f0b80 1 -- start start 2024-05-08T06:00:38.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.161+0000 7fb7b92f0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646b05dd060 0x5646b05e3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:38.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.161+0000 7fb7b92f0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646b05dd980 0x5646b05dbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:38.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.161+0000 7fb7b92f0b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5646b05e19d0 0x5646b05dc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:38.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.161+0000 7fb7b92f0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a81b4180 con 0x5646b05dd060 2024-05-08T06:00:38.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.161+0000 7fb7b92f0b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a81b5cc0 con 0x5646b05e19d0 2024-05-08T06:00:38.162 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.161+0000 7fb7b92f0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a81b4850 con 0x5646b05dd980 2024-05-08T06:00:38.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.161+0000 7fb7aca00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5646b05e19d0 0x5646b05dc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:38.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.161+0000 7fb7aca00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5646b05e19d0 0x5646b05dc3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:35882/0 (socket says 172.21.15.82:35882) 2024-05-08T06:00:38.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.161+0000 7fb7aca00700 1 -- 172.21.15.82:0/595559400 learned_addr learned my addr 172.21.15.82:0/595559400 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:00:38.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.161+0000 7fb7a7e00700 1 --2- 172.21.15.82:0/595559400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646b05dd060 0x5646b05e3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:38.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.161+0000 7fb79f400700 1 --2- 172.21.15.82:0/595559400 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646b05dd980 0x5646b05dbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:38.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.162+0000 7fb7aca00700 1 -- 172.21.15.82:0/595559400 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646b05dd980 msgr2=0x5646b05dbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:00:38.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.162+0000 7fb7aca00700 1 --2- 172.21.15.82:0/595559400 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646b05dd980 0x5646b05dbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:38.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.162+0000 7fb7aca00700 1 -- 172.21.15.82:0/595559400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646b05dd060 msgr2=0x5646b05e3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:00:38.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.162+0000 7fb7aca00700 1 --2- 172.21.15.82:0/595559400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646b05dd060 0x5646b05e3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:38.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.162+0000 7fb7aca00700 1 -- 172.21.15.82:0/595559400 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646b05e91b0 con 0x5646b05e19d0 2024-05-08T06:00:38.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.162+0000 7fb7aca00700 1 --2- 172.21.15.82:0/595559400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5646b05e19d0 0x5646b05dc3b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb7a00a9060 tx=0x7fb7a00a94e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6f21673237b1545 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:00:38.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.162+0000 7fb79cc00700 1 -- 172.21.15.82:0/595559400 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7a001f070 con 0x5646b05e19d0 2024-05-08T06:00:38.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.162+0000 7fb79cc00700 1 -- 172.21.15.82:0/595559400 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb7a00ca330 con 0x5646b05e19d0 2024-05-08T06:00:38.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.162+0000 7fb79cc00700 1 -- 172.21.15.82:0/595559400 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7a00b1d30 con 0x5646b05e19d0 2024-05-08T06:00:38.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.163+0000 7fb7b92f0b80 1 -- 172.21.15.82:0/595559400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5646b05e19d0 msgr2=0x5646b05dc3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:38.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.163+0000 7fb7b92f0b80 1 --2- 172.21.15.82:0/595559400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5646b05e19d0 0x5646b05dc3b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fb7a00a9060 tx=0x7fb7a00a94e0 comp rx=0 tx=0).stop 2024-05-08T06:00:38.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.164+0000 7fb7b92f0b80 1 -- 172.21.15.82:0/595559400 shutdown_connections 2024-05-08T06:00:38.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.164+0000 7fb7b92f0b80 1 --2- 172.21.15.82:0/595559400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5646b05e19d0 0x5646b05dc3b0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:38.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.164+0000 7fb7b92f0b80 1 --2- 172.21.15.82:0/595559400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646b05dd060 0x5646b05e3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:38.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.164+0000 7fb7b92f0b80 1 --2- 172.21.15.82:0/595559400 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646b05dd980 0x5646b05dbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:38.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.164+0000 7fb7b92f0b80 1 -- 172.21.15.82:0/595559400 >> 172.21.15.82:0/595559400 conn(0x5646b050bb60 msgr2=0x5646b05d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:00:38.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.164+0000 7fb7b92f0b80 1 -- 172.21.15.82:0/595559400 shutdown_connections 2024-05-08T06:00:38.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.164+0000 7fb7b92f0b80 1 -- 172.21.15.82:0/595559400 wait complete. 2024-05-08T06:00:38.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.165+0000 7fb7b92f0b80 1 -- start start 2024-05-08T06:00:38.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.165+0000 7fb7b92f0b80 1 Processor -- start 2024-05-08T06:00:38.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.166+0000 7fb7b92f0b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5646b05dd060 0x5646b05ef5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:38.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.166+0000 7fb7b92f0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646b05dd980 0x5646b05fdc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:38.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.166+0000 7fb7b92f0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646b05e19d0 0x5646b05fe230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:38.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.166+0000 7fb7b92f0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a81b55f0 con 0x5646b05e19d0 2024-05-08T06:00:38.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.166+0000 7fb7b92f0b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a81b4f20 con 0x5646b05dd060 2024-05-08T06:00:38.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.166+0000 7fb7b92f0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a81b2120 con 0x5646b05dd980 2024-05-08T06:00:38.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.166+0000 7fb7b92f0b80 10 client.0 _ll_register_callbacks cb 0x5646b04d6c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:00:38.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.166+0000 7fb79f400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646b05dd980 0x5646b05fdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:38.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.166+0000 7fb7a7e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5646b05dd060 0x5646b05ef5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:38.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.166+0000 7fb7a7e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5646b05dd060 0x5646b05ef5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:35884/0 (socket says 172.21.15.82:35884) 2024-05-08T06:00:38.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.166+0000 7fb7a7e00700 1 -- 172.21.15.82:0/3222109140 learned_addr learned my addr 172.21.15.82:0/3222109140 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:00:38.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.166+0000 7fb79f400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646b05dd980 0x5646b05fdc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:35508/0 (socket says 172.21.15.82:35508) 2024-05-08T06:00:38.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.166+0000 7fb7aca00700 1 --2- 172.21.15.82:0/3222109140 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646b05e19d0 0x5646b05fe230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:38.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.166+0000 7fb7a7e00700 1 -- 172.21.15.82:0/3222109140 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646b05dd980 msgr2=0x5646b05fdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:00:38.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.166+0000 7fb7a7e00700 1 --2- 172.21.15.82:0/3222109140 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646b05dd980 0x5646b05fdc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:38.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.166+0000 7fb7a7e00700 1 -- 172.21.15.82:0/3222109140 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646b05e19d0 msgr2=0x5646b05fe230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:00:38.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.166+0000 7fb7a7e00700 1 --2- 172.21.15.82:0/3222109140 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646b05e19d0 0x5646b05fe230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:38.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.166+0000 7fb7a7e00700 1 -- 172.21.15.82:0/3222109140 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646b05fea70 con 0x5646b05dd060 2024-05-08T06:00:38.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.166+0000 7fb7aca00700 1 --2- 172.21.15.82:0/3222109140 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646b05e19d0 0x5646b05fe230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:00:38.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.167+0000 7fb7a7e00700 1 --2- 172.21.15.82:0/3222109140 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5646b05dd060 0x5646b05ef5e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb798009d00 tx=0x7fb798011000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4d2ad9573bd6a91 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:00:38.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.167+0000 7fb796000700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T06:00:38.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.167+0000 7fb796000700 1 -- 172.21.15.82:0/3222109140 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb798038060 con 0x5646b05dd060 2024-05-08T06:00:38.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.167+0000 7fb7b92f0b80 1 -- 172.21.15.82:0/3222109140 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb7a00ca330 con 0x5646b05dd060 2024-05-08T06:00:38.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.167+0000 7fb796000700 1 -- 172.21.15.82:0/3222109140 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb798017490 con 0x5646b05dd060 2024-05-08T06:00:38.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.167+0000 7fb796000700 1 -- 172.21.15.82:0/3222109140 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fb798017690 con 0x5646b05dd060 2024-05-08T06:00:38.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.167+0000 7fb7b92f0b80 10 client.26264 fetch_fsmap learned FSMap version 31 2024-05-08T06:00:38.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.167+0000 7fb7b92f0b80 1 -- 172.21.15.82:0/3222109140 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5646b0661380 con 0x5646b05dd060 2024-05-08T06:00:38.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.168+0000 7fb796000700 1 -- 172.21.15.82:0/3222109140 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb7a00ca330 con 0x5646b05dd060 2024-05-08T06:00:38.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.168+0000 7fb796000700 1 -- 172.21.15.82:0/3222109140 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fb798032030 con 0x5646b05dd060 2024-05-08T06:00:38.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.168+0000 7fb7b92f0b80 10 client.26264 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:00:38.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.168+0000 7fb7b92f0b80 10 client.26264 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-05-08T06:00:38.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.168+0000 7fb7b92f0b80 20 client.26264 populate_metadata read hostname 'smithi082' 2024-05-08T06:00:38.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.168+0000 7fb7b92f0b80 1 --2- 172.21.15.82:0/3222109140 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x5646b0661ac0 0x5646b0663ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:38.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.168+0000 7fb7b92f0b80 4 client.26264 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T06:00:38.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.168+0000 7fb7b92f0b80 1 -- 172.21.15.82:0/3222109140 --> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5646b053d400 con 0x5646b0661ac0 2024-05-08T06:00:38.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.169+0000 7fb79f400700 1 --2- 172.21.15.82:0/3222109140 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x5646b0661ac0 0x5646b0663ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:38.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.170+0000 7fb79f400700 1 --2- 172.21.15.82:0/3222109140 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x5646b0661ac0 0x5646b0663ee0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=517aa6f150e3307c server_cookie=9eb592f04aaff95c in_seq=0 out_seq=0 2024-05-08T06:00:38.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.170+0000 7fb796000700 10 client.26264 ms_handle_connect on v2:172.21.15.134:6836/2212411710 2024-05-08T06:00:38.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.170+0000 7fb796000700 1 -- 172.21.15.82:0/3222109140 <== mds.4 v2:172.21.15.134:6836/2212411710 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5646b053d400 con 0x5646b0661ac0 2024-05-08T06:00:38.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.170+0000 7fb796000700 10 client.26264 handle_command_reply: tid=0 2024-05-08T06:00:38.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.170+0000 7fb7b92f0b80 1 client.26264 shutdown 2024-05-08T06:00:38.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.171+0000 7fb7b92f0b80 1 -- 172.21.15.82:0/3222109140 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5646b05dd060 msgr2=0x5646b05ef5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:38.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.171+0000 7fb7b92f0b80 1 --2- 172.21.15.82:0/3222109140 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5646b05dd060 0x5646b05ef5e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb798009d00 tx=0x7fb798011000 comp rx=0 tx=0).stop 2024-05-08T06:00:38.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.172+0000 7fb7b92f0b80 1 -- 172.21.15.82:0/3222109140 shutdown_connections 2024-05-08T06:00:38.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.172+0000 7fb7b92f0b80 1 --2- 172.21.15.82:0/3222109140 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x5646b0661ac0 0x5646b0663ee0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:38.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.172+0000 7fb7b92f0b80 1 --2- 172.21.15.82:0/3222109140 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5646b05dd060 0x5646b05ef5e0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:38.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.172+0000 7fb7b92f0b80 1 --2- 172.21.15.82:0/3222109140 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5646b05e19d0 0x5646b05fe230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:38.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.172+0000 7fb7b92f0b80 1 --2- 172.21.15.82:0/3222109140 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5646b05dd980 0x5646b05fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:38.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.172+0000 7fb7b92f0b80 1 -- 172.21.15.82:0/3222109140 >> 172.21.15.82:0/3222109140 conn(0x5646b050bb60 msgr2=0x5646b05e49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:00:38.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.172+0000 7fb796000700 0 client.26264 ms_handle_reset on v2:172.21.15.134:6836/2212411710 2024-05-08T06:00:38.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.172+0000 7fb7b92f0b80 1 -- 172.21.15.82:0/3222109140 shutdown_connections 2024-05-08T06:00:38.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.173+0000 7fb7b92f0b80 1 -- 172.21.15.82:0/3222109140 wait complete. 2024-05-08T06:00:38.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.173+0000 7fb7b92f0b80 20 client.26264 trim_cache size 0 max 16384 2024-05-08T06:00:38.175 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T06:00:38.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.175+0000 7fb7aea00700 1 -- 172.21.15.82:0/3675331311 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb78c0b2940 msgr2=0x7fb78c0b4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:38.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.175+0000 7fb7aea00700 1 --2- 172.21.15.82:0/3675331311 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb78c0b2940 0x7fb78c0b4e00 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb798009f20 tx=0x7fb7980094f0 comp rx=0 tx=0).stop 2024-05-08T06:00:38.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.175+0000 7fb7aea00700 1 -- 172.21.15.82:0/3675331311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7a81146d0 msgr2=0x7fb7a81a4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:38.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.175+0000 7fb7aea00700 1 --2- 172.21.15.82:0/3675331311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7a81146d0 0x7fb7a81a4b00 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fb7a000d750 tx=0x7fb7a000db10 comp rx=0 tx=0).stop 2024-05-08T06:00:38.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.175+0000 7fb7aea00700 1 -- 172.21.15.82:0/3675331311 shutdown_connections 2024-05-08T06:00:38.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.175+0000 7fb7aea00700 1 --2- 172.21.15.82:0/3675331311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7a81146d0 0x7fb7a81a4b00 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:38.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.175+0000 7fb7aea00700 1 --2- 172.21.15.82:0/3675331311 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb78c0b2940 0x7fb78c0b4e00 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:38.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.175+0000 7fb7aea00700 1 --2- 172.21.15.82:0/3675331311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7a80756d0 0x7fb7a81a0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:38.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.175+0000 7fb7aea00700 1 --2- 172.21.15.82:0/3675331311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb7a8075ff0 0x7fb7a81a0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:38.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.175+0000 7fb7aea00700 1 -- 172.21.15.82:0/3675331311 >> 172.21.15.82:0/3675331311 conn(0x7fb7a807a600 msgr2=0x7fb7a8113490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:00:38.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.176+0000 7fb7aea00700 1 -- 172.21.15.82:0/3675331311 shutdown_connections 2024-05-08T06:00:38.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:38.176+0000 7fb7aea00700 1 -- 172.21.15.82:0/3675331311 wait complete. 2024-05-08T06:00:38.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:00:38 smithi134 ceph-mon[34132]: pgmap v758: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 6.2 MiB/s wr, 647 op/s 2024-05-08T06:00:38.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:00:38 smithi151 ceph-mon[34815]: pgmap v758: 97 pgs: 97 active+clean; 1.6 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 6.2 MiB/s wr, 647 op/s 2024-05-08T06:00:39.164 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-05-08T06:00:39.824 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:00:40.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 590.0 s, 1979.8 tps, lat 51.050 ms stddev 64.635 2024-05-08T06:00:40.345 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:00:40 smithi082 ceph-mon[30098]: pgmap v759: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.7 MiB/s wr, 569 op/s 2024-05-08T06:00:40.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:00:40 smithi151 ceph-mon[34815]: pgmap v759: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.7 MiB/s wr, 569 op/s 2024-05-08T06:00:40.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:00:40 smithi134 ceph-mon[34132]: pgmap v759: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.7 MiB/s wr, 569 op/s 2024-05-08T06:00:42.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.049+0000 7f3f25400700 1 -- 172.21.15.82:0/925684453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f20108460 msgr2=0x7f3f20108840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:42.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.049+0000 7f3f25400700 1 --2- 172.21.15.82:0/925684453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f20108460 0x7f3f20108840 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c009990 tx=0x7f3f0c009ca0 comp rx=0 tx=0).stop 2024-05-08T06:00:42.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.049+0000 7f3f25400700 1 -- 172.21.15.82:0/925684453 shutdown_connections 2024-05-08T06:00:42.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.049+0000 7f3f25400700 1 --2- 172.21.15.82:0/925684453 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f20103ef0 0x7f3f201103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:42.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.049+0000 7f3f25400700 1 --2- 172.21.15.82:0/925684453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f20108460 0x7f3f20108840 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:42.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.049+0000 7f3f25400700 1 --2- 172.21.15.82:0/925684453 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f20103550 0x7f3f201039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:42.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.049+0000 7f3f25400700 1 -- 172.21.15.82:0/925684453 >> 172.21.15.82:0/925684453 conn(0x7f3f2007a600 msgr2=0x7f3f2007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:00:42.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.050+0000 7f3f25400700 1 -- 172.21.15.82:0/925684453 shutdown_connections 2024-05-08T06:00:42.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.051+0000 7f3f25400700 1 -- 172.21.15.82:0/925684453 wait complete. 2024-05-08T06:00:42.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.052+0000 7f3f25400700 1 Processor -- start 2024-05-08T06:00:42.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.052+0000 7f3f25400700 1 -- start start 2024-05-08T06:00:42.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.054+0000 7f3f25400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f20103550 0x7f3f200749c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:42.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.054+0000 7f3f25400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f20103ef0 0x7f3f20074f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:42.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.054+0000 7f3f25400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f20108460 0x7f3f2006da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:42.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.055+0000 7f3f1e800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f20103550 0x7f3f200749c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:42.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.055+0000 7f3f1f200700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f20108460 0x7f3f2006da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:42.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.055+0000 7f3f1f200700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f20108460 0x7f3f2006da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:35534/0 (socket says 172.21.15.82:35534) 2024-05-08T06:00:42.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.055+0000 7f3f1f200700 1 -- 172.21.15.82:0/1153475540 learned_addr learned my addr 172.21.15.82:0/1153475540 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:00:42.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.055+0000 7f3f1de00700 1 --2- 172.21.15.82:0/1153475540 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f20103ef0 0x7f3f20074f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:42.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.056+0000 7f3f25400700 1 -- 172.21.15.82:0/1153475540 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3f20113750 con 0x7f3f20103550 2024-05-08T06:00:42.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.056+0000 7f3f25400700 1 -- 172.21.15.82:0/1153475540 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3f201135d0 con 0x7f3f20103ef0 2024-05-08T06:00:42.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.056+0000 7f3f25400700 1 -- 172.21.15.82:0/1153475540 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3f201138d0 con 0x7f3f20108460 2024-05-08T06:00:42.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.057+0000 7f3f1f200700 1 -- 172.21.15.82:0/1153475540 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f20103ef0 msgr2=0x7f3f20074f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:42.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.057+0000 7f3f1f200700 1 --2- 172.21.15.82:0/1153475540 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f20103ef0 0x7f3f20074f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:42.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.057+0000 7f3f1f200700 1 -- 172.21.15.82:0/1153475540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f20103550 msgr2=0x7f3f200749c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:42.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.057+0000 7f3f1f200700 1 --2- 172.21.15.82:0/1153475540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f20103550 0x7f3f200749c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:42.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.057+0000 7f3f1f200700 1 -- 172.21.15.82:0/1153475540 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f2006e2c0 con 0x7f3f20108460 2024-05-08T06:00:42.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.057+0000 7f3f1e800700 1 --2- 172.21.15.82:0/1153475540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f20103550 0x7f3f200749c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:00:42.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.057+0000 7f3f1f200700 1 --2- 172.21.15.82:0/1153475540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f20108460 0x7f3f2006da50 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3f1800b9e0 tx=0x7f3f1800bcf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:00:42.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.057+0000 7f3f1de00700 1 --2- 172.21.15.82:0/1153475540 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f20103ef0 0x7f3f20074f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:00:42.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.057+0000 7f3f17400700 1 -- 172.21.15.82:0/1153475540 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f1800d8e0 con 0x7f3f20108460 2024-05-08T06:00:42.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.057+0000 7f3f25400700 1 -- 172.21.15.82:0/1153475540 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f2006e5b0 con 0x7f3f20108460 2024-05-08T06:00:42.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.058+0000 7f3f25400700 1 -- 172.21.15.82:0/1153475540 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f200726c0 con 0x7f3f20108460 2024-05-08T06:00:42.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.058+0000 7f3f17400700 1 -- 172.21.15.82:0/1153475540 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f18015420 con 0x7f3f20108460 2024-05-08T06:00:42.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.058+0000 7f3f17400700 1 -- 172.21.15.82:0/1153475540 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f18014630 con 0x7f3f20108460 2024-05-08T06:00:42.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.066+0000 7f3f17400700 1 -- 172.21.15.82:0/1153475540 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f3f180147d0 con 0x7f3f20108460 2024-05-08T06:00:42.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.066+0000 7f3f2fdc5b80 1 Processor -- start 2024-05-08T06:00:42.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.067+0000 7f3f2fdc5b80 1 -- start start 2024-05-08T06:00:42.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.068+0000 7f3f2fdc5b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d73ad28060 0x55d73ad28440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:42.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.068+0000 7f3f2fdc5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d73ad28980 0x55d73ad2c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:42.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.069+0000 7f3f1de00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d73ad28060 0x55d73ad28440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:42.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.068+0000 7f3f2fdc5b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d73ad2c9d0 0x55d73ad2ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:42.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.069+0000 7f3f2fdc5b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d73ac7aa20 con 0x55d73ad28060 2024-05-08T06:00:42.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.069+0000 7f3f2fdc5b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d73ac18760 con 0x55d73ad2c9d0 2024-05-08T06:00:42.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.069+0000 7f3f2fdc5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55d73ac769e0 con 0x55d73ad28980 2024-05-08T06:00:42.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.069+0000 7f3f1e800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d73ad28980 0x55d73ad2c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:42.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.069+0000 7f3f1e800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d73ad28980 0x55d73ad2c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:35542/0 (socket says 172.21.15.82:35542) 2024-05-08T06:00:42.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.069+0000 7f3f1e800700 1 -- 172.21.15.82:0/4194161117 learned_addr learned my addr 172.21.15.82:0/4194161117 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:00:42.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.069+0000 7f3f17400700 1 --2- 172.21.15.82:0/1153475540 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3f040b2980 0x7f3f040b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:42.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.070+0000 7f3f17400700 1 -- 172.21.15.82:0/1153475540 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f3f180e1a80 con 0x7f3f20108460 2024-05-08T06:00:42.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.070+0000 7f3f1de00700 1 --2- 172.21.15.82:0/4194161117 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d73ad2c9d0 0x55d73ad2ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:42.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.071+0000 7f3f1e800700 1 -- 172.21.15.82:0/4194161117 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d73ad2c9d0 msgr2=0x55d73ad2ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:00:42.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.071+0000 7f3f1e800700 1 --2- 172.21.15.82:0/4194161117 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d73ad2c9d0 0x55d73ad2ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:42.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.071+0000 7f3f1e800700 1 -- 172.21.15.82:0/4194161117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d73ad28060 msgr2=0x55d73ad28440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:00:42.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.071+0000 7f3f1e800700 1 --2- 172.21.15.82:0/4194161117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d73ad28060 0x55d73ad28440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:42.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.071+0000 7f3f1f200700 1 --2- 172.21.15.82:0/1153475540 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3f040b2980 0x7f3f040b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:42.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.071+0000 7f3f1e800700 1 -- 172.21.15.82:0/4194161117 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d73abc78d0 con 0x55d73ad28980 2024-05-08T06:00:42.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.072+0000 7f3f1f200700 1 --2- 172.21.15.82:0/1153475540 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3f040b2980 0x7f3f040b4e40 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3f1800dfd0 tx=0x7f3f18004ad0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:00:42.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.072+0000 7f3f1e800700 1 --2- 172.21.15.82:0/4194161117 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d73ad28980 0x55d73ad2c490 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c015000 tx=0x7f3f0c005da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55f2c2f491f0d6ef server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:00:42.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.072+0000 7f3f0be00700 1 -- 172.21.15.82:0/4194161117 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f0c005520 con 0x55d73ad28980 2024-05-08T06:00:42.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.072+0000 7f3f0be00700 1 -- 172.21.15.82:0/4194161117 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f0c02d070 con 0x55d73ad28980 2024-05-08T06:00:42.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.073+0000 7f3f2fdc5b80 1 -- 172.21.15.82:0/4194161117 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d73ad28980 msgr2=0x55d73ad2c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:42.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.073+0000 7f3f0be00700 1 -- 172.21.15.82:0/4194161117 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f0c005520 con 0x55d73ad28980 2024-05-08T06:00:42.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.073+0000 7f3f2fdc5b80 1 --2- 172.21.15.82:0/4194161117 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d73ad28980 0x55d73ad2c490 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c015000 tx=0x7f3f0c005da0 comp rx=0 tx=0).stop 2024-05-08T06:00:42.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.074+0000 7f3f2fdc5b80 1 -- 172.21.15.82:0/4194161117 shutdown_connections 2024-05-08T06:00:42.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.074+0000 7f3f2fdc5b80 1 --2- 172.21.15.82:0/4194161117 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d73ad2c9d0 0x55d73ad2ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:42.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.074+0000 7f3f2fdc5b80 1 --2- 172.21.15.82:0/4194161117 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d73ad28060 0x55d73ad28440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:42.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.074+0000 7f3f2fdc5b80 1 --2- 172.21.15.82:0/4194161117 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d73ad28980 0x55d73ad2c490 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:42.075 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.074+0000 7f3f2fdc5b80 1 -- 172.21.15.82:0/4194161117 >> 172.21.15.82:0/4194161117 conn(0x55d73ac56b60 msgr2=0x55d73ad227a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:00:42.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.075+0000 7f3f2fdc5b80 1 -- 172.21.15.82:0/4194161117 shutdown_connections 2024-05-08T06:00:42.076 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.075+0000 7f3f2fdc5b80 1 -- 172.21.15.82:0/4194161117 wait complete. 2024-05-08T06:00:42.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.076+0000 7f3f2fdc5b80 1 -- start start 2024-05-08T06:00:42.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.077+0000 7f3f2fdc5b80 1 Processor -- start 2024-05-08T06:00:42.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.077+0000 7f3f2fdc5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d73ad28060 0x55d73ad33d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:42.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.077+0000 7f3f2fdc5b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d73ad28980 0x55d73ad310c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:42.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.077+0000 7f3f2fdc5b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d73ad2c9d0 0x55d73ad31600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:42.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.077+0000 7f3f2fdc5b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d73ad34bd0 con 0x55d73ad2c9d0 2024-05-08T06:00:42.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.077+0000 7f3f2fdc5b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d73abe0b20 con 0x55d73ad28980 2024-05-08T06:00:42.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.077+0000 7f3f2fdc5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55d73ad34d50 con 0x55d73ad28060 2024-05-08T06:00:42.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.077+0000 7f3f2fdc5b80 10 client.0 _ll_register_callbacks cb 0x55d73ac21c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:00:42.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.078+0000 7f3f1e800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d73ad28980 0x55d73ad310c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:42.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.078+0000 7f3f1e800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d73ad28980 0x55d73ad310c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:35914/0 (socket says 172.21.15.82:35914) 2024-05-08T06:00:42.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.078+0000 7f3f1e800700 1 -- 172.21.15.82:0/1749309311 learned_addr learned my addr 172.21.15.82:0/1749309311 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:00:42.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.078+0000 7f3f1e800700 1 -- 172.21.15.82:0/1749309311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d73ad28060 msgr2=0x55d73ad33d20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T06:00:42.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.078+0000 7f3f1e800700 1 --2- 172.21.15.82:0/1749309311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d73ad28060 0x55d73ad33d20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:42.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.078+0000 7f3f1e800700 1 -- 172.21.15.82:0/1749309311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d73ad2c9d0 msgr2=0x55d73ad31600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T06:00:42.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.078+0000 7f3f1e800700 1 --2- 172.21.15.82:0/1749309311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d73ad2c9d0 0x55d73ad31600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:42.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.079+0000 7f3f1e800700 1 -- 172.21.15.82:0/1749309311 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d73ac40420 con 0x55d73ad28980 2024-05-08T06:00:42.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.079+0000 7f3f1e800700 1 --2- 172.21.15.82:0/1749309311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d73ad28980 0x55d73ad310c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c005550 tx=0x7f3f0c00bfd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa46ee7b248df50f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:00:42.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.079+0000 7f3f08c00700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T06:00:42.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.079+0000 7f3f08c00700 1 -- 172.21.15.82:0/1749309311 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f0c035020 con 0x55d73ad28980 2024-05-08T06:00:42.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.079+0000 7f3f08c00700 1 -- 172.21.15.82:0/1749309311 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f3f0c028d50 con 0x55d73ad28980 2024-05-08T06:00:42.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.079+0000 7f3f2fdc5b80 1 -- 172.21.15.82:0/1749309311 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f0c02d070 con 0x55d73ad28980 2024-05-08T06:00:42.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.080+0000 7f3f08c00700 1 -- 172.21.15.82:0/1749309311 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f3f0c00b850 con 0x55d73ad28980 2024-05-08T06:00:42.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.080+0000 7f3f2fdc5b80 10 client.26273 fetch_fsmap learned FSMap version 31 2024-05-08T06:00:42.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.080+0000 7f3f2fdc5b80 1 -- 172.21.15.82:0/1749309311 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55d73ad3f3f0 con 0x55d73ad28980 2024-05-08T06:00:42.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.080+0000 7f3f08c00700 1 -- 172.21.15.82:0/1749309311 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f0c02d070 con 0x55d73ad28980 2024-05-08T06:00:42.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.081+0000 7f3f08c00700 1 -- 172.21.15.82:0/1749309311 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f3f0c00f830 con 0x55d73ad28980 2024-05-08T06:00:42.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.081+0000 7f3f2fdc5b80 10 client.26273 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:00:42.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.081+0000 7f3f2fdc5b80 10 client.26273 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-05-08T06:00:42.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.081+0000 7f3f2fdc5b80 20 client.26273 populate_metadata read hostname 'smithi082' 2024-05-08T06:00:42.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.081+0000 7f3f2fdc5b80 1 --2- 172.21.15.82:0/1749309311 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x55d73ad418c0 0x55d73ad43cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:42.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.081+0000 7f3f2fdc5b80 4 client.26273 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:00:42.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.081+0000 7f3f2fdc5b80 1 -- 172.21.15.82:0/1749309311 --> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d73acf50a0 con 0x55d73ad418c0 2024-05-08T06:00:42.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.082+0000 7f3f1de00700 1 --2- 172.21.15.82:0/1749309311 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x55d73ad418c0 0x55d73ad43cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:42.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.083+0000 7f3f1de00700 1 --2- 172.21.15.82:0/1749309311 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x55d73ad418c0 0x55d73ad43cb0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8e69427f07769355 server_cookie=ea8b4c1494363e25 in_seq=0 out_seq=0 2024-05-08T06:00:42.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.083+0000 7f3f08c00700 10 client.26273 ms_handle_connect on v2:172.21.15.151:6834/2093655929 2024-05-08T06:00:42.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.084+0000 7f3f08c00700 1 -- 172.21.15.82:0/1749309311 <== mds.3 v2:172.21.15.151:6834/2093655929 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55d73acf50a0 con 0x55d73ad418c0 2024-05-08T06:00:42.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.084+0000 7f3f08c00700 10 client.26273 handle_command_reply: tid=0 2024-05-08T06:00:42.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.084+0000 7f3f2fdc5b80 1 client.26273 shutdown 2024-05-08T06:00:42.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.085+0000 7f3f2fdc5b80 1 -- 172.21.15.82:0/1749309311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d73ad28980 msgr2=0x55d73ad310c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:42.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.085+0000 7f3f2fdc5b80 1 --2- 172.21.15.82:0/1749309311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d73ad28980 0x55d73ad310c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c005550 tx=0x7f3f0c00bfd0 comp rx=0 tx=0).stop 2024-05-08T06:00:42.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.085+0000 7f3f2fdc5b80 1 -- 172.21.15.82:0/1749309311 shutdown_connections 2024-05-08T06:00:42.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.085+0000 7f3f2fdc5b80 1 --2- 172.21.15.82:0/1749309311 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x55d73ad418c0 0x55d73ad43cb0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:42.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.085+0000 7f3f2fdc5b80 1 --2- 172.21.15.82:0/1749309311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d73ad2c9d0 0x55d73ad31600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:42.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.085+0000 7f3f2fdc5b80 1 --2- 172.21.15.82:0/1749309311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d73ad28060 0x55d73ad33d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:42.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.085+0000 7f3f2fdc5b80 1 --2- 172.21.15.82:0/1749309311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d73ad28980 0x55d73ad310c0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:42.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.085+0000 7f3f2fdc5b80 1 -- 172.21.15.82:0/1749309311 >> 172.21.15.82:0/1749309311 conn(0x55d73ac56b60 msgr2=0x55d73ad1d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:00:42.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.085+0000 7f3f08c00700 0 client.26273 ms_handle_reset on v2:172.21.15.151:6834/2093655929 2024-05-08T06:00:42.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.085+0000 7f3f2fdc5b80 1 -- 172.21.15.82:0/1749309311 shutdown_connections 2024-05-08T06:00:42.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.085+0000 7f3f2fdc5b80 1 -- 172.21.15.82:0/1749309311 wait complete. 2024-05-08T06:00:42.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.085+0000 7f3f2fdc5b80 20 client.26273 trim_cache size 0 max 16384 2024-05-08T06:00:42.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.106+0000 7f3f2fdc5b80 1 Processor -- start 2024-05-08T06:00:42.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.106+0000 7f3f2fdc5b80 1 -- start start 2024-05-08T06:00:42.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.106+0000 7f3f2fdc5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d73ad28060 0x55d73ad2d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:42.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.106+0000 7f3f2fdc5b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d73ad28980 0x55d73ad2da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:42.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.106+0000 7f3f2fdc5b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d73ad2c9d0 0x55d73ad2a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:42.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.106+0000 7f3f2fdc5b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3f0000d380 con 0x55d73ad28980 2024-05-08T06:00:42.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.106+0000 7f3f2fdc5b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3f0000eec0 con 0x55d73ad2c9d0 2024-05-08T06:00:42.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.106+0000 7f3f2fdc5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3f0000da50 con 0x55d73ad28060 2024-05-08T06:00:42.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.107+0000 7f3f1de00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d73ad28060 0x55d73ad2d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:42.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.107+0000 7f3f1e800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d73ad28980 0x55d73ad2da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:42.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.107+0000 7f3f1de00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d73ad28060 0x55d73ad2d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:35558/0 (socket says 172.21.15.82:35558) 2024-05-08T06:00:42.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.107+0000 7f3f1de00700 1 -- 172.21.15.82:0/478559763 learned_addr learned my addr 172.21.15.82:0/478559763 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:00:42.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.107+0000 7f3f1de00700 1 --2- 172.21.15.82:0/478559763 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d73ad2c9d0 0x55d73ad2a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:42.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.107+0000 7f3f1de00700 1 -- 172.21.15.82:0/478559763 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d73ad2c9d0 msgr2=0x55d73ad2a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:00:42.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.107+0000 7f3f1de00700 1 --2- 172.21.15.82:0/478559763 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d73ad2c9d0 0x55d73ad2a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:42.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.107+0000 7f3f1de00700 1 -- 172.21.15.82:0/478559763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d73ad28980 msgr2=0x55d73ad2da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:00:42.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.107+0000 7f3f1de00700 1 --2- 172.21.15.82:0/478559763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d73ad28980 0x55d73ad2da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:42.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.107+0000 7f3f1de00700 1 -- 172.21.15.82:0/478559763 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d73ad31910 con 0x55d73ad28060 2024-05-08T06:00:42.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.107+0000 7f3f1e800700 1 --2- 172.21.15.82:0/478559763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d73ad28980 0x55d73ad2da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:00:42.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.108+0000 7f3f1de00700 1 --2- 172.21.15.82:0/478559763 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d73ad28060 0x55d73ad2d540 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3f10004790 tx=0x7f3f1000a380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=365168ce5c2ab235 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:00:42.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.108+0000 7f3f0b400700 1 -- 172.21.15.82:0/478559763 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f1001f6e0 con 0x55d73ad28060 2024-05-08T06:00:42.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.108+0000 7f3f0b400700 1 -- 172.21.15.82:0/478559763 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f100044d0 con 0x55d73ad28060 2024-05-08T06:00:42.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.108+0000 7f3f0b400700 1 -- 172.21.15.82:0/478559763 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f10004d30 con 0x55d73ad28060 2024-05-08T06:00:42.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.109+0000 7f3f2fdc5b80 1 -- 172.21.15.82:0/478559763 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d73ad28060 msgr2=0x55d73ad2d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:42.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.109+0000 7f3f2fdc5b80 1 --2- 172.21.15.82:0/478559763 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d73ad28060 0x55d73ad2d540 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3f10004790 tx=0x7f3f1000a380 comp rx=0 tx=0).stop 2024-05-08T06:00:42.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.109+0000 7f3f2fdc5b80 1 -- 172.21.15.82:0/478559763 shutdown_connections 2024-05-08T06:00:42.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.109+0000 7f3f2fdc5b80 1 --2- 172.21.15.82:0/478559763 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d73ad2c9d0 0x55d73ad2a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:42.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.109+0000 7f3f2fdc5b80 1 --2- 172.21.15.82:0/478559763 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d73ad28060 0x55d73ad2d540 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:42.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.109+0000 7f3f2fdc5b80 1 --2- 172.21.15.82:0/478559763 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d73ad28980 0x55d73ad2da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:42.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.109+0000 7f3f2fdc5b80 1 -- 172.21.15.82:0/478559763 >> 172.21.15.82:0/478559763 conn(0x55d73ac56b60 msgr2=0x55d73ad2f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:00:42.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.109+0000 7f3f2fdc5b80 1 -- 172.21.15.82:0/478559763 shutdown_connections 2024-05-08T06:00:42.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.109+0000 7f3f2fdc5b80 1 -- 172.21.15.82:0/478559763 wait complete. 2024-05-08T06:00:42.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.110+0000 7f3f2fdc5b80 1 -- start start 2024-05-08T06:00:42.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.110+0000 7f3f2fdc5b80 1 Processor -- start 2024-05-08T06:00:42.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.112+0000 7f3f2fdc5b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d73ad28060 0x55d73ad470c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:42.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.112+0000 7f3f2fdc5b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d73ad28980 0x55d73ad29960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:42.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.112+0000 7f3f2fdc5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d73ad2c9d0 0x55d73ad29ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:42.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.112+0000 7f3f2fdc5b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3f0000e7f0 con 0x55d73ad28060 2024-05-08T06:00:42.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.112+0000 7f3f2fdc5b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3f0000e120 con 0x55d73ad28980 2024-05-08T06:00:42.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.112+0000 7f3f2fdc5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3f0000b320 con 0x55d73ad2c9d0 2024-05-08T06:00:42.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.113+0000 7f3f1e800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d73ad28980 0x55d73ad29960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:42.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.113+0000 7f3f1de00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d73ad2c9d0 0x55d73ad29ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:42.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.113+0000 7f3f1de00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d73ad2c9d0 0x55d73ad29ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:35560/0 (socket says 172.21.15.82:35560) 2024-05-08T06:00:42.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.113+0000 7f3f1de00700 1 -- 172.21.15.82:0/1663119637 learned_addr learned my addr 172.21.15.82:0/1663119637 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:00:42.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.113+0000 7f3f1de00700 1 --2- 172.21.15.82:0/1663119637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d73ad28060 0x55d73ad470c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:42.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.113+0000 7f3f2fdc5b80 10 client.0 _ll_register_callbacks cb 0x55d73ac21c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:00:42.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.113+0000 7f3f1e800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d73ad28980 0x55d73ad29960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:35932/0 (socket says 172.21.15.82:35932) 2024-05-08T06:00:42.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.114+0000 7f3f1de00700 1 -- 172.21.15.82:0/1663119637 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d73ad28980 msgr2=0x55d73ad29960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:00:42.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.114+0000 7f3f1de00700 1 --2- 172.21.15.82:0/1663119637 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d73ad28980 0x55d73ad29960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:42.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.114+0000 7f3f1de00700 1 -- 172.21.15.82:0/1663119637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d73ad28060 msgr2=0x55d73ad470c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:00:42.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.114+0000 7f3f1de00700 1 --2- 172.21.15.82:0/1663119637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d73ad28060 0x55d73ad470c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:42.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.114+0000 7f3f1de00700 1 -- 172.21.15.82:0/1663119637 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d73ad2a520 con 0x55d73ad2c9d0 2024-05-08T06:00:42.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.115+0000 7f3f1e800700 1 --2- 172.21.15.82:0/1663119637 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d73ad28980 0x55d73ad29960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:00:42.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.115+0000 7f3f1de00700 1 --2- 172.21.15.82:0/1663119637 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d73ad2c9d0 0x55d73ad29ea0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3f1000ad10 tx=0x7f3f1000a380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8068ebd14f026cac server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:00:42.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.116+0000 7f3f08c00700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T06:00:42.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.116+0000 7f3f08c00700 1 -- 172.21.15.82:0/1663119637 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f10004320 con 0x55d73ad2c9d0 2024-05-08T06:00:42.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.116+0000 7f3f08c00700 1 -- 172.21.15.82:0/1663119637 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f3f10003680 con 0x55d73ad2c9d0 2024-05-08T06:00:42.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.116+0000 7f3f2fdc5b80 1 -- 172.21.15.82:0/1663119637 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f100044d0 con 0x55d73ad2c9d0 2024-05-08T06:00:42.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.116+0000 7f3f08c00700 1 -- 172.21.15.82:0/1663119637 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f3f10003880 con 0x55d73ad2c9d0 2024-05-08T06:00:42.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.116+0000 7f3f2fdc5b80 10 client.26308 fetch_fsmap learned FSMap version 31 2024-05-08T06:00:42.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.116+0000 7f3f2fdc5b80 1 -- 172.21.15.82:0/1663119637 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55d73adabbd0 con 0x55d73ad2c9d0 2024-05-08T06:00:42.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.116+0000 7f3f08c00700 1 -- 172.21.15.82:0/1663119637 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3f100044d0 con 0x55d73ad2c9d0 2024-05-08T06:00:42.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.117+0000 7f3f08c00700 1 -- 172.21.15.82:0/1663119637 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f3f1002e870 con 0x55d73ad2c9d0 2024-05-08T06:00:42.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.117+0000 7f3f2fdc5b80 10 client.26308 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:00:42.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.117+0000 7f3f2fdc5b80 10 client.26308 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-05-08T06:00:42.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.117+0000 7f3f2fdc5b80 20 client.26308 populate_metadata read hostname 'smithi082' 2024-05-08T06:00:42.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.117+0000 7f3f2fdc5b80 1 --2- 172.21.15.82:0/1663119637 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x55d73adac1e0 0x55d73adae600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:42.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.117+0000 7f3f2fdc5b80 4 client.26308 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T06:00:42.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.117+0000 7f3f2fdc5b80 1 -- 172.21.15.82:0/1663119637 --> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d73ac88400 con 0x55d73adac1e0 2024-05-08T06:00:42.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.117+0000 7f3f1e800700 1 --2- 172.21.15.82:0/1663119637 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x55d73adac1e0 0x55d73adae600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:42.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.118+0000 7f3f1e800700 1 --2- 172.21.15.82:0/1663119637 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x55d73adac1e0 0x55d73adae600 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=cea265ce550d7da3 server_cookie=a41255324ee7ebf0 in_seq=0 out_seq=0 2024-05-08T06:00:42.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.118+0000 7f3f08c00700 10 client.26308 ms_handle_connect on v2:172.21.15.151:6834/2093655929 2024-05-08T06:00:42.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.118+0000 7f3f08c00700 1 -- 172.21.15.82:0/1663119637 <== mds.3 v2:172.21.15.151:6834/2093655929 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d73ac88400 con 0x55d73adac1e0 2024-05-08T06:00:42.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.118+0000 7f3f08c00700 10 client.26308 handle_command_reply: tid=0 2024-05-08T06:00:42.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.118+0000 7f3f2fdc5b80 1 client.26308 shutdown 2024-05-08T06:00:42.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.118+0000 7f3f2fdc5b80 1 -- 172.21.15.82:0/1663119637 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d73ad2c9d0 msgr2=0x55d73ad29ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:42.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.118+0000 7f3f2fdc5b80 1 --2- 172.21.15.82:0/1663119637 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d73ad2c9d0 0x55d73ad29ea0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3f1000ad10 tx=0x7f3f1000a380 comp rx=0 tx=0).stop 2024-05-08T06:00:42.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.118+0000 7f3f2fdc5b80 1 -- 172.21.15.82:0/1663119637 shutdown_connections 2024-05-08T06:00:42.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.118+0000 7f3f2fdc5b80 1 --2- 172.21.15.82:0/1663119637 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x55d73adac1e0 0x55d73adae600 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:42.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.118+0000 7f3f2fdc5b80 1 --2- 172.21.15.82:0/1663119637 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d73ad2c9d0 0x55d73ad29ea0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:42.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.118+0000 7f3f2fdc5b80 1 --2- 172.21.15.82:0/1663119637 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d73ad28060 0x55d73ad470c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:42.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.118+0000 7f3f2fdc5b80 1 --2- 172.21.15.82:0/1663119637 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d73ad28980 0x55d73ad29960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:42.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.118+0000 7f3f08c00700 0 client.26308 ms_handle_reset on v2:172.21.15.151:6834/2093655929 2024-05-08T06:00:42.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.118+0000 7f3f2fdc5b80 1 -- 172.21.15.82:0/1663119637 >> 172.21.15.82:0/1663119637 conn(0x55d73ac56b60 msgr2=0x55d73ad1ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:00:42.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.118+0000 7f3f2fdc5b80 1 -- 172.21.15.82:0/1663119637 shutdown_connections 2024-05-08T06:00:42.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.119+0000 7f3f2fdc5b80 1 -- 172.21.15.82:0/1663119637 wait complete. 2024-05-08T06:00:42.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.119+0000 7f3f2fdc5b80 20 client.26308 trim_cache size 0 max 16384 2024-05-08T06:00:42.121 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T06:00:42.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.120+0000 7f3f25400700 1 -- 172.21.15.82:0/1153475540 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3f040b2980 msgr2=0x7f3f040b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:42.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.120+0000 7f3f25400700 1 --2- 172.21.15.82:0/1153475540 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3f040b2980 0x7f3f040b4e40 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3f1800dfd0 tx=0x7f3f18004ad0 comp rx=0 tx=0).stop 2024-05-08T06:00:42.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.120+0000 7f3f25400700 1 -- 172.21.15.82:0/1153475540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f20108460 msgr2=0x7f3f2006da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:42.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.120+0000 7f3f25400700 1 --2- 172.21.15.82:0/1153475540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f20108460 0x7f3f2006da50 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3f1800b9e0 tx=0x7f3f1800bcf0 comp rx=0 tx=0).stop 2024-05-08T06:00:42.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.121+0000 7f3f25400700 1 -- 172.21.15.82:0/1153475540 shutdown_connections 2024-05-08T06:00:42.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.121+0000 7f3f25400700 1 --2- 172.21.15.82:0/1153475540 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3f040b2980 0x7f3f040b4e40 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:42.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.121+0000 7f3f25400700 1 --2- 172.21.15.82:0/1153475540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f20108460 0x7f3f2006da50 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:42.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.121+0000 7f3f25400700 1 --2- 172.21.15.82:0/1153475540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3f20103550 0x7f3f200749c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:42.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.121+0000 7f3f25400700 1 --2- 172.21.15.82:0/1153475540 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f20103ef0 0x7f3f20074f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:42.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.121+0000 7f3f25400700 1 -- 172.21.15.82:0/1153475540 >> 172.21.15.82:0/1153475540 conn(0x7f3f2007a600 msgr2=0x7f3f201013c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:00:42.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.121+0000 7f3f25400700 1 -- 172.21.15.82:0/1153475540 shutdown_connections 2024-05-08T06:00:42.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:42.121+0000 7f3f25400700 1 -- 172.21.15.82:0/1153475540 wait complete. 2024-05-08T06:00:42.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:00:42 smithi151 ceph-mon[34815]: pgmap v760: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.5 MiB/s wr, 761 op/s 2024-05-08T06:00:42.472 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:00:42 smithi082 ceph-mon[30098]: pgmap v760: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.5 MiB/s wr, 761 op/s 2024-05-08T06:00:42.499 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:00:42 smithi134 ceph-mon[34132]: pgmap v760: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.5 MiB/s wr, 761 op/s 2024-05-08T06:00:43.007 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-05-08T06:00:43.631 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:00:44.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:00:44 smithi151 ceph-mon[34815]: pgmap v761: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.5 MiB/s wr, 597 op/s 2024-05-08T06:00:44.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:00:44 smithi082 ceph-mon[30098]: pgmap v761: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.5 MiB/s wr, 597 op/s 2024-05-08T06:00:44.499 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:00:44 smithi134 ceph-mon[34132]: pgmap v761: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.5 MiB/s wr, 597 op/s 2024-05-08T06:00:45.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 595.0 s, 1700.6 tps, lat 58.449 ms stddev 69.721 2024-05-08T06:00:46.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.085+0000 7ff3e0c00700 1 -- 172.21.15.82:0/1594137799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3dc06b6f0 msgr2=0x7ff3dc06bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:46.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.085+0000 7ff3e0c00700 1 --2- 172.21.15.82:0/1594137799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3dc06b6f0 0x7ff3dc06bb50 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff3c80098f0 tx=0x7ff3c8009c00 comp rx=0 tx=0).stop 2024-05-08T06:00:46.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.085+0000 7ff3e0c00700 1 -- 172.21.15.82:0/1594137799 shutdown_connections 2024-05-08T06:00:46.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.085+0000 7ff3e0c00700 1 --2- 172.21.15.82:0/1594137799 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3dc105ee0 0x7ff3dc106370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:46.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.085+0000 7ff3e0c00700 1 --2- 172.21.15.82:0/1594137799 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3dc1083d0 0x7ff3dc06b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:46.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.085+0000 7ff3e0c00700 1 --2- 172.21.15.82:0/1594137799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3dc06b6f0 0x7ff3dc06bb50 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:46.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.085+0000 7ff3e0c00700 1 -- 172.21.15.82:0/1594137799 >> 172.21.15.82:0/1594137799 conn(0x7ff3dc079350 msgr2=0x7ff3dc079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:00:46.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.086+0000 7ff3e0c00700 1 -- 172.21.15.82:0/1594137799 shutdown_connections 2024-05-08T06:00:46.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.086+0000 7ff3e0c00700 1 -- 172.21.15.82:0/1594137799 wait complete. 2024-05-08T06:00:46.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.087+0000 7ff3e0c00700 1 Processor -- start 2024-05-08T06:00:46.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.087+0000 7ff3e0c00700 1 -- start start 2024-05-08T06:00:46.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.088+0000 7ff3e0c00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3dc06b6f0 0x7ff3dc116790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:46.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.088+0000 7ff3e0c00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3dc105ee0 0x7ff3dc10f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:46.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.088+0000 7ff3e0c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3dc1083d0 0x7ff3dc10fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:46.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.088+0000 7ff3e0c00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff3dc119cd0 con 0x7ff3dc1083d0 2024-05-08T06:00:46.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.088+0000 7ff3e0c00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff3dc119b50 con 0x7ff3dc06b6f0 2024-05-08T06:00:46.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.088+0000 7ff3e0c00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff3dc119e50 con 0x7ff3dc105ee0 2024-05-08T06:00:46.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.088+0000 7ff3d9e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3dc06b6f0 0x7ff3dc116790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:46.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.088+0000 7ff3d9e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3dc06b6f0 0x7ff3dc116790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:57868/0 (socket says 172.21.15.82:57868) 2024-05-08T06:00:46.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.088+0000 7ff3d9e00700 1 -- 172.21.15.82:0/888643615 learned_addr learned my addr 172.21.15.82:0/888643615 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:00:46.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.088+0000 7ff3d9400700 1 --2- 172.21.15.82:0/888643615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3dc105ee0 0x7ff3dc10f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:46.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.089+0000 7ff3da800700 1 --2- 172.21.15.82:0/888643615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3dc1083d0 0x7ff3dc10fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:46.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.089+0000 7ff3d9e00700 1 -- 172.21.15.82:0/888643615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3dc105ee0 msgr2=0x7ff3dc10f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:46.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.089+0000 7ff3d9e00700 1 --2- 172.21.15.82:0/888643615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3dc105ee0 0x7ff3dc10f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:46.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.089+0000 7ff3d9e00700 1 -- 172.21.15.82:0/888643615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3dc1083d0 msgr2=0x7ff3dc10fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:46.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.089+0000 7ff3d9e00700 1 --2- 172.21.15.82:0/888643615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3dc1083d0 0x7ff3dc10fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:46.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.089+0000 7ff3d9e00700 1 -- 172.21.15.82:0/888643615 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3dc110350 con 0x7ff3dc06b6f0 2024-05-08T06:00:46.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.089+0000 7ff3da800700 1 --2- 172.21.15.82:0/888643615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3dc1083d0 0x7ff3dc10fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:00:46.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.089+0000 7ff3d9e00700 1 --2- 172.21.15.82:0/888643615 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3dc06b6f0 0x7ff3dc116790 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc00c9b0 tx=0x7ff3cc00ccc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:00:46.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.091+0000 7ff3d2a00700 1 -- 172.21.15.82:0/888643615 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc007b00 con 0x7ff3dc06b6f0 2024-05-08T06:00:46.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.091+0000 7ff3d2a00700 1 -- 172.21.15.82:0/888643615 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3cc007ca0 con 0x7ff3dc06b6f0 2024-05-08T06:00:46.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.091+0000 7ff3d2a00700 1 -- 172.21.15.82:0/888643615 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc018660 con 0x7ff3dc06b6f0 2024-05-08T06:00:46.093 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:00:46 smithi082 ceph-mon[30098]: pgmap v762: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.9 MiB/s wr, 631 op/s 2024-05-08T06:00:46.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.091+0000 7ff3e0c00700 1 -- 172.21.15.82:0/888643615 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3dc110640 con 0x7ff3dc06b6f0 2024-05-08T06:00:46.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.091+0000 7ff3e0c00700 1 -- 172.21.15.82:0/888643615 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3dc1145b0 con 0x7ff3dc06b6f0 2024-05-08T06:00:46.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.099+0000 7ff3d2a00700 1 -- 172.21.15.82:0/888643615 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7ff3cc00f450 con 0x7ff3dc06b6f0 2024-05-08T06:00:46.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.104+0000 7ff3d2a00700 1 --2- 172.21.15.82:0/888643615 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff3c00b2a90 0x7ff3c00b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:46.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.105+0000 7ff3d9400700 1 --2- 172.21.15.82:0/888643615 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff3c00b2a90 0x7ff3c00b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:46.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.105+0000 7ff3d2a00700 1 -- 172.21.15.82:0/888643615 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7ff3cc0e1f60 con 0x7ff3dc06b6f0 2024-05-08T06:00:46.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.106+0000 7ff3eb529b80 1 Processor -- start 2024-05-08T06:00:46.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.106+0000 7ff3eb529b80 1 -- start start 2024-05-08T06:00:46.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.107+0000 7ff3eb529b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0442f4060 0x55f0442f4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:46.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.107+0000 7ff3eb529b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0442f4980 0x55f0442f8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:46.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.107+0000 7ff3eb529b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0442f89d0 0x55f0442f8e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:46.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.107+0000 7ff3eb529b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f044246a20 con 0x55f0442f4060 2024-05-08T06:00:46.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.107+0000 7ff3eb529b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f0441e4760 con 0x55f0442f89d0 2024-05-08T06:00:46.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.107+0000 7ff3eb529b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55f0442429e0 con 0x55f0442f4980 2024-05-08T06:00:46.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.107+0000 7ff3d9400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0442f4980 0x55f0442f8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:46.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.108+0000 7ff3d9400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0442f4980 0x55f0442f8490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:60174/0 (socket says 172.21.15.82:60174) 2024-05-08T06:00:46.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.108+0000 7ff3d9400700 1 -- 172.21.15.82:0/2863852025 learned_addr learned my addr 172.21.15.82:0/2863852025 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:00:46.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.108+0000 7ff3d9e00700 1 --2- 172.21.15.82:0/2863852025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0442f4060 0x55f0442f4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:46.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.109+0000 7ff3da800700 1 --2- 172.21.15.82:0/2863852025 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0442f89d0 0x55f0442f8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:46.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.109+0000 7ff3d9400700 1 --2- 172.21.15.82:0/888643615 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff3c00b2a90 0x7ff3c00b4f50 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc111070 tx=0x7ff3c8019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:00:46.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.109+0000 7ff3d9e00700 1 -- 172.21.15.82:0/2863852025 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0442f4980 msgr2=0x55f0442f8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:00:46.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.109+0000 7ff3d9e00700 1 --2- 172.21.15.82:0/2863852025 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0442f4980 0x55f0442f8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:46.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.109+0000 7ff3d9e00700 1 -- 172.21.15.82:0/2863852025 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0442f89d0 msgr2=0x55f0442f8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:00:46.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.109+0000 7ff3d9e00700 1 --2- 172.21.15.82:0/2863852025 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0442f89d0 0x55f0442f8e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:46.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.109+0000 7ff3d9e00700 1 -- 172.21.15.82:0/2863852025 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0441938d0 con 0x55f0442f4060 2024-05-08T06:00:46.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.110+0000 7ff3d9e00700 1 --2- 172.21.15.82:0/2863852025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0442f4060 0x55f0442f4440 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc0a6820 tx=0x7ff3cc007e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caa501778375f365 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:00:46.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.110+0000 7ff3c7400700 1 -- 172.21.15.82:0/2863852025 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc0c2070 con 0x55f0442f4060 2024-05-08T06:00:46.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.110+0000 7ff3c7400700 1 -- 172.21.15.82:0/2863852025 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3cc0a90c0 con 0x55f0442f4060 2024-05-08T06:00:46.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.110+0000 7ff3c7400700 1 -- 172.21.15.82:0/2863852025 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3cc0a9810 con 0x55f0442f4060 2024-05-08T06:00:46.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.111+0000 7ff3eb529b80 1 -- 172.21.15.82:0/2863852025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0442f4060 msgr2=0x55f0442f4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:46.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.111+0000 7ff3eb529b80 1 --2- 172.21.15.82:0/2863852025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0442f4060 0x55f0442f4440 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc0a6820 tx=0x7ff3cc007e50 comp rx=0 tx=0).stop 2024-05-08T06:00:46.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.111+0000 7ff3eb529b80 1 -- 172.21.15.82:0/2863852025 shutdown_connections 2024-05-08T06:00:46.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.112+0000 7ff3eb529b80 1 --2- 172.21.15.82:0/2863852025 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0442f89d0 0x55f0442f8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:46.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.112+0000 7ff3eb529b80 1 --2- 172.21.15.82:0/2863852025 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0442f4060 0x55f0442f4440 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:46.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.112+0000 7ff3eb529b80 1 --2- 172.21.15.82:0/2863852025 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0442f4980 0x55f0442f8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:46.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.112+0000 7ff3eb529b80 1 -- 172.21.15.82:0/2863852025 >> 172.21.15.82:0/2863852025 conn(0x55f044222b60 msgr2=0x55f0442ee7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:00:46.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.112+0000 7ff3eb529b80 1 -- 172.21.15.82:0/2863852025 shutdown_connections 2024-05-08T06:00:46.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.112+0000 7ff3eb529b80 1 -- 172.21.15.82:0/2863852025 wait complete. 2024-05-08T06:00:46.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.113+0000 7ff3eb529b80 1 -- start start 2024-05-08T06:00:46.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.113+0000 7ff3eb529b80 1 Processor -- start 2024-05-08T06:00:46.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.114+0000 7ff3eb529b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0442f4060 0x55f0442fff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:46.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.114+0000 7ff3eb529b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0442f4980 0x55f0442fd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:46.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.114+0000 7ff3eb529b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0442f89d0 0x55f0442fd820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:46.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.114+0000 7ff3eb529b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f044300be0 con 0x55f0442f4980 2024-05-08T06:00:46.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.114+0000 7ff3eb529b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f0441acb20 con 0x55f0442f4060 2024-05-08T06:00:46.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.114+0000 7ff3eb529b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55f044300d60 con 0x55f0442f89d0 2024-05-08T06:00:46.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.114+0000 7ff3eb529b80 10 client.0 _ll_register_callbacks cb 0x55f0441edc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:00:46.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.115+0000 7ff3d9e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0442f4060 0x55f0442fff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:46.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.115+0000 7ff3d9e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0442f4060 0x55f0442fff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:57882/0 (socket says 172.21.15.82:57882) 2024-05-08T06:00:46.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.115+0000 7ff3d9e00700 1 -- 172.21.15.82:0/1578279197 learned_addr learned my addr 172.21.15.82:0/1578279197 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:00:46.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.115+0000 7ff3d9400700 1 --2- 172.21.15.82:0/1578279197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0442f4980 0x55f0442fd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:46.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.115+0000 7ff3da800700 1 --2- 172.21.15.82:0/1578279197 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0442f89d0 0x55f0442fd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:46.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.115+0000 7ff3da800700 1 -- 172.21.15.82:0/1578279197 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0442f4060 msgr2=0x55f0442fff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:00:46.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.115+0000 7ff3da800700 1 --2- 172.21.15.82:0/1578279197 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0442f4060 0x55f0442fff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:46.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.115+0000 7ff3da800700 1 -- 172.21.15.82:0/1578279197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0442f4980 msgr2=0x55f0442fd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:00:46.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.115+0000 7ff3da800700 1 --2- 172.21.15.82:0/1578279197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0442f4980 0x55f0442fd2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:46.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.115+0000 7ff3da800700 1 -- 172.21.15.82:0/1578279197 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f04420c420 con 0x55f0442f89d0 2024-05-08T06:00:46.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.116+0000 7ff3da800700 1 --2- 172.21.15.82:0/1578279197 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0442f89d0 0x55f0442fd820 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4007a50 tx=0x7ff3d4007d60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a86fe11070853a3c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:00:46.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.116+0000 7ff3bbe00700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T06:00:46.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.116+0000 7ff3bbe00700 1 -- 172.21.15.82:0/1578279197 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d401a030 con 0x55f0442f89d0 2024-05-08T06:00:46.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.116+0000 7ff3bbe00700 1 -- 172.21.15.82:0/1578279197 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7ff3d4012040 con 0x55f0442f89d0 2024-05-08T06:00:46.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.117+0000 7ff3eb529b80 1 -- 172.21.15.82:0/1578279197 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3cc0a90c0 con 0x55f0442f89d0 2024-05-08T06:00:46.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.117+0000 7ff3bbe00700 1 -- 172.21.15.82:0/1578279197 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7ff3d4004bb0 con 0x55f0442f89d0 2024-05-08T06:00:46.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.117+0000 7ff3eb529b80 10 client.26320 fetch_fsmap learned FSMap version 31 2024-05-08T06:00:46.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.117+0000 7ff3eb529b80 1 -- 172.21.15.82:0/1578279197 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55f04430b650 con 0x55f0442f89d0 2024-05-08T06:00:46.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.118+0000 7ff3bbe00700 1 -- 172.21.15.82:0/1578279197 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3cc0a90c0 con 0x55f0442f89d0 2024-05-08T06:00:46.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.118+0000 7ff3bbe00700 1 -- 172.21.15.82:0/1578279197 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7ff3d4016910 con 0x55f0442f89d0 2024-05-08T06:00:46.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.118+0000 7ff3eb529b80 10 client.26320 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:00:46.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.118+0000 7ff3eb529b80 10 client.26320 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-05-08T06:00:46.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.118+0000 7ff3eb529b80 20 client.26320 populate_metadata read hostname 'smithi082' 2024-05-08T06:00:46.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.118+0000 7ff3eb529b80 1 --2- 172.21.15.82:0/1578279197 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55f04430dc90 0x55f044310080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:46.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.118+0000 7ff3eb529b80 4 client.26320 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:00:46.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.118+0000 7ff3eb529b80 1 -- 172.21.15.82:0/1578279197 --> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f0442c10a0 con 0x55f04430dc90 2024-05-08T06:00:46.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.119+0000 7ff3d9e00700 1 --2- 172.21.15.82:0/1578279197 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55f04430dc90 0x55f044310080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:46.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.119+0000 7ff3bbe00700 10 client.26320 ms_handle_connect on v2:172.21.15.151:6836/4192404464 2024-05-08T06:00:46.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.119+0000 7ff3d9e00700 1 --2- 172.21.15.82:0/1578279197 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55f04430dc90 0x55f044310080 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3bfbf332c4482692 server_cookie=a9fc2a13ac6edfb0 in_seq=0 out_seq=0 2024-05-08T06:00:46.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.121+0000 7ff3bbe00700 1 -- 172.21.15.82:0/1578279197 <== mds.2 v2:172.21.15.151:6836/4192404464 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f0442c10a0 con 0x55f04430dc90 2024-05-08T06:00:46.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.121+0000 7ff3bbe00700 10 client.26320 handle_command_reply: tid=0 2024-05-08T06:00:46.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.121+0000 7ff3eb529b80 1 client.26320 shutdown 2024-05-08T06:00:46.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.122+0000 7ff3eb529b80 1 -- 172.21.15.82:0/1578279197 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0442f89d0 msgr2=0x55f0442fd820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:46.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.122+0000 7ff3eb529b80 1 --2- 172.21.15.82:0/1578279197 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0442f89d0 0x55f0442fd820 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4007a50 tx=0x7ff3d4007d60 comp rx=0 tx=0).stop 2024-05-08T06:00:46.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.122+0000 7ff3eb529b80 1 -- 172.21.15.82:0/1578279197 shutdown_connections 2024-05-08T06:00:46.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.122+0000 7ff3eb529b80 1 --2- 172.21.15.82:0/1578279197 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55f04430dc90 0x55f044310080 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:46.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.122+0000 7ff3eb529b80 1 --2- 172.21.15.82:0/1578279197 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0442f4060 0x55f0442fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:46.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.122+0000 7ff3eb529b80 1 --2- 172.21.15.82:0/1578279197 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0442f89d0 0x55f0442fd820 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:46.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.122+0000 7ff3eb529b80 1 --2- 172.21.15.82:0/1578279197 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0442f4980 0x55f0442fd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:46.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.122+0000 7ff3eb529b80 1 -- 172.21.15.82:0/1578279197 >> 172.21.15.82:0/1578279197 conn(0x55f044222b60 msgr2=0x55f0442ee760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:00:46.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.123+0000 7ff3bbe00700 0 client.26320 ms_handle_reset on v2:172.21.15.151:6836/4192404464 2024-05-08T06:00:46.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.123+0000 7ff3eb529b80 1 -- 172.21.15.82:0/1578279197 shutdown_connections 2024-05-08T06:00:46.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.124+0000 7ff3eb529b80 1 -- 172.21.15.82:0/1578279197 wait complete. 2024-05-08T06:00:46.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.124+0000 7ff3eb529b80 20 client.26320 trim_cache size 0 max 16384 2024-05-08T06:00:46.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.153+0000 7ff3eb529b80 1 Processor -- start 2024-05-08T06:00:46.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.153+0000 7ff3eb529b80 1 -- start start 2024-05-08T06:00:46.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.154+0000 7ff3eb529b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0442f4060 0x55f044309c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:46.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.154+0000 7ff3eb529b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0442f4980 0x55f0442e9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:46.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.154+0000 7ff3eb529b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0442f89d0 0x55f044315910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:46.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.154+0000 7ff3eb529b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff3dc1bca60 con 0x55f0442f89d0 2024-05-08T06:00:46.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.154+0000 7ff3eb529b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff3dc1be5a0 con 0x55f0442f4980 2024-05-08T06:00:46.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.154+0000 7ff3eb529b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff3dc1bd130 con 0x55f0442f4060 2024-05-08T06:00:46.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.154+0000 7ff3d9400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0442f4980 0x55f0442e9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:46.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.154+0000 7ff3d9400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0442f4980 0x55f0442e9130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:57884/0 (socket says 172.21.15.82:57884) 2024-05-08T06:00:46.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.154+0000 7ff3d9400700 1 -- 172.21.15.82:0/1876183591 learned_addr learned my addr 172.21.15.82:0/1876183591 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:00:46.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.155+0000 7ff3d9400700 1 -- 172.21.15.82:0/1876183591 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0442f4060 msgr2=0x55f044309c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:00:46.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.155+0000 7ff3d9400700 1 --2- 172.21.15.82:0/1876183591 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0442f4060 0x55f044309c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:46.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.155+0000 7ff3d9400700 1 -- 172.21.15.82:0/1876183591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0442f89d0 msgr2=0x55f044315910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T06:00:46.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.155+0000 7ff3d9400700 1 --2- 172.21.15.82:0/1876183591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0442f89d0 0x55f044315910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:46.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.155+0000 7ff3d9400700 1 -- 172.21.15.82:0/1876183591 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0442ef610 con 0x55f0442f4980 2024-05-08T06:00:46.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.155+0000 7ff3d9400700 1 --2- 172.21.15.82:0/1876183591 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0442f4980 0x55f0442e9130 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff3c8016000 tx=0x7ff3c801e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=609988be7d5c6c40 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:00:46.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.156+0000 7ff3c6a00700 1 -- 172.21.15.82:0/1876183591 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c8035070 con 0x55f0442f4980 2024-05-08T06:00:46.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.156+0000 7ff3c6a00700 1 -- 172.21.15.82:0/1876183591 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3c8003680 con 0x55f0442f4980 2024-05-08T06:00:46.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.156+0000 7ff3c6a00700 1 -- 172.21.15.82:0/1876183591 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c800b7c0 con 0x55f0442f4980 2024-05-08T06:00:46.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.157+0000 7ff3eb529b80 1 -- 172.21.15.82:0/1876183591 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0442f4980 msgr2=0x55f0442e9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:46.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.157+0000 7ff3eb529b80 1 --2- 172.21.15.82:0/1876183591 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0442f4980 0x55f0442e9130 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff3c8016000 tx=0x7ff3c801e000 comp rx=0 tx=0).stop 2024-05-08T06:00:46.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.158+0000 7ff3eb529b80 1 -- 172.21.15.82:0/1876183591 shutdown_connections 2024-05-08T06:00:46.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.158+0000 7ff3eb529b80 1 --2- 172.21.15.82:0/1876183591 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0442f89d0 0x55f044315910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:46.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.158+0000 7ff3eb529b80 1 --2- 172.21.15.82:0/1876183591 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0442f4060 0x55f044309c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:46.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.158+0000 7ff3eb529b80 1 --2- 172.21.15.82:0/1876183591 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0442f4980 0x55f0442e9130 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:46.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.158+0000 7ff3eb529b80 1 -- 172.21.15.82:0/1876183591 >> 172.21.15.82:0/1876183591 conn(0x55f044222b60 msgr2=0x55f0442e8a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:00:46.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.158+0000 7ff3eb529b80 1 -- 172.21.15.82:0/1876183591 shutdown_connections 2024-05-08T06:00:46.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.160+0000 7ff3eb529b80 1 -- 172.21.15.82:0/1876183591 wait complete. 2024-05-08T06:00:46.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.160+0000 7ff3eb529b80 1 -- start start 2024-05-08T06:00:46.161 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.161+0000 7ff3eb529b80 1 Processor -- start 2024-05-08T06:00:46.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.162+0000 7ff3eb529b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0442f4060 0x55f044306510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:46.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.162+0000 7ff3eb529b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0442f4980 0x55f0443038b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:46.163 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.163+0000 7ff3eb529b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0442f89d0 0x55f044303df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:46.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.163+0000 7ff3d9400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0442f4980 0x55f0443038b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:46.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.163+0000 7ff3da800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0442f89d0 0x55f044303df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:46.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.163+0000 7ff3da800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0442f89d0 0x55f044303df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:60200/0 (socket says 172.21.15.82:60200) 2024-05-08T06:00:46.166 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.163+0000 7ff3da800700 1 -- 172.21.15.82:0/3132125889 learned_addr learned my addr 172.21.15.82:0/3132125889 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:00:46.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.163+0000 7ff3eb529b80 1 -- 172.21.15.82:0/3132125889 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff3dc1bded0 con 0x55f0442f4060 2024-05-08T06:00:46.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.163+0000 7ff3eb529b80 1 -- 172.21.15.82:0/3132125889 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff3dc1bd800 con 0x55f0442f4980 2024-05-08T06:00:46.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.164+0000 7ff3d9e00700 1 --2- 172.21.15.82:0/3132125889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0442f4060 0x55f044306510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:46.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.166+0000 7ff3eb529b80 1 -- 172.21.15.82:0/3132125889 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff3dc1baa00 con 0x55f0442f89d0 2024-05-08T06:00:46.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.166+0000 7ff3eb529b80 10 client.0 _ll_register_callbacks cb 0x55f0441edc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:00:46.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.166+0000 7ff3da800700 1 -- 172.21.15.82:0/3132125889 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0442f4980 msgr2=0x55f0443038b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:00:46.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.166+0000 7ff3da800700 1 --2- 172.21.15.82:0/3132125889 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0442f4980 0x55f0443038b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:46.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.166+0000 7ff3da800700 1 -- 172.21.15.82:0/3132125889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0442f4060 msgr2=0x55f044306510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:00:46.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.167+0000 7ff3da800700 1 --2- 172.21.15.82:0/3132125889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0442f4060 0x55f044306510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:46.168 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.167+0000 7ff3da800700 1 -- 172.21.15.82:0/3132125889 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f044304630 con 0x55f0442f89d0 2024-05-08T06:00:46.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.169+0000 7ff3bbe00700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T06:00:46.169 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.169+0000 7ff3da800700 1 --2- 172.21.15.82:0/3132125889 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0442f89d0 0x55f044303df0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4000f80 tx=0x7ff3d4005f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=866fcb60916580d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:00:46.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.169+0000 7ff3bbe00700 1 -- 172.21.15.82:0/3132125889 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d402d060 con 0x55f0442f89d0 2024-05-08T06:00:46.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.169+0000 7ff3bbe00700 1 -- 172.21.15.82:0/3132125889 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7ff3d4011a60 con 0x55f0442f89d0 2024-05-08T06:00:46.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.169+0000 7ff3eb529b80 1 -- 172.21.15.82:0/3132125889 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff3c8003680 con 0x55f0442f89d0 2024-05-08T06:00:46.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.170+0000 7ff3bbe00700 1 -- 172.21.15.82:0/3132125889 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7ff3d402d060 con 0x55f0442f89d0 2024-05-08T06:00:46.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.170+0000 7ff3eb529b80 10 client.26323 fetch_fsmap learned FSMap version 31 2024-05-08T06:00:46.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.170+0000 7ff3eb529b80 1 -- 172.21.15.82:0/3132125889 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55f0443784e0 con 0x55f0442f89d0 2024-05-08T06:00:46.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.171+0000 7ff3bbe00700 1 -- 172.21.15.82:0/3132125889 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff3c8003680 con 0x55f0442f89d0 2024-05-08T06:00:46.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.171+0000 7ff3bbe00700 1 -- 172.21.15.82:0/3132125889 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7ff3d40158a0 con 0x55f0442f89d0 2024-05-08T06:00:46.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.173+0000 7ff3eb529b80 10 client.26323 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:00:46.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.173+0000 7ff3eb529b80 10 client.26323 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-05-08T06:00:46.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.173+0000 7ff3eb529b80 20 client.26323 populate_metadata read hostname 'smithi082' 2024-05-08T06:00:46.174 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.173+0000 7ff3eb529b80 1 --2- 172.21.15.82:0/3132125889 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55f044378ae0 0x55f04437af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:46.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.174+0000 7ff3eb529b80 4 client.26323 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T06:00:46.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.174+0000 7ff3eb529b80 1 -- 172.21.15.82:0/3132125889 --> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f044254400 con 0x55f044378ae0 2024-05-08T06:00:46.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.175+0000 7ff3d9e00700 1 --2- 172.21.15.82:0/3132125889 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55f044378ae0 0x55f04437af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:46.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.178+0000 7ff3d9e00700 1 --2- 172.21.15.82:0/3132125889 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55f044378ae0 0x55f04437af00 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a77720ac5e2a2eaf server_cookie=aa45038808c45928 in_seq=0 out_seq=0 2024-05-08T06:00:46.180 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.178+0000 7ff3bbe00700 10 client.26323 ms_handle_connect on v2:172.21.15.151:6836/4192404464 2024-05-08T06:00:46.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.180+0000 7ff3bbe00700 1 -- 172.21.15.82:0/3132125889 <== mds.2 v2:172.21.15.151:6836/4192404464 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f044254400 con 0x55f044378ae0 2024-05-08T06:00:46.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.180+0000 7ff3bbe00700 10 client.26323 handle_command_reply: tid=0 2024-05-08T06:00:46.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.181+0000 7ff3eb529b80 1 client.26323 shutdown 2024-05-08T06:00:46.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.181+0000 7ff3eb529b80 1 -- 172.21.15.82:0/3132125889 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0442f89d0 msgr2=0x55f044303df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:46.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.181+0000 7ff3eb529b80 1 --2- 172.21.15.82:0/3132125889 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0442f89d0 0x55f044303df0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4000f80 tx=0x7ff3d4005f70 comp rx=0 tx=0).stop 2024-05-08T06:00:46.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.181+0000 7ff3eb529b80 1 -- 172.21.15.82:0/3132125889 shutdown_connections 2024-05-08T06:00:46.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.181+0000 7ff3eb529b80 1 --2- 172.21.15.82:0/3132125889 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55f044378ae0 0x55f04437af00 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:46.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.181+0000 7ff3eb529b80 1 --2- 172.21.15.82:0/3132125889 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0442f89d0 0x55f044303df0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:46.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.181+0000 7ff3eb529b80 1 --2- 172.21.15.82:0/3132125889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f0442f4060 0x55f044306510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:46.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.181+0000 7ff3eb529b80 1 --2- 172.21.15.82:0/3132125889 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0442f4980 0x55f0443038b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:46.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.181+0000 7ff3bbe00700 0 client.26323 ms_handle_reset on v2:172.21.15.151:6836/4192404464 2024-05-08T06:00:46.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.181+0000 7ff3eb529b80 1 -- 172.21.15.82:0/3132125889 >> 172.21.15.82:0/3132125889 conn(0x55f044222b60 msgr2=0x55f0442e92b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:00:46.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.182+0000 7ff3eb529b80 1 -- 172.21.15.82:0/3132125889 shutdown_connections 2024-05-08T06:00:46.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.182+0000 7ff3eb529b80 1 -- 172.21.15.82:0/3132125889 wait complete. 2024-05-08T06:00:46.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.183+0000 7ff3eb529b80 20 client.26323 trim_cache size 0 max 16384 2024-05-08T06:00:46.184 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T06:00:46.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.184+0000 7ff3e0c00700 1 -- 172.21.15.82:0/888643615 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff3c00b2a90 msgr2=0x7ff3c00b4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:46.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.184+0000 7ff3e0c00700 1 --2- 172.21.15.82:0/888643615 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff3c00b2a90 0x7ff3c00b4f50 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc111070 tx=0x7ff3c8019040 comp rx=0 tx=0).stop 2024-05-08T06:00:46.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.184+0000 7ff3e0c00700 1 -- 172.21.15.82:0/888643615 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3dc06b6f0 msgr2=0x7ff3dc116790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:46.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.184+0000 7ff3e0c00700 1 --2- 172.21.15.82:0/888643615 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3dc06b6f0 0x7ff3dc116790 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff3cc00c9b0 tx=0x7ff3cc00ccc0 comp rx=0 tx=0).stop 2024-05-08T06:00:46.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.184+0000 7ff3e0c00700 1 -- 172.21.15.82:0/888643615 shutdown_connections 2024-05-08T06:00:46.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.184+0000 7ff3e0c00700 1 --2- 172.21.15.82:0/888643615 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3dc06b6f0 0x7ff3dc116790 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:46.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.184+0000 7ff3e0c00700 1 --2- 172.21.15.82:0/888643615 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff3c00b2a90 0x7ff3c00b4f50 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:46.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.184+0000 7ff3e0c00700 1 --2- 172.21.15.82:0/888643615 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff3dc1083d0 0x7ff3dc10fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:46.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.184+0000 7ff3e0c00700 1 --2- 172.21.15.82:0/888643615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3dc105ee0 0x7ff3dc10f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:46.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.184+0000 7ff3e0c00700 1 -- 172.21.15.82:0/888643615 >> 172.21.15.82:0/888643615 conn(0x7ff3dc079350 msgr2=0x7ff3dc104ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:00:46.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.184+0000 7ff3e0c00700 1 -- 172.21.15.82:0/888643615 shutdown_connections 2024-05-08T06:00:46.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:46.184+0000 7ff3e0c00700 1 -- 172.21.15.82:0/888643615 wait complete. 2024-05-08T06:00:46.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:00:46 smithi151 ceph-mon[34815]: pgmap v762: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.9 MiB/s wr, 631 op/s 2024-05-08T06:00:46.499 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:00:46 smithi134 ceph-mon[34132]: pgmap v762: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.9 MiB/s wr, 631 op/s 2024-05-08T06:00:47.252 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-05-08T06:00:47.860 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:00:48.338 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:00:48 smithi082 ceph-mon[30098]: pgmap v763: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.0 MiB/s wr, 730 op/s 2024-05-08T06:00:48.338 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:00:48 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:00:48.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:00:48 smithi151 ceph-mon[34815]: pgmap v763: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.0 MiB/s wr, 730 op/s 2024-05-08T06:00:48.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:00:48 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:00:48.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:00:48 smithi134 ceph-mon[34132]: pgmap v763: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.0 MiB/s wr, 730 op/s 2024-05-08T06:00:48.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:00:48 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:00:50.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.247+0000 7f0e30a00700 1 -- 172.21.15.82:0/1431292449 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e2c10b6e0 msgr2=0x7f0e2c10bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:50.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.247+0000 7f0e30a00700 1 --2- 172.21.15.82:0/1431292449 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e2c10b6e0 0x7f0e2c10bac0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c0098f0 tx=0x7f0e1c009c00 comp rx=0 tx=0).stop 2024-05-08T06:00:50.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.248+0000 7f0e30a00700 1 -- 172.21.15.82:0/1431292449 shutdown_connections 2024-05-08T06:00:50.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.248+0000 7f0e30a00700 1 --2- 172.21.15.82:0/1431292449 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e2c10b6e0 0x7f0e2c10bac0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:50.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.248+0000 7f0e30a00700 1 --2- 172.21.15.82:0/1431292449 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e2c1060a0 0x7f0e2c1125b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:50.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.248+0000 7f0e30a00700 1 --2- 172.21.15.82:0/1431292449 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e2c1056e0 0x7f0e2c105b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:50.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.248+0000 7f0e30a00700 1 -- 172.21.15.82:0/1431292449 >> 172.21.15.82:0/1431292449 conn(0x7f0e2c1011d0 msgr2=0x7f0e2c1035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:00:50.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.250+0000 7f0e30a00700 1 -- 172.21.15.82:0/1431292449 shutdown_connections 2024-05-08T06:00:50.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.250+0000 7f0e30a00700 1 -- 172.21.15.82:0/1431292449 wait complete. 2024-05-08T06:00:50.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.253+0000 7f0e30a00700 1 Processor -- start 2024-05-08T06:00:50.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.253+0000 7f0e30a00700 1 -- start start 2024-05-08T06:00:50.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.253+0000 7f0e30a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e2c1056e0 0x7f0e2c1102f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:50.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.253+0000 7f0e30a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e2c1060a0 0x7f0e2c110830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:50.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.253+0000 7f0e30a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e2c10b6e0 0x7f0e2c111a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:50.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.253+0000 7f0e30a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0e2c077c70 con 0x7f0e2c1060a0 2024-05-08T06:00:50.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.254+0000 7f0e30a00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0e2c077af0 con 0x7f0e2c10b6e0 2024-05-08T06:00:50.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.254+0000 7f0e30a00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0e2c077df0 con 0x7f0e2c1056e0 2024-05-08T06:00:50.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.254+0000 7f0e29e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e2c1056e0 0x7f0e2c1102f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:50.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.254+0000 7f0e29e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e2c1056e0 0x7f0e2c1102f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:60218/0 (socket says 172.21.15.82:60218) 2024-05-08T06:00:50.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.254+0000 7f0e29e00700 1 -- 172.21.15.82:0/1702365926 learned_addr learned my addr 172.21.15.82:0/1702365926 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:00:50.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.254+0000 7f0e2a800700 1 --2- 172.21.15.82:0/1702365926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e2c10b6e0 0x7f0e2c111a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:50.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.254+0000 7f0e29400700 1 --2- 172.21.15.82:0/1702365926 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e2c1060a0 0x7f0e2c110830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:50.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.254+0000 7f0e29e00700 1 -- 172.21.15.82:0/1702365926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e2c10b6e0 msgr2=0x7f0e2c111a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:50.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.254+0000 7f0e29e00700 1 --2- 172.21.15.82:0/1702365926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e2c10b6e0 0x7f0e2c111a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:50.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.254+0000 7f0e29e00700 1 -- 172.21.15.82:0/1702365926 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e2c1060a0 msgr2=0x7f0e2c110830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:50.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.254+0000 7f0e29e00700 1 --2- 172.21.15.82:0/1702365926 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e2c1060a0 0x7f0e2c110830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:50.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.254+0000 7f0e29e00700 1 -- 172.21.15.82:0/1702365926 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e2c112270 con 0x7f0e2c1056e0 2024-05-08T06:00:50.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.255+0000 7f0e29400700 1 --2- 172.21.15.82:0/1702365926 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e2c1060a0 0x7f0e2c110830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:00:50.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.255+0000 7f0e29e00700 1 --2- 172.21.15.82:0/1702365926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e2c1056e0 0x7f0e2c1102f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c00fb40 tx=0x7f0e1c0050f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:00:50.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.255+0000 7f0e22a00700 1 -- 172.21.15.82:0/1702365926 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c027070 con 0x7f0e2c1056e0 2024-05-08T06:00:50.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.255+0000 7f0e30a00700 1 -- 172.21.15.82:0/1702365926 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e2c112500 con 0x7f0e2c1056e0 2024-05-08T06:00:50.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.255+0000 7f0e22a00700 1 -- 172.21.15.82:0/1702365926 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e1c00b560 con 0x7f0e2c1056e0 2024-05-08T06:00:50.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.255+0000 7f0e22a00700 1 -- 172.21.15.82:0/1702365926 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c0049e0 con 0x7f0e2c1056e0 2024-05-08T06:00:50.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.256+0000 7f0e30a00700 1 -- 172.21.15.82:0/1702365926 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e2c06cec0 con 0x7f0e2c1056e0 2024-05-08T06:00:50.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.259+0000 7f0e22a00700 1 -- 172.21.15.82:0/1702365926 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f0e1c02a070 con 0x7f0e2c1056e0 2024-05-08T06:00:50.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.261+0000 7f0e22a00700 1 --2- 172.21.15.82:0/1702365926 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f0e100b28c0 0x7f0e100b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:50.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.262+0000 7f0e22a00700 1 -- 172.21.15.82:0/1702365926 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f0e1c0e2d50 con 0x7f0e2c1056e0 2024-05-08T06:00:50.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.262+0000 7f0e29400700 1 --2- 172.21.15.82:0/1702365926 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f0e100b28c0 0x7f0e100b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:50.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.262+0000 7f0e3b45bb80 1 Processor -- start 2024-05-08T06:00:50.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.263+0000 7f0e3b45bb80 1 -- start start 2024-05-08T06:00:50.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.263+0000 7f0e3b45bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563598237060 0x563598237440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:50.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.263+0000 7f0e3b45bb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563598237980 0x56359823b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:50.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.263+0000 7f0e3b45bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56359823b9d0 0x56359823be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:50.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.263+0000 7f0e3b45bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x563598189a20 con 0x56359823b9d0 2024-05-08T06:00:50.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.263+0000 7f0e3b45bb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x563598127760 con 0x563598237980 2024-05-08T06:00:50.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.263+0000 7f0e3b45bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5635981859e0 con 0x563598237060 2024-05-08T06:00:50.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.263+0000 7f0e29e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563598237060 0x563598237440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:50.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.263+0000 7f0e29e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563598237060 0x563598237440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:60230/0 (socket says 172.21.15.82:60230) 2024-05-08T06:00:50.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.263+0000 7f0e29e00700 1 -- 172.21.15.82:0/3994295298 learned_addr learned my addr 172.21.15.82:0/3994295298 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:00:50.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.264+0000 7f0e29e00700 1 -- 172.21.15.82:0/3994295298 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563598237980 msgr2=0x56359823b490 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T06:00:50.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.264+0000 7f0e2a800700 1 --2- 172.21.15.82:0/3994295298 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56359823b9d0 0x56359823be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:50.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.264+0000 7f0e29e00700 1 --2- 172.21.15.82:0/3994295298 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563598237980 0x56359823b490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:50.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.265+0000 7f0e29e00700 1 -- 172.21.15.82:0/3994295298 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56359823b9d0 msgr2=0x56359823be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:00:50.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.265+0000 7f0e29e00700 1 --2- 172.21.15.82:0/3994295298 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56359823b9d0 0x56359823be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:50.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.265+0000 7f0e29e00700 1 -- 172.21.15.82:0/3994295298 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5635980d68d0 con 0x563598237060 2024-05-08T06:00:50.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 600.0 s, 1468.2 tps, lat 66.849 ms stddev 89.226 2024-05-08T06:00:50.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.265+0000 7f0e2a800700 1 --2- 172.21.15.82:0/3994295298 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56359823b9d0 0x56359823be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:00:50.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.265+0000 7f0e29e00700 1 --2- 172.21.15.82:0/3994295298 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563598237060 0x563598237440 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c0a6490 tx=0x7f0e1c0a9fa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=634a27f4a5e35844 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:00:50.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.265+0000 7f0e17400700 1 -- 172.21.15.82:0/3994295298 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c0ae7c0 con 0x563598237060 2024-05-08T06:00:50.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.265+0000 7f0e17400700 1 -- 172.21.15.82:0/3994295298 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e1c0b31e0 con 0x563598237060 2024-05-08T06:00:50.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.265+0000 7f0e17400700 1 -- 172.21.15.82:0/3994295298 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c0b2fb0 con 0x563598237060 2024-05-08T06:00:50.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.265+0000 7f0e29400700 1 --2- 172.21.15.82:0/1702365926 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f0e100b28c0 0x7f0e100b4d80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0e18005fd0 tx=0x7f0e18005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:00:50.268 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:00:50 smithi082 ceph-mon[30098]: pgmap v764: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.0 MiB/s wr, 614 op/s 2024-05-08T06:00:50.268 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:00:50 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:00:50.268 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:00:50 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:00:50.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.267+0000 7f0e3b45bb80 1 -- 172.21.15.82:0/3994295298 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563598237060 msgr2=0x563598237440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:50.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.267+0000 7f0e3b45bb80 1 --2- 172.21.15.82:0/3994295298 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563598237060 0x563598237440 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c0a6490 tx=0x7f0e1c0a9fa0 comp rx=0 tx=0).stop 2024-05-08T06:00:50.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.267+0000 7f0e3b45bb80 1 -- 172.21.15.82:0/3994295298 shutdown_connections 2024-05-08T06:00:50.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.267+0000 7f0e3b45bb80 1 --2- 172.21.15.82:0/3994295298 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56359823b9d0 0x56359823be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:50.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.267+0000 7f0e3b45bb80 1 --2- 172.21.15.82:0/3994295298 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563598237060 0x563598237440 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:50.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.267+0000 7f0e3b45bb80 1 --2- 172.21.15.82:0/3994295298 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563598237980 0x56359823b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:50.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.267+0000 7f0e3b45bb80 1 -- 172.21.15.82:0/3994295298 >> 172.21.15.82:0/3994295298 conn(0x563598165b60 msgr2=0x5635982317a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:00:50.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.267+0000 7f0e3b45bb80 1 -- 172.21.15.82:0/3994295298 shutdown_connections 2024-05-08T06:00:50.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.267+0000 7f0e3b45bb80 1 -- 172.21.15.82:0/3994295298 wait complete. 2024-05-08T06:00:50.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.268+0000 7f0e3b45bb80 1 -- start start 2024-05-08T06:00:50.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.268+0000 7f0e3b45bb80 1 Processor -- start 2024-05-08T06:00:50.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.269+0000 7f0e3b45bb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563598237060 0x563598242ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:50.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.269+0000 7f0e3b45bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563598237980 0x563598240260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:50.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.269+0000 7f0e3b45bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56359823b9d0 0x5635982407a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:50.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.269+0000 7f0e3b45bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5635982439a0 con 0x563598237980 2024-05-08T06:00:50.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.269+0000 7f0e3b45bb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5635980efb20 con 0x563598237060 2024-05-08T06:00:50.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.269+0000 7f0e3b45bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x563598243b20 con 0x56359823b9d0 2024-05-08T06:00:50.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.269+0000 7f0e3b45bb80 10 client.0 _ll_register_callbacks cb 0x563598130c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:00:50.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.269+0000 7f0e2a800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56359823b9d0 0x5635982407a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:50.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.269+0000 7f0e2a800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56359823b9d0 0x5635982407a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:60244/0 (socket says 172.21.15.82:60244) 2024-05-08T06:00:50.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.269+0000 7f0e2a800700 1 -- 172.21.15.82:0/2578274550 learned_addr learned my addr 172.21.15.82:0/2578274550 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:00:50.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.269+0000 7f0e29400700 1 --2- 172.21.15.82:0/2578274550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563598237980 0x563598240260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:50.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.269+0000 7f0e29e00700 1 --2- 172.21.15.82:0/2578274550 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563598237060 0x563598242ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:50.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.270+0000 7f0e2a800700 1 -- 172.21.15.82:0/2578274550 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563598237060 msgr2=0x563598242ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:00:50.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.270+0000 7f0e2a800700 1 --2- 172.21.15.82:0/2578274550 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563598237060 0x563598242ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:50.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.270+0000 7f0e2a800700 1 -- 172.21.15.82:0/2578274550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563598237980 msgr2=0x563598240260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:00:50.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.270+0000 7f0e2a800700 1 --2- 172.21.15.82:0/2578274550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563598237980 0x563598240260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:50.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.270+0000 7f0e2a800700 1 -- 172.21.15.82:0/2578274550 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56359814f420 con 0x56359823b9d0 2024-05-08T06:00:50.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.270+0000 7f0e2a800700 1 --2- 172.21.15.82:0/2578274550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56359823b9d0 0x5635982407a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0e24007b70 tx=0x7f0e24007e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9ceeb7a98528cb1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:00:50.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.270+0000 7f0e0be00700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T06:00:50.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.271+0000 7f0e0be00700 1 -- 172.21.15.82:0/2578274550 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e2401a020 con 0x56359823b9d0 2024-05-08T06:00:50.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.271+0000 7f0e0be00700 1 -- 172.21.15.82:0/2578274550 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f0e240117f0 con 0x56359823b9d0 2024-05-08T06:00:50.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.272+0000 7f0e3b45bb80 1 -- 172.21.15.82:0/2578274550 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e1c0b31e0 con 0x56359823b9d0 2024-05-08T06:00:50.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.272+0000 7f0e0be00700 1 -- 172.21.15.82:0/2578274550 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f0e240119f0 con 0x56359823b9d0 2024-05-08T06:00:50.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.276+0000 7f0e3b45bb80 10 client.26335 fetch_fsmap learned FSMap version 31 2024-05-08T06:00:50.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.276+0000 7f0e3b45bb80 1 -- 172.21.15.82:0/2578274550 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56359824e1d0 con 0x56359823b9d0 2024-05-08T06:00:50.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.277+0000 7f0e0be00700 1 -- 172.21.15.82:0/2578274550 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e1c0b31e0 con 0x56359823b9d0 2024-05-08T06:00:50.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.277+0000 7f0e0be00700 1 -- 172.21.15.82:0/2578274550 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f0e24027020 con 0x56359823b9d0 2024-05-08T06:00:50.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.277+0000 7f0e3b45bb80 10 client.26335 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:00:50.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.277+0000 7f0e3b45bb80 10 client.26335 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-08T06:00:50.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.277+0000 7f0e3b45bb80 20 client.26335 populate_metadata read hostname 'smithi082' 2024-05-08T06:00:50.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.277+0000 7f0e3b45bb80 1 --2- 172.21.15.82:0/2578274550 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x5635982508b0 0x563598252ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:50.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.277+0000 7f0e3b45bb80 4 client.26335 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:00:50.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.277+0000 7f0e3b45bb80 1 -- 172.21.15.82:0/2578274550 --> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5635982040a0 con 0x5635982508b0 2024-05-08T06:00:50.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.278+0000 7f0e29e00700 1 --2- 172.21.15.82:0/2578274550 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x5635982508b0 0x563598252ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:50.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.278+0000 7f0e29e00700 1 --2- 172.21.15.82:0/2578274550 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x5635982508b0 0x563598252ca0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=817f18e1787aa469 server_cookie=50ac3735f209f0f5 in_seq=0 out_seq=0 2024-05-08T06:00:50.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.278+0000 7f0e0be00700 10 client.26335 ms_handle_connect on v2:172.21.15.151:6838/2963754236 2024-05-08T06:00:50.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.279+0000 7f0e0be00700 1 -- 172.21.15.82:0/2578274550 <== mds.1 v2:172.21.15.151:6838/2963754236 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5635982040a0 con 0x5635982508b0 2024-05-08T06:00:50.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.279+0000 7f0e0be00700 10 client.26335 handle_command_reply: tid=0 2024-05-08T06:00:50.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.279+0000 7f0e3b45bb80 1 client.26335 shutdown 2024-05-08T06:00:50.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.279+0000 7f0e3b45bb80 1 -- 172.21.15.82:0/2578274550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56359823b9d0 msgr2=0x5635982407a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:50.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.279+0000 7f0e3b45bb80 1 --2- 172.21.15.82:0/2578274550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56359823b9d0 0x5635982407a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f0e24007b70 tx=0x7f0e24007e80 comp rx=0 tx=0).stop 2024-05-08T06:00:50.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.279+0000 7f0e3b45bb80 1 -- 172.21.15.82:0/2578274550 shutdown_connections 2024-05-08T06:00:50.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.279+0000 7f0e3b45bb80 1 --2- 172.21.15.82:0/2578274550 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x5635982508b0 0x563598252ca0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:50.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.279+0000 7f0e0be00700 0 client.26335 ms_handle_reset on v2:172.21.15.151:6838/2963754236 2024-05-08T06:00:50.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.279+0000 7f0e3b45bb80 1 --2- 172.21.15.82:0/2578274550 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563598237060 0x563598242ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:50.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.279+0000 7f0e3b45bb80 1 --2- 172.21.15.82:0/2578274550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56359823b9d0 0x5635982407a0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:50.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.279+0000 7f0e3b45bb80 1 --2- 172.21.15.82:0/2578274550 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563598237980 0x563598240260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:50.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.279+0000 7f0e3b45bb80 1 -- 172.21.15.82:0/2578274550 >> 172.21.15.82:0/2578274550 conn(0x563598165b60 msgr2=0x56359822c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:00:50.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.280+0000 7f0e3b45bb80 1 -- 172.21.15.82:0/2578274550 shutdown_connections 2024-05-08T06:00:50.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.280+0000 7f0e3b45bb80 1 -- 172.21.15.82:0/2578274550 wait complete. 2024-05-08T06:00:50.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.280+0000 7f0e3b45bb80 20 client.26335 trim_cache size 0 max 16384 2024-05-08T06:00:50.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.301+0000 7f0e3b45bb80 1 Processor -- start 2024-05-08T06:00:50.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.301+0000 7f0e3b45bb80 1 -- start start 2024-05-08T06:00:50.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.301+0000 7f0e3b45bb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563598237060 0x56359823f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:50.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.301+0000 7f0e3b45bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563598237980 0x56359823db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:50.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.301+0000 7f0e3b45bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56359823b9d0 0x5635982585b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:50.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.301+0000 7f0e3b45bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0e2c074180 con 0x56359823b9d0 2024-05-08T06:00:50.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.301+0000 7f0e3b45bb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0e2c1be360 con 0x563598237060 2024-05-08T06:00:50.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.301+0000 7f0e3b45bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0e2c074850 con 0x563598237980 2024-05-08T06:00:50.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.302+0000 7f0e29e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563598237060 0x56359823f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:50.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.302+0000 7f0e29400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563598237980 0x56359823db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:50.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.302+0000 7f0e29e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563598237060 0x56359823f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:57938/0 (socket says 172.21.15.82:57938) 2024-05-08T06:00:50.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.302+0000 7f0e29e00700 1 -- 172.21.15.82:0/208306648 learned_addr learned my addr 172.21.15.82:0/208306648 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:00:50.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.302+0000 7f0e2a800700 1 --2- 172.21.15.82:0/208306648 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56359823b9d0 0x5635982585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:50.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.303+0000 7f0e29e00700 1 -- 172.21.15.82:0/208306648 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563598237980 msgr2=0x56359823db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:00:50.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.303+0000 7f0e29e00700 1 --2- 172.21.15.82:0/208306648 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563598237980 0x56359823db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:50.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.303+0000 7f0e29e00700 1 -- 172.21.15.82:0/208306648 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56359823b9d0 msgr2=0x5635982585b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:00:50.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.303+0000 7f0e29e00700 1 --2- 172.21.15.82:0/208306648 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56359823b9d0 0x5635982585b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:50.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.303+0000 7f0e29e00700 1 -- 172.21.15.82:0/208306648 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56359823e7f0 con 0x563598237060 2024-05-08T06:00:50.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.303+0000 7f0e29400700 1 --2- 172.21.15.82:0/208306648 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563598237980 0x56359823db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:00:50.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.303+0000 7f0e2a800700 1 --2- 172.21.15.82:0/208306648 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56359823b9d0 0x5635982585b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:00:50.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.303+0000 7f0e29e00700 1 --2- 172.21.15.82:0/208306648 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563598237060 0x56359823f1e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c0e08b0 tx=0x7f0e1c092040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5633c43f686497e0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:00:50.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.303+0000 7f0e16a00700 1 -- 172.21.15.82:0/208306648 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c0c3070 con 0x563598237060 2024-05-08T06:00:50.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.303+0000 7f0e16a00700 1 -- 172.21.15.82:0/208306648 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e1c0aa670 con 0x563598237060 2024-05-08T06:00:50.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.303+0000 7f0e16a00700 1 -- 172.21.15.82:0/208306648 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c004e00 con 0x563598237060 2024-05-08T06:00:50.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.304+0000 7f0e3b45bb80 1 -- 172.21.15.82:0/208306648 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563598237060 msgr2=0x56359823f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:50.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.304+0000 7f0e3b45bb80 1 --2- 172.21.15.82:0/208306648 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563598237060 0x56359823f1e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c0e08b0 tx=0x7f0e1c092040 comp rx=0 tx=0).stop 2024-05-08T06:00:50.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.304+0000 7f0e3b45bb80 1 -- 172.21.15.82:0/208306648 shutdown_connections 2024-05-08T06:00:50.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.304+0000 7f0e3b45bb80 1 --2- 172.21.15.82:0/208306648 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563598237060 0x56359823f1e0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:50.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.304+0000 7f0e3b45bb80 1 --2- 172.21.15.82:0/208306648 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56359823b9d0 0x5635982585b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:50.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.304+0000 7f0e3b45bb80 1 --2- 172.21.15.82:0/208306648 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563598237980 0x56359823db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:50.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.304+0000 7f0e3b45bb80 1 -- 172.21.15.82:0/208306648 >> 172.21.15.82:0/208306648 conn(0x563598165b60 msgr2=0x56359823d480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:00:50.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.304+0000 7f0e3b45bb80 1 -- 172.21.15.82:0/208306648 shutdown_connections 2024-05-08T06:00:50.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.305+0000 7f0e3b45bb80 1 -- 172.21.15.82:0/208306648 wait complete. 2024-05-08T06:00:50.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.305+0000 7f0e3b45bb80 1 -- start start 2024-05-08T06:00:50.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.305+0000 7f0e3b45bb80 1 Processor -- start 2024-05-08T06:00:50.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.306+0000 7f0e3b45bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563598237060 0x563598244cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:50.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.306+0000 7f0e3b45bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563598237980 0x5635982451f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:50.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.306+0000 7f0e3b45bb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56359823b9d0 0x5635982ba160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:50.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.306+0000 7f0e3b45bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0e2c1bdd60 con 0x563598237980 2024-05-08T06:00:50.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.306+0000 7f0e3b45bb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0e2c074f20 con 0x56359823b9d0 2024-05-08T06:00:50.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.306+0000 7f0e3b45bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0e2c072140 con 0x563598237060 2024-05-08T06:00:50.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.306+0000 7f0e3b45bb80 10 client.0 _ll_register_callbacks cb 0x563598130c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:00:50.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.306+0000 7f0e29400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563598237980 0x5635982451f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:50.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.306+0000 7f0e29400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563598237980 0x5635982451f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:42258/0 (socket says 172.21.15.82:42258) 2024-05-08T06:00:50.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.306+0000 7f0e29400700 1 -- 172.21.15.82:0/690102788 learned_addr learned my addr 172.21.15.82:0/690102788 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:00:50.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.307+0000 7f0e29e00700 1 --2- 172.21.15.82:0/690102788 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563598237060 0x563598244cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:50.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.307+0000 7f0e2a800700 1 --2- 172.21.15.82:0/690102788 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56359823b9d0 0x5635982ba160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:50.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.307+0000 7f0e29400700 1 -- 172.21.15.82:0/690102788 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563598237060 msgr2=0x563598244cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:00:50.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.307+0000 7f0e29400700 1 --2- 172.21.15.82:0/690102788 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563598237060 0x563598244cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:50.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.307+0000 7f0e29400700 1 -- 172.21.15.82:0/690102788 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56359823b9d0 msgr2=0x5635982ba160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:00:50.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.307+0000 7f0e29400700 1 --2- 172.21.15.82:0/690102788 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56359823b9d0 0x5635982ba160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:50.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.307+0000 7f0e29400700 1 -- 172.21.15.82:0/690102788 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5635982ba6a0 con 0x563598237980 2024-05-08T06:00:50.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.307+0000 7f0e29e00700 1 --2- 172.21.15.82:0/690102788 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563598237060 0x563598244cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:00:50.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.309+0000 7f0e29400700 1 --2- 172.21.15.82:0/690102788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563598237980 0x5635982451f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0e18009410 tx=0x7f0e180047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8e3f5f678c4f72f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:00:50.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.310+0000 7f0e0be00700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T06:00:50.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.312+0000 7f0e0be00700 1 -- 172.21.15.82:0/690102788 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e18004a30 con 0x563598237980 2024-05-08T06:00:50.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.312+0000 7f0e0be00700 1 -- 172.21.15.82:0/690102788 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f0e18004bd0 con 0x563598237980 2024-05-08T06:00:50.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.312+0000 7f0e3b45bb80 1 -- 172.21.15.82:0/690102788 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e1c0aa670 con 0x563598237980 2024-05-08T06:00:50.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.313+0000 7f0e0be00700 1 -- 172.21.15.82:0/690102788 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f0e18004dd0 con 0x563598237980 2024-05-08T06:00:50.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.313+0000 7f0e3b45bb80 10 client.15930 fetch_fsmap learned FSMap version 31 2024-05-08T06:00:50.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.313+0000 7f0e3b45bb80 1 -- 172.21.15.82:0/690102788 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5635982bb890 con 0x563598237980 2024-05-08T06:00:50.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.314+0000 7f0e0be00700 1 -- 172.21.15.82:0/690102788 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0e1c0aa670 con 0x563598237980 2024-05-08T06:00:50.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.314+0000 7f0e0be00700 1 -- 172.21.15.82:0/690102788 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f0e1800f040 con 0x563598237980 2024-05-08T06:00:50.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.314+0000 7f0e3b45bb80 10 client.15930 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:00:50.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.314+0000 7f0e3b45bb80 10 client.15930 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-08T06:00:50.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.314+0000 7f0e3b45bb80 20 client.15930 populate_metadata read hostname 'smithi082' 2024-05-08T06:00:50.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.314+0000 7f0e3b45bb80 1 --2- 172.21.15.82:0/690102788 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x5635982508b0 0x5635982bdff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:50.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.314+0000 7f0e3b45bb80 4 client.15930 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T06:00:50.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.314+0000 7f0e3b45bb80 1 -- 172.21.15.82:0/690102788 --> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563598197400 con 0x5635982508b0 2024-05-08T06:00:50.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.314+0000 7f0e29e00700 1 --2- 172.21.15.82:0/690102788 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x5635982508b0 0x5635982bdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:50.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.315+0000 7f0e29e00700 1 --2- 172.21.15.82:0/690102788 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x5635982508b0 0x5635982bdff0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=75b2631dce4ac1a5 server_cookie=cd115b03289a3ab4 in_seq=0 out_seq=0 2024-05-08T06:00:50.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.315+0000 7f0e0be00700 10 client.15930 ms_handle_connect on v2:172.21.15.151:6838/2963754236 2024-05-08T06:00:50.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.316+0000 7f0e0be00700 1 -- 172.21.15.82:0/690102788 <== mds.1 v2:172.21.15.151:6838/2963754236 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563598197400 con 0x5635982508b0 2024-05-08T06:00:50.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.316+0000 7f0e0be00700 10 client.15930 handle_command_reply: tid=0 2024-05-08T06:00:50.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.316+0000 7f0e3b45bb80 1 client.15930 shutdown 2024-05-08T06:00:50.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.316+0000 7f0e3b45bb80 1 -- 172.21.15.82:0/690102788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563598237980 msgr2=0x5635982451f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:50.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.316+0000 7f0e3b45bb80 1 --2- 172.21.15.82:0/690102788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563598237980 0x5635982451f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0e18009410 tx=0x7f0e180047c0 comp rx=0 tx=0).stop 2024-05-08T06:00:50.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.317+0000 7f0e3b45bb80 1 -- 172.21.15.82:0/690102788 shutdown_connections 2024-05-08T06:00:50.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.317+0000 7f0e3b45bb80 1 --2- 172.21.15.82:0/690102788 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x5635982508b0 0x5635982bdff0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:50.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.317+0000 7f0e3b45bb80 1 --2- 172.21.15.82:0/690102788 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56359823b9d0 0x5635982ba160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:50.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.317+0000 7f0e3b45bb80 1 --2- 172.21.15.82:0/690102788 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563598237060 0x563598244cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:50.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.317+0000 7f0e3b45bb80 1 --2- 172.21.15.82:0/690102788 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563598237980 0x5635982451f0 secure :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f0e18009410 tx=0x7f0e180047c0 comp rx=0 tx=0).stop 2024-05-08T06:00:50.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.317+0000 7f0e3b45bb80 1 -- 172.21.15.82:0/690102788 >> 172.21.15.82:0/690102788 conn(0x563598165b60 msgr2=0x56359822c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:00:50.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.317+0000 7f0e0be00700 0 client.15930 ms_handle_reset on v2:172.21.15.151:6838/2963754236 2024-05-08T06:00:50.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.318+0000 7f0e3b45bb80 1 -- 172.21.15.82:0/690102788 shutdown_connections 2024-05-08T06:00:50.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.318+0000 7f0e3b45bb80 1 -- 172.21.15.82:0/690102788 wait complete. 2024-05-08T06:00:50.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.318+0000 7f0e3b45bb80 20 client.15930 trim_cache size 0 max 16384 2024-05-08T06:00:50.320 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T06:00:50.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.319+0000 7f0e30a00700 1 -- 172.21.15.82:0/1702365926 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f0e100b28c0 msgr2=0x7f0e100b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:50.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.319+0000 7f0e30a00700 1 --2- 172.21.15.82:0/1702365926 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f0e100b28c0 0x7f0e100b4d80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0e18005fd0 tx=0x7f0e18005ee0 comp rx=0 tx=0).stop 2024-05-08T06:00:50.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.319+0000 7f0e30a00700 1 -- 172.21.15.82:0/1702365926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e2c1056e0 msgr2=0x7f0e2c1102f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:50.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.319+0000 7f0e30a00700 1 --2- 172.21.15.82:0/1702365926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e2c1056e0 0x7f0e2c1102f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c00fb40 tx=0x7f0e1c0050f0 comp rx=0 tx=0).stop 2024-05-08T06:00:50.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.319+0000 7f0e30a00700 1 -- 172.21.15.82:0/1702365926 shutdown_connections 2024-05-08T06:00:50.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.319+0000 7f0e30a00700 1 --2- 172.21.15.82:0/1702365926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e2c10b6e0 0x7f0e2c111a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:50.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.319+0000 7f0e30a00700 1 --2- 172.21.15.82:0/1702365926 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f0e100b28c0 0x7f0e100b4d80 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:50.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.319+0000 7f0e30a00700 1 --2- 172.21.15.82:0/1702365926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e2c1056e0 0x7f0e2c1102f0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:50.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.319+0000 7f0e30a00700 1 --2- 172.21.15.82:0/1702365926 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0e2c1060a0 0x7f0e2c110830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:50.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.319+0000 7f0e30a00700 1 -- 172.21.15.82:0/1702365926 >> 172.21.15.82:0/1702365926 conn(0x7f0e2c1011d0 msgr2=0x7f0e2c1019a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:00:50.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.319+0000 7f0e30a00700 1 -- 172.21.15.82:0/1702365926 shutdown_connections 2024-05-08T06:00:50.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:50.320+0000 7f0e30a00700 1 -- 172.21.15.82:0/1702365926 wait complete. 2024-05-08T06:00:50.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:00:50 smithi151 ceph-mon[34815]: pgmap v764: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.0 MiB/s wr, 614 op/s 2024-05-08T06:00:50.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:00:50 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:00:50.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:00:50 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:00:50.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:00:50 smithi134 ceph-mon[34132]: pgmap v764: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.0 MiB/s wr, 614 op/s 2024-05-08T06:00:50.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:00:50 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:00:50.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:00:50 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:00:51.236 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-05-08T06:00:51.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:00:51 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T06:00:51.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:00:51 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T06:00:51.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:00:51 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T06:00:51.800 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:00:52.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:00:52 smithi082 ceph-mon[30098]: pgmap v765: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.1 MiB/s wr, 729 op/s 2024-05-08T06:00:52.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:00:52 smithi151 ceph-mon[34815]: pgmap v765: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.1 MiB/s wr, 729 op/s 2024-05-08T06:00:52.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:00:52 smithi134 ceph-mon[34132]: pgmap v765: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.1 MiB/s wr, 729 op/s 2024-05-08T06:00:54.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.318+0000 7ffa14400700 1 -- 172.21.15.82:0/3874648941 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa0c06bb70 msgr2=0x7ffa0c06bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:54.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.318+0000 7ffa14400700 1 --2- 172.21.15.82:0/3874648941 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa0c06bb70 0x7ffa0c06bff0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7ff9f8009990 tx=0x7ff9f8009ca0 comp rx=0 tx=0).stop 2024-05-08T06:00:54.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.319+0000 7ffa14400700 1 -- 172.21.15.82:0/3874648941 shutdown_connections 2024-05-08T06:00:54.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.319+0000 7ffa14400700 1 --2- 172.21.15.82:0/3874648941 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa0c06c530 0x7ffa0c110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:54.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.319+0000 7ffa14400700 1 --2- 172.21.15.82:0/3874648941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa0c109520 0x7ffa0c109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:54.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.319+0000 7ffa14400700 1 --2- 172.21.15.82:0/3874648941 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa0c06bb70 0x7ffa0c06bff0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:54.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.319+0000 7ffa14400700 1 -- 172.21.15.82:0/3874648941 >> 172.21.15.82:0/3874648941 conn(0x7ffa0c079350 msgr2=0x7ffa0c079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:00:54.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.319+0000 7ffa14400700 1 -- 172.21.15.82:0/3874648941 shutdown_connections 2024-05-08T06:00:54.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.319+0000 7ffa14400700 1 -- 172.21.15.82:0/3874648941 wait complete. 2024-05-08T06:00:54.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.320+0000 7ffa14400700 1 Processor -- start 2024-05-08T06:00:54.321 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.320+0000 7ffa14400700 1 -- start start 2024-05-08T06:00:54.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.321+0000 7ffa14400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa0c06bb70 0x7ffa0c19d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:54.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.321+0000 7ffa14400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa0c06c530 0x7ffa0c19dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:54.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.321+0000 7ffa14400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa0c109520 0x7ffa0c1977e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:54.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.321+0000 7ffa14400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ffa0c1114a0 con 0x7ffa0c06c530 2024-05-08T06:00:54.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.321+0000 7ffa14400700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ffa0c111320 con 0x7ffa0c06bb70 2024-05-08T06:00:54.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.321+0000 7ffa14400700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ffa0c111620 con 0x7ffa0c109520 2024-05-08T06:00:54.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.322+0000 7ffa12400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa0c109520 0x7ffa0c1977e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:54.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.322+0000 7ffa11a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa0c06bb70 0x7ffa0c19d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:54.323 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.322+0000 7ffa11a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa0c06bb70 0x7ffa0c19d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:57538/0 (socket says 172.21.15.82:57538) 2024-05-08T06:00:54.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.322+0000 7ffa12400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa0c109520 0x7ffa0c1977e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:60026/0 (socket says 172.21.15.82:60026) 2024-05-08T06:00:54.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.322+0000 7ffa11a00700 1 -- 172.21.15.82:0/1533907324 learned_addr learned my addr 172.21.15.82:0/1533907324 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:00:54.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.322+0000 7ffa11a00700 1 -- 172.21.15.82:0/1533907324 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa0c109520 msgr2=0x7ffa0c1977e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:54.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.322+0000 7ffa11a00700 1 --2- 172.21.15.82:0/1533907324 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa0c109520 0x7ffa0c1977e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:54.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.322+0000 7ffa11a00700 1 -- 172.21.15.82:0/1533907324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa0c06c530 msgr2=0x7ffa0c19dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:54.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.322+0000 7ffa11a00700 1 --2- 172.21.15.82:0/1533907324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa0c06c530 0x7ffa0c19dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:54.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.322+0000 7ffa11a00700 1 -- 172.21.15.82:0/1533907324 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa0c197fc0 con 0x7ffa0c06bb70 2024-05-08T06:00:54.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.323+0000 7ffa11a00700 1 --2- 172.21.15.82:0/1533907324 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa0c06bb70 0x7ffa0c19d660 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ffa00007440 tx=0x7ffa00007750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:00:54.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.323+0000 7ffa0a000700 1 -- 172.21.15.82:0/1533907324 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0001d5f0 con 0x7ffa0c06bb70 2024-05-08T06:00:54.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.323+0000 7ffa14400700 1 -- 172.21.15.82:0/1533907324 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa0c1982b0 con 0x7ffa0c06bb70 2024-05-08T06:00:54.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.323+0000 7ffa0a000700 1 -- 172.21.15.82:0/1533907324 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa00022070 con 0x7ffa0c06bb70 2024-05-08T06:00:54.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.323+0000 7ffa0a000700 1 -- 172.21.15.82:0/1533907324 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0001ca50 con 0x7ffa0c06bb70 2024-05-08T06:00:54.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.323+0000 7ffa14400700 1 -- 172.21.15.82:0/1533907324 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa0c1a44c0 con 0x7ffa0c06bb70 2024-05-08T06:00:54.331 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.330+0000 7ffa0a000700 1 -- 172.21.15.82:0/1533907324 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7ffa0001cbf0 con 0x7ffa0c06bb70 2024-05-08T06:00:54.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.332+0000 7ffa0a000700 1 --2- 172.21.15.82:0/1533907324 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff9f40b2980 0x7ff9f40b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:54.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.332+0000 7ffa0a000700 1 -- 172.21.15.82:0/1533907324 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7ffa000e9e10 con 0x7ffa0c06bb70 2024-05-08T06:00:54.333 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.333+0000 7ffa11000700 1 --2- 172.21.15.82:0/1533907324 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff9f40b2980 0x7ff9f40b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:54.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.333+0000 7ffa1ed90b80 1 Processor -- start 2024-05-08T06:00:54.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.333+0000 7ffa1ed90b80 1 -- start start 2024-05-08T06:00:54.334 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.334+0000 7ffa11000700 1 --2- 172.21.15.82:0/1533907324 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff9f40b2980 0x7ff9f40b4e40 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff9f80098e0 tx=0x7ff9f8005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:00:54.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.336+0000 7ffa1ed90b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a4ff5ed060 0x55a4ff5ed440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:54.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.337+0000 7ffa1ed90b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a4ff5ed980 0x55a4ff5f1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:54.337 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.337+0000 7ffa1ed90b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a4ff5f19d0 0x55a4ff5f1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:54.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.337+0000 7ffa11a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a4ff5ed060 0x55a4ff5ed440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:54.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.337+0000 7ffa1ed90b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a4ff53fa20 con 0x55a4ff5ed980 2024-05-08T06:00:54.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.337+0000 7ffa1ed90b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a4ff4dd760 con 0x55a4ff5ed060 2024-05-08T06:00:54.338 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.337+0000 7ffa1ed90b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55a4ff53b9e0 con 0x55a4ff5f19d0 2024-05-08T06:00:54.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.337+0000 7ffa11a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a4ff5ed060 0x55a4ff5ed440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:57542/0 (socket says 172.21.15.82:57542) 2024-05-08T06:00:54.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.337+0000 7ffa11a00700 1 -- 172.21.15.82:0/4153780667 learned_addr learned my addr 172.21.15.82:0/4153780667 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:00:54.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.338+0000 7ffa12400700 1 --2- 172.21.15.82:0/4153780667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a4ff5f19d0 0x55a4ff5f1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:54.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.338+0000 7ffa11000700 1 --2- 172.21.15.82:0/4153780667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a4ff5ed980 0x55a4ff5f1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:54.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.338+0000 7ffa11a00700 1 -- 172.21.15.82:0/4153780667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a4ff5f19d0 msgr2=0x55a4ff5f1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:00:54.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.338+0000 7ffa11a00700 1 --2- 172.21.15.82:0/4153780667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a4ff5f19d0 0x55a4ff5f1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:54.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.338+0000 7ffa11a00700 1 -- 172.21.15.82:0/4153780667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a4ff5ed980 msgr2=0x55a4ff5f1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:00:54.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.338+0000 7ffa11a00700 1 --2- 172.21.15.82:0/4153780667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a4ff5ed980 0x55a4ff5f1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:54.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.338+0000 7ffa11a00700 1 -- 172.21.15.82:0/4153780667 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4ff48c8d0 con 0x55a4ff5ed060 2024-05-08T06:00:54.339 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.338+0000 7ffa11000700 1 --2- 172.21.15.82:0/4153780667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a4ff5ed980 0x55a4ff5f1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:00:54.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.338+0000 7ffa11a00700 1 --2- 172.21.15.82:0/4153780667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a4ff5ed060 0x55a4ff5ed440 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ffa000ae650 tx=0x7ffa0001c350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12eeda87b2ded6bd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:00:54.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.338+0000 7ff9fea00700 1 -- 172.21.15.82:0/4153780667 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa000b13e0 con 0x55a4ff5ed060 2024-05-08T06:00:54.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.339+0000 7ff9fea00700 1 -- 172.21.15.82:0/4153780667 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa000b5790 con 0x55a4ff5ed060 2024-05-08T06:00:54.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.339+0000 7ff9fea00700 1 -- 172.21.15.82:0/4153780667 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa000b9db0 con 0x55a4ff5ed060 2024-05-08T06:00:54.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.340+0000 7ffa1ed90b80 1 -- 172.21.15.82:0/4153780667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a4ff5ed060 msgr2=0x55a4ff5ed440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:54.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.341+0000 7ffa1ed90b80 1 --2- 172.21.15.82:0/4153780667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a4ff5ed060 0x55a4ff5ed440 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ffa000ae650 tx=0x7ffa0001c350 comp rx=0 tx=0).stop 2024-05-08T06:00:54.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.342+0000 7ffa1ed90b80 1 -- 172.21.15.82:0/4153780667 shutdown_connections 2024-05-08T06:00:54.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.342+0000 7ffa1ed90b80 1 --2- 172.21.15.82:0/4153780667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a4ff5ed060 0x55a4ff5ed440 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:54.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.342+0000 7ffa1ed90b80 1 --2- 172.21.15.82:0/4153780667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a4ff5f19d0 0x55a4ff5f1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:54.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.342+0000 7ffa1ed90b80 1 --2- 172.21.15.82:0/4153780667 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a4ff5ed980 0x55a4ff5f1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:54.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.342+0000 7ffa1ed90b80 1 -- 172.21.15.82:0/4153780667 >> 172.21.15.82:0/4153780667 conn(0x55a4ff51bb60 msgr2=0x55a4ff5e77a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:00:54.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.343+0000 7ffa1ed90b80 1 -- 172.21.15.82:0/4153780667 shutdown_connections 2024-05-08T06:00:54.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.343+0000 7ffa1ed90b80 1 -- 172.21.15.82:0/4153780667 wait complete. 2024-05-08T06:00:54.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.344+0000 7ffa1ed90b80 1 -- start start 2024-05-08T06:00:54.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.344+0000 7ffa1ed90b80 1 Processor -- start 2024-05-08T06:00:54.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.345+0000 7ffa1ed90b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a4ff5ed060 0x55a4ff5f8f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:54.351 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:00:54 smithi082 ceph-mon[30098]: pgmap v766: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.2 MiB/s wr, 533 op/s 2024-05-08T06:00:54.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.345+0000 7ffa1ed90b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a4ff5ed980 0x55a4ff5f62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:54.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.345+0000 7ffa1ed90b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a4ff5f19d0 0x55a4ff5f67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:54.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.345+0000 7ffa1ed90b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a4ff5f9be0 con 0x55a4ff5f19d0 2024-05-08T06:00:54.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.345+0000 7ffa1ed90b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a4ff4a5b20 con 0x55a4ff5ed980 2024-05-08T06:00:54.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.345+0000 7ffa1ed90b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55a4ff5f9d60 con 0x55a4ff5ed060 2024-05-08T06:00:54.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.345+0000 7ffa1ed90b80 10 client.0 _ll_register_callbacks cb 0x55a4ff4e6c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:00:54.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.346+0000 7ffa12400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a4ff5f19d0 0x55a4ff5f67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:54.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.346+0000 7ffa12400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a4ff5f19d0 0x55a4ff5f67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54662/0 (socket says 172.21.15.82:54662) 2024-05-08T06:00:54.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.346+0000 7ffa12400700 1 -- 172.21.15.82:0/1990283064 learned_addr learned my addr 172.21.15.82:0/1990283064 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:00:54.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.348+0000 7ffa12400700 1 -- 172.21.15.82:0/1990283064 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a4ff5ed060 msgr2=0x55a4ff5f8f00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T06:00:54.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.348+0000 7ffa11a00700 1 --2- 172.21.15.82:0/1990283064 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a4ff5ed060 0x55a4ff5f8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:54.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.348+0000 7ffa12400700 1 --2- 172.21.15.82:0/1990283064 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a4ff5ed060 0x55a4ff5f8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:54.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.348+0000 7ffa12400700 1 -- 172.21.15.82:0/1990283064 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a4ff5ed980 msgr2=0x55a4ff5f62a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T06:00:54.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.348+0000 7ffa12400700 1 --2- 172.21.15.82:0/1990283064 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a4ff5ed980 0x55a4ff5f62a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:54.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.348+0000 7ffa12400700 1 -- 172.21.15.82:0/1990283064 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4ff505420 con 0x55a4ff5f19d0 2024-05-08T06:00:54.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.348+0000 7ffa11a00700 1 --2- 172.21.15.82:0/1990283064 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a4ff5ed060 0x55a4ff5f8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:00:54.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.349+0000 7ffa12400700 1 --2- 172.21.15.82:0/1990283064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a4ff5f19d0 0x55a4ff5f67e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ffa04007ed0 tx=0x7ffa0400f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4ebcdf1968f76ca server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:00:54.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.349+0000 7ff9f3400700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T06:00:54.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.350+0000 7ff9f3400700 1 -- 172.21.15.82:0/1990283064 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa0401e060 con 0x55a4ff5f19d0 2024-05-08T06:00:54.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.350+0000 7ff9f3400700 1 -- 172.21.15.82:0/1990283064 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7ffa0400fbf0 con 0x55a4ff5f19d0 2024-05-08T06:00:54.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.350+0000 7ffa1ed90b80 1 -- 172.21.15.82:0/1990283064 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa000b5790 con 0x55a4ff5f19d0 2024-05-08T06:00:54.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.350+0000 7ff9f3400700 1 -- 172.21.15.82:0/1990283064 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7ffa0400fdf0 con 0x55a4ff5f19d0 2024-05-08T06:00:54.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.350+0000 7ffa1ed90b80 10 client.15936 fetch_fsmap learned FSMap version 31 2024-05-08T06:00:54.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.350+0000 7ffa1ed90b80 1 -- 172.21.15.82:0/1990283064 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a4ff6154d0 con 0x55a4ff5f19d0 2024-05-08T06:00:54.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.350+0000 7ff9f3400700 1 -- 172.21.15.82:0/1990283064 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa000b5790 con 0x55a4ff5f19d0 2024-05-08T06:00:54.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.350+0000 7ff9f3400700 1 -- 172.21.15.82:0/1990283064 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7ffa04018070 con 0x55a4ff5f19d0 2024-05-08T06:00:54.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.351+0000 7ffa1ed90b80 10 client.15936 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:00:54.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.351+0000 7ffa1ed90b80 10 client.15936 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T06:00:54.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.351+0000 7ffa1ed90b80 20 client.15936 populate_metadata read hostname 'smithi082' 2024-05-08T06:00:54.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.351+0000 7ffa1ed90b80 1 --2- 172.21.15.82:0/1990283064 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55a4ff617b60 0x55a4ff619f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:54.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.351+0000 7ffa1ed90b80 4 client.15936 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:00:54.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.351+0000 7ffa1ed90b80 1 -- 172.21.15.82:0/1990283064 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a4ff5ba0a0 con 0x55a4ff617b60 2024-05-08T06:00:54.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.351+0000 7ffa11a00700 1 --2- 172.21.15.82:0/1990283064 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55a4ff617b60 0x55a4ff619f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:54.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.351+0000 7ffa11a00700 1 --2- 172.21.15.82:0/1990283064 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55a4ff617b60 0x55a4ff619f90 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8cd0ec371d46c8e2 server_cookie=e9725519fc9ca91c in_seq=0 out_seq=0 2024-05-08T06:00:54.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.351+0000 7ff9f3400700 10 client.15936 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T06:00:54.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.352+0000 7ff9f3400700 1 -- 172.21.15.82:0/1990283064 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a4ff5ba0a0 con 0x55a4ff617b60 2024-05-08T06:00:54.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.352+0000 7ff9f3400700 10 client.15936 handle_command_reply: tid=0 2024-05-08T06:00:54.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.352+0000 7ffa1ed90b80 1 client.15936 shutdown 2024-05-08T06:00:54.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.353+0000 7ffa1ed90b80 1 -- 172.21.15.82:0/1990283064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a4ff5f19d0 msgr2=0x55a4ff5f67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:54.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.353+0000 7ffa1ed90b80 1 --2- 172.21.15.82:0/1990283064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a4ff5f19d0 0x55a4ff5f67e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ffa04007ed0 tx=0x7ffa0400f1b0 comp rx=0 tx=0).stop 2024-05-08T06:00:54.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.353+0000 7ffa1ed90b80 1 -- 172.21.15.82:0/1990283064 shutdown_connections 2024-05-08T06:00:54.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.353+0000 7ffa1ed90b80 1 --2- 172.21.15.82:0/1990283064 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a4ff5f19d0 0x55a4ff5f67e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:54.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.353+0000 7ffa1ed90b80 1 --2- 172.21.15.82:0/1990283064 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a4ff5ed060 0x55a4ff5f8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:54.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.353+0000 7ffa1ed90b80 1 --2- 172.21.15.82:0/1990283064 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55a4ff617b60 0x55a4ff619f90 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:54.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.353+0000 7ffa1ed90b80 1 --2- 172.21.15.82:0/1990283064 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a4ff5ed980 0x55a4ff5f62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:54.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.353+0000 7ffa1ed90b80 1 -- 172.21.15.82:0/1990283064 >> 172.21.15.82:0/1990283064 conn(0x55a4ff51bb60 msgr2=0x55a4ff5e22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:00:54.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.353+0000 7ff9f3400700 0 client.15936 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T06:00:54.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.354+0000 7ffa1ed90b80 1 -- 172.21.15.82:0/1990283064 shutdown_connections 2024-05-08T06:00:54.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.354+0000 7ffa1ed90b80 1 -- 172.21.15.82:0/1990283064 wait complete. 2024-05-08T06:00:54.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.355+0000 7ffa1ed90b80 20 client.15936 trim_cache size 0 max 16384 2024-05-08T06:00:54.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:00:54 smithi151 ceph-mon[34815]: pgmap v766: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.2 MiB/s wr, 533 op/s 2024-05-08T06:00:54.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.381+0000 7ffa1ed90b80 1 Processor -- start 2024-05-08T06:00:54.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.382+0000 7ffa1ed90b80 1 -- start start 2024-05-08T06:00:54.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.382+0000 7ffa1ed90b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a4ff5ed060 0x55a4ff5f6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:54.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.382+0000 7ffa1ed90b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a4ff5ed980 0x55a4ff61f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:54.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.382+0000 7ffa1ed90b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a4ff5f19d0 0x55a4ff61fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:54.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.383+0000 7ffa1ed90b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ffa0c074170 con 0x55a4ff5ed980 2024-05-08T06:00:54.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.383+0000 7ffa1ed90b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ffa0c1a4dc0 con 0x55a4ff5f19d0 2024-05-08T06:00:54.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.383+0000 7ffa1ed90b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ffa0c074840 con 0x55a4ff5ed060 2024-05-08T06:00:54.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.383+0000 7ffa11a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a4ff5ed060 0x55a4ff5f6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:54.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.383+0000 7ffa11a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a4ff5ed060 0x55a4ff5f6870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:60050/0 (socket says 172.21.15.82:60050) 2024-05-08T06:00:54.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.383+0000 7ffa11a00700 1 -- 172.21.15.82:0/3218988023 learned_addr learned my addr 172.21.15.82:0/3218988023 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:00:54.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.383+0000 7ffa11000700 1 --2- 172.21.15.82:0/3218988023 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a4ff5ed980 0x55a4ff61f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:54.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.383+0000 7ffa12400700 1 --2- 172.21.15.82:0/3218988023 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a4ff5f19d0 0x55a4ff61fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:54.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.383+0000 7ffa11a00700 1 -- 172.21.15.82:0/3218988023 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a4ff5f19d0 msgr2=0x55a4ff61fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:00:54.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.383+0000 7ffa11a00700 1 --2- 172.21.15.82:0/3218988023 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a4ff5f19d0 0x55a4ff61fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:54.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.383+0000 7ffa11a00700 1 -- 172.21.15.82:0/3218988023 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a4ff5ed980 msgr2=0x55a4ff61f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:00:54.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.384+0000 7ffa11a00700 1 --2- 172.21.15.82:0/3218988023 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a4ff5ed980 0x55a4ff61f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:54.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.384+0000 7ffa11a00700 1 -- 172.21.15.82:0/3218988023 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a4ff5e89c0 con 0x55a4ff5ed060 2024-05-08T06:00:54.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.384+0000 7ffa12400700 1 --2- 172.21.15.82:0/3218988023 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a4ff5f19d0 0x55a4ff61fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:00:54.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.384+0000 7ffa11000700 1 --2- 172.21.15.82:0/3218988023 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a4ff5ed980 0x55a4ff61f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:00:54.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.384+0000 7ffa11a00700 1 --2- 172.21.15.82:0/3218988023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a4ff5ed060 0x55a4ff5f6870 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ffa000b1090 tx=0x7ffa0001c4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa969cd481cde61a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:00:54.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.384+0000 7ff9fe000700 1 -- 172.21.15.82:0/3218988023 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa000b5790 con 0x55a4ff5ed060 2024-05-08T06:00:54.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.384+0000 7ff9fe000700 1 -- 172.21.15.82:0/3218988023 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa000ad670 con 0x55a4ff5ed060 2024-05-08T06:00:54.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.384+0000 7ff9fe000700 1 -- 172.21.15.82:0/3218988023 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa000ba010 con 0x55a4ff5ed060 2024-05-08T06:00:54.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.385+0000 7ffa1ed90b80 1 -- 172.21.15.82:0/3218988023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a4ff5ed060 msgr2=0x55a4ff5f6870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:54.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.385+0000 7ffa1ed90b80 1 --2- 172.21.15.82:0/3218988023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a4ff5ed060 0x55a4ff5f6870 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7ffa000b1090 tx=0x7ffa0001c4f0 comp rx=0 tx=0).stop 2024-05-08T06:00:54.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.385+0000 7ffa1ed90b80 1 -- 172.21.15.82:0/3218988023 shutdown_connections 2024-05-08T06:00:54.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.385+0000 7ffa1ed90b80 1 --2- 172.21.15.82:0/3218988023 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a4ff5f19d0 0x55a4ff61fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:54.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.385+0000 7ffa1ed90b80 1 --2- 172.21.15.82:0/3218988023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a4ff5ed060 0x55a4ff5f6870 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:54.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.385+0000 7ffa1ed90b80 1 --2- 172.21.15.82:0/3218988023 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a4ff5ed980 0x55a4ff61f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:54.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.385+0000 7ffa1ed90b80 1 -- 172.21.15.82:0/3218988023 >> 172.21.15.82:0/3218988023 conn(0x55a4ff51bb60 msgr2=0x55a4ff5e22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:00:54.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.386+0000 7ffa1ed90b80 1 -- 172.21.15.82:0/3218988023 shutdown_connections 2024-05-08T06:00:54.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.386+0000 7ffa1ed90b80 1 -- 172.21.15.82:0/3218988023 wait complete. 2024-05-08T06:00:54.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.386+0000 7ffa1ed90b80 1 -- start start 2024-05-08T06:00:54.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.387+0000 7ffa1ed90b80 1 Processor -- start 2024-05-08T06:00:54.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.389+0000 7ffa1ed90b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a4ff5ed060 0x55a4ff5ff480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:54.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.390+0000 7ffa1ed90b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a4ff5ed980 0x55a4ff5fc820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:54.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.390+0000 7ffa1ed90b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a4ff5f19d0 0x55a4ff5fcd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:54.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.390+0000 7ffa1ed90b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ffa0c1a47e0 con 0x55a4ff5ed980 2024-05-08T06:00:54.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.390+0000 7ffa1ed90b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ffa0c074f10 con 0x55a4ff5ed060 2024-05-08T06:00:54.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.390+0000 7ffa1ed90b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ffa0c072110 con 0x55a4ff5f19d0 2024-05-08T06:00:54.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.390+0000 7ffa1ed90b80 10 client.0 _ll_register_callbacks cb 0x55a4ff4e6c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:00:54.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.390+0000 7ffa11a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a4ff5ed060 0x55a4ff5ff480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:54.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.390+0000 7ffa11a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a4ff5ed060 0x55a4ff5ff480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:57586/0 (socket says 172.21.15.82:57586) 2024-05-08T06:00:54.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.390+0000 7ffa11a00700 1 -- 172.21.15.82:0/2086561202 learned_addr learned my addr 172.21.15.82:0/2086561202 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:00:54.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.390+0000 7ffa11000700 1 --2- 172.21.15.82:0/2086561202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a4ff5ed980 0x55a4ff5fc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:54.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.391+0000 7ffa11a00700 1 -- 172.21.15.82:0/2086561202 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a4ff5f19d0 msgr2=0x55a4ff5fcd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:00:54.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.391+0000 7ffa11a00700 1 --2- 172.21.15.82:0/2086561202 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a4ff5f19d0 0x55a4ff5fcd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:54.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.391+0000 7ffa11a00700 1 -- 172.21.15.82:0/2086561202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a4ff5ed980 msgr2=0x55a4ff5fc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:00:54.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.391+0000 7ffa11a00700 1 --2- 172.21.15.82:0/2086561202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a4ff5ed980 0x55a4ff5fc820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:54.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.391+0000 7ffa11a00700 1 -- 172.21.15.82:0/2086561202 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a4ff5fd5a0 con 0x55a4ff5ed060 2024-05-08T06:00:54.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.391+0000 7ffa11a00700 1 --2- 172.21.15.82:0/2086561202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a4ff5ed060 0x55a4ff5ff480 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ffa000b1370 tx=0x7ffa00000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83368bfb576839b0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:00:54.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.391+0000 7ff9f3400700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T06:00:54.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.391+0000 7ff9f3400700 1 -- 172.21.15.82:0/2086561202 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa000cb060 con 0x55a4ff5ed060 2024-05-08T06:00:54.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.392+0000 7ffa1ed90b80 1 -- 172.21.15.82:0/2086561202 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa000ad670 con 0x55a4ff5ed060 2024-05-08T06:00:54.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.392+0000 7ff9f3400700 1 -- 172.21.15.82:0/2086561202 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7ffa000b9fc0 con 0x55a4ff5ed060 2024-05-08T06:00:54.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.392+0000 7ff9f3400700 1 -- 172.21.15.82:0/2086561202 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7ffa000b0640 con 0x55a4ff5ed060 2024-05-08T06:00:54.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.392+0000 7ffa1ed90b80 10 client.26324 fetch_fsmap learned FSMap version 31 2024-05-08T06:00:54.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.392+0000 7ffa1ed90b80 1 -- 172.21.15.82:0/2086561202 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a4ff682350 con 0x55a4ff5ed060 2024-05-08T06:00:54.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.392+0000 7ff9f3400700 1 -- 172.21.15.82:0/2086561202 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ffa000ad670 con 0x55a4ff5ed060 2024-05-08T06:00:54.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.392+0000 7ff9f3400700 1 -- 172.21.15.82:0/2086561202 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7ffa000abb00 con 0x55a4ff5ed060 2024-05-08T06:00:54.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.392+0000 7ffa1ed90b80 10 client.26324 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:00:54.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.392+0000 7ffa1ed90b80 10 client.26324 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T06:00:54.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.392+0000 7ffa1ed90b80 20 client.26324 populate_metadata read hostname 'smithi082' 2024-05-08T06:00:54.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.392+0000 7ffa1ed90b80 1 --2- 172.21.15.82:0/2086561202 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55a4ff682350 0x55a4ff684740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:54.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.392+0000 7ffa1ed90b80 4 client.26324 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T06:00:54.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.392+0000 7ffa1ed90b80 1 -- 172.21.15.82:0/2086561202 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a4ff54d400 con 0x55a4ff682350 2024-05-08T06:00:54.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.393+0000 7ffa11000700 1 --2- 172.21.15.82:0/2086561202 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55a4ff682350 0x55a4ff684740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:54.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.394+0000 7ffa11000700 1 --2- 172.21.15.82:0/2086561202 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55a4ff682350 0x55a4ff684740 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ccbfcd28557069b8 server_cookie=cd048e39181baa43 in_seq=0 out_seq=0 2024-05-08T06:00:54.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.394+0000 7ff9f3400700 10 client.26324 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T06:00:54.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.394+0000 7ff9f3400700 1 -- 172.21.15.82:0/2086561202 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a4ff54d400 con 0x55a4ff682350 2024-05-08T06:00:54.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.394+0000 7ff9f3400700 10 client.26324 handle_command_reply: tid=0 2024-05-08T06:00:54.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.394+0000 7ffa1ed90b80 1 client.26324 shutdown 2024-05-08T06:00:54.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.395+0000 7ffa1ed90b80 1 -- 172.21.15.82:0/2086561202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a4ff5ed060 msgr2=0x55a4ff5ff480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:54.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.395+0000 7ffa1ed90b80 1 --2- 172.21.15.82:0/2086561202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a4ff5ed060 0x55a4ff5ff480 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ffa000b1370 tx=0x7ffa00000bc0 comp rx=0 tx=0).stop 2024-05-08T06:00:54.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.395+0000 7ffa1ed90b80 1 -- 172.21.15.82:0/2086561202 shutdown_connections 2024-05-08T06:00:54.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.395+0000 7ffa1ed90b80 1 --2- 172.21.15.82:0/2086561202 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55a4ff682350 0x55a4ff684740 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:54.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.395+0000 7ffa1ed90b80 1 --2- 172.21.15.82:0/2086561202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a4ff5ed060 0x55a4ff5ff480 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:54.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.395+0000 7ffa1ed90b80 1 --2- 172.21.15.82:0/2086561202 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a4ff5f19d0 0x55a4ff5fcd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:54.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.395+0000 7ffa1ed90b80 1 --2- 172.21.15.82:0/2086561202 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a4ff5ed980 0x55a4ff5fc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:54.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.395+0000 7ffa1ed90b80 1 -- 172.21.15.82:0/2086561202 >> 172.21.15.82:0/2086561202 conn(0x55a4ff51bb60 msgr2=0x55a4ff5ebe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:00:54.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.395+0000 7ff9f3400700 0 client.26324 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T06:00:54.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.395+0000 7ffa1ed90b80 1 -- 172.21.15.82:0/2086561202 shutdown_connections 2024-05-08T06:00:54.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.396+0000 7ffa1ed90b80 1 -- 172.21.15.82:0/2086561202 wait complete. 2024-05-08T06:00:54.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.396+0000 7ffa1ed90b80 20 client.26324 trim_cache size 0 max 16384 2024-05-08T06:00:54.398 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T06:00:54.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.397+0000 7ffa14400700 1 -- 172.21.15.82:0/1533907324 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff9f40b2980 msgr2=0x7ff9f40b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:54.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.397+0000 7ffa14400700 1 --2- 172.21.15.82:0/1533907324 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff9f40b2980 0x7ff9f40b4e40 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff9f80098e0 tx=0x7ff9f8005fb0 comp rx=0 tx=0).stop 2024-05-08T06:00:54.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.397+0000 7ffa14400700 1 -- 172.21.15.82:0/1533907324 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa0c06bb70 msgr2=0x7ffa0c19d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:54.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.397+0000 7ffa14400700 1 --2- 172.21.15.82:0/1533907324 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa0c06bb70 0x7ffa0c19d660 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ffa00007440 tx=0x7ffa00007750 comp rx=0 tx=0).stop 2024-05-08T06:00:54.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.397+0000 7ffa14400700 1 -- 172.21.15.82:0/1533907324 shutdown_connections 2024-05-08T06:00:54.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.397+0000 7ffa14400700 1 --2- 172.21.15.82:0/1533907324 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa0c06bb70 0x7ffa0c19d660 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:54.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.397+0000 7ffa14400700 1 --2- 172.21.15.82:0/1533907324 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff9f40b2980 0x7ff9f40b4e40 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:54.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.397+0000 7ffa14400700 1 --2- 172.21.15.82:0/1533907324 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa0c109520 0x7ffa0c1977e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:54.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.397+0000 7ffa14400700 1 --2- 172.21.15.82:0/1533907324 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ffa0c06c530 0x7ffa0c19dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:54.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.397+0000 7ffa14400700 1 -- 172.21.15.82:0/1533907324 >> 172.21.15.82:0/1533907324 conn(0x7ffa0c079350 msgr2=0x7ffa0c101550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:00:54.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.397+0000 7ffa14400700 1 -- 172.21.15.82:0/1533907324 shutdown_connections 2024-05-08T06:00:54.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:54.397+0000 7ffa14400700 1 -- 172.21.15.82:0/1533907324 wait complete. 2024-05-08T06:00:54.499 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:00:54 smithi134 ceph-mon[34132]: pgmap v766: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.2 MiB/s wr, 533 op/s 2024-05-08T06:00:55.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 605.0 s, 1401.6 tps, lat 72.537 ms stddev 82.045 2024-05-08T06:00:56.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:00:56 smithi151 ceph-mon[34815]: pgmap v767: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 5.9 MiB/s wr, 590 op/s 2024-05-08T06:00:56.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:00:56 smithi082 ceph-mon[30098]: pgmap v767: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 5.9 MiB/s wr, 590 op/s 2024-05-08T06:00:56.499 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:00:56 smithi134 ceph-mon[34132]: pgmap v767: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 5.9 MiB/s wr, 590 op/s 2024-05-08T06:00:56.777 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-08T06:00:56.778 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-05-08T06:00:57.418 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:00:58.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:00:58 smithi082 ceph-mon[30098]: pgmap v768: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.6 MiB/s wr, 678 op/s 2024-05-08T06:00:58.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:00:58 smithi151 ceph-mon[34815]: pgmap v768: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.6 MiB/s wr, 678 op/s 2024-05-08T06:00:58.499 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:00:58 smithi134 ceph-mon[34132]: pgmap v768: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.6 MiB/s wr, 678 op/s 2024-05-08T06:00:59.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.857+0000 7fd041800700 1 -- 172.21.15.82:0/1733017309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd03c10fea0 msgr2=0x7fd03c112290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:59.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.857+0000 7fd041800700 1 --2- 172.21.15.82:0/1733017309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd03c10fea0 0x7fd03c112290 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd03400b0a0 tx=0x7fd03400b3b0 comp rx=0 tx=0).stop 2024-05-08T06:00:59.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.858+0000 7fd041800700 1 -- 172.21.15.82:0/1733017309 shutdown_connections 2024-05-08T06:00:59.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.859+0000 7fd041800700 1 --2- 172.21.15.82:0/1733017309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd03c10fea0 0x7fd03c112290 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:59.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.859+0000 7fd041800700 1 --2- 172.21.15.82:0/1733017309 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd03c0756d0 0x7fd03c075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:59.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.859+0000 7fd041800700 1 --2- 172.21.15.82:0/1733017309 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd03c075ff0 0x7fd03c10f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:59.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.859+0000 7fd041800700 1 -- 172.21.15.82:0/1733017309 >> 172.21.15.82:0/1733017309 conn(0x7fd03c07a600 msgr2=0x7fd03c07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:00:59.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.861+0000 7fd041800700 1 -- 172.21.15.82:0/1733017309 shutdown_connections 2024-05-08T06:00:59.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.861+0000 7fd041800700 1 -- 172.21.15.82:0/1733017309 wait complete. 2024-05-08T06:00:59.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.863+0000 7fd041800700 1 Processor -- start 2024-05-08T06:00:59.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.864+0000 7fd041800700 1 -- start start 2024-05-08T06:00:59.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.865+0000 7fd041800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd03c0756d0 0x7fd03c10e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:59.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.865+0000 7fd041800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd03c075ff0 0x7fd03c10e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:59.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.865+0000 7fd041800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd03c10fea0 0x7fd03c1abe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:59.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.865+0000 7fd041800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd03c1045a0 con 0x7fd03c075ff0 2024-05-08T06:00:59.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.865+0000 7fd041800700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd03c104420 con 0x7fd03c0756d0 2024-05-08T06:00:59.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.865+0000 7fd041800700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd03c104720 con 0x7fd03c10fea0 2024-05-08T06:00:59.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.866+0000 7fd03aa00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd03c0756d0 0x7fd03c10e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:59.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.866+0000 7fd03aa00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd03c0756d0 0x7fd03c10e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:57600/0 (socket says 172.21.15.82:57600) 2024-05-08T06:00:59.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.866+0000 7fd03aa00700 1 -- 172.21.15.82:0/1342829713 learned_addr learned my addr 172.21.15.82:0/1342829713 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:00:59.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.866+0000 7fd03a000700 1 --2- 172.21.15.82:0/1342829713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd03c075ff0 0x7fd03c10e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:59.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.867+0000 7fd03b400700 1 --2- 172.21.15.82:0/1342829713 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd03c10fea0 0x7fd03c1abe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:59.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.867+0000 7fd03aa00700 1 -- 172.21.15.82:0/1342829713 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd03c10fea0 msgr2=0x7fd03c1abe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:59.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.867+0000 7fd03aa00700 1 --2- 172.21.15.82:0/1342829713 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd03c10fea0 0x7fd03c1abe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:59.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.867+0000 7fd03aa00700 1 -- 172.21.15.82:0/1342829713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd03c075ff0 msgr2=0x7fd03c10e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:59.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.867+0000 7fd03aa00700 1 --2- 172.21.15.82:0/1342829713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd03c075ff0 0x7fd03c10e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:59.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.867+0000 7fd03aa00700 1 -- 172.21.15.82:0/1342829713 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd03c1ac440 con 0x7fd03c0756d0 2024-05-08T06:00:59.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.867+0000 7fd03aa00700 1 --2- 172.21.15.82:0/1342829713 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd03c0756d0 0x7fd03c10e200 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd02800c920 tx=0x7fd02800cc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:00:59.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.868+0000 7fd033400700 1 -- 172.21.15.82:0/1342829713 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd028004a30 con 0x7fd03c0756d0 2024-05-08T06:00:59.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.868+0000 7fd033400700 1 -- 172.21.15.82:0/1342829713 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0280054d0 con 0x7fd03c0756d0 2024-05-08T06:00:59.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.868+0000 7fd033400700 1 -- 172.21.15.82:0/1342829713 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd028007c30 con 0x7fd03c0756d0 2024-05-08T06:00:59.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.868+0000 7fd041800700 1 -- 172.21.15.82:0/1342829713 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd03c1ac730 con 0x7fd03c0756d0 2024-05-08T06:00:59.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.868+0000 7fd041800700 1 -- 172.21.15.82:0/1342829713 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd03c1acc20 con 0x7fd03c0756d0 2024-05-08T06:00:59.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.875+0000 7fd04c203b80 1 Processor -- start 2024-05-08T06:00:59.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.876+0000 7fd04c203b80 1 -- start start 2024-05-08T06:00:59.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.876+0000 7fd04c203b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5574319300e0 0x5574319304c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:59.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.876+0000 7fd04c203b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557431930a00 0x557431934510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:59.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.876+0000 7fd04c203b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557431934a50 0x557431934eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:59.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.876+0000 7fd04c203b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x557431882aa0 con 0x557431930a00 2024-05-08T06:00:59.877 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.876+0000 7fd04c203b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5574318207e0 con 0x5574319300e0 2024-05-08T06:00:59.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.876+0000 7fd04c203b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55743187ea60 con 0x557431934a50 2024-05-08T06:00:59.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.877+0000 7fd03b400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5574319300e0 0x5574319304c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:59.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.877+0000 7fd03b400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5574319300e0 0x5574319304c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:57614/0 (socket says 172.21.15.82:57614) 2024-05-08T06:00:59.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.877+0000 7fd03b400700 1 -- 172.21.15.82:0/2806074095 learned_addr learned my addr 172.21.15.82:0/2806074095 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:00:59.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.877+0000 7fd03b400700 1 -- 172.21.15.82:0/2806074095 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557431934a50 msgr2=0x557431934eb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T06:00:59.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.878+0000 7fd03a000700 1 --2- 172.21.15.82:0/2806074095 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557431934a50 0x557431934eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:59.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.878+0000 7fd033400700 1 -- 172.21.15.82:0/1342829713 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fd02800f450 con 0x7fd03c0756d0 2024-05-08T06:00:59.878 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.878+0000 7fd03b400700 1 --2- 172.21.15.82:0/2806074095 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557431934a50 0x557431934eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:59.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.878+0000 7fd03b400700 1 -- 172.21.15.82:0/2806074095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557431930a00 msgr2=0x557431934510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:00:59.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.878+0000 7fd03aa00700 1 --2- 172.21.15.82:0/2806074095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557431930a00 0x557431934510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:59.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.879+0000 7fd03b400700 1 --2- 172.21.15.82:0/2806074095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557431930a00 0x557431934510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:59.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.879+0000 7fd03b400700 1 -- 172.21.15.82:0/2806074095 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574317cf950 con 0x5574319300e0 2024-05-08T06:00:59.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.879+0000 7fd03a000700 1 --2- 172.21.15.82:0/2806074095 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557431934a50 0x557431934eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:00:59.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.879+0000 7fd03aa00700 1 --2- 172.21.15.82:0/2806074095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557431930a00 0x557431934510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:00:59.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.880+0000 7fd03b400700 1 --2- 172.21.15.82:0/2806074095 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5574319300e0 0x5574319304c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd03c06bd30 tx=0x7fd034009520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ad51bd0ced867c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:00:59.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.880+0000 7fd027e00700 1 -- 172.21.15.82:0/2806074095 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd03400bdb0 con 0x5574319300e0 2024-05-08T06:00:59.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.880+0000 7fd027e00700 1 -- 172.21.15.82:0/2806074095 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0340074a0 con 0x5574319300e0 2024-05-08T06:00:59.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.880+0000 7fd027e00700 1 -- 172.21.15.82:0/2806074095 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0340052a0 con 0x5574319300e0 2024-05-08T06:00:59.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.881+0000 7fd033400700 1 --2- 172.21.15.82:0/1342829713 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd0200b2a50 0x7fd0200b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:59.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.881+0000 7fd033400700 1 -- 172.21.15.82:0/1342829713 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd0280e1cd0 con 0x7fd03c0756d0 2024-05-08T06:00:59.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.881+0000 7fd03aa00700 1 --2- 172.21.15.82:0/1342829713 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd0200b2a50 0x7fd0200b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:59.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.881+0000 7fd04c203b80 1 -- 172.21.15.82:0/2806074095 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5574319300e0 msgr2=0x5574319304c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:59.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.881+0000 7fd04c203b80 1 --2- 172.21.15.82:0/2806074095 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5574319300e0 0x5574319304c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd03c06bd30 tx=0x7fd034009520 comp rx=0 tx=0).stop 2024-05-08T06:00:59.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.882+0000 7fd03aa00700 1 --2- 172.21.15.82:0/1342829713 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd0200b2a50 0x7fd0200b4f10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd0280a9230 tx=0x7fd0280076d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:00:59.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.882+0000 7fd04c203b80 1 -- 172.21.15.82:0/2806074095 shutdown_connections 2024-05-08T06:00:59.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.882+0000 7fd04c203b80 1 --2- 172.21.15.82:0/2806074095 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5574319300e0 0x5574319304c0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:59.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.882+0000 7fd04c203b80 1 --2- 172.21.15.82:0/2806074095 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557431934a50 0x557431934eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:59.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.882+0000 7fd04c203b80 1 --2- 172.21.15.82:0/2806074095 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557431930a00 0x557431934510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:59.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.882+0000 7fd04c203b80 1 -- 172.21.15.82:0/2806074095 >> 172.21.15.82:0/2806074095 conn(0x55743185ebe0 msgr2=0x55743192a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:00:59.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.882+0000 7fd04c203b80 1 -- 172.21.15.82:0/2806074095 shutdown_connections 2024-05-08T06:00:59.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.882+0000 7fd04c203b80 1 -- 172.21.15.82:0/2806074095 wait complete. 2024-05-08T06:00:59.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.883+0000 7fd04c203b80 1 -- start start 2024-05-08T06:00:59.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.883+0000 7fd04c203b80 1 Processor -- start 2024-05-08T06:00:59.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.884+0000 7fd04c203b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5574319300e0 0x55743193be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:59.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.884+0000 7fd04c203b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557431930a00 0x5574319391b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:59.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.884+0000 7fd04c203b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557431934a50 0x5574319396f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:59.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.884+0000 7fd04c203b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55743193cc00 con 0x557431930a00 2024-05-08T06:00:59.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.884+0000 7fd04c203b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5574317e8ba0 con 0x5574319300e0 2024-05-08T06:00:59.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.884+0000 7fd04c203b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55743193cd80 con 0x557431934a50 2024-05-08T06:00:59.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.884+0000 7fd04c203b80 10 client.0 _ll_register_callbacks cb 0x557431829cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:00:59.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.885+0000 7fd03b400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5574319300e0 0x55743193be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:59.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.885+0000 7fd03b400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5574319300e0 0x55743193be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:57624/0 (socket says 172.21.15.82:57624) 2024-05-08T06:00:59.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.885+0000 7fd03b400700 1 -- 172.21.15.82:0/2457581658 learned_addr learned my addr 172.21.15.82:0/2457581658 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:00:59.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.885+0000 7fd03b400700 1 --2- 172.21.15.82:0/2457581658 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557431934a50 0x5574319396f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:59.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.885+0000 7fd03b400700 1 -- 172.21.15.82:0/2457581658 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557431934a50 msgr2=0x5574319396f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:00:59.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.885+0000 7fd03b400700 1 --2- 172.21.15.82:0/2457581658 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557431934a50 0x5574319396f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:59.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.885+0000 7fd03b400700 1 -- 172.21.15.82:0/2457581658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557431930a00 msgr2=0x5574319391b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:00:59.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.885+0000 7fd03b400700 1 --2- 172.21.15.82:0/2457581658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557431930a00 0x5574319391b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:59.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.885+0000 7fd03b400700 1 -- 172.21.15.82:0/2457581658 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574318484a0 con 0x5574319300e0 2024-05-08T06:00:59.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.886+0000 7fd03b400700 1 --2- 172.21.15.82:0/2457581658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5574319300e0 0x55743193be10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fd03400d010 tx=0x7fd034007d60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5cc5248c32b1dbdf server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:00:59.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.886+0000 7fd024c00700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T06:00:59.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.886+0000 7fd024c00700 1 -- 172.21.15.82:0/2457581658 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd034003e20 con 0x5574319300e0 2024-05-08T06:00:59.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.886+0000 7fd024c00700 1 -- 172.21.15.82:0/2457581658 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd034007860 con 0x5574319300e0 2024-05-08T06:00:59.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.886+0000 7fd04c203b80 1 -- 172.21.15.82:0/2457581658 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0340074a0 con 0x5574319300e0 2024-05-08T06:00:59.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.887+0000 7fd024c00700 1 -- 172.21.15.82:0/2457581658 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fd034007a60 con 0x5574319300e0 2024-05-08T06:00:59.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.887+0000 7fd04c203b80 10 client.26336 fetch_fsmap learned FSMap version 31 2024-05-08T06:00:59.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.887+0000 7fd04c203b80 1 -- 172.21.15.82:0/2457581658 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x557431947340 con 0x5574319300e0 2024-05-08T06:00:59.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.887+0000 7fd024c00700 1 -- 172.21.15.82:0/2457581658 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd0340074a0 con 0x5574319300e0 2024-05-08T06:00:59.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.887+0000 7fd024c00700 1 -- 172.21.15.82:0/2457581658 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fd034011070 con 0x5574319300e0 2024-05-08T06:00:59.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.888+0000 7fd04c203b80 10 client.26336 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:00:59.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.888+0000 7fd04c203b80 10 client.26336 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T06:00:59.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.888+0000 7fd04c203b80 20 client.26336 populate_metadata read hostname 'smithi082' 2024-05-08T06:00:59.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.888+0000 7fd04c203b80 1 --2- 172.21.15.82:0/2457581658 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x557431949810 0x55743194bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:59.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.888+0000 7fd04c203b80 4 client.26336 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:00:59.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.888+0000 7fd04c203b80 1 -- 172.21.15.82:0/2457581658 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5574318fd120 con 0x557431949810 2024-05-08T06:00:59.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.888+0000 7fd03a000700 1 --2- 172.21.15.82:0/2457581658 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x557431949810 0x55743194bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:59.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.889+0000 7fd03a000700 1 --2- 172.21.15.82:0/2457581658 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x557431949810 0x55743194bc00 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e22560b5ff4ed0b7 server_cookie=e1a9d693a3e93abf in_seq=0 out_seq=0 2024-05-08T06:00:59.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.889+0000 7fd024c00700 10 client.26336 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T06:00:59.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.889+0000 7fd024c00700 1 -- 172.21.15.82:0/2457581658 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5574318fd120 con 0x557431949810 2024-05-08T06:00:59.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.889+0000 7fd024c00700 10 client.26336 handle_command_reply: tid=0 2024-05-08T06:00:59.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.889+0000 7fd04c203b80 1 client.26336 shutdown 2024-05-08T06:00:59.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.890+0000 7fd04c203b80 1 -- 172.21.15.82:0/2457581658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5574319300e0 msgr2=0x55743193be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:59.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.890+0000 7fd04c203b80 1 --2- 172.21.15.82:0/2457581658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5574319300e0 0x55743193be10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fd03400d010 tx=0x7fd034007d60 comp rx=0 tx=0).stop 2024-05-08T06:00:59.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.890+0000 7fd04c203b80 1 -- 172.21.15.82:0/2457581658 shutdown_connections 2024-05-08T06:00:59.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.890+0000 7fd04c203b80 1 --2- 172.21.15.82:0/2457581658 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x557431949810 0x55743194bc00 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:59.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.890+0000 7fd04c203b80 1 --2- 172.21.15.82:0/2457581658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5574319300e0 0x55743193be10 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:59.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.890+0000 7fd04c203b80 1 --2- 172.21.15.82:0/2457581658 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557431934a50 0x5574319396f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:59.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.890+0000 7fd04c203b80 1 --2- 172.21.15.82:0/2457581658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557431930a00 0x5574319391b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:59.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.890+0000 7fd04c203b80 1 -- 172.21.15.82:0/2457581658 >> 172.21.15.82:0/2457581658 conn(0x55743185ebe0 msgr2=0x557431925330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:00:59.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.891+0000 7fd024c00700 0 client.26336 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T06:00:59.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.891+0000 7fd04c203b80 1 -- 172.21.15.82:0/2457581658 shutdown_connections 2024-05-08T06:00:59.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.891+0000 7fd04c203b80 1 -- 172.21.15.82:0/2457581658 wait complete. 2024-05-08T06:00:59.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.892+0000 7fd04c203b80 20 client.26336 trim_cache size 0 max 16384 2024-05-08T06:00:59.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.918+0000 7fd04c203b80 1 Processor -- start 2024-05-08T06:00:59.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.919+0000 7fd04c203b80 1 -- start start 2024-05-08T06:00:59.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.919+0000 7fd04c203b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5574319300e0 0x557431935e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:59.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.919+0000 7fd04c203b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557431930a00 0x557431936de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:59.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.920+0000 7fd04c203b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557431934a50 0x557431932410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:59.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.920+0000 7fd04c203b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd03c1b4000 con 0x557431934a50 2024-05-08T06:00:59.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.920+0000 7fd04c203b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd03c1b5b40 con 0x557431930a00 2024-05-08T06:00:59.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.920+0000 7fd04c203b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd03c1b46d0 con 0x5574319300e0 2024-05-08T06:00:59.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.920+0000 7fd03b400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5574319300e0 0x557431935e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:59.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.920+0000 7fd03b400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5574319300e0 0x557431935e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:60106/0 (socket says 172.21.15.82:60106) 2024-05-08T06:00:59.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.920+0000 7fd03b400700 1 -- 172.21.15.82:0/2533202058 learned_addr learned my addr 172.21.15.82:0/2533202058 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:00:59.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.920+0000 7fd03a000700 1 --2- 172.21.15.82:0/2533202058 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557431930a00 0x557431936de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:59.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.921+0000 7fd03b400700 1 --2- 172.21.15.82:0/2533202058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557431934a50 0x557431932410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:59.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.921+0000 7fd03a000700 1 -- 172.21.15.82:0/2533202058 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5574319300e0 msgr2=0x557431935e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:00:59.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.921+0000 7fd03a000700 1 --2- 172.21.15.82:0/2533202058 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5574319300e0 0x557431935e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:59.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.921+0000 7fd03a000700 1 -- 172.21.15.82:0/2533202058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557431934a50 msgr2=0x557431932410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:00:59.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.921+0000 7fd03a000700 1 --2- 172.21.15.82:0/2533202058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557431934a50 0x557431932410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:59.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.921+0000 7fd03a000700 1 -- 172.21.15.82:0/2533202058 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55743192b690 con 0x557431930a00 2024-05-08T06:00:59.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.921+0000 7fd03b400700 1 --2- 172.21.15.82:0/2533202058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557431934a50 0x557431932410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:00:59.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.921+0000 7fd03a000700 1 --2- 172.21.15.82:0/2533202058 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557431930a00 0x557431936de0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x55743192b430 tx=0x7fd02c009370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=797c86eb570b476f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:00:59.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.923+0000 7fd027400700 1 -- 172.21.15.82:0/2533202058 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd02c01e070 con 0x557431930a00 2024-05-08T06:00:59.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.923+0000 7fd027400700 1 -- 172.21.15.82:0/2533202058 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd02c012e20 con 0x557431930a00 2024-05-08T06:00:59.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.924+0000 7fd04c203b80 1 -- 172.21.15.82:0/2533202058 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557431930a00 msgr2=0x557431936de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:59.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.924+0000 7fd04c203b80 1 --2- 172.21.15.82:0/2533202058 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557431930a00 0x557431936de0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x55743192b430 tx=0x7fd02c009370 comp rx=0 tx=0).stop 2024-05-08T06:00:59.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.925+0000 7fd04c203b80 1 -- 172.21.15.82:0/2533202058 shutdown_connections 2024-05-08T06:00:59.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.925+0000 7fd04c203b80 1 --2- 172.21.15.82:0/2533202058 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557431934a50 0x557431932410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:59.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.925+0000 7fd04c203b80 1 --2- 172.21.15.82:0/2533202058 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5574319300e0 0x557431935e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:59.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.925+0000 7fd04c203b80 1 --2- 172.21.15.82:0/2533202058 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557431930a00 0x557431936de0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:59.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.925+0000 7fd04c203b80 1 -- 172.21.15.82:0/2533202058 >> 172.21.15.82:0/2533202058 conn(0x55743185ebe0 msgr2=0x557431925330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:00:59.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.925+0000 7fd04c203b80 1 -- 172.21.15.82:0/2533202058 shutdown_connections 2024-05-08T06:00:59.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.926+0000 7fd04c203b80 1 -- 172.21.15.82:0/2533202058 wait complete. 2024-05-08T06:00:59.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.926+0000 7fd04c203b80 1 -- start start 2024-05-08T06:00:59.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.926+0000 7fd04c203b80 1 Processor -- start 2024-05-08T06:00:59.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.927+0000 7fd04c203b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5574319300e0 0x55743194ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:59.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.927+0000 7fd04c203b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557431930a00 0x55743194efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:59.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.927+0000 7fd04c203b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557431934a50 0x55743194c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:59.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.927+0000 7fd04c203b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd03c1b5470 con 0x5574319300e0 2024-05-08T06:00:59.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.927+0000 7fd04c203b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd03c1b4da0 con 0x557431934a50 2024-05-08T06:00:59.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.927+0000 7fd04c203b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd03c1b1fa0 con 0x557431930a00 2024-05-08T06:00:59.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.927+0000 7fd04c203b80 10 client.0 _ll_register_callbacks cb 0x557431829cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:00:59.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.928+0000 7fd03b400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5574319300e0 0x55743194ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:59.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.928+0000 7fd03a000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557431930a00 0x55743194efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:59.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.928+0000 7fd03b400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5574319300e0 0x55743194ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54736/0 (socket says 172.21.15.82:54736) 2024-05-08T06:00:59.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.928+0000 7fd03b400700 1 -- 172.21.15.82:0/1902952735 learned_addr learned my addr 172.21.15.82:0/1902952735 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:00:59.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.928+0000 7fd03a000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557431930a00 0x55743194efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:60108/0 (socket says 172.21.15.82:60108) 2024-05-08T06:00:59.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.928+0000 7fd03b400700 1 --2- 172.21.15.82:0/1902952735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557431934a50 0x55743194c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:59.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.928+0000 7fd03b400700 1 -- 172.21.15.82:0/1902952735 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557431930a00 msgr2=0x55743194efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:00:59.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.928+0000 7fd03b400700 1 --2- 172.21.15.82:0/1902952735 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557431930a00 0x55743194efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:59.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.928+0000 7fd03b400700 1 -- 172.21.15.82:0/1902952735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557431934a50 msgr2=0x55743194c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:00:59.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.928+0000 7fd03b400700 1 --2- 172.21.15.82:0/1902952735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557431934a50 0x55743194c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:59.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.928+0000 7fd03b400700 1 -- 172.21.15.82:0/1902952735 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55743194c6e0 con 0x5574319300e0 2024-05-08T06:00:59.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.928+0000 7fd03a000700 1 --2- 172.21.15.82:0/1902952735 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557431930a00 0x55743194efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:00:59.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.929+0000 7fd03b400700 1 --2- 172.21.15.82:0/1902952735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5574319300e0 0x55743194ea90 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd0340062a0 tx=0x7fd034007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a96efdfcc61019e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:00:59.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.929+0000 7fd024c00700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T06:00:59.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.930+0000 7fd024c00700 1 -- 172.21.15.82:0/1902952735 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd034007860 con 0x5574319300e0 2024-05-08T06:00:59.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.930+0000 7fd024c00700 1 -- 172.21.15.82:0/1902952735 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd034032040 con 0x5574319300e0 2024-05-08T06:00:59.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.930+0000 7fd04c203b80 1 -- 172.21.15.82:0/1902952735 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd02c012e20 con 0x5574319300e0 2024-05-08T06:00:59.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.930+0000 7fd024c00700 1 -- 172.21.15.82:0/1902952735 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fd034037420 con 0x5574319300e0 2024-05-08T06:00:59.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.931+0000 7fd04c203b80 10 client.15951 fetch_fsmap learned FSMap version 31 2024-05-08T06:00:59.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.931+0000 7fd04c203b80 1 -- 172.21.15.82:0/1902952735 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5574319b5790 con 0x5574319300e0 2024-05-08T06:00:59.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.931+0000 7fd024c00700 1 -- 172.21.15.82:0/1902952735 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd02c012e20 con 0x5574319300e0 2024-05-08T06:00:59.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.932+0000 7fd024c00700 1 -- 172.21.15.82:0/1902952735 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fd034011040 con 0x5574319300e0 2024-05-08T06:00:59.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.932+0000 7fd04c203b80 10 client.15951 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:00:59.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.932+0000 7fd04c203b80 10 client.15951 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T06:00:59.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.932+0000 7fd04c203b80 20 client.15951 populate_metadata read hostname 'smithi082' 2024-05-08T06:00:59.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.932+0000 7fd04c203b80 1 --2- 172.21.15.82:0/1902952735 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5574319b5e70 0x5574319b8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:00:59.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.932+0000 7fd04c203b80 4 client.15951 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-08T06:00:59.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.932+0000 7fd04c203b80 1 -- 172.21.15.82:0/1902952735 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x557431890480 con 0x5574319b5e70 2024-05-08T06:00:59.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.932+0000 7fd03a000700 1 --2- 172.21.15.82:0/1902952735 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5574319b5e70 0x5574319b8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:00:59.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.933+0000 7fd03a000700 1 --2- 172.21.15.82:0/1902952735 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5574319b5e70 0x5574319b8290 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5dd4f01f169f67 server_cookie=3029393d04357755 in_seq=0 out_seq=0 2024-05-08T06:00:59.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.933+0000 7fd024c00700 10 client.15951 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T06:00:59.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.934+0000 7fd024c00700 1 -- 172.21.15.82:0/1902952735 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x557431890480 con 0x5574319b5e70 2024-05-08T06:00:59.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.934+0000 7fd024c00700 10 client.15951 handle_command_reply: tid=0 2024-05-08T06:00:59.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.934+0000 7fd04c203b80 1 client.15951 shutdown 2024-05-08T06:00:59.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.934+0000 7fd04c203b80 1 -- 172.21.15.82:0/1902952735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5574319300e0 msgr2=0x55743194ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:59.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.934+0000 7fd04c203b80 1 --2- 172.21.15.82:0/1902952735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5574319300e0 0x55743194ea90 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd0340062a0 tx=0x7fd034007ee0 comp rx=0 tx=0).stop 2024-05-08T06:00:59.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.935+0000 7fd04c203b80 1 -- 172.21.15.82:0/1902952735 shutdown_connections 2024-05-08T06:00:59.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.935+0000 7fd04c203b80 1 --2- 172.21.15.82:0/1902952735 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5574319b5e70 0x5574319b8290 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:59.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.935+0000 7fd04c203b80 1 --2- 172.21.15.82:0/1902952735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557431934a50 0x55743194c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:59.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.935+0000 7fd04c203b80 1 --2- 172.21.15.82:0/1902952735 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5574319300e0 0x55743194ea90 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:59.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.935+0000 7fd04c203b80 1 --2- 172.21.15.82:0/1902952735 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557431930a00 0x55743194efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:59.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.935+0000 7fd04c203b80 1 -- 172.21.15.82:0/1902952735 >> 172.21.15.82:0/1902952735 conn(0x55743185ebe0 msgr2=0x55743192eef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:00:59.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.935+0000 7fd024c00700 0 client.15951 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T06:00:59.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.935+0000 7fd04c203b80 1 -- 172.21.15.82:0/1902952735 shutdown_connections 2024-05-08T06:00:59.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.936+0000 7fd04c203b80 1 -- 172.21.15.82:0/1902952735 wait complete. 2024-05-08T06:00:59.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.936+0000 7fd04c203b80 20 client.15951 trim_cache size 0 max 16384 2024-05-08T06:00:59.936 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T06:00:59.937 INFO:teuthology.orchestra.run.smithi082.stdout: "return_code": 0, 2024-05-08T06:00:59.937 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_tag": "d95d75ae-c2ab-4203-a451-549e3abdf975", 2024-05-08T06:00:59.937 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": "asynchronous" 2024-05-08T06:00:59.937 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T06:00:59.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.938+0000 7fd041800700 1 -- 172.21.15.82:0/1342829713 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd0200b2a50 msgr2=0x7fd0200b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:59.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.938+0000 7fd041800700 1 --2- 172.21.15.82:0/1342829713 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd0200b2a50 0x7fd0200b4f10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fd0280a9230 tx=0x7fd0280076d0 comp rx=0 tx=0).stop 2024-05-08T06:00:59.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.938+0000 7fd041800700 1 -- 172.21.15.82:0/1342829713 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd03c0756d0 msgr2=0x7fd03c10e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:00:59.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.938+0000 7fd041800700 1 --2- 172.21.15.82:0/1342829713 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd03c0756d0 0x7fd03c10e200 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd02800c920 tx=0x7fd02800cc30 comp rx=0 tx=0).stop 2024-05-08T06:00:59.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.938+0000 7fd041800700 1 -- 172.21.15.82:0/1342829713 shutdown_connections 2024-05-08T06:00:59.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.938+0000 7fd041800700 1 --2- 172.21.15.82:0/1342829713 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd03c0756d0 0x7fd03c10e200 secure :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd02800c920 tx=0x7fd02800cc30 comp rx=0 tx=0).stop 2024-05-08T06:00:59.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.938+0000 7fd041800700 1 --2- 172.21.15.82:0/1342829713 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd0200b2a50 0x7fd0200b4f10 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:59.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.938+0000 7fd041800700 1 --2- 172.21.15.82:0/1342829713 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd03c10fea0 0x7fd03c1abe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:59.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.938+0000 7fd041800700 1 --2- 172.21.15.82:0/1342829713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd03c075ff0 0x7fd03c10e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:00:59.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.938+0000 7fd041800700 1 -- 172.21.15.82:0/1342829713 >> 172.21.15.82:0/1342829713 conn(0x7fd03c07a600 msgr2=0x7fd03c1005d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:00:59.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.938+0000 7fd041800700 1 -- 172.21.15.82:0/1342829713 shutdown_connections 2024-05-08T06:00:59.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:00:59.939+0000 7fd041800700 1 -- 172.21.15.82:0/1342829713 wait complete. 2024-05-08T06:01:00.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 610.0 s, 1774.0 tps, lat 56.524 ms stddev 69.800 2024-05-08T06:01:00.400 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:01:00 smithi082 ceph-mon[30098]: pgmap v769: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.4 MiB/s wr, 558 op/s 2024-05-08T06:01:00.499 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:01:00 smithi134 ceph-mon[34132]: pgmap v769: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.4 MiB/s wr, 558 op/s 2024-05-08T06:01:00.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:01:00 smithi151 ceph-mon[34815]: pgmap v769: 97 pgs: 97 active+clean; 1.6 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.4 MiB/s wr, 558 op/s 2024-05-08T06:01:00.798 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-08T06:01:01.424 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:01:01.454 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:01:01 smithi134 ceph-mon[34132]: scrub queued for path: / 2024-05-08T06:01:01.454 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:01:01 smithi134 ceph-mon[34132]: scrub summary: idle+waiting paths [/] 2024-05-08T06:01:01.454 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:01:01 smithi134 ceph-mon[34132]: scrub summary: active paths [/] 2024-05-08T06:01:01.454 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:01:01 smithi134 ceph-mon[34132]: scrub summary: active paths [/] 2024-05-08T06:01:01.454 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:01:01 smithi134 ceph-mon[34132]: scrub summary: idle+waiting paths [/] 2024-05-08T06:01:01.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:01:01 smithi082 ceph-mon[30098]: scrub queued for path: / 2024-05-08T06:01:01.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:01:01 smithi082 ceph-mon[30098]: scrub summary: idle+waiting paths [/] 2024-05-08T06:01:01.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:01:01 smithi082 ceph-mon[30098]: scrub summary: active paths [/] 2024-05-08T06:01:01.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:01:01 smithi082 ceph-mon[30098]: scrub summary: active paths [/] 2024-05-08T06:01:01.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:01:01 smithi082 ceph-mon[30098]: scrub summary: idle+waiting paths [/] 2024-05-08T06:01:01.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:01:01 smithi151 ceph-mon[34815]: scrub queued for path: / 2024-05-08T06:01:01.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:01:01 smithi151 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-05-08T06:01:01.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:01:01 smithi151 ceph-mon[34815]: scrub summary: active paths [/] 2024-05-08T06:01:01.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:01:01 smithi151 ceph-mon[34815]: scrub summary: active paths [/] 2024-05-08T06:01:01.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:01:01 smithi151 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-05-08T06:01:02.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:01:02 smithi151 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-05-08T06:01:02.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:01:02 smithi151 ceph-mon[34815]: pgmap v770: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.5 MiB/s wr, 737 op/s 2024-05-08T06:01:02.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:01:02 smithi082 ceph-mon[30098]: scrub summary: idle+waiting paths [/] 2024-05-08T06:01:02.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:01:02 smithi082 ceph-mon[30098]: pgmap v770: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.5 MiB/s wr, 737 op/s 2024-05-08T06:01:02.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:01:02 smithi134 ceph-mon[34132]: scrub summary: idle+waiting paths [/] 2024-05-08T06:01:02.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:01:02 smithi134 ceph-mon[34132]: pgmap v770: 97 pgs: 97 active+clean; 1.6 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.5 MiB/s wr, 737 op/s 2024-05-08T06:01:03.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.816+0000 7f7d79e00700 1 -- 172.21.15.82:0/2058307792 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d74114380 msgr2=0x7f7d74116770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:03.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.816+0000 7f7d79e00700 1 --2- 172.21.15.82:0/2058307792 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d74114380 0x7f7d74116770 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c00b0a0 tx=0x7f7d6c00b3b0 comp rx=0 tx=0).stop 2024-05-08T06:01:03.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.816+0000 7f7d79e00700 1 -- 172.21.15.82:0/2058307792 shutdown_connections 2024-05-08T06:01:03.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.816+0000 7f7d79e00700 1 --2- 172.21.15.82:0/2058307792 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d74114380 0x7f7d74116770 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:03.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.816+0000 7f7d79e00700 1 --2- 172.21.15.82:0/2058307792 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7d740779d0 0x7f7d74077db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:03.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.816+0000 7f7d79e00700 1 --2- 172.21.15.82:0/2058307792 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d740782f0 0x7f7d74113e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:03.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.816+0000 7f7d79e00700 1 -- 172.21.15.82:0/2058307792 >> 172.21.15.82:0/2058307792 conn(0x7f7d741011d0 msgr2=0x7f7d741035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:01:03.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.816+0000 7f7d79e00700 1 -- 172.21.15.82:0/2058307792 shutdown_connections 2024-05-08T06:01:03.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.816+0000 7f7d79e00700 1 -- 172.21.15.82:0/2058307792 wait complete. 2024-05-08T06:01:03.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.818+0000 7f7d79e00700 1 Processor -- start 2024-05-08T06:01:03.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.818+0000 7f7d79e00700 1 -- start start 2024-05-08T06:01:03.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.819+0000 7f7d79e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d740779d0 0x7f7d74074b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:03.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.819+0000 7f7d79e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d740782f0 0x7f7d740750d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:03.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.820+0000 7f7d79e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7d74114380 0x7f7d7406ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:03.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.820+0000 7f7d72000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d740782f0 0x7f7d740750d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:03.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.820+0000 7f7d72000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d740782f0 0x7f7d740750d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54108/0 (socket says 172.21.15.82:54108) 2024-05-08T06:01:03.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.820+0000 7f7d72000700 1 -- 172.21.15.82:0/132006215 learned_addr learned my addr 172.21.15.82:0/132006215 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:01:03.821 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.821+0000 7f7d73400700 1 --2- 172.21.15.82:0/132006215 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7d74114380 0x7f7d7406ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:03.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.820+0000 7f7d72a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d740779d0 0x7f7d74074b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:03.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.821+0000 7f7d79e00700 1 -- 172.21.15.82:0/132006215 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7d74119d10 con 0x7f7d740782f0 2024-05-08T06:01:03.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.821+0000 7f7d79e00700 1 -- 172.21.15.82:0/132006215 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7d74119b90 con 0x7f7d740779d0 2024-05-08T06:01:03.822 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.821+0000 7f7d79e00700 1 -- 172.21.15.82:0/132006215 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7d74119e90 con 0x7f7d74114380 2024-05-08T06:01:03.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.822+0000 7f7d72000700 1 -- 172.21.15.82:0/132006215 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7d74114380 msgr2=0x7f7d7406ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:03.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.822+0000 7f7d72000700 1 --2- 172.21.15.82:0/132006215 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7d74114380 0x7f7d7406ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:03.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.822+0000 7f7d72000700 1 -- 172.21.15.82:0/132006215 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d740779d0 msgr2=0x7f7d74074b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:03.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.822+0000 7f7d72000700 1 --2- 172.21.15.82:0/132006215 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d740779d0 0x7f7d74074b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:03.823 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.822+0000 7f7d72000700 1 -- 172.21.15.82:0/132006215 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d7406e6b0 con 0x7f7d740782f0 2024-05-08T06:01:03.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.823+0000 7f7d72a00700 1 --2- 172.21.15.82:0/132006215 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d740779d0 0x7f7d74074b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:01:03.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.823+0000 7f7d72000700 1 --2- 172.21.15.82:0/132006215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d740782f0 0x7f7d740750d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7d6000c9b0 tx=0x7f7d6000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:01:03.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.824+0000 7f7d78a00700 1 -- 172.21.15.82:0/132006215 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d60007b00 con 0x7f7d740782f0 2024-05-08T06:01:03.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.825+0000 7f7d78a00700 1 -- 172.21.15.82:0/132006215 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7d6000ce50 con 0x7f7d740782f0 2024-05-08T06:01:03.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.825+0000 7f7d79e00700 1 -- 172.21.15.82:0/132006215 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d7406e9a0 con 0x7f7d740782f0 2024-05-08T06:01:03.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.825+0000 7f7d78a00700 1 -- 172.21.15.82:0/132006215 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d60018660 con 0x7f7d740782f0 2024-05-08T06:01:03.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.826+0000 7f7d79e00700 1 -- 172.21.15.82:0/132006215 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d74072940 con 0x7f7d740782f0 2024-05-08T06:01:03.831 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.831+0000 7f7d78a00700 1 -- 172.21.15.82:0/132006215 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f7d6000f450 con 0x7f7d740782f0 2024-05-08T06:01:03.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.833+0000 7f7d847a7b80 1 Processor -- start 2024-05-08T06:01:03.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.833+0000 7f7d78a00700 1 --2- 172.21.15.82:0/132006215 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7d580b2a10 0x7f7d580b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:03.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.834+0000 7f7d78a00700 1 -- 172.21.15.82:0/132006215 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f7d600e2020 con 0x7f7d740782f0 2024-05-08T06:01:03.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.834+0000 7f7d847a7b80 1 -- start start 2024-05-08T06:01:03.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.835+0000 7f7d847a7b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f78ed2060 0x556f78ed2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:03.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.835+0000 7f7d847a7b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f78ed2980 0x556f78ed6490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:03.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.835+0000 7f7d847a7b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f78ed69d0 0x556f78ed6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:03.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.835+0000 7f7d847a7b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556f78e24a20 con 0x556f78ed2060 2024-05-08T06:01:03.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.835+0000 7f7d847a7b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x556f78dc2760 con 0x556f78ed2980 2024-05-08T06:01:03.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.835+0000 7f7d847a7b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x556f78e209e0 con 0x556f78ed69d0 2024-05-08T06:01:03.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.836+0000 7f7d72a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f78ed2060 0x556f78ed2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:03.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.836+0000 7f7d72a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f78ed2060 0x556f78ed2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54124/0 (socket says 172.21.15.82:54124) 2024-05-08T06:01:03.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.836+0000 7f7d72a00700 1 -- 172.21.15.82:0/2243692288 learned_addr learned my addr 172.21.15.82:0/2243692288 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:01:03.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.836+0000 7f7d72000700 1 --2- 172.21.15.82:0/2243692288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f78ed2980 0x556f78ed6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:03.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.836+0000 7f7d72000700 1 -- 172.21.15.82:0/2243692288 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f78ed69d0 msgr2=0x556f78ed6e30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T06:01:03.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.836+0000 7f7d72000700 1 --2- 172.21.15.82:0/2243692288 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f78ed69d0 0x556f78ed6e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:03.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.836+0000 7f7d72000700 1 -- 172.21.15.82:0/2243692288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f78ed2060 msgr2=0x556f78ed2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:01:03.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.836+0000 7f7d72000700 1 --2- 172.21.15.82:0/2243692288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f78ed2060 0x556f78ed2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:03.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.836+0000 7f7d72000700 1 -- 172.21.15.82:0/2243692288 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f78d718d0 con 0x556f78ed2980 2024-05-08T06:01:03.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.837+0000 7f7d72000700 1 --2- 172.21.15.82:0/2243692288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f78ed2980 0x556f78ed6490 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7d6000afd0 tx=0x7f7d600a8ec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d836f76ea09d5fa server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:01:03.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.837+0000 7f7d68c00700 1 -- 172.21.15.82:0/2243692288 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d600c8070 con 0x556f78ed2980 2024-05-08T06:01:03.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.837+0000 7f7d68c00700 1 -- 172.21.15.82:0/2243692288 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7d600a96d0 con 0x556f78ed2980 2024-05-08T06:01:03.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.837+0000 7f7d68c00700 1 -- 172.21.15.82:0/2243692288 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d600c2030 con 0x556f78ed2980 2024-05-08T06:01:03.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.837+0000 7f7d73400700 1 --2- 172.21.15.82:0/132006215 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7d580b2a10 0x7f7d580b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:03.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.839+0000 7f7d847a7b80 1 -- 172.21.15.82:0/2243692288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f78ed2980 msgr2=0x556f78ed6490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:03.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.839+0000 7f7d847a7b80 1 --2- 172.21.15.82:0/2243692288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f78ed2980 0x556f78ed6490 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7d6000afd0 tx=0x7f7d600a8ec0 comp rx=0 tx=0).stop 2024-05-08T06:01:03.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.840+0000 7f7d847a7b80 1 -- 172.21.15.82:0/2243692288 shutdown_connections 2024-05-08T06:01:03.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.840+0000 7f7d847a7b80 1 --2- 172.21.15.82:0/2243692288 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f78ed69d0 0x556f78ed6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:03.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.840+0000 7f7d847a7b80 1 --2- 172.21.15.82:0/2243692288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f78ed2060 0x556f78ed2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:03.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.840+0000 7f7d847a7b80 1 --2- 172.21.15.82:0/2243692288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f78ed2980 0x556f78ed6490 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:03.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.840+0000 7f7d847a7b80 1 -- 172.21.15.82:0/2243692288 >> 172.21.15.82:0/2243692288 conn(0x556f78e00b60 msgr2=0x556f78ecc7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:01:03.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.840+0000 7f7d73400700 1 --2- 172.21.15.82:0/132006215 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7d580b2a10 0x7f7d580b4ed0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c006070 tx=0x7f7d6c006000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:01:03.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.840+0000 7f7d847a7b80 1 -- 172.21.15.82:0/2243692288 shutdown_connections 2024-05-08T06:01:03.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.840+0000 7f7d847a7b80 1 -- 172.21.15.82:0/2243692288 wait complete. 2024-05-08T06:01:03.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.841+0000 7f7d847a7b80 1 -- start start 2024-05-08T06:01:03.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.841+0000 7f7d847a7b80 1 Processor -- start 2024-05-08T06:01:03.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.842+0000 7f7d847a7b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f78ed2060 0x556f78edde20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:03.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.842+0000 7f7d847a7b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f78ed2980 0x556f78edb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:03.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.842+0000 7f7d847a7b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f78ed69d0 0x556f78edb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:03.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.842+0000 7f7d847a7b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556f78edebe0 con 0x556f78ed2060 2024-05-08T06:01:03.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.842+0000 7f7d847a7b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x556f78d8ab20 con 0x556f78ed69d0 2024-05-08T06:01:03.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.842+0000 7f7d847a7b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x556f78eded60 con 0x556f78ed2980 2024-05-08T06:01:03.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.842+0000 7f7d847a7b80 10 client.0 _ll_register_callbacks cb 0x556f78dcbc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:01:03.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.842+0000 7f7d72000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f78ed2980 0x556f78edb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:03.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.842+0000 7f7d72000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f78ed2980 0x556f78edb230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:43612/0 (socket says 172.21.15.82:43612) 2024-05-08T06:01:03.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.842+0000 7f7d72000700 1 -- 172.21.15.82:0/1818213101 learned_addr learned my addr 172.21.15.82:0/1818213101 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:01:03.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.842+0000 7f7d73400700 1 --2- 172.21.15.82:0/1818213101 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f78ed69d0 0x556f78edb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:03.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.842+0000 7f7d72a00700 1 --2- 172.21.15.82:0/1818213101 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f78ed2060 0x556f78edde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:03.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.843+0000 7f7d73400700 1 -- 172.21.15.82:0/1818213101 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f78ed2980 msgr2=0x556f78edb230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:01:03.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.843+0000 7f7d73400700 1 --2- 172.21.15.82:0/1818213101 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f78ed2980 0x556f78edb230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:03.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.843+0000 7f7d73400700 1 -- 172.21.15.82:0/1818213101 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f78ed2060 msgr2=0x556f78edde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:01:03.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.843+0000 7f7d73400700 1 --2- 172.21.15.82:0/1818213101 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f78ed2060 0x556f78edde20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:03.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.843+0000 7f7d73400700 1 -- 172.21.15.82:0/1818213101 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f78dea420 con 0x556f78ed69d0 2024-05-08T06:01:03.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.843+0000 7f7d73400700 1 --2- 172.21.15.82:0/1818213101 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f78ed69d0 0x556f78edb770 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c00b070 tx=0x7f7d6c0099e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cea6846d71e9b49d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:01:03.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.843+0000 7f7d5d600700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T06:01:03.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.844+0000 7f7d5d600700 1 -- 172.21.15.82:0/1818213101 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d6c02c030 con 0x556f78ed69d0 2024-05-08T06:01:03.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.844+0000 7f7d5d600700 1 -- 172.21.15.82:0/1818213101 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f7d6c028440 con 0x556f78ed69d0 2024-05-08T06:01:03.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.844+0000 7f7d847a7b80 1 -- 172.21.15.82:0/1818213101 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d600a96d0 con 0x556f78ed69d0 2024-05-08T06:01:03.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.844+0000 7f7d5d600700 1 -- 172.21.15.82:0/1818213101 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f7d6c0090d0 con 0x556f78ed69d0 2024-05-08T06:01:03.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.845+0000 7f7d847a7b80 10 client.26354 fetch_fsmap learned FSMap version 31 2024-05-08T06:01:03.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.845+0000 7f7d847a7b80 1 -- 172.21.15.82:0/1818213101 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x556f78ee9490 con 0x556f78ed69d0 2024-05-08T06:01:03.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.845+0000 7f7d5d600700 1 -- 172.21.15.82:0/1818213101 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7d600a96d0 con 0x556f78ed69d0 2024-05-08T06:01:03.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.845+0000 7f7d5d600700 1 -- 172.21.15.82:0/1818213101 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f7d6c011070 con 0x556f78ed69d0 2024-05-08T06:01:03.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.845+0000 7f7d847a7b80 10 client.26354 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:01:03.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.845+0000 7f7d847a7b80 10 client.26354 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T06:01:03.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.845+0000 7f7d847a7b80 20 client.26354 populate_metadata read hostname 'smithi082' 2024-05-08T06:01:03.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.845+0000 7f7d847a7b80 1 --2- 172.21.15.82:0/1818213101 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x556f78eeba20 0x556f78eede30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:03.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.845+0000 7f7d847a7b80 4 client.26354 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:01:03.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.845+0000 7f7d847a7b80 1 -- 172.21.15.82:0/1818213101 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556f78e9f0a0 con 0x556f78eeba20 2024-05-08T06:01:03.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.846+0000 7f7d72a00700 1 --2- 172.21.15.82:0/1818213101 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x556f78eeba20 0x556f78eede30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:03.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.847+0000 7f7d5d600700 10 client.26354 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T06:01:03.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.847+0000 7f7d72a00700 1 --2- 172.21.15.82:0/1818213101 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x556f78eeba20 0x556f78eede30 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf272c01ccda8fd8 server_cookie=d51d346f0c49602d in_seq=0 out_seq=0 2024-05-08T06:01:03.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.847+0000 7f7d5d600700 1 -- 172.21.15.82:0/1818213101 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x556f78e9f0a0 con 0x556f78eeba20 2024-05-08T06:01:03.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.847+0000 7f7d5d600700 10 client.26354 handle_command_reply: tid=0 2024-05-08T06:01:03.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.848+0000 7f7d847a7b80 1 client.26354 shutdown 2024-05-08T06:01:03.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.848+0000 7f7d847a7b80 1 -- 172.21.15.82:0/1818213101 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f78ed69d0 msgr2=0x556f78edb770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:03.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.848+0000 7f7d847a7b80 1 --2- 172.21.15.82:0/1818213101 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f78ed69d0 0x556f78edb770 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c00b070 tx=0x7f7d6c0099e0 comp rx=0 tx=0).stop 2024-05-08T06:01:03.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.848+0000 7f7d847a7b80 1 -- 172.21.15.82:0/1818213101 shutdown_connections 2024-05-08T06:01:03.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.848+0000 7f7d847a7b80 1 --2- 172.21.15.82:0/1818213101 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x556f78eeba20 0x556f78eede30 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:03.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.848+0000 7f7d847a7b80 1 --2- 172.21.15.82:0/1818213101 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f78ed69d0 0x556f78edb770 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:03.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.848+0000 7f7d847a7b80 1 --2- 172.21.15.82:0/1818213101 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f78ed2060 0x556f78edde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:03.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.848+0000 7f7d847a7b80 1 --2- 172.21.15.82:0/1818213101 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f78ed2980 0x556f78edb230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:03.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.848+0000 7f7d847a7b80 1 -- 172.21.15.82:0/1818213101 >> 172.21.15.82:0/1818213101 conn(0x556f78e00b60 msgr2=0x556f78ec72b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:01:03.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.848+0000 7f7d5d600700 0 client.26354 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T06:01:03.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.849+0000 7f7d847a7b80 1 -- 172.21.15.82:0/1818213101 shutdown_connections 2024-05-08T06:01:03.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.849+0000 7f7d847a7b80 1 -- 172.21.15.82:0/1818213101 wait complete. 2024-05-08T06:01:03.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.849+0000 7f7d847a7b80 20 client.26354 trim_cache size 0 max 16384 2024-05-08T06:01:03.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.879+0000 7f7d847a7b80 1 Processor -- start 2024-05-08T06:01:03.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.879+0000 7f7d847a7b80 1 -- start start 2024-05-08T06:01:03.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.880+0000 7f7d847a7b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f78ed2060 0x556f78ed8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:03.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.880+0000 7f7d847a7b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f78ed2980 0x556f78ee7c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:03.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.880+0000 7f7d847a7b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f78ed69d0 0x556f78edaa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:03.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.880+0000 7f7d847a7b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7d7410ce00 con 0x556f78ed2060 2024-05-08T06:01:03.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.880+0000 7f7d847a7b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7d7410e940 con 0x556f78ed69d0 2024-05-08T06:01:03.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.880+0000 7f7d847a7b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7d7410d4d0 con 0x556f78ed2980 2024-05-08T06:01:03.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.881+0000 7f7d72000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f78ed2980 0x556f78ee7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:03.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.881+0000 7f7d72000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f78ed2980 0x556f78ee7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:43620/0 (socket says 172.21.15.82:43620) 2024-05-08T06:01:03.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.881+0000 7f7d72000700 1 -- 172.21.15.82:0/3149721917 learned_addr learned my addr 172.21.15.82:0/3149721917 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:01:03.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.881+0000 7f7d73400700 1 --2- 172.21.15.82:0/3149721917 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f78ed69d0 0x556f78edaa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:03.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.881+0000 7f7d72a00700 1 --2- 172.21.15.82:0/3149721917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f78ed2060 0x556f78ed8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:03.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.881+0000 7f7d72000700 1 -- 172.21.15.82:0/3149721917 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f78ed69d0 msgr2=0x556f78edaa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:01:03.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.882+0000 7f7d72000700 1 --2- 172.21.15.82:0/3149721917 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f78ed69d0 0x556f78edaa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:03.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.882+0000 7f7d72000700 1 -- 172.21.15.82:0/3149721917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f78ed2060 msgr2=0x556f78ed8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:01:03.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.882+0000 7f7d72000700 1 --2- 172.21.15.82:0/3149721917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f78ed2060 0x556f78ed8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:03.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.882+0000 7f7d72000700 1 -- 172.21.15.82:0/3149721917 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f78ecd9c0 con 0x556f78ed2980 2024-05-08T06:01:03.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.882+0000 7f7d73400700 1 --2- 172.21.15.82:0/3149721917 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f78ed69d0 0x556f78edaa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:01:03.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.882+0000 7f7d72000700 1 --2- 172.21.15.82:0/3149721917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f78ed2980 0x556f78ee7c70 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7d6000afd0 tx=0x7f7d6000fef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=102af9f5aa5533b3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:01:03.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.882+0000 7f7d5fe00700 1 -- 172.21.15.82:0/3149721917 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d600c8030 con 0x556f78ed2980 2024-05-08T06:01:03.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.883+0000 7f7d5fe00700 1 -- 172.21.15.82:0/3149721917 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7d600b2530 con 0x556f78ed2980 2024-05-08T06:01:03.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.883+0000 7f7d5fe00700 1 -- 172.21.15.82:0/3149721917 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d600c2070 con 0x556f78ed2980 2024-05-08T06:01:03.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.883+0000 7f7d847a7b80 1 -- 172.21.15.82:0/3149721917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f78ed2980 msgr2=0x556f78ee7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:03.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.883+0000 7f7d847a7b80 1 --2- 172.21.15.82:0/3149721917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f78ed2980 0x556f78ee7c70 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7d6000afd0 tx=0x7f7d6000fef0 comp rx=0 tx=0).stop 2024-05-08T06:01:03.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.883+0000 7f7d847a7b80 1 -- 172.21.15.82:0/3149721917 shutdown_connections 2024-05-08T06:01:03.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.883+0000 7f7d847a7b80 1 --2- 172.21.15.82:0/3149721917 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f78ed69d0 0x556f78edaa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:03.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.883+0000 7f7d847a7b80 1 --2- 172.21.15.82:0/3149721917 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f78ed2060 0x556f78ed8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:03.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.883+0000 7f7d847a7b80 1 --2- 172.21.15.82:0/3149721917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f78ed2980 0x556f78ee7c70 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:03.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.883+0000 7f7d847a7b80 1 -- 172.21.15.82:0/3149721917 >> 172.21.15.82:0/3149721917 conn(0x556f78e00b60 msgr2=0x556f78ed1700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:01:03.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.884+0000 7f7d847a7b80 1 -- 172.21.15.82:0/3149721917 shutdown_connections 2024-05-08T06:01:03.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.884+0000 7f7d847a7b80 1 -- 172.21.15.82:0/3149721917 wait complete. 2024-05-08T06:01:03.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.884+0000 7f7d847a7b80 1 -- start start 2024-05-08T06:01:03.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.884+0000 7f7d847a7b80 1 Processor -- start 2024-05-08T06:01:03.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.885+0000 7f7d847a7b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f78ed2060 0x556f78ef3270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:03.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.885+0000 7f7d847a7b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f78ed2980 0x556f78ef37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:03.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.885+0000 7f7d847a7b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f78ed69d0 0x556f78ee26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:03.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.885+0000 7f7d847a7b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7d7410e270 con 0x556f78ed2060 2024-05-08T06:01:03.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.885+0000 7f7d847a7b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7d7410dba0 con 0x556f78ed69d0 2024-05-08T06:01:03.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.885+0000 7f7d847a7b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7d7410ada0 con 0x556f78ed2980 2024-05-08T06:01:03.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.885+0000 7f7d847a7b80 10 client.0 _ll_register_callbacks cb 0x556f78dcbc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:01:03.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.886+0000 7f7d73400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f78ed69d0 0x556f78ee26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:03.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.886+0000 7f7d73400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f78ed69d0 0x556f78ee26b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:59532/0 (socket says 172.21.15.82:59532) 2024-05-08T06:01:03.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.886+0000 7f7d73400700 1 -- 172.21.15.82:0/1830254880 learned_addr learned my addr 172.21.15.82:0/1830254880 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:01:03.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.886+0000 7f7d72000700 1 --2- 172.21.15.82:0/1830254880 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f78ed2980 0x556f78ef37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:03.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.887+0000 7f7d72a00700 1 --2- 172.21.15.82:0/1830254880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f78ed2060 0x556f78ef3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:03.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.887+0000 7f7d72000700 1 -- 172.21.15.82:0/1830254880 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f78ed69d0 msgr2=0x556f78ee26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:01:03.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.887+0000 7f7d72000700 1 --2- 172.21.15.82:0/1830254880 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f78ed69d0 0x556f78ee26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:03.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.887+0000 7f7d72000700 1 -- 172.21.15.82:0/1830254880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f78ed2060 msgr2=0x556f78ef3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:01:03.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.887+0000 7f7d72000700 1 --2- 172.21.15.82:0/1830254880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f78ed2060 0x556f78ef3270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:03.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.887+0000 7f7d72000700 1 -- 172.21.15.82:0/1830254880 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f78ee2bf0 con 0x556f78ed2980 2024-05-08T06:01:03.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.888+0000 7f7d72000700 1 --2- 172.21.15.82:0/1830254880 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f78ed2980 0x556f78ef37b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7d600074a0 tx=0x7f7d600dfdb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1bd087dbc0003fe server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:01:03.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.888+0000 7f7d5d600700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T06:01:03.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.888+0000 7f7d5d600700 1 -- 172.21.15.82:0/1830254880 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d600c8070 con 0x556f78ed2980 2024-05-08T06:01:03.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.889+0000 7f7d5d600700 1 -- 172.21.15.82:0/1830254880 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f7d600a5cc0 con 0x556f78ed2980 2024-05-08T06:01:03.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.889+0000 7f7d847a7b80 1 -- 172.21.15.82:0/1830254880 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7d600b2530 con 0x556f78ed2980 2024-05-08T06:01:03.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.889+0000 7f7d5d600700 1 -- 172.21.15.82:0/1830254880 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f7d60083e60 con 0x556f78ed2980 2024-05-08T06:01:03.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.889+0000 7f7d847a7b80 10 client.26380 fetch_fsmap learned FSMap version 31 2024-05-08T06:01:03.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.890+0000 7f7d847a7b80 1 -- 172.21.15.82:0/1830254880 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x556f78f56920 con 0x556f78ed2980 2024-05-08T06:01:03.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.890+0000 7f7d5d600700 1 -- 172.21.15.82:0/1830254880 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7d600b2530 con 0x556f78ed2980 2024-05-08T06:01:03.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.890+0000 7f7d5d600700 1 -- 172.21.15.82:0/1830254880 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f7d600beb20 con 0x556f78ed2980 2024-05-08T06:01:03.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.890+0000 7f7d847a7b80 10 client.26380 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:01:03.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.890+0000 7f7d847a7b80 10 client.26380 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T06:01:03.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.890+0000 7f7d847a7b80 20 client.26380 populate_metadata read hostname 'smithi082' 2024-05-08T06:01:03.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.890+0000 7f7d847a7b80 1 --2- 172.21.15.82:0/1830254880 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x556f78f56af0 0x556f78f58ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:03.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.890+0000 7f7d847a7b80 4 client.26380 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-08T06:01:03.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.890+0000 7f7d847a7b80 1 -- 172.21.15.82:0/1830254880 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556f78e32400 con 0x556f78f56af0 2024-05-08T06:01:03.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.890+0000 7f7d72a00700 1 --2- 172.21.15.82:0/1830254880 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x556f78f56af0 0x556f78f58ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:03.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.891+0000 7f7d5d600700 10 client.26380 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T06:01:03.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.891+0000 7f7d72a00700 1 --2- 172.21.15.82:0/1830254880 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x556f78f56af0 0x556f78f58ee0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a282063802c72812 server_cookie=6511d979d973b989 in_seq=0 out_seq=0 2024-05-08T06:01:03.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.892+0000 7f7d5d600700 1 -- 172.21.15.82:0/1830254880 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x556f78e32400 con 0x556f78f56af0 2024-05-08T06:01:03.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.892+0000 7f7d5d600700 10 client.26380 handle_command_reply: tid=0 2024-05-08T06:01:03.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.892+0000 7f7d847a7b80 1 client.26380 shutdown 2024-05-08T06:01:03.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.892+0000 7f7d847a7b80 1 -- 172.21.15.82:0/1830254880 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f78ed2980 msgr2=0x556f78ef37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:03.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.892+0000 7f7d847a7b80 1 --2- 172.21.15.82:0/1830254880 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f78ed2980 0x556f78ef37b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7d600074a0 tx=0x7f7d600dfdb0 comp rx=0 tx=0).stop 2024-05-08T06:01:03.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.892+0000 7f7d847a7b80 1 -- 172.21.15.82:0/1830254880 shutdown_connections 2024-05-08T06:01:03.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.892+0000 7f7d847a7b80 1 --2- 172.21.15.82:0/1830254880 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x556f78f56af0 0x556f78f58ee0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:03.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.892+0000 7f7d847a7b80 1 --2- 172.21.15.82:0/1830254880 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556f78ed69d0 0x556f78ee26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:03.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.892+0000 7f7d847a7b80 1 --2- 172.21.15.82:0/1830254880 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556f78ed2060 0x556f78ef3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:03.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.892+0000 7f7d847a7b80 1 --2- 172.21.15.82:0/1830254880 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556f78ed2980 0x556f78ef37b0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:03.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.892+0000 7f7d847a7b80 1 -- 172.21.15.82:0/1830254880 >> 172.21.15.82:0/1830254880 conn(0x556f78e00b60 msgr2=0x556f78ed6e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:01:03.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.892+0000 7f7d5d600700 0 client.26380 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T06:01:03.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.893+0000 7f7d847a7b80 1 -- 172.21.15.82:0/1830254880 shutdown_connections 2024-05-08T06:01:03.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.893+0000 7f7d847a7b80 1 -- 172.21.15.82:0/1830254880 wait complete. 2024-05-08T06:01:03.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.893+0000 7f7d847a7b80 20 client.26380 trim_cache size 0 max 16384 2024-05-08T06:01:03.895 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T06:01:03.895 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-08T06:01:03.895 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2024-05-08T06:01:03.895 INFO:teuthology.orchestra.run.smithi082.stdout: "d95d75ae-c2ab-4203-a451-549e3abdf975": { 2024-05-08T06:01:03.896 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2024-05-08T06:01:03.896 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "d95d75ae-c2ab-4203-a451-549e3abdf975", 2024-05-08T06:01:03.896 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2024-05-08T06:01:03.896 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:01:03.896 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:01:03.896 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T06:01:03.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.895+0000 7f7d79e00700 1 -- 172.21.15.82:0/132006215 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7d580b2a10 msgr2=0x7f7d580b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:03.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.895+0000 7f7d79e00700 1 --2- 172.21.15.82:0/132006215 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7d580b2a10 0x7f7d580b4ed0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c006070 tx=0x7f7d6c006000 comp rx=0 tx=0).stop 2024-05-08T06:01:03.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.895+0000 7f7d79e00700 1 -- 172.21.15.82:0/132006215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d740782f0 msgr2=0x7f7d740750d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:03.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.895+0000 7f7d79e00700 1 --2- 172.21.15.82:0/132006215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d740782f0 0x7f7d740750d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7d6000c9b0 tx=0x7f7d6000ccc0 comp rx=0 tx=0).stop 2024-05-08T06:01:03.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.895+0000 7f7d79e00700 1 -- 172.21.15.82:0/132006215 shutdown_connections 2024-05-08T06:01:03.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.895+0000 7f7d79e00700 1 --2- 172.21.15.82:0/132006215 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d740779d0 0x7f7d74074b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:03.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.895+0000 7f7d79e00700 1 --2- 172.21.15.82:0/132006215 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7d580b2a10 0x7f7d580b4ed0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:03.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.895+0000 7f7d79e00700 1 --2- 172.21.15.82:0/132006215 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7d74114380 0x7f7d7406ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:03.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.895+0000 7f7d79e00700 1 --2- 172.21.15.82:0/132006215 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7d740782f0 0x7f7d740750d0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:03.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.895+0000 7f7d79e00700 1 -- 172.21.15.82:0/132006215 >> 172.21.15.82:0/132006215 conn(0x7f7d741011d0 msgr2=0x7f7d741035c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:01:03.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.895+0000 7f7d79e00700 1 -- 172.21.15.82:0/132006215 shutdown_connections 2024-05-08T06:01:03.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:03.895+0000 7f7d79e00700 1 -- 172.21.15.82:0/132006215 wait complete. 2024-05-08T06:01:04.159 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:01:04 smithi082 ceph-mon[30098]: pgmap v771: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.2 MiB/s wr, 581 op/s 2024-05-08T06:01:04.499 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:01:04 smithi134 ceph-mon[34132]: pgmap v771: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.2 MiB/s wr, 581 op/s 2024-05-08T06:01:04.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:01:04 smithi151 ceph-mon[34815]: pgmap v771: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.2 MiB/s wr, 581 op/s 2024-05-08T06:01:04.850 INFO:tasks.cephfs.filesystem:scrub status for tag:d95d75ae-c2ab-4203-a451-549e3abdf975 - {'path': '/', 'tag': 'd95d75ae-c2ab-4203-a451-549e3abdf975', 'options': 'recursive,force'} 2024-05-08T06:01:05.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 615.0 s, 1519.0 tps, lat 65.301 ms stddev 74.081 2024-05-08T06:01:06.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:01:06 smithi082 ceph-mon[30098]: pgmap v772: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.7 MiB/s wr, 632 op/s 2024-05-08T06:01:06.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:01:06 smithi082 ceph-mon[30098]: scrub summary: idle 2024-05-08T06:01:06.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:01:06 smithi082 ceph-mon[30098]: scrub summary: idle 2024-05-08T06:01:06.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:01:06 smithi134 ceph-mon[34132]: pgmap v772: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.7 MiB/s wr, 632 op/s 2024-05-08T06:01:06.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:01:06 smithi134 ceph-mon[34132]: scrub summary: idle 2024-05-08T06:01:06.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:01:06 smithi134 ceph-mon[34132]: scrub summary: idle 2024-05-08T06:01:06.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:01:06 smithi151 ceph-mon[34815]: pgmap v772: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.7 MiB/s wr, 632 op/s 2024-05-08T06:01:06.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:01:06 smithi151 ceph-mon[34815]: scrub summary: idle 2024-05-08T06:01:06.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:01:06 smithi151 ceph-mon[34815]: scrub summary: idle 2024-05-08T06:01:08.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:01:08 smithi082 ceph-mon[30098]: pgmap v773: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.9 MiB/s wr, 683 op/s 2024-05-08T06:01:08.499 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:01:08 smithi134 ceph-mon[34132]: pgmap v773: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.9 MiB/s wr, 683 op/s 2024-05-08T06:01:08.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:01:08 smithi151 ceph-mon[34815]: pgmap v773: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.9 MiB/s wr, 683 op/s 2024-05-08T06:01:10.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 620.0 s, 1540.2 tps, lat 65.431 ms stddev 79.615 2024-05-08T06:01:10.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:01:10 smithi082 ceph-mon[30098]: pgmap v774: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 6.8 MiB/s wr, 559 op/s 2024-05-08T06:01:10.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:01:10 smithi134 ceph-mon[34132]: pgmap v774: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 6.8 MiB/s wr, 559 op/s 2024-05-08T06:01:10.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:01:10 smithi151 ceph-mon[34815]: pgmap v774: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 6.8 MiB/s wr, 559 op/s 2024-05-08T06:01:12.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:01:12 smithi082 ceph-mon[30098]: pgmap v775: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 8.7 MiB/s wr, 750 op/s 2024-05-08T06:01:12.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:01:12 smithi134 ceph-mon[34132]: pgmap v775: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 8.7 MiB/s wr, 750 op/s 2024-05-08T06:01:12.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:01:12 smithi151 ceph-mon[34815]: pgmap v775: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 8.7 MiB/s wr, 750 op/s 2024-05-08T06:01:13.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:01:13 smithi134 ceph-mon[34132]: pgmap v776: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.5 MiB/s wr, 567 op/s 2024-05-08T06:01:13.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:01:13 smithi151 ceph-mon[34815]: pgmap v776: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.5 MiB/s wr, 567 op/s 2024-05-08T06:01:13.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:01:13 smithi082 ceph-mon[30098]: pgmap v776: 97 pgs: 97 active+clean; 1.6 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 5.5 MiB/s wr, 567 op/s 2024-05-08T06:01:15.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 625.0 s, 1678.4 tps, lat 59.522 ms stddev 70.360 2024-05-08T06:01:15.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:01:15 smithi151 ceph-mon[34815]: pgmap v777: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 5.6 MiB/s wr, 610 op/s 2024-05-08T06:01:15.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:01:15 smithi082 ceph-mon[30098]: pgmap v777: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 5.6 MiB/s wr, 610 op/s 2024-05-08T06:01:15.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:01:15 smithi134 ceph-mon[34132]: pgmap v777: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 5.6 MiB/s wr, 610 op/s 2024-05-08T06:01:17.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:01:17 smithi151 ceph-mon[34815]: pgmap v778: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 6.5 MiB/s wr, 707 op/s 2024-05-08T06:01:17.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:01:17 smithi082 ceph-mon[30098]: pgmap v778: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 6.5 MiB/s wr, 707 op/s 2024-05-08T06:01:17.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:01:17 smithi134 ceph-mon[34132]: pgmap v778: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 6.5 MiB/s wr, 707 op/s 2024-05-08T06:01:19.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:01:19 smithi151 ceph-mon[34815]: pgmap v779: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 5.9 MiB/s wr, 614 op/s 2024-05-08T06:01:19.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:01:19 smithi082 ceph-mon[30098]: pgmap v779: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 5.9 MiB/s wr, 614 op/s 2024-05-08T06:01:20.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:01:19 smithi134 ceph-mon[34132]: pgmap v779: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 5.9 MiB/s wr, 614 op/s 2024-05-08T06:01:20.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 630.0 s, 1916.6 tps, lat 52.098 ms stddev 60.693 2024-05-08T06:01:21.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:01:21 smithi151 ceph-mon[34815]: pgmap v780: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 6.8 MiB/s wr, 738 op/s 2024-05-08T06:01:21.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:01:21 smithi082 ceph-mon[30098]: pgmap v780: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 6.8 MiB/s wr, 738 op/s 2024-05-08T06:01:22.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:01:21 smithi134 ceph-mon[34132]: pgmap v780: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 6.8 MiB/s wr, 738 op/s 2024-05-08T06:01:23.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:01:23 smithi151 ceph-mon[34815]: pgmap v781: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 4.8 MiB/s wr, 540 op/s 2024-05-08T06:01:23.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:01:23 smithi082 ceph-mon[30098]: pgmap v781: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 4.8 MiB/s wr, 540 op/s 2024-05-08T06:01:23.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:01:23 smithi134 ceph-mon[34132]: pgmap v781: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 4.8 MiB/s wr, 540 op/s 2024-05-08T06:01:25.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 635.0 s, 1874.8 tps, lat 53.173 ms stddev 62.760 2024-05-08T06:01:25.880 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:01:25 smithi151 ceph-mon[34815]: pgmap v782: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.5 MiB/s wr, 598 op/s 2024-05-08T06:01:25.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:01:25 smithi082 ceph-mon[30098]: pgmap v782: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.5 MiB/s wr, 598 op/s 2024-05-08T06:01:26.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:01:25 smithi134 ceph-mon[34132]: pgmap v782: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 5.5 MiB/s wr, 598 op/s 2024-05-08T06:01:27.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:01:27 smithi151 ceph-mon[34815]: pgmap v783: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 6.5 MiB/s wr, 704 op/s 2024-05-08T06:01:27.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:01:27 smithi082 ceph-mon[30098]: pgmap v783: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 6.5 MiB/s wr, 704 op/s 2024-05-08T06:01:27.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:01:27 smithi134 ceph-mon[34132]: pgmap v783: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 6.5 MiB/s wr, 704 op/s 2024-05-08T06:01:29.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:01:29 smithi151 ceph-mon[34815]: pgmap v784: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.0 MiB/s wr, 558 op/s 2024-05-08T06:01:29.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:01:29 smithi082 ceph-mon[30098]: pgmap v784: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.0 MiB/s wr, 558 op/s 2024-05-08T06:01:30.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:01:29 smithi134 ceph-mon[34132]: pgmap v784: 97 pgs: 97 active+clean; 1.6 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 5.0 MiB/s wr, 558 op/s 2024-05-08T06:01:30.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 640.0 s, 1327.6 tps, lat 75.321 ms stddev 91.339 2024-05-08T06:01:31.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:01:31 smithi151 ceph-mon[34815]: pgmap v785: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 6.7 MiB/s wr, 718 op/s 2024-05-08T06:01:31.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:01:31 smithi082 ceph-mon[30098]: pgmap v785: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 6.7 MiB/s wr, 718 op/s 2024-05-08T06:01:32.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:01:31 smithi134 ceph-mon[34132]: pgmap v785: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 6.7 MiB/s wr, 718 op/s 2024-05-08T06:01:33.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:01:33 smithi151 ceph-mon[34815]: pgmap v786: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.8 MiB/s wr, 597 op/s 2024-05-08T06:01:33.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:01:33 smithi082 ceph-mon[30098]: pgmap v786: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.8 MiB/s wr, 597 op/s 2024-05-08T06:01:33.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:01:33 smithi134 ceph-mon[34132]: pgmap v786: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 5.8 MiB/s wr, 597 op/s 2024-05-08T06:01:34.851 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-08T06:01:35.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 645.0 s, 1377.8 tps, lat 72.207 ms stddev 76.849 2024-05-08T06:01:35.461 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:01:35.864 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:01:35 smithi082 ceph-mon[30098]: pgmap v787: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 6.5 MiB/s wr, 655 op/s 2024-05-08T06:01:35.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:01:35 smithi151 ceph-mon[34815]: pgmap v787: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 6.5 MiB/s wr, 655 op/s 2024-05-08T06:01:35.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:01:35 smithi134 ceph-mon[34132]: pgmap v787: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 6.5 MiB/s wr, 655 op/s 2024-05-08T06:01:37.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:01:37 smithi151 ceph-mon[34815]: pgmap v788: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.9 MiB/s wr, 709 op/s 2024-05-08T06:01:37.887 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:01:37 smithi082 ceph-mon[30098]: pgmap v788: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.9 MiB/s wr, 709 op/s 2024-05-08T06:01:37.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:01:37 smithi134 ceph-mon[34132]: pgmap v788: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.9 MiB/s wr, 709 op/s 2024-05-08T06:01:38.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.118+0000 7fe089600700 1 -- 172.21.15.82:0/2520113869 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe08410ff50 msgr2=0x7fe084112340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:38.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.118+0000 7fe089600700 1 --2- 172.21.15.82:0/2520113869 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe08410ff50 0x7fe084112340 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fe07c00b0a0 tx=0x7fe07c00b3b0 comp rx=0 tx=0).stop 2024-05-08T06:01:38.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.118+0000 7fe089600700 1 -- 172.21.15.82:0/2520113869 shutdown_connections 2024-05-08T06:01:38.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.118+0000 7fe089600700 1 --2- 172.21.15.82:0/2520113869 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe08410ff50 0x7fe084112340 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:38.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.118+0000 7fe089600700 1 --2- 172.21.15.82:0/2520113869 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe08406b1b0 0x7fe08406b590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:38.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.118+0000 7fe089600700 1 --2- 172.21.15.82:0/2520113869 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe08406bad0 0x7fe08410fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:38.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.118+0000 7fe089600700 1 -- 172.21.15.82:0/2520113869 >> 172.21.15.82:0/2520113869 conn(0x7fe084079350 msgr2=0x7fe084079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:01:38.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.119+0000 7fe089600700 1 -- 172.21.15.82:0/2520113869 shutdown_connections 2024-05-08T06:01:38.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.119+0000 7fe089600700 1 -- 172.21.15.82:0/2520113869 wait complete. 2024-05-08T06:01:38.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.120+0000 7fe089600700 1 Processor -- start 2024-05-08T06:01:38.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.120+0000 7fe089600700 1 -- start start 2024-05-08T06:01:38.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.120+0000 7fe089600700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe08406b1b0 0x7fe08419be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:38.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.120+0000 7fe089600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe08406bad0 0x7fe08419c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:38.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.120+0000 7fe089600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe08410ff50 0x7fe0841a0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:38.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.120+0000 7fe089600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe0841158c0 con 0x7fe08410ff50 2024-05-08T06:01:38.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.120+0000 7fe089600700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe084115740 con 0x7fe08406bad0 2024-05-08T06:01:38.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.120+0000 7fe089600700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe084115a40 con 0x7fe08406b1b0 2024-05-08T06:01:38.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.121+0000 7fe07be00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe08406bad0 0x7fe08419c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:38.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.121+0000 7fe07be00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe08406bad0 0x7fe08419c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:40768/0 (socket says 172.21.15.82:40768) 2024-05-08T06:01:38.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.121+0000 7fe07be00700 1 -- 172.21.15.82:0/1427388378 learned_addr learned my addr 172.21.15.82:0/1427388378 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:01:38.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.121+0000 7fe082a00700 1 --2- 172.21.15.82:0/1427388378 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe08406b1b0 0x7fe08419be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:38.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.121+0000 7fe083400700 1 --2- 172.21.15.82:0/1427388378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe08410ff50 0x7fe0841a0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:38.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.121+0000 7fe07be00700 1 -- 172.21.15.82:0/1427388378 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe08406b1b0 msgr2=0x7fe08419be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:38.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.121+0000 7fe07be00700 1 --2- 172.21.15.82:0/1427388378 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe08406b1b0 0x7fe08419be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:38.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.121+0000 7fe07be00700 1 -- 172.21.15.82:0/1427388378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe08410ff50 msgr2=0x7fe0841a0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:38.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.121+0000 7fe07be00700 1 --2- 172.21.15.82:0/1427388378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe08410ff50 0x7fe0841a0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:38.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.121+0000 7fe07be00700 1 -- 172.21.15.82:0/1427388378 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0841a0dd0 con 0x7fe08406bad0 2024-05-08T06:01:38.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.121+0000 7fe083400700 1 --2- 172.21.15.82:0/1427388378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe08410ff50 0x7fe0841a0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:01:38.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.121+0000 7fe07be00700 1 --2- 172.21.15.82:0/1427388378 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe08406bad0 0x7fe08419c350 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe07400d950 tx=0x7fe07400dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:01:38.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.122+0000 7fe07b400700 1 -- 172.21.15.82:0/1427388378 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe074016070 con 0x7fe08406bad0 2024-05-08T06:01:38.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.122+0000 7fe07b400700 1 -- 172.21.15.82:0/1427388378 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe074009df0 con 0x7fe08406bad0 2024-05-08T06:01:38.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.122+0000 7fe07b400700 1 -- 172.21.15.82:0/1427388378 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07400f3c0 con 0x7fe08406bad0 2024-05-08T06:01:38.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.122+0000 7fe089600700 1 -- 172.21.15.82:0/1427388378 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0841a10c0 con 0x7fe08406bad0 2024-05-08T06:01:38.124 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.122+0000 7fe089600700 1 -- 172.21.15.82:0/1427388378 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0841a8940 con 0x7fe08406bad0 2024-05-08T06:01:38.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.127+0000 7fe07b400700 1 -- 172.21.15.82:0/1427388378 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fe074019070 con 0x7fe08406bad0 2024-05-08T06:01:38.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.128+0000 7fe093fa9b80 1 Processor -- start 2024-05-08T06:01:38.129 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.129+0000 7fe093fa9b80 1 -- start start 2024-05-08T06:01:38.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.129+0000 7fe093fa9b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cfe87d9060 0x55cfe87d9440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:38.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.129+0000 7fe093fa9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfe87d9980 0x55cfe87dd490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:38.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.129+0000 7fe093fa9b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfe87dd9d0 0x55cfe87dde30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:38.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.129+0000 7fe093fa9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55cfe872ba20 con 0x55cfe87d9980 2024-05-08T06:01:38.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.129+0000 7fe093fa9b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55cfe86c9760 con 0x55cfe87dd9d0 2024-05-08T06:01:38.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.129+0000 7fe093fa9b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55cfe87279e0 con 0x55cfe87d9060 2024-05-08T06:01:38.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.129+0000 7fe083400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cfe87d9060 0x55cfe87d9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:38.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.129+0000 7fe07be00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfe87dd9d0 0x55cfe87dde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:38.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.130+0000 7fe082a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfe87d9980 0x55cfe87dd490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:38.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.130+0000 7fe083400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cfe87d9060 0x55cfe87d9440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:55812/0 (socket says 172.21.15.82:55812) 2024-05-08T06:01:38.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.130+0000 7fe083400700 1 -- 172.21.15.82:0/2369500148 learned_addr learned my addr 172.21.15.82:0/2369500148 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:01:38.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.132+0000 7fe07b400700 1 --2- 172.21.15.82:0/1427388378 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fe0680b2900 0x7fe0680b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:38.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.133+0000 7fe083400700 1 -- 172.21.15.82:0/2369500148 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfe87dd9d0 msgr2=0x55cfe87dde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:01:38.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.133+0000 7fe083400700 1 --2- 172.21.15.82:0/2369500148 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfe87dd9d0 0x55cfe87dde30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:38.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.133+0000 7fe083400700 1 -- 172.21.15.82:0/2369500148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfe87d9980 msgr2=0x55cfe87dd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:01:38.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.133+0000 7fe083400700 1 --2- 172.21.15.82:0/2369500148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfe87d9980 0x55cfe87dd490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:38.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.133+0000 7fe083400700 1 -- 172.21.15.82:0/2369500148 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfe86788d0 con 0x55cfe87d9060 2024-05-08T06:01:38.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.133+0000 7fe07b400700 1 -- 172.21.15.82:0/1427388378 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fe0740e1d10 con 0x7fe08406bad0 2024-05-08T06:01:38.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.134+0000 7fe083400700 1 --2- 172.21.15.82:0/1427388378 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fe0680b2900 0x7fe0680b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:38.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.134+0000 7fe083400700 1 --2- 172.21.15.82:0/2369500148 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cfe87d9060 0x55cfe87d9440 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe07c015000 tx=0x7fe07c0092d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a329e4dd9a3c3515 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:01:38.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.134+0000 7fe073e00700 1 -- 172.21.15.82:0/2369500148 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07c003de0 con 0x55cfe87d9060 2024-05-08T06:01:38.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.135+0000 7fe073e00700 1 -- 172.21.15.82:0/2369500148 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe07c027470 con 0x55cfe87d9060 2024-05-08T06:01:38.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.135+0000 7fe073e00700 1 -- 172.21.15.82:0/2369500148 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07c0052d0 con 0x55cfe87d9060 2024-05-08T06:01:38.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.135+0000 7fe083400700 1 --2- 172.21.15.82:0/1427388378 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fe0680b2900 0x7fe0680b4dc0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe07c026000 tx=0x7fe07c029000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:01:38.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.136+0000 7fe093fa9b80 1 -- 172.21.15.82:0/2369500148 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cfe87d9060 msgr2=0x55cfe87d9440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:38.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.136+0000 7fe093fa9b80 1 --2- 172.21.15.82:0/2369500148 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cfe87d9060 0x55cfe87d9440 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe07c015000 tx=0x7fe07c0092d0 comp rx=0 tx=0).stop 2024-05-08T06:01:38.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.136+0000 7fe093fa9b80 1 -- 172.21.15.82:0/2369500148 shutdown_connections 2024-05-08T06:01:38.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.136+0000 7fe093fa9b80 1 --2- 172.21.15.82:0/2369500148 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfe87dd9d0 0x55cfe87dde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:38.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.137+0000 7fe093fa9b80 1 --2- 172.21.15.82:0/2369500148 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cfe87d9060 0x55cfe87d9440 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:38.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.137+0000 7fe093fa9b80 1 --2- 172.21.15.82:0/2369500148 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfe87d9980 0x55cfe87dd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:38.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.137+0000 7fe093fa9b80 1 -- 172.21.15.82:0/2369500148 >> 172.21.15.82:0/2369500148 conn(0x55cfe8707b60 msgr2=0x55cfe87d37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:01:38.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.137+0000 7fe093fa9b80 1 -- 172.21.15.82:0/2369500148 shutdown_connections 2024-05-08T06:01:38.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.137+0000 7fe093fa9b80 1 -- 172.21.15.82:0/2369500148 wait complete. 2024-05-08T06:01:38.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.138+0000 7fe093fa9b80 1 -- start start 2024-05-08T06:01:38.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.138+0000 7fe093fa9b80 1 Processor -- start 2024-05-08T06:01:38.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.139+0000 7fe093fa9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfe87d9060 0x55cfe87e4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:38.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.140+0000 7fe093fa9b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cfe87d9980 0x55cfe87e21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:38.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.140+0000 7fe093fa9b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfe87dd9d0 0x55cfe87e2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:38.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.140+0000 7fe093fa9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55cfe87e5be0 con 0x55cfe87d9060 2024-05-08T06:01:38.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.140+0000 7fe093fa9b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55cfe8691b20 con 0x55cfe87dd9d0 2024-05-08T06:01:38.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.140+0000 7fe093fa9b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55cfe87e5d60 con 0x55cfe87d9980 2024-05-08T06:01:38.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.140+0000 7fe093fa9b80 10 client.0 _ll_register_callbacks cb 0x55cfe86d2c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:01:38.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.141+0000 7fe07be00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cfe87d9980 0x55cfe87e21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:38.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.141+0000 7fe07be00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cfe87d9980 0x55cfe87e21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:55826/0 (socket says 172.21.15.82:55826) 2024-05-08T06:01:38.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.141+0000 7fe07be00700 1 -- 172.21.15.82:0/1946001462 learned_addr learned my addr 172.21.15.82:0/1946001462 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:01:38.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.141+0000 7fe083400700 1 --2- 172.21.15.82:0/1946001462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfe87dd9d0 0x55cfe87e2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:38.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.141+0000 7fe082a00700 1 --2- 172.21.15.82:0/1946001462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfe87d9060 0x55cfe87e4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:38.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.142+0000 7fe083400700 1 -- 172.21.15.82:0/1946001462 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cfe87d9980 msgr2=0x55cfe87e21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:01:38.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.142+0000 7fe083400700 1 --2- 172.21.15.82:0/1946001462 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cfe87d9980 0x55cfe87e21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:38.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.142+0000 7fe083400700 1 -- 172.21.15.82:0/1946001462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfe87d9060 msgr2=0x55cfe87e4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:01:38.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.142+0000 7fe083400700 1 --2- 172.21.15.82:0/1946001462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfe87d9060 0x55cfe87e4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:38.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.142+0000 7fe083400700 1 -- 172.21.15.82:0/1946001462 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfe86f1420 con 0x55cfe87dd9d0 2024-05-08T06:01:38.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.143+0000 7fe083400700 1 --2- 172.21.15.82:0/1946001462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfe87dd9d0 0x55cfe87e2730 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe07c009fd0 tx=0x7fe07c027850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=90a5be12202e871e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:01:38.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.143+0000 7fe070c00700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T06:01:38.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.143+0000 7fe070c00700 1 -- 172.21.15.82:0/1946001462 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe07c009cc0 con 0x55cfe87dd9d0 2024-05-08T06:01:38.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.143+0000 7fe070c00700 1 -- 172.21.15.82:0/1946001462 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fe07c003de0 con 0x55cfe87dd9d0 2024-05-08T06:01:38.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.143+0000 7fe093fa9b80 1 -- 172.21.15.82:0/1946001462 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe07c027470 con 0x55cfe87dd9d0 2024-05-08T06:01:38.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.144+0000 7fe070c00700 1 -- 172.21.15.82:0/1946001462 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fe07c027d80 con 0x55cfe87dd9d0 2024-05-08T06:01:38.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.144+0000 7fe093fa9b80 10 client.26372 fetch_fsmap learned FSMap version 31 2024-05-08T06:01:38.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.144+0000 7fe093fa9b80 1 -- 172.21.15.82:0/1946001462 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55cfe87f8cd0 con 0x55cfe87dd9d0 2024-05-08T06:01:38.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.144+0000 7fe070c00700 1 -- 172.21.15.82:0/1946001462 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe07c027470 con 0x55cfe87dd9d0 2024-05-08T06:01:38.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.144+0000 7fe070c00700 1 -- 172.21.15.82:0/1946001462 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fe07c011070 con 0x55cfe87dd9d0 2024-05-08T06:01:38.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.144+0000 7fe093fa9b80 10 client.26372 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:01:38.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.144+0000 7fe093fa9b80 10 client.26372 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T06:01:38.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.144+0000 7fe093fa9b80 20 client.26372 populate_metadata read hostname 'smithi082' 2024-05-08T06:01:38.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.144+0000 7fe093fa9b80 1 --2- 172.21.15.82:0/1946001462 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55cfe87fb1a0 0x55cfe87fd590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:38.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.144+0000 7fe093fa9b80 4 client.26372 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:01:38.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.144+0000 7fe093fa9b80 1 -- 172.21.15.82:0/1946001462 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cfe87a60a0 con 0x55cfe87fb1a0 2024-05-08T06:01:38.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.145+0000 7fe082a00700 1 --2- 172.21.15.82:0/1946001462 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55cfe87fb1a0 0x55cfe87fd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:38.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.146+0000 7fe082a00700 1 --2- 172.21.15.82:0/1946001462 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55cfe87fb1a0 0x55cfe87fd590 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f55e606a38b8bd3 server_cookie=2e431538b340be95 in_seq=0 out_seq=0 2024-05-08T06:01:38.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.146+0000 7fe070c00700 10 client.26372 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T06:01:38.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.148+0000 7fe070c00700 1 -- 172.21.15.82:0/1946001462 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55cfe87a60a0 con 0x55cfe87fb1a0 2024-05-08T06:01:38.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.148+0000 7fe070c00700 10 client.26372 handle_command_reply: tid=0 2024-05-08T06:01:38.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.148+0000 7fe093fa9b80 1 client.26372 shutdown 2024-05-08T06:01:38.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.150+0000 7fe093fa9b80 1 -- 172.21.15.82:0/1946001462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfe87dd9d0 msgr2=0x55cfe87e2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:38.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.150+0000 7fe093fa9b80 1 --2- 172.21.15.82:0/1946001462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfe87dd9d0 0x55cfe87e2730 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe07c009fd0 tx=0x7fe07c027850 comp rx=0 tx=0).stop 2024-05-08T06:01:38.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.150+0000 7fe093fa9b80 1 -- 172.21.15.82:0/1946001462 shutdown_connections 2024-05-08T06:01:38.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.150+0000 7fe093fa9b80 1 --2- 172.21.15.82:0/1946001462 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55cfe87fb1a0 0x55cfe87fd590 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:38.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.150+0000 7fe070c00700 0 client.26372 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T06:01:38.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.150+0000 7fe093fa9b80 1 --2- 172.21.15.82:0/1946001462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfe87dd9d0 0x55cfe87e2730 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:38.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.150+0000 7fe093fa9b80 1 --2- 172.21.15.82:0/1946001462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfe87d9060 0x55cfe87e4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:38.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.150+0000 7fe093fa9b80 1 --2- 172.21.15.82:0/1946001462 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cfe87d9980 0x55cfe87e21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:38.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.150+0000 7fe093fa9b80 1 -- 172.21.15.82:0/1946001462 >> 172.21.15.82:0/1946001462 conn(0x55cfe8707b60 msgr2=0x55cfe87ce2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:01:38.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.150+0000 7fe093fa9b80 1 -- 172.21.15.82:0/1946001462 shutdown_connections 2024-05-08T06:01:38.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.151+0000 7fe093fa9b80 1 -- 172.21.15.82:0/1946001462 wait complete. 2024-05-08T06:01:38.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.151+0000 7fe093fa9b80 20 client.26372 trim_cache size 0 max 16384 2024-05-08T06:01:38.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.180+0000 7fe093fa9b80 1 Processor -- start 2024-05-08T06:01:38.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.180+0000 7fe093fa9b80 1 -- start start 2024-05-08T06:01:38.181 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.181+0000 7fe093fa9b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cfe87d9060 0x55cfe87e3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:38.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.181+0000 7fe093fa9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfe87d9980 0x55cfe87e09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:38.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.181+0000 7fe093fa9b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfe87dd9d0 0x55cfe87e0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:38.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.181+0000 7fe093fa9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe0841ab870 con 0x55cfe87d9980 2024-05-08T06:01:38.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.181+0000 7fe093fa9b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe0841ad3b0 con 0x55cfe87dd9d0 2024-05-08T06:01:38.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.181+0000 7fe093fa9b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe0841abf40 con 0x55cfe87d9060 2024-05-08T06:01:38.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.182+0000 7fe082a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cfe87d9060 0x55cfe87e3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:38.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.182+0000 7fe082a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cfe87d9060 0x55cfe87e3fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:55830/0 (socket says 172.21.15.82:55830) 2024-05-08T06:01:38.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.182+0000 7fe082a00700 1 -- 172.21.15.82:0/2675649127 learned_addr learned my addr 172.21.15.82:0/2675649127 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:01:38.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.182+0000 7fe083400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfe87dd9d0 0x55cfe87e0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:38.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.182+0000 7fe07be00700 1 --2- 172.21.15.82:0/2675649127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfe87d9980 0x55cfe87e09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:38.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.183+0000 7fe082a00700 1 -- 172.21.15.82:0/2675649127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfe87dd9d0 msgr2=0x55cfe87e0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:01:38.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.183+0000 7fe082a00700 1 --2- 172.21.15.82:0/2675649127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfe87dd9d0 0x55cfe87e0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:38.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.183+0000 7fe082a00700 1 -- 172.21.15.82:0/2675649127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfe87d9980 msgr2=0x55cfe87e09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:01:38.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.183+0000 7fe082a00700 1 --2- 172.21.15.82:0/2675649127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfe87d9980 0x55cfe87e09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:38.184 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.183+0000 7fe082a00700 1 -- 172.21.15.82:0/2675649127 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfe87cff90 con 0x55cfe87d9060 2024-05-08T06:01:38.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.184+0000 7fe082a00700 1 --2- 172.21.15.82:0/2675649127 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cfe87d9060 0x55cfe87e3fb0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x55cfe87e5dd0 tx=0x7fe06c0073d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=599621aa38a15d47 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:01:38.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.184+0000 7fe073400700 1 -- 172.21.15.82:0/2675649127 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe06c004a30 con 0x55cfe87d9060 2024-05-08T06:01:38.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.184+0000 7fe073400700 1 -- 172.21.15.82:0/2675649127 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe06c0054d0 con 0x55cfe87d9060 2024-05-08T06:01:38.185 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.184+0000 7fe073400700 1 -- 172.21.15.82:0/2675649127 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe06c003c30 con 0x55cfe87d9060 2024-05-08T06:01:38.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.186+0000 7fe093fa9b80 1 -- 172.21.15.82:0/2675649127 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cfe87d9060 msgr2=0x55cfe87e3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:38.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.186+0000 7fe093fa9b80 1 --2- 172.21.15.82:0/2675649127 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cfe87d9060 0x55cfe87e3fb0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x55cfe87e5dd0 tx=0x7fe06c0073d0 comp rx=0 tx=0).stop 2024-05-08T06:01:38.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.186+0000 7fe093fa9b80 1 -- 172.21.15.82:0/2675649127 shutdown_connections 2024-05-08T06:01:38.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.186+0000 7fe093fa9b80 1 --2- 172.21.15.82:0/2675649127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfe87dd9d0 0x55cfe87e0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:38.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.186+0000 7fe093fa9b80 1 --2- 172.21.15.82:0/2675649127 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cfe87d9060 0x55cfe87e3fb0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:38.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.186+0000 7fe093fa9b80 1 --2- 172.21.15.82:0/2675649127 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfe87d9980 0x55cfe87e09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:38.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.186+0000 7fe093fa9b80 1 -- 172.21.15.82:0/2675649127 >> 172.21.15.82:0/2675649127 conn(0x55cfe8707b60 msgr2=0x55cfe87e38a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:01:38.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.186+0000 7fe093fa9b80 1 -- 172.21.15.82:0/2675649127 shutdown_connections 2024-05-08T06:01:38.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.187+0000 7fe093fa9b80 1 -- 172.21.15.82:0/2675649127 wait complete. 2024-05-08T06:01:38.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.187+0000 7fe093fa9b80 1 -- start start 2024-05-08T06:01:38.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.187+0000 7fe093fa9b80 1 Processor -- start 2024-05-08T06:01:38.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.188+0000 7fe093fa9b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfe87d9060 0x55cfe8859830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:38.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.188+0000 7fe093fa9b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cfe87d9980 0x55cfe8859d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:38.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.188+0000 7fe093fa9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfe87dd9d0 0x55cfe88646d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:38.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.188+0000 7fe093fa9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fe0841acce0 con 0x55cfe87dd9d0 2024-05-08T06:01:38.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.188+0000 7fe093fa9b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe0841ac610 con 0x55cfe87d9060 2024-05-08T06:01:38.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.188+0000 7fe093fa9b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe084108450 con 0x55cfe87d9980 2024-05-08T06:01:38.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.188+0000 7fe093fa9b80 10 client.0 _ll_register_callbacks cb 0x55cfe86d2c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:01:38.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.189+0000 7fe082a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfe87d9060 0x55cfe8859830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:38.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.189+0000 7fe082a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfe87d9060 0x55cfe8859830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:40796/0 (socket says 172.21.15.82:40796) 2024-05-08T06:01:38.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.189+0000 7fe082a00700 1 -- 172.21.15.82:0/282697240 learned_addr learned my addr 172.21.15.82:0/282697240 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:01:38.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.189+0000 7fe07be00700 1 --2- 172.21.15.82:0/282697240 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cfe87d9980 0x55cfe8859d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:38.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.190+0000 7fe083400700 1 --2- 172.21.15.82:0/282697240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfe87dd9d0 0x55cfe88646d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:38.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.190+0000 7fe07be00700 1 -- 172.21.15.82:0/282697240 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfe87d9060 msgr2=0x55cfe8859830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:01:38.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.190+0000 7fe07be00700 1 --2- 172.21.15.82:0/282697240 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfe87d9060 0x55cfe8859830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:38.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.190+0000 7fe07be00700 1 -- 172.21.15.82:0/282697240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfe87dd9d0 msgr2=0x55cfe88646d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:01:38.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.190+0000 7fe07be00700 1 --2- 172.21.15.82:0/282697240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfe87dd9d0 0x55cfe88646d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:38.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.190+0000 7fe07be00700 1 -- 172.21.15.82:0/282697240 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfe8864c10 con 0x55cfe87d9980 2024-05-08T06:01:38.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.196+0000 7fe07be00700 1 --2- 172.21.15.82:0/282697240 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cfe87d9980 0x55cfe8859d70 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe0740dfb90 tx=0x7fe074005910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e67f4495c10975d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:01:38.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.196+0000 7fe070c00700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T06:01:38.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.196+0000 7fe070c00700 1 -- 172.21.15.82:0/282697240 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe074020040 con 0x55cfe87d9980 2024-05-08T06:01:38.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.197+0000 7fe070c00700 1 -- 172.21.15.82:0/282697240 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fe0740b1f10 con 0x55cfe87d9980 2024-05-08T06:01:38.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.198+0000 7fe093fa9b80 1 -- 172.21.15.82:0/282697240 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe06c0054d0 con 0x55cfe87d9980 2024-05-08T06:01:38.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.198+0000 7fe070c00700 1 -- 172.21.15.82:0/282697240 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fe0740a8e50 con 0x55cfe87d9980 2024-05-08T06:01:38.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.199+0000 7fe093fa9b80 10 client.26398 fetch_fsmap learned FSMap version 31 2024-05-08T06:01:38.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.199+0000 7fe093fa9b80 1 -- 172.21.15.82:0/282697240 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55cfe8865f30 con 0x55cfe87d9980 2024-05-08T06:01:38.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.201+0000 7fe070c00700 1 -- 172.21.15.82:0/282697240 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fe06c0054d0 con 0x55cfe87d9980 2024-05-08T06:01:38.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.201+0000 7fe070c00700 1 -- 172.21.15.82:0/282697240 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fe0740dfce0 con 0x55cfe87d9980 2024-05-08T06:01:38.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.201+0000 7fe093fa9b80 10 client.26398 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:01:38.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.201+0000 7fe093fa9b80 10 client.26398 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T06:01:38.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.201+0000 7fe093fa9b80 20 client.26398 populate_metadata read hostname 'smithi082' 2024-05-08T06:01:38.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.201+0000 7fe093fa9b80 1 --2- 172.21.15.82:0/282697240 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55cfe8866630 0x55cfe8868a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:38.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.201+0000 7fe093fa9b80 4 client.26398 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-08T06:01:38.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.201+0000 7fe093fa9b80 1 -- 172.21.15.82:0/282697240 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cfe8739400 con 0x55cfe8866630 2024-05-08T06:01:38.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.202+0000 7fe082a00700 1 --2- 172.21.15.82:0/282697240 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55cfe8866630 0x55cfe8868a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:38.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.203+0000 7fe070c00700 10 client.26398 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T06:01:38.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.204+0000 7fe082a00700 1 --2- 172.21.15.82:0/282697240 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55cfe8866630 0x55cfe8868a50 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=119fd74a635faec4 server_cookie=a82ed2049303bc81 in_seq=0 out_seq=0 2024-05-08T06:01:38.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.206+0000 7fe070c00700 1 -- 172.21.15.82:0/282697240 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55cfe8739400 con 0x55cfe8866630 2024-05-08T06:01:38.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.206+0000 7fe070c00700 10 client.26398 handle_command_reply: tid=0 2024-05-08T06:01:38.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.206+0000 7fe093fa9b80 1 client.26398 shutdown 2024-05-08T06:01:38.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.206+0000 7fe093fa9b80 1 -- 172.21.15.82:0/282697240 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cfe87d9980 msgr2=0x55cfe8859d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:38.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.206+0000 7fe093fa9b80 1 --2- 172.21.15.82:0/282697240 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cfe87d9980 0x55cfe8859d70 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe0740dfb90 tx=0x7fe074005910 comp rx=0 tx=0).stop 2024-05-08T06:01:38.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.206+0000 7fe093fa9b80 1 -- 172.21.15.82:0/282697240 shutdown_connections 2024-05-08T06:01:38.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.206+0000 7fe093fa9b80 1 --2- 172.21.15.82:0/282697240 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55cfe8866630 0x55cfe8868a50 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:38.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.207+0000 7fe093fa9b80 1 --2- 172.21.15.82:0/282697240 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfe87d9060 0x55cfe8859830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:38.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.207+0000 7fe093fa9b80 1 --2- 172.21.15.82:0/282697240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55cfe87dd9d0 0x55cfe88646d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:38.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.207+0000 7fe093fa9b80 1 --2- 172.21.15.82:0/282697240 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cfe87d9980 0x55cfe8859d70 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:38.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.207+0000 7fe093fa9b80 1 -- 172.21.15.82:0/282697240 >> 172.21.15.82:0/282697240 conn(0x55cfe8707b60 msgr2=0x55cfe87f7190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:01:38.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.207+0000 7fe070c00700 0 client.26398 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T06:01:38.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.207+0000 7fe093fa9b80 1 -- 172.21.15.82:0/282697240 shutdown_connections 2024-05-08T06:01:38.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.207+0000 7fe093fa9b80 1 -- 172.21.15.82:0/282697240 wait complete. 2024-05-08T06:01:38.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.207+0000 7fe093fa9b80 20 client.26398 trim_cache size 0 max 16384 2024-05-08T06:01:38.209 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T06:01:38.209 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "no active scrubs running", 2024-05-08T06:01:38.209 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": {} 2024-05-08T06:01:38.210 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T06:01:38.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.209+0000 7fe089600700 1 -- 172.21.15.82:0/1427388378 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fe0680b2900 msgr2=0x7fe0680b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:38.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.209+0000 7fe089600700 1 --2- 172.21.15.82:0/1427388378 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fe0680b2900 0x7fe0680b4dc0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fe07c026000 tx=0x7fe07c029000 comp rx=0 tx=0).stop 2024-05-08T06:01:38.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.209+0000 7fe089600700 1 -- 172.21.15.82:0/1427388378 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe08406bad0 msgr2=0x7fe08419c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:38.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.209+0000 7fe089600700 1 --2- 172.21.15.82:0/1427388378 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe08406bad0 0x7fe08419c350 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe07400d950 tx=0x7fe07400dc60 comp rx=0 tx=0).stop 2024-05-08T06:01:38.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.210+0000 7fe089600700 1 -- 172.21.15.82:0/1427388378 shutdown_connections 2024-05-08T06:01:38.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.210+0000 7fe089600700 1 --2- 172.21.15.82:0/1427388378 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fe0680b2900 0x7fe0680b4dc0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:38.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.210+0000 7fe089600700 1 --2- 172.21.15.82:0/1427388378 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fe08410ff50 0x7fe0841a0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:38.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.211+0000 7fe089600700 1 --2- 172.21.15.82:0/1427388378 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe08406b1b0 0x7fe08419be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:38.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.211+0000 7fe089600700 1 --2- 172.21.15.82:0/1427388378 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe08406bad0 0x7fe08419c350 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:38.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.211+0000 7fe089600700 1 -- 172.21.15.82:0/1427388378 >> 172.21.15.82:0/1427388378 conn(0x7fe084079350 msgr2=0x7fe084111440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:01:38.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.211+0000 7fe089600700 1 -- 172.21.15.82:0/1427388378 shutdown_connections 2024-05-08T06:01:38.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:38.211+0000 7fe089600700 1 -- 172.21.15.82:0/1427388378 wait complete. 2024-05-08T06:01:39.094 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-08T06:01:39.094 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T06:01:39.669 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:01:39.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:01:39 smithi082 ceph-mon[30098]: pgmap v789: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.4 MiB/s wr, 559 op/s 2024-05-08T06:01:39.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:01:39 smithi151 ceph-mon[34815]: pgmap v789: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.4 MiB/s wr, 559 op/s 2024-05-08T06:01:39.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:01:39 smithi134 ceph-mon[34132]: pgmap v789: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.4 MiB/s wr, 559 op/s 2024-05-08T06:01:40.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 650.0 s, 1150.0 tps, lat 87.008 ms stddev 109.556 2024-05-08T06:01:41.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:01:41 smithi082 ceph-mon[30098]: pgmap v790: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.5 MiB/s wr, 682 op/s 2024-05-08T06:01:41.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:01:41 smithi151 ceph-mon[34815]: pgmap v790: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.5 MiB/s wr, 682 op/s 2024-05-08T06:01:41.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:41.980+0000 7f6260c00700 1 -- 172.21.15.82:0/4032699139 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f625c0779d0 msgr2=0x7f625c077db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:41.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:41.980+0000 7f6260c00700 1 --2- 172.21.15.82:0/4032699139 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f625c0779d0 0x7f625c077db0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f624c009990 tx=0x7f624c009ca0 comp rx=0 tx=0).stop 2024-05-08T06:01:41.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:41.981+0000 7f6260c00700 1 -- 172.21.15.82:0/4032699139 shutdown_connections 2024-05-08T06:01:41.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:41.981+0000 7f6260c00700 1 --2- 172.21.15.82:0/4032699139 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f625c114360 0x7f625c116750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:41.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:41.981+0000 7f6260c00700 1 --2- 172.21.15.82:0/4032699139 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f625c0779d0 0x7f625c077db0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:41.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:41.981+0000 7f6260c00700 1 --2- 172.21.15.82:0/4032699139 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f625c0782f0 0x7f625c113e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:41.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:41.981+0000 7f6260c00700 1 -- 172.21.15.82:0/4032699139 >> 172.21.15.82:0/4032699139 conn(0x7f625c1011d0 msgr2=0x7f625c1035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:01:41.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:41.981+0000 7f6260c00700 1 -- 172.21.15.82:0/4032699139 shutdown_connections 2024-05-08T06:01:41.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:41.981+0000 7f6260c00700 1 -- 172.21.15.82:0/4032699139 wait complete. 2024-05-08T06:01:41.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:41.982+0000 7f6260c00700 1 Processor -- start 2024-05-08T06:01:41.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:41.982+0000 7f6260c00700 1 -- start start 2024-05-08T06:01:41.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:41.983+0000 7f6260c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f625c0779d0 0x7f625c1a01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:41.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:41.983+0000 7f6260c00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f625c0782f0 0x7f625c1a0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:41.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:41.983+0000 7f6260c00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f625c114360 0x7f625c1a4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:41.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:41.983+0000 7f6260c00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f625c119d40 con 0x7f625c0779d0 2024-05-08T06:01:41.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:41.983+0000 7f6260c00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f625c119bc0 con 0x7f625c0782f0 2024-05-08T06:01:41.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:41.983+0000 7f6260c00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f625c119ec0 con 0x7f625c114360 2024-05-08T06:01:41.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:41.983+0000 7f6259e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f625c0779d0 0x7f625c1a01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:41.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:41.983+0000 7f6259e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f625c0779d0 0x7f625c1a01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48308/0 (socket says 172.21.15.82:48308) 2024-05-08T06:01:41.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:41.983+0000 7f6259e00700 1 -- 172.21.15.82:0/4188647172 learned_addr learned my addr 172.21.15.82:0/4188647172 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:01:41.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:41.983+0000 7f625a800700 1 --2- 172.21.15.82:0/4188647172 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f625c114360 0x7f625c1a4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:41.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:41.983+0000 7f6259400700 1 --2- 172.21.15.82:0/4188647172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f625c0782f0 0x7f625c1a0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:41.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:41.984+0000 7f6259e00700 1 -- 172.21.15.82:0/4188647172 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f625c114360 msgr2=0x7f625c1a4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:41.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:41.984+0000 7f6259e00700 1 --2- 172.21.15.82:0/4188647172 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f625c114360 0x7f625c1a4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:41.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:41.984+0000 7f6259e00700 1 -- 172.21.15.82:0/4188647172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f625c0782f0 msgr2=0x7f625c1a0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:41.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:41.984+0000 7f6259e00700 1 --2- 172.21.15.82:0/4188647172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f625c0782f0 0x7f625c1a0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:41.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:41.984+0000 7f6259e00700 1 -- 172.21.15.82:0/4188647172 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f625c1a5200 con 0x7f625c0779d0 2024-05-08T06:01:41.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:41.984+0000 7f6259400700 1 --2- 172.21.15.82:0/4188647172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f625c0782f0 0x7f625c1a0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:01:41.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:41.984+0000 7f625a800700 1 --2- 172.21.15.82:0/4188647172 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f625c114360 0x7f625c1a4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:01:41.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:41.984+0000 7f6259e00700 1 --2- 172.21.15.82:0/4188647172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f625c0779d0 0x7f625c1a01f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f624c005910 tx=0x7f624c00b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:01:41.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:41.984+0000 7f6252a00700 1 -- 172.21.15.82:0/4188647172 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f624c027070 con 0x7f625c0779d0 2024-05-08T06:01:41.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:41.984+0000 7f6252a00700 1 -- 172.21.15.82:0/4188647172 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f624c022470 con 0x7f625c0779d0 2024-05-08T06:01:41.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:41.984+0000 7f6260c00700 1 -- 172.21.15.82:0/4188647172 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f625c1a5490 con 0x7f625c0779d0 2024-05-08T06:01:41.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:41.984+0000 7f6260c00700 1 -- 172.21.15.82:0/4188647172 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f625c1acd70 con 0x7f625c0779d0 2024-05-08T06:01:41.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:41.985+0000 7f6252a00700 1 -- 172.21.15.82:0/4188647172 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f624c017650 con 0x7f625c0779d0 2024-05-08T06:01:41.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:41.986+0000 7f6260c00700 1 -- 172.21.15.82:0/4188647172 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f625c06a190 con 0x7f625c0779d0 2024-05-08T06:01:41.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:41.989+0000 7f6252a00700 1 -- 172.21.15.82:0/4188647172 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f624c02a070 con 0x7f625c0779d0 2024-05-08T06:01:41.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:41.993+0000 7f6252a00700 1 --2- 172.21.15.82:0/4188647172 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f62400b2900 0x7f62400b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:41.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:41.993+0000 7f6259400700 1 --2- 172.21.15.82:0/4188647172 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f62400b2900 0x7f62400b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:41.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:41.994+0000 7f6252a00700 1 -- 172.21.15.82:0/4188647172 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f624c0e3140 con 0x7f625c0779d0 2024-05-08T06:01:41.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:41.995+0000 7f6259400700 1 --2- 172.21.15.82:0/4188647172 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f62400b2900 0x7f62400b4dc0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f625c07a9b0 tx=0x7f6248009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:01:41.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:41.997+0000 7f6252a00700 1 -- 172.21.15.82:0/4188647172 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f624c013070 con 0x7f625c0779d0 2024-05-08T06:01:42.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:01:41 smithi134 ceph-mon[34132]: pgmap v790: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.5 MiB/s wr, 682 op/s 2024-05-08T06:01:42.407 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:42.406+0000 7f6260c00700 1 -- 172.21.15.82:0/4188647172 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f625c02e510 con 0x7f625c0779d0 2024-05-08T06:01:42.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:42.407+0000 7f6252a00700 1 -- 172.21.15.82:0/4188647172 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11948 (secure 0 0 0) 0x7f624c0aaea0 con 0x7f625c0779d0 2024-05-08T06:01:42.408 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T06:01:42.408 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14364,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3876883250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3876883250},{"type":"v1","addr":"172.21.15.82:6835","nonce":3876883250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1965070586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1965070586},{"type":"v1","addr":"172.21.15.82:6837","nonce":1965070586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":31,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T05:45:57.654009+0000","modified":"2024-05-08T05:53:20.165672+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24505,"mds_2":24487,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14397":{"gid":14397,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/1890720973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1890720973},{"type":"v1","addr":"172.21.15.82:6839","nonce":1890720973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14409":{"gid":14409,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/2957083305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":2957083305},{"type":"v1","addr":"172.21.15.82:6841","nonce":2957083305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6833/3827691638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3827691638},{"type":"v1","addr":"172.21.15.134:6833","nonce":3827691638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6833/3625067797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3625067797},{"type":"v1","addr":"172.21.15.151:6833","nonce":3625067797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/4074163402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4074163402},{"type":"v1","addr":"172.21.15.134:6835","nonce":4074163402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.134:6837/2212411710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2212411710},{"type":"v1","addr":"172.21.15.134:6837","nonce":2212411710}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":17,"addr":"172.21.15.151:6835/2093655929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2093655929},{"type":"v1","addr":"172.21.15.151:6835","nonce":2093655929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6837/4192404464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":4192404464},{"type":"v1","addr":"172.21.15.151:6837","nonce":4192404464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":14,"addr":"172.21.15.151:6839/2963754236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":2963754236},{"type":"v1","addr":"172.21.15.151:6839","nonce":2963754236}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.134:6839/1145270893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1145270893},{"type":"v1","addr":"172.21.15.134:6839","nonce":1145270893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24505,24506,24487,24475,24467]},"id":1}]} 2024-05-08T06:01:42.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:42.409+0000 7f6260c00700 1 -- 172.21.15.82:0/4188647172 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f62400b2900 msgr2=0x7f62400b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:42.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:42.409+0000 7f6260c00700 1 --2- 172.21.15.82:0/4188647172 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f62400b2900 0x7f62400b4dc0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f625c07a9b0 tx=0x7f6248009260 comp rx=0 tx=0).stop 2024-05-08T06:01:42.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:42.409+0000 7f6260c00700 1 -- 172.21.15.82:0/4188647172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f625c0779d0 msgr2=0x7f625c1a01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:42.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:42.409+0000 7f6260c00700 1 --2- 172.21.15.82:0/4188647172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f625c0779d0 0x7f625c1a01f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f624c005910 tx=0x7f624c00b670 comp rx=0 tx=0).stop 2024-05-08T06:01:42.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:42.409+0000 7f6260c00700 1 -- 172.21.15.82:0/4188647172 shutdown_connections 2024-05-08T06:01:42.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:42.409+0000 7f6260c00700 1 --2- 172.21.15.82:0/4188647172 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f62400b2900 0x7f62400b4dc0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:42.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:42.409+0000 7f6260c00700 1 --2- 172.21.15.82:0/4188647172 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f625c114360 0x7f625c1a4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:42.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:42.409+0000 7f6260c00700 1 --2- 172.21.15.82:0/4188647172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f625c0779d0 0x7f625c1a01f0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:42.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:42.409+0000 7f6260c00700 1 --2- 172.21.15.82:0/4188647172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f625c0782f0 0x7f625c1a0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:42.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:42.409+0000 7f6260c00700 1 -- 172.21.15.82:0/4188647172 >> 172.21.15.82:0/4188647172 conn(0x7f625c1011d0 msgr2=0x7f625c1035c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:01:42.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:42.410+0000 7f6260c00700 1 -- 172.21.15.82:0/4188647172 shutdown_connections 2024-05-08T06:01:42.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:42.410+0000 7f6260c00700 1 -- 172.21.15.82:0/4188647172 wait complete. 2024-05-08T06:01:42.414 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 31 2024-05-08T06:01:42.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:01:42 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/4188647172' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:01:42.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:01:42 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/4188647172' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:01:43.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:01:42 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/4188647172' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:01:43.494 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-05-08T06:01:43.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:01:43 smithi082 ceph-mon[30098]: pgmap v791: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.5 MiB/s wr, 582 op/s 2024-05-08T06:01:43.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:01:43 smithi151 ceph-mon[34815]: pgmap v791: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.5 MiB/s wr, 582 op/s 2024-05-08T06:01:43.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:01:43 smithi134 ceph-mon[34132]: pgmap v791: 97 pgs: 97 active+clean; 1.6 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.5 MiB/s wr, 582 op/s 2024-05-08T06:01:44.055 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:01:45.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 655.0 s, 1324.2 tps, lat 75.055 ms stddev 91.217 2024-05-08T06:01:45.896 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:01:45 smithi082 ceph-mon[30098]: pgmap v792: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.7 MiB/s wr, 603 op/s 2024-05-08T06:01:45.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:01:45 smithi134 ceph-mon[34132]: pgmap v792: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.7 MiB/s wr, 603 op/s 2024-05-08T06:01:46.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:01:45 smithi151 ceph-mon[34815]: pgmap v792: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.7 MiB/s wr, 603 op/s 2024-05-08T06:01:46.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.246+0000 7f974d400700 1 -- 172.21.15.82:0/4042450172 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9748106070 msgr2=0x7f9748112580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:46.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.246+0000 7f974d400700 1 --2- 172.21.15.82:0/4042450172 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9748106070 0x7f9748112580 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f974000b0a0 tx=0x7f974000b3b0 comp rx=0 tx=0).stop 2024-05-08T06:01:46.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.246+0000 7f974d400700 1 -- 172.21.15.82:0/4042450172 shutdown_connections 2024-05-08T06:01:46.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.246+0000 7f974d400700 1 --2- 172.21.15.82:0/4042450172 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9748106070 0x7f9748112580 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:46.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.246+0000 7f974d400700 1 --2- 172.21.15.82:0/4042450172 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f974810b6b0 0x7f974810ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:46.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.246+0000 7f974d400700 1 --2- 172.21.15.82:0/4042450172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f97481056b0 0x7f9748105b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:46.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.246+0000 7f974d400700 1 -- 172.21.15.82:0/4042450172 >> 172.21.15.82:0/4042450172 conn(0x7f9748101180 msgr2=0x7f97481035a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:01:46.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.246+0000 7f974d400700 1 -- 172.21.15.82:0/4042450172 shutdown_connections 2024-05-08T06:01:46.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.246+0000 7f974d400700 1 -- 172.21.15.82:0/4042450172 wait complete. 2024-05-08T06:01:46.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.247+0000 7f974d400700 1 Processor -- start 2024-05-08T06:01:46.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.247+0000 7f974d400700 1 -- start start 2024-05-08T06:01:46.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.247+0000 7f974d400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97481056b0 0x7f97481a1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:46.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.247+0000 7f974d400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9748106070 0x7f97481a1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:46.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.248+0000 7f974d400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f974810b6b0 0x7f974819bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:46.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.248+0000 7f974d400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9748115900 con 0x7f974810b6b0 2024-05-08T06:01:46.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.248+0000 7f974d400700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9748115780 con 0x7f9748106070 2024-05-08T06:01:46.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.248+0000 7f974d400700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9748115a80 con 0x7f97481056b0 2024-05-08T06:01:46.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.248+0000 7f9746800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97481056b0 0x7f97481a1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:46.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.248+0000 7f973fe00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9748106070 0x7f97481a1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:46.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.248+0000 7f9746800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97481056b0 0x7f97481a1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:41378/0 (socket says 172.21.15.82:41378) 2024-05-08T06:01:46.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.248+0000 7f9746800700 1 -- 172.21.15.82:0/3444915153 learned_addr learned my addr 172.21.15.82:0/3444915153 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:01:46.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.248+0000 7f9747200700 1 --2- 172.21.15.82:0/3444915153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f974810b6b0 0x7f974819bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:46.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.248+0000 7f973fe00700 1 -- 172.21.15.82:0/3444915153 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97481056b0 msgr2=0x7f97481a1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:46.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.248+0000 7f973fe00700 1 --2- 172.21.15.82:0/3444915153 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97481056b0 0x7f97481a1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:46.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.248+0000 7f973fe00700 1 -- 172.21.15.82:0/3444915153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f974810b6b0 msgr2=0x7f974819bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:46.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.248+0000 7f973fe00700 1 --2- 172.21.15.82:0/3444915153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f974810b6b0 0x7f974819bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:46.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.248+0000 7f973fe00700 1 -- 172.21.15.82:0/3444915153 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f974819c400 con 0x7f9748106070 2024-05-08T06:01:46.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.248+0000 7f9747200700 1 --2- 172.21.15.82:0/3444915153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f974810b6b0 0x7f974819bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:01:46.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.248+0000 7f9746800700 1 --2- 172.21.15.82:0/3444915153 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97481056b0 0x7f97481a1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:01:46.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.249+0000 7f973fe00700 1 --2- 172.21.15.82:0/3444915153 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9748106070 0x7f97481a1f90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f973000e9f0 tx=0x7f973000ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:01:46.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.249+0000 7f973f400700 1 -- 172.21.15.82:0/3444915153 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f973000cb70 con 0x7f9748106070 2024-05-08T06:01:46.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.249+0000 7f973f400700 1 -- 172.21.15.82:0/3444915153 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97300044d0 con 0x7f9748106070 2024-05-08T06:01:46.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.249+0000 7f974d400700 1 -- 172.21.15.82:0/3444915153 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f974819c6f0 con 0x7f9748106070 2024-05-08T06:01:46.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.249+0000 7f973f400700 1 -- 172.21.15.82:0/3444915153 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9730003e00 con 0x7f9748106070 2024-05-08T06:01:46.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.249+0000 7f974d400700 1 -- 172.21.15.82:0/3444915153 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97481a89d0 con 0x7f9748106070 2024-05-08T06:01:46.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.254+0000 7f973f400700 1 -- 172.21.15.82:0/3444915153 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f973000cd10 con 0x7f9748106070 2024-05-08T06:01:46.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.255+0000 7f973f400700 1 --2- 172.21.15.82:0/3444915153 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f972c0b2940 0x7f972c0b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:46.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.256+0000 7f973f400700 1 -- 172.21.15.82:0/3444915153 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f97300e2350 con 0x7f9748106070 2024-05-08T06:01:46.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.256+0000 7f9757ca8b80 1 Processor -- start 2024-05-08T06:01:46.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.256+0000 7f9757ca8b80 1 -- start start 2024-05-08T06:01:46.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.256+0000 7f9746800700 1 --2- 172.21.15.82:0/3444915153 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f972c0b2940 0x7f972c0b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:46.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.256+0000 7f9757ca8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560971b7ebc0 0x560971b7efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:46.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.256+0000 7f9757ca8b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560971b7f4e0 0x560971b792d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:46.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.256+0000 7f9757ca8b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560971b798f0 0x560971b79d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:46.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.256+0000 7f9757ca8b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x560971acba20 con 0x560971b7ebc0 2024-05-08T06:01:46.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.256+0000 7f9757ca8b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x560971a69760 con 0x560971b7f4e0 2024-05-08T06:01:46.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.256+0000 7f9757ca8b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x560971ac79e0 con 0x560971b798f0 2024-05-08T06:01:46.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.257+0000 7f973fe00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560971b7f4e0 0x560971b792d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:46.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.257+0000 7f973fe00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560971b7f4e0 0x560971b792d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:60316/0 (socket says 172.21.15.82:60316) 2024-05-08T06:01:46.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.257+0000 7f973fe00700 1 -- 172.21.15.82:0/1903409723 learned_addr learned my addr 172.21.15.82:0/1903409723 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:01:46.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.257+0000 7f9746800700 1 --2- 172.21.15.82:0/3444915153 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f972c0b2940 0x7f972c0b4e00 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9738011550 tx=0x7f9738009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:01:46.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.257+0000 7f9746800700 1 --2- 172.21.15.82:0/1903409723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560971b7ebc0 0x560971b7efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:46.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.257+0000 7f9747200700 1 --2- 172.21.15.82:0/1903409723 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560971b798f0 0x560971b79d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:46.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.257+0000 7f973fe00700 1 -- 172.21.15.82:0/1903409723 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560971b798f0 msgr2=0x560971b79d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:01:46.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.257+0000 7f973fe00700 1 --2- 172.21.15.82:0/1903409723 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560971b798f0 0x560971b79d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:46.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.257+0000 7f973fe00700 1 -- 172.21.15.82:0/1903409723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560971b7ebc0 msgr2=0x560971b7efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:01:46.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.257+0000 7f973fe00700 1 --2- 172.21.15.82:0/1903409723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560971b7ebc0 0x560971b7efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:46.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.257+0000 7f973fe00700 1 -- 172.21.15.82:0/1903409723 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560971a188d0 con 0x560971b7f4e0 2024-05-08T06:01:46.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.257+0000 7f9746800700 1 --2- 172.21.15.82:0/1903409723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560971b7ebc0 0x560971b7efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:01:46.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.257+0000 7f973fe00700 1 --2- 172.21.15.82:0/1903409723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560971b7f4e0 0x560971b792d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f97300a5a00 tx=0x7f97300a93d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a10c2fd14a0077cc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:01:46.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.258+0000 7f9737e00700 1 -- 172.21.15.82:0/1903409723 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97300b2130 con 0x560971b7f4e0 2024-05-08T06:01:46.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.258+0000 7f9737e00700 1 -- 172.21.15.82:0/1903409723 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97300a9490 con 0x560971b7f4e0 2024-05-08T06:01:46.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.258+0000 7f9737e00700 1 -- 172.21.15.82:0/1903409723 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97300b2350 con 0x560971b7f4e0 2024-05-08T06:01:46.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.259+0000 7f9757ca8b80 1 -- 172.21.15.82:0/1903409723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560971b7f4e0 msgr2=0x560971b792d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:46.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.259+0000 7f9757ca8b80 1 --2- 172.21.15.82:0/1903409723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560971b7f4e0 0x560971b792d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f97300a5a00 tx=0x7f97300a93d0 comp rx=0 tx=0).stop 2024-05-08T06:01:46.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.260+0000 7f9757ca8b80 1 -- 172.21.15.82:0/1903409723 shutdown_connections 2024-05-08T06:01:46.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.260+0000 7f9757ca8b80 1 --2- 172.21.15.82:0/1903409723 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560971b798f0 0x560971b79d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:46.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.260+0000 7f9757ca8b80 1 --2- 172.21.15.82:0/1903409723 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560971b7ebc0 0x560971b7efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:46.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.260+0000 7f9757ca8b80 1 --2- 172.21.15.82:0/1903409723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560971b7f4e0 0x560971b792d0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:46.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.260+0000 7f9757ca8b80 1 -- 172.21.15.82:0/1903409723 >> 172.21.15.82:0/1903409723 conn(0x560971af16d0 msgr2=0x560971b73b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:01:46.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.260+0000 7f9757ca8b80 1 -- 172.21.15.82:0/1903409723 shutdown_connections 2024-05-08T06:01:46.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.260+0000 7f9757ca8b80 1 -- 172.21.15.82:0/1903409723 wait complete. 2024-05-08T06:01:46.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.261+0000 7f9757ca8b80 1 -- start start 2024-05-08T06:01:46.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.261+0000 7f9757ca8b80 1 Processor -- start 2024-05-08T06:01:46.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.262+0000 7f9757ca8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560971b798f0 0x560971b85160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:46.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.262+0000 7f9757ca8b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560971b7ebc0 0x560971b82500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:46.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.262+0000 7f9757ca8b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560971b7f4e0 0x560971b82a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:46.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.262+0000 7f9757ca8b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x560971b85ec0 con 0x560971b798f0 2024-05-08T06:01:46.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.262+0000 7f9757ca8b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x560971a31b20 con 0x560971b7ebc0 2024-05-08T06:01:46.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.262+0000 7f9757ca8b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x560971b86040 con 0x560971b7f4e0 2024-05-08T06:01:46.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.262+0000 7f9757ca8b80 10 client.0 _ll_register_callbacks cb 0x560971a72c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:01:46.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.262+0000 7f9747200700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560971b7f4e0 0x560971b82a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:46.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.262+0000 7f9747200700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560971b7f4e0 0x560971b82a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:41394/0 (socket says 172.21.15.82:41394) 2024-05-08T06:01:46.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.262+0000 7f9747200700 1 -- 172.21.15.82:0/3757576653 learned_addr learned my addr 172.21.15.82:0/3757576653 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:01:46.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.262+0000 7f973fe00700 1 --2- 172.21.15.82:0/3757576653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560971b7ebc0 0x560971b82500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:46.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.262+0000 7f9746800700 1 --2- 172.21.15.82:0/3757576653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560971b798f0 0x560971b85160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:46.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.263+0000 7f9747200700 1 -- 172.21.15.82:0/3757576653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560971b7ebc0 msgr2=0x560971b82500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:01:46.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.263+0000 7f9747200700 1 --2- 172.21.15.82:0/3757576653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560971b7ebc0 0x560971b82500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:46.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.263+0000 7f9747200700 1 -- 172.21.15.82:0/3757576653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560971b798f0 msgr2=0x560971b85160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:01:46.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.263+0000 7f9747200700 1 --2- 172.21.15.82:0/3757576653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560971b798f0 0x560971b85160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:46.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.263+0000 7f9747200700 1 -- 172.21.15.82:0/3757576653 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560971a91420 con 0x560971b7f4e0 2024-05-08T06:01:46.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.263+0000 7f9746800700 1 --2- 172.21.15.82:0/3757576653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560971b798f0 0x560971b85160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:01:46.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.263+0000 7f9747200700 1 --2- 172.21.15.82:0/3757576653 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560971b7f4e0 0x560971b82a40 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f974000b0a0 tx=0x7f974000bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f45977a4ea19d179 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:01:46.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.263+0000 7f9734c00700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T06:01:46.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.263+0000 7f9734c00700 1 -- 172.21.15.82:0/3757576653 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9740029060 con 0x560971b7f4e0 2024-05-08T06:01:46.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.263+0000 7f9734c00700 1 -- 172.21.15.82:0/3757576653 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f9740003dc0 con 0x560971b7f4e0 2024-05-08T06:01:46.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.264+0000 7f9757ca8b80 1 -- 172.21.15.82:0/3757576653 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97300a9490 con 0x560971b7f4e0 2024-05-08T06:01:46.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.264+0000 7f9734c00700 1 -- 172.21.15.82:0/3757576653 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f97400074e0 con 0x560971b7f4e0 2024-05-08T06:01:46.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.264+0000 7f9757ca8b80 10 client.26416 fetch_fsmap learned FSMap version 31 2024-05-08T06:01:46.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.265+0000 7f9757ca8b80 1 -- 172.21.15.82:0/3757576653 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x560971b98f00 con 0x560971b7f4e0 2024-05-08T06:01:46.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.265+0000 7f9734c00700 1 -- 172.21.15.82:0/3757576653 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97300a9490 con 0x560971b7f4e0 2024-05-08T06:01:46.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.265+0000 7f9734c00700 1 -- 172.21.15.82:0/3757576653 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f9740011070 con 0x560971b7f4e0 2024-05-08T06:01:46.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.265+0000 7f9757ca8b80 10 client.26416 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:01:46.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.265+0000 7f9757ca8b80 10 client.26416 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-05-08T06:01:46.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.265+0000 7f9757ca8b80 20 client.26416 populate_metadata read hostname 'smithi082' 2024-05-08T06:01:46.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.266+0000 7f9757ca8b80 1 --2- 172.21.15.82:0/3757576653 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x560971b9b540 0x560971b9d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:46.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.266+0000 7f9757ca8b80 4 client.26416 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:01:46.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.266+0000 7f9757ca8b80 1 -- 172.21.15.82:0/3757576653 --> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560971b46140 con 0x560971b9b540 2024-05-08T06:01:46.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.266+0000 7f9746800700 1 --2- 172.21.15.82:0/3757576653 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x560971b9b540 0x560971b9d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:46.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.267+0000 7f9746800700 1 --2- 172.21.15.82:0/3757576653 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x560971b9b540 0x560971b9d960 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=5ac43f38a915d52e server_cookie=298327041ce10109 in_seq=0 out_seq=0 2024-05-08T06:01:46.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.267+0000 7f9734c00700 10 client.26416 ms_handle_connect on v2:172.21.15.134:6836/2212411710 2024-05-08T06:01:46.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.267+0000 7f9734c00700 1 -- 172.21.15.82:0/3757576653 <== mds.4 v2:172.21.15.134:6836/2212411710 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x560971b46140 con 0x560971b9b540 2024-05-08T06:01:46.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.267+0000 7f9734c00700 10 client.26416 handle_command_reply: tid=0 2024-05-08T06:01:46.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.267+0000 7f9757ca8b80 1 client.26416 shutdown 2024-05-08T06:01:46.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.268+0000 7f9757ca8b80 1 -- 172.21.15.82:0/3757576653 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560971b7f4e0 msgr2=0x560971b82a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:46.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.268+0000 7f9757ca8b80 1 --2- 172.21.15.82:0/3757576653 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560971b7f4e0 0x560971b82a40 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f974000b0a0 tx=0x7f974000bed0 comp rx=0 tx=0).stop 2024-05-08T06:01:46.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.268+0000 7f9757ca8b80 1 -- 172.21.15.82:0/3757576653 shutdown_connections 2024-05-08T06:01:46.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.268+0000 7f9757ca8b80 1 --2- 172.21.15.82:0/3757576653 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x560971b9b540 0x560971b9d960 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:46.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.268+0000 7f9757ca8b80 1 --2- 172.21.15.82:0/3757576653 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560971b7f4e0 0x560971b82a40 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:46.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.268+0000 7f9757ca8b80 1 --2- 172.21.15.82:0/3757576653 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560971b798f0 0x560971b85160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:46.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.268+0000 7f9757ca8b80 1 --2- 172.21.15.82:0/3757576653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560971b7ebc0 0x560971b82500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:46.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.268+0000 7f9734c00700 0 client.26416 ms_handle_reset on v2:172.21.15.134:6836/2212411710 2024-05-08T06:01:46.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.268+0000 7f9757ca8b80 1 -- 172.21.15.82:0/3757576653 >> 172.21.15.82:0/3757576653 conn(0x560971af16d0 msgr2=0x560971b73190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:01:46.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.268+0000 7f9757ca8b80 1 -- 172.21.15.82:0/3757576653 shutdown_connections 2024-05-08T06:01:46.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.268+0000 7f9757ca8b80 1 -- 172.21.15.82:0/3757576653 wait complete. 2024-05-08T06:01:46.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.269+0000 7f9757ca8b80 20 client.26416 trim_cache size 0 max 16384 2024-05-08T06:01:46.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.291+0000 7f9757ca8b80 1 Processor -- start 2024-05-08T06:01:46.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.291+0000 7f9757ca8b80 1 -- start start 2024-05-08T06:01:46.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.291+0000 7f9757ca8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560971b798f0 0x560971b792d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:46.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.291+0000 7f9757ca8b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560971b7ebc0 0x560971b81480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:46.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.291+0000 7f9757ca8b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560971b7f4e0 0x560971b801a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:46.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.291+0000 7f9757ca8b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f97481ab870 con 0x560971b798f0 2024-05-08T06:01:46.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.291+0000 7f9757ca8b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f97481ad3b0 con 0x560971b7ebc0 2024-05-08T06:01:46.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.291+0000 7f9757ca8b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f97481abf40 con 0x560971b7f4e0 2024-05-08T06:01:46.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.292+0000 7f973fe00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560971b7ebc0 0x560971b81480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:46.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.292+0000 7f973fe00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560971b7ebc0 0x560971b81480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:60346/0 (socket says 172.21.15.82:60346) 2024-05-08T06:01:46.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.292+0000 7f973fe00700 1 -- 172.21.15.82:0/1160024021 learned_addr learned my addr 172.21.15.82:0/1160024021 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:01:46.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.292+0000 7f9747200700 1 --2- 172.21.15.82:0/1160024021 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560971b7f4e0 0x560971b801a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:46.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.292+0000 7f9746800700 1 --2- 172.21.15.82:0/1160024021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560971b798f0 0x560971b792d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:46.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.292+0000 7f973fe00700 1 -- 172.21.15.82:0/1160024021 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560971b7f4e0 msgr2=0x560971b801a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:01:46.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.292+0000 7f973fe00700 1 --2- 172.21.15.82:0/1160024021 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560971b7f4e0 0x560971b801a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:46.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.292+0000 7f973fe00700 1 -- 172.21.15.82:0/1160024021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560971b798f0 msgr2=0x560971b792d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:01:46.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.292+0000 7f973fe00700 1 --2- 172.21.15.82:0/1160024021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560971b798f0 0x560971b792d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:46.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.292+0000 7f973fe00700 1 -- 172.21.15.82:0/1160024021 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560971b9dcd0 con 0x560971b7ebc0 2024-05-08T06:01:46.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.292+0000 7f9746800700 1 --2- 172.21.15.82:0/1160024021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560971b798f0 0x560971b792d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:01:46.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.293+0000 7f973fe00700 1 --2- 172.21.15.82:0/1160024021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560971b7ebc0 0x560971b81480 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f97300a9440 tx=0x7f973000ef40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40820ab33111f982 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:01:46.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.293+0000 7f9737400700 1 -- 172.21.15.82:0/1160024021 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97300a9490 con 0x560971b7ebc0 2024-05-08T06:01:46.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.293+0000 7f9737400700 1 -- 172.21.15.82:0/1160024021 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97300aa080 con 0x560971b7ebc0 2024-05-08T06:01:46.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.293+0000 7f9737400700 1 -- 172.21.15.82:0/1160024021 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97300b2350 con 0x560971b7ebc0 2024-05-08T06:01:46.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.294+0000 7f9757ca8b80 1 -- 172.21.15.82:0/1160024021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560971b7ebc0 msgr2=0x560971b81480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:46.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.294+0000 7f9757ca8b80 1 --2- 172.21.15.82:0/1160024021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560971b7ebc0 0x560971b81480 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f97300a9440 tx=0x7f973000ef40 comp rx=0 tx=0).stop 2024-05-08T06:01:46.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.294+0000 7f9757ca8b80 1 -- 172.21.15.82:0/1160024021 shutdown_connections 2024-05-08T06:01:46.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.294+0000 7f9757ca8b80 1 --2- 172.21.15.82:0/1160024021 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560971b7f4e0 0x560971b801a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:46.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.294+0000 7f9757ca8b80 1 --2- 172.21.15.82:0/1160024021 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560971b798f0 0x560971b792d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:46.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.294+0000 7f9757ca8b80 1 --2- 172.21.15.82:0/1160024021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560971b7ebc0 0x560971b81480 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:46.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.294+0000 7f9757ca8b80 1 -- 172.21.15.82:0/1160024021 >> 172.21.15.82:0/1160024021 conn(0x560971af16d0 msgr2=0x560971b7d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:01:46.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.294+0000 7f9757ca8b80 1 -- 172.21.15.82:0/1160024021 shutdown_connections 2024-05-08T06:01:46.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.294+0000 7f9757ca8b80 1 -- 172.21.15.82:0/1160024021 wait complete. 2024-05-08T06:01:46.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.294+0000 7f9757ca8b80 1 -- start start 2024-05-08T06:01:46.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.295+0000 7f9757ca8b80 1 Processor -- start 2024-05-08T06:01:46.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.295+0000 7f9757ca8b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560971b798f0 0x560971b93f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:46.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.295+0000 7f9757ca8b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560971b7ebc0 0x560971ba2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:46.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.295+0000 7f9757ca8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560971b7f4e0 0x560971ba2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:46.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.295+0000 7f9757ca8b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f97481acce0 con 0x560971b7f4e0 2024-05-08T06:01:46.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.295+0000 7f9757ca8b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f97481ac610 con 0x560971b7ebc0 2024-05-08T06:01:46.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.295+0000 7f9757ca8b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f974807b740 con 0x560971b798f0 2024-05-08T06:01:46.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.295+0000 7f9757ca8b80 10 client.0 _ll_register_callbacks cb 0x560971a72c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:01:46.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.295+0000 7f9746800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560971b798f0 0x560971b93f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:46.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.295+0000 7f973fe00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560971b7ebc0 0x560971ba2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:46.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.295+0000 7f9746800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560971b798f0 0x560971b93f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:41404/0 (socket says 172.21.15.82:41404) 2024-05-08T06:01:46.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.295+0000 7f9746800700 1 -- 172.21.15.82:0/3501412711 learned_addr learned my addr 172.21.15.82:0/3501412711 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:01:46.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.296+0000 7f973fe00700 1 -- 172.21.15.82:0/3501412711 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560971b798f0 msgr2=0x560971b93f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:01:46.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.296+0000 7f973fe00700 1 --2- 172.21.15.82:0/3501412711 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560971b798f0 0x560971b93f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:46.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.296+0000 7f973fe00700 1 -- 172.21.15.82:0/3501412711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560971b7f4e0 msgr2=0x560971ba2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:01:46.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.296+0000 7f973fe00700 1 --2- 172.21.15.82:0/3501412711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560971b7f4e0 0x560971ba2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:46.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.296+0000 7f973fe00700 1 -- 172.21.15.82:0/3501412711 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560971ba31e0 con 0x560971b7ebc0 2024-05-08T06:01:46.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.297+0000 7f9734c00700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T06:01:46.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.297+0000 7f973fe00700 1 --2- 172.21.15.82:0/3501412711 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560971b7ebc0 0x560971ba2620 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x560971b9e140 tx=0x7f97300b2870 comp rx=0 tx=0).ready entity=mon.2 client_cookie=211ac97746d6c6a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:01:46.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.297+0000 7f9734c00700 1 -- 172.21.15.82:0/3501412711 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97300cc0d0 con 0x560971b7ebc0 2024-05-08T06:01:46.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.297+0000 7f9734c00700 1 -- 172.21.15.82:0/3501412711 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f97300cc270 con 0x560971b7ebc0 2024-05-08T06:01:46.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.298+0000 7f9757ca8b80 1 -- 172.21.15.82:0/3501412711 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97300aa080 con 0x560971b7ebc0 2024-05-08T06:01:46.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.298+0000 7f9734c00700 1 -- 172.21.15.82:0/3501412711 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f97300b2350 con 0x560971b7ebc0 2024-05-08T06:01:46.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.298+0000 7f9757ca8b80 10 client.26402 fetch_fsmap learned FSMap version 31 2024-05-08T06:01:46.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.298+0000 7f9757ca8b80 1 -- 172.21.15.82:0/3501412711 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x560971c05c70 con 0x560971b7ebc0 2024-05-08T06:01:46.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.298+0000 7f9734c00700 1 -- 172.21.15.82:0/3501412711 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97300b24f0 con 0x560971b7ebc0 2024-05-08T06:01:46.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.299+0000 7f9734c00700 1 -- 172.21.15.82:0/3501412711 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f973008a040 con 0x560971b7ebc0 2024-05-08T06:01:46.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.299+0000 7f9757ca8b80 10 client.26402 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:01:46.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.299+0000 7f9757ca8b80 10 client.26402 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-05-08T06:01:46.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.299+0000 7f9757ca8b80 20 client.26402 populate_metadata read hostname 'smithi082' 2024-05-08T06:01:46.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.299+0000 7f9757ca8b80 1 --2- 172.21.15.82:0/3501412711 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x560971c05ef0 0x560971c082e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:46.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.299+0000 7f9757ca8b80 4 client.26402 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T06:01:46.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.299+0000 7f9757ca8b80 1 -- 172.21.15.82:0/3501412711 --> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f97300aa080 con 0x560971c05ef0 2024-05-08T06:01:46.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.299+0000 7f9746800700 1 --2- 172.21.15.82:0/3501412711 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x560971c05ef0 0x560971c082e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:46.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.299+0000 7f9746800700 1 --2- 172.21.15.82:0/3501412711 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x560971c05ef0 0x560971c082e0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=4a6b6e417c7ab65e server_cookie=37912ffbdb868f24 in_seq=0 out_seq=0 2024-05-08T06:01:46.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.299+0000 7f9734c00700 10 client.26402 ms_handle_connect on v2:172.21.15.134:6836/2212411710 2024-05-08T06:01:46.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.300+0000 7f9734c00700 1 -- 172.21.15.82:0/3501412711 <== mds.4 v2:172.21.15.134:6836/2212411710 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f97300aa080 con 0x560971c05ef0 2024-05-08T06:01:46.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.300+0000 7f9734c00700 10 client.26402 handle_command_reply: tid=0 2024-05-08T06:01:46.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.300+0000 7f9757ca8b80 1 client.26402 shutdown 2024-05-08T06:01:46.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.300+0000 7f9757ca8b80 1 -- 172.21.15.82:0/3501412711 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560971b7ebc0 msgr2=0x560971ba2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:46.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.300+0000 7f9757ca8b80 1 --2- 172.21.15.82:0/3501412711 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560971b7ebc0 0x560971ba2620 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x560971b9e140 tx=0x7f97300b2870 comp rx=0 tx=0).stop 2024-05-08T06:01:46.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.300+0000 7f9757ca8b80 1 -- 172.21.15.82:0/3501412711 shutdown_connections 2024-05-08T06:01:46.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.300+0000 7f9757ca8b80 1 --2- 172.21.15.82:0/3501412711 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x560971c05ef0 0x560971c082e0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:46.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.300+0000 7f9757ca8b80 1 --2- 172.21.15.82:0/3501412711 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x560971b7f4e0 0x560971ba2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:46.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.300+0000 7f9757ca8b80 1 --2- 172.21.15.82:0/3501412711 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560971b798f0 0x560971b93f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:46.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.300+0000 7f9757ca8b80 1 --2- 172.21.15.82:0/3501412711 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560971b7ebc0 0x560971ba2620 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:46.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.300+0000 7f9757ca8b80 1 -- 172.21.15.82:0/3501412711 >> 172.21.15.82:0/3501412711 conn(0x560971af16d0 msgr2=0x560971b84340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:01:46.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.300+0000 7f9734c00700 0 client.26402 ms_handle_reset on v2:172.21.15.134:6836/2212411710 2024-05-08T06:01:46.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.300+0000 7f9757ca8b80 1 -- 172.21.15.82:0/3501412711 shutdown_connections 2024-05-08T06:01:46.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.300+0000 7f9757ca8b80 1 -- 172.21.15.82:0/3501412711 wait complete. 2024-05-08T06:01:46.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.300+0000 7f9757ca8b80 20 client.26402 trim_cache size 0 max 16384 2024-05-08T06:01:46.303 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T06:01:46.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.301+0000 7f974d400700 1 -- 172.21.15.82:0/3444915153 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f972c0b2940 msgr2=0x7f972c0b4e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:46.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.301+0000 7f974d400700 1 --2- 172.21.15.82:0/3444915153 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f972c0b2940 0x7f972c0b4e00 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f9738011550 tx=0x7f9738009260 comp rx=0 tx=0).stop 2024-05-08T06:01:46.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.301+0000 7f974d400700 1 -- 172.21.15.82:0/3444915153 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9748106070 msgr2=0x7f97481a1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:46.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.301+0000 7f974d400700 1 --2- 172.21.15.82:0/3444915153 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9748106070 0x7f97481a1f90 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f973000e9f0 tx=0x7f973000ed00 comp rx=0 tx=0).stop 2024-05-08T06:01:46.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.302+0000 7f974d400700 1 -- 172.21.15.82:0/3444915153 shutdown_connections 2024-05-08T06:01:46.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.302+0000 7f974d400700 1 --2- 172.21.15.82:0/3444915153 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f972c0b2940 0x7f972c0b4e00 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:46.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.302+0000 7f974d400700 1 --2- 172.21.15.82:0/3444915153 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f974810b6b0 0x7f974819bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:46.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.302+0000 7f974d400700 1 --2- 172.21.15.82:0/3444915153 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97481056b0 0x7f97481a1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:46.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.302+0000 7f974d400700 1 --2- 172.21.15.82:0/3444915153 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9748106070 0x7f97481a1f90 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:46.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.302+0000 7f974d400700 1 -- 172.21.15.82:0/3444915153 >> 172.21.15.82:0/3444915153 conn(0x7f9748101180 msgr2=0x7f9748101700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:01:46.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.303+0000 7f974d400700 1 -- 172.21.15.82:0/3444915153 shutdown_connections 2024-05-08T06:01:46.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:46.304+0000 7f974d400700 1 -- 172.21.15.82:0/3444915153 wait complete. 2024-05-08T06:01:47.236 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-05-08T06:01:47.795 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:01:47.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:01:47 smithi082 ceph-mon[30098]: pgmap v793: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.1 MiB/s wr, 670 op/s 2024-05-08T06:01:48.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:01:47 smithi134 ceph-mon[34132]: pgmap v793: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.1 MiB/s wr, 670 op/s 2024-05-08T06:01:48.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:01:47 smithi151 ceph-mon[34815]: pgmap v793: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.1 MiB/s wr, 670 op/s 2024-05-08T06:01:49.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:01:49 smithi082 ceph-mon[30098]: pgmap v794: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.1 MiB/s wr, 567 op/s 2024-05-08T06:01:49.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:01:49 smithi134 ceph-mon[34132]: pgmap v794: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.1 MiB/s wr, 567 op/s 2024-05-08T06:01:50.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:01:49 smithi151 ceph-mon[34815]: pgmap v794: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.1 MiB/s wr, 567 op/s 2024-05-08T06:01:50.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 660.0 s, 1660.8 tps, lat 60.801 ms stddev 72.083 2024-05-08T06:01:50.948 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:01:50 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:01:51.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:01:50 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:01:51.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:01:50 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:01:51.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.186+0000 7f12c0a00700 1 -- 172.21.15.82:0/1195705681 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12bc0756d0 msgr2=0x7f12bc075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:51.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.187+0000 7f12c0a00700 1 --2- 172.21.15.82:0/1195705681 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12bc0756d0 0x7f12bc075ab0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f12ac013ef0 tx=0x7f12ac0097f0 comp rx=0 tx=0).stop 2024-05-08T06:01:51.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.187+0000 7f12c0a00700 1 -- 172.21.15.82:0/1195705681 shutdown_connections 2024-05-08T06:01:51.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.187+0000 7f12c0a00700 1 --2- 172.21.15.82:0/1195705681 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12bc10ff00 0x7f12bc1122f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:51.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.187+0000 7f12c0a00700 1 --2- 172.21.15.82:0/1195705681 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12bc0756d0 0x7f12bc075ab0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:51.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.187+0000 7f12c0a00700 1 --2- 172.21.15.82:0/1195705681 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12bc075ff0 0x7f12bc10f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:51.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.187+0000 7f12c0a00700 1 -- 172.21.15.82:0/1195705681 >> 172.21.15.82:0/1195705681 conn(0x7f12bc07a600 msgr2=0x7f12bc07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:01:51.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.187+0000 7f12c0a00700 1 -- 172.21.15.82:0/1195705681 shutdown_connections 2024-05-08T06:01:51.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.188+0000 7f12c0a00700 1 -- 172.21.15.82:0/1195705681 wait complete. 2024-05-08T06:01:51.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.189+0000 7f12c0a00700 1 Processor -- start 2024-05-08T06:01:51.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.193+0000 7f12c0a00700 1 -- start start 2024-05-08T06:01:51.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.193+0000 7f12c0a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12bc0756d0 0x7f12bc19d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:51.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.193+0000 7f12c0a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12bc075ff0 0x7f12bc19dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:51.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.193+0000 7f12c0a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12bc10ff00 0x7f12bc197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:51.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.194+0000 7f12b9e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12bc0756d0 0x7f12bc19d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:51.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.194+0000 7f12b9e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12bc0756d0 0x7f12bc19d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:60372/0 (socket says 172.21.15.82:60372) 2024-05-08T06:01:51.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.195+0000 7f12c0a00700 1 -- 172.21.15.82:0/17946068 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f12bc105d40 con 0x7f12bc10ff00 2024-05-08T06:01:51.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.195+0000 7f12c0a00700 1 -- 172.21.15.82:0/17946068 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f12bc105bc0 con 0x7f12bc0756d0 2024-05-08T06:01:51.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.195+0000 7f12c0a00700 1 -- 172.21.15.82:0/17946068 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f12bc105ec0 con 0x7f12bc075ff0 2024-05-08T06:01:51.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.195+0000 7f12b9e00700 1 -- 172.21.15.82:0/17946068 learned_addr learned my addr 172.21.15.82:0/17946068 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:01:51.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.195+0000 7f12b9400700 1 --2- 172.21.15.82:0/17946068 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12bc075ff0 0x7f12bc19dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:51.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.196+0000 7f12b9e00700 1 -- 172.21.15.82:0/17946068 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12bc075ff0 msgr2=0x7f12bc19dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:51.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.196+0000 7f12b9e00700 1 --2- 172.21.15.82:0/17946068 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12bc075ff0 0x7f12bc19dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:51.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.196+0000 7f12b9e00700 1 -- 172.21.15.82:0/17946068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12bc10ff00 msgr2=0x7f12bc197e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:51.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.196+0000 7f12b9e00700 1 --2- 172.21.15.82:0/17946068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12bc10ff00 0x7f12bc197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:51.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.196+0000 7f12b9e00700 1 -- 172.21.15.82:0/17946068 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12bc198780 con 0x7f12bc0756d0 2024-05-08T06:01:51.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.196+0000 7f12b9e00700 1 --2- 172.21.15.82:0/17946068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12bc0756d0 0x7f12bc19d6f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f12ac005f50 tx=0x7f12ac013890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:01:51.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.197+0000 7f12b2a00700 1 -- 172.21.15.82:0/17946068 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12ac029070 con 0x7f12bc0756d0 2024-05-08T06:01:51.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.197+0000 7f12b2a00700 1 -- 172.21.15.82:0/17946068 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f12ac004170 con 0x7f12bc0756d0 2024-05-08T06:01:51.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.198+0000 7f12c0a00700 1 -- 172.21.15.82:0/17946068 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12bc198a10 con 0x7f12bc0756d0 2024-05-08T06:01:51.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.198+0000 7f12b2a00700 1 -- 172.21.15.82:0/17946068 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12ac0258f0 con 0x7f12bc0756d0 2024-05-08T06:01:51.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.199+0000 7f12c0a00700 1 -- 172.21.15.82:0/17946068 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12bc1a4690 con 0x7f12bc0756d0 2024-05-08T06:01:51.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.206+0000 7f12cb3f8b80 1 Processor -- start 2024-05-08T06:01:51.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.206+0000 7f12cb3f8b80 1 -- start start 2024-05-08T06:01:51.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.206+0000 7f12cb3f8b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56174bc3b060 0x56174bc3b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:51.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.206+0000 7f12cb3f8b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56174bc3b980 0x56174bc3f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:51.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.206+0000 7f12cb3f8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56174bc3f9d0 0x56174bc3fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:51.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.206+0000 7f12cb3f8b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56174bb8da20 con 0x56174bc3f9d0 2024-05-08T06:01:51.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.206+0000 7f12cb3f8b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56174bb2b760 con 0x56174bc3b060 2024-05-08T06:01:51.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.206+0000 7f12cb3f8b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56174bb899e0 con 0x56174bc3b980 2024-05-08T06:01:51.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.207+0000 7f12ba800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56174bc3b060 0x56174bc3b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:51.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.207+0000 7f12ba800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56174bc3b060 0x56174bc3b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:60374/0 (socket says 172.21.15.82:60374) 2024-05-08T06:01:51.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.207+0000 7f12ba800700 1 -- 172.21.15.82:0/2265315343 learned_addr learned my addr 172.21.15.82:0/2265315343 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:01:51.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.208+0000 7f12b9400700 1 --2- 172.21.15.82:0/2265315343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56174bc3f9d0 0x56174bc3fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:51.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.208+0000 7f12ba800700 1 -- 172.21.15.82:0/2265315343 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56174bc3b980 msgr2=0x56174bc3f490 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T06:01:51.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.209+0000 7f12ba800700 1 --2- 172.21.15.82:0/2265315343 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56174bc3b980 0x56174bc3f490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:51.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.209+0000 7f12ba800700 1 -- 172.21.15.82:0/2265315343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56174bc3f9d0 msgr2=0x56174bc3fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:01:51.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.209+0000 7f12b2a00700 1 -- 172.21.15.82:0/17946068 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f12ac02c070 con 0x7f12bc0756d0 2024-05-08T06:01:51.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.209+0000 7f12ba800700 1 --2- 172.21.15.82:0/2265315343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56174bc3f9d0 0x56174bc3fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:51.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.209+0000 7f12ba800700 1 -- 172.21.15.82:0/2265315343 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56174bada8d0 con 0x56174bc3b060 2024-05-08T06:01:51.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.209+0000 7f12b9400700 1 --2- 172.21.15.82:0/2265315343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56174bc3f9d0 0x56174bc3fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:01:51.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.210+0000 7f12ba800700 1 --2- 172.21.15.82:0/2265315343 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56174bc3b060 0x56174bc3b440 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f12b4009d50 tx=0x7f12b40077e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2bf931de3a8db493 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:01:51.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.211+0000 7f12b2a00700 1 --2- 172.21.15.82:0/17946068 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f12a00b29d0 0x7f12a00b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:51.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.212+0000 7f12b2a00700 1 -- 172.21.15.82:0/17946068 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f12ac0eb6d0 con 0x7f12bc0756d0 2024-05-08T06:01:51.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.213+0000 7f12a7400700 1 -- 172.21.15.82:0/2265315343 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b4004db0 con 0x56174bc3b060 2024-05-08T06:01:51.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.213+0000 7f12a7400700 1 -- 172.21.15.82:0/2265315343 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f12b40054d0 con 0x56174bc3b060 2024-05-08T06:01:51.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.213+0000 7f12a7400700 1 -- 172.21.15.82:0/2265315343 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b4004db0 con 0x56174bc3b060 2024-05-08T06:01:51.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.214+0000 7f12cb3f8b80 1 -- 172.21.15.82:0/2265315343 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56174bc3b060 msgr2=0x56174bc3b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:51.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.214+0000 7f12cb3f8b80 1 --2- 172.21.15.82:0/2265315343 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56174bc3b060 0x56174bc3b440 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f12b4009d50 tx=0x7f12b40077e0 comp rx=0 tx=0).stop 2024-05-08T06:01:51.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.214+0000 7f12cb3f8b80 1 -- 172.21.15.82:0/2265315343 shutdown_connections 2024-05-08T06:01:51.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.214+0000 7f12cb3f8b80 1 --2- 172.21.15.82:0/2265315343 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56174bc3b060 0x56174bc3b440 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:51.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.214+0000 7f12cb3f8b80 1 --2- 172.21.15.82:0/2265315343 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56174bc3f9d0 0x56174bc3fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:51.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.214+0000 7f12cb3f8b80 1 --2- 172.21.15.82:0/2265315343 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56174bc3b980 0x56174bc3f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:51.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.214+0000 7f12cb3f8b80 1 -- 172.21.15.82:0/2265315343 >> 172.21.15.82:0/2265315343 conn(0x56174bb69b60 msgr2=0x56174bc357a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:01:51.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.215+0000 7f12cb3f8b80 1 -- 172.21.15.82:0/2265315343 shutdown_connections 2024-05-08T06:01:51.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.216+0000 7f12cb3f8b80 1 -- 172.21.15.82:0/2265315343 wait complete. 2024-05-08T06:01:51.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.217+0000 7f12b9e00700 1 --2- 172.21.15.82:0/17946068 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f12a00b29d0 0x7f12a00b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:51.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.217+0000 7f12cb3f8b80 1 -- start start 2024-05-08T06:01:51.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.221+0000 7f12cb3f8b80 1 Processor -- start 2024-05-08T06:01:51.223 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.222+0000 7f12cb3f8b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56174bc3b060 0x56174bc46e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:51.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.222+0000 7f12cb3f8b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56174bc3b980 0x56174bc441a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:51.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.223+0000 7f12ba800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56174bc3b060 0x56174bc46e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:51.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.223+0000 7f12ba800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56174bc3b060 0x56174bc46e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:41422/0 (socket says 172.21.15.82:41422) 2024-05-08T06:01:51.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.223+0000 7f12ba800700 1 -- 172.21.15.82:0/235485682 learned_addr learned my addr 172.21.15.82:0/235485682 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:01:51.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.223+0000 7f12cb3f8b80 1 --2- 172.21.15.82:0/235485682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56174bc3f9d0 0x56174bc446e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:51.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.224+0000 7f12cb3f8b80 1 -- 172.21.15.82:0/235485682 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56174bc47c30 con 0x56174bc3f9d0 2024-05-08T06:01:51.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.224+0000 7f12cb3f8b80 1 -- 172.21.15.82:0/235485682 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56174baf3b20 con 0x56174bc3b980 2024-05-08T06:01:51.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.224+0000 7f12cb3f8b80 1 -- 172.21.15.82:0/235485682 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56174bc47db0 con 0x56174bc3b060 2024-05-08T06:01:51.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.224+0000 7f12cb3f8b80 10 client.0 _ll_register_callbacks cb 0x56174bb34c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:01:51.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.225+0000 7f12b9400700 1 --2- 172.21.15.82:0/235485682 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56174bc3b980 0x56174bc441a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:51.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.227+0000 7f12ba800700 1 --2- 172.21.15.82:0/235485682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56174bc3f9d0 0x56174bc446e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:51.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.227+0000 7f12ba800700 1 -- 172.21.15.82:0/235485682 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56174bc3b980 msgr2=0x56174bc441a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:01:51.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.227+0000 7f12ba800700 1 --2- 172.21.15.82:0/235485682 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56174bc3b980 0x56174bc441a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:51.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.228+0000 7f12ba800700 1 -- 172.21.15.82:0/235485682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56174bc3f9d0 msgr2=0x56174bc446e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:01:51.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.228+0000 7f12ba800700 1 --2- 172.21.15.82:0/235485682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56174bc3f9d0 0x56174bc446e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:51.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.228+0000 7f12ba800700 1 -- 172.21.15.82:0/235485682 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56174bb53420 con 0x56174bc3b060 2024-05-08T06:01:51.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.229+0000 7f12ba800700 1 --2- 172.21.15.82:0/235485682 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56174bc3b060 0x56174bc46e00 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f12b4009450 tx=0x7f12b40097e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6801b9f4f2a9d2c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:01:51.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.229+0000 7f129be00700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T06:01:51.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.230+0000 7f129be00700 1 -- 172.21.15.82:0/235485682 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b4005740 con 0x56174bc3b060 2024-05-08T06:01:51.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.230+0000 7f129be00700 1 -- 172.21.15.82:0/235485682 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f12b40058e0 con 0x56174bc3b060 2024-05-08T06:01:51.231 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.231+0000 7f12cb3f8b80 1 -- 172.21.15.82:0/235485682 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12b40054d0 con 0x56174bc3b060 2024-05-08T06:01:51.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.232+0000 7f129be00700 1 -- 172.21.15.82:0/235485682 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f12b4003a00 con 0x56174bc3b060 2024-05-08T06:01:51.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.232+0000 7f12cb3f8b80 10 client.26431 fetch_fsmap learned FSMap version 31 2024-05-08T06:01:51.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.232+0000 7f12cb3f8b80 1 -- 172.21.15.82:0/235485682 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56174bc524a0 con 0x56174bc3b060 2024-05-08T06:01:51.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.232+0000 7f129be00700 1 -- 172.21.15.82:0/235485682 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f12b40054d0 con 0x56174bc3b060 2024-05-08T06:01:51.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.233+0000 7f129be00700 1 -- 172.21.15.82:0/235485682 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f12b401d440 con 0x56174bc3b060 2024-05-08T06:01:51.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.234+0000 7f12cb3f8b80 10 client.26431 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:01:51.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.234+0000 7f12cb3f8b80 10 client.26431 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-05-08T06:01:51.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.234+0000 7f12cb3f8b80 20 client.26431 populate_metadata read hostname 'smithi082' 2024-05-08T06:01:51.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.234+0000 7f12cb3f8b80 1 --2- 172.21.15.82:0/235485682 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x56174bc54a80 0x56174bc56e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:51.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.234+0000 7f12cb3f8b80 4 client.26431 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:01:51.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.234+0000 7f12cb3f8b80 1 -- 172.21.15.82:0/235485682 --> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56174bc080a0 con 0x56174bc54a80 2024-05-08T06:01:51.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.235+0000 7f12b9e00700 1 --2- 172.21.15.82:0/17946068 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f12a00b29d0 0x7f12a00b4e90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f12ac009c70 tx=0x7f12ac0097f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:01:51.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.235+0000 7f12b9400700 1 --2- 172.21.15.82:0/235485682 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x56174bc54a80 0x56174bc56e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:51.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.237+0000 7f12b9400700 1 --2- 172.21.15.82:0/235485682 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x56174bc54a80 0x56174bc56e70 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b293a7a4ad7a676a server_cookie=4a5db2717166fc30 in_seq=0 out_seq=0 2024-05-08T06:01:51.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.237+0000 7f129be00700 10 client.26431 ms_handle_connect on v2:172.21.15.151:6834/2093655929 2024-05-08T06:01:51.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.239+0000 7f129be00700 1 -- 172.21.15.82:0/235485682 <== mds.3 v2:172.21.15.151:6834/2093655929 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56174bc080a0 con 0x56174bc54a80 2024-05-08T06:01:51.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.239+0000 7f129be00700 10 client.26431 handle_command_reply: tid=0 2024-05-08T06:01:51.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.239+0000 7f12cb3f8b80 1 client.26431 shutdown 2024-05-08T06:01:51.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.240+0000 7f12cb3f8b80 1 -- 172.21.15.82:0/235485682 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56174bc3b060 msgr2=0x56174bc46e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:51.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.241+0000 7f12cb3f8b80 1 --2- 172.21.15.82:0/235485682 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56174bc3b060 0x56174bc46e00 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f12b4009450 tx=0x7f12b40097e0 comp rx=0 tx=0).stop 2024-05-08T06:01:51.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.241+0000 7f12cb3f8b80 1 -- 172.21.15.82:0/235485682 shutdown_connections 2024-05-08T06:01:51.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.241+0000 7f12cb3f8b80 1 --2- 172.21.15.82:0/235485682 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x56174bc54a80 0x56174bc56e70 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:51.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.242+0000 7f12cb3f8b80 1 --2- 172.21.15.82:0/235485682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56174bc3f9d0 0x56174bc446e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:51.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.242+0000 7f129be00700 0 client.26431 ms_handle_reset on v2:172.21.15.151:6834/2093655929 2024-05-08T06:01:51.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.242+0000 7f12cb3f8b80 1 --2- 172.21.15.82:0/235485682 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56174bc3b060 0x56174bc46e00 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:51.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.242+0000 7f12cb3f8b80 1 --2- 172.21.15.82:0/235485682 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56174bc3b980 0x56174bc441a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:51.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.242+0000 7f12cb3f8b80 1 -- 172.21.15.82:0/235485682 >> 172.21.15.82:0/235485682 conn(0x56174bb69b60 msgr2=0x56174bc302b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:01:51.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.243+0000 7f12cb3f8b80 1 -- 172.21.15.82:0/235485682 shutdown_connections 2024-05-08T06:01:51.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.244+0000 7f12cb3f8b80 1 -- 172.21.15.82:0/235485682 wait complete. 2024-05-08T06:01:51.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.244+0000 7f12cb3f8b80 20 client.26431 trim_cache size 0 max 16384 2024-05-08T06:01:51.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.275+0000 7f12cb3f8b80 1 Processor -- start 2024-05-08T06:01:51.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.275+0000 7f12cb3f8b80 1 -- start start 2024-05-08T06:01:51.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.276+0000 7f12cb3f8b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56174bc3b060 0x56174bc40e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:51.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.277+0000 7f12ba800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56174bc3b060 0x56174bc40e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:51.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.277+0000 7f12ba800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56174bc3b060 0x56174bc40e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:60392/0 (socket says 172.21.15.82:60392) 2024-05-08T06:01:51.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.277+0000 7f12ba800700 1 -- 172.21.15.82:0/3955451266 learned_addr learned my addr 172.21.15.82:0/3955451266 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:01:51.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.277+0000 7f12cb3f8b80 1 --2- 172.21.15.82:0/3955451266 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56174bc3b980 0x56174bc2fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:51.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.277+0000 7f12cb3f8b80 1 --2- 172.21.15.82:0/3955451266 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56174bc3f9d0 0x56174bc2ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:51.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.277+0000 7f12cb3f8b80 1 -- 172.21.15.82:0/3955451266 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f12bc1ab9c0 con 0x56174bc3f9d0 2024-05-08T06:01:51.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.277+0000 7f12cb3f8b80 1 -- 172.21.15.82:0/3955451266 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f12bc1ad500 con 0x56174bc3b060 2024-05-08T06:01:51.278 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.277+0000 7f12cb3f8b80 1 -- 172.21.15.82:0/3955451266 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f12bc1ac090 con 0x56174bc3b980 2024-05-08T06:01:51.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.278+0000 7f12b9400700 1 --2- 172.21.15.82:0/3955451266 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56174bc3b980 0x56174bc2fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:51.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.278+0000 7f12b9400700 1 -- 172.21.15.82:0/3955451266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56174bc3b060 msgr2=0x56174bc40e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:01:51.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.278+0000 7f12b9400700 1 --2- 172.21.15.82:0/3955451266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56174bc3b060 0x56174bc40e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:51.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.278+0000 7f12b9400700 1 -- 172.21.15.82:0/3955451266 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56174bc3f9d0 msgr2=0x56174bc2ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:01:51.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.278+0000 7f12b9400700 1 --2- 172.21.15.82:0/3955451266 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56174bc3f9d0 0x56174bc2ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:51.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.278+0000 7f12b9400700 1 -- 172.21.15.82:0/3955451266 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56174bc36610 con 0x56174bc3b980 2024-05-08T06:01:51.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.278+0000 7f12b9400700 1 --2- 172.21.15.82:0/3955451266 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56174bc3b980 0x56174bc2fa20 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x56174bc47e70 tx=0x7f12a8008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d5a846c6def8547 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:01:51.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.279+0000 7f12a6a00700 1 -- 172.21.15.82:0/3955451266 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a8020070 con 0x56174bc3b980 2024-05-08T06:01:51.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.279+0000 7f12a6a00700 1 -- 172.21.15.82:0/3955451266 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f12a8015c30 con 0x56174bc3b980 2024-05-08T06:01:51.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.279+0000 7f12a6a00700 1 -- 172.21.15.82:0/3955451266 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a801ca10 con 0x56174bc3b980 2024-05-08T06:01:51.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.280+0000 7f12cb3f8b80 1 -- 172.21.15.82:0/3955451266 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56174bc3b980 msgr2=0x56174bc2fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:51.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.280+0000 7f12cb3f8b80 1 --2- 172.21.15.82:0/3955451266 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56174bc3b980 0x56174bc2fa20 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x56174bc47e70 tx=0x7f12a8008040 comp rx=0 tx=0).stop 2024-05-08T06:01:51.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.280+0000 7f12cb3f8b80 1 -- 172.21.15.82:0/3955451266 shutdown_connections 2024-05-08T06:01:51.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.280+0000 7f12cb3f8b80 1 --2- 172.21.15.82:0/3955451266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56174bc3b060 0x56174bc40e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:51.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.280+0000 7f12cb3f8b80 1 --2- 172.21.15.82:0/3955451266 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56174bc3f9d0 0x56174bc2ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:51.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.280+0000 7f12cb3f8b80 1 --2- 172.21.15.82:0/3955451266 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56174bc3b980 0x56174bc2fa20 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:51.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.280+0000 7f12cb3f8b80 1 -- 172.21.15.82:0/3955451266 >> 172.21.15.82:0/3955451266 conn(0x56174bb69b60 msgr2=0x56174bc35600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:01:51.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.280+0000 7f12cb3f8b80 1 -- 172.21.15.82:0/3955451266 shutdown_connections 2024-05-08T06:01:51.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.280+0000 7f12cb3f8b80 1 -- 172.21.15.82:0/3955451266 wait complete. 2024-05-08T06:01:51.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.281+0000 7f12cb3f8b80 1 -- start start 2024-05-08T06:01:51.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.281+0000 7f12cb3f8b80 1 Processor -- start 2024-05-08T06:01:51.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.282+0000 7f12cb3f8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56174bc3b060 0x56174bc5a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:51.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.282+0000 7f12cb3f8b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56174bc3b980 0x56174bc55800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:51.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.282+0000 7f12cb3f8b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56174bc3f9d0 0x56174bc55da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:51.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.282+0000 7f12cb3f8b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f12bc1ace30 con 0x56174bc3b060 2024-05-08T06:01:51.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.282+0000 7f12cb3f8b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f12bc1ac760 con 0x56174bc3b980 2024-05-08T06:01:51.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.282+0000 7f12cb3f8b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f12bc1a9980 con 0x56174bc3f9d0 2024-05-08T06:01:51.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.282+0000 7f12cb3f8b80 10 client.0 _ll_register_callbacks cb 0x56174bb34c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:01:51.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.282+0000 7f12b9400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56174bc3b980 0x56174bc55800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:51.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.282+0000 7f12b9400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56174bc3b980 0x56174bc55800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:60404/0 (socket says 172.21.15.82:60404) 2024-05-08T06:01:51.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.282+0000 7f12b9400700 1 -- 172.21.15.82:0/489281614 learned_addr learned my addr 172.21.15.82:0/489281614 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:01:51.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.282+0000 7f12ba800700 1 --2- 172.21.15.82:0/489281614 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56174bc3f9d0 0x56174bc55da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:51.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.282+0000 7f12ba800700 1 --2- 172.21.15.82:0/489281614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56174bc3b060 0x56174bc5a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:51.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.282+0000 7f12b9400700 1 -- 172.21.15.82:0/489281614 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56174bc3f9d0 msgr2=0x56174bc55da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:01:51.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.282+0000 7f12b9400700 1 --2- 172.21.15.82:0/489281614 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56174bc3f9d0 0x56174bc55da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:51.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.282+0000 7f12b9400700 1 -- 172.21.15.82:0/489281614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56174bc3b060 msgr2=0x56174bc5a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:01:51.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.282+0000 7f12b9400700 1 --2- 172.21.15.82:0/489281614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56174bc3b060 0x56174bc5a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:51.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.282+0000 7f12b9400700 1 -- 172.21.15.82:0/489281614 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56174bc47770 con 0x56174bc3b980 2024-05-08T06:01:51.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.283+0000 7f12b9400700 1 --2- 172.21.15.82:0/489281614 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56174bc3b980 0x56174bc55800 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f12a80048a0 tx=0x7f12a801c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a09a4d6f6240782 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:01:51.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.283+0000 7f129be00700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T06:01:51.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.283+0000 7f129be00700 1 -- 172.21.15.82:0/489281614 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12a8029070 con 0x56174bc3b980 2024-05-08T06:01:51.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.283+0000 7f12cb3f8b80 1 -- 172.21.15.82:0/489281614 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f12a8015c30 con 0x56174bc3b980 2024-05-08T06:01:51.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.283+0000 7f129be00700 1 -- 172.21.15.82:0/489281614 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f12a8005a50 con 0x56174bc3b980 2024-05-08T06:01:51.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.283+0000 7f129be00700 1 -- 172.21.15.82:0/489281614 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f12a8035050 con 0x56174bc3b980 2024-05-08T06:01:51.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.284+0000 7f12cb3f8b80 10 client.26420 fetch_fsmap learned FSMap version 31 2024-05-08T06:01:51.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.284+0000 7f12cb3f8b80 1 -- 172.21.15.82:0/489281614 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56174bc3b7b0 con 0x56174bc3b980 2024-05-08T06:01:51.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.284+0000 7f129be00700 1 -- 172.21.15.82:0/489281614 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f12a8015c30 con 0x56174bc3b980 2024-05-08T06:01:51.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.285+0000 7f129be00700 1 -- 172.21.15.82:0/489281614 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f12a801cce0 con 0x56174bc3b980 2024-05-08T06:01:51.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.286+0000 7f12cb3f8b80 10 client.26420 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:01:51.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.286+0000 7f12cb3f8b80 10 client.26420 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-05-08T06:01:51.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.286+0000 7f12cb3f8b80 20 client.26420 populate_metadata read hostname 'smithi082' 2024-05-08T06:01:51.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.286+0000 7f12cb3f8b80 1 --2- 172.21.15.82:0/489281614 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x56174bc54a80 0x56174bcc12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:51.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.286+0000 7f12cb3f8b80 4 client.26420 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T06:01:51.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.286+0000 7f12cb3f8b80 1 -- 172.21.15.82:0/489281614 --> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56174bb9b400 con 0x56174bc54a80 2024-05-08T06:01:51.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.287+0000 7f12ba800700 1 --2- 172.21.15.82:0/489281614 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x56174bc54a80 0x56174bcc12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:51.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.288+0000 7f12ba800700 1 --2- 172.21.15.82:0/489281614 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x56174bc54a80 0x56174bcc12a0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=be48fededb8899d6 server_cookie=d6135a18c8b6424e in_seq=0 out_seq=0 2024-05-08T06:01:51.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.288+0000 7f129be00700 10 client.26420 ms_handle_connect on v2:172.21.15.151:6834/2093655929 2024-05-08T06:01:51.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.288+0000 7f129be00700 1 -- 172.21.15.82:0/489281614 <== mds.3 v2:172.21.15.151:6834/2093655929 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56174bb9b400 con 0x56174bc54a80 2024-05-08T06:01:51.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.288+0000 7f129be00700 10 client.26420 handle_command_reply: tid=0 2024-05-08T06:01:51.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.289+0000 7f12cb3f8b80 1 client.26420 shutdown 2024-05-08T06:01:51.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.289+0000 7f12cb3f8b80 1 -- 172.21.15.82:0/489281614 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56174bc3b980 msgr2=0x56174bc55800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:51.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.289+0000 7f12cb3f8b80 1 --2- 172.21.15.82:0/489281614 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56174bc3b980 0x56174bc55800 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f12a80048a0 tx=0x7f12a801c530 comp rx=0 tx=0).stop 2024-05-08T06:01:51.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.289+0000 7f12cb3f8b80 1 -- 172.21.15.82:0/489281614 shutdown_connections 2024-05-08T06:01:51.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.289+0000 7f12cb3f8b80 1 --2- 172.21.15.82:0/489281614 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x56174bc54a80 0x56174bcc12a0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:51.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.289+0000 7f12cb3f8b80 1 --2- 172.21.15.82:0/489281614 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56174bc3f9d0 0x56174bc55da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:51.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.289+0000 7f12cb3f8b80 1 --2- 172.21.15.82:0/489281614 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56174bc3b060 0x56174bc5a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:51.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.289+0000 7f12cb3f8b80 1 --2- 172.21.15.82:0/489281614 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56174bc3b980 0x56174bc55800 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:51.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.289+0000 7f12cb3f8b80 1 -- 172.21.15.82:0/489281614 >> 172.21.15.82:0/489281614 conn(0x56174bb69b60 msgr2=0x56174bc302b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:01:51.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.289+0000 7f129be00700 0 client.26420 ms_handle_reset on v2:172.21.15.151:6834/2093655929 2024-05-08T06:01:51.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.289+0000 7f12cb3f8b80 1 -- 172.21.15.82:0/489281614 shutdown_connections 2024-05-08T06:01:51.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.290+0000 7f12cb3f8b80 1 -- 172.21.15.82:0/489281614 wait complete. 2024-05-08T06:01:51.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.290+0000 7f12cb3f8b80 20 client.26420 trim_cache size 0 max 16384 2024-05-08T06:01:51.292 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T06:01:51.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.291+0000 7f12c0a00700 1 -- 172.21.15.82:0/17946068 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f12a00b29d0 msgr2=0x7f12a00b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:51.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.291+0000 7f12c0a00700 1 --2- 172.21.15.82:0/17946068 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f12a00b29d0 0x7f12a00b4e90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f12ac009c70 tx=0x7f12ac0097f0 comp rx=0 tx=0).stop 2024-05-08T06:01:51.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.291+0000 7f12c0a00700 1 -- 172.21.15.82:0/17946068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12bc0756d0 msgr2=0x7f12bc19d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:51.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.291+0000 7f12c0a00700 1 --2- 172.21.15.82:0/17946068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12bc0756d0 0x7f12bc19d6f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f12ac005f50 tx=0x7f12ac013890 comp rx=0 tx=0).stop 2024-05-08T06:01:51.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.291+0000 7f12c0a00700 1 -- 172.21.15.82:0/17946068 shutdown_connections 2024-05-08T06:01:51.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.291+0000 7f12c0a00700 1 --2- 172.21.15.82:0/17946068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f12bc0756d0 0x7f12bc19d6f0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:51.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.291+0000 7f12c0a00700 1 --2- 172.21.15.82:0/17946068 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f12a00b29d0 0x7f12a00b4e90 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:51.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.291+0000 7f12c0a00700 1 --2- 172.21.15.82:0/17946068 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f12bc10ff00 0x7f12bc197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:51.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.291+0000 7f12c0a00700 1 --2- 172.21.15.82:0/17946068 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12bc075ff0 0x7f12bc19dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:51.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.291+0000 7f12c0a00700 1 -- 172.21.15.82:0/17946068 >> 172.21.15.82:0/17946068 conn(0x7f12bc07a600 msgr2=0x7f12bc100710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:01:51.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.291+0000 7f12c0a00700 1 -- 172.21.15.82:0/17946068 shutdown_connections 2024-05-08T06:01:51.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:51.291+0000 7f12c0a00700 1 -- 172.21.15.82:0/17946068 wait complete. 2024-05-08T06:01:51.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:01:51 smithi082 ceph-mon[30098]: pgmap v795: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.4 MiB/s wr, 702 op/s 2024-05-08T06:01:52.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:01:51 smithi134 ceph-mon[34132]: pgmap v795: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.4 MiB/s wr, 702 op/s 2024-05-08T06:01:52.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:01:51 smithi151 ceph-mon[34815]: pgmap v795: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.4 MiB/s wr, 702 op/s 2024-05-08T06:01:52.569 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-05-08T06:01:52.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:01:52 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:01:52.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:01:52 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:01:52.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:01:52 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T06:01:53.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:01:52 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:01:53.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:01:52 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:01:53.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:01:52 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T06:01:53.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:01:52 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:01:53.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:01:52 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:01:53.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:01:52 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T06:01:53.213 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:01:53.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:01:53 smithi082 ceph-mon[30098]: pgmap v796: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.5 MiB/s wr, 606 op/s 2024-05-08T06:01:53.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:01:53 smithi134 ceph-mon[34132]: pgmap v796: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.5 MiB/s wr, 606 op/s 2024-05-08T06:01:54.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:01:53 smithi151 ceph-mon[34815]: pgmap v796: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.5 MiB/s wr, 606 op/s 2024-05-08T06:01:55.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 665.0 s, 1879.6 tps, lat 53.093 ms stddev 63.858 2024-05-08T06:01:55.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:01:55 smithi082 ceph-mon[30098]: pgmap v797: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.8 MiB/s wr, 556 op/s 2024-05-08T06:01:55.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.788+0000 7fcc98e00700 1 -- 172.21.15.82:0/3024598871 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc940756d0 msgr2=0x7fcc94075ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:55.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.788+0000 7fcc98e00700 1 --2- 172.21.15.82:0/3024598871 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc940756d0 0x7fcc94075ab0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fcc84009990 tx=0x7fcc84009ca0 comp rx=0 tx=0).stop 2024-05-08T06:01:55.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.788+0000 7fcc98e00700 1 -- 172.21.15.82:0/3024598871 shutdown_connections 2024-05-08T06:01:55.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.788+0000 7fcc98e00700 1 --2- 172.21.15.82:0/3024598871 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc94114670 0x7fcc94116a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:55.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.788+0000 7fcc98e00700 1 --2- 172.21.15.82:0/3024598871 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc940756d0 0x7fcc94075ab0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:55.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.788+0000 7fcc98e00700 1 --2- 172.21.15.82:0/3024598871 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc94075ff0 0x7fcc94114130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:55.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.788+0000 7fcc98e00700 1 -- 172.21.15.82:0/3024598871 >> 172.21.15.82:0/3024598871 conn(0x7fcc9407a600 msgr2=0x7fcc9407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:01:55.788 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.788+0000 7fcc98e00700 1 -- 172.21.15.82:0/3024598871 shutdown_connections 2024-05-08T06:01:55.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.788+0000 7fcc98e00700 1 -- 172.21.15.82:0/3024598871 wait complete. 2024-05-08T06:01:55.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.789+0000 7fcc98e00700 1 Processor -- start 2024-05-08T06:01:55.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.789+0000 7fcc98e00700 1 -- start start 2024-05-08T06:01:55.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.789+0000 7fcc98e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc940756d0 0x7fcc94110730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:55.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.789+0000 7fcc98e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc94075ff0 0x7fcc94109810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:55.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.789+0000 7fcc98e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc94114670 0x7fcc94109d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:55.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.790+0000 7fcc98e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcc94119cd0 con 0x7fcc94075ff0 2024-05-08T06:01:55.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.790+0000 7fcc98e00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcc94119b50 con 0x7fcc940756d0 2024-05-08T06:01:55.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.790+0000 7fcc98e00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fcc94119e50 con 0x7fcc94114670 2024-05-08T06:01:55.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.790+0000 7fcc91e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc940756d0 0x7fcc94110730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:55.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.790+0000 7fcc92800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc94114670 0x7fcc94109d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:55.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.790+0000 7fcc91e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc940756d0 0x7fcc94110730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:49106/0 (socket says 172.21.15.82:49106) 2024-05-08T06:01:55.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.790+0000 7fcc91400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc94075ff0 0x7fcc94109810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:55.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.790+0000 7fcc91e00700 1 -- 172.21.15.82:0/2455543381 learned_addr learned my addr 172.21.15.82:0/2455543381 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:01:55.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.790+0000 7fcc91e00700 1 -- 172.21.15.82:0/2455543381 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc94114670 msgr2=0x7fcc94109d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:55.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.790+0000 7fcc91e00700 1 --2- 172.21.15.82:0/2455543381 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc94114670 0x7fcc94109d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:55.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.790+0000 7fcc91e00700 1 -- 172.21.15.82:0/2455543381 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc94075ff0 msgr2=0x7fcc94109810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:55.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.790+0000 7fcc91e00700 1 --2- 172.21.15.82:0/2455543381 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc94075ff0 0x7fcc94109810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:55.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.790+0000 7fcc91e00700 1 -- 172.21.15.82:0/2455543381 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc9410a3c0 con 0x7fcc940756d0 2024-05-08T06:01:55.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.791+0000 7fcc91e00700 1 --2- 172.21.15.82:0/2455543381 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc940756d0 0x7fcc94110730 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fcc84005910 tx=0x7fcc8400b670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:01:55.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.791+0000 7fcc8aa00700 1 -- 172.21.15.82:0/2455543381 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc84027070 con 0x7fcc940756d0 2024-05-08T06:01:55.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.791+0000 7fcc98e00700 1 -- 172.21.15.82:0/2455543381 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc9410a650 con 0x7fcc940756d0 2024-05-08T06:01:55.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.791+0000 7fcc98e00700 1 -- 172.21.15.82:0/2455543381 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc9410e540 con 0x7fcc940756d0 2024-05-08T06:01:55.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.791+0000 7fcc8aa00700 1 -- 172.21.15.82:0/2455543381 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc84022470 con 0x7fcc940756d0 2024-05-08T06:01:55.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.791+0000 7fcc8aa00700 1 -- 172.21.15.82:0/2455543381 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc84017650 con 0x7fcc940756d0 2024-05-08T06:01:55.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.798+0000 7fcc8aa00700 1 -- 172.21.15.82:0/2455543381 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fcc8402a070 con 0x7fcc940756d0 2024-05-08T06:01:55.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.799+0000 7fcca382cb80 1 Processor -- start 2024-05-08T06:01:55.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.800+0000 7fcca382cb80 1 -- start start 2024-05-08T06:01:55.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.801+0000 7fcc8aa00700 1 --2- 172.21.15.82:0/2455543381 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fcc780b2900 0x7fcc780b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:55.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.801+0000 7fcca382cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606751c9060 0x5606751c9440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:55.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.801+0000 7fcca382cb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5606751c9980 0x5606751cd490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:55.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.801+0000 7fcca382cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5606751cd9d0 0x5606751cde30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:55.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.801+0000 7fcca382cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56067511ba20 con 0x5606751c9060 2024-05-08T06:01:55.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.801+0000 7fcca382cb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5606750b9760 con 0x5606751c9980 2024-05-08T06:01:55.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.801+0000 7fcca382cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5606751179e0 con 0x5606751cd9d0 2024-05-08T06:01:55.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.801+0000 7fcc8aa00700 1 -- 172.21.15.82:0/2455543381 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fcc840e2d30 con 0x7fcc940756d0 2024-05-08T06:01:55.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.801+0000 7fcc92800700 1 --2- 172.21.15.82:0/2455543381 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fcc780b2900 0x7fcc780b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:55.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.802+0000 7fcc91e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606751c9060 0x5606751c9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:55.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.802+0000 7fcc91e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606751c9060 0x5606751c9440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39744/0 (socket says 172.21.15.82:39744) 2024-05-08T06:01:55.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.802+0000 7fcc91e00700 1 -- 172.21.15.82:0/2710974211 learned_addr learned my addr 172.21.15.82:0/2710974211 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:01:55.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.802+0000 7fcc91e00700 1 -- 172.21.15.82:0/2710974211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5606751cd9d0 msgr2=0x5606751cde30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:01:55.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.802+0000 7fcc91e00700 1 --2- 172.21.15.82:0/2710974211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5606751cd9d0 0x5606751cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:55.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.802+0000 7fcc91e00700 1 -- 172.21.15.82:0/2710974211 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5606751c9980 msgr2=0x5606751cd490 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T06:01:55.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.802+0000 7fcc91e00700 1 --2- 172.21.15.82:0/2710974211 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5606751c9980 0x5606751cd490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:55.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.802+0000 7fcc91e00700 1 -- 172.21.15.82:0/2710974211 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606750688d0 con 0x5606751c9060 2024-05-08T06:01:55.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.804+0000 7fcc91e00700 1 --2- 172.21.15.82:0/2710974211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606751c9060 0x5606751c9440 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fcc840a7660 tx=0x7fcc840a9d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1db7d8a2ab006841 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:01:55.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.805+0000 7fcc7f400700 1 -- 172.21.15.82:0/2710974211 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc840a9f00 con 0x5606751c9060 2024-05-08T06:01:55.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.805+0000 7fcc7f400700 1 -- 172.21.15.82:0/2710974211 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc840aaaf0 con 0x5606751c9060 2024-05-08T06:01:55.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.805+0000 7fcc7f400700 1 -- 172.21.15.82:0/2710974211 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc840a4d70 con 0x5606751c9060 2024-05-08T06:01:55.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.806+0000 7fcca382cb80 1 -- 172.21.15.82:0/2710974211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606751c9060 msgr2=0x5606751c9440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:55.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.806+0000 7fcca382cb80 1 --2- 172.21.15.82:0/2710974211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606751c9060 0x5606751c9440 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fcc840a7660 tx=0x7fcc840a9d40 comp rx=0 tx=0).stop 2024-05-08T06:01:55.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.806+0000 7fcca382cb80 1 -- 172.21.15.82:0/2710974211 shutdown_connections 2024-05-08T06:01:55.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.806+0000 7fcca382cb80 1 --2- 172.21.15.82:0/2710974211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5606751cd9d0 0x5606751cde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:55.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.806+0000 7fcca382cb80 1 --2- 172.21.15.82:0/2710974211 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606751c9060 0x5606751c9440 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:55.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.806+0000 7fcca382cb80 1 --2- 172.21.15.82:0/2710974211 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5606751c9980 0x5606751cd490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:55.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.806+0000 7fcca382cb80 1 -- 172.21.15.82:0/2710974211 >> 172.21.15.82:0/2710974211 conn(0x5606750f7b60 msgr2=0x5606751c37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:01:55.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.806+0000 7fcca382cb80 1 -- 172.21.15.82:0/2710974211 shutdown_connections 2024-05-08T06:01:55.806 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.806+0000 7fcca382cb80 1 -- 172.21.15.82:0/2710974211 wait complete. 2024-05-08T06:01:55.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.807+0000 7fcca382cb80 1 -- start start 2024-05-08T06:01:55.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.807+0000 7fcca382cb80 1 Processor -- start 2024-05-08T06:01:55.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.807+0000 7fcc92800700 1 --2- 172.21.15.82:0/2455543381 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fcc780b2900 0x7fcc780b4dc0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c009ec0 tx=0x7fcc8c009920 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:01:55.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.810+0000 7fcca382cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5606751c9060 0x5606751d4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:55.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.810+0000 7fcca382cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606751c9980 0x5606751d2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:55.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.810+0000 7fcca382cb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5606751cd9d0 0x5606751d26c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:55.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.810+0000 7fcca382cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5606751d59a0 con 0x5606751c9980 2024-05-08T06:01:55.810 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.810+0000 7fcca382cb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x560675081b20 con 0x5606751cd9d0 2024-05-08T06:01:55.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.810+0000 7fcca382cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5606751d5b20 con 0x5606751c9060 2024-05-08T06:01:55.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.810+0000 7fcca382cb80 10 client.0 _ll_register_callbacks cb 0x5606750c2c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:01:55.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.810+0000 7fcc91e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5606751c9060 0x5606751d4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:55.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.810+0000 7fcc91e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5606751c9060 0x5606751d4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:53762/0 (socket says 172.21.15.82:53762) 2024-05-08T06:01:55.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.810+0000 7fcc91e00700 1 -- 172.21.15.82:0/1784561405 learned_addr learned my addr 172.21.15.82:0/1784561405 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:01:55.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.810+0000 7fcc91e00700 1 -- 172.21.15.82:0/1784561405 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5606751cd9d0 msgr2=0x5606751d26c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T06:01:55.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.810+0000 7fcc91e00700 1 --2- 172.21.15.82:0/1784561405 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5606751cd9d0 0x5606751d26c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:55.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.810+0000 7fcc91e00700 1 -- 172.21.15.82:0/1784561405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606751c9980 msgr2=0x5606751d2180 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T06:01:55.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.810+0000 7fcc91e00700 1 --2- 172.21.15.82:0/1784561405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606751c9980 0x5606751d2180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:55.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.810+0000 7fcc91e00700 1 -- 172.21.15.82:0/1784561405 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606750e1420 con 0x5606751c9060 2024-05-08T06:01:55.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.811+0000 7fcc91e00700 1 --2- 172.21.15.82:0/1784561405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5606751c9060 0x5606751d4de0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fcc840aa380 tx=0x7fcc84005fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be74e47cdeb8d3af server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:01:55.811 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.811+0000 7fcc73e00700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T06:01:55.812 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.811+0000 7fcc73e00700 1 -- 172.21.15.82:0/1784561405 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc840c3020 con 0x5606751c9060 2024-05-08T06:01:55.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.812+0000 7fcc73e00700 1 -- 172.21.15.82:0/1784561405 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fcc840a4b10 con 0x5606751c9060 2024-05-08T06:01:55.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.812+0000 7fcca382cb80 1 -- 172.21.15.82:0/1784561405 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc840aaaf0 con 0x5606751c9060 2024-05-08T06:01:55.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.812+0000 7fcc73e00700 1 -- 172.21.15.82:0/1784561405 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fcc840a4d10 con 0x5606751c9060 2024-05-08T06:01:55.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.812+0000 7fcca382cb80 10 client.26446 fetch_fsmap learned FSMap version 31 2024-05-08T06:01:55.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.812+0000 7fcca382cb80 1 -- 172.21.15.82:0/1784561405 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5606751d59a0 con 0x5606751c9060 2024-05-08T06:01:55.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.812+0000 7fcc73e00700 1 -- 172.21.15.82:0/1784561405 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc840ca020 con 0x5606751c9060 2024-05-08T06:01:55.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.812+0000 7fcc73e00700 1 -- 172.21.15.82:0/1784561405 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fcc8400fbd0 con 0x5606751c9060 2024-05-08T06:01:55.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.813+0000 7fcca382cb80 10 client.26446 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:01:55.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.813+0000 7fcca382cb80 10 client.26446 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-05-08T06:01:55.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.813+0000 7fcca382cb80 20 client.26446 populate_metadata read hostname 'smithi082' 2024-05-08T06:01:55.813 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.813+0000 7fcca382cb80 1 --2- 172.21.15.82:0/1784561405 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x5606751e24c0 0x5606751e48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:55.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.813+0000 7fcca382cb80 4 client.26446 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:01:55.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.813+0000 7fcca382cb80 1 -- 172.21.15.82:0/1784561405 --> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fcc840aaaf0 con 0x5606751e24c0 2024-05-08T06:01:55.814 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.813+0000 7fcc91400700 1 --2- 172.21.15.82:0/1784561405 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x5606751e24c0 0x5606751e48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:55.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.815+0000 7fcc91400700 1 --2- 172.21.15.82:0/1784561405 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x5606751e24c0 0x5606751e48e0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8d079c7fa94ad78f server_cookie=53f146fdbb13dc20 in_seq=0 out_seq=0 2024-05-08T06:01:55.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.815+0000 7fcc73e00700 10 client.26446 ms_handle_connect on v2:172.21.15.151:6836/4192404464 2024-05-08T06:01:55.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.816+0000 7fcc73e00700 1 -- 172.21.15.82:0/1784561405 <== mds.2 v2:172.21.15.151:6836/4192404464 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7fcc840aaaf0 con 0x5606751e24c0 2024-05-08T06:01:55.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.816+0000 7fcc73e00700 10 client.26446 handle_command_reply: tid=0 2024-05-08T06:01:55.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.816+0000 7fcca382cb80 1 client.26446 shutdown 2024-05-08T06:01:55.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.817+0000 7fcca382cb80 1 -- 172.21.15.82:0/1784561405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5606751c9060 msgr2=0x5606751d4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:55.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.817+0000 7fcca382cb80 1 --2- 172.21.15.82:0/1784561405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5606751c9060 0x5606751d4de0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fcc840aa380 tx=0x7fcc84005fb0 comp rx=0 tx=0).stop 2024-05-08T06:01:55.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.817+0000 7fcca382cb80 1 -- 172.21.15.82:0/1784561405 shutdown_connections 2024-05-08T06:01:55.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.817+0000 7fcca382cb80 1 --2- 172.21.15.82:0/1784561405 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x5606751e24c0 0x5606751e48e0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:55.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.817+0000 7fcca382cb80 1 --2- 172.21.15.82:0/1784561405 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5606751cd9d0 0x5606751d26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:55.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.817+0000 7fcca382cb80 1 --2- 172.21.15.82:0/1784561405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5606751c9060 0x5606751d4de0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:55.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.817+0000 7fcca382cb80 1 --2- 172.21.15.82:0/1784561405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606751c9980 0x5606751d2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:55.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.817+0000 7fcca382cb80 1 -- 172.21.15.82:0/1784561405 >> 172.21.15.82:0/1784561405 conn(0x5606750f7b60 msgr2=0x5606751be2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:01:55.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.817+0000 7fcc73e00700 0 client.26446 ms_handle_reset on v2:172.21.15.151:6836/4192404464 2024-05-08T06:01:55.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.817+0000 7fcca382cb80 1 -- 172.21.15.82:0/1784561405 shutdown_connections 2024-05-08T06:01:55.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.818+0000 7fcca382cb80 1 -- 172.21.15.82:0/1784561405 wait complete. 2024-05-08T06:01:55.818 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.818+0000 7fcca382cb80 20 client.26446 trim_cache size 0 max 16384 2024-05-08T06:01:55.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.844+0000 7fcca382cb80 1 Processor -- start 2024-05-08T06:01:55.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.844+0000 7fcca382cb80 1 -- start start 2024-05-08T06:01:55.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.844+0000 7fcca382cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606751c9060 0x5606751de9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:55.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.844+0000 7fcca382cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5606751c9980 0x5606751cfe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:55.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.844+0000 7fcca382cb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5606751cd9d0 0x5606751d26f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:55.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.845+0000 7fcca382cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcc7400d3f0 con 0x5606751c9060 2024-05-08T06:01:55.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.845+0000 7fcca382cb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcc7400ef30 con 0x5606751cd9d0 2024-05-08T06:01:55.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.845+0000 7fcca382cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fcc7400dac0 con 0x5606751c9980 2024-05-08T06:01:55.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.845+0000 7fcc92800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5606751cd9d0 0x5606751d26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:55.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.845+0000 7fcc92800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5606751cd9d0 0x5606751d26f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:49112/0 (socket says 172.21.15.82:49112) 2024-05-08T06:01:55.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.845+0000 7fcc92800700 1 -- 172.21.15.82:0/241825825 learned_addr learned my addr 172.21.15.82:0/241825825 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:01:55.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.846+0000 7fcc92800700 1 -- 172.21.15.82:0/241825825 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5606751c9980 msgr2=0x5606751cfe80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T06:01:55.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.846+0000 7fcc92800700 1 --2- 172.21.15.82:0/241825825 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5606751c9980 0x5606751cfe80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:55.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.846+0000 7fcc92800700 1 -- 172.21.15.82:0/241825825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606751c9060 msgr2=0x5606751de9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:01:55.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.846+0000 7fcc92800700 1 --2- 172.21.15.82:0/241825825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606751c9060 0x5606751de9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:55.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.846+0000 7fcc92800700 1 -- 172.21.15.82:0/241825825 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5606751e4ec0 con 0x5606751cd9d0 2024-05-08T06:01:55.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.846+0000 7fcc92800700 1 --2- 172.21.15.82:0/241825825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5606751cd9d0 0x5606751d26f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c009140 tx=0x7fcc8c014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fce8e816ca1ab135 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:01:55.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.846+0000 7fcc7ea00700 1 -- 172.21.15.82:0/241825825 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc8c01b070 con 0x5606751cd9d0 2024-05-08T06:01:55.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.846+0000 7fcc7ea00700 1 -- 172.21.15.82:0/241825825 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc8c004bb0 con 0x5606751cd9d0 2024-05-08T06:01:55.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.846+0000 7fcc7ea00700 1 -- 172.21.15.82:0/241825825 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc8c022d60 con 0x5606751cd9d0 2024-05-08T06:01:55.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.848+0000 7fcca382cb80 1 -- 172.21.15.82:0/241825825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5606751cd9d0 msgr2=0x5606751d26f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:55.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.848+0000 7fcca382cb80 1 --2- 172.21.15.82:0/241825825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5606751cd9d0 0x5606751d26f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c009140 tx=0x7fcc8c014000 comp rx=0 tx=0).stop 2024-05-08T06:01:55.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.849+0000 7fcca382cb80 1 -- 172.21.15.82:0/241825825 shutdown_connections 2024-05-08T06:01:55.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.849+0000 7fcca382cb80 1 --2- 172.21.15.82:0/241825825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5606751cd9d0 0x5606751d26f0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:55.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.849+0000 7fcca382cb80 1 --2- 172.21.15.82:0/241825825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606751c9060 0x5606751de9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:55.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.849+0000 7fcca382cb80 1 --2- 172.21.15.82:0/241825825 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5606751c9980 0x5606751cfe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:55.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.851+0000 7fcca382cb80 1 -- 172.21.15.82:0/241825825 >> 172.21.15.82:0/241825825 conn(0x5606750f7b60 msgr2=0x5606751ce6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:01:55.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.851+0000 7fcca382cb80 1 -- 172.21.15.82:0/241825825 shutdown_connections 2024-05-08T06:01:55.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.852+0000 7fcca382cb80 1 -- 172.21.15.82:0/241825825 wait complete. 2024-05-08T06:01:55.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.853+0000 7fcca382cb80 1 -- start start 2024-05-08T06:01:55.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.853+0000 7fcca382cb80 1 Processor -- start 2024-05-08T06:01:55.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.856+0000 7fcca382cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606751c9060 0x5606751db1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:55.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.856+0000 7fcca382cb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5606751c9980 0x5606751e9780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:55.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.856+0000 7fcca382cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5606751cd9d0 0x5606751e9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:55.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.859+0000 7fcc91400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5606751c9980 0x5606751e9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:55.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.859+0000 7fcc91400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5606751c9980 0x5606751e9780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:49126/0 (socket says 172.21.15.82:49126) 2024-05-08T06:01:55.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.859+0000 7fcc91400700 1 -- 172.21.15.82:0/2321068768 learned_addr learned my addr 172.21.15.82:0/2321068768 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:01:55.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.859+0000 7fcca382cb80 1 -- 172.21.15.82:0/2321068768 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcc7400e860 con 0x5606751c9060 2024-05-08T06:01:55.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.859+0000 7fcca382cb80 1 -- 172.21.15.82:0/2321068768 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcc7400e190 con 0x5606751c9980 2024-05-08T06:01:55.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.859+0000 7fcca382cb80 1 -- 172.21.15.82:0/2321068768 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fcc7400b390 con 0x5606751cd9d0 2024-05-08T06:01:55.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.859+0000 7fcc92800700 1 --2- 172.21.15.82:0/2321068768 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5606751cd9d0 0x5606751e9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:55.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.859+0000 7fcca382cb80 10 client.0 _ll_register_callbacks cb 0x5606751c5a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:01:55.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.860+0000 7fcc92800700 1 -- 172.21.15.82:0/2321068768 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5606751c9980 msgr2=0x5606751e9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:01:55.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.860+0000 7fcc92800700 1 --2- 172.21.15.82:0/2321068768 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5606751c9980 0x5606751e9780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:55.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.860+0000 7fcc92800700 1 -- 172.21.15.82:0/2321068768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606751c9060 msgr2=0x5606751db1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:01:55.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.860+0000 7fcc92800700 1 --2- 172.21.15.82:0/2321068768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606751c9060 0x5606751db1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:55.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.860+0000 7fcc92800700 1 -- 172.21.15.82:0/2321068768 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5606751ea410 con 0x5606751cd9d0 2024-05-08T06:01:55.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.860+0000 7fcc91400700 1 --2- 172.21.15.82:0/2321068768 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5606751c9980 0x5606751e9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:01:55.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.861+0000 7fcc92800700 1 --2- 172.21.15.82:0/2321068768 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5606751cd9d0 0x5606751e9cc0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c022860 tx=0x7fcc8c004f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1a91935e2cbb5a1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:01:55.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.861+0000 7fcc73e00700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T06:01:55.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.862+0000 7fcc73e00700 1 -- 172.21.15.82:0/2321068768 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc8c030020 con 0x5606751cd9d0 2024-05-08T06:01:55.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.862+0000 7fcc73e00700 1 -- 172.21.15.82:0/2321068768 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fcc8c003a00 con 0x5606751cd9d0 2024-05-08T06:01:55.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.862+0000 7fcca382cb80 1 -- 172.21.15.82:0/2321068768 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcc8c004bb0 con 0x5606751cd9d0 2024-05-08T06:01:55.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.863+0000 7fcc73e00700 1 -- 172.21.15.82:0/2321068768 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fcc8c01b070 con 0x5606751cd9d0 2024-05-08T06:01:55.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.863+0000 7fcca382cb80 10 client.26449 fetch_fsmap learned FSMap version 31 2024-05-08T06:01:55.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.863+0000 7fcca382cb80 1 -- 172.21.15.82:0/2321068768 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56067524ccd0 con 0x5606751cd9d0 2024-05-08T06:01:55.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.863+0000 7fcc73e00700 1 -- 172.21.15.82:0/2321068768 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcc8c004bb0 con 0x5606751cd9d0 2024-05-08T06:01:55.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.863+0000 7fcc73e00700 1 -- 172.21.15.82:0/2321068768 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fcc8c004330 con 0x5606751cd9d0 2024-05-08T06:01:55.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.864+0000 7fcca382cb80 10 client.26449 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:01:55.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.864+0000 7fcca382cb80 10 client.26449 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-05-08T06:01:55.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.864+0000 7fcca382cb80 20 client.26449 populate_metadata read hostname 'smithi082' 2024-05-08T06:01:55.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.864+0000 7fcca382cb80 1 --2- 172.21.15.82:0/2321068768 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x56067524d390 0x56067524f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:55.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.864+0000 7fcca382cb80 4 client.26449 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T06:01:55.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.864+0000 7fcca382cb80 1 -- 172.21.15.82:0/2321068768 --> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5606751960a0 con 0x56067524d390 2024-05-08T06:01:55.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.864+0000 7fcc91e00700 1 --2- 172.21.15.82:0/2321068768 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x56067524d390 0x56067524f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:55.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.865+0000 7fcc73e00700 10 client.26449 ms_handle_connect on v2:172.21.15.151:6836/4192404464 2024-05-08T06:01:55.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.865+0000 7fcc91e00700 1 --2- 172.21.15.82:0/2321068768 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x56067524d390 0x56067524f7b0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=acdd53ae39cef8cd server_cookie=43a6988c4e390875 in_seq=0 out_seq=0 2024-05-08T06:01:55.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.866+0000 7fcc73e00700 1 -- 172.21.15.82:0/2321068768 <== mds.2 v2:172.21.15.151:6836/4192404464 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5606751960a0 con 0x56067524d390 2024-05-08T06:01:55.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.866+0000 7fcc73e00700 10 client.26449 handle_command_reply: tid=0 2024-05-08T06:01:55.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.866+0000 7fcca382cb80 1 client.26449 shutdown 2024-05-08T06:01:55.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.866+0000 7fcca382cb80 1 -- 172.21.15.82:0/2321068768 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5606751cd9d0 msgr2=0x5606751e9cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:55.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.866+0000 7fcca382cb80 1 --2- 172.21.15.82:0/2321068768 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5606751cd9d0 0x5606751e9cc0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c022860 tx=0x7fcc8c004f90 comp rx=0 tx=0).stop 2024-05-08T06:01:55.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.866+0000 7fcca382cb80 1 -- 172.21.15.82:0/2321068768 shutdown_connections 2024-05-08T06:01:55.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.866+0000 7fcca382cb80 1 --2- 172.21.15.82:0/2321068768 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x56067524d390 0x56067524f7b0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:55.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.866+0000 7fcca382cb80 1 --2- 172.21.15.82:0/2321068768 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5606751cd9d0 0x5606751e9cc0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:55.866 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.866+0000 7fcc73e00700 0 client.26449 ms_handle_reset on v2:172.21.15.151:6836/4192404464 2024-05-08T06:01:55.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.866+0000 7fcca382cb80 1 --2- 172.21.15.82:0/2321068768 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5606751c9060 0x5606751db1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:55.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.866+0000 7fcca382cb80 1 --2- 172.21.15.82:0/2321068768 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5606751c9980 0x5606751e9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:55.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.866+0000 7fcca382cb80 1 -- 172.21.15.82:0/2321068768 >> 172.21.15.82:0/2321068768 conn(0x5606750f7b60 msgr2=0x5606751d3780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:01:55.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.867+0000 7fcca382cb80 1 -- 172.21.15.82:0/2321068768 shutdown_connections 2024-05-08T06:01:55.867 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.867+0000 7fcca382cb80 1 -- 172.21.15.82:0/2321068768 wait complete. 2024-05-08T06:01:55.868 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.868+0000 7fcca382cb80 20 client.26449 trim_cache size 0 max 16384 2024-05-08T06:01:55.868 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T06:01:55.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.869+0000 7fcc98e00700 1 -- 172.21.15.82:0/2455543381 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fcc780b2900 msgr2=0x7fcc780b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:55.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.869+0000 7fcc98e00700 1 --2- 172.21.15.82:0/2455543381 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fcc780b2900 0x7fcc780b4dc0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c009ec0 tx=0x7fcc8c009920 comp rx=0 tx=0).stop 2024-05-08T06:01:55.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.869+0000 7fcc98e00700 1 -- 172.21.15.82:0/2455543381 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc940756d0 msgr2=0x7fcc94110730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:55.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.869+0000 7fcc98e00700 1 --2- 172.21.15.82:0/2455543381 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc940756d0 0x7fcc94110730 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fcc84005910 tx=0x7fcc8400b670 comp rx=0 tx=0).stop 2024-05-08T06:01:55.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.870+0000 7fcc98e00700 1 -- 172.21.15.82:0/2455543381 shutdown_connections 2024-05-08T06:01:55.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.870+0000 7fcc98e00700 1 --2- 172.21.15.82:0/2455543381 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc940756d0 0x7fcc94110730 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:55.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.870+0000 7fcc98e00700 1 --2- 172.21.15.82:0/2455543381 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fcc780b2900 0x7fcc780b4dc0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:55.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.870+0000 7fcc98e00700 1 --2- 172.21.15.82:0/2455543381 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc94114670 0x7fcc94109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:55.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.870+0000 7fcc98e00700 1 --2- 172.21.15.82:0/2455543381 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcc94075ff0 0x7fcc94109810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:55.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.870+0000 7fcc98e00700 1 -- 172.21.15.82:0/2455543381 >> 172.21.15.82:0/2455543381 conn(0x7fcc9407a600 msgr2=0x7fcc941004d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:01:55.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.870+0000 7fcc98e00700 1 -- 172.21.15.82:0/2455543381 shutdown_connections 2024-05-08T06:01:55.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:55.870+0000 7fcc98e00700 1 -- 172.21.15.82:0/2455543381 wait complete. 2024-05-08T06:01:55.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:01:55 smithi134 ceph-mon[34132]: pgmap v797: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.8 MiB/s wr, 556 op/s 2024-05-08T06:01:56.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:01:55 smithi151 ceph-mon[34815]: pgmap v797: 97 pgs: 97 active+clean; 1.6 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.8 MiB/s wr, 556 op/s 2024-05-08T06:01:57.035 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-05-08T06:01:57.596 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:01:57.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:01:57 smithi082 ceph-mon[30098]: pgmap v798: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.3 MiB/s wr, 693 op/s 2024-05-08T06:01:57.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:01:57 smithi134 ceph-mon[34132]: pgmap v798: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.3 MiB/s wr, 693 op/s 2024-05-08T06:01:58.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:01:57 smithi151 ceph-mon[34815]: pgmap v798: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.3 MiB/s wr, 693 op/s 2024-05-08T06:01:59.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.869+0000 7fd2d6800700 1 -- 172.21.15.82:0/3639381012 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2d006c510 msgr2=0x7fd2d01104b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:59.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.869+0000 7fd2d6800700 1 --2- 172.21.15.82:0/3639381012 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2d006c510 0x7fd2d01104b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd2c800b0a0 tx=0x7fd2c800b3b0 comp rx=0 tx=0).stop 2024-05-08T06:01:59.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.869+0000 7fd2d6800700 1 -- 172.21.15.82:0/3639381012 shutdown_connections 2024-05-08T06:01:59.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.869+0000 7fd2d6800700 1 --2- 172.21.15.82:0/3639381012 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2d006c510 0x7fd2d01104b0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:59.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.869+0000 7fd2d6800700 1 --2- 172.21.15.82:0/3639381012 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2d0105380 0x7fd2d0105760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:59.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.869+0000 7fd2d6800700 1 --2- 172.21.15.82:0/3639381012 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2d006bb50 0x7fd2d006bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:59.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.869+0000 7fd2d6800700 1 -- 172.21.15.82:0/3639381012 >> 172.21.15.82:0/3639381012 conn(0x7fd2d00791a0 msgr2=0x7fd2d00795b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:01:59.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.869+0000 7fd2d6800700 1 -- 172.21.15.82:0/3639381012 shutdown_connections 2024-05-08T06:01:59.869 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.869+0000 7fd2d6800700 1 -- 172.21.15.82:0/3639381012 wait complete. 2024-05-08T06:01:59.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.870+0000 7fd2d6800700 1 Processor -- start 2024-05-08T06:01:59.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.870+0000 7fd2d6800700 1 -- start start 2024-05-08T06:01:59.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.870+0000 7fd2d6800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2d006bb50 0x7fd2d019be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:59.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.870+0000 7fd2d6800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2d006c510 0x7fd2d019c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:59.870 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.870+0000 7fd2d6800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2d0105380 0x7fd2d01a0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:59.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.870+0000 7fd2d6800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d01137b0 con 0x7fd2d0105380 2024-05-08T06:01:59.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.870+0000 7fd2d6800700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d0113630 con 0x7fd2d006c510 2024-05-08T06:01:59.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.870+0000 7fd2d6800700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d0113930 con 0x7fd2d006bb50 2024-05-08T06:01:59.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.871+0000 7fd2cf400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2d006bb50 0x7fd2d019be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:59.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.871+0000 7fd2cf400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2d006bb50 0x7fd2d019be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:53800/0 (socket says 172.21.15.82:53800) 2024-05-08T06:01:59.871 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.871+0000 7fd2cf400700 1 -- 172.21.15.82:0/3975180240 learned_addr learned my addr 172.21.15.82:0/3975180240 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:01:59.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.872+0000 7fd2cea00700 1 --2- 172.21.15.82:0/3975180240 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2d006c510 0x7fd2d019c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:59.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.872+0000 7fd2cfe00700 1 --2- 172.21.15.82:0/3975180240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2d0105380 0x7fd2d01a0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:59.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.872+0000 7fd2cea00700 1 -- 172.21.15.82:0/3975180240 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2d006bb50 msgr2=0x7fd2d019be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:59.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.872+0000 7fd2cea00700 1 --2- 172.21.15.82:0/3975180240 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2d006bb50 0x7fd2d019be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:59.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.872+0000 7fd2cea00700 1 -- 172.21.15.82:0/3975180240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2d0105380 msgr2=0x7fd2d01a0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:59.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.872+0000 7fd2cea00700 1 --2- 172.21.15.82:0/3975180240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2d0105380 0x7fd2d01a0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:59.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.872+0000 7fd2cea00700 1 -- 172.21.15.82:0/3975180240 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2d01a0dd0 con 0x7fd2d006c510 2024-05-08T06:01:59.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.873+0000 7fd2cea00700 1 --2- 172.21.15.82:0/3975180240 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2d006c510 0x7fd2d019c350 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc009ef0 tx=0x7fd2bc00ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:01:59.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.874+0000 7fd2c7e00700 1 -- 172.21.15.82:0/3975180240 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc024070 con 0x7fd2d006c510 2024-05-08T06:01:59.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.874+0000 7fd2c7e00700 1 -- 172.21.15.82:0/3975180240 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2bc00cc70 con 0x7fd2d006c510 2024-05-08T06:01:59.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.874+0000 7fd2d6800700 1 -- 172.21.15.82:0/3975180240 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2d01a10c0 con 0x7fd2d006c510 2024-05-08T06:01:59.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.874+0000 7fd2c7e00700 1 -- 172.21.15.82:0/3975180240 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2bc01fc70 con 0x7fd2d006c510 2024-05-08T06:01:59.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.874+0000 7fd2d6800700 1 -- 172.21.15.82:0/3975180240 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2d010a460 con 0x7fd2d006c510 2024-05-08T06:01:59.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.879+0000 7fd2c7e00700 1 -- 172.21.15.82:0/3975180240 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fd2bc027070 con 0x7fd2d006c510 2024-05-08T06:01:59.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.880+0000 7fd2e120ab80 1 Processor -- start 2024-05-08T06:01:59.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.880+0000 7fd2e120ab80 1 -- start start 2024-05-08T06:01:59.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.881+0000 7fd2e120ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56490d5c5060 0x56490d5c5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:59.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.881+0000 7fd2e120ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56490d5c5980 0x56490d5c9490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:59.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.881+0000 7fd2e120ab80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56490d5c99d0 0x56490d5c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:59.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.881+0000 7fd2e120ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56490d517a20 con 0x56490d5c5980 2024-05-08T06:01:59.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.881+0000 7fd2e120ab80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56490d4b5760 con 0x56490d5c99d0 2024-05-08T06:01:59.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.881+0000 7fd2e120ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56490d5139e0 con 0x56490d5c5060 2024-05-08T06:01:59.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.882+0000 7fd2cfe00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56490d5c5060 0x56490d5c5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:59.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.882+0000 7fd2cfe00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56490d5c5060 0x56490d5c5440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:53810/0 (socket says 172.21.15.82:53810) 2024-05-08T06:01:59.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.883+0000 7fd2cf400700 1 --2- 172.21.15.82:0/3896447441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56490d5c5980 0x56490d5c9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:59.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.882+0000 7fd2cfe00700 1 -- 172.21.15.82:0/3896447441 learned_addr learned my addr 172.21.15.82:0/3896447441 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:01:59.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.883+0000 7fd2cea00700 1 --2- 172.21.15.82:0/3896447441 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56490d5c99d0 0x56490d5c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:59.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.883+0000 7fd2cfe00700 1 -- 172.21.15.82:0/3896447441 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56490d5c99d0 msgr2=0x56490d5c9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:01:59.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.883+0000 7fd2cfe00700 1 --2- 172.21.15.82:0/3896447441 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56490d5c99d0 0x56490d5c9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:59.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.884+0000 7fd2cfe00700 1 -- 172.21.15.82:0/3896447441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56490d5c5980 msgr2=0x56490d5c9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:01:59.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.884+0000 7fd2cfe00700 1 --2- 172.21.15.82:0/3896447441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56490d5c5980 0x56490d5c9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:59.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.884+0000 7fd2cfe00700 1 -- 172.21.15.82:0/3896447441 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56490d4648d0 con 0x56490d5c5060 2024-05-08T06:01:59.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.884+0000 7fd2cf400700 1 --2- 172.21.15.82:0/3896447441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56490d5c5980 0x56490d5c9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:01:59.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.884+0000 7fd2c7e00700 1 --2- 172.21.15.82:0/3975180240 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd2b40b29d0 0x7fd2b40b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:59.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.884+0000 7fd2cfe00700 1 --2- 172.21.15.82:0/3896447441 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56490d5c5060 0x56490d5c5440 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8015000 tx=0x7fd2c80092e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32b37a7aff8f0fdc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:01:59.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.884+0000 7fd2c7e00700 1 -- 172.21.15.82:0/3975180240 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd2bc0ea4c0 con 0x7fd2d006c510 2024-05-08T06:01:59.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.884+0000 7fd2c4c00700 1 -- 172.21.15.82:0/3896447441 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c800bcb0 con 0x56490d5c5060 2024-05-08T06:01:59.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.884+0000 7fd2c4c00700 1 -- 172.21.15.82:0/3896447441 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2c80074e0 con 0x56490d5c5060 2024-05-08T06:01:59.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.884+0000 7fd2c4c00700 1 -- 172.21.15.82:0/3896447441 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8005280 con 0x56490d5c5060 2024-05-08T06:01:59.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.885+0000 7fd2cf400700 1 --2- 172.21.15.82:0/3975180240 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd2b40b29d0 0x7fd2b40b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:59.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.885+0000 7fd2e120ab80 1 -- 172.21.15.82:0/3896447441 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56490d5c5060 msgr2=0x56490d5c5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:59.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.885+0000 7fd2e120ab80 1 --2- 172.21.15.82:0/3896447441 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56490d5c5060 0x56490d5c5440 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8015000 tx=0x7fd2c80092e0 comp rx=0 tx=0).stop 2024-05-08T06:01:59.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.885+0000 7fd2cf400700 1 --2- 172.21.15.82:0/3975180240 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd2b40b29d0 0x7fd2b40b4e90 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd2c0012560 tx=0x7fd2c0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:01:59.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.885+0000 7fd2e120ab80 1 -- 172.21.15.82:0/3896447441 shutdown_connections 2024-05-08T06:01:59.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.885+0000 7fd2e120ab80 1 --2- 172.21.15.82:0/3896447441 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56490d5c99d0 0x56490d5c9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:59.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.885+0000 7fd2e120ab80 1 --2- 172.21.15.82:0/3896447441 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56490d5c5060 0x56490d5c5440 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:59.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.885+0000 7fd2e120ab80 1 --2- 172.21.15.82:0/3896447441 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56490d5c5980 0x56490d5c9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:59.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.885+0000 7fd2e120ab80 1 -- 172.21.15.82:0/3896447441 >> 172.21.15.82:0/3896447441 conn(0x56490d4f3b60 msgr2=0x56490d5bf7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:01:59.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.886+0000 7fd2e120ab80 1 -- 172.21.15.82:0/3896447441 shutdown_connections 2024-05-08T06:01:59.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.886+0000 7fd2e120ab80 1 -- 172.21.15.82:0/3896447441 wait complete. 2024-05-08T06:01:59.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.886+0000 7fd2e120ab80 1 -- start start 2024-05-08T06:01:59.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.886+0000 7fd2e120ab80 1 Processor -- start 2024-05-08T06:01:59.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.887+0000 7fd2e120ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56490d5c5060 0x56490d5d0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:59.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.887+0000 7fd2e120ab80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56490d5c5980 0x56490d5ce1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:59.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.887+0000 7fd2e120ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56490d5c99d0 0x56490d5ce6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:59.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.887+0000 7fd2e120ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56490d5d1b80 con 0x56490d5c5060 2024-05-08T06:01:59.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.887+0000 7fd2e120ab80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56490d47db20 con 0x56490d5c5980 2024-05-08T06:01:59.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.887+0000 7fd2e120ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56490d5d1d00 con 0x56490d5c99d0 2024-05-08T06:01:59.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.887+0000 7fd2e120ab80 10 client.0 _ll_register_callbacks cb 0x56490d4bec70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:01:59.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.888+0000 7fd2cea00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56490d5c5980 0x56490d5ce1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:59.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.888+0000 7fd2cea00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56490d5c5980 0x56490d5ce1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:49174/0 (socket says 172.21.15.82:49174) 2024-05-08T06:01:59.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.888+0000 7fd2cea00700 1 -- 172.21.15.82:0/3733911196 learned_addr learned my addr 172.21.15.82:0/3733911196 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:01:59.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.888+0000 7fd2cfe00700 1 --2- 172.21.15.82:0/3733911196 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56490d5c99d0 0x56490d5ce6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:59.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.889+0000 7fd2cfe00700 1 -- 172.21.15.82:0/3733911196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56490d5c5980 msgr2=0x56490d5ce1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:01:59.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.889+0000 7fd2cfe00700 1 --2- 172.21.15.82:0/3733911196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56490d5c5980 0x56490d5ce1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:59.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.889+0000 7fd2cfe00700 1 -- 172.21.15.82:0/3733911196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56490d5c5060 msgr2=0x56490d5d0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:01:59.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.888+0000 7fd2cf400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56490d5c5060 0x56490d5d0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:59.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.889+0000 7fd2cfe00700 1 --2- 172.21.15.82:0/3733911196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56490d5c5060 0x56490d5d0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:59.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.890+0000 7fd2cfe00700 1 -- 172.21.15.82:0/3733911196 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56490d4dd420 con 0x56490d5c99d0 2024-05-08T06:01:59.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.890+0000 7fd2cf400700 1 --2- 172.21.15.82:0/3733911196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56490d5c5060 0x56490d5d0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:01:59.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.890+0000 7fd2cfe00700 1 --2- 172.21.15.82:0/3733911196 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56490d5c99d0 0x56490d5ce6e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd2c800b780 tx=0x7fd2c800bd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c8742bc964070f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:01:59.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.890+0000 7fd2b9600700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T06:01:59.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.890+0000 7fd2b9600700 1 -- 172.21.15.82:0/3733911196 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c802b070 con 0x56490d5c99d0 2024-05-08T06:01:59.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.891+0000 7fd2b9600700 1 -- 172.21.15.82:0/3733911196 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd2c8004a50 con 0x56490d5c99d0 2024-05-08T06:01:59.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.891+0000 7fd2e120ab80 1 -- 172.21.15.82:0/3733911196 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2c80074e0 con 0x56490d5c99d0 2024-05-08T06:01:59.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.891+0000 7fd2b9600700 1 -- 172.21.15.82:0/3733911196 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fd2c8004c50 con 0x56490d5c99d0 2024-05-08T06:01:59.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.891+0000 7fd2e120ab80 10 client.26461 fetch_fsmap learned FSMap version 31 2024-05-08T06:01:59.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.891+0000 7fd2e120ab80 1 -- 172.21.15.82:0/3733911196 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56490d5d1b80 con 0x56490d5c99d0 2024-05-08T06:01:59.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.891+0000 7fd2b9600700 1 -- 172.21.15.82:0/3733911196 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2c80074e0 con 0x56490d5c99d0 2024-05-08T06:01:59.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.892+0000 7fd2b9600700 1 -- 172.21.15.82:0/3733911196 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fd2c8011070 con 0x56490d5c99d0 2024-05-08T06:01:59.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.892+0000 7fd2e120ab80 10 client.26461 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:01:59.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.892+0000 7fd2e120ab80 10 client.26461 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-08T06:01:59.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.892+0000 7fd2e120ab80 20 client.26461 populate_metadata read hostname 'smithi082' 2024-05-08T06:01:59.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.892+0000 7fd2e120ab80 1 --2- 172.21.15.82:0/3733911196 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x56490d5de6d0 0x56490d5e0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:59.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.892+0000 7fd2e120ab80 4 client.26461 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:01:59.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.892+0000 7fd2e120ab80 1 -- 172.21.15.82:0/3733911196 --> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56490d5920a0 con 0x56490d5de6d0 2024-05-08T06:01:59.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.892+0000 7fd2cf400700 1 --2- 172.21.15.82:0/3733911196 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x56490d5de6d0 0x56490d5e0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:59.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.894+0000 7fd2cf400700 1 --2- 172.21.15.82:0/3733911196 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x56490d5de6d0 0x56490d5e0ac0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cc6841916fb3cab8 server_cookie=ea8ad1c3557b2e15 in_seq=0 out_seq=0 2024-05-08T06:01:59.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.894+0000 7fd2b9600700 10 client.26461 ms_handle_connect on v2:172.21.15.151:6838/2963754236 2024-05-08T06:01:59.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.894+0000 7fd2b9600700 1 -- 172.21.15.82:0/3733911196 <== mds.1 v2:172.21.15.151:6838/2963754236 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56490d5920a0 con 0x56490d5de6d0 2024-05-08T06:01:59.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.894+0000 7fd2b9600700 10 client.26461 handle_command_reply: tid=0 2024-05-08T06:01:59.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.895+0000 7fd2e120ab80 1 client.26461 shutdown 2024-05-08T06:01:59.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.895+0000 7fd2e120ab80 1 -- 172.21.15.82:0/3733911196 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56490d5c99d0 msgr2=0x56490d5ce6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:59.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.895+0000 7fd2e120ab80 1 --2- 172.21.15.82:0/3733911196 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56490d5c99d0 0x56490d5ce6e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd2c800b780 tx=0x7fd2c800bd60 comp rx=0 tx=0).stop 2024-05-08T06:01:59.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.895+0000 7fd2e120ab80 1 -- 172.21.15.82:0/3733911196 shutdown_connections 2024-05-08T06:01:59.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.895+0000 7fd2e120ab80 1 --2- 172.21.15.82:0/3733911196 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x56490d5de6d0 0x56490d5e0ac0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:59.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.895+0000 7fd2e120ab80 1 --2- 172.21.15.82:0/3733911196 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56490d5c99d0 0x56490d5ce6e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:59.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.895+0000 7fd2e120ab80 1 --2- 172.21.15.82:0/3733911196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56490d5c5060 0x56490d5d0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:59.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.895+0000 7fd2e120ab80 1 --2- 172.21.15.82:0/3733911196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56490d5c5980 0x56490d5ce1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:59.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.895+0000 7fd2e120ab80 1 -- 172.21.15.82:0/3733911196 >> 172.21.15.82:0/3733911196 conn(0x56490d4f3b60 msgr2=0x56490d5ba2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:01:59.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.896+0000 7fd2b9600700 0 client.26461 ms_handle_reset on v2:172.21.15.151:6838/2963754236 2024-05-08T06:01:59.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.896+0000 7fd2e120ab80 1 -- 172.21.15.82:0/3733911196 shutdown_connections 2024-05-08T06:01:59.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.896+0000 7fd2e120ab80 1 -- 172.21.15.82:0/3733911196 wait complete. 2024-05-08T06:01:59.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.896+0000 7fd2e120ab80 20 client.26461 trim_cache size 0 max 16384 2024-05-08T06:01:59.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.917+0000 7fd2e120ab80 1 Processor -- start 2024-05-08T06:01:59.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.917+0000 7fd2e120ab80 1 -- start start 2024-05-08T06:01:59.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.917+0000 7fd2e120ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56490d5c5060 0x56490d5dac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:59.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.917+0000 7fd2e120ab80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56490d5c5980 0x56490d5b9a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:59.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.917+0000 7fd2e120ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56490d5c99d0 0x56490d5b9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:59.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.917+0000 7fd2e120ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d01ab720 con 0x56490d5c99d0 2024-05-08T06:01:59.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.918+0000 7fd2e120ab80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d01ad260 con 0x56490d5c5980 2024-05-08T06:01:59.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.918+0000 7fd2e120ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d01abdf0 con 0x56490d5c5060 2024-05-08T06:01:59.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.918+0000 7fd2cfe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56490d5c99d0 0x56490d5b9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:59.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.918+0000 7fd2cfe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56490d5c99d0 0x56490d5b9f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39822/0 (socket says 172.21.15.82:39822) 2024-05-08T06:01:59.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.918+0000 7fd2cfe00700 1 -- 172.21.15.82:0/2076921707 learned_addr learned my addr 172.21.15.82:0/2076921707 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:01:59.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.919+0000 7fd2cfe00700 1 -- 172.21.15.82:0/2076921707 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56490d5c5060 msgr2=0x56490d5dac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:01:59.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.919+0000 7fd2cfe00700 1 --2- 172.21.15.82:0/2076921707 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56490d5c5060 0x56490d5dac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:59.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.919+0000 7fd2cfe00700 1 -- 172.21.15.82:0/2076921707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56490d5c5980 msgr2=0x56490d5b9a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:01:59.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.919+0000 7fd2cfe00700 1 --2- 172.21.15.82:0/2076921707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56490d5c5980 0x56490d5b9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:59.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.919+0000 7fd2cfe00700 1 -- 172.21.15.82:0/2076921707 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56490d5bc3f0 con 0x56490d5c99d0 2024-05-08T06:01:59.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.920+0000 7fd2cfe00700 1 --2- 172.21.15.82:0/2076921707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56490d5c99d0 0x56490d5b9f60 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8009350 tx=0x7fd2c80074a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa4aefce9262b90f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:01:59.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.920+0000 7fd2bbe00700 1 -- 172.21.15.82:0/2076921707 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8006020 con 0x56490d5c99d0 2024-05-08T06:01:59.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.920+0000 7fd2bbe00700 1 -- 172.21.15.82:0/2076921707 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2c803f070 con 0x56490d5c99d0 2024-05-08T06:01:59.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.920+0000 7fd2bbe00700 1 -- 172.21.15.82:0/2076921707 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8007bb0 con 0x56490d5c99d0 2024-05-08T06:01:59.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.921+0000 7fd2e120ab80 1 -- 172.21.15.82:0/2076921707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56490d5c99d0 msgr2=0x56490d5b9f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:59.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.921+0000 7fd2e120ab80 1 --2- 172.21.15.82:0/2076921707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56490d5c99d0 0x56490d5b9f60 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8009350 tx=0x7fd2c80074a0 comp rx=0 tx=0).stop 2024-05-08T06:01:59.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.922+0000 7fd2e120ab80 1 -- 172.21.15.82:0/2076921707 shutdown_connections 2024-05-08T06:01:59.922 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.922+0000 7fd2e120ab80 1 --2- 172.21.15.82:0/2076921707 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56490d5c99d0 0x56490d5b9f60 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:59.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.922+0000 7fd2e120ab80 1 --2- 172.21.15.82:0/2076921707 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56490d5c5060 0x56490d5dac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:59.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.922+0000 7fd2e120ab80 1 --2- 172.21.15.82:0/2076921707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56490d5c5980 0x56490d5b9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:59.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.922+0000 7fd2e120ab80 1 -- 172.21.15.82:0/2076921707 >> 172.21.15.82:0/2076921707 conn(0x56490d4f3b60 msgr2=0x56490d5ca470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:01:59.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.923+0000 7fd2e120ab80 1 -- 172.21.15.82:0/2076921707 shutdown_connections 2024-05-08T06:01:59.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.923+0000 7fd2e120ab80 1 -- 172.21.15.82:0/2076921707 wait complete. 2024-05-08T06:01:59.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.924+0000 7fd2e120ab80 1 -- start start 2024-05-08T06:01:59.923 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.924+0000 7fd2e120ab80 1 Processor -- start 2024-05-08T06:01:59.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.926+0000 7fd2e120ab80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56490d5c5060 0x56490d5c7570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:59.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.926+0000 7fd2e120ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56490d5c5980 0x56490d5c7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:59.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.926+0000 7fd2e120ab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56490d5c99d0 0x56490d645cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:59.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.927+0000 7fd2e120ab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d01acb90 con 0x56490d5c99d0 2024-05-08T06:01:59.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.927+0000 7fd2e120ab80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d01ac4c0 con 0x56490d5c5060 2024-05-08T06:01:59.927 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:01:59 smithi082 ceph-mon[30098]: pgmap v799: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.3 MiB/s wr, 577 op/s 2024-05-08T06:01:59.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.927+0000 7fd2e120ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d010e3e0 con 0x56490d5c5980 2024-05-08T06:01:59.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.927+0000 7fd2cf400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56490d5c5060 0x56490d5c7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:59.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.928+0000 7fd2cea00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56490d5c5980 0x56490d5c7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:59.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.928+0000 7fd2cea00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56490d5c5980 0x56490d5c7ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:53828/0 (socket says 172.21.15.82:53828) 2024-05-08T06:01:59.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.928+0000 7fd2cea00700 1 -- 172.21.15.82:0/28172596 learned_addr learned my addr 172.21.15.82:0/28172596 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:01:59.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.928+0000 7fd2cfe00700 1 --2- 172.21.15.82:0/28172596 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56490d5c99d0 0x56490d645cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:59.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.928+0000 7fd2e120ab80 10 client.0 _ll_register_callbacks cb 0x56490d4bec70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:01:59.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.929+0000 7fd2cfe00700 1 -- 172.21.15.82:0/28172596 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56490d5c5980 msgr2=0x56490d5c7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:01:59.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.929+0000 7fd2cfe00700 1 --2- 172.21.15.82:0/28172596 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56490d5c5980 0x56490d5c7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:59.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.929+0000 7fd2cfe00700 1 -- 172.21.15.82:0/28172596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56490d5c5060 msgr2=0x56490d5c7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:01:59.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.929+0000 7fd2cfe00700 1 --2- 172.21.15.82:0/28172596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56490d5c5060 0x56490d5c7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:59.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.929+0000 7fd2cfe00700 1 -- 172.21.15.82:0/28172596 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56490d5c0610 con 0x56490d5c99d0 2024-05-08T06:01:59.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.930+0000 7fd2cea00700 1 --2- 172.21.15.82:0/28172596 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56490d5c5980 0x56490d5c7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:01:59.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.930+0000 7fd2cf400700 1 --2- 172.21.15.82:0/28172596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56490d5c5060 0x56490d5c7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:01:59.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.930+0000 7fd2b9600700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T06:01:59.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.932+0000 7fd2cfe00700 1 --2- 172.21.15.82:0/28172596 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56490d5c99d0 0x56490d645cb0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x56490d5b9950 tx=0x7fd2c800bcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aafe9d51b83f05f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:01:59.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.932+0000 7fd2b9600700 1 -- 172.21.15.82:0/28172596 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8047020 con 0x56490d5c99d0 2024-05-08T06:01:59.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.933+0000 7fd2e120ab80 1 -- 172.21.15.82:0/28172596 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2c803f070 con 0x56490d5c99d0 2024-05-08T06:01:59.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.933+0000 7fd2b9600700 1 -- 172.21.15.82:0/28172596 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd2c800bdd0 con 0x56490d5c99d0 2024-05-08T06:01:59.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.934+0000 7fd2b9600700 1 -- 172.21.15.82:0/28172596 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fd2c8047020 con 0x56490d5c99d0 2024-05-08T06:01:59.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.934+0000 7fd2e120ab80 10 client.16029 fetch_fsmap learned FSMap version 31 2024-05-08T06:01:59.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.934+0000 7fd2e120ab80 1 -- 172.21.15.82:0/28172596 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56490d5cb1b0 con 0x56490d5c99d0 2024-05-08T06:01:59.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.936+0000 7fd2b9600700 1 -- 172.21.15.82:0/28172596 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2c803f070 con 0x56490d5c99d0 2024-05-08T06:01:59.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.936+0000 7fd2b9600700 1 -- 172.21.15.82:0/28172596 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fd2c8011050 con 0x56490d5c99d0 2024-05-08T06:01:59.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.937+0000 7fd2e120ab80 10 client.16029 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:01:59.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.937+0000 7fd2e120ab80 10 client.16029 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-08T06:01:59.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.938+0000 7fd2e120ab80 20 client.16029 populate_metadata read hostname 'smithi082' 2024-05-08T06:01:59.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.938+0000 7fd2e120ab80 1 --2- 172.21.15.82:0/28172596 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x56490d5d5fb0 0x56490d5d63c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:01:59.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.938+0000 7fd2e120ab80 4 client.16029 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T06:01:59.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.938+0000 7fd2e120ab80 1 -- 172.21.15.82:0/28172596 --> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56490d525400 con 0x56490d5d5fb0 2024-05-08T06:01:59.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.938+0000 7fd2cf400700 1 --2- 172.21.15.82:0/28172596 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x56490d5d5fb0 0x56490d5d63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:01:59.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.939+0000 7fd2b9600700 10 client.16029 ms_handle_connect on v2:172.21.15.151:6838/2963754236 2024-05-08T06:01:59.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.939+0000 7fd2cf400700 1 --2- 172.21.15.82:0/28172596 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x56490d5d5fb0 0x56490d5d63c0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bd79b8d30ec6772f server_cookie=2c2ab57b1f371728 in_seq=0 out_seq=0 2024-05-08T06:01:59.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.939+0000 7fd2b9600700 1 -- 172.21.15.82:0/28172596 <== mds.1 v2:172.21.15.151:6838/2963754236 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56490d525400 con 0x56490d5d5fb0 2024-05-08T06:01:59.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.939+0000 7fd2b9600700 10 client.16029 handle_command_reply: tid=0 2024-05-08T06:01:59.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.939+0000 7fd2e120ab80 1 client.16029 shutdown 2024-05-08T06:01:59.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.940+0000 7fd2e120ab80 1 -- 172.21.15.82:0/28172596 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56490d5c99d0 msgr2=0x56490d645cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:59.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.940+0000 7fd2e120ab80 1 --2- 172.21.15.82:0/28172596 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56490d5c99d0 0x56490d645cb0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x56490d5b9950 tx=0x7fd2c800bcc0 comp rx=0 tx=0).stop 2024-05-08T06:01:59.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.942+0000 7fd2e120ab80 1 -- 172.21.15.82:0/28172596 shutdown_connections 2024-05-08T06:01:59.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.942+0000 7fd2e120ab80 1 --2- 172.21.15.82:0/28172596 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x56490d5d5fb0 0x56490d5d63c0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:59.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.942+0000 7fd2e120ab80 1 --2- 172.21.15.82:0/28172596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56490d5c5060 0x56490d5c7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:59.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.942+0000 7fd2e120ab80 1 --2- 172.21.15.82:0/28172596 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56490d5c99d0 0x56490d645cb0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:59.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.942+0000 7fd2e120ab80 1 --2- 172.21.15.82:0/28172596 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56490d5c5980 0x56490d5c7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:59.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.942+0000 7fd2e120ab80 1 -- 172.21.15.82:0/28172596 >> 172.21.15.82:0/28172596 conn(0x56490d4f3b60 msgr2=0x56490d5ba2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:01:59.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.943+0000 7fd2b9600700 0 client.16029 ms_handle_reset on v2:172.21.15.151:6838/2963754236 2024-05-08T06:01:59.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.943+0000 7fd2e120ab80 1 -- 172.21.15.82:0/28172596 shutdown_connections 2024-05-08T06:01:59.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.943+0000 7fd2e120ab80 1 -- 172.21.15.82:0/28172596 wait complete. 2024-05-08T06:01:59.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.943+0000 7fd2e120ab80 20 client.16029 trim_cache size 0 max 16384 2024-05-08T06:01:59.944 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T06:01:59.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.945+0000 7fd2d6800700 1 -- 172.21.15.82:0/3975180240 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd2b40b29d0 msgr2=0x7fd2b40b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:59.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.945+0000 7fd2d6800700 1 --2- 172.21.15.82:0/3975180240 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd2b40b29d0 0x7fd2b40b4e90 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd2c0012560 tx=0x7fd2c0009260 comp rx=0 tx=0).stop 2024-05-08T06:01:59.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.945+0000 7fd2d6800700 1 -- 172.21.15.82:0/3975180240 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2d006c510 msgr2=0x7fd2d019c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:01:59.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.945+0000 7fd2d6800700 1 --2- 172.21.15.82:0/3975180240 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2d006c510 0x7fd2d019c350 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd2bc009ef0 tx=0x7fd2bc00ecd0 comp rx=0 tx=0).stop 2024-05-08T06:01:59.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.945+0000 7fd2d6800700 1 -- 172.21.15.82:0/3975180240 shutdown_connections 2024-05-08T06:01:59.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.945+0000 7fd2d6800700 1 --2- 172.21.15.82:0/3975180240 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd2b40b29d0 0x7fd2b40b4e90 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:59.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.945+0000 7fd2d6800700 1 --2- 172.21.15.82:0/3975180240 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd2d0105380 0x7fd2d01a0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:59.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.945+0000 7fd2d6800700 1 --2- 172.21.15.82:0/3975180240 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2d006bb50 0x7fd2d019be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:59.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.945+0000 7fd2d6800700 1 --2- 172.21.15.82:0/3975180240 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2d006c510 0x7fd2d019c350 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:01:59.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.945+0000 7fd2d6800700 1 -- 172.21.15.82:0/3975180240 >> 172.21.15.82:0/3975180240 conn(0x7fd2d00791a0 msgr2=0x7fd2d0100890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:01:59.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.946+0000 7fd2d6800700 1 -- 172.21.15.82:0/3975180240 shutdown_connections 2024-05-08T06:01:59.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:01:59.946+0000 7fd2d6800700 1 -- 172.21.15.82:0/3975180240 wait complete. 2024-05-08T06:01:59.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:01:59 smithi134 ceph-mon[34132]: pgmap v799: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.3 MiB/s wr, 577 op/s 2024-05-08T06:02:00.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:01:59 smithi151 ceph-mon[34815]: pgmap v799: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 5.3 MiB/s wr, 577 op/s 2024-05-08T06:02:00.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 670.0 s, 1658.2 tps, lat 60.323 ms stddev 81.164 2024-05-08T06:02:00.881 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-05-08T06:02:01.470 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:02:01.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:02:01 smithi082 ceph-mon[30098]: pgmap v800: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 6.2 MiB/s wr, 681 op/s 2024-05-08T06:02:02.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:02:01 smithi134 ceph-mon[34132]: pgmap v800: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 6.2 MiB/s wr, 681 op/s 2024-05-08T06:02:02.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:02:01 smithi151 ceph-mon[34815]: pgmap v800: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 6.2 MiB/s wr, 681 op/s 2024-05-08T06:02:03.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.805+0000 7f1507e00700 1 -- 172.21.15.82:0/4145418830 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1500012650 con 0x7f150810a490 2024-05-08T06:02:03.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.806+0000 7f1510000700 1 -- 172.21.15.82:0/4145418830 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f150810a490 msgr2=0x7f15081169a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:02:03.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.806+0000 7f1510000700 1 --2- 172.21.15.82:0/4145418830 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f150810a490 0x7f15081169a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f1500009f90 tx=0x7f150000b330 comp rx=0 tx=0).stop 2024-05-08T06:02:03.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.807+0000 7f1510000700 1 -- 172.21.15.82:0/4145418830 shutdown_connections 2024-05-08T06:02:03.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.807+0000 7f1510000700 1 --2- 172.21.15.82:0/4145418830 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f150810fb60 0x7f150810ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:03.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.807+0000 7f1510000700 1 --2- 172.21.15.82:0/4145418830 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f150810a490 0x7f15081169a0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:03.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.807+0000 7f1510000700 1 --2- 172.21.15.82:0/4145418830 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1508109ad0 0x7f1508109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:03.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.807+0000 7f1510000700 1 -- 172.21.15.82:0/4145418830 >> 172.21.15.82:0/4145418830 conn(0x7f1508076c70 msgr2=0x7f1508079090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:02:03.807 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.807+0000 7f1510000700 1 -- 172.21.15.82:0/4145418830 shutdown_connections 2024-05-08T06:02:03.809 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.810+0000 7f1510000700 1 -- 172.21.15.82:0/4145418830 wait complete. 2024-05-08T06:02:03.815 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.811+0000 7f1510000700 1 Processor -- start 2024-05-08T06:02:03.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.811+0000 7f1510000700 1 -- start start 2024-05-08T06:02:03.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.812+0000 7f1510000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1508109ad0 0x7f1508083a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:03.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.812+0000 7f1510000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f150810a490 0x7f1508083f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:03.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.812+0000 7f1510000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f150810fb60 0x7f150807cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:03.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.812+0000 7f1510000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f1508119db0 con 0x7f1508109ad0 2024-05-08T06:02:03.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.812+0000 7f1510000700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1508119c30 con 0x7f150810a490 2024-05-08T06:02:03.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.812+0000 7f1510000700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1508119f30 con 0x7f150810fb60 2024-05-08T06:02:03.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.814+0000 7f150e000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f150810fb60 0x7f150807cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:03.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.814+0000 7f150d600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1508109ad0 0x7f1508083a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:03.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.814+0000 7f150d600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1508109ad0 0x7f1508083a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51678/0 (socket says 172.21.15.82:51678) 2024-05-08T06:02:03.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.814+0000 7f150d600700 1 -- 172.21.15.82:0/2880694356 learned_addr learned my addr 172.21.15.82:0/2880694356 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:02:03.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.815+0000 7f150cc00700 1 --2- 172.21.15.82:0/2880694356 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f150810a490 0x7f1508083f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:03.816 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.816+0000 7f150e000700 1 -- 172.21.15.82:0/2880694356 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f150810a490 msgr2=0x7f1508083f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:02:03.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.816+0000 7f150e000700 1 --2- 172.21.15.82:0/2880694356 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f150810a490 0x7f1508083f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:03.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.816+0000 7f150e000700 1 -- 172.21.15.82:0/2880694356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1508109ad0 msgr2=0x7f1508083a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:02:03.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.816+0000 7f150e000700 1 --2- 172.21.15.82:0/2880694356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1508109ad0 0x7f1508083a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:03.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.816+0000 7f150e000700 1 -- 172.21.15.82:0/2880694356 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f150807d5a0 con 0x7f150810fb60 2024-05-08T06:02:03.817 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.817+0000 7f150e000700 1 --2- 172.21.15.82:0/2880694356 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f150810fb60 0x7f150807cca0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f150000b6c0 tx=0x7f150000ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:02:03.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.820+0000 7f1506000700 1 -- 172.21.15.82:0/2880694356 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1500021070 con 0x7f150810fb60 2024-05-08T06:02:03.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.820+0000 7f1506000700 1 -- 172.21.15.82:0/2880694356 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1500007bc0 con 0x7f150810fb60 2024-05-08T06:02:03.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.820+0000 7f1506000700 1 -- 172.21.15.82:0/2880694356 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15000052c0 con 0x7f150810fb60 2024-05-08T06:02:03.820 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.821+0000 7f1510000700 1 -- 172.21.15.82:0/2880694356 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f150807d830 con 0x7f150810fb60 2024-05-08T06:02:03.824 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.821+0000 7f1510000700 1 -- 172.21.15.82:0/2880694356 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1508081710 con 0x7f150810fb60 2024-05-08T06:02:03.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.826+0000 7f1506000700 1 -- 172.21.15.82:0/2880694356 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f1500024070 con 0x7f150810fb60 2024-05-08T06:02:03.829 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.829+0000 7f151a9a0b80 1 Processor -- start 2024-05-08T06:02:03.834 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.834+0000 7f1506000700 1 --2- 172.21.15.82:0/2880694356 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f14f00b2900 0x7f14f00b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:03.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.835+0000 7f150cc00700 1 --2- 172.21.15.82:0/2880694356 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f14f00b2900 0x7f14f00b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:03.835 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.835+0000 7f151a9a0b80 1 -- start start 2024-05-08T06:02:03.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.838+0000 7f151a9a0b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557faac25060 0x557faac25440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:03.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.838+0000 7f151a9a0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557faac25980 0x557faac29490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:03.839 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.838+0000 7f151a9a0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557faac299d0 0x557faac29e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:03.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.838+0000 7f151a9a0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x557faab77a20 con 0x557faac299d0 2024-05-08T06:02:03.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.838+0000 7f151a9a0b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x557faab15760 con 0x557faac25060 2024-05-08T06:02:03.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.838+0000 7f151a9a0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x557faab739e0 con 0x557faac25980 2024-05-08T06:02:03.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.838+0000 7f1506000700 1 -- 172.21.15.82:0/2880694356 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f150000f020 con 0x7f150810fb60 2024-05-08T06:02:03.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.838+0000 7f150cc00700 1 --2- 172.21.15.82:0/2880694356 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f14f00b2900 0x7f14f00b4dc0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f150807e260 tx=0x7f14f4008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:02:03.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.839+0000 7f150d600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557faac25060 0x557faac25440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:03.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.839+0000 7f150d600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557faac25060 0x557faac25440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:39166/0 (socket says 172.21.15.82:39166) 2024-05-08T06:02:03.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.839+0000 7f150d600700 1 -- 172.21.15.82:0/2410667848 learned_addr learned my addr 172.21.15.82:0/2410667848 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:02:03.840 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.839+0000 7f150cc00700 1 --2- 172.21.15.82:0/2410667848 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557faac25980 0x557faac29490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:03.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.841+0000 7f150e000700 1 --2- 172.21.15.82:0/2410667848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557faac299d0 0x557faac29e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:03.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.841+0000 7f150cc00700 1 -- 172.21.15.82:0/2410667848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557faac25060 msgr2=0x557faac25440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:02:03.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.841+0000 7f150cc00700 1 --2- 172.21.15.82:0/2410667848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557faac25060 0x557faac25440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:03.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.841+0000 7f150cc00700 1 -- 172.21.15.82:0/2410667848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557faac299d0 msgr2=0x557faac29e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:02:03.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.841+0000 7f150cc00700 1 --2- 172.21.15.82:0/2410667848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557faac299d0 0x557faac29e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:03.841 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.841+0000 7f150cc00700 1 -- 172.21.15.82:0/2410667848 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557faaac48d0 con 0x557faac25980 2024-05-08T06:02:03.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.842+0000 7f150d600700 1 --2- 172.21.15.82:0/2410667848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557faac25060 0x557faac25440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:02:03.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.842+0000 7f150cc00700 1 --2- 172.21.15.82:0/2410667848 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557faac25980 0x557faac29490 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f150807e2f0 tx=0x7f14f4010000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54737d0e8261eeea server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:02:03.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.843+0000 7f14faa00700 1 -- 172.21.15.82:0/2410667848 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f4024070 con 0x557faac25980 2024-05-08T06:02:03.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.843+0000 7f14faa00700 1 -- 172.21.15.82:0/2410667848 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14f40148e0 con 0x557faac25980 2024-05-08T06:02:03.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.843+0000 7f14faa00700 1 -- 172.21.15.82:0/2410667848 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f401f8c0 con 0x557faac25980 2024-05-08T06:02:03.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.844+0000 7f150e000700 1 --2- 172.21.15.82:0/2410667848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557faac299d0 0x557faac29e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:02:03.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.845+0000 7f151a9a0b80 1 -- 172.21.15.82:0/2410667848 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557faac25980 msgr2=0x557faac29490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:02:03.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.845+0000 7f151a9a0b80 1 --2- 172.21.15.82:0/2410667848 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557faac25980 0x557faac29490 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f150807e2f0 tx=0x7f14f4010000 comp rx=0 tx=0).stop 2024-05-08T06:02:03.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.845+0000 7f151a9a0b80 1 -- 172.21.15.82:0/2410667848 shutdown_connections 2024-05-08T06:02:03.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.845+0000 7f151a9a0b80 1 --2- 172.21.15.82:0/2410667848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557faac25060 0x557faac25440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:03.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.845+0000 7f151a9a0b80 1 --2- 172.21.15.82:0/2410667848 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557faac299d0 0x557faac29e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:03.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.845+0000 7f151a9a0b80 1 --2- 172.21.15.82:0/2410667848 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557faac25980 0x557faac29490 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:03.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.845+0000 7f151a9a0b80 1 -- 172.21.15.82:0/2410667848 >> 172.21.15.82:0/2410667848 conn(0x557faab53b60 msgr2=0x557faac1f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:02:03.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.846+0000 7f151a9a0b80 1 -- 172.21.15.82:0/2410667848 shutdown_connections 2024-05-08T06:02:03.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.846+0000 7f151a9a0b80 1 -- 172.21.15.82:0/2410667848 wait complete. 2024-05-08T06:02:03.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.847+0000 7f151a9a0b80 1 -- start start 2024-05-08T06:02:03.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.847+0000 7f151a9a0b80 1 Processor -- start 2024-05-08T06:02:03.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.848+0000 7f151a9a0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557faac25060 0x557faac30ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:03.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.848+0000 7f151a9a0b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557faac25980 0x557faac2e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:03.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.848+0000 7f151a9a0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557faac299d0 0x557faac2e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:03.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.849+0000 7f150cc00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557faac25980 0x557faac2e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:03.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.849+0000 7f151a9a0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x557faac31be0 con 0x557faac299d0 2024-05-08T06:02:03.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.849+0000 7f151a9a0b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x557faaaddb20 con 0x557faac25980 2024-05-08T06:02:03.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.849+0000 7f151a9a0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x557faac31d60 con 0x557faac25060 2024-05-08T06:02:03.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.849+0000 7f151a9a0b80 10 client.0 _ll_register_callbacks cb 0x557faab1ec70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:02:03.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.849+0000 7f150cc00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557faac25980 0x557faac2e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:39180/0 (socket says 172.21.15.82:39180) 2024-05-08T06:02:03.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.849+0000 7f150cc00700 1 -- 172.21.15.82:0/793767281 learned_addr learned my addr 172.21.15.82:0/793767281 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:02:03.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.849+0000 7f150e000700 1 --2- 172.21.15.82:0/793767281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557faac299d0 0x557faac2e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:03.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.849+0000 7f150d600700 1 --2- 172.21.15.82:0/793767281 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557faac25060 0x557faac30ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:03.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.850+0000 7f150cc00700 1 -- 172.21.15.82:0/793767281 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557faac25060 msgr2=0x557faac30ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:02:03.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.850+0000 7f150cc00700 1 --2- 172.21.15.82:0/793767281 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557faac25060 0x557faac30ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:03.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.850+0000 7f150cc00700 1 -- 172.21.15.82:0/793767281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557faac299d0 msgr2=0x557faac2e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:02:03.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.850+0000 7f150cc00700 1 --2- 172.21.15.82:0/793767281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557faac299d0 0x557faac2e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:03.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.850+0000 7f150cc00700 1 -- 172.21.15.82:0/793767281 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557faab3d420 con 0x557faac25980 2024-05-08T06:02:03.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.850+0000 7f150cc00700 1 --2- 172.21.15.82:0/793767281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557faac25980 0x557faac2e280 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f14f401f440 tx=0x7f14f4014780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e19a8afb4bce571a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:02:03.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.850+0000 7f14ef400700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T06:02:03.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.851+0000 7f14ef400700 1 -- 172.21.15.82:0/793767281 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f402f060 con 0x557faac25980 2024-05-08T06:02:03.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.852+0000 7f14ef400700 1 -- 172.21.15.82:0/793767281 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f14f4014c10 con 0x557faac25980 2024-05-08T06:02:03.851 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.852+0000 7f151a9a0b80 1 -- 172.21.15.82:0/793767281 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14f40148e0 con 0x557faac25980 2024-05-08T06:02:03.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.852+0000 7f14ef400700 1 -- 172.21.15.82:0/793767281 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f14f4024040 con 0x557faac25980 2024-05-08T06:02:03.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.853+0000 7f151a9a0b80 10 client.26456 fetch_fsmap learned FSMap version 31 2024-05-08T06:02:03.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.853+0000 7f151a9a0b80 1 -- 172.21.15.82:0/793767281 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x557faac3c510 con 0x557faac25980 2024-05-08T06:02:03.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.854+0000 7f14ef400700 1 -- 172.21.15.82:0/793767281 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14f40148e0 con 0x557faac25980 2024-05-08T06:02:03.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.854+0000 7f14ef400700 1 -- 172.21.15.82:0/793767281 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f14f4027070 con 0x557faac25980 2024-05-08T06:02:03.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.855+0000 7f151a9a0b80 10 client.26456 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:02:03.855 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.855+0000 7f151a9a0b80 10 client.26456 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T06:02:03.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.855+0000 7f151a9a0b80 20 client.26456 populate_metadata read hostname 'smithi082' 2024-05-08T06:02:03.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.855+0000 7f151a9a0b80 1 --2- 172.21.15.82:0/793767281 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x557faac3e9e0 0x557faac40dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:03.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.856+0000 7f151a9a0b80 4 client.26456 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:02:03.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.856+0000 7f151a9a0b80 1 -- 172.21.15.82:0/793767281 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557faabf20a0 con 0x557faac3e9e0 2024-05-08T06:02:03.856 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.856+0000 7f150d600700 1 --2- 172.21.15.82:0/793767281 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x557faac3e9e0 0x557faac40dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:03.857 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.858+0000 7f14ef400700 10 client.26456 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T06:02:03.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.860+0000 7f150d600700 1 --2- 172.21.15.82:0/793767281 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x557faac3e9e0 0x557faac40dd0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3256c2b3f2b71af7 server_cookie=97f5b2c327821e6e in_seq=0 out_seq=0 2024-05-08T06:02:03.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.861+0000 7f14ef400700 1 -- 172.21.15.82:0/793767281 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557faabf20a0 con 0x557faac3e9e0 2024-05-08T06:02:03.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.861+0000 7f14ef400700 10 client.26456 handle_command_reply: tid=0 2024-05-08T06:02:03.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.861+0000 7f151a9a0b80 1 client.26456 shutdown 2024-05-08T06:02:03.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.862+0000 7f151a9a0b80 1 -- 172.21.15.82:0/793767281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557faac25980 msgr2=0x557faac2e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:02:03.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.862+0000 7f151a9a0b80 1 --2- 172.21.15.82:0/793767281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557faac25980 0x557faac2e280 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f14f401f440 tx=0x7f14f4014780 comp rx=0 tx=0).stop 2024-05-08T06:02:03.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.863+0000 7f151a9a0b80 1 -- 172.21.15.82:0/793767281 shutdown_connections 2024-05-08T06:02:03.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.863+0000 7f151a9a0b80 1 --2- 172.21.15.82:0/793767281 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557faac299d0 0x557faac2e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:03.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.863+0000 7f151a9a0b80 1 --2- 172.21.15.82:0/793767281 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557faac25060 0x557faac30ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:03.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.863+0000 7f151a9a0b80 1 --2- 172.21.15.82:0/793767281 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x557faac3e9e0 0x557faac40dd0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:03.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.863+0000 7f151a9a0b80 1 --2- 172.21.15.82:0/793767281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557faac25980 0x557faac2e280 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:03.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.863+0000 7f14ef400700 0 client.26456 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T06:02:03.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.863+0000 7f151a9a0b80 1 -- 172.21.15.82:0/793767281 >> 172.21.15.82:0/793767281 conn(0x557faab53b60 msgr2=0x557faac1a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:02:03.864 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:02:03 smithi082 ceph-mon[30098]: pgmap v801: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.7 MiB/s wr, 617 op/s 2024-05-08T06:02:03.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.864+0000 7f151a9a0b80 1 -- 172.21.15.82:0/793767281 shutdown_connections 2024-05-08T06:02:03.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.864+0000 7f151a9a0b80 1 -- 172.21.15.82:0/793767281 wait complete. 2024-05-08T06:02:03.865 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.864+0000 7f151a9a0b80 20 client.26456 trim_cache size 0 max 16384 2024-05-08T06:02:03.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.901+0000 7f151a9a0b80 1 Processor -- start 2024-05-08T06:02:03.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.901+0000 7f151a9a0b80 1 -- start start 2024-05-08T06:02:03.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.901+0000 7f151a9a0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557faac25060 0x557faac3acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:03.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.901+0000 7f151a9a0b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557faac25980 0x557faac1a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:03.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.901+0000 7f151a9a0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557faac299d0 0x557faac2b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:03.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.901+0000 7f151a9a0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f15081bc960 con 0x557faac25060 2024-05-08T06:02:03.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.901+0000 7f151a9a0b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f15081be4a0 con 0x557faac25980 2024-05-08T06:02:03.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.901+0000 7f151a9a0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f15081bd030 con 0x557faac299d0 2024-05-08T06:02:03.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.902+0000 7f150e000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557faac299d0 0x557faac2b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:03.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.902+0000 7f150e000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557faac299d0 0x557faac2b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:34454/0 (socket says 172.21.15.82:34454) 2024-05-08T06:02:03.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.902+0000 7f150e000700 1 -- 172.21.15.82:0/2807690081 learned_addr learned my addr 172.21.15.82:0/2807690081 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:02:03.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.902+0000 7f150cc00700 1 --2- 172.21.15.82:0/2807690081 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557faac25980 0x557faac1a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:03.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.902+0000 7f150d600700 1 --2- 172.21.15.82:0/2807690081 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557faac25060 0x557faac3acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:03.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.903+0000 7f150cc00700 1 -- 172.21.15.82:0/2807690081 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557faac299d0 msgr2=0x557faac2b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:02:03.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.903+0000 7f150cc00700 1 --2- 172.21.15.82:0/2807690081 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557faac299d0 0x557faac2b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:03.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.903+0000 7f150cc00700 1 -- 172.21.15.82:0/2807690081 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557faac25060 msgr2=0x557faac3acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:02:03.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.903+0000 7f150cc00700 1 --2- 172.21.15.82:0/2807690081 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557faac25060 0x557faac3acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:03.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.903+0000 7f150cc00700 1 -- 172.21.15.82:0/2807690081 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557faac209c0 con 0x557faac25980 2024-05-08T06:02:03.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.904+0000 7f150cc00700 1 --2- 172.21.15.82:0/2807690081 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557faac25980 0x557faac1a130 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f14f400dbe0 tx=0x7f14f4007fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61d2f47aba17077f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:02:03.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.904+0000 7f14fa000700 1 -- 172.21.15.82:0/2807690081 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f403b030 con 0x557faac25980 2024-05-08T06:02:03.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.904+0000 7f14fa000700 1 -- 172.21.15.82:0/2807690081 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14f40148a0 con 0x557faac25980 2024-05-08T06:02:03.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.904+0000 7f14fa000700 1 -- 172.21.15.82:0/2807690081 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f402f050 con 0x557faac25980 2024-05-08T06:02:03.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.905+0000 7f151a9a0b80 1 -- 172.21.15.82:0/2807690081 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557faac25980 msgr2=0x557faac1a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:02:03.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.905+0000 7f151a9a0b80 1 --2- 172.21.15.82:0/2807690081 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557faac25980 0x557faac1a130 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f14f400dbe0 tx=0x7f14f4007fd0 comp rx=0 tx=0).stop 2024-05-08T06:02:03.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.906+0000 7f151a9a0b80 1 -- 172.21.15.82:0/2807690081 shutdown_connections 2024-05-08T06:02:03.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.906+0000 7f151a9a0b80 1 --2- 172.21.15.82:0/2807690081 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557faac299d0 0x557faac2b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:03.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.906+0000 7f151a9a0b80 1 --2- 172.21.15.82:0/2807690081 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557faac25060 0x557faac3acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:03.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.906+0000 7f151a9a0b80 1 --2- 172.21.15.82:0/2807690081 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557faac25980 0x557faac1a130 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:03.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.906+0000 7f151a9a0b80 1 -- 172.21.15.82:0/2807690081 >> 172.21.15.82:0/2807690081 conn(0x557faab53b60 msgr2=0x557faac19a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:02:03.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.908+0000 7f151a9a0b80 1 -- 172.21.15.82:0/2807690081 shutdown_connections 2024-05-08T06:02:03.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.908+0000 7f151a9a0b80 1 -- 172.21.15.82:0/2807690081 wait complete. 2024-05-08T06:02:03.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.908+0000 7f151a9a0b80 1 -- start start 2024-05-08T06:02:03.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.909+0000 7f151a9a0b80 1 Processor -- start 2024-05-08T06:02:03.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.909+0000 7f151a9a0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557faac25060 0x557faac45d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:03.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.909+0000 7f151a9a0b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557faac25980 0x557faac46260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:03.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.909+0000 7f151a9a0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557faac299d0 0x557faac467a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:03.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.909+0000 7f151a9a0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f15081bddd0 con 0x557faac25060 2024-05-08T06:02:03.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.909+0000 7f151a9a0b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f15081bd700 con 0x557faac25980 2024-05-08T06:02:03.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.909+0000 7f151a9a0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f15081ba920 con 0x557faac299d0 2024-05-08T06:02:03.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.909+0000 7f151a9a0b80 10 client.0 _ll_register_callbacks cb 0x557faab1ec70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:02:03.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.910+0000 7f150e000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557faac299d0 0x557faac467a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:03.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.910+0000 7f150cc00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557faac25980 0x557faac46260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:03.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.910+0000 7f150e000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557faac299d0 0x557faac467a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:34470/0 (socket says 172.21.15.82:34470) 2024-05-08T06:02:03.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.910+0000 7f150e000700 1 -- 172.21.15.82:0/785158500 learned_addr learned my addr 172.21.15.82:0/785158500 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:02:03.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.910+0000 7f150cc00700 1 -- 172.21.15.82:0/785158500 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557faac299d0 msgr2=0x557faac467a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:02:03.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.910+0000 7f150cc00700 1 --2- 172.21.15.82:0/785158500 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557faac299d0 0x557faac467a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:03.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.910+0000 7f150cc00700 1 -- 172.21.15.82:0/785158500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557faac25060 msgr2=0x557faac45d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:02:03.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.910+0000 7f150cc00700 1 --2- 172.21.15.82:0/785158500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557faac25060 0x557faac45d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:03.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.910+0000 7f150cc00700 1 -- 172.21.15.82:0/785158500 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557faacb90f0 con 0x557faac25980 2024-05-08T06:02:03.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.910+0000 7f150cc00700 1 --2- 172.21.15.82:0/785158500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557faac25980 0x557faac46260 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x557faac2f780 tx=0x7f14f40369a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd5ad63457e22bcf server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:02:03.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.910+0000 7f14ef400700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T06:02:03.911 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.911+0000 7f14ef400700 1 -- 172.21.15.82:0/785158500 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14f403b070 con 0x557faac25980 2024-05-08T06:02:03.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.911+0000 7f14ef400700 1 -- 172.21.15.82:0/785158500 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f14f4014c60 con 0x557faac25980 2024-05-08T06:02:03.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.911+0000 7f151a9a0b80 1 -- 172.21.15.82:0/785158500 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14f40148a0 con 0x557faac25980 2024-05-08T06:02:03.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.911+0000 7f14ef400700 1 -- 172.21.15.82:0/785158500 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f14f402f040 con 0x557faac25980 2024-05-08T06:02:03.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.911+0000 7f151a9a0b80 10 client.26462 fetch_fsmap learned FSMap version 31 2024-05-08T06:02:03.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.911+0000 7f151a9a0b80 1 -- 172.21.15.82:0/785158500 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x557faacba3d0 con 0x557faac25980 2024-05-08T06:02:03.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.911+0000 7f14ef400700 1 -- 172.21.15.82:0/785158500 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f14f40044f0 con 0x557faac25980 2024-05-08T06:02:03.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.912+0000 7f14ef400700 1 -- 172.21.15.82:0/785158500 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f14f4027040 con 0x557faac25980 2024-05-08T06:02:03.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.913+0000 7f151a9a0b80 10 client.26462 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:02:03.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.913+0000 7f151a9a0b80 10 client.26462 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T06:02:03.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.913+0000 7f151a9a0b80 20 client.26462 populate_metadata read hostname 'smithi082' 2024-05-08T06:02:03.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.913+0000 7f151a9a0b80 1 --2- 172.21.15.82:0/785158500 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x557faacba9c0 0x557faacbcdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:03.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.913+0000 7f151a9a0b80 4 client.26462 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T06:02:03.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.913+0000 7f151a9a0b80 1 -- 172.21.15.82:0/785158500 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f14f40148a0 con 0x557faacba9c0 2024-05-08T06:02:03.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.913+0000 7f150d600700 1 --2- 172.21.15.82:0/785158500 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x557faacba9c0 0x557faacbcdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:03.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.914+0000 7f150d600700 1 --2- 172.21.15.82:0/785158500 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x557faacba9c0 0x557faacbcdb0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abc8f573fdb40cee server_cookie=c275933860558e24 in_seq=0 out_seq=0 2024-05-08T06:02:03.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.914+0000 7f14ef400700 10 client.26462 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T06:02:03.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.915+0000 7f14ef400700 1 -- 172.21.15.82:0/785158500 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f14f40148a0 con 0x557faacba9c0 2024-05-08T06:02:03.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.915+0000 7f14ef400700 10 client.26462 handle_command_reply: tid=0 2024-05-08T06:02:03.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.915+0000 7f151a9a0b80 1 client.26462 shutdown 2024-05-08T06:02:03.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.915+0000 7f151a9a0b80 1 -- 172.21.15.82:0/785158500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557faac25980 msgr2=0x557faac46260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:02:03.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.915+0000 7f151a9a0b80 1 --2- 172.21.15.82:0/785158500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557faac25980 0x557faac46260 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x557faac2f780 tx=0x7f14f40369a0 comp rx=0 tx=0).stop 2024-05-08T06:02:03.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.915+0000 7f151a9a0b80 1 -- 172.21.15.82:0/785158500 shutdown_connections 2024-05-08T06:02:03.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.915+0000 7f151a9a0b80 1 --2- 172.21.15.82:0/785158500 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557faac299d0 0x557faac467a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:03.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.915+0000 7f151a9a0b80 1 --2- 172.21.15.82:0/785158500 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557faac25060 0x557faac45d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:03.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.915+0000 7f151a9a0b80 1 --2- 172.21.15.82:0/785158500 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x557faacba9c0 0x557faacbcdb0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:03.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.915+0000 7f14ef400700 0 client.26462 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T06:02:03.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.915+0000 7f151a9a0b80 1 --2- 172.21.15.82:0/785158500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557faac25980 0x557faac46260 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:03.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.916+0000 7f151a9a0b80 1 -- 172.21.15.82:0/785158500 >> 172.21.15.82:0/785158500 conn(0x557faab53b60 msgr2=0x557faac1a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:02:03.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.916+0000 7f151a9a0b80 1 -- 172.21.15.82:0/785158500 shutdown_connections 2024-05-08T06:02:03.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.916+0000 7f151a9a0b80 1 -- 172.21.15.82:0/785158500 wait complete. 2024-05-08T06:02:03.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.916+0000 7f151a9a0b80 20 client.26462 trim_cache size 0 max 16384 2024-05-08T06:02:03.917 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T06:02:03.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.917+0000 7f1510000700 1 -- 172.21.15.82:0/2880694356 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f14f00b2900 msgr2=0x7f14f00b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:02:03.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.917+0000 7f1510000700 1 --2- 172.21.15.82:0/2880694356 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f14f00b2900 0x7f14f00b4dc0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f150807e260 tx=0x7f14f4008040 comp rx=0 tx=0).stop 2024-05-08T06:02:03.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.917+0000 7f1510000700 1 -- 172.21.15.82:0/2880694356 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f150810fb60 msgr2=0x7f150807cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:02:03.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.917+0000 7f1510000700 1 --2- 172.21.15.82:0/2880694356 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f150810fb60 0x7f150807cca0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f150000b6c0 tx=0x7f150000ce30 comp rx=0 tx=0).stop 2024-05-08T06:02:03.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.918+0000 7f1510000700 1 -- 172.21.15.82:0/2880694356 shutdown_connections 2024-05-08T06:02:03.919 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.918+0000 7f1510000700 1 --2- 172.21.15.82:0/2880694356 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f14f00b2900 0x7f14f00b4dc0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:03.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.918+0000 7f1510000700 1 --2- 172.21.15.82:0/2880694356 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f150810fb60 0x7f150807cca0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:03.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.918+0000 7f1510000700 1 --2- 172.21.15.82:0/2880694356 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f1508109ad0 0x7f1508083a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:03.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.918+0000 7f1510000700 1 --2- 172.21.15.82:0/2880694356 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f150810a490 0x7f1508083f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:03.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.918+0000 7f1510000700 1 -- 172.21.15.82:0/2880694356 >> 172.21.15.82:0/2880694356 conn(0x7f1508076c70 msgr2=0x7f15080772d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:02:03.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.918+0000 7f1510000700 1 -- 172.21.15.82:0/2880694356 shutdown_connections 2024-05-08T06:02:03.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:03.918+0000 7f1510000700 1 -- 172.21.15.82:0/2880694356 wait complete. 2024-05-08T06:02:04.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:02:03 smithi134 ceph-mon[34132]: pgmap v801: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.7 MiB/s wr, 617 op/s 2024-05-08T06:02:04.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:02:03 smithi151 ceph-mon[34815]: pgmap v801: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.7 MiB/s wr, 617 op/s 2024-05-08T06:02:05.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 675.0 s, 1543.2 tps, lat 64.342 ms stddev 82.069 2024-05-08T06:02:06.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:02:05 smithi134 ceph-mon[34132]: pgmap v802: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 6.1 MiB/s wr, 635 op/s 2024-05-08T06:02:06.092 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-08T06:02:06.092 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-05-08T06:02:06.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:02:05 smithi151 ceph-mon[34815]: pgmap v802: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 6.1 MiB/s wr, 635 op/s 2024-05-08T06:02:06.160 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:02:05 smithi082 ceph-mon[30098]: pgmap v802: 97 pgs: 97 active+clean; 1.6 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 6.1 MiB/s wr, 635 op/s 2024-05-08T06:02:06.718 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:02:08.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:02:07 smithi134 ceph-mon[34132]: pgmap v803: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.6 MiB/s wr, 706 op/s 2024-05-08T06:02:08.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:02:07 smithi151 ceph-mon[34815]: pgmap v803: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.6 MiB/s wr, 706 op/s 2024-05-08T06:02:08.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:02:07 smithi082 ceph-mon[30098]: pgmap v803: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.6 MiB/s wr, 706 op/s 2024-05-08T06:02:09.387 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T06:02:09.388 INFO:teuthology.orchestra.run.smithi082.stdout: "return_code": 0, 2024-05-08T06:02:09.388 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_tag": "fe5cd175-4cbd-4c1c-b158-8c78e139d42d", 2024-05-08T06:02:09.388 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": "asynchronous" 2024-05-08T06:02:09.388 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T06:02:09.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.183+0000 7f2a00000700 1 -- 172.21.15.82:0/826471329 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29f8114670 msgr2=0x7f29f8116a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:02:09.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.183+0000 7f2a00000700 1 --2- 172.21.15.82:0/826471329 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29f8114670 0x7f29f8116a60 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f29f000b0a0 tx=0x7f29f000b3b0 comp rx=0 tx=0).stop 2024-05-08T06:02:09.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.183+0000 7f2a00000700 1 -- 172.21.15.82:0/826471329 shutdown_connections 2024-05-08T06:02:09.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.183+0000 7f2a00000700 1 --2- 172.21.15.82:0/826471329 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29f80756d0 0x7f29f8075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:09.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.183+0000 7f2a00000700 1 --2- 172.21.15.82:0/826471329 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29f8114670 0x7f29f8116a60 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:09.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.183+0000 7f2a00000700 1 --2- 172.21.15.82:0/826471329 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29f8075ff0 0x7f29f8114130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:09.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.183+0000 7f2a00000700 1 -- 172.21.15.82:0/826471329 >> 172.21.15.82:0/826471329 conn(0x7f29f807a600 msgr2=0x7f29f807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:02:09.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.183+0000 7f2a00000700 1 -- 172.21.15.82:0/826471329 shutdown_connections 2024-05-08T06:02:09.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.183+0000 7f2a00000700 1 -- 172.21.15.82:0/826471329 wait complete. 2024-05-08T06:02:09.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.184+0000 7f2a00000700 1 Processor -- start 2024-05-08T06:02:09.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.184+0000 7f2a00000700 1 -- start start 2024-05-08T06:02:09.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.185+0000 7f2a00000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29f80756d0 0x7f29f81a0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:09.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.185+0000 7f2a00000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29f8075ff0 0x7f29f81a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:09.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.185+0000 7f2a00000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29f8114670 0x7f29f81a4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:09.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.185+0000 7f2a00000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f29f8119c80 con 0x7f29f8075ff0 2024-05-08T06:02:09.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.185+0000 7f2a00000700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f29f8119b00 con 0x7f29f80756d0 2024-05-08T06:02:09.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.185+0000 7f2a00000700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f29f8119e00 con 0x7f29f8114670 2024-05-08T06:02:09.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.185+0000 7f29fe000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29f8114670 0x7f29f81a4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:09.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.185+0000 7f29fe000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29f8114670 0x7f29f81a4a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:34488/0 (socket says 172.21.15.82:34488) 2024-05-08T06:02:09.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.185+0000 7f29fe000700 1 -- 172.21.15.82:0/2840673470 learned_addr learned my addr 172.21.15.82:0/2840673470 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:02:09.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.185+0000 7f29fcc00700 1 --2- 172.21.15.82:0/2840673470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29f8075ff0 0x7f29f81a06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:09.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.185+0000 7f29fd600700 1 --2- 172.21.15.82:0/2840673470 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29f80756d0 0x7f29f81a0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:09.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.186+0000 7f29fd600700 1 -- 172.21.15.82:0/2840673470 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29f8114670 msgr2=0x7f29f81a4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:02:09.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.186+0000 7f29fd600700 1 --2- 172.21.15.82:0/2840673470 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29f8114670 0x7f29f81a4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:09.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.186+0000 7f29fd600700 1 -- 172.21.15.82:0/2840673470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29f8075ff0 msgr2=0x7f29f81a06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:02:09.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.186+0000 7f29fd600700 1 --2- 172.21.15.82:0/2840673470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29f8075ff0 0x7f29f81a06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:09.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.187+0000 7f29fd600700 1 -- 172.21.15.82:0/2840673470 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29f81a5180 con 0x7f29f80756d0 2024-05-08T06:02:09.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.187+0000 7f29fcc00700 1 --2- 172.21.15.82:0/2840673470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29f8075ff0 0x7f29f81a06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:02:09.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.187+0000 7f29fd600700 1 --2- 172.21.15.82:0/2840673470 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29f80756d0 0x7f29f81a0170 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f29e800d750 tx=0x7f29e800da60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:02:09.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.188+0000 7f29f6000700 1 -- 172.21.15.82:0/2840673470 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e8016070 con 0x7f29f80756d0 2024-05-08T06:02:09.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.188+0000 7f29f6000700 1 -- 172.21.15.82:0/2840673470 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29e8004830 con 0x7f29f80756d0 2024-05-08T06:02:09.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.188+0000 7f2a00000700 1 -- 172.21.15.82:0/2840673470 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29f81a5470 con 0x7f29f80756d0 2024-05-08T06:02:09.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.189+0000 7f2a00000700 1 -- 172.21.15.82:0/2840673470 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29f81accf0 con 0x7f29f80756d0 2024-05-08T06:02:09.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.189+0000 7f29f6000700 1 -- 172.21.15.82:0/2840673470 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e80055d0 con 0x7f29f80756d0 2024-05-08T06:02:09.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.193+0000 7f29f6000700 1 -- 172.21.15.82:0/2840673470 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f29e8004220 con 0x7f29f80756d0 2024-05-08T06:02:09.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.195+0000 7f29f6000700 1 --2- 172.21.15.82:0/2840673470 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f29e00b29d0 0x7f29e00b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:09.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.195+0000 7f29f6000700 1 -- 172.21.15.82:0/2840673470 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f29e80e1dc0 con 0x7f29f80756d0 2024-05-08T06:02:09.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.195+0000 7f2a0a9e0b80 1 Processor -- start 2024-05-08T06:02:09.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.195+0000 7f29fcc00700 1 --2- 172.21.15.82:0/2840673470 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f29e00b29d0 0x7f29e00b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:09.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.197+0000 7f2a0a9e0b80 1 -- start start 2024-05-08T06:02:09.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.197+0000 7f29fcc00700 1 --2- 172.21.15.82:0/2840673470 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f29e00b29d0 0x7f29e00b4e90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f29f8110f00 tx=0x7f29ec00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:02:09.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.198+0000 7f2a0a9e0b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e27bbdbc40 0x55e27bbdc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:09.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.198+0000 7f2a0a9e0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e27bbdc560 0x55e27bbd6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:09.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.198+0000 7f2a0a9e0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e27bbd6970 0x55e27bbd6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:09.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.198+0000 7f2a0a9e0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55e27bb28aa0 con 0x55e27bbdc560 2024-05-08T06:02:09.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.198+0000 7f2a0a9e0b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e27bac67e0 con 0x55e27bbdbc40 2024-05-08T06:02:09.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.198+0000 7f2a0a9e0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55e27bb24a60 con 0x55e27bbd6970 2024-05-08T06:02:09.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.198+0000 7f29fd600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e27bbdbc40 0x55e27bbdc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:09.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.198+0000 7f29fd600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e27bbdbc40 0x55e27bbdc020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:39224/0 (socket says 172.21.15.82:39224) 2024-05-08T06:02:09.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.198+0000 7f29fd600700 1 -- 172.21.15.82:0/1798129109 learned_addr learned my addr 172.21.15.82:0/1798129109 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:02:09.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.198+0000 7f29fd600700 1 -- 172.21.15.82:0/1798129109 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e27bbd6970 msgr2=0x55e27bbd6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:02:09.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.198+0000 7f29fd600700 1 --2- 172.21.15.82:0/1798129109 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e27bbd6970 0x55e27bbd6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:09.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.198+0000 7f29fd600700 1 -- 172.21.15.82:0/1798129109 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e27bbdc560 msgr2=0x55e27bbd6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:02:09.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.198+0000 7f29fd600700 1 --2- 172.21.15.82:0/1798129109 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e27bbdc560 0x55e27bbd6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:09.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.198+0000 7f29fd600700 1 -- 172.21.15.82:0/1798129109 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e27ba75950 con 0x55e27bbdbc40 2024-05-08T06:02:09.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.199+0000 7f29fd600700 1 --2- 172.21.15.82:0/1798129109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e27bbdbc40 0x55e27bbdc020 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f29e80a6600 tx=0x7f29e8004c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6600975fc9a664d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:02:09.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.199+0000 7f29e6a00700 1 -- 172.21.15.82:0/1798129109 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e80c3070 con 0x55e27bbdbc40 2024-05-08T06:02:09.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.199+0000 7f29e6a00700 1 -- 172.21.15.82:0/1798129109 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29e80a9390 con 0x55e27bbdbc40 2024-05-08T06:02:09.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.199+0000 7f29e6a00700 1 -- 172.21.15.82:0/1798129109 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e80b1fc0 con 0x55e27bbdbc40 2024-05-08T06:02:09.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.200+0000 7f2a0a9e0b80 1 -- 172.21.15.82:0/1798129109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e27bbdbc40 msgr2=0x55e27bbdc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:02:09.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.200+0000 7f2a0a9e0b80 1 --2- 172.21.15.82:0/1798129109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e27bbdbc40 0x55e27bbdc020 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f29e80a6600 tx=0x7f29e8004c50 comp rx=0 tx=0).stop 2024-05-08T06:02:09.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.200+0000 7f2a0a9e0b80 1 -- 172.21.15.82:0/1798129109 shutdown_connections 2024-05-08T06:02:09.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.200+0000 7f2a0a9e0b80 1 --2- 172.21.15.82:0/1798129109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e27bbdbc40 0x55e27bbdc020 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:09.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.200+0000 7f2a0a9e0b80 1 --2- 172.21.15.82:0/1798129109 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e27bbd6970 0x55e27bbd6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:09.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.200+0000 7f2a0a9e0b80 1 --2- 172.21.15.82:0/1798129109 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e27bbdc560 0x55e27bbd6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:09.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.200+0000 7f2a0a9e0b80 1 -- 172.21.15.82:0/1798129109 >> 172.21.15.82:0/1798129109 conn(0x55e27bb4e750 msgr2=0x55e27bbd0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:02:09.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.200+0000 7f2a0a9e0b80 1 -- 172.21.15.82:0/1798129109 shutdown_connections 2024-05-08T06:02:09.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.200+0000 7f2a0a9e0b80 1 -- 172.21.15.82:0/1798129109 wait complete. 2024-05-08T06:02:09.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.201+0000 7f2a0a9e0b80 1 -- start start 2024-05-08T06:02:09.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.201+0000 7f2a0a9e0b80 1 Processor -- start 2024-05-08T06:02:09.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.201+0000 7f2a0a9e0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e27bbd6970 0x55e27bbe2150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:09.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.201+0000 7f2a0a9e0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e27bbdbc40 0x55e27bbdf560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:09.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.201+0000 7f2a0a9e0b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e27bbdc560 0x55e27bbdfaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:09.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.201+0000 7f2a0a9e0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55e27bbe2ff0 con 0x55e27bbd6970 2024-05-08T06:02:09.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.201+0000 7f2a0a9e0b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e27ba8eba0 con 0x55e27bbdc560 2024-05-08T06:02:09.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.201+0000 7f2a0a9e0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55e27bbe3170 con 0x55e27bbdbc40 2024-05-08T06:02:09.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.202+0000 7f2a0a9e0b80 10 client.0 _ll_register_callbacks cb 0x55e27bacfcf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:02:09.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.202+0000 7f29fe000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e27bbdc560 0x55e27bbdfaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:09.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.202+0000 7f29fd600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e27bbd6970 0x55e27bbe2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:09.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.202+0000 7f29fe000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e27bbdc560 0x55e27bbdfaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:39232/0 (socket says 172.21.15.82:39232) 2024-05-08T06:02:09.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.202+0000 7f29fe000700 1 -- 172.21.15.82:0/2669327288 learned_addr learned my addr 172.21.15.82:0/2669327288 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:02:09.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.202+0000 7f29fcc00700 1 --2- 172.21.15.82:0/2669327288 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e27bbdbc40 0x55e27bbdf560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:09.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.202+0000 7f29fe000700 1 -- 172.21.15.82:0/2669327288 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e27bbdbc40 msgr2=0x55e27bbdf560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:02:09.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.202+0000 7f29fe000700 1 --2- 172.21.15.82:0/2669327288 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e27bbdbc40 0x55e27bbdf560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:09.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.202+0000 7f29fe000700 1 -- 172.21.15.82:0/2669327288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e27bbd6970 msgr2=0x55e27bbe2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:02:09.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.202+0000 7f29fe000700 1 --2- 172.21.15.82:0/2669327288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e27bbd6970 0x55e27bbe2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:09.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.202+0000 7f29fe000700 1 -- 172.21.15.82:0/2669327288 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e27baee4a0 con 0x55e27bbdc560 2024-05-08T06:02:09.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.203+0000 7f29fe000700 1 --2- 172.21.15.82:0/2669327288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e27bbdc560 0x55e27bbdfaa0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f29f0006070 tx=0x7f29f0004a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a222f3e4c106917 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:02:09.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.204+0000 7f29db400700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T06:02:09.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.204+0000 7f29db400700 1 -- 172.21.15.82:0/2669327288 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f0022070 con 0x55e27bbdc560 2024-05-08T06:02:09.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.204+0000 7f2a0a9e0b80 1 -- 172.21.15.82:0/2669327288 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29e80a9390 con 0x55e27bbdc560 2024-05-08T06:02:09.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.204+0000 7f29db400700 1 -- 172.21.15.82:0/2669327288 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f29f0004e00 con 0x55e27bbdc560 2024-05-08T06:02:09.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.206+0000 7f29db400700 1 -- 172.21.15.82:0/2669327288 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f29f0022070 con 0x55e27bbdc560 2024-05-08T06:02:09.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.206+0000 7f2a0a9e0b80 10 client.26474 fetch_fsmap learned FSMap version 31 2024-05-08T06:02:09.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.206+0000 7f2a0a9e0b80 1 -- 172.21.15.82:0/2669327288 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55e27bbed8d0 con 0x55e27bbdc560 2024-05-08T06:02:09.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.206+0000 7f29db400700 1 -- 172.21.15.82:0/2669327288 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29e80a9390 con 0x55e27bbdc560 2024-05-08T06:02:09.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.206+0000 7f29db400700 1 -- 172.21.15.82:0/2669327288 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f29f002f020 con 0x55e27bbdc560 2024-05-08T06:02:09.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.206+0000 7f2a0a9e0b80 10 client.26474 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:02:09.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.206+0000 7f2a0a9e0b80 10 client.26474 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T06:02:09.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.206+0000 7f2a0a9e0b80 20 client.26474 populate_metadata read hostname 'smithi082' 2024-05-08T06:02:09.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.206+0000 7f2a0a9e0b80 1 --2- 172.21.15.82:0/2669327288 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55e27bbefeb0 0x55e27bbf22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:09.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.207+0000 7f2a0a9e0b80 4 client.26474 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:02:09.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.207+0000 7f2a0a9e0b80 1 -- 172.21.15.82:0/2669327288 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e27bba31c0 con 0x55e27bbefeb0 2024-05-08T06:02:09.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.207+0000 7f29fd600700 1 --2- 172.21.15.82:0/2669327288 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55e27bbefeb0 0x55e27bbf22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:09.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.207+0000 7f29fd600700 1 --2- 172.21.15.82:0/2669327288 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55e27bbefeb0 0x55e27bbf22a0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f342a7046cbf6076 server_cookie=c82103cdbe809fac in_seq=0 out_seq=0 2024-05-08T06:02:09.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.207+0000 7f29db400700 10 client.26474 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T06:02:09.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.208+0000 7f29db400700 1 -- 172.21.15.82:0/2669327288 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55e27bba31c0 con 0x55e27bbefeb0 2024-05-08T06:02:09.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.208+0000 7f29db400700 10 client.26474 handle_command_reply: tid=0 2024-05-08T06:02:09.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.208+0000 7f2a0a9e0b80 1 client.26474 shutdown 2024-05-08T06:02:09.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.208+0000 7f2a0a9e0b80 1 -- 172.21.15.82:0/2669327288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e27bbdc560 msgr2=0x55e27bbdfaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:02:09.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.208+0000 7f2a0a9e0b80 1 --2- 172.21.15.82:0/2669327288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e27bbdc560 0x55e27bbdfaa0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f29f0006070 tx=0x7f29f0004a50 comp rx=0 tx=0).stop 2024-05-08T06:02:09.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.208+0000 7f2a0a9e0b80 1 -- 172.21.15.82:0/2669327288 shutdown_connections 2024-05-08T06:02:09.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.208+0000 7f2a0a9e0b80 1 --2- 172.21.15.82:0/2669327288 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55e27bbefeb0 0x55e27bbf22a0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:09.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.209+0000 7f2a0a9e0b80 1 --2- 172.21.15.82:0/2669327288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e27bbdc560 0x55e27bbdfaa0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:09.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.209+0000 7f2a0a9e0b80 1 --2- 172.21.15.82:0/2669327288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e27bbd6970 0x55e27bbe2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:09.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.209+0000 7f29db400700 0 client.26474 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T06:02:09.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.209+0000 7f2a0a9e0b80 1 --2- 172.21.15.82:0/2669327288 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e27bbdbc40 0x55e27bbdf560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:09.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.209+0000 7f2a0a9e0b80 1 -- 172.21.15.82:0/2669327288 >> 172.21.15.82:0/2669327288 conn(0x55e27bb4e750 msgr2=0x55e27bbd0210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:02:09.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.209+0000 7f2a0a9e0b80 1 -- 172.21.15.82:0/2669327288 shutdown_connections 2024-05-08T06:02:09.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.209+0000 7f2a0a9e0b80 1 -- 172.21.15.82:0/2669327288 wait complete. 2024-05-08T06:02:09.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.209+0000 7f2a0a9e0b80 20 client.26474 trim_cache size 0 max 16384 2024-05-08T06:02:09.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.239+0000 7f2a0a9e0b80 1 Processor -- start 2024-05-08T06:02:09.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.239+0000 7f2a0a9e0b80 1 -- start start 2024-05-08T06:02:09.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.240+0000 7f2a0a9e0b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e27bbd6970 0x55e27bbec0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:09.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.241+0000 7f2a0a9e0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e27bbdbc40 0x55e27bbd0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:09.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.241+0000 7f2a0a9e0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e27bbdc560 0x55e27bbdadd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:09.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.241+0000 7f2a0a9e0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f29dc00d430 con 0x55e27bbdc560 2024-05-08T06:02:09.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.241+0000 7f2a0a9e0b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f29dc00ef70 con 0x55e27bbd6970 2024-05-08T06:02:09.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.241+0000 7f2a0a9e0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f29dc00db00 con 0x55e27bbdbc40 2024-05-08T06:02:09.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.241+0000 7f29fd600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e27bbd6970 0x55e27bbec0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:09.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.241+0000 7f29fd600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e27bbd6970 0x55e27bbec0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:39246/0 (socket says 172.21.15.82:39246) 2024-05-08T06:02:09.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.241+0000 7f29fd600700 1 -- 172.21.15.82:0/2537414516 learned_addr learned my addr 172.21.15.82:0/2537414516 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:02:09.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.241+0000 7f29fcc00700 1 --2- 172.21.15.82:0/2537414516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e27bbdbc40 0x55e27bbd0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:09.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.241+0000 7f29fe000700 1 --2- 172.21.15.82:0/2537414516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e27bbdc560 0x55e27bbdadd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:09.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.241+0000 7f29fd600700 1 -- 172.21.15.82:0/2537414516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e27bbdbc40 msgr2=0x55e27bbd0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:02:09.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.241+0000 7f29fd600700 1 --2- 172.21.15.82:0/2537414516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e27bbdbc40 0x55e27bbd0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:09.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.241+0000 7f29fd600700 1 -- 172.21.15.82:0/2537414516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e27bbdc560 msgr2=0x55e27bbdadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:02:09.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.241+0000 7f29fd600700 1 --2- 172.21.15.82:0/2537414516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e27bbdc560 0x55e27bbdadd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:09.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.241+0000 7f29fd600700 1 -- 172.21.15.82:0/2537414516 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e27bbcbb30 con 0x55e27bbd6970 2024-05-08T06:02:09.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.241+0000 7f29fe000700 1 --2- 172.21.15.82:0/2537414516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e27bbdc560 0x55e27bbdadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:02:09.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.242+0000 7f29fd600700 1 --2- 172.21.15.82:0/2537414516 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e27bbd6970 0x55e27bbec0e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f29e80a9320 tx=0x7f29e800df90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21172663695666db server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:02:09.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.242+0000 7f29e6000700 1 -- 172.21.15.82:0/2537414516 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e80c7070 con 0x55e27bbd6970 2024-05-08T06:02:09.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.242+0000 7f29e6000700 1 -- 172.21.15.82:0/2537414516 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29e80049e0 con 0x55e27bbd6970 2024-05-08T06:02:09.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.242+0000 7f29e6000700 1 -- 172.21.15.82:0/2537414516 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e80c3040 con 0x55e27bbd6970 2024-05-08T06:02:09.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.243+0000 7f2a0a9e0b80 1 -- 172.21.15.82:0/2537414516 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e27bbd6970 msgr2=0x55e27bbec0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:02:09.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.243+0000 7f2a0a9e0b80 1 --2- 172.21.15.82:0/2537414516 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e27bbd6970 0x55e27bbec0e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f29e80a9320 tx=0x7f29e800df90 comp rx=0 tx=0).stop 2024-05-08T06:02:09.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.243+0000 7f2a0a9e0b80 1 -- 172.21.15.82:0/2537414516 shutdown_connections 2024-05-08T06:02:09.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.243+0000 7f2a0a9e0b80 1 --2- 172.21.15.82:0/2537414516 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e27bbd6970 0x55e27bbec0e0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:09.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.243+0000 7f2a0a9e0b80 1 --2- 172.21.15.82:0/2537414516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e27bbdc560 0x55e27bbdadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:09.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.243+0000 7f2a0a9e0b80 1 --2- 172.21.15.82:0/2537414516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e27bbdbc40 0x55e27bbd0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:09.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.243+0000 7f2a0a9e0b80 1 -- 172.21.15.82:0/2537414516 >> 172.21.15.82:0/2537414516 conn(0x55e27bb4e750 msgr2=0x55e27bbda6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:02:09.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.244+0000 7f2a0a9e0b80 1 -- 172.21.15.82:0/2537414516 shutdown_connections 2024-05-08T06:02:09.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.244+0000 7f2a0a9e0b80 1 -- 172.21.15.82:0/2537414516 wait complete. 2024-05-08T06:02:09.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.245+0000 7f2a0a9e0b80 1 -- start start 2024-05-08T06:02:09.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.245+0000 7f2a0a9e0b80 1 Processor -- start 2024-05-08T06:02:09.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.245+0000 7f2a0a9e0b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e27bbd6970 0x55e27bbe8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:09.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.245+0000 7f2a0a9e0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e27bbdbc40 0x55e27bbe5430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:09.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.245+0000 7f2a0a9e0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e27bbdc560 0x55e27bbe59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:09.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.246+0000 7f2a0a9e0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f29dc00e8a0 con 0x55e27bbdc560 2024-05-08T06:02:09.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.246+0000 7f2a0a9e0b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f29dc00e1d0 con 0x55e27bbd6970 2024-05-08T06:02:09.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.246+0000 7f2a0a9e0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f29dc00b370 con 0x55e27bbdbc40 2024-05-08T06:02:09.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.246+0000 7f2a0a9e0b80 10 client.0 _ll_register_callbacks cb 0x55e27bacfcf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:02:09.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.246+0000 7f29fcc00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e27bbdbc40 0x55e27bbe5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:09.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.246+0000 7f29fcc00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e27bbdbc40 0x55e27bbe5430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:34510/0 (socket says 172.21.15.82:34510) 2024-05-08T06:02:09.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.246+0000 7f29fcc00700 1 -- 172.21.15.82:0/3468823985 learned_addr learned my addr 172.21.15.82:0/3468823985 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:02:09.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.246+0000 7f29fd600700 1 --2- 172.21.15.82:0/3468823985 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e27bbd6970 0x55e27bbe8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:09.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.246+0000 7f29fe000700 1 --2- 172.21.15.82:0/3468823985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e27bbdc560 0x55e27bbe59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:09.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.246+0000 7f29fcc00700 1 -- 172.21.15.82:0/3468823985 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e27bbd6970 msgr2=0x55e27bbe8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:02:09.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.246+0000 7f29fcc00700 1 --2- 172.21.15.82:0/3468823985 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e27bbd6970 0x55e27bbe8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:09.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.246+0000 7f29fcc00700 1 -- 172.21.15.82:0/3468823985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e27bbdc560 msgr2=0x55e27bbe59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:02:09.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.246+0000 7f29fcc00700 1 --2- 172.21.15.82:0/3468823985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e27bbdc560 0x55e27bbe59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:09.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.246+0000 7f29fcc00700 1 -- 172.21.15.82:0/3468823985 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e27bbe6240 con 0x55e27bbdbc40 2024-05-08T06:02:09.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.247+0000 7f29fcc00700 1 --2- 172.21.15.82:0/3468823985 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e27bbdbc40 0x55e27bbe5430 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x55e27bbdc960 tx=0x7f29ec004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89e53e212b113187 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:02:09.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.247+0000 7f29db400700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T06:02:09.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.247+0000 7f29db400700 1 -- 172.21.15.82:0/3468823985 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29ec011e00 con 0x55e27bbdbc40 2024-05-08T06:02:09.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.247+0000 7f29db400700 1 -- 172.21.15.82:0/3468823985 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f29ec01e990 con 0x55e27bbdbc40 2024-05-08T06:02:09.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.247+0000 7f2a0a9e0b80 1 -- 172.21.15.82:0/3468823985 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29e80049e0 con 0x55e27bbdbc40 2024-05-08T06:02:09.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.247+0000 7f29db400700 1 -- 172.21.15.82:0/3468823985 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f29ec01ebd0 con 0x55e27bbdbc40 2024-05-08T06:02:09.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.247+0000 7f2a0a9e0b80 10 client.26494 fetch_fsmap learned FSMap version 31 2024-05-08T06:02:09.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.247+0000 7f2a0a9e0b80 1 -- 172.21.15.82:0/3468823985 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55e27bc5b7b0 con 0x55e27bbdbc40 2024-05-08T06:02:09.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.248+0000 7f29db400700 1 -- 172.21.15.82:0/3468823985 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f29e80049e0 con 0x55e27bbdbc40 2024-05-08T06:02:09.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.248+0000 7f29db400700 1 -- 172.21.15.82:0/3468823985 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f29ec003ac0 con 0x55e27bbdbc40 2024-05-08T06:02:09.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.248+0000 7f2a0a9e0b80 10 client.26494 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:02:09.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.248+0000 7f2a0a9e0b80 10 client.26494 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T06:02:09.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.248+0000 7f2a0a9e0b80 20 client.26494 populate_metadata read hostname 'smithi082' 2024-05-08T06:02:09.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.248+0000 7f2a0a9e0b80 1 --2- 172.21.15.82:0/3468823985 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55e27bbefeb0 0x55e27bc5df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:09.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.248+0000 7f2a0a9e0b80 4 client.26494 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-08T06:02:09.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.248+0000 7f2a0a9e0b80 1 -- 172.21.15.82:0/3468823985 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55e27bb36480 con 0x55e27bbefeb0 2024-05-08T06:02:09.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.248+0000 7f29fd600700 1 --2- 172.21.15.82:0/3468823985 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55e27bbefeb0 0x55e27bc5df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:09.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.249+0000 7f29fd600700 1 --2- 172.21.15.82:0/3468823985 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55e27bbefeb0 0x55e27bc5df10 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e5dfc277f34d35f server_cookie=553f1bbdef719cf6 in_seq=0 out_seq=0 2024-05-08T06:02:09.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.249+0000 7f29db400700 10 client.26494 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T06:02:09.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.250+0000 7f29db400700 1 -- 172.21.15.82:0/3468823985 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55e27bb36480 con 0x55e27bbefeb0 2024-05-08T06:02:09.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.250+0000 7f29db400700 10 client.26494 handle_command_reply: tid=0 2024-05-08T06:02:09.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.250+0000 7f2a0a9e0b80 1 client.26494 shutdown 2024-05-08T06:02:09.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.250+0000 7f2a0a9e0b80 1 -- 172.21.15.82:0/3468823985 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e27bbdbc40 msgr2=0x55e27bbe5430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:02:09.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.250+0000 7f2a0a9e0b80 1 --2- 172.21.15.82:0/3468823985 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e27bbdbc40 0x55e27bbe5430 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x55e27bbdc960 tx=0x7f29ec004750 comp rx=0 tx=0).stop 2024-05-08T06:02:09.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.251+0000 7f2a0a9e0b80 1 -- 172.21.15.82:0/3468823985 shutdown_connections 2024-05-08T06:02:09.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.251+0000 7f2a0a9e0b80 1 --2- 172.21.15.82:0/3468823985 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55e27bbefeb0 0x55e27bc5df10 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:09.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.251+0000 7f2a0a9e0b80 1 --2- 172.21.15.82:0/3468823985 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e27bbd6970 0x55e27bbe8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:09.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.251+0000 7f2a0a9e0b80 1 --2- 172.21.15.82:0/3468823985 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e27bbdc560 0x55e27bbe59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:09.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.251+0000 7f2a0a9e0b80 1 --2- 172.21.15.82:0/3468823985 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e27bbdbc40 0x55e27bbe5430 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:09.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.251+0000 7f2a0a9e0b80 1 -- 172.21.15.82:0/3468823985 >> 172.21.15.82:0/3468823985 conn(0x55e27bb4e750 msgr2=0x55e27bbd5bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:02:09.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.251+0000 7f29db400700 0 client.26494 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T06:02:09.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.252+0000 7f2a0a9e0b80 1 -- 172.21.15.82:0/3468823985 shutdown_connections 2024-05-08T06:02:09.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.252+0000 7f2a0a9e0b80 1 -- 172.21.15.82:0/3468823985 wait complete. 2024-05-08T06:02:09.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.253+0000 7f2a0a9e0b80 20 client.26494 trim_cache size 0 max 16384 2024-05-08T06:02:09.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.254+0000 7f2a00000700 1 -- 172.21.15.82:0/2840673470 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f29e00b29d0 msgr2=0x7f29e00b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:02:09.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.254+0000 7f2a00000700 1 --2- 172.21.15.82:0/2840673470 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f29e00b29d0 0x7f29e00b4e90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f29f8110f00 tx=0x7f29ec00b410 comp rx=0 tx=0).stop 2024-05-08T06:02:09.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.254+0000 7f2a00000700 1 -- 172.21.15.82:0/2840673470 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29f80756d0 msgr2=0x7f29f81a0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:02:09.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.254+0000 7f2a00000700 1 --2- 172.21.15.82:0/2840673470 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29f80756d0 0x7f29f81a0170 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f29e800d750 tx=0x7f29e800da60 comp rx=0 tx=0).stop 2024-05-08T06:02:09.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.254+0000 7f2a00000700 1 -- 172.21.15.82:0/2840673470 shutdown_connections 2024-05-08T06:02:09.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.254+0000 7f2a00000700 1 --2- 172.21.15.82:0/2840673470 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29f80756d0 0x7f29f81a0170 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:09.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.254+0000 7f2a00000700 1 --2- 172.21.15.82:0/2840673470 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f29e00b29d0 0x7f29e00b4e90 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:09.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.254+0000 7f2a00000700 1 --2- 172.21.15.82:0/2840673470 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29f8114670 0x7f29f81a4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:09.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.254+0000 7f2a00000700 1 --2- 172.21.15.82:0/2840673470 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f29f8075ff0 0x7f29f81a06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:09.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.254+0000 7f2a00000700 1 -- 172.21.15.82:0/2840673470 >> 172.21.15.82:0/2840673470 conn(0x7f29f807a600 msgr2=0x7f29f8113440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:02:09.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.254+0000 7f2a00000700 1 -- 172.21.15.82:0/2840673470 shutdown_connections 2024-05-08T06:02:09.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:09.254+0000 7f2a00000700 1 -- 172.21.15.82:0/2840673470 wait complete. 2024-05-08T06:02:10.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:02:09 smithi151 ceph-mon[34815]: pgmap v804: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 5.5 MiB/s wr, 586 op/s 2024-05-08T06:02:10.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:02:09 smithi151 ceph-mon[34815]: scrub queued for path: / 2024-05-08T06:02:10.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:02:09 smithi151 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-05-08T06:02:10.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:02:09 smithi151 ceph-mon[34815]: scrub summary: active paths [/] 2024-05-08T06:02:10.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:02:09 smithi082 ceph-mon[30098]: pgmap v804: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 5.5 MiB/s wr, 586 op/s 2024-05-08T06:02:10.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:02:09 smithi082 ceph-mon[30098]: scrub queued for path: / 2024-05-08T06:02:10.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:02:09 smithi082 ceph-mon[30098]: scrub summary: idle+waiting paths [/] 2024-05-08T06:02:10.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:02:09 smithi082 ceph-mon[30098]: scrub summary: active paths [/] 2024-05-08T06:02:10.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:02:09 smithi134 ceph-mon[34132]: pgmap v804: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 5.5 MiB/s wr, 586 op/s 2024-05-08T06:02:10.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:02:09 smithi134 ceph-mon[34132]: scrub queued for path: / 2024-05-08T06:02:10.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:02:09 smithi134 ceph-mon[34132]: scrub summary: idle+waiting paths [/] 2024-05-08T06:02:10.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:02:09 smithi134 ceph-mon[34132]: scrub summary: active paths [/] 2024-05-08T06:02:10.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 680.0 s, 1217.4 tps, lat 82.763 ms stddev 101.949 2024-05-08T06:02:10.313 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-08T06:02:10.896 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:02:11.065 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:02:10 smithi082 ceph-mon[30098]: scrub summary: active paths [/] 2024-05-08T06:02:11.065 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:02:10 smithi082 ceph-mon[30098]: scrub summary: idle+waiting paths [/] 2024-05-08T06:02:11.065 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:02:10 smithi082 ceph-mon[30098]: scrub summary: idle+waiting paths [/] 2024-05-08T06:02:11.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:02:10 smithi151 ceph-mon[34815]: scrub summary: active paths [/] 2024-05-08T06:02:11.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:02:10 smithi151 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-05-08T06:02:11.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:02:10 smithi151 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-05-08T06:02:11.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:02:10 smithi134 ceph-mon[34132]: scrub summary: active paths [/] 2024-05-08T06:02:11.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:02:10 smithi134 ceph-mon[34132]: scrub summary: idle+waiting paths [/] 2024-05-08T06:02:11.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:02:10 smithi134 ceph-mon[34132]: scrub summary: idle+waiting paths [/] 2024-05-08T06:02:11.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:02:11 smithi082 ceph-mon[30098]: pgmap v805: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 6.9 MiB/s wr, 711 op/s 2024-05-08T06:02:12.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:02:11 smithi151 ceph-mon[34815]: pgmap v805: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 6.9 MiB/s wr, 711 op/s 2024-05-08T06:02:12.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:02:11 smithi134 ceph-mon[34132]: pgmap v805: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 6.9 MiB/s wr, 711 op/s 2024-05-08T06:02:13.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.858+0000 7fc0ae600700 1 -- 172.21.15.82:0/273983901 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0a8105ee0 msgr2=0x7fc0a8106370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:02:13.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.858+0000 7fc0ae600700 1 --2- 172.21.15.82:0/273983901 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0a8105ee0 0x7fc0a8106370 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc0a000b0a0 tx=0x7fc0a000b3b0 comp rx=0 tx=0).stop 2024-05-08T06:02:13.859 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.858+0000 7fc0ae600700 1 -- 172.21.15.82:0/273983901 shutdown_connections 2024-05-08T06:02:13.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.858+0000 7fc0ae600700 1 --2- 172.21.15.82:0/273983901 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0a8105ee0 0x7fc0a8106370 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:13.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.858+0000 7fc0ae600700 1 --2- 172.21.15.82:0/273983901 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0a81083d0 0x7fc0a806b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:13.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.858+0000 7fc0ae600700 1 --2- 172.21.15.82:0/273983901 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0a806b6f0 0x7fc0a806bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:13.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.858+0000 7fc0ae600700 1 -- 172.21.15.82:0/273983901 >> 172.21.15.82:0/273983901 conn(0x7fc0a8079350 msgr2=0x7fc0a8079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:02:13.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.859+0000 7fc0ae600700 1 -- 172.21.15.82:0/273983901 shutdown_connections 2024-05-08T06:02:13.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.859+0000 7fc0ae600700 1 -- 172.21.15.82:0/273983901 wait complete. 2024-05-08T06:02:13.860 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.860+0000 7fc0ae600700 1 Processor -- start 2024-05-08T06:02:13.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.860+0000 7fc0ae600700 1 -- start start 2024-05-08T06:02:13.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.861+0000 7fc0ae600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0a806b6f0 0x7fc0a81a0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:13.861 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.861+0000 7fc0ae600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0a8105ee0 0x7fc0a81a0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:13.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.861+0000 7fc0ae600700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0a81083d0 0x7fc0a81a4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:13.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.861+0000 7fc0ae600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a8119c60 con 0x7fc0a8105ee0 2024-05-08T06:02:13.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.861+0000 7fc0ae600700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a8119ae0 con 0x7fc0a806b6f0 2024-05-08T06:02:13.862 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.861+0000 7fc0ae600700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a8119de0 con 0x7fc0a81083d0 2024-05-08T06:02:13.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.861+0000 7fc0a7400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0a806b6f0 0x7fc0a81a0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:13.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.861+0000 7fc0a7e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0a81083d0 0x7fc0a81a4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:13.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.861+0000 7fc0a7e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0a81083d0 0x7fc0a81a4a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:32962/0 (socket says 172.21.15.82:32962) 2024-05-08T06:02:13.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.861+0000 7fc0a7e00700 1 -- 172.21.15.82:0/1229301126 learned_addr learned my addr 172.21.15.82:0/1229301126 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:02:13.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.861+0000 7fc0a7400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0a806b6f0 0x7fc0a81a0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:44542/0 (socket says 172.21.15.82:44542) 2024-05-08T06:02:13.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.862+0000 7fc0a7e00700 1 -- 172.21.15.82:0/1229301126 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0a806b6f0 msgr2=0x7fc0a81a0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:02:13.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.862+0000 7fc0a7e00700 1 --2- 172.21.15.82:0/1229301126 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0a806b6f0 0x7fc0a81a0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:13.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.862+0000 7fc0a7e00700 1 -- 172.21.15.82:0/1229301126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0a8105ee0 msgr2=0x7fc0a81a0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:02:13.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.862+0000 7fc0a7e00700 1 --2- 172.21.15.82:0/1229301126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0a8105ee0 0x7fc0a81a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:13.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.862+0000 7fc0a7e00700 1 -- 172.21.15.82:0/1229301126 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0a81a5140 con 0x7fc0a81083d0 2024-05-08T06:02:13.863 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.862+0000 7fc0a7e00700 1 --2- 172.21.15.82:0/1229301126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0a81083d0 0x7fc0a81a4a00 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc0a000b070 tx=0x7fc0a0004da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:02:13.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.862+0000 7fc09fe00700 1 -- 172.21.15.82:0/1229301126 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a0021070 con 0x7fc0a81083d0 2024-05-08T06:02:13.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.862+0000 7fc09fe00700 1 -- 172.21.15.82:0/1229301126 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc0a0003c00 con 0x7fc0a81083d0 2024-05-08T06:02:13.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.862+0000 7fc09fe00700 1 -- 172.21.15.82:0/1229301126 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a0004830 con 0x7fc0a81083d0 2024-05-08T06:02:13.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.863+0000 7fc0ae600700 1 -- 172.21.15.82:0/1229301126 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0a81a53d0 con 0x7fc0a81083d0 2024-05-08T06:02:13.864 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.863+0000 7fc0ae600700 1 -- 172.21.15.82:0/1229301126 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0a81accb0 con 0x7fc0a81083d0 2024-05-08T06:02:13.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.870+0000 7fc09fe00700 1 -- 172.21.15.82:0/1229301126 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fc0a0007a00 con 0x7fc0a81083d0 2024-05-08T06:02:13.872 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.871+0000 7fc0b9050b80 1 Processor -- start 2024-05-08T06:02:13.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.872+0000 7fc0b9050b80 1 -- start start 2024-05-08T06:02:13.873 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.872+0000 7fc0b9050b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556f7bfcbc0 0x5556f7bfcfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:13.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.873+0000 7fc0a6a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556f7bfcbc0 0x5556f7bfcfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:13.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.873+0000 7fc0a6a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556f7bfcbc0 0x5556f7bfcfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:44546/0 (socket says 172.21.15.82:44546) 2024-05-08T06:02:13.874 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.873+0000 7fc0b9050b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5556f7bfd4e0 0x5556f7bf72d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:13.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.873+0000 7fc0a6a00700 1 -- 172.21.15.82:0/1552765311 learned_addr learned my addr 172.21.15.82:0/1552765311 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:02:13.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.873+0000 7fc09fe00700 1 --2- 172.21.15.82:0/1229301126 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc08c0b2980 0x7fc08c0b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:13.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.873+0000 7fc0b9050b80 1 --2- 172.21.15.82:0/1552765311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5556f7bf78f0 0x5556f7bf7d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:13.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.873+0000 7fc0b9050b80 1 -- 172.21.15.82:0/1552765311 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5556f7b49a20 con 0x5556f7bf78f0 2024-05-08T06:02:13.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.873+0000 7fc0b9050b80 1 -- 172.21.15.82:0/1552765311 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5556f7ae7760 con 0x5556f7bfcbc0 2024-05-08T06:02:13.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.873+0000 7fc0b9050b80 1 -- 172.21.15.82:0/1552765311 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5556f7b459e0 con 0x5556f7bfd4e0 2024-05-08T06:02:13.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.874+0000 7fc0a7400700 1 --2- 172.21.15.82:0/1552765311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5556f7bfd4e0 0x5556f7bf72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:13.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.874+0000 7fc09fe00700 1 -- 172.21.15.82:0/1229301126 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fc0a000f020 con 0x7fc0a81083d0 2024-05-08T06:02:13.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.874+0000 7fc0a7400700 1 -- 172.21.15.82:0/1552765311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556f7bfcbc0 msgr2=0x5556f7bfcfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:02:13.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.874+0000 7fc0a7400700 1 --2- 172.21.15.82:0/1552765311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556f7bfcbc0 0x5556f7bfcfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:13.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.874+0000 7fc0a7400700 1 -- 172.21.15.82:0/1552765311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5556f7bf78f0 msgr2=0x5556f7bf7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:02:13.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.874+0000 7fc0a7400700 1 --2- 172.21.15.82:0/1552765311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5556f7bf78f0 0x5556f7bf7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:13.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.874+0000 7fc0a7400700 1 -- 172.21.15.82:0/1552765311 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556f7a968d0 con 0x5556f7bfd4e0 2024-05-08T06:02:13.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.874+0000 7fc0a6a00700 1 --2- 172.21.15.82:0/1229301126 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc08c0b2980 0x7fc08c0b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:13.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.874+0000 7fc0a7400700 1 --2- 172.21.15.82:0/1552765311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5556f7bfd4e0 0x5556f7bf72d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc09800dc10 tx=0x7fc09800df20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8196e7b52e32e9ca server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:02:13.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.875+0000 7fc0a6a00700 1 --2- 172.21.15.82:0/1229301126 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc08c0b2980 0x7fc08c0b4e40 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc094009e60 tx=0x7fc094004750 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:02:13.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.877+0000 7fc09cc00700 1 -- 172.21.15.82:0/1552765311 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc098004220 con 0x5556f7bfd4e0 2024-05-08T06:02:13.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.877+0000 7fc09cc00700 1 -- 172.21.15.82:0/1552765311 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc09800fdc0 con 0x5556f7bfd4e0 2024-05-08T06:02:13.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.877+0000 7fc09cc00700 1 -- 172.21.15.82:0/1552765311 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc098011440 con 0x5556f7bfd4e0 2024-05-08T06:02:13.879 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:02:13 smithi082 ceph-mon[30098]: pgmap v806: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 6.3 MiB/s wr, 642 op/s 2024-05-08T06:02:13.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.879+0000 7fc0b9050b80 1 -- 172.21.15.82:0/1552765311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5556f7bfd4e0 msgr2=0x5556f7bf72d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:02:13.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.879+0000 7fc0b9050b80 1 --2- 172.21.15.82:0/1552765311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5556f7bfd4e0 0x5556f7bf72d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc09800dc10 tx=0x7fc09800df20 comp rx=0 tx=0).stop 2024-05-08T06:02:13.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.879+0000 7fc0b9050b80 1 -- 172.21.15.82:0/1552765311 shutdown_connections 2024-05-08T06:02:13.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.879+0000 7fc0b9050b80 1 --2- 172.21.15.82:0/1552765311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556f7bfcbc0 0x5556f7bfcfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:13.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.879+0000 7fc0b9050b80 1 --2- 172.21.15.82:0/1552765311 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5556f7bf78f0 0x5556f7bf7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:13.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.879+0000 7fc0b9050b80 1 --2- 172.21.15.82:0/1552765311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5556f7bfd4e0 0x5556f7bf72d0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:13.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.879+0000 7fc0b9050b80 1 -- 172.21.15.82:0/1552765311 >> 172.21.15.82:0/1552765311 conn(0x5556f7b6f6d0 msgr2=0x5556f7bf1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:02:13.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.879+0000 7fc0b9050b80 1 -- 172.21.15.82:0/1552765311 shutdown_connections 2024-05-08T06:02:13.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.880+0000 7fc0b9050b80 1 -- 172.21.15.82:0/1552765311 wait complete. 2024-05-08T06:02:13.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.880+0000 7fc0b9050b80 1 -- start start 2024-05-08T06:02:13.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.881+0000 7fc0b9050b80 1 Processor -- start 2024-05-08T06:02:13.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.882+0000 7fc0b9050b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556f7bf78f0 0x5556f7c03250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:13.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.883+0000 7fc0b9050b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5556f7bfcbc0 0x5556f7c005f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:13.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.883+0000 7fc0b9050b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5556f7bfd4e0 0x5556f7c00b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:13.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.883+0000 7fc0b9050b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5556f7c03f20 con 0x5556f7bfd4e0 2024-05-08T06:02:13.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.883+0000 7fc0b9050b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5556f7aafb20 con 0x5556f7bf78f0 2024-05-08T06:02:13.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.883+0000 7fc0b9050b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5556f7c040a0 con 0x5556f7bfcbc0 2024-05-08T06:02:13.884 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.883+0000 7fc0b9050b80 10 client.0 _ll_register_callbacks cb 0x5556f7af0c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:02:13.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.883+0000 7fc0a7400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556f7bf78f0 0x5556f7c03250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:13.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.883+0000 7fc0a6a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5556f7bfcbc0 0x5556f7c005f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:13.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.884+0000 7fc0a7400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556f7bf78f0 0x5556f7c03250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:44550/0 (socket says 172.21.15.82:44550) 2024-05-08T06:02:13.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.884+0000 7fc0a6a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5556f7bfcbc0 0x5556f7c005f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:32976/0 (socket says 172.21.15.82:32976) 2024-05-08T06:02:13.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.884+0000 7fc0a6a00700 1 -- 172.21.15.82:0/1639057019 learned_addr learned my addr 172.21.15.82:0/1639057019 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:02:13.885 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.884+0000 7fc0a7e00700 1 --2- 172.21.15.82:0/1639057019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5556f7bfd4e0 0x5556f7c00b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:13.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.885+0000 7fc0a6a00700 1 -- 172.21.15.82:0/1639057019 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556f7bf78f0 msgr2=0x5556f7c03250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:02:13.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.885+0000 7fc0a6a00700 1 --2- 172.21.15.82:0/1639057019 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556f7bf78f0 0x5556f7c03250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:13.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.885+0000 7fc0a6a00700 1 -- 172.21.15.82:0/1639057019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5556f7bfd4e0 msgr2=0x5556f7c00b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:02:13.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.885+0000 7fc0a6a00700 1 --2- 172.21.15.82:0/1639057019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5556f7bfd4e0 0x5556f7c00b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:13.886 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.885+0000 7fc0a6a00700 1 -- 172.21.15.82:0/1639057019 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556f7b0f420 con 0x5556f7bfcbc0 2024-05-08T06:02:13.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.886+0000 7fc0a6a00700 1 --2- 172.21.15.82:0/1639057019 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5556f7bfcbc0 0x5556f7c005f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc09400fc00 tx=0x7fc0940096f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d48ca5bd6984458 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:02:13.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.886+0000 7fc091600700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T06:02:13.887 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.887+0000 7fc091600700 1 -- 172.21.15.82:0/1639057019 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc094010bf0 con 0x5556f7bfcbc0 2024-05-08T06:02:13.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.887+0000 7fc091600700 1 -- 172.21.15.82:0/1639057019 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fc094010d90 con 0x5556f7bfcbc0 2024-05-08T06:02:13.888 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.887+0000 7fc0b9050b80 1 -- 172.21.15.82:0/1639057019 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc09800fdc0 con 0x5556f7bfcbc0 2024-05-08T06:02:13.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.888+0000 7fc091600700 1 -- 172.21.15.82:0/1639057019 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fc09401d420 con 0x5556f7bfcbc0 2024-05-08T06:02:13.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.888+0000 7fc0b9050b80 10 client.26506 fetch_fsmap learned FSMap version 31 2024-05-08T06:02:13.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.888+0000 7fc0b9050b80 1 -- 172.21.15.82:0/1639057019 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5556f7c0e880 con 0x5556f7bfcbc0 2024-05-08T06:02:13.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.889+0000 7fc091600700 1 -- 172.21.15.82:0/1639057019 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc09800fdc0 con 0x5556f7bfcbc0 2024-05-08T06:02:13.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.889+0000 7fc091600700 1 -- 172.21.15.82:0/1639057019 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fc094027740 con 0x5556f7bfcbc0 2024-05-08T06:02:13.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.889+0000 7fc0b9050b80 10 client.26506 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:02:13.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.889+0000 7fc0b9050b80 10 client.26506 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T06:02:13.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.889+0000 7fc0b9050b80 20 client.26506 populate_metadata read hostname 'smithi082' 2024-05-08T06:02:13.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.889+0000 7fc0b9050b80 1 --2- 172.21.15.82:0/1639057019 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5556f7c10f60 0x5556f7c13350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:13.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.890+0000 7fc0b9050b80 4 client.26506 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:02:13.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.890+0000 7fc0b9050b80 1 -- 172.21.15.82:0/1639057019 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5556f7bc4140 con 0x5556f7c10f60 2024-05-08T06:02:13.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.890+0000 7fc0a7400700 1 --2- 172.21.15.82:0/1639057019 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5556f7c10f60 0x5556f7c13350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:13.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.892+0000 7fc0a7400700 1 --2- 172.21.15.82:0/1639057019 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5556f7c10f60 0x5556f7c13350 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3986289ac78fcc1c server_cookie=3fcd2de5efccbb3a in_seq=0 out_seq=0 2024-05-08T06:02:13.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.892+0000 7fc091600700 10 client.26506 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T06:02:13.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.893+0000 7fc091600700 1 -- 172.21.15.82:0/1639057019 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5556f7bc4140 con 0x5556f7c10f60 2024-05-08T06:02:13.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.893+0000 7fc091600700 10 client.26506 handle_command_reply: tid=0 2024-05-08T06:02:13.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.893+0000 7fc0b9050b80 1 client.26506 shutdown 2024-05-08T06:02:13.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.894+0000 7fc0b9050b80 1 -- 172.21.15.82:0/1639057019 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5556f7bfcbc0 msgr2=0x5556f7c005f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:02:13.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.894+0000 7fc0b9050b80 1 --2- 172.21.15.82:0/1639057019 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5556f7bfcbc0 0x5556f7c005f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc09400fc00 tx=0x7fc0940096f0 comp rx=0 tx=0).stop 2024-05-08T06:02:13.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.894+0000 7fc0b9050b80 1 -- 172.21.15.82:0/1639057019 shutdown_connections 2024-05-08T06:02:13.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.894+0000 7fc0b9050b80 1 --2- 172.21.15.82:0/1639057019 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5556f7c10f60 0x5556f7c13350 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:13.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.894+0000 7fc0b9050b80 1 --2- 172.21.15.82:0/1639057019 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556f7bf78f0 0x5556f7c03250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:13.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.894+0000 7fc0b9050b80 1 --2- 172.21.15.82:0/1639057019 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5556f7bfd4e0 0x5556f7c00b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:13.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.894+0000 7fc0b9050b80 1 --2- 172.21.15.82:0/1639057019 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5556f7bfcbc0 0x5556f7c005f0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:13.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.894+0000 7fc0b9050b80 1 -- 172.21.15.82:0/1639057019 >> 172.21.15.82:0/1639057019 conn(0x5556f7b6f6d0 msgr2=0x5556f7bf1190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:02:13.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.894+0000 7fc091600700 0 client.26506 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T06:02:13.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.895+0000 7fc0b9050b80 1 -- 172.21.15.82:0/1639057019 shutdown_connections 2024-05-08T06:02:13.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.895+0000 7fc0b9050b80 1 -- 172.21.15.82:0/1639057019 wait complete. 2024-05-08T06:02:13.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.895+0000 7fc0b9050b80 20 client.26506 trim_cache size 0 max 16384 2024-05-08T06:02:13.924 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.924+0000 7fc0b9050b80 1 Processor -- start 2024-05-08T06:02:13.925 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.924+0000 7fc0b9050b80 1 -- start start 2024-05-08T06:02:13.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.924+0000 7fc0b9050b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556f7bf78f0 0x5556f7c00b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:13.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.924+0000 7fc0b9050b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5556f7bfcbc0 0x5556f7c0cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:13.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.924+0000 7fc0b9050b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5556f7bfd4e0 0x5556f7bfdf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:13.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.924+0000 7fc0b9050b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a81b4010 con 0x5556f7bfcbc0 2024-05-08T06:02:13.926 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.924+0000 7fc0b9050b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a81b5b50 con 0x5556f7bf78f0 2024-05-08T06:02:13.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.924+0000 7fc0b9050b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a81b46e0 con 0x5556f7bfd4e0 2024-05-08T06:02:13.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.925+0000 7fc0a7400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556f7bf78f0 0x5556f7c00b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:13.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.925+0000 7fc0a7400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556f7bf78f0 0x5556f7c00b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:44562/0 (socket says 172.21.15.82:44562) 2024-05-08T06:02:13.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.925+0000 7fc0a7400700 1 -- 172.21.15.82:0/915504616 learned_addr learned my addr 172.21.15.82:0/915504616 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:02:13.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.925+0000 7fc0a7e00700 1 --2- 172.21.15.82:0/915504616 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5556f7bfd4e0 0x5556f7bfdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:13.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.925+0000 7fc0a6a00700 1 --2- 172.21.15.82:0/915504616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5556f7bfcbc0 0x5556f7c0cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:13.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.925+0000 7fc0a7400700 1 -- 172.21.15.82:0/915504616 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5556f7bfd4e0 msgr2=0x5556f7bfdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:02:13.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.925+0000 7fc0a7400700 1 --2- 172.21.15.82:0/915504616 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5556f7bfd4e0 0x5556f7bfdf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:13.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.925+0000 7fc0a7400700 1 -- 172.21.15.82:0/915504616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5556f7bfcbc0 msgr2=0x5556f7c0cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:02:13.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.925+0000 7fc0a7400700 1 --2- 172.21.15.82:0/915504616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5556f7bfcbc0 0x5556f7c0cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:13.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.925+0000 7fc0a7400700 1 -- 172.21.15.82:0/915504616 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556f7c136c0 con 0x5556f7bf78f0 2024-05-08T06:02:13.927 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.926+0000 7fc0a7400700 1 --2- 172.21.15.82:0/915504616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556f7bf78f0 0x5556f7c00b60 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc098003af0 tx=0x7fc0980039e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffa4ff56d45f2c83 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:02:13.928 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.926+0000 7fc093e00700 1 -- 172.21.15.82:0/915504616 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc09802f070 con 0x5556f7bf78f0 2024-05-08T06:02:13.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.926+0000 7fc093e00700 1 -- 172.21.15.82:0/915504616 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc09802a0d0 con 0x5556f7bf78f0 2024-05-08T06:02:13.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.926+0000 7fc093e00700 1 -- 172.21.15.82:0/915504616 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc09801b6c0 con 0x5556f7bf78f0 2024-05-08T06:02:13.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.927+0000 7fc0b9050b80 1 -- 172.21.15.82:0/915504616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556f7bf78f0 msgr2=0x5556f7c00b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:02:13.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.927+0000 7fc0b9050b80 1 --2- 172.21.15.82:0/915504616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556f7bf78f0 0x5556f7c00b60 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fc098003af0 tx=0x7fc0980039e0 comp rx=0 tx=0).stop 2024-05-08T06:02:13.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.927+0000 7fc0b9050b80 1 -- 172.21.15.82:0/915504616 shutdown_connections 2024-05-08T06:02:13.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.927+0000 7fc0b9050b80 1 --2- 172.21.15.82:0/915504616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556f7bf78f0 0x5556f7c00b60 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:13.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.927+0000 7fc0b9050b80 1 --2- 172.21.15.82:0/915504616 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5556f7bfd4e0 0x5556f7bfdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:13.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.927+0000 7fc0b9050b80 1 --2- 172.21.15.82:0/915504616 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5556f7bfcbc0 0x5556f7c0cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:13.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.927+0000 7fc0b9050b80 1 -- 172.21.15.82:0/915504616 >> 172.21.15.82:0/915504616 conn(0x5556f7b6f6d0 msgr2=0x5556f7bfbff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:02:13.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.928+0000 7fc0b9050b80 1 -- 172.21.15.82:0/915504616 shutdown_connections 2024-05-08T06:02:13.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.928+0000 7fc0b9050b80 1 -- 172.21.15.82:0/915504616 wait complete. 2024-05-08T06:02:13.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.928+0000 7fc0b9050b80 1 -- start start 2024-05-08T06:02:13.929 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.928+0000 7fc0b9050b80 1 Processor -- start 2024-05-08T06:02:13.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.929+0000 7fc0b9050b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5556f7bf78f0 0x5556f7c09330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:13.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.929+0000 7fc0b9050b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556f7bfcbc0 0x5556f7c09870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:13.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.929+0000 7fc0b9050b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5556f7bfd4e0 0x5556f7c06300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:13.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.929+0000 7fc0b9050b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a81b5480 con 0x5556f7bfd4e0 2024-05-08T06:02:13.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.929+0000 7fc0b9050b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a81b4db0 con 0x5556f7bfcbc0 2024-05-08T06:02:13.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.929+0000 7fc0b9050b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a81b1fb0 con 0x5556f7bf78f0 2024-05-08T06:02:13.930 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.929+0000 7fc0b9050b80 10 client.0 _ll_register_callbacks cb 0x5556f7af0c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:02:13.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.930+0000 7fc0a6a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556f7bfcbc0 0x5556f7c09870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:13.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.930+0000 7fc0a6a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556f7bfcbc0 0x5556f7c09870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:44568/0 (socket says 172.21.15.82:44568) 2024-05-08T06:02:13.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.930+0000 7fc0a6a00700 1 -- 172.21.15.82:0/1691501908 learned_addr learned my addr 172.21.15.82:0/1691501908 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:02:13.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.930+0000 7fc0a7400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5556f7bf78f0 0x5556f7c09330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:13.931 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.930+0000 7fc0a7e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5556f7bfd4e0 0x5556f7c06300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:13.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.931+0000 7fc0a7e00700 1 -- 172.21.15.82:0/1691501908 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5556f7bf78f0 msgr2=0x5556f7c09330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:02:13.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.931+0000 7fc0a7e00700 1 --2- 172.21.15.82:0/1691501908 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5556f7bf78f0 0x5556f7c09330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:13.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.931+0000 7fc0a7e00700 1 -- 172.21.15.82:0/1691501908 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556f7bfcbc0 msgr2=0x5556f7c09870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:02:13.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.931+0000 7fc0a7e00700 1 --2- 172.21.15.82:0/1691501908 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556f7bfcbc0 0x5556f7c09870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:13.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.931+0000 7fc0a7e00700 1 -- 172.21.15.82:0/1691501908 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556f7c06b40 con 0x5556f7bfd4e0 2024-05-08T06:02:13.932 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.931+0000 7fc0a7400700 1 --2- 172.21.15.82:0/1691501908 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5556f7bf78f0 0x5556f7c09330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:02:13.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.931+0000 7fc0a7e00700 1 --2- 172.21.15.82:0/1691501908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5556f7bfd4e0 0x5556f7c06300 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x5556f7bf82b0 tx=0x7fc0a00aa470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae1e060831c6961a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:02:13.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.931+0000 7fc091600700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T06:02:13.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.932+0000 7fc091600700 1 -- 172.21.15.82:0/1691501908 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a00aa810 con 0x5556f7bfd4e0 2024-05-08T06:02:13.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.932+0000 7fc0b9050b80 1 -- 172.21.15.82:0/1691501908 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc09802a0d0 con 0x5556f7bfd4e0 2024-05-08T06:02:13.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.932+0000 7fc091600700 1 -- 172.21.15.82:0/1691501908 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fc0a00b4990 con 0x5556f7bfd4e0 2024-05-08T06:02:13.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.933+0000 7fc091600700 1 -- 172.21.15.82:0/1691501908 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fc0a00074e0 con 0x5556f7bfd4e0 2024-05-08T06:02:13.933 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.933+0000 7fc0b9050b80 10 client.16062 fetch_fsmap learned FSMap version 31 2024-05-08T06:02:13.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.933+0000 7fc0b9050b80 1 -- 172.21.15.82:0/1691501908 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5556f7c7c350 con 0x5556f7bfd4e0 2024-05-08T06:02:13.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.933+0000 7fc091600700 1 -- 172.21.15.82:0/1691501908 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc09802a0d0 con 0x5556f7bfd4e0 2024-05-08T06:02:13.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.933+0000 7fc091600700 1 -- 172.21.15.82:0/1691501908 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fc0a0011070 con 0x5556f7bfd4e0 2024-05-08T06:02:13.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.933+0000 7fc0b9050b80 10 client.16062 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:02:13.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.933+0000 7fc0b9050b80 10 client.16062 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T06:02:13.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.933+0000 7fc0b9050b80 20 client.16062 populate_metadata read hostname 'smithi082' 2024-05-08T06:02:13.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.933+0000 7fc0b9050b80 1 --2- 172.21.15.82:0/1691501908 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5556f7c7ca30 0x5556f7c7ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:13.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.933+0000 7fc0b9050b80 4 client.16062 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-08T06:02:13.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.934+0000 7fc0b9050b80 1 -- 172.21.15.82:0/1691501908 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5556f7b57400 con 0x5556f7c7ca30 2024-05-08T06:02:13.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.934+0000 7fc0a7400700 1 --2- 172.21.15.82:0/1691501908 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5556f7c7ca30 0x5556f7c7ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:13.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.935+0000 7fc0a7400700 1 --2- 172.21.15.82:0/1691501908 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5556f7c7ca30 0x5556f7c7ee50 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cab8b2051c7f64e0 server_cookie=90198cb7ba66f2e5 in_seq=0 out_seq=0 2024-05-08T06:02:13.935 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.935+0000 7fc091600700 10 client.16062 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T06:02:13.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.935+0000 7fc091600700 1 -- 172.21.15.82:0/1691501908 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5556f7b57400 con 0x5556f7c7ca30 2024-05-08T06:02:13.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.935+0000 7fc091600700 10 client.16062 handle_command_reply: tid=0 2024-05-08T06:02:13.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.935+0000 7fc0b9050b80 1 client.16062 shutdown 2024-05-08T06:02:13.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.937+0000 7fc0b9050b80 1 -- 172.21.15.82:0/1691501908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5556f7bfd4e0 msgr2=0x5556f7c06300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:02:13.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.937+0000 7fc0b9050b80 1 --2- 172.21.15.82:0/1691501908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5556f7bfd4e0 0x5556f7c06300 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x5556f7bf82b0 tx=0x7fc0a00aa470 comp rx=0 tx=0).stop 2024-05-08T06:02:13.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.937+0000 7fc0b9050b80 1 -- 172.21.15.82:0/1691501908 shutdown_connections 2024-05-08T06:02:13.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.937+0000 7fc0b9050b80 1 --2- 172.21.15.82:0/1691501908 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5556f7bfd4e0 0x5556f7c06300 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:13.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.937+0000 7fc0b9050b80 1 --2- 172.21.15.82:0/1691501908 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5556f7bf78f0 0x5556f7c09330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:13.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.937+0000 7fc0b9050b80 1 --2- 172.21.15.82:0/1691501908 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5556f7c7ca30 0x5556f7c7ee50 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:13.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.937+0000 7fc0b9050b80 1 --2- 172.21.15.82:0/1691501908 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556f7bfcbc0 0x5556f7c09870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:13.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.937+0000 7fc0b9050b80 1 -- 172.21.15.82:0/1691501908 >> 172.21.15.82:0/1691501908 conn(0x5556f7b6f6d0 msgr2=0x5556f7c02480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:02:13.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.937+0000 7fc091600700 0 client.16062 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T06:02:13.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.938+0000 7fc0b9050b80 1 -- 172.21.15.82:0/1691501908 shutdown_connections 2024-05-08T06:02:13.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.938+0000 7fc0b9050b80 1 -- 172.21.15.82:0/1691501908 wait complete. 2024-05-08T06:02:13.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.938+0000 7fc0b9050b80 20 client.16062 trim_cache size 0 max 16384 2024-05-08T06:02:13.939 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T06:02:13.940 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-08T06:02:13.940 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2024-05-08T06:02:13.940 INFO:teuthology.orchestra.run.smithi082.stdout: "fe5cd175-4cbd-4c1c-b158-8c78e139d42d": { 2024-05-08T06:02:13.940 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2024-05-08T06:02:13.940 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "fe5cd175-4cbd-4c1c-b158-8c78e139d42d", 2024-05-08T06:02:13.940 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2024-05-08T06:02:13.940 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:02:13.940 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:02:13.940 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T06:02:13.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.939+0000 7fc0ae600700 1 -- 172.21.15.82:0/1229301126 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc08c0b2980 msgr2=0x7fc08c0b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:02:13.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.939+0000 7fc0ae600700 1 --2- 172.21.15.82:0/1229301126 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc08c0b2980 0x7fc08c0b4e40 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc094009e60 tx=0x7fc094004750 comp rx=0 tx=0).stop 2024-05-08T06:02:13.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.939+0000 7fc0ae600700 1 -- 172.21.15.82:0/1229301126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0a81083d0 msgr2=0x7fc0a81a4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:02:13.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.939+0000 7fc0ae600700 1 --2- 172.21.15.82:0/1229301126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0a81083d0 0x7fc0a81a4a00 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc0a000b070 tx=0x7fc0a0004da0 comp rx=0 tx=0).stop 2024-05-08T06:02:13.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.940+0000 7fc0ae600700 1 -- 172.21.15.82:0/1229301126 shutdown_connections 2024-05-08T06:02:13.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.940+0000 7fc0ae600700 1 --2- 172.21.15.82:0/1229301126 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0a806b6f0 0x7fc0a81a0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:13.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.940+0000 7fc0ae600700 1 --2- 172.21.15.82:0/1229301126 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc08c0b2980 0x7fc08c0b4e40 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:13.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.940+0000 7fc0ae600700 1 --2- 172.21.15.82:0/1229301126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0a81083d0 0x7fc0a81a4a00 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:13.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.940+0000 7fc0ae600700 1 --2- 172.21.15.82:0/1229301126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc0a8105ee0 0x7fc0a81a0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:13.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.940+0000 7fc0ae600700 1 -- 172.21.15.82:0/1229301126 >> 172.21.15.82:0/1229301126 conn(0x7fc0a8079350 msgr2=0x7fc0a8104ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:02:13.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.940+0000 7fc0ae600700 1 -- 172.21.15.82:0/1229301126 shutdown_connections 2024-05-08T06:02:13.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:13.940+0000 7fc0ae600700 1 -- 172.21.15.82:0/1229301126 wait complete. 2024-05-08T06:02:14.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:02:13 smithi151 ceph-mon[34815]: pgmap v806: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 6.3 MiB/s wr, 642 op/s 2024-05-08T06:02:14.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:02:13 smithi134 ceph-mon[34132]: pgmap v806: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 6.3 MiB/s wr, 642 op/s 2024-05-08T06:02:15.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 685.0 s, 1395.0 tps, lat 71.969 ms stddev 82.586 2024-05-08T06:02:15.385 INFO:tasks.cephfs.filesystem:scrub status for tag:fe5cd175-4cbd-4c1c-b158-8c78e139d42d - {'path': '/', 'tag': 'fe5cd175-4cbd-4c1c-b158-8c78e139d42d', 'options': 'recursive,force'} 2024-05-08T06:02:16.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:02:15 smithi151 ceph-mon[34815]: pgmap v807: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 5.6 MiB/s wr, 591 op/s 2024-05-08T06:02:16.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:02:15 smithi151 ceph-mon[34815]: scrub summary: idle 2024-05-08T06:02:16.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:02:15 smithi151 ceph-mon[34815]: scrub summary: idle 2024-05-08T06:02:16.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:02:15 smithi082 ceph-mon[30098]: pgmap v807: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 5.6 MiB/s wr, 591 op/s 2024-05-08T06:02:16.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:02:15 smithi082 ceph-mon[30098]: scrub summary: idle 2024-05-08T06:02:16.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:02:15 smithi082 ceph-mon[30098]: scrub summary: idle 2024-05-08T06:02:16.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:02:15 smithi134 ceph-mon[34132]: pgmap v807: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 5.6 MiB/s wr, 591 op/s 2024-05-08T06:02:16.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:02:15 smithi134 ceph-mon[34132]: scrub summary: idle 2024-05-08T06:02:16.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:02:15 smithi134 ceph-mon[34132]: scrub summary: idle 2024-05-08T06:02:17.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:02:17 smithi082 ceph-mon[30098]: pgmap v808: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.1 MiB/s wr, 667 op/s 2024-05-08T06:02:18.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:02:17 smithi151 ceph-mon[34815]: pgmap v808: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.1 MiB/s wr, 667 op/s 2024-05-08T06:02:18.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:02:17 smithi134 ceph-mon[34132]: pgmap v808: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.1 MiB/s wr, 667 op/s 2024-05-08T06:02:20.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:02:19 smithi151 ceph-mon[34815]: pgmap v809: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.0 MiB/s wr, 615 op/s 2024-05-08T06:02:20.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:02:19 smithi082 ceph-mon[30098]: pgmap v809: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.0 MiB/s wr, 615 op/s 2024-05-08T06:02:20.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:02:19 smithi134 ceph-mon[34132]: pgmap v809: 97 pgs: 97 active+clean; 1.6 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 6.0 MiB/s wr, 615 op/s 2024-05-08T06:02:20.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 690.0 s, 1743.6 tps, lat 56.956 ms stddev 67.326 2024-05-08T06:02:22.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:02:21 smithi151 ceph-mon[34815]: pgmap v810: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.1 MiB/s wr, 663 op/s 2024-05-08T06:02:22.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:02:21 smithi082 ceph-mon[30098]: pgmap v810: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.1 MiB/s wr, 663 op/s 2024-05-08T06:02:22.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:02:21 smithi134 ceph-mon[34132]: pgmap v810: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.1 MiB/s wr, 663 op/s 2024-05-08T06:02:24.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:02:23 smithi151 ceph-mon[34815]: pgmap v811: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.3 MiB/s wr, 590 op/s 2024-05-08T06:02:24.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:02:23 smithi082 ceph-mon[30098]: pgmap v811: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.3 MiB/s wr, 590 op/s 2024-05-08T06:02:24.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:02:23 smithi134 ceph-mon[34132]: pgmap v811: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.3 MiB/s wr, 590 op/s 2024-05-08T06:02:25.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 695.0 s, 1608.6 tps, lat 62.481 ms stddev 73.798 2024-05-08T06:02:26.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:02:25 smithi151 ceph-mon[34815]: pgmap v812: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.3 MiB/s wr, 589 op/s 2024-05-08T06:02:26.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:02:25 smithi082 ceph-mon[30098]: pgmap v812: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.3 MiB/s wr, 589 op/s 2024-05-08T06:02:26.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:02:25 smithi134 ceph-mon[34132]: pgmap v812: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 5.3 MiB/s wr, 589 op/s 2024-05-08T06:02:28.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:02:27 smithi151 ceph-mon[34815]: pgmap v813: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.1 MiB/s wr, 686 op/s 2024-05-08T06:02:28.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:02:27 smithi082 ceph-mon[30098]: pgmap v813: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.1 MiB/s wr, 686 op/s 2024-05-08T06:02:28.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:02:27 smithi134 ceph-mon[34132]: pgmap v813: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.1 MiB/s wr, 686 op/s 2024-05-08T06:02:30.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:02:29 smithi151 ceph-mon[34815]: pgmap v814: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 5.0 MiB/s wr, 563 op/s 2024-05-08T06:02:30.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:02:29 smithi082 ceph-mon[30098]: pgmap v814: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 5.0 MiB/s wr, 563 op/s 2024-05-08T06:02:30.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:02:29 smithi134 ceph-mon[34132]: pgmap v814: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 5.0 MiB/s wr, 563 op/s 2024-05-08T06:02:30.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 700.0 s, 1727.0 tps, lat 57.915 ms stddev 67.528 2024-05-08T06:02:32.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:02:31 smithi151 ceph-mon[34815]: pgmap v815: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 5.8 MiB/s wr, 653 op/s 2024-05-08T06:02:32.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:02:31 smithi082 ceph-mon[30098]: pgmap v815: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 5.8 MiB/s wr, 653 op/s 2024-05-08T06:02:32.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:02:31 smithi134 ceph-mon[34132]: pgmap v815: 97 pgs: 97 active+clean; 1.6 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 5.8 MiB/s wr, 653 op/s 2024-05-08T06:02:34.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:02:33 smithi151 ceph-mon[34815]: pgmap v816: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.8 MiB/s wr, 628 op/s 2024-05-08T06:02:34.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:02:33 smithi082 ceph-mon[30098]: pgmap v816: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.8 MiB/s wr, 628 op/s 2024-05-08T06:02:34.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:02:33 smithi134 ceph-mon[34132]: pgmap v816: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.8 MiB/s wr, 628 op/s 2024-05-08T06:02:35.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 705.0 s, 1873.4 tps, lat 53.074 ms stddev 59.797 2024-05-08T06:02:36.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:02:35 smithi151 ceph-mon[34815]: pgmap v817: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.6 MiB/s wr, 602 op/s 2024-05-08T06:02:36.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:02:35 smithi082 ceph-mon[30098]: pgmap v817: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.6 MiB/s wr, 602 op/s 2024-05-08T06:02:36.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:02:35 smithi134 ceph-mon[34132]: pgmap v817: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 5.6 MiB/s wr, 602 op/s 2024-05-08T06:02:38.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:02:37 smithi151 ceph-mon[34815]: pgmap v818: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 6.7 MiB/s wr, 713 op/s 2024-05-08T06:02:38.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:02:37 smithi082 ceph-mon[30098]: pgmap v818: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 6.7 MiB/s wr, 713 op/s 2024-05-08T06:02:38.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:02:37 smithi134 ceph-mon[34132]: pgmap v818: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 6.7 MiB/s wr, 713 op/s 2024-05-08T06:02:40.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:02:39 smithi151 ceph-mon[34815]: pgmap v819: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.6 MiB/s wr, 591 op/s 2024-05-08T06:02:40.223 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:02:39 smithi082 ceph-mon[30098]: pgmap v819: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.6 MiB/s wr, 591 op/s 2024-05-08T06:02:40.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:02:39 smithi134 ceph-mon[34132]: pgmap v819: 97 pgs: 97 active+clean; 1.6 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.6 MiB/s wr, 591 op/s 2024-05-08T06:02:40.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 710.0 s, 1518.4 tps, lat 65.722 ms stddev 76.311 2024-05-08T06:02:42.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:02:41 smithi082 ceph-mon[30098]: pgmap v820: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.2 MiB/s wr, 732 op/s 2024-05-08T06:02:42.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:02:41 smithi134 ceph-mon[34132]: pgmap v820: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.2 MiB/s wr, 732 op/s 2024-05-08T06:02:42.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:02:41 smithi151 ceph-mon[34815]: pgmap v820: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.2 MiB/s wr, 732 op/s 2024-05-08T06:02:44.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:02:43 smithi082 ceph-mon[30098]: pgmap v821: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.3 MiB/s wr, 640 op/s 2024-05-08T06:02:44.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:02:43 smithi134 ceph-mon[34132]: pgmap v821: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.3 MiB/s wr, 640 op/s 2024-05-08T06:02:44.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:02:43 smithi151 ceph-mon[34815]: pgmap v821: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.3 MiB/s wr, 640 op/s 2024-05-08T06:02:45.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 715.0 s, 1334.8 tps, lat 75.029 ms stddev 96.350 2024-05-08T06:02:45.386 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-08T06:02:45.937 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:02:46.190 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:02:45 smithi082 ceph-mon[30098]: pgmap v822: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.3 MiB/s wr, 637 op/s 2024-05-08T06:02:46.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:02:45 smithi134 ceph-mon[34132]: pgmap v822: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.3 MiB/s wr, 637 op/s 2024-05-08T06:02:46.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:02:45 smithi151 ceph-mon[34815]: pgmap v822: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.3 MiB/s wr, 637 op/s 2024-05-08T06:02:47.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:02:47 smithi082 ceph-mon[30098]: pgmap v823: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.9 MiB/s wr, 718 op/s 2024-05-08T06:02:48.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:02:47 smithi134 ceph-mon[34132]: pgmap v823: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.9 MiB/s wr, 718 op/s 2024-05-08T06:02:48.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:02:47 smithi151 ceph-mon[34815]: pgmap v823: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 6.9 MiB/s wr, 718 op/s 2024-05-08T06:02:48.830 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.828+0000 7f8555800700 1 -- 172.21.15.82:0/582871462 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f855010a4a0 msgr2=0x7f855010a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:02:49.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.828+0000 7f8555800700 1 --2- 172.21.15.82:0/582871462 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f855010a4a0 0x7f855010a880 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f85380099c0 tx=0x7f8538009cd0 comp rx=0 tx=0).stop 2024-05-08T06:02:49.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.829+0000 7f8555800700 1 -- 172.21.15.82:0/582871462 shutdown_connections 2024-05-08T06:02:49.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.829+0000 7f8555800700 1 --2- 172.21.15.82:0/582871462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85501165f0 0x7f85501189e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:49.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.829+0000 7f8555800700 1 --2- 172.21.15.82:0/582871462 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f855010a4a0 0x7f855010a880 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:49.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.829+0000 7f8555800700 1 --2- 172.21.15.82:0/582871462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f855010adc0 0x7f85501160b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:49.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.829+0000 7f8555800700 1 -- 172.21.15.82:0/582871462 >> 172.21.15.82:0/582871462 conn(0x7f855006e480 msgr2=0x7f855006e890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:02:49.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.829+0000 7f8555800700 1 -- 172.21.15.82:0/582871462 shutdown_connections 2024-05-08T06:02:49.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.829+0000 7f8555800700 1 -- 172.21.15.82:0/582871462 wait complete. 2024-05-08T06:02:49.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.830+0000 7f8555800700 1 Processor -- start 2024-05-08T06:02:49.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.831+0000 7f8555800700 1 -- start start 2024-05-08T06:02:49.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.831+0000 7f8555800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f855010a4a0 0x7f85501a8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:49.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.831+0000 7f8555800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f855010adc0 0x7f85501a9340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:49.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.831+0000 7f8555800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85501165f0 0x7f85501151d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:49.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.831+0000 7f8555800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f855011be50 con 0x7f855010a4a0 2024-05-08T06:02:49.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.831+0000 7f8555800700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f855011bcd0 con 0x7f855010adc0 2024-05-08T06:02:49.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.831+0000 7f8555800700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f855011bfd0 con 0x7f85501165f0 2024-05-08T06:02:49.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.832+0000 7f854fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f855010a4a0 0x7f85501a8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:49.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.832+0000 7f854fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f855010a4a0 0x7f85501a8e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44508/0 (socket says 172.21.15.82:44508) 2024-05-08T06:02:49.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.832+0000 7f854fe00700 1 -- 172.21.15.82:0/663933516 learned_addr learned my addr 172.21.15.82:0/663933516 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:02:49.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.832+0000 7f8554e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85501165f0 0x7f85501151d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:49.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.832+0000 7f8547400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f855010adc0 0x7f85501a9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:49.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.834+0000 7f8547400700 1 -- 172.21.15.82:0/663933516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85501165f0 msgr2=0x7f85501151d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:02:49.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.834+0000 7f8547400700 1 --2- 172.21.15.82:0/663933516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85501165f0 0x7f85501151d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:49.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.834+0000 7f8547400700 1 -- 172.21.15.82:0/663933516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f855010a4a0 msgr2=0x7f85501a8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:02:49.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.834+0000 7f8547400700 1 --2- 172.21.15.82:0/663933516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f855010a4a0 0x7f85501a8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:49.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.834+0000 7f8547400700 1 -- 172.21.15.82:0/663933516 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8550115aa0 con 0x7f855010adc0 2024-05-08T06:02:49.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.834+0000 7f8554e00700 1 --2- 172.21.15.82:0/663933516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85501165f0 0x7f85501151d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:02:49.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.839+0000 7f8547400700 1 --2- 172.21.15.82:0/663933516 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f855010adc0 0x7f85501a9340 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f854000d950 tx=0x7f854000dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:02:49.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.840+0000 7f854d600700 1 -- 172.21.15.82:0/663933516 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8540017070 con 0x7f855010adc0 2024-05-08T06:02:49.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.840+0000 7f8555800700 1 -- 172.21.15.82:0/663933516 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8550115d30 con 0x7f855010adc0 2024-05-08T06:02:49.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.840+0000 7f854d600700 1 -- 172.21.15.82:0/663933516 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8540009de0 con 0x7f855010adc0 2024-05-08T06:02:49.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.840+0000 7f854d600700 1 -- 172.21.15.82:0/663933516 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8540010d90 con 0x7f855010adc0 2024-05-08T06:02:49.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.840+0000 7f8555800700 1 -- 172.21.15.82:0/663933516 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85501a4b90 con 0x7f855010adc0 2024-05-08T06:02:49.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.846+0000 7f85617ffb80 1 Processor -- start 2024-05-08T06:02:49.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.846+0000 7f85617ffb80 1 -- start start 2024-05-08T06:02:49.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.847+0000 7f85617ffb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a060aed9e0 0x55a060aeddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:49.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.847+0000 7f85617ffb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a060aee300 0x55a060ae7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:49.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.847+0000 7f85617ffb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a060ae8600 0x55a060ae8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:49.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.847+0000 7f85617ffb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a060a3aa20 con 0x55a060ae8600 2024-05-08T06:02:49.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.847+0000 7f85617ffb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a0609d8760 con 0x55a060aed9e0 2024-05-08T06:02:49.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.847+0000 7f85617ffb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55a060a369e0 con 0x55a060aee300 2024-05-08T06:02:49.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.847+0000 7f854fe00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a060aee300 0x55a060ae7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:49.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.847+0000 7f854fe00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a060aee300 0x55a060ae7fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:43044/0 (socket says 172.21.15.82:43044) 2024-05-08T06:02:49.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.847+0000 7f854fe00700 1 -- 172.21.15.82:0/166484912 learned_addr learned my addr 172.21.15.82:0/166484912 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:02:49.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.847+0000 7f8554e00700 1 --2- 172.21.15.82:0/166484912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a060aed9e0 0x55a060aeddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:49.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.848+0000 7f854fe00700 1 -- 172.21.15.82:0/166484912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a060aed9e0 msgr2=0x55a060aeddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:02:49.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.848+0000 7f854fe00700 1 --2- 172.21.15.82:0/166484912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a060aed9e0 0x55a060aeddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:49.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.848+0000 7f854fe00700 1 -- 172.21.15.82:0/166484912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a060ae8600 msgr2=0x55a060ae8a80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T06:02:49.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.848+0000 7f854fe00700 1 --2- 172.21.15.82:0/166484912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a060ae8600 0x55a060ae8a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:49.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.848+0000 7f854fe00700 1 -- 172.21.15.82:0/166484912 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0609878d0 con 0x55a060aee300 2024-05-08T06:02:49.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.848+0000 7f854fe00700 1 --2- 172.21.15.82:0/166484912 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a060aee300 0x55a060ae7fe0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f85380096a0 tx=0x7f85380096d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3becbdab777e56d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:02:49.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.850+0000 7f8545600700 1 -- 172.21.15.82:0/166484912 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8538003b60 con 0x55a060aee300 2024-05-08T06:02:49.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.850+0000 7f8545600700 1 -- 172.21.15.82:0/166484912 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8538003d00 con 0x55a060aee300 2024-05-08T06:02:49.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.850+0000 7f8545600700 1 -- 172.21.15.82:0/166484912 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f853800be60 con 0x55a060aee300 2024-05-08T06:02:49.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.851+0000 7f85617ffb80 1 -- 172.21.15.82:0/166484912 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a060aee300 msgr2=0x55a060ae7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:02:49.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.851+0000 7f85617ffb80 1 --2- 172.21.15.82:0/166484912 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a060aee300 0x55a060ae7fe0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f85380096a0 tx=0x7f85380096d0 comp rx=0 tx=0).stop 2024-05-08T06:02:49.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.854+0000 7f854d600700 1 -- 172.21.15.82:0/663933516 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f854001a070 con 0x7f855010adc0 2024-05-08T06:02:49.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.854+0000 7f85617ffb80 1 -- 172.21.15.82:0/166484912 shutdown_connections 2024-05-08T06:02:49.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.854+0000 7f85617ffb80 1 --2- 172.21.15.82:0/166484912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a060aed9e0 0x55a060aeddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:49.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.854+0000 7f85617ffb80 1 --2- 172.21.15.82:0/166484912 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a060ae8600 0x55a060ae8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:49.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.854+0000 7f85617ffb80 1 --2- 172.21.15.82:0/166484912 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a060aee300 0x55a060ae7fe0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:49.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.854+0000 7f85617ffb80 1 -- 172.21.15.82:0/166484912 >> 172.21.15.82:0/166484912 conn(0x55a060a16b60 msgr2=0x55a060ae29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:02:49.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.858+0000 7f85617ffb80 1 -- 172.21.15.82:0/166484912 shutdown_connections 2024-05-08T06:02:49.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.858+0000 7f85617ffb80 1 -- 172.21.15.82:0/166484912 wait complete. 2024-05-08T06:02:49.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.858+0000 7f85617ffb80 1 -- start start 2024-05-08T06:02:49.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.859+0000 7f854d600700 1 --2- 172.21.15.82:0/663933516 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f85340b2790 0x7f85340b4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:49.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.859+0000 7f85617ffb80 1 Processor -- start 2024-05-08T06:02:49.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.859+0000 7f854d600700 1 -- 172.21.15.82:0/663933516 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f85400e1a60 con 0x7f855010adc0 2024-05-08T06:02:49.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.860+0000 7f8554e00700 1 --2- 172.21.15.82:0/663933516 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f85340b2790 0x7f85340b4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:49.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.861+0000 7f8554e00700 1 --2- 172.21.15.82:0/663933516 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f85340b2790 0x7f85340b4c50 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f854800a7d0 tx=0x7f8548009650 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:02:49.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.863+0000 7f85617ffb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a060ae8600 0x55a060af3f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:49.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.864+0000 7f854fe00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a060ae8600 0x55a060af3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:49.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.864+0000 7f854fe00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a060ae8600 0x55a060af3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:50218/0 (socket says 172.21.15.82:50218) 2024-05-08T06:02:49.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.864+0000 7f85617ffb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a060aed9e0 0x55a060af1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:49.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.864+0000 7f85617ffb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a060aee300 0x55a060af1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:49.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.865+0000 7f8554e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a060aee300 0x55a060af1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:49.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.865+0000 7f8554e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a060aee300 0x55a060af1840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:43052/0 (socket says 172.21.15.82:43052) 2024-05-08T06:02:49.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.866+0000 7f85617ffb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a060af4d50 con 0x55a060aed9e0 2024-05-08T06:02:49.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.866+0000 7f85617ffb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a0609a0b20 con 0x55a060ae8600 2024-05-08T06:02:49.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.866+0000 7f85617ffb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55a060af4ed0 con 0x55a060aee300 2024-05-08T06:02:49.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.866+0000 7f85617ffb80 10 client.0 _ll_register_callbacks cb 0x55a0609e1c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:02:49.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.866+0000 7f854fe00700 1 -- 172.21.15.82:0/3340023024 learned_addr learned my addr 172.21.15.82:0/3340023024 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:02:49.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.866+0000 7f8547400700 1 --2- 172.21.15.82:0/3340023024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a060aed9e0 0x55a060af1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:49.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.866+0000 7f854fe00700 1 -- 172.21.15.82:0/3340023024 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a060aee300 msgr2=0x55a060af1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:02:49.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.866+0000 7f854fe00700 1 --2- 172.21.15.82:0/3340023024 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a060aee300 0x55a060af1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:49.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.866+0000 7f854fe00700 1 -- 172.21.15.82:0/3340023024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a060aed9e0 msgr2=0x55a060af1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:02:49.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.867+0000 7f854fe00700 1 --2- 172.21.15.82:0/3340023024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a060aed9e0 0x55a060af1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:49.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.867+0000 7f854fe00700 1 -- 172.21.15.82:0/3340023024 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a060a00420 con 0x55a060ae8600 2024-05-08T06:02:49.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.867+0000 7f8547400700 1 --2- 172.21.15.82:0/3340023024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a060aed9e0 0x55a060af1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:02:49.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.869+0000 7f854fe00700 1 --2- 172.21.15.82:0/3340023024 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a060ae8600 0x55a060af3f60 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8538003900 tx=0x7f853800bdc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7a312c127bf8c0e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:02:49.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.869+0000 7f853e000700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T06:02:49.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.869+0000 7f853e000700 1 -- 172.21.15.82:0/3340023024 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8538005240 con 0x55a060ae8600 2024-05-08T06:02:49.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.869+0000 7f853e000700 1 -- 172.21.15.82:0/3340023024 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f85380053e0 con 0x55a060ae8600 2024-05-08T06:02:49.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.869+0000 7f85617ffb80 1 -- 172.21.15.82:0/3340023024 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8538003d00 con 0x55a060ae8600 2024-05-08T06:02:49.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.870+0000 7f853e000700 1 -- 172.21.15.82:0/3340023024 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f85380055e0 con 0x55a060ae8600 2024-05-08T06:02:49.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.870+0000 7f85617ffb80 10 client.26504 fetch_fsmap learned FSMap version 31 2024-05-08T06:02:49.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.870+0000 7f85617ffb80 1 -- 172.21.15.82:0/3340023024 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a060aff540 con 0x55a060ae8600 2024-05-08T06:02:49.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.871+0000 7f853e000700 1 -- 172.21.15.82:0/3340023024 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8538003d00 con 0x55a060ae8600 2024-05-08T06:02:49.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.871+0000 7f853e000700 1 -- 172.21.15.82:0/3340023024 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f8538043070 con 0x55a060ae8600 2024-05-08T06:02:49.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.871+0000 7f85617ffb80 10 client.26504 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:02:49.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.871+0000 7f85617ffb80 10 client.26504 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T06:02:49.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.871+0000 7f85617ffb80 20 client.26504 populate_metadata read hostname 'smithi082' 2024-05-08T06:02:49.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.871+0000 7f85617ffb80 1 --2- 172.21.15.82:0/3340023024 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55a060b01a10 0x55a060b03e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:49.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.871+0000 7f85617ffb80 4 client.26504 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:02:49.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.871+0000 7f85617ffb80 1 -- 172.21.15.82:0/3340023024 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a060ab50a0 con 0x55a060b01a10 2024-05-08T06:02:49.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.871+0000 7f8547400700 1 --2- 172.21.15.82:0/3340023024 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55a060b01a10 0x55a060b03e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:49.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.872+0000 7f8547400700 1 --2- 172.21.15.82:0/3340023024 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55a060b01a10 0x55a060b03e00 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7204fc9382e99e7 server_cookie=76c4df2a931d03db in_seq=0 out_seq=0 2024-05-08T06:02:49.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.872+0000 7f853e000700 10 client.26504 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T06:02:49.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.873+0000 7f853e000700 1 -- 172.21.15.82:0/3340023024 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a060ab50a0 con 0x55a060b01a10 2024-05-08T06:02:49.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.873+0000 7f853e000700 10 client.26504 handle_command_reply: tid=0 2024-05-08T06:02:49.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.873+0000 7f85617ffb80 1 client.26504 shutdown 2024-05-08T06:02:49.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.875+0000 7f85617ffb80 1 -- 172.21.15.82:0/3340023024 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a060ae8600 msgr2=0x55a060af3f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:02:49.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.875+0000 7f85617ffb80 1 --2- 172.21.15.82:0/3340023024 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a060ae8600 0x55a060af3f60 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8538003900 tx=0x7f853800bdc0 comp rx=0 tx=0).stop 2024-05-08T06:02:49.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.877+0000 7f85617ffb80 1 -- 172.21.15.82:0/3340023024 shutdown_connections 2024-05-08T06:02:49.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.877+0000 7f85617ffb80 1 --2- 172.21.15.82:0/3340023024 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55a060b01a10 0x55a060b03e00 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:49.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.877+0000 7f85617ffb80 1 --2- 172.21.15.82:0/3340023024 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a060ae8600 0x55a060af3f60 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:49.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.877+0000 7f85617ffb80 1 --2- 172.21.15.82:0/3340023024 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a060aee300 0x55a060af1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:49.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.877+0000 7f85617ffb80 1 --2- 172.21.15.82:0/3340023024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a060aed9e0 0x55a060af1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:49.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.877+0000 7f85617ffb80 1 -- 172.21.15.82:0/3340023024 >> 172.21.15.82:0/3340023024 conn(0x55a060a16b60 msgr2=0x55a060add460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:02:49.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.877+0000 7f853e000700 0 client.26504 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T06:02:49.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.877+0000 7f85617ffb80 1 -- 172.21.15.82:0/3340023024 shutdown_connections 2024-05-08T06:02:49.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.877+0000 7f85617ffb80 1 -- 172.21.15.82:0/3340023024 wait complete. 2024-05-08T06:02:49.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.878+0000 7f85617ffb80 20 client.26504 trim_cache size 0 max 16384 2024-05-08T06:02:49.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.915+0000 7f85617ffb80 1 Processor -- start 2024-05-08T06:02:49.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.916+0000 7f85617ffb80 1 -- start start 2024-05-08T06:02:49.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.916+0000 7f85617ffb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a060ae8600 0x55a060ae7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:49.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.916+0000 7f85617ffb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a060aed9e0 0x55a060aee7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:49.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.916+0000 7f85617ffb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a060aee300 0x55a060aeece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:49.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.916+0000 7f85617ffb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f852c00d4d0 con 0x55a060aee300 2024-05-08T06:02:49.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.916+0000 7f85617ffb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f852c00f010 con 0x55a060aed9e0 2024-05-08T06:02:49.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.916+0000 7f85617ffb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f852c00dba0 con 0x55a060ae8600 2024-05-08T06:02:49.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.916+0000 7f8547400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a060aed9e0 0x55a060aee7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:49.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.916+0000 7f854fe00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a060ae8600 0x55a060ae7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:49.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.916+0000 7f854fe00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a060ae8600 0x55a060ae7fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:43066/0 (socket says 172.21.15.82:43066) 2024-05-08T06:02:49.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.916+0000 7f854fe00700 1 -- 172.21.15.82:0/3982013145 learned_addr learned my addr 172.21.15.82:0/3982013145 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:02:49.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.916+0000 7f8547400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a060aed9e0 0x55a060aee7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:50226/0 (socket says 172.21.15.82:50226) 2024-05-08T06:02:49.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.917+0000 7f8554e00700 1 --2- 172.21.15.82:0/3982013145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a060aee300 0x55a060aeece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:49.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.917+0000 7f854fe00700 1 -- 172.21.15.82:0/3982013145 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a060aed9e0 msgr2=0x55a060aee7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:02:49.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.917+0000 7f854fe00700 1 --2- 172.21.15.82:0/3982013145 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a060aed9e0 0x55a060aee7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:49.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.917+0000 7f854fe00700 1 -- 172.21.15.82:0/3982013145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a060aee300 msgr2=0x55a060aeece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:02:49.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.917+0000 7f854fe00700 1 --2- 172.21.15.82:0/3982013145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a060aee300 0x55a060aeece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:49.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.917+0000 7f854fe00700 1 -- 172.21.15.82:0/3982013145 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a060af4f20 con 0x55a060ae8600 2024-05-08T06:02:49.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.917+0000 7f8547400700 1 --2- 172.21.15.82:0/3982013145 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a060aed9e0 0x55a060aee7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:02:49.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.917+0000 7f854fe00700 1 --2- 172.21.15.82:0/3982013145 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a060ae8600 0x55a060ae7fe0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f853800a010 tx=0x7f85380096a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59bda3a77b916791 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:02:49.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.918+0000 7f8544c00700 1 -- 172.21.15.82:0/3982013145 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8538003ce0 con 0x55a060ae8600 2024-05-08T06:02:49.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.918+0000 7f8544c00700 1 -- 172.21.15.82:0/3982013145 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8538045830 con 0x55a060ae8600 2024-05-08T06:02:49.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.918+0000 7f8544c00700 1 -- 172.21.15.82:0/3982013145 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f853800f6c0 con 0x55a060ae8600 2024-05-08T06:02:49.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.918+0000 7f85617ffb80 1 -- 172.21.15.82:0/3982013145 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a060ae8600 msgr2=0x55a060ae7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:02:49.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.918+0000 7f85617ffb80 1 --2- 172.21.15.82:0/3982013145 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a060ae8600 0x55a060ae7fe0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f853800a010 tx=0x7f85380096a0 comp rx=0 tx=0).stop 2024-05-08T06:02:49.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.920+0000 7f85617ffb80 1 -- 172.21.15.82:0/3982013145 shutdown_connections 2024-05-08T06:02:49.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.920+0000 7f85617ffb80 1 --2- 172.21.15.82:0/3982013145 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a060aee300 0x55a060aeece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:49.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.920+0000 7f85617ffb80 1 --2- 172.21.15.82:0/3982013145 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a060ae8600 0x55a060ae7fe0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:49.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.920+0000 7f85617ffb80 1 --2- 172.21.15.82:0/3982013145 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a060aed9e0 0x55a060aee7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:49.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.920+0000 7f85617ffb80 1 -- 172.21.15.82:0/3982013145 >> 172.21.15.82:0/3982013145 conn(0x55a060a16b60 msgr2=0x55a060aefbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:02:49.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.920+0000 7f85617ffb80 1 -- 172.21.15.82:0/3982013145 shutdown_connections 2024-05-08T06:02:49.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.920+0000 7f85617ffb80 1 -- 172.21.15.82:0/3982013145 wait complete. 2024-05-08T06:02:49.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.921+0000 7f85617ffb80 1 -- start start 2024-05-08T06:02:49.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.921+0000 7f85617ffb80 1 Processor -- start 2024-05-08T06:02:49.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.922+0000 7f85617ffb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a060ae8600 0x55a060b06e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:49.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.922+0000 7f85617ffb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a060aed9e0 0x55a060b041f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:49.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.922+0000 7f85617ffb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a060aee300 0x55a060b04730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:49.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.922+0000 7f85617ffb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f852c00e940 con 0x55a060ae8600 2024-05-08T06:02:49.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.922+0000 7f85617ffb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f852c00e270 con 0x55a060aee300 2024-05-08T06:02:49.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.922+0000 7f85617ffb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f852c00b470 con 0x55a060aed9e0 2024-05-08T06:02:49.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.922+0000 7f85617ffb80 10 client.0 _ll_register_callbacks cb 0x55a0609e1c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:02:49.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.922+0000 7f854fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a060ae8600 0x55a060b06e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:49.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.922+0000 7f8554e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a060aee300 0x55a060b04730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:49.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.922+0000 7f854fe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a060ae8600 0x55a060b06e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44534/0 (socket says 172.21.15.82:44534) 2024-05-08T06:02:49.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.922+0000 7f854fe00700 1 -- 172.21.15.82:0/2874311775 learned_addr learned my addr 172.21.15.82:0/2874311775 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:02:49.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.923+0000 7f8547400700 1 --2- 172.21.15.82:0/2874311775 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a060aed9e0 0x55a060b041f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:49.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.923+0000 7f854fe00700 1 -- 172.21.15.82:0/2874311775 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a060aed9e0 msgr2=0x55a060b041f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:02:49.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.923+0000 7f854fe00700 1 --2- 172.21.15.82:0/2874311775 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a060aed9e0 0x55a060b041f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:49.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.923+0000 7f854fe00700 1 -- 172.21.15.82:0/2874311775 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a060aee300 msgr2=0x55a060b04730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:02:49.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.923+0000 7f854fe00700 1 --2- 172.21.15.82:0/2874311775 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a060aee300 0x55a060b04730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:49.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.923+0000 7f854fe00700 1 -- 172.21.15.82:0/2874311775 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a060b04e00 con 0x55a060ae8600 2024-05-08T06:02:49.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.923+0000 7f854fe00700 1 --2- 172.21.15.82:0/2874311775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a060ae8600 0x55a060b06e50 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8538003900 tx=0x7f8538009710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd257d797c0ed48a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:02:49.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.923+0000 7f853e000700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T06:02:49.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.924+0000 7f853e000700 1 -- 172.21.15.82:0/2874311775 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8538045b50 con 0x55a060ae8600 2024-05-08T06:02:49.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.924+0000 7f853e000700 1 -- 172.21.15.82:0/2874311775 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f8538045cf0 con 0x55a060ae8600 2024-05-08T06:02:49.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.924+0000 7f85617ffb80 1 -- 172.21.15.82:0/2874311775 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8538045830 con 0x55a060ae8600 2024-05-08T06:02:49.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.924+0000 7f853e000700 1 -- 172.21.15.82:0/2874311775 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f853800f460 con 0x55a060ae8600 2024-05-08T06:02:49.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.924+0000 7f85617ffb80 10 client.16071 fetch_fsmap learned FSMap version 31 2024-05-08T06:02:49.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.924+0000 7f85617ffb80 1 -- 172.21.15.82:0/2874311775 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a060b6be30 con 0x55a060ae8600 2024-05-08T06:02:49.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.925+0000 7f853e000700 1 -- 172.21.15.82:0/2874311775 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8538045830 con 0x55a060ae8600 2024-05-08T06:02:49.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.925+0000 7f853e000700 1 -- 172.21.15.82:0/2874311775 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f8538043040 con 0x55a060ae8600 2024-05-08T06:02:49.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.925+0000 7f85617ffb80 10 client.16071 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:02:49.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.925+0000 7f85617ffb80 10 client.16071 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T06:02:49.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.925+0000 7f85617ffb80 20 client.16071 populate_metadata read hostname 'smithi082' 2024-05-08T06:02:49.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.925+0000 7f85617ffb80 1 --2- 172.21.15.82:0/2874311775 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55a060b6c240 0x55a060b6e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:49.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.925+0000 7f85617ffb80 4 client.16071 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-08T06:02:49.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.925+0000 7f85617ffb80 1 -- 172.21.15.82:0/2874311775 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a060a48400 con 0x55a060b6c240 2024-05-08T06:02:49.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.926+0000 7f8547400700 1 --2- 172.21.15.82:0/2874311775 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55a060b6c240 0x55a060b6e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:49.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.926+0000 7f8547400700 1 --2- 172.21.15.82:0/2874311775 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55a060b6c240 0x55a060b6e630 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f2cd29592b919ff server_cookie=75bc7e5cfd27dee5 in_seq=0 out_seq=0 2024-05-08T06:02:49.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.926+0000 7f853e000700 10 client.16071 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T06:02:49.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.926+0000 7f853e000700 1 -- 172.21.15.82:0/2874311775 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55a060a48400 con 0x55a060b6c240 2024-05-08T06:02:49.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.926+0000 7f853e000700 10 client.16071 handle_command_reply: tid=0 2024-05-08T06:02:49.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.927+0000 7f85617ffb80 1 client.16071 shutdown 2024-05-08T06:02:49.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.927+0000 7f85617ffb80 1 -- 172.21.15.82:0/2874311775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a060ae8600 msgr2=0x55a060b06e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:02:49.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.927+0000 7f85617ffb80 1 --2- 172.21.15.82:0/2874311775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a060ae8600 0x55a060b06e50 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8538003900 tx=0x7f8538009710 comp rx=0 tx=0).stop 2024-05-08T06:02:49.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.927+0000 7f85617ffb80 1 -- 172.21.15.82:0/2874311775 shutdown_connections 2024-05-08T06:02:49.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.927+0000 7f85617ffb80 1 --2- 172.21.15.82:0/2874311775 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55a060b6c240 0x55a060b6e630 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:49.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.927+0000 7f85617ffb80 1 --2- 172.21.15.82:0/2874311775 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a060aee300 0x55a060b04730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:49.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.927+0000 7f85617ffb80 1 --2- 172.21.15.82:0/2874311775 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a060ae8600 0x55a060b06e50 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:49.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.927+0000 7f85617ffb80 1 --2- 172.21.15.82:0/2874311775 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a060aed9e0 0x55a060b041f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:49.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.927+0000 7f85617ffb80 1 -- 172.21.15.82:0/2874311775 >> 172.21.15.82:0/2874311775 conn(0x55a060a16b60 msgr2=0x55a060adcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:02:49.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.927+0000 7f853e000700 0 client.16071 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T06:02:49.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.927+0000 7f85617ffb80 1 -- 172.21.15.82:0/2874311775 shutdown_connections 2024-05-08T06:02:49.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.927+0000 7f85617ffb80 1 -- 172.21.15.82:0/2874311775 wait complete. 2024-05-08T06:02:49.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.928+0000 7f85617ffb80 20 client.16071 trim_cache size 0 max 16384 2024-05-08T06:02:49.095 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T06:02:49.095 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "no active scrubs running", 2024-05-08T06:02:49.096 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": {} 2024-05-08T06:02:49.096 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T06:02:49.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.929+0000 7f8555800700 1 -- 172.21.15.82:0/663933516 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f85340b2790 msgr2=0x7f85340b4c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:02:49.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.929+0000 7f8555800700 1 --2- 172.21.15.82:0/663933516 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f85340b2790 0x7f85340b4c50 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f854800a7d0 tx=0x7f8548009650 comp rx=0 tx=0).stop 2024-05-08T06:02:49.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.929+0000 7f8555800700 1 -- 172.21.15.82:0/663933516 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f855010adc0 msgr2=0x7f85501a9340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:02:49.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.929+0000 7f8555800700 1 --2- 172.21.15.82:0/663933516 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f855010adc0 0x7f85501a9340 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f854000d950 tx=0x7f854000dc60 comp rx=0 tx=0).stop 2024-05-08T06:02:49.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.929+0000 7f8555800700 1 -- 172.21.15.82:0/663933516 shutdown_connections 2024-05-08T06:02:49.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.929+0000 7f8555800700 1 --2- 172.21.15.82:0/663933516 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f85340b2790 0x7f85340b4c50 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:49.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.929+0000 7f8555800700 1 --2- 172.21.15.82:0/663933516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85501165f0 0x7f85501151d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:49.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.929+0000 7f8555800700 1 --2- 172.21.15.82:0/663933516 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f855010a4a0 0x7f85501a8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:49.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.929+0000 7f8555800700 1 --2- 172.21.15.82:0/663933516 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f855010adc0 0x7f85501a9340 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:49.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.929+0000 7f8555800700 1 -- 172.21.15.82:0/663933516 >> 172.21.15.82:0/663933516 conn(0x7f855006e480 msgr2=0x7f8550073070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:02:49.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.930+0000 7f8555800700 1 -- 172.21.15.82:0/663933516 shutdown_connections 2024-05-08T06:02:49.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:48.930+0000 7f8555800700 1 -- 172.21.15.82:0/663933516 wait complete. 2024-05-08T06:02:49.802 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-08T06:02:49.802 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T06:02:50.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:02:49 smithi082 ceph-mon[30098]: pgmap v824: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.3 MiB/s wr, 568 op/s 2024-05-08T06:02:50.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:02:49 smithi134 ceph-mon[34132]: pgmap v824: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.3 MiB/s wr, 568 op/s 2024-05-08T06:02:50.267 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 720.0 s, 1207.6 tps, lat 82.820 ms stddev 98.084 2024-05-08T06:02:50.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:02:49 smithi151 ceph-mon[34815]: pgmap v824: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.3 MiB/s wr, 568 op/s 2024-05-08T06:02:50.479 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:02:52.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:02:51 smithi082 ceph-mon[30098]: pgmap v825: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.5 MiB/s wr, 692 op/s 2024-05-08T06:02:52.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:02:51 smithi134 ceph-mon[34132]: pgmap v825: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.5 MiB/s wr, 692 op/s 2024-05-08T06:02:52.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:02:51 smithi151 ceph-mon[34815]: pgmap v825: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.5 MiB/s wr, 692 op/s 2024-05-08T06:02:53.054 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:02:52 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:02:53.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:02:52 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:02:53.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:53.295+0000 7f7591200700 1 -- 172.21.15.82:0/1541074001 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f758c103ef0 msgr2=0x7f758c1103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:02:53.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:53.295+0000 7f7591200700 1 --2- 172.21.15.82:0/1541074001 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f758c103ef0 0x7f758c1103d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7584009f90 tx=0x7f758400b330 comp rx=0 tx=0).stop 2024-05-08T06:02:53.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:53.295+0000 7f7591200700 1 -- 172.21.15.82:0/1541074001 shutdown_connections 2024-05-08T06:02:53.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:53.295+0000 7f7591200700 1 --2- 172.21.15.82:0/1541074001 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f758c108460 0x7f758c108840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:53.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:53.295+0000 7f7591200700 1 --2- 172.21.15.82:0/1541074001 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f758c103ef0 0x7f758c1103d0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:53.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:53.295+0000 7f7591200700 1 --2- 172.21.15.82:0/1541074001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f758c103550 0x7f758c1039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:53.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:53.295+0000 7f7591200700 1 -- 172.21.15.82:0/1541074001 >> 172.21.15.82:0/1541074001 conn(0x7f758c07a600 msgr2=0x7f758c07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:02:53.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:53.295+0000 7f7591200700 1 -- 172.21.15.82:0/1541074001 shutdown_connections 2024-05-08T06:02:53.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:53.295+0000 7f7591200700 1 -- 172.21.15.82:0/1541074001 wait complete. 2024-05-08T06:02:53.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:53.297+0000 7f7591200700 1 Processor -- start 2024-05-08T06:02:53.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:53.297+0000 7f7591200700 1 -- start start 2024-05-08T06:02:53.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:53.298+0000 7f7591200700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f758c103550 0x7f758c19beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:53.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:53.298+0000 7f7591200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f758c103ef0 0x7f758c19c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:53.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:53.298+0000 7f7591200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f758c108460 0x7f758c1a0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:53.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:53.298+0000 7f7591200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f758c113750 con 0x7f758c108460 2024-05-08T06:02:53.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:53.298+0000 7f7591200700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f758c1135d0 con 0x7f758c103ef0 2024-05-08T06:02:53.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:53.298+0000 7f7591200700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f758c1138d0 con 0x7f758c103550 2024-05-08T06:02:53.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:53.299+0000 7f7589e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f758c103550 0x7f758c19beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:53.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:53.299+0000 7f7589e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f758c103550 0x7f758c19beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:36432/0 (socket says 172.21.15.82:36432) 2024-05-08T06:02:53.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:53.299+0000 7f7589e00700 1 -- 172.21.15.82:0/3737341843 learned_addr learned my addr 172.21.15.82:0/3737341843 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:02:53.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:53.299+0000 7f7589400700 1 --2- 172.21.15.82:0/3737341843 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f758c103ef0 0x7f758c19c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:53.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:53.300+0000 7f758a800700 1 --2- 172.21.15.82:0/3737341843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f758c108460 0x7f758c1a0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:53.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:53.300+0000 7f7589e00700 1 -- 172.21.15.82:0/3737341843 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f758c103ef0 msgr2=0x7f758c19c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:02:53.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:53.300+0000 7f7589e00700 1 --2- 172.21.15.82:0/3737341843 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f758c103ef0 0x7f758c19c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:53.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:53.300+0000 7f7589e00700 1 -- 172.21.15.82:0/3737341843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f758c108460 msgr2=0x7f758c1a0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:02:53.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:53.300+0000 7f7589e00700 1 --2- 172.21.15.82:0/3737341843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f758c108460 0x7f758c1a0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:53.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:53.300+0000 7f7589e00700 1 -- 172.21.15.82:0/3737341843 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f758c1a0ec0 con 0x7f758c103550 2024-05-08T06:02:53.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:53.301+0000 7f7589e00700 1 --2- 172.21.15.82:0/3737341843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f758c103550 0x7f758c19beb0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f757c00e9f0 tx=0x7f757c00ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:02:53.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:53.302+0000 7f7582a00700 1 -- 172.21.15.82:0/3737341843 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f757c004220 con 0x7f758c103550 2024-05-08T06:02:53.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:53.302+0000 7f7582a00700 1 -- 172.21.15.82:0/3737341843 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f757c0043c0 con 0x7f758c103550 2024-05-08T06:02:53.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:53.302+0000 7f7582a00700 1 -- 172.21.15.82:0/3737341843 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f757c003ce0 con 0x7f758c103550 2024-05-08T06:02:53.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:53.302+0000 7f7591200700 1 -- 172.21.15.82:0/3737341843 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f758c1a11b0 con 0x7f758c103550 2024-05-08T06:02:53.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:53.302+0000 7f7591200700 1 -- 172.21.15.82:0/3737341843 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f758c1a8a30 con 0x7f758c103550 2024-05-08T06:02:53.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:53.304+0000 7f7591200700 1 -- 172.21.15.82:0/3737341843 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f756c005330 con 0x7f758c103550 2024-05-08T06:02:53.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:53.310+0000 7f7582a00700 1 -- 172.21.15.82:0/3737341843 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f757c00c7c0 con 0x7f758c103550 2024-05-08T06:02:53.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:53.314+0000 7f7582a00700 1 --2- 172.21.15.82:0/3737341843 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f75700b2900 0x7f75700b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:53.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:53.315+0000 7f7582a00700 1 -- 172.21.15.82:0/3737341843 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f757c0e24d0 con 0x7f758c103550 2024-05-08T06:02:53.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:53.316+0000 7f7589400700 1 --2- 172.21.15.82:0/3737341843 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f75700b2900 0x7f75700b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:53.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:53.319+0000 7f7589400700 1 --2- 172.21.15.82:0/3737341843 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f75700b2900 0x7f75700b4dc0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f758c1033f0 tx=0x7f7578009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:02:53.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:53.319+0000 7f7582a00700 1 -- 172.21.15.82:0/3737341843 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f757c0aa200 con 0x7f758c103550 2024-05-08T06:02:53.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:02:52 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:02:53.837 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:53.837+0000 7f7591200700 1 -- 172.21.15.82:0/3737341843 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f756c005620 con 0x7f758c103550 2024-05-08T06:02:53.838 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:53.839+0000 7f7582a00700 1 -- 172.21.15.82:0/3737341843 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11948 (secure 0 0 0) 0x7f757c0a9b00 con 0x7f758c103550 2024-05-08T06:02:53.839 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T06:02:53.839 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14364,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3876883250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3876883250},{"type":"v1","addr":"172.21.15.82:6835","nonce":3876883250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1965070586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1965070586},{"type":"v1","addr":"172.21.15.82:6837","nonce":1965070586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":31,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T05:45:57.654009+0000","modified":"2024-05-08T05:53:20.165672+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24505,"mds_2":24487,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14397":{"gid":14397,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/1890720973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1890720973},{"type":"v1","addr":"172.21.15.82:6839","nonce":1890720973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14409":{"gid":14409,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/2957083305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":2957083305},{"type":"v1","addr":"172.21.15.82:6841","nonce":2957083305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6833/3827691638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3827691638},{"type":"v1","addr":"172.21.15.134:6833","nonce":3827691638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6833/3625067797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3625067797},{"type":"v1","addr":"172.21.15.151:6833","nonce":3625067797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/4074163402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4074163402},{"type":"v1","addr":"172.21.15.134:6835","nonce":4074163402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.134:6837/2212411710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2212411710},{"type":"v1","addr":"172.21.15.134:6837","nonce":2212411710}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":17,"addr":"172.21.15.151:6835/2093655929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2093655929},{"type":"v1","addr":"172.21.15.151:6835","nonce":2093655929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6837/4192404464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":4192404464},{"type":"v1","addr":"172.21.15.151:6837","nonce":4192404464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":14,"addr":"172.21.15.151:6839/2963754236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":2963754236},{"type":"v1","addr":"172.21.15.151:6839","nonce":2963754236}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.134:6839/1145270893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1145270893},{"type":"v1","addr":"172.21.15.134:6839","nonce":1145270893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24505,24506,24487,24475,24467]},"id":1}]} 2024-05-08T06:02:53.843 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:53.843+0000 7f7591200700 1 -- 172.21.15.82:0/3737341843 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f75700b2900 msgr2=0x7f75700b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:02:53.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:53.843+0000 7f7591200700 1 --2- 172.21.15.82:0/3737341843 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f75700b2900 0x7f75700b4dc0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f758c1033f0 tx=0x7f7578009190 comp rx=0 tx=0).stop 2024-05-08T06:02:53.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:53.843+0000 7f7591200700 1 -- 172.21.15.82:0/3737341843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f758c103550 msgr2=0x7f758c19beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:02:53.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:53.843+0000 7f7591200700 1 --2- 172.21.15.82:0/3737341843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f758c103550 0x7f758c19beb0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f757c00e9f0 tx=0x7f757c00ed00 comp rx=0 tx=0).stop 2024-05-08T06:02:53.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:53.844+0000 7f7591200700 1 -- 172.21.15.82:0/3737341843 shutdown_connections 2024-05-08T06:02:53.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:53.844+0000 7f7591200700 1 --2- 172.21.15.82:0/3737341843 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f75700b2900 0x7f75700b4dc0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:53.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:53.844+0000 7f7591200700 1 --2- 172.21.15.82:0/3737341843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f758c108460 0x7f758c1a0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:53.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:53.844+0000 7f7591200700 1 --2- 172.21.15.82:0/3737341843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f758c103550 0x7f758c19beb0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:53.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:53.844+0000 7f7591200700 1 --2- 172.21.15.82:0/3737341843 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f758c103ef0 0x7f758c19c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:53.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:53.844+0000 7f7591200700 1 -- 172.21.15.82:0/3737341843 >> 172.21.15.82:0/3737341843 conn(0x7f758c07a600 msgr2=0x7f758c1013c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:02:53.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:53.844+0000 7f7591200700 1 -- 172.21.15.82:0/3737341843 shutdown_connections 2024-05-08T06:02:53.844 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:53.844+0000 7f7591200700 1 -- 172.21.15.82:0/3737341843 wait complete. 2024-05-08T06:02:53.846 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 31 2024-05-08T06:02:54.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:02:53 smithi082 ceph-mon[30098]: pgmap v826: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.3 MiB/s wr, 591 op/s 2024-05-08T06:02:54.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:02:53 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/3737341843' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:02:54.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:02:53 smithi134 ceph-mon[34132]: pgmap v826: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.3 MiB/s wr, 591 op/s 2024-05-08T06:02:54.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:02:53 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/3737341843' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:02:54.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:02:53 smithi151 ceph-mon[34815]: pgmap v826: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.3 MiB/s wr, 591 op/s 2024-05-08T06:02:54.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:02:53 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/3737341843' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:02:54.698 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-05-08T06:02:55.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:02:54 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:02:55.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:02:54 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:02:55.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:02:54 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T06:02:55.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:02:54 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:02:55.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:02:54 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:02:55.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:02:54 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T06:02:55.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 725.0 s, 1874.8 tps, lat 53.224 ms stddev 69.654 2024-05-08T06:02:55.296 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:02:55.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:02:54 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:02:55.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:02:54 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:02:55.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:02:54 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T06:02:56.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:02:55 smithi082 ceph-mon[30098]: pgmap v827: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.1 MiB/s wr, 571 op/s 2024-05-08T06:02:56.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:02:55 smithi134 ceph-mon[34132]: pgmap v827: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.1 MiB/s wr, 571 op/s 2024-05-08T06:02:56.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:02:55 smithi151 ceph-mon[34815]: pgmap v827: 97 pgs: 97 active+clean; 1.6 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 5.1 MiB/s wr, 571 op/s 2024-05-08T06:02:57.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.566+0000 7fb07e800700 1 -- 172.21.15.82:0/4220635157 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb078108410 msgr2=0x7fb0781087f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:02:57.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.566+0000 7fb07e800700 1 --2- 172.21.15.82:0/4220635157 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb078108410 0x7fb0781087f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fb068009990 tx=0x7fb068009ca0 comp rx=0 tx=0).stop 2024-05-08T06:02:57.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.566+0000 7fb07e800700 1 -- 172.21.15.82:0/4220635157 shutdown_connections 2024-05-08T06:02:57.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.566+0000 7fb07e800700 1 --2- 172.21.15.82:0/4220635157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb078102d60 0x7fb07810f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:57.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.566+0000 7fb07e800700 1 --2- 172.21.15.82:0/4220635157 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb078108410 0x7fb0781087f0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:57.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.566+0000 7fb07e800700 1 --2- 172.21.15.82:0/4220635157 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0781023a0 0x7fb078102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:57.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.566+0000 7fb07e800700 1 -- 172.21.15.82:0/4220635157 >> 172.21.15.82:0/4220635157 conn(0x7fb078079350 msgr2=0x7fb078079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:02:57.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.566+0000 7fb07e800700 1 -- 172.21.15.82:0/4220635157 shutdown_connections 2024-05-08T06:02:57.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.567+0000 7fb07e800700 1 -- 172.21.15.82:0/4220635157 wait complete. 2024-05-08T06:02:57.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.568+0000 7fb07e800700 1 Processor -- start 2024-05-08T06:02:57.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.568+0000 7fb07e800700 1 -- start start 2024-05-08T06:02:57.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.569+0000 7fb07e800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0781023a0 0x7fb07810a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:57.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.569+0000 7fb07e800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb078102d60 0x7fb07810ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:57.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.569+0000 7fb07e800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb078108410 0x7fb0781abfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:57.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.570+0000 7fb077400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0781023a0 0x7fb07810a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:57.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.570+0000 7fb07e800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb0781115d0 con 0x7fb078108410 2024-05-08T06:02:57.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.570+0000 7fb077400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0781023a0 0x7fb07810a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:36446/0 (socket says 172.21.15.82:36446) 2024-05-08T06:02:57.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.570+0000 7fb077400700 1 -- 172.21.15.82:0/1263790193 learned_addr learned my addr 172.21.15.82:0/1263790193 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:02:57.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.570+0000 7fb07e800700 1 -- 172.21.15.82:0/1263790193 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb078111450 con 0x7fb078102d60 2024-05-08T06:02:57.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.570+0000 7fb07e800700 1 -- 172.21.15.82:0/1263790193 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb078111750 con 0x7fb0781023a0 2024-05-08T06:02:57.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.570+0000 7fb077400700 1 -- 172.21.15.82:0/1263790193 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb078102d60 msgr2=0x7fb07810ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:02:57.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.570+0000 7fb077400700 1 --2- 172.21.15.82:0/1263790193 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb078102d60 0x7fb07810ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:57.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.570+0000 7fb077400700 1 -- 172.21.15.82:0/1263790193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb078108410 msgr2=0x7fb0781abfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:02:57.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.570+0000 7fb077400700 1 --2- 172.21.15.82:0/1263790193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb078108410 0x7fb0781abfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:57.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.570+0000 7fb077400700 1 -- 172.21.15.82:0/1263790193 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0781ac510 con 0x7fb0781023a0 2024-05-08T06:02:57.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.571+0000 7fb077400700 1 --2- 172.21.15.82:0/1263790193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0781023a0 0x7fb07810a7e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb068009f70 tx=0x7fb068005640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:02:57.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.571+0000 7fb06fe00700 1 -- 172.21.15.82:0/1263790193 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb068026070 con 0x7fb0781023a0 2024-05-08T06:02:57.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.571+0000 7fb07e800700 1 -- 172.21.15.82:0/1263790193 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0781ac740 con 0x7fb0781023a0 2024-05-08T06:02:57.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.571+0000 7fb07e800700 1 -- 172.21.15.82:0/1263790193 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0781acc40 con 0x7fb0781023a0 2024-05-08T06:02:57.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.571+0000 7fb06fe00700 1 -- 172.21.15.82:0/1263790193 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb0680095d0 con 0x7fb0781023a0 2024-05-08T06:02:57.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.572+0000 7fb06fe00700 1 -- 172.21.15.82:0/1263790193 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb068026070 con 0x7fb0781023a0 2024-05-08T06:02:57.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.579+0000 7fb06fe00700 1 -- 172.21.15.82:0/1263790193 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fb068005080 con 0x7fb0781023a0 2024-05-08T06:02:57.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.582+0000 7fb08924bb80 1 Processor -- start 2024-05-08T06:02:57.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.582+0000 7fb08924bb80 1 -- start start 2024-05-08T06:02:57.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.583+0000 7fb08924bb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e60dc5bc0 0x557e60dc5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:57.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.583+0000 7fb08924bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557e60dc64e0 0x557e60dc02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:57.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.583+0000 7fb08924bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e60dc08f0 0x557e60dc0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:57.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.583+0000 7fb08924bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x557e60d12a20 con 0x557e60dc64e0 2024-05-08T06:02:57.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.583+0000 7fb08924bb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x557e60cb0760 con 0x557e60dc5bc0 2024-05-08T06:02:57.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.583+0000 7fb08924bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x557e60d0e9e0 con 0x557e60dc08f0 2024-05-08T06:02:57.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.584+0000 7fb06fe00700 1 --2- 172.21.15.82:0/1263790193 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb05c0b2cc0 0x7fb05c0b5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:57.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.584+0000 7fb076a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e60dc08f0 0x557e60dc0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:57.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.584+0000 7fb076a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e60dc08f0 0x557e60dc0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:36462/0 (socket says 172.21.15.82:36462) 2024-05-08T06:02:57.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.584+0000 7fb076a00700 1 -- 172.21.15.82:0/3384011322 learned_addr learned my addr 172.21.15.82:0/3384011322 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:02:57.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.585+0000 7fb077e00700 1 --2- 172.21.15.82:0/3384011322 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e60dc5bc0 0x557e60dc5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:57.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.586+0000 7fb077e00700 1 --2- 172.21.15.82:0/1263790193 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb05c0b2cc0 0x7fb05c0b5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:57.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.586+0000 7fb076a00700 1 -- 172.21.15.82:0/3384011322 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e60dc5bc0 msgr2=0x557e60dc5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:02:57.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.586+0000 7fb076a00700 1 --2- 172.21.15.82:0/3384011322 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e60dc5bc0 0x557e60dc5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:57.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.586+0000 7fb076a00700 1 -- 172.21.15.82:0/3384011322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557e60dc64e0 msgr2=0x557e60dc02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:02:57.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.586+0000 7fb076a00700 1 --2- 172.21.15.82:0/3384011322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557e60dc64e0 0x557e60dc02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:57.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.586+0000 7fb076a00700 1 -- 172.21.15.82:0/3384011322 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e60c5f8d0 con 0x557e60dc08f0 2024-05-08T06:02:57.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.586+0000 7fb06fe00700 1 -- 172.21.15.82:0/1263790193 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb06801e070 con 0x7fb0781023a0 2024-05-08T06:02:57.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.587+0000 7fb076a00700 1 --2- 172.21.15.82:0/3384011322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e60dc08f0 0x557e60dc0d70 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb060009870 tx=0x7fb060009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=581a20fb566f9c2b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:02:57.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.587+0000 7fb06cc00700 1 -- 172.21.15.82:0/3384011322 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb060015020 con 0x557e60dc08f0 2024-05-08T06:02:57.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.587+0000 7fb06cc00700 1 -- 172.21.15.82:0/3384011322 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb060011ce0 con 0x557e60dc08f0 2024-05-08T06:02:57.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.587+0000 7fb06cc00700 1 -- 172.21.15.82:0/3384011322 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb06000be20 con 0x557e60dc08f0 2024-05-08T06:02:57.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.589+0000 7fb077e00700 1 --2- 172.21.15.82:0/1263790193 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb05c0b2cc0 0x7fb05c0b5180 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb0700091e0 tx=0x7fb070008500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:02:57.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.590+0000 7fb08924bb80 1 -- 172.21.15.82:0/3384011322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e60dc08f0 msgr2=0x557e60dc0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:02:57.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.590+0000 7fb08924bb80 1 --2- 172.21.15.82:0/3384011322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e60dc08f0 0x557e60dc0d70 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fb060009870 tx=0x7fb060009b80 comp rx=0 tx=0).stop 2024-05-08T06:02:57.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.590+0000 7fb08924bb80 1 -- 172.21.15.82:0/3384011322 shutdown_connections 2024-05-08T06:02:57.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.590+0000 7fb08924bb80 1 --2- 172.21.15.82:0/3384011322 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e60dc5bc0 0x557e60dc5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:57.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.590+0000 7fb08924bb80 1 --2- 172.21.15.82:0/3384011322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e60dc08f0 0x557e60dc0d70 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:57.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.590+0000 7fb08924bb80 1 --2- 172.21.15.82:0/3384011322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557e60dc64e0 0x557e60dc02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:57.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.590+0000 7fb08924bb80 1 -- 172.21.15.82:0/3384011322 >> 172.21.15.82:0/3384011322 conn(0x557e60d386d0 msgr2=0x557e60dbab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:02:57.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.591+0000 7fb08924bb80 1 -- 172.21.15.82:0/3384011322 shutdown_connections 2024-05-08T06:02:57.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.591+0000 7fb08924bb80 1 -- 172.21.15.82:0/3384011322 wait complete. 2024-05-08T06:02:57.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.592+0000 7fb08924bb80 1 -- start start 2024-05-08T06:02:57.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.592+0000 7fb08924bb80 1 Processor -- start 2024-05-08T06:02:57.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.593+0000 7fb08924bb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e60dc08f0 0x557e60dcc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:57.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.593+0000 7fb08924bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e60dc5bc0 0x557e60dc9570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:57.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.593+0000 7fb08924bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557e60dc64e0 0x557e60dc9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:57.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.593+0000 7fb08924bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x557e60dccf20 con 0x557e60dc64e0 2024-05-08T06:02:57.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.593+0000 7fb08924bb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x557e60c78b20 con 0x557e60dc08f0 2024-05-08T06:02:57.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.593+0000 7fb08924bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x557e60dcd0a0 con 0x557e60dc5bc0 2024-05-08T06:02:57.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.593+0000 7fb08924bb80 10 client.0 _ll_register_callbacks cb 0x557e60cb9c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:02:57.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.593+0000 7fb077400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e60dc08f0 0x557e60dcc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:57.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.593+0000 7fb077400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e60dc08f0 0x557e60dcc1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:37388/0 (socket says 172.21.15.82:37388) 2024-05-08T06:02:57.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.593+0000 7fb077400700 1 -- 172.21.15.82:0/3780085948 learned_addr learned my addr 172.21.15.82:0/3780085948 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:02:57.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.593+0000 7fb077e00700 1 --2- 172.21.15.82:0/3780085948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557e60dc64e0 0x557e60dc9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:57.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.593+0000 7fb076a00700 1 --2- 172.21.15.82:0/3780085948 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e60dc5bc0 0x557e60dc9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:57.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.594+0000 7fb076a00700 1 -- 172.21.15.82:0/3780085948 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e60dc08f0 msgr2=0x557e60dcc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:02:57.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.594+0000 7fb076a00700 1 --2- 172.21.15.82:0/3780085948 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e60dc08f0 0x557e60dcc1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:57.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.594+0000 7fb076a00700 1 -- 172.21.15.82:0/3780085948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557e60dc64e0 msgr2=0x557e60dc9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:02:57.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.594+0000 7fb076a00700 1 --2- 172.21.15.82:0/3780085948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557e60dc64e0 0x557e60dc9ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:57.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.594+0000 7fb076a00700 1 -- 172.21.15.82:0/3780085948 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e60cd8420 con 0x557e60dc5bc0 2024-05-08T06:02:57.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.594+0000 7fb077e00700 1 --2- 172.21.15.82:0/3780085948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557e60dc64e0 0x557e60dc9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:02:57.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.595+0000 7fb076a00700 1 --2- 172.21.15.82:0/3780085948 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e60dc5bc0 0x557e60dc9570 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb06000b960 tx=0x7fb06000b420 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27bd14123dedaf43 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:02:57.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.595+0000 7fb065600700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T06:02:57.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.596+0000 7fb065600700 1 -- 172.21.15.82:0/3780085948 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb06000be70 con 0x557e60dc5bc0 2024-05-08T06:02:57.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.596+0000 7fb065600700 1 -- 172.21.15.82:0/3780085948 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb060011630 con 0x557e60dc5bc0 2024-05-08T06:02:57.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.597+0000 7fb08924bb80 1 -- 172.21.15.82:0/3780085948 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb060011ce0 con 0x557e60dc5bc0 2024-05-08T06:02:57.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.598+0000 7fb065600700 1 -- 172.21.15.82:0/3780085948 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fb060011850 con 0x557e60dc5bc0 2024-05-08T06:02:57.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.598+0000 7fb08924bb80 10 client.26548 fetch_fsmap learned FSMap version 31 2024-05-08T06:02:57.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.598+0000 7fb08924bb80 1 -- 172.21.15.82:0/3780085948 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x557e60dd7820 con 0x557e60dc5bc0 2024-05-08T06:02:57.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.598+0000 7fb065600700 1 -- 172.21.15.82:0/3780085948 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb060011ce0 con 0x557e60dc5bc0 2024-05-08T06:02:57.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.599+0000 7fb065600700 1 -- 172.21.15.82:0/3780085948 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fb06001a430 con 0x557e60dc5bc0 2024-05-08T06:02:57.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.599+0000 7fb08924bb80 10 client.26548 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:02:57.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.599+0000 7fb08924bb80 10 client.26548 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-05-08T06:02:57.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.600+0000 7fb08924bb80 20 client.26548 populate_metadata read hostname 'smithi082' 2024-05-08T06:02:57.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.600+0000 7fb08924bb80 1 --2- 172.21.15.82:0/3780085948 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x557e60dd9da0 0x557e60ddc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:57.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.600+0000 7fb08924bb80 4 client.26548 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:02:57.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.600+0000 7fb08924bb80 1 -- 172.21.15.82:0/3780085948 --> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557e60d8d140 con 0x557e60dd9da0 2024-05-08T06:02:57.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.600+0000 7fb077400700 1 --2- 172.21.15.82:0/3780085948 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x557e60dd9da0 0x557e60ddc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:57.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.601+0000 7fb077400700 1 --2- 172.21.15.82:0/3780085948 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x557e60dd9da0 0x557e60ddc190 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9185a27cf2c94ff2 server_cookie=fe274a0712411381 in_seq=0 out_seq=0 2024-05-08T06:02:57.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.601+0000 7fb065600700 10 client.26548 ms_handle_connect on v2:172.21.15.134:6836/2212411710 2024-05-08T06:02:57.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.602+0000 7fb065600700 1 -- 172.21.15.82:0/3780085948 <== mds.4 v2:172.21.15.134:6836/2212411710 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557e60d8d140 con 0x557e60dd9da0 2024-05-08T06:02:57.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.602+0000 7fb065600700 10 client.26548 handle_command_reply: tid=0 2024-05-08T06:02:57.602 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.602+0000 7fb08924bb80 1 client.26548 shutdown 2024-05-08T06:02:57.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.603+0000 7fb08924bb80 1 -- 172.21.15.82:0/3780085948 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e60dc5bc0 msgr2=0x557e60dc9570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:02:57.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.603+0000 7fb08924bb80 1 --2- 172.21.15.82:0/3780085948 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e60dc5bc0 0x557e60dc9570 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb06000b960 tx=0x7fb06000b420 comp rx=0 tx=0).stop 2024-05-08T06:02:57.603 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.604+0000 7fb08924bb80 1 -- 172.21.15.82:0/3780085948 shutdown_connections 2024-05-08T06:02:57.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.604+0000 7fb08924bb80 1 --2- 172.21.15.82:0/3780085948 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x557e60dd9da0 0x557e60ddc190 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:57.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.604+0000 7fb065600700 0 client.26548 ms_handle_reset on v2:172.21.15.134:6836/2212411710 2024-05-08T06:02:57.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.604+0000 7fb08924bb80 1 --2- 172.21.15.82:0/3780085948 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e60dc08f0 0x557e60dcc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:57.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.604+0000 7fb08924bb80 1 --2- 172.21.15.82:0/3780085948 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557e60dc64e0 0x557e60dc9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:57.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.604+0000 7fb08924bb80 1 --2- 172.21.15.82:0/3780085948 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e60dc5bc0 0x557e60dc9570 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:57.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.604+0000 7fb08924bb80 1 -- 172.21.15.82:0/3780085948 >> 172.21.15.82:0/3780085948 conn(0x557e60d386d0 msgr2=0x557e60dba190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:02:57.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.605+0000 7fb08924bb80 1 -- 172.21.15.82:0/3780085948 shutdown_connections 2024-05-08T06:02:57.604 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.605+0000 7fb08924bb80 1 -- 172.21.15.82:0/3780085948 wait complete. 2024-05-08T06:02:57.605 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.605+0000 7fb08924bb80 20 client.26548 trim_cache size 0 max 16384 2024-05-08T06:02:57.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.628+0000 7fb08924bb80 1 Processor -- start 2024-05-08T06:02:57.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.629+0000 7fb08924bb80 1 -- start start 2024-05-08T06:02:57.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.629+0000 7fb08924bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557e60dc08f0 0x557e60dc02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:57.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.629+0000 7fb08924bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e60dc5bc0 0x557e60dca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:57.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.629+0000 7fb08924bb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e60dc64e0 0x557e60dd6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:57.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.629+0000 7fb08924bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb05400d320 con 0x557e60dc08f0 2024-05-08T06:02:57.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.629+0000 7fb08924bb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb05400ee60 con 0x557e60dc64e0 2024-05-08T06:02:57.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.629+0000 7fb08924bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb05400d9f0 con 0x557e60dc5bc0 2024-05-08T06:02:57.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.629+0000 7fb077400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557e60dc08f0 0x557e60dc02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:57.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.629+0000 7fb076a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e60dc5bc0 0x557e60dca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:57.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.629+0000 7fb077400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557e60dc08f0 0x557e60dc02d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55160/0 (socket says 172.21.15.82:55160) 2024-05-08T06:02:57.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.629+0000 7fb077400700 1 -- 172.21.15.82:0/2474431540 learned_addr learned my addr 172.21.15.82:0/2474431540 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:02:57.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.630+0000 7fb077e00700 1 --2- 172.21.15.82:0/2474431540 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e60dc64e0 0x557e60dd6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:57.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.630+0000 7fb076a00700 1 -- 172.21.15.82:0/2474431540 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e60dc64e0 msgr2=0x557e60dd6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:02:57.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.630+0000 7fb076a00700 1 --2- 172.21.15.82:0/2474431540 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e60dc64e0 0x557e60dd6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:57.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.630+0000 7fb076a00700 1 -- 172.21.15.82:0/2474431540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557e60dc08f0 msgr2=0x557e60dc02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:02:57.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.630+0000 7fb076a00700 1 --2- 172.21.15.82:0/2474431540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557e60dc08f0 0x557e60dc02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:57.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.630+0000 7fb076a00700 1 -- 172.21.15.82:0/2474431540 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e60dbbcf0 con 0x557e60dc5bc0 2024-05-08T06:02:57.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.630+0000 7fb076a00700 1 --2- 172.21.15.82:0/2474431540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e60dc5bc0 0x557e60dca1c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb060009790 tx=0x7fb06000b990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe8009f0961d09db server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:02:57.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.630+0000 7fb067e00700 1 -- 172.21.15.82:0/2474431540 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb060015040 con 0x557e60dc5bc0 2024-05-08T06:02:57.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.631+0000 7fb067e00700 1 -- 172.21.15.82:0/2474431540 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb06001f070 con 0x557e60dc5bc0 2024-05-08T06:02:57.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.631+0000 7fb067e00700 1 -- 172.21.15.82:0/2474431540 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb06001a430 con 0x557e60dc5bc0 2024-05-08T06:02:57.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.632+0000 7fb08924bb80 1 -- 172.21.15.82:0/2474431540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e60dc5bc0 msgr2=0x557e60dca1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:02:57.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.632+0000 7fb08924bb80 1 --2- 172.21.15.82:0/2474431540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e60dc5bc0 0x557e60dca1c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fb060009790 tx=0x7fb06000b990 comp rx=0 tx=0).stop 2024-05-08T06:02:57.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.633+0000 7fb08924bb80 1 -- 172.21.15.82:0/2474431540 shutdown_connections 2024-05-08T06:02:57.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.633+0000 7fb08924bb80 1 --2- 172.21.15.82:0/2474431540 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e60dc64e0 0x557e60dd6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:57.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.633+0000 7fb08924bb80 1 --2- 172.21.15.82:0/2474431540 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557e60dc08f0 0x557e60dc02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:57.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.633+0000 7fb08924bb80 1 --2- 172.21.15.82:0/2474431540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e60dc5bc0 0x557e60dca1c0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:57.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.633+0000 7fb08924bb80 1 -- 172.21.15.82:0/2474431540 >> 172.21.15.82:0/2474431540 conn(0x557e60d386d0 msgr2=0x557e60dc68c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:02:57.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.633+0000 7fb08924bb80 1 -- 172.21.15.82:0/2474431540 shutdown_connections 2024-05-08T06:02:57.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.634+0000 7fb08924bb80 1 -- 172.21.15.82:0/2474431540 wait complete. 2024-05-08T06:02:57.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.634+0000 7fb08924bb80 1 -- start start 2024-05-08T06:02:57.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.635+0000 7fb08924bb80 1 Processor -- start 2024-05-08T06:02:57.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.636+0000 7fb08924bb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e60dc08f0 0x557e60de1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:57.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.636+0000 7fb08924bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557e60dc5bc0 0x557e60dd23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:57.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.636+0000 7fb08924bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e60dc64e0 0x557e60de0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:57.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.636+0000 7fb08924bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb05400e790 con 0x557e60dc5bc0 2024-05-08T06:02:57.636 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.636+0000 7fb08924bb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb05400e0c0 con 0x557e60dc08f0 2024-05-08T06:02:57.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.636+0000 7fb08924bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb05400b2c0 con 0x557e60dc64e0 2024-05-08T06:02:57.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.636+0000 7fb08924bb80 10 client.0 _ll_register_callbacks cb 0x557e60cb9c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:02:57.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.637+0000 7fb077400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e60dc08f0 0x557e60de1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:57.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.637+0000 7fb077400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e60dc08f0 0x557e60de1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:37418/0 (socket says 172.21.15.82:37418) 2024-05-08T06:02:57.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.637+0000 7fb077400700 1 -- 172.21.15.82:0/4265782289 learned_addr learned my addr 172.21.15.82:0/4265782289 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:02:57.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.637+0000 7fb077e00700 1 --2- 172.21.15.82:0/4265782289 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e60dc64e0 0x557e60de0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:57.637 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.637+0000 7fb076a00700 1 --2- 172.21.15.82:0/4265782289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557e60dc5bc0 0x557e60dd23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:57.638 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.637+0000 7fb077e00700 1 -- 172.21.15.82:0/4265782289 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e60dc08f0 msgr2=0x557e60de1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:02:57.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.637+0000 7fb077e00700 1 --2- 172.21.15.82:0/4265782289 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e60dc08f0 0x557e60de1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:57.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.637+0000 7fb077e00700 1 -- 172.21.15.82:0/4265782289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557e60dc5bc0 msgr2=0x557e60dd23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:02:57.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.637+0000 7fb077e00700 1 --2- 172.21.15.82:0/4265782289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557e60dc5bc0 0x557e60dd23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:57.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.637+0000 7fb077e00700 1 -- 172.21.15.82:0/4265782289 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e60dd2e00 con 0x557e60dc64e0 2024-05-08T06:02:57.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.637+0000 7fb077e00700 1 --2- 172.21.15.82:0/4265782289 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e60dc64e0 0x557e60de0870 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb070009010 tx=0x7fb070008490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=23cdaf7f9a43a161 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:02:57.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.637+0000 7fb065600700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T06:02:57.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.638+0000 7fb065600700 1 -- 172.21.15.82:0/4265782289 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb070012040 con 0x557e60dc64e0 2024-05-08T06:02:57.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.638+0000 7fb065600700 1 -- 172.21.15.82:0/4265782289 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb070004bb0 con 0x557e60dc64e0 2024-05-08T06:02:57.639 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.638+0000 7fb08924bb80 1 -- 172.21.15.82:0/4265782289 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb06001f070 con 0x557e60dc64e0 2024-05-08T06:02:57.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.638+0000 7fb065600700 1 -- 172.21.15.82:0/4265782289 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fb070004db0 con 0x557e60dc64e0 2024-05-08T06:02:57.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.639+0000 7fb08924bb80 10 client.26554 fetch_fsmap learned FSMap version 31 2024-05-08T06:02:57.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.639+0000 7fb08924bb80 1 -- 172.21.15.82:0/4265782289 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x557e60e43960 con 0x557e60dc64e0 2024-05-08T06:02:57.640 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.639+0000 7fb065600700 1 -- 172.21.15.82:0/4265782289 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb06001f070 con 0x557e60dc64e0 2024-05-08T06:02:57.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.639+0000 7fb065600700 1 -- 172.21.15.82:0/4265782289 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fb07002e870 con 0x557e60dc64e0 2024-05-08T06:02:57.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.640+0000 7fb08924bb80 10 client.26554 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:02:57.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.640+0000 7fb08924bb80 10 client.26554 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-05-08T06:02:57.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.640+0000 7fb08924bb80 20 client.26554 populate_metadata read hostname 'smithi082' 2024-05-08T06:02:57.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.640+0000 7fb08924bb80 1 --2- 172.21.15.82:0/4265782289 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x557e60dd9da0 0x557e60e46100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:02:57.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.640+0000 7fb08924bb80 4 client.26554 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T06:02:57.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.640+0000 7fb08924bb80 1 -- 172.21.15.82:0/4265782289 --> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557e60d20400 con 0x557e60dd9da0 2024-05-08T06:02:57.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.640+0000 7fb077400700 1 --2- 172.21.15.82:0/4265782289 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x557e60dd9da0 0x557e60e46100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:02:57.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.641+0000 7fb065600700 10 client.26554 ms_handle_connect on v2:172.21.15.134:6836/2212411710 2024-05-08T06:02:57.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.641+0000 7fb077400700 1 --2- 172.21.15.82:0/4265782289 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x557e60dd9da0 0x557e60e46100 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=800a6d9ad91c0d0a server_cookie=2463abee85cb6711 in_seq=0 out_seq=0 2024-05-08T06:02:57.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.641+0000 7fb065600700 1 -- 172.21.15.82:0/4265782289 <== mds.4 v2:172.21.15.134:6836/2212411710 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557e60d20400 con 0x557e60dd9da0 2024-05-08T06:02:57.642 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.641+0000 7fb065600700 10 client.26554 handle_command_reply: tid=0 2024-05-08T06:02:57.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.641+0000 7fb08924bb80 1 client.26554 shutdown 2024-05-08T06:02:57.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.641+0000 7fb08924bb80 1 -- 172.21.15.82:0/4265782289 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e60dc64e0 msgr2=0x557e60de0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:02:57.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.641+0000 7fb08924bb80 1 --2- 172.21.15.82:0/4265782289 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e60dc64e0 0x557e60de0870 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb070009010 tx=0x7fb070008490 comp rx=0 tx=0).stop 2024-05-08T06:02:57.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.641+0000 7fb08924bb80 1 -- 172.21.15.82:0/4265782289 shutdown_connections 2024-05-08T06:02:57.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.641+0000 7fb08924bb80 1 --2- 172.21.15.82:0/4265782289 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x557e60dd9da0 0x557e60e46100 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:57.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.641+0000 7fb08924bb80 1 --2- 172.21.15.82:0/4265782289 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557e60dc08f0 0x557e60de1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:57.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.641+0000 7fb08924bb80 1 --2- 172.21.15.82:0/4265782289 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e60dc64e0 0x557e60de0870 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:57.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.641+0000 7fb08924bb80 1 --2- 172.21.15.82:0/4265782289 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x557e60dc5bc0 0x557e60dd23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:57.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.641+0000 7fb08924bb80 1 -- 172.21.15.82:0/4265782289 >> 172.21.15.82:0/4265782289 conn(0x557e60d386d0 msgr2=0x557e60dc4710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:02:57.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.642+0000 7fb065600700 0 client.26554 ms_handle_reset on v2:172.21.15.134:6836/2212411710 2024-05-08T06:02:57.643 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.642+0000 7fb08924bb80 1 -- 172.21.15.82:0/4265782289 shutdown_connections 2024-05-08T06:02:57.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.642+0000 7fb08924bb80 1 -- 172.21.15.82:0/4265782289 wait complete. 2024-05-08T06:02:57.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.642+0000 7fb08924bb80 20 client.26554 trim_cache size 0 max 16384 2024-05-08T06:02:57.644 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T06:02:57.644 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.643+0000 7fb07e800700 1 -- 172.21.15.82:0/1263790193 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb05c0b2cc0 msgr2=0x7fb05c0b5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:02:57.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.643+0000 7fb07e800700 1 --2- 172.21.15.82:0/1263790193 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb05c0b2cc0 0x7fb05c0b5180 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb0700091e0 tx=0x7fb070008500 comp rx=0 tx=0).stop 2024-05-08T06:02:57.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.643+0000 7fb07e800700 1 -- 172.21.15.82:0/1263790193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0781023a0 msgr2=0x7fb07810a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:02:57.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.643+0000 7fb07e800700 1 --2- 172.21.15.82:0/1263790193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0781023a0 0x7fb07810a7e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fb068009f70 tx=0x7fb068005640 comp rx=0 tx=0).stop 2024-05-08T06:02:57.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.643+0000 7fb07e800700 1 -- 172.21.15.82:0/1263790193 shutdown_connections 2024-05-08T06:02:57.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.643+0000 7fb07e800700 1 --2- 172.21.15.82:0/1263790193 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb05c0b2cc0 0x7fb05c0b5180 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:57.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.643+0000 7fb07e800700 1 --2- 172.21.15.82:0/1263790193 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb078108410 0x7fb0781abfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:57.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.643+0000 7fb07e800700 1 --2- 172.21.15.82:0/1263790193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0781023a0 0x7fb07810a7e0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:57.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.643+0000 7fb07e800700 1 --2- 172.21.15.82:0/1263790193 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb078102d60 0x7fb07810ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:02:57.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.643+0000 7fb07e800700 1 -- 172.21.15.82:0/1263790193 >> 172.21.15.82:0/1263790193 conn(0x7fb078079350 msgr2=0x7fb078100fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:02:57.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.643+0000 7fb07e800700 1 -- 172.21.15.82:0/1263790193 shutdown_connections 2024-05-08T06:02:57.645 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:02:57.643+0000 7fb07e800700 1 -- 172.21.15.82:0/1263790193 wait complete. 2024-05-08T06:02:58.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:02:57 smithi082 ceph-mon[30098]: pgmap v828: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.0 MiB/s wr, 674 op/s 2024-05-08T06:02:58.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:02:57 smithi134 ceph-mon[34132]: pgmap v828: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.0 MiB/s wr, 674 op/s 2024-05-08T06:02:58.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:02:57 smithi151 ceph-mon[34815]: pgmap v828: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.0 MiB/s wr, 674 op/s 2024-05-08T06:02:58.490 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-05-08T06:02:59.095 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:03:00.176 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:02:59 smithi082 ceph-mon[30098]: pgmap v829: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.0 MiB/s wr, 560 op/s 2024-05-08T06:03:00.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:02:59 smithi134 ceph-mon[34132]: pgmap v829: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.0 MiB/s wr, 560 op/s 2024-05-08T06:03:00.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 730.0 s, 1651.4 tps, lat 60.598 ms stddev 67.741 2024-05-08T06:03:00.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:02:59 smithi151 ceph-mon[34815]: pgmap v829: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.0 MiB/s wr, 560 op/s 2024-05-08T06:03:01.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.460+0000 7fae68e00700 1 -- 172.21.15.82:0/752350346 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae64075ff0 msgr2=0x7fae64114130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:03:01.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.460+0000 7fae68e00700 1 --2- 172.21.15.82:0/752350346 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae64075ff0 0x7fae64114130 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fae50009990 tx=0x7fae50009ca0 comp rx=0 tx=0).stop 2024-05-08T06:03:01.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.461+0000 7fae68e00700 1 -- 172.21.15.82:0/752350346 shutdown_connections 2024-05-08T06:03:01.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.461+0000 7fae68e00700 1 --2- 172.21.15.82:0/752350346 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae64114670 0x7fae64116a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:01.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.461+0000 7fae68e00700 1 --2- 172.21.15.82:0/752350346 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae640756d0 0x7fae64075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:01.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.461+0000 7fae68e00700 1 --2- 172.21.15.82:0/752350346 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae64075ff0 0x7fae64114130 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:01.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.461+0000 7fae68e00700 1 -- 172.21.15.82:0/752350346 >> 172.21.15.82:0/752350346 conn(0x7fae6407a600 msgr2=0x7fae6407aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:03:01.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.461+0000 7fae68e00700 1 -- 172.21.15.82:0/752350346 shutdown_connections 2024-05-08T06:03:01.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.462+0000 7fae68e00700 1 -- 172.21.15.82:0/752350346 wait complete. 2024-05-08T06:03:01.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.463+0000 7fae68e00700 1 Processor -- start 2024-05-08T06:03:01.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.463+0000 7fae68e00700 1 -- start start 2024-05-08T06:03:01.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.464+0000 7fae68e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae640756d0 0x7fae641a0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:01.466 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.464+0000 7fae68e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae64075ff0 0x7fae641a06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:01.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.464+0000 7fae68e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae64114670 0x7fae641a4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:01.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.464+0000 7fae68e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fae64119d20 con 0x7fae640756d0 2024-05-08T06:03:01.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.464+0000 7fae68e00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fae64119ba0 con 0x7fae64075ff0 2024-05-08T06:03:01.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.464+0000 7fae68e00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fae64119ea0 con 0x7fae64114670 2024-05-08T06:03:01.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.464+0000 7fae61400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae64075ff0 0x7fae641a06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:01.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.465+0000 7fae62800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae64114670 0x7fae641a4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:01.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.465+0000 7fae62800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae64114670 0x7fae641a4a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:36518/0 (socket says 172.21.15.82:36518) 2024-05-08T06:03:01.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.465+0000 7fae62800700 1 -- 172.21.15.82:0/2031022041 learned_addr learned my addr 172.21.15.82:0/2031022041 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:03:01.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.465+0000 7fae61e00700 1 --2- 172.21.15.82:0/2031022041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae640756d0 0x7fae641a0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:01.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.465+0000 7fae62800700 1 -- 172.21.15.82:0/2031022041 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae64075ff0 msgr2=0x7fae641a06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:03:01.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.465+0000 7fae62800700 1 --2- 172.21.15.82:0/2031022041 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae64075ff0 0x7fae641a06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:01.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.465+0000 7fae62800700 1 -- 172.21.15.82:0/2031022041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae640756d0 msgr2=0x7fae641a0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:03:01.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.465+0000 7fae62800700 1 --2- 172.21.15.82:0/2031022041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae640756d0 0x7fae641a0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:01.467 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.465+0000 7fae62800700 1 -- 172.21.15.82:0/2031022041 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae641a51a0 con 0x7fae64114670 2024-05-08T06:03:01.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.466+0000 7fae62800700 1 --2- 172.21.15.82:0/2031022041 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae64114670 0x7fae641a4a60 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fae5c00ef90 tx=0x7fae5c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:03:01.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.466+0000 7fae5aa00700 1 -- 172.21.15.82:0/2031022041 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae5c0092e0 con 0x7fae64114670 2024-05-08T06:03:01.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.466+0000 7fae5aa00700 1 -- 172.21.15.82:0/2031022041 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae5c004bb0 con 0x7fae64114670 2024-05-08T06:03:01.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.466+0000 7fae5aa00700 1 -- 172.21.15.82:0/2031022041 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae5c004280 con 0x7fae64114670 2024-05-08T06:03:01.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.467+0000 7fae68e00700 1 -- 172.21.15.82:0/2031022041 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae641a5430 con 0x7fae64114670 2024-05-08T06:03:01.468 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.467+0000 7fae68e00700 1 -- 172.21.15.82:0/2031022041 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae641acd10 con 0x7fae64114670 2024-05-08T06:03:01.471 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.472+0000 7fae5aa00700 1 -- 172.21.15.82:0/2031022041 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fae5c01b030 con 0x7fae64114670 2024-05-08T06:03:01.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.478+0000 7fae5aa00700 1 --2- 172.21.15.82:0/2031022041 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fae480b2a10 0x7fae480b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:01.478 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.478+0000 7fae5aa00700 1 -- 172.21.15.82:0/2031022041 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fae5c0e1bd0 con 0x7fae64114670 2024-05-08T06:03:01.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.479+0000 7fae61e00700 1 --2- 172.21.15.82:0/2031022041 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fae480b2a10 0x7fae480b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:01.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.480+0000 7fae737b2b80 1 Processor -- start 2024-05-08T06:03:01.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.480+0000 7fae737b2b80 1 -- start start 2024-05-08T06:03:01.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.481+0000 7fae61e00700 1 --2- 172.21.15.82:0/2031022041 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fae480b2a10 0x7fae480b4ed0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fae54009bf0 tx=0x7fae54009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:03:01.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.481+0000 7fae737b2b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55864af72bc0 0x55864af72fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:01.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.481+0000 7fae737b2b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55864af734e0 0x55864af6d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:01.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.481+0000 7fae737b2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55864af6d8f0 0x55864af6dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:01.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.481+0000 7fae737b2b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55864aebfa20 con 0x55864af734e0 2024-05-08T06:03:01.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.481+0000 7fae737b2b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55864ae5d760 con 0x55864af72bc0 2024-05-08T06:03:01.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.481+0000 7fae737b2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55864aebb9e0 con 0x55864af6d8f0 2024-05-08T06:03:01.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.481+0000 7fae61e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55864af72bc0 0x55864af72fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:01.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.481+0000 7fae62800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55864af6d8f0 0x55864af6dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:01.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.481+0000 7fae62800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55864af6d8f0 0x55864af6dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:36532/0 (socket says 172.21.15.82:36532) 2024-05-08T06:03:01.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.481+0000 7fae62800700 1 -- 172.21.15.82:0/760396024 learned_addr learned my addr 172.21.15.82:0/760396024 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:03:01.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.482+0000 7fae62800700 1 -- 172.21.15.82:0/760396024 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55864af72bc0 msgr2=0x55864af72fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:03:01.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.482+0000 7fae62800700 1 --2- 172.21.15.82:0/760396024 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55864af72bc0 0x55864af72fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:01.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.482+0000 7fae62800700 1 -- 172.21.15.82:0/760396024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55864af734e0 msgr2=0x55864af6d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:03:01.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.482+0000 7fae62800700 1 --2- 172.21.15.82:0/760396024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55864af734e0 0x55864af6d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:01.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.482+0000 7fae62800700 1 -- 172.21.15.82:0/760396024 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55864ae0c8d0 con 0x55864af6d8f0 2024-05-08T06:03:01.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.482+0000 7fae62800700 1 --2- 172.21.15.82:0/760396024 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55864af6d8f0 0x55864af6dd70 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fae5c0090a0 tx=0x7fae5c0a8ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=498df4b8e744ba86 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:03:01.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.482+0000 7fae4f400700 1 -- 172.21.15.82:0/760396024 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae5c0a8da0 con 0x55864af6d8f0 2024-05-08T06:03:01.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.482+0000 7fae4f400700 1 -- 172.21.15.82:0/760396024 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae5c0a9990 con 0x55864af6d8f0 2024-05-08T06:03:01.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.483+0000 7fae4f400700 1 -- 172.21.15.82:0/760396024 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae5c0dfe00 con 0x55864af6d8f0 2024-05-08T06:03:01.483 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.483+0000 7fae737b2b80 1 -- 172.21.15.82:0/760396024 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55864af6d8f0 msgr2=0x55864af6dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:03:01.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.483+0000 7fae737b2b80 1 --2- 172.21.15.82:0/760396024 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55864af6d8f0 0x55864af6dd70 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fae5c0090a0 tx=0x7fae5c0a8ce0 comp rx=0 tx=0).stop 2024-05-08T06:03:01.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.483+0000 7fae737b2b80 1 -- 172.21.15.82:0/760396024 shutdown_connections 2024-05-08T06:03:01.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.483+0000 7fae737b2b80 1 --2- 172.21.15.82:0/760396024 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55864af72bc0 0x55864af72fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:01.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.483+0000 7fae737b2b80 1 --2- 172.21.15.82:0/760396024 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55864af6d8f0 0x55864af6dd70 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:01.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.483+0000 7fae737b2b80 1 --2- 172.21.15.82:0/760396024 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55864af734e0 0x55864af6d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:01.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.483+0000 7fae737b2b80 1 -- 172.21.15.82:0/760396024 >> 172.21.15.82:0/760396024 conn(0x55864aee56d0 msgr2=0x55864af67b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:03:01.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.484+0000 7fae737b2b80 1 -- 172.21.15.82:0/760396024 shutdown_connections 2024-05-08T06:03:01.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.484+0000 7fae737b2b80 1 -- 172.21.15.82:0/760396024 wait complete. 2024-05-08T06:03:01.484 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.484+0000 7fae737b2b80 1 -- start start 2024-05-08T06:03:01.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.485+0000 7fae737b2b80 1 Processor -- start 2024-05-08T06:03:01.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.486+0000 7fae737b2b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55864af6d8f0 0x55864af79270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:01.485 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.486+0000 7fae737b2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55864af72bc0 0x55864af76610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:01.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.486+0000 7fae737b2b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55864af734e0 0x55864af76b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:01.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.486+0000 7fae737b2b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55864af79f20 con 0x55864af734e0 2024-05-08T06:03:01.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.486+0000 7fae737b2b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55864ae25b20 con 0x55864af6d8f0 2024-05-08T06:03:01.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.486+0000 7fae737b2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55864af7a0a0 con 0x55864af72bc0 2024-05-08T06:03:01.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.486+0000 7fae737b2b80 10 client.0 _ll_register_callbacks cb 0x55864ae66c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:03:01.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.486+0000 7fae61e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55864af6d8f0 0x55864af79270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:01.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.487+0000 7fae61e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55864af6d8f0 0x55864af79270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:37440/0 (socket says 172.21.15.82:37440) 2024-05-08T06:03:01.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.487+0000 7fae61e00700 1 -- 172.21.15.82:0/257061181 learned_addr learned my addr 172.21.15.82:0/257061181 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:03:01.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.487+0000 7fae61400700 1 --2- 172.21.15.82:0/257061181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55864af72bc0 0x55864af76610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:01.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.487+0000 7fae61e00700 1 -- 172.21.15.82:0/257061181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55864af72bc0 msgr2=0x55864af76610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:03:01.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.487+0000 7fae61e00700 1 --2- 172.21.15.82:0/257061181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55864af72bc0 0x55864af76610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:01.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.487+0000 7fae61e00700 1 -- 172.21.15.82:0/257061181 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55864af734e0 msgr2=0x55864af76b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:03:01.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.487+0000 7fae61e00700 1 --2- 172.21.15.82:0/257061181 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55864af734e0 0x55864af76b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:01.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.487+0000 7fae61e00700 1 -- 172.21.15.82:0/257061181 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55864ae85420 con 0x55864af6d8f0 2024-05-08T06:03:01.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.488+0000 7fae61e00700 1 --2- 172.21.15.82:0/257061181 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55864af6d8f0 0x55864af79270 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fae540127f0 tx=0x7fae540047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e30b093c46ee1a5e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:03:01.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.488+0000 7fae43e00700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T06:03:01.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.488+0000 7fae43e00700 1 -- 172.21.15.82:0/257061181 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae54020840 con 0x55864af6d8f0 2024-05-08T06:03:01.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.488+0000 7fae43e00700 1 -- 172.21.15.82:0/257061181 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fae540209e0 con 0x55864af6d8f0 2024-05-08T06:03:01.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.488+0000 7fae737b2b80 1 -- 172.21.15.82:0/257061181 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae5c0a9990 con 0x55864af6d8f0 2024-05-08T06:03:01.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.488+0000 7fae43e00700 1 -- 172.21.15.82:0/257061181 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fae54020be0 con 0x55864af6d8f0 2024-05-08T06:03:01.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.488+0000 7fae737b2b80 10 client.26540 fetch_fsmap learned FSMap version 31 2024-05-08T06:03:01.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.488+0000 7fae737b2b80 1 -- 172.21.15.82:0/257061181 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55864af84890 con 0x55864af6d8f0 2024-05-08T06:03:01.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.489+0000 7fae43e00700 1 -- 172.21.15.82:0/257061181 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae5c0a9990 con 0x55864af6d8f0 2024-05-08T06:03:01.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.489+0000 7fae43e00700 1 -- 172.21.15.82:0/257061181 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fae5401b3b0 con 0x55864af6d8f0 2024-05-08T06:03:01.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.489+0000 7fae737b2b80 10 client.26540 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:03:01.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.489+0000 7fae737b2b80 10 client.26540 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-05-08T06:03:01.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.489+0000 7fae737b2b80 20 client.26540 populate_metadata read hostname 'smithi082' 2024-05-08T06:03:01.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.489+0000 7fae737b2b80 1 --2- 172.21.15.82:0/257061181 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x55864af86ed0 0x55864af892c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:01.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.489+0000 7fae737b2b80 4 client.26540 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:03:01.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.489+0000 7fae737b2b80 1 -- 172.21.15.82:0/257061181 --> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55864af3a140 con 0x55864af86ed0 2024-05-08T06:03:01.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.489+0000 7fae61400700 1 --2- 172.21.15.82:0/257061181 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x55864af86ed0 0x55864af892c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:01.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.491+0000 7fae61400700 1 --2- 172.21.15.82:0/257061181 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x55864af86ed0 0x55864af892c0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a45f36d9bc99dd2a server_cookie=f50aa366c6b4be43 in_seq=0 out_seq=0 2024-05-08T06:03:01.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.491+0000 7fae43e00700 10 client.26540 ms_handle_connect on v2:172.21.15.151:6834/2093655929 2024-05-08T06:03:01.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.492+0000 7fae43e00700 1 -- 172.21.15.82:0/257061181 <== mds.3 v2:172.21.15.151:6834/2093655929 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55864af3a140 con 0x55864af86ed0 2024-05-08T06:03:01.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.492+0000 7fae43e00700 10 client.26540 handle_command_reply: tid=0 2024-05-08T06:03:01.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.492+0000 7fae737b2b80 1 client.26540 shutdown 2024-05-08T06:03:01.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.493+0000 7fae737b2b80 1 -- 172.21.15.82:0/257061181 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55864af6d8f0 msgr2=0x55864af79270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:03:01.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.493+0000 7fae737b2b80 1 --2- 172.21.15.82:0/257061181 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55864af6d8f0 0x55864af79270 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fae540127f0 tx=0x7fae540047c0 comp rx=0 tx=0).stop 2024-05-08T06:03:01.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.493+0000 7fae737b2b80 1 -- 172.21.15.82:0/257061181 shutdown_connections 2024-05-08T06:03:01.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.493+0000 7fae737b2b80 1 --2- 172.21.15.82:0/257061181 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x55864af86ed0 0x55864af892c0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:01.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.493+0000 7fae737b2b80 1 --2- 172.21.15.82:0/257061181 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55864af6d8f0 0x55864af79270 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:01.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.493+0000 7fae737b2b80 1 --2- 172.21.15.82:0/257061181 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55864af734e0 0x55864af76b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:01.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.493+0000 7fae737b2b80 1 --2- 172.21.15.82:0/257061181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55864af72bc0 0x55864af76610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:01.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.493+0000 7fae737b2b80 1 -- 172.21.15.82:0/257061181 >> 172.21.15.82:0/257061181 conn(0x55864aee56d0 msgr2=0x55864af67190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:03:01.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.493+0000 7fae43e00700 0 client.26540 ms_handle_reset on v2:172.21.15.151:6834/2093655929 2024-05-08T06:03:01.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.493+0000 7fae737b2b80 1 -- 172.21.15.82:0/257061181 shutdown_connections 2024-05-08T06:03:01.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.493+0000 7fae737b2b80 1 -- 172.21.15.82:0/257061181 wait complete. 2024-05-08T06:03:01.494 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.494+0000 7fae737b2b80 20 client.26540 trim_cache size 0 max 16384 2024-05-08T06:03:01.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.515+0000 7fae737b2b80 1 Processor -- start 2024-05-08T06:03:01.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.515+0000 7fae737b2b80 1 -- start start 2024-05-08T06:03:01.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.515+0000 7fae737b2b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55864af6d8f0 0x55864af75570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:01.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.515+0000 7fae737b2b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55864af72bc0 0x55864af76b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:01.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.515+0000 7fae737b2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55864af734e0 0x55864af82fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:01.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.515+0000 7fae737b2b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fae641b41a0 con 0x55864af72bc0 2024-05-08T06:03:01.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.515+0000 7fae737b2b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fae641b5ce0 con 0x55864af6d8f0 2024-05-08T06:03:01.515 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.515+0000 7fae737b2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fae641b4870 con 0x55864af734e0 2024-05-08T06:03:01.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.515+0000 7fae61e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55864af6d8f0 0x55864af75570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:01.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.515+0000 7fae61e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55864af6d8f0 0x55864af75570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:37456/0 (socket says 172.21.15.82:37456) 2024-05-08T06:03:01.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.516+0000 7fae61e00700 1 -- 172.21.15.82:0/1536125426 learned_addr learned my addr 172.21.15.82:0/1536125426 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:03:01.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.516+0000 7fae61400700 1 --2- 172.21.15.82:0/1536125426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55864af72bc0 0x55864af76b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:01.516 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.516+0000 7fae62800700 1 --2- 172.21.15.82:0/1536125426 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55864af734e0 0x55864af82fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:01.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.516+0000 7fae61e00700 1 -- 172.21.15.82:0/1536125426 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55864af734e0 msgr2=0x55864af82fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:03:01.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.516+0000 7fae61e00700 1 --2- 172.21.15.82:0/1536125426 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55864af734e0 0x55864af82fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:01.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.516+0000 7fae61e00700 1 -- 172.21.15.82:0/1536125426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55864af72bc0 msgr2=0x55864af76b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:03:01.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.516+0000 7fae61e00700 1 --2- 172.21.15.82:0/1536125426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55864af72bc0 0x55864af76b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:01.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.516+0000 7fae61e00700 1 -- 172.21.15.82:0/1536125426 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55864af795e0 con 0x55864af6d8f0 2024-05-08T06:03:01.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.516+0000 7fae61400700 1 --2- 172.21.15.82:0/1536125426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55864af72bc0 0x55864af76b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:03:01.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.516+0000 7fae61e00700 1 --2- 172.21.15.82:0/1536125426 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55864af6d8f0 0x55864af75570 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fae5401b7d0 tx=0x7fae540093d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59c094c5fdcdb5e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:03:01.517 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.517+0000 7fae4ea00700 1 -- 172.21.15.82:0/1536125426 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae5401b5b0 con 0x55864af6d8f0 2024-05-08T06:03:01.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.517+0000 7fae4ea00700 1 -- 172.21.15.82:0/1536125426 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae54024070 con 0x55864af6d8f0 2024-05-08T06:03:01.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.517+0000 7fae4ea00700 1 -- 172.21.15.82:0/1536125426 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae540299a0 con 0x55864af6d8f0 2024-05-08T06:03:01.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.518+0000 7fae737b2b80 1 -- 172.21.15.82:0/1536125426 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55864af6d8f0 msgr2=0x55864af75570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:03:01.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.518+0000 7fae737b2b80 1 --2- 172.21.15.82:0/1536125426 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55864af6d8f0 0x55864af75570 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fae5401b7d0 tx=0x7fae540093d0 comp rx=0 tx=0).stop 2024-05-08T06:03:01.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.518+0000 7fae737b2b80 1 -- 172.21.15.82:0/1536125426 shutdown_connections 2024-05-08T06:03:01.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.518+0000 7fae737b2b80 1 --2- 172.21.15.82:0/1536125426 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55864af6d8f0 0x55864af75570 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:01.518 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.518+0000 7fae737b2b80 1 --2- 172.21.15.82:0/1536125426 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55864af734e0 0x55864af82fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:01.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.518+0000 7fae737b2b80 1 --2- 172.21.15.82:0/1536125426 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55864af72bc0 0x55864af76b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:01.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.518+0000 7fae737b2b80 1 -- 172.21.15.82:0/1536125426 >> 172.21.15.82:0/1536125426 conn(0x55864aee56d0 msgr2=0x55864af71770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:03:01.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.519+0000 7fae737b2b80 1 -- 172.21.15.82:0/1536125426 shutdown_connections 2024-05-08T06:03:01.519 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.520+0000 7fae737b2b80 1 -- 172.21.15.82:0/1536125426 wait complete. 2024-05-08T06:03:01.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.520+0000 7fae737b2b80 1 -- start start 2024-05-08T06:03:01.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.521+0000 7fae737b2b80 1 Processor -- start 2024-05-08T06:03:01.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.521+0000 7fae737b2b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55864af6d8f0 0x55864af8e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:01.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.521+0000 7fae737b2b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55864af72bc0 0x55864af8e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:01.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.522+0000 7fae737b2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55864af734e0 0x55864af8ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:01.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.522+0000 7fae737b2b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fae641b5610 con 0x55864af72bc0 2024-05-08T06:03:01.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.522+0000 7fae737b2b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fae641b4f40 con 0x55864af6d8f0 2024-05-08T06:03:01.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.522+0000 7fae737b2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fae641b2140 con 0x55864af734e0 2024-05-08T06:03:01.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.522+0000 7fae737b2b80 10 client.0 _ll_register_callbacks cb 0x55864ae66c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:03:01.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.522+0000 7fae61400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55864af72bc0 0x55864af8e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:01.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.522+0000 7fae61e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55864af6d8f0 0x55864af8e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:01.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.522+0000 7fae61e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55864af6d8f0 0x55864af8e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:37464/0 (socket says 172.21.15.82:37464) 2024-05-08T06:03:01.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.522+0000 7fae61e00700 1 -- 172.21.15.82:0/2004680351 learned_addr learned my addr 172.21.15.82:0/2004680351 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:03:01.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.522+0000 7fae61400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55864af72bc0 0x55864af8e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55204/0 (socket says 172.21.15.82:55204) 2024-05-08T06:03:01.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.522+0000 7fae62800700 1 --2- 172.21.15.82:0/2004680351 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55864af734e0 0x55864af8ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:01.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.522+0000 7fae61e00700 1 -- 172.21.15.82:0/2004680351 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55864af734e0 msgr2=0x55864af8ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:03:01.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.522+0000 7fae61e00700 1 --2- 172.21.15.82:0/2004680351 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55864af734e0 0x55864af8ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:01.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.522+0000 7fae61e00700 1 -- 172.21.15.82:0/2004680351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55864af72bc0 msgr2=0x55864af8e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:03:01.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.522+0000 7fae61e00700 1 --2- 172.21.15.82:0/2004680351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55864af72bc0 0x55864af8e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:01.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.522+0000 7fae61e00700 1 -- 172.21.15.82:0/2004680351 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55864aff0730 con 0x55864af6d8f0 2024-05-08T06:03:01.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.523+0000 7fae61400700 1 --2- 172.21.15.82:0/2004680351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55864af72bc0 0x55864af8e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:03:01.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.523+0000 7fae62800700 1 --2- 172.21.15.82:0/2004680351 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55864af734e0 0x55864af8ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:03:01.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.523+0000 7fae61e00700 1 --2- 172.21.15.82:0/2004680351 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55864af6d8f0 0x55864af8e270 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fae54011770 tx=0x7fae5401bfd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7d7b3a9c54dde6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:03:01.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.523+0000 7fae43e00700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T06:03:01.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.523+0000 7fae43e00700 1 -- 172.21.15.82:0/2004680351 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae54004220 con 0x55864af6d8f0 2024-05-08T06:03:01.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.523+0000 7fae43e00700 1 -- 172.21.15.82:0/2004680351 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fae540043c0 con 0x55864af6d8f0 2024-05-08T06:03:01.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.524+0000 7fae737b2b80 1 -- 172.21.15.82:0/2004680351 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae54024070 con 0x55864af6d8f0 2024-05-08T06:03:01.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.524+0000 7fae43e00700 1 -- 172.21.15.82:0/2004680351 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fae54005040 con 0x55864af6d8f0 2024-05-08T06:03:01.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.524+0000 7fae737b2b80 10 client.26546 fetch_fsmap learned FSMap version 31 2024-05-08T06:03:01.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.524+0000 7fae737b2b80 1 -- 172.21.15.82:0/2004680351 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55864aff18d0 con 0x55864af6d8f0 2024-05-08T06:03:01.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.525+0000 7fae43e00700 1 -- 172.21.15.82:0/2004680351 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fae54024070 con 0x55864af6d8f0 2024-05-08T06:03:01.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.525+0000 7fae43e00700 1 -- 172.21.15.82:0/2004680351 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fae54004c90 con 0x55864af6d8f0 2024-05-08T06:03:01.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.525+0000 7fae737b2b80 10 client.26546 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:03:01.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.525+0000 7fae737b2b80 10 client.26546 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-05-08T06:03:01.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.525+0000 7fae737b2b80 20 client.26546 populate_metadata read hostname 'smithi082' 2024-05-08T06:03:01.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.525+0000 7fae737b2b80 1 --2- 172.21.15.82:0/2004680351 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x55864aff1ed0 0x55864aff42f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:01.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.525+0000 7fae737b2b80 4 client.26546 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T06:03:01.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.525+0000 7fae737b2b80 1 -- 172.21.15.82:0/2004680351 --> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55864aecd400 con 0x55864aff1ed0 2024-05-08T06:03:01.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.525+0000 7fae61400700 1 --2- 172.21.15.82:0/2004680351 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x55864aff1ed0 0x55864aff42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:01.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.526+0000 7fae61400700 1 --2- 172.21.15.82:0/2004680351 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x55864aff1ed0 0x55864aff42f0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1c1fd14ee94e4c56 server_cookie=978887a1aae181cf in_seq=0 out_seq=0 2024-05-08T06:03:01.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.526+0000 7fae43e00700 10 client.26546 ms_handle_connect on v2:172.21.15.151:6834/2093655929 2024-05-08T06:03:01.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.526+0000 7fae43e00700 1 -- 172.21.15.82:0/2004680351 <== mds.3 v2:172.21.15.151:6834/2093655929 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55864aecd400 con 0x55864aff1ed0 2024-05-08T06:03:01.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.526+0000 7fae43e00700 10 client.26546 handle_command_reply: tid=0 2024-05-08T06:03:01.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.526+0000 7fae737b2b80 1 client.26546 shutdown 2024-05-08T06:03:01.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.526+0000 7fae737b2b80 1 -- 172.21.15.82:0/2004680351 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55864af6d8f0 msgr2=0x55864af8e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:03:01.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.526+0000 7fae737b2b80 1 --2- 172.21.15.82:0/2004680351 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55864af6d8f0 0x55864af8e270 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fae54011770 tx=0x7fae5401bfd0 comp rx=0 tx=0).stop 2024-05-08T06:03:01.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.527+0000 7fae737b2b80 1 -- 172.21.15.82:0/2004680351 shutdown_connections 2024-05-08T06:03:01.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.527+0000 7fae737b2b80 1 --2- 172.21.15.82:0/2004680351 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x55864aff1ed0 0x55864aff42f0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:01.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.527+0000 7fae43e00700 0 client.26546 ms_handle_reset on v2:172.21.15.151:6834/2093655929 2024-05-08T06:03:01.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.527+0000 7fae737b2b80 1 --2- 172.21.15.82:0/2004680351 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55864af6d8f0 0x55864af8e270 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:01.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.527+0000 7fae737b2b80 1 --2- 172.21.15.82:0/2004680351 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55864af734e0 0x55864af8ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:01.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.527+0000 7fae737b2b80 1 --2- 172.21.15.82:0/2004680351 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55864af72bc0 0x55864af8e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:01.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.527+0000 7fae737b2b80 1 -- 172.21.15.82:0/2004680351 >> 172.21.15.82:0/2004680351 conn(0x55864aee56d0 msgr2=0x55864af71770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:03:01.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.527+0000 7fae737b2b80 1 -- 172.21.15.82:0/2004680351 shutdown_connections 2024-05-08T06:03:01.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.527+0000 7fae737b2b80 1 -- 172.21.15.82:0/2004680351 wait complete. 2024-05-08T06:03:01.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.527+0000 7fae737b2b80 20 client.26546 trim_cache size 0 max 16384 2024-05-08T06:03:01.528 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T06:03:01.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.528+0000 7fae68e00700 1 -- 172.21.15.82:0/2031022041 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fae480b2a10 msgr2=0x7fae480b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:03:01.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.528+0000 7fae68e00700 1 --2- 172.21.15.82:0/2031022041 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fae480b2a10 0x7fae480b4ed0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fae54009bf0 tx=0x7fae54009260 comp rx=0 tx=0).stop 2024-05-08T06:03:01.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.528+0000 7fae68e00700 1 -- 172.21.15.82:0/2031022041 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae64114670 msgr2=0x7fae641a4a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:03:01.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.528+0000 7fae68e00700 1 --2- 172.21.15.82:0/2031022041 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae64114670 0x7fae641a4a60 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fae5c00ef90 tx=0x7fae5c00c3a0 comp rx=0 tx=0).stop 2024-05-08T06:03:01.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.528+0000 7fae68e00700 1 -- 172.21.15.82:0/2031022041 shutdown_connections 2024-05-08T06:03:01.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.528+0000 7fae68e00700 1 --2- 172.21.15.82:0/2031022041 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fae480b2a10 0x7fae480b4ed0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:01.529 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.528+0000 7fae68e00700 1 --2- 172.21.15.82:0/2031022041 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae64114670 0x7fae641a4a60 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:01.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.528+0000 7fae68e00700 1 --2- 172.21.15.82:0/2031022041 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fae640756d0 0x7fae641a0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:01.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.528+0000 7fae68e00700 1 --2- 172.21.15.82:0/2031022041 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae64075ff0 0x7fae641a06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:01.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.528+0000 7fae68e00700 1 -- 172.21.15.82:0/2031022041 >> 172.21.15.82:0/2031022041 conn(0x7fae6407a600 msgr2=0x7fae64110110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:03:01.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.529+0000 7fae68e00700 1 -- 172.21.15.82:0/2031022041 shutdown_connections 2024-05-08T06:03:01.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:01.529+0000 7fae68e00700 1 -- 172.21.15.82:0/2031022041 wait complete. 2024-05-08T06:03:02.223 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:03:01 smithi082 ceph-mon[30098]: pgmap v830: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.2 MiB/s wr, 676 op/s 2024-05-08T06:03:02.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:03:01 smithi134 ceph-mon[34132]: pgmap v830: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.2 MiB/s wr, 676 op/s 2024-05-08T06:03:02.357 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-05-08T06:03:02.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:03:01 smithi151 ceph-mon[34815]: pgmap v830: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 6.2 MiB/s wr, 676 op/s 2024-05-08T06:03:02.999 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:03:04.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:03:03 smithi082 ceph-mon[30098]: pgmap v831: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.7 MiB/s wr, 613 op/s 2024-05-08T06:03:04.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:03:03 smithi134 ceph-mon[34132]: pgmap v831: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.7 MiB/s wr, 613 op/s 2024-05-08T06:03:04.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:03:03 smithi151 ceph-mon[34815]: pgmap v831: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 5.7 MiB/s wr, 613 op/s 2024-05-08T06:03:05.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 735.0 s, 1686.8 tps, lat 59.576 ms stddev 67.341 2024-05-08T06:03:05.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.550+0000 7f44a8000700 1 -- 172.21.15.82:0/845182941 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44a01165f0 msgr2=0x7f44a01189e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:03:05.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.550+0000 7f44a8000700 1 --2- 172.21.15.82:0/845182941 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44a01165f0 0x7f44a01189e0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4498009f90 tx=0x7f449800b330 comp rx=0 tx=0).stop 2024-05-08T06:03:05.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.550+0000 7f44a8000700 1 -- 172.21.15.82:0/845182941 shutdown_connections 2024-05-08T06:03:05.553 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.550+0000 7f44a8000700 1 --2- 172.21.15.82:0/845182941 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44a010a4a0 0x7f44a010a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:05.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.550+0000 7f44a8000700 1 --2- 172.21.15.82:0/845182941 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44a01165f0 0x7f44a01189e0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:05.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.550+0000 7f44a8000700 1 --2- 172.21.15.82:0/845182941 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44a010adc0 0x7f44a01160b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:05.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.550+0000 7f44a8000700 1 -- 172.21.15.82:0/845182941 >> 172.21.15.82:0/845182941 conn(0x7f44a006e610 msgr2=0x7f44a006ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:03:05.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.550+0000 7f44a8000700 1 -- 172.21.15.82:0/845182941 shutdown_connections 2024-05-08T06:03:05.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.550+0000 7f44a8000700 1 -- 172.21.15.82:0/845182941 wait complete. 2024-05-08T06:03:05.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.552+0000 7f44a8000700 1 Processor -- start 2024-05-08T06:03:05.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.552+0000 7f44a8000700 1 -- start start 2024-05-08T06:03:05.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.552+0000 7f44a8000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44a010a4a0 0x7f44a007b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:05.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.552+0000 7f44a8000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44a010adc0 0x7f44a007b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:05.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.552+0000 7f44a8000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44a01165f0 0x7f44a0076500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:05.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.552+0000 7f44a8000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f44a0119d60 con 0x7f44a010a4a0 2024-05-08T06:03:05.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.552+0000 7f44a8000700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f44a0119be0 con 0x7f44a01165f0 2024-05-08T06:03:05.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.552+0000 7f44a8000700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f44a0119ee0 con 0x7f44a010adc0 2024-05-08T06:03:05.554 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.553+0000 7f44a4c00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44a010adc0 0x7f44a007b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:05.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.553+0000 7f44a4c00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44a010adc0 0x7f44a007b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:42452/0 (socket says 172.21.15.82:42452) 2024-05-08T06:03:05.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.553+0000 7f44a4c00700 1 -- 172.21.15.82:0/244750701 learned_addr learned my addr 172.21.15.82:0/244750701 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:03:05.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.553+0000 7f44a6000700 1 --2- 172.21.15.82:0/244750701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44a01165f0 0x7f44a0076500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:05.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.553+0000 7f44a4c00700 1 -- 172.21.15.82:0/244750701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44a01165f0 msgr2=0x7f44a0076500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:03:05.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.553+0000 7f44a4c00700 1 --2- 172.21.15.82:0/244750701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44a01165f0 0x7f44a0076500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:05.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.553+0000 7f44a4c00700 1 -- 172.21.15.82:0/244750701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44a010a4a0 msgr2=0x7f44a007b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:03:05.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.553+0000 7f44a4c00700 1 --2- 172.21.15.82:0/244750701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44a010a4a0 0x7f44a007b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:05.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.553+0000 7f44a4c00700 1 -- 172.21.15.82:0/244750701 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44a0076e00 con 0x7f44a010adc0 2024-05-08T06:03:05.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.554+0000 7f44a4c00700 1 --2- 172.21.15.82:0/244750701 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44a010adc0 0x7f44a007b8d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f449000d980 tx=0x7f449000dd40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:03:05.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.554+0000 7f449e000700 1 -- 172.21.15.82:0/244750701 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4490016070 con 0x7f44a010adc0 2024-05-08T06:03:05.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.554+0000 7f449e000700 1 -- 172.21.15.82:0/244750701 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f44900044d0 con 0x7f44a010adc0 2024-05-08T06:03:05.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.554+0000 7f449e000700 1 -- 172.21.15.82:0/244750701 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4490004d90 con 0x7f44a010adc0 2024-05-08T06:03:05.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.555+0000 7f44a8000700 1 -- 172.21.15.82:0/244750701 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44a00770f0 con 0x7f44a010adc0 2024-05-08T06:03:05.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.556+0000 7f44a8000700 1 -- 172.21.15.82:0/244750701 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44a0083290 con 0x7f44a010adc0 2024-05-08T06:03:05.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.563+0000 7f44b28a9b80 1 Processor -- start 2024-05-08T06:03:05.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.564+0000 7f44b28a9b80 1 -- start start 2024-05-08T06:03:05.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.564+0000 7f449e000700 1 -- 172.21.15.82:0/244750701 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f4490004020 con 0x7f44a010adc0 2024-05-08T06:03:05.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.564+0000 7f44b28a9b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55788b76b060 0x55788b76b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:05.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.564+0000 7f44b28a9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55788b76b980 0x55788b76f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:05.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.564+0000 7f44b28a9b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55788b76f9d0 0x55788b76fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:05.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.564+0000 7f44b28a9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55788b6bda20 con 0x55788b76b980 2024-05-08T06:03:05.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.564+0000 7f44b28a9b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55788b65b760 con 0x55788b76f9d0 2024-05-08T06:03:05.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.564+0000 7f44b28a9b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55788b6b99e0 con 0x55788b76b060 2024-05-08T06:03:05.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.565+0000 7f44a6000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55788b76b060 0x55788b76b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:05.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.565+0000 7f44a6000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55788b76b060 0x55788b76b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:42468/0 (socket says 172.21.15.82:42468) 2024-05-08T06:03:05.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.565+0000 7f44a6000700 1 -- 172.21.15.82:0/21578354 learned_addr learned my addr 172.21.15.82:0/21578354 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:03:05.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.565+0000 7f44a5600700 1 --2- 172.21.15.82:0/21578354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55788b76b980 0x55788b76f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:05.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.565+0000 7f44a4c00700 1 --2- 172.21.15.82:0/21578354 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55788b76f9d0 0x55788b76fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:05.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.565+0000 7f44a6000700 1 -- 172.21.15.82:0/21578354 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55788b76f9d0 msgr2=0x55788b76fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:03:05.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.566+0000 7f44a6000700 1 --2- 172.21.15.82:0/21578354 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55788b76f9d0 0x55788b76fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:05.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.566+0000 7f44a6000700 1 -- 172.21.15.82:0/21578354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55788b76b980 msgr2=0x55788b76f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:03:05.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.566+0000 7f44a6000700 1 --2- 172.21.15.82:0/21578354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55788b76b980 0x55788b76f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:05.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.566+0000 7f44a6000700 1 -- 172.21.15.82:0/21578354 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55788b60a8d0 con 0x55788b76b060 2024-05-08T06:03:05.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.566+0000 7f44a5600700 1 --2- 172.21.15.82:0/21578354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55788b76b980 0x55788b76f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:03:05.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.566+0000 7f44a6000700 1 --2- 172.21.15.82:0/21578354 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55788b76b060 0x55788b76b440 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4498009c80 tx=0x7f4498009cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10551a3945055387 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:03:05.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.567+0000 7f4496a00700 1 -- 172.21.15.82:0/21578354 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f449800bd20 con 0x55788b76b060 2024-05-08T06:03:05.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.567+0000 7f4496a00700 1 -- 172.21.15.82:0/21578354 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4498007420 con 0x55788b76b060 2024-05-08T06:03:05.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.568+0000 7f44b28a9b80 1 -- 172.21.15.82:0/21578354 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55788b76b060 msgr2=0x55788b76b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:03:05.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.569+0000 7f4496a00700 1 -- 172.21.15.82:0/21578354 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44980052d0 con 0x55788b76b060 2024-05-08T06:03:05.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.569+0000 7f44b28a9b80 1 --2- 172.21.15.82:0/21578354 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55788b76b060 0x55788b76b440 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f4498009c80 tx=0x7f4498009cb0 comp rx=0 tx=0).stop 2024-05-08T06:03:05.569 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.570+0000 7f449e000700 1 --2- 172.21.15.82:0/244750701 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f44840b6e20 0x7f44840b92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:05.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.570+0000 7f44b28a9b80 1 -- 172.21.15.82:0/21578354 shutdown_connections 2024-05-08T06:03:05.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.570+0000 7f44b28a9b80 1 --2- 172.21.15.82:0/21578354 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55788b76f9d0 0x55788b76fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:05.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.570+0000 7f44b28a9b80 1 --2- 172.21.15.82:0/21578354 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55788b76b060 0x55788b76b440 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:05.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.570+0000 7f44b28a9b80 1 --2- 172.21.15.82:0/21578354 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55788b76b980 0x55788b76f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:05.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.570+0000 7f44b28a9b80 1 -- 172.21.15.82:0/21578354 >> 172.21.15.82:0/21578354 conn(0x55788b699b60 msgr2=0x55788b7657a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:03:05.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.571+0000 7f44a5600700 1 --2- 172.21.15.82:0/244750701 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f44840b6e20 0x7f44840b92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:05.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.572+0000 7f449e000700 1 -- 172.21.15.82:0/244750701 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f44900e1d60 con 0x7f44a010adc0 2024-05-08T06:03:05.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.572+0000 7f44b28a9b80 1 -- 172.21.15.82:0/21578354 shutdown_connections 2024-05-08T06:03:05.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.572+0000 7f44b28a9b80 1 -- 172.21.15.82:0/21578354 wait complete. 2024-05-08T06:03:05.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.573+0000 7f44a5600700 1 --2- 172.21.15.82:0/244750701 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f44840b6e20 0x7f44840b92e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f448c005e50 tx=0x7f448c005bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:03:05.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.573+0000 7f44b28a9b80 1 -- start start 2024-05-08T06:03:05.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.574+0000 7f44b28a9b80 1 Processor -- start 2024-05-08T06:03:05.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.575+0000 7f44b28a9b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55788b76b060 0x55788b776de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:05.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.575+0000 7f44b28a9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55788b76b980 0x55788b774180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:05.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.575+0000 7f44b28a9b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55788b76f9d0 0x55788b7746c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:05.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.575+0000 7f44b28a9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55788b777bd0 con 0x55788b76b980 2024-05-08T06:03:05.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.575+0000 7f44b28a9b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55788b623b20 con 0x55788b76b060 2024-05-08T06:03:05.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.575+0000 7f44b28a9b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55788b777d50 con 0x55788b76f9d0 2024-05-08T06:03:05.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.575+0000 7f44b28a9b80 10 client.0 _ll_register_callbacks cb 0x55788b664c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:03:05.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.575+0000 7f44a4c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55788b76b980 0x55788b774180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:05.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.575+0000 7f44a4c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55788b76b980 0x55788b774180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44802/0 (socket says 172.21.15.82:44802) 2024-05-08T06:03:05.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.576+0000 7f44a4c00700 1 -- 172.21.15.82:0/3469040455 learned_addr learned my addr 172.21.15.82:0/3469040455 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:03:05.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.576+0000 7f44a6000700 1 --2- 172.21.15.82:0/3469040455 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55788b76f9d0 0x55788b7746c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:05.576 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.576+0000 7f44a5600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55788b76b060 0x55788b776de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:05.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.577+0000 7f44a4c00700 1 -- 172.21.15.82:0/3469040455 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55788b76f9d0 msgr2=0x55788b7746c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:03:05.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.577+0000 7f44a4c00700 1 --2- 172.21.15.82:0/3469040455 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55788b76f9d0 0x55788b7746c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:05.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.577+0000 7f44a4c00700 1 -- 172.21.15.82:0/3469040455 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55788b76b060 msgr2=0x55788b776de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:03:05.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.577+0000 7f44a4c00700 1 --2- 172.21.15.82:0/3469040455 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55788b76b060 0x55788b776de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:05.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.577+0000 7f44a4c00700 1 -- 172.21.15.82:0/3469040455 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55788b683420 con 0x55788b76b980 2024-05-08T06:03:05.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.577+0000 7f44a6000700 1 --2- 172.21.15.82:0/3469040455 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55788b76f9d0 0x55788b7746c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:03:05.577 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.577+0000 7f44a5600700 1 --2- 172.21.15.82:0/3469040455 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55788b76b060 0x55788b776de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:03:05.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.578+0000 7f44a4c00700 1 --2- 172.21.15.82:0/3469040455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55788b76b980 0x55788b774180 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f44900a9320 tx=0x7f44900a8d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96f59efb535d0d97 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:03:05.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.578+0000 7f448b400700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T06:03:05.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.579+0000 7f448b400700 1 -- 172.21.15.82:0/3469040455 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44900c3060 con 0x55788b76b980 2024-05-08T06:03:05.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.579+0000 7f44b28a9b80 1 -- 172.21.15.82:0/3469040455 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4498007420 con 0x55788b76b980 2024-05-08T06:03:05.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.580+0000 7f448b400700 1 -- 172.21.15.82:0/3469040455 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f449000bbf0 con 0x55788b76b980 2024-05-08T06:03:05.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.581+0000 7f448b400700 1 -- 172.21.15.82:0/3469040455 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f44900c8050 con 0x55788b76b980 2024-05-08T06:03:05.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.581+0000 7f44b28a9b80 10 client.16104 fetch_fsmap learned FSMap version 31 2024-05-08T06:03:05.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.581+0000 7f44b28a9b80 1 -- 172.21.15.82:0/3469040455 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55788b779280 con 0x55788b76b980 2024-05-08T06:03:05.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.582+0000 7f448b400700 1 -- 172.21.15.82:0/3469040455 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4498007420 con 0x55788b76b980 2024-05-08T06:03:05.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.583+0000 7f448b400700 1 -- 172.21.15.82:0/3469040455 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f4490022060 con 0x55788b76b980 2024-05-08T06:03:05.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.583+0000 7f44b28a9b80 10 client.16104 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:03:05.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.583+0000 7f44b28a9b80 10 client.16104 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-05-08T06:03:05.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.583+0000 7f44b28a9b80 20 client.16104 populate_metadata read hostname 'smithi082' 2024-05-08T06:03:05.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.583+0000 7f44b28a9b80 1 --2- 172.21.15.82:0/3469040455 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55788b77b8c0 0x55788b77dd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:05.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.583+0000 7f44b28a9b80 4 client.16104 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:03:05.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.583+0000 7f44b28a9b80 1 -- 172.21.15.82:0/3469040455 --> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55788b7380a0 con 0x55788b77b8c0 2024-05-08T06:03:05.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.584+0000 7f44a5600700 1 --2- 172.21.15.82:0/3469040455 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55788b77b8c0 0x55788b77dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:05.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.584+0000 7f448b400700 10 client.16104 ms_handle_connect on v2:172.21.15.151:6836/4192404464 2024-05-08T06:03:05.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.584+0000 7f44a5600700 1 --2- 172.21.15.82:0/3469040455 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55788b77b8c0 0x55788b77dd20 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d885350a40a9231f server_cookie=8756be4d0276bfa0 in_seq=0 out_seq=0 2024-05-08T06:03:05.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.585+0000 7f448b400700 1 -- 172.21.15.82:0/3469040455 <== mds.2 v2:172.21.15.151:6836/4192404464 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55788b7380a0 con 0x55788b77b8c0 2024-05-08T06:03:05.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.585+0000 7f448b400700 10 client.16104 handle_command_reply: tid=0 2024-05-08T06:03:05.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.585+0000 7f44b28a9b80 1 client.16104 shutdown 2024-05-08T06:03:05.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.585+0000 7f44b28a9b80 1 -- 172.21.15.82:0/3469040455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55788b76b980 msgr2=0x55788b774180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:03:05.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.585+0000 7f44b28a9b80 1 --2- 172.21.15.82:0/3469040455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55788b76b980 0x55788b774180 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f44900a9320 tx=0x7f44900a8d60 comp rx=0 tx=0).stop 2024-05-08T06:03:05.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.586+0000 7f44b28a9b80 1 -- 172.21.15.82:0/3469040455 shutdown_connections 2024-05-08T06:03:05.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.586+0000 7f44b28a9b80 1 --2- 172.21.15.82:0/3469040455 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55788b77b8c0 0x55788b77dd20 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:05.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.586+0000 7f44b28a9b80 1 --2- 172.21.15.82:0/3469040455 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55788b76b060 0x55788b776de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:05.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.586+0000 7f44b28a9b80 1 --2- 172.21.15.82:0/3469040455 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55788b76f9d0 0x55788b7746c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:05.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.586+0000 7f44b28a9b80 1 --2- 172.21.15.82:0/3469040455 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55788b76b980 0x55788b774180 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:05.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.586+0000 7f44b28a9b80 1 -- 172.21.15.82:0/3469040455 >> 172.21.15.82:0/3469040455 conn(0x55788b699b60 msgr2=0x55788b7602b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:03:05.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.586+0000 7f448b400700 0 client.16104 ms_handle_reset on v2:172.21.15.151:6836/4192404464 2024-05-08T06:03:05.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.587+0000 7f44b28a9b80 1 -- 172.21.15.82:0/3469040455 shutdown_connections 2024-05-08T06:03:05.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.587+0000 7f44b28a9b80 1 -- 172.21.15.82:0/3469040455 wait complete. 2024-05-08T06:03:05.587 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.588+0000 7f44b28a9b80 20 client.16104 trim_cache size 0 max 16384 2024-05-08T06:03:05.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.609+0000 7f44b28a9b80 1 Processor -- start 2024-05-08T06:03:05.609 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.610+0000 7f44b28a9b80 1 -- start start 2024-05-08T06:03:05.610 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.610+0000 7f44b28a9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55788b76b060 0x55788b771d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:05.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.610+0000 7f44b28a9b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55788b76b980 0x55788b788ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:05.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.610+0000 7f44b28a9b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55788b76f9d0 0x55788b79f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:05.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.610+0000 7f44b28a9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f44a01c50e0 con 0x55788b76b060 2024-05-08T06:03:05.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.610+0000 7f44b28a9b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f44a01c6c20 con 0x55788b76f9d0 2024-05-08T06:03:05.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.610+0000 7f44b28a9b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f44a01c57b0 con 0x55788b76b980 2024-05-08T06:03:05.611 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.611+0000 7f44a4c00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55788b76b980 0x55788b788ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:05.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.611+0000 7f44a5600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55788b76b060 0x55788b771d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:05.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.611+0000 7f44a5600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55788b76b060 0x55788b771d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:44816/0 (socket says 172.21.15.82:44816) 2024-05-08T06:03:05.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.611+0000 7f44a5600700 1 -- 172.21.15.82:0/2998362032 learned_addr learned my addr 172.21.15.82:0/2998362032 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:03:05.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.611+0000 7f44a6000700 1 --2- 172.21.15.82:0/2998362032 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55788b76f9d0 0x55788b79f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:05.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.611+0000 7f44a5600700 1 -- 172.21.15.82:0/2998362032 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55788b76b980 msgr2=0x55788b788ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:03:05.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.611+0000 7f44a5600700 1 --2- 172.21.15.82:0/2998362032 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55788b76b980 0x55788b788ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:05.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.611+0000 7f44a5600700 1 -- 172.21.15.82:0/2998362032 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55788b76f9d0 msgr2=0x55788b79f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:03:05.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.611+0000 7f44a5600700 1 --2- 172.21.15.82:0/2998362032 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55788b76f9d0 0x55788b79f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:05.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.611+0000 7f44a5600700 1 -- 172.21.15.82:0/2998362032 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55788b7672f0 con 0x55788b76b060 2024-05-08T06:03:05.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.611+0000 7f44a4c00700 1 --2- 172.21.15.82:0/2998362032 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55788b76b980 0x55788b788ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:03:05.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.611+0000 7f44a6000700 1 --2- 172.21.15.82:0/2998362032 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55788b76f9d0 0x55788b79f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:03:05.612 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.612+0000 7f44a5600700 1 --2- 172.21.15.82:0/2998362032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55788b76b060 0x55788b771d30 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x55788b77e2f0 tx=0x7f448c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7066305ac877aaa server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:03:05.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.612+0000 7f4496000700 1 -- 172.21.15.82:0/2998362032 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f448c00fea0 con 0x55788b76b060 2024-05-08T06:03:05.613 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.612+0000 7f4496000700 1 -- 172.21.15.82:0/2998362032 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f448c004830 con 0x55788b76b060 2024-05-08T06:03:05.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.612+0000 7f4496000700 1 -- 172.21.15.82:0/2998362032 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f448c0054e0 con 0x55788b76b060 2024-05-08T06:03:05.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.613+0000 7f44b28a9b80 1 -- 172.21.15.82:0/2998362032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55788b76b060 msgr2=0x55788b771d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:03:05.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.613+0000 7f44b28a9b80 1 --2- 172.21.15.82:0/2998362032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55788b76b060 0x55788b771d30 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x55788b77e2f0 tx=0x7f448c015000 comp rx=0 tx=0).stop 2024-05-08T06:03:05.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.613+0000 7f44b28a9b80 1 -- 172.21.15.82:0/2998362032 shutdown_connections 2024-05-08T06:03:05.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.613+0000 7f44b28a9b80 1 --2- 172.21.15.82:0/2998362032 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55788b76f9d0 0x55788b79f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:05.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.613+0000 7f44b28a9b80 1 --2- 172.21.15.82:0/2998362032 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55788b76b060 0x55788b771d30 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:05.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.613+0000 7f44b28a9b80 1 --2- 172.21.15.82:0/2998362032 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55788b76b980 0x55788b788ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:05.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.613+0000 7f44b28a9b80 1 -- 172.21.15.82:0/2998362032 >> 172.21.15.82:0/2998362032 conn(0x55788b699b60 msgr2=0x55788b771620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:03:05.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.614+0000 7f44b28a9b80 1 -- 172.21.15.82:0/2998362032 shutdown_connections 2024-05-08T06:03:05.614 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.614+0000 7f44b28a9b80 1 -- 172.21.15.82:0/2998362032 wait complete. 2024-05-08T06:03:05.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.614+0000 7f44b28a9b80 1 -- start start 2024-05-08T06:03:05.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.615+0000 7f44b28a9b80 1 Processor -- start 2024-05-08T06:03:05.615 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.615+0000 7f44b28a9b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55788b76b060 0x55788b783360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:05.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.615+0000 7f44b28a9b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55788b76b980 0x55788b7838a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:05.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.615+0000 7f44b28a9b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55788b76f9d0 0x55788b79e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:05.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.615+0000 7f44b28a9b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f44a01c6550 con 0x55788b76b060 2024-05-08T06:03:05.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.615+0000 7f44b28a9b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f44a01c5e80 con 0x55788b76f9d0 2024-05-08T06:03:05.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.615+0000 7f44b28a9b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f44a01c3020 con 0x55788b76b980 2024-05-08T06:03:05.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.616+0000 7f44b28a9b80 10 client.0 _ll_register_callbacks cb 0x55788b767a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:03:05.616 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.616+0000 7f44a6000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55788b76f9d0 0x55788b79e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:05.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.616+0000 7f44a6000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55788b76f9d0 0x55788b79e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:45244/0 (socket says 172.21.15.82:45244) 2024-05-08T06:03:05.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.616+0000 7f44a4c00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55788b76b980 0x55788b7838a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:05.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.617+0000 7f44a4c00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55788b76b980 0x55788b7838a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:42492/0 (socket says 172.21.15.82:42492) 2024-05-08T06:03:05.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.617+0000 7f44a4c00700 1 -- 172.21.15.82:0/4203650446 learned_addr learned my addr 172.21.15.82:0/4203650446 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:03:05.617 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.617+0000 7f44a5600700 1 --2- 172.21.15.82:0/4203650446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55788b76b060 0x55788b783360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:05.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.618+0000 7f44a5600700 1 -- 172.21.15.82:0/4203650446 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55788b76b980 msgr2=0x55788b7838a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:03:05.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.618+0000 7f44a5600700 1 --2- 172.21.15.82:0/4203650446 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55788b76b980 0x55788b7838a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:05.618 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.618+0000 7f44a5600700 1 -- 172.21.15.82:0/4203650446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55788b76f9d0 msgr2=0x55788b79e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:03:05.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.618+0000 7f44a5600700 1 --2- 172.21.15.82:0/4203650446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55788b76f9d0 0x55788b79e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:05.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.618+0000 7f44a5600700 1 -- 172.21.15.82:0/4203650446 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55788b79ee80 con 0x55788b76b060 2024-05-08T06:03:05.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.618+0000 7f44a4c00700 1 --2- 172.21.15.82:0/4203650446 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55788b76b980 0x55788b7838a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:03:05.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.619+0000 7f44a5600700 1 --2- 172.21.15.82:0/4203650446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55788b76b060 0x55788b783360 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f448c005100 tx=0x7f448c00fa10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fa3169a59b65cbc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:03:05.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.619+0000 7f448b400700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T06:03:05.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.620+0000 7f448b400700 1 -- 172.21.15.82:0/4203650446 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f448c004df0 con 0x55788b76b060 2024-05-08T06:03:05.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.620+0000 7f448b400700 1 -- 172.21.15.82:0/4203650446 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f448c005160 con 0x55788b76b060 2024-05-08T06:03:05.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.620+0000 7f44b28a9b80 1 -- 172.21.15.82:0/4203650446 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f448c004830 con 0x55788b76b060 2024-05-08T06:03:05.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.621+0000 7f448b400700 1 -- 172.21.15.82:0/4203650446 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f448c005360 con 0x55788b76b060 2024-05-08T06:03:05.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.621+0000 7f44b28a9b80 10 client.16110 fetch_fsmap learned FSMap version 31 2024-05-08T06:03:05.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.621+0000 7f44b28a9b80 1 -- 172.21.15.82:0/4203650446 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55788b7ffd10 con 0x55788b76b060 2024-05-08T06:03:05.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.621+0000 7f448b400700 1 -- 172.21.15.82:0/4203650446 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f448c005500 con 0x55788b76b060 2024-05-08T06:03:05.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.622+0000 7f448b400700 1 -- 172.21.15.82:0/4203650446 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f448c026ce0 con 0x55788b76b060 2024-05-08T06:03:05.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.622+0000 7f44b28a9b80 10 client.16110 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:03:05.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.622+0000 7f44b28a9b80 10 client.16110 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-05-08T06:03:05.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.622+0000 7f44b28a9b80 20 client.16110 populate_metadata read hostname 'smithi082' 2024-05-08T06:03:05.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.622+0000 7f44b28a9b80 1 --2- 172.21.15.82:0/4203650446 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55788b800360 0x55788b802780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:05.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.622+0000 7f44b28a9b80 4 client.16110 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T06:03:05.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.622+0000 7f44b28a9b80 1 -- 172.21.15.82:0/4203650446 --> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f448c004830 con 0x55788b800360 2024-05-08T06:03:05.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.622+0000 7f44a4c00700 1 --2- 172.21.15.82:0/4203650446 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55788b800360 0x55788b802780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:05.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.624+0000 7f44a4c00700 1 --2- 172.21.15.82:0/4203650446 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55788b800360 0x55788b802780 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6fd2984816ce97c2 server_cookie=22342bbe9577c6f3 in_seq=0 out_seq=0 2024-05-08T06:03:05.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.624+0000 7f448b400700 10 client.16110 ms_handle_connect on v2:172.21.15.151:6836/4192404464 2024-05-08T06:03:05.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.624+0000 7f448b400700 1 -- 172.21.15.82:0/4203650446 <== mds.2 v2:172.21.15.151:6836/4192404464 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f448c004830 con 0x55788b800360 2024-05-08T06:03:05.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.624+0000 7f448b400700 10 client.16110 handle_command_reply: tid=0 2024-05-08T06:03:05.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.624+0000 7f44b28a9b80 1 client.16110 shutdown 2024-05-08T06:03:05.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.625+0000 7f44b28a9b80 1 -- 172.21.15.82:0/4203650446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55788b76b060 msgr2=0x55788b783360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:03:05.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.625+0000 7f44b28a9b80 1 --2- 172.21.15.82:0/4203650446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55788b76b060 0x55788b783360 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f448c005100 tx=0x7f448c00fa10 comp rx=0 tx=0).stop 2024-05-08T06:03:05.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.625+0000 7f44b28a9b80 1 -- 172.21.15.82:0/4203650446 shutdown_connections 2024-05-08T06:03:05.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.625+0000 7f44b28a9b80 1 --2- 172.21.15.82:0/4203650446 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55788b800360 0x55788b802780 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:05.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.625+0000 7f448b400700 0 client.16110 ms_handle_reset on v2:172.21.15.151:6836/4192404464 2024-05-08T06:03:05.625 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.625+0000 7f44b28a9b80 1 --2- 172.21.15.82:0/4203650446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55788b76f9d0 0x55788b79e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:05.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.625+0000 7f44b28a9b80 1 --2- 172.21.15.82:0/4203650446 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55788b76b060 0x55788b783360 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:05.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.625+0000 7f44b28a9b80 1 --2- 172.21.15.82:0/4203650446 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55788b76b980 0x55788b7838a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:05.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.625+0000 7f44b28a9b80 1 -- 172.21.15.82:0/4203650446 >> 172.21.15.82:0/4203650446 conn(0x55788b699b60 msgr2=0x55788b75fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:03:05.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.625+0000 7f44b28a9b80 1 -- 172.21.15.82:0/4203650446 shutdown_connections 2024-05-08T06:03:05.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.625+0000 7f44b28a9b80 1 -- 172.21.15.82:0/4203650446 wait complete. 2024-05-08T06:03:05.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.625+0000 7f44b28a9b80 20 client.16110 trim_cache size 0 max 16384 2024-05-08T06:03:05.627 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T06:03:05.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.626+0000 7f44a8000700 1 -- 172.21.15.82:0/244750701 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f44840b6e20 msgr2=0x7f44840b92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:03:05.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.626+0000 7f44a8000700 1 --2- 172.21.15.82:0/244750701 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f44840b6e20 0x7f44840b92e0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f448c005e50 tx=0x7f448c005bc0 comp rx=0 tx=0).stop 2024-05-08T06:03:05.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.626+0000 7f44a8000700 1 -- 172.21.15.82:0/244750701 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44a010adc0 msgr2=0x7f44a007b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:03:05.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.626+0000 7f44a8000700 1 --2- 172.21.15.82:0/244750701 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44a010adc0 0x7f44a007b8d0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f449000d980 tx=0x7f449000dd40 comp rx=0 tx=0).stop 2024-05-08T06:03:05.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.627+0000 7f44a8000700 1 -- 172.21.15.82:0/244750701 shutdown_connections 2024-05-08T06:03:05.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.627+0000 7f44a8000700 1 --2- 172.21.15.82:0/244750701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44a01165f0 0x7f44a0076500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:05.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.627+0000 7f44a8000700 1 --2- 172.21.15.82:0/244750701 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f44840b6e20 0x7f44840b92e0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:05.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.627+0000 7f44a8000700 1 --2- 172.21.15.82:0/244750701 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f44a010a4a0 0x7f44a007b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:05.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.627+0000 7f44a8000700 1 --2- 172.21.15.82:0/244750701 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44a010adc0 0x7f44a007b8d0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:05.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.627+0000 7f44a8000700 1 -- 172.21.15.82:0/244750701 >> 172.21.15.82:0/244750701 conn(0x7f44a006e610 msgr2=0x7f44a0072220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:03:05.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.627+0000 7f44a8000700 1 -- 172.21.15.82:0/244750701 shutdown_connections 2024-05-08T06:03:05.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:05.627+0000 7f44a8000700 1 -- 172.21.15.82:0/244750701 wait complete. 2024-05-08T06:03:06.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:03:05 smithi134 ceph-mon[34132]: pgmap v832: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.4 MiB/s wr, 583 op/s 2024-05-08T06:03:06.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:03:05 smithi151 ceph-mon[34815]: pgmap v832: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.4 MiB/s wr, 583 op/s 2024-05-08T06:03:06.391 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:03:05 smithi082 ceph-mon[30098]: pgmap v832: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 5.4 MiB/s wr, 583 op/s 2024-05-08T06:03:06.915 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-05-08T06:03:07.572 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:03:08.151 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:03:07 smithi082 ceph-mon[30098]: pgmap v833: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 8.3 MiB/s wr, 750 op/s 2024-05-08T06:03:08.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:03:07 smithi134 ceph-mon[34132]: pgmap v833: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 8.3 MiB/s wr, 750 op/s 2024-05-08T06:03:08.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:03:07 smithi151 ceph-mon[34815]: pgmap v833: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 8.3 MiB/s wr, 750 op/s 2024-05-08T06:03:10.123 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:03:09 smithi082 ceph-mon[30098]: pgmap v834: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 6.7 MiB/s wr, 594 op/s 2024-05-08T06:03:10.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:03:09 smithi134 ceph-mon[34132]: pgmap v834: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 6.7 MiB/s wr, 594 op/s 2024-05-08T06:03:10.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 740.0 s, 1032.4 tps, lat 94.875 ms stddev 129.011 2024-05-08T06:03:10.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.376+0000 7f56b8a00700 1 -- 172.21.15.82:0/2807823302 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56b4105690 msgr2=0x7f56b4105b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:03:10.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.376+0000 7f56b8a00700 1 --2- 172.21.15.82:0/2807823302 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56b4105690 0x7f56b4105b10 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f56a0009990 tx=0x7f56a0009ca0 comp rx=0 tx=0).stop 2024-05-08T06:03:10.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.376+0000 7f56b8a00700 1 -- 172.21.15.82:0/2807823302 shutdown_connections 2024-05-08T06:03:10.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.376+0000 7f56b8a00700 1 --2- 172.21.15.82:0/2807823302 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56b4106050 0x7f56b4112560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:10.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.376+0000 7f56b8a00700 1 --2- 172.21.15.82:0/2807823302 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56b410b690 0x7f56b410ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:10.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.376+0000 7f56b8a00700 1 --2- 172.21.15.82:0/2807823302 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56b4105690 0x7f56b4105b10 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:10.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.376+0000 7f56b8a00700 1 -- 172.21.15.82:0/2807823302 >> 172.21.15.82:0/2807823302 conn(0x7f56b4101180 msgr2=0x7f56b41035a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:03:10.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.376+0000 7f56b8a00700 1 -- 172.21.15.82:0/2807823302 shutdown_connections 2024-05-08T06:03:10.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.376+0000 7f56b8a00700 1 -- 172.21.15.82:0/2807823302 wait complete. 2024-05-08T06:03:10.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:03:09 smithi151 ceph-mon[34815]: pgmap v834: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 6.7 MiB/s wr, 594 op/s 2024-05-08T06:03:10.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.378+0000 7f56b8a00700 1 Processor -- start 2024-05-08T06:03:10.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.378+0000 7f56b8a00700 1 -- start start 2024-05-08T06:03:10.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.378+0000 7f56b8a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56b4105690 0x7f56b4074be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:10.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.378+0000 7f56b8a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56b4106050 0x7f56b4075120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:10.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.379+0000 7f56b8a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56b410b690 0x7f56b406de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:10.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.379+0000 7f56b8a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f56b4115920 con 0x7f56b410b690 2024-05-08T06:03:10.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.379+0000 7f56b8a00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f56b41157a0 con 0x7f56b4105690 2024-05-08T06:03:10.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.379+0000 7f56b8a00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f56b4115aa0 con 0x7f56b4106050 2024-05-08T06:03:10.380 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.379+0000 7f56b1e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56b4105690 0x7f56b4074be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:10.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.379+0000 7f56b1400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56b4106050 0x7f56b4075120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:10.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.379+0000 7f56b1400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56b4106050 0x7f56b4075120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:42518/0 (socket says 172.21.15.82:42518) 2024-05-08T06:03:10.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.379+0000 7f56b1400700 1 -- 172.21.15.82:0/1566781544 learned_addr learned my addr 172.21.15.82:0/1566781544 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:03:10.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.379+0000 7f56b1e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56b4105690 0x7f56b4074be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:45262/0 (socket says 172.21.15.82:45262) 2024-05-08T06:03:10.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.379+0000 7f56b1400700 1 -- 172.21.15.82:0/1566781544 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56b4105690 msgr2=0x7f56b4074be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:03:10.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.379+0000 7f56b1400700 1 --2- 172.21.15.82:0/1566781544 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56b4105690 0x7f56b4074be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:10.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.379+0000 7f56b1400700 1 -- 172.21.15.82:0/1566781544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56b410b690 msgr2=0x7f56b406de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:03:10.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.379+0000 7f56b1400700 1 --2- 172.21.15.82:0/1566781544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56b410b690 0x7f56b406de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:10.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.379+0000 7f56b1400700 1 -- 172.21.15.82:0/1566781544 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56b406e770 con 0x7f56b4106050 2024-05-08T06:03:10.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.380+0000 7f56b1400700 1 --2- 172.21.15.82:0/1566781544 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56b4106050 0x7f56b4075120 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f56a0005eb0 tx=0x7f56a0005640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:03:10.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.381+0000 7f56aaa00700 1 -- 172.21.15.82:0/1566781544 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a0027070 con 0x7f56b4106050 2024-05-08T06:03:10.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.381+0000 7f56aaa00700 1 -- 172.21.15.82:0/1566781544 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56a0004030 con 0x7f56b4106050 2024-05-08T06:03:10.382 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.381+0000 7f56aaa00700 1 -- 172.21.15.82:0/1566781544 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a0027070 con 0x7f56b4106050 2024-05-08T06:03:10.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.381+0000 7f56b8a00700 1 -- 172.21.15.82:0/1566781544 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56b406ea00 con 0x7f56b4106050 2024-05-08T06:03:10.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.381+0000 7f56b8a00700 1 -- 172.21.15.82:0/1566781544 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56b40728e0 con 0x7f56b4106050 2024-05-08T06:03:10.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.388+0000 7f56aaa00700 1 -- 172.21.15.82:0/1566781544 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f56a0022470 con 0x7f56b4106050 2024-05-08T06:03:10.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.391+0000 7f56aaa00700 1 --2- 172.21.15.82:0/1566781544 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f56980b2b80 0x7f56980b5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:10.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.391+0000 7f56aaa00700 1 -- 172.21.15.82:0/1566781544 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f56a00e3020 con 0x7f56b4106050 2024-05-08T06:03:10.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.391+0000 7f56b1e00700 1 --2- 172.21.15.82:0/1566781544 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f56980b2b80 0x7f56980b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:10.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.393+0000 7f56c337bb80 1 Processor -- start 2024-05-08T06:03:10.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.393+0000 7f56b1e00700 1 --2- 172.21.15.82:0/1566781544 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f56980b2b80 0x7f56980b5040 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f56a4005ea0 tx=0x7f56a4005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:03:10.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.393+0000 7f56c337bb80 1 -- start start 2024-05-08T06:03:10.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.394+0000 7f56c337bb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f03e67d3e0 0x55f03e67d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:10.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.394+0000 7f56c337bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f03e67dd00 0x55f03e66f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:10.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.394+0000 7f56c337bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f03e66f8f0 0x55f03e66fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:10.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.395+0000 7f56c337bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f03e5c1a20 con 0x55f03e67dd00 2024-05-08T06:03:10.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.395+0000 7f56c337bb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f03e55f760 con 0x55f03e67d3e0 2024-05-08T06:03:10.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.395+0000 7f56c337bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55f03e5bd9e0 con 0x55f03e66f8f0 2024-05-08T06:03:10.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.395+0000 7f56b1e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f03e67d3e0 0x55f03e67d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:10.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.395+0000 7f56b1e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f03e67d3e0 0x55f03e67d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:45276/0 (socket says 172.21.15.82:45276) 2024-05-08T06:03:10.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.395+0000 7f56b1e00700 1 -- 172.21.15.82:0/2371094513 learned_addr learned my addr 172.21.15.82:0/2371094513 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:03:10.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.395+0000 7f56b2800700 1 --2- 172.21.15.82:0/2371094513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f03e66f8f0 0x55f03e66fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:10.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.396+0000 7f56b1e00700 1 -- 172.21.15.82:0/2371094513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f03e66f8f0 msgr2=0x55f03e66fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:03:10.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.396+0000 7f56b1e00700 1 --2- 172.21.15.82:0/2371094513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f03e66f8f0 0x55f03e66fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:10.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.396+0000 7f56b1e00700 1 -- 172.21.15.82:0/2371094513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f03e67dd00 msgr2=0x55f03e66f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:03:10.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.396+0000 7f56b1e00700 1 --2- 172.21.15.82:0/2371094513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f03e67dd00 0x55f03e66f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:10.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.396+0000 7f56b1e00700 1 -- 172.21.15.82:0/2371094513 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f03e50e8d0 con 0x55f03e67d3e0 2024-05-08T06:03:10.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.396+0000 7f56b2800700 1 --2- 172.21.15.82:0/2371094513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f03e66f8f0 0x55f03e66fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:03:10.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.396+0000 7f56b1e00700 1 --2- 172.21.15.82:0/2371094513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f03e67d3e0 0x55f03e67d7c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f56a400a520 tx=0x7f56a400af90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9e9e1f80c40994a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:03:10.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.397+0000 7f569f400700 1 -- 172.21.15.82:0/2371094513 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a4010d80 con 0x55f03e67d3e0 2024-05-08T06:03:10.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.397+0000 7f569f400700 1 -- 172.21.15.82:0/2371094513 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56a4022070 con 0x55f03e67d3e0 2024-05-08T06:03:10.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.397+0000 7f569f400700 1 -- 172.21.15.82:0/2371094513 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a400f7e0 con 0x55f03e67d3e0 2024-05-08T06:03:10.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.398+0000 7f56c337bb80 1 -- 172.21.15.82:0/2371094513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f03e67d3e0 msgr2=0x55f03e67d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:03:10.398 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.398+0000 7f56c337bb80 1 --2- 172.21.15.82:0/2371094513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f03e67d3e0 0x55f03e67d7c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f56a400a520 tx=0x7f56a400af90 comp rx=0 tx=0).stop 2024-05-08T06:03:10.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.398+0000 7f56c337bb80 1 -- 172.21.15.82:0/2371094513 shutdown_connections 2024-05-08T06:03:10.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.398+0000 7f56c337bb80 1 --2- 172.21.15.82:0/2371094513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f03e67d3e0 0x55f03e67d7c0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:10.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.398+0000 7f56c337bb80 1 --2- 172.21.15.82:0/2371094513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f03e66f8f0 0x55f03e66fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:10.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.398+0000 7f56c337bb80 1 --2- 172.21.15.82:0/2371094513 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f03e67dd00 0x55f03e66f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:10.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.398+0000 7f56c337bb80 1 -- 172.21.15.82:0/2371094513 >> 172.21.15.82:0/2371094513 conn(0x55f03e5e76d0 msgr2=0x55f03e669b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:03:10.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.398+0000 7f56c337bb80 1 -- 172.21.15.82:0/2371094513 shutdown_connections 2024-05-08T06:03:10.399 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.398+0000 7f56c337bb80 1 -- 172.21.15.82:0/2371094513 wait complete. 2024-05-08T06:03:10.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.399+0000 7f56c337bb80 1 -- start start 2024-05-08T06:03:10.400 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.399+0000 7f56c337bb80 1 Processor -- start 2024-05-08T06:03:10.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.400+0000 7f56c337bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f03e66f8f0 0x55f03e683ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:10.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.400+0000 7f56c337bb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f03e67d3e0 0x55f03e680e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:10.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.400+0000 7f56c337bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f03e67dd00 0x55f03e6813a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:10.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.400+0000 7f56c337bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f03e684740 con 0x55f03e67dd00 2024-05-08T06:03:10.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.400+0000 7f56c337bb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f03e527b20 con 0x55f03e67d3e0 2024-05-08T06:03:10.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.400+0000 7f56c337bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55f03e6848c0 con 0x55f03e66f8f0 2024-05-08T06:03:10.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.400+0000 7f56c337bb80 10 client.0 _ll_register_callbacks cb 0x55f03e568c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:03:10.401 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.401+0000 7f56b1400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f03e67d3e0 0x55f03e680e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:10.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.401+0000 7f56b1400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f03e67d3e0 0x55f03e680e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:45292/0 (socket says 172.21.15.82:45292) 2024-05-08T06:03:10.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.401+0000 7f56b1400700 1 -- 172.21.15.82:0/1968401697 learned_addr learned my addr 172.21.15.82:0/1968401697 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:03:10.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.401+0000 7f56b1e00700 1 --2- 172.21.15.82:0/1968401697 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f03e66f8f0 0x55f03e683ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:10.402 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.401+0000 7f56b2800700 1 --2- 172.21.15.82:0/1968401697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f03e67dd00 0x55f03e6813a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:10.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.401+0000 7f56b1e00700 1 -- 172.21.15.82:0/1968401697 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f03e67d3e0 msgr2=0x55f03e680e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:03:10.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.401+0000 7f56b1e00700 1 --2- 172.21.15.82:0/1968401697 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f03e67d3e0 0x55f03e680e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:10.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.401+0000 7f56b1e00700 1 -- 172.21.15.82:0/1968401697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f03e67dd00 msgr2=0x55f03e6813a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:03:10.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.402+0000 7f56b1e00700 1 --2- 172.21.15.82:0/1968401697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f03e67dd00 0x55f03e6813a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:10.403 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.402+0000 7f56b1e00700 1 -- 172.21.15.82:0/1968401697 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f03e587420 con 0x55f03e66f8f0 2024-05-08T06:03:10.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.402+0000 7f56b1400700 1 --2- 172.21.15.82:0/1968401697 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f03e67d3e0 0x55f03e680e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:03:10.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.402+0000 7f56b1e00700 1 --2- 172.21.15.82:0/1968401697 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f03e66f8f0 0x55f03e683ac0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f56a401df60 tx=0x7f56a40052f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d4df927bf0b9867 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:03:10.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.402+0000 7f5693e00700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T06:03:10.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.403+0000 7f5693e00700 1 -- 172.21.15.82:0/1968401697 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a4004710 con 0x55f03e66f8f0 2024-05-08T06:03:10.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.403+0000 7f5693e00700 1 -- 172.21.15.82:0/1968401697 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f56a40048b0 con 0x55f03e66f8f0 2024-05-08T06:03:10.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.403+0000 7f56c337bb80 1 -- 172.21.15.82:0/1968401697 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56a4022070 con 0x55f03e66f8f0 2024-05-08T06:03:10.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.404+0000 7f5693e00700 1 -- 172.21.15.82:0/1968401697 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f56a4004ab0 con 0x55f03e66f8f0 2024-05-08T06:03:10.404 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.404+0000 7f56c337bb80 10 client.26599 fetch_fsmap learned FSMap version 31 2024-05-08T06:03:10.405 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.404+0000 7f56c337bb80 1 -- 172.21.15.82:0/1968401697 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55f03e68f0d0 con 0x55f03e66f8f0 2024-05-08T06:03:10.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.405+0000 7f5693e00700 1 -- 172.21.15.82:0/1968401697 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56a4022070 con 0x55f03e66f8f0 2024-05-08T06:03:10.406 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.405+0000 7f5693e00700 1 -- 172.21.15.82:0/1968401697 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f56a4031480 con 0x55f03e66f8f0 2024-05-08T06:03:10.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.406+0000 7f56c337bb80 10 client.26599 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:03:10.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.406+0000 7f56c337bb80 10 client.26599 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-08T06:03:10.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.406+0000 7f56c337bb80 20 client.26599 populate_metadata read hostname 'smithi082' 2024-05-08T06:03:10.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.406+0000 7f56c337bb80 1 --2- 172.21.15.82:0/1968401697 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x55f03e691650 0x55f03e693a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:10.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.406+0000 7f56c337bb80 4 client.26599 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:03:10.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.406+0000 7f56c337bb80 1 -- 172.21.15.82:0/1968401697 --> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f03e63c140 con 0x55f03e691650 2024-05-08T06:03:10.408 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.406+0000 7f56b1400700 1 --2- 172.21.15.82:0/1968401697 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x55f03e691650 0x55f03e693a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:10.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.409+0000 7f5693e00700 10 client.26599 ms_handle_connect on v2:172.21.15.151:6838/2963754236 2024-05-08T06:03:10.409 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.408+0000 7f56b1400700 1 --2- 172.21.15.82:0/1968401697 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x55f03e691650 0x55f03e693a40 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=48aa941a4b196ea6 server_cookie=f133debf43fe2b68 in_seq=0 out_seq=0 2024-05-08T06:03:10.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.409+0000 7f5693e00700 1 -- 172.21.15.82:0/1968401697 <== mds.1 v2:172.21.15.151:6838/2963754236 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f03e63c140 con 0x55f03e691650 2024-05-08T06:03:10.410 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.409+0000 7f5693e00700 10 client.26599 handle_command_reply: tid=0 2024-05-08T06:03:10.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.411+0000 7f56c337bb80 1 client.26599 shutdown 2024-05-08T06:03:10.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.411+0000 7f56c337bb80 1 -- 172.21.15.82:0/1968401697 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f03e66f8f0 msgr2=0x55f03e683ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:03:10.411 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.411+0000 7f56c337bb80 1 --2- 172.21.15.82:0/1968401697 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f03e66f8f0 0x55f03e683ac0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f56a401df60 tx=0x7f56a40052f0 comp rx=0 tx=0).stop 2024-05-08T06:03:10.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.411+0000 7f56c337bb80 1 -- 172.21.15.82:0/1968401697 shutdown_connections 2024-05-08T06:03:10.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.411+0000 7f56c337bb80 1 --2- 172.21.15.82:0/1968401697 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x55f03e691650 0x55f03e693a40 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:10.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.411+0000 7f56c337bb80 1 --2- 172.21.15.82:0/1968401697 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f03e67dd00 0x55f03e6813a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:10.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.411+0000 7f5693e00700 0 client.26599 ms_handle_reset on v2:172.21.15.151:6838/2963754236 2024-05-08T06:03:10.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.411+0000 7f56c337bb80 1 --2- 172.21.15.82:0/1968401697 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f03e66f8f0 0x55f03e683ac0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:10.412 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.411+0000 7f56c337bb80 1 --2- 172.21.15.82:0/1968401697 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f03e67d3e0 0x55f03e680e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:10.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.411+0000 7f56c337bb80 1 -- 172.21.15.82:0/1968401697 >> 172.21.15.82:0/1968401697 conn(0x55f03e5e76d0 msgr2=0x55f03e669190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:03:10.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.412+0000 7f56c337bb80 1 -- 172.21.15.82:0/1968401697 shutdown_connections 2024-05-08T06:03:10.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.412+0000 7f56c337bb80 1 -- 172.21.15.82:0/1968401697 wait complete. 2024-05-08T06:03:10.413 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.413+0000 7f56c337bb80 20 client.26599 trim_cache size 0 max 16384 2024-05-08T06:03:10.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.439+0000 7f56c337bb80 1 Processor -- start 2024-05-08T06:03:10.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.439+0000 7f56c337bb80 1 -- start start 2024-05-08T06:03:10.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.440+0000 7f56c337bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f03e66f8f0 0x55f03e66f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:10.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.440+0000 7f56c337bb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f03e67d3e0 0x55f03e67fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:10.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.440+0000 7f56c337bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f03e67dd00 0x55f03e67e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:10.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.440+0000 7f56c337bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f56b41b4170 con 0x55f03e67dd00 2024-05-08T06:03:10.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.440+0000 7f56c337bb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f56b41b5cb0 con 0x55f03e67d3e0 2024-05-08T06:03:10.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.440+0000 7f56c337bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f56b41b4840 con 0x55f03e66f8f0 2024-05-08T06:03:10.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.440+0000 7f56b1e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f03e66f8f0 0x55f03e66f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:10.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.440+0000 7f56b1e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f03e66f8f0 0x55f03e66f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:42544/0 (socket says 172.21.15.82:42544) 2024-05-08T06:03:10.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.440+0000 7f56b1e00700 1 -- 172.21.15.82:0/4208476385 learned_addr learned my addr 172.21.15.82:0/4208476385 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:03:10.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.441+0000 7f56b2800700 1 --2- 172.21.15.82:0/4208476385 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f03e67dd00 0x55f03e67e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:10.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.441+0000 7f56b1400700 1 --2- 172.21.15.82:0/4208476385 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f03e67d3e0 0x55f03e67fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:10.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.441+0000 7f56b1e00700 1 -- 172.21.15.82:0/4208476385 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f03e67d3e0 msgr2=0x55f03e67fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:03:10.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.441+0000 7f56b1e00700 1 --2- 172.21.15.82:0/4208476385 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f03e67d3e0 0x55f03e67fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:10.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.441+0000 7f56b1e00700 1 -- 172.21.15.82:0/4208476385 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f03e67dd00 msgr2=0x55f03e67e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:03:10.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.441+0000 7f56b1e00700 1 --2- 172.21.15.82:0/4208476385 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f03e67dd00 0x55f03e67e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:10.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.441+0000 7f56b1e00700 1 -- 172.21.15.82:0/4208476385 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f03e67f3d0 con 0x55f03e66f8f0 2024-05-08T06:03:10.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.441+0000 7f56b1400700 1 --2- 172.21.15.82:0/4208476385 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f03e67d3e0 0x55f03e67fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:03:10.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.441+0000 7f56b2800700 1 --2- 172.21.15.82:0/4208476385 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f03e67dd00 0x55f03e67e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:03:10.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.442+0000 7f56b1e00700 1 --2- 172.21.15.82:0/4208476385 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f03e66f8f0 0x55f03e66f2d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f56a400b010 tx=0x7f56a400a980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a683f79629da0b5a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:03:10.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.442+0000 7f569ea00700 1 -- 172.21.15.82:0/4208476385 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a4014050 con 0x55f03e66f8f0 2024-05-08T06:03:10.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.442+0000 7f569ea00700 1 -- 172.21.15.82:0/4208476385 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56a403f070 con 0x55f03e66f8f0 2024-05-08T06:03:10.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.442+0000 7f569ea00700 1 -- 172.21.15.82:0/4208476385 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a4004c50 con 0x55f03e66f8f0 2024-05-08T06:03:10.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.443+0000 7f56c337bb80 1 -- 172.21.15.82:0/4208476385 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f03e66f8f0 msgr2=0x55f03e66f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:03:10.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.443+0000 7f56c337bb80 1 --2- 172.21.15.82:0/4208476385 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f03e66f8f0 0x55f03e66f2d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f56a400b010 tx=0x7f56a400a980 comp rx=0 tx=0).stop 2024-05-08T06:03:10.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.443+0000 7f56c337bb80 1 -- 172.21.15.82:0/4208476385 shutdown_connections 2024-05-08T06:03:10.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.443+0000 7f56c337bb80 1 --2- 172.21.15.82:0/4208476385 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f03e67dd00 0x55f03e67e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:10.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.443+0000 7f56c337bb80 1 --2- 172.21.15.82:0/4208476385 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f03e66f8f0 0x55f03e66f2d0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:10.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.443+0000 7f56c337bb80 1 --2- 172.21.15.82:0/4208476385 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f03e67d3e0 0x55f03e67fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:10.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.443+0000 7f56c337bb80 1 -- 172.21.15.82:0/4208476385 >> 172.21.15.82:0/4208476385 conn(0x55f03e5e76d0 msgr2=0x55f03e67bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:03:10.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.443+0000 7f56c337bb80 1 -- 172.21.15.82:0/4208476385 shutdown_connections 2024-05-08T06:03:10.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.443+0000 7f56c337bb80 1 -- 172.21.15.82:0/4208476385 wait complete. 2024-05-08T06:03:10.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.444+0000 7f56c337bb80 1 -- start start 2024-05-08T06:03:10.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.445+0000 7f56c337bb80 1 Processor -- start 2024-05-08T06:03:10.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.446+0000 7f56c337bb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f03e66f8f0 0x55f03e689b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:10.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.446+0000 7f56c337bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f03e67d3e0 0x55f03e68a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:10.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.446+0000 7f56c337bb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f03e67dd00 0x55f03e698030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:10.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.446+0000 7f56c337bb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f56b41b55e0 con 0x55f03e66f8f0 2024-05-08T06:03:10.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.446+0000 7f56c337bb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f56b41b4f10 con 0x55f03e67dd00 2024-05-08T06:03:10.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.446+0000 7f56c337bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f56b41b2110 con 0x55f03e67d3e0 2024-05-08T06:03:10.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.446+0000 7f56c337bb80 10 client.0 _ll_register_callbacks cb 0x55f03e66bed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:03:10.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.446+0000 7f56b1400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f03e67d3e0 0x55f03e68a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:10.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.446+0000 7f56b1400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f03e67d3e0 0x55f03e68a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:42546/0 (socket says 172.21.15.82:42546) 2024-05-08T06:03:10.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.446+0000 7f56b2800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f03e67dd00 0x55f03e698030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:10.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.446+0000 7f56b1400700 1 -- 172.21.15.82:0/1082404503 learned_addr learned my addr 172.21.15.82:0/1082404503 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:03:10.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.447+0000 7f56b1400700 1 -- 172.21.15.82:0/1082404503 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f03e67dd00 msgr2=0x55f03e698030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:03:10.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.447+0000 7f56b1e00700 1 --2- 172.21.15.82:0/1082404503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f03e66f8f0 0x55f03e689b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:10.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.448+0000 7f56b1400700 1 --2- 172.21.15.82:0/1082404503 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f03e67dd00 0x55f03e698030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:10.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.448+0000 7f56b1400700 1 -- 172.21.15.82:0/1082404503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f03e66f8f0 msgr2=0x55f03e689b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:03:10.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.448+0000 7f56b1400700 1 --2- 172.21.15.82:0/1082404503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f03e66f8f0 0x55f03e689b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:10.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.448+0000 7f56b1400700 1 -- 172.21.15.82:0/1082404503 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f03e698570 con 0x55f03e67d3e0 2024-05-08T06:03:10.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.448+0000 7f56b2800700 1 --2- 172.21.15.82:0/1082404503 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f03e67dd00 0x55f03e698030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:03:10.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.448+0000 7f56b1e00700 1 --2- 172.21.15.82:0/1082404503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f03e66f8f0 0x55f03e689b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:03:10.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.449+0000 7f56b1400700 1 --2- 172.21.15.82:0/1082404503 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f03e67d3e0 0x55f03e68a090 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f56a00e0b20 tx=0x7f56a00cd040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ff4c2787c4442c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:03:10.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.449+0000 7f5693e00700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T06:03:10.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.449+0000 7f5693e00700 1 -- 172.21.15.82:0/1082404503 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56a00aa680 con 0x55f03e67d3e0 2024-05-08T06:03:10.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.450+0000 7f5693e00700 1 -- 172.21.15.82:0/1082404503 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f56a00b2fc0 con 0x55f03e67d3e0 2024-05-08T06:03:10.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.450+0000 7f56c337bb80 1 -- 172.21.15.82:0/1082404503 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56a403f070 con 0x55f03e67d3e0 2024-05-08T06:03:10.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.451+0000 7f5693e00700 1 -- 172.21.15.82:0/1082404503 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f56a00aea30 con 0x55f03e67d3e0 2024-05-08T06:03:10.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.451+0000 7f56c337bb80 10 client.26605 fetch_fsmap learned FSMap version 31 2024-05-08T06:03:10.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.451+0000 7f56c337bb80 1 -- 172.21.15.82:0/1082404503 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55f03e6fb360 con 0x55f03e67d3e0 2024-05-08T06:03:10.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.452+0000 7f5693e00700 1 -- 172.21.15.82:0/1082404503 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f56a403f070 con 0x55f03e67d3e0 2024-05-08T06:03:10.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.452+0000 7f5693e00700 1 -- 172.21.15.82:0/1082404503 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f56a00a98e0 con 0x55f03e67d3e0 2024-05-08T06:03:10.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.452+0000 7f56c337bb80 10 client.26605 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:03:10.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.452+0000 7f56c337bb80 10 client.26605 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-08T06:03:10.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.452+0000 7f56c337bb80 20 client.26605 populate_metadata read hostname 'smithi082' 2024-05-08T06:03:10.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.452+0000 7f56c337bb80 1 --2- 172.21.15.82:0/1082404503 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x55f03e691650 0x55f03e6fda90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:10.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.452+0000 7f56c337bb80 4 client.26605 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T06:03:10.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.453+0000 7f56c337bb80 1 -- 172.21.15.82:0/1082404503 --> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f03e5cf400 con 0x55f03e691650 2024-05-08T06:03:10.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.453+0000 7f56b1e00700 1 --2- 172.21.15.82:0/1082404503 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x55f03e691650 0x55f03e6fda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:10.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.454+0000 7f5693e00700 10 client.26605 ms_handle_connect on v2:172.21.15.151:6838/2963754236 2024-05-08T06:03:10.455 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.454+0000 7f56b1e00700 1 --2- 172.21.15.82:0/1082404503 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x55f03e691650 0x55f03e6fda90 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4d2044c34e8540b9 server_cookie=48cc3109881f5a84 in_seq=0 out_seq=0 2024-05-08T06:03:10.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.457+0000 7f5693e00700 1 -- 172.21.15.82:0/1082404503 <== mds.1 v2:172.21.15.151:6838/2963754236 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f03e5cf400 con 0x55f03e691650 2024-05-08T06:03:10.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.457+0000 7f5693e00700 10 client.26605 handle_command_reply: tid=0 2024-05-08T06:03:10.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.457+0000 7f56c337bb80 1 client.26605 shutdown 2024-05-08T06:03:10.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.458+0000 7f56c337bb80 1 -- 172.21.15.82:0/1082404503 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f03e67d3e0 msgr2=0x55f03e68a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:03:10.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.458+0000 7f56c337bb80 1 --2- 172.21.15.82:0/1082404503 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f03e67d3e0 0x55f03e68a090 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f56a00e0b20 tx=0x7f56a00cd040 comp rx=0 tx=0).stop 2024-05-08T06:03:10.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.458+0000 7f56c337bb80 1 -- 172.21.15.82:0/1082404503 shutdown_connections 2024-05-08T06:03:10.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.458+0000 7f56c337bb80 1 --2- 172.21.15.82:0/1082404503 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x55f03e691650 0x55f03e6fda90 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:10.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.458+0000 7f56c337bb80 1 --2- 172.21.15.82:0/1082404503 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f03e67dd00 0x55f03e698030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:10.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.458+0000 7f56c337bb80 1 --2- 172.21.15.82:0/1082404503 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f03e66f8f0 0x55f03e689b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:10.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.458+0000 7f56c337bb80 1 --2- 172.21.15.82:0/1082404503 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f03e67d3e0 0x55f03e68a090 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:10.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.458+0000 7f56c337bb80 1 -- 172.21.15.82:0/1082404503 >> 172.21.15.82:0/1082404503 conn(0x55f03e5e76d0 msgr2=0x55f03e67e810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:03:10.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.458+0000 7f5693e00700 0 client.26605 ms_handle_reset on v2:172.21.15.151:6838/2963754236 2024-05-08T06:03:10.459 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.458+0000 7f56c337bb80 1 -- 172.21.15.82:0/1082404503 shutdown_connections 2024-05-08T06:03:10.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.459+0000 7f56c337bb80 1 -- 172.21.15.82:0/1082404503 wait complete. 2024-05-08T06:03:10.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.459+0000 7f56c337bb80 20 client.26605 trim_cache size 0 max 16384 2024-05-08T06:03:10.461 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T06:03:10.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.463+0000 7f56b8a00700 1 -- 172.21.15.82:0/1566781544 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f56980b2b80 msgr2=0x7f56980b5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:03:10.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.463+0000 7f56b8a00700 1 --2- 172.21.15.82:0/1566781544 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f56980b2b80 0x7f56980b5040 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f56a4005ea0 tx=0x7f56a4005e30 comp rx=0 tx=0).stop 2024-05-08T06:03:10.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.463+0000 7f56b8a00700 1 -- 172.21.15.82:0/1566781544 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56b4106050 msgr2=0x7f56b4075120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:03:10.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.463+0000 7f56b8a00700 1 --2- 172.21.15.82:0/1566781544 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56b4106050 0x7f56b4075120 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f56a0005eb0 tx=0x7f56a0005640 comp rx=0 tx=0).stop 2024-05-08T06:03:10.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.464+0000 7f56b8a00700 1 -- 172.21.15.82:0/1566781544 shutdown_connections 2024-05-08T06:03:10.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.464+0000 7f56b8a00700 1 --2- 172.21.15.82:0/1566781544 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56b4105690 0x7f56b4074be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:10.464 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.464+0000 7f56b8a00700 1 --2- 172.21.15.82:0/1566781544 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f56980b2b80 0x7f56980b5040 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:10.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.464+0000 7f56b8a00700 1 --2- 172.21.15.82:0/1566781544 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f56b410b690 0x7f56b406de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:10.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.464+0000 7f56b8a00700 1 --2- 172.21.15.82:0/1566781544 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56b4106050 0x7f56b4075120 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:10.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.464+0000 7f56b8a00700 1 -- 172.21.15.82:0/1566781544 >> 172.21.15.82:0/1566781544 conn(0x7f56b4101180 msgr2=0x7f56b4101700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:03:10.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.464+0000 7f56b8a00700 1 -- 172.21.15.82:0/1566781544 shutdown_connections 2024-05-08T06:03:10.465 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:10.464+0000 7f56b8a00700 1 -- 172.21.15.82:0/1566781544 wait complete. 2024-05-08T06:03:12.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:03:12 smithi151 ceph-mon[34815]: pgmap v835: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 9.5 MiB/s wr, 681 op/s 2024-05-08T06:03:12.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:03:12 smithi082 ceph-mon[30098]: pgmap v835: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 9.5 MiB/s wr, 681 op/s 2024-05-08T06:03:12.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:03:12 smithi134 ceph-mon[34132]: pgmap v835: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 9.5 MiB/s wr, 681 op/s 2024-05-08T06:03:12.689 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-05-08T06:03:13.282 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:03:14.090 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:03:14 smithi082 ceph-mon[30098]: pgmap v836: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 11 MiB/s wr, 712 op/s 2024-05-08T06:03:14.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:03:14 smithi151 ceph-mon[34815]: pgmap v836: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 11 MiB/s wr, 712 op/s 2024-05-08T06:03:14.499 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:03:14 smithi134 ceph-mon[34132]: pgmap v836: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 11 MiB/s wr, 712 op/s 2024-05-08T06:03:15.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 745.0 s, 1273.6 tps, lat 79.940 ms stddev 106.649 2024-05-08T06:03:15.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.938+0000 7f849b000700 1 -- 172.21.15.82:0/4067594377 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8494109510 msgr2=0x7f84941098f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:03:15.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.938+0000 7f849b000700 1 --2- 172.21.15.82:0/4067594377 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8494109510 0x7f84941098f0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f8484009990 tx=0x7f8484009ca0 comp rx=0 tx=0).stop 2024-05-08T06:03:15.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.939+0000 7f849b000700 1 -- 172.21.15.82:0/4067594377 shutdown_connections 2024-05-08T06:03:15.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.939+0000 7f849b000700 1 --2- 172.21.15.82:0/4067594377 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8494109510 0x7f84941098f0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:15.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.939+0000 7f849b000700 1 --2- 172.21.15.82:0/4067594377 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f849406bb40 0x7f8494110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:15.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.939+0000 7f849b000700 1 --2- 172.21.15.82:0/4067594377 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f849406b180 0x7f849406b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:15.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.939+0000 7f849b000700 1 -- 172.21.15.82:0/4067594377 >> 172.21.15.82:0/4067594377 conn(0x7f8494079350 msgr2=0x7f8494079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:03:15.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.941+0000 7f849b000700 1 -- 172.21.15.82:0/4067594377 shutdown_connections 2024-05-08T06:03:15.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.941+0000 7f849b000700 1 -- 172.21.15.82:0/4067594377 wait complete. 2024-05-08T06:03:15.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.942+0000 7f849b000700 1 Processor -- start 2024-05-08T06:03:15.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.943+0000 7f849b000700 1 -- start start 2024-05-08T06:03:15.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.943+0000 7f849b000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f849406b180 0x7f849419bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:15.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.943+0000 7f849b000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f849406bb40 0x7f849419c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:15.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.945+0000 7f8493400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f849406bb40 0x7f849419c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:15.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.945+0000 7f8493e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f849406b180 0x7f849419bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:15.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.945+0000 7f8493e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f849406b180 0x7f849419bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:38484/0 (socket says 172.21.15.82:38484) 2024-05-08T06:03:15.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.945+0000 7f8493e00700 1 -- 172.21.15.82:0/3226708434 learned_addr learned my addr 172.21.15.82:0/3226708434 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:03:15.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.945+0000 7f849b000700 1 --2- 172.21.15.82:0/3226708434 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8494109510 0x7f84941a0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:15.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.945+0000 7f849b000700 1 -- 172.21.15.82:0/3226708434 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f84941136e0 con 0x7f849406bb40 2024-05-08T06:03:15.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.945+0000 7f849b000700 1 -- 172.21.15.82:0/3226708434 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8494113560 con 0x7f849406b180 2024-05-08T06:03:15.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.945+0000 7f849b000700 1 -- 172.21.15.82:0/3226708434 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8494113860 con 0x7f8494109510 2024-05-08T06:03:15.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.945+0000 7f8499000700 1 --2- 172.21.15.82:0/3226708434 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8494109510 0x7f84941a0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:15.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.946+0000 7f8493400700 1 -- 172.21.15.82:0/3226708434 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8494109510 msgr2=0x7f84941a0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:03:15.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.946+0000 7f8493400700 1 --2- 172.21.15.82:0/3226708434 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8494109510 0x7f84941a0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:15.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.946+0000 7f8493400700 1 -- 172.21.15.82:0/3226708434 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f849406b180 msgr2=0x7f849419bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:03:15.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.946+0000 7f8493400700 1 --2- 172.21.15.82:0/3226708434 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f849406b180 0x7f849419bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:15.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.946+0000 7f8493400700 1 -- 172.21.15.82:0/3226708434 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84941a0db0 con 0x7f849406bb40 2024-05-08T06:03:15.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.947+0000 7f8493400700 1 --2- 172.21.15.82:0/3226708434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f849406bb40 0x7f849419c2e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f848000d950 tx=0x7f848000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:03:15.952 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.952+0000 7f8490c00700 1 -- 172.21.15.82:0/3226708434 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8480017070 con 0x7f849406bb40 2024-05-08T06:03:15.954 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.952+0000 7f8490c00700 1 -- 172.21.15.82:0/3226708434 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f848000be10 con 0x7f849406bb40 2024-05-08T06:03:15.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.952+0000 7f8490c00700 1 -- 172.21.15.82:0/3226708434 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f848000f3c0 con 0x7f849406bb40 2024-05-08T06:03:15.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.952+0000 7f849b000700 1 -- 172.21.15.82:0/3226708434 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84941a10a0 con 0x7f849406bb40 2024-05-08T06:03:15.956 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.952+0000 7f849b000700 1 -- 172.21.15.82:0/3226708434 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f849410a270 con 0x7f849406bb40 2024-05-08T06:03:15.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.963+0000 7f8490c00700 1 -- 172.21.15.82:0/3226708434 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f848001a070 con 0x7f849406bb40 2024-05-08T06:03:15.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.965+0000 7f84a5921b80 1 Processor -- start 2024-05-08T06:03:15.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.965+0000 7f84a5921b80 1 -- start start 2024-05-08T06:03:15.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.967+0000 7f8490c00700 1 --2- 172.21.15.82:0/3226708434 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f84780b29c0 0x7f84780b4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:15.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.967+0000 7f8490c00700 1 -- 172.21.15.82:0/3226708434 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f84800e1a20 con 0x7f849406bb40 2024-05-08T06:03:15.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.968+0000 7f84a5921b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56324d76cbc0 0x56324d76cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:15.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.969+0000 7f84a5921b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56324d76d4e0 0x56324d7672d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:15.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.969+0000 7f84a5921b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56324d7678f0 0x56324d767d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:15.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.969+0000 7f84a5921b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56324d6b9a20 con 0x56324d7678f0 2024-05-08T06:03:15.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.969+0000 7f84a5921b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56324d657760 con 0x56324d76cbc0 2024-05-08T06:03:15.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.969+0000 7f84a5921b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56324d6b59e0 con 0x56324d76d4e0 2024-05-08T06:03:15.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.970+0000 7f8493e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56324d76cbc0 0x56324d76cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:15.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.971+0000 7f8493400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56324d76d4e0 0x56324d7672d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:15.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.971+0000 7f8493400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56324d76d4e0 0x56324d7672d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:53124/0 (socket says 172.21.15.82:53124) 2024-05-08T06:03:15.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.971+0000 7f8493400700 1 -- 172.21.15.82:0/3118634135 learned_addr learned my addr 172.21.15.82:0/3118634135 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:03:15.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.971+0000 7f8499000700 1 --2- 172.21.15.82:0/3226708434 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f84780b29c0 0x7f84780b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:15.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.972+0000 7f8493400700 1 -- 172.21.15.82:0/3118634135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56324d76cbc0 msgr2=0x56324d76cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:03:15.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.972+0000 7f8493400700 1 --2- 172.21.15.82:0/3118634135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56324d76cbc0 0x56324d76cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:15.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.972+0000 7f8493400700 1 -- 172.21.15.82:0/3118634135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56324d7678f0 msgr2=0x56324d767d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:03:15.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.972+0000 7f8493400700 1 --2- 172.21.15.82:0/3118634135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56324d7678f0 0x56324d767d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:15.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.972+0000 7f8493400700 1 -- 172.21.15.82:0/3118634135 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56324d6068d0 con 0x56324d76d4e0 2024-05-08T06:03:15.973 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.973+0000 7f8493400700 1 --2- 172.21.15.82:0/3118634135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56324d76d4e0 0x56324d7672d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f84800a6260 tx=0x7f848000df50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84270d43af15b31c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:03:15.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.973+0000 7f8489600700 1 -- 172.21.15.82:0/3118634135 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8480021070 con 0x56324d76d4e0 2024-05-08T06:03:15.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.974+0000 7f8489600700 1 -- 172.21.15.82:0/3118634135 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f84800ad3a0 con 0x56324d76d4e0 2024-05-08T06:03:15.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.974+0000 7f8489600700 1 -- 172.21.15.82:0/3118634135 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84800a4960 con 0x56324d76d4e0 2024-05-08T06:03:15.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.975+0000 7f84a5921b80 1 -- 172.21.15.82:0/3118634135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56324d76d4e0 msgr2=0x56324d7672d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:03:15.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.976+0000 7f84a5921b80 1 --2- 172.21.15.82:0/3118634135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56324d76d4e0 0x56324d7672d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f84800a6260 tx=0x7f848000df50 comp rx=0 tx=0).stop 2024-05-08T06:03:15.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.977+0000 7f84a5921b80 1 -- 172.21.15.82:0/3118634135 shutdown_connections 2024-05-08T06:03:15.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.977+0000 7f84a5921b80 1 --2- 172.21.15.82:0/3118634135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56324d76cbc0 0x56324d76cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:15.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.977+0000 7f84a5921b80 1 --2- 172.21.15.82:0/3118634135 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56324d7678f0 0x56324d767d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:15.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.977+0000 7f84a5921b80 1 --2- 172.21.15.82:0/3118634135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56324d76d4e0 0x56324d7672d0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:15.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.977+0000 7f84a5921b80 1 -- 172.21.15.82:0/3118634135 >> 172.21.15.82:0/3118634135 conn(0x56324d6df6d0 msgr2=0x56324d761b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:03:15.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.977+0000 7f84a5921b80 1 -- 172.21.15.82:0/3118634135 shutdown_connections 2024-05-08T06:03:15.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.978+0000 7f84a5921b80 1 -- 172.21.15.82:0/3118634135 wait complete. 2024-05-08T06:03:15.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.978+0000 7f84a5921b80 1 -- start start 2024-05-08T06:03:15.979 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.979+0000 7f84a5921b80 1 Processor -- start 2024-05-08T06:03:15.981 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.980+0000 7f8499000700 1 --2- 172.21.15.82:0/3226708434 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f84780b29c0 0x7f84780b4e80 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f848c009550 tx=0x7f848c009050 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:03:15.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.981+0000 7f84a5921b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56324d7678f0 0x56324d7732b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:15.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.981+0000 7f84a5921b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56324d76cbc0 0x56324d770650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:15.982 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.981+0000 7f84a5921b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56324d76d4e0 0x56324d770b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:15.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.982+0000 7f8493400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56324d76cbc0 0x56324d770650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:15.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.982+0000 7f8493400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56324d76cbc0 0x56324d770650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:53126/0 (socket says 172.21.15.82:53126) 2024-05-08T06:03:15.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.982+0000 7f8499000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56324d76d4e0 0x56324d770b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:15.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.982+0000 7f8493400700 1 -- 172.21.15.82:0/1876671167 learned_addr learned my addr 172.21.15.82:0/1876671167 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:03:15.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.982+0000 7f84a5921b80 1 -- 172.21.15.82:0/1876671167 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56324d784ed0 con 0x56324d7678f0 2024-05-08T06:03:15.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.982+0000 7f84a5921b80 1 -- 172.21.15.82:0/1876671167 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56324d61fb20 con 0x56324d76d4e0 2024-05-08T06:03:15.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.982+0000 7f84a5921b80 1 -- 172.21.15.82:0/1876671167 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56324d785050 con 0x56324d76cbc0 2024-05-08T06:03:15.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.982+0000 7f84a5921b80 10 client.0 _ll_register_callbacks cb 0x56324d660c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:03:15.983 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.982+0000 7f8493e00700 1 --2- 172.21.15.82:0/1876671167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56324d7678f0 0x56324d7732b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:15.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.983+0000 7f8499000700 1 -- 172.21.15.82:0/1876671167 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56324d76cbc0 msgr2=0x56324d770650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:03:15.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.983+0000 7f8499000700 1 --2- 172.21.15.82:0/1876671167 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56324d76cbc0 0x56324d770650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:15.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.983+0000 7f8499000700 1 -- 172.21.15.82:0/1876671167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56324d7678f0 msgr2=0x56324d7732b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:03:15.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.983+0000 7f8499000700 1 --2- 172.21.15.82:0/1876671167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56324d7678f0 0x56324d7732b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:15.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.983+0000 7f8499000700 1 -- 172.21.15.82:0/1876671167 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56324d67f420 con 0x56324d76d4e0 2024-05-08T06:03:15.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.983+0000 7f8493e00700 1 --2- 172.21.15.82:0/1876671167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56324d7678f0 0x56324d7732b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:03:15.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.983+0000 7f8499000700 1 --2- 172.21.15.82:0/1876671167 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56324d76d4e0 0x56324d770b90 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f848c009330 tx=0x7f848c009680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f478cb407b01ff3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:03:15.984 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.983+0000 7f847e000700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T06:03:15.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.984+0000 7f847e000700 1 -- 172.21.15.82:0/1876671167 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f848c022070 con 0x56324d76d4e0 2024-05-08T06:03:15.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.985+0000 7f847e000700 1 -- 172.21.15.82:0/1876671167 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f848c012970 con 0x56324d76d4e0 2024-05-08T06:03:15.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.985+0000 7f84a5921b80 1 -- 172.21.15.82:0/1876671167 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84800ad3a0 con 0x56324d76d4e0 2024-05-08T06:03:15.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.985+0000 7f847e000700 1 -- 172.21.15.82:0/1876671167 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f848c02e050 con 0x56324d76d4e0 2024-05-08T06:03:15.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.985+0000 7f84a5921b80 10 client.26585 fetch_fsmap learned FSMap version 31 2024-05-08T06:03:15.986 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.986+0000 7f84a5921b80 1 -- 172.21.15.82:0/1876671167 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56324d78f700 con 0x56324d76d4e0 2024-05-08T06:03:15.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.987+0000 7f847e000700 1 -- 172.21.15.82:0/1876671167 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f84800ad3a0 con 0x56324d76d4e0 2024-05-08T06:03:15.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.987+0000 7f847e000700 1 -- 172.21.15.82:0/1876671167 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f848c01e410 con 0x56324d76d4e0 2024-05-08T06:03:15.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.988+0000 7f84a5921b80 10 client.26585 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:03:15.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.988+0000 7f84a5921b80 10 client.26585 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T06:03:15.988 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.988+0000 7f84a5921b80 20 client.26585 populate_metadata read hostname 'smithi082' 2024-05-08T06:03:15.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.988+0000 7f84a5921b80 1 --2- 172.21.15.82:0/1876671167 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x56324d792140 0x56324d7945a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:15.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.988+0000 7f84a5921b80 4 client.26585 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:03:15.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.988+0000 7f84a5921b80 1 -- 172.21.15.82:0/1876671167 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56324d734140 con 0x56324d792140 2024-05-08T06:03:15.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.990+0000 7f8493e00700 1 --2- 172.21.15.82:0/1876671167 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x56324d792140 0x56324d7945a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:15.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.991+0000 7f8493e00700 1 --2- 172.21.15.82:0/1876671167 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x56324d792140 0x56324d7945a0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a95229de7d2fb0b0 server_cookie=550fcf12ad89f258 in_seq=0 out_seq=0 2024-05-08T06:03:15.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.991+0000 7f847e000700 10 client.26585 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T06:03:15.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.992+0000 7f847e000700 1 -- 172.21.15.82:0/1876671167 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56324d734140 con 0x56324d792140 2024-05-08T06:03:15.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.992+0000 7f847e000700 10 client.26585 handle_command_reply: tid=0 2024-05-08T06:03:15.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.992+0000 7f84a5921b80 1 client.26585 shutdown 2024-05-08T06:03:15.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.992+0000 7f84a5921b80 1 -- 172.21.15.82:0/1876671167 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56324d76d4e0 msgr2=0x56324d770b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:03:15.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.992+0000 7f84a5921b80 1 --2- 172.21.15.82:0/1876671167 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56324d76d4e0 0x56324d770b90 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f848c009330 tx=0x7f848c009680 comp rx=0 tx=0).stop 2024-05-08T06:03:15.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.992+0000 7f84a5921b80 1 -- 172.21.15.82:0/1876671167 shutdown_connections 2024-05-08T06:03:15.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.992+0000 7f84a5921b80 1 --2- 172.21.15.82:0/1876671167 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x56324d792140 0x56324d7945a0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:15.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.992+0000 7f84a5921b80 1 --2- 172.21.15.82:0/1876671167 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56324d76d4e0 0x56324d770b90 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:15.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.992+0000 7f84a5921b80 1 --2- 172.21.15.82:0/1876671167 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56324d7678f0 0x56324d7732b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:15.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.992+0000 7f84a5921b80 1 --2- 172.21.15.82:0/1876671167 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56324d76cbc0 0x56324d770650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:15.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.992+0000 7f847e000700 0 client.26585 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T06:03:15.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.992+0000 7f84a5921b80 1 -- 172.21.15.82:0/1876671167 >> 172.21.15.82:0/1876671167 conn(0x56324d6df6d0 msgr2=0x56324d761190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:03:15.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.993+0000 7f84a5921b80 1 -- 172.21.15.82:0/1876671167 shutdown_connections 2024-05-08T06:03:15.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.993+0000 7f84a5921b80 1 -- 172.21.15.82:0/1876671167 wait complete. 2024-05-08T06:03:15.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:15.993+0000 7f84a5921b80 20 client.26585 trim_cache size 0 max 16384 2024-05-08T06:03:16.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.016+0000 7f84a5921b80 1 Processor -- start 2024-05-08T06:03:16.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.017+0000 7f84a5921b80 1 -- start start 2024-05-08T06:03:16.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.017+0000 7f84a5921b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56324d7678f0 0x56324d7672d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:16.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.017+0000 7f84a5921b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56324d76cbc0 0x56324d78df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:16.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.017+0000 7f84a5921b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56324d76d4e0 0x56324d761910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:16.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.017+0000 7f84a5921b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f847400d380 con 0x56324d7678f0 2024-05-08T06:03:16.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.017+0000 7f84a5921b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f847400eec0 con 0x56324d76d4e0 2024-05-08T06:03:16.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.017+0000 7f8499000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56324d76d4e0 0x56324d761910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:16.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.017+0000 7f8493e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56324d7678f0 0x56324d7672d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:16.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.017+0000 7f8499000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56324d76d4e0 0x56324d761910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:38508/0 (socket says 172.21.15.82:38508) 2024-05-08T06:03:16.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.017+0000 7f8499000700 1 -- 172.21.15.82:0/2612820802 learned_addr learned my addr 172.21.15.82:0/2612820802 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:03:16.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.017+0000 7f8493400700 1 --2- 172.21.15.82:0/2612820802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56324d76cbc0 0x56324d78df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:16.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.017+0000 7f84a5921b80 1 -- 172.21.15.82:0/2612820802 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f847400da50 con 0x56324d76cbc0 2024-05-08T06:03:16.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.018+0000 7f8499000700 1 -- 172.21.15.82:0/2612820802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56324d76cbc0 msgr2=0x56324d78df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:03:16.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.018+0000 7f8499000700 1 --2- 172.21.15.82:0/2612820802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56324d76cbc0 0x56324d78df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:16.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.018+0000 7f8499000700 1 -- 172.21.15.82:0/2612820802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56324d7678f0 msgr2=0x56324d7672d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:03:16.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.018+0000 7f8499000700 1 --2- 172.21.15.82:0/2612820802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56324d7678f0 0x56324d7672d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:16.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.018+0000 7f8499000700 1 -- 172.21.15.82:0/2612820802 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56324d785060 con 0x56324d76d4e0 2024-05-08T06:03:16.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.018+0000 7f8493400700 1 --2- 172.21.15.82:0/2612820802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56324d76cbc0 0x56324d78df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:03:16.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.018+0000 7f8499000700 1 --2- 172.21.15.82:0/2612820802 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56324d76d4e0 0x56324d761910 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f848c013fd0 tx=0x7f848c004af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6358cfd12a05b390 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:03:16.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.019+0000 7f8488c00700 1 -- 172.21.15.82:0/2612820802 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f848c022040 con 0x56324d76d4e0 2024-05-08T06:03:16.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.019+0000 7f8488c00700 1 -- 172.21.15.82:0/2612820802 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f848c017040 con 0x56324d76d4e0 2024-05-08T06:03:16.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.019+0000 7f8488c00700 1 -- 172.21.15.82:0/2612820802 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f848c0277c0 con 0x56324d76d4e0 2024-05-08T06:03:16.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.020+0000 7f84a5921b80 1 -- 172.21.15.82:0/2612820802 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56324d76d4e0 msgr2=0x56324d761910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:03:16.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.020+0000 7f84a5921b80 1 --2- 172.21.15.82:0/2612820802 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56324d76d4e0 0x56324d761910 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f848c013fd0 tx=0x7f848c004af0 comp rx=0 tx=0).stop 2024-05-08T06:03:16.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.020+0000 7f84a5921b80 1 -- 172.21.15.82:0/2612820802 shutdown_connections 2024-05-08T06:03:16.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.020+0000 7f84a5921b80 1 --2- 172.21.15.82:0/2612820802 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56324d76d4e0 0x56324d761910 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:16.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.020+0000 7f84a5921b80 1 --2- 172.21.15.82:0/2612820802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56324d7678f0 0x56324d7672d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:16.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.020+0000 7f84a5921b80 1 --2- 172.21.15.82:0/2612820802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56324d76cbc0 0x56324d78df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:16.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.020+0000 7f84a5921b80 1 -- 172.21.15.82:0/2612820802 >> 172.21.15.82:0/2612820802 conn(0x56324d6df6d0 msgr2=0x56324d76b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:03:16.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.020+0000 7f84a5921b80 1 -- 172.21.15.82:0/2612820802 shutdown_connections 2024-05-08T06:03:16.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.020+0000 7f84a5921b80 1 -- 172.21.15.82:0/2612820802 wait complete. 2024-05-08T06:03:16.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.021+0000 7f84a5921b80 1 -- start start 2024-05-08T06:03:16.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.021+0000 7f84a5921b80 1 Processor -- start 2024-05-08T06:03:16.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.022+0000 7f84a5921b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56324d7678f0 0x56324d78a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:16.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.022+0000 7f84a5921b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56324d76cbc0 0x56324d799440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:16.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.022+0000 7f84a5921b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56324d76d4e0 0x56324d799980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:16.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.022+0000 7f84a5921b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f847400e7f0 con 0x56324d7678f0 2024-05-08T06:03:16.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.022+0000 7f84a5921b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f847400e120 con 0x56324d76d4e0 2024-05-08T06:03:16.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.022+0000 7f84a5921b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f847400b320 con 0x56324d76cbc0 2024-05-08T06:03:16.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.022+0000 7f84a5921b80 10 client.0 _ll_register_callbacks cb 0x56324d660c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:03:16.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.022+0000 7f8493e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56324d7678f0 0x56324d78a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:16.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.022+0000 7f8493400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56324d76cbc0 0x56324d799440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:16.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.022+0000 7f8493400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56324d76cbc0 0x56324d799440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:53144/0 (socket says 172.21.15.82:53144) 2024-05-08T06:03:16.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.022+0000 7f8493400700 1 -- 172.21.15.82:0/1430823593 learned_addr learned my addr 172.21.15.82:0/1430823593 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:03:16.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.022+0000 7f8493e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56324d7678f0 0x56324d78a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51804/0 (socket says 172.21.15.82:51804) 2024-05-08T06:03:16.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.022+0000 7f8499000700 1 --2- 172.21.15.82:0/1430823593 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56324d76d4e0 0x56324d799980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:16.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.022+0000 7f8493400700 1 -- 172.21.15.82:0/1430823593 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56324d76d4e0 msgr2=0x56324d799980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:03:16.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.022+0000 7f8493400700 1 --2- 172.21.15.82:0/1430823593 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56324d76d4e0 0x56324d799980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:16.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.022+0000 7f8493400700 1 -- 172.21.15.82:0/1430823593 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56324d7678f0 msgr2=0x56324d78a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:03:16.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.022+0000 7f8493400700 1 --2- 172.21.15.82:0/1430823593 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56324d7678f0 0x56324d78a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:16.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.022+0000 7f8493400700 1 -- 172.21.15.82:0/1430823593 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56324d79a1c0 con 0x56324d76cbc0 2024-05-08T06:03:16.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.023+0000 7f8493400700 1 --2- 172.21.15.82:0/1430823593 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56324d76cbc0 0x56324d799440 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8480005950 tx=0x7f8480009d70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd5b1208f69134bc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:03:16.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.023+0000 7f847e000700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T06:03:16.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.023+0000 7f847e000700 1 -- 172.21.15.82:0/1430823593 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8480021070 con 0x56324d76cbc0 2024-05-08T06:03:16.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.023+0000 7f847e000700 1 -- 172.21.15.82:0/1430823593 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f84800a8460 con 0x56324d76cbc0 2024-05-08T06:03:16.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.023+0000 7f84a5921b80 1 -- 172.21.15.82:0/1430823593 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f848c017040 con 0x56324d76cbc0 2024-05-08T06:03:16.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.023+0000 7f847e000700 1 -- 172.21.15.82:0/1430823593 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f84800ad3a0 con 0x56324d76cbc0 2024-05-08T06:03:16.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.023+0000 7f84a5921b80 10 client.26623 fetch_fsmap learned FSMap version 31 2024-05-08T06:03:16.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.023+0000 7f84a5921b80 1 -- 172.21.15.82:0/1430823593 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56324d7fc9d0 con 0x56324d76cbc0 2024-05-08T06:03:16.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.024+0000 7f847e000700 1 -- 172.21.15.82:0/1430823593 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f848c017040 con 0x56324d76cbc0 2024-05-08T06:03:16.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.024+0000 7f847e000700 1 -- 172.21.15.82:0/1430823593 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f84800ae530 con 0x56324d76cbc0 2024-05-08T06:03:16.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.024+0000 7f84a5921b80 10 client.26623 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:03:16.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.024+0000 7f84a5921b80 10 client.26623 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T06:03:16.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.024+0000 7f84a5921b80 20 client.26623 populate_metadata read hostname 'smithi082' 2024-05-08T06:03:16.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.024+0000 7f84a5921b80 1 --2- 172.21.15.82:0/1430823593 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x56324d7fd0c0 0x56324d7ff4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:16.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.025+0000 7f84a5921b80 4 client.26623 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T06:03:16.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.025+0000 7f84a5921b80 1 -- 172.21.15.82:0/1430823593 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56324d6c7400 con 0x56324d7fd0c0 2024-05-08T06:03:16.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.025+0000 7f8493e00700 1 --2- 172.21.15.82:0/1430823593 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x56324d7fd0c0 0x56324d7ff4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:16.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.026+0000 7f847e000700 10 client.26623 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T06:03:16.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.026+0000 7f8493e00700 1 --2- 172.21.15.82:0/1430823593 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x56324d7fd0c0 0x56324d7ff4e0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b235f0679d9f3868 server_cookie=a1d18f8f830ca128 in_seq=0 out_seq=0 2024-05-08T06:03:16.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.027+0000 7f847e000700 1 -- 172.21.15.82:0/1430823593 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56324d6c7400 con 0x56324d7fd0c0 2024-05-08T06:03:16.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.027+0000 7f847e000700 10 client.26623 handle_command_reply: tid=0 2024-05-08T06:03:16.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.027+0000 7f84a5921b80 1 client.26623 shutdown 2024-05-08T06:03:16.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.027+0000 7f84a5921b80 1 -- 172.21.15.82:0/1430823593 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56324d76cbc0 msgr2=0x56324d799440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:03:16.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.027+0000 7f84a5921b80 1 --2- 172.21.15.82:0/1430823593 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56324d76cbc0 0x56324d799440 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8480005950 tx=0x7f8480009d70 comp rx=0 tx=0).stop 2024-05-08T06:03:16.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.027+0000 7f84a5921b80 1 -- 172.21.15.82:0/1430823593 shutdown_connections 2024-05-08T06:03:16.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.027+0000 7f84a5921b80 1 --2- 172.21.15.82:0/1430823593 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x56324d7fd0c0 0x56324d7ff4e0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:16.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.027+0000 7f847e000700 0 client.26623 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T06:03:16.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.027+0000 7f84a5921b80 1 --2- 172.21.15.82:0/1430823593 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56324d76d4e0 0x56324d799980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:16.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.027+0000 7f84a5921b80 1 --2- 172.21.15.82:0/1430823593 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56324d7678f0 0x56324d78a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:16.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.027+0000 7f84a5921b80 1 --2- 172.21.15.82:0/1430823593 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56324d76cbc0 0x56324d799440 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:16.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.027+0000 7f84a5921b80 1 -- 172.21.15.82:0/1430823593 >> 172.21.15.82:0/1430823593 conn(0x56324d6df6d0 msgr2=0x56324d76c040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:03:16.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.027+0000 7f84a5921b80 1 -- 172.21.15.82:0/1430823593 shutdown_connections 2024-05-08T06:03:16.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.027+0000 7f84a5921b80 1 -- 172.21.15.82:0/1430823593 wait complete. 2024-05-08T06:03:16.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.028+0000 7f84a5921b80 20 client.26623 trim_cache size 0 max 16384 2024-05-08T06:03:16.030 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T06:03:16.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.028+0000 7f849b000700 1 -- 172.21.15.82:0/3226708434 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f84780b29c0 msgr2=0x7f84780b4e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:03:16.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.028+0000 7f849b000700 1 --2- 172.21.15.82:0/3226708434 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f84780b29c0 0x7f84780b4e80 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f848c009550 tx=0x7f848c009050 comp rx=0 tx=0).stop 2024-05-08T06:03:16.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.028+0000 7f849b000700 1 -- 172.21.15.82:0/3226708434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f849406bb40 msgr2=0x7f849419c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:03:16.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.028+0000 7f849b000700 1 --2- 172.21.15.82:0/3226708434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f849406bb40 0x7f849419c2e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f848000d950 tx=0x7f848000dd10 comp rx=0 tx=0).stop 2024-05-08T06:03:16.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.029+0000 7f849b000700 1 -- 172.21.15.82:0/3226708434 shutdown_connections 2024-05-08T06:03:16.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.029+0000 7f849b000700 1 --2- 172.21.15.82:0/3226708434 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f849406b180 0x7f849419bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:16.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.029+0000 7f849b000700 1 --2- 172.21.15.82:0/3226708434 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f84780b29c0 0x7f84780b4e80 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:16.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.029+0000 7f849b000700 1 --2- 172.21.15.82:0/3226708434 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8494109510 0x7f84941a0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:16.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.029+0000 7f849b000700 1 --2- 172.21.15.82:0/3226708434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f849406bb40 0x7f849419c2e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:16.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.029+0000 7f849b000700 1 -- 172.21.15.82:0/3226708434 >> 172.21.15.82:0/3226708434 conn(0x7f8494079350 msgr2=0x7f849410e680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:03:16.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.029+0000 7f849b000700 1 -- 172.21.15.82:0/3226708434 shutdown_connections 2024-05-08T06:03:16.031 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:16.029+0000 7f849b000700 1 -- 172.21.15.82:0/3226708434 wait complete. 2024-05-08T06:03:16.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:03:16 smithi082 ceph-mon[30098]: pgmap v837: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 12 MiB/s wr, 696 op/s 2024-05-08T06:03:16.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:03:16 smithi151 ceph-mon[34815]: pgmap v837: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 12 MiB/s wr, 696 op/s 2024-05-08T06:03:16.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:03:16 smithi134 ceph-mon[34132]: pgmap v837: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 12 MiB/s wr, 696 op/s 2024-05-08T06:03:18.409 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-08T06:03:18.410 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-05-08T06:03:18.428 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:03:18 smithi082 ceph-mon[30098]: pgmap v838: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 16 MiB/s wr, 843 op/s 2024-05-08T06:03:18.499 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:03:18 smithi134 ceph-mon[34132]: pgmap v838: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 16 MiB/s wr, 843 op/s 2024-05-08T06:03:18.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:03:18 smithi151 ceph-mon[34815]: pgmap v838: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 16 MiB/s wr, 843 op/s 2024-05-08T06:03:18.947 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:03:20.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 750.0 s, 1444.2 tps, lat 68.195 ms stddev 88.073 2024-05-08T06:03:20.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:03:20 smithi082 ceph-mon[30098]: pgmap v839: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 13 MiB/s wr, 658 op/s 2024-05-08T06:03:20.501 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:03:20 smithi134 ceph-mon[34132]: pgmap v839: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 13 MiB/s wr, 658 op/s 2024-05-08T06:03:20.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:03:20 smithi151 ceph-mon[34815]: pgmap v839: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 13 MiB/s wr, 658 op/s 2024-05-08T06:03:21.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.256+0000 7fcd19e00700 1 -- 172.21.15.82:0/2368100246 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd1410a4a0 msgr2=0x7fcd1410a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:03:21.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.256+0000 7fcd19e00700 1 --2- 172.21.15.82:0/2368100246 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd1410a4a0 0x7fcd1410a880 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fccfc009990 tx=0x7fccfc009ca0 comp rx=0 tx=0).stop 2024-05-08T06:03:21.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.256+0000 7fcd19e00700 1 -- 172.21.15.82:0/2368100246 shutdown_connections 2024-05-08T06:03:21.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.256+0000 7fcd19e00700 1 --2- 172.21.15.82:0/2368100246 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd1410a4a0 0x7fcd1410a880 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:21.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.256+0000 7fcd19e00700 1 --2- 172.21.15.82:0/2368100246 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd141165f0 0x7fcd141189e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:21.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.256+0000 7fcd19e00700 1 --2- 172.21.15.82:0/2368100246 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd1410adc0 0x7fcd141160b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:21.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.256+0000 7fcd19e00700 1 -- 172.21.15.82:0/2368100246 >> 172.21.15.82:0/2368100246 conn(0x7fcd1406e610 msgr2=0x7fcd1406ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:03:21.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.256+0000 7fcd19e00700 1 -- 172.21.15.82:0/2368100246 shutdown_connections 2024-05-08T06:03:21.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.256+0000 7fcd19e00700 1 -- 172.21.15.82:0/2368100246 wait complete. 2024-05-08T06:03:21.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.260+0000 7fcd19e00700 1 Processor -- start 2024-05-08T06:03:21.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.260+0000 7fcd19e00700 1 -- start start 2024-05-08T06:03:21.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.261+0000 7fcd19e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd1410a4a0 0x7fcd14116060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:21.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.261+0000 7fcd19e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd1410adc0 0x7fcd14113160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:21.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.261+0000 7fcd19e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd141165f0 0x7fcd141138a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:21.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.261+0000 7fcd19e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcd1410d970 con 0x7fcd1410a4a0 2024-05-08T06:03:21.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.261+0000 7fcd19e00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcd1410d7f0 con 0x7fcd141165f0 2024-05-08T06:03:21.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.261+0000 7fcd19e00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fcd1410daf0 con 0x7fcd1410adc0 2024-05-08T06:03:21.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.262+0000 7fcd12a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd1410a4a0 0x7fcd14116060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:21.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.262+0000 7fcd12000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd1410adc0 0x7fcd14113160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:21.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.262+0000 7fcd13400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd141165f0 0x7fcd141138a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:21.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.262+0000 7fcd12000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd1410adc0 0x7fcd14113160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:53156/0 (socket says 172.21.15.82:53156) 2024-05-08T06:03:21.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.262+0000 7fcd12000700 1 -- 172.21.15.82:0/2366852288 learned_addr learned my addr 172.21.15.82:0/2366852288 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:03:21.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.262+0000 7fcd13400700 1 --2- 172.21.15.82:0/2366852288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd141165f0 0x7fcd141138a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:38534/0 (socket says 172.21.15.82:38534) 2024-05-08T06:03:21.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.262+0000 7fcd12000700 1 -- 172.21.15.82:0/2366852288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd141165f0 msgr2=0x7fcd141138a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:03:21.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.262+0000 7fcd12000700 1 --2- 172.21.15.82:0/2366852288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd141165f0 0x7fcd141138a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:21.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.262+0000 7fcd12000700 1 -- 172.21.15.82:0/2366852288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd1410a4a0 msgr2=0x7fcd14116060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:03:21.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.262+0000 7fcd12000700 1 --2- 172.21.15.82:0/2366852288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd1410a4a0 0x7fcd14116060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:21.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.262+0000 7fcd12000700 1 -- 172.21.15.82:0/2366852288 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd141b4e00 con 0x7fcd1410adc0 2024-05-08T06:03:21.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.263+0000 7fcd12000700 1 --2- 172.21.15.82:0/2366852288 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd1410adc0 0x7fcd14113160 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fcd0400d980 tx=0x7fcd0400dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:03:21.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.263+0000 7fcd18a00700 1 -- 172.21.15.82:0/2366852288 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd04016070 con 0x7fcd1410adc0 2024-05-08T06:03:21.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.263+0000 7fcd18a00700 1 -- 172.21.15.82:0/2366852288 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcd04004830 con 0x7fcd1410adc0 2024-05-08T06:03:21.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.263+0000 7fcd18a00700 1 -- 172.21.15.82:0/2366852288 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd04016070 con 0x7fcd1410adc0 2024-05-08T06:03:21.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.264+0000 7fcd12a00700 1 --2- 172.21.15.82:0/2366852288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd1410a4a0 0x7fcd14116060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:03:21.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.264+0000 7fcd19e00700 1 -- 172.21.15.82:0/2366852288 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd141b5090 con 0x7fcd1410adc0 2024-05-08T06:03:21.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.264+0000 7fcd19e00700 1 -- 172.21.15.82:0/2366852288 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd141b5550 con 0x7fcd1410adc0 2024-05-08T06:03:21.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.272+0000 7fcd18a00700 1 -- 172.21.15.82:0/2366852288 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fcd04004220 con 0x7fcd1410adc0 2024-05-08T06:03:21.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.281+0000 7fcd18a00700 1 --2- 172.21.15.82:0/2366852288 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fccf80b2b80 0x7fccf80b5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:21.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.282+0000 7fcd2469cb80 1 Processor -- start 2024-05-08T06:03:21.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.282+0000 7fcd18a00700 1 -- 172.21.15.82:0/2366852288 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fcd040e1bd0 con 0x7fcd1410adc0 2024-05-08T06:03:21.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.283+0000 7fcd12a00700 1 --2- 172.21.15.82:0/2366852288 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fccf80b2b80 0x7fccf80b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:21.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.283+0000 7fcd2469cb80 1 -- start start 2024-05-08T06:03:21.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.284+0000 7fcd12a00700 1 --2- 172.21.15.82:0/2366852288 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fccf80b2b80 0x7fccf80b5040 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fccfc006010 tx=0x7fccfc00b560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:03:21.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.284+0000 7fcd2469cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56313189a0e0 0x56313189a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:21.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.284+0000 7fcd2469cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56313189aa00 0x56313189e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:21.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.284+0000 7fcd2469cb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56313189ea50 0x56313189eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:21.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.284+0000 7fcd2469cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5631317ecaa0 con 0x56313189aa00 2024-05-08T06:03:21.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.284+0000 7fcd2469cb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56313178a7e0 con 0x56313189ea50 2024-05-08T06:03:21.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.284+0000 7fcd2469cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5631317e8a60 con 0x56313189a0e0 2024-05-08T06:03:21.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.284+0000 7fcd12a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56313189a0e0 0x56313189a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:21.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.284+0000 7fcd12a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56313189a0e0 0x56313189a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:53166/0 (socket says 172.21.15.82:53166) 2024-05-08T06:03:21.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.284+0000 7fcd12a00700 1 -- 172.21.15.82:0/2876021330 learned_addr learned my addr 172.21.15.82:0/2876021330 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:03:21.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.284+0000 7fcd13400700 1 --2- 172.21.15.82:0/2876021330 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56313189ea50 0x56313189eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:21.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.285+0000 7fcd12000700 1 --2- 172.21.15.82:0/2876021330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56313189aa00 0x56313189e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:21.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.285+0000 7fcd12a00700 1 -- 172.21.15.82:0/2876021330 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56313189ea50 msgr2=0x56313189eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:03:21.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.285+0000 7fcd12a00700 1 --2- 172.21.15.82:0/2876021330 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56313189ea50 0x56313189eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:21.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.285+0000 7fcd12a00700 1 -- 172.21.15.82:0/2876021330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56313189aa00 msgr2=0x56313189e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:03:21.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.285+0000 7fcd12a00700 1 --2- 172.21.15.82:0/2876021330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56313189aa00 0x56313189e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:21.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.285+0000 7fcd12a00700 1 -- 172.21.15.82:0/2876021330 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563131739950 con 0x56313189a0e0 2024-05-08T06:03:21.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.286+0000 7fcd12a00700 1 --2- 172.21.15.82:0/2876021330 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56313189a0e0 0x56313189a4c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fccfc00bae0 tx=0x7fccfc01f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f56d18f245511b7b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:03:21.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.286+0000 7fcd08c00700 1 -- 172.21.15.82:0/2876021330 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccfc00f660 con 0x56313189a0e0 2024-05-08T06:03:21.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.286+0000 7fcd08c00700 1 -- 172.21.15.82:0/2876021330 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fccfc00fcb0 con 0x56313189a0e0 2024-05-08T06:03:21.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.286+0000 7fcd08c00700 1 -- 172.21.15.82:0/2876021330 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccfc024d70 con 0x56313189a0e0 2024-05-08T06:03:21.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.289+0000 7fcd2469cb80 1 -- 172.21.15.82:0/2876021330 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56313189a0e0 msgr2=0x56313189a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:03:21.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.289+0000 7fcd2469cb80 1 --2- 172.21.15.82:0/2876021330 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56313189a0e0 0x56313189a4c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fccfc00bae0 tx=0x7fccfc01f000 comp rx=0 tx=0).stop 2024-05-08T06:03:21.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.289+0000 7fcd2469cb80 1 -- 172.21.15.82:0/2876021330 shutdown_connections 2024-05-08T06:03:21.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.289+0000 7fcd2469cb80 1 --2- 172.21.15.82:0/2876021330 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56313189ea50 0x56313189eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:21.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.289+0000 7fcd2469cb80 1 --2- 172.21.15.82:0/2876021330 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56313189a0e0 0x56313189a4c0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:21.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.289+0000 7fcd2469cb80 1 --2- 172.21.15.82:0/2876021330 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56313189aa00 0x56313189e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:21.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.289+0000 7fcd2469cb80 1 -- 172.21.15.82:0/2876021330 >> 172.21.15.82:0/2876021330 conn(0x5631317c8be0 msgr2=0x563131894820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:03:21.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.290+0000 7fcd2469cb80 1 -- 172.21.15.82:0/2876021330 shutdown_connections 2024-05-08T06:03:21.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.291+0000 7fcd2469cb80 1 -- 172.21.15.82:0/2876021330 wait complete. 2024-05-08T06:03:21.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.291+0000 7fcd2469cb80 1 -- start start 2024-05-08T06:03:21.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.292+0000 7fcd2469cb80 1 Processor -- start 2024-05-08T06:03:21.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.293+0000 7fcd2469cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56313189a0e0 0x5631318a5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:21.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.293+0000 7fcd2469cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56313189aa00 0x5631318a31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:21.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.293+0000 7fcd2469cb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56313189ea50 0x5631318a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:21.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.293+0000 7fcd2469cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5631318a6c50 con 0x56313189aa00 2024-05-08T06:03:21.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.293+0000 7fcd2469cb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x563131752ba0 con 0x56313189ea50 2024-05-08T06:03:21.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.293+0000 7fcd2469cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5631318a6dd0 con 0x56313189a0e0 2024-05-08T06:03:21.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.293+0000 7fcd2469cb80 10 client.0 _ll_register_callbacks cb 0x563131793cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:03:21.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.293+0000 7fcd12a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56313189a0e0 0x5631318a5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:21.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.293+0000 7fcd12a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56313189a0e0 0x5631318a5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:53172/0 (socket says 172.21.15.82:53172) 2024-05-08T06:03:21.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.293+0000 7fcd12a00700 1 -- 172.21.15.82:0/2995525608 learned_addr learned my addr 172.21.15.82:0/2995525608 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:03:21.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.294+0000 7fcd12a00700 1 -- 172.21.15.82:0/2995525608 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56313189ea50 msgr2=0x5631318a36f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T06:03:21.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.294+0000 7fcd12a00700 1 --2- 172.21.15.82:0/2995525608 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56313189ea50 0x5631318a36f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:21.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.294+0000 7fcd12a00700 1 -- 172.21.15.82:0/2995525608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56313189aa00 msgr2=0x5631318a31b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T06:03:21.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.294+0000 7fcd12a00700 1 --2- 172.21.15.82:0/2995525608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56313189aa00 0x5631318a31b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:21.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.294+0000 7fcd12a00700 1 -- 172.21.15.82:0/2995525608 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631317b24a0 con 0x56313189a0e0 2024-05-08T06:03:21.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.295+0000 7fcd12a00700 1 --2- 172.21.15.82:0/2995525608 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56313189a0e0 0x5631318a5e10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fccfc003890 tx=0x7fccfc024670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=100bb3d0a065fde1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:03:21.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.295+0000 7fcd01600700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T06:03:21.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.298+0000 7fcd01600700 1 -- 172.21.15.82:0/2995525608 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccfc04d060 con 0x56313189a0e0 2024-05-08T06:03:21.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.298+0000 7fcd01600700 1 -- 172.21.15.82:0/2995525608 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fccfc00f660 con 0x56313189a0e0 2024-05-08T06:03:21.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.298+0000 7fcd2469cb80 1 -- 172.21.15.82:0/2995525608 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fccfc00fcb0 con 0x56313189a0e0 2024-05-08T06:03:21.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.299+0000 7fcd01600700 1 -- 172.21.15.82:0/2995525608 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fccfc044040 con 0x56313189a0e0 2024-05-08T06:03:21.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.299+0000 7fcd2469cb80 10 client.26632 fetch_fsmap learned FSMap version 31 2024-05-08T06:03:21.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.299+0000 7fcd2469cb80 1 -- 172.21.15.82:0/2995525608 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5631318a6c50 con 0x56313189a0e0 2024-05-08T06:03:21.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.300+0000 7fcd01600700 1 -- 172.21.15.82:0/2995525608 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fccfc00fcb0 con 0x56313189a0e0 2024-05-08T06:03:21.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.300+0000 7fcd01600700 1 -- 172.21.15.82:0/2995525608 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fccfc02d070 con 0x56313189a0e0 2024-05-08T06:03:21.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.300+0000 7fcd2469cb80 10 client.26632 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:03:21.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.300+0000 7fcd2469cb80 10 client.26632 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T06:03:21.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.300+0000 7fcd2469cb80 20 client.26632 populate_metadata read hostname 'smithi082' 2024-05-08T06:03:21.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.300+0000 7fcd2469cb80 1 --2- 172.21.15.82:0/2995525608 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5631318b36f0 0x5631318b5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:21.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.300+0000 7fcd2469cb80 4 client.26632 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:03:21.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.300+0000 7fcd2469cb80 1 -- 172.21.15.82:0/2995525608 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563131867120 con 0x5631318b36f0 2024-05-08T06:03:21.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.301+0000 7fcd12000700 1 --2- 172.21.15.82:0/2995525608 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5631318b36f0 0x5631318b5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:21.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.302+0000 7fcd12000700 1 --2- 172.21.15.82:0/2995525608 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5631318b36f0 0x5631318b5ae0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ffde67edc57cad64 server_cookie=a3cfadd11ffce6a2 in_seq=0 out_seq=0 2024-05-08T06:03:21.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.302+0000 7fcd01600700 10 client.26632 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T06:03:21.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.303+0000 7fcd01600700 1 -- 172.21.15.82:0/2995525608 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x563131867120 con 0x5631318b36f0 2024-05-08T06:03:21.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.303+0000 7fcd01600700 10 client.26632 handle_command_reply: tid=0 2024-05-08T06:03:21.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.303+0000 7fcd2469cb80 1 client.26632 shutdown 2024-05-08T06:03:21.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.304+0000 7fcd2469cb80 1 -- 172.21.15.82:0/2995525608 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56313189a0e0 msgr2=0x5631318a5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:03:21.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.304+0000 7fcd2469cb80 1 --2- 172.21.15.82:0/2995525608 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56313189a0e0 0x5631318a5e10 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fccfc003890 tx=0x7fccfc024670 comp rx=0 tx=0).stop 2024-05-08T06:03:21.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.304+0000 7fcd2469cb80 1 -- 172.21.15.82:0/2995525608 shutdown_connections 2024-05-08T06:03:21.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.304+0000 7fcd2469cb80 1 --2- 172.21.15.82:0/2995525608 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5631318b36f0 0x5631318b5ae0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:21.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.305+0000 7fcd2469cb80 1 --2- 172.21.15.82:0/2995525608 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56313189ea50 0x5631318a36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:21.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.305+0000 7fcd2469cb80 1 --2- 172.21.15.82:0/2995525608 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56313189a0e0 0x5631318a5e10 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:21.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.305+0000 7fcd2469cb80 1 --2- 172.21.15.82:0/2995525608 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56313189aa00 0x5631318a31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:21.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.305+0000 7fcd2469cb80 1 -- 172.21.15.82:0/2995525608 >> 172.21.15.82:0/2995525608 conn(0x5631317c8be0 msgr2=0x5631318947e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:03:21.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.306+0000 7fcd01600700 0 client.26632 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T06:03:21.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.306+0000 7fcd2469cb80 1 -- 172.21.15.82:0/2995525608 shutdown_connections 2024-05-08T06:03:21.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.306+0000 7fcd2469cb80 1 -- 172.21.15.82:0/2995525608 wait complete. 2024-05-08T06:03:21.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.306+0000 7fcd2469cb80 20 client.26632 trim_cache size 0 max 16384 2024-05-08T06:03:21.350 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.350+0000 7fcd2469cb80 1 Processor -- start 2024-05-08T06:03:21.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.350+0000 7fcd2469cb80 1 -- start start 2024-05-08T06:03:21.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.350+0000 7fcd2469cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56313189a0e0 0x5631318afce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:21.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.350+0000 7fcd2469cb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56313189aa00 0x5631318a4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:21.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.351+0000 7fcd2469cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56313189ea50 0x5631318bb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:21.351 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.351+0000 7fcd2469cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcd14125b60 con 0x56313189ea50 2024-05-08T06:03:21.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.351+0000 7fcd2469cb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcd141b5e80 con 0x56313189aa00 2024-05-08T06:03:21.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.351+0000 7fcd2469cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fcd14126230 con 0x56313189a0e0 2024-05-08T06:03:21.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.351+0000 7fcd12000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56313189aa00 0x5631318a4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:21.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.351+0000 7fcd12000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56313189aa00 0x5631318a4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:38566/0 (socket says 172.21.15.82:38566) 2024-05-08T06:03:21.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.351+0000 7fcd12000700 1 -- 172.21.15.82:0/2381664461 learned_addr learned my addr 172.21.15.82:0/2381664461 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:03:21.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.351+0000 7fcd12a00700 1 --2- 172.21.15.82:0/2381664461 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56313189a0e0 0x5631318afce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:21.352 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.351+0000 7fcd13400700 1 --2- 172.21.15.82:0/2381664461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56313189ea50 0x5631318bb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:21.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.352+0000 7fcd12a00700 1 -- 172.21.15.82:0/2381664461 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56313189aa00 msgr2=0x5631318a4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:03:21.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.352+0000 7fcd12a00700 1 --2- 172.21.15.82:0/2381664461 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56313189aa00 0x5631318a4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:21.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.352+0000 7fcd12a00700 1 -- 172.21.15.82:0/2381664461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56313189ea50 msgr2=0x5631318bb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:03:21.354 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.352+0000 7fcd12a00700 1 --2- 172.21.15.82:0/2381664461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56313189ea50 0x5631318bb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:21.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.352+0000 7fcd12a00700 1 -- 172.21.15.82:0/2381664461 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631318a1720 con 0x56313189a0e0 2024-05-08T06:03:21.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.352+0000 7fcd13400700 1 --2- 172.21.15.82:0/2381664461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56313189ea50 0x5631318bb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:03:21.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.352+0000 7fcd12000700 1 --2- 172.21.15.82:0/2381664461 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56313189aa00 0x5631318a4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:03:21.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.353+0000 7fcd12a00700 1 --2- 172.21.15.82:0/2381664461 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56313189a0e0 0x5631318afce0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fccfc02faa0 tx=0x7fccfc0248b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efc85557539839e3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:03:21.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.353+0000 7fcd03e00700 1 -- 172.21.15.82:0/2381664461 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccfc029020 con 0x56313189a0e0 2024-05-08T06:03:21.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.353+0000 7fcd03e00700 1 -- 172.21.15.82:0/2381664461 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fccfc00f460 con 0x56313189a0e0 2024-05-08T06:03:21.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.353+0000 7fcd03e00700 1 -- 172.21.15.82:0/2381664461 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccfc04d040 con 0x56313189a0e0 2024-05-08T06:03:21.355 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.354+0000 7fcd2469cb80 1 -- 172.21.15.82:0/2381664461 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56313189a0e0 msgr2=0x5631318afce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:03:21.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.354+0000 7fcd2469cb80 1 --2- 172.21.15.82:0/2381664461 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56313189a0e0 0x5631318afce0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fccfc02faa0 tx=0x7fccfc0248b0 comp rx=0 tx=0).stop 2024-05-08T06:03:21.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.355+0000 7fcd2469cb80 1 -- 172.21.15.82:0/2381664461 shutdown_connections 2024-05-08T06:03:21.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.355+0000 7fcd2469cb80 1 --2- 172.21.15.82:0/2381664461 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56313189ea50 0x5631318bb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:21.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.355+0000 7fcd2469cb80 1 --2- 172.21.15.82:0/2381664461 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56313189a0e0 0x5631318afce0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:21.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.355+0000 7fcd2469cb80 1 --2- 172.21.15.82:0/2381664461 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56313189aa00 0x5631318a4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:21.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.355+0000 7fcd2469cb80 1 -- 172.21.15.82:0/2381664461 >> 172.21.15.82:0/2381664461 conn(0x5631317c8be0 msgr2=0x5631318a4860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:03:21.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.355+0000 7fcd2469cb80 1 -- 172.21.15.82:0/2381664461 shutdown_connections 2024-05-08T06:03:21.356 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.355+0000 7fcd2469cb80 1 -- 172.21.15.82:0/2381664461 wait complete. 2024-05-08T06:03:21.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.355+0000 7fcd2469cb80 1 -- start start 2024-05-08T06:03:21.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.356+0000 7fcd2469cb80 1 Processor -- start 2024-05-08T06:03:21.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.356+0000 7fcd2469cb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56313189a0e0 0x5631318a7020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:21.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.356+0000 7fcd2469cb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56313189aa00 0x5631318a7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:21.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.356+0000 7fcd2469cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56313189ea50 0x5631318a7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:21.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.356+0000 7fcd2469cb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcd141b5870 con 0x56313189aa00 2024-05-08T06:03:21.357 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.356+0000 7fcd2469cb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcd14126900 con 0x56313189a0e0 2024-05-08T06:03:21.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.356+0000 7fcd2469cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fcd14123b00 con 0x56313189ea50 2024-05-08T06:03:21.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.357+0000 7fcd2469cb80 10 client.0 _ll_register_callbacks cb 0x563131793cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:03:21.358 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.357+0000 7fcd12000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56313189aa00 0x5631318a7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:21.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.357+0000 7fcd12a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56313189a0e0 0x5631318a7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:21.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.357+0000 7fcd12000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56313189aa00 0x5631318a7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:51848/0 (socket says 172.21.15.82:51848) 2024-05-08T06:03:21.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.357+0000 7fcd12000700 1 -- 172.21.15.82:0/2416193765 learned_addr learned my addr 172.21.15.82:0/2416193765 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:03:21.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.357+0000 7fcd13400700 1 --2- 172.21.15.82:0/2416193765 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56313189ea50 0x5631318a7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:21.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.357+0000 7fcd12a00700 1 -- 172.21.15.82:0/2416193765 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56313189ea50 msgr2=0x5631318a7aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:03:21.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.357+0000 7fcd12a00700 1 --2- 172.21.15.82:0/2416193765 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56313189ea50 0x5631318a7aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:21.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.358+0000 7fcd12a00700 1 -- 172.21.15.82:0/2416193765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56313189aa00 msgr2=0x5631318a7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:03:21.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.358+0000 7fcd12a00700 1 --2- 172.21.15.82:0/2416193765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56313189aa00 0x5631318a7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:21.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.358+0000 7fcd12a00700 1 -- 172.21.15.82:0/2416193765 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56313191dfd0 con 0x56313189a0e0 2024-05-08T06:03:21.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.358+0000 7fcd12a00700 1 --2- 172.21.15.82:0/2416193765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56313189a0e0 0x5631318a7020 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fccfc0098e0 tx=0x7fccfc024970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de28c8ff16aa185 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:03:21.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.358+0000 7fcd01600700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T06:03:21.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.358+0000 7fcd01600700 1 -- 172.21.15.82:0/2416193765 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccfc029030 con 0x56313189a0e0 2024-05-08T06:03:21.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.358+0000 7fcd01600700 1 -- 172.21.15.82:0/2416193765 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fccfc00f610 con 0x56313189a0e0 2024-05-08T06:03:21.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.358+0000 7fcd2469cb80 1 -- 172.21.15.82:0/2416193765 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fccfc00f460 con 0x56313189a0e0 2024-05-08T06:03:21.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.359+0000 7fcd01600700 1 -- 172.21.15.82:0/2416193765 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fccfc04d040 con 0x56313189a0e0 2024-05-08T06:03:21.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.359+0000 7fcd2469cb80 10 client.26606 fetch_fsmap learned FSMap version 31 2024-05-08T06:03:21.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.359+0000 7fcd2469cb80 1 -- 172.21.15.82:0/2416193765 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56313191f2f0 con 0x56313189a0e0 2024-05-08T06:03:21.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.359+0000 7fcd01600700 1 -- 172.21.15.82:0/2416193765 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fccfc00f460 con 0x56313189a0e0 2024-05-08T06:03:21.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.359+0000 7fcd01600700 1 -- 172.21.15.82:0/2416193765 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fccfc02d070 con 0x56313189a0e0 2024-05-08T06:03:21.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.359+0000 7fcd2469cb80 10 client.26606 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:03:21.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.359+0000 7fcd2469cb80 10 client.26606 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T06:03:21.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.359+0000 7fcd2469cb80 20 client.26606 populate_metadata read hostname 'smithi082' 2024-05-08T06:03:21.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.359+0000 7fcd2469cb80 1 --2- 172.21.15.82:0/2416193765 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x56313191f880 0x563131921c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:21.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.359+0000 7fcd2469cb80 4 client.26606 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-08T06:03:21.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.359+0000 7fcd2469cb80 1 -- 172.21.15.82:0/2416193765 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5631317fa480 con 0x56313191f880 2024-05-08T06:03:21.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.360+0000 7fcd12000700 1 --2- 172.21.15.82:0/2416193765 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x56313191f880 0x563131921c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:21.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.360+0000 7fcd12000700 1 --2- 172.21.15.82:0/2416193765 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x56313191f880 0x563131921c70 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f33cf5bf016391d9 server_cookie=55c47ddad734d0e1 in_seq=0 out_seq=0 2024-05-08T06:03:21.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.360+0000 7fcd01600700 10 client.26606 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T06:03:21.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.361+0000 7fcd01600700 1 -- 172.21.15.82:0/2416193765 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5631317fa480 con 0x56313191f880 2024-05-08T06:03:21.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.361+0000 7fcd01600700 10 client.26606 handle_command_reply: tid=0 2024-05-08T06:03:21.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.362+0000 7fcd2469cb80 1 client.26606 shutdown 2024-05-08T06:03:21.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.362+0000 7fcd2469cb80 1 -- 172.21.15.82:0/2416193765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56313189a0e0 msgr2=0x5631318a7020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:03:21.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.362+0000 7fcd2469cb80 1 --2- 172.21.15.82:0/2416193765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56313189a0e0 0x5631318a7020 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fccfc0098e0 tx=0x7fccfc024970 comp rx=0 tx=0).stop 2024-05-08T06:03:21.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.362+0000 7fcd2469cb80 1 -- 172.21.15.82:0/2416193765 shutdown_connections 2024-05-08T06:03:21.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.362+0000 7fcd2469cb80 1 --2- 172.21.15.82:0/2416193765 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x56313191f880 0x563131921c70 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:21.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.362+0000 7fcd2469cb80 1 --2- 172.21.15.82:0/2416193765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56313189a0e0 0x5631318a7020 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:21.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.362+0000 7fcd2469cb80 1 --2- 172.21.15.82:0/2416193765 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56313189ea50 0x5631318a7aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:21.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.362+0000 7fcd01600700 0 client.26606 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T06:03:21.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.362+0000 7fcd2469cb80 1 --2- 172.21.15.82:0/2416193765 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56313189aa00 0x5631318a7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:21.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.362+0000 7fcd2469cb80 1 -- 172.21.15.82:0/2416193765 >> 172.21.15.82:0/2416193765 conn(0x5631317c8be0 msgr2=0x5631318a2200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:03:21.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.362+0000 7fcd2469cb80 1 -- 172.21.15.82:0/2416193765 shutdown_connections 2024-05-08T06:03:21.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.363+0000 7fcd2469cb80 1 -- 172.21.15.82:0/2416193765 wait complete. 2024-05-08T06:03:21.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.363+0000 7fcd2469cb80 20 client.26606 trim_cache size 0 max 16384 2024-05-08T06:03:21.364 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T06:03:21.364 INFO:teuthology.orchestra.run.smithi082.stdout: "return_code": 0, 2024-05-08T06:03:21.364 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_tag": "27376af7-a3dd-4f2c-986a-6b61a70de3da", 2024-05-08T06:03:21.365 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": "asynchronous" 2024-05-08T06:03:21.365 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T06:03:21.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.364+0000 7fcd19e00700 1 -- 172.21.15.82:0/2366852288 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fccf80b2b80 msgr2=0x7fccf80b5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:03:21.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.364+0000 7fcd19e00700 1 --2- 172.21.15.82:0/2366852288 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fccf80b2b80 0x7fccf80b5040 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fccfc006010 tx=0x7fccfc00b560 comp rx=0 tx=0).stop 2024-05-08T06:03:21.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.364+0000 7fcd19e00700 1 -- 172.21.15.82:0/2366852288 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd1410adc0 msgr2=0x7fcd14113160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:03:21.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.364+0000 7fcd19e00700 1 --2- 172.21.15.82:0/2366852288 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd1410adc0 0x7fcd14113160 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fcd0400d980 tx=0x7fcd0400dc90 comp rx=0 tx=0).stop 2024-05-08T06:03:21.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.364+0000 7fcd19e00700 1 -- 172.21.15.82:0/2366852288 shutdown_connections 2024-05-08T06:03:21.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.364+0000 7fcd19e00700 1 --2- 172.21.15.82:0/2366852288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd141165f0 0x7fcd141138a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:21.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.364+0000 7fcd19e00700 1 --2- 172.21.15.82:0/2366852288 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fccf80b2b80 0x7fccf80b5040 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:21.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.364+0000 7fcd19e00700 1 --2- 172.21.15.82:0/2366852288 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcd1410a4a0 0x7fcd14116060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:21.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.365+0000 7fcd19e00700 1 --2- 172.21.15.82:0/2366852288 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd1410adc0 0x7fcd14113160 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:21.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.365+0000 7fcd19e00700 1 -- 172.21.15.82:0/2366852288 >> 172.21.15.82:0/2366852288 conn(0x7fcd1406e610 msgr2=0x7fcd14072040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:03:21.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.365+0000 7fcd19e00700 1 -- 172.21.15.82:0/2366852288 shutdown_connections 2024-05-08T06:03:21.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:21.365+0000 7fcd19e00700 1 -- 172.21.15.82:0/2366852288 wait complete. 2024-05-08T06:03:22.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:03:22 smithi082 ceph-mon[30098]: pgmap v840: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 16 MiB/s wr, 729 op/s 2024-05-08T06:03:22.499 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:03:22 smithi134 ceph-mon[34132]: pgmap v840: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 16 MiB/s wr, 729 op/s 2024-05-08T06:03:22.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:03:22 smithi151 ceph-mon[34815]: pgmap v840: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 16 MiB/s wr, 729 op/s 2024-05-08T06:03:22.799 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-08T06:03:23.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:03:23 smithi082 ceph-mon[30098]: scrub queued for path: / 2024-05-08T06:03:23.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:03:23 smithi082 ceph-mon[30098]: scrub summary: idle+waiting paths [/] 2024-05-08T06:03:23.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:03:23 smithi082 ceph-mon[30098]: scrub summary: active paths [/] 2024-05-08T06:03:23.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:03:23 smithi082 ceph-mon[30098]: scrub summary: active paths [/] 2024-05-08T06:03:23.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:03:23 smithi082 ceph-mon[30098]: scrub summary: idle+waiting paths [/] 2024-05-08T06:03:23.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:03:23 smithi082 ceph-mon[30098]: scrub summary: idle+waiting paths [/] 2024-05-08T06:03:23.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:03:23 smithi134 ceph-mon[34132]: scrub queued for path: / 2024-05-08T06:03:23.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:03:23 smithi134 ceph-mon[34132]: scrub summary: idle+waiting paths [/] 2024-05-08T06:03:23.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:03:23 smithi134 ceph-mon[34132]: scrub summary: active paths [/] 2024-05-08T06:03:23.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:03:23 smithi134 ceph-mon[34132]: scrub summary: active paths [/] 2024-05-08T06:03:23.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:03:23 smithi134 ceph-mon[34132]: scrub summary: idle+waiting paths [/] 2024-05-08T06:03:23.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:03:23 smithi134 ceph-mon[34132]: scrub summary: idle+waiting paths [/] 2024-05-08T06:03:23.505 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:03:23.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:03:23 smithi151 ceph-mon[34815]: scrub queued for path: / 2024-05-08T06:03:23.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:03:23 smithi151 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-05-08T06:03:23.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:03:23 smithi151 ceph-mon[34815]: scrub summary: active paths [/] 2024-05-08T06:03:23.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:03:23 smithi151 ceph-mon[34815]: scrub summary: active paths [/] 2024-05-08T06:03:23.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:03:23 smithi151 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-05-08T06:03:23.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:03:23 smithi151 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-05-08T06:03:24.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:03:24 smithi082 ceph-mon[30098]: pgmap v841: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 16 MiB/s wr, 738 op/s 2024-05-08T06:03:24.499 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:03:24 smithi134 ceph-mon[34132]: pgmap v841: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 16 MiB/s wr, 738 op/s 2024-05-08T06:03:24.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:03:24 smithi151 ceph-mon[34815]: pgmap v841: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 16 MiB/s wr, 738 op/s 2024-05-08T06:03:25.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 755.0 s, 1512.4 tps, lat 65.874 ms stddev 84.961 2024-05-08T06:03:25.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.873+0000 7f928bc00700 1 -- 172.21.15.82:0/701955792 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92841056e0 msgr2=0x7f9284105b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:03:25.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.873+0000 7f928bc00700 1 --2- 172.21.15.82:0/701955792 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92841056e0 0x7f9284105b60 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f926c009990 tx=0x7f926c009ca0 comp rx=0 tx=0).stop 2024-05-08T06:03:25.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.874+0000 7f928bc00700 1 -- 172.21.15.82:0/701955792 shutdown_connections 2024-05-08T06:03:25.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.874+0000 7f928bc00700 1 --2- 172.21.15.82:0/701955792 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92841060a0 0x7f92841125b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:25.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.874+0000 7f928bc00700 1 --2- 172.21.15.82:0/701955792 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f928410b6e0 0x7f928410bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:25.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.874+0000 7f928bc00700 1 --2- 172.21.15.82:0/701955792 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92841056e0 0x7f9284105b60 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:25.875 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.874+0000 7f928bc00700 1 -- 172.21.15.82:0/701955792 >> 172.21.15.82:0/701955792 conn(0x7f92841011d0 msgr2=0x7f92841035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:03:25.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.876+0000 7f928bc00700 1 -- 172.21.15.82:0/701955792 shutdown_connections 2024-05-08T06:03:25.876 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.876+0000 7f928bc00700 1 -- 172.21.15.82:0/701955792 wait complete. 2024-05-08T06:03:25.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.879+0000 7f928bc00700 1 Processor -- start 2024-05-08T06:03:25.879 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.879+0000 7f928bc00700 1 -- start start 2024-05-08T06:03:25.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.880+0000 7f928bc00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92841056e0 0x7f928419bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:25.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.880+0000 7f928bc00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92841060a0 0x7f928419c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:25.880 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.880+0000 7f928bc00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f928410b6e0 0x7f92841a06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:25.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.880+0000 7f928bc00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9284115920 con 0x7f92841056e0 2024-05-08T06:03:25.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.880+0000 7f928bc00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f92841157a0 con 0x7f928410b6e0 2024-05-08T06:03:25.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.880+0000 7f928bc00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9284115aa0 con 0x7f92841060a0 2024-05-08T06:03:25.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.880+0000 7f9289c00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f928410b6e0 0x7f92841a06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:25.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.880+0000 7f927be00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92841060a0 0x7f928419c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:25.881 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.880+0000 7f9289c00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f928410b6e0 0x7f92841a06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:58200/0 (socket says 172.21.15.82:58200) 2024-05-08T06:03:25.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.880+0000 7f9289c00700 1 -- 172.21.15.82:0/1246360493 learned_addr learned my addr 172.21.15.82:0/1246360493 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:03:25.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.881+0000 7f9289c00700 1 -- 172.21.15.82:0/1246360493 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92841060a0 msgr2=0x7f928419c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:03:25.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.881+0000 7f9289c00700 1 --2- 172.21.15.82:0/1246360493 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92841060a0 0x7f928419c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:25.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.881+0000 7f9289c00700 1 -- 172.21.15.82:0/1246360493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92841056e0 msgr2=0x7f928419bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:03:25.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.881+0000 7f9289c00700 1 --2- 172.21.15.82:0/1246360493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92841056e0 0x7f928419bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:25.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.881+0000 7f9289c00700 1 -- 172.21.15.82:0/1246360493 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92841a0e00 con 0x7f928410b6e0 2024-05-08T06:03:25.882 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.881+0000 7f9289c00700 1 --2- 172.21.15.82:0/1246360493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f928410b6e0 0x7f92841a06c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f927c00ea80 tx=0x7f927c00ed90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:03:25.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.882+0000 7f9282000700 1 -- 172.21.15.82:0/1246360493 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f927c004220 con 0x7f928410b6e0 2024-05-08T06:03:25.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.882+0000 7f9282000700 1 -- 172.21.15.82:0/1246360493 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f927c00ce00 con 0x7f928410b6e0 2024-05-08T06:03:25.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.882+0000 7f9282000700 1 -- 172.21.15.82:0/1246360493 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f927c003dd0 con 0x7f928410b6e0 2024-05-08T06:03:25.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.882+0000 7f928bc00700 1 -- 172.21.15.82:0/1246360493 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92841a10f0 con 0x7f928410b6e0 2024-05-08T06:03:25.883 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.883+0000 7f928bc00700 1 -- 172.21.15.82:0/1246360493 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92841a8970 con 0x7f928410b6e0 2024-05-08T06:03:25.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.889+0000 7f9282000700 1 -- 172.21.15.82:0/1246360493 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f927c00c950 con 0x7f928410b6e0 2024-05-08T06:03:25.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.889+0000 7f92965e5b80 1 Processor -- start 2024-05-08T06:03:25.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.889+0000 7f92965e5b80 1 -- start start 2024-05-08T06:03:25.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.890+0000 7f92965e5b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556124decbc0 0x556124decfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:25.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.890+0000 7f92965e5b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556124ded4e0 0x556124de72d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:25.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.890+0000 7f92965e5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556124de78f0 0x556124de7d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:25.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.890+0000 7f92965e5b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556124d39a20 con 0x556124ded4e0 2024-05-08T06:03:25.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.890+0000 7f92965e5b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x556124cd7760 con 0x556124decbc0 2024-05-08T06:03:25.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.890+0000 7f92965e5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x556124d359e0 con 0x556124de78f0 2024-05-08T06:03:25.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.890+0000 7f927be00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556124decbc0 0x556124decfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:25.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.890+0000 7f927be00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556124decbc0 0x556124decfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:58210/0 (socket says 172.21.15.82:58210) 2024-05-08T06:03:25.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.890+0000 7f927be00700 1 -- 172.21.15.82:0/2185919225 learned_addr learned my addr 172.21.15.82:0/2185919225 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:03:25.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.890+0000 7f927be00700 1 --2- 172.21.15.82:0/2185919225 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556124de78f0 0x556124de7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:25.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.890+0000 7f9289200700 1 --2- 172.21.15.82:0/2185919225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556124ded4e0 0x556124de72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:25.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.891+0000 7f927be00700 1 -- 172.21.15.82:0/2185919225 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556124decbc0 msgr2=0x556124decfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:03:25.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.891+0000 7f927be00700 1 --2- 172.21.15.82:0/2185919225 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556124decbc0 0x556124decfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:25.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.891+0000 7f927be00700 1 -- 172.21.15.82:0/2185919225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556124ded4e0 msgr2=0x556124de72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:03:25.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.891+0000 7f927be00700 1 --2- 172.21.15.82:0/2185919225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556124ded4e0 0x556124de72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:25.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.891+0000 7f9282000700 1 --2- 172.21.15.82:0/1246360493 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f92680b2900 0x7f92680b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:25.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.891+0000 7f927be00700 1 -- 172.21.15.82:0/2185919225 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556124c868d0 con 0x556124de78f0 2024-05-08T06:03:25.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.891+0000 7f9289200700 1 --2- 172.21.15.82:0/2185919225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556124ded4e0 0x556124de72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:03:25.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.891+0000 7f9282000700 1 -- 172.21.15.82:0/1246360493 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f927c0e23a0 con 0x7f928410b6e0 2024-05-08T06:03:25.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.891+0000 7f927be00700 1 --2- 172.21.15.82:0/2185919225 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556124de78f0 0x556124de7d50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f926c015000 tx=0x7f926c009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=32842936bb4bc604 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:03:25.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.892+0000 7f9289c00700 1 --2- 172.21.15.82:0/1246360493 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f92680b2900 0x7f92680b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:25.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.892+0000 7f927a000700 1 -- 172.21.15.82:0/2185919225 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f926c00b920 con 0x556124de78f0 2024-05-08T06:03:25.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.892+0000 7f927a000700 1 -- 172.21.15.82:0/2185919225 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f926c022040 con 0x556124de78f0 2024-05-08T06:03:25.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.892+0000 7f927a000700 1 -- 172.21.15.82:0/2185919225 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f926c003e60 con 0x556124de78f0 2024-05-08T06:03:25.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.893+0000 7f92965e5b80 1 -- 172.21.15.82:0/2185919225 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556124de78f0 msgr2=0x556124de7d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:03:25.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.893+0000 7f9289c00700 1 --2- 172.21.15.82:0/1246360493 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f92680b2900 0x7f92680b4dc0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f927c003ff0 tx=0x7f927c003860 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:03:25.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.893+0000 7f92965e5b80 1 --2- 172.21.15.82:0/2185919225 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556124de78f0 0x556124de7d50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f926c015000 tx=0x7f926c009ca0 comp rx=0 tx=0).stop 2024-05-08T06:03:25.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.893+0000 7f92965e5b80 1 -- 172.21.15.82:0/2185919225 shutdown_connections 2024-05-08T06:03:25.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.893+0000 7f92965e5b80 1 --2- 172.21.15.82:0/2185919225 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556124decbc0 0x556124decfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:25.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.893+0000 7f92965e5b80 1 --2- 172.21.15.82:0/2185919225 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556124de78f0 0x556124de7d50 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:25.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.893+0000 7f92965e5b80 1 --2- 172.21.15.82:0/2185919225 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556124ded4e0 0x556124de72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:25.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.893+0000 7f92965e5b80 1 -- 172.21.15.82:0/2185919225 >> 172.21.15.82:0/2185919225 conn(0x556124d5f6d0 msgr2=0x556124de1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:03:25.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.893+0000 7f92965e5b80 1 -- 172.21.15.82:0/2185919225 shutdown_connections 2024-05-08T06:03:25.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.893+0000 7f92965e5b80 1 -- 172.21.15.82:0/2185919225 wait complete. 2024-05-08T06:03:25.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.894+0000 7f92965e5b80 1 -- start start 2024-05-08T06:03:25.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.894+0000 7f92965e5b80 1 Processor -- start 2024-05-08T06:03:25.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.894+0000 7f92965e5b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556124de78f0 0x556124df58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:25.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.894+0000 7f92965e5b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556124decbc0 0x556124df5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:25.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.894+0000 7f92965e5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556124ded4e0 0x556124dfb600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:25.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.894+0000 7f92965e5b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x556124dedca0 con 0x556124de78f0 2024-05-08T06:03:25.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.894+0000 7f92965e5b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x556124c9fb20 con 0x556124decbc0 2024-05-08T06:03:25.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.894+0000 7f92965e5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x556124dede20 con 0x556124ded4e0 2024-05-08T06:03:25.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.894+0000 7f92965e5b80 10 client.0 _ll_register_callbacks cb 0x556124ce0c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:03:25.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.895+0000 7f9289200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556124decbc0 0x556124df5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:25.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.895+0000 7f9289200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556124decbc0 0x556124df5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:58212/0 (socket says 172.21.15.82:58212) 2024-05-08T06:03:25.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.895+0000 7f9289200700 1 -- 172.21.15.82:0/1690567184 learned_addr learned my addr 172.21.15.82:0/1690567184 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:03:25.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.895+0000 7f927be00700 1 --2- 172.21.15.82:0/1690567184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556124de78f0 0x556124df58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:25.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.895+0000 7f927be00700 1 --2- 172.21.15.82:0/1690567184 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556124ded4e0 0x556124dfb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:25.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.895+0000 7f9289200700 1 -- 172.21.15.82:0/1690567184 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556124ded4e0 msgr2=0x556124dfb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:03:25.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.895+0000 7f9289200700 1 --2- 172.21.15.82:0/1690567184 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556124ded4e0 0x556124dfb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:25.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.895+0000 7f9289200700 1 -- 172.21.15.82:0/1690567184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556124de78f0 msgr2=0x556124df58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:03:25.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.895+0000 7f9289200700 1 --2- 172.21.15.82:0/1690567184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556124de78f0 0x556124df58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:25.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.895+0000 7f9289200700 1 -- 172.21.15.82:0/1690567184 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556124cff420 con 0x556124decbc0 2024-05-08T06:03:25.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.896+0000 7f9289200700 1 --2- 172.21.15.82:0/1690567184 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556124decbc0 0x556124df5e10 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9274007990 tx=0x7f9274007ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2a05f4c13232a91 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:03:25.897 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.896+0000 7f9272a00700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T06:03:25.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.896+0000 7f9272a00700 1 -- 172.21.15.82:0/1690567184 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9274003a00 con 0x556124decbc0 2024-05-08T06:03:25.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.896+0000 7f9272a00700 1 -- 172.21.15.82:0/1690567184 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f9274003ba0 con 0x556124decbc0 2024-05-08T06:03:25.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.896+0000 7f92965e5b80 1 -- 172.21.15.82:0/1690567184 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f926c022040 con 0x556124decbc0 2024-05-08T06:03:25.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.896+0000 7f9272a00700 1 -- 172.21.15.82:0/1690567184 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f9274003da0 con 0x556124decbc0 2024-05-08T06:03:25.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.896+0000 7f92965e5b80 10 client.26618 fetch_fsmap learned FSMap version 31 2024-05-08T06:03:25.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.896+0000 7f92965e5b80 1 -- 172.21.15.82:0/1690567184 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x556124e0f930 con 0x556124decbc0 2024-05-08T06:03:25.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.896+0000 7f9272a00700 1 -- 172.21.15.82:0/1690567184 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f926c022040 con 0x556124decbc0 2024-05-08T06:03:25.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.897+0000 7f9272a00700 1 -- 172.21.15.82:0/1690567184 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f9274004380 con 0x556124decbc0 2024-05-08T06:03:25.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.897+0000 7f92965e5b80 10 client.26618 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:03:25.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.897+0000 7f92965e5b80 10 client.26618 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T06:03:25.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.897+0000 7f92965e5b80 20 client.26618 populate_metadata read hostname 'smithi082' 2024-05-08T06:03:25.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.897+0000 7f92965e5b80 1 --2- 172.21.15.82:0/1690567184 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x556124e11e50 0x556124e14240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:25.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.897+0000 7f92965e5b80 4 client.26618 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:03:25.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.897+0000 7f92965e5b80 1 -- 172.21.15.82:0/1690567184 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556124db4140 con 0x556124e11e50 2024-05-08T06:03:25.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.898+0000 7f927be00700 1 --2- 172.21.15.82:0/1690567184 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x556124e11e50 0x556124e14240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:25.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.898+0000 7f927be00700 1 --2- 172.21.15.82:0/1690567184 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x556124e11e50 0x556124e14240 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d213bf2cd4b098d server_cookie=51e89d7635d240b9 in_seq=0 out_seq=0 2024-05-08T06:03:25.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.898+0000 7f9272a00700 10 client.26618 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T06:03:25.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.899+0000 7f9272a00700 1 -- 172.21.15.82:0/1690567184 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x556124db4140 con 0x556124e11e50 2024-05-08T06:03:25.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.899+0000 7f9272a00700 10 client.26618 handle_command_reply: tid=0 2024-05-08T06:03:25.900 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.900+0000 7f92965e5b80 1 client.26618 shutdown 2024-05-08T06:03:25.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.900+0000 7f92965e5b80 1 -- 172.21.15.82:0/1690567184 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556124decbc0 msgr2=0x556124df5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:03:25.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.900+0000 7f92965e5b80 1 --2- 172.21.15.82:0/1690567184 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556124decbc0 0x556124df5e10 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f9274007990 tx=0x7f9274007ca0 comp rx=0 tx=0).stop 2024-05-08T06:03:25.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.900+0000 7f92965e5b80 1 -- 172.21.15.82:0/1690567184 shutdown_connections 2024-05-08T06:03:25.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.900+0000 7f92965e5b80 1 --2- 172.21.15.82:0/1690567184 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556124ded4e0 0x556124dfb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:25.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.900+0000 7f92965e5b80 1 --2- 172.21.15.82:0/1690567184 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556124de78f0 0x556124df58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:25.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.900+0000 7f92965e5b80 1 --2- 172.21.15.82:0/1690567184 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x556124e11e50 0x556124e14240 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:25.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.900+0000 7f92965e5b80 1 --2- 172.21.15.82:0/1690567184 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556124decbc0 0x556124df5e10 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:25.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.900+0000 7f92965e5b80 1 -- 172.21.15.82:0/1690567184 >> 172.21.15.82:0/1690567184 conn(0x556124d5f6d0 msgr2=0x556124de1190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:03:25.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.900+0000 7f9272a00700 0 client.26618 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T06:03:25.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.900+0000 7f92965e5b80 1 -- 172.21.15.82:0/1690567184 shutdown_connections 2024-05-08T06:03:25.901 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.901+0000 7f92965e5b80 1 -- 172.21.15.82:0/1690567184 wait complete. 2024-05-08T06:03:25.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.901+0000 7f92965e5b80 20 client.26618 trim_cache size 0 max 16384 2024-05-08T06:03:25.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.933+0000 7f92965e5b80 1 Processor -- start 2024-05-08T06:03:25.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.933+0000 7f92965e5b80 1 -- start start 2024-05-08T06:03:25.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.933+0000 7f92965e5b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556124de78f0 0x556124defc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:25.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.933+0000 7f92965e5b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556124decbc0 0x556124dfb570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:25.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.933+0000 7f92965e5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556124ded4e0 0x556124dee900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:25.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.933+0000 7f92965e5b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f92841ab920 con 0x556124de78f0 2024-05-08T06:03:25.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.933+0000 7f92965e5b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f92841ad460 con 0x556124decbc0 2024-05-08T06:03:25.934 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.933+0000 7f92965e5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f92841abff0 con 0x556124ded4e0 2024-05-08T06:03:25.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.934+0000 7f9289200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556124decbc0 0x556124dfb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:25.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.934+0000 7f9289200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556124decbc0 0x556124dfb570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:58218/0 (socket says 172.21.15.82:58218) 2024-05-08T06:03:25.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.934+0000 7f9289200700 1 -- 172.21.15.82:0/959949841 learned_addr learned my addr 172.21.15.82:0/959949841 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:03:25.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.934+0000 7f927be00700 1 --2- 172.21.15.82:0/959949841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556124de78f0 0x556124defc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:25.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.934+0000 7f927be00700 1 --2- 172.21.15.82:0/959949841 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556124ded4e0 0x556124dee900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:25.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.934+0000 7f9289200700 1 -- 172.21.15.82:0/959949841 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556124ded4e0 msgr2=0x556124dee900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:03:25.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.934+0000 7f9289200700 1 --2- 172.21.15.82:0/959949841 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556124ded4e0 0x556124dee900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:25.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.934+0000 7f9289200700 1 -- 172.21.15.82:0/959949841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556124de78f0 msgr2=0x556124defc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:03:25.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.934+0000 7f9289200700 1 --2- 172.21.15.82:0/959949841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556124de78f0 0x556124defc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:25.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.934+0000 7f9289200700 1 -- 172.21.15.82:0/959949841 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556124df6180 con 0x556124decbc0 2024-05-08T06:03:25.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.934+0000 7f927be00700 1 --2- 172.21.15.82:0/959949841 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556124ded4e0 0x556124dee900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:03:25.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.934+0000 7f9289200700 1 --2- 172.21.15.82:0/959949841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556124decbc0 0x556124dfb570 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f9274007960 tx=0x7f9274009860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75fe1662a0e8a13f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:03:25.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.935+0000 7f9279600700 1 -- 172.21.15.82:0/959949841 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9274003ac0 con 0x556124decbc0 2024-05-08T06:03:25.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.935+0000 7f9279600700 1 -- 172.21.15.82:0/959949841 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9274003f40 con 0x556124decbc0 2024-05-08T06:03:25.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.935+0000 7f9279600700 1 -- 172.21.15.82:0/959949841 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92740156c0 con 0x556124decbc0 2024-05-08T06:03:25.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.935+0000 7f92965e5b80 1 -- 172.21.15.82:0/959949841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556124decbc0 msgr2=0x556124dfb570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:03:25.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.935+0000 7f92965e5b80 1 --2- 172.21.15.82:0/959949841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556124decbc0 0x556124dfb570 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f9274007960 tx=0x7f9274009860 comp rx=0 tx=0).stop 2024-05-08T06:03:25.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.936+0000 7f92965e5b80 1 -- 172.21.15.82:0/959949841 shutdown_connections 2024-05-08T06:03:25.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.936+0000 7f92965e5b80 1 --2- 172.21.15.82:0/959949841 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556124ded4e0 0x556124dee900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:25.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.936+0000 7f92965e5b80 1 --2- 172.21.15.82:0/959949841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556124de78f0 0x556124defc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:25.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.936+0000 7f92965e5b80 1 --2- 172.21.15.82:0/959949841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556124decbc0 0x556124dfb570 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:25.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.936+0000 7f92965e5b80 1 -- 172.21.15.82:0/959949841 >> 172.21.15.82:0/959949841 conn(0x556124d5f6d0 msgr2=0x556124deb680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:03:25.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.937+0000 7f92965e5b80 1 -- 172.21.15.82:0/959949841 shutdown_connections 2024-05-08T06:03:25.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.937+0000 7f92965e5b80 1 -- 172.21.15.82:0/959949841 wait complete. 2024-05-08T06:03:25.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.938+0000 7f92965e5b80 1 -- start start 2024-05-08T06:03:25.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.938+0000 7f92965e5b80 1 Processor -- start 2024-05-08T06:03:25.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.939+0000 7f92965e5b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556124de78f0 0x556124e25890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:25.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.939+0000 7f92965e5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556124decbc0 0x556124e22480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:25.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.940+0000 7f92965e5b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556124ded4e0 0x556124e229c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:25.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.940+0000 7f92965e5b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f92841acd90 con 0x556124ded4e0 2024-05-08T06:03:25.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.940+0000 7f92965e5b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f92841ac6c0 con 0x556124de78f0 2024-05-08T06:03:25.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.940+0000 7f927be00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556124de78f0 0x556124e25890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:25.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.940+0000 7f927be00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556124de78f0 0x556124e25890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:58234/0 (socket says 172.21.15.82:58234) 2024-05-08T06:03:25.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.940+0000 7f927be00700 1 -- 172.21.15.82:0/2674732512 learned_addr learned my addr 172.21.15.82:0/2674732512 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:03:25.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.940+0000 7f92965e5b80 1 -- 172.21.15.82:0/2674732512 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f928407b860 con 0x556124decbc0 2024-05-08T06:03:25.943 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.940+0000 7f9289200700 1 --2- 172.21.15.82:0/2674732512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556124decbc0 0x556124e22480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:25.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.941+0000 7f92965e5b80 10 client.0 _ll_register_callbacks cb 0x556124ce0c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:03:25.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.941+0000 7f927be00700 1 -- 172.21.15.82:0/2674732512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556124decbc0 msgr2=0x556124e22480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:03:25.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.941+0000 7f927be00700 1 --2- 172.21.15.82:0/2674732512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556124decbc0 0x556124e22480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:25.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.941+0000 7f927be00700 1 -- 172.21.15.82:0/2674732512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556124ded4e0 msgr2=0x556124e229c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:03:25.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.941+0000 7f927be00700 1 --2- 172.21.15.82:0/2674732512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556124ded4e0 0x556124e229c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:25.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.941+0000 7f927be00700 1 -- 172.21.15.82:0/2674732512 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556124e23040 con 0x556124de78f0 2024-05-08T06:03:25.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.941+0000 7f9289200700 1 --2- 172.21.15.82:0/2674732512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556124decbc0 0x556124e22480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:03:25.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.941+0000 7f927be00700 1 --2- 172.21.15.82:0/2674732512 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556124de78f0 0x556124e25890 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f926c003a10 tx=0x7f926c003a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb42a031b93eb1ba server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:03:25.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.941+0000 7f9272a00700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T06:03:25.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.942+0000 7f9272a00700 1 -- 172.21.15.82:0/2674732512 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f926c003cb0 con 0x556124de78f0 2024-05-08T06:03:25.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.942+0000 7f9272a00700 1 -- 172.21.15.82:0/2674732512 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f926c00b720 con 0x556124de78f0 2024-05-08T06:03:25.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.942+0000 7f92965e5b80 1 -- 172.21.15.82:0/2674732512 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9274003f40 con 0x556124de78f0 2024-05-08T06:03:25.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.942+0000 7f9272a00700 1 -- 172.21.15.82:0/2674732512 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f926c003e50 con 0x556124de78f0 2024-05-08T06:03:25.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.942+0000 7f92965e5b80 10 client.26624 fetch_fsmap learned FSMap version 31 2024-05-08T06:03:25.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.942+0000 7f92965e5b80 1 -- 172.21.15.82:0/2674732512 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x556124e7d200 con 0x556124de78f0 2024-05-08T06:03:25.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.943+0000 7f9272a00700 1 -- 172.21.15.82:0/2674732512 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9274003f40 con 0x556124de78f0 2024-05-08T06:03:25.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.943+0000 7f9272a00700 1 -- 172.21.15.82:0/2674732512 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f926c027030 con 0x556124de78f0 2024-05-08T06:03:25.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.943+0000 7f92965e5b80 10 client.26624 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:03:25.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.943+0000 7f92965e5b80 10 client.26624 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T06:03:25.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.943+0000 7f92965e5b80 20 client.26624 populate_metadata read hostname 'smithi082' 2024-05-08T06:03:25.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.943+0000 7f92965e5b80 1 --2- 172.21.15.82:0/2674732512 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x556124e7d4f0 0x556124e7f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:03:25.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.943+0000 7f92965e5b80 4 client.26624 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-08T06:03:25.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.943+0000 7f92965e5b80 1 -- 172.21.15.82:0/2674732512 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556124d47400 con 0x556124e7d4f0 2024-05-08T06:03:25.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.944+0000 7f9289200700 1 --2- 172.21.15.82:0/2674732512 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x556124e7d4f0 0x556124e7f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:03:25.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.944+0000 7f9272a00700 10 client.26624 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T06:03:25.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.944+0000 7f9289200700 1 --2- 172.21.15.82:0/2674732512 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x556124e7d4f0 0x556124e7f8e0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e93b6296cea14460 server_cookie=104c2311abf469ed in_seq=0 out_seq=0 2024-05-08T06:03:25.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.945+0000 7f9272a00700 1 -- 172.21.15.82:0/2674732512 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x556124d47400 con 0x556124e7d4f0 2024-05-08T06:03:25.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.945+0000 7f9272a00700 10 client.26624 handle_command_reply: tid=0 2024-05-08T06:03:25.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.945+0000 7f92965e5b80 1 client.26624 shutdown 2024-05-08T06:03:25.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.945+0000 7f92965e5b80 1 -- 172.21.15.82:0/2674732512 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556124de78f0 msgr2=0x556124e25890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:03:25.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.945+0000 7f92965e5b80 1 --2- 172.21.15.82:0/2674732512 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556124de78f0 0x556124e25890 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f926c003a10 tx=0x7f926c003a40 comp rx=0 tx=0).stop 2024-05-08T06:03:25.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.945+0000 7f92965e5b80 1 -- 172.21.15.82:0/2674732512 shutdown_connections 2024-05-08T06:03:25.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.945+0000 7f92965e5b80 1 --2- 172.21.15.82:0/2674732512 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x556124e7d4f0 0x556124e7f8e0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:25.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.945+0000 7f92965e5b80 1 --2- 172.21.15.82:0/2674732512 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556124de78f0 0x556124e25890 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:25.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.945+0000 7f92965e5b80 1 --2- 172.21.15.82:0/2674732512 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x556124ded4e0 0x556124e229c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:25.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.945+0000 7f92965e5b80 1 --2- 172.21.15.82:0/2674732512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556124decbc0 0x556124e22480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:25.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.945+0000 7f9272a00700 0 client.26624 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T06:03:25.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.945+0000 7f92965e5b80 1 -- 172.21.15.82:0/2674732512 >> 172.21.15.82:0/2674732512 conn(0x556124d5f6d0 msgr2=0x556124dee780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:03:25.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.946+0000 7f92965e5b80 1 -- 172.21.15.82:0/2674732512 shutdown_connections 2024-05-08T06:03:25.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.946+0000 7f92965e5b80 1 -- 172.21.15.82:0/2674732512 wait complete. 2024-05-08T06:03:25.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.946+0000 7f92965e5b80 20 client.26624 trim_cache size 0 max 16384 2024-05-08T06:03:25.948 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T06:03:25.948 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-08T06:03:25.949 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2024-05-08T06:03:25.949 INFO:teuthology.orchestra.run.smithi082.stdout: "27376af7-a3dd-4f2c-986a-6b61a70de3da": { 2024-05-08T06:03:25.949 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2024-05-08T06:03:25.949 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "27376af7-a3dd-4f2c-986a-6b61a70de3da", 2024-05-08T06:03:25.949 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2024-05-08T06:03:25.949 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:03:25.949 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:03:25.949 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T06:03:25.949 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.947+0000 7f928bc00700 1 -- 172.21.15.82:0/1246360493 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f92680b2900 msgr2=0x7f92680b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:03:25.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.947+0000 7f928bc00700 1 --2- 172.21.15.82:0/1246360493 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f92680b2900 0x7f92680b4dc0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f927c003ff0 tx=0x7f927c003860 comp rx=0 tx=0).stop 2024-05-08T06:03:25.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.947+0000 7f928bc00700 1 -- 172.21.15.82:0/1246360493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f928410b6e0 msgr2=0x7f92841a06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:03:25.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.947+0000 7f928bc00700 1 --2- 172.21.15.82:0/1246360493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f928410b6e0 0x7f92841a06c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f927c00ea80 tx=0x7f927c00ed90 comp rx=0 tx=0).stop 2024-05-08T06:03:25.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.947+0000 7f928bc00700 1 -- 172.21.15.82:0/1246360493 shutdown_connections 2024-05-08T06:03:25.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.947+0000 7f928bc00700 1 --2- 172.21.15.82:0/1246360493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f928410b6e0 0x7f92841a06c0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:25.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.947+0000 7f928bc00700 1 --2- 172.21.15.82:0/1246360493 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f92680b2900 0x7f92680b4dc0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:25.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.947+0000 7f928bc00700 1 --2- 172.21.15.82:0/1246360493 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f92841056e0 0x7f928419bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:25.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.947+0000 7f928bc00700 1 --2- 172.21.15.82:0/1246360493 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92841060a0 0x7f928419c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:03:25.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.947+0000 7f928bc00700 1 -- 172.21.15.82:0/1246360493 >> 172.21.15.82:0/1246360493 conn(0x7f92841011d0 msgr2=0x7f9284101920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:03:25.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.948+0000 7f928bc00700 1 -- 172.21.15.82:0/1246360493 shutdown_connections 2024-05-08T06:03:25.950 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:03:25.948+0000 7f928bc00700 1 -- 172.21.15.82:0/1246360493 wait complete. 2024-05-08T06:03:26.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:03:26 smithi082 ceph-mon[30098]: pgmap v842: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 599 op/s 2024-05-08T06:03:26.499 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:03:26 smithi134 ceph-mon[34132]: pgmap v842: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 599 op/s 2024-05-08T06:03:26.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:03:26 smithi151 ceph-mon[34815]: pgmap v842: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 13 MiB/s wr, 599 op/s 2024-05-08T06:03:26.893 INFO:tasks.cephfs.filesystem:scrub status for tag:27376af7-a3dd-4f2c-986a-6b61a70de3da - {'path': '/', 'tag': '27376af7-a3dd-4f2c-986a-6b61a70de3da', 'options': 'recursive,force'} 2024-05-08T06:03:28.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:03:28 smithi082 ceph-mon[30098]: pgmap v843: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 16 MiB/s wr, 713 op/s 2024-05-08T06:03:28.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:03:28 smithi134 ceph-mon[34132]: pgmap v843: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 16 MiB/s wr, 713 op/s 2024-05-08T06:03:28.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:03:28 smithi151 ceph-mon[34815]: pgmap v843: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 16 MiB/s wr, 713 op/s 2024-05-08T06:03:30.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 760.0 s, 1321.2 tps, lat 76.716 ms stddev 86.294 2024-05-08T06:03:30.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:03:30 smithi082 ceph-mon[30098]: pgmap v844: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 MiB/s wr, 562 op/s 2024-05-08T06:03:30.499 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:03:30 smithi134 ceph-mon[34132]: pgmap v844: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 MiB/s wr, 562 op/s 2024-05-08T06:03:30.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:03:30 smithi151 ceph-mon[34815]: pgmap v844: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 12 MiB/s wr, 562 op/s 2024-05-08T06:03:31.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:03:31 smithi082 ceph-mon[30098]: scrub summary: idle 2024-05-08T06:03:31.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:03:31 smithi082 ceph-mon[30098]: scrub summary: idle 2024-05-08T06:03:31.499 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:03:31 smithi134 ceph-mon[34132]: scrub summary: idle 2024-05-08T06:03:31.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:03:31 smithi134 ceph-mon[34132]: scrub summary: idle 2024-05-08T06:03:31.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:03:31 smithi151 ceph-mon[34815]: scrub summary: idle 2024-05-08T06:03:31.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:03:31 smithi151 ceph-mon[34815]: scrub summary: idle 2024-05-08T06:03:32.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:03:32 smithi082 ceph-mon[30098]: pgmap v845: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 629 op/s 2024-05-08T06:03:32.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:03:32 smithi134 ceph-mon[34132]: pgmap v845: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 629 op/s 2024-05-08T06:03:32.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:03:32 smithi151 ceph-mon[34815]: pgmap v845: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 14 MiB/s wr, 629 op/s 2024-05-08T06:03:34.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:03:34 smithi134 ceph-mon[34132]: pgmap v846: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 13 MiB/s wr, 673 op/s 2024-05-08T06:03:34.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:03:34 smithi151 ceph-mon[34815]: pgmap v846: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 13 MiB/s wr, 673 op/s 2024-05-08T06:03:34.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:03:34 smithi082 ceph-mon[30098]: pgmap v846: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 13 MiB/s wr, 673 op/s 2024-05-08T06:03:35.267 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 765.0 s, 1530.8 tps, lat 65.653 ms stddev 78.395 2024-05-08T06:03:35.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:03:35 smithi151 ceph-mon[34815]: pgmap v847: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 12 MiB/s wr, 598 op/s 2024-05-08T06:03:35.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:03:35 smithi082 ceph-mon[30098]: pgmap v847: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 12 MiB/s wr, 598 op/s 2024-05-08T06:03:35.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:03:35 smithi134 ceph-mon[34132]: pgmap v847: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 12 MiB/s wr, 598 op/s 2024-05-08T06:03:37.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:03:37 smithi151 ceph-mon[34815]: pgmap v848: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 14 MiB/s wr, 735 op/s 2024-05-08T06:03:37.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:03:37 smithi082 ceph-mon[30098]: pgmap v848: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 14 MiB/s wr, 735 op/s 2024-05-08T06:03:38.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:03:37 smithi134 ceph-mon[34132]: pgmap v848: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 14 MiB/s wr, 735 op/s 2024-05-08T06:03:39.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:03:39 smithi151 ceph-mon[34815]: pgmap v849: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 10 MiB/s wr, 577 op/s 2024-05-08T06:03:39.895 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:03:39 smithi082 ceph-mon[30098]: pgmap v849: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 10 MiB/s wr, 577 op/s 2024-05-08T06:03:39.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:03:39 smithi134 ceph-mon[34132]: pgmap v849: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 10 MiB/s wr, 577 op/s 2024-05-08T06:03:40.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 770.0 s, 1542.6 tps, lat 63.325 ms stddev 76.711 2024-05-08T06:03:41.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:03:41 smithi151 ceph-mon[34815]: pgmap v850: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 653 op/s 2024-05-08T06:03:41.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:03:41 smithi082 ceph-mon[30098]: pgmap v850: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 653 op/s 2024-05-08T06:03:41.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:03:41 smithi134 ceph-mon[34132]: pgmap v850: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 653 op/s 2024-05-08T06:03:43.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:03:43 smithi151 ceph-mon[34815]: pgmap v851: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 717 op/s 2024-05-08T06:03:43.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:03:43 smithi082 ceph-mon[30098]: pgmap v851: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 717 op/s 2024-05-08T06:03:43.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:03:43 smithi134 ceph-mon[34132]: pgmap v851: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 717 op/s 2024-05-08T06:03:45.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 775.0 s, 1439.1 tps, lat 71.359 ms stddev 84.837 2024-05-08T06:03:45.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:03:45 smithi082 ceph-mon[30098]: pgmap v852: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 626 op/s 2024-05-08T06:03:45.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:03:45 smithi134 ceph-mon[34132]: pgmap v852: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 626 op/s 2024-05-08T06:03:46.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:03:45 smithi151 ceph-mon[34815]: pgmap v852: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 626 op/s 2024-05-08T06:03:47.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:03:47 smithi082 ceph-mon[30098]: pgmap v853: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 755 op/s 2024-05-08T06:03:47.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:03:47 smithi134 ceph-mon[34132]: pgmap v853: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 755 op/s 2024-05-08T06:03:48.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:03:47 smithi151 ceph-mon[34815]: pgmap v853: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 13 MiB/s wr, 755 op/s 2024-05-08T06:03:49.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:03:49 smithi082 ceph-mon[30098]: pgmap v854: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.7 MiB/s wr, 612 op/s 2024-05-08T06:03:49.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:03:49 smithi134 ceph-mon[34132]: pgmap v854: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.7 MiB/s wr, 612 op/s 2024-05-08T06:03:50.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:03:49 smithi151 ceph-mon[34815]: pgmap v854: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9.7 MiB/s wr, 612 op/s 2024-05-08T06:03:50.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 780.0 s, 1696.6 tps, lat 58.523 ms stddev 68.386 2024-05-08T06:03:51.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:03:51 smithi082 ceph-mon[30098]: pgmap v855: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 11 MiB/s wr, 677 op/s 2024-05-08T06:03:52.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:03:51 smithi134 ceph-mon[34132]: pgmap v855: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 11 MiB/s wr, 677 op/s 2024-05-08T06:03:52.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:03:51 smithi151 ceph-mon[34815]: pgmap v855: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 11 MiB/s wr, 677 op/s 2024-05-08T06:03:53.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:03:53 smithi082 ceph-mon[30098]: pgmap v856: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 747 op/s 2024-05-08T06:03:54.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:03:53 smithi134 ceph-mon[34132]: pgmap v856: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 747 op/s 2024-05-08T06:03:54.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:03:53 smithi151 ceph-mon[34815]: pgmap v856: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 747 op/s 2024-05-08T06:03:55.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 785.0 s, 1016.2 tps, lat 98.787 ms stddev 195.446 2024-05-08T06:03:55.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:03:55 smithi082 ceph-mon[30098]: pgmap v857: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 843 op/s 2024-05-08T06:03:55.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:03:55 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:03:55.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:03:55 smithi134 ceph-mon[34132]: pgmap v857: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 843 op/s 2024-05-08T06:03:56.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:03:55 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:03:56.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:03:55 smithi151 ceph-mon[34815]: pgmap v857: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 14 MiB/s wr, 843 op/s 2024-05-08T06:03:56.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:03:55 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:03:56.894 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-08T06:03:56.963 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:03:56 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:03:56.964 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:03:56 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:03:56.964 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:03:56 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T06:03:56.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:03:56 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:03:57.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:03:56 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:03:57.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:03:56 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T06:03:57.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:03:56 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:03:57.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:03:56 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:03:57.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:03:56 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T06:03:57.472 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:03:57.953 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:03:57 smithi082 ceph-mon[30098]: pgmap v858: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 31 MiB/s wr, 1.76k op/s 2024-05-08T06:03:58.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:03:57 smithi134 ceph-mon[34132]: pgmap v858: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 31 MiB/s wr, 1.76k op/s 2024-05-08T06:03:58.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:03:57 smithi151 ceph-mon[34815]: pgmap v858: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 31 MiB/s wr, 1.76k op/s 2024-05-08T06:03:59.790 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:03:59 smithi082 ceph-mon[30098]: pgmap v859: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 30 MiB/s wr, 1.67k op/s 2024-05-08T06:04:00.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:03:59 smithi134 ceph-mon[34132]: pgmap v859: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 30 MiB/s wr, 1.67k op/s 2024-05-08T06:04:00.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:03:59 smithi151 ceph-mon[34815]: pgmap v859: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 30 MiB/s wr, 1.67k op/s 2024-05-08T06:04:00.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.164+0000 7f9805800700 1 -- 172.21.15.82:0/1349860824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9800105ee0 msgr2=0x7f9800106370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:00.164 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.164+0000 7f9805800700 1 --2- 172.21.15.82:0/1349860824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9800105ee0 0x7f9800106370 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f97f8009f90 tx=0x7f97f800b330 comp rx=0 tx=0).stop 2024-05-08T06:04:00.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.164+0000 7f9805800700 1 -- 172.21.15.82:0/1349860824 shutdown_connections 2024-05-08T06:04:00.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.164+0000 7f9805800700 1 --2- 172.21.15.82:0/1349860824 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9800105ee0 0x7f9800106370 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:00.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.164+0000 7f9805800700 1 --2- 172.21.15.82:0/1349860824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98001083d0 0x7f980006b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:00.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.164+0000 7f9805800700 1 --2- 172.21.15.82:0/1349860824 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f980006b6f0 0x7f980006bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:00.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.164+0000 7f9805800700 1 -- 172.21.15.82:0/1349860824 >> 172.21.15.82:0/1349860824 conn(0x7f9800079350 msgr2=0x7f9800079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:04:00.165 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.166+0000 7f9805800700 1 -- 172.21.15.82:0/1349860824 shutdown_connections 2024-05-08T06:04:00.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.166+0000 7f9805800700 1 -- 172.21.15.82:0/1349860824 wait complete. 2024-05-08T06:04:00.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.167+0000 7f9805800700 1 Processor -- start 2024-05-08T06:04:00.167 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.168+0000 7f9805800700 1 -- start start 2024-05-08T06:04:00.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.170+0000 7f9805800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f980006b6f0 0x7f9800074ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:00.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.170+0000 7f9805800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9800105ee0 0x7f980006dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:00.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.170+0000 7f97fea00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f980006b6f0 0x7f9800074ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:00.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.170+0000 7f97fea00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f980006b6f0 0x7f9800074ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:43502/0 (socket says 172.21.15.82:43502) 2024-05-08T06:04:00.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.170+0000 7f97fea00700 1 -- 172.21.15.82:0/2322219494 learned_addr learned my addr 172.21.15.82:0/2322219494 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:04:00.170 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.171+0000 7f9805800700 1 --2- 172.21.15.82:0/2322219494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98001083d0 0x7f980006e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:00.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.171+0000 7f97fe000700 1 --2- 172.21.15.82:0/2322219494 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9800105ee0 0x7f980006dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:00.171 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.172+0000 7f9805800700 1 -- 172.21.15.82:0/2322219494 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9800119c60 con 0x7f98001083d0 2024-05-08T06:04:00.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.172+0000 7f9805800700 1 -- 172.21.15.82:0/2322219494 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9800119ae0 con 0x7f980006b6f0 2024-05-08T06:04:00.172 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.172+0000 7f9805800700 1 -- 172.21.15.82:0/2322219494 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9800119de0 con 0x7f9800105ee0 2024-05-08T06:04:00.173 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.173+0000 7f97ff400700 1 --2- 172.21.15.82:0/2322219494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98001083d0 0x7f980006e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:00.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.175+0000 7f97fea00700 1 -- 172.21.15.82:0/2322219494 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9800105ee0 msgr2=0x7f980006dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:00.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.175+0000 7f97fea00700 1 --2- 172.21.15.82:0/2322219494 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9800105ee0 0x7f980006dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:00.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.175+0000 7f97fea00700 1 -- 172.21.15.82:0/2322219494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98001083d0 msgr2=0x7f980006e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:00.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.175+0000 7f97fea00700 1 --2- 172.21.15.82:0/2322219494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98001083d0 0x7f980006e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:00.175 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.175+0000 7f97fea00700 1 -- 172.21.15.82:0/2322219494 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f980006e920 con 0x7f980006b6f0 2024-05-08T06:04:00.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.175+0000 7f97ff400700 1 --2- 172.21.15.82:0/2322219494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98001083d0 0x7f980006e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:04:00.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.176+0000 7f97fea00700 1 --2- 172.21.15.82:0/2322219494 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f980006b6f0 0x7f9800074ce0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f97f000e9c0 tx=0x7f97f000ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:04:00.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.176+0000 7f97f7400700 1 -- 172.21.15.82:0/2322219494 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f0004a30 con 0x7f980006b6f0 2024-05-08T06:04:00.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.176+0000 7f9805800700 1 -- 172.21.15.82:0/2322219494 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9800072810 con 0x7f980006b6f0 2024-05-08T06:04:00.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.176+0000 7f97f7400700 1 -- 172.21.15.82:0/2322219494 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97f000cc70 con 0x7f980006b6f0 2024-05-08T06:04:00.176 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.177+0000 7f97f7400700 1 -- 172.21.15.82:0/2322219494 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f00054a0 con 0x7f980006b6f0 2024-05-08T06:04:00.177 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.177+0000 7f9805800700 1 -- 172.21.15.82:0/2322219494 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9800072da0 con 0x7f980006b6f0 2024-05-08T06:04:00.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.185+0000 7f981011db80 1 Processor -- start 2024-05-08T06:04:00.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.185+0000 7f97f7400700 1 -- 172.21.15.82:0/2322219494 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f97f0004bd0 con 0x7f980006b6f0 2024-05-08T06:04:00.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.186+0000 7f981011db80 1 -- start start 2024-05-08T06:04:00.186 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.186+0000 7f981011db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562759a5b060 0x562759a5b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:00.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.187+0000 7f981011db80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562759a5b980 0x562759a5f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:00.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.188+0000 7f97ff400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562759a5b060 0x562759a5b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:00.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.188+0000 7f97ff400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562759a5b060 0x562759a5b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:48356/0 (socket says 172.21.15.82:48356) 2024-05-08T06:04:00.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.188+0000 7f97ff400700 1 -- 172.21.15.82:0/145367821 learned_addr learned my addr 172.21.15.82:0/145367821 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:04:00.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.188+0000 7f97f7400700 1 --2- 172.21.15.82:0/2322219494 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f97e40b2980 0x7f97e40b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:00.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.188+0000 7f981011db80 1 --2- 172.21.15.82:0/145367821 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562759a5f9d0 0x562759a5fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:00.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.188+0000 7f981011db80 1 -- 172.21.15.82:0/145367821 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5627599ada20 con 0x562759a5f9d0 2024-05-08T06:04:00.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.188+0000 7f981011db80 1 -- 172.21.15.82:0/145367821 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56275994b760 con 0x562759a5b980 2024-05-08T06:04:00.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.188+0000 7f981011db80 1 -- 172.21.15.82:0/145367821 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5627599a99e0 con 0x562759a5b060 2024-05-08T06:04:00.189 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.188+0000 7f97f7400700 1 -- 172.21.15.82:0/2322219494 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f97f00e2290 con 0x7f980006b6f0 2024-05-08T06:04:00.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.190+0000 7f97fe000700 1 --2- 172.21.15.82:0/2322219494 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f97e40b2980 0x7f97e40b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:00.190 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.191+0000 7f97fe000700 1 --2- 172.21.15.82:0/2322219494 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f97e40b2980 0x7f97e40b4e40 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f980006f530 tx=0x7f97e80073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:04:00.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.192+0000 7f97fea00700 1 --2- 172.21.15.82:0/145367821 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562759a5b980 0x562759a5f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:00.191 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.192+0000 7f97ff400700 1 --2- 172.21.15.82:0/145367821 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562759a5f9d0 0x562759a5fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:00.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.192+0000 7f97ff400700 1 -- 172.21.15.82:0/145367821 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562759a5b980 msgr2=0x562759a5f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:04:00.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.192+0000 7f97ff400700 1 --2- 172.21.15.82:0/145367821 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562759a5b980 0x562759a5f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:00.192 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.193+0000 7f97ff400700 1 -- 172.21.15.82:0/145367821 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562759a5f9d0 msgr2=0x562759a5fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:04:00.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.193+0000 7f97ff400700 1 --2- 172.21.15.82:0/145367821 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562759a5f9d0 0x562759a5fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:00.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.193+0000 7f97ff400700 1 -- 172.21.15.82:0/145367821 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627598fa8d0 con 0x562759a5b060 2024-05-08T06:04:00.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.193+0000 7f97fea00700 1 --2- 172.21.15.82:0/145367821 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562759a5b980 0x562759a5f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:04:00.193 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.193+0000 7f97ff400700 1 --2- 172.21.15.82:0/145367821 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562759a5b060 0x562759a5b440 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f97f8004fd0 tx=0x7f97f80096c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38f3ec7d4888178 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:04:00.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.194+0000 7f97efe00700 1 -- 172.21.15.82:0/145367821 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f800bda0 con 0x562759a5b060 2024-05-08T06:04:00.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.194+0000 7f97efe00700 1 -- 172.21.15.82:0/145367821 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97f8007890 con 0x562759a5b060 2024-05-08T06:04:00.194 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.194+0000 7f97efe00700 1 -- 172.21.15.82:0/145367821 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97f801b980 con 0x562759a5b060 2024-05-08T06:04:00.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.195+0000 7f981011db80 1 -- 172.21.15.82:0/145367821 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562759a5b060 msgr2=0x562759a5b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:00.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.195+0000 7f981011db80 1 --2- 172.21.15.82:0/145367821 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562759a5b060 0x562759a5b440 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f97f8004fd0 tx=0x7f97f80096c0 comp rx=0 tx=0).stop 2024-05-08T06:04:00.195 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.196+0000 7f981011db80 1 -- 172.21.15.82:0/145367821 shutdown_connections 2024-05-08T06:04:00.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.196+0000 7f981011db80 1 --2- 172.21.15.82:0/145367821 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562759a5f9d0 0x562759a5fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:00.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.196+0000 7f981011db80 1 --2- 172.21.15.82:0/145367821 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562759a5b060 0x562759a5b440 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:00.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.196+0000 7f981011db80 1 --2- 172.21.15.82:0/145367821 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562759a5b980 0x562759a5f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:00.196 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.196+0000 7f981011db80 1 -- 172.21.15.82:0/145367821 >> 172.21.15.82:0/145367821 conn(0x562759989b60 msgr2=0x562759a557a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:04:00.197 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.198+0000 7f981011db80 1 -- 172.21.15.82:0/145367821 shutdown_connections 2024-05-08T06:04:00.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.198+0000 7f981011db80 1 -- 172.21.15.82:0/145367821 wait complete. 2024-05-08T06:04:00.198 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.199+0000 7f981011db80 1 -- start start 2024-05-08T06:04:00.199 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.199+0000 7f981011db80 1 Processor -- start 2024-05-08T06:04:00.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.201+0000 7f981011db80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562759a5b060 0x562759a66e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:00.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.201+0000 7f981011db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562759a5b980 0x562759a64230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:00.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.201+0000 7f981011db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562759a5f9d0 0x562759a64770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:00.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.201+0000 7f981011db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x562759a67b20 con 0x562759a5f9d0 2024-05-08T06:04:00.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.201+0000 7f981011db80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562759913b20 con 0x562759a5b060 2024-05-08T06:04:00.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.201+0000 7f981011db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x562759a67ca0 con 0x562759a5b980 2024-05-08T06:04:00.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.201+0000 7f981011db80 10 client.0 _ll_register_callbacks cb 0x562759954c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:04:00.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.201+0000 7f97fe000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562759a5b980 0x562759a64230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:00.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.201+0000 7f97fea00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562759a5b060 0x562759a66e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:00.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.201+0000 7f97fe000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562759a5b980 0x562759a64230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:48366/0 (socket says 172.21.15.82:48366) 2024-05-08T06:04:00.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.201+0000 7f97fe000700 1 -- 172.21.15.82:0/3580803776 learned_addr learned my addr 172.21.15.82:0/3580803776 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:04:00.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.201+0000 7f97ff400700 1 --2- 172.21.15.82:0/3580803776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562759a5f9d0 0x562759a64770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:00.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.201+0000 7f97fe000700 1 -- 172.21.15.82:0/3580803776 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562759a5b060 msgr2=0x562759a66e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:04:00.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.201+0000 7f97fe000700 1 --2- 172.21.15.82:0/3580803776 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562759a5b060 0x562759a66e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:00.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.201+0000 7f97fe000700 1 -- 172.21.15.82:0/3580803776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562759a5f9d0 msgr2=0x562759a64770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:04:00.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.201+0000 7f97fe000700 1 --2- 172.21.15.82:0/3580803776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562759a5f9d0 0x562759a64770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:00.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.202+0000 7f97fe000700 1 -- 172.21.15.82:0/3580803776 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562759973420 con 0x562759a5b980 2024-05-08T06:04:00.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.202+0000 7f97fea00700 1 --2- 172.21.15.82:0/3580803776 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562759a5b060 0x562759a66e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:04:00.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.202+0000 7f97ff400700 1 --2- 172.21.15.82:0/3580803776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562759a5f9d0 0x562759a64770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:04:00.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.202+0000 7f97fe000700 1 --2- 172.21.15.82:0/3580803776 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562759a5b980 0x562759a64230 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f97e80046c0 tx=0x7f97e80047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0acf01190da2291 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:04:00.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.202+0000 7f97ecc00700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T06:04:00.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.202+0000 7f97ecc00700 1 -- 172.21.15.82:0/3580803776 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e8003a90 con 0x562759a5b980 2024-05-08T06:04:00.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.202+0000 7f981011db80 1 -- 172.21.15.82:0/3580803776 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97f8007890 con 0x562759a5b980 2024-05-08T06:04:00.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.202+0000 7f97ecc00700 1 -- 172.21.15.82:0/3580803776 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f97e8003c30 con 0x562759a5b980 2024-05-08T06:04:00.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.203+0000 7f97ecc00700 1 -- 172.21.15.82:0/3580803776 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f97e8003e30 con 0x562759a5b980 2024-05-08T06:04:00.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.204+0000 7f981011db80 10 client.26665 fetch_fsmap learned FSMap version 31 2024-05-08T06:04:00.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.204+0000 7f981011db80 1 -- 172.21.15.82:0/3580803776 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x562759a72480 con 0x562759a5b980 2024-05-08T06:04:00.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.205+0000 7f97ecc00700 1 -- 172.21.15.82:0/3580803776 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97f8007890 con 0x562759a5b980 2024-05-08T06:04:00.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.205+0000 7f97ecc00700 1 -- 172.21.15.82:0/3580803776 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f97e80114a0 con 0x562759a5b980 2024-05-08T06:04:00.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.205+0000 7f981011db80 10 client.26665 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:04:00.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.205+0000 7f981011db80 10 client.26665 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T06:04:00.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.205+0000 7f981011db80 20 client.26665 populate_metadata read hostname 'smithi082' 2024-05-08T06:04:00.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.205+0000 7f981011db80 1 --2- 172.21.15.82:0/3580803776 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x562759a74a60 0x562759a76e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:00.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.205+0000 7f981011db80 4 client.26665 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:04:00.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.205+0000 7f981011db80 1 -- 172.21.15.82:0/3580803776 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562759a280a0 con 0x562759a74a60 2024-05-08T06:04:00.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.206+0000 7f97fea00700 1 --2- 172.21.15.82:0/3580803776 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x562759a74a60 0x562759a76e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:00.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.206+0000 7f97fea00700 1 --2- 172.21.15.82:0/3580803776 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x562759a74a60 0x562759a76e90 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fa7df688ddbbeaa server_cookie=16484f6af18b0e70 in_seq=0 out_seq=0 2024-05-08T06:04:00.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.206+0000 7f97ecc00700 10 client.26665 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T06:04:00.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.208+0000 7f97ecc00700 1 -- 172.21.15.82:0/3580803776 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562759a280a0 con 0x562759a74a60 2024-05-08T06:04:00.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.208+0000 7f97ecc00700 10 client.26665 handle_command_reply: tid=0 2024-05-08T06:04:00.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.208+0000 7f981011db80 1 client.26665 shutdown 2024-05-08T06:04:00.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.208+0000 7f981011db80 1 -- 172.21.15.82:0/3580803776 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562759a5b980 msgr2=0x562759a64230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:00.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.208+0000 7f981011db80 1 --2- 172.21.15.82:0/3580803776 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562759a5b980 0x562759a64230 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f97e80046c0 tx=0x7f97e80047c0 comp rx=0 tx=0).stop 2024-05-08T06:04:00.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.208+0000 7f981011db80 1 -- 172.21.15.82:0/3580803776 shutdown_connections 2024-05-08T06:04:00.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.208+0000 7f981011db80 1 --2- 172.21.15.82:0/3580803776 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x562759a74a60 0x562759a76e90 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:00.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.208+0000 7f981011db80 1 --2- 172.21.15.82:0/3580803776 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562759a5b060 0x562759a66e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:00.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.208+0000 7f981011db80 1 --2- 172.21.15.82:0/3580803776 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562759a5f9d0 0x562759a64770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:00.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.208+0000 7f981011db80 1 --2- 172.21.15.82:0/3580803776 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562759a5b980 0x562759a64230 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:00.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.208+0000 7f981011db80 1 -- 172.21.15.82:0/3580803776 >> 172.21.15.82:0/3580803776 conn(0x562759989b60 msgr2=0x562759a502b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:04:00.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.208+0000 7f97ecc00700 0 client.26665 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T06:04:00.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.209+0000 7f981011db80 1 -- 172.21.15.82:0/3580803776 shutdown_connections 2024-05-08T06:04:00.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.209+0000 7f981011db80 1 -- 172.21.15.82:0/3580803776 wait complete. 2024-05-08T06:04:00.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.209+0000 7f981011db80 20 client.26665 trim_cache size 0 max 16384 2024-05-08T06:04:00.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.241+0000 7f981011db80 1 Processor -- start 2024-05-08T06:04:00.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.242+0000 7f981011db80 1 -- start start 2024-05-08T06:04:00.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.242+0000 7f981011db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562759a5b060 0x562759a633d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:00.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.242+0000 7f981011db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562759a5b980 0x562759a50130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:00.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.242+0000 7f981011db80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562759a5f9d0 0x562759a7c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:00.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.242+0000 7f981011db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f98001bc930 con 0x562759a5b060 2024-05-08T06:04:00.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.242+0000 7f981011db80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f98001be470 con 0x562759a5f9d0 2024-05-08T06:04:00.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.242+0000 7f981011db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f98001bd000 con 0x562759a5b980 2024-05-08T06:04:00.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.243+0000 7f97fe000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562759a5b980 0x562759a50130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:00.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.243+0000 7f97fe000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562759a5b980 0x562759a50130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:48370/0 (socket says 172.21.15.82:48370) 2024-05-08T06:04:00.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.243+0000 7f97fe000700 1 -- 172.21.15.82:0/3986335889 learned_addr learned my addr 172.21.15.82:0/3986335889 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:04:00.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.243+0000 7f97ff400700 1 --2- 172.21.15.82:0/3986335889 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562759a5f9d0 0x562759a7c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:00.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.243+0000 7f97fea00700 1 --2- 172.21.15.82:0/3986335889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562759a5b060 0x562759a633d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:00.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.244+0000 7f97fe000700 1 -- 172.21.15.82:0/3986335889 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562759a5f9d0 msgr2=0x562759a7c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:04:00.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.244+0000 7f97fe000700 1 --2- 172.21.15.82:0/3986335889 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562759a5f9d0 0x562759a7c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:00.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.244+0000 7f97fe000700 1 -- 172.21.15.82:0/3986335889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562759a5b060 msgr2=0x562759a633d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:04:00.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.244+0000 7f97fe000700 1 --2- 172.21.15.82:0/3986335889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562759a5b060 0x562759a633d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:00.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.244+0000 7f97fe000700 1 -- 172.21.15.82:0/3986335889 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562759a523f0 con 0x562759a5b980 2024-05-08T06:04:00.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.244+0000 7f97ff400700 1 --2- 172.21.15.82:0/3986335889 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562759a5f9d0 0x562759a7c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:04:00.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.244+0000 7f97fea00700 1 --2- 172.21.15.82:0/3986335889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562759a5b060 0x562759a633d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:04:00.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.245+0000 7f97fe000700 1 --2- 172.21.15.82:0/3986335889 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562759a5b980 0x562759a50130 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f97e8011b00 tx=0x7f97e8007440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4cbdfeff68a4833 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:04:00.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.245+0000 7f97ef400700 1 -- 172.21.15.82:0/3986335889 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e8011b80 con 0x562759a5b980 2024-05-08T06:04:00.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.245+0000 7f97ef400700 1 -- 172.21.15.82:0/3986335889 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97e8015070 con 0x562759a5b980 2024-05-08T06:04:00.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.245+0000 7f97ef400700 1 -- 172.21.15.82:0/3986335889 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e80346a0 con 0x562759a5b980 2024-05-08T06:04:00.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.246+0000 7f981011db80 1 -- 172.21.15.82:0/3986335889 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562759a5b980 msgr2=0x562759a50130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:00.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.246+0000 7f981011db80 1 --2- 172.21.15.82:0/3986335889 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562759a5b980 0x562759a50130 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f97e8011b00 tx=0x7f97e8007440 comp rx=0 tx=0).stop 2024-05-08T06:04:00.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.247+0000 7f981011db80 1 -- 172.21.15.82:0/3986335889 shutdown_connections 2024-05-08T06:04:00.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.247+0000 7f981011db80 1 --2- 172.21.15.82:0/3986335889 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562759a5f9d0 0x562759a7c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:00.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.247+0000 7f981011db80 1 --2- 172.21.15.82:0/3986335889 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562759a5b060 0x562759a633d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:00.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.247+0000 7f981011db80 1 --2- 172.21.15.82:0/3986335889 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562759a5b980 0x562759a50130 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:00.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.247+0000 7f981011db80 1 -- 172.21.15.82:0/3986335889 >> 172.21.15.82:0/3986335889 conn(0x562759989b60 msgr2=0x562759a4fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:04:00.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.247+0000 7f981011db80 1 -- 172.21.15.82:0/3986335889 shutdown_connections 2024-05-08T06:04:00.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.247+0000 7f981011db80 1 -- 172.21.15.82:0/3986335889 wait complete. 2024-05-08T06:04:00.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.248+0000 7f981011db80 1 -- start start 2024-05-08T06:04:00.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.248+0000 7f981011db80 1 Processor -- start 2024-05-08T06:04:00.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.249+0000 7f981011db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562759a5b060 0x562759a6aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:00.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.249+0000 7f981011db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562759a5b980 0x562759a6b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:00.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.249+0000 7f981011db80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562759a5f9d0 0x562759a6b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:00.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.249+0000 7f981011db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f98001bdda0 con 0x562759a5b060 2024-05-08T06:04:00.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.249+0000 7f981011db80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f98001bd6d0 con 0x562759a5f9d0 2024-05-08T06:04:00.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.249+0000 7f981011db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f98001ba8d0 con 0x562759a5b980 2024-05-08T06:04:00.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.249+0000 7f981011db80 10 client.0 _ll_register_callbacks cb 0x562759954c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:04:00.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.249+0000 7f97fea00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562759a5b060 0x562759a6aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:00.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.249+0000 7f97fe000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562759a5b980 0x562759a6b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:00.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.249+0000 7f97fe000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562759a5b980 0x562759a6b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:48386/0 (socket says 172.21.15.82:48386) 2024-05-08T06:04:00.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.249+0000 7f97fe000700 1 -- 172.21.15.82:0/3261283011 learned_addr learned my addr 172.21.15.82:0/3261283011 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:04:00.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.249+0000 7f97ff400700 1 --2- 172.21.15.82:0/3261283011 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562759a5f9d0 0x562759a6b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:00.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.250+0000 7f97fe000700 1 -- 172.21.15.82:0/3261283011 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562759a5f9d0 msgr2=0x562759a6b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:04:00.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.250+0000 7f97fe000700 1 --2- 172.21.15.82:0/3261283011 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562759a5f9d0 0x562759a6b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:00.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.250+0000 7f97fe000700 1 -- 172.21.15.82:0/3261283011 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562759a5b060 msgr2=0x562759a6aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:04:00.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.250+0000 7f97fe000700 1 --2- 172.21.15.82:0/3261283011 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562759a5b060 0x562759a6aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:00.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.250+0000 7f97fe000700 1 -- 172.21.15.82:0/3261283011 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562759ade3f0 con 0x562759a5b980 2024-05-08T06:04:00.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.250+0000 7f97fea00700 1 --2- 172.21.15.82:0/3261283011 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562759a5b060 0x562759a6aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:04:00.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.250+0000 7f97fe000700 1 --2- 172.21.15.82:0/3261283011 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562759a5b980 0x562759a6b0e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f97e80046c0 tx=0x7f97e8011670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5815b8279384d2de server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:04:00.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.250+0000 7f97ecc00700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T06:04:00.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.250+0000 7f97ecc00700 1 -- 172.21.15.82:0/3261283011 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e8042060 con 0x562759a5b980 2024-05-08T06:04:00.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.250+0000 7f97ecc00700 1 -- 172.21.15.82:0/3261283011 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f97e8005070 con 0x562759a5b980 2024-05-08T06:04:00.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.250+0000 7f981011db80 1 -- 172.21.15.82:0/3261283011 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97e8015070 con 0x562759a5b980 2024-05-08T06:04:00.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.251+0000 7f97ecc00700 1 -- 172.21.15.82:0/3261283011 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f97e8005270 con 0x562759a5b980 2024-05-08T06:04:00.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.251+0000 7f981011db80 10 client.26671 fetch_fsmap learned FSMap version 31 2024-05-08T06:04:00.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.251+0000 7f981011db80 1 -- 172.21.15.82:0/3261283011 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x562759adf700 con 0x562759a5b980 2024-05-08T06:04:00.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.251+0000 7f97ecc00700 1 -- 172.21.15.82:0/3261283011 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f97e8015070 con 0x562759a5b980 2024-05-08T06:04:00.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.251+0000 7f97ecc00700 1 -- 172.21.15.82:0/3261283011 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f97e8034440 con 0x562759a5b980 2024-05-08T06:04:00.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.252+0000 7f981011db80 10 client.26671 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:04:00.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.252+0000 7f981011db80 10 client.26671 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T06:04:00.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.252+0000 7f981011db80 20 client.26671 populate_metadata read hostname 'smithi082' 2024-05-08T06:04:00.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.252+0000 7f981011db80 1 --2- 172.21.15.82:0/3261283011 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x562759adfd50 0x562759ae2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:00.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.252+0000 7f981011db80 4 client.26671 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-08T06:04:00.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.252+0000 7f981011db80 1 -- 172.21.15.82:0/3261283011 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5627599bb400 con 0x562759adfd50 2024-05-08T06:04:00.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.252+0000 7f97fea00700 1 --2- 172.21.15.82:0/3261283011 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x562759adfd50 0x562759ae2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:00.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.253+0000 7f97fea00700 1 --2- 172.21.15.82:0/3261283011 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x562759adfd50 0x562759ae2170 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=adb7710715e290f server_cookie=4ef0bee60348380e in_seq=0 out_seq=0 2024-05-08T06:04:00.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.253+0000 7f97ecc00700 10 client.26671 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T06:04:00.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.253+0000 7f97ecc00700 1 -- 172.21.15.82:0/3261283011 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5627599bb400 con 0x562759adfd50 2024-05-08T06:04:00.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.254+0000 7f97ecc00700 10 client.26671 handle_command_reply: tid=0 2024-05-08T06:04:00.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.254+0000 7f981011db80 1 client.26671 shutdown 2024-05-08T06:04:00.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.254+0000 7f981011db80 1 -- 172.21.15.82:0/3261283011 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562759a5b980 msgr2=0x562759a6b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:00.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.254+0000 7f981011db80 1 --2- 172.21.15.82:0/3261283011 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562759a5b980 0x562759a6b0e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f97e80046c0 tx=0x7f97e8011670 comp rx=0 tx=0).stop 2024-05-08T06:04:00.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.254+0000 7f981011db80 1 -- 172.21.15.82:0/3261283011 shutdown_connections 2024-05-08T06:04:00.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.254+0000 7f981011db80 1 --2- 172.21.15.82:0/3261283011 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x562759adfd50 0x562759ae2170 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:00.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.254+0000 7f981011db80 1 --2- 172.21.15.82:0/3261283011 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562759a5f9d0 0x562759a6b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:00.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.254+0000 7f981011db80 1 --2- 172.21.15.82:0/3261283011 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562759a5b060 0x562759a6aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:00.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.254+0000 7f981011db80 1 --2- 172.21.15.82:0/3261283011 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562759a5b980 0x562759a6b0e0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:00.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.254+0000 7f97ecc00700 0 client.26671 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T06:04:00.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.254+0000 7f981011db80 1 -- 172.21.15.82:0/3261283011 >> 172.21.15.82:0/3261283011 conn(0x562759989b60 msgr2=0x562759a502b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:04:00.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.254+0000 7f981011db80 1 -- 172.21.15.82:0/3261283011 shutdown_connections 2024-05-08T06:04:00.256 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T06:04:00.256 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "no active scrubs running", 2024-05-08T06:04:00.256 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": {} 2024-05-08T06:04:00.256 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T06:04:00.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.255+0000 7f981011db80 1 -- 172.21.15.82:0/3261283011 wait complete. 2024-05-08T06:04:00.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.255+0000 7f981011db80 20 client.26671 trim_cache size 0 max 16384 2024-05-08T06:04:00.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.256+0000 7f9805800700 1 -- 172.21.15.82:0/2322219494 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f97e40b2980 msgr2=0x7f97e40b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:00.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.256+0000 7f9805800700 1 --2- 172.21.15.82:0/2322219494 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f97e40b2980 0x7f97e40b4e40 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f980006f530 tx=0x7f97e80073d0 comp rx=0 tx=0).stop 2024-05-08T06:04:00.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.256+0000 7f9805800700 1 -- 172.21.15.82:0/2322219494 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f980006b6f0 msgr2=0x7f9800074ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:00.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.256+0000 7f9805800700 1 --2- 172.21.15.82:0/2322219494 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f980006b6f0 0x7f9800074ce0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f97f000e9c0 tx=0x7f97f000ecd0 comp rx=0 tx=0).stop 2024-05-08T06:04:00.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.256+0000 7f9805800700 1 -- 172.21.15.82:0/2322219494 shutdown_connections 2024-05-08T06:04:00.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.256+0000 7f9805800700 1 --2- 172.21.15.82:0/2322219494 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f980006b6f0 0x7f9800074ce0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:00.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.256+0000 7f9805800700 1 --2- 172.21.15.82:0/2322219494 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f97e40b2980 0x7f97e40b4e40 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:00.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.256+0000 7f9805800700 1 --2- 172.21.15.82:0/2322219494 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f98001083d0 0x7f980006e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:00.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.256+0000 7f9805800700 1 --2- 172.21.15.82:0/2322219494 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9800105ee0 0x7f980006dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:00.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.256+0000 7f9805800700 1 -- 172.21.15.82:0/2322219494 >> 172.21.15.82:0/2322219494 conn(0x7f9800079350 msgr2=0x7f9800104ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:04:00.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.256+0000 7f9805800700 1 -- 172.21.15.82:0/2322219494 shutdown_connections 2024-05-08T06:04:00.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:00.256+0000 7f9805800700 1 -- 172.21.15.82:0/2322219494 wait complete. 2024-05-08T06:04:00.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 790.0 s, 1367.0 tps, lat 71.808 ms stddev 96.204 2024-05-08T06:04:01.141 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-08T06:04:01.141 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T06:04:01.732 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:04:01.947 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:04:01 smithi082 ceph-mon[30098]: pgmap v860: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 31 MiB/s wr, 1.73k op/s 2024-05-08T06:04:01.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:04:01 smithi134 ceph-mon[34132]: pgmap v860: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 31 MiB/s wr, 1.73k op/s 2024-05-08T06:04:02.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:04:01 smithi151 ceph-mon[34815]: pgmap v860: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 31 MiB/s wr, 1.73k op/s 2024-05-08T06:04:03.818 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:04:03 smithi082 ceph-mon[30098]: pgmap v861: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 31 MiB/s wr, 1.81k op/s 2024-05-08T06:04:04.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:04:03 smithi134 ceph-mon[34132]: pgmap v861: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 31 MiB/s wr, 1.81k op/s 2024-05-08T06:04:04.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:04:03 smithi151 ceph-mon[34815]: pgmap v861: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 31 MiB/s wr, 1.81k op/s 2024-05-08T06:04:04.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:04.497+0000 7f93a6e00700 1 -- 172.21.15.82:0/2275378677 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93a0108850 msgr2=0x7f93a01103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:04.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:04.497+0000 7f93a6e00700 1 --2- 172.21.15.82:0/2275378677 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93a0108850 0x7f93a01103d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f939800b0d0 tx=0x7f939800b3e0 comp rx=0 tx=0).stop 2024-05-08T06:04:04.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:04.497+0000 7f93a6e00700 1 -- 172.21.15.82:0/2275378677 shutdown_connections 2024-05-08T06:04:04.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:04.497+0000 7f93a6e00700 1 --2- 172.21.15.82:0/2275378677 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93a0108850 0x7f93a01103d0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:04.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:04.497+0000 7f93a6e00700 1 --2- 172.21.15.82:0/2275378677 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93a0103750 0x7f93a0103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:04.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:04.497+0000 7f93a6e00700 1 --2- 172.21.15.82:0/2275378677 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93a0104100 0x7f93a0108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:04.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:04.497+0000 7f93a6e00700 1 -- 172.21.15.82:0/2275378677 >> 172.21.15.82:0/2275378677 conn(0x7f93a007a600 msgr2=0x7f93a007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:04:04.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:04.497+0000 7f93a6e00700 1 -- 172.21.15.82:0/2275378677 shutdown_connections 2024-05-08T06:04:04.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:04.497+0000 7f93a6e00700 1 -- 172.21.15.82:0/2275378677 wait complete. 2024-05-08T06:04:04.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:04.498+0000 7f93a6e00700 1 Processor -- start 2024-05-08T06:04:04.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:04.499+0000 7f93a6e00700 1 -- start start 2024-05-08T06:04:04.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:04.500+0000 7f93a6e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93a0103750 0x7f93a00757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:04.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:04.500+0000 7f93a6e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93a0104100 0x7f93a0075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:04.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:04.500+0000 7f93a6e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93a0108850 0x7f93a0076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:04.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:04.500+0000 7f93a6e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f93a0113670 con 0x7f93a0104100 2024-05-08T06:04:04.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:04.500+0000 7f93a6e00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f93a01134f0 con 0x7f93a0103750 2024-05-08T06:04:04.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:04.500+0000 7f93a6e00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f93a01137f0 con 0x7f93a0108850 2024-05-08T06:04:04.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:04.500+0000 7f939fe00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93a0103750 0x7f93a00757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:04.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:04.501+0000 7f939fe00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93a0103750 0x7f93a00757a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:38218/0 (socket says 172.21.15.82:38218) 2024-05-08T06:04:04.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:04.501+0000 7f939fe00700 1 -- 172.21.15.82:0/2278600809 learned_addr learned my addr 172.21.15.82:0/2278600809 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:04:04.502 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:04.501+0000 7f93a4e00700 1 --2- 172.21.15.82:0/2278600809 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93a0108850 0x7f93a0076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:04.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:04.501+0000 7f939f400700 1 --2- 172.21.15.82:0/2278600809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93a0104100 0x7f93a0075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:04.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:04.501+0000 7f93a4e00700 1 -- 172.21.15.82:0/2278600809 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93a0103750 msgr2=0x7f93a00757a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:04.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:04.501+0000 7f93a4e00700 1 --2- 172.21.15.82:0/2278600809 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93a0103750 0x7f93a00757a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:04.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:04.501+0000 7f93a4e00700 1 -- 172.21.15.82:0/2278600809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93a0104100 msgr2=0x7f93a0075ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:04.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:04.501+0000 7f93a4e00700 1 --2- 172.21.15.82:0/2278600809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93a0104100 0x7f93a0075ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:04.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:04.501+0000 7f93a4e00700 1 -- 172.21.15.82:0/2278600809 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93a01a7fb0 con 0x7f93a0108850 2024-05-08T06:04:04.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:04.501+0000 7f939f400700 1 --2- 172.21.15.82:0/2278600809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93a0104100 0x7f93a0075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:04:04.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:04.501+0000 7f93a4e00700 1 --2- 172.21.15.82:0/2278600809 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93a0108850 0x7f93a0076220 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f939800b0d0 tx=0x7f9398007980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:04:04.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:04.501+0000 7f939cc00700 1 -- 172.21.15.82:0/2278600809 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f939801f020 con 0x7f93a0108850 2024-05-08T06:04:04.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:04.501+0000 7f93a6e00700 1 -- 172.21.15.82:0/2278600809 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93a01a8240 con 0x7f93a0108850 2024-05-08T06:04:04.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:04.501+0000 7f939cc00700 1 -- 172.21.15.82:0/2278600809 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9398004c50 con 0x7f93a0108850 2024-05-08T06:04:04.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:04.501+0000 7f939cc00700 1 -- 172.21.15.82:0/2278600809 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f939801b690 con 0x7f93a0108850 2024-05-08T06:04:04.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:04.501+0000 7f93a6e00700 1 -- 172.21.15.82:0/2278600809 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93a01a8690 con 0x7f93a0108850 2024-05-08T06:04:04.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:04.501+0000 7f93a6e00700 1 -- 172.21.15.82:0/2278600809 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93a006a190 con 0x7f93a0108850 2024-05-08T06:04:04.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:04.506+0000 7f939cc00700 1 -- 172.21.15.82:0/2278600809 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f9398022020 con 0x7f93a0108850 2024-05-08T06:04:04.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:04.506+0000 7f939cc00700 1 --2- 172.21.15.82:0/2278600809 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f93840b29c0 0x7f93840b4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:04.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:04.506+0000 7f939cc00700 1 -- 172.21.15.82:0/2278600809 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f93980e2ee0 con 0x7f93a0108850 2024-05-08T06:04:04.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:04.506+0000 7f939fe00700 1 --2- 172.21.15.82:0/2278600809 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f93840b29c0 0x7f93840b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:04.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:04.510+0000 7f939fe00700 1 --2- 172.21.15.82:0/2278600809 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f93840b29c0 0x7f93840b4e80 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9390009680 tx=0x7f9390009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:04:04.513 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:04.510+0000 7f939cc00700 1 -- 172.21.15.82:0/2278600809 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9398029020 con 0x7f93a0108850 2024-05-08T06:04:05.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:05.019+0000 7f93a6e00700 1 -- 172.21.15.82:0/2278600809 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f93a002e5b0 con 0x7f93a0108850 2024-05-08T06:04:05.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:05.020+0000 7f939cc00700 1 -- 172.21.15.82:0/2278600809 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11948 (secure 0 0 0) 0x7f93980aac40 con 0x7f93a0108850 2024-05-08T06:04:05.021 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T06:04:05.021 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14364,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3876883250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3876883250},{"type":"v1","addr":"172.21.15.82:6835","nonce":3876883250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1965070586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1965070586},{"type":"v1","addr":"172.21.15.82:6837","nonce":1965070586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":31,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T05:45:57.654009+0000","modified":"2024-05-08T05:53:20.165672+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24505,"mds_2":24487,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14397":{"gid":14397,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/1890720973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1890720973},{"type":"v1","addr":"172.21.15.82:6839","nonce":1890720973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14409":{"gid":14409,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/2957083305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":2957083305},{"type":"v1","addr":"172.21.15.82:6841","nonce":2957083305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6833/3827691638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3827691638},{"type":"v1","addr":"172.21.15.134:6833","nonce":3827691638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6833/3625067797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3625067797},{"type":"v1","addr":"172.21.15.151:6833","nonce":3625067797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/4074163402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4074163402},{"type":"v1","addr":"172.21.15.134:6835","nonce":4074163402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.134:6837/2212411710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2212411710},{"type":"v1","addr":"172.21.15.134:6837","nonce":2212411710}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":17,"addr":"172.21.15.151:6835/2093655929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2093655929},{"type":"v1","addr":"172.21.15.151:6835","nonce":2093655929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6837/4192404464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":4192404464},{"type":"v1","addr":"172.21.15.151:6837","nonce":4192404464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":14,"addr":"172.21.15.151:6839/2963754236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":2963754236},{"type":"v1","addr":"172.21.15.151:6839","nonce":2963754236}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.134:6839/1145270893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1145270893},{"type":"v1","addr":"172.21.15.134:6839","nonce":1145270893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24505,24506,24487,24475,24467]},"id":1}]} 2024-05-08T06:04:05.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:05.024+0000 7f93a6e00700 1 -- 172.21.15.82:0/2278600809 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f93840b29c0 msgr2=0x7f93840b4e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:05.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:05.024+0000 7f93a6e00700 1 --2- 172.21.15.82:0/2278600809 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f93840b29c0 0x7f93840b4e80 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9390009680 tx=0x7f9390009260 comp rx=0 tx=0).stop 2024-05-08T06:04:05.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:05.024+0000 7f93a6e00700 1 -- 172.21.15.82:0/2278600809 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93a0108850 msgr2=0x7f93a0076220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:05.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:05.024+0000 7f93a6e00700 1 --2- 172.21.15.82:0/2278600809 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93a0108850 0x7f93a0076220 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f939800b0d0 tx=0x7f9398007980 comp rx=0 tx=0).stop 2024-05-08T06:04:05.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:05.024+0000 7f93a6e00700 1 -- 172.21.15.82:0/2278600809 shutdown_connections 2024-05-08T06:04:05.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:05.024+0000 7f93a6e00700 1 --2- 172.21.15.82:0/2278600809 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93a0103750 0x7f93a00757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:05.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:05.024+0000 7f93a6e00700 1 --2- 172.21.15.82:0/2278600809 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f93840b29c0 0x7f93840b4e80 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:05.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:05.024+0000 7f93a6e00700 1 --2- 172.21.15.82:0/2278600809 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93a0108850 0x7f93a0076220 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:05.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:05.024+0000 7f93a6e00700 1 --2- 172.21.15.82:0/2278600809 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f93a0104100 0x7f93a0075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:05.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:05.024+0000 7f93a6e00700 1 -- 172.21.15.82:0/2278600809 >> 172.21.15.82:0/2278600809 conn(0x7f93a007a600 msgr2=0x7f93a0101680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:04:05.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:05.025+0000 7f93a6e00700 1 -- 172.21.15.82:0/2278600809 shutdown_connections 2024-05-08T06:04:05.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:05.025+0000 7f93a6e00700 1 -- 172.21.15.82:0/2278600809 wait complete. 2024-05-08T06:04:05.027 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 31 2024-05-08T06:04:05.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 795.0 s, 1403.0 tps, lat 72.563 ms stddev 86.359 2024-05-08T06:04:05.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:04:05 smithi082 ceph-mon[30098]: pgmap v862: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 29 MiB/s wr, 1.71k op/s 2024-05-08T06:04:05.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:04:05 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/2278600809' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:04:05.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:04:05 smithi134 ceph-mon[34132]: pgmap v862: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 29 MiB/s wr, 1.71k op/s 2024-05-08T06:04:06.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:04:05 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/2278600809' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:04:06.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:04:05 smithi151 ceph-mon[34815]: pgmap v862: 97 pgs: 97 active+clean; 1.6 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 29 MiB/s wr, 1.71k op/s 2024-05-08T06:04:06.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:04:05 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/2278600809' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:04:06.171 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-05-08T06:04:06.758 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:04:07.896 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:04:07 smithi082 ceph-mon[30098]: pgmap v863: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 27 MiB/s wr, 1.66k op/s 2024-05-08T06:04:08.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:04:07 smithi134 ceph-mon[34132]: pgmap v863: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 27 MiB/s wr, 1.66k op/s 2024-05-08T06:04:08.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:04:07 smithi151 ceph-mon[34815]: pgmap v863: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 27 MiB/s wr, 1.66k op/s 2024-05-08T06:04:09.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.241+0000 7f75b3c00700 1 -- 172.21.15.82:0/2885904713 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75ac06b6f0 msgr2=0x7f75ac06bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:09.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.241+0000 7f75b3c00700 1 --2- 172.21.15.82:0/2885904713 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75ac06b6f0 0x7f75ac06bb50 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f759c009990 tx=0x7f759c009ca0 comp rx=0 tx=0).stop 2024-05-08T06:04:09.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.242+0000 7f75b3c00700 1 -- 172.21.15.82:0/2885904713 shutdown_connections 2024-05-08T06:04:09.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.242+0000 7f75b3c00700 1 --2- 172.21.15.82:0/2885904713 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f75ac105ee0 0x7f75ac106370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:09.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.242+0000 7f75b3c00700 1 --2- 172.21.15.82:0/2885904713 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75ac1083d0 0x7f75ac06b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:09.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.242+0000 7f75b3c00700 1 --2- 172.21.15.82:0/2885904713 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75ac06b6f0 0x7f75ac06bb50 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:09.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.242+0000 7f75b3c00700 1 -- 172.21.15.82:0/2885904713 >> 172.21.15.82:0/2885904713 conn(0x7f75ac079350 msgr2=0x7f75ac079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:04:09.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.242+0000 7f75b3c00700 1 -- 172.21.15.82:0/2885904713 shutdown_connections 2024-05-08T06:04:09.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.242+0000 7f75b3c00700 1 -- 172.21.15.82:0/2885904713 wait complete. 2024-05-08T06:04:09.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.243+0000 7f75b3c00700 1 Processor -- start 2024-05-08T06:04:09.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.244+0000 7f75b3c00700 1 -- start start 2024-05-08T06:04:09.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.244+0000 7f75b3c00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f75ac06b6f0 0x7f75ac1a0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:09.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.244+0000 7f75b3c00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75ac105ee0 0x7f75ac1a0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:09.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.244+0000 7f75b3c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75ac1083d0 0x7f75ac1a4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:09.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.244+0000 7f75b3c00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f75ac119d00 con 0x7f75ac1083d0 2024-05-08T06:04:09.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.244+0000 7f75b3c00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f75ac119b80 con 0x7f75ac105ee0 2024-05-08T06:04:09.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.244+0000 7f75b3c00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f75ac119e80 con 0x7f75ac06b6f0 2024-05-08T06:04:09.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.245+0000 7f75b1200700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f75ac06b6f0 0x7f75ac1a0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:09.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.245+0000 7f75b1200700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f75ac06b6f0 0x7f75ac1a0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:58572/0 (socket says 172.21.15.82:58572) 2024-05-08T06:04:09.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.245+0000 7f75b1200700 1 -- 172.21.15.82:0/335973952 learned_addr learned my addr 172.21.15.82:0/335973952 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:04:09.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.245+0000 7f75abe00700 1 --2- 172.21.15.82:0/335973952 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75ac105ee0 0x7f75ac1a0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:09.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.245+0000 7f75b1c00700 1 --2- 172.21.15.82:0/335973952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75ac1083d0 0x7f75ac1a4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:09.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.246+0000 7f75b1200700 1 -- 172.21.15.82:0/335973952 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75ac105ee0 msgr2=0x7f75ac1a0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:09.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.246+0000 7f75b1200700 1 --2- 172.21.15.82:0/335973952 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75ac105ee0 0x7f75ac1a0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:09.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.246+0000 7f75b1200700 1 -- 172.21.15.82:0/335973952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75ac1083d0 msgr2=0x7f75ac1a4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:09.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.246+0000 7f75b1200700 1 --2- 172.21.15.82:0/335973952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75ac1083d0 0x7f75ac1a4ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:09.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.246+0000 7f75b1200700 1 -- 172.21.15.82:0/335973952 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75ac1a5220 con 0x7f75ac06b6f0 2024-05-08T06:04:09.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.246+0000 7f75b1200700 1 --2- 172.21.15.82:0/335973952 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f75ac06b6f0 0x7f75ac1a0210 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f75a000c9b0 tx=0x7f75a000cd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:04:09.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.247+0000 7f75a9600700 1 -- 172.21.15.82:0/335973952 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a0007b00 con 0x7f75ac06b6f0 2024-05-08T06:04:09.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.247+0000 7f75a9600700 1 -- 172.21.15.82:0/335973952 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f75a0007ca0 con 0x7f75ac06b6f0 2024-05-08T06:04:09.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.247+0000 7f75a9600700 1 -- 172.21.15.82:0/335973952 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a0018730 con 0x7f75ac06b6f0 2024-05-08T06:04:09.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.247+0000 7f75b3c00700 1 -- 172.21.15.82:0/335973952 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75ac1a5510 con 0x7f75ac06b6f0 2024-05-08T06:04:09.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.247+0000 7f75b3c00700 1 -- 172.21.15.82:0/335973952 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75ac06cec0 con 0x7f75ac06b6f0 2024-05-08T06:04:09.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.251+0000 7f75be590b80 1 Processor -- start 2024-05-08T06:04:09.252 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.252+0000 7f75be590b80 1 -- start start 2024-05-08T06:04:09.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.252+0000 7f75be590b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c89202bc0 0x561c89202fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:09.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.253+0000 7f75be590b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561c892034e0 0x561c891fd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:09.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.253+0000 7f75a9600700 1 -- 172.21.15.82:0/335973952 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f75a00188d0 con 0x7f75ac06b6f0 2024-05-08T06:04:09.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.253+0000 7f75be590b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561c891fd8f0 0x561c891fdd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:09.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.253+0000 7f75be590b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x561c8914fa20 con 0x561c89202bc0 2024-05-08T06:04:09.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.253+0000 7f75be590b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x561c890ed760 con 0x561c892034e0 2024-05-08T06:04:09.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.253+0000 7f75be590b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x561c8914b9e0 con 0x561c891fd8f0 2024-05-08T06:04:09.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.254+0000 7f75b1c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c89202bc0 0x561c89202fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:09.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.254+0000 7f75b1c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c89202bc0 0x561c89202fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38104/0 (socket says 172.21.15.82:38104) 2024-05-08T06:04:09.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.254+0000 7f75b1c00700 1 -- 172.21.15.82:0/394004230 learned_addr learned my addr 172.21.15.82:0/394004230 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:04:09.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.254+0000 7f75b1200700 1 --2- 172.21.15.82:0/394004230 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561c892034e0 0x561c891fd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:09.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.255+0000 7f75b1c00700 1 -- 172.21.15.82:0/394004230 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561c891fd8f0 msgr2=0x561c891fdd70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T06:04:09.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.255+0000 7f75b1c00700 1 --2- 172.21.15.82:0/394004230 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561c891fd8f0 0x561c891fdd70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:09.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.255+0000 7f75b1c00700 1 -- 172.21.15.82:0/394004230 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561c892034e0 msgr2=0x561c891fd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:04:09.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.255+0000 7f75b1c00700 1 --2- 172.21.15.82:0/394004230 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561c892034e0 0x561c891fd2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:09.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.255+0000 7f75b1c00700 1 -- 172.21.15.82:0/394004230 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c8909c8d0 con 0x561c89202bc0 2024-05-08T06:04:09.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.255+0000 7f75a9600700 1 --2- 172.21.15.82:0/335973952 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f75940b29d0 0x7f75940b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:09.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.256+0000 7f75a9600700 1 -- 172.21.15.82:0/335973952 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f75a00e21d0 con 0x7f75ac06b6f0 2024-05-08T06:04:09.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.256+0000 7f75b1200700 1 --2- 172.21.15.82:0/394004230 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561c892034e0 0x561c891fd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:04:09.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.256+0000 7f75b1c00700 1 --2- 172.21.15.82:0/394004230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c89202bc0 0x561c89202fa0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f75a4007d90 tx=0x7f75a400c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee338603b87c4dfb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:04:09.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.257+0000 7f759a000700 1 -- 172.21.15.82:0/394004230 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a4015020 con 0x561c89202bc0 2024-05-08T06:04:09.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.257+0000 7f759a000700 1 -- 172.21.15.82:0/394004230 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f75a400ccc0 con 0x561c89202bc0 2024-05-08T06:04:09.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.257+0000 7f759a000700 1 -- 172.21.15.82:0/394004230 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a40105f0 con 0x561c89202bc0 2024-05-08T06:04:09.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.258+0000 7f75b1200700 1 --2- 172.21.15.82:0/335973952 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f75940b29d0 0x7f75940b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:09.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.258+0000 7f75be590b80 1 -- 172.21.15.82:0/394004230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c89202bc0 msgr2=0x561c89202fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:09.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.258+0000 7f75be590b80 1 --2- 172.21.15.82:0/394004230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c89202bc0 0x561c89202fa0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f75a4007d90 tx=0x7f75a400c470 comp rx=0 tx=0).stop 2024-05-08T06:04:09.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.258+0000 7f75be590b80 1 -- 172.21.15.82:0/394004230 shutdown_connections 2024-05-08T06:04:09.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.258+0000 7f75be590b80 1 --2- 172.21.15.82:0/394004230 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561c891fd8f0 0x561c891fdd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:09.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.258+0000 7f75be590b80 1 --2- 172.21.15.82:0/394004230 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c89202bc0 0x561c89202fa0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:09.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.258+0000 7f75be590b80 1 --2- 172.21.15.82:0/394004230 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561c892034e0 0x561c891fd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:09.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.258+0000 7f75be590b80 1 -- 172.21.15.82:0/394004230 >> 172.21.15.82:0/394004230 conn(0x561c891756d0 msgr2=0x561c891f7b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:04:09.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.258+0000 7f75be590b80 1 -- 172.21.15.82:0/394004230 shutdown_connections 2024-05-08T06:04:09.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.259+0000 7f75be590b80 1 -- 172.21.15.82:0/394004230 wait complete. 2024-05-08T06:04:09.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.259+0000 7f75b1200700 1 --2- 172.21.15.82:0/335973952 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f75940b29d0 0x7f75940b4e90 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x561c892038e0 tx=0x7f75a00a5040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:04:09.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.259+0000 7f75be590b80 1 -- start start 2024-05-08T06:04:09.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.259+0000 7f75be590b80 1 Processor -- start 2024-05-08T06:04:09.260 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.260+0000 7f75be590b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561c891fd8f0 0x561c892091f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:09.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.260+0000 7f75be590b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c89202bc0 0x561c89206590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:09.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.260+0000 7f75be590b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561c892034e0 0x561c89206ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:09.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.260+0000 7f75be590b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x561c89209f20 con 0x561c89202bc0 2024-05-08T06:04:09.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.260+0000 7f75be590b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x561c890b5b20 con 0x561c891fd8f0 2024-05-08T06:04:09.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.260+0000 7f75be590b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x561c8920a0a0 con 0x561c892034e0 2024-05-08T06:04:09.261 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.260+0000 7f75be590b80 10 client.0 _ll_register_callbacks cb 0x561c890f6c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:04:09.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.260+0000 7f75b1c00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561c891fd8f0 0x561c892091f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:09.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.260+0000 7f75abe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c89202bc0 0x561c89206590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:09.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.260+0000 7f75abe00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c89202bc0 0x561c89206590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:38120/0 (socket says 172.21.15.82:38120) 2024-05-08T06:04:09.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.260+0000 7f75abe00700 1 -- 172.21.15.82:0/3386327168 learned_addr learned my addr 172.21.15.82:0/3386327168 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:04:09.262 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.261+0000 7f75b1c00700 1 --2- 172.21.15.82:0/3386327168 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561c892034e0 0x561c89206ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:09.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.261+0000 7f75b1c00700 1 -- 172.21.15.82:0/3386327168 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561c892034e0 msgr2=0x561c89206ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:04:09.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.261+0000 7f75b1c00700 1 --2- 172.21.15.82:0/3386327168 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561c892034e0 0x561c89206ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:09.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.261+0000 7f75b1c00700 1 -- 172.21.15.82:0/3386327168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c89202bc0 msgr2=0x561c89206590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:04:09.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.261+0000 7f75b1c00700 1 --2- 172.21.15.82:0/3386327168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c89202bc0 0x561c89206590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:09.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.261+0000 7f75b1c00700 1 -- 172.21.15.82:0/3386327168 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c89115420 con 0x561c891fd8f0 2024-05-08T06:04:09.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.261+0000 7f75b1c00700 1 --2- 172.21.15.82:0/3386327168 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561c891fd8f0 0x561c892091f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f75a4007d60 tx=0x7f75a4011d60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f4cb3764c03f2b3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:04:09.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.261+0000 7f758ea00700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T06:04:09.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.262+0000 7f758ea00700 1 -- 172.21.15.82:0/3386327168 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75a401e070 con 0x561c891fd8f0 2024-05-08T06:04:09.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.262+0000 7f758ea00700 1 -- 172.21.15.82:0/3386327168 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f75a4007240 con 0x561c891fd8f0 2024-05-08T06:04:09.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.262+0000 7f75be590b80 1 -- 172.21.15.82:0/3386327168 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f75a400ccc0 con 0x561c891fd8f0 2024-05-08T06:04:09.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.263+0000 7f758ea00700 1 -- 172.21.15.82:0/3386327168 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f75a4015070 con 0x561c891fd8f0 2024-05-08T06:04:09.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.263+0000 7f75be590b80 10 client.26657 fetch_fsmap learned FSMap version 31 2024-05-08T06:04:09.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.263+0000 7f75be590b80 1 -- 172.21.15.82:0/3386327168 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x561c89214720 con 0x561c891fd8f0 2024-05-08T06:04:09.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.263+0000 7f758ea00700 1 -- 172.21.15.82:0/3386327168 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f75a400ccc0 con 0x561c891fd8f0 2024-05-08T06:04:09.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.264+0000 7f758ea00700 1 -- 172.21.15.82:0/3386327168 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f75a4010cf0 con 0x561c891fd8f0 2024-05-08T06:04:09.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.264+0000 7f75be590b80 10 client.26657 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:04:09.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.264+0000 7f75be590b80 10 client.26657 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-05-08T06:04:09.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.264+0000 7f75be590b80 20 client.26657 populate_metadata read hostname 'smithi082' 2024-05-08T06:04:09.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.264+0000 7f75be590b80 1 --2- 172.21.15.82:0/3386327168 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x561c89216bf0 0x561c89218fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:09.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.264+0000 7f75be590b80 4 client.26657 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:04:09.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.264+0000 7f75be590b80 1 -- 172.21.15.82:0/3386327168 --> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561c891ca140 con 0x561c89216bf0 2024-05-08T06:04:09.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.265+0000 7f75abe00700 1 --2- 172.21.15.82:0/3386327168 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x561c89216bf0 0x561c89218fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:09.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.265+0000 7f75abe00700 1 --2- 172.21.15.82:0/3386327168 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x561c89216bf0 0x561c89218fe0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=525c5d4d1272ba56 server_cookie=63b52097820aa0d0 in_seq=0 out_seq=0 2024-05-08T06:04:09.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.265+0000 7f758ea00700 10 client.26657 ms_handle_connect on v2:172.21.15.134:6836/2212411710 2024-05-08T06:04:09.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.266+0000 7f758ea00700 1 -- 172.21.15.82:0/3386327168 <== mds.4 v2:172.21.15.134:6836/2212411710 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x561c891ca140 con 0x561c89216bf0 2024-05-08T06:04:09.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.266+0000 7f758ea00700 10 client.26657 handle_command_reply: tid=0 2024-05-08T06:04:09.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.266+0000 7f75be590b80 1 client.26657 shutdown 2024-05-08T06:04:09.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.267+0000 7f75be590b80 1 -- 172.21.15.82:0/3386327168 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561c891fd8f0 msgr2=0x561c892091f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:09.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.267+0000 7f75be590b80 1 --2- 172.21.15.82:0/3386327168 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561c891fd8f0 0x561c892091f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f75a4007d60 tx=0x7f75a4011d60 comp rx=0 tx=0).stop 2024-05-08T06:04:09.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.267+0000 7f75be590b80 1 -- 172.21.15.82:0/3386327168 shutdown_connections 2024-05-08T06:04:09.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.267+0000 7f75be590b80 1 --2- 172.21.15.82:0/3386327168 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x561c89216bf0 0x561c89218fe0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:09.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.267+0000 7f75be590b80 1 --2- 172.21.15.82:0/3386327168 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561c891fd8f0 0x561c892091f0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:09.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.267+0000 7f75be590b80 1 --2- 172.21.15.82:0/3386327168 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561c892034e0 0x561c89206ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:09.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.267+0000 7f75be590b80 1 --2- 172.21.15.82:0/3386327168 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c89202bc0 0x561c89206590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:09.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.267+0000 7f758ea00700 0 client.26657 ms_handle_reset on v2:172.21.15.134:6836/2212411710 2024-05-08T06:04:09.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.267+0000 7f75be590b80 1 -- 172.21.15.82:0/3386327168 >> 172.21.15.82:0/3386327168 conn(0x561c891756d0 msgr2=0x561c891f7190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:04:09.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.267+0000 7f75be590b80 1 -- 172.21.15.82:0/3386327168 shutdown_connections 2024-05-08T06:04:09.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.267+0000 7f75be590b80 1 -- 172.21.15.82:0/3386327168 wait complete. 2024-05-08T06:04:09.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.268+0000 7f75be590b80 20 client.26657 trim_cache size 0 max 16384 2024-05-08T06:04:09.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.297+0000 7f75be590b80 1 Processor -- start 2024-05-08T06:04:09.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.297+0000 7f75be590b80 1 -- start start 2024-05-08T06:04:09.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.297+0000 7f75be590b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c891fd8f0 0x561c89212fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:09.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.297+0000 7f75be590b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561c89202bc0 0x561c89205710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:09.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.297+0000 7f75be590b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561c892034e0 0x561c891f7910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:09.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.297+0000 7f75be590b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f75ac074220 con 0x561c891fd8f0 2024-05-08T06:04:09.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.297+0000 7f75be590b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f75ac1be440 con 0x561c892034e0 2024-05-08T06:04:09.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.297+0000 7f75be590b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f75ac0748f0 con 0x561c89202bc0 2024-05-08T06:04:09.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.298+0000 7f75abe00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561c89202bc0 0x561c89205710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:09.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.298+0000 7f75abe00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561c89202bc0 0x561c89205710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:58602/0 (socket says 172.21.15.82:58602) 2024-05-08T06:04:09.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.298+0000 7f75abe00700 1 -- 172.21.15.82:0/1159134335 learned_addr learned my addr 172.21.15.82:0/1159134335 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:04:09.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.298+0000 7f75abe00700 1 -- 172.21.15.82:0/1159134335 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561c892034e0 msgr2=0x561c891f7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:04:09.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.298+0000 7f75abe00700 1 --2- 172.21.15.82:0/1159134335 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561c892034e0 0x561c891f7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:09.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.298+0000 7f75abe00700 1 -- 172.21.15.82:0/1159134335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c891fd8f0 msgr2=0x561c89212fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:04:09.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.298+0000 7f75b1c00700 1 --2- 172.21.15.82:0/1159134335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c891fd8f0 0x561c89212fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:09.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.298+0000 7f75abe00700 1 --2- 172.21.15.82:0/1159134335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c891fd8f0 0x561c89212fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:09.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.298+0000 7f75abe00700 1 -- 172.21.15.82:0/1159134335 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561c891f2ab0 con 0x561c89202bc0 2024-05-08T06:04:09.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.298+0000 7f75b1c00700 1 --2- 172.21.15.82:0/1159134335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c891fd8f0 0x561c89212fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:04:09.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.299+0000 7f75abe00700 1 --2- 172.21.15.82:0/1159134335 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561c89202bc0 0x561c89205710 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f759c0098e0 tx=0x7f759c005ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a580c936be33c435 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:04:09.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.299+0000 7f7599600700 1 -- 172.21.15.82:0/1159134335 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f759c02d070 con 0x561c89202bc0 2024-05-08T06:04:09.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.299+0000 7f7599600700 1 -- 172.21.15.82:0/1159134335 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f759c003da0 con 0x561c89202bc0 2024-05-08T06:04:09.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.299+0000 7f7599600700 1 -- 172.21.15.82:0/1159134335 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f759c005690 con 0x561c89202bc0 2024-05-08T06:04:09.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.300+0000 7f75be590b80 1 -- 172.21.15.82:0/1159134335 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561c89202bc0 msgr2=0x561c89205710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:09.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.300+0000 7f75be590b80 1 --2- 172.21.15.82:0/1159134335 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561c89202bc0 0x561c89205710 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f759c0098e0 tx=0x7f759c005ec0 comp rx=0 tx=0).stop 2024-05-08T06:04:09.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.300+0000 7f75be590b80 1 -- 172.21.15.82:0/1159134335 shutdown_connections 2024-05-08T06:04:09.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.300+0000 7f75be590b80 1 --2- 172.21.15.82:0/1159134335 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561c892034e0 0x561c891f7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:09.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.300+0000 7f75be590b80 1 --2- 172.21.15.82:0/1159134335 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c891fd8f0 0x561c89212fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:09.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.300+0000 7f75be590b80 1 --2- 172.21.15.82:0/1159134335 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561c89202bc0 0x561c89205710 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:09.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.300+0000 7f75be590b80 1 -- 172.21.15.82:0/1159134335 >> 172.21.15.82:0/1159134335 conn(0x561c891756d0 msgr2=0x561c892016a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:04:09.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.300+0000 7f75be590b80 1 -- 172.21.15.82:0/1159134335 shutdown_connections 2024-05-08T06:04:09.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.300+0000 7f75be590b80 1 -- 172.21.15.82:0/1159134335 wait complete. 2024-05-08T06:04:09.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.301+0000 7f75be590b80 1 -- start start 2024-05-08T06:04:09.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.301+0000 7f75be590b80 1 Processor -- start 2024-05-08T06:04:09.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.302+0000 7f75be590b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561c891fd8f0 0x561c8920f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:09.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.302+0000 7f75be590b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561c89202bc0 0x561c8921dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:09.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.302+0000 7f75be590b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c892034e0 0x561c8921e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:09.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.302+0000 7f75be590b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f75ac1bdda0 con 0x561c892034e0 2024-05-08T06:04:09.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.302+0000 7f75be590b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f75ac074fc0 con 0x561c891fd8f0 2024-05-08T06:04:09.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.302+0000 7f75be590b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f75ac0721c0 con 0x561c89202bc0 2024-05-08T06:04:09.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.302+0000 7f75be590b80 10 client.0 _ll_register_callbacks cb 0x561c890f6c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:04:09.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.302+0000 7f75abe00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561c89202bc0 0x561c8921dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:09.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.302+0000 7f75abe00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561c89202bc0 0x561c8921dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:58606/0 (socket says 172.21.15.82:58606) 2024-05-08T06:04:09.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.302+0000 7f75abe00700 1 -- 172.21.15.82:0/2954429245 learned_addr learned my addr 172.21.15.82:0/2954429245 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:04:09.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.303+0000 7f75abe00700 1 -- 172.21.15.82:0/2954429245 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561c891fd8f0 msgr2=0x561c8920f7b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T06:04:09.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.303+0000 7f75abe00700 1 --2- 172.21.15.82:0/2954429245 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561c891fd8f0 0x561c8920f7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:09.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.303+0000 7f75abe00700 1 -- 172.21.15.82:0/2954429245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c892034e0 msgr2=0x561c8921e220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T06:04:09.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.303+0000 7f75abe00700 1 --2- 172.21.15.82:0/2954429245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c892034e0 0x561c8921e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:09.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.303+0000 7f75abe00700 1 -- 172.21.15.82:0/2954429245 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561c8921e9a0 con 0x561c89202bc0 2024-05-08T06:04:09.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.304+0000 7f75abe00700 1 --2- 172.21.15.82:0/2954429245 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561c89202bc0 0x561c8921dce0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f759c009750 tx=0x7f759c005c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39950fa2ec17ac7b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:04:09.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.304+0000 7f758ea00700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T06:04:09.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.304+0000 7f758ea00700 1 -- 172.21.15.82:0/2954429245 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f759c02d070 con 0x561c89202bc0 2024-05-08T06:04:09.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.305+0000 7f758ea00700 1 -- 172.21.15.82:0/2954429245 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f759c00bb40 con 0x561c89202bc0 2024-05-08T06:04:09.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.305+0000 7f75be590b80 1 -- 172.21.15.82:0/2954429245 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f759c003da0 con 0x561c89202bc0 2024-05-08T06:04:09.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.305+0000 7f758ea00700 1 -- 172.21.15.82:0/2954429245 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f759c00b770 con 0x561c89202bc0 2024-05-08T06:04:09.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.305+0000 7f75be590b80 10 client.26689 fetch_fsmap learned FSMap version 31 2024-05-08T06:04:09.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.305+0000 7f75be590b80 1 -- 172.21.15.82:0/2954429245 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x561c89281200 con 0x561c89202bc0 2024-05-08T06:04:09.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.306+0000 7f758ea00700 1 -- 172.21.15.82:0/2954429245 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f759c003da0 con 0x561c89202bc0 2024-05-08T06:04:09.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.306+0000 7f758ea00700 1 -- 172.21.15.82:0/2954429245 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f759c00f9d0 con 0x561c89202bc0 2024-05-08T06:04:09.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.306+0000 7f75be590b80 10 client.26689 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:04:09.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.306+0000 7f75be590b80 10 client.26689 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-05-08T06:04:09.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.306+0000 7f75be590b80 20 client.26689 populate_metadata read hostname 'smithi082' 2024-05-08T06:04:09.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.307+0000 7f75be590b80 1 --2- 172.21.15.82:0/2954429245 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x561c89281680 0x561c89283aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:09.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.307+0000 7f75be590b80 4 client.26689 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T06:04:09.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.307+0000 7f75be590b80 1 -- 172.21.15.82:0/2954429245 --> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561c8915d400 con 0x561c89281680 2024-05-08T06:04:09.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.307+0000 7f75b1c00700 1 --2- 172.21.15.82:0/2954429245 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x561c89281680 0x561c89283aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:09.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.307+0000 7f75b1c00700 1 --2- 172.21.15.82:0/2954429245 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x561c89281680 0x561c89283aa0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=552e37c945e99ab8 server_cookie=4fdd0694b0433cf1 in_seq=0 out_seq=0 2024-05-08T06:04:09.308 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.307+0000 7f758ea00700 10 client.26689 ms_handle_connect on v2:172.21.15.134:6836/2212411710 2024-05-08T06:04:09.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.308+0000 7f758ea00700 1 -- 172.21.15.82:0/2954429245 <== mds.4 v2:172.21.15.134:6836/2212411710 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561c8915d400 con 0x561c89281680 2024-05-08T06:04:09.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.308+0000 7f758ea00700 10 client.26689 handle_command_reply: tid=0 2024-05-08T06:04:09.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.308+0000 7f75be590b80 1 client.26689 shutdown 2024-05-08T06:04:09.309 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.308+0000 7f75be590b80 1 -- 172.21.15.82:0/2954429245 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561c89202bc0 msgr2=0x561c8921dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:09.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.308+0000 7f75be590b80 1 --2- 172.21.15.82:0/2954429245 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561c89202bc0 0x561c8921dce0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f759c009750 tx=0x7f759c005c00 comp rx=0 tx=0).stop 2024-05-08T06:04:09.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.308+0000 7f75be590b80 1 -- 172.21.15.82:0/2954429245 shutdown_connections 2024-05-08T06:04:09.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.308+0000 7f75be590b80 1 --2- 172.21.15.82:0/2954429245 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x561c89281680 0x561c89283aa0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:09.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.308+0000 7f75be590b80 1 --2- 172.21.15.82:0/2954429245 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561c891fd8f0 0x561c8920f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:09.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.308+0000 7f75be590b80 1 --2- 172.21.15.82:0/2954429245 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561c892034e0 0x561c8921e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:09.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.308+0000 7f75be590b80 1 --2- 172.21.15.82:0/2954429245 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561c89202bc0 0x561c8921dce0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:09.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.308+0000 7f75be590b80 1 -- 172.21.15.82:0/2954429245 >> 172.21.15.82:0/2954429245 conn(0x561c891756d0 msgr2=0x561c892083f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:04:09.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.308+0000 7f758ea00700 0 client.26689 ms_handle_reset on v2:172.21.15.134:6836/2212411710 2024-05-08T06:04:09.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.309+0000 7f75be590b80 1 -- 172.21.15.82:0/2954429245 shutdown_connections 2024-05-08T06:04:09.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.309+0000 7f75be590b80 1 -- 172.21.15.82:0/2954429245 wait complete. 2024-05-08T06:04:09.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.309+0000 7f75be590b80 20 client.26689 trim_cache size 0 max 16384 2024-05-08T06:04:09.311 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T06:04:09.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.310+0000 7f75b3c00700 1 -- 172.21.15.82:0/335973952 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f75940b29d0 msgr2=0x7f75940b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:09.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.310+0000 7f75b3c00700 1 --2- 172.21.15.82:0/335973952 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f75940b29d0 0x7f75940b4e90 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x561c892038e0 tx=0x7f75a00a5040 comp rx=0 tx=0).stop 2024-05-08T06:04:09.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.310+0000 7f75b3c00700 1 -- 172.21.15.82:0/335973952 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f75ac06b6f0 msgr2=0x7f75ac1a0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:09.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.310+0000 7f75b3c00700 1 --2- 172.21.15.82:0/335973952 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f75ac06b6f0 0x7f75ac1a0210 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f75a000c9b0 tx=0x7f75a000cd70 comp rx=0 tx=0).stop 2024-05-08T06:04:09.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.310+0000 7f75b3c00700 1 -- 172.21.15.82:0/335973952 shutdown_connections 2024-05-08T06:04:09.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.310+0000 7f75b3c00700 1 --2- 172.21.15.82:0/335973952 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f75940b29d0 0x7f75940b4e90 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:09.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.310+0000 7f75b3c00700 1 --2- 172.21.15.82:0/335973952 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f75ac1083d0 0x7f75ac1a4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:09.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.310+0000 7f75b3c00700 1 --2- 172.21.15.82:0/335973952 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f75ac06b6f0 0x7f75ac1a0210 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:09.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.310+0000 7f75b3c00700 1 --2- 172.21.15.82:0/335973952 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75ac105ee0 0x7f75ac1a0750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:09.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.310+0000 7f75b3c00700 1 -- 172.21.15.82:0/335973952 >> 172.21.15.82:0/335973952 conn(0x7f75ac079350 msgr2=0x7f75ac104ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:04:09.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.310+0000 7f75b3c00700 1 -- 172.21.15.82:0/335973952 shutdown_connections 2024-05-08T06:04:09.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:09.310+0000 7f75b3c00700 1 -- 172.21.15.82:0/335973952 wait complete. 2024-05-08T06:04:09.769 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:04:09 smithi082 ceph-mon[30098]: pgmap v864: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.8 MiB/s wr, 740 op/s 2024-05-08T06:04:10.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:04:09 smithi134 ceph-mon[34132]: pgmap v864: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.8 MiB/s wr, 740 op/s 2024-05-08T06:04:10.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:04:09 smithi151 ceph-mon[34815]: pgmap v864: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.8 MiB/s wr, 740 op/s 2024-05-08T06:04:10.184 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-05-08T06:04:10.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 800.0 s, 1373.2 tps, lat 71.073 ms stddev 83.290 2024-05-08T06:04:10.784 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:04:12.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:04:11 smithi134 ceph-mon[34132]: pgmap v865: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.8 MiB/s wr, 719 op/s 2024-05-08T06:04:12.004 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:04:11 smithi082 ceph-mon[30098]: pgmap v865: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.8 MiB/s wr, 719 op/s 2024-05-08T06:04:12.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:04:11 smithi151 ceph-mon[34815]: pgmap v865: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.8 MiB/s wr, 719 op/s 2024-05-08T06:04:12.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:12.988+0000 7f5c1ee00700 1 -- 172.21.15.82:0/3733598174 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c1806b1b0 msgr2=0x7f5c1806b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:12.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:12.988+0000 7f5c1ee00700 1 --2- 172.21.15.82:0/3733598174 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c1806b1b0 0x7f5c1806b590 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5c080098f0 tx=0x7f5c08009c00 comp rx=0 tx=0).stop 2024-05-08T06:04:12.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:12.988+0000 7f5c1ee00700 1 -- 172.21.15.82:0/3733598174 shutdown_connections 2024-05-08T06:04:12.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:12.988+0000 7f5c1ee00700 1 --2- 172.21.15.82:0/3733598174 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c1806b1b0 0x7f5c1806b590 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:12.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:12.988+0000 7f5c1ee00700 1 --2- 172.21.15.82:0/3733598174 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c1810ff50 0x7f5c18112340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:12.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:12.988+0000 7f5c1ee00700 1 --2- 172.21.15.82:0/3733598174 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c1806bad0 0x7f5c1810fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:12.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:12.988+0000 7f5c1ee00700 1 -- 172.21.15.82:0/3733598174 >> 172.21.15.82:0/3733598174 conn(0x7f5c18079350 msgr2=0x7f5c18079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:04:12.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:12.988+0000 7f5c1ee00700 1 -- 172.21.15.82:0/3733598174 shutdown_connections 2024-05-08T06:04:12.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:12.988+0000 7f5c1ee00700 1 -- 172.21.15.82:0/3733598174 wait complete. 2024-05-08T06:04:12.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:12.991+0000 7f5c1ee00700 1 Processor -- start 2024-05-08T06:04:12.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:12.992+0000 7f5c1ee00700 1 -- start start 2024-05-08T06:04:12.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:12.992+0000 7f5c1ee00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c1806b1b0 0x7f5c1819bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:12.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:12.992+0000 7f5c1ee00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c1806bad0 0x7f5c1819c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:12.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:12.993+0000 7f5c1ee00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c1810ff50 0x7f5c181a0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:12.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:12.993+0000 7f5c1ee00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5c18115860 con 0x7f5c1810ff50 2024-05-08T06:04:12.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:12.993+0000 7f5c1ee00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5c181156e0 con 0x7f5c1806bad0 2024-05-08T06:04:12.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:12.993+0000 7f5c1ee00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5c181159e0 con 0x7f5c1806b1b0 2024-05-08T06:04:12.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:12.993+0000 7f5c17400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c1806bad0 0x7f5c1819c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:12.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:12.993+0000 7f5c17400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c1806bad0 0x7f5c1819c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:36650/0 (socket says 172.21.15.82:36650) 2024-05-08T06:04:12.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:12.993+0000 7f5c17400700 1 -- 172.21.15.82:0/310942465 learned_addr learned my addr 172.21.15.82:0/310942465 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:04:12.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:12.993+0000 7f5c17e00700 1 --2- 172.21.15.82:0/310942465 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c1806b1b0 0x7f5c1819bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:12.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:12.993+0000 7f5c1ce00700 1 --2- 172.21.15.82:0/310942465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c1810ff50 0x7f5c181a0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:12.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:12.994+0000 7f5c17400700 1 -- 172.21.15.82:0/310942465 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c1806b1b0 msgr2=0x7f5c1819bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:12.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:12.994+0000 7f5c17400700 1 --2- 172.21.15.82:0/310942465 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c1806b1b0 0x7f5c1819bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:12.995 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:12.994+0000 7f5c17400700 1 -- 172.21.15.82:0/310942465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c1810ff50 msgr2=0x7f5c181a0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:12.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:12.994+0000 7f5c17400700 1 --2- 172.21.15.82:0/310942465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c1810ff50 0x7f5c181a0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:12.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:12.994+0000 7f5c17400700 1 -- 172.21.15.82:0/310942465 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c181a0da0 con 0x7f5c1806bad0 2024-05-08T06:04:12.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:12.995+0000 7f5c17400700 1 --2- 172.21.15.82:0/310942465 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c1806bad0 0x7f5c1819c2d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5c0400ec10 tx=0x7f5c0400c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:04:12.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:12.996+0000 7f5c14c00700 1 -- 172.21.15.82:0/310942465 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c0400cde0 con 0x7f5c1806bad0 2024-05-08T06:04:12.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:12.996+0000 7f5c14c00700 1 -- 172.21.15.82:0/310942465 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c040044d0 con 0x7f5c1806bad0 2024-05-08T06:04:12.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:12.996+0000 7f5c14c00700 1 -- 172.21.15.82:0/310942465 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c04010690 con 0x7f5c1806bad0 2024-05-08T06:04:12.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:12.996+0000 7f5c1ee00700 1 -- 172.21.15.82:0/310942465 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c181a1090 con 0x7f5c1806bad0 2024-05-08T06:04:12.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:12.997+0000 7f5c1ee00700 1 -- 172.21.15.82:0/310942465 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c181a8910 con 0x7f5c1806bad0 2024-05-08T06:04:13.004 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.003+0000 7f5c296e0b80 1 Processor -- start 2024-05-08T06:04:13.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.004+0000 7f5c296e0b80 1 -- start start 2024-05-08T06:04:13.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.004+0000 7f5c296e0b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622e1aef3d0 0x5622e1aef7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:13.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.004+0000 7f5c296e0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622e1aefcf0 0x5622e1ae9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:13.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.004+0000 7f5c296e0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622e1aea100 0x5622e1aea580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:13.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.004+0000 7f5c296e0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5622e1a33a20 con 0x5622e1aefcf0 2024-05-08T06:04:13.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.004+0000 7f5c296e0b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5622e19d1760 con 0x5622e1aef3d0 2024-05-08T06:04:13.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.004+0000 7f5c296e0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5622e1a2f9e0 con 0x5622e1aea100 2024-05-08T06:04:13.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.005+0000 7f5c14c00700 1 -- 172.21.15.82:0/310942465 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f5c04003f00 con 0x7f5c1806bad0 2024-05-08T06:04:13.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.006+0000 7f5c17400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622e1aea100 0x5622e1aea580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:13.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.006+0000 7f5c17400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622e1aea100 0x5622e1aea580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:43354/0 (socket says 172.21.15.82:43354) 2024-05-08T06:04:13.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.006+0000 7f5c17400700 1 -- 172.21.15.82:0/1511218841 learned_addr learned my addr 172.21.15.82:0/1511218841 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:04:13.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.006+0000 7f5c17400700 1 -- 172.21.15.82:0/1511218841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622e1aef3d0 msgr2=0x5622e1aef7b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T06:04:13.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.006+0000 7f5c17400700 1 --2- 172.21.15.82:0/1511218841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622e1aef3d0 0x5622e1aef7b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:13.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.006+0000 7f5c17400700 1 -- 172.21.15.82:0/1511218841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622e1aefcf0 msgr2=0x5622e1ae9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:04:13.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.007+0000 7f5c17400700 1 --2- 172.21.15.82:0/1511218841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622e1aefcf0 0x5622e1ae9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:13.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.007+0000 7f5c17400700 1 -- 172.21.15.82:0/1511218841 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622e19808d0 con 0x5622e1aea100 2024-05-08T06:04:13.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.007+0000 7f5c17400700 1 --2- 172.21.15.82:0/1511218841 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622e1aea100 0x5622e1aea580 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f5c040e84b0 tx=0x7f5c040e84e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2e3e5cd347b0888 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:04:13.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.008+0000 7f5c14c00700 1 --2- 172.21.15.82:0/310942465 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f5bfc0b2a50 0x7f5bfc0b4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:13.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.008+0000 7f5c0d600700 1 -- 172.21.15.82:0/1511218841 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c040f5070 con 0x5622e1aea100 2024-05-08T06:04:13.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.008+0000 7f5c0d600700 1 -- 172.21.15.82:0/1511218841 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c040797b0 con 0x5622e1aea100 2024-05-08T06:04:13.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.008+0000 7f5c0d600700 1 -- 172.21.15.82:0/1511218841 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c040a92f0 con 0x5622e1aea100 2024-05-08T06:04:13.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.008+0000 7f5c14c00700 1 -- 172.21.15.82:0/310942465 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f5c040e25b0 con 0x7f5c1806bad0 2024-05-08T06:04:13.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.008+0000 7f5c1ce00700 1 --2- 172.21.15.82:0/310942465 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f5bfc0b2a50 0x7f5bfc0b4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:13.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.009+0000 7f5c296e0b80 1 -- 172.21.15.82:0/1511218841 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622e1aea100 msgr2=0x5622e1aea580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:13.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.009+0000 7f5c296e0b80 1 --2- 172.21.15.82:0/1511218841 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622e1aea100 0x5622e1aea580 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f5c040e84b0 tx=0x7f5c040e84e0 comp rx=0 tx=0).stop 2024-05-08T06:04:13.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.010+0000 7f5c1ce00700 1 --2- 172.21.15.82:0/310942465 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f5bfc0b2a50 0x7f5bfc0b4f10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5c1806ad70 tx=0x7f5c1000b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:04:13.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.010+0000 7f5c296e0b80 1 -- 172.21.15.82:0/1511218841 shutdown_connections 2024-05-08T06:04:13.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.010+0000 7f5c296e0b80 1 --2- 172.21.15.82:0/1511218841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622e1aef3d0 0x5622e1aef7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:13.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.010+0000 7f5c296e0b80 1 --2- 172.21.15.82:0/1511218841 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622e1aea100 0x5622e1aea580 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:13.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.010+0000 7f5c296e0b80 1 --2- 172.21.15.82:0/1511218841 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622e1aefcf0 0x5622e1ae9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:13.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.010+0000 7f5c296e0b80 1 -- 172.21.15.82:0/1511218841 >> 172.21.15.82:0/1511218841 conn(0x5622e1a596d0 msgr2=0x5622e1adbb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:04:13.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.010+0000 7f5c296e0b80 1 -- 172.21.15.82:0/1511218841 shutdown_connections 2024-05-08T06:04:13.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.010+0000 7f5c296e0b80 1 -- 172.21.15.82:0/1511218841 wait complete. 2024-05-08T06:04:13.011 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.011+0000 7f5c296e0b80 1 -- start start 2024-05-08T06:04:13.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.011+0000 7f5c296e0b80 1 Processor -- start 2024-05-08T06:04:13.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.012+0000 7f5c296e0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622e1aea100 0x5622e1ae3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:13.012 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.012+0000 7f5c296e0b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622e1aef3d0 0x5622e1ae3c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:13.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.012+0000 7f5c296e0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622e1aefcf0 0x5622e1ae9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:13.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.012+0000 7f5c296e0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5622e1ade650 con 0x5622e1aefcf0 2024-05-08T06:04:13.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.012+0000 7f5c296e0b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5622e1999b20 con 0x5622e1aef3d0 2024-05-08T06:04:13.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.012+0000 7f5c296e0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5622e1ade7d0 con 0x5622e1aea100 2024-05-08T06:04:13.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.012+0000 7f5c296e0b80 10 client.0 _ll_register_callbacks cb 0x5622e19dac70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:04:13.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.012+0000 7f5c17e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622e1aea100 0x5622e1ae3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:13.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.012+0000 7f5c17e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622e1aea100 0x5622e1ae3730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:43360/0 (socket says 172.21.15.82:43360) 2024-05-08T06:04:13.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.012+0000 7f5c17e00700 1 -- 172.21.15.82:0/4138050372 learned_addr learned my addr 172.21.15.82:0/4138050372 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:04:13.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.012+0000 7f5c17400700 1 --2- 172.21.15.82:0/4138050372 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622e1aef3d0 0x5622e1ae3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:13.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.012+0000 7f5c17e00700 1 -- 172.21.15.82:0/4138050372 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622e1aef3d0 msgr2=0x5622e1ae3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:04:13.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.012+0000 7f5c17e00700 1 --2- 172.21.15.82:0/4138050372 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622e1aef3d0 0x5622e1ae3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:13.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.012+0000 7f5c17e00700 1 -- 172.21.15.82:0/4138050372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622e1aefcf0 msgr2=0x5622e1ae9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:04:13.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.012+0000 7f5c17e00700 1 --2- 172.21.15.82:0/4138050372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622e1aefcf0 0x5622e1ae9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:13.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.012+0000 7f5c17e00700 1 -- 172.21.15.82:0/4138050372 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622e19f9420 con 0x5622e1aea100 2024-05-08T06:04:13.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.013+0000 7f5c17e00700 1 --2- 172.21.15.82:0/4138050372 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622e1aea100 0x5622e1ae3730 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5c080098f0 tx=0x7f5c0800f510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba32661f9cd6b16f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:04:13.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.013+0000 7f5c02000700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T06:04:13.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.013+0000 7f5c02000700 1 -- 172.21.15.82:0/4138050372 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c08005040 con 0x5622e1aea100 2024-05-08T06:04:13.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.013+0000 7f5c296e0b80 1 -- 172.21.15.82:0/4138050372 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c040797b0 con 0x5622e1aea100 2024-05-08T06:04:13.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.013+0000 7f5c02000700 1 -- 172.21.15.82:0/4138050372 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f5c080051e0 con 0x5622e1aea100 2024-05-08T06:04:13.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.013+0000 7f5c02000700 1 -- 172.21.15.82:0/4138050372 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f5c080053e0 con 0x5622e1aea100 2024-05-08T06:04:13.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.013+0000 7f5c296e0b80 10 client.26701 fetch_fsmap learned FSMap version 31 2024-05-08T06:04:13.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.013+0000 7f5c296e0b80 1 -- 172.21.15.82:0/4138050372 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5622e1b098f0 con 0x5622e1aea100 2024-05-08T06:04:13.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.014+0000 7f5c02000700 1 -- 172.21.15.82:0/4138050372 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c040797b0 con 0x5622e1aea100 2024-05-08T06:04:13.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.014+0000 7f5c02000700 1 -- 172.21.15.82:0/4138050372 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f5c0802a030 con 0x5622e1aea100 2024-05-08T06:04:13.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.015+0000 7f5c296e0b80 10 client.26701 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:04:13.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.015+0000 7f5c296e0b80 10 client.26701 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-05-08T06:04:13.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.015+0000 7f5c296e0b80 20 client.26701 populate_metadata read hostname 'smithi082' 2024-05-08T06:04:13.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.015+0000 7f5c296e0b80 1 --2- 172.21.15.82:0/4138050372 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x5622e1b0be80 0x5622e1b0e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:13.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.015+0000 7f5c296e0b80 4 client.26701 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:04:13.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.015+0000 7f5c296e0b80 1 -- 172.21.15.82:0/4138050372 --> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5622e1aae140 con 0x5622e1b0be80 2024-05-08T06:04:13.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.016+0000 7f5c17400700 1 --2- 172.21.15.82:0/4138050372 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x5622e1b0be80 0x5622e1b0e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:13.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.017+0000 7f5c17400700 1 --2- 172.21.15.82:0/4138050372 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x5622e1b0be80 0x5622e1b0e270 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=38cc71fd896e6956 server_cookie=e7ac84d1bfd958d5 in_seq=0 out_seq=0 2024-05-08T06:04:13.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.017+0000 7f5c02000700 10 client.26701 ms_handle_connect on v2:172.21.15.151:6834/2093655929 2024-05-08T06:04:13.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.018+0000 7f5c02000700 1 -- 172.21.15.82:0/4138050372 <== mds.3 v2:172.21.15.151:6834/2093655929 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5622e1aae140 con 0x5622e1b0be80 2024-05-08T06:04:13.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.018+0000 7f5c02000700 10 client.26701 handle_command_reply: tid=0 2024-05-08T06:04:13.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.018+0000 7f5c296e0b80 1 client.26701 shutdown 2024-05-08T06:04:13.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.019+0000 7f5c296e0b80 1 -- 172.21.15.82:0/4138050372 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622e1aea100 msgr2=0x5622e1ae3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:13.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.019+0000 7f5c296e0b80 1 --2- 172.21.15.82:0/4138050372 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622e1aea100 0x5622e1ae3730 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5c080098f0 tx=0x7f5c0800f510 comp rx=0 tx=0).stop 2024-05-08T06:04:13.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.019+0000 7f5c296e0b80 1 -- 172.21.15.82:0/4138050372 shutdown_connections 2024-05-08T06:04:13.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.019+0000 7f5c296e0b80 1 --2- 172.21.15.82:0/4138050372 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x5622e1b0be80 0x5622e1b0e270 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:13.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.019+0000 7f5c296e0b80 1 --2- 172.21.15.82:0/4138050372 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622e1aefcf0 0x5622e1ae9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:13.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.019+0000 7f5c296e0b80 1 --2- 172.21.15.82:0/4138050372 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622e1aea100 0x5622e1ae3730 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:13.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.019+0000 7f5c296e0b80 1 --2- 172.21.15.82:0/4138050372 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622e1aef3d0 0x5622e1ae3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:13.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.019+0000 7f5c296e0b80 1 -- 172.21.15.82:0/4138050372 >> 172.21.15.82:0/4138050372 conn(0x5622e1a596d0 msgr2=0x5622e1adb190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:04:13.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.019+0000 7f5c02000700 0 client.26701 ms_handle_reset on v2:172.21.15.151:6834/2093655929 2024-05-08T06:04:13.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.019+0000 7f5c296e0b80 1 -- 172.21.15.82:0/4138050372 shutdown_connections 2024-05-08T06:04:13.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.019+0000 7f5c296e0b80 1 -- 172.21.15.82:0/4138050372 wait complete. 2024-05-08T06:04:13.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.020+0000 7f5c296e0b80 20 client.26701 trim_cache size 0 max 16384 2024-05-08T06:04:13.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.045+0000 7f5c296e0b80 1 Processor -- start 2024-05-08T06:04:13.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.045+0000 7f5c296e0b80 1 -- start start 2024-05-08T06:04:13.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.046+0000 7f5c296e0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622e1aea100 0x5622e1ae93d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:13.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.046+0000 7f5c296e0b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622e1aef3d0 0x5622e1b13b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:13.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.046+0000 7f5c296e0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622e1aefcf0 0x5622e1b14080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:13.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.046+0000 7f5c296e0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5c181ab880 con 0x5622e1aea100 2024-05-08T06:04:13.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.046+0000 7f5c296e0b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5c181ad3c0 con 0x5622e1aef3d0 2024-05-08T06:04:13.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.046+0000 7f5c296e0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5c181abf50 con 0x5622e1aefcf0 2024-05-08T06:04:13.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.046+0000 7f5c1ce00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622e1aefcf0 0x5622e1b14080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:13.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.046+0000 7f5c1ce00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622e1aefcf0 0x5622e1b14080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:43362/0 (socket says 172.21.15.82:43362) 2024-05-08T06:04:13.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.046+0000 7f5c1ce00700 1 -- 172.21.15.82:0/1083731818 learned_addr learned my addr 172.21.15.82:0/1083731818 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:04:13.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.046+0000 7f5c17400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622e1aef3d0 0x5622e1b13b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:13.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.047+0000 7f5c17400700 1 -- 172.21.15.82:0/1083731818 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622e1aefcf0 msgr2=0x5622e1b14080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:04:13.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.047+0000 7f5c17400700 1 --2- 172.21.15.82:0/1083731818 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622e1aefcf0 0x5622e1b14080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:13.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.047+0000 7f5c17400700 1 -- 172.21.15.82:0/1083731818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622e1aea100 msgr2=0x5622e1ae93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:04:13.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.047+0000 7f5c17400700 1 --2- 172.21.15.82:0/1083731818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622e1aea100 0x5622e1ae93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:13.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.047+0000 7f5c17400700 1 -- 172.21.15.82:0/1083731818 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622e1aefa00 con 0x5622e1aef3d0 2024-05-08T06:04:13.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.048+0000 7f5c17400700 1 --2- 172.21.15.82:0/1083731818 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622e1aef3d0 0x5622e1b13b40 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5c040e8480 tx=0x7f5c040e8310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7328b6d71f59f30 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:04:13.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.048+0000 7f5c0cc00700 1 -- 172.21.15.82:0/1083731818 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c040820f0 con 0x5622e1aef3d0 2024-05-08T06:04:13.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.049+0000 7f5c0cc00700 1 -- 172.21.15.82:0/1083731818 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c040e5e50 con 0x5622e1aef3d0 2024-05-08T06:04:13.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.049+0000 7f5c0cc00700 1 -- 172.21.15.82:0/1083731818 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c040840b0 con 0x5622e1aef3d0 2024-05-08T06:04:13.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.050+0000 7f5c296e0b80 1 -- 172.21.15.82:0/1083731818 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622e1aef3d0 msgr2=0x5622e1b13b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:13.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.050+0000 7f5c296e0b80 1 --2- 172.21.15.82:0/1083731818 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622e1aef3d0 0x5622e1b13b40 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5c040e8480 tx=0x7f5c040e8310 comp rx=0 tx=0).stop 2024-05-08T06:04:13.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.051+0000 7f5c296e0b80 1 -- 172.21.15.82:0/1083731818 shutdown_connections 2024-05-08T06:04:13.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.051+0000 7f5c296e0b80 1 --2- 172.21.15.82:0/1083731818 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622e1aefcf0 0x5622e1b14080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:13.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.051+0000 7f5c296e0b80 1 --2- 172.21.15.82:0/1083731818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622e1aea100 0x5622e1ae93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:13.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.051+0000 7f5c296e0b80 1 --2- 172.21.15.82:0/1083731818 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622e1aef3d0 0x5622e1b13b40 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:13.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.051+0000 7f5c296e0b80 1 -- 172.21.15.82:0/1083731818 >> 172.21.15.82:0/1083731818 conn(0x5622e1a596d0 msgr2=0x5622e1ae2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:04:13.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.051+0000 7f5c296e0b80 1 -- 172.21.15.82:0/1083731818 shutdown_connections 2024-05-08T06:04:13.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.052+0000 7f5c296e0b80 1 -- 172.21.15.82:0/1083731818 wait complete. 2024-05-08T06:04:13.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.052+0000 7f5c296e0b80 1 -- start start 2024-05-08T06:04:13.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.052+0000 7f5c296e0b80 1 Processor -- start 2024-05-08T06:04:13.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.053+0000 7f5c296e0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622e1aea100 0x5622e1b1f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:13.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.053+0000 7f5c296e0b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622e1aef3d0 0x5622e1b1cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:13.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.053+0000 7f5c296e0b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622e1aefcf0 0x5622e1b1d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:13.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.053+0000 7f5c296e0b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5c181accf0 con 0x5622e1aefcf0 2024-05-08T06:04:13.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.053+0000 7f5c296e0b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5c181ac620 con 0x5622e1aef3d0 2024-05-08T06:04:13.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.053+0000 7f5c296e0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5c181084f0 con 0x5622e1aea100 2024-05-08T06:04:13.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.053+0000 7f5c296e0b80 10 client.0 _ll_register_callbacks cb 0x5622e19dac70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:04:13.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.054+0000 7f5c17e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622e1aea100 0x5622e1b1f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:13.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.054+0000 7f5c17e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622e1aea100 0x5622e1b1f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:43376/0 (socket says 172.21.15.82:43376) 2024-05-08T06:04:13.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.054+0000 7f5c17e00700 1 -- 172.21.15.82:0/4154145200 learned_addr learned my addr 172.21.15.82:0/4154145200 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:04:13.055 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.054+0000 7f5c17400700 1 --2- 172.21.15.82:0/4154145200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622e1aef3d0 0x5622e1b1cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:13.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.054+0000 7f5c1ce00700 1 --2- 172.21.15.82:0/4154145200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622e1aefcf0 0x5622e1b1d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:13.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.055+0000 7f5c17400700 1 -- 172.21.15.82:0/4154145200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622e1aea100 msgr2=0x5622e1b1f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:04:13.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.055+0000 7f5c17400700 1 --2- 172.21.15.82:0/4154145200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622e1aea100 0x5622e1b1f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:13.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.055+0000 7f5c17400700 1 -- 172.21.15.82:0/4154145200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622e1aefcf0 msgr2=0x5622e1b1d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:04:13.056 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.056+0000 7f5c17400700 1 --2- 172.21.15.82:0/4154145200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622e1aefcf0 0x5622e1b1d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:13.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.056+0000 7f5c17400700 1 -- 172.21.15.82:0/4154145200 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622e1b1da80 con 0x5622e1aef3d0 2024-05-08T06:04:13.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.056+0000 7f5c17e00700 1 --2- 172.21.15.82:0/4154145200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622e1aea100 0x5622e1b1f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:04:13.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.056+0000 7f5c1ce00700 1 --2- 172.21.15.82:0/4154145200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622e1aefcf0 0x5622e1b1d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:04:13.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.056+0000 7f5c17400700 1 --2- 172.21.15.82:0/4154145200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622e1aef3d0 0x5622e1b1cd00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x5622e1aae2c0 tx=0x7f5c040e8a10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd560bc882ea74fb server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:04:13.057 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.056+0000 7f5c02000700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T06:04:13.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.057+0000 7f5c02000700 1 -- 172.21.15.82:0/4154145200 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c040c2070 con 0x5622e1aef3d0 2024-05-08T06:04:13.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.057+0000 7f5c02000700 1 -- 172.21.15.82:0/4154145200 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f5c040a5e10 con 0x5622e1aef3d0 2024-05-08T06:04:13.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.057+0000 7f5c296e0b80 1 -- 172.21.15.82:0/4154145200 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c040e5e50 con 0x5622e1aef3d0 2024-05-08T06:04:13.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.057+0000 7f5c02000700 1 -- 172.21.15.82:0/4154145200 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f5c040c9050 con 0x5622e1aef3d0 2024-05-08T06:04:13.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.057+0000 7f5c296e0b80 10 client.26672 fetch_fsmap learned FSMap version 31 2024-05-08T06:04:13.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.057+0000 7f5c296e0b80 1 -- 172.21.15.82:0/4154145200 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5622e1b76380 con 0x5622e1aef3d0 2024-05-08T06:04:13.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.058+0000 7f5c02000700 1 -- 172.21.15.82:0/4154145200 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5c040e5e50 con 0x5622e1aef3d0 2024-05-08T06:04:13.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.058+0000 7f5c02000700 1 -- 172.21.15.82:0/4154145200 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f5c040a9de0 con 0x5622e1aef3d0 2024-05-08T06:04:13.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.058+0000 7f5c296e0b80 10 client.26672 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:04:13.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.058+0000 7f5c296e0b80 10 client.26672 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-05-08T06:04:13.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.058+0000 7f5c296e0b80 20 client.26672 populate_metadata read hostname 'smithi082' 2024-05-08T06:04:13.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.058+0000 7f5c296e0b80 1 --2- 172.21.15.82:0/4154145200 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x5622e1b765b0 0x5622e1b789a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:13.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.058+0000 7f5c296e0b80 4 client.26672 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T06:04:13.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.058+0000 7f5c296e0b80 1 -- 172.21.15.82:0/4154145200 --> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5622e1a41400 con 0x5622e1b765b0 2024-05-08T06:04:13.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.059+0000 7f5c17e00700 1 --2- 172.21.15.82:0/4154145200 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x5622e1b765b0 0x5622e1b789a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:13.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.061+0000 7f5c17e00700 1 --2- 172.21.15.82:0/4154145200 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x5622e1b765b0 0x5622e1b789a0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5ff77312dd6b6587 server_cookie=f3be35f8ca9e962 in_seq=0 out_seq=0 2024-05-08T06:04:13.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.061+0000 7f5c02000700 10 client.26672 ms_handle_connect on v2:172.21.15.151:6834/2093655929 2024-05-08T06:04:13.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.062+0000 7f5c02000700 1 -- 172.21.15.82:0/4154145200 <== mds.3 v2:172.21.15.151:6834/2093655929 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5622e1a41400 con 0x5622e1b765b0 2024-05-08T06:04:13.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.062+0000 7f5c02000700 10 client.26672 handle_command_reply: tid=0 2024-05-08T06:04:13.063 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.062+0000 7f5c296e0b80 1 client.26672 shutdown 2024-05-08T06:04:13.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.063+0000 7f5c296e0b80 1 -- 172.21.15.82:0/4154145200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622e1aef3d0 msgr2=0x5622e1b1cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:13.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.063+0000 7f5c296e0b80 1 --2- 172.21.15.82:0/4154145200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622e1aef3d0 0x5622e1b1cd00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x5622e1aae2c0 tx=0x7f5c040e8a10 comp rx=0 tx=0).stop 2024-05-08T06:04:13.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.063+0000 7f5c296e0b80 1 -- 172.21.15.82:0/4154145200 shutdown_connections 2024-05-08T06:04:13.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.063+0000 7f5c296e0b80 1 --2- 172.21.15.82:0/4154145200 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x5622e1b765b0 0x5622e1b789a0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:13.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.063+0000 7f5c296e0b80 1 --2- 172.21.15.82:0/4154145200 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5622e1aefcf0 0x5622e1b1d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:13.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.063+0000 7f5c296e0b80 1 --2- 172.21.15.82:0/4154145200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622e1aea100 0x5622e1b1f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:13.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.063+0000 7f5c296e0b80 1 --2- 172.21.15.82:0/4154145200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622e1aef3d0 0x5622e1b1cd00 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:13.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.063+0000 7f5c296e0b80 1 -- 172.21.15.82:0/4154145200 >> 172.21.15.82:0/4154145200 conn(0x5622e1a596d0 msgr2=0x5622e1ae29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:04:13.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.063+0000 7f5c02000700 0 client.26672 ms_handle_reset on v2:172.21.15.151:6834/2093655929 2024-05-08T06:04:13.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.064+0000 7f5c296e0b80 1 -- 172.21.15.82:0/4154145200 shutdown_connections 2024-05-08T06:04:13.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.064+0000 7f5c296e0b80 1 -- 172.21.15.82:0/4154145200 wait complete. 2024-05-08T06:04:13.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.064+0000 7f5c296e0b80 20 client.26672 trim_cache size 0 max 16384 2024-05-08T06:04:13.066 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T06:04:13.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.066+0000 7f5c1ee00700 1 -- 172.21.15.82:0/310942465 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f5bfc0b2a50 msgr2=0x7f5bfc0b4f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:13.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.066+0000 7f5c1ee00700 1 --2- 172.21.15.82:0/310942465 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f5bfc0b2a50 0x7f5bfc0b4f10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5c1806ad70 tx=0x7f5c1000b040 comp rx=0 tx=0).stop 2024-05-08T06:04:13.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.066+0000 7f5c1ee00700 1 -- 172.21.15.82:0/310942465 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c1806bad0 msgr2=0x7f5c1819c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:13.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.066+0000 7f5c1ee00700 1 --2- 172.21.15.82:0/310942465 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c1806bad0 0x7f5c1819c2d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5c0400ec10 tx=0x7f5c0400c2d0 comp rx=0 tx=0).stop 2024-05-08T06:04:13.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.066+0000 7f5c1ee00700 1 -- 172.21.15.82:0/310942465 shutdown_connections 2024-05-08T06:04:13.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.066+0000 7f5c1ee00700 1 --2- 172.21.15.82:0/310942465 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f5bfc0b2a50 0x7f5bfc0b4f10 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:13.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.066+0000 7f5c1ee00700 1 --2- 172.21.15.82:0/310942465 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5c1810ff50 0x7f5c181a0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:13.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.066+0000 7f5c1ee00700 1 --2- 172.21.15.82:0/310942465 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c1806b1b0 0x7f5c1819bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:13.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.066+0000 7f5c1ee00700 1 --2- 172.21.15.82:0/310942465 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c1806bad0 0x7f5c1819c2d0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:13.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.066+0000 7f5c1ee00700 1 -- 172.21.15.82:0/310942465 >> 172.21.15.82:0/310942465 conn(0x7f5c18079350 msgr2=0x7f5c181115e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:04:13.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.066+0000 7f5c1ee00700 1 -- 172.21.15.82:0/310942465 shutdown_connections 2024-05-08T06:04:13.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:13.066+0000 7f5c1ee00700 1 -- 172.21.15.82:0/310942465 wait complete. 2024-05-08T06:04:13.862 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-05-08T06:04:14.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:04:13 smithi151 ceph-mon[34815]: pgmap v866: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.2 MiB/s wr, 754 op/s 2024-05-08T06:04:14.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:04:13 smithi082 ceph-mon[30098]: pgmap v866: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.2 MiB/s wr, 754 op/s 2024-05-08T06:04:14.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:04:13 smithi134 ceph-mon[34132]: pgmap v866: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.2 MiB/s wr, 754 op/s 2024-05-08T06:04:14.479 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:04:15.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 805.0 s, 1242.8 tps, lat 79.427 ms stddev 98.595 2024-05-08T06:04:16.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:04:15 smithi151 ceph-mon[34815]: pgmap v867: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.7 MiB/s wr, 625 op/s 2024-05-08T06:04:16.149 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:04:15 smithi082 ceph-mon[30098]: pgmap v867: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.7 MiB/s wr, 625 op/s 2024-05-08T06:04:16.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:04:15 smithi134 ceph-mon[34132]: pgmap v867: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.7 MiB/s wr, 625 op/s 2024-05-08T06:04:17.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.092+0000 7f9d17e00700 1 -- 172.21.15.82:0/2611693109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d180757c0 msgr2=0x7f9d18075ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:17.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.092+0000 7f9d17e00700 1 --2- 172.21.15.82:0/2611693109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d180757c0 0x7f9d18075ba0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9d08009990 tx=0x7f9d08009ca0 comp rx=0 tx=0).stop 2024-05-08T06:04:17.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.092+0000 7f9d17e00700 1 -- 172.21.15.82:0/2611693109 shutdown_connections 2024-05-08T06:04:17.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.092+0000 7f9d17e00700 1 --2- 172.21.15.82:0/2611693109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d180757c0 0x7f9d18075ba0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:17.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.092+0000 7f9d17e00700 1 --2- 172.21.15.82:0/2611693109 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d1810fc90 0x7f9d18112080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:17.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.092+0000 7f9d17e00700 1 --2- 172.21.15.82:0/2611693109 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d180760e0 0x7f9d1810f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:17.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.092+0000 7f9d17e00700 1 -- 172.21.15.82:0/2611693109 >> 172.21.15.82:0/2611693109 conn(0x7f9d180fef20 msgr2=0x7f9d18101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:04:17.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.093+0000 7f9d17e00700 1 -- 172.21.15.82:0/2611693109 shutdown_connections 2024-05-08T06:04:17.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.093+0000 7f9d17e00700 1 -- 172.21.15.82:0/2611693109 wait complete. 2024-05-08T06:04:17.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.095+0000 7f9d17e00700 1 Processor -- start 2024-05-08T06:04:17.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.095+0000 7f9d17e00700 1 -- start start 2024-05-08T06:04:17.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.096+0000 7f9d17e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d180757c0 0x7f9d181033b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:17.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.096+0000 7f9d17e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d180760e0 0x7f9d181038f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:17.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.096+0000 7f9d17e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d1810fc90 0x7f9d18103e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:17.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.096+0000 7f9d17e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9d1806d250 con 0x7f9d180760e0 2024-05-08T06:04:17.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.096+0000 7f9d17e00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9d1806d0d0 con 0x7f9d180757c0 2024-05-08T06:04:17.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.096+0000 7f9d17e00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9d1806d3d0 con 0x7f9d1810fc90 2024-05-08T06:04:17.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.096+0000 7f9d16a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d180757c0 0x7f9d181033b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:17.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.096+0000 7f9d16a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d180757c0 0x7f9d181033b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:36702/0 (socket says 172.21.15.82:36702) 2024-05-08T06:04:17.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.096+0000 7f9d16a00700 1 -- 172.21.15.82:0/3793343469 learned_addr learned my addr 172.21.15.82:0/3793343469 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:04:17.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.096+0000 7f9d17400700 1 --2- 172.21.15.82:0/3793343469 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d1810fc90 0x7f9d18103e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:17.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.097+0000 7f9d16a00700 1 -- 172.21.15.82:0/3793343469 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d1810fc90 msgr2=0x7f9d18103e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:17.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.097+0000 7f9d16a00700 1 --2- 172.21.15.82:0/3793343469 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d1810fc90 0x7f9d18103e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:17.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.097+0000 7f9d16a00700 1 -- 172.21.15.82:0/3793343469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d180760e0 msgr2=0x7f9d181038f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:17.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.097+0000 7f9d16a00700 1 --2- 172.21.15.82:0/3793343469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d180760e0 0x7f9d181038f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:17.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.097+0000 7f9d16a00700 1 -- 172.21.15.82:0/3793343469 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d1810edf0 con 0x7f9d180757c0 2024-05-08T06:04:17.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.097+0000 7f9d16a00700 1 --2- 172.21.15.82:0/3793343469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d180757c0 0x7f9d181033b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9d0800ba30 tx=0x7f9d0800ba60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:04:17.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.098+0000 7f9d0f400700 1 -- 172.21.15.82:0/3793343469 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d08027070 con 0x7f9d180757c0 2024-05-08T06:04:17.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.098+0000 7f9d0f400700 1 -- 172.21.15.82:0/3793343469 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d08005da0 con 0x7f9d180757c0 2024-05-08T06:04:17.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.098+0000 7f9d0f400700 1 -- 172.21.15.82:0/3793343469 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d0800f6c0 con 0x7f9d180757c0 2024-05-08T06:04:17.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.098+0000 7f9d17e00700 1 -- 172.21.15.82:0/3793343469 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d1810f080 con 0x7f9d180757c0 2024-05-08T06:04:17.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.098+0000 7f9d17e00700 1 -- 172.21.15.82:0/3793343469 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d1810f5b0 con 0x7f9d180757c0 2024-05-08T06:04:17.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.103+0000 7f9d0f400700 1 -- 172.21.15.82:0/3793343469 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f9d0802a070 con 0x7f9d180757c0 2024-05-08T06:04:17.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.105+0000 7f9d28049b80 1 Processor -- start 2024-05-08T06:04:17.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.105+0000 7f9d28049b80 1 -- start start 2024-05-08T06:04:17.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.106+0000 7f9d28049b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d453148da0 0x55d453149180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:17.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.106+0000 7f9d28049b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4531496c0 0x55d453143430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:17.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.106+0000 7f9d28049b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d453143a50 0x55d453143ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:17.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.106+0000 7f9d28049b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d453095a20 con 0x55d4531496c0 2024-05-08T06:04:17.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.106+0000 7f9d28049b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d453033760 con 0x55d453143a50 2024-05-08T06:04:17.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.106+0000 7f9d28049b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55d4530919e0 con 0x55d453148da0 2024-05-08T06:04:17.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.106+0000 7f9d0f400700 1 --2- 172.21.15.82:0/3793343469 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9cfc0b29b0 0x7f9cfc0b4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:17.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.106+0000 7f9d17400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d453148da0 0x55d453149180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:17.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.106+0000 7f9d17400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d453148da0 0x55d453149180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:43416/0 (socket says 172.21.15.82:43416) 2024-05-08T06:04:17.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.106+0000 7f9d17400700 1 -- 172.21.15.82:0/2841246703 learned_addr learned my addr 172.21.15.82:0/2841246703 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:04:17.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.106+0000 7f9d0f400700 1 -- 172.21.15.82:0/3793343469 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f9d080e2e20 con 0x7f9d180757c0 2024-05-08T06:04:17.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.106+0000 7f9d16000700 1 --2- 172.21.15.82:0/2841246703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d453143a50 0x55d453143ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:17.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.107+0000 7f9d16a00700 1 --2- 172.21.15.82:0/2841246703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4531496c0 0x55d453143430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:17.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.107+0000 7f9d17400700 1 --2- 172.21.15.82:0/3793343469 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9cfc0b29b0 0x7f9cfc0b4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:17.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.107+0000 7f9d17400700 1 -- 172.21.15.82:0/2841246703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d453143a50 msgr2=0x55d453143ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:04:17.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.107+0000 7f9d17400700 1 --2- 172.21.15.82:0/2841246703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d453143a50 0x55d453143ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:17.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.107+0000 7f9d17400700 1 -- 172.21.15.82:0/2841246703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4531496c0 msgr2=0x55d453143430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:04:17.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.107+0000 7f9d17400700 1 --2- 172.21.15.82:0/2841246703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4531496c0 0x55d453143430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:17.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.107+0000 7f9d17400700 1 -- 172.21.15.82:0/2841246703 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d452fe28d0 con 0x55d453148da0 2024-05-08T06:04:17.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.107+0000 7f9d16a00700 1 --2- 172.21.15.82:0/2841246703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4531496c0 0x55d453143430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:04:17.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.107+0000 7f9d17400700 1 --2- 172.21.15.82:0/2841246703 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d453148da0 0x55d453149180 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f9d10013c00 tx=0x7f9d10013f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=287a5f305215c0b1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:04:17.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.108+0000 7f9d17400700 1 --2- 172.21.15.82:0/3793343469 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9cfc0b29b0 0x7f9cfc0b4e70 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9d1000a000 tx=0x7f9d1001c000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:04:17.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.108+0000 7f9d03e00700 1 -- 172.21.15.82:0/2841246703 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d10019760 con 0x55d453148da0 2024-05-08T06:04:17.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.108+0000 7f9d03e00700 1 -- 172.21.15.82:0/2841246703 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d10019db0 con 0x55d453148da0 2024-05-08T06:04:17.109 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.108+0000 7f9d03e00700 1 -- 172.21.15.82:0/2841246703 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d10021c90 con 0x55d453148da0 2024-05-08T06:04:17.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.109+0000 7f9d28049b80 1 -- 172.21.15.82:0/2841246703 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d453148da0 msgr2=0x55d453149180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:17.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.109+0000 7f9d28049b80 1 --2- 172.21.15.82:0/2841246703 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d453148da0 0x55d453149180 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f9d10013c00 tx=0x7f9d10013f10 comp rx=0 tx=0).stop 2024-05-08T06:04:17.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.110+0000 7f9d28049b80 1 -- 172.21.15.82:0/2841246703 shutdown_connections 2024-05-08T06:04:17.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.110+0000 7f9d28049b80 1 --2- 172.21.15.82:0/2841246703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d453143a50 0x55d453143ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:17.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.110+0000 7f9d28049b80 1 --2- 172.21.15.82:0/2841246703 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d453148da0 0x55d453149180 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:17.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.110+0000 7f9d28049b80 1 --2- 172.21.15.82:0/2841246703 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d4531496c0 0x55d453143430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:17.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.110+0000 7f9d28049b80 1 -- 172.21.15.82:0/2841246703 >> 172.21.15.82:0/2841246703 conn(0x55d4530bb6d0 msgr2=0x55d45313dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:04:17.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.112+0000 7f9d28049b80 1 -- 172.21.15.82:0/2841246703 shutdown_connections 2024-05-08T06:04:17.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.112+0000 7f9d28049b80 1 -- 172.21.15.82:0/2841246703 wait complete. 2024-05-08T06:04:17.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.113+0000 7f9d28049b80 1 -- start start 2024-05-08T06:04:17.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.113+0000 7f9d28049b80 1 Processor -- start 2024-05-08T06:04:17.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.114+0000 7f9d28049b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d453143a50 0x55d45314f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:17.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.114+0000 7f9d28049b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d453148da0 0x55d45314c780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:17.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.114+0000 7f9d28049b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d4531496c0 0x55d45314ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:17.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.114+0000 7f9d28049b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55d4531500f0 con 0x55d453143a50 2024-05-08T06:04:17.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.114+0000 7f9d28049b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d452ffbb20 con 0x55d4531496c0 2024-05-08T06:04:17.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.114+0000 7f9d28049b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55d453150270 con 0x55d453148da0 2024-05-08T06:04:17.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.114+0000 7f9d28049b80 10 client.0 _ll_register_callbacks cb 0x55d45303cc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:04:17.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.115+0000 7f9d16a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d453143a50 0x55d45314f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:17.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.115+0000 7f9d16a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d453143a50 0x55d45314f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48364/0 (socket says 172.21.15.82:48364) 2024-05-08T06:04:17.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.115+0000 7f9d16a00700 1 -- 172.21.15.82:0/4031720959 learned_addr learned my addr 172.21.15.82:0/4031720959 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:04:17.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.115+0000 7f9d16000700 1 --2- 172.21.15.82:0/4031720959 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d453148da0 0x55d45314c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:17.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.115+0000 7f9d17400700 1 --2- 172.21.15.82:0/4031720959 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d4531496c0 0x55d45314ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:17.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.115+0000 7f9d16000700 1 -- 172.21.15.82:0/4031720959 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d4531496c0 msgr2=0x55d45314ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:04:17.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.115+0000 7f9d16000700 1 --2- 172.21.15.82:0/4031720959 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d4531496c0 0x55d45314ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:17.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.115+0000 7f9d16000700 1 -- 172.21.15.82:0/4031720959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d453143a50 msgr2=0x55d45314f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:04:17.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.115+0000 7f9d16000700 1 --2- 172.21.15.82:0/4031720959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d453143a50 0x55d45314f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:17.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.115+0000 7f9d16000700 1 -- 172.21.15.82:0/4031720959 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d45305b420 con 0x55d453148da0 2024-05-08T06:04:17.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.116+0000 7f9d16000700 1 --2- 172.21.15.82:0/4031720959 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d453148da0 0x55d45314c780 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9d18104b70 tx=0x7f9d040106b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d742dfd871e3eb60 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:04:17.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.116+0000 7f9d00c00700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T06:04:17.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.116+0000 7f9d00c00700 1 -- 172.21.15.82:0/4031720959 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d04004050 con 0x55d453148da0 2024-05-08T06:04:17.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.116+0000 7f9d00c00700 1 -- 172.21.15.82:0/4031720959 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f9d040041f0 con 0x55d453148da0 2024-05-08T06:04:17.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.117+0000 7f9d28049b80 1 -- 172.21.15.82:0/4031720959 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d10019db0 con 0x55d453148da0 2024-05-08T06:04:17.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.117+0000 7f9d00c00700 1 -- 172.21.15.82:0/4031720959 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f9d040043f0 con 0x55d453148da0 2024-05-08T06:04:17.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.117+0000 7f9d28049b80 10 client.26719 fetch_fsmap learned FSMap version 31 2024-05-08T06:04:17.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.117+0000 7f9d28049b80 1 -- 172.21.15.82:0/4031720959 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55d45315a990 con 0x55d453148da0 2024-05-08T06:04:17.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.117+0000 7f9d00c00700 1 -- 172.21.15.82:0/4031720959 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d10019db0 con 0x55d453148da0 2024-05-08T06:04:17.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.118+0000 7f9d00c00700 1 -- 172.21.15.82:0/4031720959 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f9d040115d0 con 0x55d453148da0 2024-05-08T06:04:17.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.118+0000 7f9d28049b80 10 client.26719 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:04:17.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.118+0000 7f9d28049b80 10 client.26719 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-05-08T06:04:17.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.118+0000 7f9d28049b80 20 client.26719 populate_metadata read hostname 'smithi082' 2024-05-08T06:04:17.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.118+0000 7f9d28049b80 1 --2- 172.21.15.82:0/4031720959 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55d45315cf20 0x55d45315f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:17.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.118+0000 7f9d28049b80 4 client.26719 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:04:17.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.118+0000 7f9d28049b80 1 -- 172.21.15.82:0/4031720959 --> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d453110140 con 0x55d45315cf20 2024-05-08T06:04:17.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.118+0000 7f9d16a00700 1 --2- 172.21.15.82:0/4031720959 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55d45315cf20 0x55d45315f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:17.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.119+0000 7f9d00c00700 10 client.26719 ms_handle_connect on v2:172.21.15.151:6836/4192404464 2024-05-08T06:04:17.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.119+0000 7f9d16a00700 1 --2- 172.21.15.82:0/4031720959 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55d45315cf20 0x55d45315f310 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=97e8180dad688569 server_cookie=7b5a74e671f984e7 in_seq=0 out_seq=0 2024-05-08T06:04:17.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.120+0000 7f9d00c00700 1 -- 172.21.15.82:0/4031720959 <== mds.2 v2:172.21.15.151:6836/4192404464 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55d453110140 con 0x55d45315cf20 2024-05-08T06:04:17.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.120+0000 7f9d00c00700 10 client.26719 handle_command_reply: tid=0 2024-05-08T06:04:17.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.120+0000 7f9d28049b80 1 client.26719 shutdown 2024-05-08T06:04:17.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.121+0000 7f9d28049b80 1 -- 172.21.15.82:0/4031720959 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d453148da0 msgr2=0x55d45314c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:17.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.121+0000 7f9d28049b80 1 --2- 172.21.15.82:0/4031720959 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d453148da0 0x55d45314c780 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f9d18104b70 tx=0x7f9d040106b0 comp rx=0 tx=0).stop 2024-05-08T06:04:17.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.121+0000 7f9d28049b80 1 -- 172.21.15.82:0/4031720959 shutdown_connections 2024-05-08T06:04:17.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.121+0000 7f9d28049b80 1 --2- 172.21.15.82:0/4031720959 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55d45315cf20 0x55d45315f310 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:17.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.121+0000 7f9d28049b80 1 --2- 172.21.15.82:0/4031720959 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d4531496c0 0x55d45314ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:17.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.121+0000 7f9d28049b80 1 --2- 172.21.15.82:0/4031720959 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d453143a50 0x55d45314f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:17.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.121+0000 7f9d28049b80 1 --2- 172.21.15.82:0/4031720959 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d453148da0 0x55d45314c780 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:17.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.121+0000 7f9d28049b80 1 -- 172.21.15.82:0/4031720959 >> 172.21.15.82:0/4031720959 conn(0x55d4530bb6d0 msgr2=0x55d453138750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:04:17.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.121+0000 7f9d00c00700 0 client.26719 ms_handle_reset on v2:172.21.15.151:6836/4192404464 2024-05-08T06:04:17.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.121+0000 7f9d28049b80 1 -- 172.21.15.82:0/4031720959 shutdown_connections 2024-05-08T06:04:17.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.121+0000 7f9d28049b80 1 -- 172.21.15.82:0/4031720959 wait complete. 2024-05-08T06:04:17.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.122+0000 7f9d28049b80 20 client.26719 trim_cache size 0 max 16384 2024-05-08T06:04:17.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.144+0000 7f9d28049b80 1 Processor -- start 2024-05-08T06:04:17.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.144+0000 7f9d28049b80 1 -- start start 2024-05-08T06:04:17.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.144+0000 7f9d28049b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d453143a50 0x55d45314ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:17.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.144+0000 7f9d28049b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d453148da0 0x55d453146ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:17.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.145+0000 7f9d28049b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4531496c0 0x55d45314a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:17.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.145+0000 7f9d28049b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf800d360 con 0x55d453143a50 2024-05-08T06:04:17.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.145+0000 7f9d28049b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf800eea0 con 0x55d453148da0 2024-05-08T06:04:17.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.145+0000 7f9d28049b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf800da30 con 0x55d4531496c0 2024-05-08T06:04:17.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.145+0000 7f9d16000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d453148da0 0x55d453146ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:17.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.145+0000 7f9d16a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d453143a50 0x55d45314ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:17.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.145+0000 7f9d16000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d453148da0 0x55d453146ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:36720/0 (socket says 172.21.15.82:36720) 2024-05-08T06:04:17.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.145+0000 7f9d16000700 1 -- 172.21.15.82:0/2535793304 learned_addr learned my addr 172.21.15.82:0/2535793304 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:04:17.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.145+0000 7f9d17400700 1 --2- 172.21.15.82:0/2535793304 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4531496c0 0x55d45314a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:17.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.145+0000 7f9d16000700 1 -- 172.21.15.82:0/2535793304 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4531496c0 msgr2=0x55d45314a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:04:17.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.145+0000 7f9d16000700 1 --2- 172.21.15.82:0/2535793304 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4531496c0 0x55d45314a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:17.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.145+0000 7f9d16000700 1 -- 172.21.15.82:0/2535793304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d453143a50 msgr2=0x55d45314ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:04:17.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.145+0000 7f9d16000700 1 --2- 172.21.15.82:0/2535793304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d453143a50 0x55d45314ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:17.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.145+0000 7f9d16000700 1 -- 172.21.15.82:0/2535793304 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d45313a8a0 con 0x55d453148da0 2024-05-08T06:04:17.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.145+0000 7f9d16a00700 1 --2- 172.21.15.82:0/2535793304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d453143a50 0x55d45314ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:04:17.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.146+0000 7f9d16000700 1 --2- 172.21.15.82:0/2535793304 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d453148da0 0x55d453146ee0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9d04014040 tx=0x7f9d040075f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=734ac150948c61d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:04:17.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.146+0000 7f9d03400700 1 -- 172.21.15.82:0/2535793304 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d04032070 con 0x55d453148da0 2024-05-08T06:04:17.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.146+0000 7f9d03400700 1 -- 172.21.15.82:0/2535793304 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d04015070 con 0x55d453148da0 2024-05-08T06:04:17.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.146+0000 7f9d03400700 1 -- 172.21.15.82:0/2535793304 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d04029070 con 0x55d453148da0 2024-05-08T06:04:17.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.147+0000 7f9d28049b80 1 -- 172.21.15.82:0/2535793304 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d453148da0 msgr2=0x55d453146ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:17.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.147+0000 7f9d28049b80 1 --2- 172.21.15.82:0/2535793304 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d453148da0 0x55d453146ee0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f9d04014040 tx=0x7f9d040075f0 comp rx=0 tx=0).stop 2024-05-08T06:04:17.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.148+0000 7f9d28049b80 1 -- 172.21.15.82:0/2535793304 shutdown_connections 2024-05-08T06:04:17.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.148+0000 7f9d28049b80 1 --2- 172.21.15.82:0/2535793304 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4531496c0 0x55d45314a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:17.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.148+0000 7f9d28049b80 1 --2- 172.21.15.82:0/2535793304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d453143a50 0x55d45314ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:17.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.148+0000 7f9d28049b80 1 --2- 172.21.15.82:0/2535793304 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d453148da0 0x55d453146ee0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:17.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.148+0000 7f9d28049b80 1 -- 172.21.15.82:0/2535793304 >> 172.21.15.82:0/2535793304 conn(0x55d4530bb6d0 msgr2=0x55d45314de30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:04:17.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.148+0000 7f9d28049b80 1 -- 172.21.15.82:0/2535793304 shutdown_connections 2024-05-08T06:04:17.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.148+0000 7f9d28049b80 1 -- 172.21.15.82:0/2535793304 wait complete. 2024-05-08T06:04:17.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.149+0000 7f9d28049b80 1 -- start start 2024-05-08T06:04:17.150 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.149+0000 7f9d28049b80 1 Processor -- start 2024-05-08T06:04:17.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.150+0000 7f9d28049b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d453143a50 0x55d4531642b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:17.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.150+0000 7f9d28049b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d453148da0 0x55d4531647f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:17.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.150+0000 7f9d28049b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d4531496c0 0x55d453164d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:17.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.150+0000 7f9d28049b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf800e7d0 con 0x55d453143a50 2024-05-08T06:04:17.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.150+0000 7f9d28049b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf800e100 con 0x55d4531496c0 2024-05-08T06:04:17.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.150+0000 7f9d28049b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9cf800b300 con 0x55d453148da0 2024-05-08T06:04:17.151 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.150+0000 7f9d28049b80 10 client.0 _ll_register_callbacks cb 0x55d45303cc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:04:17.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.150+0000 7f9d17400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d4531496c0 0x55d453164d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:17.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.150+0000 7f9d16000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d453148da0 0x55d4531647f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:17.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.150+0000 7f9d17400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d4531496c0 0x55d453164d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:36724/0 (socket says 172.21.15.82:36724) 2024-05-08T06:04:17.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.150+0000 7f9d17400700 1 -- 172.21.15.82:0/1917025642 learned_addr learned my addr 172.21.15.82:0/1917025642 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:04:17.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.151+0000 7f9d16000700 1 -- 172.21.15.82:0/1917025642 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d4531496c0 msgr2=0x55d453164d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:04:17.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.151+0000 7f9d16000700 1 --2- 172.21.15.82:0/1917025642 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d4531496c0 0x55d453164d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:17.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.151+0000 7f9d16000700 1 -- 172.21.15.82:0/1917025642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d453143a50 msgr2=0x55d4531642b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:04:17.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.151+0000 7f9d16000700 1 --2- 172.21.15.82:0/1917025642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d453143a50 0x55d4531642b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:17.152 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.151+0000 7f9d16000700 1 -- 172.21.15.82:0/1917025642 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4531493d0 con 0x55d453148da0 2024-05-08T06:04:17.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.151+0000 7f9d16000700 1 --2- 172.21.15.82:0/1917025642 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d453148da0 0x55d4531647f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9d04014040 tx=0x7f9d04011dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed6f473813a003df server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:04:17.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.151+0000 7f9d00c00700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T06:04:17.153 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.151+0000 7f9d00c00700 1 -- 172.21.15.82:0/1917025642 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d0403b060 con 0x55d453148da0 2024-05-08T06:04:17.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.151+0000 7f9d00c00700 1 -- 172.21.15.82:0/1917025642 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f9d04011650 con 0x55d453148da0 2024-05-08T06:04:17.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.152+0000 7f9d28049b80 1 -- 172.21.15.82:0/1917025642 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d04015070 con 0x55d453148da0 2024-05-08T06:04:17.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.152+0000 7f9d00c00700 1 -- 172.21.15.82:0/1917025642 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f9d04032030 con 0x55d453148da0 2024-05-08T06:04:17.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.152+0000 7f9d28049b80 10 client.26725 fetch_fsmap learned FSMap version 31 2024-05-08T06:04:17.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.152+0000 7f9d28049b80 1 -- 172.21.15.82:0/1917025642 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55d4531c77b0 con 0x55d453148da0 2024-05-08T06:04:17.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.152+0000 7f9d00c00700 1 -- 172.21.15.82:0/1917025642 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9d04015070 con 0x55d453148da0 2024-05-08T06:04:17.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.152+0000 7f9d00c00700 1 -- 172.21.15.82:0/1917025642 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f9d04019420 con 0x55d453148da0 2024-05-08T06:04:17.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.153+0000 7f9d28049b80 10 client.26725 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:04:17.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.153+0000 7f9d28049b80 10 client.26725 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-05-08T06:04:17.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.153+0000 7f9d28049b80 20 client.26725 populate_metadata read hostname 'smithi082' 2024-05-08T06:04:17.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.153+0000 7f9d28049b80 1 --2- 172.21.15.82:0/1917025642 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55d4531c7d40 0x55d4531ca160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:17.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.153+0000 7f9d28049b80 4 client.26725 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T06:04:17.154 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.153+0000 7f9d28049b80 1 -- 172.21.15.82:0/1917025642 --> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d4530a3400 con 0x55d4531c7d40 2024-05-08T06:04:17.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.153+0000 7f9d16a00700 1 --2- 172.21.15.82:0/1917025642 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55d4531c7d40 0x55d4531ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:17.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.153+0000 7f9d16a00700 1 --2- 172.21.15.82:0/1917025642 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55d4531c7d40 0x55d4531ca160 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ad7d9c706d5f892b server_cookie=93d2e4e32618b5ca in_seq=0 out_seq=0 2024-05-08T06:04:17.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.153+0000 7f9d00c00700 10 client.26725 ms_handle_connect on v2:172.21.15.151:6836/4192404464 2024-05-08T06:04:17.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.154+0000 7f9d00c00700 1 -- 172.21.15.82:0/1917025642 <== mds.2 v2:172.21.15.151:6836/4192404464 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d4530a3400 con 0x55d4531c7d40 2024-05-08T06:04:17.155 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.154+0000 7f9d00c00700 10 client.26725 handle_command_reply: tid=0 2024-05-08T06:04:17.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.154+0000 7f9d28049b80 1 client.26725 shutdown 2024-05-08T06:04:17.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.154+0000 7f9d28049b80 1 -- 172.21.15.82:0/1917025642 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d453148da0 msgr2=0x55d4531647f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:17.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.154+0000 7f9d28049b80 1 --2- 172.21.15.82:0/1917025642 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d453148da0 0x55d4531647f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9d04014040 tx=0x7f9d04011dc0 comp rx=0 tx=0).stop 2024-05-08T06:04:17.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.155+0000 7f9d28049b80 1 -- 172.21.15.82:0/1917025642 shutdown_connections 2024-05-08T06:04:17.156 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.155+0000 7f9d28049b80 1 --2- 172.21.15.82:0/1917025642 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55d4531c7d40 0x55d4531ca160 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:17.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.155+0000 7f9d28049b80 1 --2- 172.21.15.82:0/1917025642 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d4531496c0 0x55d453164d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:17.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.155+0000 7f9d28049b80 1 --2- 172.21.15.82:0/1917025642 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55d453143a50 0x55d4531642b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:17.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.155+0000 7f9d28049b80 1 --2- 172.21.15.82:0/1917025642 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d453148da0 0x55d4531647f0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:17.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.155+0000 7f9d28049b80 1 -- 172.21.15.82:0/1917025642 >> 172.21.15.82:0/1917025642 conn(0x55d4530bb6d0 msgr2=0x55d45314a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:04:17.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.155+0000 7f9d00c00700 0 client.26725 ms_handle_reset on v2:172.21.15.151:6836/4192404464 2024-05-08T06:04:17.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.155+0000 7f9d28049b80 1 -- 172.21.15.82:0/1917025642 shutdown_connections 2024-05-08T06:04:17.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.155+0000 7f9d28049b80 1 -- 172.21.15.82:0/1917025642 wait complete. 2024-05-08T06:04:17.157 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.156+0000 7f9d28049b80 20 client.26725 trim_cache size 0 max 16384 2024-05-08T06:04:17.157 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T06:04:17.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.156+0000 7f9d17e00700 1 -- 172.21.15.82:0/3793343469 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9cfc0b29b0 msgr2=0x7f9cfc0b4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:17.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.156+0000 7f9d17e00700 1 --2- 172.21.15.82:0/3793343469 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9cfc0b29b0 0x7f9cfc0b4e70 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9d1000a000 tx=0x7f9d1001c000 comp rx=0 tx=0).stop 2024-05-08T06:04:17.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.157+0000 7f9d17e00700 1 -- 172.21.15.82:0/3793343469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d180757c0 msgr2=0x7f9d181033b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:17.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.157+0000 7f9d17e00700 1 --2- 172.21.15.82:0/3793343469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d180757c0 0x7f9d181033b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9d0800ba30 tx=0x7f9d0800ba60 comp rx=0 tx=0).stop 2024-05-08T06:04:17.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.157+0000 7f9d17e00700 1 -- 172.21.15.82:0/3793343469 shutdown_connections 2024-05-08T06:04:17.158 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.157+0000 7f9d17e00700 1 --2- 172.21.15.82:0/3793343469 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d180757c0 0x7f9d181033b0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:17.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.157+0000 7f9d17e00700 1 --2- 172.21.15.82:0/3793343469 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9cfc0b29b0 0x7f9cfc0b4e70 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:17.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.157+0000 7f9d17e00700 1 --2- 172.21.15.82:0/3793343469 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d1810fc90 0x7f9d18103e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:17.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.157+0000 7f9d17e00700 1 --2- 172.21.15.82:0/3793343469 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9d180760e0 0x7f9d181038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:17.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.157+0000 7f9d17e00700 1 -- 172.21.15.82:0/3793343469 >> 172.21.15.82:0/3793343469 conn(0x7f9d180fef20 msgr2=0x7f9d180ffb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:04:17.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.157+0000 7f9d17e00700 1 -- 172.21.15.82:0/3793343469 shutdown_connections 2024-05-08T06:04:17.159 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:17.157+0000 7f9d17e00700 1 -- 172.21.15.82:0/3793343469 wait complete. 2024-05-08T06:04:18.013 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-05-08T06:04:18.113 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:04:17 smithi082 ceph-mon[30098]: pgmap v868: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.9 MiB/s wr, 771 op/s 2024-05-08T06:04:18.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:04:17 smithi151 ceph-mon[34815]: pgmap v868: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.9 MiB/s wr, 771 op/s 2024-05-08T06:04:18.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:04:17 smithi134 ceph-mon[34132]: pgmap v868: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 9.9 MiB/s wr, 771 op/s 2024-05-08T06:04:18.629 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:04:20.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:04:19 smithi151 ceph-mon[34815]: pgmap v869: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.2 MiB/s wr, 585 op/s 2024-05-08T06:04:20.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:04:19 smithi082 ceph-mon[30098]: pgmap v869: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.2 MiB/s wr, 585 op/s 2024-05-08T06:04:20.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:04:19 smithi134 ceph-mon[34132]: pgmap v869: 97 pgs: 97 active+clean; 1.6 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.2 MiB/s wr, 585 op/s 2024-05-08T06:04:20.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 810.0 s, 1870.7 tps, lat 55.479 ms stddev 70.263 2024-05-08T06:04:21.867 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:04:21 smithi082 ceph-mon[30098]: pgmap v870: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.6 MiB/s wr, 637 op/s 2024-05-08T06:04:22.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:04:21 smithi151 ceph-mon[34815]: pgmap v870: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.6 MiB/s wr, 637 op/s 2024-05-08T06:04:22.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.199+0000 7ff787000700 1 -- 172.21.15.82:0/134039753 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff780103750 msgr2=0x7ff780103b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:22.200 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.199+0000 7ff787000700 1 --2- 172.21.15.82:0/134039753 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff780103750 0x7ff780103b30 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7ff7700099c0 tx=0x7ff770009cd0 comp rx=0 tx=0).stop 2024-05-08T06:04:22.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.200+0000 7ff787000700 1 -- 172.21.15.82:0/134039753 shutdown_connections 2024-05-08T06:04:22.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.200+0000 7ff787000700 1 --2- 172.21.15.82:0/134039753 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff780103750 0x7ff780103b30 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:22.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.200+0000 7ff787000700 1 --2- 172.21.15.82:0/134039753 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff780108850 0x7ff7801103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:22.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.200+0000 7ff787000700 1 --2- 172.21.15.82:0/134039753 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff780104100 0x7ff780108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:22.201 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.200+0000 7ff787000700 1 -- 172.21.15.82:0/134039753 >> 172.21.15.82:0/134039753 conn(0x7ff78007a600 msgr2=0x7ff78007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:04:22.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.202+0000 7ff787000700 1 -- 172.21.15.82:0/134039753 shutdown_connections 2024-05-08T06:04:22.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.202+0000 7ff787000700 1 -- 172.21.15.82:0/134039753 wait complete. 2024-05-08T06:04:22.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.203+0000 7ff787000700 1 Processor -- start 2024-05-08T06:04:22.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.204+0000 7ff787000700 1 -- start start 2024-05-08T06:04:22.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.204+0000 7ff787000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff780103750 0x7ff7801179b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:22.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.205+0000 7ff787000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff780104100 0x7ff780117ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:22.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.205+0000 7ff787000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff780108850 0x7ff780112ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:22.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.206+0000 7ff787000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff780111500 con 0x7ff780103750 2024-05-08T06:04:22.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.206+0000 7ff785000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff780108850 0x7ff780112ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:22.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.206+0000 7ff785000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff780108850 0x7ff780112ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:43458/0 (socket says 172.21.15.82:43458) 2024-05-08T06:04:22.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.206+0000 7ff785000700 1 -- 172.21.15.82:0/2617515720 learned_addr learned my addr 172.21.15.82:0/2617515720 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:04:22.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.207+0000 7ff77f400700 1 --2- 172.21.15.82:0/2617515720 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff780104100 0x7ff780117ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:22.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.207+0000 7ff787000700 1 -- 172.21.15.82:0/2617515720 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff780111380 con 0x7ff780104100 2024-05-08T06:04:22.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.207+0000 7ff787000700 1 -- 172.21.15.82:0/2617515720 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff780111680 con 0x7ff780108850 2024-05-08T06:04:22.208 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.208+0000 7ff77fe00700 1 --2- 172.21.15.82:0/2617515720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff780103750 0x7ff7801179b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:22.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.210+0000 7ff77f400700 1 -- 172.21.15.82:0/2617515720 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff780108850 msgr2=0x7ff780112ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:22.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.210+0000 7ff77f400700 1 --2- 172.21.15.82:0/2617515720 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff780108850 0x7ff780112ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:22.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.210+0000 7ff77f400700 1 -- 172.21.15.82:0/2617515720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff780103750 msgr2=0x7ff7801179b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:22.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.210+0000 7ff77f400700 1 --2- 172.21.15.82:0/2617515720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff780103750 0x7ff7801179b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:22.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.210+0000 7ff77f400700 1 -- 172.21.15.82:0/2617515720 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff780113010 con 0x7ff780104100 2024-05-08T06:04:22.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.212+0000 7ff77f400700 1 --2- 172.21.15.82:0/2617515720 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff780104100 0x7ff780117ef0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff76c00c970 tx=0x7ff76c00cc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:04:22.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.213+0000 7ff77cc00700 1 -- 172.21.15.82:0/2617515720 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff76c0078f0 con 0x7ff780104100 2024-05-08T06:04:22.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.213+0000 7ff77cc00700 1 -- 172.21.15.82:0/2617515720 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff76c00f450 con 0x7ff780104100 2024-05-08T06:04:22.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.217+0000 7ff77cc00700 1 -- 172.21.15.82:0/2617515720 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff76c018660 con 0x7ff780104100 2024-05-08T06:04:22.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.217+0000 7ff787000700 1 -- 172.21.15.82:0/2617515720 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff780113300 con 0x7ff780104100 2024-05-08T06:04:22.218 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.218+0000 7ff787000700 1 -- 172.21.15.82:0/2617515720 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7801137f0 con 0x7ff780104100 2024-05-08T06:04:22.225 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.225+0000 7ff77cc00700 1 -- 172.21.15.82:0/2617515720 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7ff76c00f900 con 0x7ff780104100 2024-05-08T06:04:22.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.229+0000 7ff7918f7b80 1 Processor -- start 2024-05-08T06:04:22.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.229+0000 7ff77cc00700 1 --2- 172.21.15.82:0/2617515720 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff7640b29d0 0x7ff7640b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:22.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.230+0000 7ff77cc00700 1 -- 172.21.15.82:0/2617515720 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7ff76c0e1f90 con 0x7ff780104100 2024-05-08T06:04:22.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.232+0000 7ff785000700 1 --2- 172.21.15.82:0/2617515720 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff7640b29d0 0x7ff7640b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:22.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.233+0000 7ff7918f7b80 1 -- start start 2024-05-08T06:04:22.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.234+0000 7ff7918f7b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5633502bebc0 0x5633502befa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:22.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.234+0000 7ff7918f7b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633502bf4e0 0x5633502b92d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:22.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.234+0000 7ff7918f7b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5633502b98f0 0x5633502b9d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:22.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.235+0000 7ff7918f7b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56335020ba20 con 0x5633502bf4e0 2024-05-08T06:04:22.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.235+0000 7ff7918f7b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5633501a9760 con 0x5633502b98f0 2024-05-08T06:04:22.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.235+0000 7ff77fe00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5633502bebc0 0x5633502befa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:22.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.235+0000 7ff77fe00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5633502bebc0 0x5633502befa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:43474/0 (socket says 172.21.15.82:43474) 2024-05-08T06:04:22.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.235+0000 7ff77fe00700 1 -- 172.21.15.82:0/1057874682 learned_addr learned my addr 172.21.15.82:0/1057874682 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:04:22.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.235+0000 7ff7918f7b80 1 -- 172.21.15.82:0/1057874682 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5633502079e0 con 0x5633502bebc0 2024-05-08T06:04:22.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.235+0000 7ff77f400700 1 --2- 172.21.15.82:0/1057874682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633502bf4e0 0x5633502b92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:22.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.236+0000 7ff77fe00700 1 -- 172.21.15.82:0/1057874682 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5633502b98f0 msgr2=0x5633502b9d70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T06:04:22.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.236+0000 7ff785000700 1 --2- 172.21.15.82:0/1057874682 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5633502b98f0 0x5633502b9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:22.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.236+0000 7ff77fe00700 1 --2- 172.21.15.82:0/1057874682 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5633502b98f0 0x5633502b9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:22.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.237+0000 7ff77fe00700 1 -- 172.21.15.82:0/1057874682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633502bf4e0 msgr2=0x5633502b92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:04:22.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.237+0000 7ff77fe00700 1 --2- 172.21.15.82:0/1057874682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633502bf4e0 0x5633502b92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:22.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.237+0000 7ff77fe00700 1 -- 172.21.15.82:0/1057874682 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633501588d0 con 0x5633502bebc0 2024-05-08T06:04:22.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.237+0000 7ff77f400700 1 --2- 172.21.15.82:0/1057874682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633502bf4e0 0x5633502b92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:04:22.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.237+0000 7ff785000700 1 --2- 172.21.15.82:0/1057874682 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5633502b98f0 0x5633502b9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:04:22.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.237+0000 7ff77fe00700 1 --2- 172.21.15.82:0/1057874682 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5633502bebc0 0x5633502befa0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff770000c00 tx=0x7ff7700096c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4ddff0341adfcc3 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:04:22.238 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.238+0000 7ff775600700 1 -- 172.21.15.82:0/1057874682 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77000bb40 con 0x5633502bebc0 2024-05-08T06:04:22.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.238+0000 7ff775600700 1 -- 172.21.15.82:0/1057874682 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff770026070 con 0x5633502bebc0 2024-05-08T06:04:22.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.238+0000 7ff785000700 1 --2- 172.21.15.82:0/2617515720 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff7640b29d0 0x7ff7640b4e90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x5633502ba2b0 tx=0x7ff7780098d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:04:22.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.239+0000 7ff7918f7b80 1 -- 172.21.15.82:0/1057874682 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5633502bebc0 msgr2=0x5633502befa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:22.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.239+0000 7ff7918f7b80 1 --2- 172.21.15.82:0/1057874682 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5633502bebc0 0x5633502befa0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff770000c00 tx=0x7ff7700096c0 comp rx=0 tx=0).stop 2024-05-08T06:04:22.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.239+0000 7ff775600700 1 -- 172.21.15.82:0/1057874682 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff77000bb40 con 0x5633502bebc0 2024-05-08T06:04:22.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.240+0000 7ff7918f7b80 1 -- 172.21.15.82:0/1057874682 shutdown_connections 2024-05-08T06:04:22.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.240+0000 7ff7918f7b80 1 --2- 172.21.15.82:0/1057874682 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5633502b98f0 0x5633502b9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:22.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.240+0000 7ff7918f7b80 1 --2- 172.21.15.82:0/1057874682 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5633502bebc0 0x5633502befa0 secure :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff770000c00 tx=0x7ff7700096c0 comp rx=0 tx=0).stop 2024-05-08T06:04:22.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.240+0000 7ff7918f7b80 1 --2- 172.21.15.82:0/1057874682 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633502bf4e0 0x5633502b92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:22.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.240+0000 7ff7918f7b80 1 -- 172.21.15.82:0/1057874682 >> 172.21.15.82:0/1057874682 conn(0x5633502316d0 msgr2=0x5633502b3b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:04:22.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.242+0000 7ff7918f7b80 1 -- 172.21.15.82:0/1057874682 shutdown_connections 2024-05-08T06:04:22.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.242+0000 7ff7918f7b80 1 -- 172.21.15.82:0/1057874682 wait complete. 2024-05-08T06:04:22.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.243+0000 7ff7918f7b80 1 -- start start 2024-05-08T06:04:22.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.243+0000 7ff7918f7b80 1 Processor -- start 2024-05-08T06:04:22.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.244+0000 7ff7918f7b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5633502b98f0 0x5633502c5270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:22.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.244+0000 7ff7918f7b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5633502bf4e0 0x5633502c2570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:22.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.245+0000 7ff77fe00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5633502b98f0 0x5633502c5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:22.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.245+0000 7ff77fe00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5633502b98f0 0x5633502c5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:43490/0 (socket says 172.21.15.82:43490) 2024-05-08T06:04:22.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.245+0000 7ff7918f7b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633502c2ab0 0x5633502c2f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:22.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.246+0000 7ff77f400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5633502bf4e0 0x5633502c2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:22.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.246+0000 7ff77f400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5633502bf4e0 0x5633502c2570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:36774/0 (socket says 172.21.15.82:36774) 2024-05-08T06:04:22.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.246+0000 7ff77f400700 1 -- 172.21.15.82:0/3056658807 learned_addr learned my addr 172.21.15.82:0/3056658807 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:04:22.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.246+0000 7ff7918f7b80 1 -- 172.21.15.82:0/3056658807 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5633502c5f60 con 0x5633502c2ab0 2024-05-08T06:04:22.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.246+0000 7ff7918f7b80 1 -- 172.21.15.82:0/3056658807 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x563350171b20 con 0x5633502bf4e0 2024-05-08T06:04:22.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.246+0000 7ff7918f7b80 1 -- 172.21.15.82:0/3056658807 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5633502c60e0 con 0x5633502b98f0 2024-05-08T06:04:22.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.246+0000 7ff7918f7b80 10 client.0 _ll_register_callbacks cb 0x5633501b2c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:04:22.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.247+0000 7ff77f400700 1 -- 172.21.15.82:0/3056658807 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5633502b98f0 msgr2=0x5633502c5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:04:22.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.247+0000 7ff77f400700 1 --2- 172.21.15.82:0/3056658807 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5633502b98f0 0x5633502c5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:22.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.247+0000 7ff77f400700 1 -- 172.21.15.82:0/3056658807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633502c2ab0 msgr2=0x5633502c2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:04:22.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.247+0000 7ff77f400700 1 --2- 172.21.15.82:0/3056658807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633502c2ab0 0x5633502c2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:22.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.247+0000 7ff77f400700 1 -- 172.21.15.82:0/3056658807 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633501d1420 con 0x5633502bf4e0 2024-05-08T06:04:22.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.247+0000 7ff77f400700 1 --2- 172.21.15.82:0/3056658807 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5633502bf4e0 0x5633502c2570 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ff76c0dfb60 tx=0x7ff76c0a9e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7e7064160ff23db server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:04:22.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.247+0000 7ff76a000700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T06:04:22.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.247+0000 7ff76a000700 1 -- 172.21.15.82:0/3056658807 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff76c0ada10 con 0x5633502bf4e0 2024-05-08T06:04:22.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.248+0000 7ff76a000700 1 -- 172.21.15.82:0/3056658807 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7ff76c0a9ad0 con 0x5633502bf4e0 2024-05-08T06:04:22.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.249+0000 7ff7918f7b80 1 -- 172.21.15.82:0/3056658807 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff770026070 con 0x5633502bf4e0 2024-05-08T06:04:22.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:04:21 smithi134 ceph-mon[34132]: pgmap v870: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.6 MiB/s wr, 637 op/s 2024-05-08T06:04:22.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.249+0000 7ff76a000700 1 -- 172.21.15.82:0/3056658807 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7ff76c0b24c0 con 0x5633502bf4e0 2024-05-08T06:04:22.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.251+0000 7ff7918f7b80 10 client.26699 fetch_fsmap learned FSMap version 31 2024-05-08T06:04:22.251 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.251+0000 7ff7918f7b80 1 -- 172.21.15.82:0/3056658807 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5633502d0cd0 con 0x5633502bf4e0 2024-05-08T06:04:22.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.251+0000 7ff76a000700 1 -- 172.21.15.82:0/3056658807 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff770026070 con 0x5633502bf4e0 2024-05-08T06:04:22.253 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.251+0000 7ff76a000700 1 -- 172.21.15.82:0/3056658807 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7ff76c020030 con 0x5633502bf4e0 2024-05-08T06:04:22.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.251+0000 7ff7918f7b80 10 client.26699 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:04:22.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.251+0000 7ff7918f7b80 10 client.26699 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-08T06:04:22.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.251+0000 7ff7918f7b80 20 client.26699 populate_metadata read hostname 'smithi082' 2024-05-08T06:04:22.254 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.251+0000 7ff7918f7b80 1 --2- 172.21.15.82:0/3056658807 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x5633502d3260 0x5633502d5650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:22.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.251+0000 7ff7918f7b80 4 client.26699 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:04:22.255 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.251+0000 7ff7918f7b80 1 -- 172.21.15.82:0/3056658807 --> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563350286140 con 0x5633502d3260 2024-05-08T06:04:22.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.252+0000 7ff77fe00700 1 --2- 172.21.15.82:0/3056658807 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x5633502d3260 0x5633502d5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:22.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.252+0000 7ff77fe00700 1 --2- 172.21.15.82:0/3056658807 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x5633502d3260 0x5633502d5650 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=757a463f874c8d9a server_cookie=3c4367c2e995887b in_seq=0 out_seq=0 2024-05-08T06:04:22.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.252+0000 7ff76a000700 10 client.26699 ms_handle_connect on v2:172.21.15.151:6838/2963754236 2024-05-08T06:04:22.256 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.254+0000 7ff76a000700 1 -- 172.21.15.82:0/3056658807 <== mds.1 v2:172.21.15.151:6838/2963754236 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x563350286140 con 0x5633502d3260 2024-05-08T06:04:22.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.254+0000 7ff76a000700 10 client.26699 handle_command_reply: tid=0 2024-05-08T06:04:22.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.255+0000 7ff7918f7b80 1 client.26699 shutdown 2024-05-08T06:04:22.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.256+0000 7ff7918f7b80 1 -- 172.21.15.82:0/3056658807 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5633502bf4e0 msgr2=0x5633502c2570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:22.257 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.256+0000 7ff7918f7b80 1 --2- 172.21.15.82:0/3056658807 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5633502bf4e0 0x5633502c2570 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7ff76c0dfb60 tx=0x7ff76c0a9e50 comp rx=0 tx=0).stop 2024-05-08T06:04:22.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.257+0000 7ff7918f7b80 1 -- 172.21.15.82:0/3056658807 shutdown_connections 2024-05-08T06:04:22.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.257+0000 7ff7918f7b80 1 --2- 172.21.15.82:0/3056658807 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x5633502d3260 0x5633502d5650 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:22.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.257+0000 7ff7918f7b80 1 --2- 172.21.15.82:0/3056658807 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633502c2ab0 0x5633502c2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:22.258 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.257+0000 7ff7918f7b80 1 --2- 172.21.15.82:0/3056658807 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5633502b98f0 0x5633502c5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:22.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.257+0000 7ff7918f7b80 1 --2- 172.21.15.82:0/3056658807 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5633502bf4e0 0x5633502c2570 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:22.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.257+0000 7ff76a000700 0 client.26699 ms_handle_reset on v2:172.21.15.151:6838/2963754236 2024-05-08T06:04:22.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.257+0000 7ff7918f7b80 1 -- 172.21.15.82:0/3056658807 >> 172.21.15.82:0/3056658807 conn(0x5633502316d0 msgr2=0x5633502b3190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:04:22.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.257+0000 7ff7918f7b80 1 -- 172.21.15.82:0/3056658807 shutdown_connections 2024-05-08T06:04:22.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.257+0000 7ff7918f7b80 1 -- 172.21.15.82:0/3056658807 wait complete. 2024-05-08T06:04:22.259 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.258+0000 7ff7918f7b80 20 client.26699 trim_cache size 0 max 16384 2024-05-08T06:04:22.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.288+0000 7ff7918f7b80 1 Processor -- start 2024-05-08T06:04:22.289 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.289+0000 7ff7918f7b80 1 -- start start 2024-05-08T06:04:22.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.290+0000 7ff7918f7b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5633502b98f0 0x5633502b92d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:22.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.290+0000 7ff7918f7b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5633502bf4e0 0x5633502c14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:22.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.290+0000 7ff7918f7b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633502c2ab0 0x5633502c0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:22.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.290+0000 7ff7918f7b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff7801bc7d0 con 0x5633502c2ab0 2024-05-08T06:04:22.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.290+0000 7ff7918f7b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff7801be310 con 0x5633502b98f0 2024-05-08T06:04:22.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.290+0000 7ff7918f7b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff7801bcea0 con 0x5633502bf4e0 2024-05-08T06:04:22.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.291+0000 7ff77fe00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5633502b98f0 0x5633502b92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:22.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.291+0000 7ff77fe00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5633502b98f0 0x5633502b92d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:36780/0 (socket says 172.21.15.82:36780) 2024-05-08T06:04:22.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.291+0000 7ff785000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633502c2ab0 0x5633502c0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:22.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.291+0000 7ff77f400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5633502bf4e0 0x5633502c14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:22.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.291+0000 7ff77f400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5633502bf4e0 0x5633502c14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:43492/0 (socket says 172.21.15.82:43492) 2024-05-08T06:04:22.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.291+0000 7ff77f400700 1 -- 172.21.15.82:0/2512317405 learned_addr learned my addr 172.21.15.82:0/2512317405 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:04:22.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.292+0000 7ff77f400700 1 -- 172.21.15.82:0/2512317405 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5633502b98f0 msgr2=0x5633502b92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:04:22.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.292+0000 7ff77f400700 1 --2- 172.21.15.82:0/2512317405 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5633502b98f0 0x5633502b92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:22.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.292+0000 7ff77f400700 1 -- 172.21.15.82:0/2512317405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633502c2ab0 msgr2=0x5633502c0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:04:22.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.292+0000 7ff77f400700 1 --2- 172.21.15.82:0/2512317405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633502c2ab0 0x5633502c0150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:22.293 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.292+0000 7ff77f400700 1 -- 172.21.15.82:0/2512317405 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633502aeab0 con 0x5633502bf4e0 2024-05-08T06:04:22.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.293+0000 7ff77f400700 1 --2- 172.21.15.82:0/2512317405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5633502bf4e0 0x5633502c14d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff76c0a5c00 tx=0x7ff76c00fca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87c72d60abcdd636 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:04:22.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.293+0000 7ff774c00700 1 -- 172.21.15.82:0/2512317405 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff76c0ada10 con 0x5633502bf4e0 2024-05-08T06:04:22.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.293+0000 7ff774c00700 1 -- 172.21.15.82:0/2512317405 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff76c0a9ad0 con 0x5633502bf4e0 2024-05-08T06:04:22.294 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.293+0000 7ff774c00700 1 -- 172.21.15.82:0/2512317405 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff76c0aec70 con 0x5633502bf4e0 2024-05-08T06:04:22.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.295+0000 7ff7918f7b80 1 -- 172.21.15.82:0/2512317405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5633502bf4e0 msgr2=0x5633502c14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:22.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.295+0000 7ff7918f7b80 1 --2- 172.21.15.82:0/2512317405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5633502bf4e0 0x5633502c14d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff76c0a5c00 tx=0x7ff76c00fca0 comp rx=0 tx=0).stop 2024-05-08T06:04:22.295 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.295+0000 7ff7918f7b80 1 -- 172.21.15.82:0/2512317405 shutdown_connections 2024-05-08T06:04:22.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.295+0000 7ff7918f7b80 1 --2- 172.21.15.82:0/2512317405 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5633502b98f0 0x5633502b92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:22.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.295+0000 7ff7918f7b80 1 --2- 172.21.15.82:0/2512317405 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633502c2ab0 0x5633502c0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:22.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.295+0000 7ff7918f7b80 1 --2- 172.21.15.82:0/2512317405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5633502bf4e0 0x5633502c14d0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:22.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.295+0000 7ff7918f7b80 1 -- 172.21.15.82:0/2512317405 >> 172.21.15.82:0/2512317405 conn(0x5633502316d0 msgr2=0x5633502bd740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:04:22.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.295+0000 7ff7918f7b80 1 -- 172.21.15.82:0/2512317405 shutdown_connections 2024-05-08T06:04:22.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.295+0000 7ff7918f7b80 1 -- 172.21.15.82:0/2512317405 wait complete. 2024-05-08T06:04:22.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.296+0000 7ff7918f7b80 1 -- start start 2024-05-08T06:04:22.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.296+0000 7ff7918f7b80 1 Processor -- start 2024-05-08T06:04:22.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.296+0000 7ff7918f7b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5633502b98f0 0x5633502da870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:22.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.296+0000 7ff7918f7b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633502bf4e0 0x5633502dadb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:22.297 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.296+0000 7ff7918f7b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5633502c2ab0 0x5633502db2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:22.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.296+0000 7ff7918f7b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff7801bdc40 con 0x5633502bf4e0 2024-05-08T06:04:22.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.296+0000 7ff7918f7b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff7801bd570 con 0x5633502c2ab0 2024-05-08T06:04:22.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.296+0000 7ff7918f7b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff7801ba790 con 0x5633502b98f0 2024-05-08T06:04:22.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.296+0000 7ff7918f7b80 10 client.0 _ll_register_callbacks cb 0x5633501b2c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:04:22.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.297+0000 7ff77fe00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5633502b98f0 0x5633502da870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:22.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.297+0000 7ff77f400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633502bf4e0 0x5633502dadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:22.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.297+0000 7ff77fe00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5633502b98f0 0x5633502da870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:43498/0 (socket says 172.21.15.82:43498) 2024-05-08T06:04:22.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.297+0000 7ff77f400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633502bf4e0 0x5633502dadb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:48440/0 (socket says 172.21.15.82:48440) 2024-05-08T06:04:22.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.297+0000 7ff77fe00700 1 -- 172.21.15.82:0/4186640141 learned_addr learned my addr 172.21.15.82:0/4186640141 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:04:22.298 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.297+0000 7ff785000700 1 --2- 172.21.15.82:0/4186640141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5633502c2ab0 0x5633502db2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:22.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.297+0000 7ff785000700 1 -- 172.21.15.82:0/4186640141 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5633502b98f0 msgr2=0x5633502da870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:04:22.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.297+0000 7ff785000700 1 --2- 172.21.15.82:0/4186640141 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5633502b98f0 0x5633502da870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:22.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.297+0000 7ff785000700 1 -- 172.21.15.82:0/4186640141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633502bf4e0 msgr2=0x5633502dadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:04:22.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.297+0000 7ff785000700 1 --2- 172.21.15.82:0/4186640141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633502bf4e0 0x5633502dadb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:22.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.297+0000 7ff785000700 1 -- 172.21.15.82:0/4186640141 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633502cf910 con 0x5633502c2ab0 2024-05-08T06:04:22.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.297+0000 7ff77fe00700 1 --2- 172.21.15.82:0/4186640141 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5633502b98f0 0x5633502da870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:04:22.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.298+0000 7ff785000700 1 --2- 172.21.15.82:0/4186640141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5633502c2ab0 0x5633502db2f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x5633502b4ca0 tx=0x7ff778009aa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19de0e751b96aaa7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:04:22.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.298+0000 7ff76a000700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T06:04:22.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.298+0000 7ff76a000700 1 -- 172.21.15.82:0/4186640141 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff778016900 con 0x5633502c2ab0 2024-05-08T06:04:22.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.298+0000 7ff7918f7b80 1 -- 172.21.15.82:0/4186640141 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff76c0a9ad0 con 0x5633502c2ab0 2024-05-08T06:04:22.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.298+0000 7ff76a000700 1 -- 172.21.15.82:0/4186640141 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7ff778016aa0 con 0x5633502c2ab0 2024-05-08T06:04:22.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.299+0000 7ff76a000700 1 -- 172.21.15.82:0/4186640141 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7ff778016ca0 con 0x5633502c2ab0 2024-05-08T06:04:22.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.299+0000 7ff7918f7b80 10 client.26705 fetch_fsmap learned FSMap version 31 2024-05-08T06:04:22.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.299+0000 7ff7918f7b80 1 -- 172.21.15.82:0/4186640141 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5633502bf1f0 con 0x5633502c2ab0 2024-05-08T06:04:22.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.300+0000 7ff76a000700 1 -- 172.21.15.82:0/4186640141 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff76c0a9ad0 con 0x5633502c2ab0 2024-05-08T06:04:22.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.300+0000 7ff76a000700 1 -- 172.21.15.82:0/4186640141 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7ff778016070 con 0x5633502c2ab0 2024-05-08T06:04:22.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.300+0000 7ff7918f7b80 10 client.26705 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:04:22.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.300+0000 7ff7918f7b80 10 client.26705 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-08T06:04:22.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.300+0000 7ff7918f7b80 20 client.26705 populate_metadata read hostname 'smithi082' 2024-05-08T06:04:22.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.300+0000 7ff7918f7b80 1 --2- 172.21.15.82:0/4186640141 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x56335033e2a0 0x5633503406c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:22.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.300+0000 7ff7918f7b80 4 client.26705 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T06:04:22.301 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.300+0000 7ff7918f7b80 1 -- 172.21.15.82:0/4186640141 --> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563350219400 con 0x56335033e2a0 2024-05-08T06:04:22.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.301+0000 7ff77fe00700 1 --2- 172.21.15.82:0/4186640141 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x56335033e2a0 0x5633503406c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:22.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.302+0000 7ff77fe00700 1 --2- 172.21.15.82:0/4186640141 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x56335033e2a0 0x5633503406c0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b0946498fa62218b server_cookie=397facb4f4494999 in_seq=0 out_seq=0 2024-05-08T06:04:22.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.302+0000 7ff76a000700 10 client.26705 ms_handle_connect on v2:172.21.15.151:6838/2963754236 2024-05-08T06:04:22.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.302+0000 7ff76a000700 1 -- 172.21.15.82:0/4186640141 <== mds.1 v2:172.21.15.151:6838/2963754236 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563350219400 con 0x56335033e2a0 2024-05-08T06:04:22.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.302+0000 7ff76a000700 10 client.26705 handle_command_reply: tid=0 2024-05-08T06:04:22.303 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.302+0000 7ff7918f7b80 1 client.26705 shutdown 2024-05-08T06:04:22.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.302+0000 7ff7918f7b80 1 -- 172.21.15.82:0/4186640141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5633502c2ab0 msgr2=0x5633502db2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:22.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.302+0000 7ff7918f7b80 1 --2- 172.21.15.82:0/4186640141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5633502c2ab0 0x5633502db2f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x5633502b4ca0 tx=0x7ff778009aa0 comp rx=0 tx=0).stop 2024-05-08T06:04:22.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.303+0000 7ff7918f7b80 1 -- 172.21.15.82:0/4186640141 shutdown_connections 2024-05-08T06:04:22.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.303+0000 7ff7918f7b80 1 --2- 172.21.15.82:0/4186640141 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x56335033e2a0 0x5633503406c0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:22.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.303+0000 7ff7918f7b80 1 --2- 172.21.15.82:0/4186640141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5633502c2ab0 0x5633502db2f0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:22.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.303+0000 7ff7918f7b80 1 --2- 172.21.15.82:0/4186640141 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5633502b98f0 0x5633502da870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:22.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.303+0000 7ff7918f7b80 1 --2- 172.21.15.82:0/4186640141 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5633502bf4e0 0x5633502dadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:22.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.303+0000 7ff76a000700 0 client.26705 ms_handle_reset on v2:172.21.15.151:6838/2963754236 2024-05-08T06:04:22.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.303+0000 7ff7918f7b80 1 -- 172.21.15.82:0/4186640141 >> 172.21.15.82:0/4186640141 conn(0x5633502316d0 msgr2=0x5633502bdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:04:22.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.303+0000 7ff7918f7b80 1 -- 172.21.15.82:0/4186640141 shutdown_connections 2024-05-08T06:04:22.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.303+0000 7ff7918f7b80 1 -- 172.21.15.82:0/4186640141 wait complete. 2024-05-08T06:04:22.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.304+0000 7ff7918f7b80 20 client.26705 trim_cache size 0 max 16384 2024-05-08T06:04:22.305 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T06:04:22.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.304+0000 7ff787000700 1 -- 172.21.15.82:0/2617515720 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff7640b29d0 msgr2=0x7ff7640b4e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:22.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.304+0000 7ff787000700 1 --2- 172.21.15.82:0/2617515720 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff7640b29d0 0x7ff7640b4e90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x5633502ba2b0 tx=0x7ff7780098d0 comp rx=0 tx=0).stop 2024-05-08T06:04:22.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.304+0000 7ff787000700 1 -- 172.21.15.82:0/2617515720 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff780104100 msgr2=0x7ff780117ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:22.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.304+0000 7ff787000700 1 --2- 172.21.15.82:0/2617515720 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff780104100 0x7ff780117ef0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7ff76c00c970 tx=0x7ff76c00cc80 comp rx=0 tx=0).stop 2024-05-08T06:04:22.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.304+0000 7ff787000700 1 -- 172.21.15.82:0/2617515720 shutdown_connections 2024-05-08T06:04:22.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.304+0000 7ff787000700 1 --2- 172.21.15.82:0/2617515720 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff7640b29d0 0x7ff7640b4e90 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:22.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.304+0000 7ff787000700 1 --2- 172.21.15.82:0/2617515720 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff780108850 0x7ff780112ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:22.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.304+0000 7ff787000700 1 --2- 172.21.15.82:0/2617515720 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff780103750 0x7ff7801179b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:22.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.304+0000 7ff787000700 1 --2- 172.21.15.82:0/2617515720 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff780104100 0x7ff780117ef0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:22.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.305+0000 7ff787000700 1 -- 172.21.15.82:0/2617515720 >> 172.21.15.82:0/2617515720 conn(0x7ff78007a600 msgr2=0x7ff780102cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:04:22.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.305+0000 7ff787000700 1 -- 172.21.15.82:0/2617515720 shutdown_connections 2024-05-08T06:04:22.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:22.305+0000 7ff787000700 1 -- 172.21.15.82:0/2617515720 wait complete. 2024-05-08T06:04:23.294 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-05-08T06:04:23.918 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:04:24.082 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:04:23 smithi082 ceph-mon[30098]: pgmap v871: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.4 MiB/s wr, 691 op/s 2024-05-08T06:04:24.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:04:23 smithi151 ceph-mon[34815]: pgmap v871: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.4 MiB/s wr, 691 op/s 2024-05-08T06:04:24.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:04:23 smithi134 ceph-mon[34132]: pgmap v871: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.4 MiB/s wr, 691 op/s 2024-05-08T06:04:25.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 815.0 s, 1429.2 tps, lat 69.578 ms stddev 86.506 2024-05-08T06:04:25.884 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:04:25 smithi082 ceph-mon[30098]: pgmap v872: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.7 MiB/s wr, 615 op/s 2024-05-08T06:04:26.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:04:25 smithi151 ceph-mon[34815]: pgmap v872: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.7 MiB/s wr, 615 op/s 2024-05-08T06:04:26.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:04:25 smithi134 ceph-mon[34132]: pgmap v872: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.7 MiB/s wr, 615 op/s 2024-05-08T06:04:26.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.556+0000 7f2362200700 1 -- 172.21.15.82:0/2319792779 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f235c1076c0 msgr2=0x7f235c107aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:26.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.556+0000 7f2362200700 1 --2- 172.21.15.82:0/2319792779 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f235c1076c0 0x7f235c107aa0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f2354009f90 tx=0x7f235400b330 comp rx=0 tx=0).stop 2024-05-08T06:04:26.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.556+0000 7f2362200700 1 -- 172.21.15.82:0/2319792779 shutdown_connections 2024-05-08T06:04:26.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.556+0000 7f2362200700 1 --2- 172.21.15.82:0/2319792779 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f235c1076c0 0x7f235c107aa0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:26.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.556+0000 7f2362200700 1 --2- 172.21.15.82:0/2319792779 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f235c102080 0x7f235c10e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:26.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.556+0000 7f2362200700 1 --2- 172.21.15.82:0/2319792779 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f235c1016c0 0x7f235c101b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:26.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.557+0000 7f2362200700 1 -- 172.21.15.82:0/2319792779 >> 172.21.15.82:0/2319792779 conn(0x7f235c0785a0 msgr2=0x7f235c0ff950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:04:26.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.559+0000 7f2362200700 1 -- 172.21.15.82:0/2319792779 shutdown_connections 2024-05-08T06:04:26.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.559+0000 7f2362200700 1 -- 172.21.15.82:0/2319792779 wait complete. 2024-05-08T06:04:26.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.561+0000 7f2362200700 1 Processor -- start 2024-05-08T06:04:26.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.562+0000 7f2362200700 1 -- start start 2024-05-08T06:04:26.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.562+0000 7f2362200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f235c1016c0 0x7f235c1a1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:26.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.562+0000 7f2362200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f235c102080 0x7f235c1a2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:26.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.562+0000 7f2362200700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f235c1076c0 0x7f235c19c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:26.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.562+0000 7f2362200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f235c111450 con 0x7f235c102080 2024-05-08T06:04:26.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.562+0000 7f2362200700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f235c1112d0 con 0x7f235c1016c0 2024-05-08T06:04:26.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.562+0000 7f2362200700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f235c1115d0 con 0x7f235c1076c0 2024-05-08T06:04:26.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.563+0000 7f235b400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f235c1016c0 0x7f235c1a1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:26.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.563+0000 7f235aa00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f235c102080 0x7f235c1a2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:26.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.563+0000 7f235aa00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f235c102080 0x7f235c1a2040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57756/0 (socket says 172.21.15.82:57756) 2024-05-08T06:04:26.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.563+0000 7f235aa00700 1 -- 172.21.15.82:0/2436841286 learned_addr learned my addr 172.21.15.82:0/2436841286 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:04:26.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.564+0000 7f235be00700 1 --2- 172.21.15.82:0/2436841286 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f235c1076c0 0x7f235c19c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:26.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.565+0000 7f235b400700 1 -- 172.21.15.82:0/2436841286 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f235c1076c0 msgr2=0x7f235c19c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:26.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.565+0000 7f235b400700 1 --2- 172.21.15.82:0/2436841286 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f235c1076c0 0x7f235c19c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:26.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.565+0000 7f235b400700 1 -- 172.21.15.82:0/2436841286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f235c102080 msgr2=0x7f235c1a2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:26.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.565+0000 7f235b400700 1 --2- 172.21.15.82:0/2436841286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f235c102080 0x7f235c1a2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:26.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.565+0000 7f235b400700 1 -- 172.21.15.82:0/2436841286 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f235c19c890 con 0x7f235c1016c0 2024-05-08T06:04:26.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.565+0000 7f235b400700 1 --2- 172.21.15.82:0/2436841286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f235c1016c0 0x7f235c1a1b00 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2354000f80 tx=0x7f235400cd60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:04:26.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.566+0000 7f2353e00700 1 -- 172.21.15.82:0/2436841286 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2354021070 con 0x7f235c1016c0 2024-05-08T06:04:26.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.566+0000 7f2353e00700 1 -- 172.21.15.82:0/2436841286 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2354007ac0 con 0x7f235c1016c0 2024-05-08T06:04:26.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.566+0000 7f2353e00700 1 -- 172.21.15.82:0/2436841286 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23540052a0 con 0x7f235c1016c0 2024-05-08T06:04:26.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.566+0000 7f2362200700 1 -- 172.21.15.82:0/2436841286 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f235c19cac0 con 0x7f235c1016c0 2024-05-08T06:04:26.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.566+0000 7f2362200700 1 -- 172.21.15.82:0/2436841286 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f235c06cec0 con 0x7f235c1016c0 2024-05-08T06:04:26.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.577+0000 7f2353e00700 1 -- 172.21.15.82:0/2436841286 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f2354024070 con 0x7f235c1016c0 2024-05-08T06:04:26.578 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.577+0000 7f236caf1b80 1 Processor -- start 2024-05-08T06:04:26.579 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.579+0000 7f236caf1b80 1 -- start start 2024-05-08T06:04:26.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.579+0000 7f236caf1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555d02a633d0 0x555d02a637b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:26.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.579+0000 7f236caf1b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555d02a63cf0 0x555d02a5dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:26.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.579+0000 7f236caf1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d02a5e100 0x555d02a5e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:26.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.579+0000 7f236caf1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x555d029a7a20 con 0x555d02a5e100 2024-05-08T06:04:26.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.579+0000 7f236caf1b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x555d02945760 con 0x555d02a63cf0 2024-05-08T06:04:26.580 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.579+0000 7f236caf1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x555d029a39e0 con 0x555d02a633d0 2024-05-08T06:04:26.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.580+0000 7f2353e00700 1 --2- 172.21.15.82:0/2436841286 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f23400b2980 0x7f23400b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:26.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.580+0000 7f235be00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555d02a633d0 0x555d02a637b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:26.581 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.580+0000 7f235b400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555d02a63cf0 0x555d02a5dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:26.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.580+0000 7f235b400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555d02a63cf0 0x555d02a5dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:37284/0 (socket says 172.21.15.82:37284) 2024-05-08T06:04:26.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.580+0000 7f235b400700 1 -- 172.21.15.82:0/2505115014 learned_addr learned my addr 172.21.15.82:0/2505115014 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:04:26.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.581+0000 7f235aa00700 1 --2- 172.21.15.82:0/2505115014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d02a5e100 0x555d02a5e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:26.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.581+0000 7f235be00700 1 -- 172.21.15.82:0/2505115014 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555d02a63cf0 msgr2=0x555d02a5dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:04:26.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.581+0000 7f235be00700 1 --2- 172.21.15.82:0/2505115014 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555d02a63cf0 0x555d02a5dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:26.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.581+0000 7f235be00700 1 -- 172.21.15.82:0/2505115014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d02a5e100 msgr2=0x555d02a5e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:04:26.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.581+0000 7f235be00700 1 --2- 172.21.15.82:0/2505115014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d02a5e100 0x555d02a5e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:26.582 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.581+0000 7f235be00700 1 -- 172.21.15.82:0/2505115014 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d028f48d0 con 0x555d02a633d0 2024-05-08T06:04:26.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.581+0000 7f235be00700 1 --2- 172.21.15.82:0/2505115014 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555d02a633d0 0x555d02a637b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f2348009d10 tx=0x7f2348013740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62d4fe308fa5f924 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:04:26.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.582+0000 7f2350c00700 1 -- 172.21.15.82:0/2505115014 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2348004050 con 0x555d02a633d0 2024-05-08T06:04:26.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.582+0000 7f2350c00700 1 -- 172.21.15.82:0/2505115014 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2348004830 con 0x555d02a633d0 2024-05-08T06:04:26.583 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.582+0000 7f2350c00700 1 -- 172.21.15.82:0/2505115014 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23480052c0 con 0x555d02a633d0 2024-05-08T06:04:26.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.582+0000 7f2353e00700 1 -- 172.21.15.82:0/2436841286 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f235400f020 con 0x7f235c1016c0 2024-05-08T06:04:26.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.583+0000 7f236caf1b80 1 -- 172.21.15.82:0/2505115014 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555d02a633d0 msgr2=0x555d02a637b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:26.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.583+0000 7f236caf1b80 1 --2- 172.21.15.82:0/2505115014 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555d02a633d0 0x555d02a637b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f2348009d10 tx=0x7f2348013740 comp rx=0 tx=0).stop 2024-05-08T06:04:26.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.584+0000 7f236caf1b80 1 -- 172.21.15.82:0/2505115014 shutdown_connections 2024-05-08T06:04:26.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.584+0000 7f236caf1b80 1 --2- 172.21.15.82:0/2505115014 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d02a5e100 0x555d02a5e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:26.584 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.584+0000 7f236caf1b80 1 --2- 172.21.15.82:0/2505115014 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555d02a633d0 0x555d02a637b0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:26.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.584+0000 7f236caf1b80 1 --2- 172.21.15.82:0/2505115014 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555d02a63cf0 0x555d02a5dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:26.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.584+0000 7f236caf1b80 1 -- 172.21.15.82:0/2505115014 >> 172.21.15.82:0/2505115014 conn(0x555d029cd6d0 msgr2=0x555d02a4fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:04:26.585 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.584+0000 7f236caf1b80 1 -- 172.21.15.82:0/2505115014 shutdown_connections 2024-05-08T06:04:26.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.584+0000 7f236caf1b80 1 -- 172.21.15.82:0/2505115014 wait complete. 2024-05-08T06:04:26.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.585+0000 7f235be00700 1 --2- 172.21.15.82:0/2436841286 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f23400b2980 0x7f23400b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:26.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.585+0000 7f236caf1b80 1 -- start start 2024-05-08T06:04:26.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.585+0000 7f236caf1b80 1 Processor -- start 2024-05-08T06:04:26.586 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.586+0000 7f235be00700 1 --2- 172.21.15.82:0/2436841286 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f23400b2980 0x7f23400b4e40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2348009f60 tx=0x7f2348009b70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:04:26.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.587+0000 7f236caf1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d02a5e100 0x555d02a69a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:26.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.587+0000 7f236caf1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555d02a633d0 0x555d02a66dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:26.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.587+0000 7f236caf1b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555d02a63cf0 0x555d02a67300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:26.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.587+0000 7f236caf1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x555d02a6a730 con 0x555d02a5e100 2024-05-08T06:04:26.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.587+0000 7f236caf1b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x555d0290db20 con 0x555d02a63cf0 2024-05-08T06:04:26.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.587+0000 7f236caf1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x555d02a6a8b0 con 0x555d02a633d0 2024-05-08T06:04:26.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.587+0000 7f236caf1b80 10 client.0 _ll_register_callbacks cb 0x555d0294ec70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:04:26.589 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.588+0000 7f235be00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555d02a63cf0 0x555d02a67300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:26.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.588+0000 7f235be00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555d02a63cf0 0x555d02a67300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:37286/0 (socket says 172.21.15.82:37286) 2024-05-08T06:04:26.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.588+0000 7f235be00700 1 -- 172.21.15.82:0/4294640712 learned_addr learned my addr 172.21.15.82:0/4294640712 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:04:26.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.588+0000 7f235b400700 1 --2- 172.21.15.82:0/4294640712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d02a5e100 0x555d02a69a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:26.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.589+0000 7f235be00700 1 -- 172.21.15.82:0/4294640712 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555d02a633d0 msgr2=0x555d02a66dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:04:26.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.589+0000 7f235be00700 1 --2- 172.21.15.82:0/4294640712 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555d02a633d0 0x555d02a66dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:26.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.589+0000 7f235be00700 1 -- 172.21.15.82:0/4294640712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d02a5e100 msgr2=0x555d02a69a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:04:26.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.589+0000 7f235be00700 1 --2- 172.21.15.82:0/4294640712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d02a5e100 0x555d02a69a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:26.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.589+0000 7f235be00700 1 -- 172.21.15.82:0/4294640712 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d0296d420 con 0x555d02a63cf0 2024-05-08T06:04:26.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.589+0000 7f235be00700 1 --2- 172.21.15.82:0/4294640712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555d02a63cf0 0x555d02a67300 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f2348004ec0 tx=0x7f2348009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5b3e85715e875b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:04:26.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.589+0000 7f2345600700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T06:04:26.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.589+0000 7f2345600700 1 -- 172.21.15.82:0/4294640712 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2348005590 con 0x555d02a63cf0 2024-05-08T06:04:26.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.590+0000 7f2345600700 1 -- 172.21.15.82:0/4294640712 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2348020040 con 0x555d02a63cf0 2024-05-08T06:04:26.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.590+0000 7f236caf1b80 1 -- 172.21.15.82:0/4294640712 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2348004830 con 0x555d02a63cf0 2024-05-08T06:04:26.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.590+0000 7f2345600700 1 -- 172.21.15.82:0/4294640712 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f2348005590 con 0x555d02a63cf0 2024-05-08T06:04:26.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.590+0000 7f236caf1b80 10 client.26717 fetch_fsmap learned FSMap version 31 2024-05-08T06:04:26.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.590+0000 7f236caf1b80 1 -- 172.21.15.82:0/4294640712 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x555d02a74fe0 con 0x555d02a63cf0 2024-05-08T06:04:26.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.591+0000 7f2345600700 1 -- 172.21.15.82:0/4294640712 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2348004830 con 0x555d02a63cf0 2024-05-08T06:04:26.592 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.591+0000 7f2345600700 1 -- 172.21.15.82:0/4294640712 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f2348037030 con 0x555d02a63cf0 2024-05-08T06:04:26.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.591+0000 7f236caf1b80 10 client.26717 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:04:26.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.591+0000 7f236caf1b80 10 client.26717 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T06:04:26.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.591+0000 7f236caf1b80 20 client.26717 populate_metadata read hostname 'smithi082' 2024-05-08T06:04:26.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.591+0000 7f236caf1b80 1 --2- 172.21.15.82:0/4294640712 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x555d02a774b0 0x555d02a798e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:26.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.591+0000 7f236caf1b80 4 client.26717 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:04:26.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.592+0000 7f236caf1b80 1 -- 172.21.15.82:0/4294640712 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555d02a22140 con 0x555d02a774b0 2024-05-08T06:04:26.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.592+0000 7f235b400700 1 --2- 172.21.15.82:0/4294640712 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x555d02a774b0 0x555d02a798e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:26.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.592+0000 7f235b400700 1 --2- 172.21.15.82:0/4294640712 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x555d02a774b0 0x555d02a798e0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98906ae100727013 server_cookie=c32f588aa601d03c in_seq=0 out_seq=0 2024-05-08T06:04:26.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.592+0000 7f2345600700 10 client.26717 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T06:04:26.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.593+0000 7f2345600700 1 -- 172.21.15.82:0/4294640712 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x555d02a22140 con 0x555d02a774b0 2024-05-08T06:04:26.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.593+0000 7f2345600700 10 client.26717 handle_command_reply: tid=0 2024-05-08T06:04:26.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.593+0000 7f236caf1b80 1 client.26717 shutdown 2024-05-08T06:04:26.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.594+0000 7f236caf1b80 1 -- 172.21.15.82:0/4294640712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555d02a63cf0 msgr2=0x555d02a67300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:26.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.594+0000 7f236caf1b80 1 --2- 172.21.15.82:0/4294640712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555d02a63cf0 0x555d02a67300 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f2348004ec0 tx=0x7f2348009260 comp rx=0 tx=0).stop 2024-05-08T06:04:26.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.594+0000 7f236caf1b80 1 -- 172.21.15.82:0/4294640712 shutdown_connections 2024-05-08T06:04:26.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.594+0000 7f236caf1b80 1 --2- 172.21.15.82:0/4294640712 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x555d02a774b0 0x555d02a798e0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:26.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.594+0000 7f236caf1b80 1 --2- 172.21.15.82:0/4294640712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555d02a63cf0 0x555d02a67300 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:26.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.594+0000 7f236caf1b80 1 --2- 172.21.15.82:0/4294640712 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d02a5e100 0x555d02a69a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:26.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.594+0000 7f236caf1b80 1 --2- 172.21.15.82:0/4294640712 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555d02a633d0 0x555d02a66dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:26.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.594+0000 7f236caf1b80 1 -- 172.21.15.82:0/4294640712 >> 172.21.15.82:0/4294640712 conn(0x555d029cd6d0 msgr2=0x555d02a4f190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:04:26.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.594+0000 7f2345600700 0 client.26717 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T06:04:26.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.594+0000 7f236caf1b80 1 -- 172.21.15.82:0/4294640712 shutdown_connections 2024-05-08T06:04:26.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.594+0000 7f236caf1b80 1 -- 172.21.15.82:0/4294640712 wait complete. 2024-05-08T06:04:26.596 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.595+0000 7f236caf1b80 20 client.26717 trim_cache size 0 max 16384 2024-05-08T06:04:26.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.618+0000 7f236caf1b80 1 Processor -- start 2024-05-08T06:04:26.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.618+0000 7f236caf1b80 1 -- start start 2024-05-08T06:04:26.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.619+0000 7f236caf1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555d02a5e100 0x555d02a5dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:26.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.619+0000 7f236caf1b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555d02a633d0 0x555d02a69a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:26.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.619+0000 7f236caf1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d02a63cf0 0x555d02a737c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:26.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.619+0000 7f236caf1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f235c06ff00 con 0x555d02a63cf0 2024-05-08T06:04:26.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.619+0000 7f236caf1b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f235c071a40 con 0x555d02a633d0 2024-05-08T06:04:26.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.619+0000 7f236caf1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f235c0705d0 con 0x555d02a5e100 2024-05-08T06:04:26.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.620+0000 7f235be00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d02a63cf0 0x555d02a737c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:26.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.620+0000 7f235b400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555d02a5e100 0x555d02a5dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:26.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.620+0000 7f235be00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d02a63cf0 0x555d02a737c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:57790/0 (socket says 172.21.15.82:57790) 2024-05-08T06:04:26.621 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.620+0000 7f235be00700 1 -- 172.21.15.82:0/3416664445 learned_addr learned my addr 172.21.15.82:0/3416664445 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:04:26.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.620+0000 7f235aa00700 1 --2- 172.21.15.82:0/3416664445 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555d02a633d0 0x555d02a69a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:26.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.621+0000 7f235b400700 1 -- 172.21.15.82:0/3416664445 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555d02a633d0 msgr2=0x555d02a69a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:04:26.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.621+0000 7f235b400700 1 --2- 172.21.15.82:0/3416664445 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555d02a633d0 0x555d02a69a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:26.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.621+0000 7f235b400700 1 -- 172.21.15.82:0/3416664445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d02a63cf0 msgr2=0x555d02a737c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:04:26.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.621+0000 7f235b400700 1 --2- 172.21.15.82:0/3416664445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d02a63cf0 0x555d02a737c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:26.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.621+0000 7f235b400700 1 -- 172.21.15.82:0/3416664445 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d02a653d0 con 0x555d02a5e100 2024-05-08T06:04:26.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.621+0000 7f235be00700 1 --2- 172.21.15.82:0/3416664445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d02a63cf0 0x555d02a737c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:04:26.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.621+0000 7f235b400700 1 --2- 172.21.15.82:0/3416664445 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555d02a5e100 0x555d02a5dae0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f235400b6c0 tx=0x7f23540e0f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc9cda68e91e3fb9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:04:26.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.621+0000 7f2347e00700 1 -- 172.21.15.82:0/3416664445 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23540ab4c0 con 0x555d02a5e100 2024-05-08T06:04:26.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.622+0000 7f2347e00700 1 -- 172.21.15.82:0/3416664445 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f23540cbe50 con 0x555d02a5e100 2024-05-08T06:04:26.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.622+0000 7f2347e00700 1 -- 172.21.15.82:0/3416664445 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23540a7300 con 0x555d02a5e100 2024-05-08T06:04:26.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.622+0000 7f236caf1b80 1 -- 172.21.15.82:0/3416664445 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555d02a5e100 msgr2=0x555d02a5dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:26.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.622+0000 7f236caf1b80 1 --2- 172.21.15.82:0/3416664445 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555d02a5e100 0x555d02a5dae0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f235400b6c0 tx=0x7f23540e0f50 comp rx=0 tx=0).stop 2024-05-08T06:04:26.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.622+0000 7f236caf1b80 1 -- 172.21.15.82:0/3416664445 shutdown_connections 2024-05-08T06:04:26.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.622+0000 7f236caf1b80 1 --2- 172.21.15.82:0/3416664445 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d02a63cf0 0x555d02a737c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:26.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.622+0000 7f236caf1b80 1 --2- 172.21.15.82:0/3416664445 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555d02a5e100 0x555d02a5dae0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:26.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.622+0000 7f236caf1b80 1 --2- 172.21.15.82:0/3416664445 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555d02a633d0 0x555d02a69a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:26.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.622+0000 7f236caf1b80 1 -- 172.21.15.82:0/3416664445 >> 172.21.15.82:0/3416664445 conn(0x555d029cd6d0 msgr2=0x555d02a66d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:04:26.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.622+0000 7f236caf1b80 1 -- 172.21.15.82:0/3416664445 shutdown_connections 2024-05-08T06:04:26.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.623+0000 7f236caf1b80 1 -- 172.21.15.82:0/3416664445 wait complete. 2024-05-08T06:04:26.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.623+0000 7f236caf1b80 1 -- start start 2024-05-08T06:04:26.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.623+0000 7f236caf1b80 1 Processor -- start 2024-05-08T06:04:26.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.624+0000 7f236caf1b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d02a5e100 0x555d02a7f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:26.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.624+0000 7f236caf1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555d02a633d0 0x555d02a6fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:26.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.624+0000 7f236caf1b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555d02a63cf0 0x555d02a70080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:26.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.624+0000 7f236caf1b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f235c071370 con 0x555d02a5e100 2024-05-08T06:04:26.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.624+0000 7f236caf1b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f235c070ca0 con 0x555d02a63cf0 2024-05-08T06:04:26.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.624+0000 7f236caf1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f235c116e00 con 0x555d02a633d0 2024-05-08T06:04:26.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.624+0000 7f236caf1b80 10 client.0 _ll_register_callbacks cb 0x555d0294ec70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:04:26.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.625+0000 7f235aa00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555d02a633d0 0x555d02a6fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:26.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.625+0000 7f235aa00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555d02a633d0 0x555d02a6fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:50158/0 (socket says 172.21.15.82:50158) 2024-05-08T06:04:26.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.625+0000 7f235aa00700 1 -- 172.21.15.82:0/993124327 learned_addr learned my addr 172.21.15.82:0/993124327 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:04:26.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.625+0000 7f235be00700 1 --2- 172.21.15.82:0/993124327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555d02a63cf0 0x555d02a70080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:26.627 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.625+0000 7f235b400700 1 --2- 172.21.15.82:0/993124327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d02a5e100 0x555d02a7f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:26.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.625+0000 7f235aa00700 1 -- 172.21.15.82:0/993124327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555d02a63cf0 msgr2=0x555d02a70080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:04:26.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.625+0000 7f235aa00700 1 --2- 172.21.15.82:0/993124327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555d02a63cf0 0x555d02a70080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:26.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.625+0000 7f235aa00700 1 -- 172.21.15.82:0/993124327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d02a5e100 msgr2=0x555d02a7f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:04:26.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.625+0000 7f235aa00700 1 --2- 172.21.15.82:0/993124327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d02a5e100 0x555d02a7f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:26.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.625+0000 7f235aa00700 1 -- 172.21.15.82:0/993124327 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d02adce80 con 0x555d02a633d0 2024-05-08T06:04:26.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.626+0000 7f235aa00700 1 --2- 172.21.15.82:0/993124327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555d02a633d0 0x555d02a6fb40 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f235c19d3d0 tx=0x7f234c012ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c3bed7bb3da2cfe server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:04:26.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.626+0000 7f2345600700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T06:04:26.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.626+0000 7f2345600700 1 -- 172.21.15.82:0/993124327 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f234c020060 con 0x555d02a633d0 2024-05-08T06:04:26.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.627+0000 7f2345600700 1 -- 172.21.15.82:0/993124327 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f234c005240 con 0x555d02a633d0 2024-05-08T06:04:26.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.627+0000 7f236caf1b80 1 -- 172.21.15.82:0/993124327 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23540cbe50 con 0x555d02a633d0 2024-05-08T06:04:26.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.627+0000 7f2345600700 1 -- 172.21.15.82:0/993124327 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f234c005440 con 0x555d02a633d0 2024-05-08T06:04:26.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.627+0000 7f236caf1b80 10 client.26755 fetch_fsmap learned FSMap version 31 2024-05-08T06:04:26.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.627+0000 7f236caf1b80 1 -- 172.21.15.82:0/993124327 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x555d02a7e670 con 0x555d02a633d0 2024-05-08T06:04:26.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.627+0000 7f2345600700 1 -- 172.21.15.82:0/993124327 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f23540cbe50 con 0x555d02a633d0 2024-05-08T06:04:26.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.627+0000 7f2345600700 1 -- 172.21.15.82:0/993124327 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f234c01a030 con 0x555d02a633d0 2024-05-08T06:04:26.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.627+0000 7f236caf1b80 10 client.26755 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:04:26.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.627+0000 7f236caf1b80 10 client.26755 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T06:04:26.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.627+0000 7f236caf1b80 20 client.26755 populate_metadata read hostname 'smithi082' 2024-05-08T06:04:26.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.627+0000 7f236caf1b80 1 --2- 172.21.15.82:0/993124327 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x555d02a7ed60 0x555d02a582e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:26.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.627+0000 7f236caf1b80 4 client.26755 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T06:04:26.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.627+0000 7f236caf1b80 1 -- 172.21.15.82:0/993124327 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555d029b5400 con 0x555d02a7ed60 2024-05-08T06:04:26.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.628+0000 7f235b400700 1 --2- 172.21.15.82:0/993124327 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x555d02a7ed60 0x555d02a582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:26.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.628+0000 7f235b400700 1 --2- 172.21.15.82:0/993124327 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x555d02a7ed60 0x555d02a582e0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbdc5b459069c07a server_cookie=74b293501d024512 in_seq=0 out_seq=0 2024-05-08T06:04:26.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.628+0000 7f2345600700 10 client.26755 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T06:04:26.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.629+0000 7f2345600700 1 -- 172.21.15.82:0/993124327 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555d029b5400 con 0x555d02a7ed60 2024-05-08T06:04:26.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.629+0000 7f2345600700 10 client.26755 handle_command_reply: tid=0 2024-05-08T06:04:26.631 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.629+0000 7f236caf1b80 1 client.26755 shutdown 2024-05-08T06:04:26.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.629+0000 7f236caf1b80 1 -- 172.21.15.82:0/993124327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555d02a633d0 msgr2=0x555d02a6fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:26.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.629+0000 7f236caf1b80 1 --2- 172.21.15.82:0/993124327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555d02a633d0 0x555d02a6fb40 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f235c19d3d0 tx=0x7f234c012ba0 comp rx=0 tx=0).stop 2024-05-08T06:04:26.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.630+0000 7f236caf1b80 1 -- 172.21.15.82:0/993124327 shutdown_connections 2024-05-08T06:04:26.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.630+0000 7f236caf1b80 1 --2- 172.21.15.82:0/993124327 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x555d02a7ed60 0x555d02a582e0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:26.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.630+0000 7f236caf1b80 1 --2- 172.21.15.82:0/993124327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555d02a63cf0 0x555d02a70080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:26.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.630+0000 7f236caf1b80 1 --2- 172.21.15.82:0/993124327 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x555d02a5e100 0x555d02a7f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:26.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.630+0000 7f236caf1b80 1 --2- 172.21.15.82:0/993124327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555d02a633d0 0x555d02a6fb40 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:26.632 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.630+0000 7f2345600700 0 client.26755 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T06:04:26.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.630+0000 7f236caf1b80 1 -- 172.21.15.82:0/993124327 >> 172.21.15.82:0/993124327 conn(0x555d029cd6d0 msgr2=0x555d02a655e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:04:26.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.630+0000 7f236caf1b80 1 -- 172.21.15.82:0/993124327 shutdown_connections 2024-05-08T06:04:26.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.630+0000 7f236caf1b80 1 -- 172.21.15.82:0/993124327 wait complete. 2024-05-08T06:04:26.633 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.630+0000 7f236caf1b80 20 client.26755 trim_cache size 0 max 16384 2024-05-08T06:04:26.633 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T06:04:26.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.632+0000 7f2362200700 1 -- 172.21.15.82:0/2436841286 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f23400b2980 msgr2=0x7f23400b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:26.634 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.632+0000 7f2362200700 1 --2- 172.21.15.82:0/2436841286 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f23400b2980 0x7f23400b4e40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2348009f60 tx=0x7f2348009b70 comp rx=0 tx=0).stop 2024-05-08T06:04:26.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.632+0000 7f2362200700 1 -- 172.21.15.82:0/2436841286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f235c1016c0 msgr2=0x7f235c1a1b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:26.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.632+0000 7f2362200700 1 --2- 172.21.15.82:0/2436841286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f235c1016c0 0x7f235c1a1b00 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2354000f80 tx=0x7f235400cd60 comp rx=0 tx=0).stop 2024-05-08T06:04:26.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.633+0000 7f2362200700 1 -- 172.21.15.82:0/2436841286 shutdown_connections 2024-05-08T06:04:26.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.633+0000 7f2362200700 1 --2- 172.21.15.82:0/2436841286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f235c1016c0 0x7f235c1a1b00 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:26.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.633+0000 7f2362200700 1 --2- 172.21.15.82:0/2436841286 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f23400b2980 0x7f23400b4e40 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:26.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.633+0000 7f2362200700 1 --2- 172.21.15.82:0/2436841286 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f235c1076c0 0x7f235c19c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:26.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.633+0000 7f2362200700 1 --2- 172.21.15.82:0/2436841286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f235c102080 0x7f235c1a2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:26.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.633+0000 7f2362200700 1 -- 172.21.15.82:0/2436841286 >> 172.21.15.82:0/2436841286 conn(0x7f235c0785a0 msgr2=0x7f235c103a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:04:26.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.633+0000 7f2362200700 1 -- 172.21.15.82:0/2436841286 shutdown_connections 2024-05-08T06:04:26.635 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:26.633+0000 7f2362200700 1 -- 172.21.15.82:0/2436841286 wait complete. 2024-05-08T06:04:27.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:04:27 smithi082 ceph-mon[30098]: pgmap v873: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.9 MiB/s wr, 732 op/s 2024-05-08T06:04:28.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:04:27 smithi151 ceph-mon[34815]: pgmap v873: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.9 MiB/s wr, 732 op/s 2024-05-08T06:04:28.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:04:27 smithi134 ceph-mon[34132]: pgmap v873: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.9 MiB/s wr, 732 op/s 2024-05-08T06:04:28.718 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-08T06:04:28.719 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-05-08T06:04:29.277 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:04:30.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:04:29 smithi151 ceph-mon[34815]: pgmap v874: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 6.4 MiB/s wr, 556 op/s 2024-05-08T06:04:30.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:04:29 smithi082 ceph-mon[30098]: pgmap v874: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 6.4 MiB/s wr, 556 op/s 2024-05-08T06:04:30.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:04:29 smithi134 ceph-mon[34132]: pgmap v874: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.8 KiB/s rd, 6.4 MiB/s wr, 556 op/s 2024-05-08T06:04:30.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 820.0 s, 1489.6 tps, lat 66.616 ms stddev 75.969 2024-05-08T06:04:31.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.709+0000 7fb0b3c00700 1 -- 172.21.15.82:0/2704890772 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0ac10adc0 msgr2=0x7fb0ac1160b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:31.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.709+0000 7fb0b3c00700 1 --2- 172.21.15.82:0/2704890772 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0ac10adc0 0x7fb0ac1160b0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb09c009920 tx=0x7fb09c009c30 comp rx=0 tx=0).stop 2024-05-08T06:04:31.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.710+0000 7fb0b3c00700 1 -- 172.21.15.82:0/2704890772 shutdown_connections 2024-05-08T06:04:31.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.710+0000 7fb0b3c00700 1 --2- 172.21.15.82:0/2704890772 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0ac1165f0 0x7fb0ac1189e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:31.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.710+0000 7fb0b3c00700 1 --2- 172.21.15.82:0/2704890772 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0ac10a4a0 0x7fb0ac10a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:31.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.710+0000 7fb0b3c00700 1 --2- 172.21.15.82:0/2704890772 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0ac10adc0 0x7fb0ac1160b0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:31.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.710+0000 7fb0b3c00700 1 -- 172.21.15.82:0/2704890772 >> 172.21.15.82:0/2704890772 conn(0x7fb0ac06e9f0 msgr2=0x7fb0ac06ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:04:31.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.710+0000 7fb0b3c00700 1 -- 172.21.15.82:0/2704890772 shutdown_connections 2024-05-08T06:04:31.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.710+0000 7fb0b3c00700 1 -- 172.21.15.82:0/2704890772 wait complete. 2024-05-08T06:04:31.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.711+0000 7fb0b3c00700 1 Processor -- start 2024-05-08T06:04:31.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.712+0000 7fb0b3c00700 1 -- start start 2024-05-08T06:04:31.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.712+0000 7fb0b3c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0ac10a4a0 0x7fb0ac1ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:31.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.712+0000 7fb0b3c00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0ac10adc0 0x7fb0ac1aebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:31.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.712+0000 7fb0b3c00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0ac1165f0 0x7fb0ac115330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:31.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.713+0000 7fb0abe00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0ac10adc0 0x7fb0ac1aebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:31.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.713+0000 7fb0abe00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0ac10adc0 0x7fb0ac1aebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:37334/0 (socket says 172.21.15.82:37334) 2024-05-08T06:04:31.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.713+0000 7fb0b3c00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb0ac11bea0 con 0x7fb0ac10a4a0 2024-05-08T06:04:31.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.714+0000 7fb0b3c00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb0ac11bd20 con 0x7fb0ac10adc0 2024-05-08T06:04:31.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.714+0000 7fb0b3c00700 1 -- 172.21.15.82:0/3700928103 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb0ac11c020 con 0x7fb0ac1165f0 2024-05-08T06:04:31.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.714+0000 7fb0abe00700 1 -- 172.21.15.82:0/3700928103 learned_addr learned my addr 172.21.15.82:0/3700928103 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:04:31.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.714+0000 7fb0b1c00700 1 --2- 172.21.15.82:0/3700928103 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0ac1165f0 0x7fb0ac115330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:31.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.714+0000 7fb0b1c00700 1 -- 172.21.15.82:0/3700928103 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0ac10adc0 msgr2=0x7fb0ac1aebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:31.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.714+0000 7fb0b1c00700 1 --2- 172.21.15.82:0/3700928103 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0ac10adc0 0x7fb0ac1aebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:31.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.714+0000 7fb0b1c00700 1 -- 172.21.15.82:0/3700928103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0ac10a4a0 msgr2=0x7fb0ac1ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:31.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.714+0000 7fb0b1c00700 1 --2- 172.21.15.82:0/3700928103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0ac10a4a0 0x7fb0ac1ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:31.715 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.714+0000 7fb0b1c00700 1 -- 172.21.15.82:0/3700928103 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0ac115a90 con 0x7fb0ac1165f0 2024-05-08T06:04:31.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.714+0000 7fb0abe00700 1 --2- 172.21.15.82:0/3700928103 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0ac10adc0 0x7fb0ac1aebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:04:31.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.715+0000 7fb0b1c00700 1 --2- 172.21.15.82:0/3700928103 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0ac1165f0 0x7fb0ac115330 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb09800e940 tx=0x7fb09800ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:04:31.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.715+0000 7fb0a9600700 1 -- 172.21.15.82:0/3700928103 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb098004220 con 0x7fb0ac1165f0 2024-05-08T06:04:31.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.715+0000 7fb0b3c00700 1 -- 172.21.15.82:0/3700928103 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0ac115d80 con 0x7fb0ac1165f0 2024-05-08T06:04:31.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.715+0000 7fb0b3c00700 1 -- 172.21.15.82:0/3700928103 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0ac1b5580 con 0x7fb0ac1165f0 2024-05-08T06:04:31.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.715+0000 7fb0a9600700 1 -- 172.21.15.82:0/3700928103 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb0980043c0 con 0x7fb0ac1165f0 2024-05-08T06:04:31.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.716+0000 7fb0a9600700 1 -- 172.21.15.82:0/3700928103 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb098005020 con 0x7fb0ac1165f0 2024-05-08T06:04:31.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.723+0000 7fb0be5c3b80 1 Processor -- start 2024-05-08T06:04:31.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.725+0000 7fb0a9600700 1 -- 172.21.15.82:0/3700928103 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fb0980051c0 con 0x7fb0ac1165f0 2024-05-08T06:04:31.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.726+0000 7fb0be5c3b80 1 -- start start 2024-05-08T06:04:31.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.726+0000 7fb0be5c3b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55accfc0fc40 0x55accfc10020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:31.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.726+0000 7fb0be5c3b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55accfc10560 0x55accfc0a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:31.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.727+0000 7fb0be5c3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55accfc0a970 0x55accfc0adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:31.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.727+0000 7fb0be5c3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55accfb5caa0 con 0x55accfc0a970 2024-05-08T06:04:31.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.727+0000 7fb0be5c3b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55accfafa7e0 con 0x55accfc0fc40 2024-05-08T06:04:31.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.727+0000 7fb0be5c3b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55accfb58a60 con 0x55accfc10560 2024-05-08T06:04:31.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.727+0000 7fb0b1200700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55accfc10560 0x55accfc0a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:31.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.727+0000 7fb0b1200700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55accfc10560 0x55accfc0a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:50176/0 (socket says 172.21.15.82:50176) 2024-05-08T06:04:31.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.727+0000 7fb0b1200700 1 -- 172.21.15.82:0/3776423685 learned_addr learned my addr 172.21.15.82:0/3776423685 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:04:31.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.728+0000 7fb0b1200700 1 -- 172.21.15.82:0/3776423685 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55accfc0fc40 msgr2=0x55accfc10020 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T06:04:31.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.728+0000 7fb0b1200700 1 --2- 172.21.15.82:0/3776423685 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55accfc0fc40 0x55accfc10020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:31.729 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.728+0000 7fb0b1200700 1 -- 172.21.15.82:0/3776423685 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55accfc0a970 msgr2=0x55accfc0adf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T06:04:31.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.729+0000 7fb0abe00700 1 --2- 172.21.15.82:0/3776423685 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55accfc0a970 0x55accfc0adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:31.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.730+0000 7fb0b1200700 1 --2- 172.21.15.82:0/3776423685 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55accfc0a970 0x55accfc0adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:31.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.730+0000 7fb0b1200700 1 -- 172.21.15.82:0/3776423685 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55accfaa9950 con 0x55accfc10560 2024-05-08T06:04:31.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.731+0000 7fb0abe00700 1 --2- 172.21.15.82:0/3776423685 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55accfc0a970 0x55accfc0adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:04:31.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.731+0000 7fb0b1200700 1 --2- 172.21.15.82:0/3776423685 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55accfc10560 0x55accfc0a350 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb0a400e490 tx=0x7fb0a400e7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68a848a45dd3640 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:04:31.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.732+0000 7fb0a2000700 1 -- 172.21.15.82:0/3776423685 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a40090d0 con 0x55accfc10560 2024-05-08T06:04:31.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.732+0000 7fb0a2000700 1 -- 172.21.15.82:0/3776423685 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb0a4009270 con 0x55accfc10560 2024-05-08T06:04:31.734 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.732+0000 7fb0a2000700 1 -- 172.21.15.82:0/3776423685 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a40075c0 con 0x55accfc10560 2024-05-08T06:04:31.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.734+0000 7fb0be5c3b80 1 -- 172.21.15.82:0/3776423685 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55accfc10560 msgr2=0x55accfc0a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:31.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.734+0000 7fb0be5c3b80 1 --2- 172.21.15.82:0/3776423685 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55accfc10560 0x55accfc0a350 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fb0a400e490 tx=0x7fb0a400e7a0 comp rx=0 tx=0).stop 2024-05-08T06:04:31.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.735+0000 7fb0be5c3b80 1 -- 172.21.15.82:0/3776423685 shutdown_connections 2024-05-08T06:04:31.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.735+0000 7fb0be5c3b80 1 --2- 172.21.15.82:0/3776423685 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55accfc0fc40 0x55accfc10020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:31.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.735+0000 7fb0be5c3b80 1 --2- 172.21.15.82:0/3776423685 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55accfc0a970 0x55accfc0adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:31.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.735+0000 7fb0be5c3b80 1 --2- 172.21.15.82:0/3776423685 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55accfc10560 0x55accfc0a350 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:31.737 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.735+0000 7fb0be5c3b80 1 -- 172.21.15.82:0/3776423685 >> 172.21.15.82:0/3776423685 conn(0x55accfb82750 msgr2=0x55accfc04b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:04:31.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.736+0000 7fb0be5c3b80 1 -- 172.21.15.82:0/3776423685 shutdown_connections 2024-05-08T06:04:31.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.736+0000 7fb0be5c3b80 1 -- 172.21.15.82:0/3776423685 wait complete. 2024-05-08T06:04:31.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.736+0000 7fb0be5c3b80 1 -- start start 2024-05-08T06:04:31.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.737+0000 7fb0be5c3b80 1 Processor -- start 2024-05-08T06:04:31.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.737+0000 7fb0be5c3b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55accfc0a970 0x55accfc162a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:31.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.737+0000 7fb0be5c3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55accfc0fc40 0x55accfc13640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:31.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.737+0000 7fb0be5c3b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55accfc10560 0x55accfc13b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:31.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.737+0000 7fb0be5c3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55accfc16f40 con 0x55accfc0fc40 2024-05-08T06:04:31.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.737+0000 7fb0be5c3b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55accfac2ba0 con 0x55accfc10560 2024-05-08T06:04:31.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.737+0000 7fb0be5c3b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55accfc170c0 con 0x55accfc0a970 2024-05-08T06:04:31.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.739+0000 7fb0abe00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55accfc0a970 0x55accfc162a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:31.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.739+0000 7fb0a9600700 1 --2- 172.21.15.82:0/3700928103 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb0900b2810 0x7fb0900b4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:31.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.739+0000 7fb0abe00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55accfc0a970 0x55accfc162a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:50180/0 (socket says 172.21.15.82:50180) 2024-05-08T06:04:31.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.739+0000 7fb0abe00700 1 -- 172.21.15.82:0/2013740794 learned_addr learned my addr 172.21.15.82:0/2013740794 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:04:31.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.739+0000 7fb0abe00700 1 --2- 172.21.15.82:0/2013740794 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55accfc10560 0x55accfc13b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:31.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.739+0000 7fb0a9600700 1 -- 172.21.15.82:0/3700928103 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb0980e1f90 con 0x7fb0ac1165f0 2024-05-08T06:04:31.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.740+0000 7fb0b1200700 1 --2- 172.21.15.82:0/2013740794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55accfc0fc40 0x55accfc13640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:31.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.740+0000 7fb0abe00700 1 -- 172.21.15.82:0/2013740794 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55accfc10560 msgr2=0x55accfc13b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:04:31.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.740+0000 7fb0abe00700 1 --2- 172.21.15.82:0/2013740794 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55accfc10560 0x55accfc13b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:31.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.740+0000 7fb0abe00700 1 -- 172.21.15.82:0/2013740794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55accfc0fc40 msgr2=0x55accfc13640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:04:31.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.740+0000 7fb0abe00700 1 --2- 172.21.15.82:0/2013740794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55accfc0fc40 0x55accfc13640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:31.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.740+0000 7fb0abe00700 1 -- 172.21.15.82:0/2013740794 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55accfb224a0 con 0x55accfc0a970 2024-05-08T06:04:31.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.740+0000 7fb0b1200700 1 --2- 172.21.15.82:0/2013740794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55accfc0fc40 0x55accfc13640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:04:31.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.741+0000 7fb0abe00700 1 --2- 172.21.15.82:0/2013740794 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55accfc0a970 0x55accfc162a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fb09c009560 tx=0x7fb09c00bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce6f1aa106c179c7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:04:31.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.741+0000 7fb096a00700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T06:04:31.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.742+0000 7fb096a00700 1 -- 172.21.15.82:0/2013740794 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb09c0052d0 con 0x55accfc0a970 2024-05-08T06:04:31.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.742+0000 7fb0be5c3b80 10 client.0 _ll_register_callbacks cb 0x55accfb03cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:04:31.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.742+0000 7fb096a00700 1 -- 172.21.15.82:0/2013740794 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb09c020050 con 0x55accfc0a970 2024-05-08T06:04:31.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.742+0000 7fb0be5c3b80 1 -- 172.21.15.82:0/2013740794 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0a4009270 con 0x55accfc0a970 2024-05-08T06:04:31.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.742+0000 7fb0b1c00700 1 --2- 172.21.15.82:0/3700928103 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb0900b2810 0x7fb0900b4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:31.743 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.743+0000 7fb096a00700 1 -- 172.21.15.82:0/2013740794 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fb09c005470 con 0x55accfc0a970 2024-05-08T06:04:31.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.743+0000 7fb0be5c3b80 10 client.26767 fetch_fsmap learned FSMap version 31 2024-05-08T06:04:31.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.743+0000 7fb0b1c00700 1 --2- 172.21.15.82:0/3700928103 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb0900b2810 0x7fb0900b4cd0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb098009230 tx=0x7fb09800cf30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:04:31.744 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.743+0000 7fb0be5c3b80 1 -- 172.21.15.82:0/2013740794 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({fsmap=31}) -- 0x55accfc216d0 con 0x55accfc0a970 2024-05-08T06:04:31.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.744+0000 7fb096a00700 1 -- 172.21.15.82:0/2013740794 <== mon.1 v2:172.21.15.151:3300/0 4 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fb09c003680 con 0x55accfc0a970 2024-05-08T06:04:31.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.744+0000 7fb0be5c3b80 10 client.26767 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:04:31.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.744+0000 7fb0be5c3b80 10 client.26767 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T06:04:31.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.744+0000 7fb0be5c3b80 20 client.26767 populate_metadata read hostname 'smithi082' 2024-05-08T06:04:31.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.744+0000 7fb0be5c3b80 1 --2- 172.21.15.82:0/2013740794 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55accfc23ba0 0x55accfc25ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:31.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.744+0000 7fb0be5c3b80 4 client.26767 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:04:31.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.744+0000 7fb0be5c3b80 1 -- 172.21.15.82:0/2013740794 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55accfbd71c0 con 0x55accfc23ba0 2024-05-08T06:04:31.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.745+0000 7fb0b1200700 1 --2- 172.21.15.82:0/2013740794 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55accfc23ba0 0x55accfc25ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:31.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.745+0000 7fb0b1200700 1 --2- 172.21.15.82:0/2013740794 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55accfc23ba0 0x55accfc25ff0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c314f09f9b328533 server_cookie=fe813249ae183e96 in_seq=0 out_seq=0 2024-05-08T06:04:31.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.745+0000 7fb096a00700 10 client.26767 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T06:04:31.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.746+0000 7fb096a00700 1 -- 172.21.15.82:0/2013740794 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55accfbd71c0 con 0x55accfc23ba0 2024-05-08T06:04:31.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.746+0000 7fb096a00700 10 client.26767 handle_command_reply: tid=0 2024-05-08T06:04:31.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.747+0000 7fb0be5c3b80 1 client.26767 shutdown 2024-05-08T06:04:31.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.747+0000 7fb0be5c3b80 1 -- 172.21.15.82:0/2013740794 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55accfc0a970 msgr2=0x55accfc162a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:31.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.747+0000 7fb0be5c3b80 1 --2- 172.21.15.82:0/2013740794 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55accfc0a970 0x55accfc162a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fb09c009560 tx=0x7fb09c00bf60 comp rx=0 tx=0).stop 2024-05-08T06:04:31.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.747+0000 7fb0be5c3b80 1 -- 172.21.15.82:0/2013740794 shutdown_connections 2024-05-08T06:04:31.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.747+0000 7fb0be5c3b80 1 --2- 172.21.15.82:0/2013740794 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55accfc23ba0 0x55accfc25ff0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:31.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.747+0000 7fb0be5c3b80 1 --2- 172.21.15.82:0/2013740794 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55accfc10560 0x55accfc13b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:31.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.747+0000 7fb0be5c3b80 1 --2- 172.21.15.82:0/2013740794 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55accfc0a970 0x55accfc162a0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:31.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.747+0000 7fb0be5c3b80 1 --2- 172.21.15.82:0/2013740794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55accfc0fc40 0x55accfc13640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:31.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.747+0000 7fb0be5c3b80 1 -- 172.21.15.82:0/2013740794 >> 172.21.15.82:0/2013740794 conn(0x55accfb82750 msgr2=0x55accfc04210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:04:31.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.747+0000 7fb096a00700 0 client.26767 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T06:04:31.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.748+0000 7fb0be5c3b80 1 -- 172.21.15.82:0/2013740794 shutdown_connections 2024-05-08T06:04:31.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.748+0000 7fb0be5c3b80 1 -- 172.21.15.82:0/2013740794 wait complete. 2024-05-08T06:04:31.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.748+0000 7fb0be5c3b80 20 client.26767 trim_cache size 0 max 16384 2024-05-08T06:04:31.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.788+0000 7fb0be5c3b80 1 Processor -- start 2024-05-08T06:04:31.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.788+0000 7fb0be5c3b80 1 -- start start 2024-05-08T06:04:31.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.789+0000 7fb0be5c3b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55accfc0a970 0x55accfc0a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:31.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.789+0000 7fb0be5c3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55accfc0fc40 0x55accfc04990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:31.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.789+0000 7fb0be5c3b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55accfc10560 0x55accfc2b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:31.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.789+0000 7fb0be5c3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb08c00d2a0 con 0x55accfc0fc40 2024-05-08T06:04:31.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.789+0000 7fb0be5c3b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb08c00ede0 con 0x55accfc10560 2024-05-08T06:04:31.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.789+0000 7fb0be5c3b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb08c00d970 con 0x55accfc0a970 2024-05-08T06:04:31.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.789+0000 7fb0abe00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55accfc0a970 0x55accfc0a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:31.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.789+0000 7fb0abe00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55accfc0a970 0x55accfc0a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:50182/0 (socket says 172.21.15.82:50182) 2024-05-08T06:04:31.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.789+0000 7fb0abe00700 1 -- 172.21.15.82:0/1909494196 learned_addr learned my addr 172.21.15.82:0/1909494196 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:04:31.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.789+0000 7fb0abe00700 1 --2- 172.21.15.82:0/1909494196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55accfc10560 0x55accfc2b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:31.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.789+0000 7fb0b1200700 1 --2- 172.21.15.82:0/1909494196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55accfc0fc40 0x55accfc04990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:31.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.789+0000 7fb0abe00700 1 -- 172.21.15.82:0/1909494196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55accfc10560 msgr2=0x55accfc2b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:04:31.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.789+0000 7fb0abe00700 1 --2- 172.21.15.82:0/1909494196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55accfc10560 0x55accfc2b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:31.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.789+0000 7fb0abe00700 1 -- 172.21.15.82:0/1909494196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55accfc0fc40 msgr2=0x55accfc04990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:04:31.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.790+0000 7fb0abe00700 1 --2- 172.21.15.82:0/1909494196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55accfc0fc40 0x55accfc04990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:31.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.790+0000 7fb0abe00700 1 -- 172.21.15.82:0/1909494196 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55accfbffb30 con 0x55accfc0a970 2024-05-08T06:04:31.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.790+0000 7fb0abe00700 1 --2- 172.21.15.82:0/1909494196 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55accfc0a970 0x55accfc0a350 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fb09c001eb0 tx=0x7fb09c023000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88c54c7b7f2da609 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:04:31.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.790+0000 7fb0a1600700 1 -- 172.21.15.82:0/1909494196 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb09c005610 con 0x55accfc0a970 2024-05-08T06:04:31.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.790+0000 7fb0a1600700 1 -- 172.21.15.82:0/1909494196 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb0a4009270 con 0x55accfc0a970 2024-05-08T06:04:31.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.790+0000 7fb0a1600700 1 -- 172.21.15.82:0/1909494196 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb09c00bc10 con 0x55accfc0a970 2024-05-08T06:04:31.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.791+0000 7fb0be5c3b80 1 -- 172.21.15.82:0/1909494196 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55accfc0a970 msgr2=0x55accfc0a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:31.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.791+0000 7fb0be5c3b80 1 --2- 172.21.15.82:0/1909494196 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55accfc0a970 0x55accfc0a350 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fb09c001eb0 tx=0x7fb09c023000 comp rx=0 tx=0).stop 2024-05-08T06:04:31.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.791+0000 7fb0be5c3b80 1 -- 172.21.15.82:0/1909494196 shutdown_connections 2024-05-08T06:04:31.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.791+0000 7fb0be5c3b80 1 --2- 172.21.15.82:0/1909494196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55accfc10560 0x55accfc2b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:31.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.791+0000 7fb0be5c3b80 1 --2- 172.21.15.82:0/1909494196 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55accfc0a970 0x55accfc0a350 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:31.792 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.791+0000 7fb0be5c3b80 1 --2- 172.21.15.82:0/1909494196 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55accfc0fc40 0x55accfc04990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:31.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.791+0000 7fb0be5c3b80 1 -- 172.21.15.82:0/1909494196 >> 172.21.15.82:0/1909494196 conn(0x55accfb82750 msgr2=0x55accfc154d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:04:31.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.791+0000 7fb0be5c3b80 1 -- 172.21.15.82:0/1909494196 shutdown_connections 2024-05-08T06:04:31.793 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.791+0000 7fb0be5c3b80 1 -- 172.21.15.82:0/1909494196 wait complete. 2024-05-08T06:04:31.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.792+0000 7fb0be5c3b80 1 -- start start 2024-05-08T06:04:31.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.792+0000 7fb0be5c3b80 1 Processor -- start 2024-05-08T06:04:31.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.792+0000 7fb0be5c3b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55accfc0a970 0x55accfc1c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:31.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.792+0000 7fb0be5c3b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55accfc0fc40 0x55accfc1caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:31.794 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.792+0000 7fb0be5c3b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55accfc10560 0x55accfc1abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:31.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.792+0000 7fb0be5c3b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fb08c00e710 con 0x55accfc10560 2024-05-08T06:04:31.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.792+0000 7fb0be5c3b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb08c00e040 con 0x55accfc0fc40 2024-05-08T06:04:31.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.792+0000 7fb0be5c3b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb08c00b240 con 0x55accfc0a970 2024-05-08T06:04:31.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.792+0000 7fb0be5c3b80 10 client.0 _ll_register_callbacks cb 0x55accfb03cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:04:31.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.793+0000 7fb0b1200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55accfc0fc40 0x55accfc1caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:31.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.793+0000 7fb0b1200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55accfc0fc40 0x55accfc1caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:37368/0 (socket says 172.21.15.82:37368) 2024-05-08T06:04:31.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.793+0000 7fb0b1200700 1 -- 172.21.15.82:0/3574473641 learned_addr learned my addr 172.21.15.82:0/3574473641 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:04:31.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.793+0000 7fb0b1200700 1 -- 172.21.15.82:0/3574473641 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55accfc0a970 msgr2=0x55accfc1c5b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T06:04:31.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.793+0000 7fb0b1200700 1 --2- 172.21.15.82:0/3574473641 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55accfc0a970 0x55accfc1c5b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:31.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.793+0000 7fb0b1200700 1 -- 172.21.15.82:0/3574473641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55accfc10560 msgr2=0x55accfc1abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:04:31.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.793+0000 7fb0abe00700 1 --2- 172.21.15.82:0/3574473641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55accfc10560 0x55accfc1abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:31.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.793+0000 7fb0b1200700 1 --2- 172.21.15.82:0/3574473641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55accfc10560 0x55accfc1abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:31.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.793+0000 7fb0b1200700 1 -- 172.21.15.82:0/3574473641 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55accfc1b3f0 con 0x55accfc0fc40 2024-05-08T06:04:31.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.793+0000 7fb0abe00700 1 --2- 172.21.15.82:0/3574473641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55accfc10560 0x55accfc1abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:04:31.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.793+0000 7fb0b1200700 1 --2- 172.21.15.82:0/3574473641 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55accfc0fc40 0x55accfc1caf0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fb0a400eba0 tx=0x7fb0a4003a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a536202c743411e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:04:31.795 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.794+0000 7fb096a00700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T06:04:31.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.794+0000 7fb096a00700 1 -- 172.21.15.82:0/3574473641 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0a4003e30 con 0x55accfc0fc40 2024-05-08T06:04:31.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.794+0000 7fb096a00700 1 -- 172.21.15.82:0/3574473641 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fb0a40252a0 con 0x55accfc0fc40 2024-05-08T06:04:31.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.794+0000 7fb0be5c3b80 1 -- 172.21.15.82:0/3574473641 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0a4009270 con 0x55accfc0fc40 2024-05-08T06:04:31.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.795+0000 7fb096a00700 1 -- 172.21.15.82:0/3574473641 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fb0a40254a0 con 0x55accfc0fc40 2024-05-08T06:04:31.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.795+0000 7fb0be5c3b80 10 client.26738 fetch_fsmap learned FSMap version 31 2024-05-08T06:04:31.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.795+0000 7fb0be5c3b80 1 -- 172.21.15.82:0/3574473641 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55accfc8f1c0 con 0x55accfc0fc40 2024-05-08T06:04:31.796 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.796+0000 7fb096a00700 1 -- 172.21.15.82:0/3574473641 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fb0a4009270 con 0x55accfc0fc40 2024-05-08T06:04:31.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.796+0000 7fb096a00700 1 -- 172.21.15.82:0/3574473641 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fb0a4025ce0 con 0x55accfc0fc40 2024-05-08T06:04:31.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.797+0000 7fb0be5c3b80 10 client.26738 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:04:31.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.797+0000 7fb0be5c3b80 10 client.26738 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T06:04:31.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.797+0000 7fb0be5c3b80 20 client.26738 populate_metadata read hostname 'smithi082' 2024-05-08T06:04:31.797 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.797+0000 7fb0be5c3b80 1 --2- 172.21.15.82:0/3574473641 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55accfc8f660 0x55accfc91aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:31.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.797+0000 7fb0be5c3b80 4 client.26738 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-08T06:04:31.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.797+0000 7fb0be5c3b80 1 -- 172.21.15.82:0/3574473641 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55accfb6a480 con 0x55accfc8f660 2024-05-08T06:04:31.798 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.798+0000 7fb0abe00700 1 --2- 172.21.15.82:0/3574473641 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55accfc8f660 0x55accfc91aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:31.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.799+0000 7fb0abe00700 1 --2- 172.21.15.82:0/3574473641 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55accfc8f660 0x55accfc91aa0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4c467c3c1e317dd server_cookie=1073a982f12d5b65 in_seq=0 out_seq=0 2024-05-08T06:04:31.799 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.799+0000 7fb096a00700 10 client.26738 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T06:04:31.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.800+0000 7fb096a00700 1 -- 172.21.15.82:0/3574473641 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55accfb6a480 con 0x55accfc8f660 2024-05-08T06:04:31.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.800+0000 7fb096a00700 10 client.26738 handle_command_reply: tid=0 2024-05-08T06:04:31.800 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.800+0000 7fb0be5c3b80 1 client.26738 shutdown 2024-05-08T06:04:31.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.800+0000 7fb0be5c3b80 1 -- 172.21.15.82:0/3574473641 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55accfc0fc40 msgr2=0x55accfc1caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:31.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.800+0000 7fb0be5c3b80 1 --2- 172.21.15.82:0/3574473641 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55accfc0fc40 0x55accfc1caf0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fb0a400eba0 tx=0x7fb0a4003a00 comp rx=0 tx=0).stop 2024-05-08T06:04:31.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.800+0000 7fb0be5c3b80 1 -- 172.21.15.82:0/3574473641 shutdown_connections 2024-05-08T06:04:31.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.800+0000 7fb0be5c3b80 1 --2- 172.21.15.82:0/3574473641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55accfc10560 0x55accfc1abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:31.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.800+0000 7fb0be5c3b80 1 --2- 172.21.15.82:0/3574473641 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55accfc0a970 0x55accfc1c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:31.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.800+0000 7fb0be5c3b80 1 --2- 172.21.15.82:0/3574473641 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55accfc8f660 0x55accfc91aa0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:31.801 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.800+0000 7fb0be5c3b80 1 --2- 172.21.15.82:0/3574473641 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55accfc0fc40 0x55accfc1caf0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:31.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.801+0000 7fb0be5c3b80 1 -- 172.21.15.82:0/3574473641 >> 172.21.15.82:0/3574473641 conn(0x55accfb82750 msgr2=0x55accfc09340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:04:31.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.801+0000 7fb096a00700 0 client.26738 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T06:04:31.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.801+0000 7fb0be5c3b80 1 -- 172.21.15.82:0/3574473641 shutdown_connections 2024-05-08T06:04:31.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.801+0000 7fb0be5c3b80 1 -- 172.21.15.82:0/3574473641 wait complete. 2024-05-08T06:04:31.802 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.801+0000 7fb0be5c3b80 20 client.26738 trim_cache size 0 max 16384 2024-05-08T06:04:31.803 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T06:04:31.803 INFO:teuthology.orchestra.run.smithi082.stdout: "return_code": 0, 2024-05-08T06:04:31.803 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_tag": "bcbf852c-a2f3-4a77-949e-b190adcacf70", 2024-05-08T06:04:31.803 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": "asynchronous" 2024-05-08T06:04:31.803 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T06:04:31.803 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.803+0000 7fb0b3c00700 1 -- 172.21.15.82:0/3700928103 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb0900b2810 msgr2=0x7fb0900b4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:31.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.803+0000 7fb0b3c00700 1 --2- 172.21.15.82:0/3700928103 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb0900b2810 0x7fb0900b4cd0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb098009230 tx=0x7fb09800cf30 comp rx=0 tx=0).stop 2024-05-08T06:04:31.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.803+0000 7fb0b3c00700 1 -- 172.21.15.82:0/3700928103 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0ac1165f0 msgr2=0x7fb0ac115330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:31.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.803+0000 7fb0b3c00700 1 --2- 172.21.15.82:0/3700928103 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0ac1165f0 0x7fb0ac115330 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb09800e940 tx=0x7fb09800ec50 comp rx=0 tx=0).stop 2024-05-08T06:04:31.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.803+0000 7fb0b3c00700 1 -- 172.21.15.82:0/3700928103 shutdown_connections 2024-05-08T06:04:31.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.803+0000 7fb0b3c00700 1 --2- 172.21.15.82:0/3700928103 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fb0900b2810 0x7fb0900b4cd0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:31.804 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.803+0000 7fb0b3c00700 1 --2- 172.21.15.82:0/3700928103 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0ac1165f0 0x7fb0ac115330 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:31.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.803+0000 7fb0b3c00700 1 --2- 172.21.15.82:0/3700928103 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fb0ac10a4a0 0x7fb0ac1ae6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:31.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.803+0000 7fb0b3c00700 1 --2- 172.21.15.82:0/3700928103 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0ac10adc0 0x7fb0ac1aebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:31.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.803+0000 7fb0b3c00700 1 -- 172.21.15.82:0/3700928103 >> 172.21.15.82:0/3700928103 conn(0x7fb0ac06e9f0 msgr2=0x7fb0ac0722c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:04:31.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.804+0000 7fb0b3c00700 1 -- 172.21.15.82:0/3700928103 shutdown_connections 2024-05-08T06:04:31.805 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:31.804+0000 7fb0b3c00700 1 -- 172.21.15.82:0/3700928103 wait complete. 2024-05-08T06:04:31.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:04:31 smithi082 ceph-mon[30098]: pgmap v875: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.8 MiB/s wr, 603 op/s 2024-05-08T06:04:32.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:04:31 smithi151 ceph-mon[34815]: pgmap v875: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.8 MiB/s wr, 603 op/s 2024-05-08T06:04:32.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:04:31 smithi134 ceph-mon[34132]: pgmap v875: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.8 MiB/s wr, 603 op/s 2024-05-08T06:04:32.890 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-08T06:04:33.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:04:32 smithi151 ceph-mon[34815]: scrub queued for path: / 2024-05-08T06:04:33.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:04:32 smithi151 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-05-08T06:04:33.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:04:32 smithi151 ceph-mon[34815]: scrub summary: active paths [/] 2024-05-08T06:04:33.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:04:32 smithi151 ceph-mon[34815]: scrub summary: active paths [/] 2024-05-08T06:04:33.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:04:32 smithi151 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-05-08T06:04:33.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:04:32 smithi151 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-05-08T06:04:33.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:04:32 smithi082 ceph-mon[30098]: scrub queued for path: / 2024-05-08T06:04:33.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:04:32 smithi082 ceph-mon[30098]: scrub summary: idle+waiting paths [/] 2024-05-08T06:04:33.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:04:32 smithi082 ceph-mon[30098]: scrub summary: active paths [/] 2024-05-08T06:04:33.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:04:32 smithi082 ceph-mon[30098]: scrub summary: active paths [/] 2024-05-08T06:04:33.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:04:32 smithi082 ceph-mon[30098]: scrub summary: idle+waiting paths [/] 2024-05-08T06:04:33.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:04:32 smithi082 ceph-mon[30098]: scrub summary: idle+waiting paths [/] 2024-05-08T06:04:33.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:04:32 smithi134 ceph-mon[34132]: scrub queued for path: / 2024-05-08T06:04:33.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:04:32 smithi134 ceph-mon[34132]: scrub summary: idle+waiting paths [/] 2024-05-08T06:04:33.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:04:32 smithi134 ceph-mon[34132]: scrub summary: active paths [/] 2024-05-08T06:04:33.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:04:32 smithi134 ceph-mon[34132]: scrub summary: active paths [/] 2024-05-08T06:04:33.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:04:32 smithi134 ceph-mon[34132]: scrub summary: idle+waiting paths [/] 2024-05-08T06:04:33.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:04:32 smithi134 ceph-mon[34132]: scrub summary: idle+waiting paths [/] 2024-05-08T06:04:33.568 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:04:33.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:04:33 smithi082 ceph-mon[30098]: pgmap v876: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.9 MiB/s wr, 630 op/s 2024-05-08T06:04:34.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:04:33 smithi151 ceph-mon[34815]: pgmap v876: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.9 MiB/s wr, 630 op/s 2024-05-08T06:04:34.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:04:33 smithi134 ceph-mon[34132]: pgmap v876: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.9 MiB/s wr, 630 op/s 2024-05-08T06:04:35.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 825.0 s, 1377.0 tps, lat 73.015 ms stddev 82.642 2024-05-08T06:04:36.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.065+0000 7f2c37000700 1 -- 172.21.15.82:0/3565670181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c30103750 msgr2=0x7f2c30103b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:36.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.065+0000 7f2c37000700 1 --2- 172.21.15.82:0/3565670181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c30103750 0x7f2c30103b30 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2c20009990 tx=0x7f2c20009ca0 comp rx=0 tx=0).stop 2024-05-08T06:04:36.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.068+0000 7f2c37000700 1 -- 172.21.15.82:0/3565670181 shutdown_connections 2024-05-08T06:04:36.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.068+0000 7f2c37000700 1 --2- 172.21.15.82:0/3565670181 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c30108850 0x7f2c301103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:36.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.068+0000 7f2c37000700 1 --2- 172.21.15.82:0/3565670181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c30103750 0x7f2c30103b30 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:36.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.068+0000 7f2c37000700 1 --2- 172.21.15.82:0/3565670181 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c30104100 0x7f2c30108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:36.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.068+0000 7f2c37000700 1 -- 172.21.15.82:0/3565670181 >> 172.21.15.82:0/3565670181 conn(0x7f2c3007a600 msgr2=0x7f2c3007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:04:36.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.068+0000 7f2c37000700 1 -- 172.21.15.82:0/3565670181 shutdown_connections 2024-05-08T06:04:36.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.068+0000 7f2c37000700 1 -- 172.21.15.82:0/3565670181 wait complete. 2024-05-08T06:04:36.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.070+0000 7f2c37000700 1 Processor -- start 2024-05-08T06:04:36.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.070+0000 7f2c37000700 1 -- start start 2024-05-08T06:04:36.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.071+0000 7f2c37000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c30103750 0x7f2c30110340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:36.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.071+0000 7f2c37000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c30104100 0x7f2c3010d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:36.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.071+0000 7f2c37000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c30108850 0x7f2c3010db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:36.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.071+0000 7f2c37000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2c30077250 con 0x7f2c30104100 2024-05-08T06:04:36.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.071+0000 7f2c37000700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2c300770d0 con 0x7f2c30103750 2024-05-08T06:04:36.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.071+0000 7f2c37000700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2c300773d0 con 0x7f2c30108850 2024-05-08T06:04:36.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.071+0000 7f2c2fe00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c30103750 0x7f2c30110340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:36.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.071+0000 7f2c2fe00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c30103750 0x7f2c30110340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:37824/0 (socket says 172.21.15.82:37824) 2024-05-08T06:04:36.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.071+0000 7f2c2fe00700 1 -- 172.21.15.82:0/4103594010 learned_addr learned my addr 172.21.15.82:0/4103594010 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:04:36.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.071+0000 7f2c2f400700 1 --2- 172.21.15.82:0/4103594010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c30104100 0x7f2c3010d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:36.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.072+0000 7f2c35000700 1 --2- 172.21.15.82:0/4103594010 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c30108850 0x7f2c3010db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:36.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.072+0000 7f2c2fe00700 1 -- 172.21.15.82:0/4103594010 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c30108850 msgr2=0x7f2c3010db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:36.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.072+0000 7f2c2fe00700 1 --2- 172.21.15.82:0/4103594010 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c30108850 0x7f2c3010db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:36.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.072+0000 7f2c2fe00700 1 -- 172.21.15.82:0/4103594010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c30104100 msgr2=0x7f2c3010d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:36.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.072+0000 7f2c2fe00700 1 --2- 172.21.15.82:0/4103594010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c30104100 0x7f2c3010d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:36.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.072+0000 7f2c2fe00700 1 -- 172.21.15.82:0/4103594010 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c301ac4a0 con 0x7f2c30103750 2024-05-08T06:04:36.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.073+0000 7f2c2fe00700 1 --2- 172.21.15.82:0/4103594010 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c30103750 0x7f2c30110340 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f2c20005910 tx=0x7f2c2000bfc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:04:36.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.073+0000 7f2c2cc00700 1 -- 172.21.15.82:0/4103594010 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c20027070 con 0x7f2c30103750 2024-05-08T06:04:36.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.073+0000 7f2c2cc00700 1 -- 172.21.15.82:0/4103594010 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c2000b610 con 0x7f2c30103750 2024-05-08T06:04:36.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.073+0000 7f2c37000700 1 -- 172.21.15.82:0/4103594010 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c301ac670 con 0x7f2c30103750 2024-05-08T06:04:36.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.073+0000 7f2c37000700 1 -- 172.21.15.82:0/4103594010 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c301acb70 con 0x7f2c30103750 2024-05-08T06:04:36.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.073+0000 7f2c2cc00700 1 -- 172.21.15.82:0/4103594010 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c200173f0 con 0x7f2c30103750 2024-05-08T06:04:36.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.079+0000 7f2c41955b80 1 Processor -- start 2024-05-08T06:04:36.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.079+0000 7f2c41955b80 1 -- start start 2024-05-08T06:04:36.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.079+0000 7f2c2cc00700 1 -- 172.21.15.82:0/4103594010 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f2c2002a070 con 0x7f2c30103750 2024-05-08T06:04:36.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.080+0000 7f2c41955b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559169685060 0x559169685440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:36.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.080+0000 7f2c41955b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559169685980 0x559169689490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:36.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.080+0000 7f2c41955b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5591696899d0 0x559169689e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:36.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.080+0000 7f2c41955b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5591695d7a20 con 0x559169685060 2024-05-08T06:04:36.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.080+0000 7f2c41955b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x559169575760 con 0x5591696899d0 2024-05-08T06:04:36.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.080+0000 7f2c41955b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5591695d39e0 con 0x559169685980 2024-05-08T06:04:36.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.080+0000 7f2c2f400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5591696899d0 0x559169689e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:36.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.080+0000 7f2c2f400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5591696899d0 0x559169689e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:37838/0 (socket says 172.21.15.82:37838) 2024-05-08T06:04:36.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.080+0000 7f2c35000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559169685060 0x559169685440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:36.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.080+0000 7f2c2f400700 1 -- 172.21.15.82:0/2456063624 learned_addr learned my addr 172.21.15.82:0/2456063624 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:04:36.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.081+0000 7f2c2f400700 1 -- 172.21.15.82:0/2456063624 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559169685980 msgr2=0x559169689490 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T06:04:36.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.081+0000 7f2c2f400700 1 --2- 172.21.15.82:0/2456063624 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559169685980 0x559169689490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:36.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.081+0000 7f2c2f400700 1 -- 172.21.15.82:0/2456063624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559169685060 msgr2=0x559169685440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:04:36.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.081+0000 7f2c2f400700 1 --2- 172.21.15.82:0/2456063624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559169685060 0x559169685440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:36.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.081+0000 7f2c2f400700 1 -- 172.21.15.82:0/2456063624 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591695248d0 con 0x5591696899d0 2024-05-08T06:04:36.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.081+0000 7f2c35000700 1 --2- 172.21.15.82:0/2456063624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559169685060 0x559169685440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:04:36.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.081+0000 7f2c2f400700 1 --2- 172.21.15.82:0/2456063624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5591696899d0 0x559169689e30 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c009cf0 tx=0x7f2c1c011440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d568ac95c09610c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:04:36.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.081+0000 7f2c25600700 1 -- 172.21.15.82:0/2456063624 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c011d80 con 0x5591696899d0 2024-05-08T06:04:36.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.082+0000 7f2c25600700 1 -- 172.21.15.82:0/2456063624 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c1c004500 con 0x5591696899d0 2024-05-08T06:04:36.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.082+0000 7f2c25600700 1 -- 172.21.15.82:0/2456063624 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c005310 con 0x5591696899d0 2024-05-08T06:04:36.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.082+0000 7f2c2cc00700 1 --2- 172.21.15.82:0/4103594010 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2c140b2980 0x7f2c140b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:36.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.082+0000 7f2c2cc00700 1 -- 172.21.15.82:0/4103594010 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2c200e2f80 con 0x7f2c30103750 2024-05-08T06:04:36.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.082+0000 7f2c35000700 1 --2- 172.21.15.82:0/4103594010 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2c140b2980 0x7f2c140b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:36.086 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.086+0000 7f2c35000700 1 --2- 172.21.15.82:0/4103594010 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2c140b2980 0x7f2c140b4e40 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2c280075c0 tx=0x7f2c2800b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:04:36.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.086+0000 7f2c41955b80 1 -- 172.21.15.82:0/2456063624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5591696899d0 msgr2=0x559169689e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:36.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.086+0000 7f2c41955b80 1 --2- 172.21.15.82:0/2456063624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5591696899d0 0x559169689e30 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c009cf0 tx=0x7f2c1c011440 comp rx=0 tx=0).stop 2024-05-08T06:04:36.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.086+0000 7f2c41955b80 1 -- 172.21.15.82:0/2456063624 shutdown_connections 2024-05-08T06:04:36.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.086+0000 7f2c41955b80 1 --2- 172.21.15.82:0/2456063624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5591696899d0 0x559169689e30 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:36.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.086+0000 7f2c41955b80 1 --2- 172.21.15.82:0/2456063624 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559169685060 0x559169685440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:36.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.086+0000 7f2c41955b80 1 --2- 172.21.15.82:0/2456063624 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559169685980 0x559169689490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:36.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.086+0000 7f2c41955b80 1 -- 172.21.15.82:0/2456063624 >> 172.21.15.82:0/2456063624 conn(0x5591695b3b60 msgr2=0x55916967f7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:04:36.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.086+0000 7f2c41955b80 1 -- 172.21.15.82:0/2456063624 shutdown_connections 2024-05-08T06:04:36.087 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.086+0000 7f2c41955b80 1 -- 172.21.15.82:0/2456063624 wait complete. 2024-05-08T06:04:36.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.087+0000 7f2c41955b80 1 -- start start 2024-05-08T06:04:36.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.087+0000 7f2c41955b80 1 Processor -- start 2024-05-08T06:04:36.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.088+0000 7f2c41955b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559169685060 0x559169690e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:36.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.088+0000 7f2c41955b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559169685980 0x55916968e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:36.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.088+0000 7f2c41955b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5591696899d0 0x55916968e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:36.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.088+0000 7f2c41955b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x559169691be0 con 0x559169685060 2024-05-08T06:04:36.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.088+0000 7f2c41955b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55916953db20 con 0x559169685980 2024-05-08T06:04:36.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.088+0000 7f2c41955b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x559169691d60 con 0x5591696899d0 2024-05-08T06:04:36.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.088+0000 7f2c41955b80 10 client.0 _ll_register_callbacks cb 0x55916957ec70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:04:36.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.088+0000 7f2c2f400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559169685980 0x55916968e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:36.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.089+0000 7f2c2f400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559169685980 0x55916968e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:37854/0 (socket says 172.21.15.82:37854) 2024-05-08T06:04:36.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.089+0000 7f2c2f400700 1 -- 172.21.15.82:0/1309838562 learned_addr learned my addr 172.21.15.82:0/1309838562 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:04:36.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.089+0000 7f2c35000700 1 --2- 172.21.15.82:0/1309838562 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5591696899d0 0x55916968e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:36.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.089+0000 7f2c2fe00700 1 --2- 172.21.15.82:0/1309838562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559169685060 0x559169690e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:36.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.090+0000 7f2c35000700 1 -- 172.21.15.82:0/1309838562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559169685980 msgr2=0x55916968e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:04:36.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.090+0000 7f2c35000700 1 --2- 172.21.15.82:0/1309838562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559169685980 0x55916968e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:36.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.090+0000 7f2c35000700 1 -- 172.21.15.82:0/1309838562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559169685060 msgr2=0x559169690e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:04:36.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.090+0000 7f2c35000700 1 --2- 172.21.15.82:0/1309838562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559169685060 0x559169690e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:36.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.090+0000 7f2c35000700 1 -- 172.21.15.82:0/1309838562 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55916959d420 con 0x5591696899d0 2024-05-08T06:04:36.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.090+0000 7f2c35000700 1 --2- 172.21.15.82:0/1309838562 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5591696899d0 0x55916968e730 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2c280045b0 tx=0x7f2c28004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c520c1a4be97e46 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:04:36.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.091+0000 7f2c1a000700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T06:04:36.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.091+0000 7f2c1a000700 1 -- 172.21.15.82:0/1309838562 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c28016ca0 con 0x5591696899d0 2024-05-08T06:04:36.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.091+0000 7f2c1a000700 1 -- 172.21.15.82:0/1309838562 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2c28023450 con 0x5591696899d0 2024-05-08T06:04:36.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.091+0000 7f2c41955b80 1 -- 172.21.15.82:0/1309838562 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c1c004500 con 0x5591696899d0 2024-05-08T06:04:36.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.092+0000 7f2c1a000700 1 -- 172.21.15.82:0/1309838562 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f2c28003e50 con 0x5591696899d0 2024-05-08T06:04:36.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.092+0000 7f2c41955b80 10 client.26779 fetch_fsmap learned FSMap version 31 2024-05-08T06:04:36.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.092+0000 7f2c41955b80 1 -- 172.21.15.82:0/1309838562 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5591696ad560 con 0x5591696899d0 2024-05-08T06:04:36.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.092+0000 7f2c1a000700 1 -- 172.21.15.82:0/1309838562 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c1c004500 con 0x5591696899d0 2024-05-08T06:04:36.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.092+0000 7f2c1a000700 1 -- 172.21.15.82:0/1309838562 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f2c2802f480 con 0x5591696899d0 2024-05-08T06:04:36.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.092+0000 7f2c41955b80 10 client.26779 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:04:36.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.092+0000 7f2c41955b80 10 client.26779 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T06:04:36.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.092+0000 7f2c41955b80 20 client.26779 populate_metadata read hostname 'smithi082' 2024-05-08T06:04:36.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.093+0000 7f2c41955b80 1 --2- 172.21.15.82:0/1309838562 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5591696afba0 0x5591696b1f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:36.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.093+0000 7f2c41955b80 4 client.26779 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:04:36.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.093+0000 7f2c41955b80 1 -- 172.21.15.82:0/1309838562 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5591696520a0 con 0x5591696afba0 2024-05-08T06:04:36.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.093+0000 7f2c2fe00700 1 --2- 172.21.15.82:0/1309838562 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5591696afba0 0x5591696b1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:36.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.094+0000 7f2c1a000700 10 client.26779 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T06:04:36.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.095+0000 7f2c2fe00700 1 --2- 172.21.15.82:0/1309838562 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5591696afba0 0x5591696b1f90 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27032320e1e27435 server_cookie=b15de528516aba55 in_seq=0 out_seq=0 2024-05-08T06:04:36.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.095+0000 7f2c1a000700 1 -- 172.21.15.82:0/1309838562 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5591696520a0 con 0x5591696afba0 2024-05-08T06:04:36.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.095+0000 7f2c1a000700 10 client.26779 handle_command_reply: tid=0 2024-05-08T06:04:36.096 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.095+0000 7f2c41955b80 1 client.26779 shutdown 2024-05-08T06:04:36.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.096+0000 7f2c41955b80 1 -- 172.21.15.82:0/1309838562 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5591696899d0 msgr2=0x55916968e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:36.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.096+0000 7f2c41955b80 1 --2- 172.21.15.82:0/1309838562 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5591696899d0 0x55916968e730 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f2c280045b0 tx=0x7f2c28004b40 comp rx=0 tx=0).stop 2024-05-08T06:04:36.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.096+0000 7f2c41955b80 1 -- 172.21.15.82:0/1309838562 shutdown_connections 2024-05-08T06:04:36.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.096+0000 7f2c41955b80 1 --2- 172.21.15.82:0/1309838562 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5591696899d0 0x55916968e730 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:36.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.096+0000 7f2c41955b80 1 --2- 172.21.15.82:0/1309838562 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559169685060 0x559169690e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:36.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.096+0000 7f2c41955b80 1 --2- 172.21.15.82:0/1309838562 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x5591696afba0 0x5591696b1f90 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:36.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.096+0000 7f2c1a000700 0 client.26779 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T06:04:36.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.096+0000 7f2c41955b80 1 --2- 172.21.15.82:0/1309838562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559169685980 0x55916968e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:36.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.096+0000 7f2c41955b80 1 -- 172.21.15.82:0/1309838562 >> 172.21.15.82:0/1309838562 conn(0x5591695b3b60 msgr2=0x55916967a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:04:36.098 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:04:35 smithi082 ceph-mon[30098]: pgmap v877: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.4 MiB/s wr, 571 op/s 2024-05-08T06:04:36.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.097+0000 7f2c41955b80 1 -- 172.21.15.82:0/1309838562 shutdown_connections 2024-05-08T06:04:36.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.097+0000 7f2c41955b80 1 -- 172.21.15.82:0/1309838562 wait complete. 2024-05-08T06:04:36.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.097+0000 7f2c41955b80 20 client.26779 trim_cache size 0 max 16384 2024-05-08T06:04:36.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:04:35 smithi151 ceph-mon[34815]: pgmap v877: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.4 MiB/s wr, 571 op/s 2024-05-08T06:04:36.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.129+0000 7f2c41955b80 1 Processor -- start 2024-05-08T06:04:36.130 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.129+0000 7f2c41955b80 1 -- start start 2024-05-08T06:04:36.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.130+0000 7f2c41955b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559169685060 0x55916968bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:36.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.130+0000 7f2c41955b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559169685980 0x55916968ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:36.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.130+0000 7f2c41955b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5591696899d0 0x559169683e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:36.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.130+0000 7f2c41955b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2c3011d080 con 0x559169685060 2024-05-08T06:04:36.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.130+0000 7f2c41955b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2c301ad370 con 0x5591696899d0 2024-05-08T06:04:36.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.130+0000 7f2c41955b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2c3011d750 con 0x559169685980 2024-05-08T06:04:36.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.130+0000 7f2c2f400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559169685980 0x55916968ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:36.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.131+0000 7f2c2f400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559169685980 0x55916968ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:37814/0 (socket says 172.21.15.82:37814) 2024-05-08T06:04:36.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.131+0000 7f2c2f400700 1 -- 172.21.15.82:0/3295027242 learned_addr learned my addr 172.21.15.82:0/3295027242 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:04:36.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.131+0000 7f2c2fe00700 1 --2- 172.21.15.82:0/3295027242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559169685060 0x55916968bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:36.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.131+0000 7f2c2f400700 1 -- 172.21.15.82:0/3295027242 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5591696899d0 msgr2=0x559169683e70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T06:04:36.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.132+0000 7f2c35000700 1 --2- 172.21.15.82:0/3295027242 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5591696899d0 0x559169683e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:36.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.132+0000 7f2c2f400700 1 --2- 172.21.15.82:0/3295027242 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5591696899d0 0x559169683e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:36.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.132+0000 7f2c2f400700 1 -- 172.21.15.82:0/3295027242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559169685060 msgr2=0x55916968bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:04:36.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.132+0000 7f2c2f400700 1 --2- 172.21.15.82:0/3295027242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559169685060 0x55916968bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:36.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.132+0000 7f2c2f400700 1 -- 172.21.15.82:0/3295027242 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5591696897b0 con 0x559169685980 2024-05-08T06:04:36.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.132+0000 7f2c2fe00700 1 --2- 172.21.15.82:0/3295027242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559169685060 0x55916968bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:04:36.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.132+0000 7f2c35000700 1 --2- 172.21.15.82:0/3295027242 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5591696899d0 0x559169683e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:04:36.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.133+0000 7f2c2f400700 1 --2- 172.21.15.82:0/3295027242 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559169685980 0x55916968ffb0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c004e90 tx=0x7f2c1c004ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a50626aa5992e19a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:04:36.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.133+0000 7f2c24c00700 1 -- 172.21.15.82:0/3295027242 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c028020 con 0x559169685980 2024-05-08T06:04:36.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.133+0000 7f2c24c00700 1 -- 172.21.15.82:0/3295027242 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c1c011c00 con 0x559169685980 2024-05-08T06:04:36.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.133+0000 7f2c24c00700 1 -- 172.21.15.82:0/3295027242 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c003b40 con 0x559169685980 2024-05-08T06:04:36.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.134+0000 7f2c41955b80 1 -- 172.21.15.82:0/3295027242 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559169685980 msgr2=0x55916968ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:36.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.134+0000 7f2c41955b80 1 --2- 172.21.15.82:0/3295027242 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559169685980 0x55916968ffb0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c004e90 tx=0x7f2c1c004ec0 comp rx=0 tx=0).stop 2024-05-08T06:04:36.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.134+0000 7f2c41955b80 1 -- 172.21.15.82:0/3295027242 shutdown_connections 2024-05-08T06:04:36.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.135+0000 7f2c41955b80 1 --2- 172.21.15.82:0/3295027242 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5591696899d0 0x559169683e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:36.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.135+0000 7f2c41955b80 1 --2- 172.21.15.82:0/3295027242 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x559169685060 0x55916968bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:36.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.135+0000 7f2c41955b80 1 --2- 172.21.15.82:0/3295027242 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559169685980 0x55916968ffb0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:36.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.135+0000 7f2c41955b80 1 -- 172.21.15.82:0/3295027242 >> 172.21.15.82:0/3295027242 conn(0x5591695b3b60 msgr2=0x55916968f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:04:36.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.135+0000 7f2c41955b80 1 -- 172.21.15.82:0/3295027242 shutdown_connections 2024-05-08T06:04:36.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.135+0000 7f2c41955b80 1 -- 172.21.15.82:0/3295027242 wait complete. 2024-05-08T06:04:36.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.135+0000 7f2c41955b80 1 -- start start 2024-05-08T06:04:36.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.136+0000 7f2c41955b80 1 Processor -- start 2024-05-08T06:04:36.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.137+0000 7f2c41955b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559169685060 0x559169697050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:36.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.137+0000 7f2c41955b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559169685980 0x559169697590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:36.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.137+0000 7f2c41955b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591696899d0 0x559169694020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:36.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.137+0000 7f2c41955b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f2c3011e4f0 con 0x5591696899d0 2024-05-08T06:04:36.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.137+0000 7f2c41955b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2c3011de20 con 0x559169685060 2024-05-08T06:04:36.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.137+0000 7f2c41955b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2c3011b040 con 0x559169685980 2024-05-08T06:04:36.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.137+0000 7f2c41955b80 10 client.0 _ll_register_callbacks cb 0x55916957ec70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:04:36.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.137+0000 7f2c2fe00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559169685060 0x559169697050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:36.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.138+0000 7f2c2fe00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559169685060 0x559169697050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:37866/0 (socket says 172.21.15.82:37866) 2024-05-08T06:04:36.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.138+0000 7f2c2fe00700 1 -- 172.21.15.82:0/666788216 learned_addr learned my addr 172.21.15.82:0/666788216 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:04:36.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.138+0000 7f2c2f400700 1 --2- 172.21.15.82:0/666788216 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559169685980 0x559169697590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:36.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.138+0000 7f2c2f400700 1 -- 172.21.15.82:0/666788216 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559169685060 msgr2=0x559169697050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:04:36.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.138+0000 7f2c2f400700 1 --2- 172.21.15.82:0/666788216 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559169685060 0x559169697050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:36.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.138+0000 7f2c2f400700 1 -- 172.21.15.82:0/666788216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591696899d0 msgr2=0x559169694020 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-08T06:04:36.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.138+0000 7f2c35000700 1 --2- 172.21.15.82:0/666788216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591696899d0 0x559169694020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:36.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.138+0000 7f2c2f400700 1 --2- 172.21.15.82:0/666788216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591696899d0 0x559169694020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:36.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.139+0000 7f2c2f400700 1 -- 172.21.15.82:0/666788216 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559169694810 con 0x559169685980 2024-05-08T06:04:36.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.139+0000 7f2c35000700 1 --2- 172.21.15.82:0/666788216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591696899d0 0x559169694020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:04:36.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.139+0000 7f2c2f400700 1 --2- 172.21.15.82:0/666788216 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559169685980 0x559169697590 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x55916967a960 tx=0x7f2c1c0092d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fdf492b88fcaeb1c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:04:36.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.139+0000 7f2c1a000700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T06:04:36.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.139+0000 7f2c1a000700 1 -- 172.21.15.82:0/666788216 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c1c031020 con 0x559169685980 2024-05-08T06:04:36.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.139+0000 7f2c1a000700 1 -- 172.21.15.82:0/666788216 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f2c1c011020 con 0x559169685980 2024-05-08T06:04:36.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.139+0000 7f2c41955b80 1 -- 172.21.15.82:0/666788216 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c1c011c00 con 0x559169685980 2024-05-08T06:04:36.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.140+0000 7f2c1a000700 1 -- 172.21.15.82:0/666788216 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f2c1c028070 con 0x559169685980 2024-05-08T06:04:36.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.140+0000 7f2c41955b80 10 client.26785 fetch_fsmap learned FSMap version 31 2024-05-08T06:04:36.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.140+0000 7f2c41955b80 1 -- 172.21.15.82:0/666788216 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55916971ae00 con 0x559169685980 2024-05-08T06:04:36.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.140+0000 7f2c1a000700 1 -- 172.21.15.82:0/666788216 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f2c1c0053e0 con 0x559169685980 2024-05-08T06:04:36.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.140+0000 7f2c1a000700 1 -- 172.21.15.82:0/666788216 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f2c1c018070 con 0x559169685980 2024-05-08T06:04:36.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.141+0000 7f2c41955b80 10 client.26785 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:04:36.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.141+0000 7f2c41955b80 10 client.26785 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T06:04:36.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.141+0000 7f2c41955b80 20 client.26785 populate_metadata read hostname 'smithi082' 2024-05-08T06:04:36.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.141+0000 7f2c41955b80 1 --2- 172.21.15.82:0/666788216 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55916971b1e0 0x55916971d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:04:36.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.141+0000 7f2c41955b80 4 client.26785 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-08T06:04:36.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.141+0000 7f2c41955b80 1 -- 172.21.15.82:0/666788216 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f2c1c011c00 con 0x55916971b1e0 2024-05-08T06:04:36.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.141+0000 7f2c2fe00700 1 --2- 172.21.15.82:0/666788216 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55916971b1e0 0x55916971d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:04:36.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.142+0000 7f2c1a000700 10 client.26785 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T06:04:36.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.143+0000 7f2c2fe00700 1 --2- 172.21.15.82:0/666788216 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55916971b1e0 0x55916971d600 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2bb1bfae1678226a server_cookie=f76598540054d42f in_seq=0 out_seq=0 2024-05-08T06:04:36.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.143+0000 7f2c1a000700 1 -- 172.21.15.82:0/666788216 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7f2c1c011c00 con 0x55916971b1e0 2024-05-08T06:04:36.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.143+0000 7f2c1a000700 10 client.26785 handle_command_reply: tid=0 2024-05-08T06:04:36.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.143+0000 7f2c41955b80 1 client.26785 shutdown 2024-05-08T06:04:36.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.144+0000 7f2c41955b80 1 -- 172.21.15.82:0/666788216 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559169685980 msgr2=0x559169697590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:36.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.144+0000 7f2c41955b80 1 --2- 172.21.15.82:0/666788216 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559169685980 0x559169697590 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x55916967a960 tx=0x7f2c1c0092d0 comp rx=0 tx=0).stop 2024-05-08T06:04:36.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.144+0000 7f2c41955b80 1 -- 172.21.15.82:0/666788216 shutdown_connections 2024-05-08T06:04:36.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.144+0000 7f2c41955b80 1 --2- 172.21.15.82:0/666788216 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55916971b1e0 0x55916971d600 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:36.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.144+0000 7f2c41955b80 1 --2- 172.21.15.82:0/666788216 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559169685060 0x559169697050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:36.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.144+0000 7f2c41955b80 1 --2- 172.21.15.82:0/666788216 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x5591696899d0 0x559169694020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:36.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.144+0000 7f2c41955b80 1 --2- 172.21.15.82:0/666788216 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559169685980 0x559169697590 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:36.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.144+0000 7f2c41955b80 1 -- 172.21.15.82:0/666788216 >> 172.21.15.82:0/666788216 conn(0x5591695b3b60 msgr2=0x55916968a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:04:36.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.144+0000 7f2c1a000700 0 client.26785 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T06:04:36.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.144+0000 7f2c41955b80 1 -- 172.21.15.82:0/666788216 shutdown_connections 2024-05-08T06:04:36.145 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.144+0000 7f2c41955b80 1 -- 172.21.15.82:0/666788216 wait complete. 2024-05-08T06:04:36.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.145+0000 7f2c41955b80 20 client.26785 trim_cache size 0 max 16384 2024-05-08T06:04:36.147 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T06:04:36.147 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-08T06:04:36.147 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2024-05-08T06:04:36.147 INFO:teuthology.orchestra.run.smithi082.stdout: "bcbf852c-a2f3-4a77-949e-b190adcacf70": { 2024-05-08T06:04:36.147 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2024-05-08T06:04:36.147 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "bcbf852c-a2f3-4a77-949e-b190adcacf70", 2024-05-08T06:04:36.147 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2024-05-08T06:04:36.147 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:04:36.147 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:04:36.147 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T06:04:36.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.146+0000 7f2c37000700 1 -- 172.21.15.82:0/4103594010 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2c140b2980 msgr2=0x7f2c140b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:36.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.146+0000 7f2c37000700 1 --2- 172.21.15.82:0/4103594010 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2c140b2980 0x7f2c140b4e40 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2c280075c0 tx=0x7f2c2800b040 comp rx=0 tx=0).stop 2024-05-08T06:04:36.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.146+0000 7f2c37000700 1 -- 172.21.15.82:0/4103594010 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c30103750 msgr2=0x7f2c30110340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:04:36.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.146+0000 7f2c37000700 1 --2- 172.21.15.82:0/4103594010 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c30103750 0x7f2c30110340 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f2c20005910 tx=0x7f2c2000bfc0 comp rx=0 tx=0).stop 2024-05-08T06:04:36.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.146+0000 7f2c37000700 1 -- 172.21.15.82:0/4103594010 shutdown_connections 2024-05-08T06:04:36.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.146+0000 7f2c37000700 1 --2- 172.21.15.82:0/4103594010 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c30103750 0x7f2c30110340 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:36.148 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.146+0000 7f2c37000700 1 --2- 172.21.15.82:0/4103594010 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f2c140b2980 0x7f2c140b4e40 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:36.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.146+0000 7f2c37000700 1 --2- 172.21.15.82:0/4103594010 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c30108850 0x7f2c3010db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:36.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.146+0000 7f2c37000700 1 --2- 172.21.15.82:0/4103594010 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2c30104100 0x7f2c3010d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:04:36.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.146+0000 7f2c37000700 1 -- 172.21.15.82:0/4103594010 >> 172.21.15.82:0/4103594010 conn(0x7f2c3007a600 msgr2=0x7f2c30101680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:04:36.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.146+0000 7f2c37000700 1 -- 172.21.15.82:0/4103594010 shutdown_connections 2024-05-08T06:04:36.149 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:04:36.146+0000 7f2c37000700 1 -- 172.21.15.82:0/4103594010 wait complete. 2024-05-08T06:04:36.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:04:35 smithi134 ceph-mon[34132]: pgmap v877: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.4 MiB/s wr, 571 op/s 2024-05-08T06:04:37.127 INFO:tasks.cephfs.filesystem:scrub status for tag:bcbf852c-a2f3-4a77-949e-b190adcacf70 - {'path': '/', 'tag': 'bcbf852c-a2f3-4a77-949e-b190adcacf70', 'options': 'recursive,force'} 2024-05-08T06:04:38.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:04:37 smithi151 ceph-mon[34815]: pgmap v878: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.8 MiB/s wr, 710 op/s 2024-05-08T06:04:38.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:04:37 smithi082 ceph-mon[30098]: pgmap v878: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.8 MiB/s wr, 710 op/s 2024-05-08T06:04:38.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:04:37 smithi134 ceph-mon[34132]: pgmap v878: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 7.8 MiB/s wr, 710 op/s 2024-05-08T06:04:40.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:04:39 smithi151 ceph-mon[34815]: pgmap v879: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 MiB/s wr, 580 op/s 2024-05-08T06:04:40.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:04:39 smithi082 ceph-mon[30098]: pgmap v879: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 MiB/s wr, 580 op/s 2024-05-08T06:04:40.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:04:39 smithi134 ceph-mon[34132]: pgmap v879: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.4 MiB/s wr, 580 op/s 2024-05-08T06:04:40.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 830.0 s, 1421.0 tps, lat 69.494 ms stddev 81.836 2024-05-08T06:04:41.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:04:41 smithi082 ceph-mon[30098]: scrub summary: idle 2024-05-08T06:04:41.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:04:41 smithi082 ceph-mon[30098]: scrub summary: idle 2024-05-08T06:04:41.499 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:04:41 smithi134 ceph-mon[34132]: scrub summary: idle 2024-05-08T06:04:41.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:04:41 smithi134 ceph-mon[34132]: scrub summary: idle 2024-05-08T06:04:41.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:04:41 smithi151 ceph-mon[34815]: scrub summary: idle 2024-05-08T06:04:41.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:04:41 smithi151 ceph-mon[34815]: scrub summary: idle 2024-05-08T06:04:42.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:04:42 smithi082 ceph-mon[30098]: pgmap v880: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.7 MiB/s wr, 626 op/s 2024-05-08T06:04:42.499 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:04:42 smithi134 ceph-mon[34132]: pgmap v880: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.7 MiB/s wr, 626 op/s 2024-05-08T06:04:42.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:04:42 smithi151 ceph-mon[34815]: pgmap v880: 97 pgs: 97 active+clean; 1.6 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.7 MiB/s wr, 626 op/s 2024-05-08T06:04:44.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:04:44 smithi082 ceph-mon[30098]: pgmap v881: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.6 MiB/s wr, 684 op/s 2024-05-08T06:04:44.499 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:04:44 smithi134 ceph-mon[34132]: pgmap v881: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.6 MiB/s wr, 684 op/s 2024-05-08T06:04:44.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:04:44 smithi151 ceph-mon[34815]: pgmap v881: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.6 MiB/s wr, 684 op/s 2024-05-08T06:04:45.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 835.0 s, 1250.6 tps, lat 80.543 ms stddev 101.005 2024-05-08T06:04:46.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:04:46 smithi134 ceph-mon[34132]: pgmap v882: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.4 MiB/s wr, 597 op/s 2024-05-08T06:04:46.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:04:46 smithi151 ceph-mon[34815]: pgmap v882: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.4 MiB/s wr, 597 op/s 2024-05-08T06:04:46.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:04:46 smithi082 ceph-mon[30098]: pgmap v882: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 6.4 MiB/s wr, 597 op/s 2024-05-08T06:04:48.499 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:04:48 smithi134 ceph-mon[34132]: pgmap v883: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.6 MiB/s wr, 719 op/s 2024-05-08T06:04:48.547 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:04:48 smithi082 ceph-mon[30098]: pgmap v883: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.6 MiB/s wr, 719 op/s 2024-05-08T06:04:48.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:04:48 smithi151 ceph-mon[34815]: pgmap v883: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.6 MiB/s wr, 719 op/s 2024-05-08T06:04:50.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 840.0 s, 1561.2 tps, lat 64.801 ms stddev 81.748 2024-05-08T06:04:50.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:04:50 smithi134 ceph-mon[34132]: pgmap v884: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.8 MiB/s wr, 563 op/s 2024-05-08T06:04:50.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:04:50 smithi151 ceph-mon[34815]: pgmap v884: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.8 MiB/s wr, 563 op/s 2024-05-08T06:04:50.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:04:50 smithi082 ceph-mon[30098]: pgmap v884: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.8 MiB/s wr, 563 op/s 2024-05-08T06:04:52.500 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:04:52 smithi134 ceph-mon[34132]: pgmap v885: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.0 MiB/s wr, 637 op/s 2024-05-08T06:04:52.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:04:52 smithi151 ceph-mon[34815]: pgmap v885: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.0 MiB/s wr, 637 op/s 2024-05-08T06:04:52.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:04:52 smithi082 ceph-mon[30098]: pgmap v885: 97 pgs: 97 active+clean; 1.6 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.0 MiB/s wr, 637 op/s 2024-05-08T06:04:54.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:04:54 smithi151 ceph-mon[34815]: pgmap v886: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.4 MiB/s wr, 680 op/s 2024-05-08T06:04:54.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:04:54 smithi082 ceph-mon[30098]: pgmap v886: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.4 MiB/s wr, 680 op/s 2024-05-08T06:04:54.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:04:54 smithi134 ceph-mon[34132]: pgmap v886: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.4 MiB/s wr, 680 op/s 2024-05-08T06:04:55.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 845.0 s, 1903.4 tps, lat 52.445 ms stddev 68.854 2024-05-08T06:04:56.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:04:56 smithi151 ceph-mon[34815]: pgmap v887: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.1 MiB/s wr, 557 op/s 2024-05-08T06:04:56.722 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:04:56 smithi082 ceph-mon[30098]: pgmap v887: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.1 MiB/s wr, 557 op/s 2024-05-08T06:04:56.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:04:56 smithi134 ceph-mon[34132]: pgmap v887: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.1 MiB/s wr, 557 op/s 2024-05-08T06:04:57.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:04:57 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:04:57.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:04:57 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:04:57.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:04:57 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:04:58.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:04:58 smithi151 ceph-mon[34815]: pgmap v888: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.0 MiB/s wr, 729 op/s 2024-05-08T06:04:58.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:04:58 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:04:58.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:04:58 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:04:58.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:04:58 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:04:58.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:04:58 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:04:58.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:04:58 smithi082 ceph-mon[30098]: pgmap v888: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.0 MiB/s wr, 729 op/s 2024-05-08T06:04:58.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:04:58 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:04:58.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:04:58 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:04:58.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:04:58 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:04:58.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:04:58 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:04:58.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:04:58 smithi134 ceph-mon[34132]: pgmap v888: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.0 MiB/s wr, 729 op/s 2024-05-08T06:04:58.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:04:58 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:04:58.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:04:58 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:04:58.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:04:58 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:04:58.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:04:58 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:04:59.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:04:59 smithi151 ceph-mon[34815]: Adjusting osd_memory_target on smithi134 to 176.2M 2024-05-08T06:04:59.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:04:59 smithi151 ceph-mon[34815]: Unable to set osd_memory_target on smithi134 to 184791040: error parsing value: Value '184791040' is below minimum 939524096 2024-05-08T06:04:59.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:04:59 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:04:59.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:04:59 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:04:59.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:04:59 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:04:59.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:04:59 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:04:59.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:04:59 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:04:59.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:04:59 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:04:59.630 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:04:59 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T06:04:59.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:04:59 smithi082 ceph-mon[30098]: Adjusting osd_memory_target on smithi134 to 176.2M 2024-05-08T06:04:59.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:04:59 smithi082 ceph-mon[30098]: Unable to set osd_memory_target on smithi134 to 184791040: error parsing value: Value '184791040' is below minimum 939524096 2024-05-08T06:04:59.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:04:59 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:04:59.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:04:59 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:04:59.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:04:59 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:04:59.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:04:59 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:04:59.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:04:59 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:04:59.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:04:59 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:04:59.721 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:04:59 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T06:04:59.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:04:59 smithi134 ceph-mon[34132]: Adjusting osd_memory_target on smithi134 to 176.2M 2024-05-08T06:04:59.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:04:59 smithi134 ceph-mon[34132]: Unable to set osd_memory_target on smithi134 to 184791040: error parsing value: Value '184791040' is below minimum 939524096 2024-05-08T06:04:59.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:04:59 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:04:59.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:04:59 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:04:59.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:04:59 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:04:59.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:04:59 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:04:59.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:04:59 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:04:59.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:04:59 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:04:59.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:04:59 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T06:05:00.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 850.0 s, 1234.2 tps, lat 79.994 ms stddev 99.491 2024-05-08T06:05:00.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:05:00 smithi151 ceph-mon[34815]: Adjusting osd_memory_target on smithi082 to 176.4M 2024-05-08T06:05:00.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:05:00 smithi151 ceph-mon[34815]: Unable to set osd_memory_target on smithi082 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-05-08T06:05:00.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:05:00 smithi151 ceph-mon[34815]: pgmap v889: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.1 MiB/s wr, 568 op/s 2024-05-08T06:05:00.651 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:05:00 smithi134 ceph-mon[34132]: Adjusting osd_memory_target on smithi082 to 176.4M 2024-05-08T06:05:00.651 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:05:00 smithi134 ceph-mon[34132]: Unable to set osd_memory_target on smithi082 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-05-08T06:05:00.651 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:05:00 smithi134 ceph-mon[34132]: pgmap v889: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.1 MiB/s wr, 568 op/s 2024-05-08T06:05:00.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:05:00 smithi082 ceph-mon[30098]: Adjusting osd_memory_target on smithi082 to 176.4M 2024-05-08T06:05:00.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:05:00 smithi082 ceph-mon[30098]: Unable to set osd_memory_target on smithi082 to 185040486: error parsing value: Value '185040486' is below minimum 939524096 2024-05-08T06:05:00.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:05:00 smithi082 ceph-mon[30098]: pgmap v889: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 6.1 MiB/s wr, 568 op/s 2024-05-08T06:05:02.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:05:02 smithi151 ceph-mon[34815]: pgmap v890: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.1 MiB/s wr, 649 op/s 2024-05-08T06:05:02.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:05:02 smithi082 ceph-mon[30098]: pgmap v890: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.1 MiB/s wr, 649 op/s 2024-05-08T06:05:02.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:05:02 smithi134 ceph-mon[34132]: pgmap v890: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.1 MiB/s wr, 649 op/s 2024-05-08T06:05:04.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:05:04 smithi151 ceph-mon[34815]: pgmap v891: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.3 MiB/s wr, 640 op/s 2024-05-08T06:05:04.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:05:04 smithi082 ceph-mon[30098]: pgmap v891: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.3 MiB/s wr, 640 op/s 2024-05-08T06:05:04.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:05:04 smithi134 ceph-mon[34132]: pgmap v891: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 6.3 MiB/s wr, 640 op/s 2024-05-08T06:05:05.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 855.0 s, 1698.8 tps, lat 59.418 ms stddev 75.890 2024-05-08T06:05:05.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:05:05 smithi151 ceph-mon[34815]: pgmap v892: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.2 MiB/s wr, 527 op/s 2024-05-08T06:05:05.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:05:05 smithi082 ceph-mon[30098]: pgmap v892: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.2 MiB/s wr, 527 op/s 2024-05-08T06:05:05.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:05:05 smithi134 ceph-mon[34132]: pgmap v892: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.2 MiB/s wr, 527 op/s 2024-05-08T06:05:07.128 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-08T06:05:07.739 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:05:07.921 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:05:07 smithi082 ceph-mon[30098]: pgmap v893: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.2 MiB/s wr, 718 op/s 2024-05-08T06:05:07.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:05:07 smithi134 ceph-mon[34132]: pgmap v893: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.2 MiB/s wr, 718 op/s 2024-05-08T06:05:08.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:05:07 smithi151 ceph-mon[34815]: pgmap v893: 97 pgs: 97 active+clean; 1.6 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.2 MiB/s wr, 718 op/s 2024-05-08T06:05:09.935 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:05:09 smithi082 ceph-mon[30098]: pgmap v894: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.5 MiB/s wr, 557 op/s 2024-05-08T06:05:09.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:05:09 smithi134 ceph-mon[34132]: pgmap v894: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.5 MiB/s wr, 557 op/s 2024-05-08T06:05:10.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:05:09 smithi151 ceph-mon[34815]: pgmap v894: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.5 MiB/s wr, 557 op/s 2024-05-08T06:05:10.268 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 860.0 s, 1666.6 tps, lat 60.006 ms stddev 74.364 2024-05-08T06:05:11.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.003+0000 7fd253000700 1 -- 172.21.15.82:0/1687375956 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd24c10a490 msgr2=0x7fd24c1169a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:11.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.003+0000 7fd253000700 1 --2- 172.21.15.82:0/1687375956 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd24c10a490 0x7fd24c1169a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd24400b0a0 tx=0x7fd24400b3b0 comp rx=0 tx=0).stop 2024-05-08T06:05:11.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.003+0000 7fd253000700 1 -- 172.21.15.82:0/1687375956 shutdown_connections 2024-05-08T06:05:11.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.003+0000 7fd253000700 1 --2- 172.21.15.82:0/1687375956 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd24c10fb60 0x7fd24c10ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:11.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.003+0000 7fd253000700 1 --2- 172.21.15.82:0/1687375956 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd24c10a490 0x7fd24c1169a0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:11.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.003+0000 7fd253000700 1 --2- 172.21.15.82:0/1687375956 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd24c109ad0 0x7fd24c109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:11.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.003+0000 7fd253000700 1 -- 172.21.15.82:0/1687375956 >> 172.21.15.82:0/1687375956 conn(0x7fd24c076c70 msgr2=0x7fd24c079090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:05:11.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.004+0000 7fd253000700 1 -- 172.21.15.82:0/1687375956 shutdown_connections 2024-05-08T06:05:11.005 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.004+0000 7fd253000700 1 -- 172.21.15.82:0/1687375956 wait complete. 2024-05-08T06:05:11.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.005+0000 7fd253000700 1 Processor -- start 2024-05-08T06:05:11.006 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.005+0000 7fd253000700 1 -- start start 2024-05-08T06:05:11.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.006+0000 7fd253000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd24c109ad0 0x7fd24c1a0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:11.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.006+0000 7fd253000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd24c10a490 0x7fd24c1a06d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:11.007 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.006+0000 7fd253000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd24c10fb60 0x7fd24c1a4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:11.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.006+0000 7fd253000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd24c119d60 con 0x7fd24c109ad0 2024-05-08T06:05:11.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.006+0000 7fd253000700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd24c119be0 con 0x7fd24c10fb60 2024-05-08T06:05:11.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.006+0000 7fd253000700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd24c119ee0 con 0x7fd24c10a490 2024-05-08T06:05:11.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.006+0000 7fd24b400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd24c10a490 0x7fd24c1a06d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:11.008 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.006+0000 7fd24be00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd24c109ad0 0x7fd24c1a0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:11.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.006+0000 7fd251000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd24c10fb60 0x7fd24c1a4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:11.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.007+0000 7fd24b400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd24c10a490 0x7fd24c1a06d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:48170/0 (socket says 172.21.15.82:48170) 2024-05-08T06:05:11.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.007+0000 7fd24b400700 1 -- 172.21.15.82:0/3918013798 learned_addr learned my addr 172.21.15.82:0/3918013798 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:05:11.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.007+0000 7fd251000700 1 -- 172.21.15.82:0/3918013798 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd24c10a490 msgr2=0x7fd24c1a06d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:11.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.007+0000 7fd251000700 1 --2- 172.21.15.82:0/3918013798 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd24c10a490 0x7fd24c1a06d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:11.009 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.007+0000 7fd251000700 1 -- 172.21.15.82:0/3918013798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd24c109ad0 msgr2=0x7fd24c1a0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:11.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.007+0000 7fd251000700 1 --2- 172.21.15.82:0/3918013798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd24c109ad0 0x7fd24c1a0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:11.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.007+0000 7fd251000700 1 -- 172.21.15.82:0/3918013798 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd24c1a51a0 con 0x7fd24c10fb60 2024-05-08T06:05:11.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.007+0000 7fd24b400700 1 --2- 172.21.15.82:0/3918013798 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd24c10a490 0x7fd24c1a06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:05:11.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.007+0000 7fd251000700 1 --2- 172.21.15.82:0/3918013798 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd24c10fb60 0x7fd24c1a4a60 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fd24400d010 tx=0x7fd244004c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:05:11.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.008+0000 7fd248c00700 1 -- 172.21.15.82:0/3918013798 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd244021070 con 0x7fd24c10fb60 2024-05-08T06:05:11.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.008+0000 7fd248c00700 1 -- 172.21.15.82:0/3918013798 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd244007e30 con 0x7fd24c10fb60 2024-05-08T06:05:11.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.008+0000 7fd253000700 1 -- 172.21.15.82:0/3918013798 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd24c1a5430 con 0x7fd24c10fb60 2024-05-08T06:05:11.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.008+0000 7fd248c00700 1 -- 172.21.15.82:0/3918013798 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd244004630 con 0x7fd24c10fb60 2024-05-08T06:05:11.010 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.008+0000 7fd253000700 1 -- 172.21.15.82:0/3918013798 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd24c1acd10 con 0x7fd24c10fb60 2024-05-08T06:05:11.013 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.013+0000 7fd248c00700 1 -- 172.21.15.82:0/3918013798 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fd24401d450 con 0x7fd24c10fb60 2024-05-08T06:05:11.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.015+0000 7fd248c00700 1 --2- 172.21.15.82:0/3918013798 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd2300b2a10 0x7fd2300b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:11.016 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.015+0000 7fd248c00700 1 -- 172.21.15.82:0/3918013798 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd2440e2f80 con 0x7fd24c10fb60 2024-05-08T06:05:11.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.016+0000 7fd25d8c2b80 1 Processor -- start 2024-05-08T06:05:11.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.017+0000 7fd24be00700 1 --2- 172.21.15.82:0/3918013798 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd2300b2a10 0x7fd2300b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:11.017 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.017+0000 7fd25d8c2b80 1 -- start start 2024-05-08T06:05:11.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.017+0000 7fd25d8c2b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e74a6cfbc0 0x55e74a6cffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:11.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.017+0000 7fd25d8c2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e74a6d04e0 0x55e74a6ca2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:11.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.018+0000 7fd25d8c2b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e74a6ca8f0 0x55e74a6cad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:11.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.018+0000 7fd25d8c2b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55e74a61ca20 con 0x55e74a6ca8f0 2024-05-08T06:05:11.018 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.018+0000 7fd25d8c2b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e74a5ba760 con 0x55e74a6cfbc0 2024-05-08T06:05:11.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.018+0000 7fd25d8c2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55e74a6189e0 con 0x55e74a6d04e0 2024-05-08T06:05:11.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.019+0000 7fd24b400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e74a6d04e0 0x55e74a6ca2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:11.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.019+0000 7fd24be00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e74a6cfbc0 0x55e74a6cffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:11.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.019+0000 7fd24b400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e74a6d04e0 0x55e74a6ca2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:48182/0 (socket says 172.21.15.82:48182) 2024-05-08T06:05:11.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.019+0000 7fd24b400700 1 -- 172.21.15.82:0/2028662175 learned_addr learned my addr 172.21.15.82:0/2028662175 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:05:11.019 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.019+0000 7fd251000700 1 --2- 172.21.15.82:0/2028662175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e74a6ca8f0 0x55e74a6cad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:11.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.019+0000 7fd24be00700 1 -- 172.21.15.82:0/2028662175 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e74a6d04e0 msgr2=0x55e74a6ca2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:11.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.019+0000 7fd24be00700 1 --2- 172.21.15.82:0/2028662175 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e74a6d04e0 0x55e74a6ca2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:11.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.019+0000 7fd24be00700 1 -- 172.21.15.82:0/2028662175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e74a6ca8f0 msgr2=0x55e74a6cad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:11.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.019+0000 7fd24be00700 1 --2- 172.21.15.82:0/2028662175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e74a6ca8f0 0x55e74a6cad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:11.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.019+0000 7fd24be00700 1 -- 172.21.15.82:0/2028662175 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e74a5698d0 con 0x55e74a6cfbc0 2024-05-08T06:05:11.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.019+0000 7fd24be00700 1 --2- 172.21.15.82:0/3918013798 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd2300b2a10 0x7fd2300b4ed0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd23c009d90 tx=0x7fd23c014750 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:05:11.020 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.020+0000 7fd24be00700 1 --2- 172.21.15.82:0/2028662175 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e74a6cfbc0 0x55e74a6cffa0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fd23c014b50 tx=0x7fd23c01b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca5f129e26059bbe server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:05:11.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.020+0000 7fd241600700 1 -- 172.21.15.82:0/2028662175 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd23c014170 con 0x55e74a6cfbc0 2024-05-08T06:05:11.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.020+0000 7fd241600700 1 -- 172.21.15.82:0/2028662175 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd23c004830 con 0x55e74a6cfbc0 2024-05-08T06:05:11.021 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.020+0000 7fd241600700 1 -- 172.21.15.82:0/2028662175 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd23c005260 con 0x55e74a6cfbc0 2024-05-08T06:05:11.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.021+0000 7fd25d8c2b80 1 -- 172.21.15.82:0/2028662175 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e74a6cfbc0 msgr2=0x55e74a6cffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:11.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.021+0000 7fd25d8c2b80 1 --2- 172.21.15.82:0/2028662175 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e74a6cfbc0 0x55e74a6cffa0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fd23c014b50 tx=0x7fd23c01b000 comp rx=0 tx=0).stop 2024-05-08T06:05:11.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.021+0000 7fd25d8c2b80 1 -- 172.21.15.82:0/2028662175 shutdown_connections 2024-05-08T06:05:11.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.021+0000 7fd25d8c2b80 1 --2- 172.21.15.82:0/2028662175 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e74a6cfbc0 0x55e74a6cffa0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:11.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.021+0000 7fd25d8c2b80 1 --2- 172.21.15.82:0/2028662175 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e74a6ca8f0 0x55e74a6cad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:11.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.021+0000 7fd25d8c2b80 1 --2- 172.21.15.82:0/2028662175 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e74a6d04e0 0x55e74a6ca2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:11.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.021+0000 7fd25d8c2b80 1 -- 172.21.15.82:0/2028662175 >> 172.21.15.82:0/2028662175 conn(0x55e74a6426d0 msgr2=0x55e74a6c4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:05:11.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.021+0000 7fd25d8c2b80 1 -- 172.21.15.82:0/2028662175 shutdown_connections 2024-05-08T06:05:11.022 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.022+0000 7fd25d8c2b80 1 -- 172.21.15.82:0/2028662175 wait complete. 2024-05-08T06:05:11.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.022+0000 7fd25d8c2b80 1 -- start start 2024-05-08T06:05:11.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.022+0000 7fd25d8c2b80 1 Processor -- start 2024-05-08T06:05:11.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.023+0000 7fd25d8c2b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e74a6ca8f0 0x55e74a6d61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:11.023 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.023+0000 7fd25d8c2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e74a6cfbc0 0x55e74a6d3540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:11.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.023+0000 7fd25d8c2b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e74a6d04e0 0x55e74a6d3a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:11.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.023+0000 7fd25d8c2b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55e74a6d6ec0 con 0x55e74a6d04e0 2024-05-08T06:05:11.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.023+0000 7fd25d8c2b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e74a582b20 con 0x55e74a6ca8f0 2024-05-08T06:05:11.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.023+0000 7fd25d8c2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55e74a6d7040 con 0x55e74a6cfbc0 2024-05-08T06:05:11.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.023+0000 7fd25d8c2b80 10 client.0 _ll_register_callbacks cb 0x55e74a5c3c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:05:11.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.023+0000 7fd24be00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e74a6ca8f0 0x55e74a6d61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:11.024 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.023+0000 7fd24b400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e74a6cfbc0 0x55e74a6d3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:11.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.023+0000 7fd24be00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e74a6ca8f0 0x55e74a6d61a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:57774/0 (socket says 172.21.15.82:57774) 2024-05-08T06:05:11.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.023+0000 7fd24b400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e74a6cfbc0 0x55e74a6d3540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:48190/0 (socket says 172.21.15.82:48190) 2024-05-08T06:05:11.025 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.023+0000 7fd24be00700 1 -- 172.21.15.82:0/3886298279 learned_addr learned my addr 172.21.15.82:0/3886298279 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:05:11.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.024+0000 7fd24b400700 1 -- 172.21.15.82:0/3886298279 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e74a6ca8f0 msgr2=0x55e74a6d61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:11.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.024+0000 7fd24b400700 1 --2- 172.21.15.82:0/3886298279 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e74a6ca8f0 0x55e74a6d61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:11.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.024+0000 7fd24b400700 1 -- 172.21.15.82:0/3886298279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e74a6d04e0 msgr2=0x55e74a6d3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:11.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.024+0000 7fd24b400700 1 --2- 172.21.15.82:0/3886298279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e74a6d04e0 0x55e74a6d3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:11.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.024+0000 7fd24b400700 1 -- 172.21.15.82:0/3886298279 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e74a5e2420 con 0x55e74a6cfbc0 2024-05-08T06:05:11.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.024+0000 7fd24b400700 1 --2- 172.21.15.82:0/3886298279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e74a6cfbc0 0x55e74a6d3540 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd238011940 tx=0x7fd238011c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f65c8d371307c5bd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:05:11.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.024+0000 7fd236000700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T06:05:11.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.025+0000 7fd236000700 1 -- 172.21.15.82:0/3886298279 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd238004320 con 0x55e74a6cfbc0 2024-05-08T06:05:11.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.025+0000 7fd236000700 1 -- 172.21.15.82:0/3886298279 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd2380044c0 con 0x55e74a6cfbc0 2024-05-08T06:05:11.026 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.025+0000 7fd25d8c2b80 1 -- 172.21.15.82:0/3886298279 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd23c004830 con 0x55e74a6cfbc0 2024-05-08T06:05:11.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.025+0000 7fd236000700 1 -- 172.21.15.82:0/3886298279 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fd238010840 con 0x55e74a6cfbc0 2024-05-08T06:05:11.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.025+0000 7fd25d8c2b80 10 client.26797 fetch_fsmap learned FSMap version 31 2024-05-08T06:05:11.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.025+0000 7fd25d8c2b80 1 -- 172.21.15.82:0/3886298279 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55e74a6e17b0 con 0x55e74a6cfbc0 2024-05-08T06:05:11.027 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.026+0000 7fd236000700 1 -- 172.21.15.82:0/3886298279 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd23c004830 con 0x55e74a6cfbc0 2024-05-08T06:05:11.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.026+0000 7fd236000700 1 -- 172.21.15.82:0/3886298279 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fd23801b420 con 0x55e74a6cfbc0 2024-05-08T06:05:11.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.026+0000 7fd25d8c2b80 10 client.26797 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:05:11.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.026+0000 7fd25d8c2b80 10 client.26797 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T06:05:11.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.026+0000 7fd25d8c2b80 20 client.26797 populate_metadata read hostname 'smithi082' 2024-05-08T06:05:11.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.026+0000 7fd25d8c2b80 1 --2- 172.21.15.82:0/3886298279 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55e74a6e3df0 0x55e74a6e6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:11.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.026+0000 7fd25d8c2b80 4 client.26797 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:05:11.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.026+0000 7fd25d8c2b80 1 -- 172.21.15.82:0/3886298279 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e74a697140 con 0x55e74a6e3df0 2024-05-08T06:05:11.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.026+0000 7fd24be00700 1 --2- 172.21.15.82:0/3886298279 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55e74a6e3df0 0x55e74a6e6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:11.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.027+0000 7fd24be00700 1 --2- 172.21.15.82:0/3886298279 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55e74a6e3df0 0x55e74a6e6250 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46ffc6e968c4d0 server_cookie=346ee874e903c9e7 in_seq=0 out_seq=0 2024-05-08T06:05:11.028 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.027+0000 7fd236000700 10 client.26797 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T06:05:11.029 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.028+0000 7fd236000700 1 -- 172.21.15.82:0/3886298279 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55e74a697140 con 0x55e74a6e3df0 2024-05-08T06:05:11.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.028+0000 7fd236000700 10 client.26797 handle_command_reply: tid=0 2024-05-08T06:05:11.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.028+0000 7fd25d8c2b80 1 client.26797 shutdown 2024-05-08T06:05:11.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.028+0000 7fd25d8c2b80 1 -- 172.21.15.82:0/3886298279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e74a6cfbc0 msgr2=0x55e74a6d3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:11.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.028+0000 7fd25d8c2b80 1 --2- 172.21.15.82:0/3886298279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e74a6cfbc0 0x55e74a6d3540 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd238011940 tx=0x7fd238011c50 comp rx=0 tx=0).stop 2024-05-08T06:05:11.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.029+0000 7fd25d8c2b80 1 -- 172.21.15.82:0/3886298279 shutdown_connections 2024-05-08T06:05:11.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.029+0000 7fd25d8c2b80 1 --2- 172.21.15.82:0/3886298279 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55e74a6e3df0 0x55e74a6e6250 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:11.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.029+0000 7fd25d8c2b80 1 --2- 172.21.15.82:0/3886298279 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e74a6ca8f0 0x55e74a6d61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:11.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.029+0000 7fd25d8c2b80 1 --2- 172.21.15.82:0/3886298279 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e74a6d04e0 0x55e74a6d3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:11.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.029+0000 7fd25d8c2b80 1 --2- 172.21.15.82:0/3886298279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e74a6cfbc0 0x55e74a6d3540 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:11.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.029+0000 7fd25d8c2b80 1 -- 172.21.15.82:0/3886298279 >> 172.21.15.82:0/3886298279 conn(0x55e74a6426d0 msgr2=0x55e74a6c4190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:05:11.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.029+0000 7fd236000700 0 client.26797 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T06:05:11.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.029+0000 7fd25d8c2b80 1 -- 172.21.15.82:0/3886298279 shutdown_connections 2024-05-08T06:05:11.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.029+0000 7fd25d8c2b80 1 -- 172.21.15.82:0/3886298279 wait complete. 2024-05-08T06:05:11.030 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.029+0000 7fd25d8c2b80 20 client.26797 trim_cache size 0 max 16384 2024-05-08T06:05:11.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.060+0000 7fd25d8c2b80 1 Processor -- start 2024-05-08T06:05:11.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.061+0000 7fd25d8c2b80 1 -- start start 2024-05-08T06:05:11.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.061+0000 7fd25d8c2b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e74a6ca8f0 0x55e74a6c4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:11.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.061+0000 7fd25d8c2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e74a6cfbc0 0x55e74a6ced80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:11.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.061+0000 7fd25d8c2b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e74a6d04e0 0x55e74a6cf2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:11.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.061+0000 7fd25d8c2b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd24c1b3f50 con 0x55e74a6ca8f0 2024-05-08T06:05:11.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.061+0000 7fd25d8c2b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd24c1b5a90 con 0x55e74a6d04e0 2024-05-08T06:05:11.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.061+0000 7fd25d8c2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd24c1b4620 con 0x55e74a6cfbc0 2024-05-08T06:05:11.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.061+0000 7fd24b400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e74a6cfbc0 0x55e74a6ced80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:11.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.061+0000 7fd24b400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e74a6cfbc0 0x55e74a6ced80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:48198/0 (socket says 172.21.15.82:48198) 2024-05-08T06:05:11.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.061+0000 7fd24b400700 1 -- 172.21.15.82:0/2110938131 learned_addr learned my addr 172.21.15.82:0/2110938131 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:05:11.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.061+0000 7fd251000700 1 --2- 172.21.15.82:0/2110938131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e74a6d04e0 0x55e74a6cf2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:11.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.061+0000 7fd24be00700 1 --2- 172.21.15.82:0/2110938131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e74a6ca8f0 0x55e74a6c4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:11.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.062+0000 7fd251000700 1 -- 172.21.15.82:0/2110938131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e74a6cfbc0 msgr2=0x55e74a6ced80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:11.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.062+0000 7fd251000700 1 --2- 172.21.15.82:0/2110938131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e74a6cfbc0 0x55e74a6ced80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:11.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.062+0000 7fd251000700 1 -- 172.21.15.82:0/2110938131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e74a6ca8f0 msgr2=0x55e74a6c4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:11.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.062+0000 7fd251000700 1 --2- 172.21.15.82:0/2110938131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e74a6ca8f0 0x55e74a6c4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:11.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.062+0000 7fd251000700 1 -- 172.21.15.82:0/2110938131 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e74a6e68d0 con 0x55e74a6d04e0 2024-05-08T06:05:11.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.062+0000 7fd24be00700 1 --2- 172.21.15.82:0/2110938131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e74a6ca8f0 0x55e74a6c4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:05:11.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.062+0000 7fd251000700 1 --2- 172.21.15.82:0/2110938131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e74a6d04e0 0x55e74a6cf2c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd244009fd0 tx=0x7fd244009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c68ccf6172d632d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:05:11.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.062+0000 7fd240c00700 1 -- 172.21.15.82:0/2110938131 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd24402a040 con 0x55e74a6d04e0 2024-05-08T06:05:11.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.062+0000 7fd240c00700 1 -- 172.21.15.82:0/2110938131 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2440aad40 con 0x55e74a6d04e0 2024-05-08T06:05:11.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.062+0000 7fd240c00700 1 -- 172.21.15.82:0/2110938131 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd244003d20 con 0x55e74a6d04e0 2024-05-08T06:05:11.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.063+0000 7fd25d8c2b80 1 -- 172.21.15.82:0/2110938131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e74a6d04e0 msgr2=0x55e74a6cf2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:11.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.063+0000 7fd25d8c2b80 1 --2- 172.21.15.82:0/2110938131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e74a6d04e0 0x55e74a6cf2c0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fd244009fd0 tx=0x7fd244009b80 comp rx=0 tx=0).stop 2024-05-08T06:05:11.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.063+0000 7fd25d8c2b80 1 -- 172.21.15.82:0/2110938131 shutdown_connections 2024-05-08T06:05:11.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.063+0000 7fd25d8c2b80 1 --2- 172.21.15.82:0/2110938131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e74a6d04e0 0x55e74a6cf2c0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:11.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.063+0000 7fd25d8c2b80 1 --2- 172.21.15.82:0/2110938131 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e74a6ca8f0 0x55e74a6c4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:11.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.063+0000 7fd25d8c2b80 1 --2- 172.21.15.82:0/2110938131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e74a6cfbc0 0x55e74a6ced80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:11.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.063+0000 7fd25d8c2b80 1 -- 172.21.15.82:0/2110938131 >> 172.21.15.82:0/2110938131 conn(0x55e74a6426d0 msgr2=0x55e74a6ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:05:11.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.063+0000 7fd25d8c2b80 1 -- 172.21.15.82:0/2110938131 shutdown_connections 2024-05-08T06:05:11.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.063+0000 7fd25d8c2b80 1 -- 172.21.15.82:0/2110938131 wait complete. 2024-05-08T06:05:11.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.064+0000 7fd25d8c2b80 1 -- start start 2024-05-08T06:05:11.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.064+0000 7fd25d8c2b80 1 Processor -- start 2024-05-08T06:05:11.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.064+0000 7fd25d8c2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e74a6ca8f0 0x55e74a6dc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:11.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.064+0000 7fd25d8c2b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e74a6cfbc0 0x55e74a6d92a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:11.067 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.064+0000 7fd25d8c2b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e74a6d04e0 0x55e74a6d97e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:11.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.065+0000 7fd25d8c2b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd24c1b53c0 con 0x55e74a6cfbc0 2024-05-08T06:05:11.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.065+0000 7fd25d8c2b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd24c1b4cf0 con 0x55e74a6d04e0 2024-05-08T06:05:11.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.065+0000 7fd25d8c2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd24c1b1f10 con 0x55e74a6ca8f0 2024-05-08T06:05:11.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.065+0000 7fd25d8c2b80 10 client.0 _ll_register_callbacks cb 0x55e74a5c3c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:05:11.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.065+0000 7fd251000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e74a6d04e0 0x55e74a6d97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:11.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.065+0000 7fd251000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e74a6d04e0 0x55e74a6d97e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:57780/0 (socket says 172.21.15.82:57780) 2024-05-08T06:05:11.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.065+0000 7fd251000700 1 -- 172.21.15.82:0/732764998 learned_addr learned my addr 172.21.15.82:0/732764998 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:05:11.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.065+0000 7fd24b400700 1 --2- 172.21.15.82:0/732764998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e74a6cfbc0 0x55e74a6d92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:11.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.065+0000 7fd24be00700 1 --2- 172.21.15.82:0/732764998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e74a6ca8f0 0x55e74a6dc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:11.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.065+0000 7fd251000700 1 -- 172.21.15.82:0/732764998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e74a6ca8f0 msgr2=0x55e74a6dc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:11.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.065+0000 7fd251000700 1 --2- 172.21.15.82:0/732764998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e74a6ca8f0 0x55e74a6dc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:11.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.065+0000 7fd251000700 1 -- 172.21.15.82:0/732764998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e74a6cfbc0 msgr2=0x55e74a6d92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:11.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.065+0000 7fd251000700 1 --2- 172.21.15.82:0/732764998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e74a6cfbc0 0x55e74a6d92a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:11.068 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.065+0000 7fd251000700 1 -- 172.21.15.82:0/732764998 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e74a6bfab0 con 0x55e74a6d04e0 2024-05-08T06:05:11.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.065+0000 7fd251000700 1 --2- 172.21.15.82:0/732764998 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e74a6d04e0 0x55e74a6d97e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fd2440aa340 tx=0x7fd244004e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af7ac4f28c47c6c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:05:11.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.065+0000 7fd24be00700 1 --2- 172.21.15.82:0/732764998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e74a6ca8f0 0x55e74a6dc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:05:11.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.065+0000 7fd236000700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T06:05:11.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.066+0000 7fd236000700 1 -- 172.21.15.82:0/732764998 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd24402a070 con 0x55e74a6d04e0 2024-05-08T06:05:11.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.066+0000 7fd236000700 1 -- 172.21.15.82:0/732764998 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd244003d20 con 0x55e74a6d04e0 2024-05-08T06:05:11.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.066+0000 7fd25d8c2b80 1 -- 172.21.15.82:0/732764998 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2440aad40 con 0x55e74a6d04e0 2024-05-08T06:05:11.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.066+0000 7fd236000700 1 -- 172.21.15.82:0/732764998 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fd2440aa640 con 0x55e74a6d04e0 2024-05-08T06:05:11.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.066+0000 7fd25d8c2b80 10 client.26771 fetch_fsmap learned FSMap version 31 2024-05-08T06:05:11.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.066+0000 7fd25d8c2b80 1 -- 172.21.15.82:0/732764998 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55e74a74f580 con 0x55e74a6d04e0 2024-05-08T06:05:11.069 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.066+0000 7fd236000700 1 -- 172.21.15.82:0/732764998 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd2440aad40 con 0x55e74a6d04e0 2024-05-08T06:05:11.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.067+0000 7fd236000700 1 -- 172.21.15.82:0/732764998 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fd2440b1ce0 con 0x55e74a6d04e0 2024-05-08T06:05:11.070 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.067+0000 7fd25d8c2b80 10 client.26771 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:05:11.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.068+0000 7fd25d8c2b80 10 client.26771 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T06:05:11.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.068+0000 7fd25d8c2b80 20 client.26771 populate_metadata read hostname 'smithi082' 2024-05-08T06:05:11.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.068+0000 7fd25d8c2b80 1 --2- 172.21.15.82:0/732764998 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55e74a74fb30 0x55e74a751f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:11.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.068+0000 7fd25d8c2b80 4 client.26771 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-08T06:05:11.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.068+0000 7fd25d8c2b80 1 -- 172.21.15.82:0/732764998 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e74a62a400 con 0x55e74a74fb30 2024-05-08T06:05:11.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.068+0000 7fd24be00700 1 --2- 172.21.15.82:0/732764998 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55e74a74fb30 0x55e74a751f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:11.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.069+0000 7fd24be00700 1 --2- 172.21.15.82:0/732764998 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55e74a74fb30 0x55e74a751f20 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ca2f955ccb3844c server_cookie=534b114b7d8dfe5c in_seq=0 out_seq=0 2024-05-08T06:05:11.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.069+0000 7fd236000700 10 client.26771 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T06:05:11.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.069+0000 7fd236000700 1 -- 172.21.15.82:0/732764998 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55e74a62a400 con 0x55e74a74fb30 2024-05-08T06:05:11.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.069+0000 7fd236000700 10 client.26771 handle_command_reply: tid=0 2024-05-08T06:05:11.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.069+0000 7fd25d8c2b80 1 client.26771 shutdown 2024-05-08T06:05:11.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.069+0000 7fd25d8c2b80 1 -- 172.21.15.82:0/732764998 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e74a6d04e0 msgr2=0x55e74a6d97e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:11.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.069+0000 7fd25d8c2b80 1 --2- 172.21.15.82:0/732764998 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e74a6d04e0 0x55e74a6d97e0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fd2440aa340 tx=0x7fd244004e20 comp rx=0 tx=0).stop 2024-05-08T06:05:11.071 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.069+0000 7fd25d8c2b80 1 -- 172.21.15.82:0/732764998 shutdown_connections 2024-05-08T06:05:11.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.069+0000 7fd25d8c2b80 1 --2- 172.21.15.82:0/732764998 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55e74a74fb30 0x55e74a751f20 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:11.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.069+0000 7fd236000700 0 client.26771 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T06:05:11.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.069+0000 7fd25d8c2b80 1 --2- 172.21.15.82:0/732764998 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e74a6d04e0 0x55e74a6d97e0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:11.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.070+0000 7fd25d8c2b80 1 --2- 172.21.15.82:0/732764998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e74a6ca8f0 0x55e74a6dc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:11.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.070+0000 7fd25d8c2b80 1 --2- 172.21.15.82:0/732764998 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55e74a6cfbc0 0x55e74a6d92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:11.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.070+0000 7fd25d8c2b80 1 -- 172.21.15.82:0/732764998 >> 172.21.15.82:0/732764998 conn(0x55e74a6426d0 msgr2=0x55e74a6cef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:05:11.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.070+0000 7fd25d8c2b80 1 -- 172.21.15.82:0/732764998 shutdown_connections 2024-05-08T06:05:11.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.070+0000 7fd25d8c2b80 1 -- 172.21.15.82:0/732764998 wait complete. 2024-05-08T06:05:11.072 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.070+0000 7fd25d8c2b80 20 client.26771 trim_cache size 0 max 16384 2024-05-08T06:05:11.073 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T06:05:11.073 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "no active scrubs running", 2024-05-08T06:05:11.073 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": {} 2024-05-08T06:05:11.073 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T06:05:11.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.071+0000 7fd253000700 1 -- 172.21.15.82:0/3918013798 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd2300b2a10 msgr2=0x7fd2300b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:11.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.071+0000 7fd253000700 1 --2- 172.21.15.82:0/3918013798 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd2300b2a10 0x7fd2300b4ed0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fd23c009d90 tx=0x7fd23c014750 comp rx=0 tx=0).stop 2024-05-08T06:05:11.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.071+0000 7fd253000700 1 -- 172.21.15.82:0/3918013798 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd24c10fb60 msgr2=0x7fd24c1a4a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:11.073 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.071+0000 7fd253000700 1 --2- 172.21.15.82:0/3918013798 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd24c10fb60 0x7fd24c1a4a60 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fd24400d010 tx=0x7fd244004c80 comp rx=0 tx=0).stop 2024-05-08T06:05:11.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.071+0000 7fd253000700 1 -- 172.21.15.82:0/3918013798 shutdown_connections 2024-05-08T06:05:11.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.071+0000 7fd253000700 1 --2- 172.21.15.82:0/3918013798 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd24c10fb60 0x7fd24c1a4a60 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:11.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.071+0000 7fd253000700 1 --2- 172.21.15.82:0/3918013798 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd2300b2a10 0x7fd2300b4ed0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:11.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.071+0000 7fd253000700 1 --2- 172.21.15.82:0/3918013798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd24c109ad0 0x7fd24c1a0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:11.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.071+0000 7fd253000700 1 --2- 172.21.15.82:0/3918013798 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd24c10a490 0x7fd24c1a06d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:11.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.071+0000 7fd253000700 1 -- 172.21.15.82:0/3918013798 >> 172.21.15.82:0/3918013798 conn(0x7fd24c076c70 msgr2=0x7fd24c077380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:05:11.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.071+0000 7fd253000700 1 -- 172.21.15.82:0/3918013798 shutdown_connections 2024-05-08T06:05:11.074 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:11.071+0000 7fd253000700 1 -- 172.21.15.82:0/3918013798 wait complete. 2024-05-08T06:05:11.901 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:05:11 smithi082 ceph-mon[30098]: pgmap v895: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 6.5 MiB/s wr, 632 op/s 2024-05-08T06:05:11.964 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-08T06:05:11.964 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T06:05:11.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:05:11 smithi134 ceph-mon[34132]: pgmap v895: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 6.5 MiB/s wr, 632 op/s 2024-05-08T06:05:12.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:05:11 smithi151 ceph-mon[34815]: pgmap v895: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 6.5 MiB/s wr, 632 op/s 2024-05-08T06:05:12.554 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:05:13.814 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:05:13 smithi082 ceph-mon[30098]: pgmap v896: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.6 MiB/s wr, 657 op/s 2024-05-08T06:05:13.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:05:13 smithi134 ceph-mon[34132]: pgmap v896: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.6 MiB/s wr, 657 op/s 2024-05-08T06:05:14.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:05:13 smithi151 ceph-mon[34815]: pgmap v896: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.6 MiB/s wr, 657 op/s 2024-05-08T06:05:15.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 865.0 s, 1022.4 tps, lat 97.009 ms stddev 139.828 2024-05-08T06:05:15.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:05:15 smithi082 ceph-mon[30098]: pgmap v897: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 6.0 MiB/s wr, 573 op/s 2024-05-08T06:05:15.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:15.962+0000 7fefc3200700 1 -- 172.21.15.82:0/3297609524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefc410a3a0 msgr2=0x7fefc4116840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:15.965 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:15.964+0000 7fefc3200700 1 --2- 172.21.15.82:0/3297609524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefc410a3a0 0x7fefc4116840 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fefbc009990 tx=0x7fefbc009ca0 comp rx=0 tx=0).stop 2024-05-08T06:05:15.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:15.965+0000 7fefc3200700 1 -- 172.21.15.82:0/3297609524 shutdown_connections 2024-05-08T06:05:15.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:15.965+0000 7fefc3200700 1 --2- 172.21.15.82:0/3297609524 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fefc410e8b0 0x7fefc410ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:15.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:15.965+0000 7fefc3200700 1 --2- 172.21.15.82:0/3297609524 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefc410a3a0 0x7fefc4116840 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:15.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:15.965+0000 7fefc3200700 1 --2- 172.21.15.82:0/3297609524 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fefc41099e0 0x7fefc4109e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:15.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:15.965+0000 7fefc3200700 1 -- 172.21.15.82:0/3297609524 >> 172.21.15.82:0/3297609524 conn(0x7fefc4079230 msgr2=0x7fefc41082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:05:15.966 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:15.966+0000 7fefc3200700 1 -- 172.21.15.82:0/3297609524 shutdown_connections 2024-05-08T06:05:15.967 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:15.966+0000 7fefc3200700 1 -- 172.21.15.82:0/3297609524 wait complete. 2024-05-08T06:05:15.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:15.968+0000 7fefc3200700 1 Processor -- start 2024-05-08T06:05:15.969 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:15.968+0000 7fefc3200700 1 -- start start 2024-05-08T06:05:15.970 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:15.970+0000 7fefc3200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefc41099e0 0x7fefc40839a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:15.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:15.970+0000 7fefc3200700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fefc410a3a0 0x7fefc4083ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:15.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:15.970+0000 7fefc3200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fefc410e8b0 0x7fefc407cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:15.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:15.971+0000 7fefc3200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fefc4119be0 con 0x7fefc41099e0 2024-05-08T06:05:15.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:15.971+0000 7fefbbe00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fefc410a3a0 0x7fefc4083ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:15.971 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:15.971+0000 7fefbbe00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fefc410a3a0 0x7fefc4083ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:35324/0 (socket says 172.21.15.82:35324) 2024-05-08T06:05:15.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:15.971+0000 7fefbbe00700 1 -- 172.21.15.82:0/3936356580 learned_addr learned my addr 172.21.15.82:0/3936356580 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:05:15.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:15.971+0000 7fefc2800700 1 --2- 172.21.15.82:0/3936356580 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fefc410e8b0 0x7fefc407cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:15.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:15.972+0000 7fefc3200700 1 -- 172.21.15.82:0/3936356580 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fefc4119a60 con 0x7fefc410e8b0 2024-05-08T06:05:15.972 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:15.972+0000 7fefc3200700 1 -- 172.21.15.82:0/3936356580 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fefc4119d60 con 0x7fefc410a3a0 2024-05-08T06:05:15.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:15.973+0000 7fefc1e00700 1 --2- 172.21.15.82:0/3936356580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefc41099e0 0x7fefc40839a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:15.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:15.973+0000 7fefbbe00700 1 -- 172.21.15.82:0/3936356580 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fefc410e8b0 msgr2=0x7fefc407cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:15.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:15.973+0000 7fefbbe00700 1 --2- 172.21.15.82:0/3936356580 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fefc410e8b0 0x7fefc407cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:15.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:15.973+0000 7fefbbe00700 1 -- 172.21.15.82:0/3936356580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefc41099e0 msgr2=0x7fefc40839a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:15.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:15.973+0000 7fefbbe00700 1 --2- 172.21.15.82:0/3936356580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefc41099e0 0x7fefc40839a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:15.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:15.973+0000 7fefbbe00700 1 -- 172.21.15.82:0/3936356580 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefc407d500 con 0x7fefc410a3a0 2024-05-08T06:05:15.974 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:15.973+0000 7fefbbe00700 1 --2- 172.21.15.82:0/3936356580 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fefc410a3a0 0x7fefc4083ee0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fefac00c9b0 tx=0x7fefac00ccc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:05:15.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:15.974+0000 7fefbaa00700 1 -- 172.21.15.82:0/3936356580 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefac007b00 con 0x7fefc410a3a0 2024-05-08T06:05:15.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:15.974+0000 7fefbaa00700 1 -- 172.21.15.82:0/3936356580 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fefac007ca0 con 0x7fefc410a3a0 2024-05-08T06:05:15.975 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:15.974+0000 7fefbaa00700 1 -- 172.21.15.82:0/3936356580 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefac018660 con 0x7fefc410a3a0 2024-05-08T06:05:15.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:15.974+0000 7fefc3200700 1 -- 172.21.15.82:0/3936356580 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefc407d7f0 con 0x7fefc410a3a0 2024-05-08T06:05:15.976 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:15.974+0000 7fefc3200700 1 -- 172.21.15.82:0/3936356580 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefc4081660 con 0x7fefc410a3a0 2024-05-08T06:05:15.978 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:15.978+0000 7fefc3200700 1 -- 172.21.15.82:0/3936356580 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefc406a190 con 0x7fefc410a3a0 2024-05-08T06:05:15.985 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:15.984+0000 7fefbaa00700 1 -- 172.21.15.82:0/3936356580 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fefac00f450 con 0x7fefc410a3a0 2024-05-08T06:05:15.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:15.989+0000 7fefbaa00700 1 --2- 172.21.15.82:0/3936356580 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fefa80b2900 0x7fefa80b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:15.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:15.990+0000 7fefbaa00700 1 -- 172.21.15.82:0/3936356580 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fefac0e25e0 con 0x7fefc410a3a0 2024-05-08T06:05:15.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:15.990+0000 7fefc1e00700 1 --2- 172.21.15.82:0/3936356580 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fefa80b2900 0x7fefa80b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:15.991 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:15.991+0000 7fefbaa00700 1 -- 172.21.15.82:0/3936356580 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fefac014030 con 0x7fefc410a3a0 2024-05-08T06:05:15.997 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:15.996+0000 7fefc1e00700 1 --2- 172.21.15.82:0/3936356580 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fefa80b2900 0x7fefa80b4dc0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fefb40094f0 tx=0x7fefb4009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:05:15.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:05:15 smithi134 ceph-mon[34132]: pgmap v897: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 6.0 MiB/s wr, 573 op/s 2024-05-08T06:05:16.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:05:15 smithi151 ceph-mon[34815]: pgmap v897: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 6.0 MiB/s wr, 573 op/s 2024-05-08T06:05:16.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:16.425+0000 7fefc3200700 1 -- 172.21.15.82:0/3936356580 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fefc407df20 con 0x7fefc410a3a0 2024-05-08T06:05:16.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:16.426+0000 7fefbaa00700 1 -- 172.21.15.82:0/3936356580 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11948 (secure 0 0 0) 0x7fefc407df20 con 0x7fefc410a3a0 2024-05-08T06:05:16.427 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T06:05:16.427 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14364,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3876883250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3876883250},{"type":"v1","addr":"172.21.15.82:6835","nonce":3876883250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1965070586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1965070586},{"type":"v1","addr":"172.21.15.82:6837","nonce":1965070586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":31,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T05:45:57.654009+0000","modified":"2024-05-08T05:53:20.165672+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24505,"mds_2":24487,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14397":{"gid":14397,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/1890720973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1890720973},{"type":"v1","addr":"172.21.15.82:6839","nonce":1890720973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14409":{"gid":14409,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/2957083305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":2957083305},{"type":"v1","addr":"172.21.15.82:6841","nonce":2957083305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6833/3827691638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3827691638},{"type":"v1","addr":"172.21.15.134:6833","nonce":3827691638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6833/3625067797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3625067797},{"type":"v1","addr":"172.21.15.151:6833","nonce":3625067797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/4074163402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4074163402},{"type":"v1","addr":"172.21.15.134:6835","nonce":4074163402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.134:6837/2212411710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2212411710},{"type":"v1","addr":"172.21.15.134:6837","nonce":2212411710}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":17,"addr":"172.21.15.151:6835/2093655929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2093655929},{"type":"v1","addr":"172.21.15.151:6835","nonce":2093655929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6837/4192404464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":4192404464},{"type":"v1","addr":"172.21.15.151:6837","nonce":4192404464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":14,"addr":"172.21.15.151:6839/2963754236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":2963754236},{"type":"v1","addr":"172.21.15.151:6839","nonce":2963754236}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.134:6839/1145270893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1145270893},{"type":"v1","addr":"172.21.15.134:6839","nonce":1145270893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24505,24506,24487,24475,24467]},"id":1}]} 2024-05-08T06:05:16.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:16.430+0000 7fefc3200700 1 -- 172.21.15.82:0/3936356580 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fefa80b2900 msgr2=0x7fefa80b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:16.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:16.430+0000 7fefc3200700 1 --2- 172.21.15.82:0/3936356580 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fefa80b2900 0x7fefa80b4dc0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fefb40094f0 tx=0x7fefb4009040 comp rx=0 tx=0).stop 2024-05-08T06:05:16.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:16.430+0000 7fefc3200700 1 -- 172.21.15.82:0/3936356580 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fefc410a3a0 msgr2=0x7fefc4083ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:16.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:16.430+0000 7fefc3200700 1 --2- 172.21.15.82:0/3936356580 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fefc410a3a0 0x7fefc4083ee0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fefac00c9b0 tx=0x7fefac00ccc0 comp rx=0 tx=0).stop 2024-05-08T06:05:16.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:16.430+0000 7fefc3200700 1 -- 172.21.15.82:0/3936356580 shutdown_connections 2024-05-08T06:05:16.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:16.430+0000 7fefc3200700 1 --2- 172.21.15.82:0/3936356580 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fefc410e8b0 0x7fefc407cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:16.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:16.430+0000 7fefc3200700 1 --2- 172.21.15.82:0/3936356580 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fefa80b2900 0x7fefa80b4dc0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:16.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:16.430+0000 7fefc3200700 1 --2- 172.21.15.82:0/3936356580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fefc41099e0 0x7fefc40839a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:16.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:16.430+0000 7fefc3200700 1 --2- 172.21.15.82:0/3936356580 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fefc410a3a0 0x7fefc4083ee0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:16.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:16.430+0000 7fefc3200700 1 -- 172.21.15.82:0/3936356580 >> 172.21.15.82:0/3936356580 conn(0x7fefc4079230 msgr2=0x7fefc4079790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:05:16.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:16.430+0000 7fefc3200700 1 -- 172.21.15.82:0/3936356580 shutdown_connections 2024-05-08T06:05:16.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:16.431+0000 7fefc3200700 1 -- 172.21.15.82:0/3936356580 wait complete. 2024-05-08T06:05:16.432 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 31 2024-05-08T06:05:16.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:05:16 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/3936356580' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:05:16.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:05:16 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/3936356580' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:05:17.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:05:16 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/3936356580' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:05:17.259 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-05-08T06:05:17.902 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:05:17.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:05:17 smithi082 ceph-mon[30098]: pgmap v898: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 7.9 MiB/s wr, 779 op/s 2024-05-08T06:05:17.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:05:17 smithi134 ceph-mon[34132]: pgmap v898: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 7.9 MiB/s wr, 779 op/s 2024-05-08T06:05:18.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:05:17 smithi151 ceph-mon[34815]: pgmap v898: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 7.9 MiB/s wr, 779 op/s 2024-05-08T06:05:19.849 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:05:19 smithi082 ceph-mon[30098]: pgmap v899: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.0 MiB/s wr, 604 op/s 2024-05-08T06:05:20.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:05:19 smithi134 ceph-mon[34132]: pgmap v899: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.0 MiB/s wr, 604 op/s 2024-05-08T06:05:20.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:05:19 smithi151 ceph-mon[34815]: pgmap v899: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 6.0 MiB/s wr, 604 op/s 2024-05-08T06:05:20.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 870.0 s, 1468.8 tps, lat 67.874 ms stddev 79.339 2024-05-08T06:05:20.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.485+0000 7f9fae000700 1 -- 172.21.15.82:0/1830126400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fa8103ee0 msgr2=0x7f9fa8110370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:20.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.485+0000 7f9fae000700 1 --2- 172.21.15.82:0/1830126400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fa8103ee0 0x7f9fa8110370 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0009990 tx=0x7f9fa0009ca0 comp rx=0 tx=0).stop 2024-05-08T06:05:20.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.486+0000 7f9fae000700 1 -- 172.21.15.82:0/1830126400 shutdown_connections 2024-05-08T06:05:20.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.486+0000 7f9fae000700 1 --2- 172.21.15.82:0/1830126400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fa8103ee0 0x7f9fa8110370 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:20.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.486+0000 7f9fae000700 1 --2- 172.21.15.82:0/1830126400 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9fa8109530 0x7f9fa8109910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:20.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.486+0000 7f9fae000700 1 --2- 172.21.15.82:0/1830126400 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9fa8103520 0x7f9fa81039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:20.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.486+0000 7f9fae000700 1 -- 172.21.15.82:0/1830126400 >> 172.21.15.82:0/1830126400 conn(0x7f9fa807a570 msgr2=0x7f9fa807a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:05:20.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.486+0000 7f9fae000700 1 -- 172.21.15.82:0/1830126400 shutdown_connections 2024-05-08T06:05:20.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.486+0000 7f9fae000700 1 -- 172.21.15.82:0/1830126400 wait complete. 2024-05-08T06:05:20.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.487+0000 7f9fae000700 1 Processor -- start 2024-05-08T06:05:20.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.488+0000 7f9fae000700 1 -- start start 2024-05-08T06:05:20.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.489+0000 7f9fae000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fa8103520 0x7f9fa80757a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:20.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.489+0000 7f9fae000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9fa8103ee0 0x7f9fa8075ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:20.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.489+0000 7f9fae000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9fa8109530 0x7f9fa8076220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:20.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.489+0000 7f9fae000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa81136c0 con 0x7f9fa8109530 2024-05-08T06:05:20.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.489+0000 7f9fae000700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa8113540 con 0x7f9fa8103520 2024-05-08T06:05:20.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.489+0000 7f9fae000700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa8113840 con 0x7f9fa8103ee0 2024-05-08T06:05:20.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.490+0000 7f9fa7e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9fa8109530 0x7f9fa8076220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:20.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.490+0000 7f9fa7e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9fa8109530 0x7f9fa8076220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54262/0 (socket says 172.21.15.82:54262) 2024-05-08T06:05:20.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.490+0000 7f9fa7e00700 1 -- 172.21.15.82:0/1279909543 learned_addr learned my addr 172.21.15.82:0/1279909543 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:05:20.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.490+0000 7f9fa7400700 1 --2- 172.21.15.82:0/1279909543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fa8103520 0x7f9fa80757a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:20.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.490+0000 7f9fa6a00700 1 --2- 172.21.15.82:0/1279909543 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9fa8103ee0 0x7f9fa8075ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:20.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.490+0000 7f9fa7e00700 1 -- 172.21.15.82:0/1279909543 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9fa8103ee0 msgr2=0x7f9fa8075ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:20.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.490+0000 7f9fa7e00700 1 --2- 172.21.15.82:0/1279909543 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9fa8103ee0 0x7f9fa8075ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:20.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.491+0000 7f9fa7e00700 1 -- 172.21.15.82:0/1279909543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fa8103520 msgr2=0x7f9fa80757a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:20.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.491+0000 7f9fa7e00700 1 --2- 172.21.15.82:0/1279909543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fa8103520 0x7f9fa80757a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:20.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.491+0000 7f9fa7e00700 1 -- 172.21.15.82:0/1279909543 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fa81ac4a0 con 0x7f9fa8109530 2024-05-08T06:05:20.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.491+0000 7f9fa6a00700 1 --2- 172.21.15.82:0/1279909543 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9fa8103ee0 0x7f9fa8075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:05:20.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.491+0000 7f9fa7e00700 1 --2- 172.21.15.82:0/1279909543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9fa8109530 0x7f9fa8076220 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0005b40 tx=0x7f9fa000bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:05:20.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.492+0000 7f9f9fe00700 1 -- 172.21.15.82:0/1279909543 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa0026070 con 0x7f9fa8109530 2024-05-08T06:05:20.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.492+0000 7f9f9fe00700 1 -- 172.21.15.82:0/1279909543 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9fa0021410 con 0x7f9fa8109530 2024-05-08T06:05:20.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.492+0000 7f9f9fe00700 1 -- 172.21.15.82:0/1279909543 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fa0017650 con 0x7f9fa8109530 2024-05-08T06:05:20.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.492+0000 7f9fae000700 1 -- 172.21.15.82:0/1279909543 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fa81ac6d0 con 0x7f9fa8109530 2024-05-08T06:05:20.493 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.492+0000 7f9fae000700 1 -- 172.21.15.82:0/1279909543 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fa81acbd0 con 0x7f9fa8109530 2024-05-08T06:05:20.497 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.496+0000 7f9f9fe00700 1 -- 172.21.15.82:0/1279909543 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f9fa0029070 con 0x7f9fa8109530 2024-05-08T06:05:20.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.497+0000 7f9fb88bab80 1 Processor -- start 2024-05-08T06:05:20.498 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.498+0000 7f9fb88bab80 1 -- start start 2024-05-08T06:05:20.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.498+0000 7f9fb88bab80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a5ceaaabc0 0x55a5ceaaafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:20.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.498+0000 7f9fb88bab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5ceaab4e0 0x55a5ceaa52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:20.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.498+0000 7f9fb88bab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5ceaa58f0 0x55a5ceaa5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:20.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.498+0000 7f9fb88bab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a5ce9f7a20 con 0x55a5ceaab4e0 2024-05-08T06:05:20.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.498+0000 7f9fb88bab80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a5ce995760 con 0x55a5ceaaabc0 2024-05-08T06:05:20.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.498+0000 7f9fb88bab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55a5ce9f39e0 con 0x55a5ceaa58f0 2024-05-08T06:05:20.499 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.498+0000 7f9f9fe00700 1 --2- 172.21.15.82:0/1279909543 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9f8c0b2980 0x7f9f8c0b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:20.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.498+0000 7f9fa6a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a5ceaaabc0 0x55a5ceaaafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:20.500 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.498+0000 7f9fa6a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a5ceaaabc0 0x55a5ceaaafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:48618/0 (socket says 172.21.15.82:48618) 2024-05-08T06:05:20.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.498+0000 7f9fa6a00700 1 -- 172.21.15.82:0/3561083348 learned_addr learned my addr 172.21.15.82:0/3561083348 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:05:20.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.499+0000 7f9fa6a00700 1 --2- 172.21.15.82:0/3561083348 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5ceaa58f0 0x55a5ceaa5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:20.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.499+0000 7f9f9fe00700 1 -- 172.21.15.82:0/1279909543 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f9fa00e2ea0 con 0x7f9fa8109530 2024-05-08T06:05:20.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.499+0000 7f9fa7400700 1 --2- 172.21.15.82:0/3561083348 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5ceaab4e0 0x55a5ceaa52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:20.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.499+0000 7f9fa6a00700 1 -- 172.21.15.82:0/3561083348 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5ceaa58f0 msgr2=0x55a5ceaa5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:20.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.499+0000 7f9fa6a00700 1 --2- 172.21.15.82:0/3561083348 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5ceaa58f0 0x55a5ceaa5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:20.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.499+0000 7f9fa6a00700 1 -- 172.21.15.82:0/3561083348 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5ceaab4e0 msgr2=0x55a5ceaa52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:20.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.499+0000 7f9fa6a00700 1 --2- 172.21.15.82:0/3561083348 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5ceaab4e0 0x55a5ceaa52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:20.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.499+0000 7f9fa6a00700 1 -- 172.21.15.82:0/3561083348 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5ce9448d0 con 0x55a5ceaaabc0 2024-05-08T06:05:20.501 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.499+0000 7f9fa7400700 1 --2- 172.21.15.82:0/3561083348 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5ceaab4e0 0x55a5ceaa52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:05:20.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.499+0000 7f9fa7e00700 1 --2- 172.21.15.82:0/1279909543 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9f8c0b2980 0x7f9f8c0b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:20.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.499+0000 7f9fa6a00700 1 --2- 172.21.15.82:0/3561083348 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a5ceaaabc0 0x55a5ceaaafa0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f9f94014940 tx=0x7f9f940096a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f01d1f6dcf84283b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:05:20.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.500+0000 7f9f9cc00700 1 -- 172.21.15.82:0/3561083348 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f940142d0 con 0x55a5ceaaabc0 2024-05-08T06:05:20.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.500+0000 7f9f9cc00700 1 -- 172.21.15.82:0/3561083348 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f940044e0 con 0x55a5ceaaabc0 2024-05-08T06:05:20.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.500+0000 7f9f9cc00700 1 -- 172.21.15.82:0/3561083348 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f94012450 con 0x55a5ceaaabc0 2024-05-08T06:05:20.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.500+0000 7f9fb88bab80 1 -- 172.21.15.82:0/3561083348 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a5ceaaabc0 msgr2=0x55a5ceaaafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:20.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.500+0000 7f9fa7e00700 1 --2- 172.21.15.82:0/1279909543 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9f8c0b2980 0x7f9f8c0b4e40 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9fa00a7770 tx=0x7f9fa0009ca0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:05:20.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.500+0000 7f9fb88bab80 1 --2- 172.21.15.82:0/3561083348 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a5ceaaabc0 0x55a5ceaaafa0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f9f94014940 tx=0x7f9f940096a0 comp rx=0 tx=0).stop 2024-05-08T06:05:20.503 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.501+0000 7f9fb88bab80 1 -- 172.21.15.82:0/3561083348 shutdown_connections 2024-05-08T06:05:20.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.501+0000 7f9fb88bab80 1 --2- 172.21.15.82:0/3561083348 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a5ceaaabc0 0x55a5ceaaafa0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:20.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.501+0000 7f9fb88bab80 1 --2- 172.21.15.82:0/3561083348 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5ceaa58f0 0x55a5ceaa5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:20.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.501+0000 7f9fb88bab80 1 --2- 172.21.15.82:0/3561083348 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5ceaab4e0 0x55a5ceaa52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:20.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.501+0000 7f9fb88bab80 1 -- 172.21.15.82:0/3561083348 >> 172.21.15.82:0/3561083348 conn(0x55a5cea1d6d0 msgr2=0x55a5cea9fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:05:20.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.501+0000 7f9fb88bab80 1 -- 172.21.15.82:0/3561083348 shutdown_connections 2024-05-08T06:05:20.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.501+0000 7f9fb88bab80 1 -- 172.21.15.82:0/3561083348 wait complete. 2024-05-08T06:05:20.504 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.501+0000 7f9fb88bab80 1 -- start start 2024-05-08T06:05:20.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.502+0000 7f9fb88bab80 1 Processor -- start 2024-05-08T06:05:20.505 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.502+0000 7f9fb88bab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5ceaa58f0 0x55a5ceab1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:20.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.502+0000 7f9fb88bab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5ceaaabc0 0x55a5ceaae570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:20.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.502+0000 7f9fb88bab80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a5ceaab4e0 0x55a5ceaaeab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:20.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.502+0000 7f9fb88bab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a5ceab1f70 con 0x55a5ceaaabc0 2024-05-08T06:05:20.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.502+0000 7f9fb88bab80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a5ce95db20 con 0x55a5ceaab4e0 2024-05-08T06:05:20.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.502+0000 7f9fb88bab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55a5ceab20f0 con 0x55a5ceaa58f0 2024-05-08T06:05:20.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.502+0000 7f9fb88bab80 10 client.0 _ll_register_callbacks cb 0x55a5ce99ec70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:05:20.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.503+0000 7f9fa7400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5ceaaabc0 0x55a5ceaae570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:20.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.503+0000 7f9fa6a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a5ceaab4e0 0x55a5ceaaeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:20.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.503+0000 7f9fa7400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5ceaaabc0 0x55a5ceaae570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:54270/0 (socket says 172.21.15.82:54270) 2024-05-08T06:05:20.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.503+0000 7f9fa7400700 1 -- 172.21.15.82:0/1087671158 learned_addr learned my addr 172.21.15.82:0/1087671158 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:05:20.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.503+0000 7f9fa6a00700 1 --2- 172.21.15.82:0/1087671158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5ceaa58f0 0x55a5ceab1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:20.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.503+0000 7f9fa7400700 1 -- 172.21.15.82:0/1087671158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5ceaa58f0 msgr2=0x55a5ceab1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:20.506 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.503+0000 7f9fa7400700 1 --2- 172.21.15.82:0/1087671158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5ceaa58f0 0x55a5ceab1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:20.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.503+0000 7f9fa7400700 1 -- 172.21.15.82:0/1087671158 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a5ceaab4e0 msgr2=0x55a5ceaaeab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:20.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.503+0000 7f9fa7400700 1 --2- 172.21.15.82:0/1087671158 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a5ceaab4e0 0x55a5ceaaeab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:20.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.503+0000 7f9fa7400700 1 -- 172.21.15.82:0/1087671158 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5ce9bd420 con 0x55a5ceaaabc0 2024-05-08T06:05:20.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.503+0000 7f9fa6a00700 1 --2- 172.21.15.82:0/1087671158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5ceaa58f0 0x55a5ceab1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:05:20.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.503+0000 7f9fa7400700 1 --2- 172.21.15.82:0/1087671158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5ceaaabc0 0x55a5ceaae570 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9f98007ae0 tx=0x7f9f98007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d602afbd3cc12b0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:05:20.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.503+0000 7f9f91600700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T06:05:20.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.504+0000 7f9f91600700 1 -- 172.21.15.82:0/1087671158 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f98011910 con 0x55a5ceaaabc0 2024-05-08T06:05:20.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.504+0000 7f9f91600700 1 -- 172.21.15.82:0/1087671158 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f9f98011ab0 con 0x55a5ceaaabc0 2024-05-08T06:05:20.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.504+0000 7f9fb88bab80 1 -- 172.21.15.82:0/1087671158 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f940044e0 con 0x55a5ceaaabc0 2024-05-08T06:05:20.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.504+0000 7f9f91600700 1 -- 172.21.15.82:0/1087671158 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f9f98011cb0 con 0x55a5ceaaabc0 2024-05-08T06:05:20.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.504+0000 7f9fb88bab80 10 client.16269 fetch_fsmap learned FSMap version 31 2024-05-08T06:05:20.507 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.504+0000 7f9fb88bab80 1 -- 172.21.15.82:0/1087671158 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a5ceacd7d0 con 0x55a5ceaaabc0 2024-05-08T06:05:20.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.506+0000 7f9f91600700 1 -- 172.21.15.82:0/1087671158 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f940044e0 con 0x55a5ceaaabc0 2024-05-08T06:05:20.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.506+0000 7f9f91600700 1 -- 172.21.15.82:0/1087671158 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f9f980154e0 con 0x55a5ceaaabc0 2024-05-08T06:05:20.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.506+0000 7f9fb88bab80 10 client.16269 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:05:20.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.506+0000 7f9fb88bab80 10 client.16269 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-05-08T06:05:20.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.507+0000 7f9fb88bab80 20 client.16269 populate_metadata read hostname 'smithi082' 2024-05-08T06:05:20.508 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.507+0000 7f9fb88bab80 1 --2- 172.21.15.82:0/1087671158 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x55a5ceacfe60 0x55a5cead2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:20.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.507+0000 7f9fb88bab80 4 client.16269 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:05:20.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.507+0000 7f9fb88bab80 1 -- 172.21.15.82:0/1087671158 --> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a5cea72140 con 0x55a5ceacfe60 2024-05-08T06:05:20.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.508+0000 7f9fa6a00700 1 --2- 172.21.15.82:0/1087671158 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x55a5ceacfe60 0x55a5cead2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:20.509 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.509+0000 7f9fa6a00700 1 --2- 172.21.15.82:0/1087671158 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x55a5ceacfe60 0x55a5cead2250 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9552fc1020fb7156 server_cookie=b54dde83416263ad in_seq=0 out_seq=0 2024-05-08T06:05:20.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.509+0000 7f9f91600700 10 client.16269 ms_handle_connect on v2:172.21.15.134:6836/2212411710 2024-05-08T06:05:20.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.510+0000 7f9f91600700 1 -- 172.21.15.82:0/1087671158 <== mds.4 v2:172.21.15.134:6836/2212411710 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a5cea72140 con 0x55a5ceacfe60 2024-05-08T06:05:20.510 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.510+0000 7f9f91600700 10 client.16269 handle_command_reply: tid=0 2024-05-08T06:05:20.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.510+0000 7f9fb88bab80 1 client.16269 shutdown 2024-05-08T06:05:20.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.510+0000 7f9fb88bab80 1 -- 172.21.15.82:0/1087671158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5ceaaabc0 msgr2=0x55a5ceaae570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:20.511 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.510+0000 7f9fb88bab80 1 --2- 172.21.15.82:0/1087671158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5ceaaabc0 0x55a5ceaae570 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f9f98007ae0 tx=0x7f9f98007df0 comp rx=0 tx=0).stop 2024-05-08T06:05:20.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.510+0000 7f9fb88bab80 1 -- 172.21.15.82:0/1087671158 shutdown_connections 2024-05-08T06:05:20.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.510+0000 7f9fb88bab80 1 --2- 172.21.15.82:0/1087671158 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x55a5ceacfe60 0x55a5cead2250 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:20.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.510+0000 7f9fb88bab80 1 --2- 172.21.15.82:0/1087671158 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a5ceaab4e0 0x55a5ceaaeab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:20.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.510+0000 7f9fb88bab80 1 --2- 172.21.15.82:0/1087671158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5ceaa58f0 0x55a5ceab1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:20.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.510+0000 7f9fb88bab80 1 --2- 172.21.15.82:0/1087671158 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5ceaaabc0 0x55a5ceaae570 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:20.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.510+0000 7f9fb88bab80 1 -- 172.21.15.82:0/1087671158 >> 172.21.15.82:0/1087671158 conn(0x55a5cea1d6d0 msgr2=0x55a5cea9f190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:05:20.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.510+0000 7f9f91600700 0 client.16269 ms_handle_reset on v2:172.21.15.134:6836/2212411710 2024-05-08T06:05:20.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.511+0000 7f9fb88bab80 1 -- 172.21.15.82:0/1087671158 shutdown_connections 2024-05-08T06:05:20.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.511+0000 7f9fb88bab80 1 -- 172.21.15.82:0/1087671158 wait complete. 2024-05-08T06:05:20.512 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.511+0000 7f9fb88bab80 20 client.16269 trim_cache size 0 max 16384 2024-05-08T06:05:20.536 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.535+0000 7f9fb88bab80 1 Processor -- start 2024-05-08T06:05:20.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.535+0000 7f9fb88bab80 1 -- start start 2024-05-08T06:05:20.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.535+0000 7f9fb88bab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5ceaa58f0 0x55a5ceaa52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:20.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.535+0000 7f9fb88bab80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a5ceaaabc0 0x55a5ceaabfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:20.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.535+0000 7f9fb88bab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5ceaab4e0 0x55a5cea9f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:20.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.535+0000 7f9fb88bab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa81a4d20 con 0x55a5ceaab4e0 2024-05-08T06:05:20.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.535+0000 7f9fb88bab80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa81ad330 con 0x55a5ceaaabc0 2024-05-08T06:05:20.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.535+0000 7f9fb88bab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa81a53f0 con 0x55a5ceaa58f0 2024-05-08T06:05:20.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.536+0000 7f9fa7400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a5ceaaabc0 0x55a5ceaabfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:20.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.536+0000 7f9fa6a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5ceaa58f0 0x55a5ceaa52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:20.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.536+0000 7f9fa7400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a5ceaaabc0 0x55a5ceaabfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:48638/0 (socket says 172.21.15.82:48638) 2024-05-08T06:05:20.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.536+0000 7f9fa7400700 1 -- 172.21.15.82:0/963694161 learned_addr learned my addr 172.21.15.82:0/963694161 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:05:20.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.536+0000 7f9fa6a00700 1 --2- 172.21.15.82:0/963694161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5ceaab4e0 0x55a5cea9f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:20.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.536+0000 7f9fa7400700 1 -- 172.21.15.82:0/963694161 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5ceaa58f0 msgr2=0x55a5ceaa52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:20.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.536+0000 7f9fa7400700 1 --2- 172.21.15.82:0/963694161 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5ceaa58f0 0x55a5ceaa52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:20.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.536+0000 7f9fa7400700 1 -- 172.21.15.82:0/963694161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5ceaab4e0 msgr2=0x55a5cea9f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:20.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.536+0000 7f9fa7400700 1 --2- 172.21.15.82:0/963694161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5ceaab4e0 0x55a5cea9f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:20.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.536+0000 7f9fa7400700 1 -- 172.21.15.82:0/963694161 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5cea9aab0 con 0x55a5ceaaabc0 2024-05-08T06:05:20.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.536+0000 7f9fa7400700 1 --2- 172.21.15.82:0/963694161 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a5ceaaabc0 0x55a5ceaabfd0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f9f98002230 tx=0x7f9f980095e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f9a7f1d91b62f47 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:05:20.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.537+0000 7f9f93e00700 1 -- 172.21.15.82:0/963694161 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f980119d0 con 0x55a5ceaaabc0 2024-05-08T06:05:20.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.537+0000 7f9f93e00700 1 -- 172.21.15.82:0/963694161 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f98011e50 con 0x55a5ceaaabc0 2024-05-08T06:05:20.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.537+0000 7f9f93e00700 1 -- 172.21.15.82:0/963694161 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f98003a00 con 0x55a5ceaaabc0 2024-05-08T06:05:20.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.538+0000 7f9fb88bab80 1 -- 172.21.15.82:0/963694161 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a5ceaaabc0 msgr2=0x55a5ceaabfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:20.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.538+0000 7f9fb88bab80 1 --2- 172.21.15.82:0/963694161 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a5ceaaabc0 0x55a5ceaabfd0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f9f98002230 tx=0x7f9f980095e0 comp rx=0 tx=0).stop 2024-05-08T06:05:20.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.538+0000 7f9fb88bab80 1 -- 172.21.15.82:0/963694161 shutdown_connections 2024-05-08T06:05:20.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.538+0000 7f9fb88bab80 1 --2- 172.21.15.82:0/963694161 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5ceaab4e0 0x55a5cea9f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:20.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.538+0000 7f9fb88bab80 1 --2- 172.21.15.82:0/963694161 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5ceaa58f0 0x55a5ceaa52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:20.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.538+0000 7f9fb88bab80 1 --2- 172.21.15.82:0/963694161 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a5ceaaabc0 0x55a5ceaabfd0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:20.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.538+0000 7f9fb88bab80 1 -- 172.21.15.82:0/963694161 >> 172.21.15.82:0/963694161 conn(0x55a5cea1d6d0 msgr2=0x55a5ceaab8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:05:20.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.538+0000 7f9fb88bab80 1 -- 172.21.15.82:0/963694161 shutdown_connections 2024-05-08T06:05:20.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.538+0000 7f9fb88bab80 1 -- 172.21.15.82:0/963694161 wait complete. 2024-05-08T06:05:20.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.538+0000 7f9fb88bab80 1 -- start start 2024-05-08T06:05:20.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.539+0000 7f9fb88bab80 1 Processor -- start 2024-05-08T06:05:20.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.539+0000 7f9fb88bab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5ceaa58f0 0x55a5ceab7560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:20.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.539+0000 7f9fb88bab80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a5ceaaabc0 0x55a5ceab7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:20.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.539+0000 7f9fb88bab80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5ceaab4e0 0x55a5cead6e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:20.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.539+0000 7f9fb88bab80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa81a6190 con 0x55a5ceaab4e0 2024-05-08T06:05:20.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.539+0000 7f9fb88bab80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa81a5ac0 con 0x55a5ceaaabc0 2024-05-08T06:05:20.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.539+0000 7f9fb88bab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa81a2ce0 con 0x55a5ceaa58f0 2024-05-08T06:05:20.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.539+0000 7f9fb88bab80 10 client.0 _ll_register_callbacks cb 0x55a5ce99ec70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:05:20.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.540+0000 7f9fa6a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5ceaa58f0 0x55a5ceab7560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:20.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.540+0000 7f9fa6a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5ceaa58f0 0x55a5ceab7560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:35384/0 (socket says 172.21.15.82:35384) 2024-05-08T06:05:20.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.540+0000 7f9fa6a00700 1 -- 172.21.15.82:0/3143538119 learned_addr learned my addr 172.21.15.82:0/3143538119 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:05:20.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.540+0000 7f9fa6a00700 1 --2- 172.21.15.82:0/3143538119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5ceaab4e0 0x55a5cead6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:20.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.540+0000 7f9fa7400700 1 --2- 172.21.15.82:0/3143538119 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a5ceaaabc0 0x55a5ceab7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:20.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.540+0000 7f9fa7400700 1 -- 172.21.15.82:0/3143538119 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5ceaa58f0 msgr2=0x55a5ceab7560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:20.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.540+0000 7f9fa7400700 1 --2- 172.21.15.82:0/3143538119 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5ceaa58f0 0x55a5ceab7560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:20.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.540+0000 7f9fa7400700 1 -- 172.21.15.82:0/3143538119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5ceaab4e0 msgr2=0x55a5cead6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:20.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.540+0000 7f9fa7400700 1 --2- 172.21.15.82:0/3143538119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5ceaab4e0 0x55a5cead6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:20.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.540+0000 7f9fa7400700 1 -- 172.21.15.82:0/3143538119 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5cead76a0 con 0x55a5ceaaabc0 2024-05-08T06:05:20.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.541+0000 7f9fa7400700 1 --2- 172.21.15.82:0/3143538119 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a5ceaaabc0 0x55a5ceab7aa0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9f98007ae0 tx=0x7f9f98007df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7fb2842ec3400dd1 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:05:20.543 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.541+0000 7f9f91600700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T06:05:20.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.541+0000 7f9f91600700 1 -- 172.21.15.82:0/3143538119 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f98034020 con 0x55a5ceaaabc0 2024-05-08T06:05:20.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.541+0000 7f9f91600700 1 -- 172.21.15.82:0/3143538119 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f9f980153d0 con 0x55a5ceaaabc0 2024-05-08T06:05:20.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.541+0000 7f9fb88bab80 1 -- 172.21.15.82:0/3143538119 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f98011e50 con 0x55a5ceaaabc0 2024-05-08T06:05:20.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.542+0000 7f9f91600700 1 -- 172.21.15.82:0/3143538119 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f9f98015610 con 0x55a5ceaaabc0 2024-05-08T06:05:20.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.542+0000 7f9fb88bab80 10 client.26795 fetch_fsmap learned FSMap version 31 2024-05-08T06:05:20.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.542+0000 7f9fb88bab80 1 -- 172.21.15.82:0/3143538119 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a5ceb3a370 con 0x55a5ceaaabc0 2024-05-08T06:05:20.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.543+0000 7f9f91600700 1 -- 172.21.15.82:0/3143538119 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9f98011e50 con 0x55a5ceaaabc0 2024-05-08T06:05:20.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.543+0000 7f9f91600700 1 -- 172.21.15.82:0/3143538119 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f9f980056c0 con 0x55a5ceaaabc0 2024-05-08T06:05:20.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.543+0000 7f9fb88bab80 10 client.26795 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:05:20.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.543+0000 7f9fb88bab80 10 client.26795 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-05-08T06:05:20.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.543+0000 7f9fb88bab80 20 client.26795 populate_metadata read hostname 'smithi082' 2024-05-08T06:05:20.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.543+0000 7f9fb88bab80 1 --2- 172.21.15.82:0/3143538119 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x55a5ceb3a9c0 0x55a5ceb3cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:20.544 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.543+0000 7f9fb88bab80 4 client.26795 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T06:05:20.545 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.543+0000 7f9fb88bab80 1 -- 172.21.15.82:0/3143538119 --> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a5cea05400 con 0x55a5ceb3a9c0 2024-05-08T06:05:20.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.543+0000 7f9fa6a00700 1 --2- 172.21.15.82:0/3143538119 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x55a5ceb3a9c0 0x55a5ceb3cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:20.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.544+0000 7f9fa6a00700 1 --2- 172.21.15.82:0/3143538119 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x55a5ceb3a9c0 0x55a5ceb3cde0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=75a3fd36ebfc17d0 server_cookie=ec5fbbe2d0d53d37 in_seq=0 out_seq=0 2024-05-08T06:05:20.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.544+0000 7f9f91600700 10 client.26795 ms_handle_connect on v2:172.21.15.134:6836/2212411710 2024-05-08T06:05:20.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.544+0000 7f9f91600700 1 -- 172.21.15.82:0/3143538119 <== mds.4 v2:172.21.15.134:6836/2212411710 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a5cea05400 con 0x55a5ceb3a9c0 2024-05-08T06:05:20.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.544+0000 7f9f91600700 10 client.26795 handle_command_reply: tid=0 2024-05-08T06:05:20.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.544+0000 7f9fb88bab80 1 client.26795 shutdown 2024-05-08T06:05:20.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.545+0000 7f9fb88bab80 1 -- 172.21.15.82:0/3143538119 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a5ceaaabc0 msgr2=0x55a5ceab7aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:20.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.545+0000 7f9fb88bab80 1 --2- 172.21.15.82:0/3143538119 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a5ceaaabc0 0x55a5ceab7aa0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9f98007ae0 tx=0x7f9f98007df0 comp rx=0 tx=0).stop 2024-05-08T06:05:20.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.545+0000 7f9fb88bab80 1 -- 172.21.15.82:0/3143538119 shutdown_connections 2024-05-08T06:05:20.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.545+0000 7f9fb88bab80 1 --2- 172.21.15.82:0/3143538119 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x55a5ceb3a9c0 0x55a5ceb3cde0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:20.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.545+0000 7f9fb88bab80 1 --2- 172.21.15.82:0/3143538119 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a5ceaab4e0 0x55a5cead6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:20.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.545+0000 7f9fb88bab80 1 --2- 172.21.15.82:0/3143538119 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5ceaa58f0 0x55a5ceab7560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:20.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.545+0000 7f9f91600700 0 client.26795 ms_handle_reset on v2:172.21.15.134:6836/2212411710 2024-05-08T06:05:20.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.545+0000 7f9fb88bab80 1 --2- 172.21.15.82:0/3143538119 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a5ceaaabc0 0x55a5ceab7aa0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:20.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.545+0000 7f9fb88bab80 1 -- 172.21.15.82:0/3143538119 >> 172.21.15.82:0/3143538119 conn(0x55a5cea1d6d0 msgr2=0x55a5ceaa9660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:05:20.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.545+0000 7f9fb88bab80 1 -- 172.21.15.82:0/3143538119 shutdown_connections 2024-05-08T06:05:20.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.545+0000 7f9fb88bab80 1 -- 172.21.15.82:0/3143538119 wait complete. 2024-05-08T06:05:20.547 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.545+0000 7f9fb88bab80 20 client.26795 trim_cache size 0 max 16384 2024-05-08T06:05:20.547 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T06:05:20.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.546+0000 7f9fae000700 1 -- 172.21.15.82:0/1279909543 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9f8c0b2980 msgr2=0x7f9f8c0b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:20.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.546+0000 7f9fae000700 1 --2- 172.21.15.82:0/1279909543 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9f8c0b2980 0x7f9f8c0b4e40 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f9fa00a7770 tx=0x7f9fa0009ca0 comp rx=0 tx=0).stop 2024-05-08T06:05:20.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.546+0000 7f9fae000700 1 -- 172.21.15.82:0/1279909543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9fa8109530 msgr2=0x7f9fa8076220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:20.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.546+0000 7f9fae000700 1 --2- 172.21.15.82:0/1279909543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9fa8109530 0x7f9fa8076220 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f9fa0005b40 tx=0x7f9fa000bf60 comp rx=0 tx=0).stop 2024-05-08T06:05:20.548 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.546+0000 7f9fae000700 1 -- 172.21.15.82:0/1279909543 shutdown_connections 2024-05-08T06:05:20.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.546+0000 7f9fae000700 1 --2- 172.21.15.82:0/1279909543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9fa8103520 0x7f9fa80757a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:20.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.546+0000 7f9fae000700 1 --2- 172.21.15.82:0/1279909543 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9f8c0b2980 0x7f9f8c0b4e40 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:20.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.546+0000 7f9fae000700 1 --2- 172.21.15.82:0/1279909543 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9fa8109530 0x7f9fa8076220 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:20.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.546+0000 7f9fae000700 1 --2- 172.21.15.82:0/1279909543 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9fa8103ee0 0x7f9fa8075ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:20.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.546+0000 7f9fae000700 1 -- 172.21.15.82:0/1279909543 >> 172.21.15.82:0/1279909543 conn(0x7f9fa807a570 msgr2=0x7f9fa81020b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:05:20.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.547+0000 7f9fae000700 1 -- 172.21.15.82:0/1279909543 shutdown_connections 2024-05-08T06:05:20.549 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:20.547+0000 7f9fae000700 1 -- 172.21.15.82:0/1279909543 wait complete. 2024-05-08T06:05:21.380 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-05-08T06:05:21.965 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:05:21.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:05:21 smithi082 ceph-mon[30098]: pgmap v900: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.3 MiB/s wr, 621 op/s 2024-05-08T06:05:22.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:05:21 smithi134 ceph-mon[34132]: pgmap v900: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.3 MiB/s wr, 621 op/s 2024-05-08T06:05:22.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:05:21 smithi151 ceph-mon[34815]: pgmap v900: 97 pgs: 97 active+clean; 1.6 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.3 MiB/s wr, 621 op/s 2024-05-08T06:05:23.987 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:05:23 smithi082 ceph-mon[30098]: pgmap v901: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.1 MiB/s wr, 675 op/s 2024-05-08T06:05:23.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:05:23 smithi134 ceph-mon[34132]: pgmap v901: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.1 MiB/s wr, 675 op/s 2024-05-08T06:05:24.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:05:23 smithi151 ceph-mon[34815]: pgmap v901: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.1 MiB/s wr, 675 op/s 2024-05-08T06:05:24.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.370+0000 7fa9e2600700 1 -- 172.21.15.82:0/1049942120 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa9dc104100 msgr2=0x7fa9dc108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:24.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.370+0000 7fa9e2600700 1 --2- 172.21.15.82:0/1049942120 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa9dc104100 0x7fa9dc108120 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fa9c8009990 tx=0x7fa9c8009ca0 comp rx=0 tx=0).stop 2024-05-08T06:05:24.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.371+0000 7fa9e2600700 1 -- 172.21.15.82:0/1049942120 shutdown_connections 2024-05-08T06:05:24.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.371+0000 7fa9e2600700 1 --2- 172.21.15.82:0/1049942120 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9dc108850 0x7fa9dc1103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:24.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.371+0000 7fa9e2600700 1 --2- 172.21.15.82:0/1049942120 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9dc103750 0x7fa9dc103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:24.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.371+0000 7fa9e2600700 1 --2- 172.21.15.82:0/1049942120 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa9dc104100 0x7fa9dc108120 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:24.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.371+0000 7fa9e2600700 1 -- 172.21.15.82:0/1049942120 >> 172.21.15.82:0/1049942120 conn(0x7fa9dc07a600 msgr2=0x7fa9dc07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:05:24.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.371+0000 7fa9e2600700 1 -- 172.21.15.82:0/1049942120 shutdown_connections 2024-05-08T06:05:24.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.371+0000 7fa9e2600700 1 -- 172.21.15.82:0/1049942120 wait complete. 2024-05-08T06:05:24.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.373+0000 7fa9e2600700 1 Processor -- start 2024-05-08T06:05:24.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.373+0000 7fa9e2600700 1 -- start start 2024-05-08T06:05:24.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.374+0000 7fa9e2600700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa9dc103750 0x7fa9dc19bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:24.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.374+0000 7fa9e2600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9dc108850 0x7fa9dc19c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:24.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.374+0000 7fa9e2600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9dc1a0800 0x7fa9dc1a0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:24.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.374+0000 7fa9e2600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa9dc077210 con 0x7fa9dc108850 2024-05-08T06:05:24.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.374+0000 7fa9db400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa9dc103750 0x7fa9dc19bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:24.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.375+0000 7fa9dbe00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9dc1a0800 0x7fa9dc1a0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:24.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.375+0000 7fa9dbe00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9dc1a0800 0x7fa9dc1a0c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:52254/0 (socket says 172.21.15.82:52254) 2024-05-08T06:05:24.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.375+0000 7fa9dbe00700 1 -- 172.21.15.82:0/2818965322 learned_addr learned my addr 172.21.15.82:0/2818965322 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:05:24.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.375+0000 7fa9daa00700 1 --2- 172.21.15.82:0/2818965322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9dc108850 0x7fa9dc19c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:24.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.375+0000 7fa9e2600700 1 -- 172.21.15.82:0/2818965322 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa9dc077090 con 0x7fa9dc1a0800 2024-05-08T06:05:24.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.375+0000 7fa9e2600700 1 -- 172.21.15.82:0/2818965322 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa9dc077390 con 0x7fa9dc103750 2024-05-08T06:05:24.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.375+0000 7fa9dbe00700 1 -- 172.21.15.82:0/2818965322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa9dc103750 msgr2=0x7fa9dc19bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:24.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.376+0000 7fa9dbe00700 1 --2- 172.21.15.82:0/2818965322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa9dc103750 0x7fa9dc19bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:24.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.376+0000 7fa9dbe00700 1 -- 172.21.15.82:0/2818965322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9dc108850 msgr2=0x7fa9dc19c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:24.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.376+0000 7fa9dbe00700 1 --2- 172.21.15.82:0/2818965322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9dc108850 0x7fa9dc19c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:24.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.376+0000 7fa9dbe00700 1 -- 172.21.15.82:0/2818965322 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9dc1a1320 con 0x7fa9dc1a0800 2024-05-08T06:05:24.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.376+0000 7fa9daa00700 1 --2- 172.21.15.82:0/2818965322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9dc108850 0x7fa9dc19c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:05:24.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.376+0000 7fa9db400700 1 --2- 172.21.15.82:0/2818965322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa9dc103750 0x7fa9dc19bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:05:24.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.377+0000 7fa9dbe00700 1 --2- 172.21.15.82:0/2818965322 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9dc1a0800 0x7fa9dc1a0c80 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4007ee0 tx=0x7fa9d400d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:05:24.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.377+0000 7fa9d3e00700 1 -- 172.21.15.82:0/2818965322 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d400ddd0 con 0x7fa9dc1a0800 2024-05-08T06:05:24.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.377+0000 7fa9e2600700 1 -- 172.21.15.82:0/2818965322 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9dc1a1610 con 0x7fa9dc1a0800 2024-05-08T06:05:24.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.377+0000 7fa9d3e00700 1 -- 172.21.15.82:0/2818965322 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9d4004020 con 0x7fa9dc1a0800 2024-05-08T06:05:24.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.377+0000 7fa9d3e00700 1 -- 172.21.15.82:0/2818965322 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d4015660 con 0x7fa9dc1a0800 2024-05-08T06:05:24.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.377+0000 7fa9e2600700 1 -- 172.21.15.82:0/2818965322 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9dc111e60 con 0x7fa9dc1a0800 2024-05-08T06:05:24.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.382+0000 7fa9d3e00700 1 -- 172.21.15.82:0/2818965322 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fa9d40044f0 con 0x7fa9dc1a0800 2024-05-08T06:05:24.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.384+0000 7fa9ecf8eb80 1 Processor -- start 2024-05-08T06:05:24.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.384+0000 7fa9d3e00700 1 --2- 172.21.15.82:0/2818965322 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fa9c00b28c0 0x7fa9c00b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:24.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.384+0000 7fa9ecf8eb80 1 -- start start 2024-05-08T06:05:24.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.384+0000 7fa9d3e00700 1 -- 172.21.15.82:0/2818965322 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fa9d40e1d40 con 0x7fa9dc1a0800 2024-05-08T06:05:24.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.384+0000 7fa9daa00700 1 --2- 172.21.15.82:0/2818965322 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fa9c00b28c0 0x7fa9c00b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:24.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.384+0000 7fa9ecf8eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b0b54e060 0x563b0b54e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:24.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.384+0000 7fa9ecf8eb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b0b54e980 0x563b0b552490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:24.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.384+0000 7fa9ecf8eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b0b5529d0 0x563b0b552e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:24.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.384+0000 7fa9ecf8eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x563b0b4a0a20 con 0x563b0b54e060 2024-05-08T06:05:24.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.384+0000 7fa9ecf8eb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x563b0b43e760 con 0x563b0b54e980 2024-05-08T06:05:24.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.384+0000 7fa9ecf8eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x563b0b49c9e0 con 0x563b0b5529d0 2024-05-08T06:05:24.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.385+0000 7fa9db400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b0b54e060 0x563b0b54e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:24.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.385+0000 7fa9daa00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b0b54e980 0x563b0b552490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:24.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.385+0000 7fa9db400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b0b54e060 0x563b0b54e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53232/0 (socket says 172.21.15.82:53232) 2024-05-08T06:05:24.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.385+0000 7fa9db400700 1 -- 172.21.15.82:0/2888121564 learned_addr learned my addr 172.21.15.82:0/2888121564 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:05:24.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.385+0000 7fa9dbe00700 1 --2- 172.21.15.82:0/2888121564 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b0b5529d0 0x563b0b552e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:24.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.385+0000 7fa9dbe00700 1 -- 172.21.15.82:0/2888121564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b0b54e980 msgr2=0x563b0b552490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:24.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.385+0000 7fa9dbe00700 1 --2- 172.21.15.82:0/2888121564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b0b54e980 0x563b0b552490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:24.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.385+0000 7fa9dbe00700 1 -- 172.21.15.82:0/2888121564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b0b54e060 msgr2=0x563b0b54e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:24.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.385+0000 7fa9dbe00700 1 --2- 172.21.15.82:0/2888121564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b0b54e060 0x563b0b54e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:24.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.385+0000 7fa9dbe00700 1 -- 172.21.15.82:0/2888121564 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b0b3ed8d0 con 0x563b0b5529d0 2024-05-08T06:05:24.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.385+0000 7fa9db400700 1 --2- 172.21.15.82:0/2888121564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b0b54e060 0x563b0b54e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:05:24.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.385+0000 7fa9daa00700 1 --2- 172.21.15.82:0/2818965322 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fa9c00b28c0 0x7fa9c00b4d80 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa9c8000c00 tx=0x7fa9c80096b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:05:24.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.385+0000 7fa9dbe00700 1 --2- 172.21.15.82:0/2888121564 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b0b5529d0 0x563b0b552e30 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa9d40dfbc0 tx=0x7fa9d40a8f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=154957fe2f3b028e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:05:24.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.386+0000 7fa9d0c00700 1 -- 172.21.15.82:0/2888121564 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d40ad720 con 0x563b0b5529d0 2024-05-08T06:05:24.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.386+0000 7fa9d0c00700 1 -- 172.21.15.82:0/2888121564 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9d40b21d0 con 0x563b0b5529d0 2024-05-08T06:05:24.388 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.386+0000 7fa9d0c00700 1 -- 172.21.15.82:0/2888121564 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d40a4ce0 con 0x563b0b5529d0 2024-05-08T06:05:24.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.388+0000 7fa9ecf8eb80 1 -- 172.21.15.82:0/2888121564 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b0b5529d0 msgr2=0x563b0b552e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:24.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.388+0000 7fa9ecf8eb80 1 --2- 172.21.15.82:0/2888121564 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b0b5529d0 0x563b0b552e30 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa9d40dfbc0 tx=0x7fa9d40a8f00 comp rx=0 tx=0).stop 2024-05-08T06:05:24.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.388+0000 7fa9ecf8eb80 1 -- 172.21.15.82:0/2888121564 shutdown_connections 2024-05-08T06:05:24.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.388+0000 7fa9ecf8eb80 1 --2- 172.21.15.82:0/2888121564 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b0b5529d0 0x563b0b552e30 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:24.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.388+0000 7fa9ecf8eb80 1 --2- 172.21.15.82:0/2888121564 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b0b54e060 0x563b0b54e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:24.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.388+0000 7fa9ecf8eb80 1 --2- 172.21.15.82:0/2888121564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b0b54e980 0x563b0b552490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:24.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.388+0000 7fa9ecf8eb80 1 -- 172.21.15.82:0/2888121564 >> 172.21.15.82:0/2888121564 conn(0x563b0b47cb60 msgr2=0x563b0b5487a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:05:24.389 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.388+0000 7fa9ecf8eb80 1 -- 172.21.15.82:0/2888121564 shutdown_connections 2024-05-08T06:05:24.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.389+0000 7fa9ecf8eb80 1 -- 172.21.15.82:0/2888121564 wait complete. 2024-05-08T06:05:24.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.389+0000 7fa9ecf8eb80 1 -- start start 2024-05-08T06:05:24.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.389+0000 7fa9ecf8eb80 1 Processor -- start 2024-05-08T06:05:24.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.390+0000 7fa9ecf8eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b0b54e060 0x563b0b559ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:24.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.390+0000 7fa9ecf8eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b0b54e980 0x563b0b557240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:24.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.390+0000 7fa9ecf8eb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b0b5529d0 0x563b0b557780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:24.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.390+0000 7fa9ecf8eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x563b0b55ab80 con 0x563b0b54e980 2024-05-08T06:05:24.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.390+0000 7fa9ecf8eb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x563b0b406b20 con 0x563b0b5529d0 2024-05-08T06:05:24.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.390+0000 7fa9ecf8eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x563b0b55ad00 con 0x563b0b54e060 2024-05-08T06:05:24.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.390+0000 7fa9ecf8eb80 10 client.0 _ll_register_callbacks cb 0x563b0b447c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:05:24.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.390+0000 7fa9daa00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b0b54e980 0x563b0b557240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:24.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.390+0000 7fa9daa00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b0b54e980 0x563b0b557240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53238/0 (socket says 172.21.15.82:53238) 2024-05-08T06:05:24.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.390+0000 7fa9daa00700 1 -- 172.21.15.82:0/796740797 learned_addr learned my addr 172.21.15.82:0/796740797 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:05:24.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.390+0000 7fa9db400700 1 --2- 172.21.15.82:0/796740797 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b0b54e060 0x563b0b559ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:24.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.390+0000 7fa9dbe00700 1 --2- 172.21.15.82:0/796740797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b0b5529d0 0x563b0b557780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:24.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.390+0000 7fa9daa00700 1 -- 172.21.15.82:0/796740797 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b0b54e060 msgr2=0x563b0b559ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:24.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.390+0000 7fa9daa00700 1 --2- 172.21.15.82:0/796740797 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b0b54e060 0x563b0b559ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:24.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.391+0000 7fa9daa00700 1 -- 172.21.15.82:0/796740797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b0b5529d0 msgr2=0x563b0b557780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:24.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.391+0000 7fa9daa00700 1 --2- 172.21.15.82:0/796740797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b0b5529d0 0x563b0b557780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:24.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.391+0000 7fa9daa00700 1 -- 172.21.15.82:0/796740797 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b0b466420 con 0x563b0b54e980 2024-05-08T06:05:24.392 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.391+0000 7fa9dbe00700 1 --2- 172.21.15.82:0/796740797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b0b5529d0 0x563b0b557780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:05:24.393 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.391+0000 7fa9daa00700 1 --2- 172.21.15.82:0/796740797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b0b54e980 0x563b0b557240 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa9c8009990 tx=0x7fa9c8009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21df59e2158f475f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:05:24.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.391+0000 7fa9c5600700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T06:05:24.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.391+0000 7fa9c5600700 1 -- 172.21.15.82:0/796740797 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c800be20 con 0x563b0b54e980 2024-05-08T06:05:24.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.391+0000 7fa9c5600700 1 -- 172.21.15.82:0/796740797 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fa9c8005430 con 0x563b0b54e980 2024-05-08T06:05:24.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.391+0000 7fa9ecf8eb80 1 -- 172.21.15.82:0/796740797 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9d40b21d0 con 0x563b0b54e980 2024-05-08T06:05:24.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.391+0000 7fa9c5600700 1 -- 172.21.15.82:0/796740797 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fa9c8005630 con 0x563b0b54e980 2024-05-08T06:05:24.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.391+0000 7fa9ecf8eb80 10 client.16284 fetch_fsmap learned FSMap version 31 2024-05-08T06:05:24.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.391+0000 7fa9ecf8eb80 1 -- 172.21.15.82:0/796740797 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x563b0b576490 con 0x563b0b54e980 2024-05-08T06:05:24.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.392+0000 7fa9c5600700 1 -- 172.21.15.82:0/796740797 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9d40b21d0 con 0x563b0b54e980 2024-05-08T06:05:24.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.392+0000 7fa9c5600700 1 -- 172.21.15.82:0/796740797 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fa9c800f770 con 0x563b0b54e980 2024-05-08T06:05:24.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.392+0000 7fa9ecf8eb80 10 client.16284 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:05:24.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.392+0000 7fa9ecf8eb80 10 client.16284 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-05-08T06:05:24.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.392+0000 7fa9ecf8eb80 20 client.16284 populate_metadata read hostname 'smithi082' 2024-05-08T06:05:24.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.392+0000 7fa9ecf8eb80 1 --2- 172.21.15.82:0/796740797 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x563b0b578b20 0x563b0b57af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:24.394 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.392+0000 7fa9ecf8eb80 4 client.16284 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:05:24.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.392+0000 7fa9ecf8eb80 1 -- 172.21.15.82:0/796740797 --> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563b0b51b0a0 con 0x563b0b578b20 2024-05-08T06:05:24.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.393+0000 7fa9db400700 1 --2- 172.21.15.82:0/796740797 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x563b0b578b20 0x563b0b57af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:24.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.394+0000 7fa9db400700 1 --2- 172.21.15.82:0/796740797 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x563b0b578b20 0x563b0b57af10 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=88e90a5153a6c664 server_cookie=5970d24c963b51f4 in_seq=0 out_seq=0 2024-05-08T06:05:24.395 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.394+0000 7fa9c5600700 10 client.16284 ms_handle_connect on v2:172.21.15.151:6834/2093655929 2024-05-08T06:05:24.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.395+0000 7fa9c5600700 1 -- 172.21.15.82:0/796740797 <== mds.3 v2:172.21.15.151:6834/2093655929 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x563b0b51b0a0 con 0x563b0b578b20 2024-05-08T06:05:24.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.395+0000 7fa9c5600700 10 client.16284 handle_command_reply: tid=0 2024-05-08T06:05:24.396 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.395+0000 7fa9ecf8eb80 1 client.16284 shutdown 2024-05-08T06:05:24.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.395+0000 7fa9ecf8eb80 1 -- 172.21.15.82:0/796740797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b0b54e980 msgr2=0x563b0b557240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:24.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.395+0000 7fa9ecf8eb80 1 --2- 172.21.15.82:0/796740797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b0b54e980 0x563b0b557240 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fa9c8009990 tx=0x7fa9c8009ca0 comp rx=0 tx=0).stop 2024-05-08T06:05:24.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.395+0000 7fa9ecf8eb80 1 -- 172.21.15.82:0/796740797 shutdown_connections 2024-05-08T06:05:24.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.395+0000 7fa9ecf8eb80 1 --2- 172.21.15.82:0/796740797 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x563b0b578b20 0x563b0b57af10 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:24.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.395+0000 7fa9ecf8eb80 1 --2- 172.21.15.82:0/796740797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b0b5529d0 0x563b0b557780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:24.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.395+0000 7fa9ecf8eb80 1 --2- 172.21.15.82:0/796740797 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b0b54e060 0x563b0b559ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:24.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.395+0000 7fa9ecf8eb80 1 --2- 172.21.15.82:0/796740797 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b0b54e980 0x563b0b557240 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:24.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.395+0000 7fa9ecf8eb80 1 -- 172.21.15.82:0/796740797 >> 172.21.15.82:0/796740797 conn(0x563b0b47cb60 msgr2=0x563b0b5432b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:05:24.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.396+0000 7fa9c5600700 0 client.16284 ms_handle_reset on v2:172.21.15.151:6834/2093655929 2024-05-08T06:05:24.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.396+0000 7fa9ecf8eb80 1 -- 172.21.15.82:0/796740797 shutdown_connections 2024-05-08T06:05:24.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.396+0000 7fa9ecf8eb80 1 -- 172.21.15.82:0/796740797 wait complete. 2024-05-08T06:05:24.397 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.396+0000 7fa9ecf8eb80 20 client.16284 trim_cache size 0 max 16384 2024-05-08T06:05:24.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.417+0000 7fa9ecf8eb80 1 Processor -- start 2024-05-08T06:05:24.418 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.418+0000 7fa9ecf8eb80 1 -- start start 2024-05-08T06:05:24.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.418+0000 7fa9ecf8eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b0b54e060 0x563b0b5807c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:24.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.418+0000 7fa9ecf8eb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b0b54e980 0x563b0b580d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:24.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.418+0000 7fa9ecf8eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b0b5529d0 0x563b0b5502c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:24.419 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.418+0000 7fa9ecf8eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa9dc1abd90 con 0x563b0b5529d0 2024-05-08T06:05:24.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.418+0000 7fa9ecf8eb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa9dc1ad8d0 con 0x563b0b54e980 2024-05-08T06:05:24.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.418+0000 7fa9ecf8eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa9dc1ac460 con 0x563b0b54e060 2024-05-08T06:05:24.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.418+0000 7fa9daa00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b0b54e980 0x563b0b580d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:24.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.418+0000 7fa9daa00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b0b54e980 0x563b0b580d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:52282/0 (socket says 172.21.15.82:52282) 2024-05-08T06:05:24.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.418+0000 7fa9daa00700 1 -- 172.21.15.82:0/2912624773 learned_addr learned my addr 172.21.15.82:0/2912624773 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:05:24.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.419+0000 7fa9db400700 1 --2- 172.21.15.82:0/2912624773 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b0b54e060 0x563b0b5807c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:24.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.419+0000 7fa9daa00700 1 -- 172.21.15.82:0/2912624773 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b0b54e060 msgr2=0x563b0b5807c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:24.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.419+0000 7fa9daa00700 1 --2- 172.21.15.82:0/2912624773 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b0b54e060 0x563b0b5807c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:24.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.419+0000 7fa9daa00700 1 -- 172.21.15.82:0/2912624773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b0b5529d0 msgr2=0x563b0b5502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:24.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.419+0000 7fa9daa00700 1 --2- 172.21.15.82:0/2912624773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b0b5529d0 0x563b0b5502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:24.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.419+0000 7fa9daa00700 1 -- 172.21.15.82:0/2912624773 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b0b5453f0 con 0x563b0b54e980 2024-05-08T06:05:24.420 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.419+0000 7fa9daa00700 1 --2- 172.21.15.82:0/2912624773 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b0b54e980 0x563b0b580d00 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa9c8005850 tx=0x7fa9c800b850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dfc633581b94971c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:05:24.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.419+0000 7fa9c7e00700 1 -- 172.21.15.82:0/2912624773 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c8040070 con 0x563b0b54e980 2024-05-08T06:05:24.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.419+0000 7fa9c7e00700 1 -- 172.21.15.82:0/2912624773 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9c800f910 con 0x563b0b54e980 2024-05-08T06:05:24.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.419+0000 7fa9c7e00700 1 -- 172.21.15.82:0/2912624773 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c801fa20 con 0x563b0b54e980 2024-05-08T06:05:24.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.420+0000 7fa9ecf8eb80 1 -- 172.21.15.82:0/2912624773 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b0b54e980 msgr2=0x563b0b580d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:24.421 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.420+0000 7fa9ecf8eb80 1 --2- 172.21.15.82:0/2912624773 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b0b54e980 0x563b0b580d00 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa9c8005850 tx=0x7fa9c800b850 comp rx=0 tx=0).stop 2024-05-08T06:05:24.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.421+0000 7fa9ecf8eb80 1 -- 172.21.15.82:0/2912624773 shutdown_connections 2024-05-08T06:05:24.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.421+0000 7fa9ecf8eb80 1 --2- 172.21.15.82:0/2912624773 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b0b5529d0 0x563b0b5502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:24.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.421+0000 7fa9ecf8eb80 1 --2- 172.21.15.82:0/2912624773 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b0b54e060 0x563b0b5807c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:24.422 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.421+0000 7fa9ecf8eb80 1 --2- 172.21.15.82:0/2912624773 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b0b54e980 0x563b0b580d00 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:24.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.421+0000 7fa9ecf8eb80 1 -- 172.21.15.82:0/2912624773 >> 172.21.15.82:0/2912624773 conn(0x563b0b47cb60 msgr2=0x563b0b557200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:05:24.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.422+0000 7fa9ecf8eb80 1 -- 172.21.15.82:0/2912624773 shutdown_connections 2024-05-08T06:05:24.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.422+0000 7fa9ecf8eb80 1 -- 172.21.15.82:0/2912624773 wait complete. 2024-05-08T06:05:24.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.422+0000 7fa9ecf8eb80 1 -- start start 2024-05-08T06:05:24.423 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.423+0000 7fa9ecf8eb80 1 Processor -- start 2024-05-08T06:05:24.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.423+0000 7fa9ecf8eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b0b54e060 0x563b0b55baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:24.424 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.423+0000 7fa9ecf8eb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b0b54e980 0x563b0b55c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:24.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.423+0000 7fa9ecf8eb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b0b5529d0 0x563b0b55c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:24.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.423+0000 7fa9ecf8eb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fa9dc1ad200 con 0x563b0b54e980 2024-05-08T06:05:24.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.423+0000 7fa9ecf8eb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa9dc1acb30 con 0x563b0b5529d0 2024-05-08T06:05:24.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.423+0000 7fa9ecf8eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa9dc1a9d80 con 0x563b0b54e060 2024-05-08T06:05:24.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.423+0000 7fa9ecf8eb80 10 client.0 _ll_register_callbacks cb 0x563b0b447c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:05:24.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.424+0000 7fa9dbe00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b0b5529d0 0x563b0b55c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:24.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.424+0000 7fa9dbe00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b0b5529d0 0x563b0b55c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:52298/0 (socket says 172.21.15.82:52298) 2024-05-08T06:05:24.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.424+0000 7fa9daa00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b0b54e980 0x563b0b55c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:24.425 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.424+0000 7fa9dbe00700 1 -- 172.21.15.82:0/124670839 learned_addr learned my addr 172.21.15.82:0/124670839 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:05:24.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.424+0000 7fa9dbe00700 1 -- 172.21.15.82:0/124670839 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b0b54e060 msgr2=0x563b0b55baf0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T06:05:24.426 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.424+0000 7fa9dbe00700 1 --2- 172.21.15.82:0/124670839 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b0b54e060 0x563b0b55baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:24.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.424+0000 7fa9dbe00700 1 -- 172.21.15.82:0/124670839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b0b54e980 msgr2=0x563b0b55c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:24.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.424+0000 7fa9dbe00700 1 --2- 172.21.15.82:0/124670839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b0b54e980 0x563b0b55c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:24.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.424+0000 7fa9dbe00700 1 -- 172.21.15.82:0/124670839 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b0b5e2370 con 0x563b0b5529d0 2024-05-08T06:05:24.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.425+0000 7fa9dbe00700 1 --2- 172.21.15.82:0/124670839 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b0b5529d0 0x563b0b55c570 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4004a20 tx=0x7fa9d40a8bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88dc90f0edef9098 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:05:24.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.425+0000 7fa9c5600700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T06:05:24.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.425+0000 7fa9c5600700 1 -- 172.21.15.82:0/124670839 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9d40b21d0 con 0x563b0b5529d0 2024-05-08T06:05:24.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.425+0000 7fa9c5600700 1 -- 172.21.15.82:0/124670839 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fa9d40a97e0 con 0x563b0b5529d0 2024-05-08T06:05:24.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.425+0000 7fa9ecf8eb80 1 -- 172.21.15.82:0/124670839 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa9c800f910 con 0x563b0b5529d0 2024-05-08T06:05:24.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.425+0000 7fa9c5600700 1 -- 172.21.15.82:0/124670839 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fa9d40ad720 con 0x563b0b5529d0 2024-05-08T06:05:24.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.425+0000 7fa9ecf8eb80 10 client.26813 fetch_fsmap learned FSMap version 31 2024-05-08T06:05:24.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.425+0000 7fa9ecf8eb80 1 -- 172.21.15.82:0/124670839 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x563b0b5e3640 con 0x563b0b5529d0 2024-05-08T06:05:24.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.425+0000 7fa9c5600700 1 -- 172.21.15.82:0/124670839 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fa9c800f910 con 0x563b0b5529d0 2024-05-08T06:05:24.427 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.425+0000 7fa9c5600700 1 -- 172.21.15.82:0/124670839 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fa9d40ad3a0 con 0x563b0b5529d0 2024-05-08T06:05:24.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.425+0000 7fa9ecf8eb80 10 client.26813 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:05:24.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.425+0000 7fa9ecf8eb80 10 client.26813 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-05-08T06:05:24.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.426+0000 7fa9ecf8eb80 20 client.26813 populate_metadata read hostname 'smithi082' 2024-05-08T06:05:24.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.426+0000 7fa9ecf8eb80 1 --2- 172.21.15.82:0/124670839 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x563b0b5e3920 0x563b0b5e5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:24.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.426+0000 7fa9ecf8eb80 4 client.26813 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T06:05:24.428 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.426+0000 7fa9ecf8eb80 1 -- 172.21.15.82:0/124670839 --> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563b0b4ae400 con 0x563b0b5e3920 2024-05-08T06:05:24.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.426+0000 7fa9db400700 1 --2- 172.21.15.82:0/124670839 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x563b0b5e3920 0x563b0b5e5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:24.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.427+0000 7fa9db400700 1 --2- 172.21.15.82:0/124670839 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x563b0b5e3920 0x563b0b5e5d10 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=da554567bf2db882 server_cookie=27a178589542bf08 in_seq=0 out_seq=0 2024-05-08T06:05:24.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.427+0000 7fa9c5600700 10 client.26813 ms_handle_connect on v2:172.21.15.151:6834/2093655929 2024-05-08T06:05:24.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.428+0000 7fa9c5600700 1 -- 172.21.15.82:0/124670839 <== mds.3 v2:172.21.15.151:6834/2093655929 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563b0b4ae400 con 0x563b0b5e3920 2024-05-08T06:05:24.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.428+0000 7fa9c5600700 10 client.26813 handle_command_reply: tid=0 2024-05-08T06:05:24.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.428+0000 7fa9ecf8eb80 1 client.26813 shutdown 2024-05-08T06:05:24.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.428+0000 7fa9ecf8eb80 1 -- 172.21.15.82:0/124670839 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b0b5529d0 msgr2=0x563b0b55c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:24.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.428+0000 7fa9ecf8eb80 1 --2- 172.21.15.82:0/124670839 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b0b5529d0 0x563b0b55c570 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4004a20 tx=0x7fa9d40a8bf0 comp rx=0 tx=0).stop 2024-05-08T06:05:24.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.428+0000 7fa9ecf8eb80 1 -- 172.21.15.82:0/124670839 shutdown_connections 2024-05-08T06:05:24.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.428+0000 7fa9ecf8eb80 1 --2- 172.21.15.82:0/124670839 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x563b0b5e3920 0x563b0b5e5d10 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:24.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.428+0000 7fa9ecf8eb80 1 --2- 172.21.15.82:0/124670839 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b0b5529d0 0x563b0b55c570 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:24.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.428+0000 7fa9ecf8eb80 1 --2- 172.21.15.82:0/124670839 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563b0b54e060 0x563b0b55baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:24.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.428+0000 7fa9ecf8eb80 1 --2- 172.21.15.82:0/124670839 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563b0b54e980 0x563b0b55c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:24.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.428+0000 7fa9ecf8eb80 1 -- 172.21.15.82:0/124670839 >> 172.21.15.82:0/124670839 conn(0x563b0b47cb60 msgr2=0x563b0b542a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:05:24.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.428+0000 7fa9c5600700 0 client.26813 ms_handle_reset on v2:172.21.15.151:6834/2093655929 2024-05-08T06:05:24.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.428+0000 7fa9ecf8eb80 1 -- 172.21.15.82:0/124670839 shutdown_connections 2024-05-08T06:05:24.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.428+0000 7fa9ecf8eb80 1 -- 172.21.15.82:0/124670839 wait complete. 2024-05-08T06:05:24.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.429+0000 7fa9ecf8eb80 20 client.26813 trim_cache size 0 max 16384 2024-05-08T06:05:24.431 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T06:05:24.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.429+0000 7fa9e2600700 1 -- 172.21.15.82:0/2818965322 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fa9c00b28c0 msgr2=0x7fa9c00b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:24.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.429+0000 7fa9e2600700 1 --2- 172.21.15.82:0/2818965322 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fa9c00b28c0 0x7fa9c00b4d80 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa9c8000c00 tx=0x7fa9c80096b0 comp rx=0 tx=0).stop 2024-05-08T06:05:24.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.429+0000 7fa9e2600700 1 -- 172.21.15.82:0/2818965322 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9dc1a0800 msgr2=0x7fa9dc1a0c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:24.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.429+0000 7fa9e2600700 1 --2- 172.21.15.82:0/2818965322 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9dc1a0800 0x7fa9dc1a0c80 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4007ee0 tx=0x7fa9d400d3b0 comp rx=0 tx=0).stop 2024-05-08T06:05:24.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.429+0000 7fa9e2600700 1 -- 172.21.15.82:0/2818965322 shutdown_connections 2024-05-08T06:05:24.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.429+0000 7fa9e2600700 1 --2- 172.21.15.82:0/2818965322 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9dc1a0800 0x7fa9dc1a0c80 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:24.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.429+0000 7fa9e2600700 1 --2- 172.21.15.82:0/2818965322 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fa9c00b28c0 0x7fa9c00b4d80 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:24.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.429+0000 7fa9e2600700 1 --2- 172.21.15.82:0/2818965322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa9dc103750 0x7fa9dc19bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:24.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.429+0000 7fa9e2600700 1 --2- 172.21.15.82:0/2818965322 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fa9dc108850 0x7fa9dc19c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:24.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.429+0000 7fa9e2600700 1 -- 172.21.15.82:0/2818965322 >> 172.21.15.82:0/2818965322 conn(0x7fa9dc07a600 msgr2=0x7fa9dc101640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:05:24.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.430+0000 7fa9e2600700 1 -- 172.21.15.82:0/2818965322 shutdown_connections 2024-05-08T06:05:24.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:24.430+0000 7fa9e2600700 1 -- 172.21.15.82:0/2818965322 wait complete. 2024-05-08T06:05:25.252 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-05-08T06:05:25.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 875.0 s, 1246.8 tps, lat 81.002 ms stddev 89.709 2024-05-08T06:05:25.846 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:05:25.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:05:25 smithi134 ceph-mon[34132]: pgmap v902: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.8 MiB/s wr, 549 op/s 2024-05-08T06:05:26.024 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:05:25 smithi082 ceph-mon[30098]: pgmap v902: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.8 MiB/s wr, 549 op/s 2024-05-08T06:05:26.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:05:25 smithi151 ceph-mon[34815]: pgmap v902: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 6.8 MiB/s wr, 549 op/s 2024-05-08T06:05:27.954 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:05:27 smithi082 ceph-mon[30098]: pgmap v903: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.6 MiB/s wr, 732 op/s 2024-05-08T06:05:27.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:05:27 smithi134 ceph-mon[34132]: pgmap v903: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.6 MiB/s wr, 732 op/s 2024-05-08T06:05:28.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:05:27 smithi151 ceph-mon[34815]: pgmap v903: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.6 MiB/s wr, 732 op/s 2024-05-08T06:05:28.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.275+0000 7f51f4800700 1 -- 172.21.15.82:0/3029722747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51ec103750 msgr2=0x7f51ec103b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:28.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.275+0000 7f51f4800700 1 --2- 172.21.15.82:0/3029722747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51ec103750 0x7f51ec103b30 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f51e00099c0 tx=0x7f51e0009cd0 comp rx=0 tx=0).stop 2024-05-08T06:05:28.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.276+0000 7f51f4800700 1 -- 172.21.15.82:0/3029722747 shutdown_connections 2024-05-08T06:05:28.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.276+0000 7f51f4800700 1 --2- 172.21.15.82:0/3029722747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51ec103750 0x7f51ec103b30 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:28.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.276+0000 7f51f4800700 1 --2- 172.21.15.82:0/3029722747 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51ec108850 0x7f51ec1103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:28.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.276+0000 7f51f4800700 1 --2- 172.21.15.82:0/3029722747 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51ec104100 0x7f51ec108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:28.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.276+0000 7f51f4800700 1 -- 172.21.15.82:0/3029722747 >> 172.21.15.82:0/3029722747 conn(0x7f51ec07a600 msgr2=0x7f51ec07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:05:28.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.276+0000 7f51f4800700 1 -- 172.21.15.82:0/3029722747 shutdown_connections 2024-05-08T06:05:28.277 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.276+0000 7f51f4800700 1 -- 172.21.15.82:0/3029722747 wait complete. 2024-05-08T06:05:28.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.278+0000 7f51f4800700 1 Processor -- start 2024-05-08T06:05:28.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.278+0000 7f51f4800700 1 -- start start 2024-05-08T06:05:28.279 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.278+0000 7f51f4800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51ec103750 0x7f51ec19f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:28.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.278+0000 7f51f4800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51ec104100 0x7f51ec19fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:28.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.278+0000 7f51f4800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51ec108850 0x7f51ec1999c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:28.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.278+0000 7f51f4800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f51ec113700 con 0x7f51ec104100 2024-05-08T06:05:28.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.278+0000 7f51f4800700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f51ec113580 con 0x7f51ec103750 2024-05-08T06:05:28.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.278+0000 7f51f4800700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f51ec113880 con 0x7f51ec108850 2024-05-08T06:05:28.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.279+0000 7f51f1400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51ec104100 0x7f51ec19fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:28.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.279+0000 7f51f1400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51ec104100 0x7f51ec19fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:53276/0 (socket says 172.21.15.82:53276) 2024-05-08T06:05:28.280 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.279+0000 7f51f1400700 1 -- 172.21.15.82:0/2928552579 learned_addr learned my addr 172.21.15.82:0/2928552579 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:05:28.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.279+0000 7f51f2800700 1 --2- 172.21.15.82:0/2928552579 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51ec108850 0x7f51ec1999c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:28.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.280+0000 7f51f1e00700 1 --2- 172.21.15.82:0/2928552579 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51ec103750 0x7f51ec19f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:28.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.281+0000 7f51f1400700 1 -- 172.21.15.82:0/2928552579 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51ec108850 msgr2=0x7f51ec1999c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:28.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.281+0000 7f51f1400700 1 --2- 172.21.15.82:0/2928552579 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51ec108850 0x7f51ec1999c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:28.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.281+0000 7f51f1400700 1 -- 172.21.15.82:0/2928552579 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51ec103750 msgr2=0x7f51ec19f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:28.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.281+0000 7f51f1400700 1 --2- 172.21.15.82:0/2928552579 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51ec103750 0x7f51ec19f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:28.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.281+0000 7f51f1400700 1 -- 172.21.15.82:0/2928552579 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51ec19a120 con 0x7f51ec104100 2024-05-08T06:05:28.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.282+0000 7f51f1e00700 1 --2- 172.21.15.82:0/2928552579 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51ec103750 0x7f51ec19f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:05:28.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.283+0000 7f51f1400700 1 --2- 172.21.15.82:0/2928552579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51ec104100 0x7f51ec19fd40 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f51dc00b530 tx=0x7f51dc00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:05:28.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.283+0000 7f51e6a00700 1 -- 172.21.15.82:0/2928552579 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51dc015020 con 0x7f51ec104100 2024-05-08T06:05:28.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.283+0000 7f51e6a00700 1 -- 172.21.15.82:0/2928552579 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51dc011ce0 con 0x7f51ec104100 2024-05-08T06:05:28.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.283+0000 7f51e6a00700 1 -- 172.21.15.82:0/2928552579 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51dc010dd0 con 0x7f51ec104100 2024-05-08T06:05:28.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.286+0000 7f51f4800700 1 -- 172.21.15.82:0/2928552579 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51ec19a410 con 0x7f51ec104100 2024-05-08T06:05:28.287 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.286+0000 7f51f4800700 1 -- 172.21.15.82:0/2928552579 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51ec0756d0 con 0x7f51ec104100 2024-05-08T06:05:28.296 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.296+0000 7f51ff129b80 1 Processor -- start 2024-05-08T06:05:28.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.301+0000 7f51ff129b80 1 -- start start 2024-05-08T06:05:28.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.301+0000 7f51e6a00700 1 -- 172.21.15.82:0/2928552579 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f51dc018020 con 0x7f51ec104100 2024-05-08T06:05:28.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.301+0000 7f51ff129b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561518886870 0x561518886c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:28.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.301+0000 7f51ff129b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561518887190 0x56151888aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:28.302 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.301+0000 7f51ff129b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56151888b1e0 0x56151888b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:28.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.302+0000 7f51f2800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561518886870 0x561518886c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:28.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.302+0000 7f51f2800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561518886870 0x561518886c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:45242/0 (socket says 172.21.15.82:45242) 2024-05-08T06:05:28.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.302+0000 7f51f1400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56151888b1e0 0x56151888b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:28.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.302+0000 7f51f1400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56151888b1e0 0x56151888b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:52328/0 (socket says 172.21.15.82:52328) 2024-05-08T06:05:28.304 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.303+0000 7f51e6a00700 1 --2- 172.21.15.82:0/2928552579 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f51d40b2980 0x7f51d40b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:28.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.304+0000 7f51e6a00700 1 -- 172.21.15.82:0/2928552579 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f51dc0e18b0 con 0x7f51ec104100 2024-05-08T06:05:28.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.304+0000 7f51ff129b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5615187d0a20 con 0x561518887190 2024-05-08T06:05:28.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.304+0000 7f51ff129b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56151876e760 con 0x56151888b1e0 2024-05-08T06:05:28.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.304+0000 7f51ff129b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5615187cc9e0 con 0x561518886870 2024-05-08T06:05:28.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.304+0000 7f51f2800700 1 -- 172.21.15.82:0/2123949798 learned_addr learned my addr 172.21.15.82:0/2123949798 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:05:28.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.305+0000 7f51f1400700 1 -- 172.21.15.82:0/2123949798 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561518886870 msgr2=0x561518886c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:28.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.305+0000 7f51f1400700 1 --2- 172.21.15.82:0/2123949798 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561518886870 0x561518886c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:28.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.305+0000 7f51f1400700 1 -- 172.21.15.82:0/2123949798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561518887190 msgr2=0x56151888aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:28.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.305+0000 7f51f1400700 1 --2- 172.21.15.82:0/2123949798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561518887190 0x56151888aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:28.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.305+0000 7f51f1400700 1 -- 172.21.15.82:0/2123949798 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56151871d8d0 con 0x56151888b1e0 2024-05-08T06:05:28.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.305+0000 7f51f2800700 1 --2- 172.21.15.82:0/2123949798 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561518886870 0x561518886c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:05:28.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.305+0000 7f51f2800700 1 --2- 172.21.15.82:0/2928552579 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f51d40b2980 0x7f51d40b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:28.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.306+0000 7f51f1400700 1 --2- 172.21.15.82:0/2123949798 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56151888b1e0 0x56151888b640 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f51dc0094b0 tx=0x7f51dc000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afef55b1d40b9d1c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:05:28.307 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.306+0000 7f51db400700 1 -- 172.21.15.82:0/2123949798 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51dc0a8990 con 0x56151888b1e0 2024-05-08T06:05:28.310 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.306+0000 7f51db400700 1 -- 172.21.15.82:0/2123949798 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51dc0a9580 con 0x56151888b1e0 2024-05-08T06:05:28.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.306+0000 7f51db400700 1 -- 172.21.15.82:0/2123949798 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51dc0b1ab0 con 0x56151888b1e0 2024-05-08T06:05:28.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.307+0000 7f51ff129b80 1 -- 172.21.15.82:0/2123949798 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56151888b1e0 msgr2=0x56151888b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:28.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.307+0000 7f51ff129b80 1 --2- 172.21.15.82:0/2123949798 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56151888b1e0 0x56151888b640 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f51dc0094b0 tx=0x7f51dc000bc0 comp rx=0 tx=0).stop 2024-05-08T06:05:28.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.310+0000 7f51ff129b80 1 -- 172.21.15.82:0/2123949798 shutdown_connections 2024-05-08T06:05:28.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.310+0000 7f51ff129b80 1 --2- 172.21.15.82:0/2123949798 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56151888b1e0 0x56151888b640 secure :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f51dc0094b0 tx=0x7f51dc000bc0 comp rx=0 tx=0).stop 2024-05-08T06:05:28.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.310+0000 7f51f2800700 1 --2- 172.21.15.82:0/2928552579 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f51d40b2980 0x7f51d40b4e40 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f51e8009ca0 tx=0x7f51e8004ad0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:05:28.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.310+0000 7f51ff129b80 1 --2- 172.21.15.82:0/2123949798 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561518886870 0x561518886c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:28.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.310+0000 7f51ff129b80 1 --2- 172.21.15.82:0/2123949798 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561518887190 0x56151888aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:28.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.310+0000 7f51ff129b80 1 -- 172.21.15.82:0/2123949798 >> 172.21.15.82:0/2123949798 conn(0x5615187acb60 msgr2=0x5615188787a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:05:28.311 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.310+0000 7f51ff129b80 1 -- 172.21.15.82:0/2123949798 shutdown_connections 2024-05-08T06:05:28.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.310+0000 7f51ff129b80 1 -- 172.21.15.82:0/2123949798 wait complete. 2024-05-08T06:05:28.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.311+0000 7f51ff129b80 1 -- start start 2024-05-08T06:05:28.312 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.311+0000 7f51ff129b80 1 Processor -- start 2024-05-08T06:05:28.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.313+0000 7f51ff129b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561518886870 0x561518892660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:28.313 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.313+0000 7f51ff129b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561518887190 0x56151888fa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:28.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.313+0000 7f51ff129b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56151888b1e0 0x56151888ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:28.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.313+0000 7f51f1e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561518886870 0x561518892660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:28.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.313+0000 7f51f1e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561518886870 0x561518892660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:45248/0 (socket says 172.21.15.82:45248) 2024-05-08T06:05:28.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.313+0000 7f51f1e00700 1 -- 172.21.15.82:0/1906562866 learned_addr learned my addr 172.21.15.82:0/1906562866 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:05:28.314 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.314+0000 7f51ff129b80 1 -- 172.21.15.82:0/1906562866 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x5615188933f0 con 0x56151888b1e0 2024-05-08T06:05:28.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.314+0000 7f51ff129b80 1 -- 172.21.15.82:0/1906562866 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x561518736b20 con 0x561518887190 2024-05-08T06:05:28.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.314+0000 7f51f1400700 1 --2- 172.21.15.82:0/1906562866 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561518887190 0x56151888fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:28.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.314+0000 7f51f2800700 1 --2- 172.21.15.82:0/1906562866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56151888b1e0 0x56151888ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:28.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.314+0000 7f51ff129b80 1 -- 172.21.15.82:0/1906562866 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x561518893570 con 0x561518886870 2024-05-08T06:05:28.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.315+0000 7f51ff129b80 10 client.0 _ll_register_callbacks cb 0x561518777c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:05:28.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.315+0000 7f51f1e00700 1 -- 172.21.15.82:0/1906562866 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561518887190 msgr2=0x56151888fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:28.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.315+0000 7f51f1e00700 1 --2- 172.21.15.82:0/1906562866 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561518887190 0x56151888fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:28.315 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.315+0000 7f51f1e00700 1 -- 172.21.15.82:0/1906562866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56151888b1e0 msgr2=0x56151888ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:28.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.315+0000 7f51f1e00700 1 --2- 172.21.15.82:0/1906562866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56151888b1e0 0x56151888ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:28.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.315+0000 7f51f1e00700 1 -- 172.21.15.82:0/1906562866 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561518796420 con 0x561518886870 2024-05-08T06:05:28.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.315+0000 7f51f1e00700 1 --2- 172.21.15.82:0/1906562866 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561518886870 0x561518892660 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f51e0009350 tx=0x7f51e000bfb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dbff3416af7045cd server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:05:28.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.315+0000 7f51ff129b80 1 -- 172.21.15.82:0/1906562866 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51dc0a9580 con 0x561518886870 2024-05-08T06:05:28.316 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.315+0000 7f51cfe00700 10 client.26845 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T06:05:28.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.316+0000 7f51cfe00700 1 -- 172.21.15.82:0/1906562866 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e0003c70 con 0x561518886870 2024-05-08T06:05:28.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.316+0000 7f51cfe00700 1 -- 172.21.15.82:0/1906562866 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f51e0005070 con 0x561518886870 2024-05-08T06:05:28.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.317+0000 7f51cfe00700 1 -- 172.21.15.82:0/1906562866 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f51e0003e10 con 0x561518886870 2024-05-08T06:05:28.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.317+0000 7f51ff129b80 10 client.26845 fetch_fsmap learned FSMap version 31 2024-05-08T06:05:28.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.317+0000 7f51ff129b80 1 -- 172.21.15.82:0/1906562866 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({fsmap=31}) -- 0x56151889dbf0 con 0x561518886870 2024-05-08T06:05:28.317 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.317+0000 7f51cfe00700 1 -- 172.21.15.82:0/1906562866 <== mon.1 v2:172.21.15.151:3300/0 4 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f51e0005270 con 0x561518886870 2024-05-08T06:05:28.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.317+0000 7f51ff129b80 10 client.26845 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:05:28.318 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.317+0000 7f51ff129b80 10 client.26845 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-05-08T06:05:28.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.317+0000 7f51ff129b80 20 client.26845 populate_metadata read hostname 'smithi082' 2024-05-08T06:05:28.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.317+0000 7f51ff129b80 1 --2- 172.21.15.82:0/1906562866 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x5615188a0120 0x5615188a2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:28.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.317+0000 7f51ff129b80 4 client.26845 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:05:28.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.317+0000 7f51ff129b80 1 -- 172.21.15.82:0/1906562866 --> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56151884b0a0 con 0x5615188a0120 2024-05-08T06:05:28.319 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.318+0000 7f51f1400700 1 --2- 172.21.15.82:0/1906562866 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x5615188a0120 0x5615188a2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:28.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.320+0000 7f51f1400700 1 --2- 172.21.15.82:0/1906562866 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x5615188a0120 0x5615188a2510 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e1848680012762c server_cookie=6b0316e1842d7 in_seq=0 out_seq=0 2024-05-08T06:05:28.320 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.320+0000 7f51cfe00700 10 client.26845 ms_handle_connect on v2:172.21.15.151:6836/4192404464 2024-05-08T06:05:28.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.321+0000 7f51cfe00700 1 -- 172.21.15.82:0/1906562866 <== mds.2 v2:172.21.15.151:6836/4192404464 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56151884b0a0 con 0x5615188a0120 2024-05-08T06:05:28.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.321+0000 7f51cfe00700 10 client.26845 handle_command_reply: tid=0 2024-05-08T06:05:28.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.321+0000 7f51ff129b80 1 client.26845 shutdown 2024-05-08T06:05:28.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.321+0000 7f51ff129b80 1 -- 172.21.15.82:0/1906562866 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561518886870 msgr2=0x561518892660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:28.322 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.321+0000 7f51ff129b80 1 --2- 172.21.15.82:0/1906562866 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561518886870 0x561518892660 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f51e0009350 tx=0x7f51e000bfb0 comp rx=0 tx=0).stop 2024-05-08T06:05:28.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.324+0000 7f51ff129b80 1 -- 172.21.15.82:0/1906562866 shutdown_connections 2024-05-08T06:05:28.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.324+0000 7f51ff129b80 1 --2- 172.21.15.82:0/1906562866 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x5615188a0120 0x5615188a2510 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:28.324 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.324+0000 7f51ff129b80 1 --2- 172.21.15.82:0/1906562866 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56151888b1e0 0x56151888ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:28.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.324+0000 7f51ff129b80 1 --2- 172.21.15.82:0/1906562866 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561518886870 0x561518892660 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:28.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.324+0000 7f51ff129b80 1 --2- 172.21.15.82:0/1906562866 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561518887190 0x56151888fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:28.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.324+0000 7f51ff129b80 1 -- 172.21.15.82:0/1906562866 >> 172.21.15.82:0/1906562866 conn(0x5615187acb60 msgr2=0x5615188732b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:05:28.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.324+0000 7f51cfe00700 0 client.26845 ms_handle_reset on v2:172.21.15.151:6836/4192404464 2024-05-08T06:05:28.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.324+0000 7f51ff129b80 1 -- 172.21.15.82:0/1906562866 shutdown_connections 2024-05-08T06:05:28.325 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.324+0000 7f51ff129b80 1 -- 172.21.15.82:0/1906562866 wait complete. 2024-05-08T06:05:28.326 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.325+0000 7f51ff129b80 20 client.26845 trim_cache size 0 max 16384 2024-05-08T06:05:28.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.359+0000 7f51ff129b80 1 Processor -- start 2024-05-08T06:05:28.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.359+0000 7f51ff129b80 1 -- start start 2024-05-08T06:05:28.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.359+0000 7f51ff129b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561518886870 0x56151888d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:28.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.359+0000 7f51ff129b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561518887190 0x56151889c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:28.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.359+0000 7f51ff129b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56151888b1e0 0x56151888b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:28.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.359+0000 7f51ff129b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f51ec1ab8c0 con 0x561518887190 2024-05-08T06:05:28.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.359+0000 7f51ff129b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f51ec1ad400 con 0x56151888b1e0 2024-05-08T06:05:28.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.359+0000 7f51ff129b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f51ec1abf90 con 0x561518886870 2024-05-08T06:05:28.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.360+0000 7f51f1e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561518886870 0x56151888d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:28.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.360+0000 7f51f1e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561518886870 0x56151888d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:45260/0 (socket says 172.21.15.82:45260) 2024-05-08T06:05:28.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.360+0000 7f51f1e00700 1 -- 172.21.15.82:0/820768251 learned_addr learned my addr 172.21.15.82:0/820768251 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:05:28.361 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.360+0000 7f51f2800700 1 --2- 172.21.15.82:0/820768251 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56151888b1e0 0x56151888b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:28.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.360+0000 7f51f1400700 1 --2- 172.21.15.82:0/820768251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561518887190 0x56151889c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:28.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.361+0000 7f51f2800700 1 -- 172.21.15.82:0/820768251 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561518886870 msgr2=0x56151888d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:28.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.361+0000 7f51f2800700 1 --2- 172.21.15.82:0/820768251 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561518886870 0x56151888d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:28.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.361+0000 7f51f2800700 1 -- 172.21.15.82:0/820768251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561518887190 msgr2=0x56151889c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:28.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.361+0000 7f51f2800700 1 --2- 172.21.15.82:0/820768251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561518887190 0x56151889c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:28.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.361+0000 7f51f2800700 1 -- 172.21.15.82:0/820768251 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56151888df90 con 0x56151888b1e0 2024-05-08T06:05:28.362 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.361+0000 7f51f2800700 1 --2- 172.21.15.82:0/820768251 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56151888b1e0 0x56151888b5e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f51e8003c10 tx=0x7f51e8016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1b012b8767e61e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:05:28.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.361+0000 7f51daa00700 1 -- 172.21.15.82:0/820768251 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e80178e0 con 0x56151888b1e0 2024-05-08T06:05:28.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.362+0000 7f51daa00700 1 -- 172.21.15.82:0/820768251 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51e8029070 con 0x56151888b1e0 2024-05-08T06:05:28.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.362+0000 7f51daa00700 1 -- 172.21.15.82:0/820768251 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e8024e20 con 0x56151888b1e0 2024-05-08T06:05:28.363 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.363+0000 7f51ff129b80 1 -- 172.21.15.82:0/820768251 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56151888b1e0 msgr2=0x56151888b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:28.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.363+0000 7f51ff129b80 1 --2- 172.21.15.82:0/820768251 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56151888b1e0 0x56151888b5e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f51e8003c10 tx=0x7f51e8016000 comp rx=0 tx=0).stop 2024-05-08T06:05:28.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.363+0000 7f51ff129b80 1 -- 172.21.15.82:0/820768251 shutdown_connections 2024-05-08T06:05:28.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.363+0000 7f51ff129b80 1 --2- 172.21.15.82:0/820768251 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56151888b1e0 0x56151888b5e0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:28.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.363+0000 7f51ff129b80 1 --2- 172.21.15.82:0/820768251 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561518886870 0x56151888d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:28.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.363+0000 7f51ff129b80 1 --2- 172.21.15.82:0/820768251 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561518887190 0x56151889c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:28.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.363+0000 7f51ff129b80 1 -- 172.21.15.82:0/820768251 >> 172.21.15.82:0/820768251 conn(0x5615187acb60 msgr2=0x561518872a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:05:28.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.364+0000 7f51ff129b80 1 -- 172.21.15.82:0/820768251 shutdown_connections 2024-05-08T06:05:28.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.364+0000 7f51ff129b80 1 -- 172.21.15.82:0/820768251 wait complete. 2024-05-08T06:05:28.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.365+0000 7f51ff129b80 1 -- start start 2024-05-08T06:05:28.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.365+0000 7f51ff129b80 1 Processor -- start 2024-05-08T06:05:28.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.366+0000 7f51ff129b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561518886870 0x561518898b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:28.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.366+0000 7f51ff129b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561518887190 0x5615188a7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:28.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.366+0000 7f51ff129b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56151888b1e0 0x5615188a7670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:28.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.366+0000 7f51ff129b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f51ec1acd30 con 0x561518887190 2024-05-08T06:05:28.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.366+0000 7f51ff129b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f51ec1ac660 con 0x56151888b1e0 2024-05-08T06:05:28.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.366+0000 7f51ff129b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f51ec1a9880 con 0x561518886870 2024-05-08T06:05:28.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.366+0000 7f51ff129b80 10 client.0 _ll_register_callbacks cb 0x561518777c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:05:28.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.367+0000 7f51f1e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561518886870 0x561518898b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:28.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.367+0000 7f51f1400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561518887190 0x5615188a7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:28.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.367+0000 7f51f2800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56151888b1e0 0x5615188a7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:28.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.367+0000 7f51f1e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561518886870 0x561518898b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:45270/0 (socket says 172.21.15.82:45270) 2024-05-08T06:05:28.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.367+0000 7f51f1e00700 1 -- 172.21.15.82:0/356126659 learned_addr learned my addr 172.21.15.82:0/356126659 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:05:28.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.367+0000 7f51f1400700 1 -- 172.21.15.82:0/356126659 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561518886870 msgr2=0x561518898b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:28.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.367+0000 7f51f1400700 1 --2- 172.21.15.82:0/356126659 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561518886870 0x561518898b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:28.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.367+0000 7f51f1400700 1 -- 172.21.15.82:0/356126659 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56151888b1e0 msgr2=0x5615188a7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:28.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.367+0000 7f51f1400700 1 --2- 172.21.15.82:0/356126659 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56151888b1e0 0x5615188a7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:28.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.367+0000 7f51f1400700 1 -- 172.21.15.82:0/356126659 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615188a7cb0 con 0x561518887190 2024-05-08T06:05:28.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.368+0000 7f51f1400700 1 --2- 172.21.15.82:0/356126659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561518887190 0x5615188a7130 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f51dc0ad3f0 tx=0x7f51dc0a88d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56abacd2e712d77 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:05:28.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.368+0000 7f51cfe00700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T06:05:28.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.369+0000 7f51cfe00700 1 -- 172.21.15.82:0/356126659 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51dc0b1ce0 con 0x561518887190 2024-05-08T06:05:28.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.369+0000 7f51cfe00700 1 -- 172.21.15.82:0/356126659 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f51dc0c3440 con 0x561518887190 2024-05-08T06:05:28.370 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.369+0000 7f51ff129b80 1 -- 172.21.15.82:0/356126659 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51e8029070 con 0x561518887190 2024-05-08T06:05:28.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.369+0000 7f51cfe00700 1 -- 172.21.15.82:0/356126659 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f51dc0b1850 con 0x561518887190 2024-05-08T06:05:28.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.369+0000 7f51ff129b80 10 client.16299 fetch_fsmap learned FSMap version 31 2024-05-08T06:05:28.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.369+0000 7f51ff129b80 1 -- 172.21.15.82:0/356126659 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56151890a720 con 0x561518887190 2024-05-08T06:05:28.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.370+0000 7f51cfe00700 1 -- 172.21.15.82:0/356126659 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f51e8029070 con 0x561518887190 2024-05-08T06:05:28.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.370+0000 7f51cfe00700 1 -- 172.21.15.82:0/356126659 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f51dc0a4880 con 0x561518887190 2024-05-08T06:05:28.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.370+0000 7f51ff129b80 10 client.16299 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:05:28.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.370+0000 7f51ff129b80 10 client.16299 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-05-08T06:05:28.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.370+0000 7f51ff129b80 20 client.16299 populate_metadata read hostname 'smithi082' 2024-05-08T06:05:28.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.370+0000 7f51ff129b80 1 --2- 172.21.15.82:0/356126659 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x56151890aa60 0x56151890ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:28.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.370+0000 7f51ff129b80 4 client.16299 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T06:05:28.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.370+0000 7f51ff129b80 1 -- 172.21.15.82:0/356126659 --> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5615187de400 con 0x56151890aa60 2024-05-08T06:05:28.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.371+0000 7f51f1e00700 1 --2- 172.21.15.82:0/356126659 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x56151890aa60 0x56151890ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:28.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.371+0000 7f51f1e00700 1 --2- 172.21.15.82:0/356126659 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x56151890aa60 0x56151890ce50 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a261360aaec3b249 server_cookie=c77429ad18eaf016 in_seq=0 out_seq=0 2024-05-08T06:05:28.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.371+0000 7f51cfe00700 10 client.16299 ms_handle_connect on v2:172.21.15.151:6836/4192404464 2024-05-08T06:05:28.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.372+0000 7f51cfe00700 1 -- 172.21.15.82:0/356126659 <== mds.2 v2:172.21.15.151:6836/4192404464 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5615187de400 con 0x56151890aa60 2024-05-08T06:05:28.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.372+0000 7f51cfe00700 10 client.16299 handle_command_reply: tid=0 2024-05-08T06:05:28.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.372+0000 7f51ff129b80 1 client.16299 shutdown 2024-05-08T06:05:28.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.372+0000 7f51ff129b80 1 -- 172.21.15.82:0/356126659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561518887190 msgr2=0x5615188a7130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:28.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.372+0000 7f51ff129b80 1 --2- 172.21.15.82:0/356126659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561518887190 0x5615188a7130 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f51dc0ad3f0 tx=0x7f51dc0a88d0 comp rx=0 tx=0).stop 2024-05-08T06:05:28.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.372+0000 7f51ff129b80 1 -- 172.21.15.82:0/356126659 shutdown_connections 2024-05-08T06:05:28.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.372+0000 7f51ff129b80 1 --2- 172.21.15.82:0/356126659 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x56151890aa60 0x56151890ce50 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:28.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.372+0000 7f51ff129b80 1 --2- 172.21.15.82:0/356126659 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56151888b1e0 0x5615188a7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:28.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.372+0000 7f51ff129b80 1 --2- 172.21.15.82:0/356126659 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561518886870 0x561518898b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:28.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.372+0000 7f51ff129b80 1 --2- 172.21.15.82:0/356126659 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x561518887190 0x5615188a7130 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:28.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.372+0000 7f51cfe00700 0 client.16299 ms_handle_reset on v2:172.21.15.151:6836/4192404464 2024-05-08T06:05:28.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.372+0000 7f51ff129b80 1 -- 172.21.15.82:0/356126659 >> 172.21.15.82:0/356126659 conn(0x5615187acb60 msgr2=0x5615188732b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:05:28.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.372+0000 7f51ff129b80 1 -- 172.21.15.82:0/356126659 shutdown_connections 2024-05-08T06:05:28.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.373+0000 7f51ff129b80 1 -- 172.21.15.82:0/356126659 wait complete. 2024-05-08T06:05:28.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.373+0000 7f51ff129b80 20 client.16299 trim_cache size 0 max 16384 2024-05-08T06:05:28.374 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T06:05:28.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.374+0000 7f51f4800700 1 -- 172.21.15.82:0/2928552579 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f51d40b2980 msgr2=0x7f51d40b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:28.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.374+0000 7f51f4800700 1 --2- 172.21.15.82:0/2928552579 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f51d40b2980 0x7f51d40b4e40 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f51e8009ca0 tx=0x7f51e8004ad0 comp rx=0 tx=0).stop 2024-05-08T06:05:28.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.374+0000 7f51f4800700 1 -- 172.21.15.82:0/2928552579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51ec104100 msgr2=0x7f51ec19fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:28.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.374+0000 7f51f4800700 1 --2- 172.21.15.82:0/2928552579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51ec104100 0x7f51ec19fd40 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f51dc00b530 tx=0x7f51dc00b840 comp rx=0 tx=0).stop 2024-05-08T06:05:28.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.375+0000 7f51f4800700 1 -- 172.21.15.82:0/2928552579 shutdown_connections 2024-05-08T06:05:28.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.375+0000 7f51f4800700 1 --2- 172.21.15.82:0/2928552579 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51ec103750 0x7f51ec19f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:28.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.375+0000 7f51f4800700 1 --2- 172.21.15.82:0/2928552579 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f51d40b2980 0x7f51d40b4e40 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:28.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.375+0000 7f51f4800700 1 --2- 172.21.15.82:0/2928552579 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51ec108850 0x7f51ec1999c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:28.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.375+0000 7f51f4800700 1 --2- 172.21.15.82:0/2928552579 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f51ec104100 0x7f51ec19fd40 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:28.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.375+0000 7f51f4800700 1 -- 172.21.15.82:0/2928552579 >> 172.21.15.82:0/2928552579 conn(0x7f51ec07a600 msgr2=0x7f51ec1099a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:05:28.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.375+0000 7f51f4800700 1 -- 172.21.15.82:0/2928552579 shutdown_connections 2024-05-08T06:05:28.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:28.376+0000 7f51f4800700 1 -- 172.21.15.82:0/2928552579 wait complete. 2024-05-08T06:05:29.576 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-05-08T06:05:29.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:05:29 smithi082 ceph-mon[30098]: pgmap v904: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.7 MiB/s wr, 539 op/s 2024-05-08T06:05:29.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:05:29 smithi134 ceph-mon[34132]: pgmap v904: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.7 MiB/s wr, 539 op/s 2024-05-08T06:05:30.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:05:29 smithi151 ceph-mon[34815]: pgmap v904: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.7 MiB/s wr, 539 op/s 2024-05-08T06:05:30.224 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:05:30.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 880.0 s, 1362.4 tps, lat 72.810 ms stddev 79.922 2024-05-08T06:05:32.127 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:05:31 smithi082 ceph-mon[30098]: pgmap v905: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.4 MiB/s wr, 607 op/s 2024-05-08T06:05:32.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:05:31 smithi151 ceph-mon[34815]: pgmap v905: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.4 MiB/s wr, 607 op/s 2024-05-08T06:05:32.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:05:31 smithi134 ceph-mon[34132]: pgmap v905: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.4 MiB/s wr, 607 op/s 2024-05-08T06:05:32.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.670+0000 7fdd57400700 1 -- 172.21.15.82:0/816374275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd5010fb60 msgr2=0x7fdd5010ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:32.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.670+0000 7fdd57400700 1 --2- 172.21.15.82:0/816374275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd5010fb60 0x7fdd5010ff40 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fdd44009990 tx=0x7fdd44009ca0 comp rx=0 tx=0).stop 2024-05-08T06:05:32.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.670+0000 7fdd57400700 1 -- 172.21.15.82:0/816374275 shutdown_connections 2024-05-08T06:05:32.670 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.670+0000 7fdd57400700 1 --2- 172.21.15.82:0/816374275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd5010a490 0x7fdd501169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:32.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.670+0000 7fdd57400700 1 --2- 172.21.15.82:0/816374275 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd5010fb60 0x7fdd5010ff40 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:32.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.670+0000 7fdd57400700 1 --2- 172.21.15.82:0/816374275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdd50109ad0 0x7fdd50109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:32.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.670+0000 7fdd57400700 1 -- 172.21.15.82:0/816374275 >> 172.21.15.82:0/816374275 conn(0x7fdd50076c70 msgr2=0x7fdd501082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:05:32.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.670+0000 7fdd57400700 1 -- 172.21.15.82:0/816374275 shutdown_connections 2024-05-08T06:05:32.671 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.671+0000 7fdd57400700 1 -- 172.21.15.82:0/816374275 wait complete. 2024-05-08T06:05:32.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.671+0000 7fdd57400700 1 Processor -- start 2024-05-08T06:05:32.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.672+0000 7fdd57400700 1 -- start start 2024-05-08T06:05:32.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.672+0000 7fdd57400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdd50109ad0 0x7fdd501a0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:32.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.672+0000 7fdd57400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd5010a490 0x7fdd501a06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:32.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.672+0000 7fdd57400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd5010fb60 0x7fdd501a4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:32.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.672+0000 7fdd57400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdd50119cc0 con 0x7fdd5010a490 2024-05-08T06:05:32.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.672+0000 7fdd57400700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdd50119b40 con 0x7fdd50109ad0 2024-05-08T06:05:32.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.672+0000 7fdd57400700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fdd50119e40 con 0x7fdd5010fb60 2024-05-08T06:05:32.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.672+0000 7fdd54a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdd50109ad0 0x7fdd501a0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:32.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.672+0000 7fdd55400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd5010fb60 0x7fdd501a4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:32.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.672+0000 7fdd54a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdd50109ad0 0x7fdd501a0170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:52382/0 (socket says 172.21.15.82:52382) 2024-05-08T06:05:32.672 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.672+0000 7fdd54a00700 1 -- 172.21.15.82:0/258939394 learned_addr learned my addr 172.21.15.82:0/258939394 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:05:32.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.672+0000 7fdd4fe00700 1 --2- 172.21.15.82:0/258939394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd5010a490 0x7fdd501a06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:32.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.673+0000 7fdd54a00700 1 -- 172.21.15.82:0/258939394 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd5010fb60 msgr2=0x7fdd501a4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:32.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.673+0000 7fdd54a00700 1 --2- 172.21.15.82:0/258939394 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd5010fb60 0x7fdd501a4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:32.673 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.673+0000 7fdd54a00700 1 -- 172.21.15.82:0/258939394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd5010a490 msgr2=0x7fdd501a06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:32.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.673+0000 7fdd54a00700 1 --2- 172.21.15.82:0/258939394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd5010a490 0x7fdd501a06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:32.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.673+0000 7fdd54a00700 1 -- 172.21.15.82:0/258939394 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd501a5180 con 0x7fdd50109ad0 2024-05-08T06:05:32.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.673+0000 7fdd4fe00700 1 --2- 172.21.15.82:0/258939394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd5010a490 0x7fdd501a06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:05:32.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.673+0000 7fdd55400700 1 --2- 172.21.15.82:0/258939394 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd5010fb60 0x7fdd501a4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:05:32.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.673+0000 7fdd54a00700 1 --2- 172.21.15.82:0/258939394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdd50109ad0 0x7fdd501a0170 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fdd44000c00 tx=0x7fdd4400bfd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:05:32.674 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.674+0000 7fdd4d600700 1 -- 172.21.15.82:0/258939394 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd44027070 con 0x7fdd50109ad0 2024-05-08T06:05:32.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.674+0000 7fdd4d600700 1 -- 172.21.15.82:0/258939394 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd44022470 con 0x7fdd50109ad0 2024-05-08T06:05:32.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.675+0000 7fdd4d600700 1 -- 172.21.15.82:0/258939394 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd44017650 con 0x7fdd50109ad0 2024-05-08T06:05:32.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.675+0000 7fdd57400700 1 -- 172.21.15.82:0/258939394 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd501a5410 con 0x7fdd50109ad0 2024-05-08T06:05:32.675 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.675+0000 7fdd57400700 1 -- 172.21.15.82:0/258939394 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd501accf0 con 0x7fdd50109ad0 2024-05-08T06:05:32.679 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.680+0000 7fdd4d600700 1 -- 172.21.15.82:0/258939394 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fdd4402a070 con 0x7fdd50109ad0 2024-05-08T06:05:32.681 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.681+0000 7fdd61debb80 1 Processor -- start 2024-05-08T06:05:32.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.682+0000 7fdd61debb80 1 -- start start 2024-05-08T06:05:32.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.682+0000 7fdd61debb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4b04f7060 0x55c4b04f7440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:32.682 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.682+0000 7fdd4d600700 1 --2- 172.21.15.82:0/258939394 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fdd380b2900 0x7fdd380b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:32.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.682+0000 7fdd61debb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4b04f7980 0x55c4b04fb490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:32.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.682+0000 7fdd61debb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c4b04fb9d0 0x55c4b04fbe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:32.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.682+0000 7fdd61debb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c4b0449a20 con 0x55c4b04f7980 2024-05-08T06:05:32.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.682+0000 7fdd61debb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55c4b03e7760 con 0x55c4b04fb9d0 2024-05-08T06:05:32.683 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.682+0000 7fdd61debb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55c4b04459e0 con 0x55c4b04f7060 2024-05-08T06:05:32.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.683+0000 7fdd55400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4b04f7060 0x55c4b04f7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:32.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.684+0000 7fdd55400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c4b04fb9d0 0x55c4b04fbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:32.684 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.684+0000 7fdd4d600700 1 -- 172.21.15.82:0/258939394 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fdd440e2dc0 con 0x7fdd50109ad0 2024-05-08T06:05:32.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.684+0000 7fdd55400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4b04f7060 0x55c4b04f7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:45306/0 (socket says 172.21.15.82:45306) 2024-05-08T06:05:32.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.684+0000 7fdd55400700 1 -- 172.21.15.82:0/428014434 learned_addr learned my addr 172.21.15.82:0/428014434 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:05:32.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.684+0000 7fdd54a00700 1 --2- 172.21.15.82:0/258939394 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fdd380b2900 0x7fdd380b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:32.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.684+0000 7fdd4fe00700 1 --2- 172.21.15.82:0/428014434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4b04f7980 0x55c4b04fb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:32.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.685+0000 7fdd54a00700 1 --2- 172.21.15.82:0/258939394 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fdd380b2900 0x7fdd380b4dc0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fdd44006010 tx=0x7fdd4400b280 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:05:32.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.685+0000 7fdd4fe00700 1 -- 172.21.15.82:0/428014434 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4b04f7060 msgr2=0x55c4b04f7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:32.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.685+0000 7fdd4fe00700 1 --2- 172.21.15.82:0/428014434 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4b04f7060 0x55c4b04f7440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:32.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.685+0000 7fdd4fe00700 1 -- 172.21.15.82:0/428014434 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c4b04fb9d0 msgr2=0x55c4b04fbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:32.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.685+0000 7fdd4fe00700 1 --2- 172.21.15.82:0/428014434 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c4b04fb9d0 0x55c4b04fbe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:32.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.685+0000 7fdd4fe00700 1 -- 172.21.15.82:0/428014434 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4b03968d0 con 0x55c4b04f7980 2024-05-08T06:05:32.685 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.685+0000 7fdd4fe00700 1 --2- 172.21.15.82:0/428014434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4b04f7980 0x55c4b04fb490 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c009c90 tx=0x7fdd3c0113e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65b6039f0a791989 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:05:32.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.685+0000 7fdd42000700 1 -- 172.21.15.82:0/428014434 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c011c00 con 0x55c4b04f7980 2024-05-08T06:05:32.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.685+0000 7fdd42000700 1 -- 172.21.15.82:0/428014434 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd3c011da0 con 0x55c4b04f7980 2024-05-08T06:05:32.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.685+0000 7fdd42000700 1 -- 172.21.15.82:0/428014434 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c00f7c0 con 0x55c4b04f7980 2024-05-08T06:05:32.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.686+0000 7fdd61debb80 1 -- 172.21.15.82:0/428014434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4b04f7980 msgr2=0x55c4b04fb490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:32.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.686+0000 7fdd61debb80 1 --2- 172.21.15.82:0/428014434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4b04f7980 0x55c4b04fb490 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c009c90 tx=0x7fdd3c0113e0 comp rx=0 tx=0).stop 2024-05-08T06:05:32.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.686+0000 7fdd61debb80 1 -- 172.21.15.82:0/428014434 shutdown_connections 2024-05-08T06:05:32.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.686+0000 7fdd61debb80 1 --2- 172.21.15.82:0/428014434 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c4b04fb9d0 0x55c4b04fbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:32.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.686+0000 7fdd61debb80 1 --2- 172.21.15.82:0/428014434 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4b04f7060 0x55c4b04f7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:32.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.686+0000 7fdd61debb80 1 --2- 172.21.15.82:0/428014434 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4b04f7980 0x55c4b04fb490 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:32.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.686+0000 7fdd61debb80 1 -- 172.21.15.82:0/428014434 >> 172.21.15.82:0/428014434 conn(0x55c4b0425b60 msgr2=0x55c4b04f17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:05:32.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.687+0000 7fdd61debb80 1 -- 172.21.15.82:0/428014434 shutdown_connections 2024-05-08T06:05:32.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.687+0000 7fdd61debb80 1 -- 172.21.15.82:0/428014434 wait complete. 2024-05-08T06:05:32.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.687+0000 7fdd61debb80 1 -- start start 2024-05-08T06:05:32.687 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.687+0000 7fdd61debb80 1 Processor -- start 2024-05-08T06:05:32.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.688+0000 7fdd61debb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c4b04f7060 0x55c4b0502d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:32.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.688+0000 7fdd61debb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4b04f7980 0x55c4b05000f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:32.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.688+0000 7fdd55400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c4b04f7060 0x55c4b0502d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:32.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.688+0000 7fdd55400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c4b04f7060 0x55c4b0502d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:52410/0 (socket says 172.21.15.82:52410) 2024-05-08T06:05:32.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.688+0000 7fdd55400700 1 -- 172.21.15.82:0/3711324787 learned_addr learned my addr 172.21.15.82:0/3711324787 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:05:32.689 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.688+0000 7fdd61debb80 1 --2- 172.21.15.82:0/3711324787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4b04fb9d0 0x55c4b0500630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:32.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.689+0000 7fdd61debb80 1 -- 172.21.15.82:0/3711324787 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55c4b0514bf0 con 0x55c4b04fb9d0 2024-05-08T06:05:32.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.689+0000 7fdd61debb80 1 -- 172.21.15.82:0/3711324787 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55c4b03afb20 con 0x55c4b04f7060 2024-05-08T06:05:32.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.689+0000 7fdd61debb80 1 -- 172.21.15.82:0/3711324787 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55c4b0514d70 con 0x55c4b04f7980 2024-05-08T06:05:32.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.689+0000 7fdd4fe00700 1 --2- 172.21.15.82:0/3711324787 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4b04f7980 0x55c4b05000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:32.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.689+0000 7fdd4fe00700 1 -- 172.21.15.82:0/3711324787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c4b04f7060 msgr2=0x55c4b0502d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:32.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.689+0000 7fdd4fe00700 1 --2- 172.21.15.82:0/3711324787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c4b04f7060 0x55c4b0502d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:32.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.689+0000 7fdd4fe00700 1 -- 172.21.15.82:0/3711324787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4b04fb9d0 msgr2=0x55c4b0500630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:32.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.689+0000 7fdd4fe00700 1 --2- 172.21.15.82:0/3711324787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4b04fb9d0 0x55c4b0500630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:32.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.689+0000 7fdd4fe00700 1 -- 172.21.15.82:0/3711324787 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4b040f420 con 0x55c4b04f7980 2024-05-08T06:05:32.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.689+0000 7fdd61debb80 10 client.0 _ll_register_callbacks cb 0x55c4b03f0c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:05:32.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.689+0000 7fdd4fe00700 1 --2- 172.21.15.82:0/3711324787 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4b04f7980 0x55c4b05000f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c009c90 tx=0x7fdd3c005270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b58a05621abaebe server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:05:32.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.689+0000 7fdd36a00700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T06:05:32.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.690+0000 7fdd61debb80 1 -- 172.21.15.82:0/3711324787 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd3c011da0 con 0x55c4b04f7980 2024-05-08T06:05:32.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.690+0000 7fdd36a00700 1 -- 172.21.15.82:0/3711324787 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c027070 con 0x55c4b04f7980 2024-05-08T06:05:32.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.690+0000 7fdd36a00700 1 -- 172.21.15.82:0/3711324787 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fdd3c004220 con 0x55c4b04f7980 2024-05-08T06:05:32.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.690+0000 7fdd36a00700 1 -- 172.21.15.82:0/3711324787 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fdd3c032050 con 0x55c4b04f7980 2024-05-08T06:05:32.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.690+0000 7fdd61debb80 10 client.26863 fetch_fsmap learned FSMap version 31 2024-05-08T06:05:32.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.690+0000 7fdd61debb80 1 -- 172.21.15.82:0/3711324787 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({fsmap=31}) -- 0x55c4b051f2b0 con 0x55c4b04f7980 2024-05-08T06:05:32.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.691+0000 7fdd36a00700 1 -- 172.21.15.82:0/3711324787 <== mon.1 v2:172.21.15.151:3300/0 4 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fdd3c012450 con 0x55c4b04f7980 2024-05-08T06:05:32.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.691+0000 7fdd61debb80 10 client.26863 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:05:32.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.691+0000 7fdd61debb80 10 client.26863 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-08T06:05:32.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.691+0000 7fdd61debb80 20 client.26863 populate_metadata read hostname 'smithi082' 2024-05-08T06:05:32.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.691+0000 7fdd61debb80 1 --2- 172.21.15.82:0/3711324787 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x55c4b0521780 0x55c4b0523b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:32.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.691+0000 7fdd61debb80 4 client.26863 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:05:32.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.691+0000 7fdd61debb80 1 -- 172.21.15.82:0/3711324787 --> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c4b04c40a0 con 0x55c4b0521780 2024-05-08T06:05:32.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.691+0000 7fdd55400700 1 --2- 172.21.15.82:0/3711324787 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x55c4b0521780 0x55c4b0523b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:32.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.692+0000 7fdd55400700 1 --2- 172.21.15.82:0/3711324787 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x55c4b0521780 0x55c4b0523b70 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=79de7e6915020a9a server_cookie=66cff1f9a0f05053 in_seq=0 out_seq=0 2024-05-08T06:05:32.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.692+0000 7fdd36a00700 10 client.26863 ms_handle_connect on v2:172.21.15.151:6838/2963754236 2024-05-08T06:05:32.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.693+0000 7fdd36a00700 1 -- 172.21.15.82:0/3711324787 <== mds.1 v2:172.21.15.151:6838/2963754236 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55c4b04c40a0 con 0x55c4b0521780 2024-05-08T06:05:32.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.693+0000 7fdd36a00700 10 client.26863 handle_command_reply: tid=0 2024-05-08T06:05:32.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.693+0000 7fdd61debb80 1 client.26863 shutdown 2024-05-08T06:05:32.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.693+0000 7fdd61debb80 1 -- 172.21.15.82:0/3711324787 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4b04f7980 msgr2=0x55c4b05000f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:32.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.693+0000 7fdd61debb80 1 --2- 172.21.15.82:0/3711324787 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4b04f7980 0x55c4b05000f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c009c90 tx=0x7fdd3c005270 comp rx=0 tx=0).stop 2024-05-08T06:05:32.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.694+0000 7fdd61debb80 1 -- 172.21.15.82:0/3711324787 shutdown_connections 2024-05-08T06:05:32.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.694+0000 7fdd61debb80 1 --2- 172.21.15.82:0/3711324787 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x55c4b0521780 0x55c4b0523b70 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:32.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.694+0000 7fdd61debb80 1 --2- 172.21.15.82:0/3711324787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c4b04f7060 0x55c4b0502d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:32.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.694+0000 7fdd61debb80 1 --2- 172.21.15.82:0/3711324787 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4b04fb9d0 0x55c4b0500630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:32.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.694+0000 7fdd61debb80 1 --2- 172.21.15.82:0/3711324787 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4b04f7980 0x55c4b05000f0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:32.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.694+0000 7fdd61debb80 1 -- 172.21.15.82:0/3711324787 >> 172.21.15.82:0/3711324787 conn(0x55c4b0425b60 msgr2=0x55c4b04ec2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:05:32.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.694+0000 7fdd36a00700 0 client.26863 ms_handle_reset on v2:172.21.15.151:6838/2963754236 2024-05-08T06:05:32.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.694+0000 7fdd61debb80 1 -- 172.21.15.82:0/3711324787 shutdown_connections 2024-05-08T06:05:32.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.695+0000 7fdd61debb80 1 -- 172.21.15.82:0/3711324787 wait complete. 2024-05-08T06:05:32.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.695+0000 7fdd61debb80 20 client.26863 trim_cache size 0 max 16384 2024-05-08T06:05:32.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.718+0000 7fdd61debb80 1 Processor -- start 2024-05-08T06:05:32.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.718+0000 7fdd61debb80 1 -- start start 2024-05-08T06:05:32.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.718+0000 7fdd61debb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c4b04f7060 0x55c4b04f9390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:32.718 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.718+0000 7fdd61debb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4b04f7980 0x55c4b04f98d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:32.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.718+0000 7fdd61debb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4b04fb9d0 0x55c4b04fd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:32.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.718+0000 7fdd61debb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3000d2a0 con 0x55c4b04fb9d0 2024-05-08T06:05:32.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.718+0000 7fdd61debb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3000ede0 con 0x55c4b04f7060 2024-05-08T06:05:32.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.718+0000 7fdd61debb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3000d970 con 0x55c4b04f7980 2024-05-08T06:05:32.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.719+0000 7fdd4fe00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4b04f7980 0x55c4b04f98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:32.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.720+0000 7fdd4fe00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4b04f7980 0x55c4b04f98d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:45318/0 (socket says 172.21.15.82:45318) 2024-05-08T06:05:32.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.720+0000 7fdd4fe00700 1 -- 172.21.15.82:0/300410466 learned_addr learned my addr 172.21.15.82:0/300410466 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:05:32.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.720+0000 7fdd4fe00700 1 -- 172.21.15.82:0/300410466 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c4b04f7060 msgr2=0x55c4b04f9390 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-08T06:05:32.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.720+0000 7fdd4fe00700 1 --2- 172.21.15.82:0/300410466 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c4b04f7060 0x55c4b04f9390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:32.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.720+0000 7fdd4fe00700 1 -- 172.21.15.82:0/300410466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4b04fb9d0 msgr2=0x55c4b04fd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:32.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.720+0000 7fdd55400700 1 --2- 172.21.15.82:0/300410466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4b04fb9d0 0x55c4b04fd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:32.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.720+0000 7fdd4fe00700 1 --2- 172.21.15.82:0/300410466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4b04fb9d0 0x55c4b04fd2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:32.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.720+0000 7fdd4fe00700 1 -- 172.21.15.82:0/300410466 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4b0503530 con 0x55c4b04f7980 2024-05-08T06:05:32.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.720+0000 7fdd55400700 1 --2- 172.21.15.82:0/300410466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4b04fb9d0 0x55c4b04fd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:05:32.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.721+0000 7fdd4fe00700 1 --2- 172.21.15.82:0/300410466 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4b04f7980 0x55c4b04f98d0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c011f90 tx=0x7fdd3c014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4857a0c140988b97 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:05:32.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.721+0000 7fdd41600700 1 -- 172.21.15.82:0/300410466 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c005720 con 0x55c4b04f7980 2024-05-08T06:05:32.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.721+0000 7fdd41600700 1 -- 172.21.15.82:0/300410466 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd3c011da0 con 0x55c4b04f7980 2024-05-08T06:05:32.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.721+0000 7fdd41600700 1 -- 172.21.15.82:0/300410466 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c004950 con 0x55c4b04f7980 2024-05-08T06:05:32.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.722+0000 7fdd61debb80 1 -- 172.21.15.82:0/300410466 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4b04f7980 msgr2=0x55c4b04f98d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:32.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.722+0000 7fdd61debb80 1 --2- 172.21.15.82:0/300410466 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4b04f7980 0x55c4b04f98d0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c011f90 tx=0x7fdd3c014000 comp rx=0 tx=0).stop 2024-05-08T06:05:32.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.722+0000 7fdd61debb80 1 -- 172.21.15.82:0/300410466 shutdown_connections 2024-05-08T06:05:32.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.722+0000 7fdd61debb80 1 --2- 172.21.15.82:0/300410466 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c4b04f7060 0x55c4b04f9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:32.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.722+0000 7fdd61debb80 1 --2- 172.21.15.82:0/300410466 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4b04fb9d0 0x55c4b04fd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:32.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.722+0000 7fdd61debb80 1 --2- 172.21.15.82:0/300410466 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4b04f7980 0x55c4b04f98d0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:32.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.722+0000 7fdd61debb80 1 -- 172.21.15.82:0/300410466 >> 172.21.15.82:0/300410466 conn(0x55c4b0425b60 msgr2=0x55c4b04fe9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:05:32.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.722+0000 7fdd61debb80 1 -- 172.21.15.82:0/300410466 shutdown_connections 2024-05-08T06:05:32.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.722+0000 7fdd61debb80 1 -- 172.21.15.82:0/300410466 wait complete. 2024-05-08T06:05:32.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.722+0000 7fdd61debb80 1 -- start start 2024-05-08T06:05:32.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.723+0000 7fdd61debb80 1 Processor -- start 2024-05-08T06:05:32.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.723+0000 7fdd61debb80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c4b04f7060 0x55c4b04f8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:32.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.723+0000 7fdd61debb80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4b04f7980 0x55c4b04f92d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:32.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.723+0000 7fdd61debb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4b04fb9d0 0x55c4b04f9810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:32.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.723+0000 7fdd61debb80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3000e710 con 0x55c4b04f7980 2024-05-08T06:05:32.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.723+0000 7fdd61debb80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3000e040 con 0x55c4b04f7060 2024-05-08T06:05:32.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.723+0000 7fdd61debb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3000b240 con 0x55c4b04fb9d0 2024-05-08T06:05:32.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.723+0000 7fdd61debb80 10 client.0 _ll_register_callbacks cb 0x55c4b03f0c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:05:32.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.723+0000 7fdd55400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4b04fb9d0 0x55c4b04f9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:32.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.724+0000 7fdd55400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4b04fb9d0 0x55c4b04f9810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:45322/0 (socket says 172.21.15.82:45322) 2024-05-08T06:05:32.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.724+0000 7fdd55400700 1 -- 172.21.15.82:0/326937587 learned_addr learned my addr 172.21.15.82:0/326937587 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:05:32.724 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.724+0000 7fdd55400700 1 --2- 172.21.15.82:0/326937587 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c4b04f7060 0x55c4b04f8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:32.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.724+0000 7fdd4fe00700 1 --2- 172.21.15.82:0/326937587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4b04f7980 0x55c4b04f92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:32.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.724+0000 7fdd55400700 1 -- 172.21.15.82:0/326937587 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c4b04f7060 msgr2=0x55c4b04f8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:32.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.724+0000 7fdd55400700 1 --2- 172.21.15.82:0/326937587 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c4b04f7060 0x55c4b04f8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:32.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.724+0000 7fdd55400700 1 -- 172.21.15.82:0/326937587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4b04f7980 msgr2=0x55c4b04f92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:32.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.724+0000 7fdd55400700 1 --2- 172.21.15.82:0/326937587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4b04f7980 0x55c4b04f92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:32.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.724+0000 7fdd55400700 1 -- 172.21.15.82:0/326937587 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4b058ac90 con 0x55c4b04fb9d0 2024-05-08T06:05:32.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.724+0000 7fdd4fe00700 1 --2- 172.21.15.82:0/326937587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4b04f7980 0x55c4b04f92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:05:32.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.724+0000 7fdd55400700 1 --2- 172.21.15.82:0/326937587 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4b04fb9d0 0x55c4b04f9810 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fdd480092e0 tx=0x7fdd48004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e4458f559480a39 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:05:32.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.724+0000 7fdd36a00700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T06:05:32.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.725+0000 7fdd36a00700 1 -- 172.21.15.82:0/326937587 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd480045e0 con 0x55c4b04fb9d0 2024-05-08T06:05:32.726 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.725+0000 7fdd61debb80 1 -- 172.21.15.82:0/326937587 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd3c011da0 con 0x55c4b04fb9d0 2024-05-08T06:05:32.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.725+0000 7fdd36a00700 1 -- 172.21.15.82:0/326937587 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fdd48004780 con 0x55c4b04fb9d0 2024-05-08T06:05:32.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.725+0000 7fdd36a00700 1 -- 172.21.15.82:0/326937587 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fdd48022240 con 0x55c4b04fb9d0 2024-05-08T06:05:32.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.725+0000 7fdd61debb80 10 client.26869 fetch_fsmap learned FSMap version 31 2024-05-08T06:05:32.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.725+0000 7fdd61debb80 1 -- 172.21.15.82:0/326937587 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55c4b058bf10 con 0x55c4b04fb9d0 2024-05-08T06:05:32.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.726+0000 7fdd36a00700 1 -- 172.21.15.82:0/326937587 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fdd3c011da0 con 0x55c4b04fb9d0 2024-05-08T06:05:32.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.726+0000 7fdd36a00700 1 -- 172.21.15.82:0/326937587 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fdd4802d030 con 0x55c4b04fb9d0 2024-05-08T06:05:32.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.727+0000 7fdd61debb80 10 client.26869 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:05:32.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.727+0000 7fdd61debb80 10 client.26869 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-08T06:05:32.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.727+0000 7fdd61debb80 20 client.26869 populate_metadata read hostname 'smithi082' 2024-05-08T06:05:32.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.727+0000 7fdd61debb80 1 --2- 172.21.15.82:0/326937587 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x55c4b058c5d0 0x55c4b058e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:32.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.727+0000 7fdd61debb80 4 client.26869 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T06:05:32.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.727+0000 7fdd61debb80 1 -- 172.21.15.82:0/326937587 --> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c4b0457400 con 0x55c4b058c5d0 2024-05-08T06:05:32.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.727+0000 7fdd4fe00700 1 --2- 172.21.15.82:0/326937587 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x55c4b058c5d0 0x55c4b058e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:32.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.728+0000 7fdd36a00700 10 client.26869 ms_handle_connect on v2:172.21.15.151:6838/2963754236 2024-05-08T06:05:32.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.728+0000 7fdd4fe00700 1 --2- 172.21.15.82:0/326937587 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x55c4b058c5d0 0x55c4b058e9f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7458d0d29489d3ef server_cookie=2eb7042fa80c3772 in_seq=0 out_seq=0 2024-05-08T06:05:32.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.729+0000 7fdd36a00700 1 -- 172.21.15.82:0/326937587 <== mds.1 v2:172.21.15.151:6838/2963754236 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c4b0457400 con 0x55c4b058c5d0 2024-05-08T06:05:32.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.729+0000 7fdd36a00700 10 client.26869 handle_command_reply: tid=0 2024-05-08T06:05:32.728 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.729+0000 7fdd61debb80 1 client.26869 shutdown 2024-05-08T06:05:32.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.729+0000 7fdd61debb80 1 -- 172.21.15.82:0/326937587 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4b04fb9d0 msgr2=0x55c4b04f9810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:32.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.729+0000 7fdd61debb80 1 --2- 172.21.15.82:0/326937587 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4b04fb9d0 0x55c4b04f9810 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fdd480092e0 tx=0x7fdd48004ad0 comp rx=0 tx=0).stop 2024-05-08T06:05:32.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.730+0000 7fdd61debb80 1 -- 172.21.15.82:0/326937587 shutdown_connections 2024-05-08T06:05:32.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.730+0000 7fdd61debb80 1 --2- 172.21.15.82:0/326937587 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x55c4b058c5d0 0x55c4b058e9f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:32.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.730+0000 7fdd61debb80 1 --2- 172.21.15.82:0/326937587 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c4b04f7060 0x55c4b04f8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:32.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.730+0000 7fdd61debb80 1 --2- 172.21.15.82:0/326937587 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c4b04fb9d0 0x55c4b04f9810 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:32.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.730+0000 7fdd61debb80 1 --2- 172.21.15.82:0/326937587 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55c4b04f7980 0x55c4b04f92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:32.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.730+0000 7fdd36a00700 0 client.26869 ms_handle_reset on v2:172.21.15.151:6838/2963754236 2024-05-08T06:05:32.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.730+0000 7fdd61debb80 1 -- 172.21.15.82:0/326937587 >> 172.21.15.82:0/326937587 conn(0x55c4b0425b60 msgr2=0x55c4b04ec2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:05:32.730 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.730+0000 7fdd61debb80 1 -- 172.21.15.82:0/326937587 shutdown_connections 2024-05-08T06:05:32.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.730+0000 7fdd61debb80 1 -- 172.21.15.82:0/326937587 wait complete. 2024-05-08T06:05:32.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.731+0000 7fdd61debb80 20 client.26869 trim_cache size 0 max 16384 2024-05-08T06:05:32.731 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T06:05:32.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.731+0000 7fdd57400700 1 -- 172.21.15.82:0/258939394 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fdd380b2900 msgr2=0x7fdd380b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:32.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.731+0000 7fdd57400700 1 --2- 172.21.15.82:0/258939394 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fdd380b2900 0x7fdd380b4dc0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fdd44006010 tx=0x7fdd4400b280 comp rx=0 tx=0).stop 2024-05-08T06:05:32.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.732+0000 7fdd57400700 1 -- 172.21.15.82:0/258939394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdd50109ad0 msgr2=0x7fdd501a0170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:32.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.732+0000 7fdd57400700 1 --2- 172.21.15.82:0/258939394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdd50109ad0 0x7fdd501a0170 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fdd44000c00 tx=0x7fdd4400bfd0 comp rx=0 tx=0).stop 2024-05-08T06:05:32.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.732+0000 7fdd57400700 1 -- 172.21.15.82:0/258939394 shutdown_connections 2024-05-08T06:05:32.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.732+0000 7fdd57400700 1 --2- 172.21.15.82:0/258939394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdd50109ad0 0x7fdd501a0170 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:32.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.732+0000 7fdd57400700 1 --2- 172.21.15.82:0/258939394 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fdd380b2900 0x7fdd380b4dc0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:32.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.732+0000 7fdd57400700 1 --2- 172.21.15.82:0/258939394 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd5010fb60 0x7fdd501a4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:32.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.732+0000 7fdd57400700 1 --2- 172.21.15.82:0/258939394 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fdd5010a490 0x7fdd501a06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:32.732 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.732+0000 7fdd57400700 1 -- 172.21.15.82:0/258939394 >> 172.21.15.82:0/258939394 conn(0x7fdd50076c70 msgr2=0x7fdd50077290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:05:32.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.733+0000 7fdd57400700 1 -- 172.21.15.82:0/258939394 shutdown_connections 2024-05-08T06:05:32.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:32.733+0000 7fdd57400700 1 -- 172.21.15.82:0/258939394 wait complete. 2024-05-08T06:05:34.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:05:33 smithi151 ceph-mon[34815]: pgmap v906: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.5 MiB/s wr, 653 op/s 2024-05-08T06:05:34.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:05:33 smithi082 ceph-mon[30098]: pgmap v906: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.5 MiB/s wr, 653 op/s 2024-05-08T06:05:34.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:05:33 smithi134 ceph-mon[34132]: pgmap v906: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.5 MiB/s wr, 653 op/s 2024-05-08T06:05:34.393 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-05-08T06:05:35.044 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:05:35.267 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 885.0 s, 1260.4 tps, lat 78.760 ms stddev 87.172 2024-05-08T06:05:35.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:05:35 smithi082 ceph-mon[30098]: pgmap v907: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 4.6 MiB/s wr, 505 op/s 2024-05-08T06:05:36.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:05:35 smithi151 ceph-mon[34815]: pgmap v907: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 4.6 MiB/s wr, 505 op/s 2024-05-08T06:05:36.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:05:35 smithi134 ceph-mon[34132]: pgmap v907: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 4.6 MiB/s wr, 505 op/s 2024-05-08T06:05:37.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:05:37 smithi082 ceph-mon[30098]: pgmap v908: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.8 MiB/s wr, 715 op/s 2024-05-08T06:05:38.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.035+0000 7f949ba00700 1 -- 172.21.15.82:0/1250048437 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f949406b180 msgr2=0x7f949406b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:38.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.035+0000 7f949ba00700 1 --2- 172.21.15.82:0/1250048437 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f949406b180 0x7f949406b600 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f9480009990 tx=0x7f9480009ca0 comp rx=0 tx=0).stop 2024-05-08T06:05:38.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.035+0000 7f949ba00700 1 -- 172.21.15.82:0/1250048437 shutdown_connections 2024-05-08T06:05:38.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.035+0000 7f949ba00700 1 --2- 172.21.15.82:0/1250048437 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f949406bb40 0x7f9494110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:38.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.035+0000 7f949ba00700 1 --2- 172.21.15.82:0/1250048437 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9494109510 0x7f94941098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:38.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.035+0000 7f949ba00700 1 --2- 172.21.15.82:0/1250048437 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f949406b180 0x7f949406b600 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:38.035 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.035+0000 7f949ba00700 1 -- 172.21.15.82:0/1250048437 >> 172.21.15.82:0/1250048437 conn(0x7f9494079350 msgr2=0x7f9494079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:05:38.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.035+0000 7f949ba00700 1 -- 172.21.15.82:0/1250048437 shutdown_connections 2024-05-08T06:05:38.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.035+0000 7f949ba00700 1 -- 172.21.15.82:0/1250048437 wait complete. 2024-05-08T06:05:38.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.036+0000 7f949ba00700 1 Processor -- start 2024-05-08T06:05:38.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.037+0000 7f949ba00700 1 -- start start 2024-05-08T06:05:38.036 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.037+0000 7f949ba00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f949406b180 0x7f94941a5e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:38.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.037+0000 7f949ba00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f949406bb40 0x7f94941a63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:38.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.037+0000 7f949ba00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9494109510 0x7f949410f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:38.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.037+0000 7f949ba00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f94941136c0 con 0x7f949406bb40 2024-05-08T06:05:38.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.037+0000 7f949ba00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9494113540 con 0x7f949406b180 2024-05-08T06:05:38.037 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.037+0000 7f949ba00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9494113840 con 0x7f9494109510 2024-05-08T06:05:38.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.038+0000 7f9499000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f949406b180 0x7f94941a5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:38.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.038+0000 7f9499000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f949406b180 0x7f94941a5e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:41270/0 (socket says 172.21.15.82:41270) 2024-05-08T06:05:38.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.038+0000 7f9499000700 1 -- 172.21.15.82:0/1574019962 learned_addr learned my addr 172.21.15.82:0/1574019962 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:05:38.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.038+0000 7f9499a00700 1 --2- 172.21.15.82:0/1574019962 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9494109510 0x7f949410f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:38.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.038+0000 7f9493e00700 1 --2- 172.21.15.82:0/1574019962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f949406bb40 0x7f94941a63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:38.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.038+0000 7f9499000700 1 -- 172.21.15.82:0/1574019962 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9494109510 msgr2=0x7f949410f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:38.038 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.038+0000 7f9499000700 1 --2- 172.21.15.82:0/1574019962 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9494109510 0x7f949410f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:38.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.038+0000 7f9499000700 1 -- 172.21.15.82:0/1574019962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f949406bb40 msgr2=0x7f94941a63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:38.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.038+0000 7f9499000700 1 --2- 172.21.15.82:0/1574019962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f949406bb40 0x7f94941a63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:38.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.038+0000 7f9499000700 1 -- 172.21.15.82:0/1574019962 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f949410fd20 con 0x7f949406b180 2024-05-08T06:05:38.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.038+0000 7f9493e00700 1 --2- 172.21.15.82:0/1574019962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f949406bb40 0x7f94941a63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:05:38.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.039+0000 7f9499000700 1 --2- 172.21.15.82:0/1574019962 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f949406b180 0x7f94941a5e60 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f948800d950 tx=0x7f948800dd10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:05:38.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.039+0000 7f9491600700 1 -- 172.21.15.82:0/1574019962 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9488016070 con 0x7f949406b180 2024-05-08T06:05:38.039 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.039+0000 7f949ba00700 1 -- 172.21.15.82:0/1574019962 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9494110010 con 0x7f949406b180 2024-05-08T06:05:38.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.039+0000 7f9491600700 1 -- 172.21.15.82:0/1574019962 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9488010460 con 0x7f949406b180 2024-05-08T06:05:38.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.039+0000 7f9491600700 1 -- 172.21.15.82:0/1574019962 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f948800f620 con 0x7f949406b180 2024-05-08T06:05:38.040 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.039+0000 7f949ba00700 1 -- 172.21.15.82:0/1574019962 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94941ace90 con 0x7f949406b180 2024-05-08T06:05:38.043 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.043+0000 7f9491600700 1 -- 172.21.15.82:0/1574019962 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f9488019070 con 0x7f949406b180 2024-05-08T06:05:38.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.045+0000 7f9491600700 1 --2- 172.21.15.82:0/1574019962 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f947c0b28c0 0x7f947c0b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:38.044 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.045+0000 7f9491600700 1 -- 172.21.15.82:0/1574019962 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f94880e1e50 con 0x7f949406b180 2024-05-08T06:05:38.045 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.045+0000 7f9493e00700 1 --2- 172.21.15.82:0/1574019962 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f947c0b28c0 0x7f947c0b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:38.046 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.047+0000 7f94a62d8b80 1 Processor -- start 2024-05-08T06:05:38.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.047+0000 7f9493e00700 1 --2- 172.21.15.82:0/1574019962 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f947c0b28c0 0x7f947c0b4d80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9480005cd0 tx=0x7f9480005c00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:05:38.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.047+0000 7f94a62d8b80 1 -- start start 2024-05-08T06:05:38.047 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.048+0000 7f94a62d8b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562494dcd060 0x562494dcd440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:38.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.048+0000 7f94a62d8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562494dcd980 0x562494dd1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:38.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.048+0000 7f94a62d8b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562494dd19d0 0x562494dd1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:38.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.048+0000 7f94a62d8b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x562494d1fa20 con 0x562494dcd980 2024-05-08T06:05:38.048 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.048+0000 7f94a62d8b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562494cbd760 con 0x562494dcd060 2024-05-08T06:05:38.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.048+0000 7f94a62d8b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x562494d1b9e0 con 0x562494dd19d0 2024-05-08T06:05:38.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.048+0000 7f9499000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562494dcd060 0x562494dcd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:38.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.048+0000 7f9499000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562494dcd060 0x562494dcd440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:41272/0 (socket says 172.21.15.82:41272) 2024-05-08T06:05:38.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.048+0000 7f9499000700 1 -- 172.21.15.82:0/1921231858 learned_addr learned my addr 172.21.15.82:0/1921231858 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:05:38.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.048+0000 7f9499a00700 1 --2- 172.21.15.82:0/1921231858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562494dd19d0 0x562494dd1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:38.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.048+0000 7f9499000700 1 -- 172.21.15.82:0/1921231858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562494dd19d0 msgr2=0x562494dd1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:38.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.048+0000 7f9499000700 1 --2- 172.21.15.82:0/1921231858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562494dd19d0 0x562494dd1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:38.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.048+0000 7f9499000700 1 -- 172.21.15.82:0/1921231858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562494dcd980 msgr2=0x562494dd1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:38.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.048+0000 7f9499000700 1 --2- 172.21.15.82:0/1921231858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562494dcd980 0x562494dd1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:38.049 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.049+0000 7f9499000700 1 -- 172.21.15.82:0/1921231858 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562494c6c8d0 con 0x562494dcd060 2024-05-08T06:05:38.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.049+0000 7f9499000700 1 --2- 172.21.15.82:0/1921231858 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562494dcd060 0x562494dcd440 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f9488009520 tx=0x7f94880a9000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60dbddb302025a57 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:05:38.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.050+0000 7f9486000700 1 -- 172.21.15.82:0/1921231858 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9488020070 con 0x562494dcd060 2024-05-08T06:05:38.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.050+0000 7f9486000700 1 -- 172.21.15.82:0/1921231858 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94880ad7d0 con 0x562494dcd060 2024-05-08T06:05:38.050 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.050+0000 7f9486000700 1 -- 172.21.15.82:0/1921231858 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94880b1df0 con 0x562494dcd060 2024-05-08T06:05:38.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.051+0000 7f94a62d8b80 1 -- 172.21.15.82:0/1921231858 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562494dcd060 msgr2=0x562494dcd440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:38.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.051+0000 7f94a62d8b80 1 --2- 172.21.15.82:0/1921231858 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562494dcd060 0x562494dcd440 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f9488009520 tx=0x7f94880a9000 comp rx=0 tx=0).stop 2024-05-08T06:05:38.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.051+0000 7f94a62d8b80 1 -- 172.21.15.82:0/1921231858 shutdown_connections 2024-05-08T06:05:38.051 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.051+0000 7f94a62d8b80 1 --2- 172.21.15.82:0/1921231858 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562494dcd060 0x562494dcd440 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:38.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.051+0000 7f94a62d8b80 1 --2- 172.21.15.82:0/1921231858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562494dd19d0 0x562494dd1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:38.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.051+0000 7f94a62d8b80 1 --2- 172.21.15.82:0/1921231858 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562494dcd980 0x562494dd1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:38.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.051+0000 7f94a62d8b80 1 -- 172.21.15.82:0/1921231858 >> 172.21.15.82:0/1921231858 conn(0x562494cfbb60 msgr2=0x562494dc77a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:05:38.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.051+0000 7f94a62d8b80 1 -- 172.21.15.82:0/1921231858 shutdown_connections 2024-05-08T06:05:38.052 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.051+0000 7f94a62d8b80 1 -- 172.21.15.82:0/1921231858 wait complete. 2024-05-08T06:05:38.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.052+0000 7f94a62d8b80 1 -- start start 2024-05-08T06:05:38.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.053+0000 7f94a62d8b80 1 Processor -- start 2024-05-08T06:05:38.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.053+0000 7f94a62d8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562494dcd060 0x562494dd8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:38.053 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.053+0000 7f94a62d8b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562494dcd980 0x562494dd62e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:38.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.053+0000 7f94a62d8b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562494dd19d0 0x562494dd6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:38.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.053+0000 7f94a62d8b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x562494dd9b80 con 0x562494dcd060 2024-05-08T06:05:38.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.053+0000 7f94a62d8b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562494c85b20 con 0x562494dcd980 2024-05-08T06:05:38.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.053+0000 7f94a62d8b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x562494dd9d00 con 0x562494dd19d0 2024-05-08T06:05:38.054 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.053+0000 7f94a62d8b80 10 client.0 _ll_register_callbacks cb 0x562494cc6c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:05:38.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.054+0000 7f9499000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562494dcd060 0x562494dd8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:38.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.054+0000 7f9493e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562494dcd980 0x562494dd62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:38.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.054+0000 7f9499000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562494dcd060 0x562494dd8ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:35286/0 (socket says 172.21.15.82:35286) 2024-05-08T06:05:38.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.054+0000 7f9499000700 1 -- 172.21.15.82:0/1115401091 learned_addr learned my addr 172.21.15.82:0/1115401091 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:05:38.058 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.054+0000 7f9499a00700 1 --2- 172.21.15.82:0/1115401091 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562494dd19d0 0x562494dd6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:38.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.055+0000 7f9499a00700 1 -- 172.21.15.82:0/1115401091 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562494dcd980 msgr2=0x562494dd62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:38.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.055+0000 7f9499a00700 1 --2- 172.21.15.82:0/1115401091 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562494dcd980 0x562494dd62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:38.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.055+0000 7f9499a00700 1 -- 172.21.15.82:0/1115401091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562494dcd060 msgr2=0x562494dd8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:38.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.055+0000 7f9499a00700 1 --2- 172.21.15.82:0/1115401091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562494dcd060 0x562494dd8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:38.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.055+0000 7f9499a00700 1 -- 172.21.15.82:0/1115401091 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562494ce5420 con 0x562494dd19d0 2024-05-08T06:05:38.059 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.056+0000 7f9499a00700 1 --2- 172.21.15.82:0/1115401091 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562494dd19d0 0x562494dd6820 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f948c007a80 tx=0x7f948c007d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a464b5870e0343d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:05:38.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.056+0000 7f947aa00700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T06:05:38.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.056+0000 7f947aa00700 1 -- 172.21.15.82:0/1115401091 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f948c004db0 con 0x562494dd19d0 2024-05-08T06:05:38.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.056+0000 7f947aa00700 1 -- 172.21.15.82:0/1115401091 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f948c004bb0 con 0x562494dd19d0 2024-05-08T06:05:38.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.057+0000 7f94a62d8b80 1 -- 172.21.15.82:0/1115401091 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94880ad7d0 con 0x562494dd19d0 2024-05-08T06:05:38.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.057+0000 7f947aa00700 1 -- 172.21.15.82:0/1115401091 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f948c004db0 con 0x562494dd19d0 2024-05-08T06:05:38.060 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.057+0000 7f94a62d8b80 10 client.26881 fetch_fsmap learned FSMap version 31 2024-05-08T06:05:38.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.057+0000 7f94a62d8b80 1 -- 172.21.15.82:0/1115401091 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x562494de4580 con 0x562494dd19d0 2024-05-08T06:05:38.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.058+0000 7f947aa00700 1 -- 172.21.15.82:0/1115401091 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f948c012d70 con 0x562494dd19d0 2024-05-08T06:05:38.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.058+0000 7f947aa00700 1 -- 172.21.15.82:0/1115401091 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f948c005780 con 0x562494dd19d0 2024-05-08T06:05:38.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.058+0000 7f94a62d8b80 10 client.26881 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:05:38.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.058+0000 7f94a62d8b80 10 client.26881 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T06:05:38.061 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.058+0000 7f94a62d8b80 20 client.26881 populate_metadata read hostname 'smithi082' 2024-05-08T06:05:38.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.058+0000 7f94a62d8b80 1 --2- 172.21.15.82:0/1115401091 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x562494de6bc0 0x562494de8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:38.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.058+0000 7f94a62d8b80 4 client.26881 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:05:38.062 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.058+0000 7f94a62d8b80 1 -- 172.21.15.82:0/1115401091 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f94880ad7d0 con 0x562494de6bc0 2024-05-08T06:05:38.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.058+0000 7f9499000700 1 --2- 172.21.15.82:0/1115401091 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x562494de6bc0 0x562494de8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:38.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.059+0000 7f9499000700 1 --2- 172.21.15.82:0/1115401091 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x562494de6bc0 0x562494de8fd0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92e70aa7b13f2d25 server_cookie=37980f7761df5b5e in_seq=0 out_seq=0 2024-05-08T06:05:38.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.059+0000 7f947aa00700 10 client.26881 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T06:05:38.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.060+0000 7f947aa00700 1 -- 172.21.15.82:0/1115401091 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7f94880ad7d0 con 0x562494de6bc0 2024-05-08T06:05:38.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.060+0000 7f947aa00700 10 client.26881 handle_command_reply: tid=0 2024-05-08T06:05:38.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.060+0000 7f94a62d8b80 1 client.26881 shutdown 2024-05-08T06:05:38.064 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.061+0000 7f94a62d8b80 1 -- 172.21.15.82:0/1115401091 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562494dd19d0 msgr2=0x562494dd6820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:38.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.061+0000 7f94a62d8b80 1 --2- 172.21.15.82:0/1115401091 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562494dd19d0 0x562494dd6820 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f948c007a80 tx=0x7f948c007d90 comp rx=0 tx=0).stop 2024-05-08T06:05:38.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.061+0000 7f94a62d8b80 1 -- 172.21.15.82:0/1115401091 shutdown_connections 2024-05-08T06:05:38.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.061+0000 7f94a62d8b80 1 --2- 172.21.15.82:0/1115401091 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562494dd19d0 0x562494dd6820 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:38.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.061+0000 7f94a62d8b80 1 --2- 172.21.15.82:0/1115401091 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562494dcd060 0x562494dd8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:38.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.061+0000 7f94a62d8b80 1 --2- 172.21.15.82:0/1115401091 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x562494de6bc0 0x562494de8fd0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:38.065 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.061+0000 7f94a62d8b80 1 --2- 172.21.15.82:0/1115401091 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562494dcd980 0x562494dd62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:38.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.061+0000 7f94a62d8b80 1 -- 172.21.15.82:0/1115401091 >> 172.21.15.82:0/1115401091 conn(0x562494cfbb60 msgr2=0x562494dc7760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:05:38.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.061+0000 7f947aa00700 0 client.26881 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T06:05:38.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.061+0000 7f94a62d8b80 1 -- 172.21.15.82:0/1115401091 shutdown_connections 2024-05-08T06:05:38.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.061+0000 7f94a62d8b80 1 -- 172.21.15.82:0/1115401091 wait complete. 2024-05-08T06:05:38.066 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.062+0000 7f94a62d8b80 20 client.26881 trim_cache size 0 max 16384 2024-05-08T06:05:38.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.095+0000 7f94a62d8b80 1 Processor -- start 2024-05-08T06:05:38.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.096+0000 7f94a62d8b80 1 -- start start 2024-05-08T06:05:38.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.097+0000 7f94a62d8b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562494dcd060 0x562494dcc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:38.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.097+0000 7f94a62d8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562494dcd980 0x562494dee8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:38.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.097+0000 7f94a62d8b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562494dd19d0 0x562494deede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:38.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.097+0000 7f94a62d8b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f94941b4320 con 0x562494dcd980 2024-05-08T06:05:38.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.097+0000 7f94a62d8b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f94941b5e60 con 0x562494dd19d0 2024-05-08T06:05:38.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.097+0000 7f94a62d8b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f94941b49f0 con 0x562494dcd060 2024-05-08T06:05:38.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.098+0000 7f9499000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562494dcd060 0x562494dcc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:38.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.098+0000 7f9499000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562494dcd060 0x562494dcc580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:34704/0 (socket says 172.21.15.82:34704) 2024-05-08T06:05:38.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.098+0000 7f9499000700 1 -- 172.21.15.82:0/398773448 learned_addr learned my addr 172.21.15.82:0/398773448 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:05:38.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.098+0000 7f9499a00700 1 --2- 172.21.15.82:0/398773448 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562494dd19d0 0x562494deede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:38.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.098+0000 7f9493e00700 1 --2- 172.21.15.82:0/398773448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562494dcd980 0x562494dee8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:38.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.098+0000 7f9499000700 1 -- 172.21.15.82:0/398773448 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562494dd19d0 msgr2=0x562494deede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:38.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.100+0000 7f9499000700 1 --2- 172.21.15.82:0/398773448 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562494dd19d0 0x562494deede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:38.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.100+0000 7f9499000700 1 -- 172.21.15.82:0/398773448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562494dcd980 msgr2=0x562494dee8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:38.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.100+0000 7f9499000700 1 --2- 172.21.15.82:0/398773448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562494dcd980 0x562494dee8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:38.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.100+0000 7f9499000700 1 -- 172.21.15.82:0/398773448 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562494dd4870 con 0x562494dcd060 2024-05-08T06:05:38.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.100+0000 7f9499a00700 1 --2- 172.21.15.82:0/398773448 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562494dd19d0 0x562494deede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:05:38.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.100+0000 7f9493e00700 1 --2- 172.21.15.82:0/398773448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562494dcd980 0x562494dee8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:05:38.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.100+0000 7f9499000700 1 --2- 172.21.15.82:0/398773448 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562494dcd060 0x562494dcc580 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f94880a9120 tx=0x7f9488091170 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17c25bd8532eb01b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:05:38.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.100+0000 7f9485600700 1 -- 172.21.15.82:0/398773448 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9488020040 con 0x562494dcd060 2024-05-08T06:05:38.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.101+0000 7f9485600700 1 -- 172.21.15.82:0/398773448 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94880b2280 con 0x562494dcd060 2024-05-08T06:05:38.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.102+0000 7f94a62d8b80 1 -- 172.21.15.82:0/398773448 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562494dcd060 msgr2=0x562494dcc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:38.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.102+0000 7f94a62d8b80 1 --2- 172.21.15.82:0/398773448 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562494dcd060 0x562494dcc580 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f94880a9120 tx=0x7f9488091170 comp rx=0 tx=0).stop 2024-05-08T06:05:38.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.104+0000 7f94a62d8b80 1 -- 172.21.15.82:0/398773448 shutdown_connections 2024-05-08T06:05:38.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.104+0000 7f94a62d8b80 1 --2- 172.21.15.82:0/398773448 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562494dd19d0 0x562494deede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:38.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.104+0000 7f94a62d8b80 1 --2- 172.21.15.82:0/398773448 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562494dcd060 0x562494dcc580 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:38.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.104+0000 7f94a62d8b80 1 --2- 172.21.15.82:0/398773448 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562494dcd980 0x562494dee8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:38.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.104+0000 7f94a62d8b80 1 -- 172.21.15.82:0/398773448 >> 172.21.15.82:0/398773448 conn(0x562494cfbb60 msgr2=0x562494dcbe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:05:38.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.104+0000 7f94a62d8b80 1 -- 172.21.15.82:0/398773448 shutdown_connections 2024-05-08T06:05:38.104 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.104+0000 7f94a62d8b80 1 -- 172.21.15.82:0/398773448 wait complete. 2024-05-08T06:05:38.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.105+0000 7f94a62d8b80 1 -- start start 2024-05-08T06:05:38.105 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.105+0000 7f94a62d8b80 1 Processor -- start 2024-05-08T06:05:38.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.106+0000 7f94a62d8b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562494dcd060 0x562494e48c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:38.106 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.107+0000 7f94a62d8b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562494dcd980 0x562494e491d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:38.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.107+0000 7f94a62d8b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562494dd19d0 0x562494ddea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:38.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.107+0000 7f94a62d8b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f94941b5790 con 0x562494dcd060 2024-05-08T06:05:38.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.107+0000 7f94a62d8b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f94941b50c0 con 0x562494dcd980 2024-05-08T06:05:38.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.107+0000 7f9499a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562494dd19d0 0x562494ddea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:38.107 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.107+0000 7f9499a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562494dd19d0 0x562494ddea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:34714/0 (socket says 172.21.15.82:34714) 2024-05-08T06:05:38.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.107+0000 7f9499a00700 1 -- 172.21.15.82:0/102396098 learned_addr learned my addr 172.21.15.82:0/102396098 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:05:38.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.107+0000 7f9493e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562494dcd980 0x562494e491d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:38.108 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.108+0000 7f94a62d8b80 1 -- 172.21.15.82:0/102396098 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f94941b22c0 con 0x562494dd19d0 2024-05-08T06:05:38.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.108+0000 7f94a62d8b80 10 client.0 _ll_register_callbacks cb 0x562494cc6c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:05:38.110 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.109+0000 7f9499000700 1 --2- 172.21.15.82:0/102396098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562494dcd060 0x562494e48c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:38.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.111+0000 7f9493e00700 1 -- 172.21.15.82:0/102396098 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562494dd19d0 msgr2=0x562494ddea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:38.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.111+0000 7f9493e00700 1 --2- 172.21.15.82:0/102396098 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562494dd19d0 0x562494ddea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:38.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.111+0000 7f9493e00700 1 -- 172.21.15.82:0/102396098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562494dcd060 msgr2=0x562494e48c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:38.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.111+0000 7f9493e00700 1 --2- 172.21.15.82:0/102396098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562494dcd060 0x562494e48c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:38.111 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.111+0000 7f9493e00700 1 -- 172.21.15.82:0/102396098 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562494ddf0c0 con 0x562494dcd980 2024-05-08T06:05:38.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.112+0000 7f9493e00700 1 --2- 172.21.15.82:0/102396098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562494dcd980 0x562494e491d0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f948000b2e0 tx=0x7f9480009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69f0c750d59983ae server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:05:38.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.112+0000 7f947aa00700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T06:05:38.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.112+0000 7f947aa00700 1 -- 172.21.15.82:0/102396098 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9480034060 con 0x562494dcd980 2024-05-08T06:05:38.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.113+0000 7f947aa00700 1 -- 172.21.15.82:0/102396098 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f9480003950 con 0x562494dcd980 2024-05-08T06:05:38.112 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.113+0000 7f94a62d8b80 1 -- 172.21.15.82:0/102396098 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f94880b2280 con 0x562494dcd980 2024-05-08T06:05:38.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.113+0000 7f947aa00700 1 -- 172.21.15.82:0/102396098 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f9480003b50 con 0x562494dcd980 2024-05-08T06:05:38.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.113+0000 7f94a62d8b80 10 client.26864 fetch_fsmap learned FSMap version 31 2024-05-08T06:05:38.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.113+0000 7f94a62d8b80 1 -- 172.21.15.82:0/102396098 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x562494e51540 con 0x562494dcd980 2024-05-08T06:05:38.113 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.114+0000 7f947aa00700 1 -- 172.21.15.82:0/102396098 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f94880b2280 con 0x562494dcd980 2024-05-08T06:05:38.114 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.114+0000 7f947aa00700 1 -- 172.21.15.82:0/102396098 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f9480023430 con 0x562494dcd980 2024-05-08T06:05:38.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.114+0000 7f94a62d8b80 10 client.26864 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:05:38.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.115+0000 7f94a62d8b80 10 client.26864 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T06:05:38.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.115+0000 7f94a62d8b80 20 client.26864 populate_metadata read hostname 'smithi082' 2024-05-08T06:05:38.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.115+0000 7f94a62d8b80 1 --2- 172.21.15.82:0/102396098 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x562494e51c80 0x562494e540a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:38.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.115+0000 7f94a62d8b80 4 client.26864 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T06:05:38.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.115+0000 7f94a62d8b80 1 -- 172.21.15.82:0/102396098 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562494d9a0a0 con 0x562494e51c80 2024-05-08T06:05:38.115 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.115+0000 7f9499000700 1 --2- 172.21.15.82:0/102396098 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x562494e51c80 0x562494e540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:38.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.116+0000 7f9499000700 1 --2- 172.21.15.82:0/102396098 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x562494e51c80 0x562494e540a0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=138883c800e5c580 server_cookie=336f65365efedd50 in_seq=0 out_seq=0 2024-05-08T06:05:38.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.116+0000 7f947aa00700 10 client.26864 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T06:05:38.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.116+0000 7f947aa00700 1 -- 172.21.15.82:0/102396098 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562494d9a0a0 con 0x562494e51c80 2024-05-08T06:05:38.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.116+0000 7f947aa00700 10 client.26864 handle_command_reply: tid=0 2024-05-08T06:05:38.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.116+0000 7f94a62d8b80 1 client.26864 shutdown 2024-05-08T06:05:38.116 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.117+0000 7f94a62d8b80 1 -- 172.21.15.82:0/102396098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562494dcd980 msgr2=0x562494e491d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:38.117 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.117+0000 7f94a62d8b80 1 --2- 172.21.15.82:0/102396098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562494dcd980 0x562494e491d0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f948000b2e0 tx=0x7f9480009ca0 comp rx=0 tx=0).stop 2024-05-08T06:05:38.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.119+0000 7f94a62d8b80 1 -- 172.21.15.82:0/102396098 shutdown_connections 2024-05-08T06:05:38.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.119+0000 7f94a62d8b80 1 --2- 172.21.15.82:0/102396098 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562494dd19d0 0x562494ddea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:38.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.119+0000 7f94a62d8b80 1 --2- 172.21.15.82:0/102396098 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562494dcd060 0x562494e48c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:38.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.119+0000 7f94a62d8b80 1 --2- 172.21.15.82:0/102396098 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x562494e51c80 0x562494e540a0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:38.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.119+0000 7f94a62d8b80 1 --2- 172.21.15.82:0/102396098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562494dcd980 0x562494e491d0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:38.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.119+0000 7f947aa00700 0 client.26864 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T06:05:38.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.119+0000 7f94a62d8b80 1 -- 172.21.15.82:0/102396098 >> 172.21.15.82:0/102396098 conn(0x562494cfbb60 msgr2=0x562494dcc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:05:38.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.119+0000 7f94a62d8b80 1 -- 172.21.15.82:0/102396098 shutdown_connections 2024-05-08T06:05:38.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.119+0000 7f94a62d8b80 1 -- 172.21.15.82:0/102396098 wait complete. 2024-05-08T06:05:38.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.119+0000 7f94a62d8b80 20 client.26864 trim_cache size 0 max 16384 2024-05-08T06:05:38.120 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T06:05:38.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.121+0000 7f949ba00700 1 -- 172.21.15.82:0/1574019962 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f947c0b28c0 msgr2=0x7f947c0b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:38.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.121+0000 7f949ba00700 1 --2- 172.21.15.82:0/1574019962 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f947c0b28c0 0x7f947c0b4d80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9480005cd0 tx=0x7f9480005c00 comp rx=0 tx=0).stop 2024-05-08T06:05:38.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.121+0000 7f949ba00700 1 -- 172.21.15.82:0/1574019962 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f949406b180 msgr2=0x7f94941a5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:38.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.121+0000 7f949ba00700 1 --2- 172.21.15.82:0/1574019962 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f949406b180 0x7f94941a5e60 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f948800d950 tx=0x7f948800dd10 comp rx=0 tx=0).stop 2024-05-08T06:05:38.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.121+0000 7f949ba00700 1 -- 172.21.15.82:0/1574019962 shutdown_connections 2024-05-08T06:05:38.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.121+0000 7f949ba00700 1 --2- 172.21.15.82:0/1574019962 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f949406b180 0x7f94941a5e60 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:38.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.121+0000 7f949ba00700 1 --2- 172.21.15.82:0/1574019962 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f947c0b28c0 0x7f947c0b4d80 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:38.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.121+0000 7f949ba00700 1 --2- 172.21.15.82:0/1574019962 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9494109510 0x7f949410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:38.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.121+0000 7f949ba00700 1 --2- 172.21.15.82:0/1574019962 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f949406bb40 0x7f94941a63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:38.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.121+0000 7f949ba00700 1 -- 172.21.15.82:0/1574019962 >> 172.21.15.82:0/1574019962 conn(0x7f9494079350 msgr2=0x7f9494100ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:05:38.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.122+0000 7f949ba00700 1 -- 172.21.15.82:0/1574019962 shutdown_connections 2024-05-08T06:05:38.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:38.122+0000 7f949ba00700 1 -- 172.21.15.82:0/1574019962 wait complete. 2024-05-08T06:05:38.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:05:37 smithi151 ceph-mon[34815]: pgmap v908: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.8 MiB/s wr, 715 op/s 2024-05-08T06:05:38.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:05:37 smithi134 ceph-mon[34132]: pgmap v908: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.8 MiB/s wr, 715 op/s 2024-05-08T06:05:39.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:05:39 smithi082 ceph-mon[30098]: pgmap v909: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.2 MiB/s wr, 551 op/s 2024-05-08T06:05:40.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:05:39 smithi151 ceph-mon[34815]: pgmap v909: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.2 MiB/s wr, 551 op/s 2024-05-08T06:05:40.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:05:39 smithi134 ceph-mon[34132]: pgmap v909: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.2 MiB/s wr, 551 op/s 2024-05-08T06:05:40.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 890.0 s, 1407.6 tps, lat 72.148 ms stddev 87.239 2024-05-08T06:05:40.710 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-08T06:05:40.711 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-05-08T06:05:41.304 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:05:42.080 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:05:41 smithi082 ceph-mon[30098]: pgmap v910: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.8 MiB/s wr, 617 op/s 2024-05-08T06:05:42.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:05:41 smithi151 ceph-mon[34815]: pgmap v910: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.8 MiB/s wr, 617 op/s 2024-05-08T06:05:42.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:05:41 smithi134 ceph-mon[34132]: pgmap v910: 97 pgs: 97 active+clean; 1.6 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 5.8 MiB/s wr, 617 op/s 2024-05-08T06:05:43.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:05:43 smithi082 ceph-mon[30098]: pgmap v911: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.7 MiB/s wr, 621 op/s 2024-05-08T06:05:44.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.077+0000 7f89f3200700 1 -- 172.21.15.82:0/2198280499 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89f41143e0 msgr2=0x7f89f41167d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:44.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.077+0000 7f89f3200700 1 --2- 172.21.15.82:0/2198280499 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89f41143e0 0x7f89f41167d0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f89ec00b0a0 tx=0x7f89ec00b3b0 comp rx=0 tx=0).stop 2024-05-08T06:05:44.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.077+0000 7f89f3200700 1 -- 172.21.15.82:0/2198280499 shutdown_connections 2024-05-08T06:05:44.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.077+0000 7f89f3200700 1 --2- 172.21.15.82:0/2198280499 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89f41143e0 0x7f89f41167d0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:44.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.077+0000 7f89f3200700 1 --2- 172.21.15.82:0/2198280499 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89f4075840 0x7f89f4075c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:44.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.077+0000 7f89f3200700 1 --2- 172.21.15.82:0/2198280499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89f4076160 0x7f89f4113ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:44.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.077+0000 7f89f3200700 1 -- 172.21.15.82:0/2198280499 >> 172.21.15.82:0/2198280499 conn(0x7f89f40fef20 msgr2=0x7f89f4101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:05:44.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.077+0000 7f89f3200700 1 -- 172.21.15.82:0/2198280499 shutdown_connections 2024-05-08T06:05:44.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.077+0000 7f89f3200700 1 -- 172.21.15.82:0/2198280499 wait complete. 2024-05-08T06:05:44.078 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.079+0000 7f89f3200700 1 Processor -- start 2024-05-08T06:05:44.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.079+0000 7f89f3200700 1 -- start start 2024-05-08T06:05:44.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.079+0000 7f89f3200700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89f4075840 0x7f89f41a00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:44.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.079+0000 7f89f3200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89f4076160 0x7f89f41a0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:44.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.079+0000 7f89f3200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89f41143e0 0x7f89f41a4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:44.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.079+0000 7f89f3200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f89f4119bf0 con 0x7f89f41143e0 2024-05-08T06:05:44.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.079+0000 7f89f3200700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f89f4119a70 con 0x7f89f4076160 2024-05-08T06:05:44.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.079+0000 7f89f3200700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f89f4119d70 con 0x7f89f4075840 2024-05-08T06:05:44.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.080+0000 7f89f1400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89f4076160 0x7f89f41a0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:44.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.080+0000 7f89f1e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89f4075840 0x7f89f41a00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:44.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.080+0000 7f89f1e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89f4075840 0x7f89f41a00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:47620/0 (socket says 172.21.15.82:47620) 2024-05-08T06:05:44.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.080+0000 7f89f1400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89f4076160 0x7f89f41a0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:47868/0 (socket says 172.21.15.82:47868) 2024-05-08T06:05:44.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.080+0000 7f89f1e00700 1 -- 172.21.15.82:0/452566661 learned_addr learned my addr 172.21.15.82:0/452566661 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:05:44.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.080+0000 7f89f2800700 1 --2- 172.21.15.82:0/452566661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89f41143e0 0x7f89f41a4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:44.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.081+0000 7f89f1e00700 1 -- 172.21.15.82:0/452566661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89f4076160 msgr2=0x7f89f41a0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:44.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.081+0000 7f89f1e00700 1 --2- 172.21.15.82:0/452566661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89f4076160 0x7f89f41a0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:44.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.081+0000 7f89f1e00700 1 -- 172.21.15.82:0/452566661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89f41143e0 msgr2=0x7f89f41a4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:44.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.081+0000 7f89f1e00700 1 --2- 172.21.15.82:0/452566661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89f41143e0 0x7f89f41a4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:44.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.081+0000 7f89f1e00700 1 -- 172.21.15.82:0/452566661 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89f41a50d0 con 0x7f89f4075840 2024-05-08T06:05:44.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.081+0000 7f89f2800700 1 --2- 172.21.15.82:0/452566661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89f41143e0 0x7f89f41a4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:05:44.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.081+0000 7f89f1e00700 1 --2- 172.21.15.82:0/452566661 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89f4075840 0x7f89f41a00c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f89e400e9a0 tx=0x7f89e400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:05:44.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.081+0000 7f89eaa00700 1 -- 172.21.15.82:0/452566661 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e400cbd0 con 0x7f89f4075840 2024-05-08T06:05:44.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.081+0000 7f89f3200700 1 -- 172.21.15.82:0/452566661 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89f41a53c0 con 0x7f89f4075840 2024-05-08T06:05:44.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.081+0000 7f89eaa00700 1 -- 172.21.15.82:0/452566661 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89e400cd70 con 0x7f89f4075840 2024-05-08T06:05:44.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.081+0000 7f89eaa00700 1 -- 172.21.15.82:0/452566661 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e4018680 con 0x7f89f4075840 2024-05-08T06:05:44.082 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.082+0000 7f89f3200700 1 -- 172.21.15.82:0/452566661 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89f41acc40 con 0x7f89f4075840 2024-05-08T06:05:44.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.086+0000 7f89eaa00700 1 -- 172.21.15.82:0/452566661 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f89e4010430 con 0x7f89f4075840 2024-05-08T06:05:44.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.087+0000 7f89eaa00700 1 --2- 172.21.15.82:0/452566661 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f89d80b2880 0x7f89d80b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:44.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.088+0000 7f89eaa00700 1 -- 172.21.15.82:0/452566661 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f89e40e24e0 con 0x7f89f4075840 2024-05-08T06:05:44.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.089+0000 7f89f1400700 1 --2- 172.21.15.82:0/452566661 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f89d80b2880 0x7f89d80b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:44.088 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.089+0000 7f8a03501b80 1 Processor -- start 2024-05-08T06:05:44.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.089+0000 7f8a03501b80 1 -- start start 2024-05-08T06:05:44.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.090+0000 7f8a03501b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f01d412e20 0x55f01d413200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:44.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.090+0000 7f8a03501b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f01d413740 0x55f01d40d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:44.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.090+0000 7f8a03501b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f01d40dad0 0x55f01d40df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:44.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.090+0000 7f8a03501b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f01d35faa0 con 0x55f01d413740 2024-05-08T06:05:44.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.090+0000 7f8a03501b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f01d2fd7e0 con 0x55f01d412e20 2024-05-08T06:05:44.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.090+0000 7f8a03501b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55f01d35ba60 con 0x55f01d40dad0 2024-05-08T06:05:44.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.090+0000 7f89f1400700 1 --2- 172.21.15.82:0/452566661 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f89d80b2880 0x7f89d80b4d40 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f89f41071d0 tx=0x7f89dc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:05:44.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.090+0000 7f89f1e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f01d412e20 0x55f01d413200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:44.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.090+0000 7f89f1e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f01d412e20 0x55f01d413200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:47870/0 (socket says 172.21.15.82:47870) 2024-05-08T06:05:44.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.090+0000 7f89f1e00700 1 -- 172.21.15.82:0/702971336 learned_addr learned my addr 172.21.15.82:0/702971336 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:05:44.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.090+0000 7f89f2800700 1 --2- 172.21.15.82:0/702971336 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f01d40dad0 0x55f01d40df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:44.090 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.090+0000 7f89f1400700 1 --2- 172.21.15.82:0/702971336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f01d413740 0x55f01d40d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:44.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.090+0000 7f89f1e00700 1 -- 172.21.15.82:0/702971336 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f01d40dad0 msgr2=0x55f01d40df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:44.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.090+0000 7f89f1e00700 1 --2- 172.21.15.82:0/702971336 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f01d40dad0 0x55f01d40df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:44.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.090+0000 7f89f1e00700 1 -- 172.21.15.82:0/702971336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f01d413740 msgr2=0x55f01d40d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:44.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.091+0000 7f89f1e00700 1 --2- 172.21.15.82:0/702971336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f01d413740 0x55f01d40d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:44.091 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.091+0000 7f89f1e00700 1 -- 172.21.15.82:0/702971336 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f01d2ac950 con 0x55f01d412e20 2024-05-08T06:05:44.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.092+0000 7f89f1e00700 1 --2- 172.21.15.82:0/702971336 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f01d412e20 0x55f01d413200 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f89e400e970 tx=0x7f89e40a9350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39619d8109d14872 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:05:44.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.092+0000 7f89e3400700 1 -- 172.21.15.82:0/702971336 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e40a95c0 con 0x55f01d412e20 2024-05-08T06:05:44.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.092+0000 7f89e3400700 1 -- 172.21.15.82:0/702971336 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89e40aa1b0 con 0x55f01d412e20 2024-05-08T06:05:44.092 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.093+0000 7f89e3400700 1 -- 172.21.15.82:0/702971336 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e40a95c0 con 0x55f01d412e20 2024-05-08T06:05:44.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.093+0000 7f8a03501b80 1 -- 172.21.15.82:0/702971336 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f01d412e20 msgr2=0x55f01d413200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:44.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.093+0000 7f8a03501b80 1 --2- 172.21.15.82:0/702971336 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f01d412e20 0x55f01d413200 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f89e400e970 tx=0x7f89e40a9350 comp rx=0 tx=0).stop 2024-05-08T06:05:44.093 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.094+0000 7f8a03501b80 1 -- 172.21.15.82:0/702971336 shutdown_connections 2024-05-08T06:05:44.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.094+0000 7f8a03501b80 1 --2- 172.21.15.82:0/702971336 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f01d412e20 0x55f01d413200 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:44.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.094+0000 7f8a03501b80 1 --2- 172.21.15.82:0/702971336 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f01d40dad0 0x55f01d40df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:44.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.094+0000 7f8a03501b80 1 --2- 172.21.15.82:0/702971336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f01d413740 0x55f01d40d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:44.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.094+0000 7f8a03501b80 1 -- 172.21.15.82:0/702971336 >> 172.21.15.82:0/702971336 conn(0x55f01d385750 msgr2=0x55f01d407d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:05:44.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.094+0000 7f8a03501b80 1 -- 172.21.15.82:0/702971336 shutdown_connections 2024-05-08T06:05:44.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.094+0000 7f8a03501b80 1 -- 172.21.15.82:0/702971336 wait complete. 2024-05-08T06:05:44.094 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.095+0000 7f8a03501b80 1 -- start start 2024-05-08T06:05:44.095 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.095+0000 7f8a03501b80 1 Processor -- start 2024-05-08T06:05:44.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.096+0000 7f8a03501b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f01d40dad0 0x55f01d419370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:44.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.096+0000 7f8a03501b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f01d412e20 0x55f01d416710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:44.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.096+0000 7f8a03501b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f01d413740 0x55f01d416c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:44.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.096+0000 7f8a03501b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55f01d41a210 con 0x55f01d413740 2024-05-08T06:05:44.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.096+0000 7f8a03501b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f01d2c5ba0 con 0x55f01d40dad0 2024-05-08T06:05:44.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.096+0000 7f8a03501b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55f01d41a390 con 0x55f01d412e20 2024-05-08T06:05:44.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.096+0000 7f8a03501b80 10 client.0 _ll_register_callbacks cb 0x55f01d306cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:05:44.097 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.096+0000 7f89f1e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f01d40dad0 0x55f01d419370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:44.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.096+0000 7f89f1e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f01d40dad0 0x55f01d419370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:47880/0 (socket says 172.21.15.82:47880) 2024-05-08T06:05:44.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.096+0000 7f89f1e00700 1 -- 172.21.15.82:0/2836702037 learned_addr learned my addr 172.21.15.82:0/2836702037 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:05:44.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.096+0000 7f89f1400700 1 --2- 172.21.15.82:0/2836702037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f01d412e20 0x55f01d416710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:44.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.097+0000 7f89f1e00700 1 -- 172.21.15.82:0/2836702037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f01d412e20 msgr2=0x55f01d416710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:44.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.097+0000 7f89f1e00700 1 --2- 172.21.15.82:0/2836702037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f01d412e20 0x55f01d416710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:44.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.097+0000 7f89f1e00700 1 -- 172.21.15.82:0/2836702037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f01d413740 msgr2=0x55f01d416c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:44.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.097+0000 7f89f2800700 1 --2- 172.21.15.82:0/2836702037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f01d413740 0x55f01d416c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:44.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.097+0000 7f89f1e00700 1 --2- 172.21.15.82:0/2836702037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f01d413740 0x55f01d416c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:44.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.097+0000 7f89f1e00700 1 -- 172.21.15.82:0/2836702037 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f01d3254a0 con 0x55f01d40dad0 2024-05-08T06:05:44.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.097+0000 7f89f1400700 1 --2- 172.21.15.82:0/2836702037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f01d412e20 0x55f01d416710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:05:44.098 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.097+0000 7f89f2800700 1 --2- 172.21.15.82:0/2836702037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f01d413740 0x55f01d416c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:05:44.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.097+0000 7f89f1e00700 1 --2- 172.21.15.82:0/2836702037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f01d40dad0 0x55f01d419370 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f89e40a5b30 tx=0x7f89e400cf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5a21be73526f30b server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:05:44.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.097+0000 7f89d7e00700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T06:05:44.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.097+0000 7f89d7e00700 1 -- 172.21.15.82:0/2836702037 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e40c4070 con 0x55f01d40dad0 2024-05-08T06:05:44.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.097+0000 7f89d7e00700 1 -- 172.21.15.82:0/2836702037 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f89e40a60a0 con 0x55f01d40dad0 2024-05-08T06:05:44.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.097+0000 7f8a03501b80 1 -- 172.21.15.82:0/2836702037 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89e40aa1b0 con 0x55f01d40dad0 2024-05-08T06:05:44.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.098+0000 7f89d7e00700 1 -- 172.21.15.82:0/2836702037 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f89e40a95c0 con 0x55f01d40dad0 2024-05-08T06:05:44.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.098+0000 7f8a03501b80 10 client.26876 fetch_fsmap learned FSMap version 31 2024-05-08T06:05:44.099 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.098+0000 7f8a03501b80 1 -- 172.21.15.82:0/2836702037 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55f01d4359f0 con 0x55f01d40dad0 2024-05-08T06:05:44.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.098+0000 7f89d7e00700 1 -- 172.21.15.82:0/2836702037 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89e40aa1b0 con 0x55f01d40dad0 2024-05-08T06:05:44.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.098+0000 7f89d7e00700 1 -- 172.21.15.82:0/2836702037 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f89e4010720 con 0x55f01d40dad0 2024-05-08T06:05:44.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.098+0000 7f8a03501b80 10 client.26876 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:05:44.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.098+0000 7f8a03501b80 10 client.26876 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T06:05:44.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.098+0000 7f8a03501b80 20 client.26876 populate_metadata read hostname 'smithi082' 2024-05-08T06:05:44.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.098+0000 7f8a03501b80 1 --2- 172.21.15.82:0/2836702037 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55f01d437ec0 0x55f01d43a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:44.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.098+0000 7f8a03501b80 4 client.26876 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:05:44.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.098+0000 7f8a03501b80 1 -- 172.21.15.82:0/2836702037 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f01d3da1c0 con 0x55f01d437ec0 2024-05-08T06:05:44.100 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.099+0000 7f89f1400700 1 --2- 172.21.15.82:0/2836702037 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55f01d437ec0 0x55f01d43a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:44.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.100+0000 7f89f1400700 1 --2- 172.21.15.82:0/2836702037 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55f01d437ec0 0x55f01d43a2b0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63b71ad885ac3a9c server_cookie=2f7f0acbbd41c0f in_seq=0 out_seq=0 2024-05-08T06:05:44.101 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.100+0000 7f89d7e00700 10 client.26876 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T06:05:44.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.101+0000 7f89d7e00700 1 -- 172.21.15.82:0/2836702037 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f01d3da1c0 con 0x55f01d437ec0 2024-05-08T06:05:44.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.101+0000 7f89d7e00700 10 client.26876 handle_command_reply: tid=0 2024-05-08T06:05:44.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.101+0000 7f8a03501b80 1 client.26876 shutdown 2024-05-08T06:05:44.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.102+0000 7f8a03501b80 1 -- 172.21.15.82:0/2836702037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f01d40dad0 msgr2=0x55f01d419370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:44.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.102+0000 7f8a03501b80 1 --2- 172.21.15.82:0/2836702037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f01d40dad0 0x55f01d419370 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f89e40a5b30 tx=0x7f89e400cf20 comp rx=0 tx=0).stop 2024-05-08T06:05:44.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.102+0000 7f8a03501b80 1 -- 172.21.15.82:0/2836702037 shutdown_connections 2024-05-08T06:05:44.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.102+0000 7f8a03501b80 1 --2- 172.21.15.82:0/2836702037 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55f01d437ec0 0x55f01d43a2b0 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:44.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.102+0000 7f8a03501b80 1 --2- 172.21.15.82:0/2836702037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f01d40dad0 0x55f01d419370 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:44.102 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.102+0000 7f89d7e00700 0 client.26876 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T06:05:44.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.102+0000 7f8a03501b80 1 --2- 172.21.15.82:0/2836702037 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f01d413740 0x55f01d416c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:44.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.102+0000 7f8a03501b80 1 --2- 172.21.15.82:0/2836702037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f01d412e20 0x55f01d416710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:44.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.102+0000 7f8a03501b80 1 -- 172.21.15.82:0/2836702037 >> 172.21.15.82:0/2836702037 conn(0x55f01d385750 msgr2=0x55f01d4027d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:05:44.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.102+0000 7f8a03501b80 1 -- 172.21.15.82:0/2836702037 shutdown_connections 2024-05-08T06:05:44.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.102+0000 7f8a03501b80 1 -- 172.21.15.82:0/2836702037 wait complete. 2024-05-08T06:05:44.103 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.102+0000 7f8a03501b80 20 client.26876 trim_cache size 0 max 16384 2024-05-08T06:05:44.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:05:43 smithi151 ceph-mon[34815]: pgmap v911: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.7 MiB/s wr, 621 op/s 2024-05-08T06:05:44.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.131+0000 7f8a03501b80 1 Processor -- start 2024-05-08T06:05:44.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.132+0000 7f8a03501b80 1 -- start start 2024-05-08T06:05:44.131 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.132+0000 7f8a03501b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f01d40dad0 0x55f01d40d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:44.132 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.132+0000 7f8a03501b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f01d412e20 0x55f01d4028e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:44.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.132+0000 7f8a03501b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f01d413740 0x55f01d43d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:44.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.132+0000 7f8a03501b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f89f4074110 con 0x55f01d412e20 2024-05-08T06:05:44.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.132+0000 7f8a03501b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f89f41ad3a0 con 0x55f01d413740 2024-05-08T06:05:44.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.132+0000 7f8a03501b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f89f40747e0 con 0x55f01d40dad0 2024-05-08T06:05:44.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.132+0000 7f89f1e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f01d40dad0 0x55f01d40d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:44.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.132+0000 7f89f1e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f01d40dad0 0x55f01d40d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:47658/0 (socket says 172.21.15.82:47658) 2024-05-08T06:05:44.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.132+0000 7f89f1e00700 1 -- 172.21.15.82:0/654149801 learned_addr learned my addr 172.21.15.82:0/654149801 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:05:44.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.132+0000 7f89f1400700 1 --2- 172.21.15.82:0/654149801 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f01d412e20 0x55f01d4028e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:44.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.132+0000 7f89f2800700 1 --2- 172.21.15.82:0/654149801 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f01d413740 0x55f01d43d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:44.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.133+0000 7f89f1e00700 1 -- 172.21.15.82:0/654149801 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f01d413740 msgr2=0x55f01d43d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:44.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.133+0000 7f89f1e00700 1 --2- 172.21.15.82:0/654149801 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f01d413740 0x55f01d43d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:44.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.133+0000 7f89f1e00700 1 -- 172.21.15.82:0/654149801 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f01d412e20 msgr2=0x55f01d4028e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:44.133 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.133+0000 7f89f1e00700 1 --2- 172.21.15.82:0/654149801 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f01d412e20 0x55f01d4028e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:44.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.133+0000 7f89f1e00700 1 -- 172.21.15.82:0/654149801 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f01d419b70 con 0x55f01d40dad0 2024-05-08T06:05:44.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.133+0000 7f89f1400700 1 --2- 172.21.15.82:0/654149801 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f01d412e20 0x55f01d4028e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:05:44.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.133+0000 7f89f1e00700 1 --2- 172.21.15.82:0/654149801 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f01d40dad0 0x55f01d40d4b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f89e4009860 tx=0x7f89e400cf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6868b49b42b13925 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:05:44.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.133+0000 7f89e2a00700 1 -- 172.21.15.82:0/654149801 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e40c4070 con 0x55f01d40dad0 2024-05-08T06:05:44.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.133+0000 7f89e2a00700 1 -- 172.21.15.82:0/654149801 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89e40ade60 con 0x55f01d40dad0 2024-05-08T06:05:44.134 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.133+0000 7f89e2a00700 1 -- 172.21.15.82:0/654149801 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e406f2b0 con 0x55f01d40dad0 2024-05-08T06:05:44.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.134+0000 7f8a03501b80 1 -- 172.21.15.82:0/654149801 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f01d40dad0 msgr2=0x55f01d40d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:44.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.134+0000 7f8a03501b80 1 --2- 172.21.15.82:0/654149801 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f01d40dad0 0x55f01d40d4b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f89e4009860 tx=0x7f89e400cf90 comp rx=0 tx=0).stop 2024-05-08T06:05:44.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.134+0000 7f8a03501b80 1 -- 172.21.15.82:0/654149801 shutdown_connections 2024-05-08T06:05:44.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.134+0000 7f8a03501b80 1 --2- 172.21.15.82:0/654149801 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f01d413740 0x55f01d43d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:44.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.134+0000 7f8a03501b80 1 --2- 172.21.15.82:0/654149801 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f01d40dad0 0x55f01d40d4b0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:44.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.134+0000 7f8a03501b80 1 --2- 172.21.15.82:0/654149801 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f01d412e20 0x55f01d4028e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:44.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.134+0000 7f8a03501b80 1 -- 172.21.15.82:0/654149801 >> 172.21.15.82:0/654149801 conn(0x55f01d385750 msgr2=0x55f01d415760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:05:44.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.134+0000 7f8a03501b80 1 -- 172.21.15.82:0/654149801 shutdown_connections 2024-05-08T06:05:44.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.134+0000 7f8a03501b80 1 -- 172.21.15.82:0/654149801 wait complete. 2024-05-08T06:05:44.135 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.135+0000 7f8a03501b80 1 -- start start 2024-05-08T06:05:44.136 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.135+0000 7f8a03501b80 1 Processor -- start 2024-05-08T06:05:44.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.137+0000 7f8a03501b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f01d40dad0 0x55f01d43d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:44.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.137+0000 7f8a03501b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f01d412e20 0x55f01d43b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:44.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.137+0000 7f8a03501b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f01d413740 0x55f01d43bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:44.137 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.137+0000 7f8a03501b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f89f41ace10 con 0x55f01d40dad0 2024-05-08T06:05:44.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.137+0000 7f8a03501b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f89f4074eb0 con 0x55f01d412e20 2024-05-08T06:05:44.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.137+0000 7f8a03501b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f89f40720b0 con 0x55f01d413740 2024-05-08T06:05:44.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.137+0000 7f8a03501b80 10 client.0 _ll_register_callbacks cb 0x55f01d306cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:05:44.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.137+0000 7f89f1400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f01d412e20 0x55f01d43b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:44.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.137+0000 7f89f1400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f01d412e20 0x55f01d43b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:47896/0 (socket says 172.21.15.82:47896) 2024-05-08T06:05:44.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.137+0000 7f89f1400700 1 -- 172.21.15.82:0/3419585641 learned_addr learned my addr 172.21.15.82:0/3419585641 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:05:44.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.138+0000 7f89f1e00700 1 --2- 172.21.15.82:0/3419585641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f01d40dad0 0x55f01d43d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:44.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.138+0000 7f89f2800700 1 --2- 172.21.15.82:0/3419585641 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f01d413740 0x55f01d43bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:44.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.138+0000 7f89f1400700 1 -- 172.21.15.82:0/3419585641 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f01d413740 msgr2=0x55f01d43bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:44.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.138+0000 7f89f1400700 1 --2- 172.21.15.82:0/3419585641 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f01d413740 0x55f01d43bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:44.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.138+0000 7f89f1400700 1 -- 172.21.15.82:0/3419585641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f01d40dad0 msgr2=0x55f01d43d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:44.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.138+0000 7f89f1400700 1 --2- 172.21.15.82:0/3419585641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f01d40dad0 0x55f01d43d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:44.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.138+0000 7f89f1400700 1 -- 172.21.15.82:0/3419585641 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f01d404920 con 0x55f01d412e20 2024-05-08T06:05:44.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.138+0000 7f89f2800700 1 --2- 172.21.15.82:0/3419585641 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f01d413740 0x55f01d43bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:05:44.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.139+0000 7f89f1400700 1 --2- 172.21.15.82:0/3419585641 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f01d412e20 0x55f01d43b9e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x55f01d40a130 tx=0x7f89dc013040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ee2ddfb452ca101 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:05:44.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.139+0000 7f89d7e00700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T06:05:44.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.139+0000 7f89d7e00700 1 -- 172.21.15.82:0/3419585641 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89dc02e070 con 0x55f01d412e20 2024-05-08T06:05:44.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.139+0000 7f89d7e00700 1 -- 172.21.15.82:0/3419585641 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f89dc004050 con 0x55f01d412e20 2024-05-08T06:05:44.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.139+0000 7f8a03501b80 1 -- 172.21.15.82:0/3419585641 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89e40ade60 con 0x55f01d412e20 2024-05-08T06:05:44.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.139+0000 7f89d7e00700 1 -- 172.21.15.82:0/3419585641 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f89dc03a050 con 0x55f01d412e20 2024-05-08T06:05:44.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.140+0000 7f8a03501b80 10 client.26882 fetch_fsmap learned FSMap version 31 2024-05-08T06:05:44.140 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.140+0000 7f8a03501b80 1 -- 172.21.15.82:0/3419585641 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55f01d4a3190 con 0x55f01d412e20 2024-05-08T06:05:44.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.140+0000 7f89d7e00700 1 -- 172.21.15.82:0/3419585641 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f89e40ade60 con 0x55f01d412e20 2024-05-08T06:05:44.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.140+0000 7f89d7e00700 1 -- 172.21.15.82:0/3419585641 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f89dc003680 con 0x55f01d412e20 2024-05-08T06:05:44.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.141+0000 7f8a03501b80 10 client.26882 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:05:44.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.141+0000 7f8a03501b80 10 client.26882 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T06:05:44.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.141+0000 7f8a03501b80 20 client.26882 populate_metadata read hostname 'smithi082' 2024-05-08T06:05:44.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.141+0000 7f8a03501b80 1 --2- 172.21.15.82:0/3419585641 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55f01d4a3880 0x55f01d4a5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:44.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.141+0000 7f8a03501b80 4 client.26882 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-08T06:05:44.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.141+0000 7f8a03501b80 1 -- 172.21.15.82:0/3419585641 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f01d423560 con 0x55f01d4a3880 2024-05-08T06:05:44.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.141+0000 7f89f1e00700 1 --2- 172.21.15.82:0/3419585641 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55f01d4a3880 0x55f01d4a5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:44.141 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.141+0000 7f89f1e00700 1 --2- 172.21.15.82:0/3419585641 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55f01d4a3880 0x55f01d4a5ca0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7016a92bff52277 server_cookie=a37c83eff986b58 in_seq=0 out_seq=0 2024-05-08T06:05:44.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.141+0000 7f89d7e00700 10 client.26882 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T06:05:44.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.143+0000 7f89d7e00700 1 -- 172.21.15.82:0/3419585641 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f01d423560 con 0x55f01d4a3880 2024-05-08T06:05:44.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.143+0000 7f89d7e00700 10 client.26882 handle_command_reply: tid=0 2024-05-08T06:05:44.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.143+0000 7f8a03501b80 1 client.26882 shutdown 2024-05-08T06:05:44.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.144+0000 7f8a03501b80 1 -- 172.21.15.82:0/3419585641 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f01d412e20 msgr2=0x55f01d43b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:44.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.144+0000 7f8a03501b80 1 --2- 172.21.15.82:0/3419585641 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f01d412e20 0x55f01d43b9e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x55f01d40a130 tx=0x7f89dc013040 comp rx=0 tx=0).stop 2024-05-08T06:05:44.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.144+0000 7f8a03501b80 1 -- 172.21.15.82:0/3419585641 shutdown_connections 2024-05-08T06:05:44.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.144+0000 7f8a03501b80 1 --2- 172.21.15.82:0/3419585641 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f01d413740 0x55f01d43bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:44.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.144+0000 7f8a03501b80 1 --2- 172.21.15.82:0/3419585641 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55f01d40dad0 0x55f01d43d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:44.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.144+0000 7f8a03501b80 1 --2- 172.21.15.82:0/3419585641 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55f01d4a3880 0x55f01d4a5ca0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:44.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.144+0000 7f8a03501b80 1 --2- 172.21.15.82:0/3419585641 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f01d412e20 0x55f01d43b9e0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:44.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.144+0000 7f8a03501b80 1 -- 172.21.15.82:0/3419585641 >> 172.21.15.82:0/3419585641 conn(0x55f01d385750 msgr2=0x55f01d417d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:05:44.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.144+0000 7f89d7e00700 0 client.26882 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T06:05:44.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.144+0000 7f8a03501b80 1 -- 172.21.15.82:0/3419585641 shutdown_connections 2024-05-08T06:05:44.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.144+0000 7f8a03501b80 1 -- 172.21.15.82:0/3419585641 wait complete. 2024-05-08T06:05:44.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.144+0000 7f8a03501b80 20 client.26882 trim_cache size 0 max 16384 2024-05-08T06:05:44.145 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T06:05:44.145 INFO:teuthology.orchestra.run.smithi082.stdout: "return_code": 0, 2024-05-08T06:05:44.145 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_tag": "a8898ae2-cd8b-43af-990d-ef004334e8e6", 2024-05-08T06:05:44.145 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": "asynchronous" 2024-05-08T06:05:44.145 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T06:05:44.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.145+0000 7f89f3200700 1 -- 172.21.15.82:0/452566661 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f89d80b2880 msgr2=0x7f89d80b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:44.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.145+0000 7f89f3200700 1 --2- 172.21.15.82:0/452566661 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f89d80b2880 0x7f89d80b4d40 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f89f41071d0 tx=0x7f89dc009260 comp rx=0 tx=0).stop 2024-05-08T06:05:44.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.145+0000 7f89f3200700 1 -- 172.21.15.82:0/452566661 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89f4075840 msgr2=0x7f89f41a00c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:44.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.145+0000 7f89f3200700 1 --2- 172.21.15.82:0/452566661 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89f4075840 0x7f89f41a00c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f89e400e9a0 tx=0x7f89e400ecb0 comp rx=0 tx=0).stop 2024-05-08T06:05:44.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.145+0000 7f89f3200700 1 -- 172.21.15.82:0/452566661 shutdown_connections 2024-05-08T06:05:44.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.145+0000 7f89f3200700 1 --2- 172.21.15.82:0/452566661 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f89d80b2880 0x7f89d80b4d40 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:44.146 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.146+0000 7f89f3200700 1 --2- 172.21.15.82:0/452566661 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f89f41143e0 0x7f89f41a4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:44.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.146+0000 7f89f3200700 1 --2- 172.21.15.82:0/452566661 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89f4075840 0x7f89f41a00c0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:44.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.146+0000 7f89f3200700 1 --2- 172.21.15.82:0/452566661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89f4076160 0x7f89f41a0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:44.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.146+0000 7f89f3200700 1 -- 172.21.15.82:0/452566661 >> 172.21.15.82:0/452566661 conn(0x7f89f40fef20 msgr2=0x7f89f40ffc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:05:44.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.146+0000 7f89f3200700 1 -- 172.21.15.82:0/452566661 shutdown_connections 2024-05-08T06:05:44.147 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:44.146+0000 7f89f3200700 1 -- 172.21.15.82:0/452566661 wait complete. 2024-05-08T06:05:44.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:05:43 smithi134 ceph-mon[34132]: pgmap v911: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.7 MiB/s wr, 621 op/s 2024-05-08T06:05:45.126 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:05:44 smithi082 ceph-mon[30098]: scrub queued for path: / 2024-05-08T06:05:45.126 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:05:44 smithi082 ceph-mon[30098]: scrub summary: idle+waiting paths [/] 2024-05-08T06:05:45.127 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:05:44 smithi082 ceph-mon[30098]: scrub summary: active paths [/] 2024-05-08T06:05:45.127 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:05:44 smithi082 ceph-mon[30098]: scrub summary: active paths [/] 2024-05-08T06:05:45.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:05:44 smithi151 ceph-mon[34815]: scrub queued for path: / 2024-05-08T06:05:45.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:05:44 smithi151 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-05-08T06:05:45.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:05:44 smithi151 ceph-mon[34815]: scrub summary: active paths [/] 2024-05-08T06:05:45.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:05:44 smithi151 ceph-mon[34815]: scrub summary: active paths [/] 2024-05-08T06:05:45.185 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-08T06:05:45.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:05:44 smithi134 ceph-mon[34132]: scrub queued for path: / 2024-05-08T06:05:45.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:05:44 smithi134 ceph-mon[34132]: scrub summary: idle+waiting paths [/] 2024-05-08T06:05:45.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:05:44 smithi134 ceph-mon[34132]: scrub summary: active paths [/] 2024-05-08T06:05:45.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:05:44 smithi134 ceph-mon[34132]: scrub summary: active paths [/] 2024-05-08T06:05:45.266 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 895.0 s, 1636.0 tps, lat 60.704 ms stddev 67.517 2024-05-08T06:05:45.783 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:05:46.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:05:45 smithi151 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-05-08T06:05:46.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:05:45 smithi151 ceph-mon[34815]: scrub summary: idle+waiting paths [/] 2024-05-08T06:05:46.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:05:45 smithi151 ceph-mon[34815]: pgmap v912: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.3 MiB/s wr, 545 op/s 2024-05-08T06:05:46.155 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:05:45 smithi082 ceph-mon[30098]: scrub summary: idle+waiting paths [/] 2024-05-08T06:05:46.155 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:05:45 smithi082 ceph-mon[30098]: scrub summary: idle+waiting paths [/] 2024-05-08T06:05:46.155 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:05:45 smithi082 ceph-mon[30098]: pgmap v912: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.3 MiB/s wr, 545 op/s 2024-05-08T06:05:46.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:05:45 smithi134 ceph-mon[34132]: scrub summary: idle+waiting paths [/] 2024-05-08T06:05:46.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:05:45 smithi134 ceph-mon[34132]: scrub summary: idle+waiting paths [/] 2024-05-08T06:05:46.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:05:45 smithi134 ceph-mon[34132]: pgmap v912: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 5.3 MiB/s wr, 545 op/s 2024-05-08T06:05:48.123 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:05:47 smithi082 ceph-mon[30098]: pgmap v913: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.6 MiB/s wr, 779 op/s 2024-05-08T06:05:48.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:05:47 smithi151 ceph-mon[34815]: pgmap v913: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.6 MiB/s wr, 779 op/s 2024-05-08T06:05:48.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:05:47 smithi134 ceph-mon[34132]: pgmap v913: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.6 MiB/s wr, 779 op/s 2024-05-08T06:05:48.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.340+0000 7f7f6e400700 1 -- 172.21.15.82:0/4260274816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f6806b180 msgr2=0x7f7f6806b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:48.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.340+0000 7f7f6e400700 1 --2- 172.21.15.82:0/4260274816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f6806b180 0x7f7f6806b600 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f7f54009990 tx=0x7f7f54009ca0 comp rx=0 tx=0).stop 2024-05-08T06:05:48.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.340+0000 7f7f6e400700 1 -- 172.21.15.82:0/4260274816 shutdown_connections 2024-05-08T06:05:48.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.340+0000 7f7f6e400700 1 --2- 172.21.15.82:0/4260274816 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f68109510 0x7f7f681098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:48.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.340+0000 7f7f6e400700 1 --2- 172.21.15.82:0/4260274816 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f6806bb40 0x7f7f68110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:48.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.340+0000 7f7f6e400700 1 --2- 172.21.15.82:0/4260274816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f6806b180 0x7f7f6806b600 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:48.340 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.340+0000 7f7f6e400700 1 -- 172.21.15.82:0/4260274816 >> 172.21.15.82:0/4260274816 conn(0x7f7f68079350 msgr2=0x7f7f68079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:05:48.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.341+0000 7f7f6e400700 1 -- 172.21.15.82:0/4260274816 shutdown_connections 2024-05-08T06:05:48.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.341+0000 7f7f6e400700 1 -- 172.21.15.82:0/4260274816 wait complete. 2024-05-08T06:05:48.341 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.342+0000 7f7f6e400700 1 Processor -- start 2024-05-08T06:05:48.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.342+0000 7f7f6e400700 1 -- start start 2024-05-08T06:05:48.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.343+0000 7f7f6e400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f6806b180 0x7f7f681102d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:48.342 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.343+0000 7f7f6e400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f6806bb40 0x7f7f6810d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:48.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.343+0000 7f7f6e400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f68109510 0x7f7f6810daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:48.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.343+0000 7f7f6e400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7f68103ec0 con 0x7f7f6806b180 2024-05-08T06:05:48.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.343+0000 7f7f6e400700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7f68103d40 con 0x7f7f6806bb40 2024-05-08T06:05:48.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.343+0000 7f7f6e400700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7f68104040 con 0x7f7f68109510 2024-05-08T06:05:48.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.343+0000 7f7f67e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f68109510 0x7f7f6810daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:48.343 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.343+0000 7f7f66a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f6806bb40 0x7f7f6810d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:48.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.343+0000 7f7f67e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f68109510 0x7f7f6810daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:47694/0 (socket says 172.21.15.82:47694) 2024-05-08T06:05:48.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.343+0000 7f7f67e00700 1 -- 172.21.15.82:0/3733734966 learned_addr learned my addr 172.21.15.82:0/3733734966 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:05:48.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.343+0000 7f7f67400700 1 --2- 172.21.15.82:0/3733734966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f6806b180 0x7f7f681102d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:48.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.344+0000 7f7f67e00700 1 -- 172.21.15.82:0/3733734966 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f6806bb40 msgr2=0x7f7f6810d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:48.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.344+0000 7f7f67e00700 1 --2- 172.21.15.82:0/3733734966 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f6806bb40 0x7f7f6810d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:48.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.344+0000 7f7f67e00700 1 -- 172.21.15.82:0/3733734966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f6806b180 msgr2=0x7f7f681102d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:48.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.344+0000 7f7f67e00700 1 --2- 172.21.15.82:0/3733734966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f6806b180 0x7f7f681102d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:48.344 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.344+0000 7f7f67e00700 1 -- 172.21.15.82:0/3733734966 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f681ac530 con 0x7f7f68109510 2024-05-08T06:05:48.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.345+0000 7f7f67400700 1 --2- 172.21.15.82:0/3733734966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f6806b180 0x7f7f681102d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:05:48.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.345+0000 7f7f67e00700 1 --2- 172.21.15.82:0/3733734966 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f68109510 0x7f7f6810daf0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7f60007ee0 tx=0x7f7f6000d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:05:48.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.345+0000 7f7f5fe00700 1 -- 172.21.15.82:0/3733734966 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f6000ddd0 con 0x7f7f68109510 2024-05-08T06:05:48.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.346+0000 7f7f5fe00700 1 -- 172.21.15.82:0/3733734966 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f60004020 con 0x7f7f68109510 2024-05-08T06:05:48.345 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.346+0000 7f7f5fe00700 1 -- 172.21.15.82:0/3733734966 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f60015660 con 0x7f7f68109510 2024-05-08T06:05:48.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.347+0000 7f7f66a00700 1 --2- 172.21.15.82:0/3733734966 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f6806bb40 0x7f7f6810d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:05:48.346 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.347+0000 7f7f6e400700 1 -- 172.21.15.82:0/3733734966 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f681ac760 con 0x7f7f68109510 2024-05-08T06:05:48.347 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.347+0000 7f7f6e400700 1 -- 172.21.15.82:0/3733734966 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f681acc20 con 0x7f7f68109510 2024-05-08T06:05:48.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.356+0000 7f7f5fe00700 1 -- 172.21.15.82:0/3733734966 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f7f600041d0 con 0x7f7f68109510 2024-05-08T06:05:48.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.357+0000 7f7f78d57b80 1 Processor -- start 2024-05-08T06:05:48.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.357+0000 7f7f78d57b80 1 -- start start 2024-05-08T06:05:48.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.359+0000 7f7f78d57b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef5ffb4ad0 0x55ef5ffb4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:48.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.359+0000 7f7f78d57b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ef5ffb02e0 0x55ef5ffb0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:48.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.359+0000 7f7f78d57b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef5ffb0ca0 0x55ef5ffbc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:48.359 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.359+0000 7f7f78d57b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55ef5fef1a20 con 0x55ef5ffb4ad0 2024-05-08T06:05:48.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.359+0000 7f7f78d57b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ef5fe8f760 con 0x55ef5ffb02e0 2024-05-08T06:05:48.360 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.359+0000 7f7f78d57b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ef5feed9e0 con 0x55ef5ffb0ca0 2024-05-08T06:05:48.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.360+0000 7f7f67400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ef5ffb02e0 0x55ef5ffb0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:48.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.360+0000 7f7f66a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef5ffb0ca0 0x55ef5ffbc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:48.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.362+0000 7f7f67400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ef5ffb02e0 0x55ef5ffb0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:47922/0 (socket says 172.21.15.82:47922) 2024-05-08T06:05:48.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.362+0000 7f7f66a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef5ffb0ca0 0x55ef5ffbc9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:47706/0 (socket says 172.21.15.82:47706) 2024-05-08T06:05:48.364 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.362+0000 7f7f66a00700 1 -- 172.21.15.82:0/1139379336 learned_addr learned my addr 172.21.15.82:0/1139379336 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:05:48.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.362+0000 7f7f66a00700 1 --2- 172.21.15.82:0/1139379336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef5ffb4ad0 0x55ef5ffb4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:48.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.362+0000 7f7f5fe00700 1 --2- 172.21.15.82:0/3733734966 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7f4c0b29c0 0x7f7f4c0b4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:48.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.363+0000 7f7f5fe00700 1 -- 172.21.15.82:0/3733734966 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f7f600e1da0 con 0x7f7f68109510 2024-05-08T06:05:48.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.364+0000 7f7f66a00700 1 -- 172.21.15.82:0/1139379336 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ef5ffb02e0 msgr2=0x55ef5ffb0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:48.365 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.364+0000 7f7f66a00700 1 --2- 172.21.15.82:0/1139379336 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ef5ffb02e0 0x55ef5ffb0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:48.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.364+0000 7f7f66a00700 1 -- 172.21.15.82:0/1139379336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef5ffb4ad0 msgr2=0x55ef5ffb4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:48.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.364+0000 7f7f66a00700 1 --2- 172.21.15.82:0/1139379336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef5ffb4ad0 0x55ef5ffb4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:48.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.364+0000 7f7f66a00700 1 -- 172.21.15.82:0/1139379336 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef5fe3e8d0 con 0x55ef5ffb0ca0 2024-05-08T06:05:48.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.365+0000 7f7f67e00700 1 --2- 172.21.15.82:0/3733734966 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7f4c0b29c0 0x7f7f4c0b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:48.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.366+0000 7f7f66a00700 1 --2- 172.21.15.82:0/1139379336 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef5ffb0ca0 0x55ef5ffbc9f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7f54005b40 tx=0x7f7f54005ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27359ceec4ce13f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:05:48.366 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.367+0000 7f7f5cc00700 1 -- 172.21.15.82:0/1139379336 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f54021040 con 0x55ef5ffb0ca0 2024-05-08T06:05:48.367 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.367+0000 7f7f5cc00700 1 -- 172.21.15.82:0/1139379336 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f540095d0 con 0x55ef5ffb0ca0 2024-05-08T06:05:48.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.367+0000 7f7f5cc00700 1 -- 172.21.15.82:0/1139379336 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f54005020 con 0x55ef5ffb0ca0 2024-05-08T06:05:48.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.368+0000 7f7f78d57b80 1 -- 172.21.15.82:0/1139379336 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef5ffb0ca0 msgr2=0x55ef5ffbc9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:48.368 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.368+0000 7f7f78d57b80 1 --2- 172.21.15.82:0/1139379336 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef5ffb0ca0 0x55ef5ffbc9f0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7f54005b40 tx=0x7f7f54005ad0 comp rx=0 tx=0).stop 2024-05-08T06:05:48.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.369+0000 7f7f78d57b80 1 -- 172.21.15.82:0/1139379336 shutdown_connections 2024-05-08T06:05:48.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.369+0000 7f7f78d57b80 1 --2- 172.21.15.82:0/1139379336 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef5ffb0ca0 0x55ef5ffbc9f0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:48.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.369+0000 7f7f78d57b80 1 --2- 172.21.15.82:0/1139379336 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef5ffb4ad0 0x55ef5ffb4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:48.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.369+0000 7f7f78d57b80 1 --2- 172.21.15.82:0/1139379336 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ef5ffb02e0 0x55ef5ffb0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:48.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.369+0000 7f7f78d57b80 1 -- 172.21.15.82:0/1139379336 >> 172.21.15.82:0/1139379336 conn(0x55ef5ff176d0 msgr2=0x55ef5ff99b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:05:48.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.369+0000 7f7f78d57b80 1 -- 172.21.15.82:0/1139379336 shutdown_connections 2024-05-08T06:05:48.369 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.370+0000 7f7f78d57b80 1 -- 172.21.15.82:0/1139379336 wait complete. 2024-05-08T06:05:48.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.371+0000 7f7f67e00700 1 --2- 172.21.15.82:0/3733734966 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7f4c0b29c0 0x7f7f4c0b4e80 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7f60003ff0 tx=0x7f7f6000b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:05:48.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.371+0000 7f7f78d57b80 1 -- start start 2024-05-08T06:05:48.371 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.371+0000 7f7f78d57b80 1 Processor -- start 2024-05-08T06:05:48.372 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.373+0000 7f7f78d57b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef5ffb02e0 0x55ef5ffbc540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:48.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.373+0000 7f7f78d57b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef5ffb0ca0 0x55ef5ffb98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:48.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.374+0000 7f7f78d57b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ef5ffb4ad0 0x55ef5ffb9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:48.373 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.374+0000 7f7f66a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef5ffb02e0 0x55ef5ffbc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:48.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.374+0000 7f7f66a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef5ffb02e0 0x55ef5ffbc540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:47710/0 (socket says 172.21.15.82:47710) 2024-05-08T06:05:48.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.374+0000 7f7f66a00700 1 -- 172.21.15.82:0/3655379055 learned_addr learned my addr 172.21.15.82:0/3655379055 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:05:48.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.374+0000 7f7f78d57b80 1 -- 172.21.15.82:0/3655379055 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55ef5ffbcf90 con 0x55ef5ffb0ca0 2024-05-08T06:05:48.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.374+0000 7f7f78d57b80 1 -- 172.21.15.82:0/3655379055 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ef5fe57b20 con 0x55ef5ffb4ad0 2024-05-08T06:05:48.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.374+0000 7f7f78d57b80 1 -- 172.21.15.82:0/3655379055 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ef5ffbd110 con 0x55ef5ffb02e0 2024-05-08T06:05:48.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.374+0000 7f7f67400700 1 --2- 172.21.15.82:0/3655379055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef5ffb0ca0 0x55ef5ffb98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:48.374 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.375+0000 7f7f66a00700 1 --2- 172.21.15.82:0/3655379055 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ef5ffb4ad0 0x55ef5ffb9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:48.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.375+0000 7f7f78d57b80 10 client.0 _ll_register_callbacks cb 0x55ef5fe98c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:05:48.375 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.375+0000 7f7f67400700 1 -- 172.21.15.82:0/3655379055 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef5ffb02e0 msgr2=0x55ef5ffbc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:48.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.375+0000 7f7f67400700 1 --2- 172.21.15.82:0/3655379055 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef5ffb02e0 0x55ef5ffbc540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:48.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.375+0000 7f7f67400700 1 -- 172.21.15.82:0/3655379055 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ef5ffb4ad0 msgr2=0x55ef5ffb9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:48.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.375+0000 7f7f67400700 1 --2- 172.21.15.82:0/3655379055 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ef5ffb4ad0 0x55ef5ffb9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:48.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.375+0000 7f7f67400700 1 -- 172.21.15.82:0/3655379055 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef5feb7420 con 0x55ef5ffb0ca0 2024-05-08T06:05:48.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.376+0000 7f7f66a00700 1 --2- 172.21.15.82:0/3655379055 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ef5ffb4ad0 0x55ef5ffb9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:05:48.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.377+0000 7f7f67400700 1 --2- 172.21.15.82:0/3655379055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef5ffb0ca0 0x55ef5ffb98e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7f58012750 tx=0x7f7f58012a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=714bee459ae22d0c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:05:48.376 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.377+0000 7f7f51600700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T06:05:48.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.377+0000 7f7f51600700 1 -- 172.21.15.82:0/3655379055 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f58004a30 con 0x55ef5ffb0ca0 2024-05-08T06:05:48.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.377+0000 7f7f78d57b80 1 -- 172.21.15.82:0/3655379055 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7f540095d0 con 0x55ef5ffb0ca0 2024-05-08T06:05:48.377 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.378+0000 7f7f51600700 1 -- 172.21.15.82:0/3655379055 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f7f58010650 con 0x55ef5ffb0ca0 2024-05-08T06:05:48.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.381+0000 7f7f51600700 1 -- 172.21.15.82:0/3655379055 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f7f58010850 con 0x55ef5ffb0ca0 2024-05-08T06:05:48.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.381+0000 7f7f78d57b80 10 client.16347 fetch_fsmap learned FSMap version 31 2024-05-08T06:05:48.381 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.381+0000 7f7f78d57b80 1 -- 172.21.15.82:0/3655379055 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55ef5ffc7720 con 0x55ef5ffb0ca0 2024-05-08T06:05:48.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.383+0000 7f7f51600700 1 -- 172.21.15.82:0/3655379055 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7f540095d0 con 0x55ef5ffb0ca0 2024-05-08T06:05:48.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.383+0000 7f7f51600700 1 -- 172.21.15.82:0/3655379055 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f7f58025c90 con 0x55ef5ffb0ca0 2024-05-08T06:05:48.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.383+0000 7f7f78d57b80 10 client.16347 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:05:48.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.383+0000 7f7f78d57b80 10 client.16347 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T06:05:48.385 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.383+0000 7f7f78d57b80 20 client.16347 populate_metadata read hostname 'smithi082' 2024-05-08T06:05:48.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.383+0000 7f7f78d57b80 1 --2- 172.21.15.82:0/3655379055 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55ef5ffc9d00 0x55ef5ffcc160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:48.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.383+0000 7f7f78d57b80 4 client.16347 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:05:48.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.383+0000 7f7f78d57b80 1 -- 172.21.15.82:0/3655379055 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ef5ff6c140 con 0x55ef5ffc9d00 2024-05-08T06:05:48.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.385+0000 7f7f66a00700 1 --2- 172.21.15.82:0/3655379055 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55ef5ffc9d00 0x55ef5ffcc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:48.386 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.386+0000 7f7f66a00700 1 --2- 172.21.15.82:0/3655379055 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55ef5ffc9d00 0x55ef5ffcc160 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a42807ed6fa388ba server_cookie=a0f0678a8a7c7fcf in_seq=0 out_seq=0 2024-05-08T06:05:48.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.387+0000 7f7f51600700 10 client.16347 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T06:05:48.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.388+0000 7f7f51600700 1 -- 172.21.15.82:0/3655379055 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7f7f5400be60 con 0x55ef5ffc9d00 2024-05-08T06:05:48.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.388+0000 7f7f51600700 10 client.16347 handle_command_reply: tid=0 2024-05-08T06:05:48.387 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.388+0000 7f7f78d57b80 1 client.16347 shutdown 2024-05-08T06:05:48.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.390+0000 7f7f78d57b80 1 -- 172.21.15.82:0/3655379055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef5ffb0ca0 msgr2=0x55ef5ffb98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:48.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.390+0000 7f7f78d57b80 1 --2- 172.21.15.82:0/3655379055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef5ffb0ca0 0x55ef5ffb98e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7f58012750 tx=0x7f7f58012a60 comp rx=0 tx=0).stop 2024-05-08T06:05:48.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.390+0000 7f7f78d57b80 1 -- 172.21.15.82:0/3655379055 shutdown_connections 2024-05-08T06:05:48.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.390+0000 7f7f78d57b80 1 --2- 172.21.15.82:0/3655379055 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55ef5ffc9d00 0x55ef5ffcc160 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:48.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.390+0000 7f7f78d57b80 1 --2- 172.21.15.82:0/3655379055 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ef5ffb4ad0 0x55ef5ffb9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:48.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.390+0000 7f7f78d57b80 1 --2- 172.21.15.82:0/3655379055 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef5ffb02e0 0x55ef5ffbc540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:48.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.390+0000 7f7f78d57b80 1 --2- 172.21.15.82:0/3655379055 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef5ffb0ca0 0x55ef5ffb98e0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:48.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.390+0000 7f7f78d57b80 1 -- 172.21.15.82:0/3655379055 >> 172.21.15.82:0/3655379055 conn(0x55ef5ff176d0 msgr2=0x55ef5ffb6150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:05:48.390 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.390+0000 7f7f51600700 0 client.16347 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T06:05:48.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.391+0000 7f7f78d57b80 1 -- 172.21.15.82:0/3655379055 shutdown_connections 2024-05-08T06:05:48.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.391+0000 7f7f78d57b80 1 -- 172.21.15.82:0/3655379055 wait complete. 2024-05-08T06:05:48.391 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.392+0000 7f7f78d57b80 20 client.16347 trim_cache size 0 max 16384 2024-05-08T06:05:48.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.429+0000 7f7f78d57b80 1 Processor -- start 2024-05-08T06:05:48.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.429+0000 7f7f78d57b80 1 -- start start 2024-05-08T06:05:48.429 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.430+0000 7f7f78d57b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ef5ffb02e0 0x55ef5ffb8840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:48.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.430+0000 7f7f78d57b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef5ffb0ca0 0x55ef5ffb4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:48.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.430+0000 7f7f78d57b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef5ffb4ad0 0x55ef5ffd1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:48.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.430+0000 7f7f78d57b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6811d130 con 0x55ef5ffb0ca0 2024-05-08T06:05:48.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.430+0000 7f7f78d57b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7f681ad3c0 con 0x55ef5ffb02e0 2024-05-08T06:05:48.430 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.430+0000 7f7f78d57b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6811d800 con 0x55ef5ffb4ad0 2024-05-08T06:05:48.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.430+0000 7f7f66a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ef5ffb02e0 0x55ef5ffb8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:48.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.431+0000 7f7f66a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ef5ffb02e0 0x55ef5ffb8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:47950/0 (socket says 172.21.15.82:47950) 2024-05-08T06:05:48.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.431+0000 7f7f66a00700 1 -- 172.21.15.82:0/567303451 learned_addr learned my addr 172.21.15.82:0/567303451 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:05:48.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.431+0000 7f7f66a00700 1 --2- 172.21.15.82:0/567303451 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef5ffb4ad0 0x55ef5ffd1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:48.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.431+0000 7f7f67400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef5ffb0ca0 0x55ef5ffb4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:48.431 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.431+0000 7f7f66a00700 1 -- 172.21.15.82:0/567303451 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef5ffb4ad0 msgr2=0x55ef5ffd1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:48.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.432+0000 7f7f66a00700 1 --2- 172.21.15.82:0/567303451 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef5ffb4ad0 0x55ef5ffd1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:48.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.432+0000 7f7f66a00700 1 -- 172.21.15.82:0/567303451 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef5ffb0ca0 msgr2=0x55ef5ffb4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:48.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.432+0000 7f7f66a00700 1 --2- 172.21.15.82:0/567303451 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef5ffb0ca0 0x55ef5ffb4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:48.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.432+0000 7f7f66a00700 1 -- 172.21.15.82:0/567303451 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef5ffb7e50 con 0x55ef5ffb02e0 2024-05-08T06:05:48.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.432+0000 7f7f67400700 1 --2- 172.21.15.82:0/567303451 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef5ffb0ca0 0x55ef5ffb4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:05:48.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.434+0000 7f7f66a00700 1 --2- 172.21.15.82:0/567303451 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ef5ffb02e0 0x55ef5ffb8840 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f7f54009ce0 tx=0x7f7f54019040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3b168fb9a04c6e4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:05:48.433 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.434+0000 7f7f53e00700 1 -- 172.21.15.82:0/567303451 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f54004020 con 0x55ef5ffb02e0 2024-05-08T06:05:48.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.434+0000 7f7f53e00700 1 -- 172.21.15.82:0/567303451 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55ef5ff6c140 con 0x55ef5ffb02e0 2024-05-08T06:05:48.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.434+0000 7f7f53e00700 1 -- 172.21.15.82:0/567303451 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f540038c0 con 0x55ef5ffb02e0 2024-05-08T06:05:48.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.436+0000 7f7f78d57b80 1 -- 172.21.15.82:0/567303451 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ef5ffb02e0 msgr2=0x55ef5ffb8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:48.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.436+0000 7f7f78d57b80 1 --2- 172.21.15.82:0/567303451 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ef5ffb02e0 0x55ef5ffb8840 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f7f54009ce0 tx=0x7f7f54019040 comp rx=0 tx=0).stop 2024-05-08T06:05:48.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.436+0000 7f7f78d57b80 1 -- 172.21.15.82:0/567303451 shutdown_connections 2024-05-08T06:05:48.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.436+0000 7f7f78d57b80 1 --2- 172.21.15.82:0/567303451 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ef5ffb02e0 0x55ef5ffb8840 secure :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f7f54009ce0 tx=0x7f7f54019040 comp rx=0 tx=0).stop 2024-05-08T06:05:48.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.436+0000 7f7f78d57b80 1 --2- 172.21.15.82:0/567303451 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef5ffb4ad0 0x55ef5ffd1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:48.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.436+0000 7f7f78d57b80 1 --2- 172.21.15.82:0/567303451 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef5ffb0ca0 0x55ef5ffb4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:48.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.436+0000 7f7f78d57b80 1 -- 172.21.15.82:0/567303451 >> 172.21.15.82:0/567303451 conn(0x55ef5ff176d0 msgr2=0x55ef5ffb3a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:05:48.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.437+0000 7f7f78d57b80 1 -- 172.21.15.82:0/567303451 shutdown_connections 2024-05-08T06:05:48.437 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.437+0000 7f7f78d57b80 1 -- 172.21.15.82:0/567303451 wait complete. 2024-05-08T06:05:48.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.438+0000 7f7f78d57b80 1 -- start start 2024-05-08T06:05:48.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.438+0000 7f7f78d57b80 1 Processor -- start 2024-05-08T06:05:48.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.440+0000 7f7f78d57b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef5ffb0ca0 0x55ef5ffb2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:48.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.444+0000 7f7f78d57b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef5ffb4ad0 0x55ef5ffb2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:48.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.444+0000 7f7f78d57b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ef5ffb31b0 0x55ef60033620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:48.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.444+0000 7f7f66a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef5ffb0ca0 0x55ef5ffb2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:48.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.444+0000 7f7f78d57b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6811e5a0 con 0x55ef5ffb4ad0 2024-05-08T06:05:48.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.444+0000 7f7f78d57b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6811ded0 con 0x55ef5ffb31b0 2024-05-08T06:05:48.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.444+0000 7f7f78d57b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7f6811b0d0 con 0x55ef5ffb0ca0 2024-05-08T06:05:48.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.444+0000 7f7f78d57b80 10 client.0 _ll_register_callbacks cb 0x55ef5fe98c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:05:48.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.444+0000 7f7f66a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef5ffb0ca0 0x55ef5ffb2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:47736/0 (socket says 172.21.15.82:47736) 2024-05-08T06:05:48.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.444+0000 7f7f66a00700 1 -- 172.21.15.82:0/2832866001 learned_addr learned my addr 172.21.15.82:0/2832866001 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:05:48.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.444+0000 7f7f67400700 1 --2- 172.21.15.82:0/2832866001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef5ffb4ad0 0x55ef5ffb2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:48.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.444+0000 7f7f66a00700 1 --2- 172.21.15.82:0/2832866001 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ef5ffb31b0 0x55ef60033620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:48.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.445+0000 7f7f66a00700 1 -- 172.21.15.82:0/2832866001 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ef5ffb31b0 msgr2=0x55ef60033620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:48.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.445+0000 7f7f66a00700 1 --2- 172.21.15.82:0/2832866001 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ef5ffb31b0 0x55ef60033620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:48.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.445+0000 7f7f66a00700 1 -- 172.21.15.82:0/2832866001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef5ffb4ad0 msgr2=0x55ef5ffb2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:05:48.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.445+0000 7f7f66a00700 1 --2- 172.21.15.82:0/2832866001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef5ffb4ad0 0x55ef5ffb2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:48.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.445+0000 7f7f66a00700 1 -- 172.21.15.82:0/2832866001 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef60033e60 con 0x55ef5ffb0ca0 2024-05-08T06:05:48.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.445+0000 7f7f67400700 1 --2- 172.21.15.82:0/2832866001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef5ffb4ad0 0x55ef5ffb2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:05:48.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.445+0000 7f7f66a00700 1 --2- 172.21.15.82:0/2832866001 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef5ffb0ca0 0x55ef5ffb2730 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7f5400c010 tx=0x7f7f5400b310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39e5e33ddfbd289c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:05:48.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.445+0000 7f7f51600700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T06:05:48.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.445+0000 7f7f51600700 1 -- 172.21.15.82:0/2832866001 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f54030040 con 0x55ef5ffb0ca0 2024-05-08T06:05:48.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.445+0000 7f7f51600700 1 -- 172.21.15.82:0/2832866001 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f7f54004220 con 0x55ef5ffb0ca0 2024-05-08T06:05:48.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.446+0000 7f7f78d57b80 1 -- 172.21.15.82:0/2832866001 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ef5ff6c140 con 0x55ef5ffb0ca0 2024-05-08T06:05:48.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.446+0000 7f7f51600700 1 -- 172.21.15.82:0/2832866001 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f7f54004420 con 0x55ef5ffb0ca0 2024-05-08T06:05:48.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.446+0000 7f7f78d57b80 10 client.26923 fetch_fsmap learned FSMap version 31 2024-05-08T06:05:48.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.446+0000 7f7f78d57b80 1 -- 172.21.15.82:0/2832866001 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55ef60035170 con 0x55ef5ffb0ca0 2024-05-08T06:05:48.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.446+0000 7f7f51600700 1 -- 172.21.15.82:0/2832866001 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55ef5ff6c140 con 0x55ef5ffb0ca0 2024-05-08T06:05:48.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.446+0000 7f7f51600700 1 -- 172.21.15.82:0/2832866001 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f7f54042070 con 0x55ef5ffb0ca0 2024-05-08T06:05:48.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.446+0000 7f7f78d57b80 10 client.26923 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:05:48.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.446+0000 7f7f78d57b80 10 client.26923 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T06:05:48.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.446+0000 7f7f78d57b80 20 client.26923 populate_metadata read hostname 'smithi082' 2024-05-08T06:05:48.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.446+0000 7f7f78d57b80 1 --2- 172.21.15.82:0/2832866001 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55ef60035340 0x55ef60037730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:05:48.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.447+0000 7f7f78d57b80 4 client.26923 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-08T06:05:48.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.447+0000 7f7f78d57b80 1 -- 172.21.15.82:0/2832866001 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ef5feff400 con 0x55ef60035340 2024-05-08T06:05:48.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.447+0000 7f7f67400700 1 --2- 172.21.15.82:0/2832866001 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55ef60035340 0x55ef60037730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:05:48.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.448+0000 7f7f67400700 1 --2- 172.21.15.82:0/2832866001 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55ef60035340 0x55ef60037730 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b888e145e2dabab6 server_cookie=21d4447d66686921 in_seq=0 out_seq=0 2024-05-08T06:05:48.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.448+0000 7f7f51600700 10 client.26923 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T06:05:48.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.448+0000 7f7f51600700 1 -- 172.21.15.82:0/2832866001 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55ef5feff400 con 0x55ef60035340 2024-05-08T06:05:48.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.448+0000 7f7f51600700 10 client.26923 handle_command_reply: tid=0 2024-05-08T06:05:48.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.448+0000 7f7f78d57b80 1 client.26923 shutdown 2024-05-08T06:05:48.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.448+0000 7f7f78d57b80 1 -- 172.21.15.82:0/2832866001 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef5ffb0ca0 msgr2=0x55ef5ffb2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:48.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.448+0000 7f7f78d57b80 1 --2- 172.21.15.82:0/2832866001 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef5ffb0ca0 0x55ef5ffb2730 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7f5400c010 tx=0x7f7f5400b310 comp rx=0 tx=0).stop 2024-05-08T06:05:48.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.448+0000 7f7f78d57b80 1 -- 172.21.15.82:0/2832866001 shutdown_connections 2024-05-08T06:05:48.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.448+0000 7f7f78d57b80 1 --2- 172.21.15.82:0/2832866001 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x55ef60035340 0x55ef60037730 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:48.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.448+0000 7f7f78d57b80 1 --2- 172.21.15.82:0/2832866001 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ef5ffb31b0 0x55ef60033620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:48.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.448+0000 7f7f78d57b80 1 --2- 172.21.15.82:0/2832866001 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef5ffb0ca0 0x55ef5ffb2730 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:48.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.448+0000 7f7f78d57b80 1 --2- 172.21.15.82:0/2832866001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ef5ffb4ad0 0x55ef5ffb2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:48.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.448+0000 7f7f78d57b80 1 -- 172.21.15.82:0/2832866001 >> 172.21.15.82:0/2832866001 conn(0x55ef5ff176d0 msgr2=0x55ef5ffb9a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:05:48.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.448+0000 7f7f51600700 0 client.26923 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T06:05:48.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.449+0000 7f7f78d57b80 1 -- 172.21.15.82:0/2832866001 shutdown_connections 2024-05-08T06:05:48.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.449+0000 7f7f78d57b80 1 -- 172.21.15.82:0/2832866001 wait complete. 2024-05-08T06:05:48.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.449+0000 7f7f78d57b80 20 client.26923 trim_cache size 0 max 16384 2024-05-08T06:05:48.450 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T06:05:48.450 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-08T06:05:48.450 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": { 2024-05-08T06:05:48.450 INFO:teuthology.orchestra.run.smithi082.stdout: "a8898ae2-cd8b-43af-990d-ef004334e8e6": { 2024-05-08T06:05:48.451 INFO:teuthology.orchestra.run.smithi082.stdout: "path": "/", 2024-05-08T06:05:48.451 INFO:teuthology.orchestra.run.smithi082.stdout: "tag": "a8898ae2-cd8b-43af-990d-ef004334e8e6", 2024-05-08T06:05:48.451 INFO:teuthology.orchestra.run.smithi082.stdout: "options": "recursive,force" 2024-05-08T06:05:48.451 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:05:48.451 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:05:48.451 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T06:05:48.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.450+0000 7f7f6e400700 1 -- 172.21.15.82:0/3733734966 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7f4c0b29c0 msgr2=0x7f7f4c0b4e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:48.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.450+0000 7f7f6e400700 1 --2- 172.21.15.82:0/3733734966 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7f4c0b29c0 0x7f7f4c0b4e80 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7f60003ff0 tx=0x7f7f6000b040 comp rx=0 tx=0).stop 2024-05-08T06:05:48.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.450+0000 7f7f6e400700 1 -- 172.21.15.82:0/3733734966 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f68109510 msgr2=0x7f7f6810daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:05:48.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.450+0000 7f7f6e400700 1 --2- 172.21.15.82:0/3733734966 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f68109510 0x7f7f6810daf0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f7f60007ee0 tx=0x7f7f6000d3b0 comp rx=0 tx=0).stop 2024-05-08T06:05:48.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.451+0000 7f7f6e400700 1 -- 172.21.15.82:0/3733734966 shutdown_connections 2024-05-08T06:05:48.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.451+0000 7f7f6e400700 1 --2- 172.21.15.82:0/3733734966 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7f4c0b29c0 0x7f7f4c0b4e80 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:48.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.451+0000 7f7f6e400700 1 --2- 172.21.15.82:0/3733734966 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f68109510 0x7f7f6810daf0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:48.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.451+0000 7f7f6e400700 1 --2- 172.21.15.82:0/3733734966 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7f6806b180 0x7f7f681102d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:48.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.451+0000 7f7f6e400700 1 --2- 172.21.15.82:0/3733734966 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f6806bb40 0x7f7f6810d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:05:48.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.451+0000 7f7f6e400700 1 -- 172.21.15.82:0/3733734966 >> 172.21.15.82:0/3733734966 conn(0x7f7f68079350 msgr2=0x7f7f68101070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:05:48.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.451+0000 7f7f6e400700 1 -- 172.21.15.82:0/3733734966 shutdown_connections 2024-05-08T06:05:48.452 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:05:48.452+0000 7f7f6e400700 1 -- 172.21.15.82:0/3733734966 wait complete. 2024-05-08T06:05:49.474 INFO:tasks.cephfs.filesystem:scrub status for tag:a8898ae2-cd8b-43af-990d-ef004334e8e6 - {'path': '/', 'tag': 'a8898ae2-cd8b-43af-990d-ef004334e8e6', 'options': 'recursive,force'} 2024-05-08T06:05:50.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:05:49 smithi151 ceph-mon[34815]: pgmap v914: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.5 MiB/s wr, 591 op/s 2024-05-08T06:05:50.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:05:49 smithi082 ceph-mon[30098]: pgmap v914: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.5 MiB/s wr, 591 op/s 2024-05-08T06:05:50.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:05:49 smithi134 ceph-mon[34132]: pgmap v914: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.5 MiB/s wr, 591 op/s 2024-05-08T06:05:50.265 INFO:teuthology.orchestra.run.smithi082.stderr:progress: 900.0 s, 1515.4 tps, lat 65.812 ms stddev 75.057 2024-05-08T06:05:50.509 INFO:teuthology.orchestra.run.smithi082.stdout:transaction type: 2024-05-08T06:05:50.510 INFO:teuthology.orchestra.run.smithi082.stdout:scaling factor: 32 2024-05-08T06:05:50.510 INFO:teuthology.orchestra.run.smithi082.stdout:query mode: simple 2024-05-08T06:05:50.510 INFO:teuthology.orchestra.run.smithi082.stdout:number of clients: 100 2024-05-08T06:05:50.510 INFO:teuthology.orchestra.run.smithi082.stdout:number of threads: 4 2024-05-08T06:05:50.510 INFO:teuthology.orchestra.run.smithi082.stdout:duration: 900 s 2024-05-08T06:05:50.510 INFO:teuthology.orchestra.run.smithi082.stdout:number of transactions actually processed: 1824517 2024-05-08T06:05:50.510 INFO:teuthology.orchestra.run.smithi082.stdout:latency average = 49.301 ms 2024-05-08T06:05:50.510 INFO:teuthology.orchestra.run.smithi082.stdout:latency stddev = 64.444 ms 2024-05-08T06:05:50.510 INFO:teuthology.orchestra.run.smithi082.stdout:tps = 2026.695118 (including connections establishing) 2024-05-08T06:05:50.510 INFO:teuthology.orchestra.run.smithi082.stdout:tps = 2026.712277 (excluding connections establishing) 2024-05-08T06:05:50.517 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl stop postgresql' 2024-05-08T06:05:51.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:05:50 smithi151 ceph-mon[34815]: scrub summary: idle 2024-05-08T06:05:51.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:05:50 smithi151 ceph-mon[34815]: scrub summary: idle 2024-05-08T06:05:51.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:05:50 smithi082 ceph-mon[30098]: scrub summary: idle 2024-05-08T06:05:51.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:05:50 smithi082 ceph-mon[30098]: scrub summary: idle 2024-05-08T06:05:51.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:05:50 smithi134 ceph-mon[34132]: scrub summary: idle 2024-05-08T06:05:51.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:05:50 smithi134 ceph-mon[34132]: scrub summary: idle 2024-05-08T06:05:52.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:05:51 smithi151 ceph-mon[34815]: pgmap v915: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.4 MiB/s wr, 667 op/s 2024-05-08T06:05:52.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:05:51 smithi082 ceph-mon[30098]: pgmap v915: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.4 MiB/s wr, 667 op/s 2024-05-08T06:05:52.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:05:51 smithi134 ceph-mon[34132]: pgmap v915: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.4 MiB/s wr, 667 op/s 2024-05-08T06:05:54.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:05:53 smithi151 ceph-mon[34815]: pgmap v916: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.4 MiB/s wr, 676 op/s 2024-05-08T06:05:54.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:05:53 smithi082 ceph-mon[30098]: pgmap v916: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.4 MiB/s wr, 676 op/s 2024-05-08T06:05:54.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:05:53 smithi134 ceph-mon[34132]: pgmap v916: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.4 MiB/s wr, 676 op/s 2024-05-08T06:05:56.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:05:55 smithi151 ceph-mon[34815]: pgmap v917: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.2 MiB/s wr, 639 op/s 2024-05-08T06:05:56.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:05:55 smithi082 ceph-mon[30098]: pgmap v917: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.2 MiB/s wr, 639 op/s 2024-05-08T06:05:56.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:05:55 smithi134 ceph-mon[34132]: pgmap v917: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.2 MiB/s wr, 639 op/s 2024-05-08T06:05:58.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:05:57 smithi151 ceph-mon[34815]: pgmap v918: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.3 MiB/s wr, 996 op/s 2024-05-08T06:05:58.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:05:57 smithi082 ceph-mon[30098]: pgmap v918: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.3 MiB/s wr, 996 op/s 2024-05-08T06:05:58.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:05:57 smithi134 ceph-mon[34132]: pgmap v918: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.3 MiB/s wr, 996 op/s 2024-05-08T06:05:59.222 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:05:58 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:05:59.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:05:58 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:05:59.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:05:58 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:06:00.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:05:59 smithi082 ceph-mon[30098]: pgmap v919: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 8.3 MiB/s wr, 901 op/s 2024-05-08T06:06:00.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:05:59 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:06:00.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:05:59 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:06:00.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:05:59 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:06:00.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:05:59 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:06:00.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:05:59 smithi134 ceph-mon[34132]: pgmap v919: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 8.3 MiB/s wr, 901 op/s 2024-05-08T06:06:00.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:05:59 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:06:00.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:05:59 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:06:00.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:05:59 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:06:00.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:05:59 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:06:00.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:05:59 smithi151 ceph-mon[34815]: pgmap v919: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 8.3 MiB/s wr, 901 op/s 2024-05-08T06:06:00.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:05:59 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:06:00.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:05:59 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:06:00.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:05:59 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:06:00.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:05:59 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-08T06:06:00.902 DEBUG:teuthology.orchestra.run.smithi082:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-05-08T06:06:01.045 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/: 2024-05-08T06:06:01.045 INFO:teuthology.orchestra.run.smithi082.stdout:total 0 2024-05-08T06:06:01.045 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 8 05:50 . 2024-05-08T06:06:01.045 INFO:teuthology.orchestra.run.smithi082.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1 May 8 05:50 .. 2024-05-08T06:06:01.045 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 May 8 06:06 data 2024-05-08T06:06:01.045 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T06:06:01.045 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data: 2024-05-08T06:06:01.045 INFO:teuthology.orchestra.run.smithi082.stdout:total 36 2024-05-08T06:06:01.045 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 May 8 06:06 . 2024-05-08T06:06:01.046 INFO:teuthology.orchestra.run.smithi082.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 8 05:50 .. 2024-05-08T06:06:01.046 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 May 8 05:50 base 2024-05-08T06:06:01.046 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 30 May 8 05:50 current_logfiles 2024-05-08T06:06:01.046 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 58 May 8 05:50 global 2024-05-08T06:06:01.046 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 8 05:50 log 2024-05-08T06:06:01.046 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 pg_commit_ts 2024-05-08T06:06:01.046 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 pg_dynshmem 2024-05-08T06:06:01.046 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4516 May 8 05:50 pg_hba.conf 2024-05-08T06:06:01.046 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 May 8 05:50 pg_ident.conf 2024-05-08T06:06:01.046 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 8 06:05 pg_logical 2024-05-08T06:06:01.046 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 May 8 05:50 pg_multixact 2024-05-08T06:06:01.047 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 pg_notify 2024-05-08T06:06:01.047 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 pg_replslot 2024-05-08T06:06:01.047 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 pg_serial 2024-05-08T06:06:01.047 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 pg_snapshots 2024-05-08T06:06:01.047 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 8 06:06 pg_stat 2024-05-08T06:06:01.047 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 06:06 pg_stat_tmp 2024-05-08T06:06:01.047 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 8 06:06 pg_subtrans 2024-05-08T06:06:01.047 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 pg_tblspc 2024-05-08T06:06:01.047 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 pg_twophase 2024-05-08T06:06:01.047 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 8 05:50 PG_VERSION 2024-05-08T06:06:01.047 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 65 May 8 06:06 pg_wal 2024-05-08T06:06:01.047 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 2 May 8 05:58 pg_xact 2024-05-08T06:06:01.047 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 May 8 05:50 postgresql.auto.conf 2024-05-08T06:06:01.047 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 28082 May 8 05:50 postgresql.conf 2024-05-08T06:06:01.047 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 51 May 8 05:50 postmaster.opts 2024-05-08T06:06:01.048 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T06:06:01.048 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/base: 2024-05-08T06:06:01.048 INFO:teuthology.orchestra.run.smithi082.stdout:total 0 2024-05-08T06:06:01.048 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 May 8 05:50 . 2024-05-08T06:06:01.048 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 May 8 06:06 .. 2024-05-08T06:06:01.048 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 May 8 05:50 1 2024-05-08T06:06:01.048 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 May 8 05:50 13493 2024-05-08T06:06:01.048 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 305 May 8 05:54 13494 2024-05-08T06:06:01.048 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 pgsql_tmp 2024-05-08T06:06:01.048 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T06:06:01.048 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/base/1: 2024-05-08T06:06:01.048 INFO:teuthology.orchestra.run.smithi082.stdout:total 7777 2024-05-08T06:06:01.048 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 May 8 05:50 . 2024-05-08T06:06:01.048 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 May 8 05:50 .. 2024-05-08T06:06:01.048 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 112 2024-05-08T06:06:01.049 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 113 2024-05-08T06:06:01.049 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 May 8 05:50 1247 2024-05-08T06:06:01.049 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 1247_fsm 2024-05-08T06:06:01.049 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 1247_vm 2024-05-08T06:06:01.049 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 May 8 05:50 1249 2024-05-08T06:06:01.049 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 1249_fsm 2024-05-08T06:06:01.049 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 1249_vm 2024-05-08T06:06:01.049 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 May 8 05:50 1255 2024-05-08T06:06:01.049 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 1255_fsm 2024-05-08T06:06:01.049 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 1255_vm 2024-05-08T06:06:01.049 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 May 8 05:50 1259 2024-05-08T06:06:01.049 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 1259_fsm 2024-05-08T06:06:01.049 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 1259_vm 2024-05-08T06:06:01.049 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 May 8 05:50 13344 2024-05-08T06:06:01.049 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 13344_fsm 2024-05-08T06:06:01.050 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13344_vm 2024-05-08T06:06:01.050 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 13346 2024-05-08T06:06:01.050 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13348 2024-05-08T06:06:01.050 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13349 2024-05-08T06:06:01.050 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 13349_fsm 2024-05-08T06:06:01.050 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13349_vm 2024-05-08T06:06:01.050 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 13351 2024-05-08T06:06:01.050 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13353 2024-05-08T06:06:01.050 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13354 2024-05-08T06:06:01.050 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 13354_fsm 2024-05-08T06:06:01.050 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13354_vm 2024-05-08T06:06:01.050 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 13356 2024-05-08T06:06:01.050 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13358 2024-05-08T06:06:01.050 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13359 2024-05-08T06:06:01.051 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 13359_fsm 2024-05-08T06:06:01.051 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13359_vm 2024-05-08T06:06:01.051 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 13361 2024-05-08T06:06:01.051 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13363 2024-05-08T06:06:01.051 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 1417 2024-05-08T06:06:01.051 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 1418 2024-05-08T06:06:01.051 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 174 2024-05-08T06:06:01.051 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 175 2024-05-08T06:06:01.051 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2187 2024-05-08T06:06:01.051 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2224 2024-05-08T06:06:01.051 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2328 2024-05-08T06:06:01.051 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2336 2024-05-08T06:06:01.051 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2337 2024-05-08T06:06:01.051 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2579 2024-05-08T06:06:01.051 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2600 2024-05-08T06:06:01.051 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2600_fsm 2024-05-08T06:06:01.052 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2600_vm 2024-05-08T06:06:01.052 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2601 2024-05-08T06:06:01.052 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2601_fsm 2024-05-08T06:06:01.052 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2601_vm 2024-05-08T06:06:01.052 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 8 05:50 2602 2024-05-08T06:06:01.052 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2602_fsm 2024-05-08T06:06:01.052 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2602_vm 2024-05-08T06:06:01.052 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 05:50 2603 2024-05-08T06:06:01.052 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2603_fsm 2024-05-08T06:06:01.052 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2603_vm 2024-05-08T06:06:01.052 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2604 2024-05-08T06:06:01.052 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2605 2024-05-08T06:06:01.052 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2605_fsm 2024-05-08T06:06:01.052 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2605_vm 2024-05-08T06:06:01.053 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2606 2024-05-08T06:06:01.053 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2606_fsm 2024-05-08T06:06:01.053 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2606_vm 2024-05-08T06:06:01.053 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2607 2024-05-08T06:06:01.053 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2607_fsm 2024-05-08T06:06:01.053 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2607_vm 2024-05-08T06:06:01.053 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 May 8 05:50 2608 2024-05-08T06:06:01.053 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2608_fsm 2024-05-08T06:06:01.053 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2608_vm 2024-05-08T06:06:01.053 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 May 8 05:50 2609 2024-05-08T06:06:01.053 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2609_fsm 2024-05-08T06:06:01.053 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2609_vm 2024-05-08T06:06:01.053 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 05:50 2610 2024-05-08T06:06:01.053 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2610_fsm 2024-05-08T06:06:01.053 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2610_vm 2024-05-08T06:06:01.054 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2611 2024-05-08T06:06:01.054 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2612 2024-05-08T06:06:01.054 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2612_fsm 2024-05-08T06:06:01.054 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2612_vm 2024-05-08T06:06:01.054 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2613 2024-05-08T06:06:01.054 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2615 2024-05-08T06:06:01.054 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2615_fsm 2024-05-08T06:06:01.054 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2615_vm 2024-05-08T06:06:01.054 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2616 2024-05-08T06:06:01.054 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2616_fsm 2024-05-08T06:06:01.054 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2616_vm 2024-05-08T06:06:01.055 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 May 8 05:50 2617 2024-05-08T06:06:01.055 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2617_fsm 2024-05-08T06:06:01.055 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2617_vm 2024-05-08T06:06:01.055 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 May 8 05:50 2618 2024-05-08T06:06:01.055 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2618_fsm 2024-05-08T06:06:01.055 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2618_vm 2024-05-08T06:06:01.055 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 May 8 05:50 2619 2024-05-08T06:06:01.055 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2619_fsm 2024-05-08T06:06:01.055 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2619_vm 2024-05-08T06:06:01.055 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2620 2024-05-08T06:06:01.055 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2650 2024-05-08T06:06:01.055 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2651 2024-05-08T06:06:01.055 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2652 2024-05-08T06:06:01.055 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 8 05:50 2653 2024-05-08T06:06:01.056 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 8 05:50 2654 2024-05-08T06:06:01.056 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 05:50 2655 2024-05-08T06:06:01.056 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2656 2024-05-08T06:06:01.056 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2657 2024-05-08T06:06:01.056 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 May 8 05:50 2658 2024-05-08T06:06:01.056 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 May 8 05:50 2659 2024-05-08T06:06:01.056 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2660 2024-05-08T06:06:01.056 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2661 2024-05-08T06:06:01.056 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 05:50 2662 2024-05-08T06:06:01.056 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 8 05:50 2663 2024-05-08T06:06:01.056 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2664 2024-05-08T06:06:01.056 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2665 2024-05-08T06:06:01.056 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2666 2024-05-08T06:06:01.057 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2667 2024-05-08T06:06:01.057 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2668 2024-05-08T06:06:01.057 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2669 2024-05-08T06:06:01.057 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2670 2024-05-08T06:06:01.057 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 May 8 05:50 2673 2024-05-08T06:06:01.057 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 May 8 05:50 2674 2024-05-08T06:06:01.057 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 May 8 05:50 2675 2024-05-08T06:06:01.057 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2678 2024-05-08T06:06:01.057 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2679 2024-05-08T06:06:01.057 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2680 2024-05-08T06:06:01.057 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2681 2024-05-08T06:06:01.058 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2682 2024-05-08T06:06:01.058 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2683 2024-05-08T06:06:01.058 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2684 2024-05-08T06:06:01.058 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2685 2024-05-08T06:06:01.058 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2686 2024-05-08T06:06:01.058 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2687 2024-05-08T06:06:01.058 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 8 05:50 2688 2024-05-08T06:06:01.058 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 8 05:50 2689 2024-05-08T06:06:01.058 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 May 8 05:50 2690 2024-05-08T06:06:01.058 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 May 8 05:50 2691 2024-05-08T06:06:01.058 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2692 2024-05-08T06:06:01.058 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2693 2024-05-08T06:06:01.059 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2696 2024-05-08T06:06:01.059 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2699 2024-05-08T06:06:01.059 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2701 2024-05-08T06:06:01.059 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2702 2024-05-08T06:06:01.059 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 05:50 2703 2024-05-08T06:06:01.059 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 8 05:50 2704 2024-05-08T06:06:01.059 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2753 2024-05-08T06:06:01.059 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2753_fsm 2024-05-08T06:06:01.059 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2753_vm 2024-05-08T06:06:01.059 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2754 2024-05-08T06:06:01.059 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2755 2024-05-08T06:06:01.059 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 05:50 2756 2024-05-08T06:06:01.059 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 05:50 2757 2024-05-08T06:06:01.059 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2830 2024-05-08T06:06:01.060 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2831 2024-05-08T06:06:01.060 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2832 2024-05-08T06:06:01.060 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2833 2024-05-08T06:06:01.060 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2834 2024-05-08T06:06:01.060 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2835 2024-05-08T06:06:01.060 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2836 2024-05-08T06:06:01.060 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2837 2024-05-08T06:06:01.060 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 May 8 05:50 2838 2024-05-08T06:06:01.060 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2838_fsm 2024-05-08T06:06:01.060 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2838_vm 2024-05-08T06:06:01.060 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2839 2024-05-08T06:06:01.060 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2840 2024-05-08T06:06:01.060 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2840_fsm 2024-05-08T06:06:01.060 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2840_vm 2024-05-08T06:06:01.061 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2841 2024-05-08T06:06:01.061 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2995 2024-05-08T06:06:01.061 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2996 2024-05-08T06:06:01.061 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3079 2024-05-08T06:06:01.061 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3079_fsm 2024-05-08T06:06:01.061 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3079_vm 2024-05-08T06:06:01.061 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3080 2024-05-08T06:06:01.061 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3081 2024-05-08T06:06:01.061 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 8 05:50 3085 2024-05-08T06:06:01.061 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3118 2024-05-08T06:06:01.061 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3119 2024-05-08T06:06:01.061 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 May 8 05:50 3164 2024-05-08T06:06:01.061 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3256 2024-05-08T06:06:01.061 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3257 2024-05-08T06:06:01.061 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3258 2024-05-08T06:06:01.061 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3350 2024-05-08T06:06:01.062 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3351 2024-05-08T06:06:01.062 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3379 2024-05-08T06:06:01.062 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3380 2024-05-08T06:06:01.062 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3381 2024-05-08T06:06:01.062 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3394 2024-05-08T06:06:01.062 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3394_fsm 2024-05-08T06:06:01.062 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3394_vm 2024-05-08T06:06:01.062 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3395 2024-05-08T06:06:01.062 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3429 2024-05-08T06:06:01.062 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3430 2024-05-08T06:06:01.062 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3431 2024-05-08T06:06:01.062 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3433 2024-05-08T06:06:01.062 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3439 2024-05-08T06:06:01.062 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3440 2024-05-08T06:06:01.063 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 8 05:50 3455 2024-05-08T06:06:01.063 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 May 8 05:50 3456 2024-05-08T06:06:01.063 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3456_fsm 2024-05-08T06:06:01.063 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3456_vm 2024-05-08T06:06:01.063 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3466 2024-05-08T06:06:01.063 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3467 2024-05-08T06:06:01.063 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3468 2024-05-08T06:06:01.063 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3501 2024-05-08T06:06:01.063 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3502 2024-05-08T06:06:01.063 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3503 2024-05-08T06:06:01.063 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3534 2024-05-08T06:06:01.063 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3541 2024-05-08T06:06:01.063 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3541_fsm 2024-05-08T06:06:01.063 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3541_vm 2024-05-08T06:06:01.063 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3542 2024-05-08T06:06:01.064 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3574 2024-05-08T06:06:01.064 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3575 2024-05-08T06:06:01.064 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3576 2024-05-08T06:06:01.064 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3596 2024-05-08T06:06:01.064 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3597 2024-05-08T06:06:01.064 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3598 2024-05-08T06:06:01.064 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3599 2024-05-08T06:06:01.064 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3600 2024-05-08T06:06:01.064 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3600_fsm 2024-05-08T06:06:01.064 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3600_vm 2024-05-08T06:06:01.064 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3601 2024-05-08T06:06:01.064 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3601_fsm 2024-05-08T06:06:01.064 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3601_vm 2024-05-08T06:06:01.064 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3602 2024-05-08T06:06:01.064 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3602_fsm 2024-05-08T06:06:01.064 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3602_vm 2024-05-08T06:06:01.065 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3603 2024-05-08T06:06:01.065 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3603_fsm 2024-05-08T06:06:01.065 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3603_vm 2024-05-08T06:06:01.065 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3604 2024-05-08T06:06:01.065 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3605 2024-05-08T06:06:01.065 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3606 2024-05-08T06:06:01.065 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3607 2024-05-08T06:06:01.065 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3608 2024-05-08T06:06:01.065 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 05:50 3609 2024-05-08T06:06:01.065 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3712 2024-05-08T06:06:01.065 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3764 2024-05-08T06:06:01.065 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3764_fsm 2024-05-08T06:06:01.065 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3764_vm 2024-05-08T06:06:01.065 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3766 2024-05-08T06:06:01.065 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3767 2024-05-08T06:06:01.065 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3997 2024-05-08T06:06:01.066 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4143 2024-05-08T06:06:01.066 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4144 2024-05-08T06:06:01.066 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4145 2024-05-08T06:06:01.066 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4146 2024-05-08T06:06:01.066 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4147 2024-05-08T06:06:01.066 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4148 2024-05-08T06:06:01.066 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4149 2024-05-08T06:06:01.066 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4150 2024-05-08T06:06:01.066 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4151 2024-05-08T06:06:01.066 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4152 2024-05-08T06:06:01.066 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4153 2024-05-08T06:06:01.066 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4154 2024-05-08T06:06:01.066 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4155 2024-05-08T06:06:01.066 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4156 2024-05-08T06:06:01.067 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4157 2024-05-08T06:06:01.067 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4158 2024-05-08T06:06:01.067 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4159 2024-05-08T06:06:01.067 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4160 2024-05-08T06:06:01.067 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4161 2024-05-08T06:06:01.067 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4162 2024-05-08T06:06:01.068 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4163 2024-05-08T06:06:01.068 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4164 2024-05-08T06:06:01.068 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4165 2024-05-08T06:06:01.068 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4166 2024-05-08T06:06:01.068 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4167 2024-05-08T06:06:01.068 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4168 2024-05-08T06:06:01.068 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4169 2024-05-08T06:06:01.068 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4170 2024-05-08T06:06:01.068 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4171 2024-05-08T06:06:01.068 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4172 2024-05-08T06:06:01.068 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4173 2024-05-08T06:06:01.068 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4174 2024-05-08T06:06:01.069 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 5002 2024-05-08T06:06:01.069 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 548 2024-05-08T06:06:01.069 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 549 2024-05-08T06:06:01.069 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 6102 2024-05-08T06:06:01.069 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 6104 2024-05-08T06:06:01.069 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 6106 2024-05-08T06:06:01.069 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 6110 2024-05-08T06:06:01.069 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 6111 2024-05-08T06:06:01.069 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 6112 2024-05-08T06:06:01.069 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 6113 2024-05-08T06:06:01.069 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 6117 2024-05-08T06:06:01.069 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 826 2024-05-08T06:06:01.069 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 827 2024-05-08T06:06:01.069 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 828 2024-05-08T06:06:01.069 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 May 8 05:50 pg_filenode.map 2024-05-08T06:06:01.070 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 8 05:50 PG_VERSION 2024-05-08T06:06:01.070 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T06:06:01.070 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/base/13493: 2024-05-08T06:06:01.070 INFO:teuthology.orchestra.run.smithi082.stdout:total 7777 2024-05-08T06:06:01.070 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 289 May 8 05:50 . 2024-05-08T06:06:01.070 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 May 8 05:50 .. 2024-05-08T06:06:01.070 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 112 2024-05-08T06:06:01.070 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 113 2024-05-08T06:06:01.070 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 May 8 05:50 1247 2024-05-08T06:06:01.070 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 1247_fsm 2024-05-08T06:06:01.070 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 1247_vm 2024-05-08T06:06:01.070 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 May 8 05:50 1249 2024-05-08T06:06:01.070 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 1249_fsm 2024-05-08T06:06:01.070 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 1249_vm 2024-05-08T06:06:01.070 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 May 8 05:50 1255 2024-05-08T06:06:01.071 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 1255_fsm 2024-05-08T06:06:01.071 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 1255_vm 2024-05-08T06:06:01.071 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 May 8 05:50 1259 2024-05-08T06:06:01.071 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 1259_fsm 2024-05-08T06:06:01.071 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 1259_vm 2024-05-08T06:06:01.071 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 May 8 05:50 13344 2024-05-08T06:06:01.071 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 13344_fsm 2024-05-08T06:06:01.071 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13344_vm 2024-05-08T06:06:01.071 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 13346 2024-05-08T06:06:01.071 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13348 2024-05-08T06:06:01.071 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13349 2024-05-08T06:06:01.071 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 13349_fsm 2024-05-08T06:06:01.071 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13349_vm 2024-05-08T06:06:01.071 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 13351 2024-05-08T06:06:01.071 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13353 2024-05-08T06:06:01.072 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13354 2024-05-08T06:06:01.072 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 13354_fsm 2024-05-08T06:06:01.072 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13354_vm 2024-05-08T06:06:01.072 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 13356 2024-05-08T06:06:01.072 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13358 2024-05-08T06:06:01.072 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13359 2024-05-08T06:06:01.072 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 13359_fsm 2024-05-08T06:06:01.072 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13359_vm 2024-05-08T06:06:01.072 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 13361 2024-05-08T06:06:01.072 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13363 2024-05-08T06:06:01.072 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 1417 2024-05-08T06:06:01.072 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 1418 2024-05-08T06:06:01.072 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 174 2024-05-08T06:06:01.072 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 175 2024-05-08T06:06:01.072 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2187 2024-05-08T06:06:01.072 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2224 2024-05-08T06:06:01.073 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2328 2024-05-08T06:06:01.073 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2336 2024-05-08T06:06:01.073 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2337 2024-05-08T06:06:01.073 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2579 2024-05-08T06:06:01.073 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2600 2024-05-08T06:06:01.073 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2600_fsm 2024-05-08T06:06:01.073 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2600_vm 2024-05-08T06:06:01.073 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2601 2024-05-08T06:06:01.073 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2601_fsm 2024-05-08T06:06:01.073 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2601_vm 2024-05-08T06:06:01.073 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 8 05:50 2602 2024-05-08T06:06:01.073 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2602_fsm 2024-05-08T06:06:01.073 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2602_vm 2024-05-08T06:06:01.073 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 05:50 2603 2024-05-08T06:06:01.073 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2603_fsm 2024-05-08T06:06:01.073 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2603_vm 2024-05-08T06:06:01.074 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2604 2024-05-08T06:06:01.074 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2605 2024-05-08T06:06:01.074 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2605_fsm 2024-05-08T06:06:01.074 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2605_vm 2024-05-08T06:06:01.074 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2606 2024-05-08T06:06:01.074 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2606_fsm 2024-05-08T06:06:01.074 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2606_vm 2024-05-08T06:06:01.074 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2607 2024-05-08T06:06:01.074 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2607_fsm 2024-05-08T06:06:01.074 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2607_vm 2024-05-08T06:06:01.074 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 May 8 05:50 2608 2024-05-08T06:06:01.074 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2608_fsm 2024-05-08T06:06:01.074 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2608_vm 2024-05-08T06:06:01.074 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 May 8 05:50 2609 2024-05-08T06:06:01.074 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2609_fsm 2024-05-08T06:06:01.075 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2609_vm 2024-05-08T06:06:01.075 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 05:50 2610 2024-05-08T06:06:01.075 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2610_fsm 2024-05-08T06:06:01.075 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2610_vm 2024-05-08T06:06:01.075 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2611 2024-05-08T06:06:01.075 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2612 2024-05-08T06:06:01.075 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2612_fsm 2024-05-08T06:06:01.075 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2612_vm 2024-05-08T06:06:01.075 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2613 2024-05-08T06:06:01.075 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2615 2024-05-08T06:06:01.075 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2615_fsm 2024-05-08T06:06:01.075 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2615_vm 2024-05-08T06:06:01.075 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2616 2024-05-08T06:06:01.075 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2616_fsm 2024-05-08T06:06:01.075 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2616_vm 2024-05-08T06:06:01.076 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 May 8 05:50 2617 2024-05-08T06:06:01.076 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2617_fsm 2024-05-08T06:06:01.076 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2617_vm 2024-05-08T06:06:01.076 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 May 8 05:50 2618 2024-05-08T06:06:01.076 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2618_fsm 2024-05-08T06:06:01.076 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2618_vm 2024-05-08T06:06:01.076 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 May 8 05:50 2619 2024-05-08T06:06:01.076 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2619_fsm 2024-05-08T06:06:01.076 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2619_vm 2024-05-08T06:06:01.076 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2620 2024-05-08T06:06:01.076 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2650 2024-05-08T06:06:01.076 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2651 2024-05-08T06:06:01.076 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2652 2024-05-08T06:06:01.076 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 8 05:50 2653 2024-05-08T06:06:01.077 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 8 05:50 2654 2024-05-08T06:06:01.077 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 05:50 2655 2024-05-08T06:06:01.077 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2656 2024-05-08T06:06:01.077 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2657 2024-05-08T06:06:01.077 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 May 8 05:50 2658 2024-05-08T06:06:01.077 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 May 8 05:50 2659 2024-05-08T06:06:01.077 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2660 2024-05-08T06:06:01.077 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2661 2024-05-08T06:06:01.077 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 05:50 2662 2024-05-08T06:06:01.077 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 8 05:50 2663 2024-05-08T06:06:01.077 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2664 2024-05-08T06:06:01.077 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2665 2024-05-08T06:06:01.077 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2666 2024-05-08T06:06:01.077 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2667 2024-05-08T06:06:01.077 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2668 2024-05-08T06:06:01.077 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2669 2024-05-08T06:06:01.078 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2670 2024-05-08T06:06:01.078 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 May 8 05:50 2673 2024-05-08T06:06:01.078 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 May 8 05:50 2674 2024-05-08T06:06:01.078 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 May 8 05:50 2675 2024-05-08T06:06:01.078 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2678 2024-05-08T06:06:01.078 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2679 2024-05-08T06:06:01.078 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2680 2024-05-08T06:06:01.078 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2681 2024-05-08T06:06:01.078 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2682 2024-05-08T06:06:01.078 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2683 2024-05-08T06:06:01.078 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2684 2024-05-08T06:06:01.078 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2685 2024-05-08T06:06:01.078 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2686 2024-05-08T06:06:01.078 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2687 2024-05-08T06:06:01.078 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 8 05:50 2688 2024-05-08T06:06:01.079 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 8 05:50 2689 2024-05-08T06:06:01.079 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 May 8 05:50 2690 2024-05-08T06:06:01.079 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 May 8 05:50 2691 2024-05-08T06:06:01.079 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2692 2024-05-08T06:06:01.079 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2693 2024-05-08T06:06:01.079 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2696 2024-05-08T06:06:01.079 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2699 2024-05-08T06:06:01.079 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2701 2024-05-08T06:06:01.079 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2702 2024-05-08T06:06:01.079 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 05:50 2703 2024-05-08T06:06:01.079 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 8 05:50 2704 2024-05-08T06:06:01.079 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2753 2024-05-08T06:06:01.079 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2753_fsm 2024-05-08T06:06:01.079 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2753_vm 2024-05-08T06:06:01.079 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2754 2024-05-08T06:06:01.079 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2755 2024-05-08T06:06:01.080 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 05:50 2756 2024-05-08T06:06:01.080 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 05:50 2757 2024-05-08T06:06:01.080 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2830 2024-05-08T06:06:01.080 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2831 2024-05-08T06:06:01.080 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2832 2024-05-08T06:06:01.080 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2833 2024-05-08T06:06:01.080 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2834 2024-05-08T06:06:01.080 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2835 2024-05-08T06:06:01.080 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2836 2024-05-08T06:06:01.080 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2837 2024-05-08T06:06:01.080 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 May 8 05:50 2838 2024-05-08T06:06:01.080 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2838_fsm 2024-05-08T06:06:01.080 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2838_vm 2024-05-08T06:06:01.080 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2839 2024-05-08T06:06:01.080 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2840 2024-05-08T06:06:01.081 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2840_fsm 2024-05-08T06:06:01.081 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2840_vm 2024-05-08T06:06:01.081 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2841 2024-05-08T06:06:01.081 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2995 2024-05-08T06:06:01.081 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2996 2024-05-08T06:06:01.081 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3079 2024-05-08T06:06:01.081 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3079_fsm 2024-05-08T06:06:01.081 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3079_vm 2024-05-08T06:06:01.081 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3080 2024-05-08T06:06:01.081 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3081 2024-05-08T06:06:01.081 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 8 05:50 3085 2024-05-08T06:06:01.081 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3118 2024-05-08T06:06:01.081 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3119 2024-05-08T06:06:01.081 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 May 8 05:50 3164 2024-05-08T06:06:01.081 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3256 2024-05-08T06:06:01.082 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3257 2024-05-08T06:06:01.082 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3258 2024-05-08T06:06:01.082 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3350 2024-05-08T06:06:01.082 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3351 2024-05-08T06:06:01.082 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3379 2024-05-08T06:06:01.082 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3380 2024-05-08T06:06:01.082 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3381 2024-05-08T06:06:01.082 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3394 2024-05-08T06:06:01.082 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3394_fsm 2024-05-08T06:06:01.082 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3394_vm 2024-05-08T06:06:01.082 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3395 2024-05-08T06:06:01.082 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3429 2024-05-08T06:06:01.082 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3430 2024-05-08T06:06:01.082 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3431 2024-05-08T06:06:01.082 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3433 2024-05-08T06:06:01.083 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3439 2024-05-08T06:06:01.083 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3440 2024-05-08T06:06:01.083 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 8 05:50 3455 2024-05-08T06:06:01.083 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 May 8 05:50 3456 2024-05-08T06:06:01.083 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3456_fsm 2024-05-08T06:06:01.083 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3456_vm 2024-05-08T06:06:01.083 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3466 2024-05-08T06:06:01.083 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3467 2024-05-08T06:06:01.083 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3468 2024-05-08T06:06:01.083 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3501 2024-05-08T06:06:01.083 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3502 2024-05-08T06:06:01.083 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3503 2024-05-08T06:06:01.083 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3534 2024-05-08T06:06:01.083 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3541 2024-05-08T06:06:01.083 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3541_fsm 2024-05-08T06:06:01.084 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3541_vm 2024-05-08T06:06:01.084 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3542 2024-05-08T06:06:01.084 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3574 2024-05-08T06:06:01.084 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3575 2024-05-08T06:06:01.084 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3576 2024-05-08T06:06:01.084 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3596 2024-05-08T06:06:01.084 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3597 2024-05-08T06:06:01.084 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3598 2024-05-08T06:06:01.084 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3599 2024-05-08T06:06:01.084 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3600 2024-05-08T06:06:01.084 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3600_fsm 2024-05-08T06:06:01.084 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3600_vm 2024-05-08T06:06:01.084 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3601 2024-05-08T06:06:01.084 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3601_fsm 2024-05-08T06:06:01.084 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3601_vm 2024-05-08T06:06:01.084 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3602 2024-05-08T06:06:01.085 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3602_fsm 2024-05-08T06:06:01.085 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3602_vm 2024-05-08T06:06:01.085 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3603 2024-05-08T06:06:01.085 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3603_fsm 2024-05-08T06:06:01.085 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3603_vm 2024-05-08T06:06:01.085 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3604 2024-05-08T06:06:01.085 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3605 2024-05-08T06:06:01.085 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3606 2024-05-08T06:06:01.085 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3607 2024-05-08T06:06:01.085 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3608 2024-05-08T06:06:01.085 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 05:50 3609 2024-05-08T06:06:01.085 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3712 2024-05-08T06:06:01.085 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3764 2024-05-08T06:06:01.085 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3764_fsm 2024-05-08T06:06:01.086 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3764_vm 2024-05-08T06:06:01.086 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3766 2024-05-08T06:06:01.086 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3767 2024-05-08T06:06:01.086 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3997 2024-05-08T06:06:01.086 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4143 2024-05-08T06:06:01.086 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4144 2024-05-08T06:06:01.086 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4145 2024-05-08T06:06:01.086 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4146 2024-05-08T06:06:01.086 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4147 2024-05-08T06:06:01.086 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4148 2024-05-08T06:06:01.086 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4149 2024-05-08T06:06:01.086 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4150 2024-05-08T06:06:01.086 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4151 2024-05-08T06:06:01.087 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4152 2024-05-08T06:06:01.087 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4153 2024-05-08T06:06:01.087 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4154 2024-05-08T06:06:01.087 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4155 2024-05-08T06:06:01.087 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4156 2024-05-08T06:06:01.087 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4157 2024-05-08T06:06:01.087 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4158 2024-05-08T06:06:01.087 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4159 2024-05-08T06:06:01.087 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4160 2024-05-08T06:06:01.087 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4161 2024-05-08T06:06:01.087 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4162 2024-05-08T06:06:01.087 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4163 2024-05-08T06:06:01.087 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4164 2024-05-08T06:06:01.087 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4165 2024-05-08T06:06:01.087 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4166 2024-05-08T06:06:01.088 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4167 2024-05-08T06:06:01.088 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4168 2024-05-08T06:06:01.088 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4169 2024-05-08T06:06:01.088 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4170 2024-05-08T06:06:01.088 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4171 2024-05-08T06:06:01.088 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4172 2024-05-08T06:06:01.095 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4173 2024-05-08T06:06:01.095 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4174 2024-05-08T06:06:01.095 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 5002 2024-05-08T06:06:01.095 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 548 2024-05-08T06:06:01.095 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 549 2024-05-08T06:06:01.095 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 6102 2024-05-08T06:06:01.095 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 6104 2024-05-08T06:06:01.096 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 6106 2024-05-08T06:06:01.096 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 6110 2024-05-08T06:06:01.096 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 6111 2024-05-08T06:06:01.096 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 6112 2024-05-08T06:06:01.096 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 6113 2024-05-08T06:06:01.096 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 6117 2024-05-08T06:06:01.096 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 826 2024-05-08T06:06:01.096 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 827 2024-05-08T06:06:01.096 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 828 2024-05-08T06:06:01.096 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 May 8 05:50 pg_filenode.map 2024-05-08T06:06:01.096 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 8 05:50 PG_VERSION 2024-05-08T06:06:01.096 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T06:06:01.096 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/base/13494: 2024-05-08T06:06:01.096 INFO:teuthology.orchestra.run.smithi082.stdout:total 608798 2024-05-08T06:06:01.096 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 305 May 8 05:54 . 2024-05-08T06:06:01.097 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 May 8 05:50 .. 2024-05-08T06:06:01.097 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 112 2024-05-08T06:06:01.097 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 113 2024-05-08T06:06:01.097 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 May 8 05:50 1247 2024-05-08T06:06:01.097 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 1247_fsm 2024-05-08T06:06:01.097 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 1247_vm 2024-05-08T06:06:01.097 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 May 8 05:50 1249 2024-05-08T06:06:01.097 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 1249_fsm 2024-05-08T06:06:01.097 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 1249_vm 2024-05-08T06:06:01.097 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 May 8 05:50 1255 2024-05-08T06:06:01.097 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 1255_fsm 2024-05-08T06:06:01.097 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 1255_vm 2024-05-08T06:06:01.097 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 May 8 06:05 1259 2024-05-08T06:06:01.097 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 1259_fsm 2024-05-08T06:06:01.097 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 1259_vm 2024-05-08T06:06:01.097 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 May 8 05:50 13344 2024-05-08T06:06:01.097 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 13344_fsm 2024-05-08T06:06:01.098 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13344_vm 2024-05-08T06:06:01.098 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 13346 2024-05-08T06:06:01.098 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13348 2024-05-08T06:06:01.098 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13349 2024-05-08T06:06:01.098 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 13349_fsm 2024-05-08T06:06:01.098 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13349_vm 2024-05-08T06:06:01.098 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 13351 2024-05-08T06:06:01.098 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13353 2024-05-08T06:06:01.098 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13354 2024-05-08T06:06:01.098 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 13354_fsm 2024-05-08T06:06:01.098 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13354_vm 2024-05-08T06:06:01.098 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 13356 2024-05-08T06:06:01.098 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13358 2024-05-08T06:06:01.098 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13359 2024-05-08T06:06:01.099 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 13359_fsm 2024-05-08T06:06:01.099 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13359_vm 2024-05-08T06:06:01.099 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 13361 2024-05-08T06:06:01.099 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 13363 2024-05-08T06:06:01.099 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 1417 2024-05-08T06:06:01.099 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 1418 2024-05-08T06:06:01.099 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 444620800 May 8 06:05 16396 2024-05-08T06:06:01.099 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 May 8 06:05 16396_fsm 2024-05-08T06:06:01.099 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:54 16396_vm 2024-05-08T06:06:01.099 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1572864 May 8 06:05 16397 2024-05-08T06:06:01.099 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 06:05 16397_fsm 2024-05-08T06:06:01.099 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 06:05 16397_vm 2024-05-08T06:06:01.099 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1605632 May 8 06:05 16399 2024-05-08T06:06:01.099 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 06:05 16399_fsm 2024-05-08T06:06:01.099 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 06:05 16399_vm 2024-05-08T06:06:01.099 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 06:05 16400 2024-05-08T06:06:01.100 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 May 8 06:05 16402 2024-05-08T06:06:01.100 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 71901184 May 8 06:05 16404 2024-05-08T06:06:01.100 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 95223808 May 8 06:05 16406 2024-05-08T06:06:01.100 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 8 06:05 16406_fsm 2024-05-08T06:06:01.100 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 06:05 16406_vm 2024-05-08T06:06:01.100 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 174 2024-05-08T06:06:01.100 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 175 2024-05-08T06:06:01.100 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2187 2024-05-08T06:06:01.100 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2224 2024-05-08T06:06:01.100 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2328 2024-05-08T06:06:01.100 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2336 2024-05-08T06:06:01.100 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2337 2024-05-08T06:06:01.100 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2579 2024-05-08T06:06:01.100 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2600 2024-05-08T06:06:01.101 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2600_fsm 2024-05-08T06:06:01.101 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2600_vm 2024-05-08T06:06:01.101 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2601 2024-05-08T06:06:01.101 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2601_fsm 2024-05-08T06:06:01.101 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2601_vm 2024-05-08T06:06:01.101 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 8 05:50 2602 2024-05-08T06:06:01.101 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2602_fsm 2024-05-08T06:06:01.101 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2602_vm 2024-05-08T06:06:01.101 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 05:50 2603 2024-05-08T06:06:01.101 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2603_fsm 2024-05-08T06:06:01.101 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2603_vm 2024-05-08T06:06:01.101 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2604 2024-05-08T06:06:01.101 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2605 2024-05-08T06:06:01.101 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2605_fsm 2024-05-08T06:06:01.102 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2605_vm 2024-05-08T06:06:01.102 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2606 2024-05-08T06:06:01.102 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2606_fsm 2024-05-08T06:06:01.102 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2606_vm 2024-05-08T06:06:01.102 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2607 2024-05-08T06:06:01.102 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2607_fsm 2024-05-08T06:06:01.102 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2607_vm 2024-05-08T06:06:01.102 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 May 8 05:50 2608 2024-05-08T06:06:01.102 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2608_fsm 2024-05-08T06:06:01.102 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2608_vm 2024-05-08T06:06:01.102 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 May 8 05:50 2609 2024-05-08T06:06:01.102 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2609_fsm 2024-05-08T06:06:01.102 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2609_vm 2024-05-08T06:06:01.102 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 05:50 2610 2024-05-08T06:06:01.102 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2610_fsm 2024-05-08T06:06:01.103 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2610_vm 2024-05-08T06:06:01.103 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2611 2024-05-08T06:06:01.103 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2612 2024-05-08T06:06:01.103 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2612_fsm 2024-05-08T06:06:01.103 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2612_vm 2024-05-08T06:06:01.103 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2613 2024-05-08T06:06:01.103 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2615 2024-05-08T06:06:01.103 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2615_fsm 2024-05-08T06:06:01.103 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2615_vm 2024-05-08T06:06:01.103 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2616 2024-05-08T06:06:01.103 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2616_fsm 2024-05-08T06:06:01.103 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2616_vm 2024-05-08T06:06:01.103 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 May 8 05:50 2617 2024-05-08T06:06:01.103 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2617_fsm 2024-05-08T06:06:01.103 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2617_vm 2024-05-08T06:06:01.103 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 May 8 05:50 2618 2024-05-08T06:06:01.104 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2618_fsm 2024-05-08T06:06:01.104 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2618_vm 2024-05-08T06:06:01.104 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 163840 May 8 06:05 2619 2024-05-08T06:06:01.104 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:52 2619_fsm 2024-05-08T06:06:01.104 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2619_vm 2024-05-08T06:06:01.104 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2620 2024-05-08T06:06:01.104 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2650 2024-05-08T06:06:01.104 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2651 2024-05-08T06:06:01.104 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2652 2024-05-08T06:06:01.104 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 8 05:50 2653 2024-05-08T06:06:01.104 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 8 05:50 2654 2024-05-08T06:06:01.104 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 05:50 2655 2024-05-08T06:06:01.104 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2656 2024-05-08T06:06:01.104 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2657 2024-05-08T06:06:01.104 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 May 8 05:50 2658 2024-05-08T06:06:01.104 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 May 8 05:50 2659 2024-05-08T06:06:01.105 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2660 2024-05-08T06:06:01.105 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2661 2024-05-08T06:06:01.105 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 05:50 2662 2024-05-08T06:06:01.105 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 8 05:50 2663 2024-05-08T06:06:01.105 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2664 2024-05-08T06:06:01.105 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2665 2024-05-08T06:06:01.105 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2666 2024-05-08T06:06:01.105 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2667 2024-05-08T06:06:01.105 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2668 2024-05-08T06:06:01.105 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2669 2024-05-08T06:06:01.105 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2670 2024-05-08T06:06:01.105 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 May 8 05:50 2673 2024-05-08T06:06:01.105 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 May 8 05:50 2674 2024-05-08T06:06:01.105 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 May 8 05:50 2675 2024-05-08T06:06:01.105 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2678 2024-05-08T06:06:01.105 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2679 2024-05-08T06:06:01.106 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2680 2024-05-08T06:06:01.106 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2681 2024-05-08T06:06:01.106 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2682 2024-05-08T06:06:01.106 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2683 2024-05-08T06:06:01.106 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2684 2024-05-08T06:06:01.106 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2685 2024-05-08T06:06:01.106 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2686 2024-05-08T06:06:01.106 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2687 2024-05-08T06:06:01.106 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 8 05:50 2688 2024-05-08T06:06:01.106 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 8 05:50 2689 2024-05-08T06:06:01.106 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 May 8 05:50 2690 2024-05-08T06:06:01.106 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 May 8 05:50 2691 2024-05-08T06:06:01.106 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2692 2024-05-08T06:06:01.106 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2693 2024-05-08T06:06:01.106 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 05:53 2696 2024-05-08T06:06:01.107 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2699 2024-05-08T06:06:01.107 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2701 2024-05-08T06:06:01.107 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2702 2024-05-08T06:06:01.107 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 05:50 2703 2024-05-08T06:06:01.107 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 8 05:50 2704 2024-05-08T06:06:01.107 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2753 2024-05-08T06:06:01.107 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2753_fsm 2024-05-08T06:06:01.107 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2753_vm 2024-05-08T06:06:01.107 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2754 2024-05-08T06:06:01.107 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2755 2024-05-08T06:06:01.107 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 05:50 2756 2024-05-08T06:06:01.107 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 05:50 2757 2024-05-08T06:06:01.107 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2830 2024-05-08T06:06:01.107 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2831 2024-05-08T06:06:01.107 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2832 2024-05-08T06:06:01.107 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2833 2024-05-08T06:06:01.108 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2834 2024-05-08T06:06:01.108 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2835 2024-05-08T06:06:01.108 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2836 2024-05-08T06:06:01.108 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2837 2024-05-08T06:06:01.108 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 May 8 05:50 2838 2024-05-08T06:06:01.108 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2838_fsm 2024-05-08T06:06:01.108 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2838_vm 2024-05-08T06:06:01.108 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2839 2024-05-08T06:06:01.108 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2840 2024-05-08T06:06:01.108 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2840_fsm 2024-05-08T06:06:01.108 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2840_vm 2024-05-08T06:06:01.108 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2841 2024-05-08T06:06:01.108 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2995 2024-05-08T06:06:01.108 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2996 2024-05-08T06:06:01.108 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3079 2024-05-08T06:06:01.108 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3079_fsm 2024-05-08T06:06:01.108 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3079_vm 2024-05-08T06:06:01.109 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3080 2024-05-08T06:06:01.109 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3081 2024-05-08T06:06:01.109 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 8 05:50 3085 2024-05-08T06:06:01.109 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3118 2024-05-08T06:06:01.109 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3119 2024-05-08T06:06:01.109 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 May 8 05:50 3164 2024-05-08T06:06:01.109 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3256 2024-05-08T06:06:01.109 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3257 2024-05-08T06:06:01.109 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3258 2024-05-08T06:06:01.109 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3350 2024-05-08T06:06:01.109 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3351 2024-05-08T06:06:01.109 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3379 2024-05-08T06:06:01.109 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3380 2024-05-08T06:06:01.109 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3381 2024-05-08T06:06:01.109 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3394 2024-05-08T06:06:01.110 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3394_fsm 2024-05-08T06:06:01.110 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3394_vm 2024-05-08T06:06:01.110 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3395 2024-05-08T06:06:01.110 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3429 2024-05-08T06:06:01.110 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3430 2024-05-08T06:06:01.110 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3431 2024-05-08T06:06:01.110 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3433 2024-05-08T06:06:01.110 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3439 2024-05-08T06:06:01.110 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3440 2024-05-08T06:06:01.110 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 8 05:50 3455 2024-05-08T06:06:01.110 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 May 8 05:50 3456 2024-05-08T06:06:01.110 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3456_fsm 2024-05-08T06:06:01.110 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3456_vm 2024-05-08T06:06:01.110 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3466 2024-05-08T06:06:01.110 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3467 2024-05-08T06:06:01.111 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3468 2024-05-08T06:06:01.111 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3501 2024-05-08T06:06:01.111 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3502 2024-05-08T06:06:01.111 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3503 2024-05-08T06:06:01.111 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3534 2024-05-08T06:06:01.111 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3541 2024-05-08T06:06:01.111 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3541_fsm 2024-05-08T06:06:01.111 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3541_vm 2024-05-08T06:06:01.111 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3542 2024-05-08T06:06:01.111 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3574 2024-05-08T06:06:01.111 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3575 2024-05-08T06:06:01.111 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3576 2024-05-08T06:06:01.111 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3596 2024-05-08T06:06:01.111 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3597 2024-05-08T06:06:01.111 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3598 2024-05-08T06:06:01.112 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3599 2024-05-08T06:06:01.112 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3600 2024-05-08T06:06:01.112 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3600_fsm 2024-05-08T06:06:01.112 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3600_vm 2024-05-08T06:06:01.112 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3601 2024-05-08T06:06:01.112 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3601_fsm 2024-05-08T06:06:01.112 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3601_vm 2024-05-08T06:06:01.112 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3602 2024-05-08T06:06:01.112 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3602_fsm 2024-05-08T06:06:01.112 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3602_vm 2024-05-08T06:06:01.112 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3603 2024-05-08T06:06:01.112 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3603_fsm 2024-05-08T06:06:01.112 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3603_vm 2024-05-08T06:06:01.112 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3604 2024-05-08T06:06:01.112 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3605 2024-05-08T06:06:01.112 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3606 2024-05-08T06:06:01.113 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3607 2024-05-08T06:06:01.113 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3608 2024-05-08T06:06:01.113 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 8 05:50 3609 2024-05-08T06:06:01.113 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3712 2024-05-08T06:06:01.113 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3764 2024-05-08T06:06:01.113 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 3764_fsm 2024-05-08T06:06:01.113 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3764_vm 2024-05-08T06:06:01.113 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3766 2024-05-08T06:06:01.113 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 3767 2024-05-08T06:06:01.113 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3997 2024-05-08T06:06:01.113 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4143 2024-05-08T06:06:01.113 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4144 2024-05-08T06:06:01.113 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4145 2024-05-08T06:06:01.113 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4146 2024-05-08T06:06:01.113 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4147 2024-05-08T06:06:01.113 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4148 2024-05-08T06:06:01.113 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4149 2024-05-08T06:06:01.114 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4150 2024-05-08T06:06:01.114 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4151 2024-05-08T06:06:01.114 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4152 2024-05-08T06:06:01.114 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4153 2024-05-08T06:06:01.114 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4154 2024-05-08T06:06:01.114 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4155 2024-05-08T06:06:01.114 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4156 2024-05-08T06:06:01.114 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4157 2024-05-08T06:06:01.114 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4158 2024-05-08T06:06:01.114 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4159 2024-05-08T06:06:01.115 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4160 2024-05-08T06:06:01.115 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4161 2024-05-08T06:06:01.115 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4162 2024-05-08T06:06:01.115 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4163 2024-05-08T06:06:01.115 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4164 2024-05-08T06:06:01.115 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4165 2024-05-08T06:06:01.115 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4166 2024-05-08T06:06:01.115 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4167 2024-05-08T06:06:01.115 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4168 2024-05-08T06:06:01.115 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4169 2024-05-08T06:06:01.116 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4170 2024-05-08T06:06:01.116 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4171 2024-05-08T06:06:01.116 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4172 2024-05-08T06:06:01.116 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4173 2024-05-08T06:06:01.116 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4174 2024-05-08T06:06:01.116 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 5002 2024-05-08T06:06:01.116 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 548 2024-05-08T06:06:01.116 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 549 2024-05-08T06:06:01.116 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 6102 2024-05-08T06:06:01.116 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 6104 2024-05-08T06:06:01.116 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 6106 2024-05-08T06:06:01.116 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 6110 2024-05-08T06:06:01.116 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 6111 2024-05-08T06:06:01.116 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 6112 2024-05-08T06:06:01.117 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 6113 2024-05-08T06:06:01.117 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 6117 2024-05-08T06:06:01.117 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 826 2024-05-08T06:06:01.117 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 827 2024-05-08T06:06:01.117 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 828 2024-05-08T06:06:01.117 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 May 8 05:50 pg_filenode.map 2024-05-08T06:06:01.117 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 151596 May 8 05:50 pg_internal.init 2024-05-08T06:06:01.117 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 8 05:50 PG_VERSION 2024-05-08T06:06:01.117 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T06:06:01.117 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/base/pgsql_tmp: 2024-05-08T06:06:01.117 INFO:teuthology.orchestra.run.smithi082.stdout:total 0 2024-05-08T06:06:01.117 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 . 2024-05-08T06:06:01.117 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 4 May 8 05:50 .. 2024-05-08T06:06:01.117 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T06:06:01.117 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/global: 2024-05-08T06:06:01.118 INFO:teuthology.orchestra.run.smithi082.stdout:total 560 2024-05-08T06:06:01.118 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 58 May 8 05:50 . 2024-05-08T06:06:01.118 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 May 8 06:06 .. 2024-05-08T06:06:01.118 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 1213 2024-05-08T06:06:01.118 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 1213_fsm 2024-05-08T06:06:01.118 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 1213_vm 2024-05-08T06:06:01.118 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 1214 2024-05-08T06:06:01.118 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 1214_fsm 2024-05-08T06:06:01.118 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 1214_vm 2024-05-08T06:06:01.118 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 1232 2024-05-08T06:06:01.118 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 1233 2024-05-08T06:06:01.118 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 1260 2024-05-08T06:06:01.119 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 1260_fsm 2024-05-08T06:06:01.119 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 1260_vm 2024-05-08T06:06:01.119 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 1261 2024-05-08T06:06:01.119 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 1261_fsm 2024-05-08T06:06:01.119 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 1261_vm 2024-05-08T06:06:01.119 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 1262 2024-05-08T06:06:01.119 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 1262_fsm 2024-05-08T06:06:01.119 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 1262_vm 2024-05-08T06:06:01.119 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2396 2024-05-08T06:06:01.119 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 8 05:50 2396_fsm 2024-05-08T06:06:01.119 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2396_vm 2024-05-08T06:06:01.119 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2397 2024-05-08T06:06:01.119 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2671 2024-05-08T06:06:01.119 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2672 2024-05-08T06:06:01.120 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2676 2024-05-08T06:06:01.120 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2677 2024-05-08T06:06:01.120 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2694 2024-05-08T06:06:01.120 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2695 2024-05-08T06:06:01.120 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2697 2024-05-08T06:06:01.120 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 8 05:50 2698 2024-05-08T06:06:01.120 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2846 2024-05-08T06:06:01.120 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2847 2024-05-08T06:06:01.120 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2964 2024-05-08T06:06:01.120 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2965 2024-05-08T06:06:01.120 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 2966 2024-05-08T06:06:01.120 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 2967 2024-05-08T06:06:01.121 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 3592 2024-05-08T06:06:01.121 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 3593 2024-05-08T06:06:01.121 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4060 2024-05-08T06:06:01.121 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4061 2024-05-08T06:06:01.121 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4175 2024-05-08T06:06:01.121 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4176 2024-05-08T06:06:01.121 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4177 2024-05-08T06:06:01.121 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4178 2024-05-08T06:06:01.121 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4181 2024-05-08T06:06:01.121 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4182 2024-05-08T06:06:01.121 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4183 2024-05-08T06:06:01.121 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4184 2024-05-08T06:06:01.121 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 4185 2024-05-08T06:06:01.121 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 4186 2024-05-08T06:06:01.121 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 6000 2024-05-08T06:06:01.122 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 6001 2024-05-08T06:06:01.122 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 6002 2024-05-08T06:06:01.122 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 6100 2024-05-08T06:06:01.122 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 6114 2024-05-08T06:06:01.122 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 6115 2024-05-08T06:06:01.122 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 06:05 pg_control 2024-05-08T06:06:01.122 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 May 8 05:50 pg_filenode.map 2024-05-08T06:06:01.122 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 23144 May 8 05:50 pg_internal.init 2024-05-08T06:06:01.122 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T06:06:01.122 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/log: 2024-05-08T06:06:01.122 INFO:teuthology.orchestra.run.smithi082.stdout:total 2 2024-05-08T06:06:01.122 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 8 05:50 . 2024-05-08T06:06:01.122 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 May 8 06:06 .. 2024-05-08T06:06:01.122 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1118 May 8 06:06 postgresql-Wed.log 2024-05-08T06:06:01.123 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T06:06:01.123 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2024-05-08T06:06:01.123 INFO:teuthology.orchestra.run.smithi082.stdout:total 0 2024-05-08T06:06:01.123 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 . 2024-05-08T06:06:01.123 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 May 8 06:06 .. 2024-05-08T06:06:01.123 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T06:06:01.123 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2024-05-08T06:06:01.123 INFO:teuthology.orchestra.run.smithi082.stdout:total 0 2024-05-08T06:06:01.123 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 . 2024-05-08T06:06:01.123 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 May 8 06:06 .. 2024-05-08T06:06:01.123 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T06:06:01.123 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_logical: 2024-05-08T06:06:01.123 INFO:teuthology.orchestra.run.smithi082.stdout:total 1 2024-05-08T06:06:01.123 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 8 06:05 . 2024-05-08T06:06:01.124 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 May 8 06:06 .. 2024-05-08T06:06:01.124 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 mappings 2024-05-08T06:06:01.124 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 May 8 06:05 replorigin_checkpoint 2024-05-08T06:06:01.124 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 snapshots 2024-05-08T06:06:01.124 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T06:06:01.124 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2024-05-08T06:06:01.124 INFO:teuthology.orchestra.run.smithi082.stdout:total 0 2024-05-08T06:06:01.124 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 . 2024-05-08T06:06:01.124 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 8 06:05 .. 2024-05-08T06:06:01.124 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T06:06:01.124 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2024-05-08T06:06:01.124 INFO:teuthology.orchestra.run.smithi082.stdout:total 0 2024-05-08T06:06:01.124 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 . 2024-05-08T06:06:01.125 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 8 06:05 .. 2024-05-08T06:06:01.125 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T06:06:01.125 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2024-05-08T06:06:01.125 INFO:teuthology.orchestra.run.smithi082.stdout:total 0 2024-05-08T06:06:01.125 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 May 8 05:50 . 2024-05-08T06:06:01.125 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 May 8 06:06 .. 2024-05-08T06:06:01.125 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 8 05:50 members 2024-05-08T06:06:01.125 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 8 05:50 offsets 2024-05-08T06:06:01.125 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T06:06:01.125 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2024-05-08T06:06:01.125 INFO:teuthology.orchestra.run.smithi082.stdout:total 8 2024-05-08T06:06:01.125 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 8 05:50 . 2024-05-08T06:06:01.125 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 May 8 05:50 .. 2024-05-08T06:06:01.125 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:50 0000 2024-05-08T06:06:01.125 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T06:06:01.126 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2024-05-08T06:06:01.126 INFO:teuthology.orchestra.run.smithi082.stdout:total 8 2024-05-08T06:06:01.126 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 8 05:50 . 2024-05-08T06:06:01.126 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 2 May 8 05:50 .. 2024-05-08T06:06:01.126 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 8 05:54 0000 2024-05-08T06:06:01.126 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T06:06:01.126 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_notify: 2024-05-08T06:06:01.126 INFO:teuthology.orchestra.run.smithi082.stdout:total 0 2024-05-08T06:06:01.126 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 . 2024-05-08T06:06:01.126 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 May 8 06:06 .. 2024-05-08T06:06:01.126 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T06:06:01.126 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2024-05-08T06:06:01.126 INFO:teuthology.orchestra.run.smithi082.stdout:total 0 2024-05-08T06:06:01.127 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 . 2024-05-08T06:06:01.127 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 May 8 06:06 .. 2024-05-08T06:06:01.127 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T06:06:01.127 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_serial: 2024-05-08T06:06:01.127 INFO:teuthology.orchestra.run.smithi082.stdout:total 0 2024-05-08T06:06:01.127 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 . 2024-05-08T06:06:01.127 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 May 8 06:06 .. 2024-05-08T06:06:01.127 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T06:06:01.127 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2024-05-08T06:06:01.127 INFO:teuthology.orchestra.run.smithi082.stdout:total 0 2024-05-08T06:06:01.127 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 . 2024-05-08T06:06:01.127 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 May 8 06:06 .. 2024-05-08T06:06:01.127 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T06:06:01.127 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_stat: 2024-05-08T06:06:01.127 INFO:teuthology.orchestra.run.smithi082.stdout:total 15 2024-05-08T06:06:01.127 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 8 06:06 . 2024-05-08T06:06:01.128 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 May 8 06:06 .. 2024-05-08T06:06:01.128 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1952 May 8 06:06 db_0.stat 2024-05-08T06:06:01.128 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 10979 May 8 06:06 db_13494.stat 2024-05-08T06:06:01.128 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1151 May 8 06:06 global.stat 2024-05-08T06:06:01.128 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T06:06:01.128 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2024-05-08T06:06:01.128 INFO:teuthology.orchestra.run.smithi082.stdout:total 0 2024-05-08T06:06:01.128 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 06:06 . 2024-05-08T06:06:01.128 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 May 8 06:06 .. 2024-05-08T06:06:01.128 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T06:06:01.128 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2024-05-08T06:06:01.128 INFO:teuthology.orchestra.run.smithi082.stdout:total 224 2024-05-08T06:06:01.128 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1 May 8 06:06 . 2024-05-08T06:06:01.128 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 May 8 06:06 .. 2024-05-08T06:06:01.128 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 229376 May 8 06:05 001B 2024-05-08T06:06:01.129 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T06:06:01.129 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2024-05-08T06:06:01.129 INFO:teuthology.orchestra.run.smithi082.stdout:total 0 2024-05-08T06:06:01.129 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 . 2024-05-08T06:06:01.129 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 May 8 06:06 .. 2024-05-08T06:06:01.129 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T06:06:01.129 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2024-05-08T06:06:01.129 INFO:teuthology.orchestra.run.smithi082.stdout:total 0 2024-05-08T06:06:01.129 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 . 2024-05-08T06:06:01.129 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 May 8 06:06 .. 2024-05-08T06:06:01.129 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T06:06:01.129 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_wal: 2024-05-08T06:06:01.129 INFO:teuthology.orchestra.run.smithi082.stdout:total 1048576 2024-05-08T06:06:01.129 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 65 May 8 06:06 . 2024-05-08T06:06:01.129 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 May 8 06:06 .. 2024-05-08T06:06:01.129 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 06:05 0000000100000000000000A0 2024-05-08T06:06:01.130 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 05:58 0000000100000000000000A1 2024-05-08T06:06:01.130 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 05:58 0000000100000000000000A2 2024-05-08T06:06:01.130 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 06:02 0000000100000000000000A3 2024-05-08T06:06:01.130 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 05:58 0000000100000000000000A4 2024-05-08T06:06:01.130 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 05:59 0000000100000000000000A5 2024-05-08T06:06:01.130 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 05:58 0000000100000000000000A6 2024-05-08T06:06:01.130 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 05:58 0000000100000000000000A7 2024-05-08T06:06:01.130 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 05:58 0000000100000000000000A8 2024-05-08T06:06:01.130 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 05:58 0000000100000000000000A9 2024-05-08T06:06:01.130 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 05:58 0000000100000000000000AA 2024-05-08T06:06:01.130 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 05:59 0000000100000000000000AB 2024-05-08T06:06:01.130 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 05:59 0000000100000000000000AC 2024-05-08T06:06:01.130 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 05:58 0000000100000000000000AD 2024-05-08T06:06:01.130 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 05:58 0000000100000000000000AE 2024-05-08T06:06:01.130 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 06:03 0000000100000000000000AF 2024-05-08T06:06:01.131 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 05:58 0000000100000000000000B0 2024-05-08T06:06:01.131 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 05:58 0000000100000000000000B1 2024-05-08T06:06:01.131 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 05:58 0000000100000000000000B2 2024-05-08T06:06:01.131 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 05:58 0000000100000000000000B3 2024-05-08T06:06:01.131 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 05:59 0000000100000000000000B4 2024-05-08T06:06:01.131 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 05:58 0000000100000000000000B5 2024-05-08T06:06:01.131 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 05:58 0000000100000000000000B6 2024-05-08T06:06:01.131 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 05:59 0000000100000000000000B7 2024-05-08T06:06:01.131 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 05:58 0000000100000000000000B8 2024-05-08T06:06:01.131 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 06:01 0000000100000000000000B9 2024-05-08T06:06:01.131 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 05:59 0000000100000000000000BA 2024-05-08T06:06:01.131 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 06:02 0000000100000000000000BB 2024-05-08T06:06:01.131 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 06:01 0000000100000000000000BC 2024-05-08T06:06:01.131 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 06:00 0000000100000000000000BD 2024-05-08T06:06:01.131 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 05:58 0000000100000000000000BE 2024-05-08T06:06:01.131 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 06:03 0000000100000000000000BF 2024-05-08T06:06:01.131 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 06:03 0000000100000000000000C0 2024-05-08T06:06:01.132 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 06:03 0000000100000000000000C1 2024-05-08T06:06:01.132 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 06:05 0000000100000000000000C2 2024-05-08T06:06:01.132 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 06:03 0000000100000000000000C3 2024-05-08T06:06:01.132 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 06:04 0000000100000000000000C4 2024-05-08T06:06:01.132 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 06:04 0000000100000000000000C5 2024-05-08T06:06:01.132 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 06:03 0000000100000000000000C6 2024-05-08T06:06:01.132 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 06:03 0000000100000000000000C7 2024-05-08T06:06:01.132 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 06:04 0000000100000000000000C8 2024-05-08T06:06:01.132 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 06:03 0000000100000000000000C9 2024-05-08T06:06:01.132 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 06:03 0000000100000000000000CA 2024-05-08T06:06:01.132 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 06:03 0000000100000000000000CB 2024-05-08T06:06:01.132 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 06:05 0000000100000000000000CC 2024-05-08T06:06:01.132 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 06:03 0000000100000000000000CD 2024-05-08T06:06:01.132 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 06:04 0000000100000000000000CE 2024-05-08T06:06:01.132 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 06:03 0000000100000000000000CF 2024-05-08T06:06:01.133 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 06:04 0000000100000000000000D0 2024-05-08T06:06:01.133 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 06:04 0000000100000000000000D1 2024-05-08T06:06:01.133 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 06:05 0000000100000000000000D2 2024-05-08T06:06:01.133 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 06:03 0000000100000000000000D3 2024-05-08T06:06:01.134 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 06:03 0000000100000000000000D4 2024-05-08T06:06:01.134 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 06:03 0000000100000000000000D5 2024-05-08T06:06:01.134 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 06:03 0000000100000000000000D6 2024-05-08T06:06:01.134 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 06:03 0000000100000000000000D7 2024-05-08T06:06:01.134 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 06:03 0000000100000000000000D8 2024-05-08T06:06:01.134 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 06:04 0000000100000000000000D9 2024-05-08T06:06:01.134 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 06:03 0000000100000000000000DA 2024-05-08T06:06:01.134 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 06:04 0000000100000000000000DB 2024-05-08T06:06:01.134 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 06:03 0000000100000000000000DC 2024-05-08T06:06:01.134 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 06:03 0000000100000000000000DD 2024-05-08T06:06:01.134 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 06:03 0000000100000000000000DE 2024-05-08T06:06:01.134 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 8 06:03 0000000100000000000000DF 2024-05-08T06:06:01.134 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 archive_status 2024-05-08T06:06:01.134 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T06:06:01.135 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2024-05-08T06:06:01.135 INFO:teuthology.orchestra.run.smithi082.stdout:total 0 2024-05-08T06:06:01.135 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 8 05:50 . 2024-05-08T06:06:01.135 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 65 May 8 06:06 .. 2024-05-08T06:06:01.135 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T06:06:01.135 INFO:teuthology.orchestra.run.smithi082.stdout:/tmp/cephfs/postgres/data/pg_xact: 2024-05-08T06:06:01.135 INFO:teuthology.orchestra.run.smithi082.stdout:total 448 2024-05-08T06:06:01.135 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 2 May 8 05:58 . 2024-05-08T06:06:01.135 INFO:teuthology.orchestra.run.smithi082.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 25 May 8 06:06 .. 2024-05-08T06:06:01.135 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 262144 May 8 05:58 0000 2024-05-08T06:06:01.135 INFO:teuthology.orchestra.run.smithi082.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 May 8 06:05 0001 2024-05-08T06:06:01.135 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-05-08T06:06:01.147 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-05-08T06:06:01.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:06:00 smithi082 ceph-mon[30098]: Adjusting osd_memory_target on smithi151 to 176.2M 2024-05-08T06:06:01.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:06:00 smithi082 ceph-mon[30098]: Unable to set osd_memory_target on smithi151 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-05-08T06:06:01.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:06:00 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:06:01.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:06:00 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:06:01.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:06:00 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T06:06:01.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:06:00 smithi134 ceph-mon[34132]: Adjusting osd_memory_target on smithi151 to 176.2M 2024-05-08T06:06:01.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:06:00 smithi134 ceph-mon[34132]: Unable to set osd_memory_target on smithi151 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-05-08T06:06:01.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:06:00 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:06:01.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:06:00 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:06:01.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:06:00 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T06:06:01.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:06:00 smithi151 ceph-mon[34815]: Adjusting osd_memory_target on smithi151 to 176.2M 2024-05-08T06:06:01.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:06:00 smithi151 ceph-mon[34815]: Unable to set osd_memory_target on smithi151 to 184788172: error parsing value: Value '184788172' is below minimum 939524096 2024-05-08T06:06:01.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:06:00 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:06:01.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:06:00 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:06:01.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:06:00 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T06:06:02.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:06:02 smithi151 ceph-mon[34815]: pgmap v920: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 17 MiB/s wr, 1.42k op/s 2024-05-08T06:06:02.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:06:02 smithi082 ceph-mon[30098]: pgmap v920: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 17 MiB/s wr, 1.42k op/s 2024-05-08T06:06:02.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:06:02 smithi134 ceph-mon[34132]: pgmap v920: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 17 MiB/s wr, 1.42k op/s 2024-05-08T06:06:04.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:06:04 smithi151 ceph-mon[34815]: pgmap v921: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 24 MiB/s wr, 1.87k op/s 2024-05-08T06:06:04.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:06:04 smithi082 ceph-mon[30098]: pgmap v921: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 24 MiB/s wr, 1.87k op/s 2024-05-08T06:06:04.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:06:04 smithi134 ceph-mon[34132]: pgmap v921: 97 pgs: 97 active+clean; 1.6 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 24 MiB/s wr, 1.87k op/s 2024-05-08T06:06:06.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:06:06 smithi151 ceph-mon[34815]: pgmap v922: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 27 MiB/s wr, 1.96k op/s 2024-05-08T06:06:06.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:06:06 smithi082 ceph-mon[30098]: pgmap v922: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 27 MiB/s wr, 1.96k op/s 2024-05-08T06:06:06.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:06:06 smithi134 ceph-mon[34132]: pgmap v922: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 27 MiB/s wr, 1.96k op/s 2024-05-08T06:06:08.555 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:06:08 smithi082 ceph-mon[30098]: pgmap v923: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 26 MiB/s wr, 1.90k op/s 2024-05-08T06:06:08.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:06:08 smithi151 ceph-mon[34815]: pgmap v923: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 26 MiB/s wr, 1.90k op/s 2024-05-08T06:06:08.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:06:08 smithi134 ceph-mon[34132]: pgmap v923: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 26 MiB/s wr, 1.90k op/s 2024-05-08T06:06:10.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:06:10 smithi082 ceph-mon[30098]: pgmap v924: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 22 MiB/s wr, 1.49k op/s 2024-05-08T06:06:10.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:06:10 smithi151 ceph-mon[34815]: pgmap v924: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 22 MiB/s wr, 1.49k op/s 2024-05-08T06:06:10.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:06:10 smithi134 ceph-mon[34132]: pgmap v924: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 22 MiB/s wr, 1.49k op/s 2024-05-08T06:06:12.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:06:12 smithi151 ceph-mon[34815]: pgmap v925: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 21 MiB/s wr, 1.34k op/s 2024-05-08T06:06:12.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:06:12 smithi082 ceph-mon[30098]: pgmap v925: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 21 MiB/s wr, 1.34k op/s 2024-05-08T06:06:12.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:06:12 smithi134 ceph-mon[34132]: pgmap v925: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 21 MiB/s wr, 1.34k op/s 2024-05-08T06:06:14.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:06:14 smithi151 ceph-mon[34815]: pgmap v926: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 12 MiB/s wr, 784 op/s 2024-05-08T06:06:14.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:06:14 smithi082 ceph-mon[30098]: pgmap v926: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 12 MiB/s wr, 784 op/s 2024-05-08T06:06:14.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:06:14 smithi134 ceph-mon[34132]: pgmap v926: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 12 MiB/s wr, 784 op/s 2024-05-08T06:06:16.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:06:16 smithi151 ceph-mon[34815]: pgmap v927: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 3.1 MiB/s wr, 213 op/s 2024-05-08T06:06:16.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:06:16 smithi082 ceph-mon[30098]: pgmap v927: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 3.1 MiB/s wr, 213 op/s 2024-05-08T06:06:16.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:06:16 smithi134 ceph-mon[34132]: pgmap v927: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 3.1 MiB/s wr, 213 op/s 2024-05-08T06:06:18.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:06:18 smithi151 ceph-mon[34815]: pgmap v928: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 28 KiB/s wr, 18 op/s 2024-05-08T06:06:18.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:06:18 smithi082 ceph-mon[30098]: pgmap v928: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 28 KiB/s wr, 18 op/s 2024-05-08T06:06:18.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:06:18 smithi134 ceph-mon[34132]: pgmap v928: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 28 KiB/s wr, 18 op/s 2024-05-08T06:06:19.475 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-08T06:06:19.934 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:06:20.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:06:20 smithi082 ceph-mon[30098]: pgmap v929: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 16 KiB/s wr, 14 op/s 2024-05-08T06:06:20.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:06:20 smithi151 ceph-mon[34815]: pgmap v929: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 16 KiB/s wr, 14 op/s 2024-05-08T06:06:20.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:06:20 smithi134 ceph-mon[34132]: pgmap v929: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 16 KiB/s wr, 14 op/s 2024-05-08T06:06:22.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.222+0000 7efc97200700 1 -- 172.21.15.82:0/1171670991 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efc98102160 msgr2=0x7efc9810f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:22.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.222+0000 7efc97200700 1 --2- 172.21.15.82:0/1171670991 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efc98102160 0x7efc9810f840 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7efc840098f0 tx=0x7efc84009c00 comp rx=0 tx=0).stop 2024-05-08T06:06:22.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.222+0000 7efc97200700 1 -- 172.21.15.82:0/1171670991 shutdown_connections 2024-05-08T06:06:22.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.222+0000 7efc97200700 1 --2- 172.21.15.82:0/1171670991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc98101840 0x7efc98101c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:22.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.222+0000 7efc97200700 1 --2- 172.21.15.82:0/1171670991 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc9810fd80 0x7efc98112170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:22.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.222+0000 7efc97200700 1 --2- 172.21.15.82:0/1171670991 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efc98102160 0x7efc9810f840 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:22.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.222+0000 7efc97200700 1 -- 172.21.15.82:0/1171670991 >> 172.21.15.82:0/1171670991 conn(0x7efc98077140 msgr2=0x7efc98077550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:06:22.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.222+0000 7efc97200700 1 -- 172.21.15.82:0/1171670991 shutdown_connections 2024-05-08T06:06:22.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.222+0000 7efc97200700 1 -- 172.21.15.82:0/1171670991 wait complete. 2024-05-08T06:06:22.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.223+0000 7efc97200700 1 Processor -- start 2024-05-08T06:06:22.224 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.223+0000 7efc97200700 1 -- start start 2024-05-08T06:06:22.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.224+0000 7efc97200700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efc98101840 0x7efc981a18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:22.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.224+0000 7efc97200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc98102160 0x7efc981a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:22.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.224+0000 7efc97200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc9810fd80 0x7efc9819baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:22.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.224+0000 7efc97200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efc981157d0 con 0x7efc98102160 2024-05-08T06:06:22.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.224+0000 7efc97200700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7efc98115650 con 0x7efc9810fd80 2024-05-08T06:06:22.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.224+0000 7efc97200700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7efc98115950 con 0x7efc98101840 2024-05-08T06:06:22.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.224+0000 7efc95400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc98102160 0x7efc981a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:22.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.224+0000 7efc95400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc98102160 0x7efc981a1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50642/0 (socket says 172.21.15.82:50642) 2024-05-08T06:06:22.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.224+0000 7efc95400700 1 -- 172.21.15.82:0/1800148983 learned_addr learned my addr 172.21.15.82:0/1800148983 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:06:22.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.224+0000 7efc95e00700 1 --2- 172.21.15.82:0/1800148983 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efc98101840 0x7efc981a18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:22.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.224+0000 7efc96800700 1 --2- 172.21.15.82:0/1800148983 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc9810fd80 0x7efc9819baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:22.226 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.225+0000 7efc95400700 1 -- 172.21.15.82:0/1800148983 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efc98101840 msgr2=0x7efc981a18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:22.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.225+0000 7efc95400700 1 --2- 172.21.15.82:0/1800148983 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efc98101840 0x7efc981a18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:22.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.225+0000 7efc95400700 1 -- 172.21.15.82:0/1800148983 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc9810fd80 msgr2=0x7efc9819baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:22.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.225+0000 7efc95400700 1 --2- 172.21.15.82:0/1800148983 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc9810fd80 0x7efc9819baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:22.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.225+0000 7efc95400700 1 -- 172.21.15.82:0/1800148983 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc9819c250 con 0x7efc98102160 2024-05-08T06:06:22.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.225+0000 7efc95400700 1 --2- 172.21.15.82:0/1800148983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc98102160 0x7efc981a1e20 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7efc84009230 tx=0x7efc8400fa70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:06:22.227 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.225+0000 7efc8ea00700 1 -- 172.21.15.82:0/1800148983 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc840050c0 con 0x7efc98102160 2024-05-08T06:06:22.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.226+0000 7efc8ea00700 1 -- 172.21.15.82:0/1800148983 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc8400b560 con 0x7efc98102160 2024-05-08T06:06:22.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.226+0000 7efc8ea00700 1 -- 172.21.15.82:0/1800148983 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc84003a00 con 0x7efc98102160 2024-05-08T06:06:22.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.226+0000 7efc97200700 1 -- 172.21.15.82:0/1800148983 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc9819c4e0 con 0x7efc98102160 2024-05-08T06:06:22.228 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.226+0000 7efc97200700 1 -- 172.21.15.82:0/1800148983 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc981a87b0 con 0x7efc98102160 2024-05-08T06:06:22.230 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.229+0000 7efc8ea00700 1 -- 172.21.15.82:0/1800148983 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7efc8400b710 con 0x7efc98102160 2024-05-08T06:06:22.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.231+0000 7efca7ba6b80 1 Processor -- start 2024-05-08T06:06:22.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.231+0000 7efc8ea00700 1 --2- 172.21.15.82:0/1800148983 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7efc7c0b2900 0x7efc7c0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:22.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.231+0000 7efca7ba6b80 1 -- start start 2024-05-08T06:06:22.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.231+0000 7efc8ea00700 1 -- 172.21.15.82:0/1800148983 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7efc840e30b0 con 0x7efc98102160 2024-05-08T06:06:22.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.231+0000 7efc96800700 1 --2- 172.21.15.82:0/1800148983 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7efc7c0b2900 0x7efc7c0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:22.232 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.231+0000 7efca7ba6b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a47ba6da0 0x563a47ba7180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:22.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.231+0000 7efca7ba6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a47ba76c0 0x563a47ba1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:22.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.231+0000 7efca7ba6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563a47ba1a50 0x563a47ba1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:22.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.231+0000 7efca7ba6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x563a47af3a20 con 0x563a47ba76c0 2024-05-08T06:06:22.233 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.231+0000 7efca7ba6b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x563a47a91760 con 0x563a47ba6da0 2024-05-08T06:06:22.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.231+0000 7efca7ba6b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x563a47aef9e0 con 0x563a47ba1a50 2024-05-08T06:06:22.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.232+0000 7efc95400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a47ba76c0 0x563a47ba1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:22.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.232+0000 7efc95e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a47ba6da0 0x563a47ba7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:22.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.232+0000 7efc95e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a47ba6da0 0x563a47ba7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:54570/0 (socket says 172.21.15.82:54570) 2024-05-08T06:06:22.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.232+0000 7efc95400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a47ba76c0 0x563a47ba1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50656/0 (socket says 172.21.15.82:50656) 2024-05-08T06:06:22.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.232+0000 7efc95e00700 1 -- 172.21.15.82:0/353810794 learned_addr learned my addr 172.21.15.82:0/353810794 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:06:22.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.232+0000 7efc96800700 1 --2- 172.21.15.82:0/353810794 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563a47ba1a50 0x563a47ba1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:22.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.232+0000 7efc96800700 1 --2- 172.21.15.82:0/1800148983 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7efc7c0b2900 0x7efc7c0b4dc0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7efc90009cd0 tx=0x7efc9000b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:06:22.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.233+0000 7efc96800700 1 -- 172.21.15.82:0/353810794 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a47ba6da0 msgr2=0x563a47ba7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:06:22.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.233+0000 7efc96800700 1 --2- 172.21.15.82:0/353810794 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a47ba6da0 0x563a47ba7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:22.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.233+0000 7efc96800700 1 -- 172.21.15.82:0/353810794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a47ba76c0 msgr2=0x563a47ba1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:06:22.234 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.233+0000 7efc96800700 1 --2- 172.21.15.82:0/353810794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a47ba76c0 0x563a47ba1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:22.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.233+0000 7efc96800700 1 -- 172.21.15.82:0/353810794 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a47a408d0 con 0x563a47ba1a50 2024-05-08T06:06:22.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.233+0000 7efc95e00700 1 --2- 172.21.15.82:0/353810794 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a47ba6da0 0x563a47ba7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:06:22.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.233+0000 7efc95400700 1 --2- 172.21.15.82:0/353810794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a47ba76c0 0x563a47ba1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:06:22.235 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.233+0000 7efc96800700 1 --2- 172.21.15.82:0/353810794 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563a47ba1a50 0x563a47ba1ed0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7efc90009e60 tx=0x7efc9001c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae5ab95b531626fc server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:06:22.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.233+0000 7efc83400700 1 -- 172.21.15.82:0/353810794 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc90024070 con 0x563a47ba1a50 2024-05-08T06:06:22.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.233+0000 7efc83400700 1 -- 172.21.15.82:0/353810794 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc90017e50 con 0x563a47ba1a50 2024-05-08T06:06:22.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.233+0000 7efc83400700 1 -- 172.21.15.82:0/353810794 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc900209f0 con 0x563a47ba1a50 2024-05-08T06:06:22.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.234+0000 7efca7ba6b80 1 -- 172.21.15.82:0/353810794 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563a47ba1a50 msgr2=0x563a47ba1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:22.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.234+0000 7efca7ba6b80 1 --2- 172.21.15.82:0/353810794 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563a47ba1a50 0x563a47ba1ed0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7efc90009e60 tx=0x7efc9001c000 comp rx=0 tx=0).stop 2024-05-08T06:06:22.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.234+0000 7efca7ba6b80 1 -- 172.21.15.82:0/353810794 shutdown_connections 2024-05-08T06:06:22.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.234+0000 7efca7ba6b80 1 --2- 172.21.15.82:0/353810794 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a47ba6da0 0x563a47ba7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:22.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.234+0000 7efca7ba6b80 1 --2- 172.21.15.82:0/353810794 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563a47ba1a50 0x563a47ba1ed0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:22.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.234+0000 7efca7ba6b80 1 --2- 172.21.15.82:0/353810794 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a47ba76c0 0x563a47ba1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:22.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.234+0000 7efca7ba6b80 1 -- 172.21.15.82:0/353810794 >> 172.21.15.82:0/353810794 conn(0x563a47b196d0 msgr2=0x563a47b9bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:06:22.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.234+0000 7efca7ba6b80 1 -- 172.21.15.82:0/353810794 shutdown_connections 2024-05-08T06:06:22.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.234+0000 7efca7ba6b80 1 -- 172.21.15.82:0/353810794 wait complete. 2024-05-08T06:06:22.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.235+0000 7efca7ba6b80 1 -- start start 2024-05-08T06:06:22.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.235+0000 7efca7ba6b80 1 Processor -- start 2024-05-08T06:06:22.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.236+0000 7efca7ba6b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a47ba1a50 0x563a47bad3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:22.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.236+0000 7efca7ba6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563a47ba6da0 0x563a47baa780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:22.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.236+0000 7efca7ba6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a47ba76c0 0x563a47baacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:22.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.236+0000 7efca7ba6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x563a47bae150 con 0x563a47ba76c0 2024-05-08T06:06:22.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.236+0000 7efca7ba6b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x563a47a59b20 con 0x563a47ba1a50 2024-05-08T06:06:22.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.236+0000 7efca7ba6b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x563a47bae2d0 con 0x563a47ba6da0 2024-05-08T06:06:22.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.236+0000 7efca7ba6b80 10 client.0 _ll_register_callbacks cb 0x563a47a9ac70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:06:22.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.236+0000 7efc95400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563a47ba6da0 0x563a47baa780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:22.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.236+0000 7efc96800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a47ba76c0 0x563a47baacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:22.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.236+0000 7efc95400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563a47ba6da0 0x563a47baa780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:51682/0 (socket says 172.21.15.82:51682) 2024-05-08T06:06:22.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.236+0000 7efc95400700 1 -- 172.21.15.82:0/469061802 learned_addr learned my addr 172.21.15.82:0/469061802 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:06:22.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.236+0000 7efc95e00700 1 --2- 172.21.15.82:0/469061802 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a47ba1a50 0x563a47bad3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:22.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.236+0000 7efc96800700 1 -- 172.21.15.82:0/469061802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563a47ba6da0 msgr2=0x563a47baa780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:06:22.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.236+0000 7efc96800700 1 --2- 172.21.15.82:0/469061802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563a47ba6da0 0x563a47baa780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:22.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.237+0000 7efc96800700 1 -- 172.21.15.82:0/469061802 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a47ba1a50 msgr2=0x563a47bad3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:06:22.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.237+0000 7efc96800700 1 --2- 172.21.15.82:0/469061802 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a47ba1a50 0x563a47bad3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:22.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.237+0000 7efc96800700 1 -- 172.21.15.82:0/469061802 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a47ab9420 con 0x563a47ba76c0 2024-05-08T06:06:22.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.237+0000 7efc96800700 1 --2- 172.21.15.82:0/469061802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a47ba76c0 0x563a47baacc0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7efc90009a20 tx=0x7efc90021cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c52b8b76470a06e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:06:22.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.237+0000 7efc77e00700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T06:06:22.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.237+0000 7efc77e00700 1 -- 172.21.15.82:0/469061802 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc90024040 con 0x563a47ba76c0 2024-05-08T06:06:22.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.237+0000 7efc77e00700 1 -- 172.21.15.82:0/469061802 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7efc90003c00 con 0x563a47ba76c0 2024-05-08T06:06:22.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.237+0000 7efca7ba6b80 1 -- 172.21.15.82:0/469061802 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc90017e50 con 0x563a47ba76c0 2024-05-08T06:06:22.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.237+0000 7efc77e00700 1 -- 172.21.15.82:0/469061802 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7efc90003e20 con 0x563a47ba76c0 2024-05-08T06:06:22.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.237+0000 7efca7ba6b80 10 client.16365 fetch_fsmap learned FSMap version 31 2024-05-08T06:06:22.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.238+0000 7efca7ba6b80 1 -- 172.21.15.82:0/469061802 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x563a47bb89b0 con 0x563a47ba76c0 2024-05-08T06:06:22.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.238+0000 7efc77e00700 1 -- 172.21.15.82:0/469061802 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc90017e50 con 0x563a47ba76c0 2024-05-08T06:06:22.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.238+0000 7efc77e00700 1 -- 172.21.15.82:0/469061802 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7efc90034640 con 0x563a47ba76c0 2024-05-08T06:06:22.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.238+0000 7efca7ba6b80 10 client.16365 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:06:22.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.238+0000 7efca7ba6b80 10 client.16365 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T06:06:22.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.238+0000 7efca7ba6b80 20 client.16365 populate_metadata read hostname 'smithi082' 2024-05-08T06:06:22.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.238+0000 7efca7ba6b80 1 --2- 172.21.15.82:0/469061802 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x563a47bbae80 0x563a47bbd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:22.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.238+0000 7efca7ba6b80 4 client.16365 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:06:22.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.238+0000 7efca7ba6b80 1 -- 172.21.15.82:0/469061802 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563a47b6e140 con 0x563a47bbae80 2024-05-08T06:06:22.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.239+0000 7efc95e00700 1 --2- 172.21.15.82:0/469061802 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x563a47bbae80 0x563a47bbd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:22.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.239+0000 7efc95e00700 1 --2- 172.21.15.82:0/469061802 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x563a47bbae80 0x563a47bbd270 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df083bc02ef83c69 server_cookie=5a94755226f484dc in_seq=0 out_seq=0 2024-05-08T06:06:22.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.239+0000 7efc77e00700 10 client.16365 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T06:06:22.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.240+0000 7efc77e00700 1 -- 172.21.15.82:0/469061802 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x563a47b6e140 con 0x563a47bbae80 2024-05-08T06:06:22.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.240+0000 7efc77e00700 10 client.16365 handle_command_reply: tid=0 2024-05-08T06:06:22.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.240+0000 7efca7ba6b80 1 client.16365 shutdown 2024-05-08T06:06:22.242 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.240+0000 7efca7ba6b80 1 -- 172.21.15.82:0/469061802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a47ba76c0 msgr2=0x563a47baacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:22.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.240+0000 7efca7ba6b80 1 --2- 172.21.15.82:0/469061802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a47ba76c0 0x563a47baacc0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7efc90009a20 tx=0x7efc90021cb0 comp rx=0 tx=0).stop 2024-05-08T06:06:22.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.240+0000 7efca7ba6b80 1 -- 172.21.15.82:0/469061802 shutdown_connections 2024-05-08T06:06:22.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.240+0000 7efca7ba6b80 1 --2- 172.21.15.82:0/469061802 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x563a47bbae80 0x563a47bbd270 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:22.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.240+0000 7efc77e00700 0 client.16365 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T06:06:22.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.240+0000 7efca7ba6b80 1 --2- 172.21.15.82:0/469061802 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a47ba1a50 0x563a47bad3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:22.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.240+0000 7efca7ba6b80 1 --2- 172.21.15.82:0/469061802 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a47ba76c0 0x563a47baacc0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:22.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.240+0000 7efca7ba6b80 1 --2- 172.21.15.82:0/469061802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563a47ba6da0 0x563a47baa780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:22.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.240+0000 7efca7ba6b80 1 -- 172.21.15.82:0/469061802 >> 172.21.15.82:0/469061802 conn(0x563a47b196d0 msgr2=0x563a47b96750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:06:22.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.241+0000 7efca7ba6b80 1 -- 172.21.15.82:0/469061802 shutdown_connections 2024-05-08T06:06:22.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.241+0000 7efca7ba6b80 1 -- 172.21.15.82:0/469061802 wait complete. 2024-05-08T06:06:22.243 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.241+0000 7efca7ba6b80 20 client.16365 trim_cache size 0 max 16384 2024-05-08T06:06:22.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.262+0000 7efca7ba6b80 1 Processor -- start 2024-05-08T06:06:22.263 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.263+0000 7efca7ba6b80 1 -- start start 2024-05-08T06:06:22.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.263+0000 7efca7ba6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a47ba1a50 0x563a47ba1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:22.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.263+0000 7efca7ba6b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a47ba6da0 0x563a47bb71e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:22.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.263+0000 7efca7ba6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563a47ba76c0 0x563a47ba9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:22.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.263+0000 7efca7ba6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efc981afa30 con 0x563a47ba1a50 2024-05-08T06:06:22.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.263+0000 7efca7ba6b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7efc981b1570 con 0x563a47ba6da0 2024-05-08T06:06:22.264 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.263+0000 7efca7ba6b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7efc981b0100 con 0x563a47ba76c0 2024-05-08T06:06:22.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.263+0000 7efc95e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a47ba1a50 0x563a47ba1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:22.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.263+0000 7efc95400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a47ba6da0 0x563a47bb71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:22.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.264+0000 7efc95400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a47ba6da0 0x563a47bb71e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:54586/0 (socket says 172.21.15.82:54586) 2024-05-08T06:06:22.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.264+0000 7efc95400700 1 -- 172.21.15.82:0/1016918689 learned_addr learned my addr 172.21.15.82:0/1016918689 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:06:22.265 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.264+0000 7efc96800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563a47ba76c0 0x563a47ba9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:22.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.264+0000 7efc95e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a47ba1a50 0x563a47ba1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50664/0 (socket says 172.21.15.82:50664) 2024-05-08T06:06:22.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.264+0000 7efc95400700 1 -- 172.21.15.82:0/1016918689 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563a47ba76c0 msgr2=0x563a47ba9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:06:22.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.264+0000 7efc95400700 1 --2- 172.21.15.82:0/1016918689 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563a47ba76c0 0x563a47ba9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:22.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.264+0000 7efc95400700 1 -- 172.21.15.82:0/1016918689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a47ba1a50 msgr2=0x563a47ba1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:06:22.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.264+0000 7efc95400700 1 --2- 172.21.15.82:0/1016918689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a47ba1a50 0x563a47ba1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:22.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.264+0000 7efc95400700 1 -- 172.21.15.82:0/1016918689 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563a47ba8cf0 con 0x563a47ba6da0 2024-05-08T06:06:22.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.264+0000 7efc95e00700 1 --2- 172.21.15.82:0/1016918689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a47ba1a50 0x563a47ba1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:06:22.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.264+0000 7efc95400700 1 --2- 172.21.15.82:0/1016918689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a47ba6da0 0x563a47bb71e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7efc84009fd0 tx=0x7efc840cd040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a842d94058814648 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:06:22.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.265+0000 7efc82a00700 1 -- 172.21.15.82:0/1016918689 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc840c4020 con 0x563a47ba6da0 2024-05-08T06:06:22.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.265+0000 7efc82a00700 1 -- 172.21.15.82:0/1016918689 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc840aae10 con 0x563a47ba6da0 2024-05-08T06:06:22.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.265+0000 7efc82a00700 1 -- 172.21.15.82:0/1016918689 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc840920b0 con 0x563a47ba6da0 2024-05-08T06:06:22.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.265+0000 7efca7ba6b80 1 -- 172.21.15.82:0/1016918689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a47ba6da0 msgr2=0x563a47bb71e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:22.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.265+0000 7efca7ba6b80 1 --2- 172.21.15.82:0/1016918689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a47ba6da0 0x563a47bb71e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7efc84009fd0 tx=0x7efc840cd040 comp rx=0 tx=0).stop 2024-05-08T06:06:22.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.266+0000 7efca7ba6b80 1 -- 172.21.15.82:0/1016918689 shutdown_connections 2024-05-08T06:06:22.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.266+0000 7efca7ba6b80 1 --2- 172.21.15.82:0/1016918689 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563a47ba76c0 0x563a47ba9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:22.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.266+0000 7efca7ba6b80 1 --2- 172.21.15.82:0/1016918689 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a47ba1a50 0x563a47ba1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:22.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.266+0000 7efca7ba6b80 1 --2- 172.21.15.82:0/1016918689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a47ba6da0 0x563a47bb71e0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:22.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.266+0000 7efca7ba6b80 1 -- 172.21.15.82:0/1016918689 >> 172.21.15.82:0/1016918689 conn(0x563a47b196d0 msgr2=0x563a47babe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:06:22.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.266+0000 7efca7ba6b80 1 -- 172.21.15.82:0/1016918689 shutdown_connections 2024-05-08T06:06:22.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.266+0000 7efca7ba6b80 1 -- 172.21.15.82:0/1016918689 wait complete. 2024-05-08T06:06:22.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.266+0000 7efca7ba6b80 1 -- start start 2024-05-08T06:06:22.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.266+0000 7efca7ba6b80 1 Processor -- start 2024-05-08T06:06:22.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.267+0000 7efca7ba6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a47ba1a50 0x563a47bc2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:22.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.267+0000 7efca7ba6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563a47ba6da0 0x563a47bc25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:22.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.267+0000 7efca7ba6b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a47ba76c0 0x563a47bc2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:22.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.267+0000 7efca7ba6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efc981b0ea0 con 0x563a47ba1a50 2024-05-08T06:06:22.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.267+0000 7efca7ba6b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7efc981b07d0 con 0x563a47ba76c0 2024-05-08T06:06:22.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.267+0000 7efca7ba6b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7efc981ad9f0 con 0x563a47ba6da0 2024-05-08T06:06:22.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.267+0000 7efca7ba6b80 10 client.0 _ll_register_callbacks cb 0x563a47a9ac70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:06:22.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.267+0000 7efc95e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a47ba1a50 0x563a47bc2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:22.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.267+0000 7efc95e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a47ba1a50 0x563a47bc2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:50668/0 (socket says 172.21.15.82:50668) 2024-05-08T06:06:22.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.267+0000 7efc95e00700 1 -- 172.21.15.82:0/674129389 learned_addr learned my addr 172.21.15.82:0/674129389 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:06:22.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.267+0000 7efc96800700 1 --2- 172.21.15.82:0/674129389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a47ba76c0 0x563a47bc2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:22.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.267+0000 7efc95400700 1 --2- 172.21.15.82:0/674129389 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563a47ba6da0 0x563a47bc25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:22.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.268+0000 7efc95e00700 1 -- 172.21.15.82:0/674129389 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563a47ba6da0 msgr2=0x563a47bc25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:06:22.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.268+0000 7efc95e00700 1 --2- 172.21.15.82:0/674129389 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563a47ba6da0 0x563a47bc25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:22.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.268+0000 7efc95e00700 1 -- 172.21.15.82:0/674129389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a47ba76c0 msgr2=0x563a47bc2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:06:22.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.268+0000 7efc95e00700 1 --2- 172.21.15.82:0/674129389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a47ba76c0 0x563a47bc2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:22.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.268+0000 7efc95e00700 1 -- 172.21.15.82:0/674129389 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563a47c2cc50 con 0x563a47ba1a50 2024-05-08T06:06:22.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.268+0000 7efc95e00700 1 --2- 172.21.15.82:0/674129389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a47ba1a50 0x563a47bc2090 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x563a47bbd7e0 tx=0x7efc880108d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9662476e42f8973e server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:06:22.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.268+0000 7efc77e00700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T06:06:22.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.268+0000 7efc77e00700 1 -- 172.21.15.82:0/674129389 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc88020340 con 0x563a47ba1a50 2024-05-08T06:06:22.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.268+0000 7efc77e00700 1 -- 172.21.15.82:0/674129389 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7efc880204e0 con 0x563a47ba1a50 2024-05-08T06:06:22.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.268+0000 7efca7ba6b80 1 -- 172.21.15.82:0/674129389 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc840aae10 con 0x563a47ba1a50 2024-05-08T06:06:22.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.269+0000 7efc77e00700 1 -- 172.21.15.82:0/674129389 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7efc880206e0 con 0x563a47ba1a50 2024-05-08T06:06:22.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.269+0000 7efca7ba6b80 10 client.16371 fetch_fsmap learned FSMap version 31 2024-05-08T06:06:22.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.269+0000 7efca7ba6b80 1 -- 172.21.15.82:0/674129389 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x563a47c2dfc0 con 0x563a47ba1a50 2024-05-08T06:06:22.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.269+0000 7efc77e00700 1 -- 172.21.15.82:0/674129389 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efc840aae10 con 0x563a47ba1a50 2024-05-08T06:06:22.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.269+0000 7efc77e00700 1 -- 172.21.15.82:0/674129389 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7efc8801e390 con 0x563a47ba1a50 2024-05-08T06:06:22.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.269+0000 7efca7ba6b80 10 client.16371 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:06:22.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.269+0000 7efca7ba6b80 10 client.16371 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T06:06:22.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.269+0000 7efca7ba6b80 20 client.16371 populate_metadata read hostname 'smithi082' 2024-05-08T06:06:22.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.269+0000 7efca7ba6b80 1 --2- 172.21.15.82:0/674129389 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x563a47c2e680 0x563a47c30aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:22.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.269+0000 7efca7ba6b80 4 client.16371 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-08T06:06:22.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.269+0000 7efca7ba6b80 1 -- 172.21.15.82:0/674129389 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563a47b01400 con 0x563a47c2e680 2024-05-08T06:06:22.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.270+0000 7efc95400700 1 --2- 172.21.15.82:0/674129389 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x563a47c2e680 0x563a47c30aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:22.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.270+0000 7efc95400700 1 --2- 172.21.15.82:0/674129389 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x563a47c2e680 0x563a47c30aa0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f004f4266a620ef7 server_cookie=5a850d2e4035fe64 in_seq=0 out_seq=0 2024-05-08T06:06:22.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.270+0000 7efc77e00700 10 client.16371 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T06:06:22.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.270+0000 7efc77e00700 1 -- 172.21.15.82:0/674129389 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x563a47b01400 con 0x563a47c2e680 2024-05-08T06:06:22.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.270+0000 7efc77e00700 10 client.16371 handle_command_reply: tid=0 2024-05-08T06:06:22.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.270+0000 7efca7ba6b80 1 client.16371 shutdown 2024-05-08T06:06:22.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.271+0000 7efca7ba6b80 1 -- 172.21.15.82:0/674129389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a47ba1a50 msgr2=0x563a47bc2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:22.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.271+0000 7efca7ba6b80 1 --2- 172.21.15.82:0/674129389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a47ba1a50 0x563a47bc2090 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x563a47bbd7e0 tx=0x7efc880108d0 comp rx=0 tx=0).stop 2024-05-08T06:06:22.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.271+0000 7efca7ba6b80 1 -- 172.21.15.82:0/674129389 shutdown_connections 2024-05-08T06:06:22.273 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.271+0000 7efca7ba6b80 1 --2- 172.21.15.82:0/674129389 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x563a47c2e680 0x563a47c30aa0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:22.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.271+0000 7efca7ba6b80 1 --2- 172.21.15.82:0/674129389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563a47ba76c0 0x563a47bc2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:22.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.271+0000 7efca7ba6b80 1 --2- 172.21.15.82:0/674129389 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x563a47ba1a50 0x563a47bc2090 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:22.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.271+0000 7efca7ba6b80 1 --2- 172.21.15.82:0/674129389 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563a47ba6da0 0x563a47bc25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:22.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.271+0000 7efca7ba6b80 1 -- 172.21.15.82:0/674129389 >> 172.21.15.82:0/674129389 conn(0x563a47b196d0 msgr2=0x563a47ba9780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:06:22.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.271+0000 7efc77e00700 0 client.16371 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T06:06:22.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.271+0000 7efca7ba6b80 1 -- 172.21.15.82:0/674129389 shutdown_connections 2024-05-08T06:06:22.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.271+0000 7efca7ba6b80 1 -- 172.21.15.82:0/674129389 wait complete. 2024-05-08T06:06:22.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.271+0000 7efca7ba6b80 20 client.16371 trim_cache size 0 max 16384 2024-05-08T06:06:22.274 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T06:06:22.274 INFO:teuthology.orchestra.run.smithi082.stdout: "status": "no active scrubs running", 2024-05-08T06:06:22.275 INFO:teuthology.orchestra.run.smithi082.stdout: "scrubs": {} 2024-05-08T06:06:22.275 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T06:06:22.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.272+0000 7efc97200700 1 -- 172.21.15.82:0/1800148983 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7efc7c0b2900 msgr2=0x7efc7c0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:22.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.272+0000 7efc97200700 1 --2- 172.21.15.82:0/1800148983 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7efc7c0b2900 0x7efc7c0b4dc0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7efc90009cd0 tx=0x7efc9000b040 comp rx=0 tx=0).stop 2024-05-08T06:06:22.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.272+0000 7efc97200700 1 -- 172.21.15.82:0/1800148983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc98102160 msgr2=0x7efc981a1e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:22.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.272+0000 7efc97200700 1 --2- 172.21.15.82:0/1800148983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc98102160 0x7efc981a1e20 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7efc84009230 tx=0x7efc8400fa70 comp rx=0 tx=0).stop 2024-05-08T06:06:22.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.272+0000 7efc97200700 1 -- 172.21.15.82:0/1800148983 shutdown_connections 2024-05-08T06:06:22.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.272+0000 7efc97200700 1 --2- 172.21.15.82:0/1800148983 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc9810fd80 0x7efc9819baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:22.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.272+0000 7efc97200700 1 --2- 172.21.15.82:0/1800148983 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7efc7c0b2900 0x7efc7c0b4dc0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:22.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.272+0000 7efc97200700 1 --2- 172.21.15.82:0/1800148983 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efc98101840 0x7efc981a18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:22.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.272+0000 7efc97200700 1 --2- 172.21.15.82:0/1800148983 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efc98102160 0x7efc981a1e20 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:22.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.272+0000 7efc97200700 1 -- 172.21.15.82:0/1800148983 >> 172.21.15.82:0/1800148983 conn(0x7efc98077140 msgr2=0x7efc981103e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:06:22.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.272+0000 7efc97200700 1 -- 172.21.15.82:0/1800148983 shutdown_connections 2024-05-08T06:06:22.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:22.272+0000 7efc97200700 1 -- 172.21.15.82:0/1800148983 wait complete. 2024-05-08T06:06:22.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:06:22 smithi151 ceph-mon[34815]: pgmap v930: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 17 KiB/s wr, 14 op/s 2024-05-08T06:06:22.666 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:06:22 smithi082 ceph-mon[30098]: pgmap v930: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 17 KiB/s wr, 14 op/s 2024-05-08T06:06:22.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:06:22 smithi134 ceph-mon[34132]: pgmap v930: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 17 KiB/s wr, 14 op/s 2024-05-08T06:06:23.089 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-08T06:06:23.089 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T06:06:23.545 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:06:24.579 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:06:24 smithi082 ceph-mon[30098]: pgmap v931: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-05-08T06:06:24.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:06:24 smithi151 ceph-mon[34815]: pgmap v931: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-05-08T06:06:24.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:06:24 smithi134 ceph-mon[34132]: pgmap v931: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 14 KiB/s wr, 12 op/s 2024-05-08T06:06:25.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:25.888+0000 7fcb1b200700 1 -- 172.21.15.82:0/1864553925 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb1c1055d0 msgr2=0x7fcb1c105a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:25.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:25.888+0000 7fcb1b200700 1 --2- 172.21.15.82:0/1864553925 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb1c1055d0 0x7fcb1c105a50 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fcb080098f0 tx=0x7fcb08009c00 comp rx=0 tx=0).stop 2024-05-08T06:06:25.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:25.888+0000 7fcb1b200700 1 -- 172.21.15.82:0/1864553925 shutdown_connections 2024-05-08T06:06:25.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:25.888+0000 7fcb1b200700 1 --2- 172.21.15.82:0/1864553925 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb1c105f90 0x7fcb1c112450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:25.889 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:25.888+0000 7fcb1b200700 1 --2- 172.21.15.82:0/1864553925 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb1c10b680 0x7fcb1c10ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:25.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:25.888+0000 7fcb1b200700 1 --2- 172.21.15.82:0/1864553925 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb1c1055d0 0x7fcb1c105a50 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:25.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:25.888+0000 7fcb1b200700 1 -- 172.21.15.82:0/1864553925 >> 172.21.15.82:0/1864553925 conn(0x7fcb1c101080 msgr2=0x7fcb1c1034a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:06:25.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:25.888+0000 7fcb1b200700 1 -- 172.21.15.82:0/1864553925 shutdown_connections 2024-05-08T06:06:25.890 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:25.888+0000 7fcb1b200700 1 -- 172.21.15.82:0/1864553925 wait complete. 2024-05-08T06:06:25.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:25.890+0000 7fcb1b200700 1 Processor -- start 2024-05-08T06:06:25.891 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:25.890+0000 7fcb1b200700 1 -- start start 2024-05-08T06:06:25.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:25.890+0000 7fcb1b200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb1c1055d0 0x7fcb1c1a1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:25.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:25.891+0000 7fcb1b200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb1c105f90 0x7fcb1c1a1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:25.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:25.891+0000 7fcb1b200700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb1c10b680 0x7fcb1c19bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:25.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:25.891+0000 7fcb1b200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fcb1c1157d0 con 0x7fcb1c1055d0 2024-05-08T06:06:25.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:25.891+0000 7fcb1b200700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcb1c115650 con 0x7fcb1c105f90 2024-05-08T06:06:25.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:25.891+0000 7fcb1b200700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fcb1c115950 con 0x7fcb1c10b680 2024-05-08T06:06:25.892 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:25.891+0000 7fcb19e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb1c1055d0 0x7fcb1c1a1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:25.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:25.891+0000 7fcb19e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb1c1055d0 0x7fcb1c1a1910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49454/0 (socket says 172.21.15.82:49454) 2024-05-08T06:06:25.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:25.891+0000 7fcb19e00700 1 -- 172.21.15.82:0/3685096729 learned_addr learned my addr 172.21.15.82:0/3685096729 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:06:25.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:25.891+0000 7fcb19400700 1 --2- 172.21.15.82:0/3685096729 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb1c105f90 0x7fcb1c1a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:25.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:25.891+0000 7fcb1a800700 1 --2- 172.21.15.82:0/3685096729 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb1c10b680 0x7fcb1c19bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:25.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:25.891+0000 7fcb19400700 1 -- 172.21.15.82:0/3685096729 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb1c10b680 msgr2=0x7fcb1c19bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:25.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:25.891+0000 7fcb19400700 1 --2- 172.21.15.82:0/3685096729 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb1c10b680 0x7fcb1c19bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:25.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:25.891+0000 7fcb19400700 1 -- 172.21.15.82:0/3685096729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb1c1055d0 msgr2=0x7fcb1c1a1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:25.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:25.891+0000 7fcb19400700 1 --2- 172.21.15.82:0/3685096729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb1c1055d0 0x7fcb1c1a1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:25.893 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:25.891+0000 7fcb19400700 1 -- 172.21.15.82:0/3685096729 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb1c19c230 con 0x7fcb1c105f90 2024-05-08T06:06:25.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:25.892+0000 7fcb19400700 1 --2- 172.21.15.82:0/3685096729 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb1c105f90 0x7fcb1c1a1e50 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fcb0800c010 tx=0x7fcb0800fa20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:06:25.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:25.892+0000 7fcb12a00700 1 -- 172.21.15.82:0/3685096729 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb080050c0 con 0x7fcb1c105f90 2024-05-08T06:06:25.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:25.892+0000 7fcb1b200700 1 -- 172.21.15.82:0/3685096729 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb1c19c4c0 con 0x7fcb1c105f90 2024-05-08T06:06:25.894 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:25.892+0000 7fcb12a00700 1 -- 172.21.15.82:0/3685096729 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fcb0800b560 con 0x7fcb1c105f90 2024-05-08T06:06:25.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:25.892+0000 7fcb12a00700 1 -- 172.21.15.82:0/3685096729 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb080039a0 con 0x7fcb1c105f90 2024-05-08T06:06:25.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:25.892+0000 7fcb1b200700 1 -- 172.21.15.82:0/3685096729 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb1c1a87e0 con 0x7fcb1c105f90 2024-05-08T06:06:25.895 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:25.894+0000 7fcb1b200700 1 -- 172.21.15.82:0/3685096729 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb1c106cf0 con 0x7fcb1c105f90 2024-05-08T06:06:25.896 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:25.896+0000 7fcb12a00700 1 -- 172.21.15.82:0/3685096729 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fcb0800b710 con 0x7fcb1c105f90 2024-05-08T06:06:25.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:25.897+0000 7fcb12a00700 1 --2- 172.21.15.82:0/3685096729 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fcb000b2900 0x7fcb000b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:25.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:25.897+0000 7fcb12a00700 1 -- 172.21.15.82:0/3685096729 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fcb080e2fe0 con 0x7fcb1c105f90 2024-05-08T06:06:25.898 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:25.898+0000 7fcb19e00700 1 --2- 172.21.15.82:0/3685096729 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fcb000b2900 0x7fcb000b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:25.899 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:25.898+0000 7fcb19e00700 1 --2- 172.21.15.82:0/3685096729 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fcb000b2900 0x7fcb000b4dc0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c009d20 tx=0x7fcb0c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:06:25.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:25.903+0000 7fcb12a00700 1 -- 172.21.15.82:0/3685096729 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fcb08013030 con 0x7fcb1c105f90 2024-05-08T06:06:26.182 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:26.181+0000 7fcb1b200700 1 -- 172.21.15.82:0/3685096729 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcb1c02e510 con 0x7fcb1c105f90 2024-05-08T06:06:26.183 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:26.183+0000 7fcb12a00700 1 -- 172.21.15.82:0/3685096729 <== mon.2 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11948 (secure 0 0 0) 0x7fcb080aad40 con 0x7fcb1c105f90 2024-05-08T06:06:26.184 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T06:06:26.184 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14364,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3876883250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3876883250},{"type":"v1","addr":"172.21.15.82:6835","nonce":3876883250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1965070586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1965070586},{"type":"v1","addr":"172.21.15.82:6837","nonce":1965070586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":31,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T05:45:57.654009+0000","modified":"2024-05-08T05:53:20.165672+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24505,"mds_2":24487,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14397":{"gid":14397,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/1890720973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1890720973},{"type":"v1","addr":"172.21.15.82:6839","nonce":1890720973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14409":{"gid":14409,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/2957083305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":2957083305},{"type":"v1","addr":"172.21.15.82:6841","nonce":2957083305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6833/3827691638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3827691638},{"type":"v1","addr":"172.21.15.134:6833","nonce":3827691638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6833/3625067797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3625067797},{"type":"v1","addr":"172.21.15.151:6833","nonce":3625067797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/4074163402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4074163402},{"type":"v1","addr":"172.21.15.134:6835","nonce":4074163402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.134:6837/2212411710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2212411710},{"type":"v1","addr":"172.21.15.134:6837","nonce":2212411710}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":17,"addr":"172.21.15.151:6835/2093655929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2093655929},{"type":"v1","addr":"172.21.15.151:6835","nonce":2093655929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6837/4192404464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":4192404464},{"type":"v1","addr":"172.21.15.151:6837","nonce":4192404464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":14,"addr":"172.21.15.151:6839/2963754236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":2963754236},{"type":"v1","addr":"172.21.15.151:6839","nonce":2963754236}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.134:6839/1145270893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1145270893},{"type":"v1","addr":"172.21.15.134:6839","nonce":1145270893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24505,24506,24487,24475,24467]},"id":1}]} 2024-05-08T06:06:26.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:26.186+0000 7fcb1b200700 1 -- 172.21.15.82:0/3685096729 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fcb000b2900 msgr2=0x7fcb000b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:26.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:26.186+0000 7fcb1b200700 1 --2- 172.21.15.82:0/3685096729 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fcb000b2900 0x7fcb000b4dc0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c009d20 tx=0x7fcb0c009260 comp rx=0 tx=0).stop 2024-05-08T06:06:26.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:26.186+0000 7fcb1b200700 1 -- 172.21.15.82:0/3685096729 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb1c105f90 msgr2=0x7fcb1c1a1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:26.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:26.186+0000 7fcb1b200700 1 --2- 172.21.15.82:0/3685096729 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb1c105f90 0x7fcb1c1a1e50 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fcb0800c010 tx=0x7fcb0800fa20 comp rx=0 tx=0).stop 2024-05-08T06:06:26.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:26.186+0000 7fcb1b200700 1 -- 172.21.15.82:0/3685096729 shutdown_connections 2024-05-08T06:06:26.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:26.186+0000 7fcb1b200700 1 --2- 172.21.15.82:0/3685096729 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fcb000b2900 0x7fcb000b4dc0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:26.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:26.186+0000 7fcb1b200700 1 --2- 172.21.15.82:0/3685096729 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb1c10b680 0x7fcb1c19bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:26.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:26.186+0000 7fcb1b200700 1 --2- 172.21.15.82:0/3685096729 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fcb1c1055d0 0x7fcb1c1a1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:26.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:26.186+0000 7fcb1b200700 1 --2- 172.21.15.82:0/3685096729 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb1c105f90 0x7fcb1c1a1e50 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:26.187 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:26.186+0000 7fcb1b200700 1 -- 172.21.15.82:0/3685096729 >> 172.21.15.82:0/3685096729 conn(0x7fcb1c101080 msgr2=0x7fcb1c1028e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:06:26.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:26.186+0000 7fcb1b200700 1 -- 172.21.15.82:0/3685096729 shutdown_connections 2024-05-08T06:06:26.188 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:26.186+0000 7fcb1b200700 1 -- 172.21.15.82:0/3685096729 wait complete. 2024-05-08T06:06:26.188 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 31 2024-05-08T06:06:26.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:06:26 smithi082 ceph-mon[30098]: pgmap v932: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-05-08T06:06:26.471 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:06:26 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/3685096729' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:06:26.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:06:26 smithi151 ceph-mon[34815]: pgmap v932: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-05-08T06:06:26.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:06:26 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/3685096729' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:06:26.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:06:26 smithi134 ceph-mon[34132]: pgmap v932: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-05-08T06:06:26.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:06:26 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/3685096729' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:06:27.025 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-05-08T06:06:27.478 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:06:27.622 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:06:27 smithi082 ceph-mon[30098]: pgmap v933: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 31 KiB/s wr, 13 op/s 2024-05-08T06:06:27.629 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:06:27 smithi151 ceph-mon[34815]: pgmap v933: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 31 KiB/s wr, 13 op/s 2024-05-08T06:06:27.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:06:27 smithi134 ceph-mon[34132]: pgmap v933: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 31 KiB/s wr, 13 op/s 2024-05-08T06:06:29.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.702+0000 7f7b2e000700 1 -- 172.21.15.82:0/2664455126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b28105f90 msgr2=0x7f7b28112450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:29.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.702+0000 7f7b2e000700 1 --2- 172.21.15.82:0/2664455126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b28105f90 0x7f7b28112450 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f7b20009f90 tx=0x7f7b2000b330 comp rx=0 tx=0).stop 2024-05-08T06:06:29.702 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.702+0000 7f7b2e000700 1 -- 172.21.15.82:0/2664455126 shutdown_connections 2024-05-08T06:06:29.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.702+0000 7f7b2e000700 1 --2- 172.21.15.82:0/2664455126 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b2810b680 0x7f7b2810ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:29.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.702+0000 7f7b2e000700 1 --2- 172.21.15.82:0/2664455126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b28105f90 0x7f7b28112450 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:29.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.702+0000 7f7b2e000700 1 --2- 172.21.15.82:0/2664455126 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b281055d0 0x7f7b28105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:29.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.702+0000 7f7b2e000700 1 -- 172.21.15.82:0/2664455126 >> 172.21.15.82:0/2664455126 conn(0x7f7b28101080 msgr2=0x7f7b281034a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:06:29.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.702+0000 7f7b2e000700 1 -- 172.21.15.82:0/2664455126 shutdown_connections 2024-05-08T06:06:29.703 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.702+0000 7f7b2e000700 1 -- 172.21.15.82:0/2664455126 wait complete. 2024-05-08T06:06:29.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.703+0000 7f7b2e000700 1 Processor -- start 2024-05-08T06:06:29.706 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.703+0000 7f7b2e000700 1 -- start start 2024-05-08T06:06:29.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.704+0000 7f7b2e000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b281055d0 0x7f7b281a1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:29.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.704+0000 7f7b2e000700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b28105f90 0x7f7b281a1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:29.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.704+0000 7f7b2e000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b2810b680 0x7f7b2819b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:29.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.704+0000 7f7b2e000700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7b28115830 con 0x7f7b281055d0 2024-05-08T06:06:29.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.704+0000 7f7b2e000700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7b281156b0 con 0x7f7b2810b680 2024-05-08T06:06:29.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.704+0000 7f7b2e000700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7b281159b0 con 0x7f7b28105f90 2024-05-08T06:06:29.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.704+0000 7f7b2cc00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b281055d0 0x7f7b281a1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:29.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.704+0000 7f7b2cc00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b281055d0 0x7f7b281a1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49470/0 (socket says 172.21.15.82:49470) 2024-05-08T06:06:29.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.704+0000 7f7b2d600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b2810b680 0x7f7b2819b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:29.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.704+0000 7f7b2cc00700 1 -- 172.21.15.82:0/3481839843 learned_addr learned my addr 172.21.15.82:0/3481839843 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:06:29.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.704+0000 7f7b27e00700 1 --2- 172.21.15.82:0/3481839843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b28105f90 0x7f7b281a1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:29.707 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.705+0000 7f7b2d600700 1 -- 172.21.15.82:0/3481839843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b28105f90 msgr2=0x7f7b281a1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:29.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.705+0000 7f7b2d600700 1 --2- 172.21.15.82:0/3481839843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b28105f90 0x7f7b281a1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:29.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.705+0000 7f7b2d600700 1 -- 172.21.15.82:0/3481839843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b281055d0 msgr2=0x7f7b281a1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:29.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.705+0000 7f7b2d600700 1 --2- 172.21.15.82:0/3481839843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b281055d0 0x7f7b281a1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:29.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.705+0000 7f7b2d600700 1 -- 172.21.15.82:0/3481839843 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b2819c130 con 0x7f7b2810b680 2024-05-08T06:06:29.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.705+0000 7f7b2cc00700 1 --2- 172.21.15.82:0/3481839843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b281055d0 0x7f7b281a1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:06:29.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.705+0000 7f7b2d600700 1 --2- 172.21.15.82:0/3481839843 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b2810b680 0x7f7b2819b9d0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f7b2000b6c0 tx=0x7f7b2000cc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:06:29.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.705+0000 7f7b25600700 1 -- 172.21.15.82:0/3481839843 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b20021070 con 0x7f7b2810b680 2024-05-08T06:06:29.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.705+0000 7f7b25600700 1 -- 172.21.15.82:0/3481839843 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7b2001d450 con 0x7f7b2810b680 2024-05-08T06:06:29.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.705+0000 7f7b2e000700 1 -- 172.21.15.82:0/3481839843 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b2819c3c0 con 0x7f7b2810b680 2024-05-08T06:06:29.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.705+0000 7f7b25600700 1 -- 172.21.15.82:0/3481839843 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b200052a0 con 0x7f7b2810b680 2024-05-08T06:06:29.708 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.706+0000 7f7b2e000700 1 -- 172.21.15.82:0/3481839843 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b281a86e0 con 0x7f7b2810b680 2024-05-08T06:06:29.710 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.710+0000 7f7b25600700 1 -- 172.21.15.82:0/3481839843 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f7b20024070 con 0x7f7b2810b680 2024-05-08T06:06:29.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.711+0000 7f7b39ea5b80 1 Processor -- start 2024-05-08T06:06:29.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.712+0000 7f7b39ea5b80 1 -- start start 2024-05-08T06:06:29.711 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.712+0000 7f7b25600700 1 --2- 172.21.15.82:0/3481839843 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7b100b2880 0x7f7b100b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:29.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.712+0000 7f7b39ea5b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f0259d9e0 0x562f0259ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:29.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.712+0000 7f7b39ea5b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562f0259e300 0x562f02597fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:29.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.712+0000 7f7b39ea5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562f02598600 0x562f02598a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:29.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.712+0000 7f7b39ea5b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x562f024eaa20 con 0x562f0259d9e0 2024-05-08T06:06:29.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.712+0000 7f7b39ea5b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562f02488760 con 0x562f0259e300 2024-05-08T06:06:29.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.712+0000 7f7b39ea5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x562f024e69e0 con 0x562f02598600 2024-05-08T06:06:29.712 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.712+0000 7f7b2cc00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f0259d9e0 0x562f0259ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:29.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.712+0000 7f7b25600700 1 -- 172.21.15.82:0/3481839843 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f7b2000f020 con 0x7f7b2810b680 2024-05-08T06:06:29.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.712+0000 7f7b2cc00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f0259d9e0 0x562f0259ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49474/0 (socket says 172.21.15.82:49474) 2024-05-08T06:06:29.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.712+0000 7f7b27e00700 1 --2- 172.21.15.82:0/3481839843 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7b100b2880 0x7f7b100b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:29.713 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.712+0000 7f7b2cc00700 1 -- 172.21.15.82:0/791208825 learned_addr learned my addr 172.21.15.82:0/791208825 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:06:29.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.712+0000 7f7b2d600700 1 --2- 172.21.15.82:0/791208825 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562f02598600 0x562f02598a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:29.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.713+0000 7f7b27e00700 1 --2- 172.21.15.82:0/791208825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562f0259e300 0x562f02597fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:29.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.713+0000 7f7b2cc00700 1 -- 172.21.15.82:0/791208825 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562f02598600 msgr2=0x562f02598a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:06:29.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.713+0000 7f7b2cc00700 1 --2- 172.21.15.82:0/791208825 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562f02598600 0x562f02598a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:29.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.713+0000 7f7b2cc00700 1 -- 172.21.15.82:0/791208825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562f0259e300 msgr2=0x562f02597fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:06:29.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.713+0000 7f7b2cc00700 1 --2- 172.21.15.82:0/791208825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562f0259e300 0x562f02597fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:29.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.713+0000 7f7b2cc00700 1 -- 172.21.15.82:0/791208825 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f024378d0 con 0x562f0259d9e0 2024-05-08T06:06:29.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.713+0000 7f7b2cc00700 1 --2- 172.21.15.82:0/791208825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f0259d9e0 0x562f0259ddc0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c011680 tx=0x7f7b1c011990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6352e3f2209c6814 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:06:29.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.713+0000 7f7b27e00700 1 --2- 172.21.15.82:0/3481839843 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7b100b2880 0x7f7b100b4d40 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7b2810ace0 tx=0x7f7b14009960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:06:29.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.713+0000 7f7b1a000700 1 -- 172.21.15.82:0/791208825 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c004030 con 0x562f0259d9e0 2024-05-08T06:06:29.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.714+0000 7f7b1a000700 1 -- 172.21.15.82:0/791208825 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7b1c003680 con 0x562f0259d9e0 2024-05-08T06:06:29.714 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.714+0000 7f7b1a000700 1 -- 172.21.15.82:0/791208825 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c00f6e0 con 0x562f0259d9e0 2024-05-08T06:06:29.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.714+0000 7f7b39ea5b80 1 -- 172.21.15.82:0/791208825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f0259d9e0 msgr2=0x562f0259ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:29.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.714+0000 7f7b39ea5b80 1 --2- 172.21.15.82:0/791208825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f0259d9e0 0x562f0259ddc0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c011680 tx=0x7f7b1c011990 comp rx=0 tx=0).stop 2024-05-08T06:06:29.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.714+0000 7f7b39ea5b80 1 -- 172.21.15.82:0/791208825 shutdown_connections 2024-05-08T06:06:29.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.714+0000 7f7b39ea5b80 1 --2- 172.21.15.82:0/791208825 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562f02598600 0x562f02598a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:29.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.714+0000 7f7b39ea5b80 1 --2- 172.21.15.82:0/791208825 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f0259d9e0 0x562f0259ddc0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:29.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.714+0000 7f7b39ea5b80 1 --2- 172.21.15.82:0/791208825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562f0259e300 0x562f02597fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:29.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.715+0000 7f7b39ea5b80 1 -- 172.21.15.82:0/791208825 >> 172.21.15.82:0/791208825 conn(0x562f024c6b60 msgr2=0x562f025929b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:06:29.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.715+0000 7f7b39ea5b80 1 -- 172.21.15.82:0/791208825 shutdown_connections 2024-05-08T06:06:29.716 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.715+0000 7f7b39ea5b80 1 -- 172.21.15.82:0/791208825 wait complete. 2024-05-08T06:06:29.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.715+0000 7f7b39ea5b80 1 -- start start 2024-05-08T06:06:29.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.715+0000 7f7b39ea5b80 1 Processor -- start 2024-05-08T06:06:29.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.716+0000 7f7b39ea5b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562f02598600 0x562f025a7620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:29.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.716+0000 7f7b39ea5b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f0259d9e0 0x562f025a7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:29.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.716+0000 7f7b39ea5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562f0259e300 0x562f025a1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:29.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.716+0000 7f7b39ea5b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x562f025a4da0 con 0x562f0259d9e0 2024-05-08T06:06:29.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.716+0000 7f7b39ea5b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562f02450b20 con 0x562f02598600 2024-05-08T06:06:29.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.716+0000 7f7b39ea5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x562f025a4f20 con 0x562f0259e300 2024-05-08T06:06:29.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.716+0000 7f7b39ea5b80 10 client.0 _ll_register_callbacks cb 0x562f02491c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:06:29.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.716+0000 7f7b27e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f0259d9e0 0x562f025a7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:29.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.716+0000 7f7b27e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f0259d9e0 0x562f025a7b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49482/0 (socket says 172.21.15.82:49482) 2024-05-08T06:06:29.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.716+0000 7f7b2cc00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562f02598600 0x562f025a7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:29.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.716+0000 7f7b2d600700 1 --2- 172.21.15.82:0/2823531847 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562f0259e300 0x562f025a1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:29.717 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.716+0000 7f7b27e00700 1 -- 172.21.15.82:0/2823531847 learned_addr learned my addr 172.21.15.82:0/2823531847 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:06:29.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.717+0000 7f7b2cc00700 1 -- 172.21.15.82:0/2823531847 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562f0259e300 msgr2=0x562f025a1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:06:29.719 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.717+0000 7f7b2cc00700 1 --2- 172.21.15.82:0/2823531847 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562f0259e300 0x562f025a1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:29.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.717+0000 7f7b2cc00700 1 -- 172.21.15.82:0/2823531847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f0259d9e0 msgr2=0x562f025a7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:06:29.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.717+0000 7f7b2cc00700 1 --2- 172.21.15.82:0/2823531847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f0259d9e0 0x562f025a7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:29.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.717+0000 7f7b2cc00700 1 -- 172.21.15.82:0/2823531847 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f024b0420 con 0x562f02598600 2024-05-08T06:06:29.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.717+0000 7f7b2cc00700 1 --2- 172.21.15.82:0/2823531847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562f02598600 0x562f025a7620 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c01b040 tx=0x7f7b1c0042b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18c4770731b399ba server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:06:29.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.717+0000 7f7b0ea00700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T06:06:29.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.717+0000 7f7b0ea00700 1 -- 172.21.15.82:0/2823531847 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c026030 con 0x562f02598600 2024-05-08T06:06:29.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.717+0000 7f7b0ea00700 1 -- 172.21.15.82:0/2823531847 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f7b1c016070 con 0x562f02598600 2024-05-08T06:06:29.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.717+0000 7f7b39ea5b80 1 -- 172.21.15.82:0/2823531847 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b1c003680 con 0x562f02598600 2024-05-08T06:06:29.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.718+0000 7f7b0ea00700 1 -- 172.21.15.82:0/2823531847 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f7b1c004550 con 0x562f02598600 2024-05-08T06:06:29.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.718+0000 7f7b39ea5b80 10 client.26933 fetch_fsmap learned FSMap version 31 2024-05-08T06:06:29.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.718+0000 7f7b39ea5b80 1 -- 172.21.15.82:0/2823531847 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x562f025af380 con 0x562f02598600 2024-05-08T06:06:29.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.718+0000 7f7b0ea00700 1 -- 172.21.15.82:0/2823531847 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7b1c003680 con 0x562f02598600 2024-05-08T06:06:29.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.718+0000 7f7b0ea00700 1 -- 172.21.15.82:0/2823531847 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f7b1c004cc0 con 0x562f02598600 2024-05-08T06:06:29.720 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.719+0000 7f7b39ea5b80 10 client.26933 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:06:29.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.719+0000 7f7b39ea5b80 10 client.26933 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-05-08T06:06:29.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.719+0000 7f7b39ea5b80 20 client.26933 populate_metadata read hostname 'smithi082' 2024-05-08T06:06:29.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.719+0000 7f7b39ea5b80 1 --2- 172.21.15.82:0/2823531847 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x562f025b1960 0x562f025b3d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:29.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.719+0000 7f7b39ea5b80 4 client.26933 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:06:29.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.719+0000 7f7b39ea5b80 1 -- 172.21.15.82:0/2823531847 --> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562f025650a0 con 0x562f025b1960 2024-05-08T06:06:29.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.719+0000 7f7b27e00700 1 --2- 172.21.15.82:0/2823531847 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x562f025b1960 0x562f025b3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:29.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.720+0000 7f7b0ea00700 10 client.26933 ms_handle_connect on v2:172.21.15.134:6836/2212411710 2024-05-08T06:06:29.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.720+0000 7f7b27e00700 1 --2- 172.21.15.82:0/2823531847 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x562f025b1960 0x562f025b3d50 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d48ea81f71482220 server_cookie=e534fb0d5dcbf600 in_seq=0 out_seq=0 2024-05-08T06:06:29.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.721+0000 7f7b0ea00700 1 -- 172.21.15.82:0/2823531847 <== mds.4 v2:172.21.15.134:6836/2212411710 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562f025650a0 con 0x562f025b1960 2024-05-08T06:06:29.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.721+0000 7f7b0ea00700 10 client.26933 handle_command_reply: tid=0 2024-05-08T06:06:29.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.721+0000 7f7b39ea5b80 1 client.26933 shutdown 2024-05-08T06:06:29.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.721+0000 7f7b39ea5b80 1 -- 172.21.15.82:0/2823531847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562f02598600 msgr2=0x562f025a7620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:29.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.721+0000 7f7b39ea5b80 1 --2- 172.21.15.82:0/2823531847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562f02598600 0x562f025a7620 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c01b040 tx=0x7f7b1c0042b0 comp rx=0 tx=0).stop 2024-05-08T06:06:29.722 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.721+0000 7f7b39ea5b80 1 -- 172.21.15.82:0/2823531847 shutdown_connections 2024-05-08T06:06:29.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.721+0000 7f7b39ea5b80 1 --2- 172.21.15.82:0/2823531847 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x562f025b1960 0x562f025b3d50 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:29.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.721+0000 7f7b39ea5b80 1 --2- 172.21.15.82:0/2823531847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562f02598600 0x562f025a7620 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:29.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.721+0000 7f7b39ea5b80 1 --2- 172.21.15.82:0/2823531847 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562f0259e300 0x562f025a1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:29.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.721+0000 7f7b0ea00700 0 client.26933 ms_handle_reset on v2:172.21.15.134:6836/2212411710 2024-05-08T06:06:29.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.721+0000 7f7b39ea5b80 1 --2- 172.21.15.82:0/2823531847 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f0259d9e0 0x562f025a7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:29.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.721+0000 7f7b39ea5b80 1 -- 172.21.15.82:0/2823531847 >> 172.21.15.82:0/2823531847 conn(0x562f024c6b60 msgr2=0x562f0258d460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:06:29.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.721+0000 7f7b39ea5b80 1 -- 172.21.15.82:0/2823531847 shutdown_connections 2024-05-08T06:06:29.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.721+0000 7f7b39ea5b80 1 -- 172.21.15.82:0/2823531847 wait complete. 2024-05-08T06:06:29.723 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.721+0000 7f7b39ea5b80 20 client.26933 trim_cache size 0 max 16384 2024-05-08T06:06:29.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.738+0000 7f7b39ea5b80 1 Processor -- start 2024-05-08T06:06:29.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.738+0000 7f7b39ea5b80 1 -- start start 2024-05-08T06:06:29.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.738+0000 7f7b39ea5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562f02598600 0x562f02597fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:29.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.738+0000 7f7b39ea5b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f0259d9e0 0x562f025b9550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:29.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.738+0000 7f7b39ea5b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562f0259e300 0x562f025b9a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:29.738 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.738+0000 7f7b39ea5b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7b281afaa0 con 0x562f0259d9e0 2024-05-08T06:06:29.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.738+0000 7f7b39ea5b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7b281b15e0 con 0x562f0259e300 2024-05-08T06:06:29.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.738+0000 7f7b39ea5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7b281b0170 con 0x562f02598600 2024-05-08T06:06:29.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.738+0000 7f7b27e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f0259d9e0 0x562f025b9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:29.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.739+0000 7f7b27e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f0259d9e0 0x562f025b9550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:49490/0 (socket says 172.21.15.82:49490) 2024-05-08T06:06:29.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.739+0000 7f7b27e00700 1 -- 172.21.15.82:0/3631684782 learned_addr learned my addr 172.21.15.82:0/3631684782 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:06:29.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.739+0000 7f7b2cc00700 1 --2- 172.21.15.82:0/3631684782 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562f02598600 0x562f02597fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:29.739 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.739+0000 7f7b2d600700 1 --2- 172.21.15.82:0/3631684782 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562f0259e300 0x562f025b9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:29.740 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.739+0000 7f7b2cc00700 1 -- 172.21.15.82:0/3631684782 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562f0259e300 msgr2=0x562f025b9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:06:29.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.739+0000 7f7b2cc00700 1 --2- 172.21.15.82:0/3631684782 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562f0259e300 0x562f025b9a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:29.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.739+0000 7f7b2cc00700 1 -- 172.21.15.82:0/3631684782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f0259d9e0 msgr2=0x562f025b9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:06:29.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.739+0000 7f7b2cc00700 1 --2- 172.21.15.82:0/3631684782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f0259d9e0 0x562f025b9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:29.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.739+0000 7f7b2cc00700 1 -- 172.21.15.82:0/3631684782 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f02594ac0 con 0x562f02598600 2024-05-08T06:06:29.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.739+0000 7f7b27e00700 1 --2- 172.21.15.82:0/3631684782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f0259d9e0 0x562f025b9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:06:29.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.739+0000 7f7b2cc00700 1 --2- 172.21.15.82:0/3631684782 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562f02598600 0x562f02597fe0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c02b6c0 tx=0x7f7b1c005a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b615b34fbd0a8d17 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:06:29.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.740+0000 7f7b19600700 1 -- 172.21.15.82:0/3631684782 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c026070 con 0x562f02598600 2024-05-08T06:06:29.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.740+0000 7f7b19600700 1 -- 172.21.15.82:0/3631684782 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7b1c027040 con 0x562f02598600 2024-05-08T06:06:29.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.740+0000 7f7b19600700 1 -- 172.21.15.82:0/3631684782 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c02be20 con 0x562f02598600 2024-05-08T06:06:29.741 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.740+0000 7f7b39ea5b80 1 -- 172.21.15.82:0/3631684782 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562f02598600 msgr2=0x562f02597fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:29.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.740+0000 7f7b39ea5b80 1 --2- 172.21.15.82:0/3631684782 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562f02598600 0x562f02597fe0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c02b6c0 tx=0x7f7b1c005a00 comp rx=0 tx=0).stop 2024-05-08T06:06:29.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.740+0000 7f7b39ea5b80 1 -- 172.21.15.82:0/3631684782 shutdown_connections 2024-05-08T06:06:29.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.740+0000 7f7b39ea5b80 1 --2- 172.21.15.82:0/3631684782 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562f0259e300 0x562f025b9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:29.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.740+0000 7f7b39ea5b80 1 --2- 172.21.15.82:0/3631684782 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562f02598600 0x562f02597fe0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:29.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.740+0000 7f7b39ea5b80 1 --2- 172.21.15.82:0/3631684782 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f0259d9e0 0x562f025b9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:29.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.740+0000 7f7b39ea5b80 1 -- 172.21.15.82:0/3631684782 >> 172.21.15.82:0/3631684782 conn(0x562f024c6b60 msgr2=0x562f0259fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:06:29.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.740+0000 7f7b39ea5b80 1 -- 172.21.15.82:0/3631684782 shutdown_connections 2024-05-08T06:06:29.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.740+0000 7f7b39ea5b80 1 -- 172.21.15.82:0/3631684782 wait complete. 2024-05-08T06:06:29.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.741+0000 7f7b39ea5b80 1 -- start start 2024-05-08T06:06:29.742 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.741+0000 7f7b39ea5b80 1 Processor -- start 2024-05-08T06:06:29.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.742+0000 7f7b39ea5b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f02598600 0x562f025abb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:29.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.742+0000 7f7b39ea5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562f0259d9e0 0x562f025ac050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:29.745 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.742+0000 7f7b39ea5b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562f0259e300 0x562f025ac5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:29.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.742+0000 7f7b39ea5b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f7b281b0f10 con 0x562f02598600 2024-05-08T06:06:29.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.742+0000 7f7b39ea5b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7b281b0840 con 0x562f0259e300 2024-05-08T06:06:29.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.742+0000 7f7b39ea5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7b281ada40 con 0x562f0259d9e0 2024-05-08T06:06:29.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.742+0000 7f7b39ea5b80 10 client.0 _ll_register_callbacks cb 0x562f02491c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:06:29.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.742+0000 7f7b27e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562f0259d9e0 0x562f025ac050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:29.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.742+0000 7f7b2cc00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f02598600 0x562f025abb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:29.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.742+0000 7f7b2d600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562f0259e300 0x562f025ac5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:29.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.742+0000 7f7b27e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562f0259d9e0 0x562f025ac050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:60556/0 (socket says 172.21.15.82:60556) 2024-05-08T06:06:29.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.742+0000 7f7b27e00700 1 -- 172.21.15.82:0/2701224744 learned_addr learned my addr 172.21.15.82:0/2701224744 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:06:29.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.742+0000 7f7b27e00700 1 -- 172.21.15.82:0/2701224744 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562f0259e300 msgr2=0x562f025ac5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:06:29.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.742+0000 7f7b27e00700 1 --2- 172.21.15.82:0/2701224744 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562f0259e300 0x562f025ac5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:29.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.742+0000 7f7b27e00700 1 -- 172.21.15.82:0/2701224744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f02598600 msgr2=0x562f025abb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:06:29.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.742+0000 7f7b27e00700 1 --2- 172.21.15.82:0/2701224744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f02598600 0x562f025abb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:29.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.742+0000 7f7b27e00700 1 -- 172.21.15.82:0/2701224744 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f0261b3f0 con 0x562f0259d9e0 2024-05-08T06:06:29.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.742+0000 7f7b2cc00700 1 --2- 172.21.15.82:0/2701224744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f02598600 0x562f025abb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:06:29.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.743+0000 7f7b27e00700 1 --2- 172.21.15.82:0/2701224744 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562f0259d9e0 0x562f025ac050 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x562f025b44f0 tx=0x7f7b14004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9b0a3eff0f5eea0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:06:29.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.743+0000 7f7b0ea00700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T06:06:29.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.743+0000 7f7b0ea00700 1 -- 172.21.15.82:0/2701224744 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1402d030 con 0x562f0259d9e0 2024-05-08T06:06:29.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.743+0000 7f7b39ea5b80 1 -- 172.21.15.82:0/2701224744 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b1c027040 con 0x562f0259d9e0 2024-05-08T06:06:29.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.743+0000 7f7b0ea00700 1 -- 172.21.15.82:0/2701224744 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f7b140294d0 con 0x562f0259d9e0 2024-05-08T06:06:29.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.743+0000 7f7b0ea00700 1 -- 172.21.15.82:0/2701224744 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f7b140296d0 con 0x562f0259d9e0 2024-05-08T06:06:29.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.743+0000 7f7b39ea5b80 10 client.26965 fetch_fsmap learned FSMap version 31 2024-05-08T06:06:29.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.743+0000 7f7b39ea5b80 1 -- 172.21.15.82:0/2701224744 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x562f0261c750 con 0x562f0259d9e0 2024-05-08T06:06:29.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.744+0000 7f7b0ea00700 1 -- 172.21.15.82:0/2701224744 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f7b1c027040 con 0x562f0259d9e0 2024-05-08T06:06:29.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.744+0000 7f7b0ea00700 1 -- 172.21.15.82:0/2701224744 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f7b14029ce0 con 0x562f0259d9e0 2024-05-08T06:06:29.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.744+0000 7f7b39ea5b80 10 client.26965 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:06:29.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.744+0000 7f7b39ea5b80 10 client.26965 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.h 2024-05-08T06:06:29.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.744+0000 7f7b39ea5b80 20 client.26965 populate_metadata read hostname 'smithi082' 2024-05-08T06:06:29.747 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.744+0000 7f7b39ea5b80 1 --2- 172.21.15.82:0/2701224744 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x562f0261ce90 0x562f0261f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:29.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.744+0000 7f7b39ea5b80 4 client.26965 mds_command: new command op to 24467 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T06:06:29.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.744+0000 7f7b39ea5b80 1 -- 172.21.15.82:0/2701224744 --> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562f024f8400 con 0x562f0261ce90 2024-05-08T06:06:29.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.744+0000 7f7b2cc00700 1 --2- 172.21.15.82:0/2701224744 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x562f0261ce90 0x562f0261f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:29.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.745+0000 7f7b2cc00700 1 --2- 172.21.15.82:0/2701224744 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x562f0261ce90 0x562f0261f2b0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ca9646d875b4a460 server_cookie=fa0364390147f610 in_seq=0 out_seq=0 2024-05-08T06:06:29.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.745+0000 7f7b0ea00700 10 client.26965 ms_handle_connect on v2:172.21.15.134:6836/2212411710 2024-05-08T06:06:29.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.745+0000 7f7b0ea00700 1 -- 172.21.15.82:0/2701224744 <== mds.4 v2:172.21.15.134:6836/2212411710 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562f024f8400 con 0x562f0261ce90 2024-05-08T06:06:29.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.745+0000 7f7b0ea00700 10 client.26965 handle_command_reply: tid=0 2024-05-08T06:06:29.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.745+0000 7f7b39ea5b80 1 client.26965 shutdown 2024-05-08T06:06:29.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.745+0000 7f7b39ea5b80 1 -- 172.21.15.82:0/2701224744 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562f0259d9e0 msgr2=0x562f025ac050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:29.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.745+0000 7f7b39ea5b80 1 --2- 172.21.15.82:0/2701224744 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562f0259d9e0 0x562f025ac050 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x562f025b44f0 tx=0x7f7b14004750 comp rx=0 tx=0).stop 2024-05-08T06:06:29.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.745+0000 7f7b39ea5b80 1 -- 172.21.15.82:0/2701224744 shutdown_connections 2024-05-08T06:06:29.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.745+0000 7f7b39ea5b80 1 --2- 172.21.15.82:0/2701224744 >> [v2:172.21.15.134:6836/2212411710,v1:172.21.15.134:6837/2212411710] conn(0x562f0261ce90 0x562f0261f2b0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:29.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.745+0000 7f7b39ea5b80 1 --2- 172.21.15.82:0/2701224744 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562f0259e300 0x562f025ac5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:29.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.745+0000 7f7b39ea5b80 1 --2- 172.21.15.82:0/2701224744 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x562f02598600 0x562f025abb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:29.748 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.745+0000 7f7b39ea5b80 1 --2- 172.21.15.82:0/2701224744 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562f0259d9e0 0x562f025ac050 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:29.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.745+0000 7f7b39ea5b80 1 -- 172.21.15.82:0/2701224744 >> 172.21.15.82:0/2701224744 conn(0x562f024c6b60 msgr2=0x562f025a09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:06:29.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.745+0000 7f7b0ea00700 0 client.26965 ms_handle_reset on v2:172.21.15.134:6836/2212411710 2024-05-08T06:06:29.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.746+0000 7f7b39ea5b80 1 -- 172.21.15.82:0/2701224744 shutdown_connections 2024-05-08T06:06:29.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.746+0000 7f7b39ea5b80 1 -- 172.21.15.82:0/2701224744 wait complete. 2024-05-08T06:06:29.749 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.746+0000 7f7b39ea5b80 20 client.26965 trim_cache size 0 max 16384 2024-05-08T06:06:29.749 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T06:06:29.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.746+0000 7f7b2e000700 1 -- 172.21.15.82:0/3481839843 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7b100b2880 msgr2=0x7f7b100b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:29.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.746+0000 7f7b2e000700 1 --2- 172.21.15.82:0/3481839843 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7b100b2880 0x7f7b100b4d40 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f7b2810ace0 tx=0x7f7b14009960 comp rx=0 tx=0).stop 2024-05-08T06:06:29.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.746+0000 7f7b2e000700 1 -- 172.21.15.82:0/3481839843 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b2810b680 msgr2=0x7f7b2819b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:29.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.746+0000 7f7b2e000700 1 --2- 172.21.15.82:0/3481839843 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b2810b680 0x7f7b2819b9d0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f7b2000b6c0 tx=0x7f7b2000cc30 comp rx=0 tx=0).stop 2024-05-08T06:06:29.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.747+0000 7f7b2e000700 1 -- 172.21.15.82:0/3481839843 shutdown_connections 2024-05-08T06:06:29.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.747+0000 7f7b2e000700 1 --2- 172.21.15.82:0/3481839843 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b2810b680 0x7f7b2819b9d0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:29.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.747+0000 7f7b2e000700 1 --2- 172.21.15.82:0/3481839843 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f7b100b2880 0x7f7b100b4d40 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:29.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.747+0000 7f7b2e000700 1 --2- 172.21.15.82:0/3481839843 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f7b281055d0 0x7f7b281a1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:29.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.747+0000 7f7b2e000700 1 --2- 172.21.15.82:0/3481839843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b28105f90 0x7f7b281a1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:29.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.747+0000 7f7b2e000700 1 -- 172.21.15.82:0/3481839843 >> 172.21.15.82:0/3481839843 conn(0x7f7b28101080 msgr2=0x7f7b281027c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:06:29.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.747+0000 7f7b2e000700 1 -- 172.21.15.82:0/3481839843 shutdown_connections 2024-05-08T06:06:29.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:29.747+0000 7f7b2e000700 1 -- 172.21.15.82:0/3481839843 wait complete. 2024-05-08T06:06:29.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:06:29 smithi082 ceph-mon[30098]: pgmap v934: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 21 KiB/s wr, 11 op/s 2024-05-08T06:06:29.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:06:29 smithi134 ceph-mon[34132]: pgmap v934: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 21 KiB/s wr, 11 op/s 2024-05-08T06:06:30.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:06:29 smithi151 ceph-mon[34815]: pgmap v934: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 21 KiB/s wr, 11 op/s 2024-05-08T06:06:30.579 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-05-08T06:06:31.030 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:06:31.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:06:31 smithi082 ceph-mon[30098]: pgmap v935: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 21 KiB/s wr, 10 op/s 2024-05-08T06:06:31.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:06:31 smithi134 ceph-mon[34132]: pgmap v935: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 21 KiB/s wr, 10 op/s 2024-05-08T06:06:32.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:06:31 smithi151 ceph-mon[34815]: pgmap v935: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 21 KiB/s wr, 10 op/s 2024-05-08T06:06:33.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.202+0000 7fd4e0400700 1 -- 172.21.15.82:0/2508989890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4d8108410 msgr2=0x7fd4d81087f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:33.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.202+0000 7fd4e0400700 1 --2- 172.21.15.82:0/2508989890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4d8108410 0x7fd4d81087f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc009f90 tx=0x7fd4cc00b330 comp rx=0 tx=0).stop 2024-05-08T06:06:33.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.202+0000 7fd4e0400700 1 -- 172.21.15.82:0/2508989890 shutdown_connections 2024-05-08T06:06:33.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.202+0000 7fd4e0400700 1 --2- 172.21.15.82:0/2508989890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4d8108410 0x7fd4d81087f0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:33.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.202+0000 7fd4e0400700 1 --2- 172.21.15.82:0/2508989890 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd4d8102d60 0x7fd4d810f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:33.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.202+0000 7fd4e0400700 1 --2- 172.21.15.82:0/2508989890 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4d81023a0 0x7fd4d8102820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:33.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.202+0000 7fd4e0400700 1 -- 172.21.15.82:0/2508989890 >> 172.21.15.82:0/2508989890 conn(0x7fd4d8079350 msgr2=0x7fd4d8079760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:06:33.202 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.202+0000 7fd4e0400700 1 -- 172.21.15.82:0/2508989890 shutdown_connections 2024-05-08T06:06:33.203 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.202+0000 7fd4e0400700 1 -- 172.21.15.82:0/2508989890 wait complete. 2024-05-08T06:06:33.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.203+0000 7fd4e0400700 1 Processor -- start 2024-05-08T06:06:33.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.204+0000 7fd4e0400700 1 -- start start 2024-05-08T06:06:33.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.204+0000 7fd4e0400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4d81023a0 0x7fd4d819f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:33.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.204+0000 7fd4e0400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd4d8102d60 0x7fd4d819fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:33.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.204+0000 7fd4e0400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4d8108410 0x7fd4d81999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:33.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.204+0000 7fd4e0400700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d81125b0 con 0x7fd4d81023a0 2024-05-08T06:06:33.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.204+0000 7fd4e0400700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d8112430 con 0x7fd4d8108410 2024-05-08T06:06:33.204 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.204+0000 7fd4e0400700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d8112730 con 0x7fd4d8102d60 2024-05-08T06:06:33.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.204+0000 7fd4dda00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4d81023a0 0x7fd4d819f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:33.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.204+0000 7fd4dda00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4d81023a0 0x7fd4d819f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:32904/0 (socket says 172.21.15.82:32904) 2024-05-08T06:06:33.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.204+0000 7fd4dda00700 1 -- 172.21.15.82:0/416094111 learned_addr learned my addr 172.21.15.82:0/416094111 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:06:33.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.204+0000 7fd4dd000700 1 --2- 172.21.15.82:0/416094111 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd4d8102d60 0x7fd4d819fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:33.205 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.204+0000 7fd4de400700 1 --2- 172.21.15.82:0/416094111 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4d8108410 0x7fd4d81999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:33.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.205+0000 7fd4dda00700 1 -- 172.21.15.82:0/416094111 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd4d8102d60 msgr2=0x7fd4d819fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:33.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.205+0000 7fd4dda00700 1 --2- 172.21.15.82:0/416094111 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd4d8102d60 0x7fd4d819fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:33.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.205+0000 7fd4dda00700 1 -- 172.21.15.82:0/416094111 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4d8108410 msgr2=0x7fd4d81999e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:33.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.205+0000 7fd4dda00700 1 --2- 172.21.15.82:0/416094111 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4d8108410 0x7fd4d81999e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:33.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.205+0000 7fd4dda00700 1 -- 172.21.15.82:0/416094111 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4d819a140 con 0x7fd4d81023a0 2024-05-08T06:06:33.206 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.205+0000 7fd4dd000700 1 --2- 172.21.15.82:0/416094111 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd4d8102d60 0x7fd4d819fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:06:33.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.205+0000 7fd4dda00700 1 --2- 172.21.15.82:0/416094111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4d81023a0 0x7fd4d819f7d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc009f60 tx=0x7fd4cc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:06:33.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.205+0000 7fd4d6000700 1 -- 172.21.15.82:0/416094111 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc021070 con 0x7fd4d81023a0 2024-05-08T06:06:33.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.206+0000 7fd4d6000700 1 -- 172.21.15.82:0/416094111 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4cc007ac0 con 0x7fd4d81023a0 2024-05-08T06:06:33.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.206+0000 7fd4e0400700 1 -- 172.21.15.82:0/416094111 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4d819a3d0 con 0x7fd4d81023a0 2024-05-08T06:06:33.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.206+0000 7fd4d6000700 1 -- 172.21.15.82:0/416094111 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc005040 con 0x7fd4d81023a0 2024-05-08T06:06:33.207 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.206+0000 7fd4e0400700 1 -- 172.21.15.82:0/416094111 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4d81a66a0 con 0x7fd4d81023a0 2024-05-08T06:06:33.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.209+0000 7fd4d6000700 1 -- 172.21.15.82:0/416094111 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fd4cc024070 con 0x7fd4d81023a0 2024-05-08T06:06:33.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.210+0000 7fd4ead93b80 1 Processor -- start 2024-05-08T06:06:33.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.211+0000 7fd4ead93b80 1 -- start start 2024-05-08T06:06:33.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.211+0000 7fd4ead93b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56517cf03bc0 0x56517cf03fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:33.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.211+0000 7fd4ead93b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56517cf044e0 0x56517cefe2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:33.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.211+0000 7fd4d6000700 1 --2- 172.21.15.82:0/416094111 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd4c00b2900 0x7fd4c00b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:33.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.211+0000 7fd4ead93b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56517cefe8f0 0x56517cefed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:33.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.211+0000 7fd4ead93b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56517ce50a20 con 0x56517cf044e0 2024-05-08T06:06:33.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.211+0000 7fd4ead93b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56517cdee760 con 0x56517cefe8f0 2024-05-08T06:06:33.211 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.211+0000 7fd4ead93b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56517ce4c9e0 con 0x56517cf03bc0 2024-05-08T06:06:33.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.211+0000 7fd4de400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56517cf03bc0 0x56517cf03fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:33.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.211+0000 7fd4d6000700 1 -- 172.21.15.82:0/416094111 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd4cc00f020 con 0x7fd4d81023a0 2024-05-08T06:06:33.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.211+0000 7fd4dd000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56517cf044e0 0x56517cefe2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:33.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.211+0000 7fd4de400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56517cf03bc0 0x56517cf03fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:54872/0 (socket says 172.21.15.82:54872) 2024-05-08T06:06:33.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.211+0000 7fd4de400700 1 -- 172.21.15.82:0/4152555766 learned_addr learned my addr 172.21.15.82:0/4152555766 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:06:33.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.211+0000 7fd4de400700 1 --2- 172.21.15.82:0/4152555766 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56517cefe8f0 0x56517cefed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:33.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.212+0000 7fd4dda00700 1 --2- 172.21.15.82:0/416094111 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd4c00b2900 0x7fd4c00b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:33.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.212+0000 7fd4de400700 1 -- 172.21.15.82:0/4152555766 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56517cefe8f0 msgr2=0x56517cefed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:06:33.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.212+0000 7fd4de400700 1 --2- 172.21.15.82:0/4152555766 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56517cefe8f0 0x56517cefed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:33.212 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.212+0000 7fd4de400700 1 -- 172.21.15.82:0/4152555766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56517cf044e0 msgr2=0x56517cefe2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:06:33.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.212+0000 7fd4de400700 1 --2- 172.21.15.82:0/4152555766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56517cf044e0 0x56517cefe2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:33.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.212+0000 7fd4de400700 1 -- 172.21.15.82:0/4152555766 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56517cd9d8d0 con 0x56517cf03bc0 2024-05-08T06:06:33.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.212+0000 7fd4de400700 1 --2- 172.21.15.82:0/4152555766 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56517cf03bc0 0x56517cf03fa0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd4d0009fd0 tx=0x7fd4d0009690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e33a21586df3187 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:06:33.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.212+0000 7fd4dda00700 1 --2- 172.21.15.82:0/416094111 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd4c00b2900 0x7fd4c00b4dc0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc0e10a0 tx=0x7fd4cc009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:06:33.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.212+0000 7fd4caa00700 1 -- 172.21.15.82:0/4152555766 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d0013dc0 con 0x56517cf03bc0 2024-05-08T06:06:33.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.213+0000 7fd4caa00700 1 -- 172.21.15.82:0/4152555766 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4d0004500 con 0x56517cf03bc0 2024-05-08T06:06:33.213 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.213+0000 7fd4caa00700 1 -- 172.21.15.82:0/4152555766 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4d0003df0 con 0x56517cf03bc0 2024-05-08T06:06:33.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.213+0000 7fd4ead93b80 1 -- 172.21.15.82:0/4152555766 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56517cf03bc0 msgr2=0x56517cf03fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:33.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.213+0000 7fd4ead93b80 1 --2- 172.21.15.82:0/4152555766 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56517cf03bc0 0x56517cf03fa0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd4d0009fd0 tx=0x7fd4d0009690 comp rx=0 tx=0).stop 2024-05-08T06:06:33.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.214+0000 7fd4ead93b80 1 -- 172.21.15.82:0/4152555766 shutdown_connections 2024-05-08T06:06:33.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.214+0000 7fd4ead93b80 1 --2- 172.21.15.82:0/4152555766 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56517cefe8f0 0x56517cefed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:33.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.214+0000 7fd4ead93b80 1 --2- 172.21.15.82:0/4152555766 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56517cf03bc0 0x56517cf03fa0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:33.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.214+0000 7fd4ead93b80 1 --2- 172.21.15.82:0/4152555766 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56517cf044e0 0x56517cefe2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:33.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.214+0000 7fd4ead93b80 1 -- 172.21.15.82:0/4152555766 >> 172.21.15.82:0/4152555766 conn(0x56517ce766d0 msgr2=0x56517cef8b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:06:33.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.214+0000 7fd4ead93b80 1 -- 172.21.15.82:0/4152555766 shutdown_connections 2024-05-08T06:06:33.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.214+0000 7fd4ead93b80 1 -- 172.21.15.82:0/4152555766 wait complete. 2024-05-08T06:06:33.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.214+0000 7fd4ead93b80 1 -- start start 2024-05-08T06:06:33.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.214+0000 7fd4ead93b80 1 Processor -- start 2024-05-08T06:06:33.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.215+0000 7fd4ead93b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56517cefe8f0 0x56517cf11e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:33.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.215+0000 7fd4ead93b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56517cf03bc0 0x56517cf12360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:33.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.215+0000 7fd4ead93b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56517cf044e0 0x56517cf0c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:33.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.215+0000 7fd4ead93b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x56517cf0aec0 con 0x56517cefe8f0 2024-05-08T06:06:33.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.215+0000 7fd4ead93b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56517cdb6b20 con 0x56517cf03bc0 2024-05-08T06:06:33.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.215+0000 7fd4ead93b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56517cf0b040 con 0x56517cf044e0 2024-05-08T06:06:33.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.215+0000 7fd4ead93b80 10 client.0 _ll_register_callbacks cb 0x56517cdf7c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:06:33.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.215+0000 7fd4dd000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56517cf03bc0 0x56517cf12360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:33.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.215+0000 7fd4de400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56517cefe8f0 0x56517cf11e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:33.216 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.215+0000 7fd4dd000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56517cf03bc0 0x56517cf12360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:38678/0 (socket says 172.21.15.82:38678) 2024-05-08T06:06:33.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.215+0000 7fd4dd000700 1 -- 172.21.15.82:0/3031361833 learned_addr learned my addr 172.21.15.82:0/3031361833 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:06:33.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.215+0000 7fd4de400700 1 --2- 172.21.15.82:0/3031361833 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56517cf044e0 0x56517cf0c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:33.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.216+0000 7fd4dd000700 1 -- 172.21.15.82:0/3031361833 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56517cf044e0 msgr2=0x56517cf0c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:06:33.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.216+0000 7fd4dd000700 1 --2- 172.21.15.82:0/3031361833 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56517cf044e0 0x56517cf0c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:33.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.216+0000 7fd4dd000700 1 -- 172.21.15.82:0/3031361833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56517cefe8f0 msgr2=0x56517cf11e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:06:33.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.216+0000 7fd4dd000700 1 --2- 172.21.15.82:0/3031361833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56517cefe8f0 0x56517cf11e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:33.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.216+0000 7fd4dd000700 1 -- 172.21.15.82:0/3031361833 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56517ce16420 con 0x56517cf03bc0 2024-05-08T06:06:33.217 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.216+0000 7fd4de400700 1 --2- 172.21.15.82:0/3031361833 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56517cf044e0 0x56517cf0c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:06:33.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.216+0000 7fd4dd000700 1 --2- 172.21.15.82:0/3031361833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56517cf03bc0 0x56517cf12360 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4012d20 tx=0x7fd4c400f6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac695fee428f42d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:06:33.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.216+0000 7fd4bf400700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T06:06:33.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.216+0000 7fd4bf400700 1 -- 172.21.15.82:0/3031361833 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c400fc30 con 0x56517cf03bc0 2024-05-08T06:06:33.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.216+0000 7fd4ead93b80 1 -- 172.21.15.82:0/3031361833 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4d0004500 con 0x56517cf03bc0 2024-05-08T06:06:33.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.217+0000 7fd4bf400700 1 -- 172.21.15.82:0/3031361833 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd4c400fdd0 con 0x56517cf03bc0 2024-05-08T06:06:33.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.217+0000 7fd4bf400700 1 -- 172.21.15.82:0/3031361833 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fd4c4004050 con 0x56517cf03bc0 2024-05-08T06:06:33.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.217+0000 7fd4ead93b80 10 client.26951 fetch_fsmap learned FSMap version 31 2024-05-08T06:06:33.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.217+0000 7fd4ead93b80 1 -- 172.21.15.82:0/3031361833 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56517cf19c30 con 0x56517cf03bc0 2024-05-08T06:06:33.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.217+0000 7fd4bf400700 1 -- 172.21.15.82:0/3031361833 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4d0004500 con 0x56517cf03bc0 2024-05-08T06:06:33.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.218+0000 7fd4bf400700 1 -- 172.21.15.82:0/3031361833 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fd4c4010430 con 0x56517cf03bc0 2024-05-08T06:06:33.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.218+0000 7fd4ead93b80 10 client.26951 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:06:33.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.218+0000 7fd4ead93b80 10 client.26951 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-05-08T06:06:33.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.218+0000 7fd4ead93b80 20 client.26951 populate_metadata read hostname 'smithi082' 2024-05-08T06:06:33.219 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.218+0000 7fd4ead93b80 1 --2- 172.21.15.82:0/3031361833 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x56517cf1c270 0x56517cf1e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:33.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.218+0000 7fd4ead93b80 4 client.26951 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:06:33.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.218+0000 7fd4ead93b80 1 -- 172.21.15.82:0/3031361833 --> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56517cecb140 con 0x56517cf1c270 2024-05-08T06:06:33.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.218+0000 7fd4de400700 1 --2- 172.21.15.82:0/3031361833 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x56517cf1c270 0x56517cf1e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:33.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.219+0000 7fd4de400700 1 --2- 172.21.15.82:0/3031361833 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x56517cf1c270 0x56517cf1e660 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=400b20e4b50db7d7 server_cookie=8aa79e7a5a8ed8ae in_seq=0 out_seq=0 2024-05-08T06:06:33.220 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.219+0000 7fd4bf400700 10 client.26951 ms_handle_connect on v2:172.21.15.151:6834/2093655929 2024-05-08T06:06:33.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.220+0000 7fd4bf400700 1 -- 172.21.15.82:0/3031361833 <== mds.3 v2:172.21.15.151:6834/2093655929 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56517cecb140 con 0x56517cf1c270 2024-05-08T06:06:33.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.220+0000 7fd4bf400700 10 client.26951 handle_command_reply: tid=0 2024-05-08T06:06:33.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.220+0000 7fd4ead93b80 1 client.26951 shutdown 2024-05-08T06:06:33.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.220+0000 7fd4ead93b80 1 -- 172.21.15.82:0/3031361833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56517cf03bc0 msgr2=0x56517cf12360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:33.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.220+0000 7fd4ead93b80 1 --2- 172.21.15.82:0/3031361833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56517cf03bc0 0x56517cf12360 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4012d20 tx=0x7fd4c400f6a0 comp rx=0 tx=0).stop 2024-05-08T06:06:33.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.220+0000 7fd4ead93b80 1 -- 172.21.15.82:0/3031361833 shutdown_connections 2024-05-08T06:06:33.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.220+0000 7fd4ead93b80 1 --2- 172.21.15.82:0/3031361833 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x56517cf1c270 0x56517cf1e660 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:33.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.220+0000 7fd4ead93b80 1 --2- 172.21.15.82:0/3031361833 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56517cf044e0 0x56517cf0c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:33.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.220+0000 7fd4ead93b80 1 --2- 172.21.15.82:0/3031361833 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56517cefe8f0 0x56517cf11e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:33.221 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.220+0000 7fd4ead93b80 1 --2- 172.21.15.82:0/3031361833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56517cf03bc0 0x56517cf12360 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:33.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.220+0000 7fd4bf400700 0 client.26951 ms_handle_reset on v2:172.21.15.151:6834/2093655929 2024-05-08T06:06:33.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.220+0000 7fd4ead93b80 1 -- 172.21.15.82:0/3031361833 >> 172.21.15.82:0/3031361833 conn(0x56517ce766d0 msgr2=0x56517cef8190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:06:33.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.220+0000 7fd4ead93b80 1 -- 172.21.15.82:0/3031361833 shutdown_connections 2024-05-08T06:06:33.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.220+0000 7fd4ead93b80 1 -- 172.21.15.82:0/3031361833 wait complete. 2024-05-08T06:06:33.222 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.220+0000 7fd4ead93b80 20 client.26951 trim_cache size 0 max 16384 2024-05-08T06:06:33.236 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.237+0000 7fd4ead93b80 1 Processor -- start 2024-05-08T06:06:33.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.237+0000 7fd4ead93b80 1 -- start start 2024-05-08T06:06:33.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.237+0000 7fd4ead93b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56517cefe8f0 0x56517cf0c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:33.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.237+0000 7fd4ead93b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56517cf03bc0 0x56517ceffe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:33.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.237+0000 7fd4ead93b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56517cf044e0 0x56517cf23f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:33.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.237+0000 7fd4ead93b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d81ab7b0 con 0x56517cf044e0 2024-05-08T06:06:33.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.237+0000 7fd4ead93b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d81ad2f0 con 0x56517cf03bc0 2024-05-08T06:06:33.237 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.237+0000 7fd4ead93b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d81abe80 con 0x56517cefe8f0 2024-05-08T06:06:33.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.237+0000 7fd4de400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56517cf044e0 0x56517cf23f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:33.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.237+0000 7fd4de400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56517cf044e0 0x56517cf23f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:32940/0 (socket says 172.21.15.82:32940) 2024-05-08T06:06:33.239 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.238+0000 7fd4de400700 1 -- 172.21.15.82:0/433862495 learned_addr learned my addr 172.21.15.82:0/433862495 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:06:33.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.238+0000 7fd4dd000700 1 --2- 172.21.15.82:0/433862495 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56517cf03bc0 0x56517ceffe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:33.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.238+0000 7fd4de400700 1 --2- 172.21.15.82:0/433862495 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56517cefe8f0 0x56517cf0c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:33.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.238+0000 7fd4dd000700 1 -- 172.21.15.82:0/433862495 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56517cefe8f0 msgr2=0x56517cf0c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:06:33.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.238+0000 7fd4dd000700 1 --2- 172.21.15.82:0/433862495 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56517cefe8f0 0x56517cf0c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:33.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.238+0000 7fd4dd000700 1 -- 172.21.15.82:0/433862495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56517cf044e0 msgr2=0x56517cf23f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:06:33.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.238+0000 7fd4dd000700 1 --2- 172.21.15.82:0/433862495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56517cf044e0 0x56517cf23f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:33.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.238+0000 7fd4dd000700 1 -- 172.21.15.82:0/433862495 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56517cf02c90 con 0x56517cf03bc0 2024-05-08T06:06:33.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.238+0000 7fd4de400700 1 --2- 172.21.15.82:0/433862495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56517cf044e0 0x56517cf23f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:06:33.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.238+0000 7fd4dd000700 1 --2- 172.21.15.82:0/433862495 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56517cf03bc0 0x56517ceffe10 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4010850 tx=0x7fd4c4010d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b7351aa5221f3b9 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:06:33.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.239+0000 7fd4ca000700 1 -- 172.21.15.82:0/433862495 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c4010430 con 0x56517cf03bc0 2024-05-08T06:06:33.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.239+0000 7fd4ca000700 1 -- 172.21.15.82:0/433862495 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4c40105d0 con 0x56517cf03bc0 2024-05-08T06:06:33.240 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.239+0000 7fd4ca000700 1 -- 172.21.15.82:0/433862495 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c40038e0 con 0x56517cf03bc0 2024-05-08T06:06:33.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.239+0000 7fd4ead93b80 1 -- 172.21.15.82:0/433862495 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56517cf03bc0 msgr2=0x56517ceffe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:33.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.239+0000 7fd4ead93b80 1 --2- 172.21.15.82:0/433862495 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56517cf03bc0 0x56517ceffe10 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fd4c4010850 tx=0x7fd4c4010d70 comp rx=0 tx=0).stop 2024-05-08T06:06:33.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.239+0000 7fd4ead93b80 1 -- 172.21.15.82:0/433862495 shutdown_connections 2024-05-08T06:06:33.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.239+0000 7fd4ead93b80 1 --2- 172.21.15.82:0/433862495 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56517cf044e0 0x56517cf23f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:33.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.239+0000 7fd4ead93b80 1 --2- 172.21.15.82:0/433862495 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56517cefe8f0 0x56517cf0c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:33.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.239+0000 7fd4ead93b80 1 --2- 172.21.15.82:0/433862495 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56517cf03bc0 0x56517ceffe10 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:33.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.239+0000 7fd4ead93b80 1 -- 172.21.15.82:0/433862495 >> 172.21.15.82:0/433862495 conn(0x56517ce766d0 msgr2=0x56517ceff700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:06:33.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.239+0000 7fd4ead93b80 1 -- 172.21.15.82:0/433862495 shutdown_connections 2024-05-08T06:06:33.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.239+0000 7fd4ead93b80 1 -- 172.21.15.82:0/433862495 wait complete. 2024-05-08T06:06:33.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.240+0000 7fd4ead93b80 1 -- start start 2024-05-08T06:06:33.241 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.240+0000 7fd4ead93b80 1 Processor -- start 2024-05-08T06:06:33.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.241+0000 7fd4ead93b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56517cefe8f0 0x56517cf18610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:33.244 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.241+0000 7fd4ead93b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56517cf03bc0 0x56517cf13990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:33.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.241+0000 7fd4ead93b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56517cf044e0 0x56517cf13ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:33.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.241+0000 7fd4ead93b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d81acc20 con 0x56517cf03bc0 2024-05-08T06:06:33.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.241+0000 7fd4ead93b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d81ac550 con 0x56517cf044e0 2024-05-08T06:06:33.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.241+0000 7fd4ead93b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd4d81a9750 con 0x56517cefe8f0 2024-05-08T06:06:33.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.241+0000 7fd4ead93b80 10 client.0 _ll_register_callbacks cb 0x56517cdf7c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:06:33.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.241+0000 7fd4dd000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56517cf03bc0 0x56517cf13990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:33.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.241+0000 7fd4dd000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56517cf03bc0 0x56517cf13990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:32942/0 (socket says 172.21.15.82:32942) 2024-05-08T06:06:33.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.241+0000 7fd4dd000700 1 -- 172.21.15.82:0/2184981874 learned_addr learned my addr 172.21.15.82:0/2184981874 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:06:33.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.241+0000 7fd4de400700 1 --2- 172.21.15.82:0/2184981874 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56517cefe8f0 0x56517cf18610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:33.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.241+0000 7fd4de400700 1 --2- 172.21.15.82:0/2184981874 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56517cf044e0 0x56517cf13ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:33.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.241+0000 7fd4dd000700 1 -- 172.21.15.82:0/2184981874 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56517cefe8f0 msgr2=0x56517cf18610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:06:33.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.241+0000 7fd4dd000700 1 --2- 172.21.15.82:0/2184981874 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56517cefe8f0 0x56517cf18610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:33.245 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.241+0000 7fd4dd000700 1 -- 172.21.15.82:0/2184981874 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56517cf044e0 msgr2=0x56517cf13ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:06:33.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.241+0000 7fd4dd000700 1 --2- 172.21.15.82:0/2184981874 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56517cf044e0 0x56517cf13ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:33.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.241+0000 7fd4dd000700 1 -- 172.21.15.82:0/2184981874 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56517cf14410 con 0x56517cf03bc0 2024-05-08T06:06:33.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.241+0000 7fd4de400700 1 --2- 172.21.15.82:0/2184981874 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56517cf044e0 0x56517cf13ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-08T06:06:33.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.242+0000 7fd4dd000700 1 --2- 172.21.15.82:0/2184981874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56517cf03bc0 0x56517cf13990 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd4c40109c0 tx=0x7fd4c4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=283f402b001f3a03 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:06:33.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.242+0000 7fd4bf400700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T06:06:33.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.242+0000 7fd4bf400700 1 -- 172.21.15.82:0/2184981874 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4c40054a0 con 0x56517cf03bc0 2024-05-08T06:06:33.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.242+0000 7fd4ead93b80 1 -- 172.21.15.82:0/2184981874 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd4c40105d0 con 0x56517cf03bc0 2024-05-08T06:06:33.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.242+0000 7fd4bf400700 1 -- 172.21.15.82:0/2184981874 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fd4c4005640 con 0x56517cf03bc0 2024-05-08T06:06:33.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.242+0000 7fd4bf400700 1 -- 172.21.15.82:0/2184981874 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fd4c4003680 con 0x56517cf03bc0 2024-05-08T06:06:33.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.242+0000 7fd4ead93b80 10 client.16413 fetch_fsmap learned FSMap version 31 2024-05-08T06:06:33.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.242+0000 7fd4ead93b80 1 -- 172.21.15.82:0/2184981874 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56517cf867c0 con 0x56517cf03bc0 2024-05-08T06:06:33.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.243+0000 7fd4bf400700 1 -- 172.21.15.82:0/2184981874 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fd4c40105d0 con 0x56517cf03bc0 2024-05-08T06:06:33.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.243+0000 7fd4bf400700 1 -- 172.21.15.82:0/2184981874 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7fd4c4037020 con 0x56517cf03bc0 2024-05-08T06:06:33.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.243+0000 7fd4ead93b80 10 client.16413 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:06:33.246 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.243+0000 7fd4ead93b80 10 client.16413 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.f 2024-05-08T06:06:33.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.243+0000 7fd4ead93b80 20 client.16413 populate_metadata read hostname 'smithi082' 2024-05-08T06:06:33.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.243+0000 7fd4ead93b80 1 --2- 172.21.15.82:0/2184981874 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x56517cf86e10 0x56517cf89230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:33.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.243+0000 7fd4ead93b80 4 client.16413 mds_command: new command op to 24475 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T06:06:33.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.243+0000 7fd4ead93b80 1 -- 172.21.15.82:0/2184981874 --> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56517ce5e400 con 0x56517cf86e10 2024-05-08T06:06:33.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.243+0000 7fd4de400700 1 --2- 172.21.15.82:0/2184981874 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x56517cf86e10 0x56517cf89230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:33.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.244+0000 7fd4de400700 1 --2- 172.21.15.82:0/2184981874 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x56517cf86e10 0x56517cf89230 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ad02f5b20697da1c server_cookie=db68ae877d953b37 in_seq=0 out_seq=0 2024-05-08T06:06:33.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.244+0000 7fd4bf400700 10 client.16413 ms_handle_connect on v2:172.21.15.151:6834/2093655929 2024-05-08T06:06:33.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.244+0000 7fd4bf400700 1 -- 172.21.15.82:0/2184981874 <== mds.3 v2:172.21.15.151:6834/2093655929 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56517ce5e400 con 0x56517cf86e10 2024-05-08T06:06:33.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.244+0000 7fd4bf400700 10 client.16413 handle_command_reply: tid=0 2024-05-08T06:06:33.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.244+0000 7fd4ead93b80 1 client.16413 shutdown 2024-05-08T06:06:33.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.244+0000 7fd4ead93b80 1 -- 172.21.15.82:0/2184981874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56517cf03bc0 msgr2=0x56517cf13990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:33.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.244+0000 7fd4ead93b80 1 --2- 172.21.15.82:0/2184981874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56517cf03bc0 0x56517cf13990 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd4c40109c0 tx=0x7fd4c4000bc0 comp rx=0 tx=0).stop 2024-05-08T06:06:33.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.244+0000 7fd4ead93b80 1 -- 172.21.15.82:0/2184981874 shutdown_connections 2024-05-08T06:06:33.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.244+0000 7fd4ead93b80 1 --2- 172.21.15.82:0/2184981874 >> [v2:172.21.15.151:6834/2093655929,v1:172.21.15.151:6835/2093655929] conn(0x56517cf86e10 0x56517cf89230 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:33.247 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.245+0000 7fd4ead93b80 1 --2- 172.21.15.82:0/2184981874 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56517cf044e0 0x56517cf13ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:33.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.245+0000 7fd4ead93b80 1 --2- 172.21.15.82:0/2184981874 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56517cefe8f0 0x56517cf18610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:33.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.245+0000 7fd4ead93b80 1 --2- 172.21.15.82:0/2184981874 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x56517cf03bc0 0x56517cf13990 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:33.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.245+0000 7fd4ead93b80 1 -- 172.21.15.82:0/2184981874 >> 172.21.15.82:0/2184981874 conn(0x56517ce766d0 msgr2=0x56517ceffe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:06:33.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.245+0000 7fd4bf400700 0 client.16413 ms_handle_reset on v2:172.21.15.151:6834/2093655929 2024-05-08T06:06:33.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.245+0000 7fd4ead93b80 1 -- 172.21.15.82:0/2184981874 shutdown_connections 2024-05-08T06:06:33.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.245+0000 7fd4ead93b80 1 -- 172.21.15.82:0/2184981874 wait complete. 2024-05-08T06:06:33.248 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.245+0000 7fd4ead93b80 20 client.16413 trim_cache size 0 max 16384 2024-05-08T06:06:33.248 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T06:06:33.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.246+0000 7fd4e0400700 1 -- 172.21.15.82:0/416094111 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd4c00b2900 msgr2=0x7fd4c00b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:33.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.246+0000 7fd4e0400700 1 --2- 172.21.15.82:0/416094111 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd4c00b2900 0x7fd4c00b4dc0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc0e10a0 tx=0x7fd4cc009040 comp rx=0 tx=0).stop 2024-05-08T06:06:33.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.246+0000 7fd4e0400700 1 -- 172.21.15.82:0/416094111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4d81023a0 msgr2=0x7fd4d819f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:33.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.246+0000 7fd4e0400700 1 --2- 172.21.15.82:0/416094111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4d81023a0 0x7fd4d819f7d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc009f60 tx=0x7fd4cc00ccb0 comp rx=0 tx=0).stop 2024-05-08T06:06:33.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.246+0000 7fd4e0400700 1 -- 172.21.15.82:0/416094111 shutdown_connections 2024-05-08T06:06:33.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.246+0000 7fd4e0400700 1 --2- 172.21.15.82:0/416094111 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4d8108410 0x7fd4d81999e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:33.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.246+0000 7fd4e0400700 1 --2- 172.21.15.82:0/416094111 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fd4c00b2900 0x7fd4c00b4dc0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:33.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.246+0000 7fd4e0400700 1 --2- 172.21.15.82:0/416094111 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fd4d81023a0 0x7fd4d819f7d0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:33.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.246+0000 7fd4e0400700 1 --2- 172.21.15.82:0/416094111 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd4d8102d60 0x7fd4d819fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:33.249 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.246+0000 7fd4e0400700 1 -- 172.21.15.82:0/416094111 >> 172.21.15.82:0/416094111 conn(0x7fd4d8079350 msgr2=0x7fd4d81016a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:06:33.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.246+0000 7fd4e0400700 1 -- 172.21.15.82:0/416094111 shutdown_connections 2024-05-08T06:06:33.250 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:33.246+0000 7fd4e0400700 1 -- 172.21.15.82:0/416094111 wait complete. 2024-05-08T06:06:33.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:06:33 smithi082 ceph-mon[30098]: pgmap v936: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 20 KiB/s wr, 10 op/s 2024-05-08T06:06:34.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:06:33 smithi134 ceph-mon[34132]: pgmap v936: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 20 KiB/s wr, 10 op/s 2024-05-08T06:06:34.122 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-05-08T06:06:34.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:06:33 smithi151 ceph-mon[34815]: pgmap v936: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 20 KiB/s wr, 10 op/s 2024-05-08T06:06:34.558 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:06:35.898 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:06:35 smithi082 ceph-mon[30098]: pgmap v937: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 20 KiB/s wr, 10 op/s 2024-05-08T06:06:35.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:06:35 smithi134 ceph-mon[34132]: pgmap v937: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 20 KiB/s wr, 10 op/s 2024-05-08T06:06:36.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:06:35 smithi151 ceph-mon[34815]: pgmap v937: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 20 KiB/s wr, 10 op/s 2024-05-08T06:06:36.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.901+0000 7f8d8cc00700 1 -- 172.21.15.82:0/2424387285 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d88106050 msgr2=0x7f8d88112560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:36.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.901+0000 7f8d8cc00700 1 --2- 172.21.15.82:0/2424387285 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d88106050 0x7f8d88112560 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f8d80009f90 tx=0x7f8d8000b330 comp rx=0 tx=0).stop 2024-05-08T06:06:36.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.901+0000 7f8d8cc00700 1 -- 172.21.15.82:0/2424387285 shutdown_connections 2024-05-08T06:06:36.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.902+0000 7f8d8cc00700 1 --2- 172.21.15.82:0/2424387285 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d88106050 0x7f8d88112560 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:36.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.902+0000 7f8d8cc00700 1 --2- 172.21.15.82:0/2424387285 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d8810b690 0x7f8d8810ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:36.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.902+0000 7f8d8cc00700 1 --2- 172.21.15.82:0/2424387285 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d88105690 0x7f8d88105b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:36.902 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.902+0000 7f8d8cc00700 1 -- 172.21.15.82:0/2424387285 >> 172.21.15.82:0/2424387285 conn(0x7f8d88101180 msgr2=0x7f8d881035a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:06:36.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.902+0000 7f8d8cc00700 1 -- 172.21.15.82:0/2424387285 shutdown_connections 2024-05-08T06:06:36.903 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.902+0000 7f8d8cc00700 1 -- 172.21.15.82:0/2424387285 wait complete. 2024-05-08T06:06:36.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.903+0000 7f8d8cc00700 1 Processor -- start 2024-05-08T06:06:36.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.903+0000 7f8d8cc00700 1 -- start start 2024-05-08T06:06:36.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.904+0000 7f8d8cc00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d88105690 0x7f8d881a1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:36.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.904+0000 7f8d8cc00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d88106050 0x7f8d881a1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:36.904 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.904+0000 7f8d8cc00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d8810b690 0x7f8d8819bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:36.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.904+0000 7f8d8cc00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8d88115920 con 0x7f8d88105690 2024-05-08T06:06:36.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.904+0000 7f8d8cc00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8d881157a0 con 0x7f8d88106050 2024-05-08T06:06:36.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.904+0000 7f8d8cc00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8d88115aa0 con 0x7f8d8810b690 2024-05-08T06:06:36.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.904+0000 7f8d85e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d88105690 0x7f8d881a1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:36.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.904+0000 7f8d85e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d88105690 0x7f8d881a1a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:32962/0 (socket says 172.21.15.82:32962) 2024-05-08T06:06:36.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.904+0000 7f8d85e00700 1 -- 172.21.15.82:0/2976841304 learned_addr learned my addr 172.21.15.82:0/2976841304 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:06:36.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.904+0000 7f8d85400700 1 --2- 172.21.15.82:0/2976841304 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d88106050 0x7f8d881a1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:36.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.904+0000 7f8d86800700 1 --2- 172.21.15.82:0/2976841304 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d8810b690 0x7f8d8819bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:36.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.905+0000 7f8d85e00700 1 -- 172.21.15.82:0/2976841304 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d8810b690 msgr2=0x7f8d8819bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:36.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.905+0000 7f8d85e00700 1 --2- 172.21.15.82:0/2976841304 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d8810b690 0x7f8d8819bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:36.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.905+0000 7f8d85e00700 1 -- 172.21.15.82:0/2976841304 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d88106050 msgr2=0x7f8d881a1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:36.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.905+0000 7f8d85e00700 1 --2- 172.21.15.82:0/2976841304 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d88106050 0x7f8d881a1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:36.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.905+0000 7f8d85e00700 1 -- 172.21.15.82:0/2976841304 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d8819c460 con 0x7f8d88105690 2024-05-08T06:06:36.905 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.905+0000 7f8d86800700 1 --2- 172.21.15.82:0/2976841304 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d8810b690 0x7f8d8819bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:06:36.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.905+0000 7f8d85400700 1 --2- 172.21.15.82:0/2976841304 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d88106050 0x7f8d881a1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:06:36.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.905+0000 7f8d85e00700 1 --2- 172.21.15.82:0/2976841304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d88105690 0x7f8d881a1a60 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f8d7800e9a0 tx=0x7f8d7800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:06:36.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.905+0000 7f8d7ea00700 1 -- 172.21.15.82:0/2976841304 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7800ca10 con 0x7f8d88105690 2024-05-08T06:06:36.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.905+0000 7f8d7ea00700 1 -- 172.21.15.82:0/2976841304 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d7800cbb0 con 0x7f8d88105690 2024-05-08T06:06:36.906 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.905+0000 7f8d7ea00700 1 -- 172.21.15.82:0/2976841304 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d78018680 con 0x7f8d88105690 2024-05-08T06:06:36.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.905+0000 7f8d8cc00700 1 -- 172.21.15.82:0/2976841304 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d8819c750 con 0x7f8d88105690 2024-05-08T06:06:36.907 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.905+0000 7f8d8cc00700 1 -- 172.21.15.82:0/2976841304 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d881a89e0 con 0x7f8d88105690 2024-05-08T06:06:36.908 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.909+0000 7f8d7ea00700 1 -- 172.21.15.82:0/2976841304 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f8d78010430 con 0x7f8d88105690 2024-05-08T06:06:36.909 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.910+0000 7f8d9754db80 1 Processor -- start 2024-05-08T06:06:36.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.910+0000 7f8d9754db80 1 -- start start 2024-05-08T06:06:36.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.911+0000 7f8d9754db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab4d4f1bc0 0x55ab4d4f1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:36.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.911+0000 7f8d9754db80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ab4d4f24e0 0x55ab4d4ec2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:36.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.911+0000 7f8d9754db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab4d4ec8f0 0x55ab4d4ecd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:36.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.911+0000 7f8d9754db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55ab4d43ea20 con 0x55ab4d4f1bc0 2024-05-08T06:06:36.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.911+0000 7f8d9754db80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ab4d3dc760 con 0x55ab4d4f24e0 2024-05-08T06:06:36.910 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.911+0000 7f8d9754db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ab4d43a9e0 con 0x55ab4d4ec8f0 2024-05-08T06:06:36.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.911+0000 7f8d86800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab4d4f1bc0 0x55ab4d4f1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:36.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.911+0000 7f8d7ea00700 1 --2- 172.21.15.82:0/2976841304 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f8d6c0b2880 0x7f8d6c0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:36.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.911+0000 7f8d86800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab4d4f1bc0 0x55ab4d4f1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:32964/0 (socket says 172.21.15.82:32964) 2024-05-08T06:06:36.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.911+0000 7f8d86800700 1 -- 172.21.15.82:0/411015635 learned_addr learned my addr 172.21.15.82:0/411015635 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:06:36.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.911+0000 7f8d85400700 1 --2- 172.21.15.82:0/411015635 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab4d4ec8f0 0x55ab4d4ecd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:36.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.911+0000 7f8d85e00700 1 --2- 172.21.15.82:0/411015635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ab4d4f24e0 0x55ab4d4ec2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:36.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.911+0000 7f8d7ea00700 1 -- 172.21.15.82:0/2976841304 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f8d780e2370 con 0x7f8d88105690 2024-05-08T06:06:36.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.912+0000 7f8d86800700 1 --2- 172.21.15.82:0/2976841304 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f8d6c0b2880 0x7f8d6c0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:36.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.912+0000 7f8d85400700 1 -- 172.21.15.82:0/411015635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ab4d4f24e0 msgr2=0x55ab4d4ec2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:06:36.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.912+0000 7f8d85400700 1 --2- 172.21.15.82:0/411015635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ab4d4f24e0 0x55ab4d4ec2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:36.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.912+0000 7f8d85400700 1 -- 172.21.15.82:0/411015635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab4d4f1bc0 msgr2=0x55ab4d4f1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:06:36.912 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.912+0000 7f8d85400700 1 --2- 172.21.15.82:0/411015635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab4d4f1bc0 0x55ab4d4f1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:36.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.912+0000 7f8d85400700 1 -- 172.21.15.82:0/411015635 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab4d38b8d0 con 0x55ab4d4ec8f0 2024-05-08T06:06:36.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.912+0000 7f8d85400700 1 --2- 172.21.15.82:0/411015635 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab4d4ec8f0 0x55ab4d4ecd70 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f8d8819d310 tx=0x7f8d740118a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72d55bf95fbf00a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:06:36.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.912+0000 7f8d86800700 1 --2- 172.21.15.82:0/2976841304 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f8d6c0b2880 0x7f8d6c0b4d40 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f8d80006090 tx=0x7f8d8000b330 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:06:36.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.912+0000 7f8d73400700 1 -- 172.21.15.82:0/411015635 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d74004230 con 0x55ab4d4ec8f0 2024-05-08T06:06:36.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.912+0000 7f8d73400700 1 -- 172.21.15.82:0/411015635 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d74004ce0 con 0x55ab4d4ec8f0 2024-05-08T06:06:36.913 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.912+0000 7f8d73400700 1 -- 172.21.15.82:0/411015635 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d740056c0 con 0x55ab4d4ec8f0 2024-05-08T06:06:36.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.913+0000 7f8d9754db80 1 -- 172.21.15.82:0/411015635 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab4d4ec8f0 msgr2=0x55ab4d4ecd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:36.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.913+0000 7f8d9754db80 1 --2- 172.21.15.82:0/411015635 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab4d4ec8f0 0x55ab4d4ecd70 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f8d8819d310 tx=0x7f8d740118a0 comp rx=0 tx=0).stop 2024-05-08T06:06:36.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.913+0000 7f8d9754db80 1 -- 172.21.15.82:0/411015635 shutdown_connections 2024-05-08T06:06:36.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.913+0000 7f8d9754db80 1 --2- 172.21.15.82:0/411015635 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab4d4ec8f0 0x55ab4d4ecd70 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:36.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.913+0000 7f8d9754db80 1 --2- 172.21.15.82:0/411015635 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab4d4f1bc0 0x55ab4d4f1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:36.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.913+0000 7f8d9754db80 1 --2- 172.21.15.82:0/411015635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ab4d4f24e0 0x55ab4d4ec2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:36.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.913+0000 7f8d9754db80 1 -- 172.21.15.82:0/411015635 >> 172.21.15.82:0/411015635 conn(0x55ab4d4646d0 msgr2=0x55ab4d4e6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:06:36.914 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.913+0000 7f8d9754db80 1 -- 172.21.15.82:0/411015635 shutdown_connections 2024-05-08T06:06:36.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.913+0000 7f8d9754db80 1 -- 172.21.15.82:0/411015635 wait complete. 2024-05-08T06:06:36.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.914+0000 7f8d9754db80 1 -- start start 2024-05-08T06:06:36.915 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.914+0000 7f8d9754db80 1 Processor -- start 2024-05-08T06:06:36.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.915+0000 7f8d9754db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab4d4ec8f0 0x55ab4d4f8180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:36.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.915+0000 7f8d9754db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab4d4f1bc0 0x55ab4d4f5520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:36.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.915+0000 7f8d9754db80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ab4d4f24e0 0x55ab4d4f5a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:36.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.915+0000 7f8d9754db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55ab4d4f8f20 con 0x55ab4d4f1bc0 2024-05-08T06:06:36.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.915+0000 7f8d9754db80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ab4d3a4b20 con 0x55ab4d4f24e0 2024-05-08T06:06:36.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.915+0000 7f8d9754db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ab4d4f90a0 con 0x55ab4d4ec8f0 2024-05-08T06:06:36.916 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.915+0000 7f8d9754db80 10 client.0 _ll_register_callbacks cb 0x55ab4d3e5c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:06:36.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.915+0000 7f8d85e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab4d4ec8f0 0x55ab4d4f8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:36.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.915+0000 7f8d85400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab4d4f1bc0 0x55ab4d4f5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:36.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.915+0000 7f8d85e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab4d4ec8f0 0x55ab4d4f8180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:54914/0 (socket says 172.21.15.82:54914) 2024-05-08T06:06:36.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.915+0000 7f8d85e00700 1 -- 172.21.15.82:0/1670182315 learned_addr learned my addr 172.21.15.82:0/1670182315 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:06:36.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.915+0000 7f8d86800700 1 --2- 172.21.15.82:0/1670182315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ab4d4f24e0 0x55ab4d4f5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:36.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.916+0000 7f8d85e00700 1 -- 172.21.15.82:0/1670182315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ab4d4f24e0 msgr2=0x55ab4d4f5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:06:36.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.916+0000 7f8d85e00700 1 --2- 172.21.15.82:0/1670182315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ab4d4f24e0 0x55ab4d4f5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:36.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.916+0000 7f8d85e00700 1 -- 172.21.15.82:0/1670182315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab4d4f1bc0 msgr2=0x55ab4d4f5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:06:36.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.916+0000 7f8d85e00700 1 --2- 172.21.15.82:0/1670182315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab4d4f1bc0 0x55ab4d4f5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:36.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.916+0000 7f8d85e00700 1 -- 172.21.15.82:0/1670182315 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab4d404420 con 0x55ab4d4ec8f0 2024-05-08T06:06:36.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.916+0000 7f8d85e00700 1 --2- 172.21.15.82:0/1670182315 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab4d4ec8f0 0x55ab4d4f8180 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f8d780a9640 tx=0x7f8d7801dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=614bd7cc6f5b7103 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:06:36.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.916+0000 7f8d67e00700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T06:06:36.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.916+0000 7f8d67e00700 1 -- 172.21.15.82:0/1670182315 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d780b20e0 con 0x55ab4d4ec8f0 2024-05-08T06:06:36.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.916+0000 7f8d67e00700 1 -- 172.21.15.82:0/1670182315 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f8d780cc0d0 con 0x55ab4d4ec8f0 2024-05-08T06:06:36.917 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.916+0000 7f8d9754db80 1 -- 172.21.15.82:0/1670182315 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d74004ce0 con 0x55ab4d4ec8f0 2024-05-08T06:06:36.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.917+0000 7f8d67e00700 1 -- 172.21.15.82:0/1670182315 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f8d780a9450 con 0x55ab4d4ec8f0 2024-05-08T06:06:36.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.917+0000 7f8d9754db80 10 client.26995 fetch_fsmap learned FSMap version 31 2024-05-08T06:06:36.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.917+0000 7f8d9754db80 1 -- 172.21.15.82:0/1670182315 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55ab4d5037a0 con 0x55ab4d4ec8f0 2024-05-08T06:06:36.918 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.917+0000 7f8d67e00700 1 -- 172.21.15.82:0/1670182315 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d74004ce0 con 0x55ab4d4ec8f0 2024-05-08T06:06:36.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.917+0000 7f8d67e00700 1 -- 172.21.15.82:0/1670182315 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f8d780b2310 con 0x55ab4d4ec8f0 2024-05-08T06:06:36.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.917+0000 7f8d9754db80 10 client.26995 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:06:36.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.917+0000 7f8d9754db80 10 client.26995 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-05-08T06:06:36.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.917+0000 7f8d9754db80 20 client.26995 populate_metadata read hostname 'smithi082' 2024-05-08T06:06:36.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.917+0000 7f8d9754db80 1 --2- 172.21.15.82:0/1670182315 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55ab4d505d30 0x55ab4d508120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:36.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.917+0000 7f8d9754db80 4 client.26995 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:06:36.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.917+0000 7f8d9754db80 1 -- 172.21.15.82:0/1670182315 --> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ab4d4b9140 con 0x55ab4d505d30 2024-05-08T06:06:36.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.918+0000 7f8d85400700 1 --2- 172.21.15.82:0/1670182315 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55ab4d505d30 0x55ab4d508120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:36.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.918+0000 7f8d85400700 1 --2- 172.21.15.82:0/1670182315 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55ab4d505d30 0x55ab4d508120 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b81147410c77a5c9 server_cookie=c26e448c20f6cc65 in_seq=0 out_seq=0 2024-05-08T06:06:36.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.918+0000 7f8d67e00700 10 client.26995 ms_handle_connect on v2:172.21.15.151:6836/4192404464 2024-05-08T06:06:36.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.919+0000 7f8d67e00700 1 -- 172.21.15.82:0/1670182315 <== mds.2 v2:172.21.15.151:6836/4192404464 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55ab4d4b9140 con 0x55ab4d505d30 2024-05-08T06:06:36.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.919+0000 7f8d67e00700 10 client.26995 handle_command_reply: tid=0 2024-05-08T06:06:36.920 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.919+0000 7f8d9754db80 1 client.26995 shutdown 2024-05-08T06:06:36.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.919+0000 7f8d9754db80 1 -- 172.21.15.82:0/1670182315 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab4d4ec8f0 msgr2=0x55ab4d4f8180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:36.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.919+0000 7f8d9754db80 1 --2- 172.21.15.82:0/1670182315 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab4d4ec8f0 0x55ab4d4f8180 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f8d780a9640 tx=0x7f8d7801dc60 comp rx=0 tx=0).stop 2024-05-08T06:06:36.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.920+0000 7f8d9754db80 1 -- 172.21.15.82:0/1670182315 shutdown_connections 2024-05-08T06:06:36.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.920+0000 7f8d9754db80 1 --2- 172.21.15.82:0/1670182315 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55ab4d505d30 0x55ab4d508120 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:36.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.920+0000 7f8d9754db80 1 --2- 172.21.15.82:0/1670182315 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ab4d4f24e0 0x55ab4d4f5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:36.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.920+0000 7f8d9754db80 1 --2- 172.21.15.82:0/1670182315 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab4d4ec8f0 0x55ab4d4f8180 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:36.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.920+0000 7f8d67e00700 0 client.26995 ms_handle_reset on v2:172.21.15.151:6836/4192404464 2024-05-08T06:06:36.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.920+0000 7f8d9754db80 1 --2- 172.21.15.82:0/1670182315 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab4d4f1bc0 0x55ab4d4f5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:36.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.920+0000 7f8d9754db80 1 -- 172.21.15.82:0/1670182315 >> 172.21.15.82:0/1670182315 conn(0x55ab4d4646d0 msgr2=0x55ab4d4e6190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:06:36.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.920+0000 7f8d9754db80 1 -- 172.21.15.82:0/1670182315 shutdown_connections 2024-05-08T06:06:36.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.920+0000 7f8d9754db80 1 -- 172.21.15.82:0/1670182315 wait complete. 2024-05-08T06:06:36.921 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.920+0000 7f8d9754db80 20 client.26995 trim_cache size 0 max 16384 2024-05-08T06:06:36.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.936+0000 7f8d9754db80 1 Processor -- start 2024-05-08T06:06:36.936 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.936+0000 7f8d9754db80 1 -- start start 2024-05-08T06:06:36.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.937+0000 7f8d9754db80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ab4d4ec8f0 0x55ab4d4ec2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:36.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.937+0000 7f8d9754db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab4d4f1bc0 0x55ab4d501fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:36.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.937+0000 7f8d9754db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab4d4f24e0 0x55ab4d4e6910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:36.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.937+0000 7f8d9754db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8d881afdd0 con 0x55ab4d4f1bc0 2024-05-08T06:06:36.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.937+0000 7f8d9754db80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8d881b1910 con 0x55ab4d4ec8f0 2024-05-08T06:06:36.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.937+0000 7f8d9754db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8d881b04a0 con 0x55ab4d4f24e0 2024-05-08T06:06:36.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.937+0000 7f8d85400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab4d4f1bc0 0x55ab4d501fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:36.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.937+0000 7f8d85400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab4d4f1bc0 0x55ab4d501fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:32984/0 (socket says 172.21.15.82:32984) 2024-05-08T06:06:36.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.937+0000 7f8d85400700 1 -- 172.21.15.82:0/1490285486 learned_addr learned my addr 172.21.15.82:0/1490285486 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:06:36.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.937+0000 7f8d86800700 1 --2- 172.21.15.82:0/1490285486 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab4d4f24e0 0x55ab4d4e6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:36.937 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.937+0000 7f8d85e00700 1 --2- 172.21.15.82:0/1490285486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ab4d4ec8f0 0x55ab4d4ec2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:36.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.937+0000 7f8d85400700 1 -- 172.21.15.82:0/1490285486 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab4d4f24e0 msgr2=0x55ab4d4e6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:06:36.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.937+0000 7f8d85400700 1 --2- 172.21.15.82:0/1490285486 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab4d4f24e0 0x55ab4d4e6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:36.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.938+0000 7f8d85400700 1 -- 172.21.15.82:0/1490285486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ab4d4ec8f0 msgr2=0x55ab4d4ec2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:06:36.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.938+0000 7f8d85400700 1 --2- 172.21.15.82:0/1490285486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ab4d4ec8f0 0x55ab4d4ec2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:36.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.938+0000 7f8d85400700 1 -- 172.21.15.82:0/1490285486 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab4d5087a0 con 0x55ab4d4f1bc0 2024-05-08T06:06:36.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.938+0000 7f8d85e00700 1 --2- 172.21.15.82:0/1490285486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ab4d4ec8f0 0x55ab4d4ec2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:06:36.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.938+0000 7f8d85400700 1 --2- 172.21.15.82:0/1490285486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab4d4f1bc0 0x55ab4d501fb0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x55ab4d4ed2b0 tx=0x7f8d74005260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e41c12e4cdcc1fab server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:06:36.938 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.938+0000 7f8d72a00700 1 -- 172.21.15.82:0/1490285486 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d74005520 con 0x55ab4d4f1bc0 2024-05-08T06:06:36.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.938+0000 7f8d72a00700 1 -- 172.21.15.82:0/1490285486 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f8d740056c0 con 0x55ab4d4f1bc0 2024-05-08T06:06:36.939 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.938+0000 7f8d72a00700 1 -- 172.21.15.82:0/1490285486 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d74019720 con 0x55ab4d4f1bc0 2024-05-08T06:06:36.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.939+0000 7f8d9754db80 1 -- 172.21.15.82:0/1490285486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab4d4f1bc0 msgr2=0x55ab4d501fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:36.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.939+0000 7f8d9754db80 1 --2- 172.21.15.82:0/1490285486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab4d4f1bc0 0x55ab4d501fb0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x55ab4d4ed2b0 tx=0x7f8d74005260 comp rx=0 tx=0).stop 2024-05-08T06:06:36.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.939+0000 7f8d9754db80 1 -- 172.21.15.82:0/1490285486 shutdown_connections 2024-05-08T06:06:36.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.939+0000 7f8d9754db80 1 --2- 172.21.15.82:0/1490285486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ab4d4ec8f0 0x55ab4d4ec2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:36.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.939+0000 7f8d9754db80 1 --2- 172.21.15.82:0/1490285486 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab4d4f24e0 0x55ab4d4e6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:36.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.939+0000 7f8d9754db80 1 --2- 172.21.15.82:0/1490285486 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab4d4f1bc0 0x55ab4d501fb0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:36.940 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.939+0000 7f8d9754db80 1 -- 172.21.15.82:0/1490285486 >> 172.21.15.82:0/1490285486 conn(0x55ab4d4646d0 msgr2=0x55ab4d4f06d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:06:36.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.939+0000 7f8d9754db80 1 -- 172.21.15.82:0/1490285486 shutdown_connections 2024-05-08T06:06:36.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.939+0000 7f8d9754db80 1 -- 172.21.15.82:0/1490285486 wait complete. 2024-05-08T06:06:36.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.940+0000 7f8d9754db80 1 -- start start 2024-05-08T06:06:36.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.940+0000 7f8d9754db80 1 Processor -- start 2024-05-08T06:06:36.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.940+0000 7f8d9754db80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab4d4ec8f0 0x55ab4d4fe330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:36.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.940+0000 7f8d9754db80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ab4d4f1bc0 0x55ab4d4fe870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:36.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.940+0000 7f8d9754db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab4d4f24e0 0x55ab4d4fb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:36.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.940+0000 7f8d9754db80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f8d881b1240 con 0x55ab4d4ec8f0 2024-05-08T06:06:36.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.940+0000 7f8d9754db80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8d881b0b70 con 0x55ab4d4f1bc0 2024-05-08T06:06:36.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.940+0000 7f8d9754db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8d881add70 con 0x55ab4d4f24e0 2024-05-08T06:06:36.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.940+0000 7f8d9754db80 10 client.0 _ll_register_callbacks cb 0x55ab4d3e5c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:06:36.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.941+0000 7f8d85e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab4d4ec8f0 0x55ab4d4fe330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:36.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.941+0000 7f8d85e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab4d4ec8f0 0x55ab4d4fe330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:32992/0 (socket says 172.21.15.82:32992) 2024-05-08T06:06:36.941 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.941+0000 7f8d85e00700 1 -- 172.21.15.82:0/1121790545 learned_addr learned my addr 172.21.15.82:0/1121790545 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:06:36.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.941+0000 7f8d85400700 1 --2- 172.21.15.82:0/1121790545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ab4d4f1bc0 0x55ab4d4fe870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:36.942 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.941+0000 7f8d86800700 1 --2- 172.21.15.82:0/1121790545 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab4d4f24e0 0x55ab4d4fb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:36.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.941+0000 7f8d85e00700 1 -- 172.21.15.82:0/1121790545 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab4d4f24e0 msgr2=0x55ab4d4fb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:06:36.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.941+0000 7f8d85e00700 1 --2- 172.21.15.82:0/1121790545 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab4d4f24e0 0x55ab4d4fb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:36.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.941+0000 7f8d85e00700 1 -- 172.21.15.82:0/1121790545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ab4d4f1bc0 msgr2=0x55ab4d4fe870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:06:36.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.941+0000 7f8d85e00700 1 --2- 172.21.15.82:0/1121790545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ab4d4f1bc0 0x55ab4d4fe870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:36.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.941+0000 7f8d85e00700 1 -- 172.21.15.82:0/1121790545 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab4d4fb8c0 con 0x55ab4d4ec8f0 2024-05-08T06:06:36.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.941+0000 7f8d85e00700 1 --2- 172.21.15.82:0/1121790545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab4d4ec8f0 0x55ab4d4fe330 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8d78009230 tx=0x7f8d780a91e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bea522bd9ca9fc8 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:06:36.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.941+0000 7f8d67e00700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T06:06:36.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.942+0000 7f8d67e00700 1 -- 172.21.15.82:0/1121790545 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7806f060 con 0x55ab4d4ec8f0 2024-05-08T06:06:36.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.942+0000 7f8d67e00700 1 -- 172.21.15.82:0/1121790545 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f8d78010720 con 0x55ab4d4ec8f0 2024-05-08T06:06:36.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.942+0000 7f8d9754db80 1 -- 172.21.15.82:0/1121790545 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ab4d44c400 con 0x55ab4d4ec8f0 2024-05-08T06:06:36.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.942+0000 7f8d67e00700 1 -- 172.21.15.82:0/1121790545 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f8d780b20e0 con 0x55ab4d4ec8f0 2024-05-08T06:06:36.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.942+0000 7f8d9754db80 10 client.16431 fetch_fsmap learned FSMap version 31 2024-05-08T06:06:36.944 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.942+0000 7f8d9754db80 1 -- 172.21.15.82:0/1121790545 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55ab4d570e70 con 0x55ab4d4ec8f0 2024-05-08T06:06:36.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.942+0000 7f8d67e00700 1 -- 172.21.15.82:0/1121790545 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x55ab4d44c400 con 0x55ab4d4ec8f0 2024-05-08T06:06:36.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.942+0000 7f8d67e00700 1 -- 172.21.15.82:0/1121790545 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f8d780cc0d0 con 0x55ab4d4ec8f0 2024-05-08T06:06:36.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.943+0000 7f8d9754db80 10 client.16431 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:06:36.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.943+0000 7f8d9754db80 10 client.16431 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-05-08T06:06:36.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.943+0000 7f8d9754db80 20 client.16431 populate_metadata read hostname 'smithi082' 2024-05-08T06:06:36.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.943+0000 7f8d9754db80 1 --2- 172.21.15.82:0/1121790545 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55ab4d5713f0 0x55ab4d573810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:36.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.943+0000 7f8d9754db80 4 client.16431 mds_command: new command op to 24487 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T06:06:36.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.943+0000 7f8d9754db80 1 -- 172.21.15.82:0/1121790545 --> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ab4d4464a0 con 0x55ab4d5713f0 2024-05-08T06:06:36.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.943+0000 7f8d85400700 1 --2- 172.21.15.82:0/1121790545 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55ab4d5713f0 0x55ab4d573810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:36.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.944+0000 7f8d85400700 1 --2- 172.21.15.82:0/1121790545 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55ab4d5713f0 0x55ab4d573810 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d9786621f9145b63 server_cookie=1c1a3e8a0d97105e in_seq=0 out_seq=0 2024-05-08T06:06:36.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.944+0000 7f8d67e00700 10 client.16431 ms_handle_connect on v2:172.21.15.151:6836/4192404464 2024-05-08T06:06:36.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.944+0000 7f8d67e00700 1 -- 172.21.15.82:0/1121790545 <== mds.2 v2:172.21.15.151:6836/4192404464 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ab4d4464a0 con 0x55ab4d5713f0 2024-05-08T06:06:36.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.944+0000 7f8d67e00700 10 client.16431 handle_command_reply: tid=0 2024-05-08T06:06:36.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.944+0000 7f8d9754db80 1 client.16431 shutdown 2024-05-08T06:06:36.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.944+0000 7f8d9754db80 1 -- 172.21.15.82:0/1121790545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab4d4ec8f0 msgr2=0x55ab4d4fe330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:36.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.944+0000 7f8d9754db80 1 --2- 172.21.15.82:0/1121790545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab4d4ec8f0 0x55ab4d4fe330 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f8d78009230 tx=0x7f8d780a91e0 comp rx=0 tx=0).stop 2024-05-08T06:06:36.945 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.944+0000 7f8d9754db80 1 -- 172.21.15.82:0/1121790545 shutdown_connections 2024-05-08T06:06:36.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.944+0000 7f8d9754db80 1 --2- 172.21.15.82:0/1121790545 >> [v2:172.21.15.151:6836/4192404464,v1:172.21.15.151:6837/4192404464] conn(0x55ab4d5713f0 0x55ab4d573810 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:36.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.944+0000 7f8d9754db80 1 --2- 172.21.15.82:0/1121790545 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab4d4f24e0 0x55ab4d4fb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:36.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.944+0000 7f8d9754db80 1 --2- 172.21.15.82:0/1121790545 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55ab4d4ec8f0 0x55ab4d4fe330 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:36.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.944+0000 7f8d67e00700 0 client.16431 ms_handle_reset on v2:172.21.15.151:6836/4192404464 2024-05-08T06:06:36.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.944+0000 7f8d9754db80 1 --2- 172.21.15.82:0/1121790545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ab4d4f1bc0 0x55ab4d4fe870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:36.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.944+0000 7f8d9754db80 1 -- 172.21.15.82:0/1121790545 >> 172.21.15.82:0/1121790545 conn(0x55ab4d4646d0 msgr2=0x55ab4d4f68b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:06:36.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.944+0000 7f8d9754db80 1 -- 172.21.15.82:0/1121790545 shutdown_connections 2024-05-08T06:06:36.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.944+0000 7f8d9754db80 1 -- 172.21.15.82:0/1121790545 wait complete. 2024-05-08T06:06:36.946 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.945+0000 7f8d9754db80 20 client.16431 trim_cache size 0 max 16384 2024-05-08T06:06:36.946 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T06:06:36.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.945+0000 7f8d8cc00700 1 -- 172.21.15.82:0/2976841304 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f8d6c0b2880 msgr2=0x7f8d6c0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:36.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.945+0000 7f8d8cc00700 1 --2- 172.21.15.82:0/2976841304 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f8d6c0b2880 0x7f8d6c0b4d40 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f8d80006090 tx=0x7f8d8000b330 comp rx=0 tx=0).stop 2024-05-08T06:06:36.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.945+0000 7f8d8cc00700 1 -- 172.21.15.82:0/2976841304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d88105690 msgr2=0x7f8d881a1a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:36.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.945+0000 7f8d8cc00700 1 --2- 172.21.15.82:0/2976841304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d88105690 0x7f8d881a1a60 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f8d7800e9a0 tx=0x7f8d7800ecb0 comp rx=0 tx=0).stop 2024-05-08T06:06:36.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.945+0000 7f8d8cc00700 1 -- 172.21.15.82:0/2976841304 shutdown_connections 2024-05-08T06:06:36.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.945+0000 7f8d8cc00700 1 --2- 172.21.15.82:0/2976841304 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f8d6c0b2880 0x7f8d6c0b4d40 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:36.947 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.945+0000 7f8d8cc00700 1 --2- 172.21.15.82:0/2976841304 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d8810b690 0x7f8d8819bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:36.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.945+0000 7f8d8cc00700 1 --2- 172.21.15.82:0/2976841304 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f8d88105690 0x7f8d881a1a60 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:36.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.945+0000 7f8d8cc00700 1 --2- 172.21.15.82:0/2976841304 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d88106050 0x7f8d881a1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:36.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.945+0000 7f8d8cc00700 1 -- 172.21.15.82:0/2976841304 >> 172.21.15.82:0/2976841304 conn(0x7f8d88101180 msgr2=0x7f8d881018c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:06:36.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.946+0000 7f8d8cc00700 1 -- 172.21.15.82:0/2976841304 shutdown_connections 2024-05-08T06:06:36.948 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:36.946+0000 7f8d8cc00700 1 -- 172.21.15.82:0/2976841304 wait complete. 2024-05-08T06:06:37.914 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-05-08T06:06:37.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:06:37 smithi082 ceph-mon[30098]: pgmap v938: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 21 KiB/s wr, 12 op/s 2024-05-08T06:06:37.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:06:37 smithi134 ceph-mon[34132]: pgmap v938: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 21 KiB/s wr, 12 op/s 2024-05-08T06:06:38.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:06:37 smithi151 ceph-mon[34815]: pgmap v938: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 21 KiB/s wr, 12 op/s 2024-05-08T06:06:38.355 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:06:39.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:06:39 smithi082 ceph-mon[30098]: pgmap v939: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-05-08T06:06:39.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:06:39 smithi134 ceph-mon[34132]: pgmap v939: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-05-08T06:06:40.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:06:39 smithi151 ceph-mon[34815]: pgmap v939: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-05-08T06:06:40.555 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.555+0000 7f1272a00700 1 -- 172.21.15.82:0/2685795792 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f126c108850 msgr2=0x7f126c1103d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:40.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.555+0000 7f1272a00700 1 --2- 172.21.15.82:0/2685795792 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f126c108850 0x7f126c1103d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f126400b0d0 tx=0x7f126400b3e0 comp rx=0 tx=0).stop 2024-05-08T06:06:40.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.555+0000 7f1272a00700 1 -- 172.21.15.82:0/2685795792 shutdown_connections 2024-05-08T06:06:40.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.555+0000 7f1272a00700 1 --2- 172.21.15.82:0/2685795792 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f126c103750 0x7f126c103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:40.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.555+0000 7f1272a00700 1 --2- 172.21.15.82:0/2685795792 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f126c108850 0x7f126c1103d0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:40.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.555+0000 7f1272a00700 1 --2- 172.21.15.82:0/2685795792 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f126c104100 0x7f126c108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:40.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.555+0000 7f1272a00700 1 -- 172.21.15.82:0/2685795792 >> 172.21.15.82:0/2685795792 conn(0x7f126c07a600 msgr2=0x7f126c07aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:06:40.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.555+0000 7f1272a00700 1 -- 172.21.15.82:0/2685795792 shutdown_connections 2024-05-08T06:06:40.556 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.555+0000 7f1272a00700 1 -- 172.21.15.82:0/2685795792 wait complete. 2024-05-08T06:06:40.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.556+0000 7f1272a00700 1 Processor -- start 2024-05-08T06:06:40.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.557+0000 7f1272a00700 1 -- start start 2024-05-08T06:06:40.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.557+0000 7f1272a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f126c103750 0x7f126c19f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:40.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.557+0000 7f1272a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f126c104100 0x7f126c19fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:40.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.557+0000 7f1272a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f126c108850 0x7f126c199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:40.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.557+0000 7f1272a00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f126c113690 con 0x7f126c103750 2024-05-08T06:06:40.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.557+0000 7f1272a00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f126c113510 con 0x7f126c104100 2024-05-08T06:06:40.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.557+0000 7f1272a00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f126c113810 con 0x7f126c108850 2024-05-08T06:06:40.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.558+0000 7f126be00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f126c103750 0x7f126c19f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:40.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.558+0000 7f126be00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f126c103750 0x7f126c19f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33022/0 (socket says 172.21.15.82:33022) 2024-05-08T06:06:40.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.558+0000 7f126be00700 1 -- 172.21.15.82:0/1068176588 learned_addr learned my addr 172.21.15.82:0/1068176588 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:06:40.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.558+0000 7f1263400700 1 --2- 172.21.15.82:0/1068176588 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f126c104100 0x7f126c19fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:40.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.558+0000 7f1270a00700 1 --2- 172.21.15.82:0/1068176588 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f126c108850 0x7f126c199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:40.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.558+0000 7f1263400700 1 -- 172.21.15.82:0/1068176588 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f126c108850 msgr2=0x7f126c199910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:40.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.558+0000 7f1263400700 1 --2- 172.21.15.82:0/1068176588 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f126c108850 0x7f126c199910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:40.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.558+0000 7f1263400700 1 -- 172.21.15.82:0/1068176588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f126c103750 msgr2=0x7f126c19f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:40.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.558+0000 7f1263400700 1 --2- 172.21.15.82:0/1068176588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f126c103750 0x7f126c19f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:40.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.558+0000 7f1263400700 1 -- 172.21.15.82:0/1068176588 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f126c19a070 con 0x7f126c104100 2024-05-08T06:06:40.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.558+0000 7f126be00700 1 --2- 172.21.15.82:0/1068176588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f126c103750 0x7f126c19f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:06:40.559 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.558+0000 7f1263400700 1 --2- 172.21.15.82:0/1068176588 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f126c104100 0x7f126c19fc40 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f125400e9f0 tx=0x7f125400ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:06:40.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.559+0000 7f1269600700 1 -- 172.21.15.82:0/1068176588 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1254004220 con 0x7f126c104100 2024-05-08T06:06:40.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.559+0000 7f1272a00700 1 -- 172.21.15.82:0/1068176588 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f126c19a360 con 0x7f126c104100 2024-05-08T06:06:40.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.559+0000 7f1269600700 1 -- 172.21.15.82:0/1068176588 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f12540043c0 con 0x7f126c104100 2024-05-08T06:06:40.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.559+0000 7f1269600700 1 -- 172.21.15.82:0/1068176588 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1254005020 con 0x7f126c104100 2024-05-08T06:06:40.560 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.559+0000 7f1272a00700 1 -- 172.21.15.82:0/1068176588 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f126c0756d0 con 0x7f126c104100 2024-05-08T06:06:40.562 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.563+0000 7f1269600700 1 -- 172.21.15.82:0/1068176588 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f1254004750 con 0x7f126c104100 2024-05-08T06:06:40.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.563+0000 7f127d2a6b80 1 Processor -- start 2024-05-08T06:06:40.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.564+0000 7f127d2a6b80 1 -- start start 2024-05-08T06:06:40.563 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.564+0000 7f1269600700 1 --2- 172.21.15.82:0/1068176588 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f12500b2880 0x7f12500b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:40.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.564+0000 7f127d2a6b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a6a0db2060 0x55a6a0db2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:40.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.564+0000 7f127d2a6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a6a0db2980 0x55a6a0db6490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:40.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.564+0000 7f1269600700 1 -- 172.21.15.82:0/1068176588 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f12540e21e0 con 0x7f126c104100 2024-05-08T06:06:40.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.564+0000 7f127d2a6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6a0db69d0 0x55a6a0db6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:40.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.564+0000 7f127d2a6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a6a0d04a20 con 0x55a6a0db69d0 2024-05-08T06:06:40.564 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.564+0000 7f127d2a6b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a6a0ca2760 con 0x55a6a0db2060 2024-05-08T06:06:40.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.564+0000 7f127d2a6b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55a6a0d009e0 con 0x55a6a0db2980 2024-05-08T06:06:40.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.564+0000 7f126be00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a6a0db2060 0x55a6a0db2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:40.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.565+0000 7f126be00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a6a0db2060 0x55a6a0db2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:38754/0 (socket says 172.21.15.82:38754) 2024-05-08T06:06:40.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.565+0000 7f126be00700 1 -- 172.21.15.82:0/2183617092 learned_addr learned my addr 172.21.15.82:0/2183617092 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:06:40.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.565+0000 7f1270a00700 1 --2- 172.21.15.82:0/1068176588 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f12500b2880 0x7f12500b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:40.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.565+0000 7f1263400700 1 --2- 172.21.15.82:0/2183617092 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a6a0db2980 0x55a6a0db6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:40.565 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.565+0000 7f1270a00700 1 --2- 172.21.15.82:0/2183617092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6a0db69d0 0x55a6a0db6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:40.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.565+0000 7f126be00700 1 -- 172.21.15.82:0/2183617092 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a6a0db2980 msgr2=0x55a6a0db6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:06:40.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.565+0000 7f126be00700 1 --2- 172.21.15.82:0/2183617092 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a6a0db2980 0x55a6a0db6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:40.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.565+0000 7f126be00700 1 -- 172.21.15.82:0/2183617092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6a0db69d0 msgr2=0x55a6a0db6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:06:40.566 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.565+0000 7f126be00700 1 --2- 172.21.15.82:0/2183617092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6a0db69d0 0x55a6a0db6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:40.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.565+0000 7f126be00700 1 -- 172.21.15.82:0/2183617092 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6a0c518d0 con 0x55a6a0db2060 2024-05-08T06:06:40.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.565+0000 7f126be00700 1 --2- 172.21.15.82:0/2183617092 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a6a0db2060 0x55a6a0db2440 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f125c011680 tx=0x7f125c011990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=206bff2722c95ad4 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:06:40.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.565+0000 7f1270a00700 1 --2- 172.21.15.82:0/1068176588 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f12500b2880 0x7f12500b4d40 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f1264006260 tx=0x7f12640061f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:06:40.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.566+0000 7f1261600700 1 -- 172.21.15.82:0/2183617092 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f125c004030 con 0x55a6a0db2060 2024-05-08T06:06:40.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.566+0000 7f1261600700 1 -- 172.21.15.82:0/2183617092 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f125c003680 con 0x55a6a0db2060 2024-05-08T06:06:40.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.566+0000 7f1261600700 1 -- 172.21.15.82:0/2183617092 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f125c0197f0 con 0x55a6a0db2060 2024-05-08T06:06:40.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.566+0000 7f127d2a6b80 1 -- 172.21.15.82:0/2183617092 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a6a0db2060 msgr2=0x55a6a0db2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:40.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.566+0000 7f127d2a6b80 1 --2- 172.21.15.82:0/2183617092 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a6a0db2060 0x55a6a0db2440 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f125c011680 tx=0x7f125c011990 comp rx=0 tx=0).stop 2024-05-08T06:06:40.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.567+0000 7f127d2a6b80 1 -- 172.21.15.82:0/2183617092 shutdown_connections 2024-05-08T06:06:40.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.567+0000 7f127d2a6b80 1 --2- 172.21.15.82:0/2183617092 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a6a0db2060 0x55a6a0db2440 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:40.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.567+0000 7f127d2a6b80 1 --2- 172.21.15.82:0/2183617092 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6a0db69d0 0x55a6a0db6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:40.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.567+0000 7f127d2a6b80 1 --2- 172.21.15.82:0/2183617092 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a6a0db2980 0x55a6a0db6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:40.567 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.567+0000 7f127d2a6b80 1 -- 172.21.15.82:0/2183617092 >> 172.21.15.82:0/2183617092 conn(0x55a6a0ce0b60 msgr2=0x55a6a0dac7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:06:40.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.567+0000 7f127d2a6b80 1 -- 172.21.15.82:0/2183617092 shutdown_connections 2024-05-08T06:06:40.568 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.567+0000 7f127d2a6b80 1 -- 172.21.15.82:0/2183617092 wait complete. 2024-05-08T06:06:40.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.567+0000 7f127d2a6b80 1 -- start start 2024-05-08T06:06:40.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.568+0000 7f127d2a6b80 1 Processor -- start 2024-05-08T06:06:40.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.568+0000 7f127d2a6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6a0db2060 0x55a6a0dbde70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:40.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.568+0000 7f127d2a6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a6a0db2980 0x55a6a0dbb210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:40.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.568+0000 7f127d2a6b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a6a0db69d0 0x55a6a0dbb750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:40.570 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.568+0000 7f127d2a6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x55a6a0dbebe0 con 0x55a6a0db2060 2024-05-08T06:06:40.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.568+0000 7f127d2a6b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a6a0c6ab20 con 0x55a6a0db69d0 2024-05-08T06:06:40.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.568+0000 7f127d2a6b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55a6a0dbed60 con 0x55a6a0db2980 2024-05-08T06:06:40.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.568+0000 7f127d2a6b80 10 client.0 _ll_register_callbacks cb 0x55a6a0cabc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:06:40.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.568+0000 7f1270a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a6a0db69d0 0x55a6a0dbb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:40.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.569+0000 7f126be00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6a0db2060 0x55a6a0dbde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:40.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.569+0000 7f1263400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a6a0db2980 0x55a6a0dbb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:40.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.569+0000 7f1270a00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a6a0db69d0 0x55a6a0dbb750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:38760/0 (socket says 172.21.15.82:38760) 2024-05-08T06:06:40.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.569+0000 7f1270a00700 1 -- 172.21.15.82:0/3903286860 learned_addr learned my addr 172.21.15.82:0/3903286860 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:06:40.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.569+0000 7f1263400700 1 -- 172.21.15.82:0/3903286860 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a6a0db69d0 msgr2=0x55a6a0dbb750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:06:40.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.569+0000 7f1263400700 1 --2- 172.21.15.82:0/3903286860 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a6a0db69d0 0x55a6a0dbb750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:40.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.569+0000 7f1263400700 1 -- 172.21.15.82:0/3903286860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6a0db2060 msgr2=0x55a6a0dbde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:06:40.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.569+0000 7f1263400700 1 --2- 172.21.15.82:0/3903286860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6a0db2060 0x55a6a0dbde70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:40.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.569+0000 7f1263400700 1 -- 172.21.15.82:0/3903286860 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6a0cca420 con 0x55a6a0db2980 2024-05-08T06:06:40.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.569+0000 7f1263400700 1 --2- 172.21.15.82:0/3903286860 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a6a0db2980 0x55a6a0dbb210 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f12540a6a20 tx=0x7f12540a8ff0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5b3234110d6318a server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:06:40.571 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.569+0000 7f125a000700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T06:06:40.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.569+0000 7f125a000700 1 -- 172.21.15.82:0/3903286860 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12540c3060 con 0x55a6a0db2980 2024-05-08T06:06:40.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.569+0000 7f125a000700 1 -- 172.21.15.82:0/3903286860 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f12540a9c20 con 0x55a6a0db2980 2024-05-08T06:06:40.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.569+0000 7f127d2a6b80 1 -- 172.21.15.82:0/3903286860 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f125c003680 con 0x55a6a0db2980 2024-05-08T06:06:40.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.570+0000 7f125a000700 1 -- 172.21.15.82:0/3903286860 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f125401c040 con 0x55a6a0db2980 2024-05-08T06:06:40.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.570+0000 7f127d2a6b80 10 client.27013 fetch_fsmap learned FSMap version 31 2024-05-08T06:06:40.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.570+0000 7f127d2a6b80 1 -- 172.21.15.82:0/3903286860 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a6a0dc94c0 con 0x55a6a0db2980 2024-05-08T06:06:40.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.570+0000 7f125a000700 1 -- 172.21.15.82:0/3903286860 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f125c003680 con 0x55a6a0db2980 2024-05-08T06:06:40.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.570+0000 7f125a000700 1 -- 172.21.15.82:0/3903286860 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f12540b2210 con 0x55a6a0db2980 2024-05-08T06:06:40.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.570+0000 7f127d2a6b80 10 client.27013 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:06:40.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.570+0000 7f127d2a6b80 10 client.27013 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-08T06:06:40.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.570+0000 7f127d2a6b80 20 client.27013 populate_metadata read hostname 'smithi082' 2024-05-08T06:06:40.572 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.570+0000 7f127d2a6b80 1 --2- 172.21.15.82:0/3903286860 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x55a6a0dcbb00 0x55a6a0dcdef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:40.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.570+0000 7f127d2a6b80 4 client.27013 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:06:40.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.570+0000 7f127d2a6b80 1 -- 172.21.15.82:0/3903286860 --> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a6a0d7f0a0 con 0x55a6a0dcbb00 2024-05-08T06:06:40.573 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.571+0000 7f126be00700 1 --2- 172.21.15.82:0/3903286860 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x55a6a0dcbb00 0x55a6a0dcdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:40.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.571+0000 7f126be00700 1 --2- 172.21.15.82:0/3903286860 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x55a6a0dcbb00 0x55a6a0dcdef0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=edb0c3842928d61a server_cookie=151aab62bf698aeb in_seq=0 out_seq=0 2024-05-08T06:06:40.574 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.571+0000 7f125a000700 10 client.27013 ms_handle_connect on v2:172.21.15.151:6838/2963754236 2024-05-08T06:06:40.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.572+0000 7f125a000700 1 -- 172.21.15.82:0/3903286860 <== mds.1 v2:172.21.15.151:6838/2963754236 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a6a0d7f0a0 con 0x55a6a0dcbb00 2024-05-08T06:06:40.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.572+0000 7f125a000700 10 client.27013 handle_command_reply: tid=0 2024-05-08T06:06:40.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.572+0000 7f127d2a6b80 1 client.27013 shutdown 2024-05-08T06:06:40.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.573+0000 7f127d2a6b80 1 -- 172.21.15.82:0/3903286860 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a6a0db2980 msgr2=0x55a6a0dbb210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:40.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.573+0000 7f127d2a6b80 1 --2- 172.21.15.82:0/3903286860 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a6a0db2980 0x55a6a0dbb210 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f12540a6a20 tx=0x7f12540a8ff0 comp rx=0 tx=0).stop 2024-05-08T06:06:40.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.573+0000 7f127d2a6b80 1 -- 172.21.15.82:0/3903286860 shutdown_connections 2024-05-08T06:06:40.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.573+0000 7f127d2a6b80 1 --2- 172.21.15.82:0/3903286860 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x55a6a0dcbb00 0x55a6a0dcdef0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:40.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.573+0000 7f127d2a6b80 1 --2- 172.21.15.82:0/3903286860 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a6a0db69d0 0x55a6a0dbb750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:40.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.573+0000 7f127d2a6b80 1 --2- 172.21.15.82:0/3903286860 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6a0db2060 0x55a6a0dbde70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:40.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.573+0000 7f127d2a6b80 1 --2- 172.21.15.82:0/3903286860 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a6a0db2980 0x55a6a0dbb210 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:40.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.573+0000 7f125a000700 0 client.27013 ms_handle_reset on v2:172.21.15.151:6838/2963754236 2024-05-08T06:06:40.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.573+0000 7f127d2a6b80 1 -- 172.21.15.82:0/3903286860 >> 172.21.15.82:0/3903286860 conn(0x55a6a0ce0b60 msgr2=0x55a6a0da72b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:06:40.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.573+0000 7f127d2a6b80 1 -- 172.21.15.82:0/3903286860 shutdown_connections 2024-05-08T06:06:40.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.573+0000 7f127d2a6b80 1 -- 172.21.15.82:0/3903286860 wait complete. 2024-05-08T06:06:40.575 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.573+0000 7f127d2a6b80 20 client.27013 trim_cache size 0 max 16384 2024-05-08T06:06:40.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.589+0000 7f127d2a6b80 1 Processor -- start 2024-05-08T06:06:40.588 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.589+0000 7f127d2a6b80 1 -- start start 2024-05-08T06:06:40.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.589+0000 7f127d2a6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6a0db2060 0x55a6a0dc7c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:40.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.589+0000 7f127d2a6b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a6a0db2980 0x55a6a0da7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:40.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.589+0000 7f127d2a6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a6a0db69d0 0x55a6a0dd3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:40.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.589+0000 7f127d2a6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f126c1afcd0 con 0x55a6a0db2060 2024-05-08T06:06:40.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.589+0000 7f127d2a6b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f126c1b1810 con 0x55a6a0db2980 2024-05-08T06:06:40.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.589+0000 7f127d2a6b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f126c1b03a0 con 0x55a6a0db69d0 2024-05-08T06:06:40.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.590+0000 7f126be00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6a0db2060 0x55a6a0dc7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:40.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.590+0000 7f126be00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6a0db2060 0x55a6a0dc7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33060/0 (socket says 172.21.15.82:33060) 2024-05-08T06:06:40.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.590+0000 7f126be00700 1 -- 172.21.15.82:0/3012223107 learned_addr learned my addr 172.21.15.82:0/3012223107 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:06:40.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.590+0000 7f1270a00700 1 --2- 172.21.15.82:0/3012223107 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a6a0db69d0 0x55a6a0dd3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:40.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.590+0000 7f1263400700 1 --2- 172.21.15.82:0/3012223107 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a6a0db2980 0x55a6a0da7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:40.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.590+0000 7f126be00700 1 -- 172.21.15.82:0/3012223107 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a6a0db69d0 msgr2=0x55a6a0dd3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:06:40.590 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.590+0000 7f126be00700 1 --2- 172.21.15.82:0/3012223107 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a6a0db69d0 0x55a6a0dd3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:40.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.590+0000 7f126be00700 1 -- 172.21.15.82:0/3012223107 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a6a0db2980 msgr2=0x55a6a0da7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:06:40.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.590+0000 7f126be00700 1 --2- 172.21.15.82:0/3012223107 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a6a0db2980 0x55a6a0da7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:40.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.590+0000 7f126be00700 1 -- 172.21.15.82:0/3012223107 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a6a0dad9c0 con 0x55a6a0db2060 2024-05-08T06:06:40.591 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.590+0000 7f126be00700 1 --2- 172.21.15.82:0/3012223107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6a0db2060 0x55a6a0dc7c70 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f125c011680 tx=0x7f125c003e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c89d6c140bd2d80d server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:06:40.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.591+0000 7f1260c00700 1 -- 172.21.15.82:0/3012223107 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f125c005ce0 con 0x55a6a0db2060 2024-05-08T06:06:40.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.591+0000 7f1260c00700 1 -- 172.21.15.82:0/3012223107 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f125c003c10 con 0x55a6a0db2060 2024-05-08T06:06:40.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.591+0000 7f1260c00700 1 -- 172.21.15.82:0/3012223107 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f125c02a710 con 0x55a6a0db2060 2024-05-08T06:06:40.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.591+0000 7f127d2a6b80 1 -- 172.21.15.82:0/3012223107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6a0db2060 msgr2=0x55a6a0dc7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:40.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.591+0000 7f127d2a6b80 1 --2- 172.21.15.82:0/3012223107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6a0db2060 0x55a6a0dc7c70 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f125c011680 tx=0x7f125c003e20 comp rx=0 tx=0).stop 2024-05-08T06:06:40.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.591+0000 7f127d2a6b80 1 -- 172.21.15.82:0/3012223107 shutdown_connections 2024-05-08T06:06:40.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.591+0000 7f127d2a6b80 1 --2- 172.21.15.82:0/3012223107 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a6a0db69d0 0x55a6a0dd3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:40.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.591+0000 7f127d2a6b80 1 --2- 172.21.15.82:0/3012223107 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6a0db2060 0x55a6a0dc7c70 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:40.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.591+0000 7f127d2a6b80 1 --2- 172.21.15.82:0/3012223107 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a6a0db2980 0x55a6a0da7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:40.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.591+0000 7f127d2a6b80 1 -- 172.21.15.82:0/3012223107 >> 172.21.15.82:0/3012223107 conn(0x55a6a0ce0b60 msgr2=0x55a6a0da6a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:06:40.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.591+0000 7f127d2a6b80 1 -- 172.21.15.82:0/3012223107 shutdown_connections 2024-05-08T06:06:40.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.592+0000 7f127d2a6b80 1 -- 172.21.15.82:0/3012223107 wait complete. 2024-05-08T06:06:40.593 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.592+0000 7f127d2a6b80 1 -- start start 2024-05-08T06:06:40.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.592+0000 7f127d2a6b80 1 Processor -- start 2024-05-08T06:06:40.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.593+0000 7f127d2a6b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a6a0db2060 0x55a6a0dc4470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:40.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.593+0000 7f127d2a6b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6a0db2980 0x55a6a0dc18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:40.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.593+0000 7f127d2a6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a6a0db69d0 0x55a6a0dc1df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:40.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.593+0000 7f127d2a6b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f126c1b1140 con 0x55a6a0db2980 2024-05-08T06:06:40.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.593+0000 7f127d2a6b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f126c1b0a70 con 0x55a6a0db2060 2024-05-08T06:06:40.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.593+0000 7f127d2a6b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f126c1adc70 con 0x55a6a0db69d0 2024-05-08T06:06:40.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.593+0000 7f127d2a6b80 10 client.0 _ll_register_callbacks cb 0x55a6a0cabc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:06:40.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.593+0000 7f1263400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6a0db2980 0x55a6a0dc18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:40.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.593+0000 7f1263400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6a0db2980 0x55a6a0dc18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:33068/0 (socket says 172.21.15.82:33068) 2024-05-08T06:06:40.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.593+0000 7f1263400700 1 -- 172.21.15.82:0/522303397 learned_addr learned my addr 172.21.15.82:0/522303397 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:06:40.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.593+0000 7f126be00700 1 --2- 172.21.15.82:0/522303397 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a6a0db2060 0x55a6a0dc4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:40.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.593+0000 7f1270a00700 1 --2- 172.21.15.82:0/522303397 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a6a0db69d0 0x55a6a0dc1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:40.594 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.593+0000 7f1263400700 1 -- 172.21.15.82:0/522303397 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a6a0db69d0 msgr2=0x55a6a0dc1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:06:40.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.593+0000 7f1263400700 1 --2- 172.21.15.82:0/522303397 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a6a0db69d0 0x55a6a0dc1df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:40.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.593+0000 7f1263400700 1 -- 172.21.15.82:0/522303397 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a6a0db2060 msgr2=0x55a6a0dc4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:06:40.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.593+0000 7f1263400700 1 --2- 172.21.15.82:0/522303397 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a6a0db2060 0x55a6a0dc4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:40.595 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.593+0000 7f1263400700 1 -- 172.21.15.82:0/522303397 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a6a0dc2540 con 0x55a6a0db2980 2024-05-08T06:06:40.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.594+0000 7f1263400700 1 --2- 172.21.15.82:0/522303397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6a0db2980 0x55a6a0dc18b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f12540b2580 tx=0x7f12540dfd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48506f8a90556e4f server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:06:40.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.594+0000 7f125a000700 10 client.0 ms_handle_connect on v2:172.21.15.82:3300/0 2024-05-08T06:06:40.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.594+0000 7f125a000700 1 -- 172.21.15.82:0/522303397 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12540c7070 con 0x55a6a0db2980 2024-05-08T06:06:40.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.594+0000 7f125a000700 1 -- 172.21.15.82:0/522303397 <== mon.0 v2:172.21.15.82:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f12540aabd0 con 0x55a6a0db2980 2024-05-08T06:06:40.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.594+0000 7f127d2a6b80 1 -- 172.21.15.82:0/522303397 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f125c003c10 con 0x55a6a0db2980 2024-05-08T06:06:40.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.594+0000 7f125a000700 1 -- 172.21.15.82:0/522303397 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f12540cc0e0 con 0x55a6a0db2980 2024-05-08T06:06:40.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.594+0000 7f127d2a6b80 10 client.16449 fetch_fsmap learned FSMap version 31 2024-05-08T06:06:40.597 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.594+0000 7f127d2a6b80 1 -- 172.21.15.82:0/522303397 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55a6a0e362c0 con 0x55a6a0db2980 2024-05-08T06:06:40.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.594+0000 7f125a000700 1 -- 172.21.15.82:0/522303397 <== mon.0 v2:172.21.15.82:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f125c003c10 con 0x55a6a0db2980 2024-05-08T06:06:40.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.595+0000 7f125a000700 1 -- 172.21.15.82:0/522303397 <== mon.0 v2:172.21.15.82:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f12540a5120 con 0x55a6a0db2980 2024-05-08T06:06:40.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.595+0000 7f127d2a6b80 10 client.16449 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:06:40.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.595+0000 7f127d2a6b80 10 client.16449 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-05-08T06:06:40.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.595+0000 7f127d2a6b80 20 client.16449 populate_metadata read hostname 'smithi082' 2024-05-08T06:06:40.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.595+0000 7f127d2a6b80 1 --2- 172.21.15.82:0/522303397 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x55a6a0e36a00 0x55a6a0e38e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:40.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.595+0000 7f127d2a6b80 4 client.16449 mds_command: new command op to 24505 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T06:06:40.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.595+0000 7f127d2a6b80 1 -- 172.21.15.82:0/522303397 --> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a6a0d12400 con 0x55a6a0e36a00 2024-05-08T06:06:40.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.595+0000 7f126be00700 1 --2- 172.21.15.82:0/522303397 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x55a6a0e36a00 0x55a6a0e38e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:40.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.596+0000 7f126be00700 1 --2- 172.21.15.82:0/522303397 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x55a6a0e36a00 0x55a6a0e38e20 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f98ceb6cbf38a69f server_cookie=f2d4ea7ba58cc56b in_seq=0 out_seq=0 2024-05-08T06:06:40.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.596+0000 7f125a000700 10 client.16449 ms_handle_connect on v2:172.21.15.151:6838/2963754236 2024-05-08T06:06:40.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.596+0000 7f125a000700 1 -- 172.21.15.82:0/522303397 <== mds.1 v2:172.21.15.151:6838/2963754236 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a6a0d12400 con 0x55a6a0e36a00 2024-05-08T06:06:40.598 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.596+0000 7f125a000700 10 client.16449 handle_command_reply: tid=0 2024-05-08T06:06:40.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.596+0000 7f127d2a6b80 1 client.16449 shutdown 2024-05-08T06:06:40.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.596+0000 7f127d2a6b80 1 -- 172.21.15.82:0/522303397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6a0db2980 msgr2=0x55a6a0dc18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:40.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.596+0000 7f127d2a6b80 1 --2- 172.21.15.82:0/522303397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6a0db2980 0x55a6a0dc18b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f12540b2580 tx=0x7f12540dfd30 comp rx=0 tx=0).stop 2024-05-08T06:06:40.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.596+0000 7f127d2a6b80 1 -- 172.21.15.82:0/522303397 shutdown_connections 2024-05-08T06:06:40.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.596+0000 7f127d2a6b80 1 --2- 172.21.15.82:0/522303397 >> [v2:172.21.15.151:6838/2963754236,v1:172.21.15.151:6839/2963754236] conn(0x55a6a0e36a00 0x55a6a0e38e20 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:40.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.596+0000 7f127d2a6b80 1 --2- 172.21.15.82:0/522303397 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a6a0db2060 0x55a6a0dc4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:40.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.596+0000 7f127d2a6b80 1 --2- 172.21.15.82:0/522303397 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a6a0db69d0 0x55a6a0dc1df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:40.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.596+0000 7f125a000700 0 client.16449 ms_handle_reset on v2:172.21.15.151:6838/2963754236 2024-05-08T06:06:40.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.596+0000 7f127d2a6b80 1 --2- 172.21.15.82:0/522303397 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x55a6a0db2980 0x55a6a0dc18b0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:40.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.596+0000 7f127d2a6b80 1 -- 172.21.15.82:0/522303397 >> 172.21.15.82:0/522303397 conn(0x55a6a0ce0b60 msgr2=0x55a6a0da72b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:06:40.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.596+0000 7f127d2a6b80 1 -- 172.21.15.82:0/522303397 shutdown_connections 2024-05-08T06:06:40.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.596+0000 7f127d2a6b80 1 -- 172.21.15.82:0/522303397 wait complete. 2024-05-08T06:06:40.599 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.597+0000 7f127d2a6b80 20 client.16449 trim_cache size 0 max 16384 2024-05-08T06:06:40.600 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T06:06:40.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.597+0000 7f1272a00700 1 -- 172.21.15.82:0/1068176588 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f12500b2880 msgr2=0x7f12500b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:40.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.597+0000 7f1272a00700 1 --2- 172.21.15.82:0/1068176588 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f12500b2880 0x7f12500b4d40 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f1264006260 tx=0x7f12640061f0 comp rx=0 tx=0).stop 2024-05-08T06:06:40.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.597+0000 7f1272a00700 1 -- 172.21.15.82:0/1068176588 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f126c104100 msgr2=0x7f126c19fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:40.600 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.597+0000 7f1272a00700 1 --2- 172.21.15.82:0/1068176588 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f126c104100 0x7f126c19fc40 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f125400e9f0 tx=0x7f125400ed00 comp rx=0 tx=0).stop 2024-05-08T06:06:40.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.597+0000 7f1272a00700 1 -- 172.21.15.82:0/1068176588 shutdown_connections 2024-05-08T06:06:40.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.597+0000 7f1272a00700 1 --2- 172.21.15.82:0/1068176588 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f12500b2880 0x7f12500b4d40 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:40.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.597+0000 7f1272a00700 1 --2- 172.21.15.82:0/1068176588 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f126c108850 0x7f126c199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:40.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.597+0000 7f1272a00700 1 --2- 172.21.15.82:0/1068176588 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f126c103750 0x7f126c19f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:40.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.597+0000 7f1272a00700 1 --2- 172.21.15.82:0/1068176588 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f126c104100 0x7f126c19fc40 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:40.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.597+0000 7f1272a00700 1 -- 172.21.15.82:0/1068176588 >> 172.21.15.82:0/1068176588 conn(0x7f126c07a600 msgr2=0x7f126c101660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:06:40.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.598+0000 7f1272a00700 1 -- 172.21.15.82:0/1068176588 shutdown_connections 2024-05-08T06:06:40.601 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:40.598+0000 7f1272a00700 1 -- 172.21.15.82:0/1068176588 wait complete. 2024-05-08T06:06:41.658 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-05-08T06:06:41.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:06:41 smithi082 ceph-mon[30098]: pgmap v940: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 3.4 KiB/s wr, 10 op/s 2024-05-08T06:06:42.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:06:41 smithi134 ceph-mon[34132]: pgmap v940: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 3.4 KiB/s wr, 10 op/s 2024-05-08T06:06:42.102 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:06:42.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:06:41 smithi151 ceph-mon[34815]: pgmap v940: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 3.4 KiB/s wr, 10 op/s 2024-05-08T06:06:43.923 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:06:43 smithi082 ceph-mon[30098]: pgmap v941: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.8 KiB/s wr, 10 op/s 2024-05-08T06:06:44.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:06:43 smithi134 ceph-mon[34132]: pgmap v941: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.8 KiB/s wr, 10 op/s 2024-05-08T06:06:44.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:06:43 smithi151 ceph-mon[34815]: pgmap v941: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.8 KiB/s wr, 10 op/s 2024-05-08T06:06:44.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.440+0000 7f10a7e00700 1 -- 172.21.15.82:0/220284896 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10a8105f90 msgr2=0x7f10a81124a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:44.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.440+0000 7f10a7e00700 1 --2- 172.21.15.82:0/220284896 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10a8105f90 0x7f10a81124a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f10a0009f90 tx=0x7f10a000b330 comp rx=0 tx=0).stop 2024-05-08T06:06:44.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.440+0000 7f10a7e00700 1 -- 172.21.15.82:0/220284896 shutdown_connections 2024-05-08T06:06:44.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.440+0000 7f10a7e00700 1 --2- 172.21.15.82:0/220284896 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10a810b660 0x7f10a810ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:44.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.440+0000 7f10a7e00700 1 --2- 172.21.15.82:0/220284896 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10a8105f90 0x7f10a81124a0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:44.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.440+0000 7f10a7e00700 1 --2- 172.21.15.82:0/220284896 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10a81055d0 0x7f10a8105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:44.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.440+0000 7f10a7e00700 1 -- 172.21.15.82:0/220284896 >> 172.21.15.82:0/220284896 conn(0x7f10a81010c0 msgr2=0x7f10a81034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:06:44.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.440+0000 7f10a7e00700 1 -- 172.21.15.82:0/220284896 shutdown_connections 2024-05-08T06:06:44.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.440+0000 7f10a7e00700 1 -- 172.21.15.82:0/220284896 wait complete. 2024-05-08T06:06:44.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.442+0000 7f10a7e00700 1 Processor -- start 2024-05-08T06:06:44.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.442+0000 7f10a7e00700 1 -- start start 2024-05-08T06:06:44.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.443+0000 7f10a7e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10a81055d0 0x7f10a81a17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:44.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.443+0000 7f10a7e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10a8105f90 0x7f10a81a1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:44.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.443+0000 7f10a7e00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10a810b660 0x7f10a819b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:44.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.443+0000 7f10a7e00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f10a8115820 con 0x7f10a81055d0 2024-05-08T06:06:44.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.443+0000 7f10a7e00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f10a81156a0 con 0x7f10a8105f90 2024-05-08T06:06:44.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.443+0000 7f10a7e00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f10a81159a0 con 0x7f10a810b660 2024-05-08T06:06:44.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.443+0000 7f10a6a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10a81055d0 0x7f10a81a17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:44.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.443+0000 7f10a6000700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10a8105f90 0x7f10a81a1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:44.444 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.443+0000 7f10a6a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10a81055d0 0x7f10a81a17a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39628/0 (socket says 172.21.15.82:39628) 2024-05-08T06:06:44.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.443+0000 7f10a6a00700 1 -- 172.21.15.82:0/2755538179 learned_addr learned my addr 172.21.15.82:0/2755538179 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:06:44.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.443+0000 7f10a7400700 1 --2- 172.21.15.82:0/2755538179 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10a810b660 0x7f10a819b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:44.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.443+0000 7f10a6a00700 1 -- 172.21.15.82:0/2755538179 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10a810b660 msgr2=0x7f10a819b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:44.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.443+0000 7f10a6a00700 1 --2- 172.21.15.82:0/2755538179 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10a810b660 0x7f10a819b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:44.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.444+0000 7f10a6a00700 1 -- 172.21.15.82:0/2755538179 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10a8105f90 msgr2=0x7f10a81a1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:44.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.444+0000 7f10a6a00700 1 --2- 172.21.15.82:0/2755538179 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10a8105f90 0x7f10a81a1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:44.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.444+0000 7f10a6a00700 1 -- 172.21.15.82:0/2755538179 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10a819c0c0 con 0x7f10a81055d0 2024-05-08T06:06:44.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.444+0000 7f10a6000700 1 --2- 172.21.15.82:0/2755538179 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10a8105f90 0x7f10a81a1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:06:44.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.444+0000 7f10a6a00700 1 --2- 172.21.15.82:0/2755538179 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10a81055d0 0x7f10a81a17a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f109800e970 tx=0x7f109800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:06:44.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.444+0000 7f109f400700 1 -- 172.21.15.82:0/2755538179 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1098004220 con 0x7f10a81055d0 2024-05-08T06:06:44.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.444+0000 7f109f400700 1 -- 172.21.15.82:0/2755538179 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10980043c0 con 0x7f10a81055d0 2024-05-08T06:06:44.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.444+0000 7f10a7e00700 1 -- 172.21.15.82:0/2755538179 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10a819c3b0 con 0x7f10a81055d0 2024-05-08T06:06:44.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.444+0000 7f109f400700 1 -- 172.21.15.82:0/2755538179 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1098003ce0 con 0x7f10a81055d0 2024-05-08T06:06:44.446 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.444+0000 7f10a7e00700 1 -- 172.21.15.82:0/2755538179 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10a81a8670 con 0x7f10a81055d0 2024-05-08T06:06:44.449 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.450+0000 7f109f400700 1 -- 172.21.15.82:0/2755538179 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f109800c7e0 con 0x7f10a81055d0 2024-05-08T06:06:44.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.451+0000 7f10b8328b80 1 Processor -- start 2024-05-08T06:06:44.450 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.451+0000 7f10b8328b80 1 -- start start 2024-05-08T06:06:44.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.451+0000 7f10b8328b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564fcafee9e0 0x564fcafeedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:44.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.451+0000 7f10b8328b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564fcafef300 0x564fcafe8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:44.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.451+0000 7f10b8328b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564fcafe9600 0x564fcafe9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:44.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.451+0000 7f10b8328b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x564fcaf3ba20 con 0x564fcafef300 2024-05-08T06:06:44.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.451+0000 7f10b8328b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564fcaed9760 con 0x564fcafe9600 2024-05-08T06:06:44.451 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.451+0000 7f10b8328b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564fcaf379e0 con 0x564fcafee9e0 2024-05-08T06:06:44.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.452+0000 7f10a7400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564fcafee9e0 0x564fcafeedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:44.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.452+0000 7f109f400700 1 --2- 172.21.15.82:0/2755538179 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f108c0b2880 0x7f108c0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:44.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.452+0000 7f10a7400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564fcafee9e0 0x564fcafeedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:39018/0 (socket says 172.21.15.82:39018) 2024-05-08T06:06:44.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.452+0000 7f10a7400700 1 -- 172.21.15.82:0/3868182882 learned_addr learned my addr 172.21.15.82:0/3868182882 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:06:44.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.452+0000 7f10a6a00700 1 --2- 172.21.15.82:0/3868182882 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564fcafef300 0x564fcafe8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:44.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.452+0000 7f109f400700 1 -- 172.21.15.82:0/2755538179 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f10980e24c0 con 0x7f10a81055d0 2024-05-08T06:06:44.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.452+0000 7f10a6000700 1 --2- 172.21.15.82:0/3868182882 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564fcafe9600 0x564fcafe9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:44.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.452+0000 7f10a7400700 1 --2- 172.21.15.82:0/2755538179 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f108c0b2880 0x7f108c0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:44.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.452+0000 7f10a7400700 1 -- 172.21.15.82:0/3868182882 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564fcafe9600 msgr2=0x564fcafe9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:06:44.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.452+0000 7f10a7400700 1 --2- 172.21.15.82:0/3868182882 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564fcafe9600 0x564fcafe9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:44.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.452+0000 7f10a7400700 1 -- 172.21.15.82:0/3868182882 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564fcafef300 msgr2=0x564fcafe8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:06:44.453 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.452+0000 7f10a7400700 1 --2- 172.21.15.82:0/3868182882 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564fcafef300 0x564fcafe8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:44.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.452+0000 7f10a7400700 1 -- 172.21.15.82:0/3868182882 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fcae888d0 con 0x564fcafee9e0 2024-05-08T06:06:44.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.452+0000 7f10a6a00700 1 --2- 172.21.15.82:0/3868182882 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564fcafef300 0x564fcafe8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:06:44.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.453+0000 7f10a7400700 1 --2- 172.21.15.82:0/3868182882 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564fcafee9e0 0x564fcafeedc0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f10a0003d00 tx=0x7f10a0003d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca8a591ed79c0035 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:06:44.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.453+0000 7f10a7400700 1 --2- 172.21.15.82:0/2755538179 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f108c0b2880 0x7f108c0b4d40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f10a0026000 tx=0x7f10a0028000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:06:44.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.453+0000 7f1093e00700 1 -- 172.21.15.82:0/3868182882 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a00093b0 con 0x564fcafee9e0 2024-05-08T06:06:44.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.453+0000 7f1093e00700 1 -- 172.21.15.82:0/3868182882 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10a0007ad0 con 0x564fcafee9e0 2024-05-08T06:06:44.454 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.453+0000 7f1093e00700 1 -- 172.21.15.82:0/3868182882 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a002aa40 con 0x564fcafee9e0 2024-05-08T06:06:44.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.454+0000 7f10b8328b80 1 -- 172.21.15.82:0/3868182882 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564fcafee9e0 msgr2=0x564fcafeedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:44.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.454+0000 7f10b8328b80 1 --2- 172.21.15.82:0/3868182882 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564fcafee9e0 0x564fcafeedc0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f10a0003d00 tx=0x7f10a0003d30 comp rx=0 tx=0).stop 2024-05-08T06:06:44.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.454+0000 7f10b8328b80 1 -- 172.21.15.82:0/3868182882 shutdown_connections 2024-05-08T06:06:44.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.454+0000 7f10b8328b80 1 --2- 172.21.15.82:0/3868182882 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564fcafe9600 0x564fcafe9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:44.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.454+0000 7f10b8328b80 1 --2- 172.21.15.82:0/3868182882 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564fcafee9e0 0x564fcafeedc0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:44.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.454+0000 7f10b8328b80 1 --2- 172.21.15.82:0/3868182882 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564fcafef300 0x564fcafe8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:44.456 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.454+0000 7f10b8328b80 1 -- 172.21.15.82:0/3868182882 >> 172.21.15.82:0/3868182882 conn(0x564fcaf17b60 msgr2=0x564fcafe39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:06:44.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.455+0000 7f10b8328b80 1 -- 172.21.15.82:0/3868182882 shutdown_connections 2024-05-08T06:06:44.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.455+0000 7f10b8328b80 1 -- 172.21.15.82:0/3868182882 wait complete. 2024-05-08T06:06:44.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.455+0000 7f10b8328b80 1 -- start start 2024-05-08T06:06:44.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.455+0000 7f10b8328b80 1 Processor -- start 2024-05-08T06:06:44.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.456+0000 7f10b8328b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564fcafe9600 0x564fcaff4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:44.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.456+0000 7f10b8328b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564fcafee9e0 0x564fcaff2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:44.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.456+0000 7f10b8328b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564fcafef300 0x564fcaff27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:44.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.456+0000 7f10b8328b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x564fcaff5d50 con 0x564fcafef300 2024-05-08T06:06:44.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.456+0000 7f10b8328b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564fcaea1b20 con 0x564fcafee9e0 2024-05-08T06:06:44.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.456+0000 7f10b8328b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564fcaff5ed0 con 0x564fcafe9600 2024-05-08T06:06:44.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.456+0000 7f10b8328b80 10 client.0 _ll_register_callbacks cb 0x564fcaee2c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:06:44.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.456+0000 7f10a7400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564fcafef300 0x564fcaff27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:44.457 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.456+0000 7f10a6a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564fcafe9600 0x564fcaff4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:44.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.456+0000 7f10a6a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564fcafe9600 0x564fcaff4ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:39032/0 (socket says 172.21.15.82:39032) 2024-05-08T06:06:44.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.456+0000 7f10a6a00700 1 -- 172.21.15.82:0/977053759 learned_addr learned my addr 172.21.15.82:0/977053759 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:06:44.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.456+0000 7f10a6000700 1 --2- 172.21.15.82:0/977053759 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564fcafee9e0 0x564fcaff2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:44.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.457+0000 7f10a6a00700 1 -- 172.21.15.82:0/977053759 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564fcafee9e0 msgr2=0x564fcaff2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:06:44.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.457+0000 7f10a6a00700 1 --2- 172.21.15.82:0/977053759 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564fcafee9e0 0x564fcaff2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:44.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.457+0000 7f10a6a00700 1 -- 172.21.15.82:0/977053759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564fcafef300 msgr2=0x564fcaff27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:06:44.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.457+0000 7f10a6a00700 1 --2- 172.21.15.82:0/977053759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564fcafef300 0x564fcaff27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:44.458 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.457+0000 7f10a6a00700 1 -- 172.21.15.82:0/977053759 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fcaf01420 con 0x564fcafe9600 2024-05-08T06:06:44.460 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.457+0000 7f10a6a00700 1 --2- 172.21.15.82:0/977053759 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564fcafe9600 0x564fcaff4ef0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f10980a5b10 tx=0x7f1098003780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4643e1d30c67761 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:06:44.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.457+0000 7f1090c00700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-05-08T06:06:44.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.457+0000 7f1090c00700 1 -- 172.21.15.82:0/977053759 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1098004570 con 0x564fcafe9600 2024-05-08T06:06:44.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.457+0000 7f1090c00700 1 -- 172.21.15.82:0/977053759 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f109800cd20 con 0x564fcafe9600 2024-05-08T06:06:44.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.457+0000 7f10b8328b80 1 -- 172.21.15.82:0/977053759 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f10a0007ad0 con 0x564fcafe9600 2024-05-08T06:06:44.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.458+0000 7f1090c00700 1 -- 172.21.15.82:0/977053759 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f10980a95a0 con 0x564fcafe9600 2024-05-08T06:06:44.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.458+0000 7f10b8328b80 10 client.27031 fetch_fsmap learned FSMap version 31 2024-05-08T06:06:44.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.458+0000 7f10b8328b80 1 -- 172.21.15.82:0/977053759 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x564fcb0004e0 con 0x564fcafe9600 2024-05-08T06:06:44.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.458+0000 7f1090c00700 1 -- 172.21.15.82:0/977053759 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f10a0007ad0 con 0x564fcafe9600 2024-05-08T06:06:44.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.458+0000 7f1090c00700 1 -- 172.21.15.82:0/977053759 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f10980e20c0 con 0x564fcafe9600 2024-05-08T06:06:44.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.458+0000 7f10b8328b80 10 client.27031 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:06:44.461 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.458+0000 7f10b8328b80 10 client.27031 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T06:06:44.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.458+0000 7f10b8328b80 20 client.27031 populate_metadata read hostname 'smithi082' 2024-05-08T06:06:44.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.458+0000 7f10b8328b80 1 --2- 172.21.15.82:0/977053759 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x564fcb002a70 0x564fcb004ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:44.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.458+0000 7f10b8328b80 4 client.27031 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-08T06:06:44.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.458+0000 7f10b8328b80 1 -- 172.21.15.82:0/977053759 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564fcafb60a0 con 0x564fcb002a70 2024-05-08T06:06:44.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.459+0000 7f10a6000700 1 --2- 172.21.15.82:0/977053759 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x564fcb002a70 0x564fcb004ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:44.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.459+0000 7f10a6000700 1 --2- 172.21.15.82:0/977053759 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x564fcb002a70 0x564fcb004ea0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5357bf2c7e326473 server_cookie=6c80b5d53a42461c in_seq=0 out_seq=0 2024-05-08T06:06:44.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.459+0000 7f1090c00700 10 client.27031 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T06:06:44.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.460+0000 7f1090c00700 1 -- 172.21.15.82:0/977053759 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564fcafb60a0 con 0x564fcb002a70 2024-05-08T06:06:44.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.460+0000 7f1090c00700 10 client.27031 handle_command_reply: tid=0 2024-05-08T06:06:44.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.460+0000 7f10b8328b80 1 client.27031 shutdown 2024-05-08T06:06:44.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.460+0000 7f10b8328b80 1 -- 172.21.15.82:0/977053759 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564fcafe9600 msgr2=0x564fcaff4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:44.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.460+0000 7f10b8328b80 1 --2- 172.21.15.82:0/977053759 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564fcafe9600 0x564fcaff4ef0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f10980a5b10 tx=0x7f1098003780 comp rx=0 tx=0).stop 2024-05-08T06:06:44.462 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.460+0000 7f10b8328b80 1 -- 172.21.15.82:0/977053759 shutdown_connections 2024-05-08T06:06:44.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.460+0000 7f10b8328b80 1 --2- 172.21.15.82:0/977053759 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564fcafef300 0x564fcaff27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:44.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.460+0000 7f10b8328b80 1 --2- 172.21.15.82:0/977053759 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564fcafe9600 0x564fcaff4ef0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:44.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.460+0000 7f10b8328b80 1 --2- 172.21.15.82:0/977053759 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x564fcb002a70 0x564fcb004ea0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:44.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.460+0000 7f10b8328b80 1 --2- 172.21.15.82:0/977053759 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564fcafee9e0 0x564fcaff2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:44.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.460+0000 7f10b8328b80 1 -- 172.21.15.82:0/977053759 >> 172.21.15.82:0/977053759 conn(0x564fcaf17b60 msgr2=0x564fcafde460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:06:44.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.460+0000 7f1090c00700 0 client.27031 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T06:06:44.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.461+0000 7f10b8328b80 1 -- 172.21.15.82:0/977053759 shutdown_connections 2024-05-08T06:06:44.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.461+0000 7f10b8328b80 1 -- 172.21.15.82:0/977053759 wait complete. 2024-05-08T06:06:44.463 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.461+0000 7f10b8328b80 20 client.27031 trim_cache size 0 max 16384 2024-05-08T06:06:44.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.477+0000 7f10b8328b80 1 Processor -- start 2024-05-08T06:06:44.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.477+0000 7f10b8328b80 1 -- start start 2024-05-08T06:06:44.479 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.477+0000 7f10b8328b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564fcafe9600 0x564fcafe8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:44.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.477+0000 7f10b8328b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564fcafee9e0 0x564fcafefdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:44.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.477+0000 7f10b8328b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564fcafef300 0x564fcb00a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:44.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.477+0000 7f10b8328b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f10a81afb50 con 0x564fcafee9e0 2024-05-08T06:06:44.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.477+0000 7f10b8328b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f10a81b1690 con 0x564fcafef300 2024-05-08T06:06:44.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.477+0000 7f10b8328b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f10a81b0220 con 0x564fcafe9600 2024-05-08T06:06:44.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.478+0000 7f10a6a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564fcafe9600 0x564fcafe8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:44.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.478+0000 7f10a6000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564fcafee9e0 0x564fcafefdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:44.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.478+0000 7f10a6a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564fcafe9600 0x564fcafe8fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:39042/0 (socket says 172.21.15.82:39042) 2024-05-08T06:06:44.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.478+0000 7f10a6a00700 1 -- 172.21.15.82:0/3945853915 learned_addr learned my addr 172.21.15.82:0/3945853915 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:06:44.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.478+0000 7f10a7400700 1 --2- 172.21.15.82:0/3945853915 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564fcafef300 0x564fcb00a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:44.480 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.478+0000 7f10a6000700 1 -- 172.21.15.82:0/3945853915 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564fcafe9600 msgr2=0x564fcafe8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:06:44.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.478+0000 7f10a6000700 1 --2- 172.21.15.82:0/3945853915 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564fcafe9600 0x564fcafe8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:44.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.478+0000 7f10a6000700 1 -- 172.21.15.82:0/3945853915 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564fcafef300 msgr2=0x564fcb00a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:06:44.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.478+0000 7f10a6000700 1 --2- 172.21.15.82:0/3945853915 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564fcafef300 0x564fcb00a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:44.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.478+0000 7f10a6000700 1 -- 172.21.15.82:0/3945853915 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564fcafe0180 con 0x564fcafee9e0 2024-05-08T06:06:44.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.478+0000 7f10a7400700 1 --2- 172.21.15.82:0/3945853915 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564fcafef300 0x564fcb00a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:06:44.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.479+0000 7f10a6000700 1 --2- 172.21.15.82:0/3945853915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564fcafee9e0 0x564fcafefdf0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x564fcafdc050 tx=0x7f1094009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8b19daf470c3477 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:06:44.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.479+0000 7f1093400700 1 -- 172.21.15.82:0/3945853915 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1094025070 con 0x564fcafee9e0 2024-05-08T06:06:44.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.479+0000 7f1093400700 1 -- 172.21.15.82:0/3945853915 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1094005020 con 0x564fcafee9e0 2024-05-08T06:06:44.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.479+0000 7f1093400700 1 -- 172.21.15.82:0/3945853915 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1094012950 con 0x564fcafee9e0 2024-05-08T06:06:44.481 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.480+0000 7f10b8328b80 1 -- 172.21.15.82:0/3945853915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564fcafee9e0 msgr2=0x564fcafefdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:44.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.480+0000 7f10b8328b80 1 --2- 172.21.15.82:0/3945853915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564fcafee9e0 0x564fcafefdf0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x564fcafdc050 tx=0x7f1094009310 comp rx=0 tx=0).stop 2024-05-08T06:06:44.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.480+0000 7f10b8328b80 1 -- 172.21.15.82:0/3945853915 shutdown_connections 2024-05-08T06:06:44.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.480+0000 7f10b8328b80 1 --2- 172.21.15.82:0/3945853915 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564fcafef300 0x564fcb00a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:44.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.480+0000 7f10b8328b80 1 --2- 172.21.15.82:0/3945853915 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564fcafe9600 0x564fcafe8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:44.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.480+0000 7f10b8328b80 1 --2- 172.21.15.82:0/3945853915 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564fcafee9e0 0x564fcafefdf0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:44.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.480+0000 7f10b8328b80 1 -- 172.21.15.82:0/3945853915 >> 172.21.15.82:0/3945853915 conn(0x564fcaf17b60 msgr2=0x564fcafef6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:06:44.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.480+0000 7f10b8328b80 1 -- 172.21.15.82:0/3945853915 shutdown_connections 2024-05-08T06:06:44.482 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.480+0000 7f10b8328b80 1 -- 172.21.15.82:0/3945853915 wait complete. 2024-05-08T06:06:44.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.480+0000 7f10b8328b80 1 -- start start 2024-05-08T06:06:44.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.481+0000 7f10b8328b80 1 Processor -- start 2024-05-08T06:06:44.486 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.481+0000 7f10b8328b80 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564fcafe9600 0x564fcaffb190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:44.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.481+0000 7f10b8328b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564fcafee9e0 0x564fcaffb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:44.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.481+0000 7f10b8328b80 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564fcafef300 0x564fcaff8160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:44.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.481+0000 7f10b8328b80 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f10a81b0fc0 con 0x564fcafe9600 2024-05-08T06:06:44.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.481+0000 7f10b8328b80 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f10a81b08f0 con 0x564fcafef300 2024-05-08T06:06:44.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.481+0000 7f10b8328b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f10a81adaf0 con 0x564fcafee9e0 2024-05-08T06:06:44.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.481+0000 7f10b8328b80 10 client.0 _ll_register_callbacks cb 0x564fcaee2c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-08T06:06:44.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.481+0000 7f10a7400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564fcafef300 0x564fcaff8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:44.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.481+0000 7f10a6a00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564fcafe9600 0x564fcaffb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:44.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.481+0000 7f10a7400700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564fcafef300 0x564fcaff8160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:47980/0 (socket says 172.21.15.82:47980) 2024-05-08T06:06:44.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.482+0000 7f10a7400700 1 -- 172.21.15.82:0/2996756392 learned_addr learned my addr 172.21.15.82:0/2996756392 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:06:44.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.482+0000 7f10a6000700 1 --2- 172.21.15.82:0/2996756392 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564fcafee9e0 0x564fcaffb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:44.487 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.482+0000 7f10a7400700 1 -- 172.21.15.82:0/2996756392 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564fcafee9e0 msgr2=0x564fcaffb6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:06:44.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.482+0000 7f10a7400700 1 --2- 172.21.15.82:0/2996756392 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564fcafee9e0 0x564fcaffb6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:44.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.482+0000 7f10a7400700 1 -- 172.21.15.82:0/2996756392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564fcafe9600 msgr2=0x564fcaffb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-08T06:06:44.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.482+0000 7f10a7400700 1 --2- 172.21.15.82:0/2996756392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564fcafe9600 0x564fcaffb190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:44.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.482+0000 7f10a7400700 1 -- 172.21.15.82:0/2996756392 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564fcaff86a0 con 0x564fcafef300 2024-05-08T06:06:44.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.482+0000 7f10a6a00700 1 --2- 172.21.15.82:0/2996756392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564fcafe9600 0x564fcaffb190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:06:44.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.482+0000 7f10a7400700 1 --2- 172.21.15.82:0/2996756392 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564fcafef300 0x564fcaff8160 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f10a0003cd0 tx=0x7f10a0009cc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e754b1b83570469c server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:06:44.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.482+0000 7f1090c00700 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-05-08T06:06:44.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.483+0000 7f1090c00700 1 -- 172.21.15.82:0/2996756392 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10a00093b0 con 0x564fcafef300 2024-05-08T06:06:44.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.483+0000 7f10b8328b80 1 -- 172.21.15.82:0/2996756392 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1094005020 con 0x564fcafef300 2024-05-08T06:06:44.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.483+0000 7f1090c00700 1 -- 172.21.15.82:0/2996756392 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f10a00075f0 con 0x564fcafef300 2024-05-08T06:06:44.488 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.483+0000 7f1090c00700 1 -- 172.21.15.82:0/2996756392 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f10a0044050 con 0x564fcafef300 2024-05-08T06:06:44.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.483+0000 7f10b8328b80 10 client.27008 fetch_fsmap learned FSMap version 31 2024-05-08T06:06:44.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.483+0000 7f10b8328b80 1 -- 172.21.15.82:0/2996756392 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x564fcb06daa0 con 0x564fcafef300 2024-05-08T06:06:44.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.483+0000 7f1090c00700 1 -- 172.21.15.82:0/2996756392 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f1094005020 con 0x564fcafef300 2024-05-08T06:06:44.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.483+0000 7f1090c00700 1 -- 172.21.15.82:0/2996756392 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 31) ==== 8354+0+0 (secure 0 0 0) 0x7f10a0011070 con 0x564fcafef300 2024-05-08T06:06:44.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.483+0000 7f10b8328b80 10 client.27008 fetch_fsmap finished waiting for FSMap version 31 2024-05-08T06:06:44.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.483+0000 7f10b8328b80 10 client.27008 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-08T06:06:44.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.483+0000 7f10b8328b80 20 client.27008 populate_metadata read hostname 'smithi082' 2024-05-08T06:06:44.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.484+0000 7f10b8328b80 1 --2- 172.21.15.82:0/2996756392 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x564fcb06de20 0x564fcb070210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:44.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.484+0000 7f10b8328b80 4 client.27008 mds_command: new command op to 24506 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-08T06:06:44.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.484+0000 7f10b8328b80 1 -- 172.21.15.82:0/2996756392 --> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564fcaf49400 con 0x564fcb06de20 2024-05-08T06:06:44.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.484+0000 7f10a6a00700 1 --2- 172.21.15.82:0/2996756392 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x564fcb06de20 0x564fcb070210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:44.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.484+0000 7f10a6a00700 1 --2- 172.21.15.82:0/2996756392 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x564fcb06de20 0x564fcb070210 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63543eb0d2701ea6 server_cookie=524fa8940e4bd1cf in_seq=0 out_seq=0 2024-05-08T06:06:44.489 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.484+0000 7f1090c00700 10 client.27008 ms_handle_connect on v2:172.21.15.134:6838/1145270893 2024-05-08T06:06:44.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.485+0000 7f1090c00700 1 -- 172.21.15.82:0/2996756392 <== mds.0 v2:172.21.15.134:6838/1145270893 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564fcaf49400 con 0x564fcb06de20 2024-05-08T06:06:44.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.485+0000 7f1090c00700 10 client.27008 handle_command_reply: tid=0 2024-05-08T06:06:44.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.485+0000 7f10b8328b80 1 client.27008 shutdown 2024-05-08T06:06:44.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.485+0000 7f10b8328b80 1 -- 172.21.15.82:0/2996756392 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564fcafef300 msgr2=0x564fcaff8160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:44.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.485+0000 7f10b8328b80 1 --2- 172.21.15.82:0/2996756392 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564fcafef300 0x564fcaff8160 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f10a0003cd0 tx=0x7f10a0009cc0 comp rx=0 tx=0).stop 2024-05-08T06:06:44.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.485+0000 7f10b8328b80 1 -- 172.21.15.82:0/2996756392 shutdown_connections 2024-05-08T06:06:44.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.485+0000 7f10b8328b80 1 --2- 172.21.15.82:0/2996756392 >> [v2:172.21.15.134:6838/1145270893,v1:172.21.15.134:6839/1145270893] conn(0x564fcb06de20 0x564fcb070210 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:44.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.485+0000 7f10b8328b80 1 --2- 172.21.15.82:0/2996756392 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564fcafef300 0x564fcaff8160 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:44.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.485+0000 7f10b8328b80 1 --2- 172.21.15.82:0/2996756392 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x564fcafe9600 0x564fcaffb190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:44.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.485+0000 7f10b8328b80 1 --2- 172.21.15.82:0/2996756392 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564fcafee9e0 0x564fcaffb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:44.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.485+0000 7f1090c00700 0 client.27008 ms_handle_reset on v2:172.21.15.134:6838/1145270893 2024-05-08T06:06:44.490 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.485+0000 7f10b8328b80 1 -- 172.21.15.82:0/2996756392 >> 172.21.15.82:0/2996756392 conn(0x564fcaf17b60 msgr2=0x564fcafddbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:06:44.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.485+0000 7f10b8328b80 1 -- 172.21.15.82:0/2996756392 shutdown_connections 2024-05-08T06:06:44.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.485+0000 7f10b8328b80 1 -- 172.21.15.82:0/2996756392 wait complete. 2024-05-08T06:06:44.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.485+0000 7f10b8328b80 20 client.27008 trim_cache size 0 max 16384 2024-05-08T06:06:44.491 INFO:teuthology.orchestra.run.smithi082.stdout:[] 2024-05-08T06:06:44.491 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.486+0000 7f10a7e00700 1 -- 172.21.15.82:0/2755538179 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f108c0b2880 msgr2=0x7f108c0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:44.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.486+0000 7f10a7e00700 1 --2- 172.21.15.82:0/2755538179 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f108c0b2880 0x7f108c0b4d40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f10a0026000 tx=0x7f10a0028000 comp rx=0 tx=0).stop 2024-05-08T06:06:44.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.486+0000 7f10a7e00700 1 -- 172.21.15.82:0/2755538179 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10a81055d0 msgr2=0x7f10a81a17a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:44.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.486+0000 7f10a7e00700 1 --2- 172.21.15.82:0/2755538179 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10a81055d0 0x7f10a81a17a0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f109800e970 tx=0x7f109800ec80 comp rx=0 tx=0).stop 2024-05-08T06:06:44.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.486+0000 7f10a7e00700 1 -- 172.21.15.82:0/2755538179 shutdown_connections 2024-05-08T06:06:44.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.486+0000 7f10a7e00700 1 --2- 172.21.15.82:0/2755538179 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f108c0b2880 0x7f108c0b4d40 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:44.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.486+0000 7f10a7e00700 1 --2- 172.21.15.82:0/2755538179 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10a810b660 0x7f10a819b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:44.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.486+0000 7f10a7e00700 1 --2- 172.21.15.82:0/2755538179 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f10a81055d0 0x7f10a81a17a0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:44.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.486+0000 7f10a7e00700 1 --2- 172.21.15.82:0/2755538179 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10a8105f90 0x7f10a81a1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:44.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.486+0000 7f10a7e00700 1 -- 172.21.15.82:0/2755538179 >> 172.21.15.82:0/2755538179 conn(0x7f10a81010c0 msgr2=0x7f10a81026d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:06:44.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.486+0000 7f10a7e00700 1 -- 172.21.15.82:0/2755538179 shutdown_connections 2024-05-08T06:06:44.492 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:44.486+0000 7f10a7e00700 1 -- 172.21.15.82:0/2755538179 wait complete. 2024-05-08T06:06:45.391 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph-c_bee299f4ac344e4c45e550d7a80abcadd7bc3d5a/qa/tasks/thrasher.py", line 47, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-05-08T06:06:45.392 INFO:tasks.fwd_scrub:done joining 2024-05-08T06:06:45.393 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-05-08T06:06:45.403 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-08T06:06:45.619 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:45.618+0000 7f9b1a400640 1 -- 172.21.15.82:0/4064775598 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b14078f50 msgr2=0x7f9b140797f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:45.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:45.618+0000 7f9b1a400640 1 --2- 172.21.15.82:0/4064775598 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b14078f50 0x7f9b140797f0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c009be0 tx=0x7f9b0c02a6d0 comp rx=0 tx=0).stop 2024-05-08T06:06:45.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:45.618+0000 7f9b1a400640 1 -- 172.21.15.82:0/4064775598 shutdown_connections 2024-05-08T06:06:45.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:45.618+0000 7f9b1a400640 1 --2- 172.21.15.82:0/4064775598 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b140785b0 0x7f9b14078a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:45.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:45.618+0000 7f9b1a400640 1 --2- 172.21.15.82:0/4064775598 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b14078f50 0x7f9b140797f0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:45.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:45.618+0000 7f9b1a400640 1 --2- 172.21.15.82:0/4064775598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b14077370 0x7f9b14077790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:45.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:45.618+0000 7f9b1a400640 1 -- 172.21.15.82:0/4064775598 >> 172.21.15.82:0/4064775598 conn(0x7f9b140fffc0 msgr2=0x7f9b141023e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:06:45.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:45.619+0000 7f9b1a400640 1 -- 172.21.15.82:0/4064775598 shutdown_connections 2024-05-08T06:06:45.620 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:45.619+0000 7f9b1a400640 1 -- 172.21.15.82:0/4064775598 wait complete. 2024-05-08T06:06:45.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:45.620+0000 7f9b1a400640 1 Processor -- start 2024-05-08T06:06:45.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:45.620+0000 7f9b1a400640 1 -- start start 2024-05-08T06:06:45.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:45.620+0000 7f9b1a400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b14077370 0x7f9b1419eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:45.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:45.620+0000 7f9b1a400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b140785b0 0x7f9b1419f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:45.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:45.620+0000 7f9b1a400640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b14078f50 0x7f9b141a65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:45.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:45.620+0000 7f9b1a400640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9b14114970 con 0x7f9b14078f50 2024-05-08T06:06:45.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:45.620+0000 7f9b1a400640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9b141147f0 con 0x7f9b140785b0 2024-05-08T06:06:45.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:45.620+0000 7f9b1a400640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9b14114af0 con 0x7f9b14077370 2024-05-08T06:06:45.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:45.621+0000 7f9b19a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b14078f50 0x7f9b141a65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:45.622 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:45.621+0000 7f9b13e00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b140785b0 0x7f9b1419f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:45.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:45.621+0000 7f9b19a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b14078f50 0x7f9b141a65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39672/0 (socket says 172.21.15.82:39672) 2024-05-08T06:06:45.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:45.621+0000 7f9b19a00640 1 -- 172.21.15.82:0/2288445160 learned_addr learned my addr 172.21.15.82:0/2288445160 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:06:45.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:45.621+0000 7f9b19000640 1 --2- 172.21.15.82:0/2288445160 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b14077370 0x7f9b1419eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:45.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:45.621+0000 7f9b19a00640 1 -- 172.21.15.82:0/2288445160 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b14077370 msgr2=0x7f9b1419eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:45.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:45.621+0000 7f9b19a00640 1 --2- 172.21.15.82:0/2288445160 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b14077370 0x7f9b1419eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:45.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:45.621+0000 7f9b19a00640 1 -- 172.21.15.82:0/2288445160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b140785b0 msgr2=0x7f9b1419f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:45.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:45.621+0000 7f9b19a00640 1 --2- 172.21.15.82:0/2288445160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b140785b0 0x7f9b1419f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:45.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:45.621+0000 7f9b19a00640 1 -- 172.21.15.82:0/2288445160 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b141a6c10 con 0x7f9b14078f50 2024-05-08T06:06:45.623 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:45.622+0000 7f9b19a00640 1 --2- 172.21.15.82:0/2288445160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b14078f50 0x7f9b141a65a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c034040 tx=0x7f9b0c030d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:06:45.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:45.622+0000 7f9b11600640 1 -- 172.21.15.82:0/2288445160 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b0c041020 con 0x7f9b14078f50 2024-05-08T06:06:45.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:45.622+0000 7f9b11600640 1 -- 172.21.15.82:0/2288445160 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b0c0318f0 con 0x7f9b14078f50 2024-05-08T06:06:45.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:45.622+0000 7f9b11600640 1 -- 172.21.15.82:0/2288445160 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b0c036040 con 0x7f9b14078f50 2024-05-08T06:06:45.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:45.622+0000 7f9b1a400640 1 -- 172.21.15.82:0/2288445160 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b141a6ea0 con 0x7f9b14078f50 2024-05-08T06:06:45.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:45.622+0000 7f9b1a400640 1 -- 172.21.15.82:0/2288445160 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b141a7300 con 0x7f9b14078f50 2024-05-08T06:06:45.624 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:45.623+0000 7f9b1a400640 1 -- 172.21.15.82:0/2288445160 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b14111580 con 0x7f9b14078f50 2024-05-08T06:06:45.626 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:45.626+0000 7f9b11600640 1 -- 172.21.15.82:0/2288445160 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f9b0c044020 con 0x7f9b14078f50 2024-05-08T06:06:45.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:45.627+0000 7f9b11600640 1 --2- 172.21.15.82:0/2288445160 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9afc0b27f0 0x7f9afc0b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:45.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:45.628+0000 7f9b11600640 1 -- 172.21.15.82:0/2288445160 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f9b0c103520 con 0x7f9b14078f50 2024-05-08T06:06:45.628 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:45.628+0000 7f9b19000640 1 --2- 172.21.15.82:0/2288445160 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9afc0b27f0 0x7f9afc0b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:45.629 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:45.628+0000 7f9b19000640 1 --2- 172.21.15.82:0/2288445160 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9afc0b27f0 0x7f9afc0b4cb0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f9b08005fd0 tx=0x7f9b08009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:06:45.630 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:45.630+0000 7f9b11600640 1 -- 172.21.15.82:0/2288445160 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9b0c04b020 con 0x7f9b14078f50 2024-05-08T06:06:45.842 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:45.842+0000 7f9b1a400640 1 -- 172.21.15.82:0/2288445160 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9b14063650 con 0x7f9b14078f50 2024-05-08T06:06:45.845 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:45.844+0000 7f9b11600640 1 -- 172.21.15.82:0/2288445160 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22631 (secure 0 0 0) 0x7f9b0c0cb1f0 con 0x7f9b14078f50 2024-05-08T06:06:45.845 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T06:06:45.846 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":82,"fsid":"c739a5c8-0cfc-11ef-bc97-c7b262605968","created":"2024-05-08T05:36:37.441393+0000","modified":"2024-05-08T05:46:45.754375+0000","last_up_change":"2024-05-08T05:44:40.677995+0000","last_in_change":"2024-05-08T05:44:20.654220+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T05:40:28.102836+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T05:45:48.727521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T05:45:53.574048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bc9bd472-b765-4893-84ed-c66b5c1c61b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":4051651615},{"type":"v1","addr":"172.21.15.82:6803","nonce":4051651615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":4051651615},{"type":"v1","addr":"172.21.15.82:6805","nonce":4051651615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4051651615},{"type":"v1","addr":"172.21.15.82:6809","nonce":4051651615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":4051651615},{"type":"v1","addr":"172.21.15.82:6807","nonce":4051651615}]},"public_addr":"172.21.15.82:6803/4051651615","cluster_addr":"172.21.15.82:6805/4051651615","heartbeat_back_addr":"172.21.15.82:6809/4051651615","heartbeat_front_addr":"172.21.15.82:6807/4051651615","state":["exists","up"]},{"osd":1,"uuid":"ad2d3a6b-8bc5-4177-8757-07e8607ca240","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":2763858634},{"type":"v1","addr":"172.21.15.134:6801","nonce":2763858634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":2763858634},{"type":"v1","addr":"172.21.15.134:6803","nonce":2763858634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":2763858634},{"type":"v1","addr":"172.21.15.134:6807","nonce":2763858634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2763858634},{"type":"v1","addr":"172.21.15.134:6805","nonce":2763858634}]},"public_addr":"172.21.15.134:6801/2763858634","cluster_addr":"172.21.15.134:6803/2763858634","heartbeat_back_addr":"172.21.15.134:6807/2763858634","heartbeat_front_addr":"172.21.15.134:6805/2763858634","state":["exists","up"]},{"osd":2,"uuid":"a06dc8fc-7324-4e42-9487-8cfe372401b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":4193933269},{"type":"v1","addr":"172.21.15.151:6801","nonce":4193933269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":4193933269},{"type":"v1","addr":"172.21.15.151:6803","nonce":4193933269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":4193933269},{"type":"v1","addr":"172.21.15.151:6807","nonce":4193933269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":4193933269},{"type":"v1","addr":"172.21.15.151:6805","nonce":4193933269}]},"public_addr":"172.21.15.151:6801/4193933269","cluster_addr":"172.21.15.151:6803/4193933269","heartbeat_back_addr":"172.21.15.151:6807/4193933269","heartbeat_front_addr":"172.21.15.151:6805/4193933269","state":["exists","up"]},{"osd":3,"uuid":"b8c8bdcd-fbd7-4494-976e-7285408e010e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":2775272422},{"type":"v1","addr":"172.21.15.82:6811","nonce":2775272422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":2775272422},{"type":"v1","addr":"172.21.15.82:6813","nonce":2775272422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":2775272422},{"type":"v1","addr":"172.21.15.82:6817","nonce":2775272422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":2775272422},{"type":"v1","addr":"172.21.15.82:6815","nonce":2775272422}]},"public_addr":"172.21.15.82:6811/2775272422","cluster_addr":"172.21.15.82:6813/2775272422","heartbeat_back_addr":"172.21.15.82:6817/2775272422","heartbeat_front_addr":"172.21.15.82:6815/2775272422","state":["exists","up"]},{"osd":4,"uuid":"391a6040-03d1-483c-9058-308b5998e7c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3565208751},{"type":"v1","addr":"172.21.15.134:6809","nonce":3565208751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3565208751},{"type":"v1","addr":"172.21.15.134:6811","nonce":3565208751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3565208751},{"type":"v1","addr":"172.21.15.134:6815","nonce":3565208751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3565208751},{"type":"v1","addr":"172.21.15.134:6813","nonce":3565208751}]},"public_addr":"172.21.15.134:6809/3565208751","cluster_addr":"172.21.15.134:6811/3565208751","heartbeat_back_addr":"172.21.15.134:6815/3565208751","heartbeat_front_addr":"172.21.15.134:6813/3565208751","state":["exists","up"]},{"osd":5,"uuid":"dacce079-4aad-474e-b747-1ed60c3c71cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":1925634069},{"type":"v1","addr":"172.21.15.151:6809","nonce":1925634069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":1925634069},{"type":"v1","addr":"172.21.15.151:6811","nonce":1925634069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1925634069},{"type":"v1","addr":"172.21.15.151:6815","nonce":1925634069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1925634069},{"type":"v1","addr":"172.21.15.151:6813","nonce":1925634069}]},"public_addr":"172.21.15.151:6809/1925634069","cluster_addr":"172.21.15.151:6811/1925634069","heartbeat_back_addr":"172.21.15.151:6815/1925634069","heartbeat_front_addr":"172.21.15.151:6813/1925634069","state":["exists","up"]},{"osd":6,"uuid":"6a445bf4-09c4-4e9b-be6e-68ef3c05b365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":762647976},{"type":"v1","addr":"172.21.15.82:6819","nonce":762647976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":762647976},{"type":"v1","addr":"172.21.15.82:6821","nonce":762647976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":762647976},{"type":"v1","addr":"172.21.15.82:6825","nonce":762647976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":762647976},{"type":"v1","addr":"172.21.15.82:6823","nonce":762647976}]},"public_addr":"172.21.15.82:6819/762647976","cluster_addr":"172.21.15.82:6821/762647976","heartbeat_back_addr":"172.21.15.82:6825/762647976","heartbeat_front_addr":"172.21.15.82:6823/762647976","state":["exists","up"]},{"osd":7,"uuid":"72b0c735-ef30-4823-8ab8-2e5bf7cc3c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3006846927},{"type":"v1","addr":"172.21.15.134:6817","nonce":3006846927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3006846927},{"type":"v1","addr":"172.21.15.134:6819","nonce":3006846927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3006846927},{"type":"v1","addr":"172.21.15.134:6823","nonce":3006846927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3006846927},{"type":"v1","addr":"172.21.15.134:6821","nonce":3006846927}]},"public_addr":"172.21.15.134:6817/3006846927","cluster_addr":"172.21.15.134:6819/3006846927","heartbeat_back_addr":"172.21.15.134:6823/3006846927","heartbeat_front_addr":"172.21.15.134:6821/3006846927","state":["exists","up"]},{"osd":8,"uuid":"93e4da0f-48ea-4ab7-b612-26b545b76de6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":787870717},{"type":"v1","addr":"172.21.15.151:6817","nonce":787870717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":787870717},{"type":"v1","addr":"172.21.15.151:6819","nonce":787870717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":787870717},{"type":"v1","addr":"172.21.15.151:6823","nonce":787870717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":787870717},{"type":"v1","addr":"172.21.15.151:6821","nonce":787870717}]},"public_addr":"172.21.15.151:6817/787870717","cluster_addr":"172.21.15.151:6819/787870717","heartbeat_back_addr":"172.21.15.151:6823/787870717","heartbeat_front_addr":"172.21.15.151:6821/787870717","state":["exists","up"]},{"osd":9,"uuid":"ea0070c1-286a-47d3-90cf-d1fada6e3cda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":533124002},{"type":"v1","addr":"172.21.15.82:6827","nonce":533124002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":533124002},{"type":"v1","addr":"172.21.15.82:6829","nonce":533124002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":533124002},{"type":"v1","addr":"172.21.15.82:6833","nonce":533124002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":533124002},{"type":"v1","addr":"172.21.15.82:6831","nonce":533124002}]},"public_addr":"172.21.15.82:6827/533124002","cluster_addr":"172.21.15.82:6829/533124002","heartbeat_back_addr":"172.21.15.82:6833/533124002","heartbeat_front_addr":"172.21.15.82:6831/533124002","state":["exists","up"]},{"osd":10,"uuid":"26ca0a0b-ab9e-472f-bb29-428e8c31e5bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":99154842},{"type":"v1","addr":"172.21.15.134:6825","nonce":99154842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":99154842},{"type":"v1","addr":"172.21.15.134:6827","nonce":99154842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":99154842},{"type":"v1","addr":"172.21.15.134:6831","nonce":99154842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":99154842},{"type":"v1","addr":"172.21.15.134:6829","nonce":99154842}]},"public_addr":"172.21.15.134:6825/99154842","cluster_addr":"172.21.15.134:6827/99154842","heartbeat_back_addr":"172.21.15.134:6831/99154842","heartbeat_front_addr":"172.21.15.134:6829/99154842","state":["exists","up"]},{"osd":11,"uuid":"9ae5dca4-acfb-4a46-8601-9d642efde794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2242771269},{"type":"v1","addr":"172.21.15.151:6825","nonce":2242771269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2242771269},{"type":"v1","addr":"172.21.15.151:6827","nonce":2242771269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2242771269},{"type":"v1","addr":"172.21.15.151:6831","nonce":2242771269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2242771269},{"type":"v1","addr":"172.21.15.151:6829","nonce":2242771269}]},"public_addr":"172.21.15.151:6825/2242771269","cluster_addr":"172.21.15.151:6827/2242771269","heartbeat_back_addr":"172.21.15.151:6831/2242771269","heartbeat_front_addr":"172.21.15.151:6829/2242771269","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:39:35.575525+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:40:00.672367+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:40:24.558682+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:40:56.791194+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:41:23.031785+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:41:47.926448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:42:21.231894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:42:47.599982+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:43:12.950581+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:43:46.333027+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:44:13.457489+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:44:38.637273+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/2761274596":"2024-05-09T05:37:43.951218+0000","172.21.15.82:0/2195734928":"2024-05-09T05:37:43.951218+0000","172.21.15.82:6801/765895649":"2024-05-09T05:37:43.951218+0000","172.21.15.82:6800/3546670887":"2024-05-09T05:37:11.114057+0000","172.21.15.82:6800/765895649":"2024-05-09T05:37:43.951218+0000","172.21.15.82:0/3986150437":"2024-05-09T05:37:11.114057+0000","172.21.15.82:0/3457457714":"2024-05-09T05:37:11.114057+0000","172.21.15.82:0/2356749286":"2024-05-09T05:37:11.114057+0000","172.21.15.82:6801/3546670887":"2024-05-09T05:37:11.114057+0000","172.21.15.82:0/1694643083":"2024-05-09T05:37:43.951218+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T06:06:45.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:45.847+0000 7f9b1a400640 1 -- 172.21.15.82:0/2288445160 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9afc0b27f0 msgr2=0x7f9afc0b4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:45.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:45.847+0000 7f9b1a400640 1 --2- 172.21.15.82:0/2288445160 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9afc0b27f0 0x7f9afc0b4cb0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f9b08005fd0 tx=0x7f9b08009260 comp rx=0 tx=0).stop 2024-05-08T06:06:45.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:45.847+0000 7f9b1a400640 1 -- 172.21.15.82:0/2288445160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b14078f50 msgr2=0x7f9b141a65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:45.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:45.847+0000 7f9b1a400640 1 --2- 172.21.15.82:0/2288445160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b14078f50 0x7f9b141a65a0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c034040 tx=0x7f9b0c030d70 comp rx=0 tx=0).stop 2024-05-08T06:06:45.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:45.847+0000 7f9b1a400640 1 -- 172.21.15.82:0/2288445160 shutdown_connections 2024-05-08T06:06:45.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:45.847+0000 7f9b1a400640 1 --2- 172.21.15.82:0/2288445160 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9afc0b27f0 0x7f9afc0b4cb0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:45.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:45.847+0000 7f9b1a400640 1 --2- 172.21.15.82:0/2288445160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b140785b0 0x7f9b1419f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:45.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:45.847+0000 7f9b1a400640 1 --2- 172.21.15.82:0/2288445160 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b14078f50 0x7f9b141a65a0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:45.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:45.847+0000 7f9b1a400640 1 --2- 172.21.15.82:0/2288445160 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b14077370 0x7f9b1419eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:45.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:45.847+0000 7f9b1a400640 1 -- 172.21.15.82:0/2288445160 >> 172.21.15.82:0/2288445160 conn(0x7f9b140fffc0 msgr2=0x7f9b141016f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:06:45.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:45.848+0000 7f9b1a400640 1 -- 172.21.15.82:0/2288445160 shutdown_connections 2024-05-08T06:06:45.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:45.848+0000 7f9b1a400640 1 -- 172.21.15.82:0/2288445160 wait complete. 2024-05-08T06:06:45.869 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-08T05:40:28.102836+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-08T05:45:48.727521+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-08T05:45:53.574048+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-08T06:06:45.869 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-08T06:06:45.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:06:45 smithi134 ceph-mon[34132]: pgmap v942: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-05-08T06:06:46.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.076+0000 7fecfaa00640 1 -- 172.21.15.82:0/2921433630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fecf4101140 msgr2=0x7fecf4103570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:46.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.076+0000 7fecfaa00640 1 --2- 172.21.15.82:0/2921433630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fecf4101140 0x7fecf4103570 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fece8009900 tx=0x7fece802a3f0 comp rx=0 tx=0).stop 2024-05-08T06:06:46.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.076+0000 7fecfaa00640 1 -- 172.21.15.82:0/2921433630 shutdown_connections 2024-05-08T06:06:46.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.076+0000 7fecfaa00640 1 --2- 172.21.15.82:0/2921433630 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecf4106460 0x7fecf41068e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:46.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.076+0000 7fecfaa00640 1 --2- 172.21.15.82:0/2921433630 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fecf4103ab0 0x7fecf4105f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:46.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.076+0000 7fecfaa00640 1 --2- 172.21.15.82:0/2921433630 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fecf4101140 0x7fecf4103570 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:46.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.076+0000 7fecfaa00640 1 -- 172.21.15.82:0/2921433630 >> 172.21.15.82:0/2921433630 conn(0x7fecf40fcd60 msgr2=0x7fecf40ff180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:06:46.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.076+0000 7fecfaa00640 1 -- 172.21.15.82:0/2921433630 shutdown_connections 2024-05-08T06:06:46.077 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.076+0000 7fecfaa00640 1 -- 172.21.15.82:0/2921433630 wait complete. 2024-05-08T06:06:46.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.077+0000 7fecfaa00640 1 Processor -- start 2024-05-08T06:06:46.079 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.077+0000 7fecfaa00640 1 -- start start 2024-05-08T06:06:46.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.077+0000 7fecfaa00640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecf4101140 0x7fecf419f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:46.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.077+0000 7fecfaa00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fecf4103ab0 0x7fecf419f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:46.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.077+0000 7fecfaa00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fecf4106460 0x7fecf41a6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:46.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.077+0000 7fecfaa00640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fecf41149c0 con 0x7fecf4103ab0 2024-05-08T06:06:46.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.077+0000 7fecfaa00640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fecf4114840 con 0x7fecf4101140 2024-05-08T06:06:46.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.077+0000 7fecfaa00640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fecf4114b40 con 0x7fecf4106460 2024-05-08T06:06:46.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.078+0000 7fecf9600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecf4101140 0x7fecf419f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:46.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.078+0000 7fecf8c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fecf4103ab0 0x7fecf419f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:46.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.078+0000 7fecf8c00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fecf4103ab0 0x7fecf419f610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39694/0 (socket says 172.21.15.82:39694) 2024-05-08T06:06:46.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.078+0000 7fecfa000640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fecf4106460 0x7fecf41a6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:46.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.078+0000 7fecf8c00640 1 -- 172.21.15.82:0/4248406070 learned_addr learned my addr 172.21.15.82:0/4248406070 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:06:46.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.078+0000 7fecf9600640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecf4101140 0x7fecf419f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.82:48026/0 (socket says 172.21.15.82:48026) 2024-05-08T06:06:46.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.078+0000 7fecf9600640 1 -- 172.21.15.82:0/4248406070 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fecf4106460 msgr2=0x7fecf41a6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:46.080 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.078+0000 7fecf9600640 1 --2- 172.21.15.82:0/4248406070 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fecf4106460 0x7fecf41a6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:46.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.078+0000 7fecf9600640 1 -- 172.21.15.82:0/4248406070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fecf4103ab0 msgr2=0x7fecf419f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:46.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.078+0000 7fecf9600640 1 --2- 172.21.15.82:0/4248406070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fecf4103ab0 0x7fecf419f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:46.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.078+0000 7fecf9600640 1 -- 172.21.15.82:0/4248406070 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecf41a6cf0 con 0x7fecf4101140 2024-05-08T06:06:46.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.079+0000 7fecf9600640 1 --2- 172.21.15.82:0/4248406070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecf4101140 0x7fecf419f0d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fece8006010 tx=0x7fece80042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:06:46.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.079+0000 7fecf2000640 1 -- 172.21.15.82:0/4248406070 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece803f030 con 0x7fecf4101140 2024-05-08T06:06:46.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.079+0000 7fecf2000640 1 -- 172.21.15.82:0/4248406070 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fece8031910 con 0x7fecf4101140 2024-05-08T06:06:46.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.079+0000 7fecfaa00640 1 -- 172.21.15.82:0/4248406070 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecf41a6f80 con 0x7fecf4101140 2024-05-08T06:06:46.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.079+0000 7fecf2000640 1 -- 172.21.15.82:0/4248406070 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece8035070 con 0x7fecf4101140 2024-05-08T06:06:46.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.079+0000 7fecfaa00640 1 -- 172.21.15.82:0/4248406070 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecf41a7390 con 0x7fecf4101140 2024-05-08T06:06:46.081 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.080+0000 7fecfaa00640 1 -- 172.21.15.82:0/4248406070 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecf40fe850 con 0x7fecf4101140 2024-05-08T06:06:46.083 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.082+0000 7fecf2000640 1 -- 172.21.15.82:0/4248406070 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fece8042030 con 0x7fecf4101140 2024-05-08T06:06:46.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.084+0000 7fecf2000640 1 --2- 172.21.15.82:0/4248406070 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fecdc0b27f0 0x7fecdc0b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:46.084 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.084+0000 7fecf2000640 1 -- 172.21.15.82:0/4248406070 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fece8102800 con 0x7fecf4101140 2024-05-08T06:06:46.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.084+0000 7fecf8c00640 1 --2- 172.21.15.82:0/4248406070 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fecdc0b27f0 0x7fecdc0b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:46.085 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.085+0000 7fecf8c00640 1 --2- 172.21.15.82:0/4248406070 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fecdc0b27f0 0x7fecdc0b4cb0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fece00095f0 tx=0x7fece0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:06:46.089 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.089+0000 7fecf2000640 1 -- 172.21.15.82:0/4248406070 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fece80c9f40 con 0x7fecf4101140 2024-05-08T06:06:46.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:06:45 smithi151 ceph-mon[34815]: pgmap v942: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-05-08T06:06:46.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:06:45 smithi082 ceph-mon[30098]: pgmap v942: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-05-08T06:06:46.299 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.299+0000 7fecfaa00640 1 -- 172.21.15.82:0/4248406070 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fecf4063650 con 0x7fecf4101140 2024-05-08T06:06:46.300 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.300+0000 7fecf2000640 1 -- 172.21.15.82:0/4248406070 <== mon.2 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v82) ==== 93+0+10 (secure 0 0 0) 0x7fece80ce240 con 0x7fecf4101140 2024-05-08T06:06:46.301 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 1 2024-05-08T06:06:46.305 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.304+0000 7fecfaa00640 1 -- 172.21.15.82:0/4248406070 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fecdc0b27f0 msgr2=0x7fecdc0b4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:46.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.304+0000 7fecfaa00640 1 --2- 172.21.15.82:0/4248406070 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fecdc0b27f0 0x7fecdc0b4cb0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fece00095f0 tx=0x7fece0005f90 comp rx=0 tx=0).stop 2024-05-08T06:06:46.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.304+0000 7fecfaa00640 1 -- 172.21.15.82:0/4248406070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecf4101140 msgr2=0x7fecf419f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:46.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.304+0000 7fecfaa00640 1 --2- 172.21.15.82:0/4248406070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecf4101140 0x7fecf419f0d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fece8006010 tx=0x7fece80042f0 comp rx=0 tx=0).stop 2024-05-08T06:06:46.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.305+0000 7fecfaa00640 1 -- 172.21.15.82:0/4248406070 shutdown_connections 2024-05-08T06:06:46.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.305+0000 7fecfaa00640 1 --2- 172.21.15.82:0/4248406070 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fecdc0b27f0 0x7fecdc0b4cb0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:46.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.305+0000 7fecfaa00640 1 --2- 172.21.15.82:0/4248406070 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fecf4106460 0x7fecf41a6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:46.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.305+0000 7fecfaa00640 1 --2- 172.21.15.82:0/4248406070 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fecf4103ab0 0x7fecf419f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:46.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.305+0000 7fecfaa00640 1 --2- 172.21.15.82:0/4248406070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fecf4101140 0x7fecf419f0d0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:46.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.305+0000 7fecfaa00640 1 -- 172.21.15.82:0/4248406070 >> 172.21.15.82:0/4248406070 conn(0x7fecf40fcd60 msgr2=0x7fecf4104530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:06:46.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.305+0000 7fecfaa00640 1 -- 172.21.15.82:0/4248406070 shutdown_connections 2024-05-08T06:06:46.306 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.305+0000 7fecfaa00640 1 -- 172.21.15.82:0/4248406070 wait complete. 2024-05-08T06:06:46.323 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-08T06:06:46.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.533+0000 7efcfd200640 1 -- 172.21.15.82:0/3306163428 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efcf80769f0 msgr2=0x7efcf8074e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:46.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.533+0000 7efcfd200640 1 --2- 172.21.15.82:0/3306163428 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efcf80769f0 0x7efcf8074e40 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7efce8009ca0 tx=0x7efce802a8c0 comp rx=0 tx=0).stop 2024-05-08T06:06:46.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.533+0000 7efcfd200640 1 -- 172.21.15.82:0/3306163428 shutdown_connections 2024-05-08T06:06:46.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.533+0000 7efcfd200640 1 --2- 172.21.15.82:0/3306163428 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efcf810efc0 0x7efcf81113b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:46.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.533+0000 7efcfd200640 1 --2- 172.21.15.82:0/3306163428 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcf8075410 0x7efcf8075890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:46.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.533+0000 7efcfd200640 1 --2- 172.21.15.82:0/3306163428 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efcf80769f0 0x7efcf8074e40 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:46.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.533+0000 7efcfd200640 1 -- 172.21.15.82:0/3306163428 >> 172.21.15.82:0/3306163428 conn(0x7efcf80fdf60 msgr2=0x7efcf81003a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:06:46.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.533+0000 7efcfd200640 1 -- 172.21.15.82:0/3306163428 shutdown_connections 2024-05-08T06:06:46.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.533+0000 7efcfd200640 1 -- 172.21.15.82:0/3306163428 wait complete. 2024-05-08T06:06:46.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.534+0000 7efcfd200640 1 Processor -- start 2024-05-08T06:06:46.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.534+0000 7efcfd200640 1 -- start start 2024-05-08T06:06:46.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.535+0000 7efcfd200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efcf8075410 0x7efcf819f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:46.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.535+0000 7efcfd200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efcf80769f0 0x7efcf819f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:46.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.535+0000 7efcfd200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcf810efc0 0x7efcf81a6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:46.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.535+0000 7efcfd200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7efcf8114b80 con 0x7efcf810efc0 2024-05-08T06:06:46.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.535+0000 7efcfd200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7efcf8114a00 con 0x7efcf8075410 2024-05-08T06:06:46.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.535+0000 7efcfd200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7efcf8114d00 con 0x7efcf80769f0 2024-05-08T06:06:46.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.535+0000 7efcf6800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcf810efc0 0x7efcf81a6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:46.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.535+0000 7efcf6800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcf810efc0 0x7efcf81a6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39716/0 (socket says 172.21.15.82:39716) 2024-05-08T06:06:46.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.535+0000 7efcf6800640 1 -- 172.21.15.82:0/2048996375 learned_addr learned my addr 172.21.15.82:0/2048996375 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:06:46.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.535+0000 7efcf5e00640 1 --2- 172.21.15.82:0/2048996375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efcf8075410 0x7efcf819f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:46.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.535+0000 7efcf5400640 1 --2- 172.21.15.82:0/2048996375 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efcf80769f0 0x7efcf819f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:46.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.535+0000 7efcf6800640 1 -- 172.21.15.82:0/2048996375 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efcf80769f0 msgr2=0x7efcf819f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:46.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.535+0000 7efcf6800640 1 --2- 172.21.15.82:0/2048996375 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efcf80769f0 0x7efcf819f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:46.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.536+0000 7efcf6800640 1 -- 172.21.15.82:0/2048996375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efcf8075410 msgr2=0x7efcf819f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:46.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.536+0000 7efcf6800640 1 --2- 172.21.15.82:0/2048996375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efcf8075410 0x7efcf819f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:46.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.536+0000 7efcf6800640 1 -- 172.21.15.82:0/2048996375 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcf81a6e80 con 0x7efcf810efc0 2024-05-08T06:06:46.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.536+0000 7efcf6800640 1 --2- 172.21.15.82:0/2048996375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcf810efc0 0x7efcf81a6810 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7efcf000e970 tx=0x7efcf000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:06:46.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.536+0000 7efceea00640 1 -- 172.21.15.82:0/2048996375 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf000ccc0 con 0x7efcf810efc0 2024-05-08T06:06:46.538 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.536+0000 7efcfd200640 1 -- 172.21.15.82:0/2048996375 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcf81a7170 con 0x7efcf810efc0 2024-05-08T06:06:46.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.536+0000 7efceea00640 1 -- 172.21.15.82:0/2048996375 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7efcf000ce60 con 0x7efcf810efc0 2024-05-08T06:06:46.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.536+0000 7efcfd200640 1 -- 172.21.15.82:0/2048996375 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcf81a7710 con 0x7efcf810efc0 2024-05-08T06:06:46.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.536+0000 7efceea00640 1 -- 172.21.15.82:0/2048996375 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcf0018430 con 0x7efcf810efc0 2024-05-08T06:06:46.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.538+0000 7efcfd200640 1 -- 172.21.15.82:0/2048996375 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcf8105190 con 0x7efcf810efc0 2024-05-08T06:06:46.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.540+0000 7efceea00640 1 -- 172.21.15.82:0/2048996375 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7efcf0004f30 con 0x7efcf810efc0 2024-05-08T06:06:46.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.541+0000 7efceea00640 1 --2- 172.21.15.82:0/2048996375 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7efcdc0b27f0 0x7efcdc0b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:46.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.541+0000 7efceea00640 1 -- 172.21.15.82:0/2048996375 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7efcf00e2630 con 0x7efcf810efc0 2024-05-08T06:06:46.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.542+0000 7efcf5e00640 1 --2- 172.21.15.82:0/2048996375 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7efcdc0b27f0 0x7efcdc0b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:46.542 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.542+0000 7efcf5e00640 1 --2- 172.21.15.82:0/2048996375 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7efcdc0b27f0 0x7efcdc0b4cb0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7efce8005e30 tx=0x7efce8005f50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:06:46.546 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.546+0000 7efceea00640 1 -- 172.21.15.82:0/2048996375 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7efcf00aa300 con 0x7efcf810efc0 2024-05-08T06:06:46.757 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.756+0000 7efcfd200640 1 -- 172.21.15.82:0/2048996375 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7efcf80635b0 con 0x7efcf810efc0 2024-05-08T06:06:46.758 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.758+0000 7efceea00640 1 -- 172.21.15.82:0/2048996375 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v82) ==== 104+0+11 (secure 0 0 0) 0x7efcf00a9c00 con 0x7efcf810efc0 2024-05-08T06:06:46.758 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 32 2024-05-08T06:06:46.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.760+0000 7efcfd200640 1 -- 172.21.15.82:0/2048996375 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7efcdc0b27f0 msgr2=0x7efcdc0b4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:46.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.760+0000 7efcfd200640 1 --2- 172.21.15.82:0/2048996375 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7efcdc0b27f0 0x7efcdc0b4cb0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7efce8005e30 tx=0x7efce8005f50 comp rx=0 tx=0).stop 2024-05-08T06:06:46.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.760+0000 7efcfd200640 1 -- 172.21.15.82:0/2048996375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcf810efc0 msgr2=0x7efcf81a6810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:46.761 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.760+0000 7efcfd200640 1 --2- 172.21.15.82:0/2048996375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcf810efc0 0x7efcf81a6810 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7efcf000e970 tx=0x7efcf000ed70 comp rx=0 tx=0).stop 2024-05-08T06:06:46.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.761+0000 7efcfd200640 1 -- 172.21.15.82:0/2048996375 shutdown_connections 2024-05-08T06:06:46.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.761+0000 7efcfd200640 1 --2- 172.21.15.82:0/2048996375 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7efcdc0b27f0 0x7efcdc0b4cb0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:46.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.761+0000 7efcfd200640 1 --2- 172.21.15.82:0/2048996375 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7efcf810efc0 0x7efcf81a6810 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:46.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.761+0000 7efcfd200640 1 --2- 172.21.15.82:0/2048996375 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efcf80769f0 0x7efcf819f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:46.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.761+0000 7efcfd200640 1 --2- 172.21.15.82:0/2048996375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efcf8075410 0x7efcf819f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:46.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.761+0000 7efcfd200640 1 -- 172.21.15.82:0/2048996375 >> 172.21.15.82:0/2048996375 conn(0x7efcf80fdf60 msgr2=0x7efcf8102360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:06:46.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.761+0000 7efcfd200640 1 -- 172.21.15.82:0/2048996375 shutdown_connections 2024-05-08T06:06:46.762 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.761+0000 7efcfd200640 1 -- 172.21.15.82:0/2048996375 wait complete. 2024-05-08T06:06:46.782 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-08T06:06:46.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.989+0000 7f5b28200640 1 -- 172.21.15.82:0/849063743 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b20104c10 msgr2=0x7f5b20105030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:46.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.989+0000 7f5b28200640 1 --2- 172.21.15.82:0/849063743 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b20104c10 0x7f5b20105030 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f5b14009900 tx=0x7f5b1402a3f0 comp rx=0 tx=0).stop 2024-05-08T06:06:46.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.989+0000 7f5b28200640 1 -- 172.21.15.82:0/849063743 shutdown_connections 2024-05-08T06:06:46.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.989+0000 7f5b28200640 1 --2- 172.21.15.82:0/849063743 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5b201067c0 0x7f5b2010d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:46.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.989+0000 7f5b28200640 1 --2- 172.21.15.82:0/849063743 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b20105e00 0x7f5b20106280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:46.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.989+0000 7f5b28200640 1 --2- 172.21.15.82:0/849063743 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b20104c10 0x7f5b20105030 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:46.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.989+0000 7f5b28200640 1 -- 172.21.15.82:0/849063743 >> 172.21.15.82:0/849063743 conn(0x7f5b201001a0 msgr2=0x7f5b201025c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:06:46.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.989+0000 7f5b28200640 1 -- 172.21.15.82:0/849063743 shutdown_connections 2024-05-08T06:06:46.990 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.989+0000 7f5b28200640 1 -- 172.21.15.82:0/849063743 wait complete. 2024-05-08T06:06:46.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.990+0000 7f5b28200640 1 Processor -- start 2024-05-08T06:06:46.992 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.990+0000 7f5b28200640 1 -- start start 2024-05-08T06:06:46.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.990+0000 7f5b28200640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b20104c10 0x7f5b2019ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:46.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.990+0000 7f5b28200640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b20105e00 0x7f5b2019b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:46.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.990+0000 7f5b28200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5b201067c0 0x7f5b201a23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:46.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.990+0000 7f5b28200640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5b20110740 con 0x7f5b20104c10 2024-05-08T06:06:46.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.990+0000 7f5b28200640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5b201105c0 con 0x7f5b20105e00 2024-05-08T06:06:46.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.990+0000 7f5b28200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5b201108c0 con 0x7f5b201067c0 2024-05-08T06:06:46.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.991+0000 7f5b25800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b20104c10 0x7f5b2019ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:46.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.991+0000 7f5b25800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b20104c10 0x7f5b2019ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39736/0 (socket says 172.21.15.82:39736) 2024-05-08T06:06:46.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.991+0000 7f5b25800640 1 -- 172.21.15.82:0/581467073 learned_addr learned my addr 172.21.15.82:0/581467073 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:06:46.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.991+0000 7f5b26200640 1 --2- 172.21.15.82:0/581467073 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5b201067c0 0x7f5b201a23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:46.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.991+0000 7f5b24e00640 1 --2- 172.21.15.82:0/581467073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b20105e00 0x7f5b2019b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:46.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.991+0000 7f5b25800640 1 -- 172.21.15.82:0/581467073 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5b201067c0 msgr2=0x7f5b201a23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:46.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.991+0000 7f5b25800640 1 --2- 172.21.15.82:0/581467073 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5b201067c0 0x7f5b201a23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:46.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.991+0000 7f5b25800640 1 -- 172.21.15.82:0/581467073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b20105e00 msgr2=0x7f5b2019b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:46.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.991+0000 7f5b25800640 1 --2- 172.21.15.82:0/581467073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b20105e00 0x7f5b2019b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:46.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.991+0000 7f5b25800640 1 -- 172.21.15.82:0/581467073 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b201a2a40 con 0x7f5b20104c10 2024-05-08T06:06:46.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.992+0000 7f5b25800640 1 --2- 172.21.15.82:0/581467073 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b20104c10 0x7f5b2019ae20 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5b14006010 tx=0x7f5b140042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:06:46.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.992+0000 7f5b1e000640 1 -- 172.21.15.82:0/581467073 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b1403f030 con 0x7f5b20104c10 2024-05-08T06:06:46.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.992+0000 7f5b1e000640 1 -- 172.21.15.82:0/581467073 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b14031910 con 0x7f5b20104c10 2024-05-08T06:06:46.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.992+0000 7f5b28200640 1 -- 172.21.15.82:0/581467073 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b201a2cd0 con 0x7f5b20104c10 2024-05-08T06:06:46.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.992+0000 7f5b1e000640 1 -- 172.21.15.82:0/581467073 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b14035070 con 0x7f5b20104c10 2024-05-08T06:06:46.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.992+0000 7f5b28200640 1 -- 172.21.15.82:0/581467073 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b201a31c0 con 0x7f5b20104c10 2024-05-08T06:06:46.994 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.993+0000 7f5b28200640 1 -- 172.21.15.82:0/581467073 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b2010bfb0 con 0x7f5b20104c10 2024-05-08T06:06:46.996 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.996+0000 7f5b1e000640 1 -- 172.21.15.82:0/581467073 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f5b14042030 con 0x7f5b20104c10 2024-05-08T06:06:46.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.997+0000 7f5b1e000640 1 --2- 172.21.15.82:0/581467073 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f5b080b27f0 0x7f5b080b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:46.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.997+0000 7f5b1e000640 1 -- 172.21.15.82:0/581467073 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f5b14102b40 con 0x7f5b20104c10 2024-05-08T06:06:46.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.998+0000 7f5b24e00640 1 --2- 172.21.15.82:0/581467073 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f5b080b27f0 0x7f5b080b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:46.998 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.998+0000 7f5b24e00640 1 --2- 172.21.15.82:0/581467073 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f5b080b27f0 0x7f5b080b4cb0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5b2019c330 tx=0x7f5b0c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:06:46.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:06:46 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/2288445160' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T06:06:46.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:06:46 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/4248406070' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T06:06:47.000 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:46.999+0000 7f5b1e000640 1 -- 172.21.15.82:0/581467073 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5b140ca1c0 con 0x7f5b20104c10 2024-05-08T06:06:47.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:06:46 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/2288445160' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T06:06:47.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:06:46 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/4248406070' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T06:06:47.209 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.209+0000 7f5b28200640 1 -- 172.21.15.82:0/581467073 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f5b2002dd20 con 0x7f5b20104c10 2024-05-08T06:06:47.210 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.210+0000 7f5b1e000640 1 -- 172.21.15.82:0/581467073 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v82) ==== 100+0+11 (secure 0 0 0) 0x7f5b140ce4c0 con 0x7f5b20104c10 2024-05-08T06:06:47.210 INFO:teuthology.orchestra.run.smithi082.stdout:pg_num: 64 2024-05-08T06:06:47.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.213+0000 7f5b28200640 1 -- 172.21.15.82:0/581467073 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f5b080b27f0 msgr2=0x7f5b080b4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:47.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.213+0000 7f5b28200640 1 --2- 172.21.15.82:0/581467073 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f5b080b27f0 0x7f5b080b4cb0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5b2019c330 tx=0x7f5b0c005f90 comp rx=0 tx=0).stop 2024-05-08T06:06:47.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.213+0000 7f5b28200640 1 -- 172.21.15.82:0/581467073 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b20104c10 msgr2=0x7f5b2019ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:47.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.213+0000 7f5b28200640 1 --2- 172.21.15.82:0/581467073 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b20104c10 0x7f5b2019ae20 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5b14006010 tx=0x7f5b140042f0 comp rx=0 tx=0).stop 2024-05-08T06:06:47.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.213+0000 7f5b28200640 1 -- 172.21.15.82:0/581467073 shutdown_connections 2024-05-08T06:06:47.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.213+0000 7f5b28200640 1 --2- 172.21.15.82:0/581467073 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f5b080b27f0 0x7f5b080b4cb0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:47.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.213+0000 7f5b28200640 1 --2- 172.21.15.82:0/581467073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b20105e00 0x7f5b2019b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:47.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.213+0000 7f5b28200640 1 --2- 172.21.15.82:0/581467073 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5b201067c0 0x7f5b201a23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:47.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.213+0000 7f5b28200640 1 --2- 172.21.15.82:0/581467073 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b20104c10 0x7f5b2019ae20 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:47.214 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.213+0000 7f5b28200640 1 -- 172.21.15.82:0/581467073 >> 172.21.15.82:0/581467073 conn(0x7f5b201001a0 msgr2=0x7f5b20109180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:06:47.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.213+0000 7f5b28200640 1 -- 172.21.15.82:0/581467073 shutdown_connections 2024-05-08T06:06:47.215 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.213+0000 7f5b28200640 1 -- 172.21.15.82:0/581467073 wait complete. 2024-05-08T06:06:47.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:06:46 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/2288445160' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T06:06:47.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:06:46 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/4248406070' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-08T06:06:47.233 DEBUG:teuthology.orchestra.run.smithi082:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-05-08T06:06:47.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.437+0000 7ff592800640 1 -- 172.21.15.82:0/3824826462 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff58c102820 msgr2=0x7ff58c102c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:47.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.437+0000 7ff592800640 1 --2- 172.21.15.82:0/3824826462 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff58c102820 0x7ff58c102c40 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ff580009900 tx=0x7ff58002a3f0 comp rx=0 tx=0).stop 2024-05-08T06:06:47.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.437+0000 7ff592800640 1 -- 172.21.15.82:0/3824826462 shutdown_connections 2024-05-08T06:06:47.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.437+0000 7ff592800640 1 --2- 172.21.15.82:0/3824826462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff58c1043d0 0x7ff58c10ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:47.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.437+0000 7ff592800640 1 --2- 172.21.15.82:0/3824826462 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff58c103a10 0x7ff58c103e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:47.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.437+0000 7ff592800640 1 --2- 172.21.15.82:0/3824826462 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff58c102820 0x7ff58c102c40 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:47.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.437+0000 7ff592800640 1 -- 172.21.15.82:0/3824826462 >> 172.21.15.82:0/3824826462 conn(0x7ff58c0fdd90 msgr2=0x7ff58c1001d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:06:47.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.437+0000 7ff592800640 1 -- 172.21.15.82:0/3824826462 shutdown_connections 2024-05-08T06:06:47.439 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.437+0000 7ff592800640 1 -- 172.21.15.82:0/3824826462 wait complete. 2024-05-08T06:06:47.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.439+0000 7ff592800640 1 Processor -- start 2024-05-08T06:06:47.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.439+0000 7ff592800640 1 -- start start 2024-05-08T06:06:47.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.439+0000 7ff592800640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff58c102820 0x7ff58c198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:47.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.439+0000 7ff592800640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff58c103a10 0x7ff58c199040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:47.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.439+0000 7ff592800640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff58c1043d0 0x7ff58c1a0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:47.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.439+0000 7ff592800640 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7ff58c10e350 con 0x7ff58c103a10 2024-05-08T06:06:47.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.439+0000 7ff592800640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff58c10e1d0 con 0x7ff58c102820 2024-05-08T06:06:47.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.439+0000 7ff592800640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff58c10e4d0 con 0x7ff58c1043d0 2024-05-08T06:06:47.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.439+0000 7ff590a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff58c103a10 0x7ff58c199040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:47.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.439+0000 7ff591e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff58c1043d0 0x7ff58c1a0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:47.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.439+0000 7ff591400640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff58c102820 0x7ff58c198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:47.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.439+0000 7ff591e00640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff58c1043d0 0x7ff58c1a0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:39124/0 (socket says 172.21.15.82:39124) 2024-05-08T06:06:47.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.439+0000 7ff591e00640 1 -- 172.21.15.82:0/2442070580 learned_addr learned my addr 172.21.15.82:0/2442070580 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:06:47.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.439+0000 7ff590a00640 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff58c103a10 0x7ff58c199040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:39762/0 (socket says 172.21.15.82:39762) 2024-05-08T06:06:47.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.440+0000 7ff591e00640 1 -- 172.21.15.82:0/2442070580 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff58c102820 msgr2=0x7ff58c198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:47.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.440+0000 7ff591e00640 1 --2- 172.21.15.82:0/2442070580 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff58c102820 0x7ff58c198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:47.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.440+0000 7ff591e00640 1 -- 172.21.15.82:0/2442070580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff58c103a10 msgr2=0x7ff58c199040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:47.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.440+0000 7ff591e00640 1 --2- 172.21.15.82:0/2442070580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff58c103a10 0x7ff58c199040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:47.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.440+0000 7ff591e00640 1 -- 172.21.15.82:0/2442070580 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff58c1a06d0 con 0x7ff58c1043d0 2024-05-08T06:06:47.442 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.440+0000 7ff591e00640 1 --2- 172.21.15.82:0/2442070580 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff58c1043d0 0x7ff58c1a0060 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff58400eb10 tx=0x7ff58400c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:06:47.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.441+0000 7ff58a000640 1 -- 172.21.15.82:0/2442070580 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff584004b20 con 0x7ff58c1043d0 2024-05-08T06:06:47.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.441+0000 7ff592800640 1 -- 172.21.15.82:0/2442070580 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff58c1a09c0 con 0x7ff58c1043d0 2024-05-08T06:06:47.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.441+0000 7ff58a000640 1 -- 172.21.15.82:0/2442070580 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7ff584004cc0 con 0x7ff58c1043d0 2024-05-08T06:06:47.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.441+0000 7ff58a000640 1 -- 172.21.15.82:0/2442070580 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff584010690 con 0x7ff58c1043d0 2024-05-08T06:06:47.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.441+0000 7ff592800640 1 -- 172.21.15.82:0/2442070580 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff58c1a0f10 con 0x7ff58c1043d0 2024-05-08T06:06:47.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.442+0000 7ff592800640 1 -- 172.21.15.82:0/2442070580 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff58c109c60 con 0x7ff58c1043d0 2024-05-08T06:06:47.445 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.444+0000 7ff58a000640 1 -- 172.21.15.82:0/2442070580 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7ff584047960 con 0x7ff58c1043d0 2024-05-08T06:06:47.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.446+0000 7ff58a000640 1 --2- 172.21.15.82:0/2442070580 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff5740b27f0 0x7ff5740b4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:06:47.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.446+0000 7ff58a000640 1 -- 172.21.15.82:0/2442070580 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7ff5840e2760 con 0x7ff58c1043d0 2024-05-08T06:06:47.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.446+0000 7ff591400640 1 --2- 172.21.15.82:0/2442070580 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff5740b27f0 0x7ff5740b4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:06:47.447 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.447+0000 7ff591400640 1 --2- 172.21.15.82:0/2442070580 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff5740b27f0 0x7ff5740b4cb0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff580009230 tx=0x7ff5800314a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:06:47.448 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.448+0000 7ff58a000640 1 -- 172.21.15.82:0/2442070580 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff5840aa430 con 0x7ff58c1043d0 2024-05-08T06:06:47.709 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.708+0000 7ff592800640 1 -- 172.21.15.82:0/2442070580 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7ff58c02dda0 con 0x7ff58c1043d0 2024-05-08T06:06:47.721 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.721+0000 7ff58a000640 1 -- 172.21.15.82:0/2442070580 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v20) ==== 81+0+815642 (secure 0 0 0) 0x7ff5840a9d30 con 0x7ff58c1043d0 2024-05-08T06:06:47.735 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T06:06:47.736 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T06:06:47.736 INFO:teuthology.orchestra.run.smithi082.stdout: "epoch": 20, 2024-05-08T06:06:47.736 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.736 INFO:teuthology.orchestra.run.smithi082.stdout: "active_gid": 14152, 2024-05-08T06:06:47.736 INFO:teuthology.orchestra.run.smithi082.stdout: "active_name": "x", 2024-05-08T06:06:47.736 INFO:teuthology.orchestra.run.smithi082.stdout: "active_addrs": { 2024-05-08T06:06:47.736 INFO:teuthology.orchestra.run.smithi082.stdout: "addrvec": [ 2024-05-08T06:06:47.736 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:47.736 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v2", 2024-05-08T06:06:47.736 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "172.21.15.82:6800", 2024-05-08T06:06:47.736 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 4089180091 2024-05-08T06:06:47.736 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.736 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:47.736 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v1", 2024-05-08T06:06:47.737 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "172.21.15.82:6801", 2024-05-08T06:06:47.737 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 4089180091 2024-05-08T06:06:47.737 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:47.737 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-05-08T06:06:47.737 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.737 INFO:teuthology.orchestra.run.smithi082.stdout: "active_addr": "172.21.15.82:6801/4089180091", 2024-05-08T06:06:47.737 INFO:teuthology.orchestra.run.smithi082.stdout: "active_change": "2024-05-08T05:37:43.951493+0000", 2024-05-08T06:06:47.737 INFO:teuthology.orchestra.run.smithi082.stdout: "active_mgr_features": 4540701547738038271, 2024-05-08T06:06:47.737 INFO:teuthology.orchestra.run.smithi082.stdout: "available": true, 2024-05-08T06:06:47.737 INFO:teuthology.orchestra.run.smithi082.stdout: "standbys": [ 2024-05-08T06:06:47.737 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:47.737 INFO:teuthology.orchestra.run.smithi082.stdout: "gid": 24112, 2024-05-08T06:06:47.737 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "z", 2024-05-08T06:06:47.737 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr_features": 4540701547738038271, 2024-05-08T06:06:47.737 INFO:teuthology.orchestra.run.smithi082.stdout: "available_modules": [ 2024-05-08T06:06:47.738 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:47.738 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "alerts", 2024-05-08T06:06:47.738 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:47.738 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:47.738 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:47.738 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-05-08T06:06:47.738 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-05-08T06:06:47.738 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:47.738 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.738 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.738 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-05-08T06:06:47.738 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.738 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.738 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.738 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How frequently to reexamine health status", 2024-05-08T06:06:47.738 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.739 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.739 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.739 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.739 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:47.739 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:47.739 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.739 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.739 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.739 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:47.739 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.739 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.739 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:47.739 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:47.739 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:47.739 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:47.739 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:47.740 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:47.740 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:47.740 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:47.740 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.740 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.740 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.740 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.740 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.740 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:47.740 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:47.740 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.740 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.740 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.740 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:47.740 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.740 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.741 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.741 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.741 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.741 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.741 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.741 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.741 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:47.741 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:47.741 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.741 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.741 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.741 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:47.741 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.741 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.741 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:47.741 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:47.742 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:47.742 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:47.742 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:47.742 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:47.742 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:47.742 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:47.742 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.742 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.742 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.742 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.742 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.742 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:47.742 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:47.742 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.742 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.743 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.743 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:47.743 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.743 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.743 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.743 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.743 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.743 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.743 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.743 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.743 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_destination": { 2024-05-08T06:06:47.743 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_destination", 2024-05-08T06:06:47.743 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.743 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.743 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.743 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:47.743 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.744 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.744 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.744 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Email address to send alerts to", 2024-05-08T06:06:47.744 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.744 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.744 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.744 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.744 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_from_name": { 2024-05-08T06:06:47.744 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_from_name", 2024-05-08T06:06:47.744 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.744 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.744 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.744 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "Ceph", 2024-05-08T06:06:47.744 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.744 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.745 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.745 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Email From: name", 2024-05-08T06:06:47.745 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.745 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.745 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.745 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.745 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_host": { 2024-05-08T06:06:47.745 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_host", 2024-05-08T06:06:47.745 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.745 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.745 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.745 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:47.745 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.745 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.745 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.745 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SMTP server", 2024-05-08T06:06:47.745 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.746 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.746 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.746 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.746 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_password": { 2024-05-08T06:06:47.746 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_password", 2024-05-08T06:06:47.746 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.746 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.746 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.746 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:47.746 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.746 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.746 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.746 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Password to authenticate with", 2024-05-08T06:06:47.746 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.747 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.747 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.747 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.747 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_port": { 2024-05-08T06:06:47.747 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_port", 2024-05-08T06:06:47.747 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:47.747 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.747 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.747 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "465", 2024-05-08T06:06:47.747 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.747 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.747 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.747 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SMTP port", 2024-05-08T06:06:47.747 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.747 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.748 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.748 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.748 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_sender": { 2024-05-08T06:06:47.748 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_sender", 2024-05-08T06:06:47.748 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.748 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.748 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.748 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:47.748 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.748 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.748 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.748 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SMTP envelope sender", 2024-05-08T06:06:47.748 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.748 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.748 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.749 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.749 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_ssl": { 2024-05-08T06:06:47.749 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_ssl", 2024-05-08T06:06:47.749 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.749 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.749 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.749 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:47.749 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.749 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.749 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.749 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use SSL to connect to SMTP server", 2024-05-08T06:06:47.749 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.749 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.749 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.750 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.750 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_user": { 2024-05-08T06:06:47.750 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_user", 2024-05-08T06:06:47.750 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.750 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.750 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.750 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:47.750 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.750 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.750 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.750 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "User to authenticate as", 2024-05-08T06:06:47.750 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.750 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.750 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.751 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.751 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:47.751 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:47.751 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:47.751 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:47.751 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.751 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:47.751 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.751 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.751 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.751 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.751 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.751 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.751 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.751 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:47.752 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:47.752 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.752 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:47.752 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "balancer", 2024-05-08T06:06:47.752 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:47.752 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:47.752 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:47.752 INFO:teuthology.orchestra.run.smithi082.stdout: "active": { 2024-05-08T06:06:47.752 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "active", 2024-05-08T06:06:47.752 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.752 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.752 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.752 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:47.752 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.752 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.753 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.753 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "automatically balance PGs across cluster", 2024-05-08T06:06:47.753 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.753 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.753 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.753 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.753 INFO:teuthology.orchestra.run.smithi082.stdout: "begin_time": { 2024-05-08T06:06:47.753 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "begin_time", 2024-05-08T06:06:47.753 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.753 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.753 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.753 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0000", 2024-05-08T06:06:47.753 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.753 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.754 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.754 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "beginning time of day to automatically balance", 2024-05-08T06:06:47.754 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-08T06:06:47.754 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.754 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.754 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.754 INFO:teuthology.orchestra.run.smithi082.stdout: "begin_weekday": { 2024-05-08T06:06:47.754 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "begin_weekday", 2024-05-08T06:06:47.754 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-05-08T06:06:47.754 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.754 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.754 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:47.754 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "0", 2024-05-08T06:06:47.754 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "6", 2024-05-08T06:06:47.754 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.755 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-05-08T06:06:47.755 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-08T06:06:47.755 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.755 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.755 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.755 INFO:teuthology.orchestra.run.smithi082.stdout: "crush_compat_max_iterations": { 2024-05-08T06:06:47.755 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crush_compat_max_iterations", 2024-05-08T06:06:47.755 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-05-08T06:06:47.755 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.755 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.755 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "25", 2024-05-08T06:06:47.755 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-05-08T06:06:47.755 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "250", 2024-05-08T06:06:47.755 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.755 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-05-08T06:06:47.756 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.756 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.756 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.756 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.756 INFO:teuthology.orchestra.run.smithi082.stdout: "crush_compat_metrics": { 2024-05-08T06:06:47.756 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crush_compat_metrics", 2024-05-08T06:06:47.756 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.756 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.756 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.756 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "pgs,objects,bytes", 2024-05-08T06:06:47.756 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.756 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.756 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.756 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-05-08T06:06:47.757 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-05-08T06:06:47.757 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.757 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.757 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.757 INFO:teuthology.orchestra.run.smithi082.stdout: "crush_compat_step": { 2024-05-08T06:06:47.757 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crush_compat_step", 2024-05-08T06:06:47.757 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-05-08T06:06:47.757 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.757 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.757 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0.5", 2024-05-08T06:06:47.757 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "0.001", 2024-05-08T06:06:47.757 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "0.999", 2024-05-08T06:06:47.757 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.757 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "aggressiveness of optimization", 2024-05-08T06:06:47.757 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-05-08T06:06:47.758 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.758 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.758 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.758 INFO:teuthology.orchestra.run.smithi082.stdout: "end_time": { 2024-05-08T06:06:47.758 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "end_time", 2024-05-08T06:06:47.758 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.758 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.758 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.758 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "2359", 2024-05-08T06:06:47.758 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.758 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.758 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.758 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "ending time of day to automatically balance", 2024-05-08T06:06:47.758 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-08T06:06:47.759 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.759 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.759 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.759 INFO:teuthology.orchestra.run.smithi082.stdout: "end_weekday": { 2024-05-08T06:06:47.759 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "end_weekday", 2024-05-08T06:06:47.759 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-05-08T06:06:47.759 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.759 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.759 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:47.759 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "0", 2024-05-08T06:06:47.759 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "6", 2024-05-08T06:06:47.759 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.759 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-05-08T06:06:47.759 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-08T06:06:47.759 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.760 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.760 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.760 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:47.760 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:47.760 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.760 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.760 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.760 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:47.760 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.760 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.760 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:47.760 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:47.760 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:47.760 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:47.760 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:47.761 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:47.761 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:47.761 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:47.761 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.761 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.761 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.761 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.761 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.761 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:47.761 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:47.761 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.761 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.761 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.761 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:47.761 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.762 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.762 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.762 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.762 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.762 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.762 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.762 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.762 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:47.762 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:47.762 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.762 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.762 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.762 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:47.762 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.763 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.763 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:47.763 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:47.763 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:47.763 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:47.763 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:47.763 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:47.763 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:47.763 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:47.763 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.763 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.763 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.763 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.763 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.763 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:47.764 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:47.764 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.764 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.764 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.764 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:47.764 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.764 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.764 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.764 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.764 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.764 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.764 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.764 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.764 INFO:teuthology.orchestra.run.smithi082.stdout: "min_score": { 2024-05-08T06:06:47.764 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "min_score", 2024-05-08T06:06:47.765 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-05-08T06:06:47.765 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.765 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.765 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:47.765 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.765 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.765 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.765 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-05-08T06:06:47.765 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.765 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.765 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.765 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.765 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": { 2024-05-08T06:06:47.765 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mode", 2024-05-08T06:06:47.765 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.766 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.766 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.766 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "upmap", 2024-05-08T06:06:47.766 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.766 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.766 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:47.766 INFO:teuthology.orchestra.run.smithi082.stdout: "crush-compat", 2024-05-08T06:06:47.766 INFO:teuthology.orchestra.run.smithi082.stdout: "none", 2024-05-08T06:06:47.766 INFO:teuthology.orchestra.run.smithi082.stdout: "read", 2024-05-08T06:06:47.766 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap", 2024-05-08T06:06:47.766 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap-read" 2024-05-08T06:06:47.766 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:47.766 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Balancer mode", 2024-05-08T06:06:47.766 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.767 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.767 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.767 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.767 INFO:teuthology.orchestra.run.smithi082.stdout: "pool_ids": { 2024-05-08T06:06:47.767 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pool_ids", 2024-05-08T06:06:47.767 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.767 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.767 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.767 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:47.767 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.767 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.767 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.767 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-05-08T06:06:47.767 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.767 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.767 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.768 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.768 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-05-08T06:06:47.768 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-05-08T06:06:47.768 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:47.768 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.768 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.768 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-05-08T06:06:47.768 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.768 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.768 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.768 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-05-08T06:06:47.768 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.768 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.768 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.768 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.769 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:47.769 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:47.769 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:47.769 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:47.769 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.769 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:47.769 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.769 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.769 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.769 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.769 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.769 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.769 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.769 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.769 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap_max_deviation": { 2024-05-08T06:06:47.770 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "upmap_max_deviation", 2024-05-08T06:06:47.770 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:47.770 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.770 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.770 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-05-08T06:06:47.770 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-05-08T06:06:47.770 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.770 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.770 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "deviation below which no optimization is attempted", 2024-05-08T06:06:47.770 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-05-08T06:06:47.770 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.770 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.770 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.770 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap_max_optimizations": { 2024-05-08T06:06:47.770 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "upmap_max_optimizations", 2024-05-08T06:06:47.771 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-05-08T06:06:47.771 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.771 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.771 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-05-08T06:06:47.771 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.771 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.771 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.771 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-05-08T06:06:47.771 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.771 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.771 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.771 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:47.771 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:47.771 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.771 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:47.772 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cephadm", 2024-05-08T06:06:47.772 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:47.772 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:47.772 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:47.772 INFO:teuthology.orchestra.run.smithi082.stdout: "agent_down_multiplier": { 2024-05-08T06:06:47.772 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "agent_down_multiplier", 2024-05-08T06:06:47.772 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-05-08T06:06:47.772 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.772 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.772 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "3.0", 2024-05-08T06:06:47.772 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.772 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.772 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.772 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-05-08T06:06:47.772 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.773 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.773 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.773 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.773 INFO:teuthology.orchestra.run.smithi082.stdout: "agent_refresh_rate": { 2024-05-08T06:06:47.773 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "agent_refresh_rate", 2024-05-08T06:06:47.773 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:47.773 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.773 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.773 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "20", 2024-05-08T06:06:47.773 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.773 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.773 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.773 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-05-08T06:06:47.773 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.774 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.774 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.774 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.774 INFO:teuthology.orchestra.run.smithi082.stdout: "agent_starting_port": { 2024-05-08T06:06:47.774 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "agent_starting_port", 2024-05-08T06:06:47.774 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:47.774 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.774 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.774 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "4721", 2024-05-08T06:06:47.774 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.774 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.774 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.774 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-05-08T06:06:47.774 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.775 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.775 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.775 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.775 INFO:teuthology.orchestra.run.smithi082.stdout: "allow_ptrace": { 2024-05-08T06:06:47.775 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "allow_ptrace", 2024-05-08T06:06:47.775 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.775 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.775 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.775 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:47.775 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.775 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.775 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.775 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-05-08T06:06:47.775 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-05-08T06:06:47.775 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.776 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.776 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.776 INFO:teuthology.orchestra.run.smithi082.stdout: "autotune_interval": { 2024-05-08T06:06:47.776 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "autotune_interval", 2024-05-08T06:06:47.776 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:47.776 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.776 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.776 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-05-08T06:06:47.776 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.776 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.776 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.776 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to autotune daemon memory", 2024-05-08T06:06:47.776 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.776 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.776 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.776 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.777 INFO:teuthology.orchestra.run.smithi082.stdout: "autotune_memory_target_ratio": { 2024-05-08T06:06:47.777 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "autotune_memory_target_ratio", 2024-05-08T06:06:47.777 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-05-08T06:06:47.777 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.777 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.777 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0.7", 2024-05-08T06:06:47.777 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.777 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.777 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.777 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-05-08T06:06:47.777 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.777 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.777 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.777 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.777 INFO:teuthology.orchestra.run.smithi082.stdout: "cephadm_log_destination": { 2024-05-08T06:06:47.777 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cephadm_log_destination", 2024-05-08T06:06:47.778 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.778 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.778 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.778 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:47.778 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.778 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.778 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:47.778 INFO:teuthology.orchestra.run.smithi082.stdout: "file", 2024-05-08T06:06:47.778 INFO:teuthology.orchestra.run.smithi082.stdout: "file,syslog", 2024-05-08T06:06:47.778 INFO:teuthology.orchestra.run.smithi082.stdout: "syslog" 2024-05-08T06:06:47.778 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:47.778 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-05-08T06:06:47.778 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.778 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.778 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.779 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.779 INFO:teuthology.orchestra.run.smithi082.stdout: "cgroups_split": { 2024-05-08T06:06:47.779 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cgroups_split", 2024-05-08T06:06:47.779 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.779 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.779 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.779 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:47.779 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.779 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.779 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.779 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-05-08T06:06:47.779 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.779 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.779 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.779 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.779 INFO:teuthology.orchestra.run.smithi082.stdout: "config_checks_enabled": { 2024-05-08T06:06:47.779 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "config_checks_enabled", 2024-05-08T06:06:47.780 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.780 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.780 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.780 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:47.780 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.780 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.780 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.780 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-05-08T06:06:47.780 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.780 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.780 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.780 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.780 INFO:teuthology.orchestra.run.smithi082.stdout: "config_dashboard": { 2024-05-08T06:06:47.780 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "config_dashboard", 2024-05-08T06:06:47.780 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.780 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.781 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.781 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:47.781 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.781 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.781 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.781 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-05-08T06:06:47.781 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.781 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.781 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.781 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.781 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_alertmanager": { 2024-05-08T06:06:47.781 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_alertmanager", 2024-05-08T06:06:47.781 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.781 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.781 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.781 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-05-08T06:06:47.781 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.782 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.782 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.782 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-05-08T06:06:47.782 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.782 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.782 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.782 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.782 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_base": { 2024-05-08T06:06:47.782 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_base", 2024-05-08T06:06:47.782 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.782 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.782 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.782 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/ceph", 2024-05-08T06:06:47.782 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.782 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.782 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.783 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Container image name, without the tag", 2024-05-08T06:06:47.783 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.783 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.783 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.783 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.783 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_elasticsearch": { 2024-05-08T06:06:47.783 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_elasticsearch", 2024-05-08T06:06:47.783 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.783 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.783 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.783 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-05-08T06:06:47.783 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.783 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.783 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.783 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "elasticsearch container image", 2024-05-08T06:06:47.783 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.784 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.784 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.784 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.784 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_grafana": { 2024-05-08T06:06:47.784 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_grafana", 2024-05-08T06:06:47.784 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.784 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.784 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.784 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-05-08T06:06:47.784 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.784 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.784 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.784 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-05-08T06:06:47.784 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.784 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.784 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.785 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.785 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_haproxy": { 2024-05-08T06:06:47.785 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_haproxy", 2024-05-08T06:06:47.785 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.785 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.785 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.785 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-05-08T06:06:47.785 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.785 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.785 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.785 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "HAproxy container image", 2024-05-08T06:06:47.785 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.785 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.785 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.785 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.785 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_jaeger_agent": { 2024-05-08T06:06:47.785 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_jaeger_agent", 2024-05-08T06:06:47.786 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.786 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.786 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.786 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-05-08T06:06:47.786 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.786 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.786 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.786 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Jaeger agent container image", 2024-05-08T06:06:47.786 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.786 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.786 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.786 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.786 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_jaeger_collector": { 2024-05-08T06:06:47.786 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_jaeger_collector", 2024-05-08T06:06:47.786 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.787 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.787 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.787 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-05-08T06:06:47.787 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.787 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.787 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.787 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Jaeger collector container image", 2024-05-08T06:06:47.787 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.787 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.787 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.787 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.787 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_jaeger_query": { 2024-05-08T06:06:47.787 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_jaeger_query", 2024-05-08T06:06:47.787 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.787 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.787 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.788 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-05-08T06:06:47.788 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.788 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.788 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.788 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Jaeger query container image", 2024-05-08T06:06:47.788 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.788 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.788 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.788 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.788 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_keepalived": { 2024-05-08T06:06:47.788 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_keepalived", 2024-05-08T06:06:47.788 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.788 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.788 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.788 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-05-08T06:06:47.788 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.789 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.789 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.789 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Keepalived container image", 2024-05-08T06:06:47.789 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.789 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.789 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.789 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.789 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_loki": { 2024-05-08T06:06:47.789 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_loki", 2024-05-08T06:06:47.789 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.789 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.789 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.789 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-05-08T06:06:47.789 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.789 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.790 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.790 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Loki container image", 2024-05-08T06:06:47.790 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.790 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.790 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.790 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.790 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_node_exporter": { 2024-05-08T06:06:47.790 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_node_exporter", 2024-05-08T06:06:47.790 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.790 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.790 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.790 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-05-08T06:06:47.790 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.790 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.790 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.791 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-05-08T06:06:47.791 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.791 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.791 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.791 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.791 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_nvmeof": { 2024-05-08T06:06:47.791 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_nvmeof", 2024-05-08T06:06:47.791 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.791 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.791 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.791 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-05-08T06:06:47.791 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.791 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.791 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.791 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Nvme-of container image", 2024-05-08T06:06:47.791 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.791 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.792 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.792 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.792 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_prometheus": { 2024-05-08T06:06:47.792 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_prometheus", 2024-05-08T06:06:47.792 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.792 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.792 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.792 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-05-08T06:06:47.792 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.792 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.792 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.792 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-05-08T06:06:47.792 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.792 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.792 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.792 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.793 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_promtail": { 2024-05-08T06:06:47.793 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_promtail", 2024-05-08T06:06:47.793 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.793 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.793 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.793 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-05-08T06:06:47.793 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.793 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.793 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.793 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Promtail container image", 2024-05-08T06:06:47.793 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.793 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.793 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.793 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.793 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_samba": { 2024-05-08T06:06:47.793 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_samba", 2024-05-08T06:06:47.793 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.794 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.794 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.794 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-05-08T06:06:47.794 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.794 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.794 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.794 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Samba/SMB container image", 2024-05-08T06:06:47.794 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.794 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.794 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.794 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.794 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_snmp_gateway": { 2024-05-08T06:06:47.794 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_snmp_gateway", 2024-05-08T06:06:47.794 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.794 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.795 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.795 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-05-08T06:06:47.795 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.795 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.795 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.795 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SNMP Gateway container image", 2024-05-08T06:06:47.795 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.795 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.795 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.795 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.795 INFO:teuthology.orchestra.run.smithi082.stdout: "container_init": { 2024-05-08T06:06:47.795 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_init", 2024-05-08T06:06:47.795 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.795 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.795 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.796 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:47.796 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.796 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.796 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.796 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Run podman/docker with `--init`", 2024-05-08T06:06:47.796 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.796 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.796 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.796 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.796 INFO:teuthology.orchestra.run.smithi082.stdout: "daemon_cache_timeout": { 2024-05-08T06:06:47.796 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "daemon_cache_timeout", 2024-05-08T06:06:47.796 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:47.796 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.796 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.796 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-05-08T06:06:47.796 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.796 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.797 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.797 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-05-08T06:06:47.797 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.797 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.797 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.797 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.797 INFO:teuthology.orchestra.run.smithi082.stdout: "default_cephadm_command_timeout": { 2024-05-08T06:06:47.797 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "default_cephadm_command_timeout", 2024-05-08T06:06:47.797 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:47.797 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.797 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.797 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "900", 2024-05-08T06:06:47.797 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.797 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.797 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.797 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-05-08T06:06:47.798 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.798 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.798 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.798 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.798 INFO:teuthology.orchestra.run.smithi082.stdout: "default_registry": { 2024-05-08T06:06:47.798 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "default_registry", 2024-05-08T06:06:47.798 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.798 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.798 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.798 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io", 2024-05-08T06:06:47.798 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.798 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.798 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.798 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-05-08T06:06:47.799 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.799 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.799 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.799 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.799 INFO:teuthology.orchestra.run.smithi082.stdout: "device_cache_timeout": { 2024-05-08T06:06:47.799 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "device_cache_timeout", 2024-05-08T06:06:47.799 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:47.799 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.799 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.799 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "1800", 2024-05-08T06:06:47.799 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.799 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.799 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.799 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "seconds to cache device inventory", 2024-05-08T06:06:47.799 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.799 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.799 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.800 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.800 INFO:teuthology.orchestra.run.smithi082.stdout: "device_enhanced_scan": { 2024-05-08T06:06:47.800 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "device_enhanced_scan", 2024-05-08T06:06:47.800 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.800 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.800 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.800 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:47.800 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.800 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.800 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.800 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use libstoragemgmt during device scans", 2024-05-08T06:06:47.800 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.800 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.800 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.800 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.800 INFO:teuthology.orchestra.run.smithi082.stdout: "facts_cache_timeout": { 2024-05-08T06:06:47.801 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "facts_cache_timeout", 2024-05-08T06:06:47.801 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:47.801 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.801 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.801 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-05-08T06:06:47.801 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.801 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.801 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.801 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "seconds to cache host facts data", 2024-05-08T06:06:47.801 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.801 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.801 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.801 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.801 INFO:teuthology.orchestra.run.smithi082.stdout: "grafana_dashboards_path": { 2024-05-08T06:06:47.801 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "grafana_dashboards_path", 2024-05-08T06:06:47.801 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.802 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.802 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.802 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-05-08T06:06:47.802 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.802 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.802 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.802 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-05-08T06:06:47.802 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.802 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.802 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.802 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.802 INFO:teuthology.orchestra.run.smithi082.stdout: "host_check_interval": { 2024-05-08T06:06:47.802 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "host_check_interval", 2024-05-08T06:06:47.802 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:47.802 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.802 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.803 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-05-08T06:06:47.803 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.803 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.803 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.803 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to perform a host check", 2024-05-08T06:06:47.803 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.803 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.803 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.803 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.803 INFO:teuthology.orchestra.run.smithi082.stdout: "hw_monitoring": { 2024-05-08T06:06:47.803 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "hw_monitoring", 2024-05-08T06:06:47.803 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.803 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.803 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.803 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:47.803 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.804 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.804 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.804 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-05-08T06:06:47.804 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.804 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.804 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.804 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.804 INFO:teuthology.orchestra.run.smithi082.stdout: "inventory_list_all": { 2024-05-08T06:06:47.804 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "inventory_list_all", 2024-05-08T06:06:47.804 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.804 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.804 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.804 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:47.804 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.804 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.805 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.805 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-05-08T06:06:47.805 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.805 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.805 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.805 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.805 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:47.805 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:47.805 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.805 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.805 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.805 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:47.805 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.806 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.806 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:47.806 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:47.806 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:47.806 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:47.806 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:47.806 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:47.806 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:47.806 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:47.806 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.806 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.806 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.806 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.806 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.806 INFO:teuthology.orchestra.run.smithi082.stdout: "log_refresh_metadata": { 2024-05-08T06:06:47.806 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_refresh_metadata", 2024-05-08T06:06:47.807 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.807 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.807 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.807 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:47.807 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.807 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.807 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.807 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-05-08T06:06:47.807 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.807 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.807 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.807 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.807 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:47.807 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:47.807 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.807 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.808 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.808 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:47.808 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.808 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.808 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.808 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-05-08T06:06:47.808 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.808 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.808 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.808 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.808 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:47.808 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:47.808 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.808 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.808 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.808 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:47.809 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.809 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.809 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:47.809 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:47.809 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:47.809 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:47.809 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:47.809 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:47.809 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:47.809 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:47.809 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.809 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.809 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.809 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.809 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.809 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:47.810 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:47.810 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.810 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.810 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.810 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:47.810 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.810 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.810 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.810 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.810 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.810 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.810 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.810 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.810 INFO:teuthology.orchestra.run.smithi082.stdout: "manage_etc_ceph_ceph_conf": { 2024-05-08T06:06:47.810 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-05-08T06:06:47.811 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.811 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.811 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.811 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:47.811 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.811 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.811 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.811 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-05-08T06:06:47.811 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.811 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.811 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.811 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.811 INFO:teuthology.orchestra.run.smithi082.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-05-08T06:06:47.811 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-05-08T06:06:47.811 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.811 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.812 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.812 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "*", 2024-05-08T06:06:47.812 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.812 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.812 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.812 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-05-08T06:06:47.812 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.812 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.812 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.812 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.812 INFO:teuthology.orchestra.run.smithi082.stdout: "max_count_per_host": { 2024-05-08T06:06:47.812 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_count_per_host", 2024-05-08T06:06:47.812 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:47.812 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.812 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.812 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-05-08T06:06:47.812 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.813 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.813 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.813 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "max number of daemons per service per host", 2024-05-08T06:06:47.813 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.813 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.813 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.813 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.813 INFO:teuthology.orchestra.run.smithi082.stdout: "max_osd_draining_count": { 2024-05-08T06:06:47.813 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_osd_draining_count", 2024-05-08T06:06:47.813 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:47.813 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.813 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.813 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-05-08T06:06:47.813 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.813 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.813 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.813 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-05-08T06:06:47.814 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.814 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.814 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.814 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.814 INFO:teuthology.orchestra.run.smithi082.stdout: "migration_current": { 2024-05-08T06:06:47.814 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "migration_current", 2024-05-08T06:06:47.814 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:47.814 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.814 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.814 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:47.814 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.814 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.814 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.814 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "internal - do not modify", 2024-05-08T06:06:47.814 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.815 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.815 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.815 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.815 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": { 2024-05-08T06:06:47.815 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mode", 2024-05-08T06:06:47.815 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.815 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.815 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.815 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "root", 2024-05-08T06:06:47.815 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.815 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.815 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:47.815 INFO:teuthology.orchestra.run.smithi082.stdout: "cephadm-package", 2024-05-08T06:06:47.815 INFO:teuthology.orchestra.run.smithi082.stdout: "root" 2024-05-08T06:06:47.815 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:47.815 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "mode for remote execution of cephadm", 2024-05-08T06:06:47.815 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.816 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.816 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.816 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.816 INFO:teuthology.orchestra.run.smithi082.stdout: "oob_default_addr": { 2024-05-08T06:06:47.816 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "oob_default_addr", 2024-05-08T06:06:47.816 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.816 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.816 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.816 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "169.254.1.1", 2024-05-08T06:06:47.816 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.816 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.816 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.816 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Default address for RedFish API (oob management).", 2024-05-08T06:06:47.816 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.816 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.816 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.817 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.817 INFO:teuthology.orchestra.run.smithi082.stdout: "prometheus_alerts_path": { 2024-05-08T06:06:47.817 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "prometheus_alerts_path", 2024-05-08T06:06:47.817 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.817 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.817 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.817 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-05-08T06:06:47.817 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.817 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.817 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.817 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-05-08T06:06:47.817 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.817 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.817 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.817 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.818 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_insecure": { 2024-05-08T06:06:47.818 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_insecure", 2024-05-08T06:06:47.818 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.818 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.818 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.818 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:47.818 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.818 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.818 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.818 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-05-08T06:06:47.818 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.818 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.818 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.818 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.818 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_password": { 2024-05-08T06:06:47.818 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_password", 2024-05-08T06:06:47.818 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.819 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.819 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.819 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:47.819 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.819 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.819 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.819 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-05-08T06:06:47.819 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.819 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.819 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.819 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.819 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_url": { 2024-05-08T06:06:47.819 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_url", 2024-05-08T06:06:47.819 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.820 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.820 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.820 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:47.820 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.820 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.820 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.820 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-05-08T06:06:47.820 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.820 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.820 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.820 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.820 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_username": { 2024-05-08T06:06:47.820 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_username", 2024-05-08T06:06:47.820 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.820 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.820 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.821 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:47.821 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.821 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.821 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.821 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-05-08T06:06:47.821 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.821 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.821 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.821 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.821 INFO:teuthology.orchestra.run.smithi082.stdout: "secure_monitoring_stack": { 2024-05-08T06:06:47.821 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "secure_monitoring_stack", 2024-05-08T06:06:47.821 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.821 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.821 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.821 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:47.821 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.822 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.822 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.822 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-05-08T06:06:47.822 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.822 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.822 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.822 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.822 INFO:teuthology.orchestra.run.smithi082.stdout: "service_discovery_port": { 2024-05-08T06:06:47.822 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "service_discovery_port", 2024-05-08T06:06:47.822 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:47.822 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.822 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.822 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8765", 2024-05-08T06:06:47.822 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.822 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.823 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.823 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "cephadm service discovery port", 2024-05-08T06:06:47.823 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.823 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.823 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.823 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.823 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:47.823 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:47.823 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:47.823 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:47.823 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.823 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:47.823 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.823 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.823 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.824 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.824 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.824 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.824 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.824 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.824 INFO:teuthology.orchestra.run.smithi082.stdout: "ssh_config_file": { 2024-05-08T06:06:47.824 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssh_config_file", 2024-05-08T06:06:47.824 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.824 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.824 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.824 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:47.824 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.824 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.824 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.824 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-05-08T06:06:47.824 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.824 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.825 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.825 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.825 INFO:teuthology.orchestra.run.smithi082.stdout: "use_agent": { 2024-05-08T06:06:47.825 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "use_agent", 2024-05-08T06:06:47.825 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.825 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.825 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.825 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:47.825 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.825 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.825 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.825 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-05-08T06:06:47.825 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.825 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.825 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.825 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.826 INFO:teuthology.orchestra.run.smithi082.stdout: "use_repo_digest": { 2024-05-08T06:06:47.826 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "use_repo_digest", 2024-05-08T06:06:47.826 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.826 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.826 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.826 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:47.826 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.826 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.826 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.826 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-05-08T06:06:47.826 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.826 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.826 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.826 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.826 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_on_failed_host_check": { 2024-05-08T06:06:47.826 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_on_failed_host_check", 2024-05-08T06:06:47.826 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.827 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.827 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.827 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:47.827 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.827 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.827 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.827 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise a health warning if the host check fails", 2024-05-08T06:06:47.827 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.827 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.827 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.827 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.827 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_on_stray_daemons": { 2024-05-08T06:06:47.827 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_on_stray_daemons", 2024-05-08T06:06:47.827 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.827 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.828 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.828 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:47.828 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.828 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.828 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.828 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-05-08T06:06:47.828 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.828 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.828 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.828 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.828 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_on_stray_hosts": { 2024-05-08T06:06:47.828 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_on_stray_hosts", 2024-05-08T06:06:47.828 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.828 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.828 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.828 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:47.828 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.829 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.829 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.829 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-05-08T06:06:47.829 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.829 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.829 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.829 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:47.829 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:47.829 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.829 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:47.829 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crash", 2024-05-08T06:06:47.829 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:47.829 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:47.829 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:47.829 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:47.830 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:47.830 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.830 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.830 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.830 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:47.830 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.830 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.830 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:47.830 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:47.830 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:47.830 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:47.830 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:47.830 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:47.830 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:47.831 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:47.831 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.831 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.831 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.831 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.831 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.831 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:47.831 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:47.831 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.831 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.831 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.831 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:47.831 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.831 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.831 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.831 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.832 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.832 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.832 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.832 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.832 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:47.832 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:47.832 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.832 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.832 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.832 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:47.832 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.832 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.832 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:47.832 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:47.832 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:47.832 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:47.833 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:47.833 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:47.833 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:47.833 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:47.833 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.833 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.833 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.833 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.833 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.833 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:47.833 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:47.833 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.833 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.833 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.833 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:47.833 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.833 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.834 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.834 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.834 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.834 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.834 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.834 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.834 INFO:teuthology.orchestra.run.smithi082.stdout: "retain_interval": { 2024-05-08T06:06:47.834 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "retain_interval", 2024-05-08T06:06:47.834 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:47.834 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.834 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.834 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "31536000", 2024-05-08T06:06:47.834 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.834 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.834 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.835 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how long to retain crashes before pruning them", 2024-05-08T06:06:47.835 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.835 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.835 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.835 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.835 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:47.835 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:47.835 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:47.835 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:47.835 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.835 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:47.835 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.835 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.835 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.835 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.836 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.836 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.836 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.836 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.836 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_recent_interval": { 2024-05-08T06:06:47.836 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_recent_interval", 2024-05-08T06:06:47.836 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:47.836 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.836 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.836 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "1209600", 2024-05-08T06:06:47.836 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.836 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.836 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.836 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "time interval in which to warn about recent crashes", 2024-05-08T06:06:47.836 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.836 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.836 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.837 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:47.837 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:47.837 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.837 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:47.837 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "dashboard", 2024-05-08T06:06:47.837 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:47.837 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:47.837 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:47.837 INFO:teuthology.orchestra.run.smithi082.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-05-08T06:06:47.837 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-05-08T06:06:47.837 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:47.837 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.837 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.837 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-05-08T06:06:47.838 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.838 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.838 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.838 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.838 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.838 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.838 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.838 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.838 INFO:teuthology.orchestra.run.smithi082.stdout: "ALERTMANAGER_API_HOST": { 2024-05-08T06:06:47.838 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ALERTMANAGER_API_HOST", 2024-05-08T06:06:47.838 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.838 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.838 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.838 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:47.839 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.839 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.839 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.839 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.839 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.839 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.839 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.839 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.839 INFO:teuthology.orchestra.run.smithi082.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-05-08T06:06:47.839 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-05-08T06:06:47.839 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.839 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.839 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.839 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:47.839 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.839 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.840 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.840 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.840 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.840 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.840 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.840 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.840 INFO:teuthology.orchestra.run.smithi082.stdout: "AUDIT_API_ENABLED": { 2024-05-08T06:06:47.840 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "AUDIT_API_ENABLED", 2024-05-08T06:06:47.840 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.840 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.840 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.840 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:47.840 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.840 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.840 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.841 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.841 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.841 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.841 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.841 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.841 INFO:teuthology.orchestra.run.smithi082.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-05-08T06:06:47.841 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-05-08T06:06:47.841 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.841 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.841 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.841 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:47.841 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.841 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.841 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.841 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.841 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.841 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.842 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.842 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.842 INFO:teuthology.orchestra.run.smithi082.stdout: "ENABLE_BROWSABLE_API": { 2024-05-08T06:06:47.842 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ENABLE_BROWSABLE_API", 2024-05-08T06:06:47.842 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.842 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.842 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.842 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:47.842 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.842 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.842 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.842 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.842 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.842 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.842 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.843 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.843 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-05-08T06:06:47.843 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-05-08T06:06:47.843 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.843 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.843 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.843 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:47.843 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.843 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.843 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.843 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.843 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.843 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.843 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.843 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.843 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-05-08T06:06:47.844 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-05-08T06:06:47.844 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.844 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.844 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.844 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:47.844 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.844 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.844 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.844 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.844 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.844 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.844 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.844 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.844 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-05-08T06:06:47.844 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-05-08T06:06:47.844 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.845 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.845 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.845 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:47.845 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.845 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.845 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.845 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.845 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.845 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.845 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.845 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.845 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-05-08T06:06:47.845 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-05-08T06:06:47.845 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.845 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.845 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.845 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:47.846 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.846 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.846 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.846 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.846 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.846 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.846 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.846 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.846 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_NFS": { 2024-05-08T06:06:47.846 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-05-08T06:06:47.846 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.846 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.846 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.846 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:47.846 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.847 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.847 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.847 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.847 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.847 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.847 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.847 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.847 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_RBD": { 2024-05-08T06:06:47.847 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-05-08T06:06:47.847 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.847 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.847 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.847 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:47.847 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.847 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.847 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.848 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.848 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.848 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.848 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.848 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.848 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_RGW": { 2024-05-08T06:06:47.848 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-05-08T06:06:47.848 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.848 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.848 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.848 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:47.848 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.848 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.848 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.848 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.848 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.848 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.849 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.849 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.849 INFO:teuthology.orchestra.run.smithi082.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-05-08T06:06:47.849 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-05-08T06:06:47.849 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.849 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.849 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.849 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:47.849 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.849 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.849 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.849 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.849 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.849 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.849 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.849 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.849 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_PASSWORD": { 2024-05-08T06:06:47.850 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_PASSWORD", 2024-05-08T06:06:47.850 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.850 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.850 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.850 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "admin", 2024-05-08T06:06:47.850 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.850 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.850 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.850 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.850 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.850 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.850 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.850 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.850 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-05-08T06:06:47.850 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-05-08T06:06:47.851 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.851 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.851 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.851 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:47.851 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.851 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.851 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.851 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.851 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.851 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.851 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.851 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.851 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_URL": { 2024-05-08T06:06:47.851 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_URL", 2024-05-08T06:06:47.851 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.852 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.852 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.852 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:47.852 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.852 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.852 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.852 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.852 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.852 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.852 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.852 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.852 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_USERNAME": { 2024-05-08T06:06:47.852 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_USERNAME", 2024-05-08T06:06:47.852 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.852 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.852 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.852 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "admin", 2024-05-08T06:06:47.853 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.853 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.853 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.853 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.853 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.853 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.853 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.853 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.853 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-05-08T06:06:47.853 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-05-08T06:06:47.853 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.853 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.853 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.853 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:47.853 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.853 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.854 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.854 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.854 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.854 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.854 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.854 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.854 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-05-08T06:06:47.854 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-05-08T06:06:47.854 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.854 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.854 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.854 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:47.854 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.854 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.854 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.855 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.855 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.855 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.855 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.855 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.855 INFO:teuthology.orchestra.run.smithi082.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-05-08T06:06:47.855 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-05-08T06:06:47.855 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.855 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.855 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.855 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:47.855 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.855 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.855 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.855 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.855 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.855 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.856 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.856 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.856 INFO:teuthology.orchestra.run.smithi082.stdout: "ISSUE_TRACKER_API_KEY": { 2024-05-08T06:06:47.856 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-05-08T06:06:47.856 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.856 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.856 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.856 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:47.856 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.856 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.856 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.856 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.856 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.856 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.856 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.856 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.857 INFO:teuthology.orchestra.run.smithi082.stdout: "MANAGED_BY_CLUSTERS": { 2024-05-08T06:06:47.857 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-05-08T06:06:47.857 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.857 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.857 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.857 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "[]", 2024-05-08T06:06:47.857 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.857 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.857 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.857 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.857 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.857 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.857 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.857 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.857 INFO:teuthology.orchestra.run.smithi082.stdout: "MULTICLUSTER_CONFIG": { 2024-05-08T06:06:47.857 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "MULTICLUSTER_CONFIG", 2024-05-08T06:06:47.857 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.858 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.858 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.858 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "{}", 2024-05-08T06:06:47.858 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.858 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.858 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.858 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.858 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.858 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.858 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.858 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.858 INFO:teuthology.orchestra.run.smithi082.stdout: "PROMETHEUS_API_HOST": { 2024-05-08T06:06:47.858 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PROMETHEUS_API_HOST", 2024-05-08T06:06:47.858 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.858 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.858 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.859 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:47.859 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.859 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.859 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.859 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.859 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.859 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.859 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.859 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.859 INFO:teuthology.orchestra.run.smithi082.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-05-08T06:06:47.859 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-05-08T06:06:47.859 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.859 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.859 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.859 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:47.859 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.859 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.860 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.860 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.860 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.860 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.860 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.860 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.860 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-05-08T06:06:47.860 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-05-08T06:06:47.860 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.860 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.860 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.860 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:47.860 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.860 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.860 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.860 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.860 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.861 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.861 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.861 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.861 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-05-08T06:06:47.861 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-05-08T06:06:47.861 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.861 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.861 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.861 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:47.861 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.861 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.861 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.861 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.861 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.861 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.861 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.862 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.862 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-05-08T06:06:47.862 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-05-08T06:06:47.862 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.862 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.862 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.862 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:47.862 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.862 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.862 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.862 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.862 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.862 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.862 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.862 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.863 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-05-08T06:06:47.863 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-05-08T06:06:47.863 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.863 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.863 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.863 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:47.863 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.863 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.863 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.863 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.863 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.863 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.863 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.863 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.863 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-05-08T06:06:47.863 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-05-08T06:06:47.864 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.864 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.864 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.864 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:47.864 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.864 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.864 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.864 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.864 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.864 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.864 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.864 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.864 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-05-08T06:06:47.864 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-05-08T06:06:47.864 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.864 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.865 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.865 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:47.865 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.865 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.865 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.865 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.865 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.865 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.865 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.865 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.865 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-05-08T06:06:47.865 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-05-08T06:06:47.865 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.865 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.865 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.865 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:47.866 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.866 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.866 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.866 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.866 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.866 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.866 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.866 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.866 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_ENABLED": { 2024-05-08T06:06:47.866 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_ENABLED", 2024-05-08T06:06:47.866 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.866 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.866 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.866 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:47.866 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.866 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.867 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.867 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.867 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.867 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.867 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.867 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.867 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-05-08T06:06:47.867 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-05-08T06:06:47.867 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.867 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.867 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.867 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-05-08T06:06:47.867 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.867 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.867 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.867 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.867 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.868 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.868 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.868 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.868 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-05-08T06:06:47.868 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-05-08T06:06:47.868 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:47.868 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.868 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.868 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-05-08T06:06:47.868 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.868 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.868 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.868 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.868 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.868 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.868 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.869 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.869 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-05-08T06:06:47.869 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-05-08T06:06:47.869 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:47.869 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.869 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.869 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8", 2024-05-08T06:06:47.869 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.869 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.869 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.869 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.869 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.869 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.869 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.869 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.869 INFO:teuthology.orchestra.run.smithi082.stdout: "REST_REQUESTS_TIMEOUT": { 2024-05-08T06:06:47.870 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-05-08T06:06:47.870 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:47.870 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.870 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.870 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "45", 2024-05-08T06:06:47.870 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.870 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.870 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.870 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.870 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.870 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.870 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.870 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.870 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_ACCESS_KEY": { 2024-05-08T06:06:47.870 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_ACCESS_KEY", 2024-05-08T06:06:47.871 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.871 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.871 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.871 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:47.871 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.871 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.871 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.871 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.871 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.871 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.871 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.871 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.871 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-05-08T06:06:47.871 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-05-08T06:06:47.871 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.871 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.871 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.872 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "admin", 2024-05-08T06:06:47.872 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.872 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.872 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.872 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.872 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.872 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.872 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.872 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.872 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_SECRET_KEY": { 2024-05-08T06:06:47.872 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_SECRET_KEY", 2024-05-08T06:06:47.872 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.872 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.872 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.872 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:47.873 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.873 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.873 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.873 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.873 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.873 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.873 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.873 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.873 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_SSL_VERIFY": { 2024-05-08T06:06:47.873 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_SSL_VERIFY", 2024-05-08T06:06:47.873 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.873 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.873 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.873 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:47.874 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.874 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.874 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.874 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.874 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.874 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.874 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.874 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.874 INFO:teuthology.orchestra.run.smithi082.stdout: "UNSAFE_TLS_v1_2": { 2024-05-08T06:06:47.874 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "UNSAFE_TLS_v1_2", 2024-05-08T06:06:47.874 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.874 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.874 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.874 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:47.874 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.874 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.875 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.875 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.875 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.875 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.875 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.875 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.875 INFO:teuthology.orchestra.run.smithi082.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-05-08T06:06:47.875 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-05-08T06:06:47.875 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:47.875 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.875 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.875 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:47.875 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.875 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.875 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.875 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.876 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.876 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.876 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.876 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.876 INFO:teuthology.orchestra.run.smithi082.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-05-08T06:06:47.876 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-05-08T06:06:47.876 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:47.876 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.876 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.876 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-05-08T06:06:47.876 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.876 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.876 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.876 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.876 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.876 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.876 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.877 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.877 INFO:teuthology.orchestra.run.smithi082.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-05-08T06:06:47.877 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-05-08T06:06:47.877 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:47.877 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.877 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.877 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-05-08T06:06:47.877 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.877 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.877 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.877 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.877 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.877 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.877 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.877 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.877 INFO:teuthology.orchestra.run.smithi082.stdout: "cross_origin_url": { 2024-05-08T06:06:47.877 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cross_origin_url", 2024-05-08T06:06:47.878 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.878 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.878 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.878 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:47.878 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.878 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.878 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.878 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.878 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.878 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.878 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.878 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.878 INFO:teuthology.orchestra.run.smithi082.stdout: "crt_file": { 2024-05-08T06:06:47.878 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crt_file", 2024-05-08T06:06:47.878 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.878 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.879 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.879 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:47.879 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.879 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.879 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.879 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.879 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.879 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.879 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.879 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.879 INFO:teuthology.orchestra.run.smithi082.stdout: "debug": { 2024-05-08T06:06:47.879 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "debug", 2024-05-08T06:06:47.879 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.879 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.879 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.879 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:47.880 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.880 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.880 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.880 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Enable/disable debug options", 2024-05-08T06:06:47.880 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.880 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.880 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.880 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.880 INFO:teuthology.orchestra.run.smithi082.stdout: "jwt_token_ttl": { 2024-05-08T06:06:47.880 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "jwt_token_ttl", 2024-05-08T06:06:47.880 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:47.880 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.880 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.880 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "28800", 2024-05-08T06:06:47.880 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.880 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.880 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.881 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.881 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.881 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.881 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.881 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.881 INFO:teuthology.orchestra.run.smithi082.stdout: "key_file": { 2024-05-08T06:06:47.881 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "key_file", 2024-05-08T06:06:47.881 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.881 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.881 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.881 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:47.881 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.881 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.881 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.881 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.881 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.882 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.882 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.882 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.882 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:47.882 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:47.882 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.882 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.882 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.882 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:47.882 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.882 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.882 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:47.882 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:47.882 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:47.882 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:47.882 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:47.883 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:47.883 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:47.883 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:47.883 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.883 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.883 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.883 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.883 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.883 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:47.883 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:47.883 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.883 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.883 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.883 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:47.883 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.883 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.884 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.884 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.884 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.884 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.884 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.884 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.884 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:47.884 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:47.884 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.884 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.884 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.884 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:47.884 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.884 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.884 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:47.884 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:47.885 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:47.885 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:47.885 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:47.885 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:47.885 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:47.885 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:47.885 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.885 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.885 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.885 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.885 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.885 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:47.885 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:47.885 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.885 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.886 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.886 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:47.886 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.886 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.886 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.886 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.886 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.886 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.886 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.886 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.886 INFO:teuthology.orchestra.run.smithi082.stdout: "motd": { 2024-05-08T06:06:47.886 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "motd", 2024-05-08T06:06:47.886 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.886 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.886 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.887 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:47.887 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.887 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.887 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.887 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "The message of the day", 2024-05-08T06:06:47.887 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.887 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.887 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.887 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.887 INFO:teuthology.orchestra.run.smithi082.stdout: "redirect_resolve_ip_addr": { 2024-05-08T06:06:47.887 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "redirect_resolve_ip_addr", 2024-05-08T06:06:47.887 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.887 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.887 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.887 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:47.888 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.888 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.888 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.888 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.888 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.888 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.888 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.888 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.888 INFO:teuthology.orchestra.run.smithi082.stdout: "server_addr": { 2024-05-08T06:06:47.888 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_addr", 2024-05-08T06:06:47.888 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.888 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.888 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.888 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "::", 2024-05-08T06:06:47.888 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.889 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.889 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.889 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.889 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.889 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.889 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.889 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.889 INFO:teuthology.orchestra.run.smithi082.stdout: "server_port": { 2024-05-08T06:06:47.889 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_port", 2024-05-08T06:06:47.889 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:47.889 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.889 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.889 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8080", 2024-05-08T06:06:47.889 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.890 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.890 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.890 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.890 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.890 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.890 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.890 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.890 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:47.890 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:47.890 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:47.890 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:47.890 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.890 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:47.890 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.890 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.891 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.891 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.891 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.891 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.891 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.891 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.891 INFO:teuthology.orchestra.run.smithi082.stdout: "ssl": { 2024-05-08T06:06:47.891 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssl", 2024-05-08T06:06:47.891 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.891 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.891 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.891 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:47.891 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.891 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.891 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.891 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.891 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.892 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.892 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.892 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.892 INFO:teuthology.orchestra.run.smithi082.stdout: "ssl_server_port": { 2024-05-08T06:06:47.892 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssl_server_port", 2024-05-08T06:06:47.892 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:47.892 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.892 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.892 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8443", 2024-05-08T06:06:47.892 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.892 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.892 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.892 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.892 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.892 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.892 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.892 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.893 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_behaviour": { 2024-05-08T06:06:47.893 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_behaviour", 2024-05-08T06:06:47.893 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.893 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.893 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.893 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "redirect", 2024-05-08T06:06:47.893 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.893 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.893 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:47.893 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:47.893 INFO:teuthology.orchestra.run.smithi082.stdout: "redirect" 2024-05-08T06:06:47.893 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:47.893 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.893 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.893 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.893 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.893 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.894 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_error_status_code": { 2024-05-08T06:06:47.894 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_error_status_code", 2024-05-08T06:06:47.894 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:47.894 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.894 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.894 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "500", 2024-05-08T06:06:47.894 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "400", 2024-05-08T06:06:47.894 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "599", 2024-05-08T06:06:47.894 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.894 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.894 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.894 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.894 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.894 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.894 INFO:teuthology.orchestra.run.smithi082.stdout: "url_prefix": { 2024-05-08T06:06:47.894 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "url_prefix", 2024-05-08T06:06:47.895 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.895 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.895 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.895 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:47.895 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.895 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.895 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.895 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.895 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.895 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.895 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.895 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:47.895 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:47.895 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.895 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:47.895 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "devicehealth", 2024-05-08T06:06:47.895 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:47.896 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:47.896 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:47.896 INFO:teuthology.orchestra.run.smithi082.stdout: "enable_monitoring": { 2024-05-08T06:06:47.896 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enable_monitoring", 2024-05-08T06:06:47.896 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.896 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.896 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.896 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:47.896 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.896 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.896 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.896 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "monitor device health metrics", 2024-05-08T06:06:47.896 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.896 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.896 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.896 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.896 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:47.897 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:47.897 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.897 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.897 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.897 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:47.897 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.897 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.897 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:47.897 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:47.897 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:47.897 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:47.897 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:47.897 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:47.897 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:47.897 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:47.897 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.898 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.898 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.898 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.898 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.898 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:47.898 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:47.898 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.898 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.898 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.898 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:47.898 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.898 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.898 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.898 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.899 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.899 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.899 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.899 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.899 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:47.899 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:47.899 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.899 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.899 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.899 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:47.899 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.899 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.899 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:47.899 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:47.899 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:47.899 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:47.899 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:47.900 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:47.900 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:47.900 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:47.900 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.900 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.900 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.900 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.900 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.900 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:47.900 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:47.900 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.900 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.900 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.900 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:47.900 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.900 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.900 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.901 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.901 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.901 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.901 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.901 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.901 INFO:teuthology.orchestra.run.smithi082.stdout: "mark_out_threshold": { 2024-05-08T06:06:47.901 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mark_out_threshold", 2024-05-08T06:06:47.901 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:47.901 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.901 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.901 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "2419200", 2024-05-08T06:06:47.901 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.901 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.901 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.901 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-05-08T06:06:47.902 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.902 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.902 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.902 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.902 INFO:teuthology.orchestra.run.smithi082.stdout: "pool_name": { 2024-05-08T06:06:47.902 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pool_name", 2024-05-08T06:06:47.902 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.902 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.902 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.902 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "device_health_metrics", 2024-05-08T06:06:47.902 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.902 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.902 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.902 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "name of pool in which to store device health metrics", 2024-05-08T06:06:47.902 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.903 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.903 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.903 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.903 INFO:teuthology.orchestra.run.smithi082.stdout: "retention_period": { 2024-05-08T06:06:47.903 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "retention_period", 2024-05-08T06:06:47.903 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:47.903 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.903 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.903 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "15552000", 2024-05-08T06:06:47.903 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.903 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.903 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.903 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how long to retain device health metrics", 2024-05-08T06:06:47.903 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.903 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.904 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.904 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.904 INFO:teuthology.orchestra.run.smithi082.stdout: "scrape_frequency": { 2024-05-08T06:06:47.904 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "scrape_frequency", 2024-05-08T06:06:47.904 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:47.904 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.904 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.904 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "86400", 2024-05-08T06:06:47.904 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.904 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.904 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.904 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to scrape device health metrics", 2024-05-08T06:06:47.904 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.904 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.904 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.904 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.904 INFO:teuthology.orchestra.run.smithi082.stdout: "self_heal": { 2024-05-08T06:06:47.905 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "self_heal", 2024-05-08T06:06:47.905 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.905 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.905 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.905 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:47.905 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.905 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.905 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.905 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-05-08T06:06:47.905 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.905 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.905 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.905 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.905 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-05-08T06:06:47.905 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-05-08T06:06:47.905 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:47.905 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.906 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.906 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-05-08T06:06:47.906 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.906 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.906 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.906 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to wake up and check device health", 2024-05-08T06:06:47.906 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.906 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.906 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.906 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.906 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:47.906 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:47.906 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:47.906 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:47.906 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.907 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:47.907 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.907 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.907 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.907 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.907 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.907 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.907 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.907 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.907 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_threshold": { 2024-05-08T06:06:47.907 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_threshold", 2024-05-08T06:06:47.907 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:47.907 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.907 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.907 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "7257600", 2024-05-08T06:06:47.907 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.908 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.908 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.908 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-05-08T06:06:47.908 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.908 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.908 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.908 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:47.908 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:47.908 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.908 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:47.908 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "diskprediction_local", 2024-05-08T06:06:47.908 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:47.908 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:47.908 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:47.908 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:47.908 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:47.908 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.909 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.909 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.909 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:47.909 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.909 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.909 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:47.909 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:47.909 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:47.909 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:47.909 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:47.909 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:47.909 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:47.909 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:47.909 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.909 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.909 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.910 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.910 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.910 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:47.910 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:47.910 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.910 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.910 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.910 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:47.910 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.910 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.910 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.910 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.910 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.910 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.910 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.911 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.911 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:47.911 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:47.911 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.911 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.911 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.911 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:47.911 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.911 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.911 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:47.911 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:47.911 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:47.911 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:47.911 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:47.911 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:47.912 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:47.912 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:47.912 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.912 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.912 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.912 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.912 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.912 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:47.912 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:47.912 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.912 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.912 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.912 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:47.912 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.912 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.912 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.913 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.913 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.913 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.913 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.913 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.913 INFO:teuthology.orchestra.run.smithi082.stdout: "predict_interval": { 2024-05-08T06:06:47.913 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "predict_interval", 2024-05-08T06:06:47.913 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.913 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.913 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.913 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "86400", 2024-05-08T06:06:47.913 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.913 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.913 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.913 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.913 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.914 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.914 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.914 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.914 INFO:teuthology.orchestra.run.smithi082.stdout: "predictor_model": { 2024-05-08T06:06:47.914 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "predictor_model", 2024-05-08T06:06:47.914 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.914 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.914 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.914 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "prophetstor", 2024-05-08T06:06:47.914 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.914 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.914 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.914 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.914 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.915 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.915 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.915 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.915 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-05-08T06:06:47.915 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-05-08T06:06:47.915 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.915 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.915 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.915 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-05-08T06:06:47.915 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.915 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.915 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.915 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.915 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.915 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.916 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.916 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.916 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:47.916 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:47.916 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:47.916 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:47.916 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.916 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:47.916 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.916 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.916 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.916 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.916 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.916 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.916 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.916 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:47.917 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:47.917 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.917 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:47.917 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "influx", 2024-05-08T06:06:47.917 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": false, 2024-05-08T06:06:47.917 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "influxdb python module not found", 2024-05-08T06:06:47.917 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:47.917 INFO:teuthology.orchestra.run.smithi082.stdout: "batch_size": { 2024-05-08T06:06:47.917 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "batch_size", 2024-05-08T06:06:47.917 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:47.917 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.917 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.917 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5000", 2024-05-08T06:06:47.917 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.917 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.917 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.917 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-05-08T06:06:47.918 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.918 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.918 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.918 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.918 INFO:teuthology.orchestra.run.smithi082.stdout: "database": { 2024-05-08T06:06:47.918 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "database", 2024-05-08T06:06:47.918 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.918 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.918 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.918 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "ceph", 2024-05-08T06:06:47.918 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.918 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.918 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.918 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-05-08T06:06:47.918 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.919 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.919 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.919 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.919 INFO:teuthology.orchestra.run.smithi082.stdout: "hostname": { 2024-05-08T06:06:47.919 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "hostname", 2024-05-08T06:06:47.919 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.919 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.919 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.919 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:47.919 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.919 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.919 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.919 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "InfluxDB server hostname", 2024-05-08T06:06:47.919 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.919 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.919 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.920 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.920 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-05-08T06:06:47.920 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-05-08T06:06:47.920 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:47.920 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.920 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.920 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "30", 2024-05-08T06:06:47.920 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "5", 2024-05-08T06:06:47.920 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.920 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.920 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-05-08T06:06:47.920 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.920 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.920 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.920 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.920 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:47.921 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:47.921 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.921 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.921 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.921 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:47.921 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.921 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.921 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:47.921 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:47.921 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:47.921 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:47.921 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:47.921 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:47.921 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:47.921 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:47.922 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.922 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.922 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.922 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.922 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.922 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:47.922 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:47.922 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.922 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.922 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.922 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:47.922 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.922 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.922 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.922 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.923 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.923 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.923 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.923 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.923 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:47.923 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:47.923 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.923 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.923 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.923 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:47.923 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.923 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.923 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:47.924 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:47.924 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:47.924 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:47.924 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:47.924 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:47.924 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:47.924 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:47.924 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.924 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.924 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.924 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.924 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.924 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:47.924 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:47.924 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.924 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.925 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.925 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:47.925 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.925 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.925 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.925 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.925 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.925 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.925 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.925 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.925 INFO:teuthology.orchestra.run.smithi082.stdout: "password": { 2024-05-08T06:06:47.925 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "password", 2024-05-08T06:06:47.925 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.925 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.925 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.925 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:47.926 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.926 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.926 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.926 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "password of InfluxDB server user", 2024-05-08T06:06:47.926 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.926 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.926 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.926 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.926 INFO:teuthology.orchestra.run.smithi082.stdout: "port": { 2024-05-08T06:06:47.926 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "port", 2024-05-08T06:06:47.926 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:47.926 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.926 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.926 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8086", 2024-05-08T06:06:47.926 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.927 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.927 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.927 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "InfluxDB server port", 2024-05-08T06:06:47.927 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.927 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.927 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.927 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.927 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:47.927 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:47.927 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:47.927 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:47.927 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.927 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:47.927 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.927 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.927 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.927 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.928 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.928 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.928 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.928 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.928 INFO:teuthology.orchestra.run.smithi082.stdout: "ssl": { 2024-05-08T06:06:47.928 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssl", 2024-05-08T06:06:47.928 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.928 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.928 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.928 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "false", 2024-05-08T06:06:47.928 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.928 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.928 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.928 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-05-08T06:06:47.928 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.929 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.929 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.929 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.929 INFO:teuthology.orchestra.run.smithi082.stdout: "threads": { 2024-05-08T06:06:47.929 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "threads", 2024-05-08T06:06:47.929 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:47.929 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.929 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.929 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-05-08T06:06:47.929 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-05-08T06:06:47.929 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "32", 2024-05-08T06:06:47.929 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.929 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-05-08T06:06:47.929 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.929 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.929 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.930 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.930 INFO:teuthology.orchestra.run.smithi082.stdout: "username": { 2024-05-08T06:06:47.930 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "username", 2024-05-08T06:06:47.930 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.930 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.930 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.930 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:47.930 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.930 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.930 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.930 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "username of InfluxDB server user", 2024-05-08T06:06:47.930 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.930 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.931 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.931 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.931 INFO:teuthology.orchestra.run.smithi082.stdout: "verify_ssl": { 2024-05-08T06:06:47.931 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "verify_ssl", 2024-05-08T06:06:47.931 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.931 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.931 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.931 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "true", 2024-05-08T06:06:47.931 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.931 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.931 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.931 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-05-08T06:06:47.931 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.931 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.932 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.932 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:47.932 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:47.932 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.932 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:47.932 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "insights", 2024-05-08T06:06:47.932 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:47.932 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:47.932 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:47.932 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:47.932 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:47.932 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.932 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.932 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.932 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:47.932 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.933 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.933 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:47.933 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:47.933 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:47.933 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:47.933 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:47.933 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:47.933 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:47.933 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:47.933 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.933 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.933 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.933 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.933 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.933 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:47.934 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:47.934 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.934 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.934 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.934 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:47.934 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.934 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.934 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.934 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.934 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.934 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.934 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.934 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.934 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:47.934 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:47.935 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.935 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.935 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.935 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:47.935 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.935 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.935 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:47.935 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:47.935 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:47.935 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:47.935 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:47.935 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:47.935 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:47.935 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:47.935 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.935 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.935 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.936 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.936 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.936 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:47.936 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:47.936 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.936 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.936 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.936 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:47.936 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.936 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.936 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.936 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.936 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.936 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.936 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.936 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.936 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:47.937 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:47.937 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:47.937 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:47.937 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.937 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:47.937 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.937 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.937 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.937 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.937 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.937 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.937 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.937 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:47.937 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:47.937 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.938 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:47.938 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "iostat", 2024-05-08T06:06:47.938 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:47.938 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:47.938 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:47.938 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:47.938 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:47.938 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.938 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.938 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.938 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:47.938 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.938 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.938 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:47.938 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:47.939 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:47.939 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:47.939 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:47.939 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:47.939 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:47.939 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:47.939 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.939 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.939 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.939 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.939 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.939 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:47.939 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:47.939 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.939 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.939 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.939 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:47.940 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.940 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.940 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.940 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.940 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.940 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.940 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.940 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.940 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:47.940 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:47.940 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.940 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.940 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.940 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:47.940 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.940 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.940 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:47.941 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:47.941 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:47.941 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:47.941 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:47.941 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:47.941 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:47.941 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:47.941 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.941 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.941 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.941 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.941 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.941 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:47.941 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:47.941 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.941 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.942 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.942 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:47.942 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.942 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.942 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.942 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.942 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.942 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.942 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.942 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.942 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:47.942 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:47.942 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:47.942 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:47.942 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.942 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:47.943 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.943 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.943 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.943 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.943 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.943 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.943 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.943 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:47.943 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:47.943 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.943 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:47.943 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "k8sevents", 2024-05-08T06:06:47.943 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:47.943 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:47.943 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:47.943 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_event_retention_days": { 2024-05-08T06:06:47.944 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ceph_event_retention_days", 2024-05-08T06:06:47.944 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:47.944 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.944 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.944 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "7", 2024-05-08T06:06:47.944 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.944 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.944 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.944 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Days to hold ceph event information within local cache", 2024-05-08T06:06:47.944 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.944 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.944 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.944 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.944 INFO:teuthology.orchestra.run.smithi082.stdout: "config_check_secs": { 2024-05-08T06:06:47.944 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "config_check_secs", 2024-05-08T06:06:47.944 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:47.944 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.945 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.945 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-05-08T06:06:47.945 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "10", 2024-05-08T06:06:47.945 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.945 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.945 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-05-08T06:06:47.945 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.945 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.945 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.945 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.945 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:47.945 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:47.945 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.945 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.945 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.945 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:47.946 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.946 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.946 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:47.946 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:47.946 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:47.946 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:47.946 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:47.946 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:47.946 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:47.946 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:47.946 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.946 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.946 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.946 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.947 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.947 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:47.947 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:47.947 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.947 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.947 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.947 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:47.947 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.947 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.947 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.947 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.947 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.947 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.947 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.947 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.948 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:47.948 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:47.948 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.948 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.948 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.948 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:47.948 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.948 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.948 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:47.948 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:47.948 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:47.948 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:47.948 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:47.948 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:47.948 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:47.948 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:47.949 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.949 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.949 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.949 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.949 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.949 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:47.949 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:47.949 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.949 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.949 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.949 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:47.949 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.949 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.949 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.949 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.949 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.950 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.950 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.950 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.950 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:47.950 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:47.950 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:47.950 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:47.950 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.950 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:47.950 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.950 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.950 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.950 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.950 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.950 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.950 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.951 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:47.951 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:47.951 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.951 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:47.951 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "localpool", 2024-05-08T06:06:47.951 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:47.951 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:47.951 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:47.951 INFO:teuthology.orchestra.run.smithi082.stdout: "failure_domain": { 2024-05-08T06:06:47.951 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "failure_domain", 2024-05-08T06:06:47.951 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.951 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.951 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.951 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "host", 2024-05-08T06:06:47.951 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.951 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.952 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.952 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "failure domain for any created local pool", 2024-05-08T06:06:47.952 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-05-08T06:06:47.952 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.952 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.952 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.952 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:47.952 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:47.952 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.952 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.952 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.952 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:47.952 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.952 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.952 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:47.952 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:47.953 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:47.953 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:47.953 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:47.953 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:47.953 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:47.953 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:47.953 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.953 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.953 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.953 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.953 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.953 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:47.953 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:47.953 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.953 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.953 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.954 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:47.954 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.954 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.954 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.954 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.954 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.954 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.954 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.954 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.954 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:47.954 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:47.954 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.954 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.954 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.954 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:47.954 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.955 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.955 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:47.955 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:47.955 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:47.955 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:47.955 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:47.955 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:47.955 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:47.955 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:47.955 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.955 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.955 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.955 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.955 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.955 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:47.955 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:47.955 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.956 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.956 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.956 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:47.956 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.956 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.956 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.956 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.956 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.956 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.956 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.956 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.956 INFO:teuthology.orchestra.run.smithi082.stdout: "min_size": { 2024-05-08T06:06:47.956 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "min_size", 2024-05-08T06:06:47.956 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:47.956 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.956 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.956 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:47.957 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.957 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.957 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.957 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "default min_size for any created local pool", 2024-05-08T06:06:47.957 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-05-08T06:06:47.957 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.957 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.957 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.957 INFO:teuthology.orchestra.run.smithi082.stdout: "num_rep": { 2024-05-08T06:06:47.957 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "num_rep", 2024-05-08T06:06:47.957 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:47.957 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.957 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.957 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "3", 2024-05-08T06:06:47.957 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.958 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.958 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.958 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "default replica count for any created local pool", 2024-05-08T06:06:47.958 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.958 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.958 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.958 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.958 INFO:teuthology.orchestra.run.smithi082.stdout: "pg_num": { 2024-05-08T06:06:47.958 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pg_num", 2024-05-08T06:06:47.958 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:47.958 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.958 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.958 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "128", 2024-05-08T06:06:47.958 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.958 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.958 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.959 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "default pg_num for any created local pool", 2024-05-08T06:06:47.959 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.959 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.959 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.959 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.959 INFO:teuthology.orchestra.run.smithi082.stdout: "prefix": { 2024-05-08T06:06:47.959 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "prefix", 2024-05-08T06:06:47.959 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.959 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.959 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.959 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:47.959 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.959 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.959 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.959 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "name prefix for any created local pool", 2024-05-08T06:06:47.959 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.960 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.960 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.960 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.960 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:47.960 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:47.960 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:47.960 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:47.960 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.960 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:47.960 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.960 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.960 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.960 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.960 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.960 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.961 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.961 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.961 INFO:teuthology.orchestra.run.smithi082.stdout: "subtree": { 2024-05-08T06:06:47.961 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "subtree", 2024-05-08T06:06:47.961 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.961 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.961 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.961 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "rack", 2024-05-08T06:06:47.961 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.961 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.961 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.961 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "CRUSH level for which to create a local pool", 2024-05-08T06:06:47.961 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-05-08T06:06:47.961 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.961 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.962 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:47.962 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:47.962 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.962 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:47.962 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mds_autoscaler", 2024-05-08T06:06:47.962 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:47.962 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:47.962 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:47.962 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:47.962 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:47.962 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.962 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.962 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.962 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:47.962 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.962 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.963 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:47.963 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:47.963 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:47.963 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:47.963 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:47.963 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:47.963 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:47.963 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:47.963 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.963 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.963 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.963 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.963 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.963 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:47.963 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:47.963 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.964 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.964 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.964 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:47.964 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.964 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.964 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.964 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.964 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.964 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.964 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.964 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.964 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:47.964 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:47.964 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.964 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.964 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.964 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:47.965 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.965 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.965 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:47.965 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:47.965 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:47.965 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:47.965 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:47.965 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:47.965 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:47.965 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:47.965 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.965 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.965 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.965 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.965 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.965 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:47.966 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:47.966 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.966 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.966 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.966 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:47.966 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.966 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.966 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.966 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.966 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.966 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.966 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.966 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.966 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:47.966 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:47.966 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:47.967 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:47.967 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.967 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:47.967 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.967 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.967 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.967 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.967 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.967 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.967 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.967 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:47.967 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:47.967 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.967 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:47.967 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mirroring", 2024-05-08T06:06:47.967 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:47.967 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:47.967 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:47.968 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:47.968 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:47.968 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.968 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.968 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.968 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:47.968 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.968 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.968 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:47.968 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:47.968 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:47.968 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:47.968 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:47.968 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:47.968 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:47.968 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:47.968 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.969 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.969 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.969 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.969 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.969 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:47.969 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:47.969 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.969 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.969 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.969 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:47.969 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.969 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.969 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.969 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.969 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.969 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.970 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.970 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.970 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:47.970 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:47.970 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.970 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.970 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.970 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:47.970 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.970 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.970 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:47.970 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:47.970 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:47.970 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:47.971 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:47.971 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:47.971 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:47.971 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:47.971 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.971 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.971 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.971 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.971 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.971 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:47.971 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:47.971 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.971 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.971 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.971 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:47.971 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.971 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.972 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.972 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.972 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.972 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.972 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.972 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.972 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:47.972 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:47.972 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:47.972 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:47.972 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.972 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:47.972 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.972 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.972 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.972 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.973 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.973 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.973 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.973 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:47.973 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:47.973 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.973 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:47.973 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "nfs", 2024-05-08T06:06:47.973 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:47.973 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:47.973 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:47.973 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:47.973 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:47.973 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.973 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.973 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.974 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:47.974 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.974 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.974 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:47.974 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:47.974 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:47.974 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:47.974 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:47.974 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:47.974 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:47.974 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:47.974 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.974 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.974 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.974 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.975 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.975 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:47.975 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:47.975 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.975 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.975 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.975 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:47.975 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.975 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.975 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.975 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.975 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.975 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.975 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.975 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.975 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:47.976 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:47.976 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.976 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.976 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.976 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:47.976 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.976 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.976 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:47.976 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:47.976 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:47.976 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:47.976 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:47.976 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:47.976 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:47.976 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:47.976 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.976 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.977 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.977 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.977 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.977 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:47.977 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:47.977 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.977 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.977 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.977 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:47.977 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.977 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.977 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.977 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.977 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.977 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.977 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.977 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.978 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:47.978 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:47.978 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:47.978 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:47.978 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.978 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:47.978 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.978 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.978 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.978 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.978 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.978 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.978 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.978 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:47.978 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:47.978 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.978 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:47.979 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "orchestrator", 2024-05-08T06:06:47.979 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:47.979 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:47.979 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:47.979 INFO:teuthology.orchestra.run.smithi082.stdout: "fail_fs": { 2024-05-08T06:06:47.979 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "fail_fs", 2024-05-08T06:06:47.979 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.979 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.979 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:47.979 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:47.979 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.979 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.979 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.979 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-05-08T06:06:47.979 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.980 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.980 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.980 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.980 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:47.980 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:47.980 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.980 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.980 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.980 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:47.980 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.980 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.980 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:47.980 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:47.980 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:47.980 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:47.980 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:47.980 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:47.981 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:47.981 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:47.981 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.981 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.981 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.981 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.981 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.981 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:47.981 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:47.981 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.981 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.981 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.981 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:47.981 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.981 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.981 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.981 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.982 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.982 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.982 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.982 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.982 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:47.982 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:47.982 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.982 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.982 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.982 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:47.982 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.982 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.982 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:47.982 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:47.982 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:47.982 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:47.983 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:47.983 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:47.983 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:47.983 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:47.983 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.983 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.983 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.983 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.983 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.983 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:47.983 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:47.983 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.983 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.983 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.983 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:47.983 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.983 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.984 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.984 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.984 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.984 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.984 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.984 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.984 INFO:teuthology.orchestra.run.smithi082.stdout: "orchestrator": { 2024-05-08T06:06:47.984 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "orchestrator", 2024-05-08T06:06:47.984 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.984 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.984 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.984 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:47.984 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.984 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.984 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:47.984 INFO:teuthology.orchestra.run.smithi082.stdout: "cephadm", 2024-05-08T06:06:47.985 INFO:teuthology.orchestra.run.smithi082.stdout: "rook", 2024-05-08T06:06:47.985 INFO:teuthology.orchestra.run.smithi082.stdout: "test_orchestrator" 2024-05-08T06:06:47.985 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:47.985 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Orchestrator backend", 2024-05-08T06:06:47.985 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.985 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.985 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.985 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.985 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:47.985 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:47.985 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:47.985 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:47.985 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.985 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:47.985 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.985 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.985 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.986 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.986 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.986 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.986 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.986 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:47.986 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:47.986 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.986 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:47.986 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "osd_perf_query", 2024-05-08T06:06:47.986 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:47.986 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:47.986 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:47.986 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:47.986 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:47.986 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.986 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.987 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.987 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:47.987 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.987 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.987 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:47.987 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:47.987 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:47.987 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:47.987 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:47.987 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:47.987 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:47.987 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:47.987 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.987 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.987 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.987 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.987 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.988 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:47.988 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:47.988 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.988 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.988 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.988 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:47.988 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.988 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.988 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.988 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.988 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.988 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.988 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.988 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.988 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:47.988 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:47.989 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.989 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.989 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.989 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:47.989 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.989 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.989 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:47.989 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:47.989 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:47.989 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:47.989 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:47.989 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:47.989 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:47.989 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:47.989 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.989 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.989 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.990 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.990 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.990 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:47.990 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:47.990 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.990 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.990 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.990 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:47.990 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.990 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.990 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.990 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.990 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.990 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.990 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.991 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.991 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:47.991 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:47.991 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:47.991 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:47.991 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.991 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:47.991 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.991 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.991 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.991 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.991 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.991 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.991 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.991 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:47.991 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:47.991 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.992 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:47.992 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "osd_support", 2024-05-08T06:06:47.992 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:47.992 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:47.992 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:47.992 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:47.992 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:47.992 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.992 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.992 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.992 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:47.992 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.992 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.992 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:47.992 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:47.992 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:47.992 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:47.992 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:47.993 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:47.993 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:47.993 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:47.993 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.993 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.993 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.993 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.993 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.993 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:47.993 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:47.993 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.993 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.993 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.993 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:47.993 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.993 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.994 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.994 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.994 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.994 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.994 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.994 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.994 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:47.994 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:47.994 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.994 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.994 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.994 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:47.994 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.994 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.994 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:47.994 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:47.995 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:47.995 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:47.995 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:47.995 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:47.995 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:47.995 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:47.995 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.995 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.995 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.995 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.995 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.995 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:47.995 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:47.995 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.995 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.995 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.996 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:47.996 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.996 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.996 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.996 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.996 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.996 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.996 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.996 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.996 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:47.996 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:47.996 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:47.996 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:47.996 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.996 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:47.996 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.996 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.997 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.997 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.997 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.997 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.997 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.997 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:47.997 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:47.997 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.997 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:47.997 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pg_autoscaler", 2024-05-08T06:06:47.997 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:47.997 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:47.997 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:47.997 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:47.997 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:47.998 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:47.998 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.998 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.998 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:47.998 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.998 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.998 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:47.998 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:47.998 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:47.998 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:47.998 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:47.998 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:47.998 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:47.998 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:47.998 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.998 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.998 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.999 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.999 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:47.999 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:47.999 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:47.999 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:47.999 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:47.999 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:47.999 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:47.999 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:47.999 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:47.999 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:47.999 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:47.999 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:47.999 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:47.999 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:47.999 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.000 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.000 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.000 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.000 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.000 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.000 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.000 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.000 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.000 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.000 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.000 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.000 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.000 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.000 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.000 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.000 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.001 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.001 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.001 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.001 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.001 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.001 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.001 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.001 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.001 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.001 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.001 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.001 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.001 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.001 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.001 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.002 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.002 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.002 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.002 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.002 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-05-08T06:06:48.002 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-05-08T06:06:48.002 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:48.002 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.002 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.002 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-05-08T06:06:48.002 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.002 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.002 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.002 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.002 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.003 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.003 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.003 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.003 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.003 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.003 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.003 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.003 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.003 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.003 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.003 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.003 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.003 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.003 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.003 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.003 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.003 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.004 INFO:teuthology.orchestra.run.smithi082.stdout: "threshold": { 2024-05-08T06:06:48.004 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "threshold", 2024-05-08T06:06:48.004 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-05-08T06:06:48.004 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.004 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.004 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "3.0", 2024-05-08T06:06:48.004 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1.0", 2024-05-08T06:06:48.004 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.004 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.004 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "scaling threshold", 2024-05-08T06:06:48.004 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-05-08T06:06:48.004 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.004 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.004 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.004 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.004 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.005 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.005 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "progress", 2024-05-08T06:06:48.005 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.005 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.005 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.005 INFO:teuthology.orchestra.run.smithi082.stdout: "allow_pg_recovery_event": { 2024-05-08T06:06:48.005 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "allow_pg_recovery_event", 2024-05-08T06:06:48.005 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.005 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.005 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.005 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.005 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.005 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.005 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.006 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "allow the module to show pg recovery progress", 2024-05-08T06:06:48.006 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.006 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.006 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.006 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.006 INFO:teuthology.orchestra.run.smithi082.stdout: "enabled": { 2024-05-08T06:06:48.006 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enabled", 2024-05-08T06:06:48.006 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.006 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.006 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.006 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.006 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.006 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.006 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.006 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.006 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.007 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.007 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.007 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.007 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.007 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.007 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.007 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.007 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.007 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.007 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.007 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.007 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.007 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.007 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.007 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.007 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.007 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.008 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.008 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.008 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.008 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.008 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.008 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.008 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.008 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.008 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.008 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.008 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.008 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.008 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.008 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.008 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.008 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.009 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.009 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.009 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.009 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.009 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.009 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.009 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.009 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.009 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.009 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.009 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.009 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.009 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.009 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.009 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.009 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.009 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.010 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.010 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.010 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.010 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.010 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.010 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.010 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.010 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.010 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.010 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.010 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.010 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.010 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.010 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.010 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.011 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.011 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.011 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.011 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.011 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.011 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.011 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.011 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.011 INFO:teuthology.orchestra.run.smithi082.stdout: "max_completed_events": { 2024-05-08T06:06:48.011 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_completed_events", 2024-05-08T06:06:48.011 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.011 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.011 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.011 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "50", 2024-05-08T06:06:48.011 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.011 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.012 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.012 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "number of past completed events to remember", 2024-05-08T06:06:48.012 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.012 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.012 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.012 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.012 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-05-08T06:06:48.012 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-05-08T06:06:48.012 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:48.012 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.012 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.012 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-05-08T06:06:48.012 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.012 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.012 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.012 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how long the module is going to sleep", 2024-05-08T06:06:48.012 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.013 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.013 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.013 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.013 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.013 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.013 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.013 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.013 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.013 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.013 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.013 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.013 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.013 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.013 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.013 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.013 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.013 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.014 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.014 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.014 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.014 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "prometheus", 2024-05-08T06:06:48.014 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.014 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.014 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.014 INFO:teuthology.orchestra.run.smithi082.stdout: "cache": { 2024-05-08T06:06:48.014 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cache", 2024-05-08T06:06:48.014 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.014 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.014 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.014 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.014 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.014 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.014 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.015 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.015 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.015 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.015 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.015 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.015 INFO:teuthology.orchestra.run.smithi082.stdout: "exclude_perf_counters": { 2024-05-08T06:06:48.015 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "exclude_perf_counters", 2024-05-08T06:06:48.015 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.015 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.015 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.015 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.015 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.015 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.015 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.015 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-05-08T06:06:48.015 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-05-08T06:06:48.015 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.016 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.016 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.016 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.016 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.016 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.016 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.016 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.016 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.016 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.016 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.016 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.016 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.016 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.016 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.016 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.017 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.017 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.017 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.017 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.017 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.017 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.017 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.017 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.017 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.017 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.017 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.017 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.017 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.017 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.018 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.018 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.018 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.018 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.018 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.018 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.018 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.018 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.018 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.018 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.018 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.018 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.018 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.018 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.018 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.019 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.019 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.019 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.019 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.019 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.019 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.019 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.019 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.019 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.019 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.019 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.019 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.019 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.019 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.019 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.019 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.020 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.020 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.020 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.020 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.020 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.020 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.020 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.020 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.020 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.020 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.020 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.020 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.020 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_stats_pools": { 2024-05-08T06:06:48.020 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_stats_pools", 2024-05-08T06:06:48.020 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.021 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.021 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.021 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.021 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.021 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.021 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.021 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.021 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.021 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.021 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.021 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.021 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_stats_pools_refresh_interval": { 2024-05-08T06:06:48.021 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-05-08T06:06:48.021 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.021 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.021 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.022 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "300", 2024-05-08T06:06:48.022 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.022 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.022 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.022 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.022 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.022 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.022 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.022 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.022 INFO:teuthology.orchestra.run.smithi082.stdout: "scrape_interval": { 2024-05-08T06:06:48.022 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "scrape_interval", 2024-05-08T06:06:48.022 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-05-08T06:06:48.022 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.022 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.022 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "15.0", 2024-05-08T06:06:48.022 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.023 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.023 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.023 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.023 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.023 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.023 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.023 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.023 INFO:teuthology.orchestra.run.smithi082.stdout: "server_addr": { 2024-05-08T06:06:48.023 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_addr", 2024-05-08T06:06:48.023 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.023 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.023 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.023 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "::", 2024-05-08T06:06:48.023 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.023 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.023 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.024 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-05-08T06:06:48.024 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.024 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.024 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.024 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.024 INFO:teuthology.orchestra.run.smithi082.stdout: "server_port": { 2024-05-08T06:06:48.024 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_port", 2024-05-08T06:06:48.024 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.024 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.024 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.024 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "9283", 2024-05-08T06:06:48.024 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.024 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.024 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.025 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-05-08T06:06:48.025 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.025 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.025 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.025 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.025 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.025 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.025 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.025 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.025 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.025 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.025 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.025 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.025 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.025 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.025 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.025 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.026 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.026 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.026 INFO:teuthology.orchestra.run.smithi082.stdout: "stale_cache_strategy": { 2024-05-08T06:06:48.026 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "stale_cache_strategy", 2024-05-08T06:06:48.026 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.026 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.026 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.026 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "log", 2024-05-08T06:06:48.026 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.026 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.026 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.026 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.026 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.026 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.026 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.027 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.027 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_behaviour": { 2024-05-08T06:06:48.027 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_behaviour", 2024-05-08T06:06:48.027 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.027 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.027 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.027 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "default", 2024-05-08T06:06:48.027 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.027 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.027 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.027 INFO:teuthology.orchestra.run.smithi082.stdout: "default", 2024-05-08T06:06:48.027 INFO:teuthology.orchestra.run.smithi082.stdout: "error" 2024-05-08T06:06:48.027 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.027 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.027 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.027 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.027 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.028 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.028 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_error_status_code": { 2024-05-08T06:06:48.028 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_error_status_code", 2024-05-08T06:06:48.028 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.028 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.028 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.028 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "500", 2024-05-08T06:06:48.028 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "400", 2024-05-08T06:06:48.028 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "599", 2024-05-08T06:06:48.028 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.028 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.028 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.028 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.028 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.028 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.028 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.028 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.029 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.029 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_support", 2024-05-08T06:06:48.029 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.029 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.029 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.029 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.029 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.029 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.029 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.029 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.029 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.029 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.029 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.029 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.029 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.030 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.030 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.030 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.030 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.030 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.030 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.030 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.030 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.030 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.030 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.030 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.030 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.030 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.030 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.030 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.031 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.031 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.031 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.031 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.031 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.031 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.031 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.031 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.031 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.031 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.031 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.031 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.031 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.031 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.031 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.032 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.032 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.032 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.032 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.032 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.032 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.032 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.032 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.032 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.032 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.032 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.032 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.032 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.032 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.032 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.032 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.033 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.033 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.033 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.033 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.033 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.033 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.033 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.033 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.033 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.033 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.033 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.033 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.033 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.033 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.033 INFO:teuthology.orchestra.run.smithi082.stdout: "max_concurrent_snap_create": { 2024-05-08T06:06:48.033 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_concurrent_snap_create", 2024-05-08T06:06:48.034 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.034 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.034 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.034 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-05-08T06:06:48.034 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.034 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.034 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.034 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.034 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.034 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.034 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.034 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.034 INFO:teuthology.orchestra.run.smithi082.stdout: "mirror_snapshot_schedule": { 2024-05-08T06:06:48.034 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mirror_snapshot_schedule", 2024-05-08T06:06:48.034 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.035 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.035 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.035 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.035 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.035 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.035 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.035 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.035 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.035 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.035 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.035 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.035 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.035 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.035 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.035 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.035 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.035 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.036 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.036 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.036 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.036 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.036 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.036 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.036 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.036 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.036 INFO:teuthology.orchestra.run.smithi082.stdout: "trash_purge_schedule": { 2024-05-08T06:06:48.036 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "trash_purge_schedule", 2024-05-08T06:06:48.036 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.036 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.036 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.036 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.036 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.036 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.037 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.037 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.037 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.037 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.037 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.037 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.037 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.037 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.037 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.037 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "restful", 2024-05-08T06:06:48.037 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.037 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.037 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.037 INFO:teuthology.orchestra.run.smithi082.stdout: "enable_auth": { 2024-05-08T06:06:48.037 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enable_auth", 2024-05-08T06:06:48.037 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.037 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.038 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.038 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.038 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.038 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.038 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.038 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.038 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.038 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.038 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.038 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.038 INFO:teuthology.orchestra.run.smithi082.stdout: "key_file": { 2024-05-08T06:06:48.038 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "key_file", 2024-05-08T06:06:48.038 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.038 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.038 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.039 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.039 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.039 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.039 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.039 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.039 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.039 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.039 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.039 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.039 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.039 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.039 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.039 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.039 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.039 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.039 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.039 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.040 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.040 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.040 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.040 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.040 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.040 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.040 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.040 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.040 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.040 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.040 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.040 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.040 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.040 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.040 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.040 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.040 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.041 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.041 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.041 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.041 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.041 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.041 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.041 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.041 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.041 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.041 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.041 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.041 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.041 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.041 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.041 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.041 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.042 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.042 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.042 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.042 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.042 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.042 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.042 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.042 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.042 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.042 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.042 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.042 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.042 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.042 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.042 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.042 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.043 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.043 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.043 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.043 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.043 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.043 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.043 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.043 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.043 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.043 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.043 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.043 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.043 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.043 INFO:teuthology.orchestra.run.smithi082.stdout: "server_addr": { 2024-05-08T06:06:48.043 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_addr", 2024-05-08T06:06:48.043 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.044 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.044 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.044 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.044 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.044 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.044 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.044 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.044 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.044 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.044 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.044 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.044 INFO:teuthology.orchestra.run.smithi082.stdout: "server_port": { 2024-05-08T06:06:48.044 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_port", 2024-05-08T06:06:48.044 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.044 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.044 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.045 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.045 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.045 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.045 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.045 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.045 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.045 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.045 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.045 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.045 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.045 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.045 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.045 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.045 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.045 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.045 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.046 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.046 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.046 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.046 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.046 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.046 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.046 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.046 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.046 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.046 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.046 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rgw", 2024-05-08T06:06:48.046 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.046 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.046 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.047 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.047 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.047 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.047 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.047 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.047 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.047 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.047 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.047 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.047 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.047 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.047 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.047 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.047 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.047 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.047 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.047 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.048 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.048 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.048 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.048 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.048 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.048 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.048 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.048 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.048 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.048 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.048 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.048 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.048 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.048 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.048 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.048 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.048 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.049 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.049 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.049 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.049 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.049 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.049 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.049 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.049 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.049 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.049 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.049 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.049 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.049 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.049 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.049 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.050 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.050 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.050 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.050 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.050 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.050 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.050 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.050 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.050 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.050 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.050 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.050 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.050 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.050 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.050 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.050 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.050 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.051 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.051 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.051 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.051 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.051 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.051 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.051 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.051 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.051 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.051 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.051 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.051 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.051 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.051 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.051 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.051 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.051 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.052 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.052 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.052 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.052 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.052 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rook", 2024-05-08T06:06:48.052 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.052 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.052 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.052 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.052 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.052 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.052 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.052 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.052 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.052 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.053 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.053 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.053 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.053 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.053 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.053 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.053 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.053 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.053 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.053 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.053 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.053 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.053 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.053 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.053 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.053 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.054 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.054 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.054 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.054 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.054 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.054 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.054 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.054 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.054 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.054 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.054 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.054 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.054 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.054 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.054 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.054 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.055 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.055 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.055 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.055 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.055 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.055 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.055 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.055 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.055 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.055 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.055 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.055 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.055 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.055 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.055 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.055 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.056 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.056 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.056 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.056 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.056 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.056 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.056 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.056 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.056 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.056 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.056 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.056 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.056 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.056 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.056 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.056 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.056 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.057 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.057 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.057 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.057 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.057 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.057 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.057 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.057 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.057 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.057 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.057 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.057 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.057 INFO:teuthology.orchestra.run.smithi082.stdout: "storage_class": { 2024-05-08T06:06:48.057 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "storage_class", 2024-05-08T06:06:48.057 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.057 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.058 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.058 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "local", 2024-05-08T06:06:48.058 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.058 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.058 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.058 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-05-08T06:06:48.058 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.058 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.058 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.058 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.058 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.058 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.058 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.058 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "selftest", 2024-05-08T06:06:48.058 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.058 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.059 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.059 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.059 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.059 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.059 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.059 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.059 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.059 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.059 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.059 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.059 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.059 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.059 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.059 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.059 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.059 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.060 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.060 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.060 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.060 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.060 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.060 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.060 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.060 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.060 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.060 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.060 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.060 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.060 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.060 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.060 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.060 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.060 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.061 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.061 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.061 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.061 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.061 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.061 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.061 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.061 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.061 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.061 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.061 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.061 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.061 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.061 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.061 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.061 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.061 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.062 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.062 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.062 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.062 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.062 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.062 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.062 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.062 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.062 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.062 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.062 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.062 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.062 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.062 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.062 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.063 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.063 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.063 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.063 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.063 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.063 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.063 INFO:teuthology.orchestra.run.smithi082.stdout: "roption1": { 2024-05-08T06:06:48.063 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "roption1", 2024-05-08T06:06:48.063 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.063 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.063 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.063 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.063 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.063 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.063 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.063 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.063 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.064 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.064 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.064 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.066 INFO:teuthology.orchestra.run.smithi082.stdout: "roption2": { 2024-05-08T06:06:48.066 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "roption2", 2024-05-08T06:06:48.066 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.066 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.066 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.066 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "xyz", 2024-05-08T06:06:48.066 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.066 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.066 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.066 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.066 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.067 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.067 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.067 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.067 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption1": { 2024-05-08T06:06:48.067 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption1", 2024-05-08T06:06:48.067 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.067 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.067 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.067 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.067 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.067 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.067 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.067 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.067 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.067 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.068 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.068 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.068 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption2": { 2024-05-08T06:06:48.068 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption2", 2024-05-08T06:06:48.068 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.068 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.068 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.068 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.068 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.068 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.068 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.068 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.068 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.068 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.068 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.068 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.069 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption3": { 2024-05-08T06:06:48.069 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption3", 2024-05-08T06:06:48.069 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-05-08T06:06:48.069 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.069 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.069 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.069 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.069 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.069 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.069 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.069 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.069 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.069 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.069 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.069 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption4": { 2024-05-08T06:06:48.069 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption4", 2024-05-08T06:06:48.069 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.070 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.070 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.070 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.070 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.070 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.070 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.070 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.070 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.070 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.070 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.070 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.070 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption5": { 2024-05-08T06:06:48.070 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption5", 2024-05-08T06:06:48.070 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.070 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.071 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.071 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.071 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.071 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.071 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.071 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.071 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.071 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.071 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.071 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.071 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption6": { 2024-05-08T06:06:48.071 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption6", 2024-05-08T06:06:48.071 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.071 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.071 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.071 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.072 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.072 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.072 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.072 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.072 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.072 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.072 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.072 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.072 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption7": { 2024-05-08T06:06:48.072 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption7", 2024-05-08T06:06:48.072 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.072 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.072 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.072 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.072 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-05-08T06:06:48.072 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "42", 2024-05-08T06:06:48.073 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.073 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.073 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.073 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.073 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.073 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.073 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.073 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.073 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.073 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.073 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.073 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.073 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.073 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.073 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.073 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.073 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.074 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.074 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.074 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.074 INFO:teuthology.orchestra.run.smithi082.stdout: "testkey": { 2024-05-08T06:06:48.074 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "testkey", 2024-05-08T06:06:48.074 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.074 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.074 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.074 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.074 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.074 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.074 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.074 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.074 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.074 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.074 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.075 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.075 INFO:teuthology.orchestra.run.smithi082.stdout: "testlkey": { 2024-05-08T06:06:48.075 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "testlkey", 2024-05-08T06:06:48.075 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.075 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.075 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.075 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.075 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.075 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.075 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.075 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.075 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.075 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.075 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.075 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.075 INFO:teuthology.orchestra.run.smithi082.stdout: "testnewline": { 2024-05-08T06:06:48.075 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "testnewline", 2024-05-08T06:06:48.076 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.076 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.076 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.076 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.076 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.076 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.076 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.076 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.076 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.076 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.076 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.076 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.076 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.076 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.076 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.076 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smb", 2024-05-08T06:06:48.076 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.077 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.077 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.077 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.077 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.077 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.077 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.077 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.077 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.077 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.077 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.077 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.077 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.077 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.077 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.077 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.077 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.078 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.078 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.078 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.078 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.078 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.078 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.078 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.078 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.078 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.078 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.078 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.078 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.078 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.078 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.078 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.078 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.078 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.079 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.079 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.079 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.079 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.079 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.079 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.079 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.079 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.079 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.079 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.079 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.079 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.079 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.079 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.079 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.080 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.080 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.080 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.080 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.080 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.080 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.080 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.080 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.080 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.080 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.080 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.080 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.080 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.080 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.080 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.080 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.081 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.081 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.081 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.081 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.081 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.081 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.081 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.081 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.081 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.081 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.081 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.081 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.081 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.081 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.081 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.082 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.082 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.082 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.082 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.082 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.082 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.082 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.082 INFO:teuthology.orchestra.run.smithi082.stdout: "update_orchestration": { 2024-05-08T06:06:48.082 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "update_orchestration", 2024-05-08T06:06:48.082 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.082 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.082 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.082 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.082 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.082 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.082 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.083 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-05-08T06:06:48.083 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.083 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.083 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.083 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.083 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.083 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.083 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.083 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "snap_schedule", 2024-05-08T06:06:48.083 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.083 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.083 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.083 INFO:teuthology.orchestra.run.smithi082.stdout: "allow_m_granularity": { 2024-05-08T06:06:48.083 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "allow_m_granularity", 2024-05-08T06:06:48.083 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.083 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.084 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.084 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.084 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.084 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.084 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.084 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "allow minute scheduled snapshots", 2024-05-08T06:06:48.084 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.084 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.084 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.084 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.084 INFO:teuthology.orchestra.run.smithi082.stdout: "dump_on_update": { 2024-05-08T06:06:48.084 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "dump_on_update", 2024-05-08T06:06:48.084 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.084 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.084 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.084 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.085 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.085 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.085 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.085 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "dump database to debug log on update", 2024-05-08T06:06:48.085 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.085 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.085 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.085 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.085 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.085 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.085 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.085 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.085 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.085 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.085 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.085 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.085 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.086 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.086 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.086 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.086 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.086 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.086 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.086 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.086 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.086 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.086 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.086 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.086 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.086 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.086 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.086 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.087 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.087 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.087 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.087 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.087 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.087 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.087 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.087 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.087 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.087 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.087 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.087 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.087 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.087 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.087 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.087 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.088 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.088 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.088 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.088 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.088 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.088 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.088 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.088 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.088 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.088 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.088 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.088 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.088 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.088 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.088 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.089 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.089 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.089 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.089 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.089 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.089 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.089 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.089 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.089 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.089 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.089 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.089 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.089 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.089 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.089 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.090 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.090 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.090 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.090 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.090 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.090 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.090 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.090 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.090 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.090 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.090 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.090 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.090 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.090 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.090 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.091 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.091 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.091 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "stats", 2024-05-08T06:06:48.091 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.091 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.091 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.091 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.091 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.091 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.091 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.091 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.091 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.091 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.091 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.091 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.092 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.092 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.092 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.092 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.092 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.092 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.092 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.092 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.092 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.092 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.092 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.092 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.092 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.092 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.092 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.093 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.093 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.093 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.093 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.093 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.093 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.093 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.093 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.093 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.093 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.093 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.093 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.093 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.093 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.093 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.094 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.094 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.094 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.094 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.094 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.094 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.094 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.094 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.094 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.094 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.094 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.094 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.094 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.094 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.095 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.095 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.095 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.095 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.095 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.095 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.095 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.095 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.095 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.095 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.095 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.095 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.095 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.095 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.096 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.096 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.096 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.096 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.096 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.096 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.096 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.096 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.096 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.096 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.096 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.096 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.096 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.096 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.096 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.097 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.097 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.097 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.097 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.097 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.097 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "status", 2024-05-08T06:06:48.097 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.097 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.097 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.097 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.097 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.097 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.097 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.097 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.097 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.098 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.098 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.098 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.098 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.098 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.098 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.098 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.098 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.098 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.098 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.098 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.098 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.098 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.098 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.099 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.099 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.099 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.099 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.099 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.099 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.099 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.099 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.099 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.099 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.099 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.099 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.099 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.099 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.099 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.100 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.100 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.100 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.100 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.100 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.100 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.100 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.100 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.100 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.100 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.100 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.100 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.100 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.100 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.100 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.100 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.101 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.101 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.101 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.101 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.101 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.101 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.101 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.101 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.101 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.101 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.101 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.101 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.101 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.101 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.101 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.102 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.102 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.102 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.102 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.102 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.102 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.102 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.102 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.102 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.102 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.102 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.102 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.102 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.102 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.103 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.103 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.103 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.103 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.103 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.103 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.103 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.103 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "telegraf", 2024-05-08T06:06:48.103 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.103 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.103 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.103 INFO:teuthology.orchestra.run.smithi082.stdout: "address": { 2024-05-08T06:06:48.103 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "address", 2024-05-08T06:06:48.103 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.103 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.103 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.103 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-05-08T06:06:48.104 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.104 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.104 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.104 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.104 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.104 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.104 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.104 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.104 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-05-08T06:06:48.104 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-05-08T06:06:48.104 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:48.104 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.104 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.104 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "15", 2024-05-08T06:06:48.104 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.104 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.105 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.105 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.105 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.105 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.105 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.105 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.105 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.105 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.105 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.105 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.105 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.105 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.105 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.105 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.106 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.106 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.106 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.106 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.106 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.106 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.106 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.106 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.106 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.106 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.106 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.106 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.106 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.106 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.106 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.107 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.107 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.107 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.107 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.107 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.107 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.107 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.107 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.107 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.107 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.107 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.107 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.107 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.107 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.107 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.107 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.107 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.108 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.108 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.108 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.108 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.108 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.108 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.108 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.108 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.108 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.108 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.108 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.108 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.108 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.108 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.108 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.108 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.109 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.109 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.109 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.109 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.109 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.109 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.109 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.109 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.109 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.109 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.109 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.109 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.109 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.109 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.109 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.109 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.109 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.110 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.110 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.110 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.110 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.110 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.110 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.110 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.110 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.110 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.110 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.110 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.110 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.110 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.110 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.110 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "telemetry", 2024-05-08T06:06:48.111 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.111 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.111 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.111 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_basic": { 2024-05-08T06:06:48.111 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_basic", 2024-05-08T06:06:48.111 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.111 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.111 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.111 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.111 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.111 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.111 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.111 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share basic cluster information (size, version)", 2024-05-08T06:06:48.111 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.111 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.111 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.112 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.112 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_crash": { 2024-05-08T06:06:48.112 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_crash", 2024-05-08T06:06:48.112 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.112 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.112 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.112 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.112 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.112 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.112 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.112 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-05-08T06:06:48.112 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.112 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.112 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.112 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.112 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_device": { 2024-05-08T06:06:48.112 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_device", 2024-05-08T06:06:48.113 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.113 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.113 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.113 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.113 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.113 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.113 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.113 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-05-08T06:06:48.113 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.113 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.113 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.113 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.113 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_ident": { 2024-05-08T06:06:48.113 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_ident", 2024-05-08T06:06:48.113 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.114 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.114 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.114 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.114 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.114 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.114 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.114 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-05-08T06:06:48.114 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.114 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.114 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.114 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.114 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_perf": { 2024-05-08T06:06:48.114 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_perf", 2024-05-08T06:06:48.114 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.114 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.114 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.115 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.115 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.115 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.115 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.115 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share various performance metrics of a cluster", 2024-05-08T06:06:48.115 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.115 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.115 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.115 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.115 INFO:teuthology.orchestra.run.smithi082.stdout: "contact": { 2024-05-08T06:06:48.115 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "contact", 2024-05-08T06:06:48.115 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.115 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.115 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.115 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.116 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.116 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.116 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.116 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.116 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.116 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.116 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.116 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.116 INFO:teuthology.orchestra.run.smithi082.stdout: "description": { 2024-05-08T06:06:48.116 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "description", 2024-05-08T06:06:48.116 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.116 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.116 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.116 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.116 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.116 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.117 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.117 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.117 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.117 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.117 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.117 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.117 INFO:teuthology.orchestra.run.smithi082.stdout: "device_url": { 2024-05-08T06:06:48.117 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "device_url", 2024-05-08T06:06:48.117 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.117 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.117 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.117 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-05-08T06:06:48.117 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.117 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.117 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.117 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.117 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.118 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.118 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.118 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.118 INFO:teuthology.orchestra.run.smithi082.stdout: "enabled": { 2024-05-08T06:06:48.118 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enabled", 2024-05-08T06:06:48.118 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.118 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.118 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.118 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.118 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.118 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.118 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.118 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.118 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.118 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.119 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.119 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.119 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-05-08T06:06:48.119 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-05-08T06:06:48.119 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.119 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.119 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.119 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "24", 2024-05-08T06:06:48.119 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "8", 2024-05-08T06:06:48.119 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.119 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.119 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.119 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.119 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.119 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.119 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.120 INFO:teuthology.orchestra.run.smithi082.stdout: "last_opt_revision": { 2024-05-08T06:06:48.120 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "last_opt_revision", 2024-05-08T06:06:48.120 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.120 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.120 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.120 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "1", 2024-05-08T06:06:48.120 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.120 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.120 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.120 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.120 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.120 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.120 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.120 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.120 INFO:teuthology.orchestra.run.smithi082.stdout: "leaderboard": { 2024-05-08T06:06:48.121 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "leaderboard", 2024-05-08T06:06:48.121 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.121 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.121 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.121 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.121 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.121 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.121 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.121 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.121 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.121 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.121 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.121 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.121 INFO:teuthology.orchestra.run.smithi082.stdout: "leaderboard_description": { 2024-05-08T06:06:48.121 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "leaderboard_description", 2024-05-08T06:06:48.121 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.122 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.122 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.122 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.122 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.122 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.122 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.122 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.122 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.122 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.122 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.122 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.122 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.122 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.122 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.123 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.123 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.123 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.123 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.123 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.123 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.123 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.123 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.123 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.123 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.123 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.123 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.123 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.123 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.123 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.123 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.124 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.124 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.124 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.124 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.124 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.124 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.124 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.124 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.124 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.124 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.124 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.124 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.124 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.124 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.124 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.125 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.125 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.125 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.125 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.125 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.125 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.125 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.125 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.125 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.125 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.125 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.125 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.125 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.125 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.125 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.126 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.126 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.126 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.126 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.126 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.126 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.126 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.126 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.126 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.126 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.126 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.126 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.126 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.126 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.126 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.126 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.127 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.127 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.127 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.127 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.127 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.127 INFO:teuthology.orchestra.run.smithi082.stdout: "organization": { 2024-05-08T06:06:48.127 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "organization", 2024-05-08T06:06:48.127 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.127 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.127 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.127 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.127 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.127 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.127 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.127 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.127 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.127 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.127 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.128 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.128 INFO:teuthology.orchestra.run.smithi082.stdout: "proxy": { 2024-05-08T06:06:48.128 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "proxy", 2024-05-08T06:06:48.128 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.128 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.128 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.128 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.128 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.128 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.128 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.128 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.128 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.128 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.128 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.128 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.128 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.128 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.129 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.129 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.129 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.129 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.129 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.129 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.129 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.129 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.129 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.129 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.129 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.129 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.129 INFO:teuthology.orchestra.run.smithi082.stdout: "url": { 2024-05-08T06:06:48.129 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "url", 2024-05-08T06:06:48.129 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.130 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.130 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.130 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-05-08T06:06:48.130 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.130 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.130 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.130 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.130 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.130 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.130 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.130 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.130 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.130 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.130 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.130 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "test_orchestrator", 2024-05-08T06:06:48.131 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.131 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.131 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.131 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.131 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.131 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.131 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.131 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.131 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.131 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.131 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.131 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.131 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.131 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.131 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.132 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.132 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.132 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.132 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.132 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.132 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.132 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.132 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.132 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.132 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.132 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.132 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.132 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.132 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.132 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.133 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.133 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.133 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.133 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.133 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.133 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.133 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.133 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.133 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.133 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.133 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.133 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.133 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.134 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.134 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.134 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.134 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.134 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.134 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.134 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.134 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.134 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.134 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.134 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.134 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.134 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.134 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.134 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.135 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.135 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.135 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.135 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.135 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.135 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.135 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.135 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.135 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.135 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.135 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.135 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.135 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.135 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.135 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.135 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.136 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.136 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.136 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.136 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.136 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.136 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.136 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.136 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.136 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.136 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.136 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.136 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.136 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.136 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.136 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.136 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.136 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "volumes", 2024-05-08T06:06:48.137 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.137 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.137 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.137 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.137 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.137 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.137 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.137 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.137 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.137 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.137 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.137 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.137 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.137 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.137 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.137 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.137 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.138 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.138 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.138 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.138 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.138 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.138 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.138 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.138 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.138 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.138 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.138 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.138 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.138 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.138 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.138 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.139 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.139 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.139 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.139 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.139 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.139 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.139 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.139 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.139 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.139 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.139 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.139 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.139 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.139 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.140 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.140 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.140 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.140 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.140 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.140 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.140 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.140 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.140 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.140 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.140 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.140 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.140 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.140 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.140 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.140 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.140 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.141 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.141 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.141 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.141 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.141 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.141 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.141 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.141 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.141 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.141 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.141 INFO:teuthology.orchestra.run.smithi082.stdout: "max_concurrent_clones": { 2024-05-08T06:06:48.141 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_concurrent_clones", 2024-05-08T06:06:48.141 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.141 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.141 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.142 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "4", 2024-05-08T06:06:48.142 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.142 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.142 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.142 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Number of asynchronous cloner threads", 2024-05-08T06:06:48.142 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.142 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.142 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.142 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.142 INFO:teuthology.orchestra.run.smithi082.stdout: "periodic_async_work": { 2024-05-08T06:06:48.142 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "periodic_async_work", 2024-05-08T06:06:48.142 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.142 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.142 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.142 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.142 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.143 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.143 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.143 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Periodically check for async work", 2024-05-08T06:06:48.143 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.143 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.143 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.143 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.143 INFO:teuthology.orchestra.run.smithi082.stdout: "snapshot_clone_delay": { 2024-05-08T06:06:48.143 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "snapshot_clone_delay", 2024-05-08T06:06:48.143 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.143 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.143 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.143 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.143 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.143 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.143 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.144 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-05-08T06:06:48.144 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.144 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.144 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.144 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.144 INFO:teuthology.orchestra.run.smithi082.stdout: "snapshot_clone_no_wait": { 2024-05-08T06:06:48.144 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "snapshot_clone_no_wait", 2024-05-08T06:06:48.144 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.144 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.144 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.144 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.144 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.144 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.144 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.144 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-05-08T06:06:48.144 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.144 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.145 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.145 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.145 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.145 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.145 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.145 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.145 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.145 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.145 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.145 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.145 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.145 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.145 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.145 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.145 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.145 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.145 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.146 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.146 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.146 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix", 2024-05-08T06:06:48.146 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.146 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.146 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.146 INFO:teuthology.orchestra.run.smithi082.stdout: "discovery_interval": { 2024-05-08T06:06:48.146 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "discovery_interval", 2024-05-08T06:06:48.146 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-05-08T06:06:48.146 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.146 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.146 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "100", 2024-05-08T06:06:48.146 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.146 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.146 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.147 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.147 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.147 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.147 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.147 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.147 INFO:teuthology.orchestra.run.smithi082.stdout: "identifier": { 2024-05-08T06:06:48.147 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "identifier", 2024-05-08T06:06:48.147 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.147 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.147 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.147 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.147 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.147 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.147 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.147 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.147 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.147 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.148 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.148 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.148 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-05-08T06:06:48.148 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-05-08T06:06:48.148 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:48.148 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.148 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.148 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-05-08T06:06:48.148 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.148 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.148 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.148 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.148 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.148 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.148 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.149 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.149 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.149 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.149 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.149 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.149 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.149 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.149 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.149 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.149 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.149 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.149 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.149 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.149 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.149 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.149 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.149 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.150 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.150 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.150 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.150 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.150 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.150 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.150 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.150 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.150 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.150 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.150 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.150 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.150 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.150 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.150 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.151 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.151 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.151 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.151 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.151 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.151 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.151 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.151 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.151 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.151 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.151 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.151 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.151 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.151 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.151 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.151 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.151 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.152 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.152 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.152 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.152 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.152 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.152 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.152 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.152 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.152 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.152 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.152 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.152 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.152 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.152 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.152 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.152 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.153 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.153 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.153 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.153 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.153 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.153 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.153 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.153 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.153 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.153 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.153 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.153 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.153 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.153 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.153 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.154 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.154 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.154 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.154 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.154 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.154 INFO:teuthology.orchestra.run.smithi082.stdout: "zabbix_host": { 2024-05-08T06:06:48.154 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix_host", 2024-05-08T06:06:48.154 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.154 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.154 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.154 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.154 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.154 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.154 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.155 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.155 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.155 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.155 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.155 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.155 INFO:teuthology.orchestra.run.smithi082.stdout: "zabbix_port": { 2024-05-08T06:06:48.155 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix_port", 2024-05-08T06:06:48.155 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.155 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.155 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.155 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10051", 2024-05-08T06:06:48.155 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.155 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.155 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.155 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.155 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.156 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.156 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.156 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.156 INFO:teuthology.orchestra.run.smithi082.stdout: "zabbix_sender": { 2024-05-08T06:06:48.156 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix_sender", 2024-05-08T06:06:48.156 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.156 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.156 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.156 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-05-08T06:06:48.156 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.156 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.156 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.156 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.156 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.156 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.156 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.156 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.157 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.157 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.157 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-05-08T06:06:48.157 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.157 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.157 INFO:teuthology.orchestra.run.smithi082.stdout: "gid": 24113, 2024-05-08T06:06:48.157 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "y", 2024-05-08T06:06:48.157 INFO:teuthology.orchestra.run.smithi082.stdout: "mgr_features": 4540701547738038271, 2024-05-08T06:06:48.157 INFO:teuthology.orchestra.run.smithi082.stdout: "available_modules": [ 2024-05-08T06:06:48.157 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.157 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "alerts", 2024-05-08T06:06:48.157 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.157 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.157 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.157 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-05-08T06:06:48.158 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-05-08T06:06:48.158 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:48.158 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.158 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.158 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-05-08T06:06:48.158 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.158 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.158 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.158 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How frequently to reexamine health status", 2024-05-08T06:06:48.158 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.158 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.158 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.158 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.158 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.158 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.159 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.159 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.159 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.159 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.159 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.159 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.159 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.159 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.159 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.159 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.159 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.159 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.159 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.159 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.159 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.159 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.159 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.160 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.160 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.160 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.160 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.160 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.160 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.160 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.160 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.160 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.160 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.160 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.160 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.160 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.160 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.160 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.160 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.161 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.161 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.161 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.161 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.161 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.161 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.161 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.161 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.161 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.161 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.161 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.161 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.161 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.161 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.161 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.161 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.161 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.162 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.162 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.162 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.162 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.162 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.162 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.162 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.162 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.162 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.162 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.162 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.162 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.162 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.162 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.162 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.162 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.163 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.163 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.163 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_destination": { 2024-05-08T06:06:48.163 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_destination", 2024-05-08T06:06:48.163 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.163 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.163 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.163 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.163 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.163 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.163 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.163 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Email address to send alerts to", 2024-05-08T06:06:48.163 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.163 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.163 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.163 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.163 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_from_name": { 2024-05-08T06:06:48.163 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_from_name", 2024-05-08T06:06:48.164 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.164 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.164 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.164 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "Ceph", 2024-05-08T06:06:48.164 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.164 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.164 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.164 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Email From: name", 2024-05-08T06:06:48.164 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.164 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.164 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.164 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.164 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_host": { 2024-05-08T06:06:48.164 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_host", 2024-05-08T06:06:48.164 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.164 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.164 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.165 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.165 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.165 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.165 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.165 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SMTP server", 2024-05-08T06:06:48.165 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.165 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.165 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.165 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.165 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_password": { 2024-05-08T06:06:48.165 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_password", 2024-05-08T06:06:48.165 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.165 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.165 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.165 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.165 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.166 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.166 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.166 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Password to authenticate with", 2024-05-08T06:06:48.166 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.166 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.166 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.166 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.166 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_port": { 2024-05-08T06:06:48.166 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_port", 2024-05-08T06:06:48.166 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.166 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.166 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.166 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "465", 2024-05-08T06:06:48.166 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.167 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.167 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.167 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SMTP port", 2024-05-08T06:06:48.167 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.167 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.167 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.167 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.167 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_sender": { 2024-05-08T06:06:48.167 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_sender", 2024-05-08T06:06:48.167 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.167 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.167 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.167 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.167 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.167 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.167 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.168 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SMTP envelope sender", 2024-05-08T06:06:48.168 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.168 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.168 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.168 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.168 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_ssl": { 2024-05-08T06:06:48.168 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_ssl", 2024-05-08T06:06:48.168 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.168 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.168 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.168 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.168 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.168 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.168 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.168 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use SSL to connect to SMTP server", 2024-05-08T06:06:48.168 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.169 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.169 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.169 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.169 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_user": { 2024-05-08T06:06:48.169 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_user", 2024-05-08T06:06:48.169 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.169 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.169 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.169 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.169 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.169 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.169 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.169 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "User to authenticate as", 2024-05-08T06:06:48.169 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.169 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.170 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.170 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.170 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.170 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.170 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.170 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.170 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.170 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.170 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.170 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.170 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.170 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.170 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.170 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.170 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.170 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.171 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.171 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.171 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.171 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "balancer", 2024-05-08T06:06:48.171 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.171 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.171 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.171 INFO:teuthology.orchestra.run.smithi082.stdout: "active": { 2024-05-08T06:06:48.171 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "active", 2024-05-08T06:06:48.171 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.171 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.171 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.171 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.171 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.171 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.171 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.172 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "automatically balance PGs across cluster", 2024-05-08T06:06:48.172 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.172 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.172 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.172 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.172 INFO:teuthology.orchestra.run.smithi082.stdout: "begin_time": { 2024-05-08T06:06:48.172 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "begin_time", 2024-05-08T06:06:48.172 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.172 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.172 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.172 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0000", 2024-05-08T06:06:48.172 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.172 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.172 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.172 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "beginning time of day to automatically balance", 2024-05-08T06:06:48.172 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-08T06:06:48.172 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.173 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.173 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.173 INFO:teuthology.orchestra.run.smithi082.stdout: "begin_weekday": { 2024-05-08T06:06:48.173 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "begin_weekday", 2024-05-08T06:06:48.173 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-05-08T06:06:48.173 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.173 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.173 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.173 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "0", 2024-05-08T06:06:48.173 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "6", 2024-05-08T06:06:48.173 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.173 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-05-08T06:06:48.173 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-08T06:06:48.173 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.173 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.173 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.173 INFO:teuthology.orchestra.run.smithi082.stdout: "crush_compat_max_iterations": { 2024-05-08T06:06:48.174 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crush_compat_max_iterations", 2024-05-08T06:06:48.174 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-05-08T06:06:48.174 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.174 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.174 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "25", 2024-05-08T06:06:48.174 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-05-08T06:06:48.174 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "250", 2024-05-08T06:06:48.174 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.174 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-05-08T06:06:48.174 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.174 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.174 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.174 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.174 INFO:teuthology.orchestra.run.smithi082.stdout: "crush_compat_metrics": { 2024-05-08T06:06:48.174 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crush_compat_metrics", 2024-05-08T06:06:48.174 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.175 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.175 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.175 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "pgs,objects,bytes", 2024-05-08T06:06:48.175 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.175 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.175 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.175 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-05-08T06:06:48.175 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-05-08T06:06:48.175 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.175 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.175 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.175 INFO:teuthology.orchestra.run.smithi082.stdout: "crush_compat_step": { 2024-05-08T06:06:48.175 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crush_compat_step", 2024-05-08T06:06:48.175 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-05-08T06:06:48.175 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.176 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.176 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0.5", 2024-05-08T06:06:48.176 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "0.001", 2024-05-08T06:06:48.176 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "0.999", 2024-05-08T06:06:48.176 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.176 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "aggressiveness of optimization", 2024-05-08T06:06:48.176 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-05-08T06:06:48.176 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.176 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.176 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.176 INFO:teuthology.orchestra.run.smithi082.stdout: "end_time": { 2024-05-08T06:06:48.176 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "end_time", 2024-05-08T06:06:48.176 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.176 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.176 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.176 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "2359", 2024-05-08T06:06:48.177 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.177 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.177 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.177 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "ending time of day to automatically balance", 2024-05-08T06:06:48.177 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-08T06:06:48.177 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.177 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.177 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.177 INFO:teuthology.orchestra.run.smithi082.stdout: "end_weekday": { 2024-05-08T06:06:48.177 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "end_weekday", 2024-05-08T06:06:48.177 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-05-08T06:06:48.177 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.177 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.177 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.177 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "0", 2024-05-08T06:06:48.177 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "6", 2024-05-08T06:06:48.177 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.178 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-05-08T06:06:48.178 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-08T06:06:48.178 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.178 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.178 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.178 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.178 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.178 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.178 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.178 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.178 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.178 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.178 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.178 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.178 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.178 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.179 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.179 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.179 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.179 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.179 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.179 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.179 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.179 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.179 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.179 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.179 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.179 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.179 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.179 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.179 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.179 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.179 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.180 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.180 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.180 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.180 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.180 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.180 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.180 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.180 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.180 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.180 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.180 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.180 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.180 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.180 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.180 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.180 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.180 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.181 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.181 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.181 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.181 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.181 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.181 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.181 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.181 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.181 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.181 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.181 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.181 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.181 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.181 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.181 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.181 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.182 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.182 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.182 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.182 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.182 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.182 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.182 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.182 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.182 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.182 INFO:teuthology.orchestra.run.smithi082.stdout: "min_score": { 2024-05-08T06:06:48.182 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "min_score", 2024-05-08T06:06:48.182 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-05-08T06:06:48.182 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.182 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.182 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.182 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.183 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.183 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.183 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-05-08T06:06:48.183 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.183 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.183 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.183 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.183 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": { 2024-05-08T06:06:48.183 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mode", 2024-05-08T06:06:48.183 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.183 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.183 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.183 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "upmap", 2024-05-08T06:06:48.183 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.183 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.183 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.183 INFO:teuthology.orchestra.run.smithi082.stdout: "crush-compat", 2024-05-08T06:06:48.183 INFO:teuthology.orchestra.run.smithi082.stdout: "none", 2024-05-08T06:06:48.184 INFO:teuthology.orchestra.run.smithi082.stdout: "read", 2024-05-08T06:06:48.184 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap", 2024-05-08T06:06:48.184 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap-read" 2024-05-08T06:06:48.184 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.184 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Balancer mode", 2024-05-08T06:06:48.184 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.184 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.184 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.184 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.184 INFO:teuthology.orchestra.run.smithi082.stdout: "pool_ids": { 2024-05-08T06:06:48.184 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pool_ids", 2024-05-08T06:06:48.184 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.184 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.184 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.184 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.184 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.184 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.185 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.185 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-05-08T06:06:48.185 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.185 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.185 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.185 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.185 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-05-08T06:06:48.185 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-05-08T06:06:48.185 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:48.185 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.185 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.185 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-05-08T06:06:48.185 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.185 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.185 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.185 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-05-08T06:06:48.186 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.186 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.186 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.186 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.186 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.186 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.186 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.186 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.186 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.186 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.186 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.186 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.186 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.186 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.186 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.187 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.187 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.187 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.187 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap_max_deviation": { 2024-05-08T06:06:48.187 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "upmap_max_deviation", 2024-05-08T06:06:48.187 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.187 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.187 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.187 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-05-08T06:06:48.187 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-05-08T06:06:48.187 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.187 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.187 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "deviation below which no optimization is attempted", 2024-05-08T06:06:48.187 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-05-08T06:06:48.187 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.187 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.187 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.188 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap_max_optimizations": { 2024-05-08T06:06:48.188 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "upmap_max_optimizations", 2024-05-08T06:06:48.188 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-05-08T06:06:48.188 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.188 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.188 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-05-08T06:06:48.188 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.188 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.188 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.188 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-05-08T06:06:48.188 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.188 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.188 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.188 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.189 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.189 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.189 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.189 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cephadm", 2024-05-08T06:06:48.189 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.189 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.189 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.189 INFO:teuthology.orchestra.run.smithi082.stdout: "agent_down_multiplier": { 2024-05-08T06:06:48.189 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "agent_down_multiplier", 2024-05-08T06:06:48.189 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-05-08T06:06:48.189 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.189 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.189 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "3.0", 2024-05-08T06:06:48.189 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.189 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.190 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.190 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-05-08T06:06:48.190 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.190 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.190 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.190 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.190 INFO:teuthology.orchestra.run.smithi082.stdout: "agent_refresh_rate": { 2024-05-08T06:06:48.190 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "agent_refresh_rate", 2024-05-08T06:06:48.190 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:48.190 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.190 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.190 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "20", 2024-05-08T06:06:48.190 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.191 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.191 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.191 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-05-08T06:06:48.191 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.191 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.191 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.191 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.191 INFO:teuthology.orchestra.run.smithi082.stdout: "agent_starting_port": { 2024-05-08T06:06:48.191 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "agent_starting_port", 2024-05-08T06:06:48.191 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.191 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.191 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.191 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "4721", 2024-05-08T06:06:48.191 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.191 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.192 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.192 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-05-08T06:06:48.192 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.192 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.192 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.192 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.192 INFO:teuthology.orchestra.run.smithi082.stdout: "allow_ptrace": { 2024-05-08T06:06:48.192 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "allow_ptrace", 2024-05-08T06:06:48.192 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.192 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.192 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.192 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.192 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.192 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.193 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.193 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-05-08T06:06:48.193 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-05-08T06:06:48.193 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.193 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.193 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.193 INFO:teuthology.orchestra.run.smithi082.stdout: "autotune_interval": { 2024-05-08T06:06:48.193 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "autotune_interval", 2024-05-08T06:06:48.193 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:48.193 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.193 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.193 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-05-08T06:06:48.193 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.193 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.193 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.194 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to autotune daemon memory", 2024-05-08T06:06:48.194 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.194 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.194 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.194 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.194 INFO:teuthology.orchestra.run.smithi082.stdout: "autotune_memory_target_ratio": { 2024-05-08T06:06:48.194 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "autotune_memory_target_ratio", 2024-05-08T06:06:48.194 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-05-08T06:06:48.194 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.194 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.194 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0.7", 2024-05-08T06:06:48.194 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.194 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.194 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.195 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-05-08T06:06:48.195 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.195 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.195 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.195 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.195 INFO:teuthology.orchestra.run.smithi082.stdout: "cephadm_log_destination": { 2024-05-08T06:06:48.195 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cephadm_log_destination", 2024-05-08T06:06:48.195 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.195 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.195 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.195 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.195 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.195 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.195 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.195 INFO:teuthology.orchestra.run.smithi082.stdout: "file", 2024-05-08T06:06:48.196 INFO:teuthology.orchestra.run.smithi082.stdout: "file,syslog", 2024-05-08T06:06:48.196 INFO:teuthology.orchestra.run.smithi082.stdout: "syslog" 2024-05-08T06:06:48.196 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.196 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-05-08T06:06:48.196 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.196 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.196 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.196 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.196 INFO:teuthology.orchestra.run.smithi082.stdout: "cgroups_split": { 2024-05-08T06:06:48.196 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cgroups_split", 2024-05-08T06:06:48.196 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.196 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.196 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.196 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.196 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.196 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.197 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.197 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-05-08T06:06:48.197 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.197 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.197 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.197 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.197 INFO:teuthology.orchestra.run.smithi082.stdout: "config_checks_enabled": { 2024-05-08T06:06:48.197 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "config_checks_enabled", 2024-05-08T06:06:48.197 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.197 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.197 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.197 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.197 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.197 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.198 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.198 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-05-08T06:06:48.198 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.198 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.198 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.198 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.198 INFO:teuthology.orchestra.run.smithi082.stdout: "config_dashboard": { 2024-05-08T06:06:48.198 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "config_dashboard", 2024-05-08T06:06:48.198 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.198 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.198 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.198 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.198 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.198 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.198 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.199 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-05-08T06:06:48.199 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.199 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.199 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.199 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.199 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_alertmanager": { 2024-05-08T06:06:48.199 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_alertmanager", 2024-05-08T06:06:48.199 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.199 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.199 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.199 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-05-08T06:06:48.199 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.199 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.199 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.200 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-05-08T06:06:48.200 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.200 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.200 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.200 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.200 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_base": { 2024-05-08T06:06:48.200 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_base", 2024-05-08T06:06:48.200 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.200 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.200 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.200 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/ceph", 2024-05-08T06:06:48.200 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.200 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.200 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.200 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Container image name, without the tag", 2024-05-08T06:06:48.201 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.201 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.201 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.201 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.201 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_elasticsearch": { 2024-05-08T06:06:48.201 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_elasticsearch", 2024-05-08T06:06:48.201 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.201 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.201 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.201 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-05-08T06:06:48.201 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.201 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.201 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.201 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "elasticsearch container image", 2024-05-08T06:06:48.201 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.201 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.202 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.202 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.202 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_grafana": { 2024-05-08T06:06:48.202 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_grafana", 2024-05-08T06:06:48.202 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.202 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.202 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.202 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-05-08T06:06:48.202 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.202 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.202 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.202 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-05-08T06:06:48.202 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.202 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.203 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.203 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.203 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_haproxy": { 2024-05-08T06:06:48.203 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_haproxy", 2024-05-08T06:06:48.203 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.203 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.203 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.203 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-05-08T06:06:48.203 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.203 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.203 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.203 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "HAproxy container image", 2024-05-08T06:06:48.203 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.203 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.203 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.203 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.204 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_jaeger_agent": { 2024-05-08T06:06:48.204 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_jaeger_agent", 2024-05-08T06:06:48.204 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.204 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.204 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.204 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-05-08T06:06:48.204 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.204 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.204 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.204 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Jaeger agent container image", 2024-05-08T06:06:48.204 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.204 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.204 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.204 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.204 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_jaeger_collector": { 2024-05-08T06:06:48.205 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_jaeger_collector", 2024-05-08T06:06:48.205 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.205 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.205 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.205 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-05-08T06:06:48.205 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.205 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.205 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.205 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Jaeger collector container image", 2024-05-08T06:06:48.205 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.205 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.205 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.205 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.205 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_jaeger_query": { 2024-05-08T06:06:48.205 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_jaeger_query", 2024-05-08T06:06:48.205 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.206 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.206 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.206 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-05-08T06:06:48.206 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.206 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.206 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.206 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Jaeger query container image", 2024-05-08T06:06:48.206 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.206 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.206 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.206 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.206 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_keepalived": { 2024-05-08T06:06:48.206 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_keepalived", 2024-05-08T06:06:48.206 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.207 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.207 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.207 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-05-08T06:06:48.207 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.207 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.207 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.207 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Keepalived container image", 2024-05-08T06:06:48.207 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.207 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.207 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.207 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.207 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_loki": { 2024-05-08T06:06:48.207 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_loki", 2024-05-08T06:06:48.207 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.207 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.207 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.207 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-05-08T06:06:48.207 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.208 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.208 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.208 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Loki container image", 2024-05-08T06:06:48.208 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.208 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.208 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.208 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.208 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_node_exporter": { 2024-05-08T06:06:48.208 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_node_exporter", 2024-05-08T06:06:48.208 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.208 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.208 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.208 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-05-08T06:06:48.208 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.209 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.209 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.209 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-05-08T06:06:48.209 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.209 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.209 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.209 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.209 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_nvmeof": { 2024-05-08T06:06:48.209 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_nvmeof", 2024-05-08T06:06:48.209 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.209 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.209 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.209 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-05-08T06:06:48.209 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.209 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.210 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.210 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Nvme-of container image", 2024-05-08T06:06:48.210 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.210 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.210 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.210 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.210 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_prometheus": { 2024-05-08T06:06:48.210 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_prometheus", 2024-05-08T06:06:48.210 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.210 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.210 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.210 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-05-08T06:06:48.210 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.210 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.211 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.211 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-05-08T06:06:48.211 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.211 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.211 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.211 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.211 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_promtail": { 2024-05-08T06:06:48.211 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_promtail", 2024-05-08T06:06:48.211 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.211 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.211 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.211 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-05-08T06:06:48.211 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.211 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.211 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.212 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Promtail container image", 2024-05-08T06:06:48.212 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.212 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.212 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.212 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.212 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_samba": { 2024-05-08T06:06:48.212 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_samba", 2024-05-08T06:06:48.212 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.212 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.212 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.212 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-05-08T06:06:48.212 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.212 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.212 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.213 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Samba/SMB container image", 2024-05-08T06:06:48.213 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.213 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.213 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.213 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.213 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_snmp_gateway": { 2024-05-08T06:06:48.213 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_snmp_gateway", 2024-05-08T06:06:48.213 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.213 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.213 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.213 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-05-08T06:06:48.213 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.213 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.213 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.213 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SNMP Gateway container image", 2024-05-08T06:06:48.213 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.214 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.214 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.214 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.214 INFO:teuthology.orchestra.run.smithi082.stdout: "container_init": { 2024-05-08T06:06:48.214 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_init", 2024-05-08T06:06:48.214 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.214 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.214 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.214 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.214 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.214 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.214 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.214 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Run podman/docker with `--init`", 2024-05-08T06:06:48.214 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.214 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.215 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.215 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.215 INFO:teuthology.orchestra.run.smithi082.stdout: "daemon_cache_timeout": { 2024-05-08T06:06:48.215 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "daemon_cache_timeout", 2024-05-08T06:06:48.215 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:48.215 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.215 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.215 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-05-08T06:06:48.215 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.215 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.215 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.215 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-05-08T06:06:48.215 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.215 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.215 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.215 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.216 INFO:teuthology.orchestra.run.smithi082.stdout: "default_cephadm_command_timeout": { 2024-05-08T06:06:48.216 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "default_cephadm_command_timeout", 2024-05-08T06:06:48.216 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.216 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.216 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.216 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "900", 2024-05-08T06:06:48.216 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.216 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.216 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.216 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-05-08T06:06:48.216 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.216 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.216 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.216 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.216 INFO:teuthology.orchestra.run.smithi082.stdout: "default_registry": { 2024-05-08T06:06:48.216 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "default_registry", 2024-05-08T06:06:48.216 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.217 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.217 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.217 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io", 2024-05-08T06:06:48.217 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.217 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.217 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.217 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-05-08T06:06:48.217 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.217 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.217 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.217 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.217 INFO:teuthology.orchestra.run.smithi082.stdout: "device_cache_timeout": { 2024-05-08T06:06:48.217 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "device_cache_timeout", 2024-05-08T06:06:48.217 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:48.217 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.217 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.217 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "1800", 2024-05-08T06:06:48.218 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.218 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.218 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.218 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "seconds to cache device inventory", 2024-05-08T06:06:48.218 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.218 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.218 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.218 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.218 INFO:teuthology.orchestra.run.smithi082.stdout: "device_enhanced_scan": { 2024-05-08T06:06:48.218 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "device_enhanced_scan", 2024-05-08T06:06:48.218 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.218 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.218 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.218 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.218 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.218 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.219 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.219 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use libstoragemgmt during device scans", 2024-05-08T06:06:48.219 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.219 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.219 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.219 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.219 INFO:teuthology.orchestra.run.smithi082.stdout: "facts_cache_timeout": { 2024-05-08T06:06:48.219 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "facts_cache_timeout", 2024-05-08T06:06:48.219 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:48.219 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.219 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.219 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-05-08T06:06:48.219 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.219 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.220 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.220 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "seconds to cache host facts data", 2024-05-08T06:06:48.220 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.220 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.220 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.220 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.220 INFO:teuthology.orchestra.run.smithi082.stdout: "grafana_dashboards_path": { 2024-05-08T06:06:48.220 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "grafana_dashboards_path", 2024-05-08T06:06:48.220 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.220 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.220 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.220 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-05-08T06:06:48.220 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.220 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.220 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.220 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-05-08T06:06:48.221 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.221 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.221 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.221 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.221 INFO:teuthology.orchestra.run.smithi082.stdout: "host_check_interval": { 2024-05-08T06:06:48.221 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "host_check_interval", 2024-05-08T06:06:48.221 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:48.221 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.221 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.221 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-05-08T06:06:48.221 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.221 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.221 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.221 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to perform a host check", 2024-05-08T06:06:48.221 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.221 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.221 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.222 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.222 INFO:teuthology.orchestra.run.smithi082.stdout: "hw_monitoring": { 2024-05-08T06:06:48.222 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "hw_monitoring", 2024-05-08T06:06:48.222 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.222 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.222 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.222 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.222 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.222 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.222 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.222 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-05-08T06:06:48.222 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.222 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.222 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.223 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.223 INFO:teuthology.orchestra.run.smithi082.stdout: "inventory_list_all": { 2024-05-08T06:06:48.223 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "inventory_list_all", 2024-05-08T06:06:48.223 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.223 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.223 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.223 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.223 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.223 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.223 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.223 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-05-08T06:06:48.223 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.223 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.223 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.223 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.223 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.224 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.224 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.224 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.224 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.224 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.224 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.224 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.224 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.224 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.224 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.224 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.224 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.224 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.224 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.224 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.225 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.225 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.225 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.225 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.225 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.225 INFO:teuthology.orchestra.run.smithi082.stdout: "log_refresh_metadata": { 2024-05-08T06:06:48.225 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_refresh_metadata", 2024-05-08T06:06:48.225 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.225 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.225 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.225 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.225 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.225 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.225 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.225 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-05-08T06:06:48.226 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.226 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.226 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.226 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.226 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.226 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.226 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.226 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.226 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.226 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.226 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.226 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.226 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.226 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-05-08T06:06:48.226 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.227 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.227 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.227 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.227 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.227 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.227 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.227 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.227 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.227 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.227 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.227 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.227 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.227 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.227 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.227 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.228 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.228 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.228 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.228 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.228 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.228 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.228 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.228 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.228 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.228 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.228 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.228 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.228 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.228 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.228 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.228 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.229 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.229 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.229 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.229 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.229 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.229 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.229 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.229 INFO:teuthology.orchestra.run.smithi082.stdout: "manage_etc_ceph_ceph_conf": { 2024-05-08T06:06:48.229 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-05-08T06:06:48.229 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.229 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.229 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.229 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.229 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.229 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.229 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.230 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-05-08T06:06:48.230 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.230 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.230 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.230 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.230 INFO:teuthology.orchestra.run.smithi082.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-05-08T06:06:48.230 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-05-08T06:06:48.230 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.230 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.230 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.230 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "*", 2024-05-08T06:06:48.230 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.230 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.230 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.230 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-05-08T06:06:48.231 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.231 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.231 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.231 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.231 INFO:teuthology.orchestra.run.smithi082.stdout: "max_count_per_host": { 2024-05-08T06:06:48.231 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_count_per_host", 2024-05-08T06:06:48.231 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.231 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.231 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.231 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-05-08T06:06:48.231 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.231 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.231 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.231 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "max number of daemons per service per host", 2024-05-08T06:06:48.231 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.231 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.232 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.232 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.232 INFO:teuthology.orchestra.run.smithi082.stdout: "max_osd_draining_count": { 2024-05-08T06:06:48.232 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_osd_draining_count", 2024-05-08T06:06:48.232 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.232 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.232 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.232 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-05-08T06:06:48.232 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.232 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.232 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.232 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-05-08T06:06:48.232 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.232 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.232 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.233 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.233 INFO:teuthology.orchestra.run.smithi082.stdout: "migration_current": { 2024-05-08T06:06:48.233 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "migration_current", 2024-05-08T06:06:48.233 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.233 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.233 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.233 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.233 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.233 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.233 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.233 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "internal - do not modify", 2024-05-08T06:06:48.233 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.233 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.233 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.233 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.233 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": { 2024-05-08T06:06:48.234 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mode", 2024-05-08T06:06:48.234 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.234 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.234 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.234 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "root", 2024-05-08T06:06:48.234 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.234 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.234 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.234 INFO:teuthology.orchestra.run.smithi082.stdout: "cephadm-package", 2024-05-08T06:06:48.234 INFO:teuthology.orchestra.run.smithi082.stdout: "root" 2024-05-08T06:06:48.234 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.234 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "mode for remote execution of cephadm", 2024-05-08T06:06:48.234 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.234 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.235 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.235 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.235 INFO:teuthology.orchestra.run.smithi082.stdout: "oob_default_addr": { 2024-05-08T06:06:48.235 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "oob_default_addr", 2024-05-08T06:06:48.235 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.235 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.235 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.235 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "169.254.1.1", 2024-05-08T06:06:48.235 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.235 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.235 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.235 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Default address for RedFish API (oob management).", 2024-05-08T06:06:48.235 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.235 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.235 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.235 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.235 INFO:teuthology.orchestra.run.smithi082.stdout: "prometheus_alerts_path": { 2024-05-08T06:06:48.236 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "prometheus_alerts_path", 2024-05-08T06:06:48.236 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.236 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.236 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.236 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-05-08T06:06:48.236 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.236 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.236 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.236 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-05-08T06:06:48.236 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.236 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.236 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.236 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.236 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_insecure": { 2024-05-08T06:06:48.236 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_insecure", 2024-05-08T06:06:48.236 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.237 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.237 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.237 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.237 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.237 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.237 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.237 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-05-08T06:06:48.237 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.237 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.237 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.237 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.237 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_password": { 2024-05-08T06:06:48.237 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_password", 2024-05-08T06:06:48.237 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.237 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.237 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.237 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.238 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.238 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.238 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.238 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-05-08T06:06:48.238 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.238 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.238 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.238 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.238 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_url": { 2024-05-08T06:06:48.238 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_url", 2024-05-08T06:06:48.238 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.238 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.238 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.238 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.238 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.238 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.239 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.239 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-05-08T06:06:48.239 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.239 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.239 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.239 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.239 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_username": { 2024-05-08T06:06:48.239 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_username", 2024-05-08T06:06:48.239 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.239 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.239 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.239 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.239 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.239 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.239 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.239 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-05-08T06:06:48.240 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.240 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.240 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.240 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.240 INFO:teuthology.orchestra.run.smithi082.stdout: "secure_monitoring_stack": { 2024-05-08T06:06:48.240 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "secure_monitoring_stack", 2024-05-08T06:06:48.240 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.240 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.240 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.240 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.240 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.240 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.240 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.240 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-05-08T06:06:48.240 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.241 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.241 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.241 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.241 INFO:teuthology.orchestra.run.smithi082.stdout: "service_discovery_port": { 2024-05-08T06:06:48.241 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "service_discovery_port", 2024-05-08T06:06:48.241 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.241 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.241 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.241 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8765", 2024-05-08T06:06:48.241 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.241 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.241 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.241 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "cephadm service discovery port", 2024-05-08T06:06:48.241 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.241 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.241 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.242 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.242 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.242 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.242 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.242 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.242 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.242 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.242 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.242 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.242 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.242 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.242 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.242 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.242 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.242 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.243 INFO:teuthology.orchestra.run.smithi082.stdout: "ssh_config_file": { 2024-05-08T06:06:48.243 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssh_config_file", 2024-05-08T06:06:48.243 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.243 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.243 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.243 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.243 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.243 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.243 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.243 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-05-08T06:06:48.243 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.243 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.243 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.243 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.243 INFO:teuthology.orchestra.run.smithi082.stdout: "use_agent": { 2024-05-08T06:06:48.243 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "use_agent", 2024-05-08T06:06:48.244 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.244 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.244 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.244 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.244 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.244 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.244 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.244 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-05-08T06:06:48.244 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.244 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.244 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.244 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.244 INFO:teuthology.orchestra.run.smithi082.stdout: "use_repo_digest": { 2024-05-08T06:06:48.244 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "use_repo_digest", 2024-05-08T06:06:48.244 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.244 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.244 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.245 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.245 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.245 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.245 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.245 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-05-08T06:06:48.245 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.245 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.245 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.245 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.245 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_on_failed_host_check": { 2024-05-08T06:06:48.245 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_on_failed_host_check", 2024-05-08T06:06:48.245 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.245 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.245 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.245 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.245 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.246 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.246 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.246 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise a health warning if the host check fails", 2024-05-08T06:06:48.246 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.246 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.246 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.246 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.246 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_on_stray_daemons": { 2024-05-08T06:06:48.246 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_on_stray_daemons", 2024-05-08T06:06:48.246 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.246 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.246 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.246 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.246 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.246 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.246 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.247 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-05-08T06:06:48.247 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.247 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.247 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.247 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.247 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_on_stray_hosts": { 2024-05-08T06:06:48.247 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_on_stray_hosts", 2024-05-08T06:06:48.247 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.247 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.247 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.247 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.247 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.247 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.247 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.247 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-05-08T06:06:48.247 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.248 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.248 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.248 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.248 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.248 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.248 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.248 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crash", 2024-05-08T06:06:48.248 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.248 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.248 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.248 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.248 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.248 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.248 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.248 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.248 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.249 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.249 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.249 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.249 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.249 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.249 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.249 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.249 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.249 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.249 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.249 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.249 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.249 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.249 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.249 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.249 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.250 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.250 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.250 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.250 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.250 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.250 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.250 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.250 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.250 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.250 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.250 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.250 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.250 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.250 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.250 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.251 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.251 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.251 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.251 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.251 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.251 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.251 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.251 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.251 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.251 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.251 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.251 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.251 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.251 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.251 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.251 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.251 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.251 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.252 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.252 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.252 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.252 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.252 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.252 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.252 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.252 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.252 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.252 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.252 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.252 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.252 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.252 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.252 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.252 INFO:teuthology.orchestra.run.smithi082.stdout: "retain_interval": { 2024-05-08T06:06:48.253 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "retain_interval", 2024-05-08T06:06:48.253 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:48.253 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.253 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.253 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "31536000", 2024-05-08T06:06:48.253 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.253 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.253 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.253 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how long to retain crashes before pruning them", 2024-05-08T06:06:48.253 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.253 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.253 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.253 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.253 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.253 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.253 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.253 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.254 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.254 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.254 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.254 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.254 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.254 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.254 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.254 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.254 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.254 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.254 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_recent_interval": { 2024-05-08T06:06:48.254 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_recent_interval", 2024-05-08T06:06:48.254 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:48.254 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.254 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.255 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "1209600", 2024-05-08T06:06:48.255 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.255 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.255 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.255 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "time interval in which to warn about recent crashes", 2024-05-08T06:06:48.255 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.255 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.255 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.255 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.255 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.255 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.255 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.255 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "dashboard", 2024-05-08T06:06:48.255 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.255 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.256 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.256 INFO:teuthology.orchestra.run.smithi082.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-05-08T06:06:48.256 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-05-08T06:06:48.256 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.256 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.256 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.256 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-05-08T06:06:48.256 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.256 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.256 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.256 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.256 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.256 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.256 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.256 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.256 INFO:teuthology.orchestra.run.smithi082.stdout: "ALERTMANAGER_API_HOST": { 2024-05-08T06:06:48.257 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ALERTMANAGER_API_HOST", 2024-05-08T06:06:48.257 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.257 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.257 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.257 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.257 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.257 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.257 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.257 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.257 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.257 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.257 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.257 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.257 INFO:teuthology.orchestra.run.smithi082.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-05-08T06:06:48.257 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-05-08T06:06:48.257 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.258 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.258 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.258 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.258 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.258 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.258 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.258 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.258 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.258 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.258 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.258 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.258 INFO:teuthology.orchestra.run.smithi082.stdout: "AUDIT_API_ENABLED": { 2024-05-08T06:06:48.258 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "AUDIT_API_ENABLED", 2024-05-08T06:06:48.258 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.258 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.259 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.259 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.259 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.259 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.259 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.259 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.259 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.259 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.259 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.259 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.259 INFO:teuthology.orchestra.run.smithi082.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-05-08T06:06:48.259 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-05-08T06:06:48.259 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.259 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.259 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.259 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.259 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.260 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.260 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.260 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.260 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.260 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.260 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.260 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.260 INFO:teuthology.orchestra.run.smithi082.stdout: "ENABLE_BROWSABLE_API": { 2024-05-08T06:06:48.260 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ENABLE_BROWSABLE_API", 2024-05-08T06:06:48.260 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.260 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.260 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.260 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.260 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.260 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.260 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.261 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.261 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.261 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.261 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.261 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.261 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-05-08T06:06:48.261 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-05-08T06:06:48.261 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.261 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.261 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.261 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.261 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.261 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.261 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.261 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.261 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.261 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.262 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.262 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.262 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-05-08T06:06:48.262 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-05-08T06:06:48.262 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.262 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.262 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.262 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.262 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.262 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.262 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.262 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.262 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.262 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.262 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.263 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.263 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-05-08T06:06:48.263 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-05-08T06:06:48.263 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.263 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.263 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.263 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.263 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.263 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.263 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.263 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.263 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.263 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.263 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.263 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.263 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-05-08T06:06:48.264 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-05-08T06:06:48.264 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.264 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.264 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.264 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.264 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.264 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.264 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.264 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.264 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.264 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.264 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.264 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.264 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_NFS": { 2024-05-08T06:06:48.264 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-05-08T06:06:48.264 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.265 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.265 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.265 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.265 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.265 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.265 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.265 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.265 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.265 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.265 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.265 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.265 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_RBD": { 2024-05-08T06:06:48.265 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-05-08T06:06:48.265 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.265 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.265 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.265 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.266 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.266 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.266 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.266 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.266 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.266 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.266 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.266 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.266 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_RGW": { 2024-05-08T06:06:48.266 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-05-08T06:06:48.266 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.266 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.266 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.266 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.267 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.267 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.267 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.267 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.267 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.267 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.267 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.267 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.267 INFO:teuthology.orchestra.run.smithi082.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-05-08T06:06:48.267 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-05-08T06:06:48.267 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.267 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.267 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.267 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.268 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.268 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.268 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.268 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.268 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.268 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.268 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.268 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.268 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_PASSWORD": { 2024-05-08T06:06:48.268 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_PASSWORD", 2024-05-08T06:06:48.268 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.268 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.268 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.268 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "admin", 2024-05-08T06:06:48.268 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.268 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.269 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.269 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.269 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.269 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.269 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.269 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.269 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-05-08T06:06:48.269 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-05-08T06:06:48.269 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.269 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.269 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.269 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.269 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.269 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.269 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.269 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.269 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.270 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.270 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.270 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.270 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_URL": { 2024-05-08T06:06:48.270 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_URL", 2024-05-08T06:06:48.270 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.270 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.270 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.270 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.270 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.270 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.270 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.270 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.270 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.270 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.271 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.271 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.271 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_USERNAME": { 2024-05-08T06:06:48.271 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_USERNAME", 2024-05-08T06:06:48.271 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.271 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.271 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.271 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "admin", 2024-05-08T06:06:48.271 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.271 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.271 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.271 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.271 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.271 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.271 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.271 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.271 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-05-08T06:06:48.272 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-05-08T06:06:48.272 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.272 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.272 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.272 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.272 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.272 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.272 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.272 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.272 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.272 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.272 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.272 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.272 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-05-08T06:06:48.272 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-05-08T06:06:48.272 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.273 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.273 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.273 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.273 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.273 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.273 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.273 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.273 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.273 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.273 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.273 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.273 INFO:teuthology.orchestra.run.smithi082.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-05-08T06:06:48.273 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-05-08T06:06:48.273 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.273 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.273 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.274 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.274 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.274 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.274 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.274 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.274 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.274 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.274 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.274 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.274 INFO:teuthology.orchestra.run.smithi082.stdout: "ISSUE_TRACKER_API_KEY": { 2024-05-08T06:06:48.274 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-05-08T06:06:48.274 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.274 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.274 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.274 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.274 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.275 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.275 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.275 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.275 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.275 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.275 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.275 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.275 INFO:teuthology.orchestra.run.smithi082.stdout: "MANAGED_BY_CLUSTERS": { 2024-05-08T06:06:48.275 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-05-08T06:06:48.275 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.275 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.275 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.275 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "[]", 2024-05-08T06:06:48.275 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.275 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.275 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.275 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.276 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.276 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.276 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.276 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.276 INFO:teuthology.orchestra.run.smithi082.stdout: "MULTICLUSTER_CONFIG": { 2024-05-08T06:06:48.276 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "MULTICLUSTER_CONFIG", 2024-05-08T06:06:48.276 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.276 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.276 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.276 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "{}", 2024-05-08T06:06:48.276 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.276 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.276 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.276 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.276 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.276 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.277 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.277 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.277 INFO:teuthology.orchestra.run.smithi082.stdout: "PROMETHEUS_API_HOST": { 2024-05-08T06:06:48.277 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PROMETHEUS_API_HOST", 2024-05-08T06:06:48.277 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.277 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.277 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.277 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.277 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.277 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.277 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.277 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.277 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.277 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.277 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.277 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.278 INFO:teuthology.orchestra.run.smithi082.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-05-08T06:06:48.278 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-05-08T06:06:48.278 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.278 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.278 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.278 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.278 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.278 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.278 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.278 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.278 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.278 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.278 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.278 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.278 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-05-08T06:06:48.279 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-05-08T06:06:48.279 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.279 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.279 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.279 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.279 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.279 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.279 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.279 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.279 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.279 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.279 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.279 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.279 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-05-08T06:06:48.279 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-05-08T06:06:48.280 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.280 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.280 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.280 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.280 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.280 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.280 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.280 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.280 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.280 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.280 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.280 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.280 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-05-08T06:06:48.280 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-05-08T06:06:48.280 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.281 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.281 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.281 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.281 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.281 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.281 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.281 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.281 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.281 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.281 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.281 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.281 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-05-08T06:06:48.281 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-05-08T06:06:48.281 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.281 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.281 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.282 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.282 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.282 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.282 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.282 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.282 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.282 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.282 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.282 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.282 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-05-08T06:06:48.282 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-05-08T06:06:48.282 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.282 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.282 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.283 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.283 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.283 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.283 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.283 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.283 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.283 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.283 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.283 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.283 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-05-08T06:06:48.283 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-05-08T06:06:48.283 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.283 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.283 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.283 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.283 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.284 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.284 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.284 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.284 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.284 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.284 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.284 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.284 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-05-08T06:06:48.284 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-05-08T06:06:48.284 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.284 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.284 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.284 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.284 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.284 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.284 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.284 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.285 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.285 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.285 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.285 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.285 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_ENABLED": { 2024-05-08T06:06:48.285 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_ENABLED", 2024-05-08T06:06:48.285 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.285 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.285 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.285 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.285 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.285 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.285 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.285 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.285 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.285 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.285 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.286 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.286 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-05-08T06:06:48.286 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-05-08T06:06:48.286 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.286 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.286 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.286 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-05-08T06:06:48.286 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.286 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.286 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.286 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.286 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.286 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.286 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.287 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.287 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-05-08T06:06:48.287 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-05-08T06:06:48.287 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.287 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.287 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.287 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-05-08T06:06:48.287 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.287 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.287 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.287 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.287 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.287 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.287 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.287 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.288 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-05-08T06:06:48.288 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-05-08T06:06:48.288 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.288 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.288 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.288 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8", 2024-05-08T06:06:48.288 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.288 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.288 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.288 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.288 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.288 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.288 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.288 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.288 INFO:teuthology.orchestra.run.smithi082.stdout: "REST_REQUESTS_TIMEOUT": { 2024-05-08T06:06:48.289 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-05-08T06:06:48.289 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.289 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.289 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.289 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "45", 2024-05-08T06:06:48.289 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.289 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.289 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.289 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.289 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.289 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.289 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.289 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.289 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_ACCESS_KEY": { 2024-05-08T06:06:48.289 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_ACCESS_KEY", 2024-05-08T06:06:48.290 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.290 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.290 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.290 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.290 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.290 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.290 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.290 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.290 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.290 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.290 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.290 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.290 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-05-08T06:06:48.290 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-05-08T06:06:48.291 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.291 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.291 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.291 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "admin", 2024-05-08T06:06:48.291 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.291 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.291 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.291 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.291 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.291 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.291 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.291 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.291 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_SECRET_KEY": { 2024-05-08T06:06:48.291 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_SECRET_KEY", 2024-05-08T06:06:48.291 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.291 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.292 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.292 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.292 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.292 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.292 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.292 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.292 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.292 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.292 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.292 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.292 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_SSL_VERIFY": { 2024-05-08T06:06:48.292 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_SSL_VERIFY", 2024-05-08T06:06:48.292 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.292 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.292 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.293 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.293 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.293 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.293 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.293 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.293 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.293 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.293 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.293 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.293 INFO:teuthology.orchestra.run.smithi082.stdout: "UNSAFE_TLS_v1_2": { 2024-05-08T06:06:48.293 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "UNSAFE_TLS_v1_2", 2024-05-08T06:06:48.293 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.293 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.293 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.293 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.293 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.293 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.294 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.294 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.294 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.294 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.294 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.294 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.294 INFO:teuthology.orchestra.run.smithi082.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-05-08T06:06:48.294 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-05-08T06:06:48.294 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.294 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.294 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.294 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.294 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.294 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.294 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.294 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.295 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.295 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.295 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.295 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.295 INFO:teuthology.orchestra.run.smithi082.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-05-08T06:06:48.295 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-05-08T06:06:48.295 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.295 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.295 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.295 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-05-08T06:06:48.295 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.295 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.295 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.295 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.295 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.295 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.295 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.296 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.296 INFO:teuthology.orchestra.run.smithi082.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-05-08T06:06:48.296 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-05-08T06:06:48.296 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.296 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.296 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.296 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-05-08T06:06:48.296 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.296 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.296 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.296 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.296 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.296 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.296 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.296 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.296 INFO:teuthology.orchestra.run.smithi082.stdout: "cross_origin_url": { 2024-05-08T06:06:48.296 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cross_origin_url", 2024-05-08T06:06:48.297 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.297 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.297 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.297 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.297 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.297 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.297 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.297 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.297 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.297 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.297 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.297 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.297 INFO:teuthology.orchestra.run.smithi082.stdout: "crt_file": { 2024-05-08T06:06:48.297 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crt_file", 2024-05-08T06:06:48.297 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.297 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.298 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.298 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.298 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.298 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.298 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.298 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.298 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.298 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.298 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.298 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.298 INFO:teuthology.orchestra.run.smithi082.stdout: "debug": { 2024-05-08T06:06:48.298 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "debug", 2024-05-08T06:06:48.298 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.298 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.298 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.298 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.299 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.299 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.299 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.299 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Enable/disable debug options", 2024-05-08T06:06:48.299 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.299 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.299 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.299 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.299 INFO:teuthology.orchestra.run.smithi082.stdout: "jwt_token_ttl": { 2024-05-08T06:06:48.299 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "jwt_token_ttl", 2024-05-08T06:06:48.299 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.299 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.299 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.299 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "28800", 2024-05-08T06:06:48.299 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.299 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.299 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.300 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.300 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.300 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.300 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.300 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.300 INFO:teuthology.orchestra.run.smithi082.stdout: "key_file": { 2024-05-08T06:06:48.300 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "key_file", 2024-05-08T06:06:48.300 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.300 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.300 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.300 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.300 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.300 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.300 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.300 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.300 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.301 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.301 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.301 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.301 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.301 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.301 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.301 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.301 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.301 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.301 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.301 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.301 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.301 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.301 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.301 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.301 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.302 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.302 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.302 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.302 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.302 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.302 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.302 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.302 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.302 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.302 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.302 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.302 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.302 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.303 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.303 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.303 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.303 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.303 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.303 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.303 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.303 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.303 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.303 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.303 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.303 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.303 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.303 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.303 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.303 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.304 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.304 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.304 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.304 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.304 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.304 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.304 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.304 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.304 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.304 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.304 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.304 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.304 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.304 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.304 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.305 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.305 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.305 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.305 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.305 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.305 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.305 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.305 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.305 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.305 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.305 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.305 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.305 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.305 INFO:teuthology.orchestra.run.smithi082.stdout: "motd": { 2024-05-08T06:06:48.305 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "motd", 2024-05-08T06:06:48.305 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.305 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.306 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.306 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.306 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.306 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.306 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.306 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "The message of the day", 2024-05-08T06:06:48.306 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.306 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.306 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.306 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.306 INFO:teuthology.orchestra.run.smithi082.stdout: "redirect_resolve_ip_addr": { 2024-05-08T06:06:48.306 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "redirect_resolve_ip_addr", 2024-05-08T06:06:48.306 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.306 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.307 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.307 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.307 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.307 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.307 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.307 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.307 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.307 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.307 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.307 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.307 INFO:teuthology.orchestra.run.smithi082.stdout: "server_addr": { 2024-05-08T06:06:48.307 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_addr", 2024-05-08T06:06:48.307 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.307 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.307 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.307 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "::", 2024-05-08T06:06:48.307 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.308 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.308 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.308 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.308 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.308 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.308 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.308 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.308 INFO:teuthology.orchestra.run.smithi082.stdout: "server_port": { 2024-05-08T06:06:48.308 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_port", 2024-05-08T06:06:48.308 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.308 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.308 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.308 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8080", 2024-05-08T06:06:48.308 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.308 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.308 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.309 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.309 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.309 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.309 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.309 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.309 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.309 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.309 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.309 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.309 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.309 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.309 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.309 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.309 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.309 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.309 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.309 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.310 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.310 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.310 INFO:teuthology.orchestra.run.smithi082.stdout: "ssl": { 2024-05-08T06:06:48.310 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssl", 2024-05-08T06:06:48.310 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.310 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.310 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.310 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.310 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.310 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.310 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.310 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.310 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.310 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.310 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.311 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.311 INFO:teuthology.orchestra.run.smithi082.stdout: "ssl_server_port": { 2024-05-08T06:06:48.311 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssl_server_port", 2024-05-08T06:06:48.311 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.311 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.311 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.311 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8443", 2024-05-08T06:06:48.311 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.311 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.311 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.311 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.311 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.311 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.311 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.311 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.311 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_behaviour": { 2024-05-08T06:06:48.312 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_behaviour", 2024-05-08T06:06:48.312 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.312 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.312 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.312 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "redirect", 2024-05-08T06:06:48.312 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.312 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.312 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.312 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.312 INFO:teuthology.orchestra.run.smithi082.stdout: "redirect" 2024-05-08T06:06:48.312 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.312 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.312 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.312 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.312 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.312 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.313 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_error_status_code": { 2024-05-08T06:06:48.313 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_error_status_code", 2024-05-08T06:06:48.313 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.313 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.313 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.313 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "500", 2024-05-08T06:06:48.313 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "400", 2024-05-08T06:06:48.313 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "599", 2024-05-08T06:06:48.313 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.313 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.313 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.313 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.313 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.313 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.313 INFO:teuthology.orchestra.run.smithi082.stdout: "url_prefix": { 2024-05-08T06:06:48.313 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "url_prefix", 2024-05-08T06:06:48.314 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.314 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.314 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.314 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.314 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.314 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.314 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.314 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.314 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.314 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.314 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.314 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.314 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.314 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.314 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.314 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "devicehealth", 2024-05-08T06:06:48.315 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.315 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.315 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.315 INFO:teuthology.orchestra.run.smithi082.stdout: "enable_monitoring": { 2024-05-08T06:06:48.315 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enable_monitoring", 2024-05-08T06:06:48.315 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.315 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.315 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.315 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.315 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.315 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.315 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.315 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "monitor device health metrics", 2024-05-08T06:06:48.315 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.315 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.316 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.316 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.316 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.316 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.316 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.316 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.316 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.316 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.316 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.316 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.316 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.316 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.316 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.316 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.316 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.316 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.316 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.317 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.317 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.317 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.317 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.317 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.317 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.317 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.317 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.317 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.317 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.317 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.317 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.317 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.317 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.317 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.317 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.318 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.318 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.318 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.318 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.318 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.318 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.318 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.318 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.318 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.318 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.318 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.318 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.318 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.319 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.319 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.319 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.319 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.319 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.319 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.319 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.319 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.319 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.319 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.319 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.319 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.319 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.319 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.319 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.319 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.319 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.320 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.320 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.320 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.320 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.320 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.320 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.320 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.320 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.320 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.320 INFO:teuthology.orchestra.run.smithi082.stdout: "mark_out_threshold": { 2024-05-08T06:06:48.320 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mark_out_threshold", 2024-05-08T06:06:48.320 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:48.320 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.320 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.320 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "2419200", 2024-05-08T06:06:48.320 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.321 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.321 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.321 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-05-08T06:06:48.321 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.321 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.321 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.321 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.321 INFO:teuthology.orchestra.run.smithi082.stdout: "pool_name": { 2024-05-08T06:06:48.321 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pool_name", 2024-05-08T06:06:48.321 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.321 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.321 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.321 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "device_health_metrics", 2024-05-08T06:06:48.321 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.321 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.321 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.322 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "name of pool in which to store device health metrics", 2024-05-08T06:06:48.322 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.322 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.322 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.322 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.322 INFO:teuthology.orchestra.run.smithi082.stdout: "retention_period": { 2024-05-08T06:06:48.322 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "retention_period", 2024-05-08T06:06:48.322 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:48.322 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.322 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.322 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "15552000", 2024-05-08T06:06:48.322 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.322 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.322 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.322 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how long to retain device health metrics", 2024-05-08T06:06:48.323 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.323 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.323 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.323 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.323 INFO:teuthology.orchestra.run.smithi082.stdout: "scrape_frequency": { 2024-05-08T06:06:48.323 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "scrape_frequency", 2024-05-08T06:06:48.323 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:48.323 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.323 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.323 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "86400", 2024-05-08T06:06:48.323 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.323 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.323 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.323 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to scrape device health metrics", 2024-05-08T06:06:48.323 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.324 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.324 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.324 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.324 INFO:teuthology.orchestra.run.smithi082.stdout: "self_heal": { 2024-05-08T06:06:48.324 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "self_heal", 2024-05-08T06:06:48.324 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.324 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.324 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.324 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.324 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.324 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.324 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.324 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-05-08T06:06:48.324 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.324 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.324 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.325 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.325 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-05-08T06:06:48.325 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-05-08T06:06:48.325 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:48.325 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.325 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.325 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-05-08T06:06:48.325 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.325 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.325 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.325 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to wake up and check device health", 2024-05-08T06:06:48.325 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.325 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.325 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.326 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.326 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.326 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.326 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.326 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.326 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.326 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.326 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.326 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.327 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.327 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.327 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.327 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.327 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.327 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.327 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_threshold": { 2024-05-08T06:06:48.327 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_threshold", 2024-05-08T06:06:48.327 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:48.327 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.327 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.327 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "7257600", 2024-05-08T06:06:48.327 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.327 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.327 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.328 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-05-08T06:06:48.328 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.328 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.328 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.328 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.328 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.328 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.328 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.328 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "diskprediction_local", 2024-05-08T06:06:48.328 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.328 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.328 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.328 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.328 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.328 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.329 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.329 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.329 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.329 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.329 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.329 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.329 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.329 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.329 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.329 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.329 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.329 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.329 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.329 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.329 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.329 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.330 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.330 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.330 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.330 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.330 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.330 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.330 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.330 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.330 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.330 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.330 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.330 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.330 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.330 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.331 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.331 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.331 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.331 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.331 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.331 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.331 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.331 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.331 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.331 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.331 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.331 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.331 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.331 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.331 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.332 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.332 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.332 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.332 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.332 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.332 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.332 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.332 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.332 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.332 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.332 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.332 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.332 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.332 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.332 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.333 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.333 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.333 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.333 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.333 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.333 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.333 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.333 INFO:teuthology.orchestra.run.smithi082.stdout: "predict_interval": { 2024-05-08T06:06:48.333 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "predict_interval", 2024-05-08T06:06:48.333 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.333 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.333 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.333 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "86400", 2024-05-08T06:06:48.334 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.334 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.334 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.334 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.334 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.334 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.334 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.334 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.334 INFO:teuthology.orchestra.run.smithi082.stdout: "predictor_model": { 2024-05-08T06:06:48.334 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "predictor_model", 2024-05-08T06:06:48.334 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.334 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.334 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.334 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "prophetstor", 2024-05-08T06:06:48.335 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.335 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.335 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.335 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.335 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.335 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.335 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.335 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.335 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-05-08T06:06:48.335 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-05-08T06:06:48.335 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.335 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.335 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.335 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-05-08T06:06:48.336 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.336 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.336 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.336 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.336 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.336 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.336 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.336 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.336 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.336 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.336 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.336 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.336 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.336 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.336 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.336 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.337 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.337 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.337 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.337 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.337 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.337 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.337 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.337 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.337 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.337 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "influx", 2024-05-08T06:06:48.337 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": false, 2024-05-08T06:06:48.337 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "influxdb python module not found", 2024-05-08T06:06:48.337 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.337 INFO:teuthology.orchestra.run.smithi082.stdout: "batch_size": { 2024-05-08T06:06:48.337 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "batch_size", 2024-05-08T06:06:48.337 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.337 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.338 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.338 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5000", 2024-05-08T06:06:48.338 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.338 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.338 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.338 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-05-08T06:06:48.338 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.338 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.338 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.338 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.338 INFO:teuthology.orchestra.run.smithi082.stdout: "database": { 2024-05-08T06:06:48.338 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "database", 2024-05-08T06:06:48.338 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.338 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.338 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.338 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "ceph", 2024-05-08T06:06:48.339 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.339 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.339 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.339 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-05-08T06:06:48.339 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.339 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.339 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.339 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.339 INFO:teuthology.orchestra.run.smithi082.stdout: "hostname": { 2024-05-08T06:06:48.339 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "hostname", 2024-05-08T06:06:48.339 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.339 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.339 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.339 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.339 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.339 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.340 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.340 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "InfluxDB server hostname", 2024-05-08T06:06:48.340 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.340 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.340 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.340 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.340 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-05-08T06:06:48.340 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-05-08T06:06:48.340 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:48.340 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.340 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.340 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "30", 2024-05-08T06:06:48.340 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "5", 2024-05-08T06:06:48.340 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.340 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.341 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-05-08T06:06:48.341 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.341 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.341 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.341 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.341 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.341 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.341 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.341 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.341 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.341 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.341 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.341 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.341 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.341 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.341 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.342 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.342 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.342 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.342 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.342 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.342 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.342 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.342 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.342 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.342 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.342 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.342 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.342 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.342 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.342 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.343 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.343 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.343 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.343 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.343 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.343 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.343 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.343 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.343 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.343 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.343 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.343 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.343 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.343 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.343 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.343 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.344 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.344 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.344 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.344 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.344 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.344 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.344 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.344 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.344 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.344 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.344 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.344 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.344 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.344 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.344 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.344 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.345 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.345 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.345 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.345 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.345 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.345 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.345 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.345 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.345 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.345 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.345 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.345 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.345 INFO:teuthology.orchestra.run.smithi082.stdout: "password": { 2024-05-08T06:06:48.345 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "password", 2024-05-08T06:06:48.345 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.346 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.346 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.346 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.346 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.346 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.346 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.346 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "password of InfluxDB server user", 2024-05-08T06:06:48.346 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.346 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.346 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.346 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.346 INFO:teuthology.orchestra.run.smithi082.stdout: "port": { 2024-05-08T06:06:48.346 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "port", 2024-05-08T06:06:48.346 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.346 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.346 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.347 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8086", 2024-05-08T06:06:48.347 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.347 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.347 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.347 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "InfluxDB server port", 2024-05-08T06:06:48.347 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.347 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.347 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.347 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.347 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.347 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.347 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.347 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.347 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.347 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.347 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.348 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.348 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.348 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.348 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.348 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.348 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.348 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.348 INFO:teuthology.orchestra.run.smithi082.stdout: "ssl": { 2024-05-08T06:06:48.348 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssl", 2024-05-08T06:06:48.348 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.348 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.348 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.348 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "false", 2024-05-08T06:06:48.348 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.348 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.348 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.349 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-05-08T06:06:48.349 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.349 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.349 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.349 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.349 INFO:teuthology.orchestra.run.smithi082.stdout: "threads": { 2024-05-08T06:06:48.349 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "threads", 2024-05-08T06:06:48.349 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.349 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.349 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.349 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-05-08T06:06:48.349 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-05-08T06:06:48.349 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "32", 2024-05-08T06:06:48.349 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.349 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-05-08T06:06:48.349 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.349 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.350 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.350 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.350 INFO:teuthology.orchestra.run.smithi082.stdout: "username": { 2024-05-08T06:06:48.350 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "username", 2024-05-08T06:06:48.350 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.350 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.350 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.350 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.350 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.350 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.350 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.350 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "username of InfluxDB server user", 2024-05-08T06:06:48.350 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.350 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.351 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.351 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.351 INFO:teuthology.orchestra.run.smithi082.stdout: "verify_ssl": { 2024-05-08T06:06:48.351 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "verify_ssl", 2024-05-08T06:06:48.351 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.351 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.351 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.351 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "true", 2024-05-08T06:06:48.351 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.351 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.351 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.351 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-05-08T06:06:48.351 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.351 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.351 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.351 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.351 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.352 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.352 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.352 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "insights", 2024-05-08T06:06:48.352 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.352 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.352 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.352 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.352 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.352 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.352 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.352 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.352 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.352 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.352 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.352 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.352 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.353 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.353 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.353 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.353 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.353 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.353 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.353 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.353 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.353 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.353 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.353 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.353 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.353 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.353 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.353 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.354 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.354 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.354 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.354 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.354 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.354 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.354 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.354 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.354 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.354 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.354 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.354 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.354 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.354 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.355 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.355 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.355 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.355 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.355 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.355 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.355 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.355 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.355 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.355 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.355 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.355 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.355 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.355 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.355 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.355 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.356 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.356 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.356 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.356 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.356 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.356 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.356 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.356 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.356 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.356 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.356 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.356 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.356 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.356 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.356 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.356 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.357 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.357 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.357 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.357 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.357 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.357 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.357 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.357 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.357 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.357 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.357 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.357 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.357 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.357 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.357 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.357 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.358 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "iostat", 2024-05-08T06:06:48.358 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.358 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.358 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.358 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.358 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.358 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.358 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.358 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.358 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.358 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.358 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.358 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.358 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.358 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.358 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.359 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.359 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.359 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.359 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.359 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.359 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.359 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.359 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.359 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.359 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.359 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.359 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.359 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.359 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.359 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.359 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.360 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.360 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.360 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.360 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.360 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.360 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.360 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.360 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.360 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.360 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.360 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.360 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.360 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.360 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.360 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.360 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.360 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.361 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.361 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.361 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.361 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.361 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.361 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.361 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.361 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.361 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.361 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.361 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.361 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.361 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.361 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.361 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.361 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.361 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.362 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.362 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.362 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.362 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.362 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.362 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.362 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.362 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.362 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.362 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.362 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.362 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.362 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.362 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.362 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.363 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.363 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.363 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.363 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.363 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.363 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.363 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.363 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.363 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.363 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.363 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "k8sevents", 2024-05-08T06:06:48.363 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.363 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.363 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.363 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_event_retention_days": { 2024-05-08T06:06:48.363 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ceph_event_retention_days", 2024-05-08T06:06:48.364 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.364 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.364 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.364 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "7", 2024-05-08T06:06:48.364 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.364 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.364 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.364 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Days to hold ceph event information within local cache", 2024-05-08T06:06:48.364 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.364 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.364 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.364 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.364 INFO:teuthology.orchestra.run.smithi082.stdout: "config_check_secs": { 2024-05-08T06:06:48.364 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "config_check_secs", 2024-05-08T06:06:48.364 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.364 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.365 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.365 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-05-08T06:06:48.365 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "10", 2024-05-08T06:06:48.365 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.365 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.365 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-05-08T06:06:48.365 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.365 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.365 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.365 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.365 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.365 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.365 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.365 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.365 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.366 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.366 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.366 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.366 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.366 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.366 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.366 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.366 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.366 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.366 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.366 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.366 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.366 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.366 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.367 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.367 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.367 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.367 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.367 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.367 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.367 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.367 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.367 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.367 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.367 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.367 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.367 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.367 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.367 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.367 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.368 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.368 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.368 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.368 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.368 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.368 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.368 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.368 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.368 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.368 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.368 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.368 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.368 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.368 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.368 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.368 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.369 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.369 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.369 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.369 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.369 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.369 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.369 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.369 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.369 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.369 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.369 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.369 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.369 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.369 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.369 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.370 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.370 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.370 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.370 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.370 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.370 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.370 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.370 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.370 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.370 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.370 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.370 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.370 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.370 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.370 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.370 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.371 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.371 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.371 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.371 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.371 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.371 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "localpool", 2024-05-08T06:06:48.371 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.371 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.371 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.371 INFO:teuthology.orchestra.run.smithi082.stdout: "failure_domain": { 2024-05-08T06:06:48.371 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "failure_domain", 2024-05-08T06:06:48.371 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.371 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.371 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.371 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "host", 2024-05-08T06:06:48.372 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.372 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.372 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.372 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "failure domain for any created local pool", 2024-05-08T06:06:48.372 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-05-08T06:06:48.372 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.372 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.372 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.372 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.372 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.372 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.372 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.372 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.372 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.373 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.373 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.373 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.373 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.373 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.373 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.373 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.373 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.373 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.373 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.373 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.373 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.373 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.373 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.373 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.374 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.374 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.374 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.374 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.374 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.374 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.374 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.374 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.374 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.374 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.374 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.374 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.374 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.374 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.375 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.375 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.375 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.375 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.375 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.375 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.375 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.375 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.375 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.375 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.375 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.375 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.375 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.375 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.376 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.376 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.376 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.376 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.376 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.376 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.376 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.376 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.376 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.376 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.376 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.376 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.376 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.376 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.376 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.377 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.377 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.377 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.377 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.377 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.377 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.377 INFO:teuthology.orchestra.run.smithi082.stdout: "min_size": { 2024-05-08T06:06:48.377 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "min_size", 2024-05-08T06:06:48.377 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.377 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.377 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.377 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.377 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.377 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.378 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.378 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "default min_size for any created local pool", 2024-05-08T06:06:48.378 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-05-08T06:06:48.378 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.378 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.378 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.378 INFO:teuthology.orchestra.run.smithi082.stdout: "num_rep": { 2024-05-08T06:06:48.378 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "num_rep", 2024-05-08T06:06:48.378 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.378 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.378 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.378 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "3", 2024-05-08T06:06:48.378 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.378 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.379 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.379 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "default replica count for any created local pool", 2024-05-08T06:06:48.379 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.379 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.379 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.379 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.379 INFO:teuthology.orchestra.run.smithi082.stdout: "pg_num": { 2024-05-08T06:06:48.379 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pg_num", 2024-05-08T06:06:48.379 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.379 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.379 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.379 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "128", 2024-05-08T06:06:48.379 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.379 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.379 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.380 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "default pg_num for any created local pool", 2024-05-08T06:06:48.380 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.380 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.380 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.380 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.380 INFO:teuthology.orchestra.run.smithi082.stdout: "prefix": { 2024-05-08T06:06:48.380 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "prefix", 2024-05-08T06:06:48.380 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.380 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.380 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.380 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.380 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.380 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.380 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.380 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "name prefix for any created local pool", 2024-05-08T06:06:48.380 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.381 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.381 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.381 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.381 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.381 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.381 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.381 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.381 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.381 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.381 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.381 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.381 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.381 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.381 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.381 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.382 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.382 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.382 INFO:teuthology.orchestra.run.smithi082.stdout: "subtree": { 2024-05-08T06:06:48.382 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "subtree", 2024-05-08T06:06:48.382 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.382 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.382 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.382 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "rack", 2024-05-08T06:06:48.382 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.382 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.382 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.382 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "CRUSH level for which to create a local pool", 2024-05-08T06:06:48.382 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-05-08T06:06:48.382 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.383 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.383 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.383 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.383 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.383 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.383 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mds_autoscaler", 2024-05-08T06:06:48.383 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.383 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.383 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.383 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.383 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.383 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.383 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.383 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.383 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.384 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.384 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.384 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.384 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.384 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.384 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.384 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.384 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.384 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.384 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.384 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.384 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.384 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.384 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.384 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.385 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.385 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.385 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.385 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.385 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.385 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.385 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.385 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.385 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.385 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.385 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.385 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.385 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.385 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.385 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.385 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.385 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.386 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.386 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.386 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.386 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.386 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.386 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.386 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.386 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.386 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.386 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.386 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.386 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.386 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.386 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.386 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.386 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.387 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.387 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.387 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.387 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.387 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.387 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.387 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.387 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.387 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.387 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.387 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.387 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.387 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.387 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.387 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.387 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.387 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.388 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.388 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.388 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.388 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.388 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.388 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.388 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.388 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.388 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.388 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.388 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.388 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.388 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.388 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.388 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.388 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.389 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mirroring", 2024-05-08T06:06:48.389 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.389 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.389 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.389 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.389 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.389 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.389 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.389 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.389 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.389 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.389 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.389 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.389 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.390 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.390 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.390 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.390 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.390 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.390 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.390 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.390 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.390 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.390 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.390 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.390 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.390 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.390 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.391 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.391 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.391 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.391 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.391 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.391 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.391 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.391 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.391 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.391 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.391 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.391 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.391 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.391 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.391 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.392 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.392 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.392 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.392 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.392 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.392 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.392 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.392 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.392 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.392 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.392 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.392 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.392 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.392 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.392 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.393 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.393 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.393 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.393 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.393 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.393 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.393 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.393 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.393 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.393 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.393 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.393 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.393 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.393 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.393 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.393 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.394 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.394 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.394 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.394 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.394 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.394 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.394 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.394 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.394 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.394 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.394 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.394 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.394 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.394 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.394 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.395 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.395 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.395 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "nfs", 2024-05-08T06:06:48.395 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.395 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.395 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.395 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.395 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.395 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.395 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.395 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.395 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.395 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.395 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.395 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.395 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.395 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.396 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.396 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.396 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.396 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.396 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.396 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.396 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.396 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.396 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.396 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.396 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.396 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.396 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.396 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.396 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.396 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.396 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.397 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.397 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.397 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.397 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.397 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.397 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.397 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.397 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.397 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.397 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.397 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.397 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.397 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.397 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.397 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.397 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.398 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.398 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.398 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.398 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.398 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.398 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.398 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.398 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.398 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.398 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.398 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.398 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.398 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.398 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.398 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.398 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.399 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.399 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.399 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.399 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.399 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.399 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.399 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.399 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.399 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.399 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.399 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.399 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.399 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.399 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.399 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.399 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.400 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.400 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.400 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.400 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.400 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.400 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.400 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.400 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.400 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.400 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.400 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.400 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "orchestrator", 2024-05-08T06:06:48.400 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.400 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.400 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.400 INFO:teuthology.orchestra.run.smithi082.stdout: "fail_fs": { 2024-05-08T06:06:48.400 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "fail_fs", 2024-05-08T06:06:48.401 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.401 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.401 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.401 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.401 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.401 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.401 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.401 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-05-08T06:06:48.401 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.401 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.401 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.401 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.401 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.401 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.402 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.402 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.402 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.402 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.402 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.402 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.402 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.402 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.402 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.402 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.402 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.402 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.402 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.402 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.402 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.403 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.403 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.403 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.403 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.403 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.403 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.403 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.403 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.403 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.403 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.403 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.403 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.403 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.403 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.404 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.404 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.404 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.404 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.404 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.404 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.404 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.404 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.404 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.404 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.404 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.404 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.404 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.404 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.404 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.404 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.404 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.405 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.405 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.405 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.405 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.405 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.405 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.405 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.405 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.405 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.405 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.405 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.405 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.405 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.405 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.405 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.405 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.405 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.406 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.406 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.406 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.406 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.406 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.406 INFO:teuthology.orchestra.run.smithi082.stdout: "orchestrator": { 2024-05-08T06:06:48.406 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "orchestrator", 2024-05-08T06:06:48.406 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.406 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.406 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.406 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.406 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.406 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.406 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.407 INFO:teuthology.orchestra.run.smithi082.stdout: "cephadm", 2024-05-08T06:06:48.407 INFO:teuthology.orchestra.run.smithi082.stdout: "rook", 2024-05-08T06:06:48.407 INFO:teuthology.orchestra.run.smithi082.stdout: "test_orchestrator" 2024-05-08T06:06:48.407 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.407 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Orchestrator backend", 2024-05-08T06:06:48.407 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.407 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.407 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.407 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.407 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.407 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.407 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.407 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.407 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.407 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.407 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.407 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.408 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.408 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.408 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.408 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.408 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.408 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.408 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.408 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.408 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.408 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "osd_perf_query", 2024-05-08T06:06:48.408 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.408 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.408 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.408 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.408 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.408 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.408 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.409 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.409 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.409 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.409 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.409 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.409 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.409 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.409 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.409 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.409 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.409 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.409 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.409 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.409 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.409 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.409 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.410 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.410 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.410 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.410 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.410 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.410 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.410 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.410 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.410 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.410 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.410 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.410 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.410 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.410 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.410 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.411 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.411 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.411 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.411 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.411 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.411 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.411 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.411 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.411 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.411 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.411 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.411 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.411 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.411 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.411 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.411 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.412 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.412 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.412 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.412 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.412 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.412 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.412 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.412 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.412 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.412 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.412 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.412 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.412 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.412 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.412 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.412 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.413 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.413 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.413 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.413 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.413 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.413 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.413 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.413 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.413 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.413 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.413 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.413 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.413 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.413 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.413 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.413 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.414 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.414 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.414 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.414 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.414 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "osd_support", 2024-05-08T06:06:48.414 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.414 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.414 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.414 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.414 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.414 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.414 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.414 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.414 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.414 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.415 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.415 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.415 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.415 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.415 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.415 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.415 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.415 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.415 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.415 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.415 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.415 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.415 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.415 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.415 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.415 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.416 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.416 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.416 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.416 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.416 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.416 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.416 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.416 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.416 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.416 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.416 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.416 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.416 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.416 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.416 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.416 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.417 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.417 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.417 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.417 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.417 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.417 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.417 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.417 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.417 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.417 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.417 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.417 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.417 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.417 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.417 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.417 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.417 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.418 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.418 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.418 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.418 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.418 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.418 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.418 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.418 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.418 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.418 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.418 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.418 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.418 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.418 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.418 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.419 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.419 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.419 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.419 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.419 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.419 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.419 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.419 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.419 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.419 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.419 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.419 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.419 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.419 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.419 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.419 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.420 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pg_autoscaler", 2024-05-08T06:06:48.420 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.420 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.420 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.420 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.420 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.420 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.420 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.420 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.420 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.420 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.420 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.420 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.420 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.420 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.420 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.421 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.421 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.421 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.421 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.421 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.421 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.421 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.421 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.421 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.421 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.421 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.421 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.421 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.421 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.421 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.421 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.422 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.422 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.422 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.422 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.422 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.422 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.422 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.422 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.422 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.422 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.422 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.422 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.422 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.422 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.422 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.422 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.423 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.423 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.423 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.423 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.423 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.423 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.423 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.423 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.423 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.423 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.423 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.423 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.423 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.423 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.423 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.423 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.423 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.424 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.424 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.424 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.424 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.424 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.424 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.424 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.424 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.424 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.424 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-05-08T06:06:48.424 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-05-08T06:06:48.424 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:48.424 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.424 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.424 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-05-08T06:06:48.424 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.424 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.425 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.425 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.425 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.425 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.425 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.425 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.425 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.425 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.425 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.425 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.425 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.425 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.425 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.425 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.426 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.426 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.426 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.426 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.426 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.426 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.426 INFO:teuthology.orchestra.run.smithi082.stdout: "threshold": { 2024-05-08T06:06:48.426 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "threshold", 2024-05-08T06:06:48.426 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-05-08T06:06:48.426 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.426 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.426 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "3.0", 2024-05-08T06:06:48.426 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1.0", 2024-05-08T06:06:48.426 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.427 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.427 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "scaling threshold", 2024-05-08T06:06:48.427 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-05-08T06:06:48.427 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.427 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.427 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.427 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.427 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.427 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.427 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "progress", 2024-05-08T06:06:48.427 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.427 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.427 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.427 INFO:teuthology.orchestra.run.smithi082.stdout: "allow_pg_recovery_event": { 2024-05-08T06:06:48.427 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "allow_pg_recovery_event", 2024-05-08T06:06:48.428 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.428 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.428 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.428 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.428 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.428 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.428 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.428 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "allow the module to show pg recovery progress", 2024-05-08T06:06:48.428 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.428 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.428 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.428 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.428 INFO:teuthology.orchestra.run.smithi082.stdout: "enabled": { 2024-05-08T06:06:48.428 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enabled", 2024-05-08T06:06:48.428 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.428 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.429 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.429 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.429 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.429 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.429 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.429 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.429 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.429 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.429 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.429 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.429 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.429 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.429 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.429 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.429 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.430 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.430 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.430 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.430 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.430 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.430 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.430 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.430 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.430 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.430 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.430 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.430 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.430 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.430 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.430 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.430 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.431 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.431 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.431 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.431 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.431 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.431 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.431 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.431 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.431 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.431 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.431 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.431 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.431 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.431 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.431 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.431 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.432 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.432 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.432 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.432 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.432 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.432 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.432 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.432 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.432 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.432 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.432 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.432 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.432 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.432 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.432 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.432 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.433 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.433 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.433 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.433 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.433 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.433 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.433 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.433 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.433 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.433 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.433 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.433 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.433 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.433 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.433 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.433 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.434 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.434 INFO:teuthology.orchestra.run.smithi082.stdout: "max_completed_events": { 2024-05-08T06:06:48.434 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_completed_events", 2024-05-08T06:06:48.434 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.434 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.434 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.434 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "50", 2024-05-08T06:06:48.434 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.434 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.434 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.434 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "number of past completed events to remember", 2024-05-08T06:06:48.434 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.434 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.434 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.435 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.435 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-05-08T06:06:48.435 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-05-08T06:06:48.435 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:48.435 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.435 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.435 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-05-08T06:06:48.435 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.435 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.435 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.435 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how long the module is going to sleep", 2024-05-08T06:06:48.435 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.435 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.435 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.435 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.436 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.436 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.436 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.436 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.436 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.436 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.436 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.436 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.436 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.436 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.436 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.436 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.436 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.436 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.436 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.437 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.437 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.437 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "prometheus", 2024-05-08T06:06:48.437 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.437 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.437 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.437 INFO:teuthology.orchestra.run.smithi082.stdout: "cache": { 2024-05-08T06:06:48.437 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cache", 2024-05-08T06:06:48.437 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.437 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.437 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.437 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.437 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.437 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.437 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.437 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.438 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.438 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.438 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.438 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.438 INFO:teuthology.orchestra.run.smithi082.stdout: "exclude_perf_counters": { 2024-05-08T06:06:48.438 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "exclude_perf_counters", 2024-05-08T06:06:48.438 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.438 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.438 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.438 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.438 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.438 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.438 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.438 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-05-08T06:06:48.438 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-05-08T06:06:48.439 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.439 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.439 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.439 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.439 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.439 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.439 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.439 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.439 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.439 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.439 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.439 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.439 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.439 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.439 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.439 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.439 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.440 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.440 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.440 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.440 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.440 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.440 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.440 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.440 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.440 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.440 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.440 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.440 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.440 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.440 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.440 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.440 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.441 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.441 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.441 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.441 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.441 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.441 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.441 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.441 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.441 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.441 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.441 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.441 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.441 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.441 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.441 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.442 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.442 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.442 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.442 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.442 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.442 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.442 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.442 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.442 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.442 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.442 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.442 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.442 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.442 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.442 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.443 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.443 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.443 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.443 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.443 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.443 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.443 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.443 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.443 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.443 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.443 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_stats_pools": { 2024-05-08T06:06:48.443 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_stats_pools", 2024-05-08T06:06:48.443 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.443 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.443 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.443 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.443 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.444 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.444 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.444 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.444 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.444 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.444 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.444 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.444 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_stats_pools_refresh_interval": { 2024-05-08T06:06:48.444 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-05-08T06:06:48.444 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.444 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.444 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.444 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "300", 2024-05-08T06:06:48.444 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.444 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.444 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.444 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.445 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.445 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.445 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.445 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.445 INFO:teuthology.orchestra.run.smithi082.stdout: "scrape_interval": { 2024-05-08T06:06:48.445 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "scrape_interval", 2024-05-08T06:06:48.445 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-05-08T06:06:48.445 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.445 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.445 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "15.0", 2024-05-08T06:06:48.445 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.445 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.445 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.445 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.445 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.446 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.446 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.446 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.446 INFO:teuthology.orchestra.run.smithi082.stdout: "server_addr": { 2024-05-08T06:06:48.446 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_addr", 2024-05-08T06:06:48.446 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.446 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.446 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.446 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "::", 2024-05-08T06:06:48.446 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.446 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.446 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.446 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-05-08T06:06:48.446 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.446 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.446 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.446 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.447 INFO:teuthology.orchestra.run.smithi082.stdout: "server_port": { 2024-05-08T06:06:48.447 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_port", 2024-05-08T06:06:48.447 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.447 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.447 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.447 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "9283", 2024-05-08T06:06:48.447 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.447 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.447 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.447 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-05-08T06:06:48.447 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.447 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.447 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.447 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.447 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.447 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.448 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.448 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.448 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.448 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.448 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.448 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.448 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.448 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.448 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.448 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.448 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.448 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.448 INFO:teuthology.orchestra.run.smithi082.stdout: "stale_cache_strategy": { 2024-05-08T06:06:48.448 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "stale_cache_strategy", 2024-05-08T06:06:48.448 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.448 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.448 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.449 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "log", 2024-05-08T06:06:48.449 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.449 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.449 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.449 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.449 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.449 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.449 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.449 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.449 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_behaviour": { 2024-05-08T06:06:48.449 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_behaviour", 2024-05-08T06:06:48.449 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.449 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.449 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.449 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "default", 2024-05-08T06:06:48.450 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.450 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.450 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.450 INFO:teuthology.orchestra.run.smithi082.stdout: "default", 2024-05-08T06:06:48.450 INFO:teuthology.orchestra.run.smithi082.stdout: "error" 2024-05-08T06:06:48.450 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.450 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.450 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.450 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.450 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.450 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.450 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_error_status_code": { 2024-05-08T06:06:48.450 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_error_status_code", 2024-05-08T06:06:48.450 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.451 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.451 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.451 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "500", 2024-05-08T06:06:48.451 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "400", 2024-05-08T06:06:48.451 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "599", 2024-05-08T06:06:48.451 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.451 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.451 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.451 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.451 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.451 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.451 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.451 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.451 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.451 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_support", 2024-05-08T06:06:48.452 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.452 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.452 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.452 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.452 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.452 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.452 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.452 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.452 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.452 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.452 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.452 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.452 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.452 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.452 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.453 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.453 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.453 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.453 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.453 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.453 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.453 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.453 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.453 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.453 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.453 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.453 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.453 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.453 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.453 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.454 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.454 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.454 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.454 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.454 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.454 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.454 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.454 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.454 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.454 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.454 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.454 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.454 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.454 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.455 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.455 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.455 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.455 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.455 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.455 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.455 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.455 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.455 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.455 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.455 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.455 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.455 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.455 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.455 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.456 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.456 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.456 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.456 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.456 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.456 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.456 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.456 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.456 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.456 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.456 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.456 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.456 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.456 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.456 INFO:teuthology.orchestra.run.smithi082.stdout: "max_concurrent_snap_create": { 2024-05-08T06:06:48.456 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_concurrent_snap_create", 2024-05-08T06:06:48.456 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.457 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.457 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.457 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-05-08T06:06:48.457 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.457 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.457 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.457 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.457 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.457 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.457 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.457 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.457 INFO:teuthology.orchestra.run.smithi082.stdout: "mirror_snapshot_schedule": { 2024-05-08T06:06:48.457 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mirror_snapshot_schedule", 2024-05-08T06:06:48.457 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.457 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.457 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.458 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.458 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.458 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.458 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.458 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.458 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.458 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.458 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.458 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.458 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.458 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.458 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.458 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.458 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.458 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.458 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.459 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.459 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.459 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.459 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.459 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.459 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.459 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.459 INFO:teuthology.orchestra.run.smithi082.stdout: "trash_purge_schedule": { 2024-05-08T06:06:48.459 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "trash_purge_schedule", 2024-05-08T06:06:48.459 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.459 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.459 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.459 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.459 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.459 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.459 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.460 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.460 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.460 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.460 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.460 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.460 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.460 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.460 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.460 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "restful", 2024-05-08T06:06:48.460 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.460 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.460 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.460 INFO:teuthology.orchestra.run.smithi082.stdout: "enable_auth": { 2024-05-08T06:06:48.460 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enable_auth", 2024-05-08T06:06:48.460 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.460 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.460 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.460 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.461 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.461 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.461 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.461 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.461 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.461 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.461 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.461 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.461 INFO:teuthology.orchestra.run.smithi082.stdout: "key_file": { 2024-05-08T06:06:48.461 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "key_file", 2024-05-08T06:06:48.461 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.461 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.461 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.461 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.461 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.462 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.462 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.462 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.462 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.462 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.462 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.462 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.462 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.462 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.462 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.462 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.462 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.462 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.462 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.462 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.462 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.463 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.463 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.463 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.463 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.463 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.463 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.463 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.463 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.463 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.463 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.463 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.463 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.463 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.463 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.463 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.463 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.464 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.464 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.464 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.464 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.464 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.464 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.464 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.464 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.464 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.464 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.464 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.464 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.464 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.464 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.464 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.464 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.465 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.465 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.465 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.465 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.465 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.465 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.465 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.465 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.465 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.465 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.465 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.465 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.465 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.465 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.465 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.465 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.465 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.466 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.466 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.466 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.466 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.466 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.466 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.466 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.466 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.466 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.466 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.466 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.466 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.466 INFO:teuthology.orchestra.run.smithi082.stdout: "server_addr": { 2024-05-08T06:06:48.466 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_addr", 2024-05-08T06:06:48.467 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.467 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.467 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.467 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.467 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.467 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.467 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.467 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.467 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.467 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.467 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.467 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.467 INFO:teuthology.orchestra.run.smithi082.stdout: "server_port": { 2024-05-08T06:06:48.467 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_port", 2024-05-08T06:06:48.467 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.467 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.467 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.468 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.468 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.468 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.468 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.468 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.468 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.468 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.468 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.468 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.468 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.468 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.468 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.468 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.468 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.468 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.468 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.468 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.469 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.469 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.469 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.469 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.469 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.469 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.469 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.469 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.469 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.469 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rgw", 2024-05-08T06:06:48.469 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.469 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.469 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.469 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.469 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.469 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.470 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.470 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.470 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.470 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.470 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.470 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.470 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.470 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.470 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.470 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.470 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.470 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.470 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.470 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.471 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.471 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.471 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.471 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.471 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.471 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.471 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.471 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.471 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.471 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.471 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.471 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.471 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.471 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.471 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.471 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.471 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.472 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.472 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.472 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.472 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.472 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.472 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.472 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.472 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.472 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.472 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.472 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.472 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.472 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.472 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.472 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.472 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.472 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.473 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.473 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.473 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.473 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.473 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.473 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.473 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.473 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.473 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.473 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.473 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.473 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.473 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.473 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.473 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.473 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.474 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.474 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.474 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.474 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.474 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.474 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.474 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.474 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.474 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.474 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.474 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.474 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.474 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.474 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.475 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.475 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.475 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.475 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.475 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.475 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.475 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rook", 2024-05-08T06:06:48.475 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.475 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.475 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.475 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.475 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.475 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.475 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.475 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.475 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.476 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.476 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.476 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.476 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.476 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.476 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.476 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.476 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.476 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.476 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.476 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.476 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.476 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.476 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.476 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.476 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.477 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.477 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.477 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.477 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.477 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.477 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.477 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.477 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.477 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.477 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.477 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.477 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.477 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.477 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.477 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.478 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.478 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.478 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.478 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.478 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.478 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.478 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.478 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.478 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.478 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.478 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.478 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.478 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.478 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.478 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.479 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.479 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.479 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.479 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.479 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.479 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.479 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.479 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.479 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.479 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.479 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.479 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.479 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.479 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.479 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.479 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.480 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.480 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.480 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.480 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.480 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.480 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.480 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.480 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.480 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.480 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.480 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.480 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.480 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.480 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.480 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.480 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.481 INFO:teuthology.orchestra.run.smithi082.stdout: "storage_class": { 2024-05-08T06:06:48.481 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "storage_class", 2024-05-08T06:06:48.481 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.481 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.481 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.481 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "local", 2024-05-08T06:06:48.481 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.481 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.481 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.481 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-05-08T06:06:48.481 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.481 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.481 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.481 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.481 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.481 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.482 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.482 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "selftest", 2024-05-08T06:06:48.482 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.482 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.482 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.482 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.482 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.482 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.482 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.482 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.482 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.482 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.482 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.482 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.482 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.483 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.483 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.483 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.483 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.483 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.483 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.483 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.483 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.483 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.483 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.483 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.483 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.483 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.483 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.483 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.484 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.484 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.484 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.484 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.484 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.484 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.484 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.484 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.484 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.484 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.484 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.484 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.484 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.484 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.484 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.485 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.485 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.485 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.485 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.485 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.485 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.485 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.485 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.485 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.485 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.485 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.485 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.485 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.485 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.485 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.485 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.486 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.486 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.486 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.486 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.486 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.486 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.486 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.486 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.486 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.486 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.486 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.486 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.486 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.486 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.487 INFO:teuthology.orchestra.run.smithi082.stdout: "roption1": { 2024-05-08T06:06:48.487 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "roption1", 2024-05-08T06:06:48.487 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.487 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.487 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.487 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.487 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.487 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.487 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.487 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.487 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.487 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.487 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.487 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.487 INFO:teuthology.orchestra.run.smithi082.stdout: "roption2": { 2024-05-08T06:06:48.488 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "roption2", 2024-05-08T06:06:48.488 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.488 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.488 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.488 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "xyz", 2024-05-08T06:06:48.488 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.488 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.488 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.488 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.488 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.488 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.488 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.488 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.488 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption1": { 2024-05-08T06:06:48.488 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption1", 2024-05-08T06:06:48.488 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.489 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.489 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.489 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.489 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.489 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.489 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.489 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.489 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.489 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.489 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.489 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.489 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption2": { 2024-05-08T06:06:48.489 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption2", 2024-05-08T06:06:48.489 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.489 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.490 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.490 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.490 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.490 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.490 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.490 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.490 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.490 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.490 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.490 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.490 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption3": { 2024-05-08T06:06:48.490 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption3", 2024-05-08T06:06:48.490 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-05-08T06:06:48.490 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.491 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.491 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.491 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.491 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.491 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.491 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.491 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.491 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.491 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.491 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.491 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption4": { 2024-05-08T06:06:48.491 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption4", 2024-05-08T06:06:48.491 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.491 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.491 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.492 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.492 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.492 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.492 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.492 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.492 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.492 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.492 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.492 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.492 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption5": { 2024-05-08T06:06:48.492 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption5", 2024-05-08T06:06:48.492 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.492 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.492 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.492 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.492 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.493 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.493 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.493 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.493 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.493 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.493 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.493 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.493 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption6": { 2024-05-08T06:06:48.493 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption6", 2024-05-08T06:06:48.493 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.493 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.493 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.493 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.493 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.493 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.494 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.494 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.494 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.494 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.494 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.494 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.494 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption7": { 2024-05-08T06:06:48.494 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption7", 2024-05-08T06:06:48.494 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.494 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.494 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.494 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.494 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-05-08T06:06:48.494 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "42", 2024-05-08T06:06:48.495 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.495 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.495 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.495 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.495 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.495 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.495 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.495 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.495 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.495 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.495 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.495 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.495 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.495 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.495 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.495 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.495 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.496 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.496 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.496 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.496 INFO:teuthology.orchestra.run.smithi082.stdout: "testkey": { 2024-05-08T06:06:48.496 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "testkey", 2024-05-08T06:06:48.496 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.496 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.496 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.496 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.496 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.496 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.496 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.496 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.496 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.496 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.496 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.497 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.497 INFO:teuthology.orchestra.run.smithi082.stdout: "testlkey": { 2024-05-08T06:06:48.497 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "testlkey", 2024-05-08T06:06:48.497 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.497 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.497 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.497 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.497 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.497 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.497 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.497 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.497 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.497 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.497 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.497 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.497 INFO:teuthology.orchestra.run.smithi082.stdout: "testnewline": { 2024-05-08T06:06:48.498 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "testnewline", 2024-05-08T06:06:48.498 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.498 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.498 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.498 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.498 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.498 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.498 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.498 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.498 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.498 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.498 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.498 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.498 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.498 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.499 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.499 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smb", 2024-05-08T06:06:48.499 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.499 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.499 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.499 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.499 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.499 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.499 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.499 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.499 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.499 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.499 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.499 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.500 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.500 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.500 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.500 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.500 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.500 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.500 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.500 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.500 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.500 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.500 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.500 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.500 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.500 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.500 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.501 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.501 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.501 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.501 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.501 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.501 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.501 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.501 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.501 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.501 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.501 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.501 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.501 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.501 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.501 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.501 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.502 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.502 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.502 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.502 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.502 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.502 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.502 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.502 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.502 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.502 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.502 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.502 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.502 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.502 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.503 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.503 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.503 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.503 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.503 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.503 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.503 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.503 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.503 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.503 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.503 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.503 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.503 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.503 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.503 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.504 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.504 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.504 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.504 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.504 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.504 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.504 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.504 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.504 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.504 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.504 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.504 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.504 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.504 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.504 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.505 INFO:teuthology.orchestra.run.smithi082.stdout: "update_orchestration": { 2024-05-08T06:06:48.505 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "update_orchestration", 2024-05-08T06:06:48.505 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.505 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.505 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.505 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.505 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.505 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.505 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.505 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-05-08T06:06:48.505 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.505 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.505 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.505 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.505 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.506 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.506 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.506 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "snap_schedule", 2024-05-08T06:06:48.506 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.506 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.506 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.506 INFO:teuthology.orchestra.run.smithi082.stdout: "allow_m_granularity": { 2024-05-08T06:06:48.506 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "allow_m_granularity", 2024-05-08T06:06:48.506 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.506 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.506 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.506 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.506 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.506 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.506 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.506 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "allow minute scheduled snapshots", 2024-05-08T06:06:48.507 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.507 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.507 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.507 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.507 INFO:teuthology.orchestra.run.smithi082.stdout: "dump_on_update": { 2024-05-08T06:06:48.507 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "dump_on_update", 2024-05-08T06:06:48.507 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.507 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.507 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.507 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.507 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.507 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.507 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.507 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "dump database to debug log on update", 2024-05-08T06:06:48.507 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.507 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.507 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.508 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.508 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.508 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.508 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.508 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.508 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.508 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.508 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.508 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.508 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.508 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.508 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.508 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.508 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.508 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.508 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.509 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.509 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.509 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.509 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.509 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.509 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.509 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.509 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.509 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.509 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.509 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.509 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.509 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.509 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.509 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.509 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.509 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.510 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.510 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.510 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.510 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.510 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.510 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.510 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.510 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.510 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.510 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.510 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.510 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.510 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.510 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.510 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.511 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.511 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.511 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.511 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.511 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.511 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.511 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.511 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.511 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.511 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.511 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.511 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.511 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.511 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.511 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.511 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.512 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.512 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.512 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.512 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.512 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.512 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.512 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.512 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.512 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.512 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.512 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.512 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.512 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.512 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.512 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.512 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.513 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.513 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.513 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.513 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.513 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.513 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.513 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.513 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.513 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "stats", 2024-05-08T06:06:48.513 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.513 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.513 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.513 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.513 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.513 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.513 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.514 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.514 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.514 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.514 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.514 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.514 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.514 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.514 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.514 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.514 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.514 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.514 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.514 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.514 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.514 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.514 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.515 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.515 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.515 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.515 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.515 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.515 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.515 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.515 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.515 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.515 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.515 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.515 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.515 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.515 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.515 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.515 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.516 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.516 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.516 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.516 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.516 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.516 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.516 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.516 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.516 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.516 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.516 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.516 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.516 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.516 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.516 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.516 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.516 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.517 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.517 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.517 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.517 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.517 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.517 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.517 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.517 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.517 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.517 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.517 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.517 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.517 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.517 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.517 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.517 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.518 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.518 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.518 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.518 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.518 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.518 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.518 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.518 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.518 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.518 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.518 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.518 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.518 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.518 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.518 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.519 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.519 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.519 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.519 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "status", 2024-05-08T06:06:48.519 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.519 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.519 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.519 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.519 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.519 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.519 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.519 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.519 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.519 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.519 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.520 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.520 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.520 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.520 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.520 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.520 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.520 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.520 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.520 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.520 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.520 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.520 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.520 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.520 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.520 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.520 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.521 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.521 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.521 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.521 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.521 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.521 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.521 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.521 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.521 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.521 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.521 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.521 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.521 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.521 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.521 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.521 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.521 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.522 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.522 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.522 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.522 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.522 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.522 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.522 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.522 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.522 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.522 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.522 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.522 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.522 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.522 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.522 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.523 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.523 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.523 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.523 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.523 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.523 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.523 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.523 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.523 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.523 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.523 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.523 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.523 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.523 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.523 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.523 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.523 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.524 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.524 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.524 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.524 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.524 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.524 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.524 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.524 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.524 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.524 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.524 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.524 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.524 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.524 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.524 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "telegraf", 2024-05-08T06:06:48.525 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.525 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.525 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.525 INFO:teuthology.orchestra.run.smithi082.stdout: "address": { 2024-05-08T06:06:48.525 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "address", 2024-05-08T06:06:48.525 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.525 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.525 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.525 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-05-08T06:06:48.525 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.525 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.525 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.525 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.525 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.525 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.526 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.526 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.526 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-05-08T06:06:48.526 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-05-08T06:06:48.526 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:48.526 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.526 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.526 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "15", 2024-05-08T06:06:48.526 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.526 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.526 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.526 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.526 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.526 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.526 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.527 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.527 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.527 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.527 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.527 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.527 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.527 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.527 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.527 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.527 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.527 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.527 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.527 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.527 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.527 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.527 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.528 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.528 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.528 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.528 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.528 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.528 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.528 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.528 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.528 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.528 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.528 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.528 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.528 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.528 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.528 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.528 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.528 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.529 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.529 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.529 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.529 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.529 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.529 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.529 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.529 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.529 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.529 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.529 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.529 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.529 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.529 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.529 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.530 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.530 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.530 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.530 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.530 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.530 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.530 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.530 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.530 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.530 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.530 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.530 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.530 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.530 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.530 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.531 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.531 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.531 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.531 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.531 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.531 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.531 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.531 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.531 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.531 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.531 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.531 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.531 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.531 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.531 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.531 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.532 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.532 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.532 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.532 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.532 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.532 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.532 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.532 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.532 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.532 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "telemetry", 2024-05-08T06:06:48.532 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.532 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.532 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.532 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_basic": { 2024-05-08T06:06:48.532 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_basic", 2024-05-08T06:06:48.532 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.532 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.533 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.533 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.533 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.533 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.533 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.533 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share basic cluster information (size, version)", 2024-05-08T06:06:48.533 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.533 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.533 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.533 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.533 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_crash": { 2024-05-08T06:06:48.533 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_crash", 2024-05-08T06:06:48.533 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.533 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.533 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.533 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.533 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.534 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.534 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.534 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-05-08T06:06:48.534 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.534 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.534 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.534 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.534 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_device": { 2024-05-08T06:06:48.534 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_device", 2024-05-08T06:06:48.534 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.534 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.534 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.534 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.534 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.534 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.534 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.535 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-05-08T06:06:48.535 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.535 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.535 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.535 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.535 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_ident": { 2024-05-08T06:06:48.535 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_ident", 2024-05-08T06:06:48.535 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.535 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.535 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.535 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.535 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.535 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.535 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.535 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-05-08T06:06:48.535 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.536 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.536 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.536 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.536 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_perf": { 2024-05-08T06:06:48.536 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_perf", 2024-05-08T06:06:48.536 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.536 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.536 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.536 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.536 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.536 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.536 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.536 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share various performance metrics of a cluster", 2024-05-08T06:06:48.536 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.536 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.536 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.537 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.537 INFO:teuthology.orchestra.run.smithi082.stdout: "contact": { 2024-05-08T06:06:48.537 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "contact", 2024-05-08T06:06:48.537 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.537 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.537 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.537 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.537 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.537 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.537 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.537 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.537 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.537 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.537 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.537 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.537 INFO:teuthology.orchestra.run.smithi082.stdout: "description": { 2024-05-08T06:06:48.537 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "description", 2024-05-08T06:06:48.538 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.538 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.538 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.538 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.538 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.538 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.538 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.538 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.538 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.538 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.538 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.538 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.538 INFO:teuthology.orchestra.run.smithi082.stdout: "device_url": { 2024-05-08T06:06:48.538 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "device_url", 2024-05-08T06:06:48.538 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.539 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.539 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.539 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-05-08T06:06:48.539 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.539 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.539 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.539 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.539 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.539 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.539 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.539 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.539 INFO:teuthology.orchestra.run.smithi082.stdout: "enabled": { 2024-05-08T06:06:48.539 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enabled", 2024-05-08T06:06:48.539 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.539 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.539 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.539 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.540 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.540 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.540 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.540 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.540 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.540 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.540 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.540 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.540 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-05-08T06:06:48.540 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-05-08T06:06:48.540 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.540 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.540 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.540 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "24", 2024-05-08T06:06:48.540 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "8", 2024-05-08T06:06:48.540 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.540 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.541 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.541 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.541 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.541 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.541 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.541 INFO:teuthology.orchestra.run.smithi082.stdout: "last_opt_revision": { 2024-05-08T06:06:48.541 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "last_opt_revision", 2024-05-08T06:06:48.541 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.541 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.541 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.541 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "1", 2024-05-08T06:06:48.541 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.541 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.541 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.541 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.542 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.542 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.542 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.542 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.542 INFO:teuthology.orchestra.run.smithi082.stdout: "leaderboard": { 2024-05-08T06:06:48.542 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "leaderboard", 2024-05-08T06:06:48.542 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.542 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.542 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.542 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.542 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.542 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.542 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.542 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.542 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.543 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.543 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.543 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.543 INFO:teuthology.orchestra.run.smithi082.stdout: "leaderboard_description": { 2024-05-08T06:06:48.543 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "leaderboard_description", 2024-05-08T06:06:48.543 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.543 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.543 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.543 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.543 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.543 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.543 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.543 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.543 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.543 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.543 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.543 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.544 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.544 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.544 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.544 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.544 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.544 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.544 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.544 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.544 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.544 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.544 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.544 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.544 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.544 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.544 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.544 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.544 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.545 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.545 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.545 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.545 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.545 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.545 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.545 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.545 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.545 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.545 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.545 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.545 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.545 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.545 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.545 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.546 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.546 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.546 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.546 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.546 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.546 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.546 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.546 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.546 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.546 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.546 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.546 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.546 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.546 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.546 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.547 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.547 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.547 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.547 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.547 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.547 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.547 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.547 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.547 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.547 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.547 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.547 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.547 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.547 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.547 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.547 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.548 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.548 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.548 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.548 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.548 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.548 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.548 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.548 INFO:teuthology.orchestra.run.smithi082.stdout: "organization": { 2024-05-08T06:06:48.548 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "organization", 2024-05-08T06:06:48.548 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.548 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.548 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.548 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.548 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.548 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.548 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.549 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.549 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.549 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.549 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.549 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.549 INFO:teuthology.orchestra.run.smithi082.stdout: "proxy": { 2024-05-08T06:06:48.549 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "proxy", 2024-05-08T06:06:48.549 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.549 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.549 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.549 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.549 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.549 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.549 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.550 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.550 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.550 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.550 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.550 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.550 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.550 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.550 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.550 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.550 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.550 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.550 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.550 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.550 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.550 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.550 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.550 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.551 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.551 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.551 INFO:teuthology.orchestra.run.smithi082.stdout: "url": { 2024-05-08T06:06:48.551 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "url", 2024-05-08T06:06:48.551 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.551 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.551 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.551 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-05-08T06:06:48.551 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.551 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.551 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.551 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.551 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.551 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.551 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.551 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.551 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.552 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.552 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.552 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "test_orchestrator", 2024-05-08T06:06:48.552 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.552 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.552 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.552 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.552 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.552 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.552 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.552 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.552 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.552 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.552 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.552 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.552 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.553 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.553 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.553 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.553 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.553 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.553 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.553 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.553 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.553 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.553 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.553 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.553 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.553 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.553 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.553 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.553 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.554 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.554 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.554 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.554 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.554 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.554 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.554 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.554 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.554 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.554 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.554 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.554 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.554 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.554 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.554 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.554 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.554 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.555 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.555 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.555 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.555 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.555 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.555 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.555 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.555 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.555 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.555 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.555 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.555 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.555 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.555 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.555 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.555 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.555 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.556 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.556 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.556 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.556 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.556 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.556 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.556 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.556 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.556 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.556 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.556 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.556 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.556 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.556 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.556 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.556 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.557 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.557 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.557 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.557 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.557 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.557 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.557 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.557 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.557 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.557 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.557 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.557 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "volumes", 2024-05-08T06:06:48.557 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.557 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.557 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.557 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.557 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.558 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.558 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.558 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.558 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.558 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.558 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.558 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.558 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.558 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.558 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.558 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.558 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.558 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.558 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.558 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.558 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.558 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.559 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.559 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.559 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.559 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.559 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.559 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.559 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.559 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.559 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.559 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.559 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.559 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.559 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.559 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.559 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.559 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.559 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.560 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.560 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.560 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.560 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.560 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.560 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.560 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.560 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.560 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.560 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.560 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.560 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.560 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.560 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.560 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.560 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.561 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.561 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.561 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.561 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.561 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.561 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.561 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.561 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.561 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.561 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.561 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.561 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.561 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.561 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.561 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.561 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.562 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.562 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.562 INFO:teuthology.orchestra.run.smithi082.stdout: "max_concurrent_clones": { 2024-05-08T06:06:48.562 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_concurrent_clones", 2024-05-08T06:06:48.562 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.562 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.562 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.562 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "4", 2024-05-08T06:06:48.562 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.562 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.562 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.562 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Number of asynchronous cloner threads", 2024-05-08T06:06:48.562 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.562 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.562 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.562 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.563 INFO:teuthology.orchestra.run.smithi082.stdout: "periodic_async_work": { 2024-05-08T06:06:48.563 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "periodic_async_work", 2024-05-08T06:06:48.563 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.563 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.563 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.563 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.563 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.563 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.563 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.563 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Periodically check for async work", 2024-05-08T06:06:48.563 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.563 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.563 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.563 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.563 INFO:teuthology.orchestra.run.smithi082.stdout: "snapshot_clone_delay": { 2024-05-08T06:06:48.563 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "snapshot_clone_delay", 2024-05-08T06:06:48.563 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.564 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.564 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.564 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.564 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.564 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.564 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.564 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-05-08T06:06:48.564 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.564 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.564 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.564 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.564 INFO:teuthology.orchestra.run.smithi082.stdout: "snapshot_clone_no_wait": { 2024-05-08T06:06:48.564 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "snapshot_clone_no_wait", 2024-05-08T06:06:48.564 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.564 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.564 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.564 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.565 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.565 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.565 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.565 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-05-08T06:06:48.565 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.565 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.565 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.565 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.565 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.565 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.565 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.565 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.565 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.565 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.565 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.565 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.566 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.566 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.566 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.566 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.566 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.566 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.566 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.566 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.566 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.566 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix", 2024-05-08T06:06:48.566 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.566 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.566 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.566 INFO:teuthology.orchestra.run.smithi082.stdout: "discovery_interval": { 2024-05-08T06:06:48.566 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "discovery_interval", 2024-05-08T06:06:48.566 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-05-08T06:06:48.567 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.567 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.567 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "100", 2024-05-08T06:06:48.567 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.567 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.567 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.567 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.567 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.567 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.567 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.567 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.567 INFO:teuthology.orchestra.run.smithi082.stdout: "identifier": { 2024-05-08T06:06:48.567 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "identifier", 2024-05-08T06:06:48.567 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.567 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.567 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.567 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.568 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.568 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.568 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.568 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.568 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.568 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.568 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.568 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.568 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-05-08T06:06:48.568 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-05-08T06:06:48.568 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:48.568 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.568 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.568 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-05-08T06:06:48.568 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.568 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.568 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.569 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.569 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.569 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.569 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.569 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.569 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.569 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.569 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.569 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.569 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.569 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.569 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.569 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.569 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.569 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.569 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.569 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.570 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.570 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.570 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.570 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.570 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.570 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.570 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.570 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.570 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.570 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.571 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.571 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.571 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.571 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.571 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.571 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.571 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.571 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.571 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.571 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.571 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.571 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.571 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.572 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.572 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.572 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.572 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.572 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.572 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.572 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.572 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.572 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.572 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.572 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.572 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.572 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.572 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.572 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.572 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.573 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.573 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.573 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.573 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.573 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.573 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.573 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.573 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.573 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.573 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.573 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.573 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.573 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.573 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.573 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.574 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.574 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.574 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.574 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.574 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.574 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.574 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.574 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.574 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.574 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.574 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.574 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.574 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.574 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.575 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.575 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.575 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.575 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.575 INFO:teuthology.orchestra.run.smithi082.stdout: "zabbix_host": { 2024-05-08T06:06:48.575 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix_host", 2024-05-08T06:06:48.575 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.575 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.575 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.575 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.575 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.575 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.575 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.575 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.575 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.575 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.576 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.576 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.576 INFO:teuthology.orchestra.run.smithi082.stdout: "zabbix_port": { 2024-05-08T06:06:48.576 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix_port", 2024-05-08T06:06:48.576 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.576 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.576 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.576 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10051", 2024-05-08T06:06:48.576 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.576 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.576 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.576 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.576 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.576 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.577 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.577 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.577 INFO:teuthology.orchestra.run.smithi082.stdout: "zabbix_sender": { 2024-05-08T06:06:48.577 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix_sender", 2024-05-08T06:06:48.577 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.577 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.577 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.577 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-05-08T06:06:48.577 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.577 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.577 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.577 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.577 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.577 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.577 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.578 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.578 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.578 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.578 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-05-08T06:06:48.578 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.578 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.578 INFO:teuthology.orchestra.run.smithi082.stdout: "modules": [ 2024-05-08T06:06:48.578 INFO:teuthology.orchestra.run.smithi082.stdout: "cephadm", 2024-05-08T06:06:48.578 INFO:teuthology.orchestra.run.smithi082.stdout: "dashboard", 2024-05-08T06:06:48.578 INFO:teuthology.orchestra.run.smithi082.stdout: "iostat", 2024-05-08T06:06:48.578 INFO:teuthology.orchestra.run.smithi082.stdout: "nfs", 2024-05-08T06:06:48.578 INFO:teuthology.orchestra.run.smithi082.stdout: "restful" 2024-05-08T06:06:48.578 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.578 INFO:teuthology.orchestra.run.smithi082.stdout: "available_modules": [ 2024-05-08T06:06:48.579 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.579 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "alerts", 2024-05-08T06:06:48.579 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.579 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.579 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.579 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-05-08T06:06:48.579 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-05-08T06:06:48.579 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:48.579 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.579 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.579 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-05-08T06:06:48.579 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.579 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.579 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.579 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How frequently to reexamine health status", 2024-05-08T06:06:48.580 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.580 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.580 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.580 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.580 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.580 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.580 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.580 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.580 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.580 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.580 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.580 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.580 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.580 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.580 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.580 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.580 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.581 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.581 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.581 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.581 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.581 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.581 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.581 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.581 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.581 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.581 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.581 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.581 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.581 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.581 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.581 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.581 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.582 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.582 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.582 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.582 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.582 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.582 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.582 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.582 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.582 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.582 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.582 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.582 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.582 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.582 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.582 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.583 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.583 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.583 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.583 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.583 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.583 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.583 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.583 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.583 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.583 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.583 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.583 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.583 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.583 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.583 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.584 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.584 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.584 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.584 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.584 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.584 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.584 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.584 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.584 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.584 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.584 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.584 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_destination": { 2024-05-08T06:06:48.584 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_destination", 2024-05-08T06:06:48.584 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.584 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.584 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.585 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.585 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.585 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.585 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.585 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Email address to send alerts to", 2024-05-08T06:06:48.585 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.585 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.585 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.585 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.585 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_from_name": { 2024-05-08T06:06:48.585 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_from_name", 2024-05-08T06:06:48.585 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.585 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.585 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.585 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "Ceph", 2024-05-08T06:06:48.585 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.585 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.586 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.586 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Email From: name", 2024-05-08T06:06:48.586 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.586 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.586 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.586 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.586 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_host": { 2024-05-08T06:06:48.586 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_host", 2024-05-08T06:06:48.586 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.586 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.586 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.586 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.586 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.586 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.587 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.587 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SMTP server", 2024-05-08T06:06:48.587 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.587 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.587 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.587 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.587 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_password": { 2024-05-08T06:06:48.587 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_password", 2024-05-08T06:06:48.587 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.587 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.587 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.587 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.587 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.587 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.587 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.587 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Password to authenticate with", 2024-05-08T06:06:48.588 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.588 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.588 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.588 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.588 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_port": { 2024-05-08T06:06:48.588 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_port", 2024-05-08T06:06:48.588 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.588 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.588 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.588 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "465", 2024-05-08T06:06:48.588 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.588 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.588 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.588 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SMTP port", 2024-05-08T06:06:48.588 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.588 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.588 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.589 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.589 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_sender": { 2024-05-08T06:06:48.589 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_sender", 2024-05-08T06:06:48.589 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.589 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.589 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.589 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.589 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.589 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.589 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.589 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SMTP envelope sender", 2024-05-08T06:06:48.589 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.589 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.589 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.590 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.590 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_ssl": { 2024-05-08T06:06:48.590 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_ssl", 2024-05-08T06:06:48.590 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.590 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.590 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.590 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.590 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.590 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.590 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.590 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use SSL to connect to SMTP server", 2024-05-08T06:06:48.590 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.590 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.590 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.590 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.591 INFO:teuthology.orchestra.run.smithi082.stdout: "smtp_user": { 2024-05-08T06:06:48.591 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smtp_user", 2024-05-08T06:06:48.591 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.591 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.591 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.591 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.591 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.591 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.591 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.591 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "User to authenticate as", 2024-05-08T06:06:48.591 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.591 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.591 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.591 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.591 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.591 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.592 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.592 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.592 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.592 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.592 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.592 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.592 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.592 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.592 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.592 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.592 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.592 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.592 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.592 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.592 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.592 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "balancer", 2024-05-08T06:06:48.592 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.593 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.593 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.593 INFO:teuthology.orchestra.run.smithi082.stdout: "active": { 2024-05-08T06:06:48.593 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "active", 2024-05-08T06:06:48.593 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.593 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.593 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.593 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.593 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.593 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.593 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.593 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "automatically balance PGs across cluster", 2024-05-08T06:06:48.593 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.593 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.593 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.594 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.594 INFO:teuthology.orchestra.run.smithi082.stdout: "begin_time": { 2024-05-08T06:06:48.594 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "begin_time", 2024-05-08T06:06:48.594 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.594 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.594 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.594 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0000", 2024-05-08T06:06:48.594 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.594 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.594 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.594 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "beginning time of day to automatically balance", 2024-05-08T06:06:48.594 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-08T06:06:48.594 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.594 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.595 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.595 INFO:teuthology.orchestra.run.smithi082.stdout: "begin_weekday": { 2024-05-08T06:06:48.595 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "begin_weekday", 2024-05-08T06:06:48.595 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-05-08T06:06:48.595 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.595 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.595 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.595 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "0", 2024-05-08T06:06:48.595 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "6", 2024-05-08T06:06:48.595 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.595 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-05-08T06:06:48.595 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-08T06:06:48.595 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.595 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.595 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.595 INFO:teuthology.orchestra.run.smithi082.stdout: "crush_compat_max_iterations": { 2024-05-08T06:06:48.596 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crush_compat_max_iterations", 2024-05-08T06:06:48.596 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-05-08T06:06:48.596 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.596 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.596 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "25", 2024-05-08T06:06:48.596 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-05-08T06:06:48.596 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "250", 2024-05-08T06:06:48.596 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.596 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-05-08T06:06:48.596 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.596 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.596 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.596 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.596 INFO:teuthology.orchestra.run.smithi082.stdout: "crush_compat_metrics": { 2024-05-08T06:06:48.596 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crush_compat_metrics", 2024-05-08T06:06:48.596 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.596 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.597 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.597 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "pgs,objects,bytes", 2024-05-08T06:06:48.597 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.597 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.597 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.597 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-05-08T06:06:48.597 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-05-08T06:06:48.597 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.597 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.597 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.597 INFO:teuthology.orchestra.run.smithi082.stdout: "crush_compat_step": { 2024-05-08T06:06:48.597 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crush_compat_step", 2024-05-08T06:06:48.597 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-05-08T06:06:48.597 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.597 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.598 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0.5", 2024-05-08T06:06:48.598 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "0.001", 2024-05-08T06:06:48.598 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "0.999", 2024-05-08T06:06:48.598 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.598 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "aggressiveness of optimization", 2024-05-08T06:06:48.598 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-05-08T06:06:48.598 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.598 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.598 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.598 INFO:teuthology.orchestra.run.smithi082.stdout: "end_time": { 2024-05-08T06:06:48.598 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "end_time", 2024-05-08T06:06:48.598 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.598 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.598 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.599 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "2359", 2024-05-08T06:06:48.599 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.599 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.599 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.599 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "ending time of day to automatically balance", 2024-05-08T06:06:48.599 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-08T06:06:48.599 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.599 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.599 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.599 INFO:teuthology.orchestra.run.smithi082.stdout: "end_weekday": { 2024-05-08T06:06:48.599 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "end_weekday", 2024-05-08T06:06:48.599 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-05-08T06:06:48.599 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.599 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.599 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.599 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "0", 2024-05-08T06:06:48.599 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "6", 2024-05-08T06:06:48.600 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.600 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-05-08T06:06:48.600 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-08T06:06:48.600 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.600 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.600 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.600 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.600 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.600 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.600 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.600 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.600 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.600 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.600 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.600 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.600 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.601 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.601 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.601 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.601 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.601 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.601 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.601 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.601 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.601 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.601 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.601 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.601 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.601 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.601 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.601 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.601 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.602 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.602 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.602 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.602 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.602 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.602 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.602 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.602 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.602 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.602 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.602 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.602 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.602 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.602 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.603 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.603 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.603 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.603 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.603 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.603 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.603 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.603 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.603 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.603 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.603 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.603 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.603 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.603 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.603 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.603 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.604 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.604 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.604 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.604 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.604 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.604 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.604 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.604 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.604 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.604 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.604 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.604 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.604 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.604 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.604 INFO:teuthology.orchestra.run.smithi082.stdout: "min_score": { 2024-05-08T06:06:48.604 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "min_score", 2024-05-08T06:06:48.605 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-05-08T06:06:48.605 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.605 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.605 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.605 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.605 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.605 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.605 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-05-08T06:06:48.605 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.605 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.605 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.605 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.605 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": { 2024-05-08T06:06:48.605 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mode", 2024-05-08T06:06:48.605 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.605 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.605 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.606 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "upmap", 2024-05-08T06:06:48.606 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.606 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.606 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.606 INFO:teuthology.orchestra.run.smithi082.stdout: "crush-compat", 2024-05-08T06:06:48.606 INFO:teuthology.orchestra.run.smithi082.stdout: "none", 2024-05-08T06:06:48.606 INFO:teuthology.orchestra.run.smithi082.stdout: "read", 2024-05-08T06:06:48.606 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap", 2024-05-08T06:06:48.606 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap-read" 2024-05-08T06:06:48.606 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.606 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Balancer mode", 2024-05-08T06:06:48.606 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.606 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.606 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.606 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.607 INFO:teuthology.orchestra.run.smithi082.stdout: "pool_ids": { 2024-05-08T06:06:48.607 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pool_ids", 2024-05-08T06:06:48.607 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.607 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.607 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.607 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.607 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.607 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.607 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.607 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-05-08T06:06:48.607 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.607 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.607 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.607 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.607 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-05-08T06:06:48.607 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-05-08T06:06:48.607 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:48.608 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.608 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.608 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-05-08T06:06:48.608 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.608 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.608 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.608 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-05-08T06:06:48.608 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.608 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.608 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.608 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.608 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.608 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.608 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.608 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.608 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.608 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.609 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.609 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.609 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.609 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.609 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.609 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.609 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.609 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.609 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap_max_deviation": { 2024-05-08T06:06:48.609 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "upmap_max_deviation", 2024-05-08T06:06:48.609 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.609 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.609 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.609 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-05-08T06:06:48.609 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-05-08T06:06:48.609 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.609 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.610 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "deviation below which no optimization is attempted", 2024-05-08T06:06:48.610 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-05-08T06:06:48.610 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.610 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.610 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.610 INFO:teuthology.orchestra.run.smithi082.stdout: "upmap_max_optimizations": { 2024-05-08T06:06:48.610 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "upmap_max_optimizations", 2024-05-08T06:06:48.610 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-05-08T06:06:48.610 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.610 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.610 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-05-08T06:06:48.610 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.610 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.610 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.610 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-05-08T06:06:48.611 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.611 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.611 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.611 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.611 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.611 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.611 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.611 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cephadm", 2024-05-08T06:06:48.611 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.611 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.611 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.611 INFO:teuthology.orchestra.run.smithi082.stdout: "agent_down_multiplier": { 2024-05-08T06:06:48.611 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "agent_down_multiplier", 2024-05-08T06:06:48.611 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-05-08T06:06:48.611 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.611 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.611 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "3.0", 2024-05-08T06:06:48.612 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.612 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.612 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.612 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-05-08T06:06:48.612 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.612 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.612 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.612 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.612 INFO:teuthology.orchestra.run.smithi082.stdout: "agent_refresh_rate": { 2024-05-08T06:06:48.612 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "agent_refresh_rate", 2024-05-08T06:06:48.612 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:48.612 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.612 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.612 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "20", 2024-05-08T06:06:48.612 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.612 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.612 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.612 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-05-08T06:06:48.613 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.613 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.613 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.613 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.613 INFO:teuthology.orchestra.run.smithi082.stdout: "agent_starting_port": { 2024-05-08T06:06:48.613 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "agent_starting_port", 2024-05-08T06:06:48.613 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.613 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.613 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.613 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "4721", 2024-05-08T06:06:48.613 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.613 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.613 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.613 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-05-08T06:06:48.613 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.613 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.614 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.614 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.614 INFO:teuthology.orchestra.run.smithi082.stdout: "allow_ptrace": { 2024-05-08T06:06:48.614 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "allow_ptrace", 2024-05-08T06:06:48.614 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.614 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.614 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.614 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.614 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.614 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.614 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.614 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-05-08T06:06:48.614 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-05-08T06:06:48.614 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.614 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.614 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.615 INFO:teuthology.orchestra.run.smithi082.stdout: "autotune_interval": { 2024-05-08T06:06:48.615 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "autotune_interval", 2024-05-08T06:06:48.615 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:48.615 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.615 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.615 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-05-08T06:06:48.615 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.615 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.615 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.615 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to autotune daemon memory", 2024-05-08T06:06:48.615 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.615 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.615 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.615 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.615 INFO:teuthology.orchestra.run.smithi082.stdout: "autotune_memory_target_ratio": { 2024-05-08T06:06:48.615 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "autotune_memory_target_ratio", 2024-05-08T06:06:48.616 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-05-08T06:06:48.616 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.616 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.616 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0.7", 2024-05-08T06:06:48.616 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.616 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.616 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.616 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-05-08T06:06:48.616 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.616 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.616 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.616 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.616 INFO:teuthology.orchestra.run.smithi082.stdout: "cephadm_log_destination": { 2024-05-08T06:06:48.616 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cephadm_log_destination", 2024-05-08T06:06:48.616 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.616 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.616 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.617 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.617 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.617 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.617 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.617 INFO:teuthology.orchestra.run.smithi082.stdout: "file", 2024-05-08T06:06:48.617 INFO:teuthology.orchestra.run.smithi082.stdout: "file,syslog", 2024-05-08T06:06:48.617 INFO:teuthology.orchestra.run.smithi082.stdout: "syslog" 2024-05-08T06:06:48.617 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.617 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-05-08T06:06:48.617 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.617 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.617 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.617 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.617 INFO:teuthology.orchestra.run.smithi082.stdout: "cgroups_split": { 2024-05-08T06:06:48.617 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cgroups_split", 2024-05-08T06:06:48.617 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.618 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.618 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.618 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.618 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.618 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.618 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.618 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-05-08T06:06:48.618 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.618 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.618 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.618 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.618 INFO:teuthology.orchestra.run.smithi082.stdout: "config_checks_enabled": { 2024-05-08T06:06:48.618 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "config_checks_enabled", 2024-05-08T06:06:48.618 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.618 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.618 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.619 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.619 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.619 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.619 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.619 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-05-08T06:06:48.619 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.619 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.619 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.619 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.619 INFO:teuthology.orchestra.run.smithi082.stdout: "config_dashboard": { 2024-05-08T06:06:48.619 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "config_dashboard", 2024-05-08T06:06:48.619 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.619 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.619 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.619 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.619 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.620 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.620 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.620 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-05-08T06:06:48.620 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.620 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.620 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.620 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.620 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_alertmanager": { 2024-05-08T06:06:48.620 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_alertmanager", 2024-05-08T06:06:48.620 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.620 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.620 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.620 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-05-08T06:06:48.620 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.620 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.620 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.621 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-05-08T06:06:48.621 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.621 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.621 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.621 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.621 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_base": { 2024-05-08T06:06:48.621 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_base", 2024-05-08T06:06:48.621 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.621 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.621 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.621 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/ceph", 2024-05-08T06:06:48.621 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.621 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.621 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.621 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Container image name, without the tag", 2024-05-08T06:06:48.621 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.621 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.622 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.622 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.622 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_elasticsearch": { 2024-05-08T06:06:48.622 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_elasticsearch", 2024-05-08T06:06:48.622 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.622 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.622 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.622 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-05-08T06:06:48.622 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.622 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.622 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.622 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "elasticsearch container image", 2024-05-08T06:06:48.622 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.622 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.622 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.622 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.623 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_grafana": { 2024-05-08T06:06:48.623 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_grafana", 2024-05-08T06:06:48.623 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.623 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.623 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.623 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-05-08T06:06:48.623 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.623 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.623 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.623 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-05-08T06:06:48.623 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.623 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.623 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.623 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.623 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_haproxy": { 2024-05-08T06:06:48.623 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_haproxy", 2024-05-08T06:06:48.623 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.624 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.624 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.624 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-05-08T06:06:48.624 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.624 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.624 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.624 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "HAproxy container image", 2024-05-08T06:06:48.624 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.624 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.624 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.624 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.624 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_jaeger_agent": { 2024-05-08T06:06:48.624 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_jaeger_agent", 2024-05-08T06:06:48.624 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.624 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.624 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.625 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-05-08T06:06:48.625 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.625 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.625 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.625 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Jaeger agent container image", 2024-05-08T06:06:48.625 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.625 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.625 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.625 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.625 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_jaeger_collector": { 2024-05-08T06:06:48.625 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_jaeger_collector", 2024-05-08T06:06:48.625 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.625 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.625 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.625 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-05-08T06:06:48.625 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.626 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.626 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.626 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Jaeger collector container image", 2024-05-08T06:06:48.626 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.626 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.626 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.626 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.626 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_jaeger_query": { 2024-05-08T06:06:48.626 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_jaeger_query", 2024-05-08T06:06:48.626 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.626 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.626 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.626 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-05-08T06:06:48.626 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.626 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.627 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.627 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Jaeger query container image", 2024-05-08T06:06:48.627 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.627 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.627 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.627 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.627 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_keepalived": { 2024-05-08T06:06:48.627 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_keepalived", 2024-05-08T06:06:48.627 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.627 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.627 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.627 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-05-08T06:06:48.627 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.627 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.627 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.628 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Keepalived container image", 2024-05-08T06:06:48.628 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.628 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.628 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.628 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.628 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_loki": { 2024-05-08T06:06:48.628 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_loki", 2024-05-08T06:06:48.628 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.628 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.628 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.628 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-05-08T06:06:48.628 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.628 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.628 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.628 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Loki container image", 2024-05-08T06:06:48.628 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.629 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.629 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.629 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.629 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_node_exporter": { 2024-05-08T06:06:48.629 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_node_exporter", 2024-05-08T06:06:48.629 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.629 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.629 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.629 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-05-08T06:06:48.629 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.629 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.629 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.629 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-05-08T06:06:48.629 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.629 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.629 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.630 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.630 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_nvmeof": { 2024-05-08T06:06:48.630 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_nvmeof", 2024-05-08T06:06:48.630 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.630 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.630 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.630 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-05-08T06:06:48.630 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.630 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.630 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.630 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Nvme-of container image", 2024-05-08T06:06:48.630 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.630 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.630 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.630 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.631 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_prometheus": { 2024-05-08T06:06:48.631 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_prometheus", 2024-05-08T06:06:48.631 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.631 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.631 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.631 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-05-08T06:06:48.631 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.631 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.631 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.631 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Prometheus container image", 2024-05-08T06:06:48.631 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.631 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.631 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.631 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.631 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_promtail": { 2024-05-08T06:06:48.631 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_promtail", 2024-05-08T06:06:48.632 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.632 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.632 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.632 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-05-08T06:06:48.632 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.632 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.632 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.632 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Promtail container image", 2024-05-08T06:06:48.632 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.632 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.632 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.632 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.632 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_samba": { 2024-05-08T06:06:48.632 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_samba", 2024-05-08T06:06:48.632 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.632 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.632 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.633 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-05-08T06:06:48.633 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.633 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.633 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.633 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Samba/SMB container image", 2024-05-08T06:06:48.633 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.633 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.633 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.633 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.633 INFO:teuthology.orchestra.run.smithi082.stdout: "container_image_snmp_gateway": { 2024-05-08T06:06:48.633 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_image_snmp_gateway", 2024-05-08T06:06:48.633 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.633 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.633 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.633 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-05-08T06:06:48.633 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.634 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.634 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.634 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "SNMP Gateway container image", 2024-05-08T06:06:48.634 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.634 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.634 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.634 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.634 INFO:teuthology.orchestra.run.smithi082.stdout: "container_init": { 2024-05-08T06:06:48.634 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "container_init", 2024-05-08T06:06:48.634 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.634 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.634 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.634 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.634 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.634 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.635 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.635 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Run podman/docker with `--init`", 2024-05-08T06:06:48.635 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.635 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.635 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.635 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.635 INFO:teuthology.orchestra.run.smithi082.stdout: "daemon_cache_timeout": { 2024-05-08T06:06:48.635 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "daemon_cache_timeout", 2024-05-08T06:06:48.635 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:48.635 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.635 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.635 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-05-08T06:06:48.635 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.635 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.635 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.635 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-05-08T06:06:48.636 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.636 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.636 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.636 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.636 INFO:teuthology.orchestra.run.smithi082.stdout: "default_cephadm_command_timeout": { 2024-05-08T06:06:48.636 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "default_cephadm_command_timeout", 2024-05-08T06:06:48.636 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.636 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.636 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.636 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "900", 2024-05-08T06:06:48.636 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.636 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.636 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.636 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-05-08T06:06:48.636 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.637 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.637 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.637 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.637 INFO:teuthology.orchestra.run.smithi082.stdout: "default_registry": { 2024-05-08T06:06:48.637 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "default_registry", 2024-05-08T06:06:48.637 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.637 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.637 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.637 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "docker.io", 2024-05-08T06:06:48.637 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.637 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.637 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.637 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-05-08T06:06:48.637 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.637 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.637 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.637 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.638 INFO:teuthology.orchestra.run.smithi082.stdout: "device_cache_timeout": { 2024-05-08T06:06:48.638 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "device_cache_timeout", 2024-05-08T06:06:48.638 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:48.638 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.638 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.638 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "1800", 2024-05-08T06:06:48.638 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.638 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.638 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.638 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "seconds to cache device inventory", 2024-05-08T06:06:48.638 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.638 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.638 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.638 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.638 INFO:teuthology.orchestra.run.smithi082.stdout: "device_enhanced_scan": { 2024-05-08T06:06:48.638 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "device_enhanced_scan", 2024-05-08T06:06:48.639 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.639 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.639 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.639 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.639 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.639 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.639 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.639 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use libstoragemgmt during device scans", 2024-05-08T06:06:48.639 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.639 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.639 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.639 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.639 INFO:teuthology.orchestra.run.smithi082.stdout: "facts_cache_timeout": { 2024-05-08T06:06:48.639 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "facts_cache_timeout", 2024-05-08T06:06:48.639 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:48.639 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.640 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.640 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-05-08T06:06:48.640 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.640 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.640 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.640 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "seconds to cache host facts data", 2024-05-08T06:06:48.640 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.640 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.640 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.640 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.640 INFO:teuthology.orchestra.run.smithi082.stdout: "grafana_dashboards_path": { 2024-05-08T06:06:48.640 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "grafana_dashboards_path", 2024-05-08T06:06:48.640 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.640 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.640 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.640 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-05-08T06:06:48.640 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.641 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.641 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.641 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-05-08T06:06:48.641 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.641 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.641 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.641 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.641 INFO:teuthology.orchestra.run.smithi082.stdout: "host_check_interval": { 2024-05-08T06:06:48.641 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "host_check_interval", 2024-05-08T06:06:48.641 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:48.641 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.641 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.641 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-05-08T06:06:48.641 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.641 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.641 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.642 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to perform a host check", 2024-05-08T06:06:48.642 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.642 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.642 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.642 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.642 INFO:teuthology.orchestra.run.smithi082.stdout: "hw_monitoring": { 2024-05-08T06:06:48.642 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "hw_monitoring", 2024-05-08T06:06:48.642 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.642 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.642 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.642 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.642 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.642 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.642 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.642 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-05-08T06:06:48.643 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.643 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.643 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.643 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.643 INFO:teuthology.orchestra.run.smithi082.stdout: "inventory_list_all": { 2024-05-08T06:06:48.643 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "inventory_list_all", 2024-05-08T06:06:48.643 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.643 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.643 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.643 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.643 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.643 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.643 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.643 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-05-08T06:06:48.643 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.643 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.643 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.644 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.644 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.644 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.644 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.644 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.644 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.644 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.644 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.644 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.644 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.644 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.644 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.644 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.644 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.644 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.644 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.645 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.645 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.645 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.645 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.645 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.645 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.645 INFO:teuthology.orchestra.run.smithi082.stdout: "log_refresh_metadata": { 2024-05-08T06:06:48.645 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_refresh_metadata", 2024-05-08T06:06:48.645 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.645 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.645 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.645 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.645 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.645 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.645 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.645 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-05-08T06:06:48.646 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.646 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.646 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.646 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.646 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.646 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.646 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.646 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.646 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.646 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.646 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.646 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.646 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.646 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-05-08T06:06:48.646 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.646 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.646 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.647 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.647 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.647 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.647 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.647 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.647 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.647 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.647 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.647 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.647 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.647 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.647 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.647 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.647 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.647 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.647 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.647 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.648 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.648 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.648 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.648 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.648 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.648 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.648 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.648 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.648 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.648 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.648 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.648 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.648 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.648 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.648 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.648 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.648 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.649 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.649 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.649 INFO:teuthology.orchestra.run.smithi082.stdout: "manage_etc_ceph_ceph_conf": { 2024-05-08T06:06:48.649 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-05-08T06:06:48.649 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.649 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.649 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.649 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.649 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.649 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.649 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.649 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-05-08T06:06:48.649 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.649 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.649 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.649 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.649 INFO:teuthology.orchestra.run.smithi082.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-05-08T06:06:48.650 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-05-08T06:06:48.650 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.650 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.650 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.650 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "*", 2024-05-08T06:06:48.650 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.650 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.650 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.650 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-05-08T06:06:48.650 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.650 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.650 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.650 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.650 INFO:teuthology.orchestra.run.smithi082.stdout: "max_count_per_host": { 2024-05-08T06:06:48.650 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_count_per_host", 2024-05-08T06:06:48.650 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.650 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.651 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.651 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-05-08T06:06:48.651 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.651 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.651 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.651 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "max number of daemons per service per host", 2024-05-08T06:06:48.651 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.651 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.651 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.651 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.651 INFO:teuthology.orchestra.run.smithi082.stdout: "max_osd_draining_count": { 2024-05-08T06:06:48.651 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_osd_draining_count", 2024-05-08T06:06:48.651 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.652 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.652 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.652 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-05-08T06:06:48.652 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.652 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.652 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.652 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-05-08T06:06:48.652 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.652 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.652 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.652 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.652 INFO:teuthology.orchestra.run.smithi082.stdout: "migration_current": { 2024-05-08T06:06:48.652 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "migration_current", 2024-05-08T06:06:48.652 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.652 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.653 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.653 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.653 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.653 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.653 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.653 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "internal - do not modify", 2024-05-08T06:06:48.653 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.653 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.653 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.653 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.653 INFO:teuthology.orchestra.run.smithi082.stdout: "mode": { 2024-05-08T06:06:48.653 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mode", 2024-05-08T06:06:48.653 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.653 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.653 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.653 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "root", 2024-05-08T06:06:48.653 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.654 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.654 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.654 INFO:teuthology.orchestra.run.smithi082.stdout: "cephadm-package", 2024-05-08T06:06:48.654 INFO:teuthology.orchestra.run.smithi082.stdout: "root" 2024-05-08T06:06:48.654 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.654 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "mode for remote execution of cephadm", 2024-05-08T06:06:48.654 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.654 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.654 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.654 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.654 INFO:teuthology.orchestra.run.smithi082.stdout: "oob_default_addr": { 2024-05-08T06:06:48.654 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "oob_default_addr", 2024-05-08T06:06:48.654 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.654 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.654 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.654 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "169.254.1.1", 2024-05-08T06:06:48.655 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.655 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.655 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.655 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Default address for RedFish API (oob management).", 2024-05-08T06:06:48.655 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.655 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.655 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.655 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.655 INFO:teuthology.orchestra.run.smithi082.stdout: "prometheus_alerts_path": { 2024-05-08T06:06:48.655 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "prometheus_alerts_path", 2024-05-08T06:06:48.655 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.655 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.655 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.655 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-05-08T06:06:48.655 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.655 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.655 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.656 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-05-08T06:06:48.656 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.656 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.656 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.656 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.656 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_insecure": { 2024-05-08T06:06:48.656 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_insecure", 2024-05-08T06:06:48.656 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.656 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.656 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.656 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.656 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.656 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.656 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.656 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-05-08T06:06:48.657 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.657 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.657 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.657 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.657 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_password": { 2024-05-08T06:06:48.657 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_password", 2024-05-08T06:06:48.657 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.657 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.657 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.657 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.657 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.657 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.657 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.657 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-05-08T06:06:48.657 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.657 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.658 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.658 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.658 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_url": { 2024-05-08T06:06:48.658 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_url", 2024-05-08T06:06:48.658 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.658 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.658 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.658 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.658 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.658 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.658 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.658 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-05-08T06:06:48.658 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.658 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.658 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.658 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.659 INFO:teuthology.orchestra.run.smithi082.stdout: "registry_username": { 2024-05-08T06:06:48.659 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "registry_username", 2024-05-08T06:06:48.659 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.659 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.659 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.659 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.659 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.659 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.659 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.659 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-05-08T06:06:48.659 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.659 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.659 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.659 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.659 INFO:teuthology.orchestra.run.smithi082.stdout: "secure_monitoring_stack": { 2024-05-08T06:06:48.659 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "secure_monitoring_stack", 2024-05-08T06:06:48.659 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.660 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.660 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.660 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.660 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.660 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.660 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.660 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-05-08T06:06:48.660 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.660 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.660 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.660 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.660 INFO:teuthology.orchestra.run.smithi082.stdout: "service_discovery_port": { 2024-05-08T06:06:48.660 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "service_discovery_port", 2024-05-08T06:06:48.660 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.660 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.660 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.661 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8765", 2024-05-08T06:06:48.661 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.661 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.661 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.661 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "cephadm service discovery port", 2024-05-08T06:06:48.661 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.661 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.661 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.661 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.661 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.661 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.661 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.661 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.661 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.661 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.661 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.662 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.662 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.662 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.662 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.662 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.662 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.662 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.662 INFO:teuthology.orchestra.run.smithi082.stdout: "ssh_config_file": { 2024-05-08T06:06:48.662 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssh_config_file", 2024-05-08T06:06:48.662 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.662 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.662 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.662 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.662 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.663 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.663 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.663 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-05-08T06:06:48.663 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.663 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.663 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.663 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.663 INFO:teuthology.orchestra.run.smithi082.stdout: "use_agent": { 2024-05-08T06:06:48.663 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "use_agent", 2024-05-08T06:06:48.663 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.663 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.663 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.663 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.663 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.664 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.664 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.664 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-05-08T06:06:48.664 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.664 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.664 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.664 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.664 INFO:teuthology.orchestra.run.smithi082.stdout: "use_repo_digest": { 2024-05-08T06:06:48.664 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "use_repo_digest", 2024-05-08T06:06:48.664 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.664 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.664 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.664 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.664 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.664 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.664 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.665 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-05-08T06:06:48.665 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.665 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.665 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.665 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.665 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_on_failed_host_check": { 2024-05-08T06:06:48.665 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_on_failed_host_check", 2024-05-08T06:06:48.665 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.665 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.665 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.665 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.665 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.665 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.665 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.665 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise a health warning if the host check fails", 2024-05-08T06:06:48.666 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.666 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.666 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.666 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.666 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_on_stray_daemons": { 2024-05-08T06:06:48.666 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_on_stray_daemons", 2024-05-08T06:06:48.666 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.666 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.666 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.666 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.666 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.666 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.666 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.666 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-05-08T06:06:48.667 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.667 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.667 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.667 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.667 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_on_stray_hosts": { 2024-05-08T06:06:48.667 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_on_stray_hosts", 2024-05-08T06:06:48.667 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.667 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.667 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.667 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.667 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.667 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.667 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.667 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-05-08T06:06:48.667 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.668 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.668 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.668 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.668 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.668 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.668 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.668 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crash", 2024-05-08T06:06:48.668 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.668 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.668 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.668 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.668 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.668 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.668 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.668 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.669 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.669 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.669 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.669 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.669 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.669 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.669 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.669 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.669 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.669 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.669 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.669 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.669 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.669 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.669 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.670 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.670 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.670 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.670 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.670 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.670 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.670 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.670 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.670 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.670 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.670 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.670 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.670 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.670 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.671 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.671 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.671 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.671 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.671 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.671 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.671 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.671 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.671 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.671 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.671 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.671 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.671 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.671 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.671 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.672 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.672 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.672 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.672 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.672 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.672 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.672 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.672 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.672 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.672 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.672 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.672 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.672 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.672 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.672 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.672 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.673 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.673 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.673 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.673 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.673 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.673 INFO:teuthology.orchestra.run.smithi082.stdout: "retain_interval": { 2024-05-08T06:06:48.673 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "retain_interval", 2024-05-08T06:06:48.673 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:48.673 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.673 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.673 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "31536000", 2024-05-08T06:06:48.673 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.673 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.673 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.673 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how long to retain crashes before pruning them", 2024-05-08T06:06:48.674 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.674 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.674 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.674 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.674 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.674 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.674 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.674 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.674 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.674 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.674 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.674 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.674 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.674 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.675 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.677 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.677 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.677 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.677 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_recent_interval": { 2024-05-08T06:06:48.678 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_recent_interval", 2024-05-08T06:06:48.678 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:48.678 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.678 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.678 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "1209600", 2024-05-08T06:06:48.678 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.678 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.678 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.678 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "time interval in which to warn about recent crashes", 2024-05-08T06:06:48.678 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.678 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.678 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.678 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.679 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.679 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.679 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.679 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "dashboard", 2024-05-08T06:06:48.679 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.679 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.679 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.679 INFO:teuthology.orchestra.run.smithi082.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-05-08T06:06:48.679 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-05-08T06:06:48.679 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.679 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.679 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.679 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-05-08T06:06:48.679 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.679 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.679 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.680 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.680 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.680 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.680 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.680 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.680 INFO:teuthology.orchestra.run.smithi082.stdout: "ALERTMANAGER_API_HOST": { 2024-05-08T06:06:48.680 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ALERTMANAGER_API_HOST", 2024-05-08T06:06:48.680 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.680 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.680 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.680 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.680 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.680 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.680 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.680 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.680 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.681 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.681 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.681 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.681 INFO:teuthology.orchestra.run.smithi082.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-05-08T06:06:48.681 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-05-08T06:06:48.681 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.681 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.681 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.681 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.681 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.681 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.681 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.681 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.681 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.681 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.681 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.682 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.682 INFO:teuthology.orchestra.run.smithi082.stdout: "AUDIT_API_ENABLED": { 2024-05-08T06:06:48.682 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "AUDIT_API_ENABLED", 2024-05-08T06:06:48.682 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.682 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.682 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.682 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.682 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.682 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.682 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.682 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.682 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.682 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.682 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.682 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.683 INFO:teuthology.orchestra.run.smithi082.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-05-08T06:06:48.683 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-05-08T06:06:48.683 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.683 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.683 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.683 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.683 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.683 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.683 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.683 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.683 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.683 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.683 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.683 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.683 INFO:teuthology.orchestra.run.smithi082.stdout: "ENABLE_BROWSABLE_API": { 2024-05-08T06:06:48.684 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ENABLE_BROWSABLE_API", 2024-05-08T06:06:48.684 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.684 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.684 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.684 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.684 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.684 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.684 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.684 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.684 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.684 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.684 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.684 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.684 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-05-08T06:06:48.684 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-05-08T06:06:48.685 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.685 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.685 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.685 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.685 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.685 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.685 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.685 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.685 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.685 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.685 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.685 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.685 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-05-08T06:06:48.685 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-05-08T06:06:48.685 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.685 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.686 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.686 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.686 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.686 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.686 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.686 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.686 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.686 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.686 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.686 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.686 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-05-08T06:06:48.686 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-05-08T06:06:48.686 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.686 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.686 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.687 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.687 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.687 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.687 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.687 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.687 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.687 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.687 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.687 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.687 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-05-08T06:06:48.687 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-05-08T06:06:48.687 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.687 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.687 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.687 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.687 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.688 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.688 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.688 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.688 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.688 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.688 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.688 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.688 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_NFS": { 2024-05-08T06:06:48.688 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-05-08T06:06:48.688 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.688 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.688 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.688 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.688 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.688 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.689 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.689 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.689 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.689 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.689 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.689 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.689 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_RBD": { 2024-05-08T06:06:48.689 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-05-08T06:06:48.689 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.689 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.689 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.689 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.689 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.689 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.689 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.689 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.690 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.690 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.690 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.690 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.690 INFO:teuthology.orchestra.run.smithi082.stdout: "FEATURE_TOGGLE_RGW": { 2024-05-08T06:06:48.690 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-05-08T06:06:48.690 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.690 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.690 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.690 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.690 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.690 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.690 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.690 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.690 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.691 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.691 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.691 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.691 INFO:teuthology.orchestra.run.smithi082.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-05-08T06:06:48.691 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-05-08T06:06:48.691 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.691 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.691 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.691 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.691 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.691 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.691 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.691 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.691 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.692 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.692 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.692 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.692 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_PASSWORD": { 2024-05-08T06:06:48.692 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_PASSWORD", 2024-05-08T06:06:48.692 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.692 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.692 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.692 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "admin", 2024-05-08T06:06:48.692 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.692 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.692 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.692 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.692 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.692 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.692 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.693 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.693 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-05-08T06:06:48.693 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-05-08T06:06:48.693 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.693 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.693 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.693 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.693 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.693 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.693 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.693 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.693 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.693 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.693 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.693 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.693 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_URL": { 2024-05-08T06:06:48.694 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_URL", 2024-05-08T06:06:48.694 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.694 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.694 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.694 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.694 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.694 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.694 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.694 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.694 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.694 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.694 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.694 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.694 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_API_USERNAME": { 2024-05-08T06:06:48.695 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_API_USERNAME", 2024-05-08T06:06:48.695 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.695 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.695 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.695 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "admin", 2024-05-08T06:06:48.695 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.695 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.695 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.695 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.695 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.695 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.695 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.695 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.695 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-05-08T06:06:48.695 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-05-08T06:06:48.695 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.696 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.696 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.696 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.696 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.696 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.696 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.696 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.696 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.696 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.696 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.696 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.696 INFO:teuthology.orchestra.run.smithi082.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-05-08T06:06:48.696 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-05-08T06:06:48.696 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.696 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.696 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.697 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.697 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.697 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.697 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.697 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.697 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.697 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.697 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.697 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.697 INFO:teuthology.orchestra.run.smithi082.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-05-08T06:06:48.697 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-05-08T06:06:48.697 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.697 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.697 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.697 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.698 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.698 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.698 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.698 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.698 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.698 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.698 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.698 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.698 INFO:teuthology.orchestra.run.smithi082.stdout: "ISSUE_TRACKER_API_KEY": { 2024-05-08T06:06:48.698 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-05-08T06:06:48.698 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.698 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.698 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.698 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.698 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.699 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.699 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.699 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.699 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.699 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.699 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.699 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.699 INFO:teuthology.orchestra.run.smithi082.stdout: "MANAGED_BY_CLUSTERS": { 2024-05-08T06:06:48.699 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-05-08T06:06:48.699 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.699 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.699 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.699 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "[]", 2024-05-08T06:06:48.699 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.699 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.699 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.699 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.700 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.700 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.700 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.700 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.700 INFO:teuthology.orchestra.run.smithi082.stdout: "MULTICLUSTER_CONFIG": { 2024-05-08T06:06:48.700 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "MULTICLUSTER_CONFIG", 2024-05-08T06:06:48.700 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.700 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.700 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.700 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "{}", 2024-05-08T06:06:48.700 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.700 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.700 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.700 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.700 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.700 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.700 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.701 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.701 INFO:teuthology.orchestra.run.smithi082.stdout: "PROMETHEUS_API_HOST": { 2024-05-08T06:06:48.701 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PROMETHEUS_API_HOST", 2024-05-08T06:06:48.701 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.701 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.701 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.701 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.701 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.701 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.701 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.701 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.701 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.701 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.701 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.701 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.701 INFO:teuthology.orchestra.run.smithi082.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-05-08T06:06:48.702 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-05-08T06:06:48.702 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.702 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.702 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.702 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.702 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.702 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.702 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.702 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.702 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.702 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.702 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.702 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.702 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-05-08T06:06:48.702 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-05-08T06:06:48.703 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.703 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.703 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.703 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.703 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.703 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.703 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.703 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.703 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.703 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.703 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.703 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.703 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-05-08T06:06:48.703 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-05-08T06:06:48.703 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.704 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.704 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.704 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.704 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.704 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.704 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.704 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.704 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.704 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.704 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.704 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.704 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-05-08T06:06:48.704 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-05-08T06:06:48.704 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.704 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.704 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.705 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.705 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.705 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.705 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.705 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.705 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.705 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.705 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.705 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.705 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-05-08T06:06:48.705 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-05-08T06:06:48.705 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.705 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.705 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.705 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.705 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.705 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.706 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.706 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.706 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.706 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.706 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.706 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.706 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-05-08T06:06:48.706 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-05-08T06:06:48.706 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.706 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.706 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.706 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.706 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.706 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.707 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.707 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.707 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.707 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.707 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.707 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.707 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-05-08T06:06:48.707 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-05-08T06:06:48.707 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.707 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.707 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.707 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.707 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.707 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.707 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.707 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.708 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.708 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.708 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.708 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.708 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-05-08T06:06:48.708 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-05-08T06:06:48.708 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.708 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.708 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.708 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.708 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.708 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.708 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.708 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.708 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.708 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.708 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.709 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.709 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_ENABLED": { 2024-05-08T06:06:48.709 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_ENABLED", 2024-05-08T06:06:48.709 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.709 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.709 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.709 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.709 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.709 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.709 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.709 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.709 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.709 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.709 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.709 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.709 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-05-08T06:06:48.710 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-05-08T06:06:48.710 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.710 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.710 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.710 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-05-08T06:06:48.710 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.710 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.710 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.710 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.710 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.710 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.710 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.710 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.710 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-05-08T06:06:48.710 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-05-08T06:06:48.710 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.711 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.711 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.711 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-05-08T06:06:48.711 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.711 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.711 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.711 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.711 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.711 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.711 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.711 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.711 INFO:teuthology.orchestra.run.smithi082.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-05-08T06:06:48.711 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-05-08T06:06:48.711 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.711 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.711 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.712 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8", 2024-05-08T06:06:48.712 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.712 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.712 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.712 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.712 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.712 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.712 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.712 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.712 INFO:teuthology.orchestra.run.smithi082.stdout: "REST_REQUESTS_TIMEOUT": { 2024-05-08T06:06:48.712 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-05-08T06:06:48.712 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.712 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.712 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.712 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "45", 2024-05-08T06:06:48.712 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.713 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.713 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.713 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.713 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.713 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.713 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.713 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.713 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_ACCESS_KEY": { 2024-05-08T06:06:48.713 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_ACCESS_KEY", 2024-05-08T06:06:48.713 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.713 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.713 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.713 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.713 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.713 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.713 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.713 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.714 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.714 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.714 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.714 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.714 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-05-08T06:06:48.714 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-05-08T06:06:48.714 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.714 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.714 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.714 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "admin", 2024-05-08T06:06:48.714 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.714 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.714 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.714 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.714 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.714 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.715 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.715 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.715 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_SECRET_KEY": { 2024-05-08T06:06:48.715 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_SECRET_KEY", 2024-05-08T06:06:48.715 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.715 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.715 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.715 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.715 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.715 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.715 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.715 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.715 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.715 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.715 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.715 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.716 INFO:teuthology.orchestra.run.smithi082.stdout: "RGW_API_SSL_VERIFY": { 2024-05-08T06:06:48.716 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "RGW_API_SSL_VERIFY", 2024-05-08T06:06:48.716 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.716 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.716 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.716 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.716 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.716 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.716 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.716 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.716 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.716 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.716 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.716 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.716 INFO:teuthology.orchestra.run.smithi082.stdout: "UNSAFE_TLS_v1_2": { 2024-05-08T06:06:48.716 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "UNSAFE_TLS_v1_2", 2024-05-08T06:06:48.717 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.717 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.717 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.717 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.717 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.717 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.717 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.717 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.717 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.717 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.717 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.717 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.717 INFO:teuthology.orchestra.run.smithi082.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-05-08T06:06:48.717 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-05-08T06:06:48.717 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.717 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.718 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.718 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.718 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.718 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.718 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.718 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.718 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.718 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.718 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.718 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.718 INFO:teuthology.orchestra.run.smithi082.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-05-08T06:06:48.718 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-05-08T06:06:48.718 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.718 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.718 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.719 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-05-08T06:06:48.719 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.719 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.719 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.719 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.719 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.719 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.719 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.719 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.719 INFO:teuthology.orchestra.run.smithi082.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-05-08T06:06:48.719 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-05-08T06:06:48.719 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.719 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.719 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.719 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-05-08T06:06:48.719 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.719 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.720 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.720 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.720 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.720 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.720 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.720 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.720 INFO:teuthology.orchestra.run.smithi082.stdout: "cross_origin_url": { 2024-05-08T06:06:48.720 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cross_origin_url", 2024-05-08T06:06:48.720 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.720 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.720 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.720 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.720 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.720 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.720 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.721 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.721 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.721 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.721 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.721 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.721 INFO:teuthology.orchestra.run.smithi082.stdout: "crt_file": { 2024-05-08T06:06:48.721 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "crt_file", 2024-05-08T06:06:48.721 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.721 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.721 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.721 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.721 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.721 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.721 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.721 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.721 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.721 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.722 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.722 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.722 INFO:teuthology.orchestra.run.smithi082.stdout: "debug": { 2024-05-08T06:06:48.722 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "debug", 2024-05-08T06:06:48.722 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.722 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.722 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.722 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.722 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.722 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.722 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.722 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Enable/disable debug options", 2024-05-08T06:06:48.722 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.722 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.722 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.723 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.723 INFO:teuthology.orchestra.run.smithi082.stdout: "jwt_token_ttl": { 2024-05-08T06:06:48.723 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "jwt_token_ttl", 2024-05-08T06:06:48.723 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.723 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.723 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.723 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "28800", 2024-05-08T06:06:48.723 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.723 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.723 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.723 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.723 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.723 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.723 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.723 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.723 INFO:teuthology.orchestra.run.smithi082.stdout: "key_file": { 2024-05-08T06:06:48.723 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "key_file", 2024-05-08T06:06:48.724 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.724 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.724 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.724 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.724 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.724 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.724 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.724 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.724 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.724 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.724 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.724 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.724 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.724 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.724 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.724 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.725 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.725 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.725 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.725 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.725 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.725 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.725 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.725 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.725 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.725 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.725 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.725 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.725 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.725 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.725 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.725 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.726 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.726 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.726 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.726 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.726 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.726 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.726 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.726 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.726 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.726 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.726 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.726 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.726 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.726 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.726 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.727 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.727 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.727 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.727 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.727 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.727 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.727 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.727 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.727 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.727 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.727 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.727 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.727 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.727 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.727 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.728 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.728 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.728 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.728 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.728 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.728 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.728 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.728 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.728 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.728 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.728 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.728 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.728 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.728 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.728 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.729 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.729 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.729 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.729 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.729 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.729 INFO:teuthology.orchestra.run.smithi082.stdout: "motd": { 2024-05-08T06:06:48.729 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "motd", 2024-05-08T06:06:48.729 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.729 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.729 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.729 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.729 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.729 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.729 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.729 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "The message of the day", 2024-05-08T06:06:48.729 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.730 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.730 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.730 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.730 INFO:teuthology.orchestra.run.smithi082.stdout: "redirect_resolve_ip_addr": { 2024-05-08T06:06:48.730 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "redirect_resolve_ip_addr", 2024-05-08T06:06:48.730 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.730 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.730 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.730 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.730 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.730 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.730 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.730 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.730 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.730 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.731 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.731 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.731 INFO:teuthology.orchestra.run.smithi082.stdout: "server_addr": { 2024-05-08T06:06:48.731 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_addr", 2024-05-08T06:06:48.731 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.731 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.731 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.731 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "::", 2024-05-08T06:06:48.731 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.731 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.731 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.731 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.731 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.731 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.731 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.731 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.731 INFO:teuthology.orchestra.run.smithi082.stdout: "server_port": { 2024-05-08T06:06:48.732 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_port", 2024-05-08T06:06:48.732 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.732 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.732 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.732 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8080", 2024-05-08T06:06:48.732 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.732 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.732 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.732 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.732 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.732 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.732 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.732 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.732 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.732 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.732 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.732 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.733 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.733 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.733 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.733 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.733 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.733 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.733 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.733 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.733 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.733 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.733 INFO:teuthology.orchestra.run.smithi082.stdout: "ssl": { 2024-05-08T06:06:48.733 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssl", 2024-05-08T06:06:48.733 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.733 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.733 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.733 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.733 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.734 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.734 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.734 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.734 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.734 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.734 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.734 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.734 INFO:teuthology.orchestra.run.smithi082.stdout: "ssl_server_port": { 2024-05-08T06:06:48.734 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssl_server_port", 2024-05-08T06:06:48.734 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.734 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.734 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.734 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8443", 2024-05-08T06:06:48.734 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.734 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.735 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.735 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.735 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.735 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.735 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.735 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.735 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_behaviour": { 2024-05-08T06:06:48.735 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_behaviour", 2024-05-08T06:06:48.735 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.735 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.735 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.735 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "redirect", 2024-05-08T06:06:48.735 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.735 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.735 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.735 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.735 INFO:teuthology.orchestra.run.smithi082.stdout: "redirect" 2024-05-08T06:06:48.736 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.736 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.736 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.736 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.736 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.736 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.736 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_error_status_code": { 2024-05-08T06:06:48.736 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_error_status_code", 2024-05-08T06:06:48.736 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.736 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.736 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.736 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "500", 2024-05-08T06:06:48.736 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "400", 2024-05-08T06:06:48.736 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "599", 2024-05-08T06:06:48.736 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.737 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.737 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.737 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.737 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.737 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.737 INFO:teuthology.orchestra.run.smithi082.stdout: "url_prefix": { 2024-05-08T06:06:48.737 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "url_prefix", 2024-05-08T06:06:48.737 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.737 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.737 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.737 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.737 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.737 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.737 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.737 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.737 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.737 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.738 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.738 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.738 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.738 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.738 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.738 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "devicehealth", 2024-05-08T06:06:48.738 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.738 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.738 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.738 INFO:teuthology.orchestra.run.smithi082.stdout: "enable_monitoring": { 2024-05-08T06:06:48.738 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enable_monitoring", 2024-05-08T06:06:48.738 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.738 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.738 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.738 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.738 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.739 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.739 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.739 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "monitor device health metrics", 2024-05-08T06:06:48.739 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.739 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.739 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.739 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.739 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.739 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.739 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.739 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.739 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.739 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.739 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.739 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.739 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.739 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.740 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.740 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.740 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.740 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.740 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.740 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.740 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.740 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.740 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.740 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.740 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.740 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.740 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.740 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.740 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.740 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.741 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.741 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.741 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.741 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.741 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.741 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.741 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.741 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.741 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.741 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.741 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.741 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.741 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.741 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.741 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.741 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.741 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.742 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.742 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.742 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.742 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.742 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.742 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.742 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.742 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.742 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.742 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.742 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.742 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.742 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.742 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.742 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.742 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.743 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.743 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.743 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.743 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.743 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.743 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.743 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.743 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.743 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.743 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.743 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.743 INFO:teuthology.orchestra.run.smithi082.stdout: "mark_out_threshold": { 2024-05-08T06:06:48.743 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mark_out_threshold", 2024-05-08T06:06:48.743 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:48.743 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.743 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.744 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "2419200", 2024-05-08T06:06:48.744 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.744 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.744 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.744 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-05-08T06:06:48.744 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.744 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.744 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.744 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.744 INFO:teuthology.orchestra.run.smithi082.stdout: "pool_name": { 2024-05-08T06:06:48.744 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pool_name", 2024-05-08T06:06:48.744 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.744 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.744 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.744 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "device_health_metrics", 2024-05-08T06:06:48.744 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.744 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.745 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.745 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "name of pool in which to store device health metrics", 2024-05-08T06:06:48.745 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.745 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.745 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.745 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.745 INFO:teuthology.orchestra.run.smithi082.stdout: "retention_period": { 2024-05-08T06:06:48.745 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "retention_period", 2024-05-08T06:06:48.745 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:48.745 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.745 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.745 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "15552000", 2024-05-08T06:06:48.745 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.745 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.745 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.745 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how long to retain device health metrics", 2024-05-08T06:06:48.746 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.746 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.746 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.746 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.746 INFO:teuthology.orchestra.run.smithi082.stdout: "scrape_frequency": { 2024-05-08T06:06:48.746 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "scrape_frequency", 2024-05-08T06:06:48.746 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:48.746 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.746 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.746 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "86400", 2024-05-08T06:06:48.746 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.746 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.746 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.746 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to scrape device health metrics", 2024-05-08T06:06:48.746 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.747 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.747 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.747 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.747 INFO:teuthology.orchestra.run.smithi082.stdout: "self_heal": { 2024-05-08T06:06:48.747 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "self_heal", 2024-05-08T06:06:48.747 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.747 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.747 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.747 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.747 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.747 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.748 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.748 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-05-08T06:06:48.748 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.748 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.748 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.748 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.748 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-05-08T06:06:48.748 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-05-08T06:06:48.748 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:48.749 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.749 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.749 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-05-08T06:06:48.749 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.749 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.749 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.749 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how frequently to wake up and check device health", 2024-05-08T06:06:48.749 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.749 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.749 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.749 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.749 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.749 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.750 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.750 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.750 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.750 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.750 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.750 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.750 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.750 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.750 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.750 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.750 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.750 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.750 INFO:teuthology.orchestra.run.smithi082.stdout: "warn_threshold": { 2024-05-08T06:06:48.750 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "warn_threshold", 2024-05-08T06:06:48.750 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:48.750 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.751 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.751 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "7257600", 2024-05-08T06:06:48.751 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.751 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.751 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.751 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-05-08T06:06:48.751 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.751 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.751 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.751 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.751 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.751 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.751 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.751 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "diskprediction_local", 2024-05-08T06:06:48.751 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.751 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.751 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.752 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.752 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.752 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.752 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.752 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.752 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.752 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.752 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.752 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.752 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.752 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.752 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.752 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.752 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.752 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.752 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.753 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.753 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.753 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.753 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.753 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.753 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.753 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.753 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.753 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.753 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.753 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.753 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.753 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.753 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.753 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.753 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.753 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.754 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.754 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.754 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.754 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.754 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.754 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.754 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.754 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.754 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.754 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.754 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.754 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.754 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.754 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.754 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.754 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.754 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.755 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.755 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.755 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.755 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.755 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.755 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.755 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.755 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.755 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.755 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.755 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.755 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.755 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.755 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.755 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.755 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.756 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.756 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.756 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.756 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.756 INFO:teuthology.orchestra.run.smithi082.stdout: "predict_interval": { 2024-05-08T06:06:48.756 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "predict_interval", 2024-05-08T06:06:48.756 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.756 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.756 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.756 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "86400", 2024-05-08T06:06:48.756 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.756 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.756 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.756 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.756 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.756 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.756 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.757 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.757 INFO:teuthology.orchestra.run.smithi082.stdout: "predictor_model": { 2024-05-08T06:06:48.757 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "predictor_model", 2024-05-08T06:06:48.757 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.757 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.757 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.757 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "prophetstor", 2024-05-08T06:06:48.757 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.757 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.757 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.757 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.757 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.757 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.757 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.757 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.757 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-05-08T06:06:48.758 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-05-08T06:06:48.758 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.758 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.758 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.758 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "600", 2024-05-08T06:06:48.758 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.758 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.758 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.758 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.758 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.758 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.758 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.758 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.758 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.758 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.758 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.758 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.759 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.759 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.759 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.759 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.759 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.759 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.759 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.759 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.759 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.759 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.759 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.759 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.759 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.759 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "influx", 2024-05-08T06:06:48.759 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": false, 2024-05-08T06:06:48.759 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "influxdb python module not found", 2024-05-08T06:06:48.760 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.760 INFO:teuthology.orchestra.run.smithi082.stdout: "batch_size": { 2024-05-08T06:06:48.760 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "batch_size", 2024-05-08T06:06:48.760 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.760 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.760 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.760 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5000", 2024-05-08T06:06:48.760 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.760 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.760 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.760 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-05-08T06:06:48.760 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.760 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.760 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.760 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.761 INFO:teuthology.orchestra.run.smithi082.stdout: "database": { 2024-05-08T06:06:48.761 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "database", 2024-05-08T06:06:48.761 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.761 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.761 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.761 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "ceph", 2024-05-08T06:06:48.761 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.761 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.761 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.761 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-05-08T06:06:48.761 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.761 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.761 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.761 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.761 INFO:teuthology.orchestra.run.smithi082.stdout: "hostname": { 2024-05-08T06:06:48.761 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "hostname", 2024-05-08T06:06:48.762 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.762 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.762 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.762 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.762 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.762 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.762 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.762 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "InfluxDB server hostname", 2024-05-08T06:06:48.762 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.762 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.762 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.762 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.762 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-05-08T06:06:48.762 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-05-08T06:06:48.763 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:48.763 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.763 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.763 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "30", 2024-05-08T06:06:48.763 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "5", 2024-05-08T06:06:48.763 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.763 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.763 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-05-08T06:06:48.763 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.763 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.763 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.763 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.763 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.763 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.763 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.763 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.763 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.764 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.764 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.764 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.764 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.764 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.764 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.764 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.764 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.764 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.764 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.764 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.764 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.764 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.764 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.764 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.764 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.765 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.765 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.765 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.765 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.765 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.765 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.765 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.765 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.765 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.765 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.765 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.765 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.765 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.765 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.765 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.765 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.765 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.765 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.766 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.766 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.766 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.766 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.766 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.766 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.766 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.766 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.766 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.766 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.766 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.766 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.766 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.767 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.767 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.767 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.767 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.767 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.767 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.767 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.767 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.767 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.767 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.767 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.767 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.767 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.767 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.767 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.767 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.767 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.768 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.768 INFO:teuthology.orchestra.run.smithi082.stdout: "password": { 2024-05-08T06:06:48.768 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "password", 2024-05-08T06:06:48.768 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.768 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.768 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.768 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.768 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.768 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.768 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.768 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "password of InfluxDB server user", 2024-05-08T06:06:48.768 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.768 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.768 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.768 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.768 INFO:teuthology.orchestra.run.smithi082.stdout: "port": { 2024-05-08T06:06:48.768 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "port", 2024-05-08T06:06:48.769 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.769 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.769 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.769 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "8086", 2024-05-08T06:06:48.769 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.769 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.769 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.769 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "InfluxDB server port", 2024-05-08T06:06:48.769 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.769 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.769 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.769 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.769 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.769 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.769 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.769 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.770 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.770 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.770 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.770 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.770 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.770 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.770 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.770 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.770 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.770 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.770 INFO:teuthology.orchestra.run.smithi082.stdout: "ssl": { 2024-05-08T06:06:48.770 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ssl", 2024-05-08T06:06:48.770 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.770 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.770 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.770 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "false", 2024-05-08T06:06:48.770 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.771 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.771 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.771 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-05-08T06:06:48.771 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.771 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.771 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.771 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.771 INFO:teuthology.orchestra.run.smithi082.stdout: "threads": { 2024-05-08T06:06:48.771 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "threads", 2024-05-08T06:06:48.771 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.771 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.771 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.771 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-05-08T06:06:48.771 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-05-08T06:06:48.771 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "32", 2024-05-08T06:06:48.771 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.772 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-05-08T06:06:48.772 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.772 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.772 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.772 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.772 INFO:teuthology.orchestra.run.smithi082.stdout: "username": { 2024-05-08T06:06:48.772 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "username", 2024-05-08T06:06:48.772 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.772 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.772 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.772 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.772 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.772 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.772 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.772 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "username of InfluxDB server user", 2024-05-08T06:06:48.772 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.772 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.773 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.773 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.773 INFO:teuthology.orchestra.run.smithi082.stdout: "verify_ssl": { 2024-05-08T06:06:48.773 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "verify_ssl", 2024-05-08T06:06:48.773 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.773 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.773 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.773 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "true", 2024-05-08T06:06:48.773 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.773 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.773 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.773 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-05-08T06:06:48.773 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.773 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.773 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.774 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.774 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.774 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.774 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.774 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "insights", 2024-05-08T06:06:48.774 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.774 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.774 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.774 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.774 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.774 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.774 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.774 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.774 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.774 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.774 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.775 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.775 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.775 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.775 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.775 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.775 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.775 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.775 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.775 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.775 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.775 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.775 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.775 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.775 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.775 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.775 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.775 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.776 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.776 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.776 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.776 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.776 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.776 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.776 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.776 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.776 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.776 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.776 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.776 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.776 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.776 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.776 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.776 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.776 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.777 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.777 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.777 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.777 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.777 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.777 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.777 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.777 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.777 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.777 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.777 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.777 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.777 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.777 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.777 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.777 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.777 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.778 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.778 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.778 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.778 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.778 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.778 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.778 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.778 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.778 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.778 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.778 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.778 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.778 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.778 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.778 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.779 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.779 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.779 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.779 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.779 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.779 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.779 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.779 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.779 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.779 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.779 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.779 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.779 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.779 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "iostat", 2024-05-08T06:06:48.779 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.779 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.780 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.780 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.780 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.780 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.780 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.780 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.780 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.780 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.780 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.780 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.780 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.780 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.780 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.780 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.780 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.780 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.781 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.781 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.781 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.781 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.781 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.781 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.781 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.781 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.781 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.781 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.781 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.781 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.781 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.781 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.781 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.781 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.781 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.781 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.782 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.782 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.782 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.782 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.782 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.782 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.782 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.782 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.782 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.782 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.782 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.782 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.782 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.782 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.782 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.782 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.783 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.783 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.783 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.783 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.783 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.783 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.783 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.783 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.783 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.783 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.783 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.783 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.783 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.783 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.783 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.783 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.783 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.784 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.784 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.784 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.784 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.784 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.784 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.784 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.784 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.784 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.784 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.784 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.784 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.784 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.784 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.784 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.784 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.785 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.785 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.785 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.785 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.785 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.785 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "k8sevents", 2024-05-08T06:06:48.785 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.785 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.785 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.785 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_event_retention_days": { 2024-05-08T06:06:48.785 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "ceph_event_retention_days", 2024-05-08T06:06:48.785 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.785 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.785 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.785 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "7", 2024-05-08T06:06:48.785 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.786 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.786 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.786 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Days to hold ceph event information within local cache", 2024-05-08T06:06:48.786 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.786 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.786 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.786 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.786 INFO:teuthology.orchestra.run.smithi082.stdout: "config_check_secs": { 2024-05-08T06:06:48.786 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "config_check_secs", 2024-05-08T06:06:48.786 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.786 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.786 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.786 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-05-08T06:06:48.786 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "10", 2024-05-08T06:06:48.786 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.786 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.787 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-05-08T06:06:48.787 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.787 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.787 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.787 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.787 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.787 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.787 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.787 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.787 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.787 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.787 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.787 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.787 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.787 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.787 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.788 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.788 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.788 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.788 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.788 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.788 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.788 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.788 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.788 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.788 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.788 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.788 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.788 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.788 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.788 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.789 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.789 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.789 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.789 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.789 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.789 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.789 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.789 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.789 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.789 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.789 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.789 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.789 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.789 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.789 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.789 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.789 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.790 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.790 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.790 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.790 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.790 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.790 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.790 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.790 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.790 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.790 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.790 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.790 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.790 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.790 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.790 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.791 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.791 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.791 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.791 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.791 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.791 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.791 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.791 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.791 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.791 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.791 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.791 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.791 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.791 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.791 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.791 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.791 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.792 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.792 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.792 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.792 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.792 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.792 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.792 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.792 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.792 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.792 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.792 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.792 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.792 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "localpool", 2024-05-08T06:06:48.792 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.792 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.792 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.793 INFO:teuthology.orchestra.run.smithi082.stdout: "failure_domain": { 2024-05-08T06:06:48.793 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "failure_domain", 2024-05-08T06:06:48.793 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.793 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.793 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.793 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "host", 2024-05-08T06:06:48.793 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.793 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.793 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.793 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "failure domain for any created local pool", 2024-05-08T06:06:48.793 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-05-08T06:06:48.793 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.793 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.793 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.793 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.793 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.793 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.794 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.794 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.794 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.794 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.794 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.794 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.794 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.794 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.794 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.794 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.794 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.794 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.794 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.794 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.794 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.794 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.795 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.795 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.795 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.795 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.795 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.795 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.795 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.795 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.795 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.795 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.795 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.795 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.795 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.795 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.795 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.795 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.795 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.796 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.796 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.796 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.796 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.796 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.796 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.796 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.796 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.796 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.796 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.796 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.796 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.796 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.796 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.796 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.796 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.796 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.796 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.797 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.797 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.797 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.797 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.797 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.797 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.797 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.797 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.797 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.797 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.797 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.797 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.797 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.797 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.797 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.797 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.798 INFO:teuthology.orchestra.run.smithi082.stdout: "min_size": { 2024-05-08T06:06:48.798 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "min_size", 2024-05-08T06:06:48.798 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.798 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.798 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.798 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.798 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.798 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.798 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.798 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "default min_size for any created local pool", 2024-05-08T06:06:48.798 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-05-08T06:06:48.798 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.798 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.798 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.798 INFO:teuthology.orchestra.run.smithi082.stdout: "num_rep": { 2024-05-08T06:06:48.798 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "num_rep", 2024-05-08T06:06:48.799 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.799 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.799 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.799 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "3", 2024-05-08T06:06:48.799 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.799 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.799 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.799 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "default replica count for any created local pool", 2024-05-08T06:06:48.799 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.799 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.799 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.799 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.799 INFO:teuthology.orchestra.run.smithi082.stdout: "pg_num": { 2024-05-08T06:06:48.799 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pg_num", 2024-05-08T06:06:48.799 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.799 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.800 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.800 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "128", 2024-05-08T06:06:48.800 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.800 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.800 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.800 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "default pg_num for any created local pool", 2024-05-08T06:06:48.800 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.800 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.800 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.800 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.800 INFO:teuthology.orchestra.run.smithi082.stdout: "prefix": { 2024-05-08T06:06:48.800 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "prefix", 2024-05-08T06:06:48.800 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.800 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.800 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.800 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.801 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.801 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.801 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.801 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "name prefix for any created local pool", 2024-05-08T06:06:48.801 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.801 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.801 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.801 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.801 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.801 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.801 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.801 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.801 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.801 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.801 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.802 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.802 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.802 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.802 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.802 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.802 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.802 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.802 INFO:teuthology.orchestra.run.smithi082.stdout: "subtree": { 2024-05-08T06:06:48.802 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "subtree", 2024-05-08T06:06:48.802 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.802 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.802 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.802 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "rack", 2024-05-08T06:06:48.802 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.802 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.803 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.803 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "CRUSH level for which to create a local pool", 2024-05-08T06:06:48.803 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-05-08T06:06:48.803 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.803 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.803 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.803 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.803 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.803 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.803 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mds_autoscaler", 2024-05-08T06:06:48.803 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.803 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.803 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.803 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.803 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.803 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.804 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.804 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.804 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.804 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.804 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.804 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.804 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.804 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.804 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.804 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.804 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.804 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.804 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.804 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.805 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.805 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.805 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.805 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.805 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.805 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.805 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.805 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.805 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.805 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.805 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.805 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.805 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.805 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.805 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.805 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.806 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.806 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.806 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.806 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.806 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.806 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.806 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.806 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.806 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.806 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.806 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.806 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.806 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.806 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.806 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.806 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.807 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.807 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.807 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.807 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.807 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.807 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.807 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.807 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.807 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.807 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.807 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.807 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.807 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.807 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.807 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.807 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.808 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.808 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.808 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.808 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.808 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.808 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.808 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.808 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.808 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.808 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.808 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.808 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.808 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.808 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.808 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.808 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.808 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.809 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.809 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.809 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.809 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.809 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.809 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mirroring", 2024-05-08T06:06:48.809 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.809 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.809 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.809 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.809 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.809 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.809 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.809 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.809 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.809 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.809 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.810 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.810 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.810 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.810 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.810 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.810 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.810 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.810 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.810 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.810 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.810 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.810 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.810 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.810 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.810 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.810 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.811 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.811 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.811 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.811 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.811 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.811 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.811 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.811 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.811 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.811 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.811 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.811 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.811 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.811 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.811 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.811 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.811 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.812 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.812 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.812 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.812 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.812 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.812 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.812 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.812 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.812 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.812 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.812 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.812 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.812 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.812 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.812 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.812 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.813 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.813 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.813 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.813 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.813 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.813 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.813 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.813 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.813 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.813 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.813 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.813 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.813 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.813 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.813 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.813 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.814 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.814 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.814 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.814 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.814 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.814 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.814 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.814 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.814 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.814 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.814 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.814 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.814 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.814 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.814 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "nfs", 2024-05-08T06:06:48.815 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.815 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.815 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.815 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.815 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.815 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.815 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.815 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.815 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.815 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.815 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.815 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.815 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.815 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.815 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.815 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.815 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.816 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.816 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.816 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.816 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.816 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.816 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.816 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.816 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.816 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.816 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.816 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.816 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.816 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.816 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.816 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.816 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.817 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.817 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.817 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.817 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.817 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.817 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.817 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.817 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.817 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.817 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.817 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.817 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.817 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.817 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.817 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.817 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.818 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.818 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.818 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.818 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.818 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.818 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.818 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.818 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.818 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.818 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.818 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.818 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.818 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.818 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.818 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.818 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.819 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.819 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.819 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.819 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.819 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.819 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.819 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.819 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.819 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.819 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.819 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.819 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.819 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.819 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.819 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.819 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.820 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.820 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.820 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.820 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.820 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.820 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.820 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.820 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.820 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.820 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "orchestrator", 2024-05-08T06:06:48.820 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.820 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.820 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.820 INFO:teuthology.orchestra.run.smithi082.stdout: "fail_fs": { 2024-05-08T06:06:48.820 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "fail_fs", 2024-05-08T06:06:48.820 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.821 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.821 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.821 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.821 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.821 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.821 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.821 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-05-08T06:06:48.821 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.821 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.821 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.821 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.821 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.821 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.821 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.821 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.821 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.821 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.821 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.822 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.822 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.822 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.822 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.822 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.822 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.822 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.822 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.822 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.822 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.822 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.822 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.822 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.822 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.822 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.822 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.823 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.823 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.823 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.823 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.823 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.823 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.823 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.823 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.823 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.823 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.823 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.823 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.823 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.823 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.823 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.823 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.824 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.824 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.824 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.824 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.824 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.824 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.824 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.824 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.824 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.824 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.824 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.824 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.824 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.824 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.824 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.824 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.824 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.825 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.825 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.825 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.825 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.825 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.825 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.825 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.825 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.825 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.825 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.825 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.825 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.825 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.825 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.825 INFO:teuthology.orchestra.run.smithi082.stdout: "orchestrator": { 2024-05-08T06:06:48.825 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "orchestrator", 2024-05-08T06:06:48.825 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.826 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.826 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.826 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.826 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.826 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.826 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.826 INFO:teuthology.orchestra.run.smithi082.stdout: "cephadm", 2024-05-08T06:06:48.826 INFO:teuthology.orchestra.run.smithi082.stdout: "rook", 2024-05-08T06:06:48.826 INFO:teuthology.orchestra.run.smithi082.stdout: "test_orchestrator" 2024-05-08T06:06:48.826 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.826 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Orchestrator backend", 2024-05-08T06:06:48.826 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.826 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.826 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.826 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.827 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.827 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.827 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.827 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.827 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.827 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.827 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.827 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.827 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.827 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.827 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.827 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.827 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.827 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.827 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.828 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.828 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.828 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "osd_perf_query", 2024-05-08T06:06:48.828 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.828 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.828 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.828 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.828 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.828 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.828 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.828 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.828 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.828 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.828 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.828 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.828 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.829 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.829 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.829 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.829 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.829 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.829 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.829 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.829 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.829 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.829 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.829 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.829 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.829 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.829 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.829 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.830 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.830 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.830 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.830 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.830 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.830 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.830 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.830 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.830 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.830 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.830 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.830 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.830 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.830 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.830 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.830 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.831 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.831 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.831 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.831 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.831 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.831 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.831 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.831 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.831 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.831 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.831 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.831 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.831 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.831 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.831 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.831 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.832 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.832 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.832 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.832 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.832 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.832 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.832 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.832 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.832 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.832 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.832 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.832 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.832 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.832 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.832 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.832 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.833 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.833 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.833 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.833 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.833 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.833 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.833 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.833 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.833 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.833 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.833 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.833 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.833 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.833 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.833 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "osd_support", 2024-05-08T06:06:48.833 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.834 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.834 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.834 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.834 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.834 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.834 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.834 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.834 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.834 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.834 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.834 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.834 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.834 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.834 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.834 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.834 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.835 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.835 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.835 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.835 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.835 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.835 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.835 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.835 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.835 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.835 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.835 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.835 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.835 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.835 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.835 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.835 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.836 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.836 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.836 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.836 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.836 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.836 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.836 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.836 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.836 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.836 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.836 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.836 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.836 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.836 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.836 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.837 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.837 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.837 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.837 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.837 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.837 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.837 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.837 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.837 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.837 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.837 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.837 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.837 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.837 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.837 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.837 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.837 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.837 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.838 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.838 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.838 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.838 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.838 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.838 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.838 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.838 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.838 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.838 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.838 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.838 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.838 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.838 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.838 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.839 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.839 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.839 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.839 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.839 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.839 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.839 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.839 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.839 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.839 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "pg_autoscaler", 2024-05-08T06:06:48.839 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.839 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.839 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.839 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.839 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.839 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.840 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.840 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.840 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.840 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.840 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.840 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.840 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.840 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.840 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.840 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.840 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.840 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.840 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.840 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.840 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.840 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.840 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.840 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.841 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.841 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.841 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.841 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.841 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.841 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.841 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.841 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.841 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.841 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.841 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.841 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.841 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.841 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.841 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.841 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.842 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.842 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.842 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.842 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.842 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.842 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.842 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.842 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.842 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.842 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.842 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.842 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.842 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.842 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.842 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.842 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.843 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.843 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.843 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.843 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.843 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.843 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.843 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.843 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.843 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.843 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.843 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.843 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.843 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.843 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.843 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.843 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.844 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.844 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-05-08T06:06:48.844 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-05-08T06:06:48.844 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:48.844 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.844 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.844 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-05-08T06:06:48.844 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.844 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.844 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.844 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.844 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.844 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.844 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.844 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.844 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.845 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.845 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.845 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.845 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.845 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.845 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.845 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.845 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.845 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.845 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.845 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.845 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.845 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.845 INFO:teuthology.orchestra.run.smithi082.stdout: "threshold": { 2024-05-08T06:06:48.845 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "threshold", 2024-05-08T06:06:48.845 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-05-08T06:06:48.845 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.846 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.846 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "3.0", 2024-05-08T06:06:48.846 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1.0", 2024-05-08T06:06:48.846 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.846 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.846 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "scaling threshold", 2024-05-08T06:06:48.846 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-05-08T06:06:48.846 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.846 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.846 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.846 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.846 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.846 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.846 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "progress", 2024-05-08T06:06:48.846 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.846 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.847 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.847 INFO:teuthology.orchestra.run.smithi082.stdout: "allow_pg_recovery_event": { 2024-05-08T06:06:48.847 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "allow_pg_recovery_event", 2024-05-08T06:06:48.847 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.847 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.847 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.847 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.847 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.847 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.847 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.847 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "allow the module to show pg recovery progress", 2024-05-08T06:06:48.847 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.847 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.847 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.847 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.847 INFO:teuthology.orchestra.run.smithi082.stdout: "enabled": { 2024-05-08T06:06:48.847 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enabled", 2024-05-08T06:06:48.848 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.848 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.848 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.848 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.848 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.848 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.848 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.848 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.848 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.848 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.848 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.848 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.848 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.848 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.848 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.848 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.849 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.849 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.849 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.849 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.849 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.849 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.849 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.849 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.849 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.849 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.849 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.849 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.849 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.849 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.849 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.849 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.849 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.849 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.850 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.850 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.850 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.850 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.850 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.850 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.850 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.850 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.850 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.850 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.850 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.850 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.850 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.850 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.850 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.850 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.851 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.851 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.851 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.851 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.851 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.851 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.851 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.851 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.851 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.851 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.851 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.851 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.851 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.851 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.851 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.851 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.852 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.852 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.852 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.852 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.852 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.852 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.852 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.852 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.852 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.852 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.852 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.852 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.852 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.852 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.852 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.852 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.853 INFO:teuthology.orchestra.run.smithi082.stdout: "max_completed_events": { 2024-05-08T06:06:48.853 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_completed_events", 2024-05-08T06:06:48.853 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.853 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.853 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.853 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "50", 2024-05-08T06:06:48.853 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.853 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.853 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.853 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "number of past completed events to remember", 2024-05-08T06:06:48.853 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.853 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.853 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.853 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.853 INFO:teuthology.orchestra.run.smithi082.stdout: "sleep_interval": { 2024-05-08T06:06:48.853 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sleep_interval", 2024-05-08T06:06:48.854 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:48.854 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.854 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.854 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "5", 2024-05-08T06:06:48.854 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.854 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.854 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.854 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "how long the module is going to sleep", 2024-05-08T06:06:48.854 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.854 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.854 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.854 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.854 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.854 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.854 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.854 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.854 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.855 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.855 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.855 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.855 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.855 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.855 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.855 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.855 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.855 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.855 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.855 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.855 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.855 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "prometheus", 2024-05-08T06:06:48.855 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.855 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.855 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.855 INFO:teuthology.orchestra.run.smithi082.stdout: "cache": { 2024-05-08T06:06:48.856 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "cache", 2024-05-08T06:06:48.856 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.856 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.856 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.856 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.856 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.856 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.856 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.856 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.856 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.856 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.856 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.856 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.856 INFO:teuthology.orchestra.run.smithi082.stdout: "exclude_perf_counters": { 2024-05-08T06:06:48.856 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "exclude_perf_counters", 2024-05-08T06:06:48.856 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.856 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.857 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.857 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.857 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.857 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.857 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.857 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-05-08T06:06:48.857 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-05-08T06:06:48.857 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.857 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.857 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.857 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.857 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.857 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.857 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.857 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.857 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.858 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.858 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.858 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.858 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.858 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.858 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.858 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.858 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.858 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.858 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.858 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.858 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.858 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.859 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.859 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.859 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.859 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.859 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.859 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.859 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.859 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.859 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.859 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.859 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.859 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.859 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.859 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.859 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.860 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.860 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.860 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.860 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.860 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.860 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.860 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.860 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.860 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.860 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.860 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.860 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.860 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.860 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.860 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.861 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.861 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.861 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.861 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.861 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.861 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.861 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.861 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.861 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.861 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.861 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.861 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.861 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.861 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.861 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.861 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.862 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.862 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.862 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.862 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.862 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.862 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_stats_pools": { 2024-05-08T06:06:48.862 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_stats_pools", 2024-05-08T06:06:48.862 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.862 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.862 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.862 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.862 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.862 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.863 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.863 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.863 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.863 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.863 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.863 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.863 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_stats_pools_refresh_interval": { 2024-05-08T06:06:48.863 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-05-08T06:06:48.863 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.863 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.863 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.863 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "300", 2024-05-08T06:06:48.863 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.863 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.863 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.864 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.864 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.864 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.864 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.864 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.864 INFO:teuthology.orchestra.run.smithi082.stdout: "scrape_interval": { 2024-05-08T06:06:48.864 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "scrape_interval", 2024-05-08T06:06:48.864 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-05-08T06:06:48.864 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.864 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.864 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "15.0", 2024-05-08T06:06:48.864 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.864 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.864 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.864 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.865 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.865 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.865 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.865 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.865 INFO:teuthology.orchestra.run.smithi082.stdout: "server_addr": { 2024-05-08T06:06:48.865 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_addr", 2024-05-08T06:06:48.865 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.865 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.865 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.865 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "::", 2024-05-08T06:06:48.865 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.865 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.865 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.865 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-05-08T06:06:48.865 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.866 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.866 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.866 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.866 INFO:teuthology.orchestra.run.smithi082.stdout: "server_port": { 2024-05-08T06:06:48.866 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_port", 2024-05-08T06:06:48.866 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.866 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.866 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.866 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "9283", 2024-05-08T06:06:48.866 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.866 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.866 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.866 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-05-08T06:06:48.866 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.866 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.867 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.867 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.867 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.867 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.867 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.867 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.867 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.867 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.867 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.867 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.867 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.867 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.867 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.867 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.867 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.868 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.868 INFO:teuthology.orchestra.run.smithi082.stdout: "stale_cache_strategy": { 2024-05-08T06:06:48.868 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "stale_cache_strategy", 2024-05-08T06:06:48.868 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.868 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.868 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.868 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "log", 2024-05-08T06:06:48.868 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.868 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.868 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.868 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.868 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.868 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.868 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.869 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.869 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_behaviour": { 2024-05-08T06:06:48.869 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_behaviour", 2024-05-08T06:06:48.869 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.869 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.869 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.869 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "default", 2024-05-08T06:06:48.869 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.869 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.869 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.869 INFO:teuthology.orchestra.run.smithi082.stdout: "default", 2024-05-08T06:06:48.869 INFO:teuthology.orchestra.run.smithi082.stdout: "error" 2024-05-08T06:06:48.869 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.869 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.869 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.869 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.870 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.870 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.870 INFO:teuthology.orchestra.run.smithi082.stdout: "standby_error_status_code": { 2024-05-08T06:06:48.870 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "standby_error_status_code", 2024-05-08T06:06:48.870 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.870 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.870 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.870 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "500", 2024-05-08T06:06:48.870 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "400", 2024-05-08T06:06:48.870 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "599", 2024-05-08T06:06:48.870 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.870 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.870 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.870 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.870 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.871 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.871 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.871 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.871 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.871 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_support", 2024-05-08T06:06:48.871 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.871 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.871 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.871 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.871 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.871 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.871 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.871 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.871 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.871 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.872 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.872 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.872 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.872 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.872 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.872 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.872 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.872 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.872 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.872 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.872 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.872 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.872 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.872 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.873 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.873 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.873 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.873 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.873 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.873 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.873 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.873 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.873 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.873 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.873 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.873 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.873 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.873 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.873 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.873 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.874 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.874 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.874 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.874 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.874 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.874 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.874 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.874 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.874 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.874 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.874 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.874 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.874 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.874 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.874 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.875 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.875 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.875 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.875 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.875 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.875 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.875 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.875 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.875 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.875 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.875 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.875 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.875 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.875 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.875 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.876 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.876 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.876 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.876 INFO:teuthology.orchestra.run.smithi082.stdout: "max_concurrent_snap_create": { 2024-05-08T06:06:48.876 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_concurrent_snap_create", 2024-05-08T06:06:48.876 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.876 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.876 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.876 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10", 2024-05-08T06:06:48.876 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.876 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.876 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.876 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.876 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.876 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.877 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.877 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.877 INFO:teuthology.orchestra.run.smithi082.stdout: "mirror_snapshot_schedule": { 2024-05-08T06:06:48.877 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "mirror_snapshot_schedule", 2024-05-08T06:06:48.877 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.877 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.877 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.877 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.877 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.877 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.877 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.877 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.877 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.877 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.877 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.878 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.878 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.878 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.878 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.878 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.878 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.878 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.878 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.878 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.878 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.878 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.878 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.878 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.879 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.879 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.879 INFO:teuthology.orchestra.run.smithi082.stdout: "trash_purge_schedule": { 2024-05-08T06:06:48.879 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "trash_purge_schedule", 2024-05-08T06:06:48.879 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.879 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.879 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.879 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.879 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.879 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.879 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.879 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.879 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.879 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.879 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.880 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.880 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.880 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.880 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.880 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "restful", 2024-05-08T06:06:48.880 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.880 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.880 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.880 INFO:teuthology.orchestra.run.smithi082.stdout: "enable_auth": { 2024-05-08T06:06:48.880 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enable_auth", 2024-05-08T06:06:48.880 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.880 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.880 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.880 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.881 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.881 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.881 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.881 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.881 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.881 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.881 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.881 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.881 INFO:teuthology.orchestra.run.smithi082.stdout: "key_file": { 2024-05-08T06:06:48.881 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "key_file", 2024-05-08T06:06:48.881 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.881 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.881 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.881 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.881 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.882 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.882 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.882 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.882 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.882 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.882 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.882 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.882 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.882 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.882 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.882 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.882 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.882 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.882 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.882 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.883 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.883 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.883 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.883 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.883 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.883 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.883 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.883 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.883 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.883 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.883 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.883 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.883 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.883 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.884 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.884 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.884 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.884 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.884 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.884 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.884 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.884 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.884 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.884 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.884 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.884 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.884 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.884 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.884 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.885 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.885 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.885 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.885 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.885 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.885 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.885 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.885 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.885 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.885 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.885 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.885 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.885 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.885 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.885 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.886 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.886 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.886 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.886 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.886 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.886 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.886 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.886 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.886 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.886 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.886 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.886 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.886 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.886 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.887 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.887 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.887 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.887 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.887 INFO:teuthology.orchestra.run.smithi082.stdout: "server_addr": { 2024-05-08T06:06:48.887 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_addr", 2024-05-08T06:06:48.887 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.887 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.887 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.887 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.887 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.887 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.887 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.887 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.887 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.887 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.887 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.888 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.888 INFO:teuthology.orchestra.run.smithi082.stdout: "server_port": { 2024-05-08T06:06:48.888 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "server_port", 2024-05-08T06:06:48.888 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.888 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.888 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.888 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.888 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.888 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.888 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.888 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.888 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.888 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.888 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.888 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.888 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.889 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.889 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.889 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.889 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.889 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.889 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.889 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.889 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.889 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.889 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.889 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.889 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.889 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.889 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.889 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.889 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.890 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rgw", 2024-05-08T06:06:48.890 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.890 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.890 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.890 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.890 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.890 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.890 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.890 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.890 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.890 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.890 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.890 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.890 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.890 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.890 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.890 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.891 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.891 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.891 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.891 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.891 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.891 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.891 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.891 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.891 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.891 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.891 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.891 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.891 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.891 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.891 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.891 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.892 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.892 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.892 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.892 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.892 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.892 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.892 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.892 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.892 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.892 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.892 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.892 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.892 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.892 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.892 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.892 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.892 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.893 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.893 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.893 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.893 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.893 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.893 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.893 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.893 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.893 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.893 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.893 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.893 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.893 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.893 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.893 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.893 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.894 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.894 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.894 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.894 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.894 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.894 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.894 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.894 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.894 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.894 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.894 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.894 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.894 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.894 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.894 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.895 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.895 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.895 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.895 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.895 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.895 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.895 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.895 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.895 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.895 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.895 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rook", 2024-05-08T06:06:48.895 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.895 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.895 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.895 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.896 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.896 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.896 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.896 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.896 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.896 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.896 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.896 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.896 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.896 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.896 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.896 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.896 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.896 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.896 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.897 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.897 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.897 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.897 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.897 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.897 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.897 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.897 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.897 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.897 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.897 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.897 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.897 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.897 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.897 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.897 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.897 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.898 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.898 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.898 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.898 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.898 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.898 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.898 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.898 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.898 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.898 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.898 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.898 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.898 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.898 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.899 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.899 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.899 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.899 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.899 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.899 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.899 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.899 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.899 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.899 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.899 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.899 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.899 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.899 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.899 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.900 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.900 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.900 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.900 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.900 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.900 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.900 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.900 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.900 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.900 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.900 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.900 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.900 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.900 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.900 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.901 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.901 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.901 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.901 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.901 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.901 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.901 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.901 INFO:teuthology.orchestra.run.smithi082.stdout: "storage_class": { 2024-05-08T06:06:48.901 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "storage_class", 2024-05-08T06:06:48.901 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.901 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.901 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.901 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "local", 2024-05-08T06:06:48.901 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.901 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.902 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.902 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-05-08T06:06:48.902 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.902 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.902 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.902 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.902 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.902 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.902 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.902 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "selftest", 2024-05-08T06:06:48.902 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.902 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.902 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.902 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.903 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.903 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.903 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.903 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.903 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.903 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.903 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.903 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.903 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.903 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.903 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.903 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.903 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.903 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.903 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.903 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.904 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.904 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.904 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.904 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.904 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.904 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.904 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.904 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.904 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.904 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.904 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.904 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.904 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.904 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.904 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.905 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.905 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.905 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.905 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.905 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.905 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.905 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.905 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.905 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.905 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.905 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.905 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.905 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.906 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.906 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.906 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.906 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.906 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.906 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.906 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.906 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.906 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.906 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.906 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.906 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.906 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.906 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.907 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.907 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.907 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.907 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.907 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.907 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.907 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.907 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.907 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.907 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.907 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.907 INFO:teuthology.orchestra.run.smithi082.stdout: "roption1": { 2024-05-08T06:06:48.907 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "roption1", 2024-05-08T06:06:48.907 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.907 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.908 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.908 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.908 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.908 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.908 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.908 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.908 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.908 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.908 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.908 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.908 INFO:teuthology.orchestra.run.smithi082.stdout: "roption2": { 2024-05-08T06:06:48.908 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "roption2", 2024-05-08T06:06:48.908 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.908 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.908 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.909 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "xyz", 2024-05-08T06:06:48.909 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.909 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.909 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.909 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.909 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.909 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.909 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.909 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.909 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption1": { 2024-05-08T06:06:48.909 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption1", 2024-05-08T06:06:48.909 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.909 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.909 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.909 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.909 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.910 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.910 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.910 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.910 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.910 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.910 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.910 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.910 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption2": { 2024-05-08T06:06:48.910 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption2", 2024-05-08T06:06:48.910 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.910 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.910 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.910 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.910 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.911 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.911 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.911 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.911 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.911 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.911 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.911 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.911 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption3": { 2024-05-08T06:06:48.911 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption3", 2024-05-08T06:06:48.911 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "float", 2024-05-08T06:06:48.911 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.911 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.911 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.911 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.911 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.912 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.912 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.912 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.912 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.912 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.912 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.912 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption4": { 2024-05-08T06:06:48.912 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption4", 2024-05-08T06:06:48.912 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.912 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.912 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.912 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.912 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.912 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.912 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.912 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.913 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.913 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.913 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.913 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.913 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption5": { 2024-05-08T06:06:48.913 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption5", 2024-05-08T06:06:48.913 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.913 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.913 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.913 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.913 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.913 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.913 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.913 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.913 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.913 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.914 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.914 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.914 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption6": { 2024-05-08T06:06:48.914 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption6", 2024-05-08T06:06:48.914 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.914 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.914 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.914 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.914 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.914 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.914 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.914 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.914 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.914 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.915 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.915 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.915 INFO:teuthology.orchestra.run.smithi082.stdout: "rwoption7": { 2024-05-08T06:06:48.915 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rwoption7", 2024-05-08T06:06:48.915 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.915 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.915 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.915 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.915 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "1", 2024-05-08T06:06:48.915 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "42", 2024-05-08T06:06:48.915 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.915 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.915 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.915 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.915 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.915 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.916 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.916 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.916 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.916 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.916 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.916 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.916 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.916 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.916 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.916 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.916 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.916 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.916 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.916 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.916 INFO:teuthology.orchestra.run.smithi082.stdout: "testkey": { 2024-05-08T06:06:48.917 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "testkey", 2024-05-08T06:06:48.917 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.917 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.917 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.917 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.917 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.917 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.917 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.917 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.917 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.917 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.917 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.917 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.917 INFO:teuthology.orchestra.run.smithi082.stdout: "testlkey": { 2024-05-08T06:06:48.917 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "testlkey", 2024-05-08T06:06:48.917 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.917 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.918 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.918 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.918 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.918 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.918 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.918 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.918 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.918 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.918 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.918 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.918 INFO:teuthology.orchestra.run.smithi082.stdout: "testnewline": { 2024-05-08T06:06:48.918 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "testnewline", 2024-05-08T06:06:48.918 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.918 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.919 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.919 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.919 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.919 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.919 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.919 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.919 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.919 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.919 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.919 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.919 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.919 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.919 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.919 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "smb", 2024-05-08T06:06:48.919 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.920 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.920 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.920 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.920 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.920 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.920 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.920 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.920 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.920 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.920 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.920 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.920 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.920 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.920 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.921 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.921 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.921 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.921 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.921 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.921 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.921 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.921 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.921 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.921 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.921 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.921 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.921 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.921 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.921 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.921 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.922 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.922 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.922 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.922 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.922 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.922 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.922 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.922 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.922 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.922 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.922 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.922 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.922 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.923 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.923 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.923 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.923 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.923 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.923 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.923 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.923 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.923 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.923 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.924 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.924 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.924 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.924 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.924 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.924 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.924 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.924 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.924 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.924 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.924 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.924 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.925 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.925 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.925 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.925 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.925 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.925 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.925 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.925 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.925 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.925 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.925 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.925 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.925 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.925 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.925 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.925 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.926 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.926 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.926 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.926 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.926 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.926 INFO:teuthology.orchestra.run.smithi082.stdout: "update_orchestration": { 2024-05-08T06:06:48.926 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "update_orchestration", 2024-05-08T06:06:48.926 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.926 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.926 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.926 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.926 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.926 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.926 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.927 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-05-08T06:06:48.927 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.927 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.927 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.927 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.927 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.927 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.927 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.927 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "snap_schedule", 2024-05-08T06:06:48.927 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.927 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.927 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.927 INFO:teuthology.orchestra.run.smithi082.stdout: "allow_m_granularity": { 2024-05-08T06:06:48.927 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "allow_m_granularity", 2024-05-08T06:06:48.927 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.927 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.928 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.928 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.928 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.928 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.928 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.928 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "allow minute scheduled snapshots", 2024-05-08T06:06:48.928 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.928 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.928 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.928 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.928 INFO:teuthology.orchestra.run.smithi082.stdout: "dump_on_update": { 2024-05-08T06:06:48.928 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "dump_on_update", 2024-05-08T06:06:48.928 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.928 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.928 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.929 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.929 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.929 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.929 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.929 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "dump database to debug log on update", 2024-05-08T06:06:48.929 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.929 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.929 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.929 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.929 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.929 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.929 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.929 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.929 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.929 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.929 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.929 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.930 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.930 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.930 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.930 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.930 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.930 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.930 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.930 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.930 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.930 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.930 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.930 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.930 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.930 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.931 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.931 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.931 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.931 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.931 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.931 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.931 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.931 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.931 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.931 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.931 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.931 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.931 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.931 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.931 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.932 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.932 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.932 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.932 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.932 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.932 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.932 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.932 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.932 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.932 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.932 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.932 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.932 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.932 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.932 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.932 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.932 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.933 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.933 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.933 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.933 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.933 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.933 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.933 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.933 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.933 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.933 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.933 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.933 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.933 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.933 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.933 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.933 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.933 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.934 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.934 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.934 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.934 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.934 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.934 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.934 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.934 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.934 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.934 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.934 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.934 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.934 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.934 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.934 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.934 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.935 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "stats", 2024-05-08T06:06:48.935 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.935 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.935 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.935 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.935 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.935 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.935 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.935 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.935 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.935 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.935 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.935 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.935 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.935 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.935 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.936 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.936 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.936 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.936 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.936 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.936 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.936 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.936 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.936 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.936 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.936 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.936 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.936 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.936 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.936 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.936 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.937 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.937 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.937 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.937 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.937 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.937 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.937 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.937 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.937 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.937 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.937 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.937 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.937 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.937 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.937 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.938 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.938 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.938 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.938 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.938 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.938 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.938 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.938 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.938 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.938 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.938 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.938 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.938 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.938 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.939 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.939 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.939 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.939 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.939 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.939 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.939 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.939 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.939 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.939 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.939 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.939 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.939 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.939 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.940 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.940 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.940 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.940 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.940 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.940 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.940 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.940 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.940 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.940 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.940 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.940 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.940 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.940 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.941 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.941 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.941 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "status", 2024-05-08T06:06:48.941 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.941 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.941 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.941 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.941 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.941 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.941 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.941 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.941 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.941 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.941 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.942 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.942 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.942 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.942 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.942 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.942 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.942 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.942 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.942 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.942 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.942 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.942 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.942 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.943 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.943 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.943 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.943 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.943 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.943 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.943 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.943 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.943 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.943 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.943 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.943 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.943 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.943 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.944 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.944 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.944 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.944 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.944 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.944 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.944 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.944 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.944 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.944 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.944 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.944 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.944 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.944 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.944 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.945 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.945 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.945 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.945 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.945 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.945 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.945 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.945 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.945 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.945 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.945 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.945 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.945 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.945 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.945 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.945 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.945 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.946 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.946 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.946 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.946 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.946 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.946 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.946 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.946 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.946 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.946 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.946 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.946 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.946 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.947 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.947 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.947 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.947 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.947 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.947 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.947 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.947 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "telegraf", 2024-05-08T06:06:48.947 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.947 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.947 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.947 INFO:teuthology.orchestra.run.smithi082.stdout: "address": { 2024-05-08T06:06:48.947 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "address", 2024-05-08T06:06:48.947 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.948 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.948 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.948 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-05-08T06:06:48.948 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.948 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.948 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.948 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.948 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.948 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.948 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.948 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.948 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-05-08T06:06:48.948 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-05-08T06:06:48.948 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:48.948 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.949 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.949 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "15", 2024-05-08T06:06:48.949 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.949 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.949 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.949 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.949 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.949 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.949 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.949 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.949 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.949 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.949 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.949 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.950 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.950 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.950 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.950 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.950 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.950 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.950 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.950 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.950 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.950 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.950 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.950 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.950 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.950 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.950 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.951 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.951 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.951 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.951 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.951 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.951 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.951 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.951 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.951 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.951 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.951 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.951 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.951 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.951 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.952 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.952 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.952 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.952 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.952 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.952 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.952 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.952 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.952 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.952 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.952 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.952 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.952 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.952 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.952 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.953 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.953 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.953 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.953 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.953 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.953 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.953 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.953 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.953 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.953 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.953 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.953 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.953 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.953 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.954 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.954 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.954 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.954 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.954 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.954 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.954 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.954 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.954 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.954 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.954 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.954 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.954 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.955 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.955 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.955 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.955 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.955 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.955 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.955 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.955 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.955 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.955 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.955 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.955 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.955 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "telemetry", 2024-05-08T06:06:48.956 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.956 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.956 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.956 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_basic": { 2024-05-08T06:06:48.956 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_basic", 2024-05-08T06:06:48.956 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.956 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.956 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.956 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.956 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.956 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.956 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.956 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share basic cluster information (size, version)", 2024-05-08T06:06:48.956 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.956 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.957 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.957 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.957 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_crash": { 2024-05-08T06:06:48.957 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_crash", 2024-05-08T06:06:48.957 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.957 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.957 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.957 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.957 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.957 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.957 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.957 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-05-08T06:06:48.957 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.957 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.958 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.958 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.958 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_device": { 2024-05-08T06:06:48.958 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_device", 2024-05-08T06:06:48.958 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.958 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.958 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.958 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.958 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.958 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.958 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.958 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-05-08T06:06:48.958 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.958 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.959 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.959 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.959 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_ident": { 2024-05-08T06:06:48.959 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_ident", 2024-05-08T06:06:48.959 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.959 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.959 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.959 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.959 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.959 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.959 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.959 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-05-08T06:06:48.959 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.959 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.960 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.960 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.960 INFO:teuthology.orchestra.run.smithi082.stdout: "channel_perf": { 2024-05-08T06:06:48.960 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "channel_perf", 2024-05-08T06:06:48.960 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.960 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.960 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.960 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.960 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.960 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.960 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.960 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Share various performance metrics of a cluster", 2024-05-08T06:06:48.960 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.960 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.960 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.960 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.960 INFO:teuthology.orchestra.run.smithi082.stdout: "contact": { 2024-05-08T06:06:48.961 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "contact", 2024-05-08T06:06:48.961 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.961 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.961 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.961 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.961 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.961 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.961 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.961 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.961 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.961 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.961 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.961 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.961 INFO:teuthology.orchestra.run.smithi082.stdout: "description": { 2024-05-08T06:06:48.961 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "description", 2024-05-08T06:06:48.962 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.962 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.962 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.962 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.962 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.962 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.962 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.962 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.962 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.962 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.962 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.962 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.962 INFO:teuthology.orchestra.run.smithi082.stdout: "device_url": { 2024-05-08T06:06:48.962 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "device_url", 2024-05-08T06:06:48.963 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.963 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.963 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.963 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-05-08T06:06:48.963 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.963 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.963 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.963 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.963 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.963 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.963 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.963 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.963 INFO:teuthology.orchestra.run.smithi082.stdout: "enabled": { 2024-05-08T06:06:48.963 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "enabled", 2024-05-08T06:06:48.963 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.964 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.964 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.964 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.964 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.964 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.964 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.964 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.964 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.964 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.964 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.964 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.964 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-05-08T06:06:48.964 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-05-08T06:06:48.964 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.964 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.964 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.965 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "24", 2024-05-08T06:06:48.965 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "8", 2024-05-08T06:06:48.965 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.965 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.965 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.965 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.965 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.965 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.965 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.965 INFO:teuthology.orchestra.run.smithi082.stdout: "last_opt_revision": { 2024-05-08T06:06:48.965 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "last_opt_revision", 2024-05-08T06:06:48.965 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.965 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.965 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.965 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "1", 2024-05-08T06:06:48.965 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.965 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.966 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.966 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.966 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.966 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.966 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.966 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.966 INFO:teuthology.orchestra.run.smithi082.stdout: "leaderboard": { 2024-05-08T06:06:48.966 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "leaderboard", 2024-05-08T06:06:48.966 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.966 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.966 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.966 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.966 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.966 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.966 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.966 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.967 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.967 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.967 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.967 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.967 INFO:teuthology.orchestra.run.smithi082.stdout: "leaderboard_description": { 2024-05-08T06:06:48.967 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "leaderboard_description", 2024-05-08T06:06:48.967 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.967 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.967 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.967 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.967 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.967 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.967 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.967 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.967 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.967 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.968 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.968 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.968 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.968 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.968 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.968 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.968 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.968 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.968 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.968 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.968 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.968 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.968 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.968 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.968 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.968 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.969 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.969 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.969 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.969 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.969 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.969 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.969 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.969 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.969 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.969 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.969 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.969 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.969 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.969 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.969 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.970 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.970 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.970 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.970 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.970 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.970 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.970 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.970 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.970 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.970 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.970 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.970 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.970 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.970 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.970 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.970 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.971 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.971 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.971 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.971 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.971 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.971 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.971 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.971 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.971 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.971 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.971 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.971 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.971 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.971 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.971 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.971 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.972 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.972 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.972 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.972 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.972 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.972 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.972 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.972 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.972 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.972 INFO:teuthology.orchestra.run.smithi082.stdout: "organization": { 2024-05-08T06:06:48.972 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "organization", 2024-05-08T06:06:48.972 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.972 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.972 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.972 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.972 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.972 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.973 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.973 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.973 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.973 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.973 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.973 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.973 INFO:teuthology.orchestra.run.smithi082.stdout: "proxy": { 2024-05-08T06:06:48.973 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "proxy", 2024-05-08T06:06:48.973 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.973 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.973 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.973 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.973 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.973 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.973 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.973 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.974 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.974 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.974 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.974 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.974 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.974 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.974 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.974 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.974 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.974 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.974 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.974 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.974 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.974 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.974 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.975 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.975 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.975 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.975 INFO:teuthology.orchestra.run.smithi082.stdout: "url": { 2024-05-08T06:06:48.975 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "url", 2024-05-08T06:06:48.975 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.975 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.975 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.975 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-05-08T06:06:48.975 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.975 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.975 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.975 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.975 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.975 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.975 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.976 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.976 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.976 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.976 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.976 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "test_orchestrator", 2024-05-08T06:06:48.976 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.976 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.976 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.976 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.976 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.976 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.976 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.976 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.976 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.976 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.977 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.977 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.977 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.977 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.977 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.977 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.977 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.977 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.977 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.977 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.977 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.977 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.977 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.977 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.977 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.977 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.977 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.978 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.978 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.978 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.978 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.978 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.978 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.978 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.978 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.978 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.978 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.978 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.978 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.978 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.978 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.978 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.978 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.979 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.979 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.979 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.979 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.979 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.979 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.979 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.979 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.979 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.979 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.979 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.979 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.979 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.979 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.980 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.980 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.980 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.980 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.980 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.980 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.980 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.980 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.980 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.980 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.980 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.980 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.980 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.980 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.980 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.981 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.981 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.981 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.981 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.981 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.981 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.981 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.981 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.981 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.981 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.981 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.981 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.981 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.981 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.982 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.982 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.982 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.982 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.982 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "volumes", 2024-05-08T06:06:48.982 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.982 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.982 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.982 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.982 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.982 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.982 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.982 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.982 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.983 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.983 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.983 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.983 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.983 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.983 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.983 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.983 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.983 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.983 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.983 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.983 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.983 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.983 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.983 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.984 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.984 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.984 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.984 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.984 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.984 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.984 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.984 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.984 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.984 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.984 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.984 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.984 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.984 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.985 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.985 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.985 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.985 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.985 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.985 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.985 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.985 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.985 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.985 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.985 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.985 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.985 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.985 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.986 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.986 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.986 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.986 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.986 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.986 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.986 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.986 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.986 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.986 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.986 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.986 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.986 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.986 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.987 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.987 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.987 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.987 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.987 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.987 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.987 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.987 INFO:teuthology.orchestra.run.smithi082.stdout: "max_concurrent_clones": { 2024-05-08T06:06:48.987 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "max_concurrent_clones", 2024-05-08T06:06:48.987 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.987 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.987 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.987 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "4", 2024-05-08T06:06:48.988 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.988 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.988 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.988 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Number of asynchronous cloner threads", 2024-05-08T06:06:48.988 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.988 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.988 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.988 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.988 INFO:teuthology.orchestra.run.smithi082.stdout: "periodic_async_work": { 2024-05-08T06:06:48.988 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "periodic_async_work", 2024-05-08T06:06:48.988 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.988 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.988 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.988 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.988 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.989 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.989 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.989 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Periodically check for async work", 2024-05-08T06:06:48.989 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.989 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.989 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.989 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.989 INFO:teuthology.orchestra.run.smithi082.stdout: "snapshot_clone_delay": { 2024-05-08T06:06:48.989 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "snapshot_clone_delay", 2024-05-08T06:06:48.989 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.989 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.989 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.989 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.989 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.989 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.990 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.990 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-05-08T06:06:48.990 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.990 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.990 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.990 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.990 INFO:teuthology.orchestra.run.smithi082.stdout: "snapshot_clone_no_wait": { 2024-05-08T06:06:48.990 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "snapshot_clone_no_wait", 2024-05-08T06:06:48.990 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.990 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.990 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.990 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "True", 2024-05-08T06:06:48.990 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.990 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.990 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.991 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-05-08T06:06:48.991 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.991 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.991 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.991 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.991 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:48.991 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:48.991 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:48.991 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:48.991 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.991 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:48.991 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.991 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.991 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.991 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.992 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.992 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.992 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.992 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.992 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:48.992 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.992 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:48.992 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix", 2024-05-08T06:06:48.992 INFO:teuthology.orchestra.run.smithi082.stdout: "can_run": true, 2024-05-08T06:06:48.992 INFO:teuthology.orchestra.run.smithi082.stdout: "error_string": "", 2024-05-08T06:06:48.992 INFO:teuthology.orchestra.run.smithi082.stdout: "module_options": { 2024-05-08T06:06:48.992 INFO:teuthology.orchestra.run.smithi082.stdout: "discovery_interval": { 2024-05-08T06:06:48.992 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "discovery_interval", 2024-05-08T06:06:48.992 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "uint", 2024-05-08T06:06:48.993 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.993 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.993 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "100", 2024-05-08T06:06:48.993 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.993 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.993 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.993 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.993 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.993 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.993 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.993 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.993 INFO:teuthology.orchestra.run.smithi082.stdout: "identifier": { 2024-05-08T06:06:48.993 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "identifier", 2024-05-08T06:06:48.993 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.993 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.993 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.994 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.994 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.994 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.994 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.994 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.994 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.994 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.994 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.994 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.994 INFO:teuthology.orchestra.run.smithi082.stdout: "interval": { 2024-05-08T06:06:48.994 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "interval", 2024-05-08T06:06:48.994 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "secs", 2024-05-08T06:06:48.994 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.994 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:48.994 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "60", 2024-05-08T06:06:48.995 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.995 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.995 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.995 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.995 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.995 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.995 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.995 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.995 INFO:teuthology.orchestra.run.smithi082.stdout: "log_level": { 2024-05-08T06:06:48.995 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_level", 2024-05-08T06:06:48.995 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.995 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.995 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.995 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:48.996 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.996 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.996 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.996 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.996 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.996 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.996 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.996 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.996 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.996 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.996 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.996 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.996 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.996 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.996 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.996 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster": { 2024-05-08T06:06:48.997 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster", 2024-05-08T06:06:48.997 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.997 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.997 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.997 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.997 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.997 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.997 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.997 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.997 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.997 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.997 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.997 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.997 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_cluster_level": { 2024-05-08T06:06:48.997 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_cluster_level", 2024-05-08T06:06:48.998 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:48.998 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.998 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.998 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "info", 2024-05-08T06:06:48.998 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.998 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.998 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [ 2024-05-08T06:06:48.998 INFO:teuthology.orchestra.run.smithi082.stdout: "", 2024-05-08T06:06:48.998 INFO:teuthology.orchestra.run.smithi082.stdout: "critical", 2024-05-08T06:06:48.998 INFO:teuthology.orchestra.run.smithi082.stdout: "debug", 2024-05-08T06:06:48.998 INFO:teuthology.orchestra.run.smithi082.stdout: "error", 2024-05-08T06:06:48.998 INFO:teuthology.orchestra.run.smithi082.stdout: "info", 2024-05-08T06:06:48.998 INFO:teuthology.orchestra.run.smithi082.stdout: "warning" 2024-05-08T06:06:48.998 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:48.999 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:48.999 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:48.999 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:48.999 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:48.999 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:48.999 INFO:teuthology.orchestra.run.smithi082.stdout: "log_to_file": { 2024-05-08T06:06:48.999 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "log_to_file", 2024-05-08T06:06:48.999 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "bool", 2024-05-08T06:06:48.999 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:48.999 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:48.999 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "False", 2024-05-08T06:06:48.999 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:48.999 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:48.999 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:48.999 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:49.000 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:49.000 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:49.000 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:49.000 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:49.000 INFO:teuthology.orchestra.run.smithi082.stdout: "sqlite3_killpoint": { 2024-05-08T06:06:49.000 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "sqlite3_killpoint", 2024-05-08T06:06:49.000 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:49.000 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "dev", 2024-05-08T06:06:49.000 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 1, 2024-05-08T06:06:49.000 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "0", 2024-05-08T06:06:49.000 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:49.000 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:49.000 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:49.000 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:49.001 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:49.001 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:49.001 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:49.001 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:49.001 INFO:teuthology.orchestra.run.smithi082.stdout: "zabbix_host": { 2024-05-08T06:06:49.001 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix_host", 2024-05-08T06:06:49.001 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:49.001 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:49.001 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:49.001 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "", 2024-05-08T06:06:49.001 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:49.001 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:49.001 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:49.001 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:49.001 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:49.002 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:49.002 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:49.002 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:49.002 INFO:teuthology.orchestra.run.smithi082.stdout: "zabbix_port": { 2024-05-08T06:06:49.002 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix_port", 2024-05-08T06:06:49.002 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "int", 2024-05-08T06:06:49.002 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:49.002 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:49.002 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "10051", 2024-05-08T06:06:49.002 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:49.002 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:49.002 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:49.002 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:49.003 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:49.003 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:49.003 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:49.003 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:49.003 INFO:teuthology.orchestra.run.smithi082.stdout: "zabbix_sender": { 2024-05-08T06:06:49.003 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "zabbix_sender", 2024-05-08T06:06:49.003 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "str", 2024-05-08T06:06:49.003 INFO:teuthology.orchestra.run.smithi082.stdout: "level": "advanced", 2024-05-08T06:06:49.003 INFO:teuthology.orchestra.run.smithi082.stdout: "flags": 0, 2024-05-08T06:06:49.003 INFO:teuthology.orchestra.run.smithi082.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-05-08T06:06:49.003 INFO:teuthology.orchestra.run.smithi082.stdout: "min": "", 2024-05-08T06:06:49.003 INFO:teuthology.orchestra.run.smithi082.stdout: "max": "", 2024-05-08T06:06:49.003 INFO:teuthology.orchestra.run.smithi082.stdout: "enum_allowed": [], 2024-05-08T06:06:49.003 INFO:teuthology.orchestra.run.smithi082.stdout: "desc": "", 2024-05-08T06:06:49.003 INFO:teuthology.orchestra.run.smithi082.stdout: "long_desc": "", 2024-05-08T06:06:49.004 INFO:teuthology.orchestra.run.smithi082.stdout: "tags": [], 2024-05-08T06:06:49.004 INFO:teuthology.orchestra.run.smithi082.stdout: "see_also": [] 2024-05-08T06:06:49.004 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:49.004 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:49.004 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:49.004 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:49.004 INFO:teuthology.orchestra.run.smithi082.stdout: "services": { 2024-05-08T06:06:49.004 INFO:teuthology.orchestra.run.smithi082.stdout: "dashboard": "https://172.21.15.82:8443/" 2024-05-08T06:06:49.004 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:49.004 INFO:teuthology.orchestra.run.smithi082.stdout: "always_on_modules": { 2024-05-08T06:06:49.004 INFO:teuthology.orchestra.run.smithi082.stdout: "octopus": [ 2024-05-08T06:06:49.004 INFO:teuthology.orchestra.run.smithi082.stdout: "balancer", 2024-05-08T06:06:49.004 INFO:teuthology.orchestra.run.smithi082.stdout: "crash", 2024-05-08T06:06:49.004 INFO:teuthology.orchestra.run.smithi082.stdout: "devicehealth", 2024-05-08T06:06:49.005 INFO:teuthology.orchestra.run.smithi082.stdout: "orchestrator", 2024-05-08T06:06:49.005 INFO:teuthology.orchestra.run.smithi082.stdout: "pg_autoscaler", 2024-05-08T06:06:49.005 INFO:teuthology.orchestra.run.smithi082.stdout: "progress", 2024-05-08T06:06:49.005 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_support", 2024-05-08T06:06:49.005 INFO:teuthology.orchestra.run.smithi082.stdout: "status", 2024-05-08T06:06:49.005 INFO:teuthology.orchestra.run.smithi082.stdout: "telemetry", 2024-05-08T06:06:49.005 INFO:teuthology.orchestra.run.smithi082.stdout: "volumes" 2024-05-08T06:06:49.005 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:49.005 INFO:teuthology.orchestra.run.smithi082.stdout: "pacific": [ 2024-05-08T06:06:49.005 INFO:teuthology.orchestra.run.smithi082.stdout: "balancer", 2024-05-08T06:06:49.005 INFO:teuthology.orchestra.run.smithi082.stdout: "crash", 2024-05-08T06:06:49.005 INFO:teuthology.orchestra.run.smithi082.stdout: "devicehealth", 2024-05-08T06:06:49.005 INFO:teuthology.orchestra.run.smithi082.stdout: "orchestrator", 2024-05-08T06:06:49.005 INFO:teuthology.orchestra.run.smithi082.stdout: "pg_autoscaler", 2024-05-08T06:06:49.005 INFO:teuthology.orchestra.run.smithi082.stdout: "progress", 2024-05-08T06:06:49.006 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_support", 2024-05-08T06:06:49.006 INFO:teuthology.orchestra.run.smithi082.stdout: "status", 2024-05-08T06:06:49.006 INFO:teuthology.orchestra.run.smithi082.stdout: "telemetry", 2024-05-08T06:06:49.006 INFO:teuthology.orchestra.run.smithi082.stdout: "volumes" 2024-05-08T06:06:49.006 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:49.006 INFO:teuthology.orchestra.run.smithi082.stdout: "quincy": [ 2024-05-08T06:06:49.006 INFO:teuthology.orchestra.run.smithi082.stdout: "balancer", 2024-05-08T06:06:49.006 INFO:teuthology.orchestra.run.smithi082.stdout: "crash", 2024-05-08T06:06:49.006 INFO:teuthology.orchestra.run.smithi082.stdout: "devicehealth", 2024-05-08T06:06:49.006 INFO:teuthology.orchestra.run.smithi082.stdout: "orchestrator", 2024-05-08T06:06:49.006 INFO:teuthology.orchestra.run.smithi082.stdout: "pg_autoscaler", 2024-05-08T06:06:49.006 INFO:teuthology.orchestra.run.smithi082.stdout: "progress", 2024-05-08T06:06:49.006 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_support", 2024-05-08T06:06:49.006 INFO:teuthology.orchestra.run.smithi082.stdout: "status", 2024-05-08T06:06:49.006 INFO:teuthology.orchestra.run.smithi082.stdout: "telemetry", 2024-05-08T06:06:49.007 INFO:teuthology.orchestra.run.smithi082.stdout: "volumes" 2024-05-08T06:06:49.007 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:49.007 INFO:teuthology.orchestra.run.smithi082.stdout: "reef": [ 2024-05-08T06:06:49.007 INFO:teuthology.orchestra.run.smithi082.stdout: "balancer", 2024-05-08T06:06:49.007 INFO:teuthology.orchestra.run.smithi082.stdout: "crash", 2024-05-08T06:06:49.007 INFO:teuthology.orchestra.run.smithi082.stdout: "devicehealth", 2024-05-08T06:06:49.007 INFO:teuthology.orchestra.run.smithi082.stdout: "orchestrator", 2024-05-08T06:06:49.007 INFO:teuthology.orchestra.run.smithi082.stdout: "pg_autoscaler", 2024-05-08T06:06:49.007 INFO:teuthology.orchestra.run.smithi082.stdout: "progress", 2024-05-08T06:06:49.007 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_support", 2024-05-08T06:06:49.007 INFO:teuthology.orchestra.run.smithi082.stdout: "status", 2024-05-08T06:06:49.007 INFO:teuthology.orchestra.run.smithi082.stdout: "telemetry", 2024-05-08T06:06:49.007 INFO:teuthology.orchestra.run.smithi082.stdout: "volumes" 2024-05-08T06:06:49.007 INFO:teuthology.orchestra.run.smithi082.stdout: ], 2024-05-08T06:06:49.007 INFO:teuthology.orchestra.run.smithi082.stdout: "squid": [ 2024-05-08T06:06:49.008 INFO:teuthology.orchestra.run.smithi082.stdout: "balancer", 2024-05-08T06:06:49.008 INFO:teuthology.orchestra.run.smithi082.stdout: "crash", 2024-05-08T06:06:49.008 INFO:teuthology.orchestra.run.smithi082.stdout: "devicehealth", 2024-05-08T06:06:49.008 INFO:teuthology.orchestra.run.smithi082.stdout: "orchestrator", 2024-05-08T06:06:49.008 INFO:teuthology.orchestra.run.smithi082.stdout: "pg_autoscaler", 2024-05-08T06:06:49.008 INFO:teuthology.orchestra.run.smithi082.stdout: "progress", 2024-05-08T06:06:49.008 INFO:teuthology.orchestra.run.smithi082.stdout: "rbd_support", 2024-05-08T06:06:49.008 INFO:teuthology.orchestra.run.smithi082.stdout: "status", 2024-05-08T06:06:49.008 INFO:teuthology.orchestra.run.smithi082.stdout: "telemetry", 2024-05-08T06:06:49.008 INFO:teuthology.orchestra.run.smithi082.stdout: "volumes" 2024-05-08T06:06:49.008 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-05-08T06:06:49.008 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:49.008 INFO:teuthology.orchestra.run.smithi082.stdout: "last_failure_osd_epoch": 3, 2024-05-08T06:06:49.008 INFO:teuthology.orchestra.run.smithi082.stdout: "active_clients": [ 2024-05-08T06:06:49.008 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:49.009 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "devicehealth", 2024-05-08T06:06:49.009 INFO:teuthology.orchestra.run.smithi082.stdout: "addrvec": [ 2024-05-08T06:06:49.009 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:49.009 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v2", 2024-05-08T06:06:49.009 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "172.21.15.82:0", 2024-05-08T06:06:49.009 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 197249076 2024-05-08T06:06:49.009 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:49.009 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-05-08T06:06:49.009 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:49.009 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:49.009 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "libcephsqlite", 2024-05-08T06:06:49.009 INFO:teuthology.orchestra.run.smithi082.stdout: "addrvec": [ 2024-05-08T06:06:49.009 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:49.009 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v2", 2024-05-08T06:06:49.009 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "172.21.15.82:0", 2024-05-08T06:06:49.009 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 1902988802 2024-05-08T06:06:49.010 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:49.010 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-05-08T06:06:49.010 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:49.010 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:49.010 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "rbd_support", 2024-05-08T06:06:49.010 INFO:teuthology.orchestra.run.smithi082.stdout: "addrvec": [ 2024-05-08T06:06:49.010 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:49.010 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v2", 2024-05-08T06:06:49.010 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "172.21.15.82:0", 2024-05-08T06:06:49.010 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 3665227932 2024-05-08T06:06:49.010 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:49.010 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-05-08T06:06:49.010 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:49.010 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:49.011 INFO:teuthology.orchestra.run.smithi082.stdout: "name": "volumes", 2024-05-08T06:06:49.011 INFO:teuthology.orchestra.run.smithi082.stdout: "addrvec": [ 2024-05-08T06:06:49.011 INFO:teuthology.orchestra.run.smithi082.stdout: { 2024-05-08T06:06:49.011 INFO:teuthology.orchestra.run.smithi082.stdout: "type": "v2", 2024-05-08T06:06:49.011 INFO:teuthology.orchestra.run.smithi082.stdout: "addr": "172.21.15.82:0", 2024-05-08T06:06:49.011 INFO:teuthology.orchestra.run.smithi082.stdout: "nonce": 4179080010 2024-05-08T06:06:49.011 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:49.011 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-05-08T06:06:49.011 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:49.011 INFO:teuthology.orchestra.run.smithi082.stdout: ] 2024-05-08T06:06:49.011 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T06:06:49.012 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:06:47 smithi134 ceph-mon[34132]: pgmap v943: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.9 KiB/s wr, 11 op/s 2024-05-08T06:06:49.012 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:06:47 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/2048996375' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-08T06:06:49.012 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:06:47 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/581467073' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-08T06:06:49.013 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:06:47 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/2442070580' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-05-08T06:06:49.013 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:06:47 smithi151 ceph-mon[34815]: pgmap v943: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.9 KiB/s wr, 11 op/s 2024-05-08T06:06:49.013 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:06:47 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/2048996375' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-08T06:06:49.013 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:06:47 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/581467073' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-08T06:06:49.013 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:06:47 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/2442070580' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-05-08T06:06:49.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.736+0000 7ff592800640 1 -- 172.21.15.82:0/2442070580 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff5740b27f0 msgr2=0x7ff5740b4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:49.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.736+0000 7ff592800640 1 --2- 172.21.15.82:0/2442070580 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff5740b27f0 0x7ff5740b4cb0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff580009230 tx=0x7ff5800314a0 comp rx=0 tx=0).stop 2024-05-08T06:06:49.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.736+0000 7ff592800640 1 -- 172.21.15.82:0/2442070580 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff58c1043d0 msgr2=0x7ff58c1a0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:06:49.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.736+0000 7ff592800640 1 --2- 172.21.15.82:0/2442070580 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff58c1043d0 0x7ff58c1a0060 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff58400eb10 tx=0x7ff58400c2d0 comp rx=0 tx=0).stop 2024-05-08T06:06:49.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.737+0000 7ff592800640 1 -- 172.21.15.82:0/2442070580 shutdown_connections 2024-05-08T06:06:49.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.737+0000 7ff592800640 1 --2- 172.21.15.82:0/2442070580 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7ff5740b27f0 0x7ff5740b4cb0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:49.014 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.737+0000 7ff592800640 1 --2- 172.21.15.82:0/2442070580 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff58c1043d0 0x7ff58c1a0060 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:49.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.737+0000 7ff592800640 1 --2- 172.21.15.82:0/2442070580 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7ff58c103a10 0x7ff58c199040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:49.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.737+0000 7ff592800640 1 --2- 172.21.15.82:0/2442070580 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff58c102820 0x7ff58c198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:06:49.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.737+0000 7ff592800640 1 -- 172.21.15.82:0/2442070580 >> 172.21.15.82:0/2442070580 conn(0x7ff58c0fdd90 msgr2=0x7ff58c106e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:06:49.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.737+0000 7ff592800640 1 -- 172.21.15.82:0/2442070580 shutdown_connections 2024-05-08T06:06:49.015 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:06:47.737+0000 7ff592800640 1 -- 172.21.15.82:0/2442070580 wait complete. 2024-05-08T06:06:49.021 DEBUG:tasks.check_counter:Getting stats from a 2024-05-08T06:06:49.021 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph daemon mds.a perf dump 2024-05-08T06:06:49.021 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:06:47 smithi082 ceph-mon[30098]: pgmap v943: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.9 KiB/s wr, 11 op/s 2024-05-08T06:06:49.021 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:06:47 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/2048996375' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-08T06:06:49.021 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:06:47 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/581467073' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-08T06:06:49.022 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:06:47 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/2442070580' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-05-08T06:06:49.478 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:06:49.826 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:06:49 smithi082 ceph-mon[30098]: pgmap v944: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-05-08T06:06:50.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:06:49 smithi151 ceph-mon[34815]: pgmap v944: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-05-08T06:06:50.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:06:49 smithi134 ceph-mon[34132]: pgmap v944: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-05-08T06:06:51.820 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T06:06:51.821 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T06:06:51.821 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 2644, 2024-05-08T06:06:51.821 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 2646, 2024-05-08T06:06:51.821 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 2634188, 2024-05-08T06:06:51.821 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 840793, 2024-05-08T06:06:51.821 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 6, 2024-05-08T06:06:51.821 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 2, 2024-05-08T06:06:51.821 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.419461929, 2024-05-08T06:06:51.821 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.133045071, 2024-05-08T06:06:51.821 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.100282168, 2024-05-08T06:06:51.821 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.141290559, 2024-05-08T06:06:51.821 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T06:06:51.821 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 2644, 2024-05-08T06:06:51.822 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.424150412, 2024-05-08T06:06:51.822 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000160419 2024-05-08T06:06:51.822 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.822 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-05-08T06:06:51.822 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:51.822 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:51.822 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:51.822 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.822 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-08T06:06:51.822 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 0 2024-05-08T06:06:51.822 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.822 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T06:06:51.822 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 1146, 2024-05-08T06:06:51.823 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 1404, 2024-05-08T06:06:51.823 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 282482, 2024-05-08T06:06:51.823 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 896754, 2024-05-08T06:06:51.823 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 6, 2024-05-08T06:06:51.823 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 4, 2024-05-08T06:06:51.823 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.228196625, 2024-05-08T06:06:51.823 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.085440769, 2024-05-08T06:06:51.823 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.039981764, 2024-05-08T06:06:51.823 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.076969006, 2024-05-08T06:06:51.823 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T06:06:51.823 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 1402, 2024-05-08T06:06:51.823 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.207014130, 2024-05-08T06:06:51.824 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000147656 2024-05-08T06:06:51.824 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.824 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-05-08T06:06:51.824 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:51.824 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:51.824 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:51.824 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.824 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-08T06:06:51.824 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 532576 2024-05-08T06:06:51.824 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.824 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T06:06:51.824 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 361, 2024-05-08T06:06:51.824 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 350, 2024-05-08T06:06:51.825 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 895740, 2024-05-08T06:06:51.825 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 212126, 2024-05-08T06:06:51.825 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 4, 2024-05-08T06:06:51.825 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 2, 2024-05-08T06:06:51.825 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.108634267, 2024-05-08T06:06:51.825 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.047816629, 2024-05-08T06:06:51.825 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.058141601, 2024-05-08T06:06:51.825 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.013144640, 2024-05-08T06:06:51.825 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T06:06:51.825 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 350, 2024-05-08T06:06:51.825 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.055054316, 2024-05-08T06:06:51.825 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000157298 2024-05-08T06:06:51.825 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.826 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-05-08T06:06:51.826 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:51.826 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:51.826 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:51.826 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.826 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 895472, 2024-05-08T06:06:51.826 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 211808 2024-05-08T06:06:51.826 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.826 INFO:teuthology.orchestra.run.smithi082.stdout: "cct": { 2024-05-08T06:06:51.826 INFO:teuthology.orchestra.run.smithi082.stdout: "total_workers": 1, 2024-05-08T06:06:51.826 INFO:teuthology.orchestra.run.smithi082.stdout: "unhealthy_workers": 0 2024-05-08T06:06:51.826 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.826 INFO:teuthology.orchestra.run.smithi082.stdout: "finisher-MDSRank": { 2024-05-08T06:06:51.826 INFO:teuthology.orchestra.run.smithi082.stdout: "queue_len": 0, 2024-05-08T06:06:51.827 INFO:teuthology.orchestra.run.smithi082.stdout: "complete_latency": { 2024-05-08T06:06:51.827 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 6069, 2024-05-08T06:06:51.827 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.296131389, 2024-05-08T06:06:51.827 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000048794 2024-05-08T06:06:51.827 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:51.827 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.827 INFO:teuthology.orchestra.run.smithi082.stdout: "finisher-PurgeQueue": { 2024-05-08T06:06:51.827 INFO:teuthology.orchestra.run.smithi082.stdout: "queue_len": 0, 2024-05-08T06:06:51.827 INFO:teuthology.orchestra.run.smithi082.stdout: "complete_latency": { 2024-05-08T06:06:51.827 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:51.827 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:51.827 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:51.827 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:51.827 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.827 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-05-08T06:06:51.828 INFO:teuthology.orchestra.run.smithi082.stdout: "request": 0, 2024-05-08T06:06:51.828 INFO:teuthology.orchestra.run.smithi082.stdout: "reply": 0, 2024-05-08T06:06:51.828 INFO:teuthology.orchestra.run.smithi082.stdout: "reply_latency": { 2024-05-08T06:06:51.828 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:51.828 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:51.828 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:51.828 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.828 INFO:teuthology.orchestra.run.smithi082.stdout: "slow_reply": 0, 2024-05-08T06:06:51.828 INFO:teuthology.orchestra.run.smithi082.stdout: "forward": 0, 2024-05-08T06:06:51.828 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_fetch_complete": 0, 2024-05-08T06:06:51.828 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_fetch_keys": 0, 2024-05-08T06:06:51.828 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_commit": 0, 2024-05-08T06:06:51.828 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_split": 0, 2024-05-08T06:06:51.828 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_merge": 0, 2024-05-08T06:06:51.829 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes": 325, 2024-05-08T06:06:51.829 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_top": 0, 2024-05-08T06:06:51.829 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_bottom": 325, 2024-05-08T06:06:51.829 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_pin_tail": 0, 2024-05-08T06:06:51.829 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_pinned": 325, 2024-05-08T06:06:51.829 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_expired": 0, 2024-05-08T06:06:51.829 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_with_caps": 0, 2024-05-08T06:06:51.829 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": 0, 2024-05-08T06:06:51.829 INFO:teuthology.orchestra.run.smithi082.stdout: "subtrees": 10, 2024-05-08T06:06:51.829 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse": 0, 2024-05-08T06:06:51.829 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_hit": 0, 2024-05-08T06:06:51.829 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_forward": 0, 2024-05-08T06:06:51.829 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_discover": 0, 2024-05-08T06:06:51.829 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_dir_fetch": 0, 2024-05-08T06:06:51.829 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_remote_ino": 0, 2024-05-08T06:06:51.830 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_lock": 0, 2024-05-08T06:06:51.830 INFO:teuthology.orchestra.run.smithi082.stdout: "load_cent": 0, 2024-05-08T06:06:51.830 INFO:teuthology.orchestra.run.smithi082.stdout: "q": 0, 2024-05-08T06:06:51.830 INFO:teuthology.orchestra.run.smithi082.stdout: "exported": 0, 2024-05-08T06:06:51.830 INFO:teuthology.orchestra.run.smithi082.stdout: "exported_inodes": 0, 2024-05-08T06:06:51.830 INFO:teuthology.orchestra.run.smithi082.stdout: "imported": 0, 2024-05-08T06:06:51.830 INFO:teuthology.orchestra.run.smithi082.stdout: "imported_inodes": 0, 2024-05-08T06:06:51.830 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_dir_fetch": 0, 2024-05-08T06:06:51.830 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_backtrace_fetch": 0, 2024-05-08T06:06:51.830 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_peer_discover": 0, 2024-05-08T06:06:51.830 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rfiles": 0, 2024-05-08T06:06:51.830 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rbytes": 0, 2024-05-08T06:06:51.830 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rsnaps": 0, 2024-05-08T06:06:51.830 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_backtrace_fetch": 0, 2024-05-08T06:06:51.831 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_set_tag": 0, 2024-05-08T06:06:51.831 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_backtrace_repaired": 0, 2024-05-08T06:06:51.831 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_inotable_repaired": 0, 2024-05-08T06:06:51.831 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dir_inodes": 0, 2024-05-08T06:06:51.831 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dir_base_inodes": 0, 2024-05-08T06:06:51.831 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dirfrag_rstats": 0, 2024-05-08T06:06:51.831 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_file_inodes": 0, 2024-05-08T06:06:51.831 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_inode_file_caps": 0, 2024-05-08T06:06:51.831 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_revoke": 0, 2024-05-08T06:06:51.831 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_grant": 0, 2024-05-08T06:06:51.831 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_trunc": 0, 2024-05-08T06:06:51.831 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-08T06:06:51.831 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-08T06:06:51.831 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_caps": 0, 2024-05-08T06:06:51.831 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_caps_dirty": 0, 2024-05-08T06:06:51.831 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_cap_release": 0, 2024-05-08T06:06:51.832 INFO:teuthology.orchestra.run.smithi082.stdout: "process_request_cap_release": 0 2024-05-08T06:06:51.832 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.832 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_cache": { 2024-05-08T06:06:51.832 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_update": 0, 2024-05-08T06:06:51.832 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_update_receipt": 0, 2024-05-08T06:06:51.832 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_try_discover": 0, 2024-05-08T06:06:51.832 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_send_discover": 0, 2024-05-08T06:06:51.832 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_handle_discover": 0, 2024-05-08T06:06:51.832 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays": 0, 2024-05-08T06:06:51.832 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays_delayed": 0, 2024-05-08T06:06:51.832 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays_enqueuing": 0, 2024-05-08T06:06:51.832 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_created": 0, 2024-05-08T06:06:51.832 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_enqueued": 0, 2024-05-08T06:06:51.832 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_reintegrated": 0, 2024-05-08T06:06:51.832 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_migrated": 0, 2024-05-08T06:06:51.833 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_processing": 0, 2024-05-08T06:06:51.833 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_enqueued": 0, 2024-05-08T06:06:51.833 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_prioritized": 0, 2024-05-08T06:06:51.833 INFO:teuthology.orchestra.run.smithi082.stdout: "recovery_started": 0, 2024-05-08T06:06:51.833 INFO:teuthology.orchestra.run.smithi082.stdout: "recovery_completed": 0, 2024-05-08T06:06:51.833 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_quiesce_path": 0, 2024-05-08T06:06:51.833 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_quiesce_inode": 0, 2024-05-08T06:06:51.833 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_enqueue_scrub": 0, 2024-05-08T06:06:51.833 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_exportdir": 0, 2024-05-08T06:06:51.833 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_flush": 0, 2024-05-08T06:06:51.833 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_fragmentdir": 0, 2024-05-08T06:06:51.833 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_fragstats": 0, 2024-05-08T06:06:51.833 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_inodestats": 0 2024-05-08T06:06:51.833 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.833 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_log": { 2024-05-08T06:06:51.833 INFO:teuthology.orchestra.run.smithi082.stdout: "evlrg": 0, 2024-05-08T06:06:51.834 INFO:teuthology.orchestra.run.smithi082.stdout: "evadd": 0, 2024-05-08T06:06:51.834 INFO:teuthology.orchestra.run.smithi082.stdout: "evex": 0, 2024-05-08T06:06:51.834 INFO:teuthology.orchestra.run.smithi082.stdout: "evtrm": 0, 2024-05-08T06:06:51.834 INFO:teuthology.orchestra.run.smithi082.stdout: "ev": 1629, 2024-05-08T06:06:51.834 INFO:teuthology.orchestra.run.smithi082.stdout: "evexg": 0, 2024-05-08T06:06:51.834 INFO:teuthology.orchestra.run.smithi082.stdout: "evexd": 0, 2024-05-08T06:06:51.834 INFO:teuthology.orchestra.run.smithi082.stdout: "segadd": 0, 2024-05-08T06:06:51.834 INFO:teuthology.orchestra.run.smithi082.stdout: "segex": 0, 2024-05-08T06:06:51.834 INFO:teuthology.orchestra.run.smithi082.stdout: "segtrm": 0, 2024-05-08T06:06:51.834 INFO:teuthology.orchestra.run.smithi082.stdout: "seg": 3, 2024-05-08T06:06:51.834 INFO:teuthology.orchestra.run.smithi082.stdout: "segmjr": 2, 2024-05-08T06:06:51.834 INFO:teuthology.orchestra.run.smithi082.stdout: "segexg": 0, 2024-05-08T06:06:51.835 INFO:teuthology.orchestra.run.smithi082.stdout: "segexd": 0, 2024-05-08T06:06:51.835 INFO:teuthology.orchestra.run.smithi082.stdout: "expos": 4194304, 2024-05-08T06:06:51.835 INFO:teuthology.orchestra.run.smithi082.stdout: "wrpos": 6047865, 2024-05-08T06:06:51.835 INFO:teuthology.orchestra.run.smithi082.stdout: "rdpos": 6047291, 2024-05-08T06:06:51.835 INFO:teuthology.orchestra.run.smithi082.stdout: "jlat": { 2024-05-08T06:06:51.835 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:51.835 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:51.835 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:51.835 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.835 INFO:teuthology.orchestra.run.smithi082.stdout: "replayed": 1629 2024-05-08T06:06:51.835 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.835 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_mem": { 2024-05-08T06:06:51.835 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 317, 2024-05-08T06:06:51.836 INFO:teuthology.orchestra.run.smithi082.stdout: "ino+": 322, 2024-05-08T06:06:51.836 INFO:teuthology.orchestra.run.smithi082.stdout: "ino-": 5, 2024-05-08T06:06:51.836 INFO:teuthology.orchestra.run.smithi082.stdout: "dir": 18, 2024-05-08T06:06:51.836 INFO:teuthology.orchestra.run.smithi082.stdout: "dir+": 18, 2024-05-08T06:06:51.836 INFO:teuthology.orchestra.run.smithi082.stdout: "dir-": 0, 2024-05-08T06:06:51.836 INFO:teuthology.orchestra.run.smithi082.stdout: "dn": 325, 2024-05-08T06:06:51.836 INFO:teuthology.orchestra.run.smithi082.stdout: "dn+": 325, 2024-05-08T06:06:51.836 INFO:teuthology.orchestra.run.smithi082.stdout: "dn-": 0, 2024-05-08T06:06:51.836 INFO:teuthology.orchestra.run.smithi082.stdout: "cap": 0, 2024-05-08T06:06:51.836 INFO:teuthology.orchestra.run.smithi082.stdout: "cap+": 0, 2024-05-08T06:06:51.836 INFO:teuthology.orchestra.run.smithi082.stdout: "cap-": 0, 2024-05-08T06:06:51.836 INFO:teuthology.orchestra.run.smithi082.stdout: "rss": 52068, 2024-05-08T06:06:51.836 INFO:teuthology.orchestra.run.smithi082.stdout: "heap": 215416 2024-05-08T06:06:51.836 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.837 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_server": { 2024-05-08T06:06:51.837 INFO:teuthology.orchestra.run.smithi082.stdout: "dispatch_client_request": 0, 2024-05-08T06:06:51.837 INFO:teuthology.orchestra.run.smithi082.stdout: "dispatch_server_request": 0, 2024-05-08T06:06:51.837 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_request": 0, 2024-05-08T06:06:51.837 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_session": 0, 2024-05-08T06:06:51.837 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_peer_request": 0, 2024-05-08T06:06:51.837 INFO:teuthology.orchestra.run.smithi082.stdout: "req_create_latency": { 2024-05-08T06:06:51.837 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:51.837 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:51.837 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:51.837 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.837 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getattr_latency": { 2024-05-08T06:06:51.837 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:51.838 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:51.838 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:51.838 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.838 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getfilelock_latency": { 2024-05-08T06:06:51.838 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:51.838 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:51.838 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:51.838 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.838 INFO:teuthology.orchestra.run.smithi082.stdout: "req_link_latency": { 2024-05-08T06:06:51.838 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:51.838 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:51.838 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:51.838 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.838 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookup_latency": { 2024-05-08T06:06:51.838 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:51.839 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:51.839 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:51.839 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.839 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookuphash_latency": { 2024-05-08T06:06:51.839 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:51.839 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:51.839 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:51.839 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.839 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupino_latency": { 2024-05-08T06:06:51.839 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:51.839 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:51.839 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:51.839 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.839 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupname_latency": { 2024-05-08T06:06:51.840 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:51.840 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:51.840 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:51.840 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.840 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupparent_latency": { 2024-05-08T06:06:51.840 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:51.840 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:51.840 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:51.840 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.840 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupsnap_latency": { 2024-05-08T06:06:51.840 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:51.840 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:51.840 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:51.840 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.840 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lssnap_latency": { 2024-05-08T06:06:51.840 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:51.841 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:51.841 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:51.841 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.841 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mkdir_latency": { 2024-05-08T06:06:51.841 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:51.841 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:51.842 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:51.842 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.842 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mknod_latency": { 2024-05-08T06:06:51.842 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:51.842 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:51.842 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:51.842 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.842 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mksnap_latency": { 2024-05-08T06:06:51.842 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:51.842 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:51.842 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:51.842 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.842 INFO:teuthology.orchestra.run.smithi082.stdout: "req_open_latency": { 2024-05-08T06:06:51.842 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:51.843 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:51.843 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:51.843 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.843 INFO:teuthology.orchestra.run.smithi082.stdout: "req_readdir_latency": { 2024-05-08T06:06:51.843 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:51.843 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:51.843 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:51.843 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.843 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rename_latency": { 2024-05-08T06:06:51.843 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:51.843 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:51.843 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:51.843 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.843 INFO:teuthology.orchestra.run.smithi082.stdout: "req_renamesnap_latency": { 2024-05-08T06:06:51.843 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:51.844 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:51.844 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:51.844 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.844 INFO:teuthology.orchestra.run.smithi082.stdout: "req_snapdiff_latency": { 2024-05-08T06:06:51.844 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:51.844 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:51.844 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:51.844 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.844 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmdir_latency": { 2024-05-08T06:06:51.844 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:51.844 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:51.844 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:51.844 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.844 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmsnap_latency": { 2024-05-08T06:06:51.844 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:51.845 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:51.845 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:51.845 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.845 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmxattr_latency": { 2024-05-08T06:06:51.845 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:51.845 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:51.845 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:51.845 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.845 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setattr_latency": { 2024-05-08T06:06:51.845 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:51.845 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:51.845 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:51.845 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.845 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setdirlayout_latency": { 2024-05-08T06:06:51.846 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:51.846 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:51.846 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:51.846 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.846 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setfilelock_latency": { 2024-05-08T06:06:51.846 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:51.846 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:51.846 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:51.846 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.846 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setlayout_latency": { 2024-05-08T06:06:51.846 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:51.846 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:51.846 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:51.847 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.847 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setxattr_latency": { 2024-05-08T06:06:51.847 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:51.847 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:51.847 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:51.847 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.847 INFO:teuthology.orchestra.run.smithi082.stdout: "req_symlink_latency": { 2024-05-08T06:06:51.847 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:51.847 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:51.847 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:51.847 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.847 INFO:teuthology.orchestra.run.smithi082.stdout: "req_unlink_latency": { 2024-05-08T06:06:51.847 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:51.847 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:51.847 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:51.848 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.848 INFO:teuthology.orchestra.run.smithi082.stdout: "cap_revoke_eviction": 0, 2024-05-08T06:06:51.848 INFO:teuthology.orchestra.run.smithi082.stdout: "cap_acquisition_throttle": 0, 2024-05-08T06:06:51.848 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getvxattr_latency": { 2024-05-08T06:06:51.848 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:51.848 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:51.848 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:51.848 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:51.848 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.848 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_sessions": { 2024-05-08T06:06:51.848 INFO:teuthology.orchestra.run.smithi082.stdout: "session_count": 1, 2024-05-08T06:06:51.848 INFO:teuthology.orchestra.run.smithi082.stdout: "session_add": 3, 2024-05-08T06:06:51.848 INFO:teuthology.orchestra.run.smithi082.stdout: "session_remove": 2, 2024-05-08T06:06:51.848 INFO:teuthology.orchestra.run.smithi082.stdout: "sessions_open": 2, 2024-05-08T06:06:51.848 INFO:teuthology.orchestra.run.smithi082.stdout: "sessions_stale": 0, 2024-05-08T06:06:51.849 INFO:teuthology.orchestra.run.smithi082.stdout: "total_load": 0, 2024-05-08T06:06:51.849 INFO:teuthology.orchestra.run.smithi082.stdout: "average_load": 0, 2024-05-08T06:06:51.849 INFO:teuthology.orchestra.run.smithi082.stdout: "avg_session_uptime": 3773, 2024-05-08T06:06:51.849 INFO:teuthology.orchestra.run.smithi082.stdout: "mdthresh_evicted": 0 2024-05-08T06:06:51.849 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.849 INFO:teuthology.orchestra.run.smithi082.stdout: "mempool": { 2024-05-08T06:06:51.849 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_bytes": 0, 2024-05-08T06:06:51.849 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_items": 0, 2024-05-08T06:06:51.849 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T06:06:51.849 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_items": 0, 2024-05-08T06:06:51.849 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T06:06:51.849 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_items": 0, 2024-05-08T06:06:51.849 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T06:06:51.849 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T06:06:51.849 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T06:06:51.850 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T06:06:51.850 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T06:06:51.850 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_items": 0, 2024-05-08T06:06:51.850 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T06:06:51.850 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T06:06:51.850 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_bytes": 0, 2024-05-08T06:06:51.850 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_items": 0, 2024-05-08T06:06:51.850 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_bytes": 0, 2024-05-08T06:06:51.850 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_items": 0, 2024-05-08T06:06:51.850 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T06:06:51.850 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T06:06:51.850 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T06:06:51.850 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T06:06:51.850 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T06:06:51.851 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_items": 0, 2024-05-08T06:06:51.851 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_bytes": 0, 2024-05-08T06:06:51.851 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_items": 0, 2024-05-08T06:06:51.851 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T06:06:51.851 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T06:06:51.851 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_bytes": 0, 2024-05-08T06:06:51.851 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_items": 0, 2024-05-08T06:06:51.851 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_bytes": 0, 2024-05-08T06:06:51.851 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_items": 0, 2024-05-08T06:06:51.851 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T06:06:51.851 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_items": 0, 2024-05-08T06:06:51.851 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T06:06:51.851 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_items": 0, 2024-05-08T06:06:51.851 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_bytes": 201600, 2024-05-08T06:06:51.851 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_items": 361, 2024-05-08T06:06:51.852 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_bytes": 0, 2024-05-08T06:06:51.852 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_items": 0, 2024-05-08T06:06:51.852 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_bytes": 0, 2024-05-08T06:06:51.852 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_items": 0, 2024-05-08T06:06:51.852 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_bytes": 0, 2024-05-08T06:06:51.852 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_items": 0, 2024-05-08T06:06:51.852 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_bytes": 0, 2024-05-08T06:06:51.852 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_items": 0, 2024-05-08T06:06:51.852 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_bytes": 7528, 2024-05-08T06:06:51.852 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_items": 158, 2024-05-08T06:06:51.852 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T06:06:51.852 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_items": 0, 2024-05-08T06:06:51.852 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_bytes": 0, 2024-05-08T06:06:51.852 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_items": 0, 2024-05-08T06:06:51.852 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_bytes": 979330, 2024-05-08T06:06:51.852 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_items": 8636, 2024-05-08T06:06:51.853 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_bytes": 0, 2024-05-08T06:06:51.853 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_items": 0, 2024-05-08T06:06:51.853 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_bytes": 0, 2024-05-08T06:06:51.853 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_items": 0 2024-05-08T06:06:51.853 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.853 INFO:teuthology.orchestra.run.smithi082.stdout: "objecter": { 2024-05-08T06:06:51.853 INFO:teuthology.orchestra.run.smithi082.stdout: "op_active": 0, 2024-05-08T06:06:51.853 INFO:teuthology.orchestra.run.smithi082.stdout: "op_laggy": 0, 2024-05-08T06:06:51.853 INFO:teuthology.orchestra.run.smithi082.stdout: "op_send": 3790, 2024-05-08T06:06:51.853 INFO:teuthology.orchestra.run.smithi082.stdout: "op_send_bytes": 21, 2024-05-08T06:06:51.853 INFO:teuthology.orchestra.run.smithi082.stdout: "op_resend": 3, 2024-05-08T06:06:51.853 INFO:teuthology.orchestra.run.smithi082.stdout: "op_reply": 3790, 2024-05-08T06:06:51.853 INFO:teuthology.orchestra.run.smithi082.stdout: "op_latency": { 2024-05-08T06:06:51.853 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 3790, 2024-05-08T06:06:51.853 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 5.987889068, 2024-05-08T06:06:51.853 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.001579917 2024-05-08T06:06:51.854 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.854 INFO:teuthology.orchestra.run.smithi082.stdout: "op_inflight": 0, 2024-05-08T06:06:51.854 INFO:teuthology.orchestra.run.smithi082.stdout: "oplen_avg": { 2024-05-08T06:06:51.854 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 3790, 2024-05-08T06:06:51.854 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 3791 2024-05-08T06:06:51.854 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.854 INFO:teuthology.orchestra.run.smithi082.stdout: "op": 3790, 2024-05-08T06:06:51.854 INFO:teuthology.orchestra.run.smithi082.stdout: "op_r": 3790, 2024-05-08T06:06:51.854 INFO:teuthology.orchestra.run.smithi082.stdout: "op_w": 0, 2024-05-08T06:06:51.854 INFO:teuthology.orchestra.run.smithi082.stdout: "op_rmw": 0, 2024-05-08T06:06:51.854 INFO:teuthology.orchestra.run.smithi082.stdout: "op_pg": 0, 2024-05-08T06:06:51.854 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_stat": 2370, 2024-05-08T06:06:51.854 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_create": 0, 2024-05-08T06:06:51.854 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_read": 1418, 2024-05-08T06:06:51.855 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_write": 0, 2024-05-08T06:06:51.855 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_writefull": 0, 2024-05-08T06:06:51.855 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_writesame": 0, 2024-05-08T06:06:51.855 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_append": 0, 2024-05-08T06:06:51.855 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_zero": 0, 2024-05-08T06:06:51.855 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_truncate": 0, 2024-05-08T06:06:51.855 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_delete": 0, 2024-05-08T06:06:51.855 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_mapext": 0, 2024-05-08T06:06:51.855 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_sparse_read": 0, 2024-05-08T06:06:51.855 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_clonerange": 0, 2024-05-08T06:06:51.855 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_getxattr": 1, 2024-05-08T06:06:51.855 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_setxattr": 0, 2024-05-08T06:06:51.855 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_cmpxattr": 0, 2024-05-08T06:06:51.855 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_rmxattr": 0, 2024-05-08T06:06:51.855 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_resetxattrs": 0, 2024-05-08T06:06:51.855 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_call": 0, 2024-05-08T06:06:51.856 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_watch": 0, 2024-05-08T06:06:51.856 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_notify": 0, 2024-05-08T06:06:51.856 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_src_cmpxattr": 0, 2024-05-08T06:06:51.856 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_pgls": 0, 2024-05-08T06:06:51.856 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_pgls_filter": 0, 2024-05-08T06:06:51.856 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_other": 0, 2024-05-08T06:06:51.856 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_active": 0, 2024-05-08T06:06:51.856 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_send": 0, 2024-05-08T06:06:51.856 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_resend": 0, 2024-05-08T06:06:51.856 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_ping": 0, 2024-05-08T06:06:51.856 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_active": 0, 2024-05-08T06:06:51.856 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_send": 0, 2024-05-08T06:06:51.856 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_resend": 0, 2024-05-08T06:06:51.856 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_active": 0, 2024-05-08T06:06:51.856 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_send": 0, 2024-05-08T06:06:51.857 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_resend": 0, 2024-05-08T06:06:51.857 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_active": 0, 2024-05-08T06:06:51.857 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_send": 0, 2024-05-08T06:06:51.857 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_resend": 0, 2024-05-08T06:06:51.857 INFO:teuthology.orchestra.run.smithi082.stdout: "command_active": 0, 2024-05-08T06:06:51.857 INFO:teuthology.orchestra.run.smithi082.stdout: "command_send": 0, 2024-05-08T06:06:51.857 INFO:teuthology.orchestra.run.smithi082.stdout: "command_resend": 0, 2024-05-08T06:06:51.857 INFO:teuthology.orchestra.run.smithi082.stdout: "map_epoch": 82, 2024-05-08T06:06:51.857 INFO:teuthology.orchestra.run.smithi082.stdout: "map_full": 0, 2024-05-08T06:06:51.857 INFO:teuthology.orchestra.run.smithi082.stdout: "map_inc": 2, 2024-05-08T06:06:51.857 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_sessions": 5, 2024-05-08T06:06:51.857 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_session_open": 7, 2024-05-08T06:06:51.857 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_session_close": 2, 2024-05-08T06:06:51.857 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_laggy": 0, 2024-05-08T06:06:51.857 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_wr": 0, 2024-05-08T06:06:51.858 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_rd": 2, 2024-05-08T06:06:51.858 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_del": 0 2024-05-08T06:06:51.858 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.858 INFO:teuthology.orchestra.run.smithi082.stdout: "oft": { 2024-05-08T06:06:51.858 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_objs": 0, 2024-05-08T06:06:51.858 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_kv_pairs": 0, 2024-05-08T06:06:51.858 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_updates": 0, 2024-05-08T06:06:51.858 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_removes": 0 2024-05-08T06:06:51.858 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.858 INFO:teuthology.orchestra.run.smithi082.stdout: "osd-slow-ops": { 2024-05-08T06:06:51.858 INFO:teuthology.orchestra.run.smithi082.stdout: "slow_ops_count": 0 2024-05-08T06:06:51.858 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.858 INFO:teuthology.orchestra.run.smithi082.stdout: "purge_queue": { 2024-05-08T06:06:51.858 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_ops": 0, 2024-05-08T06:06:51.859 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_ops_high_water": 0, 2024-05-08T06:06:51.859 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing": 0, 2024-05-08T06:06:51.859 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_high_water": 0, 2024-05-08T06:06:51.859 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executed_ops": 0, 2024-05-08T06:06:51.859 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executed": 0, 2024-05-08T06:06:51.859 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_item_in_journal": 0 2024-05-08T06:06:51.859 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.859 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T06:06:51.859 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-05-08T06:06:51.859 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 104857600, 2024-05-08T06:06:51.859 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-05-08T06:06:51.859 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 4147, 2024-05-08T06:06:51.859 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 3417864, 2024-05-08T06:06:51.859 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-05-08T06:06:51.859 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 4147, 2024-05-08T06:06:51.860 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-05-08T06:06:51.860 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-05-08T06:06:51.860 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 4147, 2024-05-08T06:06:51.860 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 3417864, 2024-05-08T06:06:51.860 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-05-08T06:06:51.860 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:51.860 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:51.860 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:51.860 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:51.860 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.860 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-objecter_bytes": { 2024-05-08T06:06:51.860 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-05-08T06:06:51.860 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 104857600, 2024-05-08T06:06:51.860 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-05-08T06:06:51.860 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-05-08T06:06:51.860 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-05-08T06:06:51.861 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-05-08T06:06:51.861 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-05-08T06:06:51.861 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 3790, 2024-05-08T06:06:51.861 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 1853566, 2024-05-08T06:06:51.861 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 3790, 2024-05-08T06:06:51.861 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 1853566, 2024-05-08T06:06:51.861 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-05-08T06:06:51.861 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:51.861 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:51.861 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:51.861 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:51.861 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.861 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-objecter_ops": { 2024-05-08T06:06:51.861 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-05-08T06:06:51.862 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 1024, 2024-05-08T06:06:51.862 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-05-08T06:06:51.862 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-05-08T06:06:51.862 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-05-08T06:06:51.862 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-05-08T06:06:51.862 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-05-08T06:06:51.862 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 3790, 2024-05-08T06:06:51.862 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 3790, 2024-05-08T06:06:51.862 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 3790, 2024-05-08T06:06:51.862 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 3790, 2024-05-08T06:06:51.862 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-05-08T06:06:51.862 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:51.862 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:51.862 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:51.863 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:51.863 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.863 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-write_buf_throttle": { 2024-05-08T06:06:51.863 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-05-08T06:06:51.863 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 3758096384, 2024-05-08T06:06:51.863 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-05-08T06:06:51.863 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-05-08T06:06:51.863 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-05-08T06:06:51.863 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-05-08T06:06:51.863 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-05-08T06:06:51.863 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-05-08T06:06:51.863 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-05-08T06:06:51.863 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 0, 2024-05-08T06:06:51.863 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 0, 2024-05-08T06:06:51.863 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-05-08T06:06:51.864 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:51.864 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:51.864 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:51.864 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:51.864 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:51.864 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-write_buf_throttle-0x561152a64780": { 2024-05-08T06:06:51.864 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-05-08T06:06:51.864 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 3758096384, 2024-05-08T06:06:51.864 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-05-08T06:06:51.864 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-05-08T06:06:51.864 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-05-08T06:06:51.864 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-05-08T06:06:51.864 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-05-08T06:06:51.864 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-05-08T06:06:51.864 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-05-08T06:06:51.864 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 0, 2024-05-08T06:06:51.865 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 0, 2024-05-08T06:06:51.865 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-05-08T06:06:51.865 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:51.865 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:51.865 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:51.865 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:51.865 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:51.865 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T06:06:51.865 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:06:51 smithi082 ceph-mon[30098]: pgmap v945: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 682 B/s wr, 9 op/s 2024-05-08T06:06:52.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:06:51 smithi151 ceph-mon[34815]: pgmap v945: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 682 B/s wr, 9 op/s 2024-05-08T06:06:52.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:06:51 smithi134 ceph-mon[34132]: pgmap v945: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 682 B/s wr, 9 op/s 2024-05-08T06:06:53.024 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-05-08T06:06:53.024 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-05-08T06:06:53.024 DEBUG:tasks.check_counter:Getting stats from d 2024-05-08T06:06:53.025 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph daemon mds.d perf dump 2024-05-08T06:06:53.473 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:06:53.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:06:53 smithi082 ceph-mon[30098]: pgmap v946: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-05-08T06:06:54.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:06:53 smithi151 ceph-mon[34815]: pgmap v946: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-05-08T06:06:54.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:06:53 smithi134 ceph-mon[34132]: pgmap v946: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-05-08T06:06:55.951 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T06:06:55.951 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T06:06:55.951 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 4, 2024-05-08T06:06:55.951 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 4, 2024-05-08T06:06:55.951 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 2992, 2024-05-08T06:06:55.951 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 448, 2024-05-08T06:06:55.951 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 4, 2024-05-08T06:06:55.951 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 0, 2024-05-08T06:06:55.951 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.003977184, 2024-05-08T06:06:55.951 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.000066623, 2024-05-08T06:06:55.951 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.000928497, 2024-05-08T06:06:55.952 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-08T06:06:55.952 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T06:06:55.952 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 3, 2024-05-08T06:06:55.952 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.001473158, 2024-05-08T06:06:55.952 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000491052 2024-05-08T06:06:55.952 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:55.952 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-05-08T06:06:55.952 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:55.952 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:55.952 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:55.952 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:55.952 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-05-08T06:06:55.952 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 448 2024-05-08T06:06:55.952 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:55.953 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T06:06:55.953 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 2, 2024-05-08T06:06:55.953 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 266, 2024-05-08T06:06:55.953 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 320, 2024-05-08T06:06:55.953 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 204288, 2024-05-08T06:06:55.953 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 4, 2024-05-08T06:06:55.953 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 2, 2024-05-08T06:06:55.953 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.042980530, 2024-05-08T06:06:55.953 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.035905852, 2024-05-08T06:06:55.953 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.002721724, 2024-05-08T06:06:55.953 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-08T06:06:55.953 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T06:06:55.953 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 264, 2024-05-08T06:06:55.953 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.043727151, 2024-05-08T06:06:55.954 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000165633 2024-05-08T06:06:55.954 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:55.954 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-05-08T06:06:55.954 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:55.954 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:55.954 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:55.954 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:55.954 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 320, 2024-05-08T06:06:55.954 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 204288 2024-05-08T06:06:55.954 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:55.954 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T06:06:55.954 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 352, 2024-05-08T06:06:55.954 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 347, 2024-05-08T06:06:55.954 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 851008, 2024-05-08T06:06:55.954 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 214656, 2024-05-08T06:06:55.955 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 2, 2024-05-08T06:06:55.955 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 1, 2024-05-08T06:06:55.955 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.111486888, 2024-05-08T06:06:55.955 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.049306420, 2024-05-08T06:06:55.955 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.052980417, 2024-05-08T06:06:55.955 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.013388424, 2024-05-08T06:06:55.955 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T06:06:55.955 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 346, 2024-05-08T06:06:55.955 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.056298609, 2024-05-08T06:06:55.955 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000162712 2024-05-08T06:06:55.955 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:55.955 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-05-08T06:06:55.955 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:55.955 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:55.956 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:55.956 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:55.956 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 851008, 2024-05-08T06:06:55.956 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 214656 2024-05-08T06:06:55.956 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:55.956 INFO:teuthology.orchestra.run.smithi082.stdout: "cct": { 2024-05-08T06:06:55.956 INFO:teuthology.orchestra.run.smithi082.stdout: "total_workers": 0, 2024-05-08T06:06:55.956 INFO:teuthology.orchestra.run.smithi082.stdout: "unhealthy_workers": 0 2024-05-08T06:06:55.956 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:55.956 INFO:teuthology.orchestra.run.smithi082.stdout: "mempool": { 2024-05-08T06:06:55.956 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_bytes": 0, 2024-05-08T06:06:55.956 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_items": 0, 2024-05-08T06:06:55.956 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T06:06:55.956 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_items": 0, 2024-05-08T06:06:55.956 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T06:06:55.957 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_items": 0, 2024-05-08T06:06:55.957 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T06:06:55.957 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T06:06:55.957 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T06:06:55.957 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T06:06:55.957 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T06:06:55.957 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_items": 0, 2024-05-08T06:06:55.957 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T06:06:55.957 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T06:06:55.957 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_bytes": 0, 2024-05-08T06:06:55.957 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_items": 0, 2024-05-08T06:06:55.957 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_bytes": 0, 2024-05-08T06:06:55.957 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_items": 0, 2024-05-08T06:06:55.957 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T06:06:55.957 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T06:06:55.957 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T06:06:55.958 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T06:06:55.958 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T06:06:55.958 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_items": 0, 2024-05-08T06:06:55.958 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_bytes": 0, 2024-05-08T06:06:55.958 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_items": 0, 2024-05-08T06:06:55.958 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T06:06:55.958 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T06:06:55.958 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_bytes": 0, 2024-05-08T06:06:55.958 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_items": 0, 2024-05-08T06:06:55.958 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_bytes": 0, 2024-05-08T06:06:55.958 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_items": 0, 2024-05-08T06:06:55.958 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T06:06:55.958 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_items": 0, 2024-05-08T06:06:55.958 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T06:06:55.958 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_items": 0, 2024-05-08T06:06:55.958 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_bytes": 148721, 2024-05-08T06:06:55.959 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_items": 30, 2024-05-08T06:06:55.959 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_bytes": 0, 2024-05-08T06:06:55.959 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_items": 0, 2024-05-08T06:06:55.959 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_bytes": 0, 2024-05-08T06:06:55.959 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_items": 0, 2024-05-08T06:06:55.959 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_bytes": 0, 2024-05-08T06:06:55.959 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_items": 0, 2024-05-08T06:06:55.959 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_bytes": 0, 2024-05-08T06:06:55.959 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_items": 0, 2024-05-08T06:06:55.959 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_bytes": 0, 2024-05-08T06:06:55.959 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_items": 0, 2024-05-08T06:06:55.959 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T06:06:55.959 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_items": 0, 2024-05-08T06:06:55.959 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_bytes": 0, 2024-05-08T06:06:55.959 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_items": 0, 2024-05-08T06:06:55.960 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_bytes": 928, 2024-05-08T06:06:55.960 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_items": 2, 2024-05-08T06:06:55.960 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_bytes": 0, 2024-05-08T06:06:55.960 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_items": 0, 2024-05-08T06:06:55.960 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_bytes": 0, 2024-05-08T06:06:55.960 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_items": 0 2024-05-08T06:06:55.960 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:55.960 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T06:06:55.960 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-05-08T06:06:55.960 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 104857600, 2024-05-08T06:06:55.960 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-05-08T06:06:55.960 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 354, 2024-05-08T06:06:55.960 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 801243, 2024-05-08T06:06:55.960 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-05-08T06:06:55.960 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 354, 2024-05-08T06:06:55.960 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-05-08T06:06:55.961 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-05-08T06:06:55.961 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 354, 2024-05-08T06:06:55.961 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 801243, 2024-05-08T06:06:55.961 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-05-08T06:06:55.961 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:55.961 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:55.961 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:55.961 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:55.961 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:55.961 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T06:06:56.017 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:06:55 smithi082 ceph-mon[30098]: pgmap v947: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 85 B/s wr, 10 op/s 2024-05-08T06:06:56.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:06:55 smithi151 ceph-mon[34815]: pgmap v947: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 85 B/s wr, 10 op/s 2024-05-08T06:06:56.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:06:55 smithi134 ceph-mon[34132]: pgmap v947: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 85 B/s wr, 10 op/s 2024-05-08T06:06:56.911 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-05-08T06:06:56.911 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-05-08T06:06:56.911 DEBUG:tasks.check_counter:Getting stats from g 2024-05-08T06:06:56.912 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph daemon mds.g perf dump 2024-05-08T06:06:57.368 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:06:58.107 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:06:57 smithi082 ceph-mon[30098]: pgmap v948: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-05-08T06:06:58.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:06:57 smithi151 ceph-mon[34815]: pgmap v948: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-05-08T06:06:58.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:06:57 smithi134 ceph-mon[34132]: pgmap v948: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-05-08T06:06:59.905 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T06:06:59.905 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T06:06:59.905 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 1237, 2024-05-08T06:06:59.906 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 1239, 2024-05-08T06:06:59.906 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 415577, 2024-05-08T06:06:59.906 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 393367, 2024-05-08T06:06:59.906 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 7, 2024-05-08T06:06:59.906 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 2, 2024-05-08T06:06:59.906 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.288222160, 2024-05-08T06:06:59.906 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.133049137, 2024-05-08T06:06:59.906 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.052205613, 2024-05-08T06:06:59.906 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.076747548, 2024-05-08T06:06:59.906 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T06:06:59.906 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 1237, 2024-05-08T06:06:59.906 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.234893966, 2024-05-08T06:06:59.906 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000189890 2024-05-08T06:06:59.906 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.907 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-05-08T06:06:59.907 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:59.907 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:59.907 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:59.907 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.907 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-08T06:06:59.907 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 0 2024-05-08T06:06:59.907 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.907 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T06:06:59.907 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 2238, 2024-05-08T06:06:59.907 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 2497, 2024-05-08T06:06:59.907 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 573208, 2024-05-08T06:06:59.907 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 1245319, 2024-05-08T06:06:59.908 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 5, 2024-05-08T06:06:59.908 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 4, 2024-05-08T06:06:59.908 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.319209112, 2024-05-08T06:06:59.908 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.121912866, 2024-05-08T06:06:59.908 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.067509261, 2024-05-08T06:06:59.908 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.104906339, 2024-05-08T06:06:59.908 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T06:06:59.908 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 2496, 2024-05-08T06:06:59.908 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.319785577, 2024-05-08T06:06:59.908 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000128119 2024-05-08T06:06:59.908 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.908 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-05-08T06:06:59.908 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:59.908 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:59.909 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:59.909 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.909 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-05-08T06:06:59.909 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 535168 2024-05-08T06:06:59.909 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.909 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T06:06:59.909 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 363, 2024-05-08T06:06:59.909 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 354, 2024-05-08T06:06:59.909 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 894916, 2024-05-08T06:06:59.909 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 214885, 2024-05-08T06:06:59.909 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 5, 2024-05-08T06:06:59.909 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 3, 2024-05-08T06:06:59.909 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.115735324, 2024-05-08T06:06:59.909 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.051839283, 2024-05-08T06:06:59.909 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.060460489, 2024-05-08T06:06:59.910 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.013113084, 2024-05-08T06:06:59.910 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T06:06:59.910 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 353, 2024-05-08T06:06:59.910 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.060654198, 2024-05-08T06:06:59.910 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000171824 2024-05-08T06:06:59.910 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.910 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-05-08T06:06:59.910 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:59.910 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:59.910 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:59.910 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.910 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 893568, 2024-05-08T06:06:59.910 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 213920 2024-05-08T06:06:59.910 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.911 INFO:teuthology.orchestra.run.smithi082.stdout: "cct": { 2024-05-08T06:06:59.911 INFO:teuthology.orchestra.run.smithi082.stdout: "total_workers": 1, 2024-05-08T06:06:59.911 INFO:teuthology.orchestra.run.smithi082.stdout: "unhealthy_workers": 0 2024-05-08T06:06:59.911 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.911 INFO:teuthology.orchestra.run.smithi082.stdout: "finisher-MDSRank": { 2024-05-08T06:06:59.911 INFO:teuthology.orchestra.run.smithi082.stdout: "queue_len": 0, 2024-05-08T06:06:59.911 INFO:teuthology.orchestra.run.smithi082.stdout: "complete_latency": { 2024-05-08T06:06:59.911 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 5723, 2024-05-08T06:06:59.911 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.224099901, 2024-05-08T06:06:59.911 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000039157 2024-05-08T06:06:59.911 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:59.911 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.911 INFO:teuthology.orchestra.run.smithi082.stdout: "finisher-PurgeQueue": { 2024-05-08T06:06:59.911 INFO:teuthology.orchestra.run.smithi082.stdout: "queue_len": 0, 2024-05-08T06:06:59.911 INFO:teuthology.orchestra.run.smithi082.stdout: "complete_latency": { 2024-05-08T06:06:59.911 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:59.912 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:59.912 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:59.912 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:59.912 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.912 INFO:teuthology.orchestra.run.smithi082.stdout: "mds": { 2024-05-08T06:06:59.912 INFO:teuthology.orchestra.run.smithi082.stdout: "request": 0, 2024-05-08T06:06:59.912 INFO:teuthology.orchestra.run.smithi082.stdout: "reply": 0, 2024-05-08T06:06:59.912 INFO:teuthology.orchestra.run.smithi082.stdout: "reply_latency": { 2024-05-08T06:06:59.912 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:59.912 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:59.912 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:59.912 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.912 INFO:teuthology.orchestra.run.smithi082.stdout: "slow_reply": 0, 2024-05-08T06:06:59.912 INFO:teuthology.orchestra.run.smithi082.stdout: "forward": 0, 2024-05-08T06:06:59.912 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_fetch_complete": 0, 2024-05-08T06:06:59.913 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_fetch_keys": 0, 2024-05-08T06:06:59.913 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_commit": 0, 2024-05-08T06:06:59.913 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_split": 0, 2024-05-08T06:06:59.913 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_merge": 0, 2024-05-08T06:06:59.913 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes": 0, 2024-05-08T06:06:59.913 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_top": 0, 2024-05-08T06:06:59.913 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_bottom": 0, 2024-05-08T06:06:59.913 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_pin_tail": 0, 2024-05-08T06:06:59.913 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_pinned": 0, 2024-05-08T06:06:59.913 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_expired": 0, 2024-05-08T06:06:59.913 INFO:teuthology.orchestra.run.smithi082.stdout: "inodes_with_caps": 0, 2024-05-08T06:06:59.913 INFO:teuthology.orchestra.run.smithi082.stdout: "caps": 0, 2024-05-08T06:06:59.913 INFO:teuthology.orchestra.run.smithi082.stdout: "subtrees": 1, 2024-05-08T06:06:59.913 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse": 0, 2024-05-08T06:06:59.913 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_hit": 0, 2024-05-08T06:06:59.914 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_forward": 0, 2024-05-08T06:06:59.914 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_discover": 0, 2024-05-08T06:06:59.914 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_dir_fetch": 0, 2024-05-08T06:06:59.914 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_remote_ino": 0, 2024-05-08T06:06:59.914 INFO:teuthology.orchestra.run.smithi082.stdout: "traverse_lock": 0, 2024-05-08T06:06:59.914 INFO:teuthology.orchestra.run.smithi082.stdout: "load_cent": 0, 2024-05-08T06:06:59.914 INFO:teuthology.orchestra.run.smithi082.stdout: "q": 0, 2024-05-08T06:06:59.914 INFO:teuthology.orchestra.run.smithi082.stdout: "exported": 0, 2024-05-08T06:06:59.914 INFO:teuthology.orchestra.run.smithi082.stdout: "exported_inodes": 0, 2024-05-08T06:06:59.914 INFO:teuthology.orchestra.run.smithi082.stdout: "imported": 0, 2024-05-08T06:06:59.914 INFO:teuthology.orchestra.run.smithi082.stdout: "imported_inodes": 0, 2024-05-08T06:06:59.914 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_dir_fetch": 0, 2024-05-08T06:06:59.914 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_backtrace_fetch": 0, 2024-05-08T06:06:59.914 INFO:teuthology.orchestra.run.smithi082.stdout: "openino_peer_discover": 0, 2024-05-08T06:06:59.915 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rfiles": 0, 2024-05-08T06:06:59.915 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rbytes": 0, 2024-05-08T06:06:59.915 INFO:teuthology.orchestra.run.smithi082.stdout: "root_rsnaps": 0, 2024-05-08T06:06:59.915 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_backtrace_fetch": 0, 2024-05-08T06:06:59.915 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_set_tag": 0, 2024-05-08T06:06:59.915 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_backtrace_repaired": 0, 2024-05-08T06:06:59.915 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_inotable_repaired": 0, 2024-05-08T06:06:59.915 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dir_inodes": 0, 2024-05-08T06:06:59.915 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dir_base_inodes": 0, 2024-05-08T06:06:59.915 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_dirfrag_rstats": 0, 2024-05-08T06:06:59.915 INFO:teuthology.orchestra.run.smithi082.stdout: "scrub_file_inodes": 0, 2024-05-08T06:06:59.915 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_inode_file_caps": 0, 2024-05-08T06:06:59.915 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_revoke": 0, 2024-05-08T06:06:59.915 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_grant": 0, 2024-05-08T06:06:59.915 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_trunc": 0, 2024-05-08T06:06:59.915 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-08T06:06:59.916 INFO:teuthology.orchestra.run.smithi082.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-08T06:06:59.916 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_caps": 0, 2024-05-08T06:06:59.916 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_caps_dirty": 0, 2024-05-08T06:06:59.916 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_cap_release": 0, 2024-05-08T06:06:59.916 INFO:teuthology.orchestra.run.smithi082.stdout: "process_request_cap_release": 0 2024-05-08T06:06:59.916 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.916 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_cache": { 2024-05-08T06:06:59.916 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_update": 0, 2024-05-08T06:06:59.916 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_update_receipt": 0, 2024-05-08T06:06:59.916 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_try_discover": 0, 2024-05-08T06:06:59.916 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_send_discover": 0, 2024-05-08T06:06:59.916 INFO:teuthology.orchestra.run.smithi082.stdout: "dir_handle_discover": 0, 2024-05-08T06:06:59.916 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays": 0, 2024-05-08T06:06:59.916 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays_delayed": 0, 2024-05-08T06:06:59.916 INFO:teuthology.orchestra.run.smithi082.stdout: "num_strays_enqueuing": 0, 2024-05-08T06:06:59.917 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_created": 0, 2024-05-08T06:06:59.917 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_enqueued": 0, 2024-05-08T06:06:59.917 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_reintegrated": 0, 2024-05-08T06:06:59.917 INFO:teuthology.orchestra.run.smithi082.stdout: "strays_migrated": 0, 2024-05-08T06:06:59.917 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_processing": 0, 2024-05-08T06:06:59.917 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_enqueued": 0, 2024-05-08T06:06:59.917 INFO:teuthology.orchestra.run.smithi082.stdout: "num_recovering_prioritized": 0, 2024-05-08T06:06:59.917 INFO:teuthology.orchestra.run.smithi082.stdout: "recovery_started": 0, 2024-05-08T06:06:59.917 INFO:teuthology.orchestra.run.smithi082.stdout: "recovery_completed": 0, 2024-05-08T06:06:59.917 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_quiesce_path": 0, 2024-05-08T06:06:59.917 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_quiesce_inode": 0, 2024-05-08T06:06:59.917 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_enqueue_scrub": 0, 2024-05-08T06:06:59.917 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_exportdir": 0, 2024-05-08T06:06:59.917 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_flush": 0, 2024-05-08T06:06:59.917 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_fragmentdir": 0, 2024-05-08T06:06:59.918 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_fragstats": 0, 2024-05-08T06:06:59.918 INFO:teuthology.orchestra.run.smithi082.stdout: "ireq_inodestats": 0 2024-05-08T06:06:59.918 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.918 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_log": { 2024-05-08T06:06:59.918 INFO:teuthology.orchestra.run.smithi082.stdout: "evlrg": 0, 2024-05-08T06:06:59.918 INFO:teuthology.orchestra.run.smithi082.stdout: "evadd": 0, 2024-05-08T06:06:59.918 INFO:teuthology.orchestra.run.smithi082.stdout: "evex": 0, 2024-05-08T06:06:59.918 INFO:teuthology.orchestra.run.smithi082.stdout: "evtrm": 0, 2024-05-08T06:06:59.918 INFO:teuthology.orchestra.run.smithi082.stdout: "ev": 3, 2024-05-08T06:06:59.918 INFO:teuthology.orchestra.run.smithi082.stdout: "evexg": 0, 2024-05-08T06:06:59.918 INFO:teuthology.orchestra.run.smithi082.stdout: "evexd": 0, 2024-05-08T06:06:59.918 INFO:teuthology.orchestra.run.smithi082.stdout: "segadd": 0, 2024-05-08T06:06:59.918 INFO:teuthology.orchestra.run.smithi082.stdout: "segex": 0, 2024-05-08T06:06:59.918 INFO:teuthology.orchestra.run.smithi082.stdout: "segtrm": 0, 2024-05-08T06:06:59.918 INFO:teuthology.orchestra.run.smithi082.stdout: "seg": 2, 2024-05-08T06:06:59.919 INFO:teuthology.orchestra.run.smithi082.stdout: "segmjr": 2, 2024-05-08T06:06:59.919 INFO:teuthology.orchestra.run.smithi082.stdout: "segexg": 0, 2024-05-08T06:06:59.919 INFO:teuthology.orchestra.run.smithi082.stdout: "segexd": 0, 2024-05-08T06:06:59.919 INFO:teuthology.orchestra.run.smithi082.stdout: "expos": 4194304, 2024-05-08T06:06:59.919 INFO:teuthology.orchestra.run.smithi082.stdout: "wrpos": 4195202, 2024-05-08T06:06:59.919 INFO:teuthology.orchestra.run.smithi082.stdout: "rdpos": 4194892, 2024-05-08T06:06:59.919 INFO:teuthology.orchestra.run.smithi082.stdout: "jlat": { 2024-05-08T06:06:59.919 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:59.919 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:59.919 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:59.919 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.919 INFO:teuthology.orchestra.run.smithi082.stdout: "replayed": 3 2024-05-08T06:06:59.919 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.919 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_mem": { 2024-05-08T06:06:59.919 INFO:teuthology.orchestra.run.smithi082.stdout: "ino": 3, 2024-05-08T06:06:59.919 INFO:teuthology.orchestra.run.smithi082.stdout: "ino+": 3, 2024-05-08T06:06:59.920 INFO:teuthology.orchestra.run.smithi082.stdout: "ino-": 0, 2024-05-08T06:06:59.920 INFO:teuthology.orchestra.run.smithi082.stdout: "dir": 1, 2024-05-08T06:06:59.920 INFO:teuthology.orchestra.run.smithi082.stdout: "dir+": 1, 2024-05-08T06:06:59.920 INFO:teuthology.orchestra.run.smithi082.stdout: "dir-": 0, 2024-05-08T06:06:59.920 INFO:teuthology.orchestra.run.smithi082.stdout: "dn": 0, 2024-05-08T06:06:59.920 INFO:teuthology.orchestra.run.smithi082.stdout: "dn+": 0, 2024-05-08T06:06:59.920 INFO:teuthology.orchestra.run.smithi082.stdout: "dn-": 0, 2024-05-08T06:06:59.920 INFO:teuthology.orchestra.run.smithi082.stdout: "cap": 0, 2024-05-08T06:06:59.920 INFO:teuthology.orchestra.run.smithi082.stdout: "cap+": 0, 2024-05-08T06:06:59.920 INFO:teuthology.orchestra.run.smithi082.stdout: "cap-": 0, 2024-05-08T06:06:59.920 INFO:teuthology.orchestra.run.smithi082.stdout: "rss": 49084, 2024-05-08T06:06:59.920 INFO:teuthology.orchestra.run.smithi082.stdout: "heap": 215416 2024-05-08T06:06:59.920 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.920 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_server": { 2024-05-08T06:06:59.920 INFO:teuthology.orchestra.run.smithi082.stdout: "dispatch_client_request": 0, 2024-05-08T06:06:59.921 INFO:teuthology.orchestra.run.smithi082.stdout: "dispatch_server_request": 0, 2024-05-08T06:06:59.921 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_request": 0, 2024-05-08T06:06:59.921 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_client_session": 0, 2024-05-08T06:06:59.921 INFO:teuthology.orchestra.run.smithi082.stdout: "handle_peer_request": 0, 2024-05-08T06:06:59.921 INFO:teuthology.orchestra.run.smithi082.stdout: "req_create_latency": { 2024-05-08T06:06:59.921 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:59.921 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:59.921 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:59.921 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.921 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getattr_latency": { 2024-05-08T06:06:59.921 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:59.921 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:59.921 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:59.921 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.922 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getfilelock_latency": { 2024-05-08T06:06:59.922 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:59.922 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:59.922 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:59.922 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.922 INFO:teuthology.orchestra.run.smithi082.stdout: "req_link_latency": { 2024-05-08T06:06:59.922 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:59.922 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:59.922 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:59.922 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.922 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookup_latency": { 2024-05-08T06:06:59.922 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:59.922 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:59.922 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:59.923 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.923 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookuphash_latency": { 2024-05-08T06:06:59.923 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:59.923 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:59.923 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:59.923 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.923 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupino_latency": { 2024-05-08T06:06:59.923 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:59.923 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:59.923 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:59.923 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.923 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupname_latency": { 2024-05-08T06:06:59.923 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:59.923 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:59.923 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:59.923 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.924 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupparent_latency": { 2024-05-08T06:06:59.924 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:59.924 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:59.924 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:59.924 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.924 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lookupsnap_latency": { 2024-05-08T06:06:59.924 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:59.924 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:59.924 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:59.924 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.924 INFO:teuthology.orchestra.run.smithi082.stdout: "req_lssnap_latency": { 2024-05-08T06:06:59.924 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:59.924 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:59.924 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:59.924 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.924 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mkdir_latency": { 2024-05-08T06:06:59.925 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:59.925 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:59.925 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:59.925 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.925 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mknod_latency": { 2024-05-08T06:06:59.926 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:59.926 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:59.926 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:59.926 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.926 INFO:teuthology.orchestra.run.smithi082.stdout: "req_mksnap_latency": { 2024-05-08T06:06:59.926 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:59.926 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:59.926 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:59.926 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.926 INFO:teuthology.orchestra.run.smithi082.stdout: "req_open_latency": { 2024-05-08T06:06:59.926 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:59.926 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:59.926 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:59.926 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.926 INFO:teuthology.orchestra.run.smithi082.stdout: "req_readdir_latency": { 2024-05-08T06:06:59.927 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:59.927 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:59.927 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:59.927 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.927 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rename_latency": { 2024-05-08T06:06:59.927 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:59.927 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:59.927 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:59.927 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.927 INFO:teuthology.orchestra.run.smithi082.stdout: "req_renamesnap_latency": { 2024-05-08T06:06:59.927 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:59.927 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:59.927 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:59.927 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.927 INFO:teuthology.orchestra.run.smithi082.stdout: "req_snapdiff_latency": { 2024-05-08T06:06:59.927 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:59.928 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:59.928 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:59.928 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.928 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmdir_latency": { 2024-05-08T06:06:59.928 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:59.928 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:59.928 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:59.928 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.928 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmsnap_latency": { 2024-05-08T06:06:59.928 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:59.928 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:59.928 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:59.928 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.928 INFO:teuthology.orchestra.run.smithi082.stdout: "req_rmxattr_latency": { 2024-05-08T06:06:59.928 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:59.929 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:59.929 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:59.929 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.929 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setattr_latency": { 2024-05-08T06:06:59.929 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:59.929 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:59.929 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:59.929 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.929 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setdirlayout_latency": { 2024-05-08T06:06:59.929 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:59.929 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:59.929 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:59.929 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.929 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setfilelock_latency": { 2024-05-08T06:06:59.929 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:59.929 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:59.930 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:59.930 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.930 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setlayout_latency": { 2024-05-08T06:06:59.930 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:59.930 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:59.930 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:59.930 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.930 INFO:teuthology.orchestra.run.smithi082.stdout: "req_setxattr_latency": { 2024-05-08T06:06:59.930 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:59.930 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:59.930 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:59.930 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.930 INFO:teuthology.orchestra.run.smithi082.stdout: "req_symlink_latency": { 2024-05-08T06:06:59.930 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:59.931 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:59.931 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:59.931 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.931 INFO:teuthology.orchestra.run.smithi082.stdout: "req_unlink_latency": { 2024-05-08T06:06:59.931 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:59.931 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:59.931 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:59.931 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.931 INFO:teuthology.orchestra.run.smithi082.stdout: "cap_revoke_eviction": 0, 2024-05-08T06:06:59.931 INFO:teuthology.orchestra.run.smithi082.stdout: "cap_acquisition_throttle": 0, 2024-05-08T06:06:59.931 INFO:teuthology.orchestra.run.smithi082.stdout: "req_getvxattr_latency": { 2024-05-08T06:06:59.931 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:59.931 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:59.931 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:59.932 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:59.932 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.932 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_sessions": { 2024-05-08T06:06:59.932 INFO:teuthology.orchestra.run.smithi082.stdout: "session_count": 1, 2024-05-08T06:06:59.932 INFO:teuthology.orchestra.run.smithi082.stdout: "session_add": 1, 2024-05-08T06:06:59.932 INFO:teuthology.orchestra.run.smithi082.stdout: "session_remove": 0, 2024-05-08T06:06:59.932 INFO:teuthology.orchestra.run.smithi082.stdout: "sessions_open": 1, 2024-05-08T06:06:59.932 INFO:teuthology.orchestra.run.smithi082.stdout: "sessions_stale": 0, 2024-05-08T06:06:59.932 INFO:teuthology.orchestra.run.smithi082.stdout: "total_load": 0, 2024-05-08T06:06:59.932 INFO:teuthology.orchestra.run.smithi082.stdout: "average_load": 0, 2024-05-08T06:06:59.932 INFO:teuthology.orchestra.run.smithi082.stdout: "avg_session_uptime": 2397, 2024-05-08T06:06:59.932 INFO:teuthology.orchestra.run.smithi082.stdout: "mdthresh_evicted": 0 2024-05-08T06:06:59.932 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.932 INFO:teuthology.orchestra.run.smithi082.stdout: "mempool": { 2024-05-08T06:06:59.932 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_bytes": 0, 2024-05-08T06:06:59.933 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_items": 0, 2024-05-08T06:06:59.933 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T06:06:59.933 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_items": 0, 2024-05-08T06:06:59.933 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T06:06:59.933 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_items": 0, 2024-05-08T06:06:59.933 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T06:06:59.933 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T06:06:59.933 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T06:06:59.933 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T06:06:59.933 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T06:06:59.933 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_items": 0, 2024-05-08T06:06:59.933 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T06:06:59.933 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T06:06:59.933 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_bytes": 0, 2024-05-08T06:06:59.933 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_items": 0, 2024-05-08T06:06:59.934 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_bytes": 0, 2024-05-08T06:06:59.934 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_items": 0, 2024-05-08T06:06:59.934 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T06:06:59.934 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T06:06:59.934 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T06:06:59.934 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T06:06:59.934 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T06:06:59.934 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_items": 0, 2024-05-08T06:06:59.934 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_bytes": 0, 2024-05-08T06:06:59.934 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_items": 0, 2024-05-08T06:06:59.934 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T06:06:59.934 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T06:06:59.934 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_bytes": 0, 2024-05-08T06:06:59.934 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_items": 0, 2024-05-08T06:06:59.934 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_bytes": 0, 2024-05-08T06:06:59.935 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_items": 0, 2024-05-08T06:06:59.935 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T06:06:59.935 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_items": 0, 2024-05-08T06:06:59.935 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T06:06:59.935 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_items": 0, 2024-05-08T06:06:59.935 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_bytes": 198247, 2024-05-08T06:06:59.935 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_items": 56, 2024-05-08T06:06:59.935 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_bytes": 0, 2024-05-08T06:06:59.935 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_items": 0, 2024-05-08T06:06:59.935 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_bytes": 0, 2024-05-08T06:06:59.935 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_items": 0, 2024-05-08T06:06:59.935 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_bytes": 0, 2024-05-08T06:06:59.935 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_items": 0, 2024-05-08T06:06:59.935 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_bytes": 0, 2024-05-08T06:06:59.935 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_items": 0, 2024-05-08T06:06:59.935 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_bytes": 7528, 2024-05-08T06:06:59.936 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_items": 158, 2024-05-08T06:06:59.936 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T06:06:59.936 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_items": 0, 2024-05-08T06:06:59.936 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_bytes": 0, 2024-05-08T06:06:59.936 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_items": 0, 2024-05-08T06:06:59.936 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_bytes": 8512, 2024-05-08T06:06:59.936 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_items": 13, 2024-05-08T06:06:59.936 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_bytes": 0, 2024-05-08T06:06:59.936 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_items": 0, 2024-05-08T06:06:59.936 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_bytes": 0, 2024-05-08T06:06:59.936 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_items": 0 2024-05-08T06:06:59.936 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.936 INFO:teuthology.orchestra.run.smithi082.stdout: "objecter": { 2024-05-08T06:06:59.936 INFO:teuthology.orchestra.run.smithi082.stdout: "op_active": 0, 2024-05-08T06:06:59.936 INFO:teuthology.orchestra.run.smithi082.stdout: "op_laggy": 0, 2024-05-08T06:06:59.936 INFO:teuthology.orchestra.run.smithi082.stdout: "op_send": 3473, 2024-05-08T06:06:59.936 INFO:teuthology.orchestra.run.smithi082.stdout: "op_send_bytes": 21, 2024-05-08T06:06:59.937 INFO:teuthology.orchestra.run.smithi082.stdout: "op_resend": 3, 2024-05-08T06:06:59.937 INFO:teuthology.orchestra.run.smithi082.stdout: "op_reply": 3473, 2024-05-08T06:06:59.937 INFO:teuthology.orchestra.run.smithi082.stdout: "op_latency": { 2024-05-08T06:06:59.937 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 3473, 2024-05-08T06:06:59.937 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 6.646876884, 2024-05-08T06:06:59.937 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.001913871 2024-05-08T06:06:59.937 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.937 INFO:teuthology.orchestra.run.smithi082.stdout: "op_inflight": 0, 2024-05-08T06:06:59.937 INFO:teuthology.orchestra.run.smithi082.stdout: "oplen_avg": { 2024-05-08T06:06:59.937 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 3473, 2024-05-08T06:06:59.937 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 3474 2024-05-08T06:06:59.937 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.937 INFO:teuthology.orchestra.run.smithi082.stdout: "op": 3473, 2024-05-08T06:06:59.937 INFO:teuthology.orchestra.run.smithi082.stdout: "op_r": 3473, 2024-05-08T06:06:59.937 INFO:teuthology.orchestra.run.smithi082.stdout: "op_w": 0, 2024-05-08T06:06:59.937 INFO:teuthology.orchestra.run.smithi082.stdout: "op_rmw": 0, 2024-05-08T06:06:59.938 INFO:teuthology.orchestra.run.smithi082.stdout: "op_pg": 0, 2024-05-08T06:06:59.938 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_stat": 2230, 2024-05-08T06:06:59.938 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_create": 0, 2024-05-08T06:06:59.938 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_read": 1241, 2024-05-08T06:06:59.938 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_write": 0, 2024-05-08T06:06:59.938 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_writefull": 0, 2024-05-08T06:06:59.938 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_writesame": 0, 2024-05-08T06:06:59.938 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_append": 0, 2024-05-08T06:06:59.938 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_zero": 0, 2024-05-08T06:06:59.938 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_truncate": 0, 2024-05-08T06:06:59.938 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_delete": 0, 2024-05-08T06:06:59.938 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_mapext": 0, 2024-05-08T06:06:59.938 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_sparse_read": 0, 2024-05-08T06:06:59.938 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_clonerange": 0, 2024-05-08T06:06:59.938 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_getxattr": 1, 2024-05-08T06:06:59.939 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_setxattr": 0, 2024-05-08T06:06:59.939 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_cmpxattr": 0, 2024-05-08T06:06:59.939 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_rmxattr": 0, 2024-05-08T06:06:59.939 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_resetxattrs": 0, 2024-05-08T06:06:59.939 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_call": 0, 2024-05-08T06:06:59.939 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_watch": 0, 2024-05-08T06:06:59.939 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_notify": 0, 2024-05-08T06:06:59.939 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_src_cmpxattr": 0, 2024-05-08T06:06:59.939 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_pgls": 0, 2024-05-08T06:06:59.939 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_pgls_filter": 0, 2024-05-08T06:06:59.939 INFO:teuthology.orchestra.run.smithi082.stdout: "osdop_other": 0, 2024-05-08T06:06:59.939 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_active": 0, 2024-05-08T06:06:59.939 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_send": 0, 2024-05-08T06:06:59.939 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_resend": 0, 2024-05-08T06:06:59.940 INFO:teuthology.orchestra.run.smithi082.stdout: "linger_ping": 0, 2024-05-08T06:06:59.940 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_active": 0, 2024-05-08T06:06:59.940 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_send": 0, 2024-05-08T06:06:59.940 INFO:teuthology.orchestra.run.smithi082.stdout: "poolop_resend": 0, 2024-05-08T06:06:59.940 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_active": 0, 2024-05-08T06:06:59.940 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_send": 0, 2024-05-08T06:06:59.940 INFO:teuthology.orchestra.run.smithi082.stdout: "poolstat_resend": 0, 2024-05-08T06:06:59.940 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_active": 0, 2024-05-08T06:06:59.940 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_send": 0, 2024-05-08T06:06:59.940 INFO:teuthology.orchestra.run.smithi082.stdout: "statfs_resend": 0, 2024-05-08T06:06:59.940 INFO:teuthology.orchestra.run.smithi082.stdout: "command_active": 0, 2024-05-08T06:06:59.940 INFO:teuthology.orchestra.run.smithi082.stdout: "command_send": 0, 2024-05-08T06:06:59.940 INFO:teuthology.orchestra.run.smithi082.stdout: "command_resend": 0, 2024-05-08T06:06:59.940 INFO:teuthology.orchestra.run.smithi082.stdout: "map_epoch": 82, 2024-05-08T06:06:59.940 INFO:teuthology.orchestra.run.smithi082.stdout: "map_full": 0, 2024-05-08T06:06:59.940 INFO:teuthology.orchestra.run.smithi082.stdout: "map_inc": 2, 2024-05-08T06:06:59.940 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_sessions": 6, 2024-05-08T06:06:59.941 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_session_open": 8, 2024-05-08T06:06:59.941 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_session_close": 2, 2024-05-08T06:06:59.941 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_laggy": 0, 2024-05-08T06:06:59.941 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_wr": 0, 2024-05-08T06:06:59.941 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_rd": 2, 2024-05-08T06:06:59.941 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_del": 0 2024-05-08T06:06:59.941 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.941 INFO:teuthology.orchestra.run.smithi082.stdout: "oft": { 2024-05-08T06:06:59.941 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_objs": 0, 2024-05-08T06:06:59.941 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_kv_pairs": 0, 2024-05-08T06:06:59.941 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_updates": 0, 2024-05-08T06:06:59.941 INFO:teuthology.orchestra.run.smithi082.stdout: "omap_total_removes": 0 2024-05-08T06:06:59.941 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.941 INFO:teuthology.orchestra.run.smithi082.stdout: "osd-slow-ops": { 2024-05-08T06:06:59.941 INFO:teuthology.orchestra.run.smithi082.stdout: "slow_ops_count": 0 2024-05-08T06:06:59.941 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.942 INFO:teuthology.orchestra.run.smithi082.stdout: "purge_queue": { 2024-05-08T06:06:59.942 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_ops": 0, 2024-05-08T06:06:59.942 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_ops_high_water": 0, 2024-05-08T06:06:59.942 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing": 0, 2024-05-08T06:06:59.942 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executing_high_water": 0, 2024-05-08T06:06:59.942 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executed_ops": 0, 2024-05-08T06:06:59.942 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_executed": 0, 2024-05-08T06:06:59.942 INFO:teuthology.orchestra.run.smithi082.stdout: "pq_item_in_journal": 0 2024-05-08T06:06:59.942 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.942 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T06:06:59.942 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-05-08T06:06:59.942 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 104857600, 2024-05-08T06:06:59.942 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-05-08T06:06:59.942 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 3834, 2024-05-08T06:06:59.942 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 1517117, 2024-05-08T06:06:59.943 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-05-08T06:06:59.943 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 3834, 2024-05-08T06:06:59.943 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-05-08T06:06:59.943 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-05-08T06:06:59.943 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 3834, 2024-05-08T06:06:59.943 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 1517117, 2024-05-08T06:06:59.943 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-05-08T06:06:59.943 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:59.943 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:59.943 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:59.943 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:59.943 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.943 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-objecter_bytes": { 2024-05-08T06:06:59.943 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-05-08T06:06:59.943 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 104857600, 2024-05-08T06:06:59.943 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-05-08T06:06:59.943 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-05-08T06:06:59.944 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-05-08T06:06:59.944 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-05-08T06:06:59.944 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-05-08T06:06:59.944 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 3473, 2024-05-08T06:06:59.944 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 903, 2024-05-08T06:06:59.944 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 3473, 2024-05-08T06:06:59.944 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 903, 2024-05-08T06:06:59.944 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-05-08T06:06:59.944 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:59.944 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:59.944 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:59.944 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:59.944 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.944 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-objecter_ops": { 2024-05-08T06:06:59.944 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-05-08T06:06:59.945 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 1024, 2024-05-08T06:06:59.945 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-05-08T06:06:59.945 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-05-08T06:06:59.945 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-05-08T06:06:59.945 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-05-08T06:06:59.945 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-05-08T06:06:59.945 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 3473, 2024-05-08T06:06:59.945 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 3473, 2024-05-08T06:06:59.945 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 3473, 2024-05-08T06:06:59.945 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 3473, 2024-05-08T06:06:59.945 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-05-08T06:06:59.945 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:59.945 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:59.945 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:59.945 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:59.945 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.945 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-write_buf_throttle": { 2024-05-08T06:06:59.946 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-05-08T06:06:59.946 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 3758096384, 2024-05-08T06:06:59.946 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-05-08T06:06:59.946 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-05-08T06:06:59.946 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-05-08T06:06:59.946 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-05-08T06:06:59.946 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-05-08T06:06:59.946 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-05-08T06:06:59.946 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-05-08T06:06:59.946 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 0, 2024-05-08T06:06:59.946 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 0, 2024-05-08T06:06:59.946 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-05-08T06:06:59.946 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:59.946 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:59.947 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:59.947 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:59.947 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:06:59.947 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-write_buf_throttle-0x5558b9682780": { 2024-05-08T06:06:59.947 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-05-08T06:06:59.947 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 3758096384, 2024-05-08T06:06:59.947 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-05-08T06:06:59.947 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 0, 2024-05-08T06:06:59.947 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 0, 2024-05-08T06:06:59.947 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-05-08T06:06:59.947 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 0, 2024-05-08T06:06:59.947 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-05-08T06:06:59.947 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-05-08T06:06:59.947 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 0, 2024-05-08T06:06:59.947 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 0, 2024-05-08T06:06:59.947 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-05-08T06:06:59.947 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:06:59.948 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:06:59.948 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:06:59.948 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:59.948 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:06:59.948 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T06:06:59.948 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:06:59 smithi082 ceph-mon[30098]: pgmap v949: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-05-08T06:07:00.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:06:59 smithi151 ceph-mon[34815]: pgmap v949: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-05-08T06:07:00.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:06:59 smithi134 ceph-mon[34132]: pgmap v949: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-05-08T06:07:00.962 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-05-08T06:07:00.962 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-05-08T06:07:00.962 DEBUG:tasks.check_counter:Getting stats from j 2024-05-08T06:07:00.962 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph daemon mds.j perf dump 2024-05-08T06:07:01.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:00 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:07:01.151 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:00 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:07:01.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:00 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-08T06:07:01.446 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:07:01.922 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:01 smithi082 ceph-mon[30098]: pgmap v950: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-08T06:07:01.922 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:01 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:07:01.922 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:01 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:07:01.922 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:01 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T06:07:02.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:01 smithi151 ceph-mon[34815]: pgmap v950: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-08T06:07:02.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:01 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:07:02.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:01 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:07:02.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:01 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T06:07:02.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:01 smithi134 ceph-mon[34132]: pgmap v950: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-08T06:07:02.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:01 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-08T06:07:02.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:01 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-08T06:07:02.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:01 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' 2024-05-08T06:07:03.969 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:03 smithi082 ceph-mon[30098]: pgmap v951: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-08T06:07:03.970 INFO:teuthology.orchestra.run.smithi082.stdout:{ 2024-05-08T06:07:03.971 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T06:07:03.971 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 356, 2024-05-08T06:07:03.971 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 351, 2024-05-08T06:07:03.971 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 852096, 2024-05-08T06:07:03.971 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 217216, 2024-05-08T06:07:03.971 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 4, 2024-05-08T06:07:03.971 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 0, 2024-05-08T06:07:03.971 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.117920390, 2024-05-08T06:07:03.971 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.048780767, 2024-05-08T06:07:03.971 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.059777915, 2024-05-08T06:07:03.971 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.013026745, 2024-05-08T06:07:03.971 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T06:07:03.971 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 350, 2024-05-08T06:07:03.971 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.048116613, 2024-05-08T06:07:03.971 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000137476 2024-05-08T06:07:03.971 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:07:03.972 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-05-08T06:07:03.972 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:07:03.972 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:07:03.972 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:07:03.972 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:07:03.972 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 852096, 2024-05-08T06:07:03.972 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 217216 2024-05-08T06:07:03.972 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:07:03.972 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T06:07:03.972 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 6, 2024-05-08T06:07:03.972 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 270, 2024-05-08T06:07:03.972 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 3312, 2024-05-08T06:07:03.972 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 205088, 2024-05-08T06:07:03.972 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 4, 2024-05-08T06:07:03.972 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 2, 2024-05-08T06:07:03.972 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.048130846, 2024-05-08T06:07:03.973 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.039985078, 2024-05-08T06:07:03.973 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.004066250, 2024-05-08T06:07:03.973 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-08T06:07:03.973 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T06:07:03.973 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 269, 2024-05-08T06:07:03.973 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.056478045, 2024-05-08T06:07:03.973 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000209955 2024-05-08T06:07:03.973 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:07:03.973 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-05-08T06:07:03.973 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:07:03.973 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:07:03.973 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:07:03.973 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:07:03.973 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 3312, 2024-05-08T06:07:03.973 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 205088 2024-05-08T06:07:03.973 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:07:03.973 INFO:teuthology.orchestra.run.smithi082.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T06:07:03.974 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_messages": 0, 2024-05-08T06:07:03.974 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages": 2, 2024-05-08T06:07:03.974 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_bytes": 0, 2024-05-08T06:07:03.974 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_bytes": 0, 2024-05-08T06:07:03.974 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_created_connections": 2, 2024-05-08T06:07:03.974 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_active_connections": 1, 2024-05-08T06:07:03.974 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_total_time": 0.000985373, 2024-05-08T06:07:03.974 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_send_time": 0.000000000, 2024-05-08T06:07:03.974 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_recv_time": 0.000822867, 2024-05-08T06:07:03.974 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-08T06:07:03.974 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T06:07:03.974 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:07:03.974 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:07:03.974 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:07:03.974 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:07:03.974 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_handle_ack_lat": { 2024-05-08T06:07:03.975 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:07:03.975 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:07:03.975 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:07:03.975 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:07:03.975 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-08T06:07:03.975 INFO:teuthology.orchestra.run.smithi082.stdout: "msgr_send_encrypted_bytes": 0 2024-05-08T06:07:03.975 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:07:03.975 INFO:teuthology.orchestra.run.smithi082.stdout: "cct": { 2024-05-08T06:07:03.975 INFO:teuthology.orchestra.run.smithi082.stdout: "total_workers": 0, 2024-05-08T06:07:03.975 INFO:teuthology.orchestra.run.smithi082.stdout: "unhealthy_workers": 0 2024-05-08T06:07:03.975 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:07:03.975 INFO:teuthology.orchestra.run.smithi082.stdout: "mempool": { 2024-05-08T06:07:03.975 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_bytes": 0, 2024-05-08T06:07:03.975 INFO:teuthology.orchestra.run.smithi082.stdout: "bloom_filter_items": 0, 2024-05-08T06:07:03.975 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T06:07:03.975 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_alloc_items": 0, 2024-05-08T06:07:03.975 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T06:07:03.976 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_data_items": 0, 2024-05-08T06:07:03.976 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T06:07:03.976 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T06:07:03.976 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T06:07:03.976 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T06:07:03.976 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T06:07:03.976 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_other_items": 0, 2024-05-08T06:07:03.976 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T06:07:03.976 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T06:07:03.976 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_bytes": 0, 2024-05-08T06:07:03.976 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_extent_items": 0, 2024-05-08T06:07:03.976 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_bytes": 0, 2024-05-08T06:07:03.976 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_blob_items": 0, 2024-05-08T06:07:03.976 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T06:07:03.976 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T06:07:03.976 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T06:07:03.977 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T06:07:03.977 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T06:07:03.977 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_fsck_items": 0, 2024-05-08T06:07:03.977 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_bytes": 0, 2024-05-08T06:07:03.977 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_txc_items": 0, 2024-05-08T06:07:03.977 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T06:07:03.977 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T06:07:03.977 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_bytes": 0, 2024-05-08T06:07:03.977 INFO:teuthology.orchestra.run.smithi082.stdout: "bluestore_writing_items": 0, 2024-05-08T06:07:03.977 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_bytes": 0, 2024-05-08T06:07:03.977 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_items": 0, 2024-05-08T06:07:03.977 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T06:07:03.977 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_reader_items": 0, 2024-05-08T06:07:03.977 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T06:07:03.977 INFO:teuthology.orchestra.run.smithi082.stdout: "bluefs_file_writer_items": 0, 2024-05-08T06:07:03.978 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_bytes": 148704, 2024-05-08T06:07:03.978 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_anon_items": 29, 2024-05-08T06:07:03.978 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_bytes": 0, 2024-05-08T06:07:03.978 INFO:teuthology.orchestra.run.smithi082.stdout: "buffer_meta_items": 0, 2024-05-08T06:07:03.978 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_bytes": 0, 2024-05-08T06:07:03.978 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_items": 0, 2024-05-08T06:07:03.978 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_bytes": 0, 2024-05-08T06:07:03.978 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_mapbl_items": 0, 2024-05-08T06:07:03.978 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_bytes": 0, 2024-05-08T06:07:03.978 INFO:teuthology.orchestra.run.smithi082.stdout: "osd_pglog_items": 0, 2024-05-08T06:07:03.978 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_bytes": 0, 2024-05-08T06:07:03.978 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_items": 0, 2024-05-08T06:07:03.978 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T06:07:03.978 INFO:teuthology.orchestra.run.smithi082.stdout: "osdmap_mapping_items": 0, 2024-05-08T06:07:03.979 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_bytes": 0, 2024-05-08T06:07:03.979 INFO:teuthology.orchestra.run.smithi082.stdout: "pgmap_items": 0, 2024-05-08T06:07:03.979 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_bytes": 928, 2024-05-08T06:07:03.979 INFO:teuthology.orchestra.run.smithi082.stdout: "mds_co_items": 2, 2024-05-08T06:07:03.979 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_bytes": 0, 2024-05-08T06:07:03.979 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_1_items": 0, 2024-05-08T06:07:03.979 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_bytes": 0, 2024-05-08T06:07:03.979 INFO:teuthology.orchestra.run.smithi082.stdout: "unittest_2_items": 0 2024-05-08T06:07:03.979 INFO:teuthology.orchestra.run.smithi082.stdout: }, 2024-05-08T06:07:03.979 INFO:teuthology.orchestra.run.smithi082.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T06:07:03.979 INFO:teuthology.orchestra.run.smithi082.stdout: "val": 0, 2024-05-08T06:07:03.979 INFO:teuthology.orchestra.run.smithi082.stdout: "max": 104857600, 2024-05-08T06:07:03.979 INFO:teuthology.orchestra.run.smithi082.stdout: "get_started": 0, 2024-05-08T06:07:03.979 INFO:teuthology.orchestra.run.smithi082.stdout: "get": 358, 2024-05-08T06:07:03.979 INFO:teuthology.orchestra.run.smithi082.stdout: "get_sum": 801763, 2024-05-08T06:07:03.979 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_fail": 0, 2024-05-08T06:07:03.979 INFO:teuthology.orchestra.run.smithi082.stdout: "get_or_fail_success": 358, 2024-05-08T06:07:03.979 INFO:teuthology.orchestra.run.smithi082.stdout: "take": 0, 2024-05-08T06:07:03.980 INFO:teuthology.orchestra.run.smithi082.stdout: "take_sum": 0, 2024-05-08T06:07:03.980 INFO:teuthology.orchestra.run.smithi082.stdout: "put": 358, 2024-05-08T06:07:03.980 INFO:teuthology.orchestra.run.smithi082.stdout: "put_sum": 801763, 2024-05-08T06:07:03.980 INFO:teuthology.orchestra.run.smithi082.stdout: "wait": { 2024-05-08T06:07:03.980 INFO:teuthology.orchestra.run.smithi082.stdout: "avgcount": 0, 2024-05-08T06:07:03.980 INFO:teuthology.orchestra.run.smithi082.stdout: "sum": 0.000000000, 2024-05-08T06:07:03.980 INFO:teuthology.orchestra.run.smithi082.stdout: "avgtime": 0.000000000 2024-05-08T06:07:03.980 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:07:03.980 INFO:teuthology.orchestra.run.smithi082.stdout: } 2024-05-08T06:07:03.980 INFO:teuthology.orchestra.run.smithi082.stdout:} 2024-05-08T06:07:04.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:03 smithi151 ceph-mon[34815]: pgmap v951: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-08T06:07:04.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:03 smithi134 ceph-mon[34132]: pgmap v951: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-08T06:07:04.928 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-05-08T06:07:04.929 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-05-08T06:07:04.929 DEBUG:tasks.check_counter:Getting stats from b 2024-05-08T06:07:04.929 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph daemon mds.b perf dump 2024-05-08T06:07:05.178 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T06:07:05.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:05 smithi134 ceph-mon[34132]: pgmap v952: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-05-08T06:07:06.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:05 smithi151 ceph-mon[34815]: pgmap v952: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-05-08T06:07:06.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:05 smithi082 ceph-mon[30098]: pgmap v952: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-05-08T06:07:07.180 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-05-08T06:07:07.180 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T06:07:07.180 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 6768, 2024-05-08T06:07:07.180 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 6101, 2024-05-08T06:07:07.180 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 1762065, 2024-05-08T06:07:07.180 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 10402298, 2024-05-08T06:07:07.180 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 17, 2024-05-08T06:07:07.180 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 3, 2024-05-08T06:07:07.180 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.454297629, 2024-05-08T06:07:07.181 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.145729457, 2024-05-08T06:07:07.181 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.116015456, 2024-05-08T06:07:07.181 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.154733364, 2024-05-08T06:07:07.181 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T06:07:07.181 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 6102, 2024-05-08T06:07:07.181 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.386468929, 2024-05-08T06:07:07.181 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000063334 2024-05-08T06:07:07.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.181 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-05-08T06:07:07.181 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 2241, 2024-05-08T06:07:07.181 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000418898, 2024-05-08T06:07:07.181 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000186 2024-05-08T06:07:07.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.181 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-08T06:07:07.182 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 0 2024-05-08T06:07:07.182 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.182 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T06:07:07.182 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 6586, 2024-05-08T06:07:07.182 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 6990, 2024-05-08T06:07:07.182 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 1931738, 2024-05-08T06:07:07.182 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 7439778, 2024-05-08T06:07:07.182 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 10, 2024-05-08T06:07:07.182 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 6, 2024-05-08T06:07:07.182 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.395675719, 2024-05-08T06:07:07.182 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.131688793, 2024-05-08T06:07:07.182 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.115264647, 2024-05-08T06:07:07.182 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.122043866, 2024-05-08T06:07:07.182 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T06:07:07.183 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 6989, 2024-05-08T06:07:07.183 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.411210963, 2024-05-08T06:07:07.183 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000058836 2024-05-08T06:07:07.183 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.183 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-05-08T06:07:07.183 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 2496, 2024-05-08T06:07:07.183 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000461366, 2024-05-08T06:07:07.183 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000184 2024-05-08T06:07:07.183 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.183 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-05-08T06:07:07.183 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 550192 2024-05-08T06:07:07.183 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.183 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T06:07:07.183 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 13804, 2024-05-08T06:07:07.183 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 15570, 2024-05-08T06:07:07.184 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 5604695, 2024-05-08T06:07:07.184 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 12608609, 2024-05-08T06:07:07.184 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 121, 2024-05-08T06:07:07.184 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 10, 2024-05-08T06:07:07.184 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 1.028424919, 2024-05-08T06:07:07.184 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.370764909, 2024-05-08T06:07:07.184 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.782494710, 2024-05-08T06:07:07.184 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.167576815, 2024-05-08T06:07:07.184 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T06:07:07.184 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 15566, 2024-05-08T06:07:07.184 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.639575373, 2024-05-08T06:07:07.184 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000041087 2024-05-08T06:07:07.184 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.184 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-05-08T06:07:07.185 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 19849, 2024-05-08T06:07:07.185 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.002844188, 2024-05-08T06:07:07.185 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000143 2024-05-08T06:07:07.185 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.185 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 4481120, 2024-05-08T06:07:07.185 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 7043632 2024-05-08T06:07:07.185 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.185 INFO:teuthology.orchestra.run.smithi134.stdout: "cct": { 2024-05-08T06:07:07.185 INFO:teuthology.orchestra.run.smithi134.stdout: "total_workers": 1, 2024-05-08T06:07:07.185 INFO:teuthology.orchestra.run.smithi134.stdout: "unhealthy_workers": 0 2024-05-08T06:07:07.185 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.185 INFO:teuthology.orchestra.run.smithi134.stdout: "finisher-MDSRank": { 2024-05-08T06:07:07.185 INFO:teuthology.orchestra.run.smithi134.stdout: "queue_len": 0, 2024-05-08T06:07:07.185 INFO:teuthology.orchestra.run.smithi134.stdout: "complete_latency": { 2024-05-08T06:07:07.186 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 11908, 2024-05-08T06:07:07.186 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 4.276239216, 2024-05-08T06:07:07.186 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000359106 2024-05-08T06:07:07.186 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-05-08T06:07:07.186 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.186 INFO:teuthology.orchestra.run.smithi134.stdout: "finisher-PurgeQueue": { 2024-05-08T06:07:07.186 INFO:teuthology.orchestra.run.smithi134.stdout: "queue_len": 0, 2024-05-08T06:07:07.186 INFO:teuthology.orchestra.run.smithi134.stdout: "complete_latency": { 2024-05-08T06:07:07.186 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 957, 2024-05-08T06:07:07.186 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.034776028, 2024-05-08T06:07:07.186 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000036338 2024-05-08T06:07:07.186 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-05-08T06:07:07.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.187 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-05-08T06:07:07.187 INFO:teuthology.orchestra.run.smithi134.stdout: "request": 4344, 2024-05-08T06:07:07.187 INFO:teuthology.orchestra.run.smithi134.stdout: "reply": 4332, 2024-05-08T06:07:07.187 INFO:teuthology.orchestra.run.smithi134.stdout: "reply_latency": { 2024-05-08T06:07:07.187 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 4332, 2024-05-08T06:07:07.187 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 20.378978952, 2024-05-08T06:07:07.187 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.004704288 2024-05-08T06:07:07.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.187 INFO:teuthology.orchestra.run.smithi134.stdout: "slow_reply": 0, 2024-05-08T06:07:07.187 INFO:teuthology.orchestra.run.smithi134.stdout: "forward": 12, 2024-05-08T06:07:07.187 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_fetch_complete": 0, 2024-05-08T06:07:07.188 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_fetch_keys": 0, 2024-05-08T06:07:07.188 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_commit": 39, 2024-05-08T06:07:07.188 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_split": 3, 2024-05-08T06:07:07.188 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_merge": 0, 2024-05-08T06:07:07.188 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes": 1218, 2024-05-08T06:07:07.188 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_top": 0, 2024-05-08T06:07:07.188 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_bottom": 606, 2024-05-08T06:07:07.188 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_pin_tail": 612, 2024-05-08T06:07:07.188 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_pinned": 1218, 2024-05-08T06:07:07.188 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_expired": 303, 2024-05-08T06:07:07.188 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_with_caps": 748, 2024-05-08T06:07:07.188 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": 748, 2024-05-08T06:07:07.188 INFO:teuthology.orchestra.run.smithi134.stdout: "subtrees": 10, 2024-05-08T06:07:07.188 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse": 7694, 2024-05-08T06:07:07.188 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_hit": 6411, 2024-05-08T06:07:07.189 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_forward": 12, 2024-05-08T06:07:07.189 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_discover": 0, 2024-05-08T06:07:07.189 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_dir_fetch": 0, 2024-05-08T06:07:07.189 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_remote_ino": 0, 2024-05-08T06:07:07.189 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_lock": 338, 2024-05-08T06:07:07.189 INFO:teuthology.orchestra.run.smithi134.stdout: "load_cent": 0, 2024-05-08T06:07:07.189 INFO:teuthology.orchestra.run.smithi134.stdout: "q": 0, 2024-05-08T06:07:07.189 INFO:teuthology.orchestra.run.smithi134.stdout: "exported": 8, 2024-05-08T06:07:07.189 INFO:teuthology.orchestra.run.smithi134.stdout: "exported_inodes": 301, 2024-05-08T06:07:07.189 INFO:teuthology.orchestra.run.smithi134.stdout: "imported": 0, 2024-05-08T06:07:07.189 INFO:teuthology.orchestra.run.smithi134.stdout: "imported_inodes": 0, 2024-05-08T06:07:07.189 INFO:teuthology.orchestra.run.smithi134.stdout: "openino_dir_fetch": 0, 2024-05-08T06:07:07.189 INFO:teuthology.orchestra.run.smithi134.stdout: "openino_backtrace_fetch": 9811, 2024-05-08T06:07:07.189 INFO:teuthology.orchestra.run.smithi134.stdout: "openino_peer_discover": 0, 2024-05-08T06:07:07.190 INFO:teuthology.orchestra.run.smithi134.stdout: "root_rfiles": 1026, 2024-05-08T06:07:07.190 INFO:teuthology.orchestra.run.smithi134.stdout: "root_rbytes": 1714402645, 2024-05-08T06:07:07.190 INFO:teuthology.orchestra.run.smithi134.stdout: "root_rsnaps": 0, 2024-05-08T06:07:07.190 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_backtrace_fetch": 9811, 2024-05-08T06:07:07.190 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_set_tag": 0, 2024-05-08T06:07:07.190 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_backtrace_repaired": 0, 2024-05-08T06:07:07.190 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_inotable_repaired": 0, 2024-05-08T06:07:07.190 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_dir_inodes": 477, 2024-05-08T06:07:07.190 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_dir_base_inodes": 14, 2024-05-08T06:07:07.190 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_dirfrag_rstats": 463, 2024-05-08T06:07:07.190 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_file_inodes": 9334, 2024-05-08T06:07:07.190 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_inode_file_caps": 2, 2024-05-08T06:07:07.190 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_revoke": 535, 2024-05-08T06:07:07.190 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_grant": 2628, 2024-05-08T06:07:07.191 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_trunc": 0, 2024-05-08T06:07:07.191 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-08T06:07:07.191 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-08T06:07:07.191 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_caps": 3413, 2024-05-08T06:07:07.191 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_caps_dirty": 1679, 2024-05-08T06:07:07.191 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_cap_release": 183, 2024-05-08T06:07:07.191 INFO:teuthology.orchestra.run.smithi134.stdout: "process_request_cap_release": 1204 2024-05-08T06:07:07.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.191 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_cache": { 2024-05-08T06:07:07.191 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_update": 0, 2024-05-08T06:07:07.191 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_update_receipt": 0, 2024-05-08T06:07:07.191 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_try_discover": 0, 2024-05-08T06:07:07.191 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_send_discover": 0, 2024-05-08T06:07:07.191 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_handle_discover": 8, 2024-05-08T06:07:07.192 INFO:teuthology.orchestra.run.smithi134.stdout: "num_strays": 0, 2024-05-08T06:07:07.192 INFO:teuthology.orchestra.run.smithi134.stdout: "num_strays_delayed": 0, 2024-05-08T06:07:07.192 INFO:teuthology.orchestra.run.smithi134.stdout: "num_strays_enqueuing": 0, 2024-05-08T06:07:07.192 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_created": 492, 2024-05-08T06:07:07.192 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_enqueued": 269, 2024-05-08T06:07:07.192 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_reintegrated": 223, 2024-05-08T06:07:07.192 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_migrated": 0, 2024-05-08T06:07:07.192 INFO:teuthology.orchestra.run.smithi134.stdout: "num_recovering_processing": 0, 2024-05-08T06:07:07.192 INFO:teuthology.orchestra.run.smithi134.stdout: "num_recovering_enqueued": 0, 2024-05-08T06:07:07.192 INFO:teuthology.orchestra.run.smithi134.stdout: "num_recovering_prioritized": 0, 2024-05-08T06:07:07.192 INFO:teuthology.orchestra.run.smithi134.stdout: "recovery_started": 0, 2024-05-08T06:07:07.192 INFO:teuthology.orchestra.run.smithi134.stdout: "recovery_completed": 0, 2024-05-08T06:07:07.192 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_quiesce_path": 0, 2024-05-08T06:07:07.192 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_quiesce_inode": 0, 2024-05-08T06:07:07.193 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_enqueue_scrub": 14, 2024-05-08T06:07:07.193 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_exportdir": 8, 2024-05-08T06:07:07.193 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_flush": 0, 2024-05-08T06:07:07.193 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_fragmentdir": 3, 2024-05-08T06:07:07.193 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_fragstats": 0, 2024-05-08T06:07:07.193 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_inodestats": 0 2024-05-08T06:07:07.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.193 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_log": { 2024-05-08T06:07:07.193 INFO:teuthology.orchestra.run.smithi134.stdout: "evlrg": 0, 2024-05-08T06:07:07.193 INFO:teuthology.orchestra.run.smithi134.stdout: "evadd": 5883, 2024-05-08T06:07:07.193 INFO:teuthology.orchestra.run.smithi134.stdout: "evex": 0, 2024-05-08T06:07:07.193 INFO:teuthology.orchestra.run.smithi134.stdout: "evtrm": 0, 2024-05-08T06:07:07.193 INFO:teuthology.orchestra.run.smithi134.stdout: "ev": 5883, 2024-05-08T06:07:07.193 INFO:teuthology.orchestra.run.smithi134.stdout: "evexg": 0, 2024-05-08T06:07:07.193 INFO:teuthology.orchestra.run.smithi134.stdout: "evexd": 0, 2024-05-08T06:07:07.193 INFO:teuthology.orchestra.run.smithi134.stdout: "segadd": 8, 2024-05-08T06:07:07.194 INFO:teuthology.orchestra.run.smithi134.stdout: "segex": 0, 2024-05-08T06:07:07.194 INFO:teuthology.orchestra.run.smithi134.stdout: "segtrm": 0, 2024-05-08T06:07:07.194 INFO:teuthology.orchestra.run.smithi134.stdout: "seg": 8, 2024-05-08T06:07:07.194 INFO:teuthology.orchestra.run.smithi134.stdout: "segmjr": 2, 2024-05-08T06:07:07.194 INFO:teuthology.orchestra.run.smithi134.stdout: "segexg": 0, 2024-05-08T06:07:07.194 INFO:teuthology.orchestra.run.smithi134.stdout: "segexd": 0, 2024-05-08T06:07:07.194 INFO:teuthology.orchestra.run.smithi134.stdout: "expos": 4194304, 2024-05-08T06:07:07.194 INFO:teuthology.orchestra.run.smithi134.stdout: "wrpos": 19552087, 2024-05-08T06:07:07.194 INFO:teuthology.orchestra.run.smithi134.stdout: "rdpos": 0, 2024-05-08T06:07:07.194 INFO:teuthology.orchestra.run.smithi134.stdout: "jlat": { 2024-05-08T06:07:07.194 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 2321, 2024-05-08T06:07:07.194 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 12.789814395, 2024-05-08T06:07:07.194 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.005510475 2024-05-08T06:07:07.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.195 INFO:teuthology.orchestra.run.smithi134.stdout: "replayed": 0 2024-05-08T06:07:07.195 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.195 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_mem": { 2024-05-08T06:07:07.195 INFO:teuthology.orchestra.run.smithi134.stdout: "ino": 769, 2024-05-08T06:07:07.195 INFO:teuthology.orchestra.run.smithi134.stdout: "ino+": 1351, 2024-05-08T06:07:07.195 INFO:teuthology.orchestra.run.smithi134.stdout: "ino-": 582, 2024-05-08T06:07:07.195 INFO:teuthology.orchestra.run.smithi134.stdout: "dir": 68, 2024-05-08T06:07:07.195 INFO:teuthology.orchestra.run.smithi134.stdout: "dir+": 73, 2024-05-08T06:07:07.195 INFO:teuthology.orchestra.run.smithi134.stdout: "dir-": 5, 2024-05-08T06:07:07.195 INFO:teuthology.orchestra.run.smithi134.stdout: "dn": 1218, 2024-05-08T06:07:07.195 INFO:teuthology.orchestra.run.smithi134.stdout: "dn+": 2043, 2024-05-08T06:07:07.195 INFO:teuthology.orchestra.run.smithi134.stdout: "dn-": 825, 2024-05-08T06:07:07.195 INFO:teuthology.orchestra.run.smithi134.stdout: "cap": 748, 2024-05-08T06:07:07.195 INFO:teuthology.orchestra.run.smithi134.stdout: "cap+": 1428, 2024-05-08T06:07:07.195 INFO:teuthology.orchestra.run.smithi134.stdout: "cap-": 680, 2024-05-08T06:07:07.196 INFO:teuthology.orchestra.run.smithi134.stdout: "rss": 69388, 2024-05-08T06:07:07.196 INFO:teuthology.orchestra.run.smithi134.stdout: "heap": 231800 2024-05-08T06:07:07.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.196 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_server": { 2024-05-08T06:07:07.196 INFO:teuthology.orchestra.run.smithi134.stdout: "dispatch_client_request": 5217, 2024-05-08T06:07:07.196 INFO:teuthology.orchestra.run.smithi134.stdout: "dispatch_server_request": 17, 2024-05-08T06:07:07.196 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_request": 4344, 2024-05-08T06:07:07.196 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_session": 478, 2024-05-08T06:07:07.196 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_peer_request": 34, 2024-05-08T06:07:07.196 INFO:teuthology.orchestra.run.smithi134.stdout: "req_create_latency": { 2024-05-08T06:07:07.196 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 1288, 2024-05-08T06:07:07.196 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 10.224625127, 2024-05-08T06:07:07.196 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.007938373 2024-05-08T06:07:07.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.196 INFO:teuthology.orchestra.run.smithi134.stdout: "req_getattr_latency": { 2024-05-08T06:07:07.197 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 49, 2024-05-08T06:07:07.197 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 5.463731304, 2024-05-08T06:07:07.197 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.111504720 2024-05-08T06:07:07.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.197 INFO:teuthology.orchestra.run.smithi134.stdout: "req_getfilelock_latency": { 2024-05-08T06:07:07.197 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:07.197 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:07.197 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:07.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.197 INFO:teuthology.orchestra.run.smithi134.stdout: "req_link_latency": { 2024-05-08T06:07:07.197 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 223, 2024-05-08T06:07:07.198 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.434379080, 2024-05-08T06:07:07.198 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.001947888 2024-05-08T06:07:07.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.198 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookup_latency": { 2024-05-08T06:07:07.198 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 1513, 2024-05-08T06:07:07.198 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.956151705, 2024-05-08T06:07:07.198 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000631957 2024-05-08T06:07:07.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.198 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookuphash_latency": { 2024-05-08T06:07:07.198 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:07.198 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:07.198 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:07.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.198 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupino_latency": { 2024-05-08T06:07:07.199 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 1, 2024-05-08T06:07:07.199 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000163494, 2024-05-08T06:07:07.199 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000163494 2024-05-08T06:07:07.199 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.199 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupname_latency": { 2024-05-08T06:07:07.199 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:07.199 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:07.199 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:07.199 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.199 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupparent_latency": { 2024-05-08T06:07:07.199 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:07.199 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:07.199 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:07.199 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.199 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupsnap_latency": { 2024-05-08T06:07:07.199 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:07.199 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:07.200 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:07.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.200 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lssnap_latency": { 2024-05-08T06:07:07.200 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:07.200 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:07.200 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:07.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.200 INFO:teuthology.orchestra.run.smithi134.stdout: "req_mkdir_latency": { 2024-05-08T06:07:07.201 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 37, 2024-05-08T06:07:07.201 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.614279706, 2024-05-08T06:07:07.201 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.016602154 2024-05-08T06:07:07.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.201 INFO:teuthology.orchestra.run.smithi134.stdout: "req_mknod_latency": { 2024-05-08T06:07:07.201 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:07.201 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:07.201 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:07.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.201 INFO:teuthology.orchestra.run.smithi134.stdout: "req_mksnap_latency": { 2024-05-08T06:07:07.201 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:07.201 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:07.201 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:07.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.201 INFO:teuthology.orchestra.run.smithi134.stdout: "req_open_latency": { 2024-05-08T06:07:07.202 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 425, 2024-05-08T06:07:07.202 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.110036026, 2024-05-08T06:07:07.202 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000258908 2024-05-08T06:07:07.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.202 INFO:teuthology.orchestra.run.smithi134.stdout: "req_readdir_latency": { 2024-05-08T06:07:07.202 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 58, 2024-05-08T06:07:07.202 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.108841440, 2024-05-08T06:07:07.202 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.001876576 2024-05-08T06:07:07.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.202 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rename_latency": { 2024-05-08T06:07:07.202 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 463, 2024-05-08T06:07:07.202 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 1.983093655, 2024-05-08T06:07:07.202 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.004283139 2024-05-08T06:07:07.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.202 INFO:teuthology.orchestra.run.smithi134.stdout: "req_renamesnap_latency": { 2024-05-08T06:07:07.203 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:07.203 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:07.203 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:07.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.203 INFO:teuthology.orchestra.run.smithi134.stdout: "req_snapdiff_latency": { 2024-05-08T06:07:07.203 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:07.203 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:07.203 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:07.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.203 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rmdir_latency": { 2024-05-08T06:07:07.203 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 2, 2024-05-08T06:07:07.203 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.016805448, 2024-05-08T06:07:07.203 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.008402724 2024-05-08T06:07:07.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.203 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rmsnap_latency": { 2024-05-08T06:07:07.203 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:07.204 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:07.204 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:07.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.204 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rmxattr_latency": { 2024-05-08T06:07:07.204 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:07.204 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:07.204 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:07.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.204 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setattr_latency": { 2024-05-08T06:07:07.204 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 1, 2024-05-08T06:07:07.204 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.001440730, 2024-05-08T06:07:07.204 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.001440730 2024-05-08T06:07:07.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.204 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setdirlayout_latency": { 2024-05-08T06:07:07.204 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:07.205 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:07.205 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:07.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.205 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setfilelock_latency": { 2024-05-08T06:07:07.205 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:07.205 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:07.205 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:07.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.205 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setlayout_latency": { 2024-05-08T06:07:07.205 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:07.205 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:07.205 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:07.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.205 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setxattr_latency": { 2024-05-08T06:07:07.205 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 8, 2024-05-08T06:07:07.206 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.022255764, 2024-05-08T06:07:07.206 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.002781970 2024-05-08T06:07:07.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.206 INFO:teuthology.orchestra.run.smithi134.stdout: "req_symlink_latency": { 2024-05-08T06:07:07.206 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:07.206 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:07.206 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:07.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.206 INFO:teuthology.orchestra.run.smithi134.stdout: "req_unlink_latency": { 2024-05-08T06:07:07.206 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 264, 2024-05-08T06:07:07.206 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.443175473, 2024-05-08T06:07:07.206 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.001678694 2024-05-08T06:07:07.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.207 INFO:teuthology.orchestra.run.smithi134.stdout: "cap_revoke_eviction": 0, 2024-05-08T06:07:07.207 INFO:teuthology.orchestra.run.smithi134.stdout: "cap_acquisition_throttle": 0, 2024-05-08T06:07:07.207 INFO:teuthology.orchestra.run.smithi134.stdout: "req_getvxattr_latency": { 2024-05-08T06:07:07.207 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:07.207 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:07.207 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:07.207 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-05-08T06:07:07.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.207 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_sessions": { 2024-05-08T06:07:07.207 INFO:teuthology.orchestra.run.smithi134.stdout: "session_count": 1, 2024-05-08T06:07:07.207 INFO:teuthology.orchestra.run.smithi134.stdout: "session_add": 3, 2024-05-08T06:07:07.207 INFO:teuthology.orchestra.run.smithi134.stdout: "session_remove": 2, 2024-05-08T06:07:07.207 INFO:teuthology.orchestra.run.smithi134.stdout: "sessions_open": 1, 2024-05-08T06:07:07.207 INFO:teuthology.orchestra.run.smithi134.stdout: "sessions_stale": 0, 2024-05-08T06:07:07.208 INFO:teuthology.orchestra.run.smithi134.stdout: "total_load": 954, 2024-05-08T06:07:07.208 INFO:teuthology.orchestra.run.smithi134.stdout: "average_load": 954, 2024-05-08T06:07:07.208 INFO:teuthology.orchestra.run.smithi134.stdout: "avg_session_uptime": 1022, 2024-05-08T06:07:07.208 INFO:teuthology.orchestra.run.smithi134.stdout: "mdthresh_evicted": 0 2024-05-08T06:07:07.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.208 INFO:teuthology.orchestra.run.smithi134.stdout: "mempool": { 2024-05-08T06:07:07.208 INFO:teuthology.orchestra.run.smithi134.stdout: "bloom_filter_bytes": 0, 2024-05-08T06:07:07.208 INFO:teuthology.orchestra.run.smithi134.stdout: "bloom_filter_items": 0, 2024-05-08T06:07:07.208 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T06:07:07.208 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_alloc_items": 0, 2024-05-08T06:07:07.208 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T06:07:07.208 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_data_items": 0, 2024-05-08T06:07:07.208 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T06:07:07.208 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T06:07:07.208 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T06:07:07.208 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T06:07:07.209 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T06:07:07.209 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_other_items": 0, 2024-05-08T06:07:07.209 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T06:07:07.209 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T06:07:07.209 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_bytes": 0, 2024-05-08T06:07:07.209 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_items": 0, 2024-05-08T06:07:07.209 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_blob_bytes": 0, 2024-05-08T06:07:07.209 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_blob_items": 0, 2024-05-08T06:07:07.209 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T06:07:07.209 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T06:07:07.209 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T06:07:07.209 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T06:07:07.209 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T06:07:07.209 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_items": 0, 2024-05-08T06:07:07.209 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_txc_bytes": 0, 2024-05-08T06:07:07.209 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_txc_items": 0, 2024-05-08T06:07:07.210 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T06:07:07.210 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T06:07:07.210 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_bytes": 0, 2024-05-08T06:07:07.210 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_items": 0, 2024-05-08T06:07:07.210 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_bytes": 0, 2024-05-08T06:07:07.210 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_items": 0, 2024-05-08T06:07:07.210 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T06:07:07.210 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_reader_items": 0, 2024-05-08T06:07:07.210 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T06:07:07.210 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_writer_items": 0, 2024-05-08T06:07:07.210 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_anon_bytes": 1113817, 2024-05-08T06:07:07.210 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_anon_items": 1080, 2024-05-08T06:07:07.210 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_meta_bytes": 968, 2024-05-08T06:07:07.210 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_meta_items": 11, 2024-05-08T06:07:07.210 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_bytes": 0, 2024-05-08T06:07:07.210 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_items": 0, 2024-05-08T06:07:07.211 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mapbl_bytes": 0, 2024-05-08T06:07:07.211 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mapbl_items": 0, 2024-05-08T06:07:07.211 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pglog_bytes": 0, 2024-05-08T06:07:07.211 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pglog_items": 0, 2024-05-08T06:07:07.211 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_bytes": 7528, 2024-05-08T06:07:07.211 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_items": 158, 2024-05-08T06:07:07.211 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T06:07:07.211 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_mapping_items": 0, 2024-05-08T06:07:07.211 INFO:teuthology.orchestra.run.smithi134.stdout: "pgmap_bytes": 0, 2024-05-08T06:07:07.211 INFO:teuthology.orchestra.run.smithi134.stdout: "pgmap_items": 0, 2024-05-08T06:07:07.211 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_co_bytes": 3223374, 2024-05-08T06:07:07.211 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_co_items": 53200, 2024-05-08T06:07:07.211 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_1_bytes": 0, 2024-05-08T06:07:07.211 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_1_items": 0, 2024-05-08T06:07:07.211 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_2_bytes": 0, 2024-05-08T06:07:07.211 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_2_items": 0 2024-05-08T06:07:07.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.212 INFO:teuthology.orchestra.run.smithi134.stdout: "objecter": { 2024-05-08T06:07:07.212 INFO:teuthology.orchestra.run.smithi134.stdout: "op_active": 0, 2024-05-08T06:07:07.212 INFO:teuthology.orchestra.run.smithi134.stdout: "op_laggy": 0, 2024-05-08T06:07:07.212 INFO:teuthology.orchestra.run.smithi134.stdout: "op_send": 13730, 2024-05-08T06:07:07.212 INFO:teuthology.orchestra.run.smithi134.stdout: "op_send_bytes": 15934047, 2024-05-08T06:07:07.212 INFO:teuthology.orchestra.run.smithi134.stdout: "op_resend": 37, 2024-05-08T06:07:07.212 INFO:teuthology.orchestra.run.smithi134.stdout: "op_reply": 13730, 2024-05-08T06:07:07.212 INFO:teuthology.orchestra.run.smithi134.stdout: "op_latency": { 2024-05-08T06:07:07.212 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 13730, 2024-05-08T06:07:07.212 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 51.166840328, 2024-05-08T06:07:07.212 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.003726645 2024-05-08T06:07:07.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.212 INFO:teuthology.orchestra.run.smithi134.stdout: "op_inflight": 0, 2024-05-08T06:07:07.213 INFO:teuthology.orchestra.run.smithi134.stdout: "oplen_avg": { 2024-05-08T06:07:07.213 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 13730, 2024-05-08T06:07:07.213 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 14133 2024-05-08T06:07:07.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.213 INFO:teuthology.orchestra.run.smithi134.stdout: "op": 13730, 2024-05-08T06:07:07.213 INFO:teuthology.orchestra.run.smithi134.stdout: "op_r": 9951, 2024-05-08T06:07:07.213 INFO:teuthology.orchestra.run.smithi134.stdout: "op_w": 3779, 2024-05-08T06:07:07.213 INFO:teuthology.orchestra.run.smithi134.stdout: "op_rmw": 0, 2024-05-08T06:07:07.213 INFO:teuthology.orchestra.run.smithi134.stdout: "op_pg": 0, 2024-05-08T06:07:07.213 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_stat": 0, 2024-05-08T06:07:07.213 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_create": 11, 2024-05-08T06:07:07.213 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_read": 126, 2024-05-08T06:07:07.213 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_write": 2433, 2024-05-08T06:07:07.213 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_writefull": 162, 2024-05-08T06:07:07.213 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_writesame": 0, 2024-05-08T06:07:07.213 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_append": 0, 2024-05-08T06:07:07.214 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_zero": 0, 2024-05-08T06:07:07.214 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_truncate": 3, 2024-05-08T06:07:07.214 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_delete": 798, 2024-05-08T06:07:07.214 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_mapext": 0, 2024-05-08T06:07:07.214 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_sparse_read": 0, 2024-05-08T06:07:07.214 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_clonerange": 0, 2024-05-08T06:07:07.214 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_getxattr": 9825, 2024-05-08T06:07:07.214 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_setxattr": 22, 2024-05-08T06:07:07.214 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_cmpxattr": 0, 2024-05-08T06:07:07.214 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_rmxattr": 0, 2024-05-08T06:07:07.214 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_resetxattrs": 0, 2024-05-08T06:07:07.214 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_call": 0, 2024-05-08T06:07:07.214 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_watch": 0, 2024-05-08T06:07:07.214 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_notify": 0, 2024-05-08T06:07:07.214 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_src_cmpxattr": 0, 2024-05-08T06:07:07.215 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_pgls": 0, 2024-05-08T06:07:07.215 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_pgls_filter": 0, 2024-05-08T06:07:07.215 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_other": 0, 2024-05-08T06:07:07.215 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_active": 0, 2024-05-08T06:07:07.215 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_send": 0, 2024-05-08T06:07:07.215 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_resend": 0, 2024-05-08T06:07:07.215 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_ping": 0, 2024-05-08T06:07:07.215 INFO:teuthology.orchestra.run.smithi134.stdout: "poolop_active": 0, 2024-05-08T06:07:07.215 INFO:teuthology.orchestra.run.smithi134.stdout: "poolop_send": 0, 2024-05-08T06:07:07.215 INFO:teuthology.orchestra.run.smithi134.stdout: "poolop_resend": 0, 2024-05-08T06:07:07.215 INFO:teuthology.orchestra.run.smithi134.stdout: "poolstat_active": 0, 2024-05-08T06:07:07.215 INFO:teuthology.orchestra.run.smithi134.stdout: "poolstat_send": 0, 2024-05-08T06:07:07.215 INFO:teuthology.orchestra.run.smithi134.stdout: "poolstat_resend": 0, 2024-05-08T06:07:07.215 INFO:teuthology.orchestra.run.smithi134.stdout: "statfs_active": 0, 2024-05-08T06:07:07.215 INFO:teuthology.orchestra.run.smithi134.stdout: "statfs_send": 0, 2024-05-08T06:07:07.215 INFO:teuthology.orchestra.run.smithi134.stdout: "statfs_resend": 0, 2024-05-08T06:07:07.216 INFO:teuthology.orchestra.run.smithi134.stdout: "command_active": 0, 2024-05-08T06:07:07.216 INFO:teuthology.orchestra.run.smithi134.stdout: "command_send": 0, 2024-05-08T06:07:07.216 INFO:teuthology.orchestra.run.smithi134.stdout: "command_resend": 0, 2024-05-08T06:07:07.216 INFO:teuthology.orchestra.run.smithi134.stdout: "map_epoch": 82, 2024-05-08T06:07:07.216 INFO:teuthology.orchestra.run.smithi134.stdout: "map_full": 0, 2024-05-08T06:07:07.216 INFO:teuthology.orchestra.run.smithi134.stdout: "map_inc": 2, 2024-05-08T06:07:07.216 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_sessions": 12, 2024-05-08T06:07:07.216 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_session_open": 12, 2024-05-08T06:07:07.216 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_session_close": 0, 2024-05-08T06:07:07.216 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_laggy": 0, 2024-05-08T06:07:07.216 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_wr": 598, 2024-05-08T06:07:07.216 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_rd": 0, 2024-05-08T06:07:07.216 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_del": 155 2024-05-08T06:07:07.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.216 INFO:teuthology.orchestra.run.smithi134.stdout: "oft": { 2024-05-08T06:07:07.216 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_objs": 1, 2024-05-08T06:07:07.217 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_kv_pairs": 0, 2024-05-08T06:07:07.217 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_updates": 0, 2024-05-08T06:07:07.217 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_removes": 0 2024-05-08T06:07:07.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.217 INFO:teuthology.orchestra.run.smithi134.stdout: "osd-slow-ops": { 2024-05-08T06:07:07.217 INFO:teuthology.orchestra.run.smithi134.stdout: "slow_ops_count": 0 2024-05-08T06:07:07.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.217 INFO:teuthology.orchestra.run.smithi134.stdout: "purge_queue": { 2024-05-08T06:07:07.217 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing_ops": 0, 2024-05-08T06:07:07.217 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing_ops_high_water": 13, 2024-05-08T06:07:07.217 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing": 0, 2024-05-08T06:07:07.217 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing_high_water": 6, 2024-05-08T06:07:07.217 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executed_ops": 283, 2024-05-08T06:07:07.217 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executed": 269, 2024-05-08T06:07:07.217 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_item_in_journal": 0 2024-05-08T06:07:07.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.217 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T06:07:07.218 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-05-08T06:07:07.218 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 104857600, 2024-05-08T06:07:07.218 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-05-08T06:07:07.218 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 27154, 2024-05-08T06:07:07.218 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 6393955, 2024-05-08T06:07:07.218 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-05-08T06:07:07.218 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 27154, 2024-05-08T06:07:07.218 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-05-08T06:07:07.218 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-05-08T06:07:07.218 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 27154, 2024-05-08T06:07:07.218 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 6393955, 2024-05-08T06:07:07.218 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-05-08T06:07:07.218 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:07.218 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:07.218 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:07.219 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-05-08T06:07:07.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.219 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-objecter_bytes": { 2024-05-08T06:07:07.219 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-05-08T06:07:07.219 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 104857600, 2024-05-08T06:07:07.219 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-05-08T06:07:07.219 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 0, 2024-05-08T06:07:07.219 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 0, 2024-05-08T06:07:07.219 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-05-08T06:07:07.219 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 0, 2024-05-08T06:07:07.219 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 13730, 2024-05-08T06:07:07.219 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 15961216, 2024-05-08T06:07:07.219 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 13730, 2024-05-08T06:07:07.219 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 15961216, 2024-05-08T06:07:07.219 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-05-08T06:07:07.220 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:07.220 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:07.220 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:07.220 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-05-08T06:07:07.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.220 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-objecter_ops": { 2024-05-08T06:07:07.220 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-05-08T06:07:07.220 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 1024, 2024-05-08T06:07:07.220 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-05-08T06:07:07.220 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 0, 2024-05-08T06:07:07.220 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 0, 2024-05-08T06:07:07.220 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-05-08T06:07:07.220 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 0, 2024-05-08T06:07:07.220 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 13730, 2024-05-08T06:07:07.220 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 13730, 2024-05-08T06:07:07.220 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 13730, 2024-05-08T06:07:07.221 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 13730, 2024-05-08T06:07:07.221 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-05-08T06:07:07.221 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:07.221 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:07.221 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:07.221 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-05-08T06:07:07.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.221 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-write_buf_throttle": { 2024-05-08T06:07:07.221 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-05-08T06:07:07.221 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 3758096384, 2024-05-08T06:07:07.221 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-05-08T06:07:07.221 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 269, 2024-05-08T06:07:07.221 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 27169, 2024-05-08T06:07:07.221 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-05-08T06:07:07.221 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 269, 2024-05-08T06:07:07.221 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-05-08T06:07:07.221 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-05-08T06:07:07.222 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 112, 2024-05-08T06:07:07.222 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 27169, 2024-05-08T06:07:07.222 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-05-08T06:07:07.222 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:07.222 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:07.222 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:07.222 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-05-08T06:07:07.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:07.222 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-write_buf_throttle-0x5600f026c500": { 2024-05-08T06:07:07.222 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-05-08T06:07:07.222 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 3758096384, 2024-05-08T06:07:07.222 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-05-08T06:07:07.222 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 5883, 2024-05-08T06:07:07.222 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 15357783, 2024-05-08T06:07:07.222 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-05-08T06:07:07.222 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 5883, 2024-05-08T06:07:07.223 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-05-08T06:07:07.223 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-05-08T06:07:07.223 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 2321, 2024-05-08T06:07:07.223 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 15357783, 2024-05-08T06:07:07.223 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-05-08T06:07:07.223 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:07.223 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:07.223 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:07.223 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-05-08T06:07:07.223 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-05-08T06:07:07.223 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-05-08T06:07:07.962 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:07 smithi134 ceph-mon[34132]: pgmap v953: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 11 KiB/s wr, 11 op/s 2024-05-08T06:07:07.990 INFO:tasks.check_counter:Daemon mds.b mds.exported=8 2024-05-08T06:07:07.990 INFO:tasks.check_counter:Daemon mds.b mds.imported=0 2024-05-08T06:07:07.990 DEBUG:tasks.check_counter:Getting stats from e 2024-05-08T06:07:07.990 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph daemon mds.e perf dump 2024-05-08T06:07:08.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:07 smithi151 ceph-mon[34815]: pgmap v953: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 11 KiB/s wr, 11 op/s 2024-05-08T06:07:08.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:07 smithi082 ceph-mon[30098]: pgmap v953: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 11 KiB/s wr, 11 op/s 2024-05-08T06:07:08.241 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T06:07:10.025 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:09 smithi134 ceph-mon[34132]: pgmap v954: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 15 KiB/s wr, 10 op/s 2024-05-08T06:07:10.061 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-05-08T06:07:10.061 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T06:07:10.061 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 2196, 2024-05-08T06:07:10.061 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 2186, 2024-05-08T06:07:10.061 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 5656644, 2024-05-08T06:07:10.061 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 799228, 2024-05-08T06:07:10.061 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 5, 2024-05-08T06:07:10.061 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 1, 2024-05-08T06:07:10.061 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.214253541, 2024-05-08T06:07:10.062 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.077339739, 2024-05-08T06:07:10.062 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.064161906, 2024-05-08T06:07:10.062 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.060335173, 2024-05-08T06:07:10.062 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T06:07:10.062 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 2185, 2024-05-08T06:07:10.062 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.107194661, 2024-05-08T06:07:10.062 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000049059 2024-05-08T06:07:10.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.062 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-05-08T06:07:10.062 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:10.062 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:10.062 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:10.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.063 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 895360, 2024-05-08T06:07:10.063 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 217920 2024-05-08T06:07:10.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.063 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T06:07:10.063 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 1581, 2024-05-08T06:07:10.063 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 1847, 2024-05-08T06:07:10.063 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 7377737, 2024-05-08T06:07:10.063 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 1041338, 2024-05-08T06:07:10.063 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 5, 2024-05-08T06:07:10.063 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 4, 2024-05-08T06:07:10.063 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.121496025, 2024-05-08T06:07:10.063 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.035206614, 2024-05-08T06:07:10.063 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.033957710, 2024-05-08T06:07:10.063 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.042380089, 2024-05-08T06:07:10.064 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T06:07:10.064 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 1845, 2024-05-08T06:07:10.064 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.067788448, 2024-05-08T06:07:10.064 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000036741 2024-05-08T06:07:10.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.064 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-05-08T06:07:10.064 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:10.064 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:10.064 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:10.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.064 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-08T06:07:10.064 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 538832 2024-05-08T06:07:10.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.064 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T06:07:10.064 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 697, 2024-05-08T06:07:10.065 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 697, 2024-05-08T06:07:10.065 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 4381252, 2024-05-08T06:07:10.065 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 220829, 2024-05-08T06:07:10.065 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 5, 2024-05-08T06:07:10.065 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 3, 2024-05-08T06:07:10.065 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.052466026, 2024-05-08T06:07:10.065 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.013849552, 2024-05-08T06:07:10.065 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.016849337, 2024-05-08T06:07:10.065 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.017486250, 2024-05-08T06:07:10.065 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T06:07:10.065 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 696, 2024-05-08T06:07:10.065 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.021898386, 2024-05-08T06:07:10.065 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000031463 2024-05-08T06:07:10.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.066 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-05-08T06:07:10.066 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:10.066 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:10.066 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:10.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.066 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-05-08T06:07:10.066 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 448 2024-05-08T06:07:10.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.066 INFO:teuthology.orchestra.run.smithi134.stdout: "cct": { 2024-05-08T06:07:10.066 INFO:teuthology.orchestra.run.smithi134.stdout: "total_workers": 1, 2024-05-08T06:07:10.066 INFO:teuthology.orchestra.run.smithi134.stdout: "unhealthy_workers": 0 2024-05-08T06:07:10.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.066 INFO:teuthology.orchestra.run.smithi134.stdout: "finisher-MDSRank": { 2024-05-08T06:07:10.066 INFO:teuthology.orchestra.run.smithi134.stdout: "queue_len": 0, 2024-05-08T06:07:10.067 INFO:teuthology.orchestra.run.smithi134.stdout: "complete_latency": { 2024-05-08T06:07:10.067 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 6889, 2024-05-08T06:07:10.067 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.157046330, 2024-05-08T06:07:10.067 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000022796 2024-05-08T06:07:10.067 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-05-08T06:07:10.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.067 INFO:teuthology.orchestra.run.smithi134.stdout: "finisher-PurgeQueue": { 2024-05-08T06:07:10.067 INFO:teuthology.orchestra.run.smithi134.stdout: "queue_len": 0, 2024-05-08T06:07:10.067 INFO:teuthology.orchestra.run.smithi134.stdout: "complete_latency": { 2024-05-08T06:07:10.067 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:10.067 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:10.067 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:10.067 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-05-08T06:07:10.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.067 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-05-08T06:07:10.068 INFO:teuthology.orchestra.run.smithi134.stdout: "request": 0, 2024-05-08T06:07:10.068 INFO:teuthology.orchestra.run.smithi134.stdout: "reply": 0, 2024-05-08T06:07:10.068 INFO:teuthology.orchestra.run.smithi134.stdout: "reply_latency": { 2024-05-08T06:07:10.068 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:10.068 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:10.068 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:10.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.068 INFO:teuthology.orchestra.run.smithi134.stdout: "slow_reply": 0, 2024-05-08T06:07:10.068 INFO:teuthology.orchestra.run.smithi134.stdout: "forward": 0, 2024-05-08T06:07:10.068 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_fetch_complete": 0, 2024-05-08T06:07:10.068 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_fetch_keys": 0, 2024-05-08T06:07:10.068 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_commit": 0, 2024-05-08T06:07:10.068 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_split": 0, 2024-05-08T06:07:10.068 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_merge": 0, 2024-05-08T06:07:10.069 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes": 1484, 2024-05-08T06:07:10.069 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_top": 0, 2024-05-08T06:07:10.069 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_bottom": 1484, 2024-05-08T06:07:10.069 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_pin_tail": 0, 2024-05-08T06:07:10.069 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_pinned": 1484, 2024-05-08T06:07:10.069 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_expired": 0, 2024-05-08T06:07:10.069 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_with_caps": 0, 2024-05-08T06:07:10.069 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": 0, 2024-05-08T06:07:10.069 INFO:teuthology.orchestra.run.smithi134.stdout: "subtrees": 10, 2024-05-08T06:07:10.069 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse": 0, 2024-05-08T06:07:10.069 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_hit": 0, 2024-05-08T06:07:10.069 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_forward": 0, 2024-05-08T06:07:10.069 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_discover": 0, 2024-05-08T06:07:10.069 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_dir_fetch": 0, 2024-05-08T06:07:10.069 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_remote_ino": 0, 2024-05-08T06:07:10.070 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_lock": 0, 2024-05-08T06:07:10.070 INFO:teuthology.orchestra.run.smithi134.stdout: "load_cent": 0, 2024-05-08T06:07:10.070 INFO:teuthology.orchestra.run.smithi134.stdout: "q": 0, 2024-05-08T06:07:10.070 INFO:teuthology.orchestra.run.smithi134.stdout: "exported": 0, 2024-05-08T06:07:10.070 INFO:teuthology.orchestra.run.smithi134.stdout: "exported_inodes": 0, 2024-05-08T06:07:10.070 INFO:teuthology.orchestra.run.smithi134.stdout: "imported": 0, 2024-05-08T06:07:10.070 INFO:teuthology.orchestra.run.smithi134.stdout: "imported_inodes": 0, 2024-05-08T06:07:10.070 INFO:teuthology.orchestra.run.smithi134.stdout: "openino_dir_fetch": 0, 2024-05-08T06:07:10.070 INFO:teuthology.orchestra.run.smithi134.stdout: "openino_backtrace_fetch": 0, 2024-05-08T06:07:10.070 INFO:teuthology.orchestra.run.smithi134.stdout: "openino_peer_discover": 0, 2024-05-08T06:07:10.070 INFO:teuthology.orchestra.run.smithi134.stdout: "root_rfiles": 1026, 2024-05-08T06:07:10.070 INFO:teuthology.orchestra.run.smithi134.stdout: "root_rbytes": 1714402645, 2024-05-08T06:07:10.070 INFO:teuthology.orchestra.run.smithi134.stdout: "root_rsnaps": 0, 2024-05-08T06:07:10.070 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_backtrace_fetch": 0, 2024-05-08T06:07:10.071 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_set_tag": 0, 2024-05-08T06:07:10.071 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_backtrace_repaired": 0, 2024-05-08T06:07:10.071 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_inotable_repaired": 0, 2024-05-08T06:07:10.071 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_dir_inodes": 0, 2024-05-08T06:07:10.071 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_dir_base_inodes": 0, 2024-05-08T06:07:10.071 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_dirfrag_rstats": 0, 2024-05-08T06:07:10.071 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_file_inodes": 0, 2024-05-08T06:07:10.071 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_inode_file_caps": 0, 2024-05-08T06:07:10.071 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_revoke": 0, 2024-05-08T06:07:10.071 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_grant": 0, 2024-05-08T06:07:10.071 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_trunc": 0, 2024-05-08T06:07:10.071 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-08T06:07:10.071 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-08T06:07:10.071 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_caps": 0, 2024-05-08T06:07:10.071 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_caps_dirty": 0, 2024-05-08T06:07:10.072 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_cap_release": 0, 2024-05-08T06:07:10.072 INFO:teuthology.orchestra.run.smithi134.stdout: "process_request_cap_release": 0 2024-05-08T06:07:10.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.072 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_cache": { 2024-05-08T06:07:10.072 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_update": 0, 2024-05-08T06:07:10.072 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_update_receipt": 0, 2024-05-08T06:07:10.072 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_try_discover": 0, 2024-05-08T06:07:10.072 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_send_discover": 0, 2024-05-08T06:07:10.072 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_handle_discover": 0, 2024-05-08T06:07:10.072 INFO:teuthology.orchestra.run.smithi134.stdout: "num_strays": 0, 2024-05-08T06:07:10.072 INFO:teuthology.orchestra.run.smithi134.stdout: "num_strays_delayed": 0, 2024-05-08T06:07:10.072 INFO:teuthology.orchestra.run.smithi134.stdout: "num_strays_enqueuing": 0, 2024-05-08T06:07:10.072 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_created": 0, 2024-05-08T06:07:10.072 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_enqueued": 0, 2024-05-08T06:07:10.072 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_reintegrated": 0, 2024-05-08T06:07:10.073 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_migrated": 0, 2024-05-08T06:07:10.073 INFO:teuthology.orchestra.run.smithi134.stdout: "num_recovering_processing": 0, 2024-05-08T06:07:10.073 INFO:teuthology.orchestra.run.smithi134.stdout: "num_recovering_enqueued": 0, 2024-05-08T06:07:10.073 INFO:teuthology.orchestra.run.smithi134.stdout: "num_recovering_prioritized": 0, 2024-05-08T06:07:10.073 INFO:teuthology.orchestra.run.smithi134.stdout: "recovery_started": 0, 2024-05-08T06:07:10.073 INFO:teuthology.orchestra.run.smithi134.stdout: "recovery_completed": 0, 2024-05-08T06:07:10.073 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_quiesce_path": 0, 2024-05-08T06:07:10.073 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_quiesce_inode": 0, 2024-05-08T06:07:10.073 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_enqueue_scrub": 0, 2024-05-08T06:07:10.073 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_exportdir": 0, 2024-05-08T06:07:10.073 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_flush": 0, 2024-05-08T06:07:10.073 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_fragmentdir": 0, 2024-05-08T06:07:10.073 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_fragstats": 0, 2024-05-08T06:07:10.073 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_inodestats": 0 2024-05-08T06:07:10.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.073 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_log": { 2024-05-08T06:07:10.074 INFO:teuthology.orchestra.run.smithi134.stdout: "evlrg": 0, 2024-05-08T06:07:10.074 INFO:teuthology.orchestra.run.smithi134.stdout: "evadd": 0, 2024-05-08T06:07:10.074 INFO:teuthology.orchestra.run.smithi134.stdout: "evex": 0, 2024-05-08T06:07:10.074 INFO:teuthology.orchestra.run.smithi134.stdout: "evtrm": 0, 2024-05-08T06:07:10.074 INFO:teuthology.orchestra.run.smithi134.stdout: "ev": 5884, 2024-05-08T06:07:10.074 INFO:teuthology.orchestra.run.smithi134.stdout: "evexg": 0, 2024-05-08T06:07:10.074 INFO:teuthology.orchestra.run.smithi134.stdout: "evexd": 0, 2024-05-08T06:07:10.074 INFO:teuthology.orchestra.run.smithi134.stdout: "segadd": 0, 2024-05-08T06:07:10.074 INFO:teuthology.orchestra.run.smithi134.stdout: "segex": 0, 2024-05-08T06:07:10.074 INFO:teuthology.orchestra.run.smithi134.stdout: "segtrm": 0, 2024-05-08T06:07:10.074 INFO:teuthology.orchestra.run.smithi134.stdout: "seg": 8, 2024-05-08T06:07:10.074 INFO:teuthology.orchestra.run.smithi134.stdout: "segmjr": 2, 2024-05-08T06:07:10.074 INFO:teuthology.orchestra.run.smithi134.stdout: "segexg": 0, 2024-05-08T06:07:10.074 INFO:teuthology.orchestra.run.smithi134.stdout: "segexd": 0, 2024-05-08T06:07:10.074 INFO:teuthology.orchestra.run.smithi134.stdout: "expos": 4194304, 2024-05-08T06:07:10.075 INFO:teuthology.orchestra.run.smithi134.stdout: "wrpos": 19560033, 2024-05-08T06:07:10.075 INFO:teuthology.orchestra.run.smithi134.stdout: "rdpos": 19552087, 2024-05-08T06:07:10.075 INFO:teuthology.orchestra.run.smithi134.stdout: "jlat": { 2024-05-08T06:07:10.075 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:10.075 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:10.075 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:10.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.075 INFO:teuthology.orchestra.run.smithi134.stdout: "replayed": 5884 2024-05-08T06:07:10.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.075 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_mem": { 2024-05-08T06:07:10.075 INFO:teuthology.orchestra.run.smithi134.stdout: "ino": 766, 2024-05-08T06:07:10.075 INFO:teuthology.orchestra.run.smithi134.stdout: "ino+": 1334, 2024-05-08T06:07:10.075 INFO:teuthology.orchestra.run.smithi134.stdout: "ino-": 568, 2024-05-08T06:07:10.075 INFO:teuthology.orchestra.run.smithi134.stdout: "dir": 65, 2024-05-08T06:07:10.075 INFO:teuthology.orchestra.run.smithi134.stdout: "dir+": 70, 2024-05-08T06:07:10.076 INFO:teuthology.orchestra.run.smithi134.stdout: "dir-": 5, 2024-05-08T06:07:10.076 INFO:teuthology.orchestra.run.smithi134.stdout: "dn": 1484, 2024-05-08T06:07:10.076 INFO:teuthology.orchestra.run.smithi134.stdout: "dn+": 1788, 2024-05-08T06:07:10.076 INFO:teuthology.orchestra.run.smithi134.stdout: "dn-": 304, 2024-05-08T06:07:10.076 INFO:teuthology.orchestra.run.smithi134.stdout: "cap": 0, 2024-05-08T06:07:10.076 INFO:teuthology.orchestra.run.smithi134.stdout: "cap+": 0, 2024-05-08T06:07:10.076 INFO:teuthology.orchestra.run.smithi134.stdout: "cap-": 0, 2024-05-08T06:07:10.076 INFO:teuthology.orchestra.run.smithi134.stdout: "rss": 56340, 2024-05-08T06:07:10.076 INFO:teuthology.orchestra.run.smithi134.stdout: "heap": 215416 2024-05-08T06:07:10.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.076 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_server": { 2024-05-08T06:07:10.076 INFO:teuthology.orchestra.run.smithi134.stdout: "dispatch_client_request": 0, 2024-05-08T06:07:10.076 INFO:teuthology.orchestra.run.smithi134.stdout: "dispatch_server_request": 0, 2024-05-08T06:07:10.076 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_request": 0, 2024-05-08T06:07:10.076 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_session": 0, 2024-05-08T06:07:10.077 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_peer_request": 0, 2024-05-08T06:07:10.077 INFO:teuthology.orchestra.run.smithi134.stdout: "req_create_latency": { 2024-05-08T06:07:10.077 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:10.077 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:10.077 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:10.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.077 INFO:teuthology.orchestra.run.smithi134.stdout: "req_getattr_latency": { 2024-05-08T06:07:10.077 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:10.077 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:10.077 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:10.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.077 INFO:teuthology.orchestra.run.smithi134.stdout: "req_getfilelock_latency": { 2024-05-08T06:07:10.077 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:10.077 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:10.077 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:10.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.078 INFO:teuthology.orchestra.run.smithi134.stdout: "req_link_latency": { 2024-05-08T06:07:10.078 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:10.078 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:10.078 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:10.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.078 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookup_latency": { 2024-05-08T06:07:10.078 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:10.078 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:10.078 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:10.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.078 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookuphash_latency": { 2024-05-08T06:07:10.078 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:10.078 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:10.078 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:10.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.079 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupino_latency": { 2024-05-08T06:07:10.079 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:10.079 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:10.079 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:10.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.079 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupname_latency": { 2024-05-08T06:07:10.079 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:10.079 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:10.079 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:10.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.079 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupparent_latency": { 2024-05-08T06:07:10.079 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:10.079 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:10.079 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:10.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.080 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupsnap_latency": { 2024-05-08T06:07:10.080 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:10.080 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:10.080 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:10.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.080 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lssnap_latency": { 2024-05-08T06:07:10.080 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:10.080 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:10.080 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:10.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.081 INFO:teuthology.orchestra.run.smithi134.stdout: "req_mkdir_latency": { 2024-05-08T06:07:10.081 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:10.081 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:10.081 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:10.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.081 INFO:teuthology.orchestra.run.smithi134.stdout: "req_mknod_latency": { 2024-05-08T06:07:10.081 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:10.081 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:10.081 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:10.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.082 INFO:teuthology.orchestra.run.smithi134.stdout: "req_mksnap_latency": { 2024-05-08T06:07:10.082 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:10.082 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:10.082 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:10.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.082 INFO:teuthology.orchestra.run.smithi134.stdout: "req_open_latency": { 2024-05-08T06:07:10.082 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:10.082 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:10.082 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:10.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.082 INFO:teuthology.orchestra.run.smithi134.stdout: "req_readdir_latency": { 2024-05-08T06:07:10.082 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:10.082 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:10.083 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:10.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.083 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rename_latency": { 2024-05-08T06:07:10.083 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:10.083 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:10.083 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:10.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.083 INFO:teuthology.orchestra.run.smithi134.stdout: "req_renamesnap_latency": { 2024-05-08T06:07:10.083 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:10.083 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:10.083 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:10.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.083 INFO:teuthology.orchestra.run.smithi134.stdout: "req_snapdiff_latency": { 2024-05-08T06:07:10.083 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:10.083 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:10.083 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:10.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.084 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rmdir_latency": { 2024-05-08T06:07:10.084 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:10.084 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:10.084 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:10.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.084 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rmsnap_latency": { 2024-05-08T06:07:10.084 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:10.084 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:10.084 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:10.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.084 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rmxattr_latency": { 2024-05-08T06:07:10.084 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:10.084 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:10.084 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:10.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.085 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setattr_latency": { 2024-05-08T06:07:10.085 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:10.085 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:10.085 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:10.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.085 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setdirlayout_latency": { 2024-05-08T06:07:10.085 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:10.085 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:10.085 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:10.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.085 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setfilelock_latency": { 2024-05-08T06:07:10.085 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:10.085 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:10.086 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:10.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.086 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setlayout_latency": { 2024-05-08T06:07:10.086 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:10.086 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:10.086 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:10.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.086 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setxattr_latency": { 2024-05-08T06:07:10.086 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:10.086 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:10.086 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:10.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.086 INFO:teuthology.orchestra.run.smithi134.stdout: "req_symlink_latency": { 2024-05-08T06:07:10.086 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:10.086 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:10.087 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:10.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.087 INFO:teuthology.orchestra.run.smithi134.stdout: "req_unlink_latency": { 2024-05-08T06:07:10.087 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:10.087 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:10.087 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:10.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.087 INFO:teuthology.orchestra.run.smithi134.stdout: "cap_revoke_eviction": 0, 2024-05-08T06:07:10.087 INFO:teuthology.orchestra.run.smithi134.stdout: "cap_acquisition_throttle": 0, 2024-05-08T06:07:10.087 INFO:teuthology.orchestra.run.smithi134.stdout: "req_getvxattr_latency": { 2024-05-08T06:07:10.087 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:10.087 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:10.087 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:10.087 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-05-08T06:07:10.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.088 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_sessions": { 2024-05-08T06:07:10.088 INFO:teuthology.orchestra.run.smithi134.stdout: "session_count": 1, 2024-05-08T06:07:10.088 INFO:teuthology.orchestra.run.smithi134.stdout: "session_add": 3, 2024-05-08T06:07:10.088 INFO:teuthology.orchestra.run.smithi134.stdout: "session_remove": 2, 2024-05-08T06:07:10.088 INFO:teuthology.orchestra.run.smithi134.stdout: "sessions_open": 2, 2024-05-08T06:07:10.088 INFO:teuthology.orchestra.run.smithi134.stdout: "sessions_stale": 0, 2024-05-08T06:07:10.088 INFO:teuthology.orchestra.run.smithi134.stdout: "total_load": 0, 2024-05-08T06:07:10.088 INFO:teuthology.orchestra.run.smithi134.stdout: "average_load": 0, 2024-05-08T06:07:10.088 INFO:teuthology.orchestra.run.smithi134.stdout: "avg_session_uptime": 4350, 2024-05-08T06:07:10.088 INFO:teuthology.orchestra.run.smithi134.stdout: "mdthresh_evicted": 0 2024-05-08T06:07:10.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.088 INFO:teuthology.orchestra.run.smithi134.stdout: "mempool": { 2024-05-08T06:07:10.088 INFO:teuthology.orchestra.run.smithi134.stdout: "bloom_filter_bytes": 0, 2024-05-08T06:07:10.088 INFO:teuthology.orchestra.run.smithi134.stdout: "bloom_filter_items": 0, 2024-05-08T06:07:10.089 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T06:07:10.089 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_alloc_items": 0, 2024-05-08T06:07:10.089 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T06:07:10.089 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_data_items": 0, 2024-05-08T06:07:10.089 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T06:07:10.089 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T06:07:10.089 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T06:07:10.089 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T06:07:10.089 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T06:07:10.089 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_other_items": 0, 2024-05-08T06:07:10.089 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T06:07:10.089 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T06:07:10.089 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_bytes": 0, 2024-05-08T06:07:10.089 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_items": 0, 2024-05-08T06:07:10.089 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_blob_bytes": 0, 2024-05-08T06:07:10.090 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_blob_items": 0, 2024-05-08T06:07:10.090 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T06:07:10.090 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T06:07:10.090 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T06:07:10.090 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T06:07:10.090 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T06:07:10.090 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_items": 0, 2024-05-08T06:07:10.090 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_txc_bytes": 0, 2024-05-08T06:07:10.090 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_txc_items": 0, 2024-05-08T06:07:10.090 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T06:07:10.090 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T06:07:10.090 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_bytes": 0, 2024-05-08T06:07:10.090 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_items": 0, 2024-05-08T06:07:10.090 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_bytes": 0, 2024-05-08T06:07:10.091 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_items": 0, 2024-05-08T06:07:10.091 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T06:07:10.091 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_reader_items": 0, 2024-05-08T06:07:10.091 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T06:07:10.091 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_writer_items": 0, 2024-05-08T06:07:10.091 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_anon_bytes": 217786, 2024-05-08T06:07:10.091 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_anon_items": 799, 2024-05-08T06:07:10.091 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_meta_bytes": 0, 2024-05-08T06:07:10.091 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_meta_items": 0, 2024-05-08T06:07:10.091 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_bytes": 0, 2024-05-08T06:07:10.091 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_items": 0, 2024-05-08T06:07:10.091 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mapbl_bytes": 0, 2024-05-08T06:07:10.091 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mapbl_items": 0, 2024-05-08T06:07:10.091 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pglog_bytes": 0, 2024-05-08T06:07:10.091 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pglog_items": 0, 2024-05-08T06:07:10.092 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_bytes": 7528, 2024-05-08T06:07:10.092 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_items": 158, 2024-05-08T06:07:10.092 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T06:07:10.092 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_mapping_items": 0, 2024-05-08T06:07:10.092 INFO:teuthology.orchestra.run.smithi134.stdout: "pgmap_bytes": 0, 2024-05-08T06:07:10.092 INFO:teuthology.orchestra.run.smithi134.stdout: "pgmap_items": 0, 2024-05-08T06:07:10.092 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_co_bytes": 2893558, 2024-05-08T06:07:10.092 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_co_items": 35897, 2024-05-08T06:07:10.092 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_1_bytes": 0, 2024-05-08T06:07:10.092 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_1_items": 0, 2024-05-08T06:07:10.092 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_2_bytes": 0, 2024-05-08T06:07:10.092 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_2_items": 0 2024-05-08T06:07:10.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.092 INFO:teuthology.orchestra.run.smithi134.stdout: "objecter": { 2024-05-08T06:07:10.093 INFO:teuthology.orchestra.run.smithi134.stdout: "op_active": 0, 2024-05-08T06:07:10.093 INFO:teuthology.orchestra.run.smithi134.stdout: "op_laggy": 0, 2024-05-08T06:07:10.093 INFO:teuthology.orchestra.run.smithi134.stdout: "op_send": 4101, 2024-05-08T06:07:10.093 INFO:teuthology.orchestra.run.smithi134.stdout: "op_send_bytes": 26, 2024-05-08T06:07:10.093 INFO:teuthology.orchestra.run.smithi134.stdout: "op_resend": 4, 2024-05-08T06:07:10.093 INFO:teuthology.orchestra.run.smithi134.stdout: "op_reply": 4101, 2024-05-08T06:07:10.093 INFO:teuthology.orchestra.run.smithi134.stdout: "op_latency": { 2024-05-08T06:07:10.093 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 4101, 2024-05-08T06:07:10.093 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 8.490810926, 2024-05-08T06:07:10.093 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.002070424 2024-05-08T06:07:10.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.093 INFO:teuthology.orchestra.run.smithi134.stdout: "op_inflight": 0, 2024-05-08T06:07:10.093 INFO:teuthology.orchestra.run.smithi134.stdout: "oplen_avg": { 2024-05-08T06:07:10.093 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 4101, 2024-05-08T06:07:10.093 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 4102 2024-05-08T06:07:10.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.094 INFO:teuthology.orchestra.run.smithi134.stdout: "op": 4101, 2024-05-08T06:07:10.094 INFO:teuthology.orchestra.run.smithi134.stdout: "op_r": 4101, 2024-05-08T06:07:10.094 INFO:teuthology.orchestra.run.smithi134.stdout: "op_w": 0, 2024-05-08T06:07:10.094 INFO:teuthology.orchestra.run.smithi134.stdout: "op_rmw": 0, 2024-05-08T06:07:10.094 INFO:teuthology.orchestra.run.smithi134.stdout: "op_pg": 0, 2024-05-08T06:07:10.094 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_stat": 2480, 2024-05-08T06:07:10.094 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_create": 0, 2024-05-08T06:07:10.094 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_read": 1618, 2024-05-08T06:07:10.094 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_write": 0, 2024-05-08T06:07:10.094 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_writefull": 0, 2024-05-08T06:07:10.094 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_writesame": 0, 2024-05-08T06:07:10.094 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_append": 0, 2024-05-08T06:07:10.094 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_zero": 0, 2024-05-08T06:07:10.094 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_truncate": 0, 2024-05-08T06:07:10.095 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_delete": 0, 2024-05-08T06:07:10.095 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_mapext": 0, 2024-05-08T06:07:10.095 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_sparse_read": 0, 2024-05-08T06:07:10.095 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_clonerange": 0, 2024-05-08T06:07:10.095 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_getxattr": 2, 2024-05-08T06:07:10.095 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_setxattr": 0, 2024-05-08T06:07:10.095 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_cmpxattr": 0, 2024-05-08T06:07:10.095 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_rmxattr": 0, 2024-05-08T06:07:10.095 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_resetxattrs": 0, 2024-05-08T06:07:10.095 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_call": 0, 2024-05-08T06:07:10.095 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_watch": 0, 2024-05-08T06:07:10.095 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_notify": 0, 2024-05-08T06:07:10.095 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_src_cmpxattr": 0, 2024-05-08T06:07:10.095 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_pgls": 0, 2024-05-08T06:07:10.095 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_pgls_filter": 0, 2024-05-08T06:07:10.096 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_other": 0, 2024-05-08T06:07:10.096 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_active": 0, 2024-05-08T06:07:10.096 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_send": 0, 2024-05-08T06:07:10.096 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_resend": 0, 2024-05-08T06:07:10.096 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_ping": 0, 2024-05-08T06:07:10.096 INFO:teuthology.orchestra.run.smithi134.stdout: "poolop_active": 0, 2024-05-08T06:07:10.096 INFO:teuthology.orchestra.run.smithi134.stdout: "poolop_send": 0, 2024-05-08T06:07:10.096 INFO:teuthology.orchestra.run.smithi134.stdout: "poolop_resend": 0, 2024-05-08T06:07:10.096 INFO:teuthology.orchestra.run.smithi134.stdout: "poolstat_active": 0, 2024-05-08T06:07:10.096 INFO:teuthology.orchestra.run.smithi134.stdout: "poolstat_send": 0, 2024-05-08T06:07:10.096 INFO:teuthology.orchestra.run.smithi134.stdout: "poolstat_resend": 0, 2024-05-08T06:07:10.096 INFO:teuthology.orchestra.run.smithi134.stdout: "statfs_active": 0, 2024-05-08T06:07:10.096 INFO:teuthology.orchestra.run.smithi134.stdout: "statfs_send": 0, 2024-05-08T06:07:10.096 INFO:teuthology.orchestra.run.smithi134.stdout: "statfs_resend": 0, 2024-05-08T06:07:10.096 INFO:teuthology.orchestra.run.smithi134.stdout: "command_active": 0, 2024-05-08T06:07:10.096 INFO:teuthology.orchestra.run.smithi134.stdout: "command_send": 0, 2024-05-08T06:07:10.097 INFO:teuthology.orchestra.run.smithi134.stdout: "command_resend": 0, 2024-05-08T06:07:10.097 INFO:teuthology.orchestra.run.smithi134.stdout: "map_epoch": 82, 2024-05-08T06:07:10.097 INFO:teuthology.orchestra.run.smithi134.stdout: "map_full": 0, 2024-05-08T06:07:10.097 INFO:teuthology.orchestra.run.smithi134.stdout: "map_inc": 2, 2024-05-08T06:07:10.097 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_sessions": 5, 2024-05-08T06:07:10.097 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_session_open": 6, 2024-05-08T06:07:10.097 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_session_close": 1, 2024-05-08T06:07:10.097 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_laggy": 0, 2024-05-08T06:07:10.097 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_wr": 0, 2024-05-08T06:07:10.097 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_rd": 2, 2024-05-08T06:07:10.097 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_del": 0 2024-05-08T06:07:10.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.097 INFO:teuthology.orchestra.run.smithi134.stdout: "oft": { 2024-05-08T06:07:10.097 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_objs": 0, 2024-05-08T06:07:10.098 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_kv_pairs": 0, 2024-05-08T06:07:10.098 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_updates": 0, 2024-05-08T06:07:10.098 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_removes": 0 2024-05-08T06:07:10.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.098 INFO:teuthology.orchestra.run.smithi134.stdout: "osd-slow-ops": { 2024-05-08T06:07:10.098 INFO:teuthology.orchestra.run.smithi134.stdout: "slow_ops_count": 0 2024-05-08T06:07:10.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.098 INFO:teuthology.orchestra.run.smithi134.stdout: "purge_queue": { 2024-05-08T06:07:10.098 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing_ops": 0, 2024-05-08T06:07:10.098 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing_ops_high_water": 0, 2024-05-08T06:07:10.098 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing": 0, 2024-05-08T06:07:10.098 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing_high_water": 0, 2024-05-08T06:07:10.098 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executed_ops": 0, 2024-05-08T06:07:10.098 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executed": 0, 2024-05-08T06:07:10.098 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_item_in_journal": 0 2024-05-08T06:07:10.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.099 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T06:07:10.099 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-05-08T06:07:10.099 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 104857600, 2024-05-08T06:07:10.099 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-05-08T06:07:10.099 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 4470, 2024-05-08T06:07:10.099 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 16991451, 2024-05-08T06:07:10.099 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-05-08T06:07:10.099 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 4470, 2024-05-08T06:07:10.099 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-05-08T06:07:10.099 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-05-08T06:07:10.099 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 4470, 2024-05-08T06:07:10.099 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 16991451, 2024-05-08T06:07:10.099 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-05-08T06:07:10.100 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:10.100 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:10.100 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:10.100 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-05-08T06:07:10.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.100 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-objecter_bytes": { 2024-05-08T06:07:10.100 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-05-08T06:07:10.100 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 104857600, 2024-05-08T06:07:10.100 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-05-08T06:07:10.100 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 0, 2024-05-08T06:07:10.100 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 0, 2024-05-08T06:07:10.100 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-05-08T06:07:10.100 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 0, 2024-05-08T06:07:10.100 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 4101, 2024-05-08T06:07:10.100 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 15374247, 2024-05-08T06:07:10.100 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 4101, 2024-05-08T06:07:10.101 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 15374247, 2024-05-08T06:07:10.101 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-05-08T06:07:10.101 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:10.101 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:10.101 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:10.101 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-05-08T06:07:10.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.101 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-objecter_ops": { 2024-05-08T06:07:10.101 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-05-08T06:07:10.101 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 1024, 2024-05-08T06:07:10.101 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-05-08T06:07:10.101 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 0, 2024-05-08T06:07:10.101 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 0, 2024-05-08T06:07:10.101 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-05-08T06:07:10.102 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 0, 2024-05-08T06:07:10.102 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 4101, 2024-05-08T06:07:10.102 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 4101, 2024-05-08T06:07:10.102 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 4101, 2024-05-08T06:07:10.102 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 4101, 2024-05-08T06:07:10.102 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-05-08T06:07:10.102 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:10.102 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:10.102 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:10.102 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-05-08T06:07:10.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.102 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-write_buf_throttle": { 2024-05-08T06:07:10.102 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-05-08T06:07:10.102 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 3758096384, 2024-05-08T06:07:10.102 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-05-08T06:07:10.103 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 0, 2024-05-08T06:07:10.103 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 0, 2024-05-08T06:07:10.103 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-05-08T06:07:10.103 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 0, 2024-05-08T06:07:10.103 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-05-08T06:07:10.103 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-05-08T06:07:10.103 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 0, 2024-05-08T06:07:10.103 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 0, 2024-05-08T06:07:10.103 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-05-08T06:07:10.103 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:10.103 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:10.103 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:10.103 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-05-08T06:07:10.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:10.103 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-write_buf_throttle-0x55941ac886e0": { 2024-05-08T06:07:10.104 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-05-08T06:07:10.104 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 3758096384, 2024-05-08T06:07:10.104 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-05-08T06:07:10.104 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 0, 2024-05-08T06:07:10.104 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 0, 2024-05-08T06:07:10.104 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-05-08T06:07:10.104 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 0, 2024-05-08T06:07:10.104 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-05-08T06:07:10.104 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-05-08T06:07:10.104 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 0, 2024-05-08T06:07:10.104 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 0, 2024-05-08T06:07:10.104 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-05-08T06:07:10.104 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:10.104 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:10.104 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:10.104 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-05-08T06:07:10.105 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-05-08T06:07:10.105 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-05-08T06:07:10.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:09 smithi151 ceph-mon[34815]: pgmap v954: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 15 KiB/s wr, 10 op/s 2024-05-08T06:07:10.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:09 smithi082 ceph-mon[30098]: pgmap v954: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 15 KiB/s wr, 10 op/s 2024-05-08T06:07:10.898 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-05-08T06:07:10.898 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-05-08T06:07:10.898 DEBUG:tasks.check_counter:Getting stats from h 2024-05-08T06:07:10.898 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph daemon mds.h perf dump 2024-05-08T06:07:11.143 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T06:07:12.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:11 smithi151 ceph-mon[34815]: pgmap v955: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 16 KiB/s wr, 10 op/s 2024-05-08T06:07:12.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:11 smithi082 ceph-mon[30098]: pgmap v955: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 16 KiB/s wr, 10 op/s 2024-05-08T06:07:12.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:11 smithi134 ceph-mon[34132]: pgmap v955: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 16 KiB/s wr, 10 op/s 2024-05-08T06:07:12.897 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-05-08T06:07:12.898 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T06:07:12.898 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 806, 2024-05-08T06:07:12.898 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 1125, 2024-05-08T06:07:12.898 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 997965, 2024-05-08T06:07:12.898 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 517755, 2024-05-08T06:07:12.898 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 8, 2024-05-08T06:07:12.898 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 3, 2024-05-08T06:07:12.898 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.118064985, 2024-05-08T06:07:12.898 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.049778954, 2024-05-08T06:07:12.898 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.049220219, 2024-05-08T06:07:12.898 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.014512585, 2024-05-08T06:07:12.898 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T06:07:12.898 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 1124, 2024-05-08T06:07:12.898 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.069860067, 2024-05-08T06:07:12.899 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000062153 2024-05-08T06:07:12.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.899 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-05-08T06:07:12.899 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 1114, 2024-05-08T06:07:12.899 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000268251, 2024-05-08T06:07:12.899 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000240 2024-05-08T06:07:12.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.899 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 907376, 2024-05-08T06:07:12.899 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 221920 2024-05-08T06:07:12.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.899 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T06:07:12.899 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 30, 2024-05-08T06:07:12.899 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 295, 2024-05-08T06:07:12.899 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 8857, 2024-05-08T06:07:12.899 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 689654, 2024-05-08T06:07:12.900 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 14, 2024-05-08T06:07:12.900 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 4, 2024-05-08T06:07:12.900 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.023850624, 2024-05-08T06:07:12.900 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.012109351, 2024-05-08T06:07:12.900 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.008865694, 2024-05-08T06:07:12.900 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.000177220, 2024-05-08T06:07:12.900 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T06:07:12.900 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 293, 2024-05-08T06:07:12.900 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.036255052, 2024-05-08T06:07:12.900 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000123737 2024-05-08T06:07:12.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.900 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-05-08T06:07:12.900 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 33, 2024-05-08T06:07:12.900 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000005465, 2024-05-08T06:07:12.901 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000165 2024-05-08T06:07:12.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.901 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 5776, 2024-05-08T06:07:12.901 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 631520 2024-05-08T06:07:12.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.901 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T06:07:12.901 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 50, 2024-05-08T06:07:12.901 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 50, 2024-05-08T06:07:12.901 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 11857, 2024-05-08T06:07:12.901 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 342805, 2024-05-08T06:07:12.901 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 35, 2024-05-08T06:07:12.901 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 4, 2024-05-08T06:07:12.901 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.011018664, 2024-05-08T06:07:12.901 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.000836593, 2024-05-08T06:07:12.901 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.009001640, 2024-05-08T06:07:12.902 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.000287573, 2024-05-08T06:07:12.902 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T06:07:12.902 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 49, 2024-05-08T06:07:12.902 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.020146431, 2024-05-08T06:07:12.902 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000411151 2024-05-08T06:07:12.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.902 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-05-08T06:07:12.902 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 28, 2024-05-08T06:07:12.902 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000003840, 2024-05-08T06:07:12.902 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000137 2024-05-08T06:07:12.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.902 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-05-08T06:07:12.902 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 448 2024-05-08T06:07:12.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.902 INFO:teuthology.orchestra.run.smithi134.stdout: "cct": { 2024-05-08T06:07:12.903 INFO:teuthology.orchestra.run.smithi134.stdout: "total_workers": 1, 2024-05-08T06:07:12.903 INFO:teuthology.orchestra.run.smithi134.stdout: "unhealthy_workers": 0 2024-05-08T06:07:12.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.903 INFO:teuthology.orchestra.run.smithi134.stdout: "finisher-MDSRank": { 2024-05-08T06:07:12.903 INFO:teuthology.orchestra.run.smithi134.stdout: "queue_len": 0, 2024-05-08T06:07:12.903 INFO:teuthology.orchestra.run.smithi134.stdout: "complete_latency": { 2024-05-08T06:07:12.903 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 49, 2024-05-08T06:07:12.903 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000975374, 2024-05-08T06:07:12.903 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000019905 2024-05-08T06:07:12.903 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-05-08T06:07:12.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.903 INFO:teuthology.orchestra.run.smithi134.stdout: "finisher-PurgeQueue": { 2024-05-08T06:07:12.903 INFO:teuthology.orchestra.run.smithi134.stdout: "queue_len": 0, 2024-05-08T06:07:12.903 INFO:teuthology.orchestra.run.smithi134.stdout: "complete_latency": { 2024-05-08T06:07:12.903 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 2, 2024-05-08T06:07:12.904 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000006493, 2024-05-08T06:07:12.904 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000003246 2024-05-08T06:07:12.904 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-05-08T06:07:12.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.904 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-05-08T06:07:12.904 INFO:teuthology.orchestra.run.smithi134.stdout: "request": 1, 2024-05-08T06:07:12.904 INFO:teuthology.orchestra.run.smithi134.stdout: "reply": 1, 2024-05-08T06:07:12.904 INFO:teuthology.orchestra.run.smithi134.stdout: "reply_latency": { 2024-05-08T06:07:12.904 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 1, 2024-05-08T06:07:12.904 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000090104, 2024-05-08T06:07:12.904 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000090104 2024-05-08T06:07:12.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.904 INFO:teuthology.orchestra.run.smithi134.stdout: "slow_reply": 0, 2024-05-08T06:07:12.904 INFO:teuthology.orchestra.run.smithi134.stdout: "forward": 0, 2024-05-08T06:07:12.904 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_fetch_complete": 0, 2024-05-08T06:07:12.905 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_fetch_keys": 0, 2024-05-08T06:07:12.905 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_commit": 11, 2024-05-08T06:07:12.905 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_split": 0, 2024-05-08T06:07:12.905 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_merge": 0, 2024-05-08T06:07:12.905 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes": 10, 2024-05-08T06:07:12.905 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_top": 0, 2024-05-08T06:07:12.905 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_bottom": 10, 2024-05-08T06:07:12.905 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_pin_tail": 0, 2024-05-08T06:07:12.905 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_pinned": 10, 2024-05-08T06:07:12.905 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_expired": 0, 2024-05-08T06:07:12.905 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_with_caps": 1, 2024-05-08T06:07:12.905 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": 1, 2024-05-08T06:07:12.905 INFO:teuthology.orchestra.run.smithi134.stdout: "subtrees": 1, 2024-05-08T06:07:12.905 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse": 0, 2024-05-08T06:07:12.905 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_hit": 0, 2024-05-08T06:07:12.906 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_forward": 0, 2024-05-08T06:07:12.906 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_discover": 0, 2024-05-08T06:07:12.906 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_dir_fetch": 0, 2024-05-08T06:07:12.906 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_remote_ino": 0, 2024-05-08T06:07:12.906 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_lock": 0, 2024-05-08T06:07:12.906 INFO:teuthology.orchestra.run.smithi134.stdout: "load_cent": 0, 2024-05-08T06:07:12.906 INFO:teuthology.orchestra.run.smithi134.stdout: "q": 0, 2024-05-08T06:07:12.906 INFO:teuthology.orchestra.run.smithi134.stdout: "exported": 0, 2024-05-08T06:07:12.906 INFO:teuthology.orchestra.run.smithi134.stdout: "exported_inodes": 0, 2024-05-08T06:07:12.906 INFO:teuthology.orchestra.run.smithi134.stdout: "imported": 0, 2024-05-08T06:07:12.906 INFO:teuthology.orchestra.run.smithi134.stdout: "imported_inodes": 0, 2024-05-08T06:07:12.906 INFO:teuthology.orchestra.run.smithi134.stdout: "openino_dir_fetch": 0, 2024-05-08T06:07:12.906 INFO:teuthology.orchestra.run.smithi134.stdout: "openino_backtrace_fetch": 0, 2024-05-08T06:07:12.906 INFO:teuthology.orchestra.run.smithi134.stdout: "openino_peer_discover": 0, 2024-05-08T06:07:12.906 INFO:teuthology.orchestra.run.smithi134.stdout: "root_rfiles": 1029, 2024-05-08T06:07:12.907 INFO:teuthology.orchestra.run.smithi134.stdout: "root_rbytes": 1712962860, 2024-05-08T06:07:12.907 INFO:teuthology.orchestra.run.smithi134.stdout: "root_rsnaps": 0, 2024-05-08T06:07:12.907 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_backtrace_fetch": 0, 2024-05-08T06:07:12.907 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_set_tag": 0, 2024-05-08T06:07:12.907 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_backtrace_repaired": 0, 2024-05-08T06:07:12.907 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_inotable_repaired": 0, 2024-05-08T06:07:12.907 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_dir_inodes": 0, 2024-05-08T06:07:12.907 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_dir_base_inodes": 0, 2024-05-08T06:07:12.907 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_dirfrag_rstats": 0, 2024-05-08T06:07:12.907 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_file_inodes": 0, 2024-05-08T06:07:12.907 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_inode_file_caps": 0, 2024-05-08T06:07:12.907 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_revoke": 0, 2024-05-08T06:07:12.907 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_grant": 0, 2024-05-08T06:07:12.907 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_trunc": 0, 2024-05-08T06:07:12.907 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-08T06:07:12.908 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-08T06:07:12.908 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_caps": 0, 2024-05-08T06:07:12.908 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_caps_dirty": 0, 2024-05-08T06:07:12.908 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_cap_release": 0, 2024-05-08T06:07:12.908 INFO:teuthology.orchestra.run.smithi134.stdout: "process_request_cap_release": 0 2024-05-08T06:07:12.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.908 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_cache": { 2024-05-08T06:07:12.908 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_update": 0, 2024-05-08T06:07:12.908 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_update_receipt": 0, 2024-05-08T06:07:12.908 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_try_discover": 0, 2024-05-08T06:07:12.908 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_send_discover": 1, 2024-05-08T06:07:12.908 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_handle_discover": 0, 2024-05-08T06:07:12.908 INFO:teuthology.orchestra.run.smithi134.stdout: "num_strays": 0, 2024-05-08T06:07:12.908 INFO:teuthology.orchestra.run.smithi134.stdout: "num_strays_delayed": 0, 2024-05-08T06:07:12.908 INFO:teuthology.orchestra.run.smithi134.stdout: "num_strays_enqueuing": 0, 2024-05-08T06:07:12.909 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_created": 0, 2024-05-08T06:07:12.909 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_enqueued": 0, 2024-05-08T06:07:12.909 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_reintegrated": 0, 2024-05-08T06:07:12.909 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_migrated": 0, 2024-05-08T06:07:12.909 INFO:teuthology.orchestra.run.smithi134.stdout: "num_recovering_processing": 0, 2024-05-08T06:07:12.909 INFO:teuthology.orchestra.run.smithi134.stdout: "num_recovering_enqueued": 0, 2024-05-08T06:07:12.909 INFO:teuthology.orchestra.run.smithi134.stdout: "num_recovering_prioritized": 0, 2024-05-08T06:07:12.909 INFO:teuthology.orchestra.run.smithi134.stdout: "recovery_started": 0, 2024-05-08T06:07:12.909 INFO:teuthology.orchestra.run.smithi134.stdout: "recovery_completed": 0, 2024-05-08T06:07:12.909 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_quiesce_path": 0, 2024-05-08T06:07:12.909 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_quiesce_inode": 0, 2024-05-08T06:07:12.909 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_enqueue_scrub": 0, 2024-05-08T06:07:12.909 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_exportdir": 0, 2024-05-08T06:07:12.909 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_flush": 0, 2024-05-08T06:07:12.909 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_fragmentdir": 0, 2024-05-08T06:07:12.909 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_fragstats": 0, 2024-05-08T06:07:12.910 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_inodestats": 0 2024-05-08T06:07:12.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.910 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_log": { 2024-05-08T06:07:12.910 INFO:teuthology.orchestra.run.smithi134.stdout: "evlrg": 0, 2024-05-08T06:07:12.910 INFO:teuthology.orchestra.run.smithi134.stdout: "evadd": 3, 2024-05-08T06:07:12.910 INFO:teuthology.orchestra.run.smithi134.stdout: "evex": 0, 2024-05-08T06:07:12.910 INFO:teuthology.orchestra.run.smithi134.stdout: "evtrm": 0, 2024-05-08T06:07:12.910 INFO:teuthology.orchestra.run.smithi134.stdout: "ev": 3, 2024-05-08T06:07:12.910 INFO:teuthology.orchestra.run.smithi134.stdout: "evexg": 0, 2024-05-08T06:07:12.910 INFO:teuthology.orchestra.run.smithi134.stdout: "evexd": 0, 2024-05-08T06:07:12.910 INFO:teuthology.orchestra.run.smithi134.stdout: "segadd": 2, 2024-05-08T06:07:12.910 INFO:teuthology.orchestra.run.smithi134.stdout: "segex": 0, 2024-05-08T06:07:12.910 INFO:teuthology.orchestra.run.smithi134.stdout: "segtrm": 0, 2024-05-08T06:07:12.910 INFO:teuthology.orchestra.run.smithi134.stdout: "seg": 2, 2024-05-08T06:07:12.911 INFO:teuthology.orchestra.run.smithi134.stdout: "segmjr": 2, 2024-05-08T06:07:12.911 INFO:teuthology.orchestra.run.smithi134.stdout: "segexg": 0, 2024-05-08T06:07:12.911 INFO:teuthology.orchestra.run.smithi134.stdout: "segexd": 0, 2024-05-08T06:07:12.911 INFO:teuthology.orchestra.run.smithi134.stdout: "expos": 4194304, 2024-05-08T06:07:12.911 INFO:teuthology.orchestra.run.smithi134.stdout: "wrpos": 4195202, 2024-05-08T06:07:12.911 INFO:teuthology.orchestra.run.smithi134.stdout: "rdpos": 0, 2024-05-08T06:07:12.911 INFO:teuthology.orchestra.run.smithi134.stdout: "jlat": { 2024-05-08T06:07:12.911 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 2, 2024-05-08T06:07:12.911 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.005726359, 2024-05-08T06:07:12.911 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.002863179 2024-05-08T06:07:12.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.911 INFO:teuthology.orchestra.run.smithi134.stdout: "replayed": 0 2024-05-08T06:07:12.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.911 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_mem": { 2024-05-08T06:07:12.911 INFO:teuthology.orchestra.run.smithi134.stdout: "ino": 13, 2024-05-08T06:07:12.912 INFO:teuthology.orchestra.run.smithi134.stdout: "ino+": 13, 2024-05-08T06:07:12.912 INFO:teuthology.orchestra.run.smithi134.stdout: "ino-": 0, 2024-05-08T06:07:12.912 INFO:teuthology.orchestra.run.smithi134.stdout: "dir": 11, 2024-05-08T06:07:12.912 INFO:teuthology.orchestra.run.smithi134.stdout: "dir+": 12, 2024-05-08T06:07:12.912 INFO:teuthology.orchestra.run.smithi134.stdout: "dir-": 1, 2024-05-08T06:07:12.912 INFO:teuthology.orchestra.run.smithi134.stdout: "dn": 10, 2024-05-08T06:07:12.912 INFO:teuthology.orchestra.run.smithi134.stdout: "dn+": 10, 2024-05-08T06:07:12.912 INFO:teuthology.orchestra.run.smithi134.stdout: "dn-": 0, 2024-05-08T06:07:12.912 INFO:teuthology.orchestra.run.smithi134.stdout: "cap": 1, 2024-05-08T06:07:12.912 INFO:teuthology.orchestra.run.smithi134.stdout: "cap+": 1, 2024-05-08T06:07:12.912 INFO:teuthology.orchestra.run.smithi134.stdout: "cap-": 0, 2024-05-08T06:07:12.912 INFO:teuthology.orchestra.run.smithi134.stdout: "rss": 52400, 2024-05-08T06:07:12.912 INFO:teuthology.orchestra.run.smithi134.stdout: "heap": 223608 2024-05-08T06:07:12.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.912 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_server": { 2024-05-08T06:07:12.912 INFO:teuthology.orchestra.run.smithi134.stdout: "dispatch_client_request": 1, 2024-05-08T06:07:12.913 INFO:teuthology.orchestra.run.smithi134.stdout: "dispatch_server_request": 0, 2024-05-08T06:07:12.913 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_request": 1, 2024-05-08T06:07:12.913 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_session": 14, 2024-05-08T06:07:12.913 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_peer_request": 0, 2024-05-08T06:07:12.913 INFO:teuthology.orchestra.run.smithi134.stdout: "req_create_latency": { 2024-05-08T06:07:12.913 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:12.913 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:12.913 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:12.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.913 INFO:teuthology.orchestra.run.smithi134.stdout: "req_getattr_latency": { 2024-05-08T06:07:12.913 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:12.913 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:12.913 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:12.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.913 INFO:teuthology.orchestra.run.smithi134.stdout: "req_getfilelock_latency": { 2024-05-08T06:07:12.914 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:12.914 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:12.914 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:12.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.914 INFO:teuthology.orchestra.run.smithi134.stdout: "req_link_latency": { 2024-05-08T06:07:12.914 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:12.914 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:12.914 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:12.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.914 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookup_latency": { 2024-05-08T06:07:12.914 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:12.914 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:12.914 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:12.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.915 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookuphash_latency": { 2024-05-08T06:07:12.915 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:12.915 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:12.915 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:12.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.915 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupino_latency": { 2024-05-08T06:07:12.915 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 1, 2024-05-08T06:07:12.915 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000090104, 2024-05-08T06:07:12.915 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000090104 2024-05-08T06:07:12.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.915 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupname_latency": { 2024-05-08T06:07:12.915 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:12.915 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:12.915 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:12.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.915 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupparent_latency": { 2024-05-08T06:07:12.916 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:12.916 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:12.916 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:12.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.916 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupsnap_latency": { 2024-05-08T06:07:12.916 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:12.916 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:12.916 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:12.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.916 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lssnap_latency": { 2024-05-08T06:07:12.916 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:12.916 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:12.916 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:12.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.916 INFO:teuthology.orchestra.run.smithi134.stdout: "req_mkdir_latency": { 2024-05-08T06:07:12.916 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:12.917 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:12.917 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:12.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.917 INFO:teuthology.orchestra.run.smithi134.stdout: "req_mknod_latency": { 2024-05-08T06:07:12.917 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:12.917 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:12.918 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:12.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.918 INFO:teuthology.orchestra.run.smithi134.stdout: "req_mksnap_latency": { 2024-05-08T06:07:12.918 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:12.918 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:12.918 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:12.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.918 INFO:teuthology.orchestra.run.smithi134.stdout: "req_open_latency": { 2024-05-08T06:07:12.918 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:12.918 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:12.918 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:12.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.918 INFO:teuthology.orchestra.run.smithi134.stdout: "req_readdir_latency": { 2024-05-08T06:07:12.919 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:12.919 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:12.919 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:12.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.919 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rename_latency": { 2024-05-08T06:07:12.919 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:12.919 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:12.919 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:12.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.919 INFO:teuthology.orchestra.run.smithi134.stdout: "req_renamesnap_latency": { 2024-05-08T06:07:12.919 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:12.919 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:12.919 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:12.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.920 INFO:teuthology.orchestra.run.smithi134.stdout: "req_snapdiff_latency": { 2024-05-08T06:07:12.920 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:12.920 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:12.920 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:12.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.920 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rmdir_latency": { 2024-05-08T06:07:12.920 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:12.920 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:12.920 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:12.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.920 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rmsnap_latency": { 2024-05-08T06:07:12.920 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:12.920 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:12.920 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:12.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.921 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rmxattr_latency": { 2024-05-08T06:07:12.921 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:12.921 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:12.921 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:12.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.921 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setattr_latency": { 2024-05-08T06:07:12.921 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:12.921 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:12.921 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:12.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.921 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setdirlayout_latency": { 2024-05-08T06:07:12.921 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:12.921 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:12.922 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:12.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.922 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setfilelock_latency": { 2024-05-08T06:07:12.922 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:12.922 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:12.922 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:12.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.922 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setlayout_latency": { 2024-05-08T06:07:12.922 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:12.922 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:12.922 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:12.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.922 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setxattr_latency": { 2024-05-08T06:07:12.923 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:12.923 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:12.923 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:12.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.923 INFO:teuthology.orchestra.run.smithi134.stdout: "req_symlink_latency": { 2024-05-08T06:07:12.923 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:12.923 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:12.923 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:12.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.923 INFO:teuthology.orchestra.run.smithi134.stdout: "req_unlink_latency": { 2024-05-08T06:07:12.923 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:12.923 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:12.923 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:12.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.924 INFO:teuthology.orchestra.run.smithi134.stdout: "cap_revoke_eviction": 0, 2024-05-08T06:07:12.924 INFO:teuthology.orchestra.run.smithi134.stdout: "cap_acquisition_throttle": 0, 2024-05-08T06:07:12.924 INFO:teuthology.orchestra.run.smithi134.stdout: "req_getvxattr_latency": { 2024-05-08T06:07:12.924 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:12.924 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:12.924 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:12.924 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-05-08T06:07:12.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.924 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_sessions": { 2024-05-08T06:07:12.924 INFO:teuthology.orchestra.run.smithi134.stdout: "session_count": 1, 2024-05-08T06:07:12.924 INFO:teuthology.orchestra.run.smithi134.stdout: "session_add": 1, 2024-05-08T06:07:12.924 INFO:teuthology.orchestra.run.smithi134.stdout: "session_remove": 0, 2024-05-08T06:07:12.924 INFO:teuthology.orchestra.run.smithi134.stdout: "sessions_open": 1, 2024-05-08T06:07:12.924 INFO:teuthology.orchestra.run.smithi134.stdout: "sessions_stale": 0, 2024-05-08T06:07:12.925 INFO:teuthology.orchestra.run.smithi134.stdout: "total_load": 1, 2024-05-08T06:07:12.925 INFO:teuthology.orchestra.run.smithi134.stdout: "average_load": 1, 2024-05-08T06:07:12.925 INFO:teuthology.orchestra.run.smithi134.stdout: "avg_session_uptime": 1009, 2024-05-08T06:07:12.925 INFO:teuthology.orchestra.run.smithi134.stdout: "mdthresh_evicted": 0 2024-05-08T06:07:12.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.925 INFO:teuthology.orchestra.run.smithi134.stdout: "mempool": { 2024-05-08T06:07:12.925 INFO:teuthology.orchestra.run.smithi134.stdout: "bloom_filter_bytes": 0, 2024-05-08T06:07:12.925 INFO:teuthology.orchestra.run.smithi134.stdout: "bloom_filter_items": 0, 2024-05-08T06:07:12.925 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T06:07:12.925 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_alloc_items": 0, 2024-05-08T06:07:12.925 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T06:07:12.925 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_data_items": 0, 2024-05-08T06:07:12.925 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T06:07:12.926 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T06:07:12.926 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T06:07:12.926 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T06:07:12.926 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T06:07:12.926 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_other_items": 0, 2024-05-08T06:07:12.926 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T06:07:12.926 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T06:07:12.926 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_bytes": 0, 2024-05-08T06:07:12.926 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_items": 0, 2024-05-08T06:07:12.926 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_blob_bytes": 0, 2024-05-08T06:07:12.926 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_blob_items": 0, 2024-05-08T06:07:12.926 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T06:07:12.926 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T06:07:12.926 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T06:07:12.927 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T06:07:12.927 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T06:07:12.927 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_items": 0, 2024-05-08T06:07:12.927 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_txc_bytes": 0, 2024-05-08T06:07:12.927 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_txc_items": 0, 2024-05-08T06:07:12.927 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T06:07:12.927 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T06:07:12.927 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_bytes": 0, 2024-05-08T06:07:12.927 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_items": 0, 2024-05-08T06:07:12.927 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_bytes": 0, 2024-05-08T06:07:12.927 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_items": 0, 2024-05-08T06:07:12.927 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T06:07:12.927 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_reader_items": 0, 2024-05-08T06:07:12.928 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T06:07:12.928 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_writer_items": 0, 2024-05-08T06:07:12.928 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_anon_bytes": 246951, 2024-05-08T06:07:12.928 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_anon_items": 79, 2024-05-08T06:07:12.928 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_meta_bytes": 0, 2024-05-08T06:07:12.928 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_meta_items": 0, 2024-05-08T06:07:12.928 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_bytes": 0, 2024-05-08T06:07:12.928 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_items": 0, 2024-05-08T06:07:12.928 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mapbl_bytes": 0, 2024-05-08T06:07:12.928 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mapbl_items": 0, 2024-05-08T06:07:12.928 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pglog_bytes": 0, 2024-05-08T06:07:12.928 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pglog_items": 0, 2024-05-08T06:07:12.928 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_bytes": 7528, 2024-05-08T06:07:12.928 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_items": 158, 2024-05-08T06:07:12.929 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T06:07:12.929 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_mapping_items": 0, 2024-05-08T06:07:12.929 INFO:teuthology.orchestra.run.smithi134.stdout: "pgmap_bytes": 0, 2024-05-08T06:07:12.929 INFO:teuthology.orchestra.run.smithi134.stdout: "pgmap_items": 0, 2024-05-08T06:07:12.929 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_co_bytes": 51240, 2024-05-08T06:07:12.929 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_co_items": 200, 2024-05-08T06:07:12.929 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_1_bytes": 0, 2024-05-08T06:07:12.929 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_1_items": 0, 2024-05-08T06:07:12.929 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_2_bytes": 0, 2024-05-08T06:07:12.929 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_2_items": 0 2024-05-08T06:07:12.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.929 INFO:teuthology.orchestra.run.smithi134.stdout: "objecter": { 2024-05-08T06:07:12.929 INFO:teuthology.orchestra.run.smithi134.stdout: "op_active": 0, 2024-05-08T06:07:12.929 INFO:teuthology.orchestra.run.smithi134.stdout: "op_laggy": 0, 2024-05-08T06:07:12.929 INFO:teuthology.orchestra.run.smithi134.stdout: "op_send": 37, 2024-05-08T06:07:12.930 INFO:teuthology.orchestra.run.smithi134.stdout: "op_send_bytes": 11110, 2024-05-08T06:07:12.930 INFO:teuthology.orchestra.run.smithi134.stdout: "op_resend": 33, 2024-05-08T06:07:12.930 INFO:teuthology.orchestra.run.smithi134.stdout: "op_reply": 37, 2024-05-08T06:07:12.930 INFO:teuthology.orchestra.run.smithi134.stdout: "op_latency": { 2024-05-08T06:07:12.930 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 37, 2024-05-08T06:07:12.930 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.353991934, 2024-05-08T06:07:12.930 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.009567349 2024-05-08T06:07:12.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.930 INFO:teuthology.orchestra.run.smithi134.stdout: "op_inflight": 0, 2024-05-08T06:07:12.930 INFO:teuthology.orchestra.run.smithi134.stdout: "oplen_avg": { 2024-05-08T06:07:12.930 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 37, 2024-05-08T06:07:12.930 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 59 2024-05-08T06:07:12.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.930 INFO:teuthology.orchestra.run.smithi134.stdout: "op": 37, 2024-05-08T06:07:12.930 INFO:teuthology.orchestra.run.smithi134.stdout: "op_r": 0, 2024-05-08T06:07:12.931 INFO:teuthology.orchestra.run.smithi134.stdout: "op_w": 37, 2024-05-08T06:07:12.931 INFO:teuthology.orchestra.run.smithi134.stdout: "op_rmw": 0, 2024-05-08T06:07:12.931 INFO:teuthology.orchestra.run.smithi134.stdout: "op_pg": 0, 2024-05-08T06:07:12.931 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_stat": 0, 2024-05-08T06:07:12.931 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_create": 10, 2024-05-08T06:07:12.931 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_read": 0, 2024-05-08T06:07:12.931 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_write": 2, 2024-05-08T06:07:12.931 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_writefull": 6, 2024-05-08T06:07:12.931 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_writesame": 0, 2024-05-08T06:07:12.931 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_append": 0, 2024-05-08T06:07:12.931 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_zero": 0, 2024-05-08T06:07:12.931 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_truncate": 0, 2024-05-08T06:07:12.931 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_delete": 6, 2024-05-08T06:07:12.931 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_mapext": 0, 2024-05-08T06:07:12.931 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_sparse_read": 0, 2024-05-08T06:07:12.932 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_clonerange": 0, 2024-05-08T06:07:12.932 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_getxattr": 0, 2024-05-08T06:07:12.932 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_setxattr": 20, 2024-05-08T06:07:12.932 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_cmpxattr": 0, 2024-05-08T06:07:12.932 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_rmxattr": 0, 2024-05-08T06:07:12.932 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_resetxattrs": 0, 2024-05-08T06:07:12.932 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_call": 0, 2024-05-08T06:07:12.932 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_watch": 0, 2024-05-08T06:07:12.932 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_notify": 0, 2024-05-08T06:07:12.932 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_src_cmpxattr": 0, 2024-05-08T06:07:12.932 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_pgls": 0, 2024-05-08T06:07:12.932 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_pgls_filter": 0, 2024-05-08T06:07:12.932 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_other": 0, 2024-05-08T06:07:12.932 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_active": 0, 2024-05-08T06:07:12.932 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_send": 0, 2024-05-08T06:07:12.933 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_resend": 0, 2024-05-08T06:07:12.933 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_ping": 0, 2024-05-08T06:07:12.933 INFO:teuthology.orchestra.run.smithi134.stdout: "poolop_active": 0, 2024-05-08T06:07:12.933 INFO:teuthology.orchestra.run.smithi134.stdout: "poolop_send": 0, 2024-05-08T06:07:12.933 INFO:teuthology.orchestra.run.smithi134.stdout: "poolop_resend": 0, 2024-05-08T06:07:12.933 INFO:teuthology.orchestra.run.smithi134.stdout: "poolstat_active": 0, 2024-05-08T06:07:12.933 INFO:teuthology.orchestra.run.smithi134.stdout: "poolstat_send": 0, 2024-05-08T06:07:12.933 INFO:teuthology.orchestra.run.smithi134.stdout: "poolstat_resend": 0, 2024-05-08T06:07:12.933 INFO:teuthology.orchestra.run.smithi134.stdout: "statfs_active": 0, 2024-05-08T06:07:12.933 INFO:teuthology.orchestra.run.smithi134.stdout: "statfs_send": 0, 2024-05-08T06:07:12.933 INFO:teuthology.orchestra.run.smithi134.stdout: "statfs_resend": 0, 2024-05-08T06:07:12.933 INFO:teuthology.orchestra.run.smithi134.stdout: "command_active": 0, 2024-05-08T06:07:12.933 INFO:teuthology.orchestra.run.smithi134.stdout: "command_send": 0, 2024-05-08T06:07:12.933 INFO:teuthology.orchestra.run.smithi134.stdout: "command_resend": 0, 2024-05-08T06:07:12.933 INFO:teuthology.orchestra.run.smithi134.stdout: "map_epoch": 82, 2024-05-08T06:07:12.934 INFO:teuthology.orchestra.run.smithi134.stdout: "map_full": 0, 2024-05-08T06:07:12.934 INFO:teuthology.orchestra.run.smithi134.stdout: "map_inc": 2, 2024-05-08T06:07:12.934 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_sessions": 9, 2024-05-08T06:07:12.934 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_session_open": 12, 2024-05-08T06:07:12.934 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_session_close": 3, 2024-05-08T06:07:12.934 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_laggy": 0, 2024-05-08T06:07:12.934 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_wr": 14, 2024-05-08T06:07:12.934 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_rd": 0, 2024-05-08T06:07:12.934 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_del": 1 2024-05-08T06:07:12.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.934 INFO:teuthology.orchestra.run.smithi134.stdout: "oft": { 2024-05-08T06:07:12.934 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_objs": 1, 2024-05-08T06:07:12.934 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_kv_pairs": 0, 2024-05-08T06:07:12.934 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_updates": 0, 2024-05-08T06:07:12.934 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_removes": 0 2024-05-08T06:07:12.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.935 INFO:teuthology.orchestra.run.smithi134.stdout: "osd-slow-ops": { 2024-05-08T06:07:12.935 INFO:teuthology.orchestra.run.smithi134.stdout: "slow_ops_count": 0 2024-05-08T06:07:12.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.935 INFO:teuthology.orchestra.run.smithi134.stdout: "purge_queue": { 2024-05-08T06:07:12.935 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing_ops": 0, 2024-05-08T06:07:12.935 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing_ops_high_water": 0, 2024-05-08T06:07:12.935 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing": 0, 2024-05-08T06:07:12.935 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing_high_water": 0, 2024-05-08T06:07:12.935 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executed_ops": 0, 2024-05-08T06:07:12.935 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executed": 0, 2024-05-08T06:07:12.935 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_item_in_journal": 0 2024-05-08T06:07:12.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.935 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T06:07:12.935 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-05-08T06:07:12.935 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 104857600, 2024-05-08T06:07:12.936 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-05-08T06:07:12.936 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 882, 2024-05-08T06:07:12.936 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 915304, 2024-05-08T06:07:12.936 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-05-08T06:07:12.936 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 882, 2024-05-08T06:07:12.936 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-05-08T06:07:12.936 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-05-08T06:07:12.936 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 882, 2024-05-08T06:07:12.936 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 915304, 2024-05-08T06:07:12.936 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-05-08T06:07:12.936 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:12.936 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:12.936 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:12.936 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-05-08T06:07:12.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.937 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-objecter_bytes": { 2024-05-08T06:07:12.937 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-05-08T06:07:12.937 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 104857600, 2024-05-08T06:07:12.937 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-05-08T06:07:12.937 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 0, 2024-05-08T06:07:12.937 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 0, 2024-05-08T06:07:12.937 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-05-08T06:07:12.937 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 0, 2024-05-08T06:07:12.937 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 37, 2024-05-08T06:07:12.937 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 11110, 2024-05-08T06:07:12.937 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 37, 2024-05-08T06:07:12.937 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 11110, 2024-05-08T06:07:12.937 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-05-08T06:07:12.937 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:12.937 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:12.938 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:12.938 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-05-08T06:07:12.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.938 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-objecter_ops": { 2024-05-08T06:07:12.938 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-05-08T06:07:12.938 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 1024, 2024-05-08T06:07:12.938 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-05-08T06:07:12.938 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 0, 2024-05-08T06:07:12.938 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 0, 2024-05-08T06:07:12.938 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-05-08T06:07:12.938 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 0, 2024-05-08T06:07:12.938 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 37, 2024-05-08T06:07:12.938 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 37, 2024-05-08T06:07:12.938 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 37, 2024-05-08T06:07:12.938 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 37, 2024-05-08T06:07:12.939 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-05-08T06:07:12.939 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:12.939 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:12.939 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:12.939 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-05-08T06:07:12.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.939 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-write_buf_throttle": { 2024-05-08T06:07:12.939 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-05-08T06:07:12.939 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 3758096384, 2024-05-08T06:07:12.939 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-05-08T06:07:12.939 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 0, 2024-05-08T06:07:12.939 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 0, 2024-05-08T06:07:12.939 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-05-08T06:07:12.939 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 0, 2024-05-08T06:07:12.939 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-05-08T06:07:12.939 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-05-08T06:07:12.940 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 0, 2024-05-08T06:07:12.940 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 0, 2024-05-08T06:07:12.940 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-05-08T06:07:12.940 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:12.940 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:12.940 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:12.940 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-05-08T06:07:12.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:12.940 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-write_buf_throttle-0x55834a01c500": { 2024-05-08T06:07:12.940 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-05-08T06:07:12.940 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 3758096384, 2024-05-08T06:07:12.940 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-05-08T06:07:12.940 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 3, 2024-05-08T06:07:12.940 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 898, 2024-05-08T06:07:12.940 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-05-08T06:07:12.941 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 3, 2024-05-08T06:07:12.941 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-05-08T06:07:12.941 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-05-08T06:07:12.941 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 2, 2024-05-08T06:07:12.941 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 898, 2024-05-08T06:07:12.941 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-05-08T06:07:12.941 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:12.941 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:12.941 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:12.941 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-05-08T06:07:12.941 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-05-08T06:07:12.941 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-05-08T06:07:13.672 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-05-08T06:07:13.672 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-05-08T06:07:13.672 DEBUG:tasks.check_counter:Getting stats from k 2024-05-08T06:07:13.672 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph daemon mds.k perf dump 2024-05-08T06:07:13.912 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.b/config 2024-05-08T06:07:14.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:13 smithi134 ceph-mon[34132]: pgmap v956: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 16 KiB/s wr, 10 op/s 2024-05-08T06:07:14.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:13 smithi151 ceph-mon[34815]: pgmap v956: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 16 KiB/s wr, 10 op/s 2024-05-08T06:07:14.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:13 smithi082 ceph-mon[30098]: pgmap v956: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 16 KiB/s wr, 10 op/s 2024-05-08T06:07:15.686 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-05-08T06:07:15.686 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T06:07:15.686 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 1254, 2024-05-08T06:07:15.686 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 1254, 2024-05-08T06:07:15.686 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 332203, 2024-05-08T06:07:15.686 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 398012, 2024-05-08T06:07:15.686 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 7, 2024-05-08T06:07:15.686 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 2, 2024-05-08T06:07:15.687 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.102166170, 2024-05-08T06:07:15.687 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.037462937, 2024-05-08T06:07:15.687 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.024713082, 2024-05-08T06:07:15.687 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.030411248, 2024-05-08T06:07:15.687 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T06:07:15.687 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 1253, 2024-05-08T06:07:15.687 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.045965799, 2024-05-08T06:07:15.687 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000036684 2024-05-08T06:07:15.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.687 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-05-08T06:07:15.687 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:15.687 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:15.687 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:15.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.688 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-05-08T06:07:15.688 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 448 2024-05-08T06:07:15.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.688 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T06:07:15.688 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 1020, 2024-05-08T06:07:15.688 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 1290, 2024-05-08T06:07:15.688 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 250856, 2024-05-08T06:07:15.688 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 866815, 2024-05-08T06:07:15.688 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 5, 2024-05-08T06:07:15.688 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 4, 2024-05-08T06:07:15.688 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.096876619, 2024-05-08T06:07:15.688 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.030704171, 2024-05-08T06:07:15.688 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.019348543, 2024-05-08T06:07:15.689 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.034410772, 2024-05-08T06:07:15.689 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T06:07:15.689 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 1288, 2024-05-08T06:07:15.689 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.060042762, 2024-05-08T06:07:15.689 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000046617 2024-05-08T06:07:15.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.689 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-05-08T06:07:15.689 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:15.689 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:15.689 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:15.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.689 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-08T06:07:15.689 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 542768 2024-05-08T06:07:15.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.690 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T06:07:15.690 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 1615, 2024-05-08T06:07:15.690 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 1606, 2024-05-08T06:07:15.690 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 1314544, 2024-05-08T06:07:15.690 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 616552, 2024-05-08T06:07:15.690 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 3, 2024-05-08T06:07:15.690 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 2, 2024-05-08T06:07:15.690 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.183157718, 2024-05-08T06:07:15.690 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.056885658, 2024-05-08T06:07:15.690 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.061095943, 2024-05-08T06:07:15.690 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.055191537, 2024-05-08T06:07:15.690 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T06:07:15.690 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 1605, 2024-05-08T06:07:15.691 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.091773064, 2024-05-08T06:07:15.691 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000057179 2024-05-08T06:07:15.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.691 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-05-08T06:07:15.691 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:15.691 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:15.691 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:15.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.691 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 896560, 2024-05-08T06:07:15.691 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 220960 2024-05-08T06:07:15.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.691 INFO:teuthology.orchestra.run.smithi134.stdout: "cct": { 2024-05-08T06:07:15.691 INFO:teuthology.orchestra.run.smithi134.stdout: "total_workers": 1, 2024-05-08T06:07:15.691 INFO:teuthology.orchestra.run.smithi134.stdout: "unhealthy_workers": 0 2024-05-08T06:07:15.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.691 INFO:teuthology.orchestra.run.smithi134.stdout: "finisher-MDSRank": { 2024-05-08T06:07:15.692 INFO:teuthology.orchestra.run.smithi134.stdout: "queue_len": 0, 2024-05-08T06:07:15.692 INFO:teuthology.orchestra.run.smithi134.stdout: "complete_latency": { 2024-05-08T06:07:15.692 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 5987, 2024-05-08T06:07:15.692 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.165971089, 2024-05-08T06:07:15.692 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000027721 2024-05-08T06:07:15.692 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-05-08T06:07:15.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.692 INFO:teuthology.orchestra.run.smithi134.stdout: "finisher-PurgeQueue": { 2024-05-08T06:07:15.692 INFO:teuthology.orchestra.run.smithi134.stdout: "queue_len": 0, 2024-05-08T06:07:15.692 INFO:teuthology.orchestra.run.smithi134.stdout: "complete_latency": { 2024-05-08T06:07:15.692 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:15.692 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:15.692 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:15.692 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-05-08T06:07:15.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.693 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-05-08T06:07:15.693 INFO:teuthology.orchestra.run.smithi134.stdout: "request": 0, 2024-05-08T06:07:15.693 INFO:teuthology.orchestra.run.smithi134.stdout: "reply": 0, 2024-05-08T06:07:15.693 INFO:teuthology.orchestra.run.smithi134.stdout: "reply_latency": { 2024-05-08T06:07:15.693 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:15.693 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:15.693 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:15.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.693 INFO:teuthology.orchestra.run.smithi134.stdout: "slow_reply": 0, 2024-05-08T06:07:15.693 INFO:teuthology.orchestra.run.smithi134.stdout: "forward": 0, 2024-05-08T06:07:15.693 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_fetch_complete": 0, 2024-05-08T06:07:15.693 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_fetch_keys": 0, 2024-05-08T06:07:15.693 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_commit": 0, 2024-05-08T06:07:15.693 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_split": 0, 2024-05-08T06:07:15.694 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_merge": 0, 2024-05-08T06:07:15.694 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes": 0, 2024-05-08T06:07:15.694 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_top": 0, 2024-05-08T06:07:15.694 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_bottom": 0, 2024-05-08T06:07:15.694 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_pin_tail": 0, 2024-05-08T06:07:15.694 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_pinned": 0, 2024-05-08T06:07:15.694 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_expired": 0, 2024-05-08T06:07:15.694 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_with_caps": 0, 2024-05-08T06:07:15.694 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": 0, 2024-05-08T06:07:15.694 INFO:teuthology.orchestra.run.smithi134.stdout: "subtrees": 1, 2024-05-08T06:07:15.694 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse": 0, 2024-05-08T06:07:15.694 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_hit": 0, 2024-05-08T06:07:15.694 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_forward": 0, 2024-05-08T06:07:15.695 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_discover": 0, 2024-05-08T06:07:15.695 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_dir_fetch": 0, 2024-05-08T06:07:15.695 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_remote_ino": 0, 2024-05-08T06:07:15.695 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_lock": 0, 2024-05-08T06:07:15.695 INFO:teuthology.orchestra.run.smithi134.stdout: "load_cent": 0, 2024-05-08T06:07:15.695 INFO:teuthology.orchestra.run.smithi134.stdout: "q": 0, 2024-05-08T06:07:15.695 INFO:teuthology.orchestra.run.smithi134.stdout: "exported": 0, 2024-05-08T06:07:15.695 INFO:teuthology.orchestra.run.smithi134.stdout: "exported_inodes": 0, 2024-05-08T06:07:15.695 INFO:teuthology.orchestra.run.smithi134.stdout: "imported": 0, 2024-05-08T06:07:15.695 INFO:teuthology.orchestra.run.smithi134.stdout: "imported_inodes": 0, 2024-05-08T06:07:15.695 INFO:teuthology.orchestra.run.smithi134.stdout: "openino_dir_fetch": 0, 2024-05-08T06:07:15.695 INFO:teuthology.orchestra.run.smithi134.stdout: "openino_backtrace_fetch": 0, 2024-05-08T06:07:15.695 INFO:teuthology.orchestra.run.smithi134.stdout: "openino_peer_discover": 0, 2024-05-08T06:07:15.695 INFO:teuthology.orchestra.run.smithi134.stdout: "root_rfiles": 0, 2024-05-08T06:07:15.696 INFO:teuthology.orchestra.run.smithi134.stdout: "root_rbytes": 0, 2024-05-08T06:07:15.696 INFO:teuthology.orchestra.run.smithi134.stdout: "root_rsnaps": 0, 2024-05-08T06:07:15.696 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_backtrace_fetch": 0, 2024-05-08T06:07:15.696 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_set_tag": 0, 2024-05-08T06:07:15.696 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_backtrace_repaired": 0, 2024-05-08T06:07:15.696 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_inotable_repaired": 0, 2024-05-08T06:07:15.696 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_dir_inodes": 0, 2024-05-08T06:07:15.696 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_dir_base_inodes": 0, 2024-05-08T06:07:15.696 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_dirfrag_rstats": 0, 2024-05-08T06:07:15.696 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_file_inodes": 0, 2024-05-08T06:07:15.696 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_inode_file_caps": 0, 2024-05-08T06:07:15.696 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_revoke": 0, 2024-05-08T06:07:15.696 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_grant": 0, 2024-05-08T06:07:15.696 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_trunc": 0, 2024-05-08T06:07:15.696 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-08T06:07:15.697 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-08T06:07:15.697 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_caps": 0, 2024-05-08T06:07:15.697 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_caps_dirty": 0, 2024-05-08T06:07:15.697 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_cap_release": 0, 2024-05-08T06:07:15.697 INFO:teuthology.orchestra.run.smithi134.stdout: "process_request_cap_release": 0 2024-05-08T06:07:15.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.697 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_cache": { 2024-05-08T06:07:15.697 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_update": 0, 2024-05-08T06:07:15.697 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_update_receipt": 0, 2024-05-08T06:07:15.697 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_try_discover": 0, 2024-05-08T06:07:15.697 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_send_discover": 0, 2024-05-08T06:07:15.697 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_handle_discover": 0, 2024-05-08T06:07:15.697 INFO:teuthology.orchestra.run.smithi134.stdout: "num_strays": 0, 2024-05-08T06:07:15.697 INFO:teuthology.orchestra.run.smithi134.stdout: "num_strays_delayed": 0, 2024-05-08T06:07:15.697 INFO:teuthology.orchestra.run.smithi134.stdout: "num_strays_enqueuing": 0, 2024-05-08T06:07:15.697 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_created": 0, 2024-05-08T06:07:15.698 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_enqueued": 0, 2024-05-08T06:07:15.698 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_reintegrated": 0, 2024-05-08T06:07:15.698 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_migrated": 0, 2024-05-08T06:07:15.698 INFO:teuthology.orchestra.run.smithi134.stdout: "num_recovering_processing": 0, 2024-05-08T06:07:15.698 INFO:teuthology.orchestra.run.smithi134.stdout: "num_recovering_enqueued": 0, 2024-05-08T06:07:15.698 INFO:teuthology.orchestra.run.smithi134.stdout: "num_recovering_prioritized": 0, 2024-05-08T06:07:15.698 INFO:teuthology.orchestra.run.smithi134.stdout: "recovery_started": 0, 2024-05-08T06:07:15.698 INFO:teuthology.orchestra.run.smithi134.stdout: "recovery_completed": 0, 2024-05-08T06:07:15.698 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_quiesce_path": 0, 2024-05-08T06:07:15.698 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_quiesce_inode": 0, 2024-05-08T06:07:15.698 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_enqueue_scrub": 0, 2024-05-08T06:07:15.698 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_exportdir": 0, 2024-05-08T06:07:15.698 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_flush": 0, 2024-05-08T06:07:15.698 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_fragmentdir": 0, 2024-05-08T06:07:15.698 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_fragstats": 0, 2024-05-08T06:07:15.699 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_inodestats": 0 2024-05-08T06:07:15.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.699 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_log": { 2024-05-08T06:07:15.699 INFO:teuthology.orchestra.run.smithi134.stdout: "evlrg": 0, 2024-05-08T06:07:15.699 INFO:teuthology.orchestra.run.smithi134.stdout: "evadd": 0, 2024-05-08T06:07:15.699 INFO:teuthology.orchestra.run.smithi134.stdout: "evex": 0, 2024-05-08T06:07:15.699 INFO:teuthology.orchestra.run.smithi134.stdout: "evtrm": 0, 2024-05-08T06:07:15.699 INFO:teuthology.orchestra.run.smithi134.stdout: "ev": 4, 2024-05-08T06:07:15.699 INFO:teuthology.orchestra.run.smithi134.stdout: "evexg": 0, 2024-05-08T06:07:15.699 INFO:teuthology.orchestra.run.smithi134.stdout: "evexd": 0, 2024-05-08T06:07:15.699 INFO:teuthology.orchestra.run.smithi134.stdout: "segadd": 0, 2024-05-08T06:07:15.699 INFO:teuthology.orchestra.run.smithi134.stdout: "segex": 0, 2024-05-08T06:07:15.699 INFO:teuthology.orchestra.run.smithi134.stdout: "segtrm": 0, 2024-05-08T06:07:15.699 INFO:teuthology.orchestra.run.smithi134.stdout: "seg": 2, 2024-05-08T06:07:15.699 INFO:teuthology.orchestra.run.smithi134.stdout: "segmjr": 2, 2024-05-08T06:07:15.700 INFO:teuthology.orchestra.run.smithi134.stdout: "segexg": 0, 2024-05-08T06:07:15.700 INFO:teuthology.orchestra.run.smithi134.stdout: "segexd": 0, 2024-05-08T06:07:15.700 INFO:teuthology.orchestra.run.smithi134.stdout: "expos": 4194304, 2024-05-08T06:07:15.700 INFO:teuthology.orchestra.run.smithi134.stdout: "wrpos": 4195424, 2024-05-08T06:07:15.700 INFO:teuthology.orchestra.run.smithi134.stdout: "rdpos": 4195283, 2024-05-08T06:07:15.700 INFO:teuthology.orchestra.run.smithi134.stdout: "jlat": { 2024-05-08T06:07:15.700 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:15.700 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:15.700 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:15.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.700 INFO:teuthology.orchestra.run.smithi134.stdout: "replayed": 4 2024-05-08T06:07:15.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.700 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_mem": { 2024-05-08T06:07:15.700 INFO:teuthology.orchestra.run.smithi134.stdout: "ino": 3, 2024-05-08T06:07:15.700 INFO:teuthology.orchestra.run.smithi134.stdout: "ino+": 3, 2024-05-08T06:07:15.701 INFO:teuthology.orchestra.run.smithi134.stdout: "ino-": 0, 2024-05-08T06:07:15.701 INFO:teuthology.orchestra.run.smithi134.stdout: "dir": 1, 2024-05-08T06:07:15.701 INFO:teuthology.orchestra.run.smithi134.stdout: "dir+": 1, 2024-05-08T06:07:15.701 INFO:teuthology.orchestra.run.smithi134.stdout: "dir-": 0, 2024-05-08T06:07:15.701 INFO:teuthology.orchestra.run.smithi134.stdout: "dn": 0, 2024-05-08T06:07:15.701 INFO:teuthology.orchestra.run.smithi134.stdout: "dn+": 0, 2024-05-08T06:07:15.701 INFO:teuthology.orchestra.run.smithi134.stdout: "dn-": 0, 2024-05-08T06:07:15.701 INFO:teuthology.orchestra.run.smithi134.stdout: "cap": 0, 2024-05-08T06:07:15.701 INFO:teuthology.orchestra.run.smithi134.stdout: "cap+": 0, 2024-05-08T06:07:15.701 INFO:teuthology.orchestra.run.smithi134.stdout: "cap-": 0, 2024-05-08T06:07:15.701 INFO:teuthology.orchestra.run.smithi134.stdout: "rss": 49812, 2024-05-08T06:07:15.701 INFO:teuthology.orchestra.run.smithi134.stdout: "heap": 215416 2024-05-08T06:07:15.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.701 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_server": { 2024-05-08T06:07:15.701 INFO:teuthology.orchestra.run.smithi134.stdout: "dispatch_client_request": 0, 2024-05-08T06:07:15.702 INFO:teuthology.orchestra.run.smithi134.stdout: "dispatch_server_request": 0, 2024-05-08T06:07:15.702 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_request": 0, 2024-05-08T06:07:15.702 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_session": 0, 2024-05-08T06:07:15.702 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_peer_request": 0, 2024-05-08T06:07:15.702 INFO:teuthology.orchestra.run.smithi134.stdout: "req_create_latency": { 2024-05-08T06:07:15.702 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:15.702 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:15.702 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:15.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.702 INFO:teuthology.orchestra.run.smithi134.stdout: "req_getattr_latency": { 2024-05-08T06:07:15.702 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:15.702 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:15.702 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:15.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.702 INFO:teuthology.orchestra.run.smithi134.stdout: "req_getfilelock_latency": { 2024-05-08T06:07:15.703 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:15.703 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:15.703 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:15.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.703 INFO:teuthology.orchestra.run.smithi134.stdout: "req_link_latency": { 2024-05-08T06:07:15.703 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:15.703 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:15.703 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:15.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.703 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookup_latency": { 2024-05-08T06:07:15.703 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:15.703 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:15.703 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:15.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.703 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookuphash_latency": { 2024-05-08T06:07:15.703 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:15.704 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:15.704 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:15.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.704 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupino_latency": { 2024-05-08T06:07:15.704 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:15.704 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:15.704 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:15.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.704 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupname_latency": { 2024-05-08T06:07:15.704 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:15.704 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:15.704 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:15.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.704 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupparent_latency": { 2024-05-08T06:07:15.704 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:15.705 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:15.705 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:15.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.705 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupsnap_latency": { 2024-05-08T06:07:15.705 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:15.705 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:15.705 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:15.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.705 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lssnap_latency": { 2024-05-08T06:07:15.705 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:15.705 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:15.705 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:15.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.705 INFO:teuthology.orchestra.run.smithi134.stdout: "req_mkdir_latency": { 2024-05-08T06:07:15.705 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:15.706 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:15.706 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:15.706 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.706 INFO:teuthology.orchestra.run.smithi134.stdout: "req_mknod_latency": { 2024-05-08T06:07:15.706 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:15.706 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:15.706 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:15.706 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.706 INFO:teuthology.orchestra.run.smithi134.stdout: "req_mksnap_latency": { 2024-05-08T06:07:15.707 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:15.707 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:15.707 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:15.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.707 INFO:teuthology.orchestra.run.smithi134.stdout: "req_open_latency": { 2024-05-08T06:07:15.707 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:15.707 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:15.707 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:15.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.707 INFO:teuthology.orchestra.run.smithi134.stdout: "req_readdir_latency": { 2024-05-08T06:07:15.707 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:15.707 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:15.707 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:15.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.707 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rename_latency": { 2024-05-08T06:07:15.707 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:15.708 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:15.708 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:15.708 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.708 INFO:teuthology.orchestra.run.smithi134.stdout: "req_renamesnap_latency": { 2024-05-08T06:07:15.708 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:15.708 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:15.708 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:15.708 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.708 INFO:teuthology.orchestra.run.smithi134.stdout: "req_snapdiff_latency": { 2024-05-08T06:07:15.708 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:15.708 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:15.708 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:15.708 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.708 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rmdir_latency": { 2024-05-08T06:07:15.708 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:15.709 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:15.709 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:15.709 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.709 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rmsnap_latency": { 2024-05-08T06:07:15.709 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:15.709 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:15.709 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:15.709 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.709 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rmxattr_latency": { 2024-05-08T06:07:15.709 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:15.709 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:15.709 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:15.709 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.709 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setattr_latency": { 2024-05-08T06:07:15.709 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:15.709 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:15.710 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:15.710 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.710 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setdirlayout_latency": { 2024-05-08T06:07:15.710 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:15.710 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:15.710 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:15.710 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.710 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setfilelock_latency": { 2024-05-08T06:07:15.710 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:15.710 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:15.710 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:15.710 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.710 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setlayout_latency": { 2024-05-08T06:07:15.710 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:15.711 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:15.711 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:15.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.711 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setxattr_latency": { 2024-05-08T06:07:15.711 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:15.711 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:15.711 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:15.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.711 INFO:teuthology.orchestra.run.smithi134.stdout: "req_symlink_latency": { 2024-05-08T06:07:15.711 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:15.711 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:15.711 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:15.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.711 INFO:teuthology.orchestra.run.smithi134.stdout: "req_unlink_latency": { 2024-05-08T06:07:15.712 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:15.712 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:15.712 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:15.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.712 INFO:teuthology.orchestra.run.smithi134.stdout: "cap_revoke_eviction": 0, 2024-05-08T06:07:15.712 INFO:teuthology.orchestra.run.smithi134.stdout: "cap_acquisition_throttle": 0, 2024-05-08T06:07:15.712 INFO:teuthology.orchestra.run.smithi134.stdout: "req_getvxattr_latency": { 2024-05-08T06:07:15.712 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:15.712 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:15.712 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:15.712 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-05-08T06:07:15.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.712 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_sessions": { 2024-05-08T06:07:15.712 INFO:teuthology.orchestra.run.smithi134.stdout: "session_count": 0, 2024-05-08T06:07:15.713 INFO:teuthology.orchestra.run.smithi134.stdout: "session_add": 1, 2024-05-08T06:07:15.713 INFO:teuthology.orchestra.run.smithi134.stdout: "session_remove": 1, 2024-05-08T06:07:15.713 INFO:teuthology.orchestra.run.smithi134.stdout: "sessions_open": 1, 2024-05-08T06:07:15.713 INFO:teuthology.orchestra.run.smithi134.stdout: "sessions_stale": 0, 2024-05-08T06:07:15.713 INFO:teuthology.orchestra.run.smithi134.stdout: "total_load": 0, 2024-05-08T06:07:15.713 INFO:teuthology.orchestra.run.smithi134.stdout: "average_load": 0, 2024-05-08T06:07:15.713 INFO:teuthology.orchestra.run.smithi134.stdout: "avg_session_uptime": 1732, 2024-05-08T06:07:15.713 INFO:teuthology.orchestra.run.smithi134.stdout: "mdthresh_evicted": 0 2024-05-08T06:07:15.713 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.713 INFO:teuthology.orchestra.run.smithi134.stdout: "mempool": { 2024-05-08T06:07:15.713 INFO:teuthology.orchestra.run.smithi134.stdout: "bloom_filter_bytes": 0, 2024-05-08T06:07:15.713 INFO:teuthology.orchestra.run.smithi134.stdout: "bloom_filter_items": 0, 2024-05-08T06:07:15.713 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T06:07:15.714 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_alloc_items": 0, 2024-05-08T06:07:15.714 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T06:07:15.714 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_data_items": 0, 2024-05-08T06:07:15.714 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T06:07:15.714 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T06:07:15.714 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T06:07:15.714 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T06:07:15.714 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T06:07:15.714 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_other_items": 0, 2024-05-08T06:07:15.714 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T06:07:15.714 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T06:07:15.714 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_bytes": 0, 2024-05-08T06:07:15.714 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_items": 0, 2024-05-08T06:07:15.715 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_blob_bytes": 0, 2024-05-08T06:07:15.715 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_blob_items": 0, 2024-05-08T06:07:15.715 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T06:07:15.715 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T06:07:15.715 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T06:07:15.715 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T06:07:15.715 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T06:07:15.715 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_items": 0, 2024-05-08T06:07:15.715 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_txc_bytes": 0, 2024-05-08T06:07:15.715 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_txc_items": 0, 2024-05-08T06:07:15.715 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T06:07:15.715 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T06:07:15.715 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_bytes": 0, 2024-05-08T06:07:15.715 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_items": 0, 2024-05-08T06:07:15.716 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_bytes": 0, 2024-05-08T06:07:15.716 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_items": 0, 2024-05-08T06:07:15.716 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T06:07:15.716 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_reader_items": 0, 2024-05-08T06:07:15.716 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T06:07:15.716 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_writer_items": 0, 2024-05-08T06:07:15.716 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_anon_bytes": 190929, 2024-05-08T06:07:15.716 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_anon_items": 54, 2024-05-08T06:07:15.716 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_meta_bytes": 0, 2024-05-08T06:07:15.716 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_meta_items": 0, 2024-05-08T06:07:15.716 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_bytes": 0, 2024-05-08T06:07:15.716 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_items": 0, 2024-05-08T06:07:15.716 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mapbl_bytes": 0, 2024-05-08T06:07:15.716 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mapbl_items": 0, 2024-05-08T06:07:15.717 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pglog_bytes": 0, 2024-05-08T06:07:15.717 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pglog_items": 0, 2024-05-08T06:07:15.717 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_bytes": 7528, 2024-05-08T06:07:15.717 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_items": 158, 2024-05-08T06:07:15.717 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T06:07:15.717 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_mapping_items": 0, 2024-05-08T06:07:15.717 INFO:teuthology.orchestra.run.smithi134.stdout: "pgmap_bytes": 0, 2024-05-08T06:07:15.717 INFO:teuthology.orchestra.run.smithi134.stdout: "pgmap_items": 0, 2024-05-08T06:07:15.717 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_co_bytes": 8512, 2024-05-08T06:07:15.717 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_co_items": 13, 2024-05-08T06:07:15.717 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_1_bytes": 0, 2024-05-08T06:07:15.718 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_1_items": 0, 2024-05-08T06:07:15.718 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_2_bytes": 0, 2024-05-08T06:07:15.718 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_2_items": 0 2024-05-08T06:07:15.718 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.718 INFO:teuthology.orchestra.run.smithi134.stdout: "objecter": { 2024-05-08T06:07:15.718 INFO:teuthology.orchestra.run.smithi134.stdout: "op_active": 0, 2024-05-08T06:07:15.718 INFO:teuthology.orchestra.run.smithi134.stdout: "op_laggy": 0, 2024-05-08T06:07:15.718 INFO:teuthology.orchestra.run.smithi134.stdout: "op_send": 3513, 2024-05-08T06:07:15.718 INFO:teuthology.orchestra.run.smithi134.stdout: "op_send_bytes": 21, 2024-05-08T06:07:15.718 INFO:teuthology.orchestra.run.smithi134.stdout: "op_resend": 3, 2024-05-08T06:07:15.718 INFO:teuthology.orchestra.run.smithi134.stdout: "op_reply": 3513, 2024-05-08T06:07:15.718 INFO:teuthology.orchestra.run.smithi134.stdout: "op_latency": { 2024-05-08T06:07:15.718 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 3513, 2024-05-08T06:07:15.719 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 14.963667308, 2024-05-08T06:07:15.719 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.004259512 2024-05-08T06:07:15.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.719 INFO:teuthology.orchestra.run.smithi134.stdout: "op_inflight": 0, 2024-05-08T06:07:15.719 INFO:teuthology.orchestra.run.smithi134.stdout: "oplen_avg": { 2024-05-08T06:07:15.719 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 3513, 2024-05-08T06:07:15.719 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 3514 2024-05-08T06:07:15.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.719 INFO:teuthology.orchestra.run.smithi134.stdout: "op": 3513, 2024-05-08T06:07:15.719 INFO:teuthology.orchestra.run.smithi134.stdout: "op_r": 3513, 2024-05-08T06:07:15.719 INFO:teuthology.orchestra.run.smithi134.stdout: "op_w": 0, 2024-05-08T06:07:15.719 INFO:teuthology.orchestra.run.smithi134.stdout: "op_rmw": 0, 2024-05-08T06:07:15.719 INFO:teuthology.orchestra.run.smithi134.stdout: "op_pg": 0, 2024-05-08T06:07:15.719 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_stat": 2261, 2024-05-08T06:07:15.720 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_create": 0, 2024-05-08T06:07:15.720 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_read": 1250, 2024-05-08T06:07:15.720 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_write": 0, 2024-05-08T06:07:15.720 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_writefull": 0, 2024-05-08T06:07:15.720 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_writesame": 0, 2024-05-08T06:07:15.720 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_append": 0, 2024-05-08T06:07:15.720 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_zero": 0, 2024-05-08T06:07:15.720 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_truncate": 0, 2024-05-08T06:07:15.720 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_delete": 0, 2024-05-08T06:07:15.720 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_mapext": 0, 2024-05-08T06:07:15.720 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_sparse_read": 0, 2024-05-08T06:07:15.720 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_clonerange": 0, 2024-05-08T06:07:15.720 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_getxattr": 1, 2024-05-08T06:07:15.720 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_setxattr": 0, 2024-05-08T06:07:15.721 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_cmpxattr": 0, 2024-05-08T06:07:15.721 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_rmxattr": 0, 2024-05-08T06:07:15.721 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_resetxattrs": 0, 2024-05-08T06:07:15.721 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_call": 0, 2024-05-08T06:07:15.721 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_watch": 0, 2024-05-08T06:07:15.721 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_notify": 0, 2024-05-08T06:07:15.721 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_src_cmpxattr": 0, 2024-05-08T06:07:15.721 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_pgls": 0, 2024-05-08T06:07:15.721 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_pgls_filter": 0, 2024-05-08T06:07:15.721 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_other": 0, 2024-05-08T06:07:15.721 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_active": 0, 2024-05-08T06:07:15.721 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_send": 0, 2024-05-08T06:07:15.721 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_resend": 0, 2024-05-08T06:07:15.721 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_ping": 0, 2024-05-08T06:07:15.722 INFO:teuthology.orchestra.run.smithi134.stdout: "poolop_active": 0, 2024-05-08T06:07:15.722 INFO:teuthology.orchestra.run.smithi134.stdout: "poolop_send": 0, 2024-05-08T06:07:15.722 INFO:teuthology.orchestra.run.smithi134.stdout: "poolop_resend": 0, 2024-05-08T06:07:15.722 INFO:teuthology.orchestra.run.smithi134.stdout: "poolstat_active": 0, 2024-05-08T06:07:15.722 INFO:teuthology.orchestra.run.smithi134.stdout: "poolstat_send": 0, 2024-05-08T06:07:15.722 INFO:teuthology.orchestra.run.smithi134.stdout: "poolstat_resend": 0, 2024-05-08T06:07:15.722 INFO:teuthology.orchestra.run.smithi134.stdout: "statfs_active": 0, 2024-05-08T06:07:15.722 INFO:teuthology.orchestra.run.smithi134.stdout: "statfs_send": 0, 2024-05-08T06:07:15.722 INFO:teuthology.orchestra.run.smithi134.stdout: "statfs_resend": 0, 2024-05-08T06:07:15.722 INFO:teuthology.orchestra.run.smithi134.stdout: "command_active": 0, 2024-05-08T06:07:15.722 INFO:teuthology.orchestra.run.smithi134.stdout: "command_send": 0, 2024-05-08T06:07:15.722 INFO:teuthology.orchestra.run.smithi134.stdout: "command_resend": 0, 2024-05-08T06:07:15.722 INFO:teuthology.orchestra.run.smithi134.stdout: "map_epoch": 82, 2024-05-08T06:07:15.723 INFO:teuthology.orchestra.run.smithi134.stdout: "map_full": 0, 2024-05-08T06:07:15.723 INFO:teuthology.orchestra.run.smithi134.stdout: "map_inc": 2, 2024-05-08T06:07:15.723 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_sessions": 5, 2024-05-08T06:07:15.723 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_session_open": 6, 2024-05-08T06:07:15.723 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_session_close": 1, 2024-05-08T06:07:15.723 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_laggy": 0, 2024-05-08T06:07:15.723 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_wr": 0, 2024-05-08T06:07:15.723 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_rd": 2, 2024-05-08T06:07:15.723 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_del": 0 2024-05-08T06:07:15.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.723 INFO:teuthology.orchestra.run.smithi134.stdout: "oft": { 2024-05-08T06:07:15.723 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_objs": 0, 2024-05-08T06:07:15.723 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_kv_pairs": 0, 2024-05-08T06:07:15.723 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_updates": 0, 2024-05-08T06:07:15.724 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_removes": 0 2024-05-08T06:07:15.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.724 INFO:teuthology.orchestra.run.smithi134.stdout: "osd-slow-ops": { 2024-05-08T06:07:15.724 INFO:teuthology.orchestra.run.smithi134.stdout: "slow_ops_count": 0 2024-05-08T06:07:15.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.724 INFO:teuthology.orchestra.run.smithi134.stdout: "purge_queue": { 2024-05-08T06:07:15.724 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing_ops": 0, 2024-05-08T06:07:15.724 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing_ops_high_water": 0, 2024-05-08T06:07:15.724 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing": 0, 2024-05-08T06:07:15.724 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing_high_water": 0, 2024-05-08T06:07:15.724 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executed_ops": 0, 2024-05-08T06:07:15.724 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executed": 0, 2024-05-08T06:07:15.724 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_item_in_journal": 0 2024-05-08T06:07:15.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.725 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T06:07:15.725 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-05-08T06:07:15.725 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 104857600, 2024-05-08T06:07:15.725 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-05-08T06:07:15.725 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 3885, 2024-05-08T06:07:15.725 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 1525857, 2024-05-08T06:07:15.725 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-05-08T06:07:15.725 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 3885, 2024-05-08T06:07:15.725 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-05-08T06:07:15.725 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-05-08T06:07:15.725 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 3885, 2024-05-08T06:07:15.725 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 1525857, 2024-05-08T06:07:15.725 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-05-08T06:07:15.726 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:15.726 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:15.726 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:15.726 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-05-08T06:07:15.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.726 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-objecter_bytes": { 2024-05-08T06:07:15.726 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-05-08T06:07:15.726 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 104857600, 2024-05-08T06:07:15.726 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-05-08T06:07:15.726 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 0, 2024-05-08T06:07:15.726 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 0, 2024-05-08T06:07:15.726 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-05-08T06:07:15.726 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 0, 2024-05-08T06:07:15.726 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 3513, 2024-05-08T06:07:15.727 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 1125, 2024-05-08T06:07:15.727 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 3513, 2024-05-08T06:07:15.727 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 1125, 2024-05-08T06:07:15.727 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-05-08T06:07:15.727 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:15.727 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:15.727 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:15.727 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-05-08T06:07:15.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.727 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-objecter_ops": { 2024-05-08T06:07:15.727 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-05-08T06:07:15.727 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 1024, 2024-05-08T06:07:15.727 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-05-08T06:07:15.727 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 0, 2024-05-08T06:07:15.727 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 0, 2024-05-08T06:07:15.728 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-05-08T06:07:15.728 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 0, 2024-05-08T06:07:15.728 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 3513, 2024-05-08T06:07:15.728 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 3513, 2024-05-08T06:07:15.728 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 3513, 2024-05-08T06:07:15.728 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 3513, 2024-05-08T06:07:15.728 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-05-08T06:07:15.728 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:15.728 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:15.728 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:15.728 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-05-08T06:07:15.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.728 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-write_buf_throttle": { 2024-05-08T06:07:15.728 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-05-08T06:07:15.728 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 3758096384, 2024-05-08T06:07:15.729 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-05-08T06:07:15.729 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 0, 2024-05-08T06:07:15.729 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 0, 2024-05-08T06:07:15.729 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-05-08T06:07:15.729 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 0, 2024-05-08T06:07:15.729 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-05-08T06:07:15.729 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-05-08T06:07:15.729 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 0, 2024-05-08T06:07:15.729 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 0, 2024-05-08T06:07:15.729 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-05-08T06:07:15.729 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:15.729 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:15.729 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:15.729 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-05-08T06:07:15.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-05-08T06:07:15.730 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-write_buf_throttle-0x55acf44206e0": { 2024-05-08T06:07:15.730 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-05-08T06:07:15.730 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 3758096384, 2024-05-08T06:07:15.730 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-05-08T06:07:15.730 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 0, 2024-05-08T06:07:15.730 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 0, 2024-05-08T06:07:15.730 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-05-08T06:07:15.730 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 0, 2024-05-08T06:07:15.730 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-05-08T06:07:15.730 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-05-08T06:07:15.730 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 0, 2024-05-08T06:07:15.730 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 0, 2024-05-08T06:07:15.730 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-05-08T06:07:15.730 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-05-08T06:07:15.731 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-05-08T06:07:15.731 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-05-08T06:07:15.731 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-05-08T06:07:15.731 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-05-08T06:07:15.731 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-05-08T06:07:16.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:15 smithi134 ceph-mon[34132]: pgmap v957: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 16 KiB/s wr, 11 op/s 2024-05-08T06:07:16.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:15 smithi151 ceph-mon[34815]: pgmap v957: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 16 KiB/s wr, 11 op/s 2024-05-08T06:07:16.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:15 smithi082 ceph-mon[30098]: pgmap v957: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 16 KiB/s wr, 11 op/s 2024-05-08T06:07:16.570 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-05-08T06:07:16.570 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-05-08T06:07:16.570 DEBUG:tasks.check_counter:Getting stats from c 2024-05-08T06:07:16.571 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph daemon mds.c perf dump 2024-05-08T06:07:16.820 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T06:07:17.999 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:17 smithi134 ceph-mon[34132]: pgmap v958: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 16 KiB/s wr, 11 op/s 2024-05-08T06:07:18.026 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:17 smithi151 ceph-mon[34815]: pgmap v958: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 16 KiB/s wr, 11 op/s 2024-05-08T06:07:18.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:17 smithi082 ceph-mon[30098]: pgmap v958: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 16 KiB/s wr, 11 op/s 2024-05-08T06:07:18.586 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T06:07:18.586 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T06:07:18.586 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 56, 2024-05-08T06:07:18.586 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 62, 2024-05-08T06:07:18.587 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 10890, 2024-05-08T06:07:18.587 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 393008, 2024-05-08T06:07:18.587 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 42, 2024-05-08T06:07:18.587 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 4, 2024-05-08T06:07:18.587 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 0.018659858, 2024-05-08T06:07:18.587 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 0.001969000, 2024-05-08T06:07:18.587 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 0.012311563, 2024-05-08T06:07:18.588 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 0.000462308, 2024-05-08T06:07:18.588 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T06:07:18.588 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 56, 2024-05-08T06:07:18.588 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.023918913, 2024-05-08T06:07:18.588 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000427123 2024-05-08T06:07:18.588 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.588 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2024-05-08T06:07:18.589 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 39, 2024-05-08T06:07:18.589 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000005066, 2024-05-08T06:07:18.589 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000129 2024-05-08T06:07:18.589 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.589 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 928, 2024-05-08T06:07:18.589 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 736 2024-05-08T06:07:18.590 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.590 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T06:07:18.590 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 421, 2024-05-08T06:07:18.590 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 404, 2024-05-08T06:07:18.590 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 926318, 2024-05-08T06:07:18.590 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 235752, 2024-05-08T06:07:18.591 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 7, 2024-05-08T06:07:18.591 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 4, 2024-05-08T06:07:18.591 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 0.053083621, 2024-05-08T06:07:18.591 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 0.019067701, 2024-05-08T06:07:18.591 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 0.029472751, 2024-05-08T06:07:18.591 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 0.008291571, 2024-05-08T06:07:18.591 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T06:07:18.592 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 404, 2024-05-08T06:07:18.592 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.037129470, 2024-05-08T06:07:18.592 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000091904 2024-05-08T06:07:18.592 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.592 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2024-05-08T06:07:18.592 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:18.593 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:18.593 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:18.593 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.593 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 922528, 2024-05-08T06:07:18.593 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 223648 2024-05-08T06:07:18.593 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.594 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T06:07:18.594 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 408, 2024-05-08T06:07:18.594 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 1013, 2024-05-08T06:07:18.594 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 88587, 2024-05-08T06:07:18.594 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 757299, 2024-05-08T06:07:18.594 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 9, 2024-05-08T06:07:18.595 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 3, 2024-05-08T06:07:18.595 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 0.075903125, 2024-05-08T06:07:18.595 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 0.034555649, 2024-05-08T06:07:18.595 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 0.027923058, 2024-05-08T06:07:18.595 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 0.007015356, 2024-05-08T06:07:18.595 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T06:07:18.596 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 1015, 2024-05-08T06:07:18.596 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.052532874, 2024-05-08T06:07:18.596 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000051756 2024-05-08T06:07:18.596 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.596 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2024-05-08T06:07:18.597 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 1132, 2024-05-08T06:07:18.597 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000301268, 2024-05-08T06:07:18.597 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000266 2024-05-08T06:07:18.597 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.598 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-08T06:07:18.598 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 622944 2024-05-08T06:07:18.598 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.598 INFO:teuthology.orchestra.run.smithi151.stdout: "cct": { 2024-05-08T06:07:18.598 INFO:teuthology.orchestra.run.smithi151.stdout: "total_workers": 1, 2024-05-08T06:07:18.598 INFO:teuthology.orchestra.run.smithi151.stdout: "unhealthy_workers": 0 2024-05-08T06:07:18.599 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.599 INFO:teuthology.orchestra.run.smithi151.stdout: "finisher-MDSRank": { 2024-05-08T06:07:18.599 INFO:teuthology.orchestra.run.smithi151.stdout: "queue_len": 0, 2024-05-08T06:07:18.599 INFO:teuthology.orchestra.run.smithi151.stdout: "complete_latency": { 2024-05-08T06:07:18.599 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 54, 2024-05-08T06:07:18.599 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.001405845, 2024-05-08T06:07:18.600 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000026034 2024-05-08T06:07:18.600 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T06:07:18.600 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.600 INFO:teuthology.orchestra.run.smithi151.stdout: "finisher-PurgeQueue": { 2024-05-08T06:07:18.600 INFO:teuthology.orchestra.run.smithi151.stdout: "queue_len": 0, 2024-05-08T06:07:18.600 INFO:teuthology.orchestra.run.smithi151.stdout: "complete_latency": { 2024-05-08T06:07:18.601 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 2, 2024-05-08T06:07:18.601 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000007746, 2024-05-08T06:07:18.601 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000003873 2024-05-08T06:07:18.601 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T06:07:18.601 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.601 INFO:teuthology.orchestra.run.smithi151.stdout: "mds": { 2024-05-08T06:07:18.601 INFO:teuthology.orchestra.run.smithi151.stdout: "request": 0, 2024-05-08T06:07:18.601 INFO:teuthology.orchestra.run.smithi151.stdout: "reply": 0, 2024-05-08T06:07:18.601 INFO:teuthology.orchestra.run.smithi151.stdout: "reply_latency": { 2024-05-08T06:07:18.602 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:18.602 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:18.602 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:18.602 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.602 INFO:teuthology.orchestra.run.smithi151.stdout: "slow_reply": 0, 2024-05-08T06:07:18.602 INFO:teuthology.orchestra.run.smithi151.stdout: "forward": 0, 2024-05-08T06:07:18.602 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_fetch_complete": 0, 2024-05-08T06:07:18.602 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_fetch_keys": 0, 2024-05-08T06:07:18.602 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_commit": 11, 2024-05-08T06:07:18.603 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_split": 0, 2024-05-08T06:07:18.603 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_merge": 0, 2024-05-08T06:07:18.603 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes": 10, 2024-05-08T06:07:18.603 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_top": 0, 2024-05-08T06:07:18.603 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_bottom": 10, 2024-05-08T06:07:18.603 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_pin_tail": 0, 2024-05-08T06:07:18.603 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_pinned": 10, 2024-05-08T06:07:18.603 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_expired": 0, 2024-05-08T06:07:18.603 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_with_caps": 0, 2024-05-08T06:07:18.604 INFO:teuthology.orchestra.run.smithi151.stdout: "caps": 0, 2024-05-08T06:07:18.604 INFO:teuthology.orchestra.run.smithi151.stdout: "subtrees": 1, 2024-05-08T06:07:18.604 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse": 0, 2024-05-08T06:07:18.604 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_hit": 0, 2024-05-08T06:07:18.604 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_forward": 0, 2024-05-08T06:07:18.605 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_discover": 0, 2024-05-08T06:07:18.605 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_dir_fetch": 0, 2024-05-08T06:07:18.605 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_remote_ino": 0, 2024-05-08T06:07:18.605 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_lock": 0, 2024-05-08T06:07:18.605 INFO:teuthology.orchestra.run.smithi151.stdout: "load_cent": 0, 2024-05-08T06:07:18.605 INFO:teuthology.orchestra.run.smithi151.stdout: "q": 0, 2024-05-08T06:07:18.605 INFO:teuthology.orchestra.run.smithi151.stdout: "exported": 0, 2024-05-08T06:07:18.605 INFO:teuthology.orchestra.run.smithi151.stdout: "exported_inodes": 0, 2024-05-08T06:07:18.605 INFO:teuthology.orchestra.run.smithi151.stdout: "imported": 0, 2024-05-08T06:07:18.605 INFO:teuthology.orchestra.run.smithi151.stdout: "imported_inodes": 0, 2024-05-08T06:07:18.605 INFO:teuthology.orchestra.run.smithi151.stdout: "openino_dir_fetch": 0, 2024-05-08T06:07:18.605 INFO:teuthology.orchestra.run.smithi151.stdout: "openino_backtrace_fetch": 0, 2024-05-08T06:07:18.606 INFO:teuthology.orchestra.run.smithi151.stdout: "openino_peer_discover": 0, 2024-05-08T06:07:18.606 INFO:teuthology.orchestra.run.smithi151.stdout: "root_rfiles": 1029, 2024-05-08T06:07:18.606 INFO:teuthology.orchestra.run.smithi151.stdout: "root_rbytes": 1712962860, 2024-05-08T06:07:18.606 INFO:teuthology.orchestra.run.smithi151.stdout: "root_rsnaps": 0, 2024-05-08T06:07:18.606 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_backtrace_fetch": 0, 2024-05-08T06:07:18.606 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_set_tag": 0, 2024-05-08T06:07:18.606 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_backtrace_repaired": 0, 2024-05-08T06:07:18.606 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_inotable_repaired": 0, 2024-05-08T06:07:18.606 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_dir_inodes": 0, 2024-05-08T06:07:18.606 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_dir_base_inodes": 0, 2024-05-08T06:07:18.606 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_dirfrag_rstats": 0, 2024-05-08T06:07:18.606 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_file_inodes": 0, 2024-05-08T06:07:18.606 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_inode_file_caps": 0, 2024-05-08T06:07:18.607 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_revoke": 0, 2024-05-08T06:07:18.607 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_grant": 0, 2024-05-08T06:07:18.607 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_trunc": 0, 2024-05-08T06:07:18.607 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-08T06:07:18.607 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-08T06:07:18.607 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_caps": 0, 2024-05-08T06:07:18.607 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_caps_dirty": 0, 2024-05-08T06:07:18.607 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_cap_release": 0, 2024-05-08T06:07:18.607 INFO:teuthology.orchestra.run.smithi151.stdout: "process_request_cap_release": 0 2024-05-08T06:07:18.607 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.607 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_cache": { 2024-05-08T06:07:18.607 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_update": 0, 2024-05-08T06:07:18.607 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_update_receipt": 0, 2024-05-08T06:07:18.607 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_try_discover": 0, 2024-05-08T06:07:18.607 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_send_discover": 1, 2024-05-08T06:07:18.608 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_handle_discover": 0, 2024-05-08T06:07:18.608 INFO:teuthology.orchestra.run.smithi151.stdout: "num_strays": 0, 2024-05-08T06:07:18.608 INFO:teuthology.orchestra.run.smithi151.stdout: "num_strays_delayed": 0, 2024-05-08T06:07:18.608 INFO:teuthology.orchestra.run.smithi151.stdout: "num_strays_enqueuing": 0, 2024-05-08T06:07:18.608 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_created": 0, 2024-05-08T06:07:18.608 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_enqueued": 0, 2024-05-08T06:07:18.608 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_reintegrated": 0, 2024-05-08T06:07:18.608 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_migrated": 0, 2024-05-08T06:07:18.608 INFO:teuthology.orchestra.run.smithi151.stdout: "num_recovering_processing": 0, 2024-05-08T06:07:18.608 INFO:teuthology.orchestra.run.smithi151.stdout: "num_recovering_enqueued": 0, 2024-05-08T06:07:18.608 INFO:teuthology.orchestra.run.smithi151.stdout: "num_recovering_prioritized": 0, 2024-05-08T06:07:18.608 INFO:teuthology.orchestra.run.smithi151.stdout: "recovery_started": 0, 2024-05-08T06:07:18.608 INFO:teuthology.orchestra.run.smithi151.stdout: "recovery_completed": 0, 2024-05-08T06:07:18.608 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_quiesce_path": 0, 2024-05-08T06:07:18.608 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_quiesce_inode": 0, 2024-05-08T06:07:18.608 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_enqueue_scrub": 0, 2024-05-08T06:07:18.609 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_exportdir": 0, 2024-05-08T06:07:18.609 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_flush": 0, 2024-05-08T06:07:18.609 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_fragmentdir": 0, 2024-05-08T06:07:18.609 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_fragstats": 0, 2024-05-08T06:07:18.609 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_inodestats": 0 2024-05-08T06:07:18.609 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.609 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_log": { 2024-05-08T06:07:18.609 INFO:teuthology.orchestra.run.smithi151.stdout: "evlrg": 0, 2024-05-08T06:07:18.609 INFO:teuthology.orchestra.run.smithi151.stdout: "evadd": 4, 2024-05-08T06:07:18.609 INFO:teuthology.orchestra.run.smithi151.stdout: "evex": 0, 2024-05-08T06:07:18.609 INFO:teuthology.orchestra.run.smithi151.stdout: "evtrm": 0, 2024-05-08T06:07:18.609 INFO:teuthology.orchestra.run.smithi151.stdout: "ev": 4, 2024-05-08T06:07:18.609 INFO:teuthology.orchestra.run.smithi151.stdout: "evexg": 0, 2024-05-08T06:07:18.609 INFO:teuthology.orchestra.run.smithi151.stdout: "evexd": 0, 2024-05-08T06:07:18.609 INFO:teuthology.orchestra.run.smithi151.stdout: "segadd": 2, 2024-05-08T06:07:18.609 INFO:teuthology.orchestra.run.smithi151.stdout: "segex": 0, 2024-05-08T06:07:18.610 INFO:teuthology.orchestra.run.smithi151.stdout: "segtrm": 0, 2024-05-08T06:07:18.610 INFO:teuthology.orchestra.run.smithi151.stdout: "seg": 2, 2024-05-08T06:07:18.610 INFO:teuthology.orchestra.run.smithi151.stdout: "segmjr": 2, 2024-05-08T06:07:18.610 INFO:teuthology.orchestra.run.smithi151.stdout: "segexg": 0, 2024-05-08T06:07:18.610 INFO:teuthology.orchestra.run.smithi151.stdout: "segexd": 0, 2024-05-08T06:07:18.610 INFO:teuthology.orchestra.run.smithi151.stdout: "expos": 4194304, 2024-05-08T06:07:18.610 INFO:teuthology.orchestra.run.smithi151.stdout: "wrpos": 4195424, 2024-05-08T06:07:18.610 INFO:teuthology.orchestra.run.smithi151.stdout: "rdpos": 0, 2024-05-08T06:07:18.610 INFO:teuthology.orchestra.run.smithi151.stdout: "jlat": { 2024-05-08T06:07:18.610 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 3, 2024-05-08T06:07:18.610 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.005114721, 2024-05-08T06:07:18.610 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.001704907 2024-05-08T06:07:18.610 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.611 INFO:teuthology.orchestra.run.smithi151.stdout: "replayed": 0 2024-05-08T06:07:18.611 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.611 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_mem": { 2024-05-08T06:07:18.611 INFO:teuthology.orchestra.run.smithi151.stdout: "ino": 13, 2024-05-08T06:07:18.611 INFO:teuthology.orchestra.run.smithi151.stdout: "ino+": 13, 2024-05-08T06:07:18.611 INFO:teuthology.orchestra.run.smithi151.stdout: "ino-": 0, 2024-05-08T06:07:18.611 INFO:teuthology.orchestra.run.smithi151.stdout: "dir": 11, 2024-05-08T06:07:18.611 INFO:teuthology.orchestra.run.smithi151.stdout: "dir+": 12, 2024-05-08T06:07:18.611 INFO:teuthology.orchestra.run.smithi151.stdout: "dir-": 1, 2024-05-08T06:07:18.611 INFO:teuthology.orchestra.run.smithi151.stdout: "dn": 10, 2024-05-08T06:07:18.611 INFO:teuthology.orchestra.run.smithi151.stdout: "dn+": 10, 2024-05-08T06:07:18.611 INFO:teuthology.orchestra.run.smithi151.stdout: "dn-": 0, 2024-05-08T06:07:18.611 INFO:teuthology.orchestra.run.smithi151.stdout: "cap": 0, 2024-05-08T06:07:18.611 INFO:teuthology.orchestra.run.smithi151.stdout: "cap+": 0, 2024-05-08T06:07:18.612 INFO:teuthology.orchestra.run.smithi151.stdout: "cap-": 0, 2024-05-08T06:07:18.612 INFO:teuthology.orchestra.run.smithi151.stdout: "rss": 54800, 2024-05-08T06:07:18.612 INFO:teuthology.orchestra.run.smithi151.stdout: "heap": 223608 2024-05-08T06:07:18.612 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.612 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_server": { 2024-05-08T06:07:18.612 INFO:teuthology.orchestra.run.smithi151.stdout: "dispatch_client_request": 0, 2024-05-08T06:07:18.612 INFO:teuthology.orchestra.run.smithi151.stdout: "dispatch_server_request": 0, 2024-05-08T06:07:18.612 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_request": 0, 2024-05-08T06:07:18.612 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_session": 4, 2024-05-08T06:07:18.612 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_peer_request": 0, 2024-05-08T06:07:18.612 INFO:teuthology.orchestra.run.smithi151.stdout: "req_create_latency": { 2024-05-08T06:07:18.612 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:18.612 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:18.612 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:18.612 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.613 INFO:teuthology.orchestra.run.smithi151.stdout: "req_getattr_latency": { 2024-05-08T06:07:18.613 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:18.613 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:18.613 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:18.613 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.613 INFO:teuthology.orchestra.run.smithi151.stdout: "req_getfilelock_latency": { 2024-05-08T06:07:18.613 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:18.613 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:18.613 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:18.613 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.613 INFO:teuthology.orchestra.run.smithi151.stdout: "req_link_latency": { 2024-05-08T06:07:18.613 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:18.613 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:18.613 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:18.614 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.614 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookup_latency": { 2024-05-08T06:07:18.614 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:18.614 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:18.614 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:18.614 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.614 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookuphash_latency": { 2024-05-08T06:07:18.614 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:18.614 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:18.614 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:18.614 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.614 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupino_latency": { 2024-05-08T06:07:18.614 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:18.615 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:18.615 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:18.615 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.615 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupname_latency": { 2024-05-08T06:07:18.615 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:18.615 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:18.615 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:18.615 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.615 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupparent_latency": { 2024-05-08T06:07:18.615 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:18.615 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:18.615 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:18.615 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.615 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupsnap_latency": { 2024-05-08T06:07:18.616 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:18.616 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:18.616 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:18.616 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.616 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lssnap_latency": { 2024-05-08T06:07:18.616 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:18.616 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:18.616 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:18.616 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.616 INFO:teuthology.orchestra.run.smithi151.stdout: "req_mkdir_latency": { 2024-05-08T06:07:18.616 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:18.617 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:18.617 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:18.617 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.617 INFO:teuthology.orchestra.run.smithi151.stdout: "req_mknod_latency": { 2024-05-08T06:07:18.617 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:18.617 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:18.617 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:18.617 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.618 INFO:teuthology.orchestra.run.smithi151.stdout: "req_mksnap_latency": { 2024-05-08T06:07:18.618 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:18.618 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:18.618 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:18.618 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.618 INFO:teuthology.orchestra.run.smithi151.stdout: "req_open_latency": { 2024-05-08T06:07:18.618 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:18.618 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:18.618 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:18.618 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.618 INFO:teuthology.orchestra.run.smithi151.stdout: "req_readdir_latency": { 2024-05-08T06:07:18.618 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:18.618 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:18.618 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:18.619 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.619 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rename_latency": { 2024-05-08T06:07:18.619 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:18.619 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:18.619 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:18.619 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.619 INFO:teuthology.orchestra.run.smithi151.stdout: "req_renamesnap_latency": { 2024-05-08T06:07:18.619 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:18.619 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:18.619 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:18.619 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.619 INFO:teuthology.orchestra.run.smithi151.stdout: "req_snapdiff_latency": { 2024-05-08T06:07:18.619 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:18.619 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:18.619 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:18.620 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.620 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rmdir_latency": { 2024-05-08T06:07:18.620 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:18.620 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:18.620 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:18.620 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.620 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rmsnap_latency": { 2024-05-08T06:07:18.620 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:18.620 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:18.620 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:18.620 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.620 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rmxattr_latency": { 2024-05-08T06:07:18.620 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:18.620 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:18.620 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:18.620 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.620 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setattr_latency": { 2024-05-08T06:07:18.621 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:18.621 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:18.621 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:18.621 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.621 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setdirlayout_latency": { 2024-05-08T06:07:18.621 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:18.621 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:18.621 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:18.621 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.621 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setfilelock_latency": { 2024-05-08T06:07:18.621 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:18.621 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:18.621 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:18.621 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.621 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setlayout_latency": { 2024-05-08T06:07:18.621 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:18.622 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:18.622 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:18.622 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.622 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setxattr_latency": { 2024-05-08T06:07:18.622 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:18.622 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:18.622 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:18.622 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.622 INFO:teuthology.orchestra.run.smithi151.stdout: "req_symlink_latency": { 2024-05-08T06:07:18.622 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:18.622 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:18.622 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:18.622 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.622 INFO:teuthology.orchestra.run.smithi151.stdout: "req_unlink_latency": { 2024-05-08T06:07:18.622 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:18.623 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:18.623 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:18.623 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.623 INFO:teuthology.orchestra.run.smithi151.stdout: "cap_revoke_eviction": 0, 2024-05-08T06:07:18.623 INFO:teuthology.orchestra.run.smithi151.stdout: "cap_acquisition_throttle": 0, 2024-05-08T06:07:18.623 INFO:teuthology.orchestra.run.smithi151.stdout: "req_getvxattr_latency": { 2024-05-08T06:07:18.623 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:18.623 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:18.623 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:18.623 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T06:07:18.623 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.623 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_sessions": { 2024-05-08T06:07:18.623 INFO:teuthology.orchestra.run.smithi151.stdout: "session_count": 0, 2024-05-08T06:07:18.623 INFO:teuthology.orchestra.run.smithi151.stdout: "session_add": 1, 2024-05-08T06:07:18.623 INFO:teuthology.orchestra.run.smithi151.stdout: "session_remove": 1, 2024-05-08T06:07:18.623 INFO:teuthology.orchestra.run.smithi151.stdout: "sessions_open": 0, 2024-05-08T06:07:18.624 INFO:teuthology.orchestra.run.smithi151.stdout: "sessions_stale": 0, 2024-05-08T06:07:18.624 INFO:teuthology.orchestra.run.smithi151.stdout: "total_load": 0, 2024-05-08T06:07:18.624 INFO:teuthology.orchestra.run.smithi151.stdout: "average_load": 0, 2024-05-08T06:07:18.624 INFO:teuthology.orchestra.run.smithi151.stdout: "avg_session_uptime": 67, 2024-05-08T06:07:18.624 INFO:teuthology.orchestra.run.smithi151.stdout: "mdthresh_evicted": 0 2024-05-08T06:07:18.624 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.624 INFO:teuthology.orchestra.run.smithi151.stdout: "mempool": { 2024-05-08T06:07:18.624 INFO:teuthology.orchestra.run.smithi151.stdout: "bloom_filter_bytes": 0, 2024-05-08T06:07:18.624 INFO:teuthology.orchestra.run.smithi151.stdout: "bloom_filter_items": 0, 2024-05-08T06:07:18.624 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T06:07:18.624 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_alloc_items": 0, 2024-05-08T06:07:18.624 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T06:07:18.624 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_data_items": 0, 2024-05-08T06:07:18.624 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T06:07:18.624 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T06:07:18.624 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T06:07:18.625 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T06:07:18.625 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T06:07:18.625 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_other_items": 0, 2024-05-08T06:07:18.625 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T06:07:18.625 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T06:07:18.625 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_extent_bytes": 0, 2024-05-08T06:07:18.625 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_extent_items": 0, 2024-05-08T06:07:18.625 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_blob_bytes": 0, 2024-05-08T06:07:18.625 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_blob_items": 0, 2024-05-08T06:07:18.625 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T06:07:18.625 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T06:07:18.625 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T06:07:18.625 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T06:07:18.625 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T06:07:18.626 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_fsck_items": 0, 2024-05-08T06:07:18.626 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_txc_bytes": 0, 2024-05-08T06:07:18.626 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_txc_items": 0, 2024-05-08T06:07:18.626 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T06:07:18.626 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T06:07:18.626 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_bytes": 0, 2024-05-08T06:07:18.626 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_items": 0, 2024-05-08T06:07:18.626 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_bytes": 0, 2024-05-08T06:07:18.626 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_items": 0, 2024-05-08T06:07:18.626 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T06:07:18.626 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_reader_items": 0, 2024-05-08T06:07:18.626 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T06:07:18.626 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_writer_items": 0, 2024-05-08T06:07:18.626 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_anon_bytes": 222535, 2024-05-08T06:07:18.626 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_anon_items": 67, 2024-05-08T06:07:18.627 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_meta_bytes": 0, 2024-05-08T06:07:18.627 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_meta_items": 0, 2024-05-08T06:07:18.627 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_bytes": 0, 2024-05-08T06:07:18.627 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_items": 0, 2024-05-08T06:07:18.627 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_mapbl_bytes": 0, 2024-05-08T06:07:18.627 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_mapbl_items": 0, 2024-05-08T06:07:18.627 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_pglog_bytes": 0, 2024-05-08T06:07:18.627 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_pglog_items": 0, 2024-05-08T06:07:18.627 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_bytes": 7528, 2024-05-08T06:07:18.627 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_items": 158, 2024-05-08T06:07:18.627 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T06:07:18.627 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_mapping_items": 0, 2024-05-08T06:07:18.627 INFO:teuthology.orchestra.run.smithi151.stdout: "pgmap_bytes": 0, 2024-05-08T06:07:18.627 INFO:teuthology.orchestra.run.smithi151.stdout: "pgmap_items": 0, 2024-05-08T06:07:18.627 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_co_bytes": 50872, 2024-05-08T06:07:18.627 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_co_items": 198, 2024-05-08T06:07:18.627 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_1_bytes": 0, 2024-05-08T06:07:18.628 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_1_items": 0, 2024-05-08T06:07:18.628 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_2_bytes": 0, 2024-05-08T06:07:18.628 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_2_items": 0 2024-05-08T06:07:18.628 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.628 INFO:teuthology.orchestra.run.smithi151.stdout: "objecter": { 2024-05-08T06:07:18.628 INFO:teuthology.orchestra.run.smithi151.stdout: "op_active": 0, 2024-05-08T06:07:18.628 INFO:teuthology.orchestra.run.smithi151.stdout: "op_laggy": 0, 2024-05-08T06:07:18.628 INFO:teuthology.orchestra.run.smithi151.stdout: "op_send": 39, 2024-05-08T06:07:18.628 INFO:teuthology.orchestra.run.smithi151.stdout: "op_send_bytes": 11422, 2024-05-08T06:07:18.628 INFO:teuthology.orchestra.run.smithi151.stdout: "op_resend": 33, 2024-05-08T06:07:18.628 INFO:teuthology.orchestra.run.smithi151.stdout: "op_reply": 39, 2024-05-08T06:07:18.628 INFO:teuthology.orchestra.run.smithi151.stdout: "op_latency": { 2024-05-08T06:07:18.628 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 39, 2024-05-08T06:07:18.628 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.367995502, 2024-05-08T06:07:18.628 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.009435782 2024-05-08T06:07:18.628 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.629 INFO:teuthology.orchestra.run.smithi151.stdout: "op_inflight": 0, 2024-05-08T06:07:18.629 INFO:teuthology.orchestra.run.smithi151.stdout: "oplen_avg": { 2024-05-08T06:07:18.629 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 39, 2024-05-08T06:07:18.629 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 61 2024-05-08T06:07:18.629 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.629 INFO:teuthology.orchestra.run.smithi151.stdout: "op": 39, 2024-05-08T06:07:18.629 INFO:teuthology.orchestra.run.smithi151.stdout: "op_r": 0, 2024-05-08T06:07:18.629 INFO:teuthology.orchestra.run.smithi151.stdout: "op_w": 39, 2024-05-08T06:07:18.629 INFO:teuthology.orchestra.run.smithi151.stdout: "op_rmw": 0, 2024-05-08T06:07:18.629 INFO:teuthology.orchestra.run.smithi151.stdout: "op_pg": 0, 2024-05-08T06:07:18.629 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_stat": 0, 2024-05-08T06:07:18.629 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_create": 10, 2024-05-08T06:07:18.629 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_read": 0, 2024-05-08T06:07:18.629 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_write": 3, 2024-05-08T06:07:18.629 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_writefull": 7, 2024-05-08T06:07:18.629 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_writesame": 0, 2024-05-08T06:07:18.629 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_append": 0, 2024-05-08T06:07:18.630 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_zero": 0, 2024-05-08T06:07:18.630 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_truncate": 0, 2024-05-08T06:07:18.630 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_delete": 6, 2024-05-08T06:07:18.630 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_mapext": 0, 2024-05-08T06:07:18.630 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_sparse_read": 0, 2024-05-08T06:07:18.630 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_clonerange": 0, 2024-05-08T06:07:18.630 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_getxattr": 0, 2024-05-08T06:07:18.630 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_setxattr": 20, 2024-05-08T06:07:18.630 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_cmpxattr": 0, 2024-05-08T06:07:18.630 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_rmxattr": 0, 2024-05-08T06:07:18.630 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_resetxattrs": 0, 2024-05-08T06:07:18.630 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_call": 0, 2024-05-08T06:07:18.630 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_watch": 0, 2024-05-08T06:07:18.630 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_notify": 0, 2024-05-08T06:07:18.631 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_src_cmpxattr": 0, 2024-05-08T06:07:18.631 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_pgls": 0, 2024-05-08T06:07:18.631 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_pgls_filter": 0, 2024-05-08T06:07:18.631 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_other": 0, 2024-05-08T06:07:18.631 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_active": 0, 2024-05-08T06:07:18.631 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_send": 0, 2024-05-08T06:07:18.631 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_resend": 0, 2024-05-08T06:07:18.631 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_ping": 0, 2024-05-08T06:07:18.631 INFO:teuthology.orchestra.run.smithi151.stdout: "poolop_active": 0, 2024-05-08T06:07:18.631 INFO:teuthology.orchestra.run.smithi151.stdout: "poolop_send": 0, 2024-05-08T06:07:18.631 INFO:teuthology.orchestra.run.smithi151.stdout: "poolop_resend": 0, 2024-05-08T06:07:18.631 INFO:teuthology.orchestra.run.smithi151.stdout: "poolstat_active": 0, 2024-05-08T06:07:18.631 INFO:teuthology.orchestra.run.smithi151.stdout: "poolstat_send": 0, 2024-05-08T06:07:18.631 INFO:teuthology.orchestra.run.smithi151.stdout: "poolstat_resend": 0, 2024-05-08T06:07:18.631 INFO:teuthology.orchestra.run.smithi151.stdout: "statfs_active": 0, 2024-05-08T06:07:18.631 INFO:teuthology.orchestra.run.smithi151.stdout: "statfs_send": 0, 2024-05-08T06:07:18.631 INFO:teuthology.orchestra.run.smithi151.stdout: "statfs_resend": 0, 2024-05-08T06:07:18.632 INFO:teuthology.orchestra.run.smithi151.stdout: "command_active": 0, 2024-05-08T06:07:18.632 INFO:teuthology.orchestra.run.smithi151.stdout: "command_send": 0, 2024-05-08T06:07:18.632 INFO:teuthology.orchestra.run.smithi151.stdout: "command_resend": 0, 2024-05-08T06:07:18.632 INFO:teuthology.orchestra.run.smithi151.stdout: "map_epoch": 82, 2024-05-08T06:07:18.632 INFO:teuthology.orchestra.run.smithi151.stdout: "map_full": 0, 2024-05-08T06:07:18.632 INFO:teuthology.orchestra.run.smithi151.stdout: "map_inc": 2, 2024-05-08T06:07:18.632 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_sessions": 8, 2024-05-08T06:07:18.632 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_session_open": 13, 2024-05-08T06:07:18.632 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_session_close": 5, 2024-05-08T06:07:18.632 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_laggy": 0, 2024-05-08T06:07:18.632 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_wr": 14, 2024-05-08T06:07:18.632 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_rd": 0, 2024-05-08T06:07:18.632 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_del": 1 2024-05-08T06:07:18.632 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.632 INFO:teuthology.orchestra.run.smithi151.stdout: "oft": { 2024-05-08T06:07:18.632 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_objs": 1, 2024-05-08T06:07:18.633 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_kv_pairs": 0, 2024-05-08T06:07:18.633 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_updates": 0, 2024-05-08T06:07:18.633 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_removes": 0 2024-05-08T06:07:18.633 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.633 INFO:teuthology.orchestra.run.smithi151.stdout: "osd-slow-ops": { 2024-05-08T06:07:18.633 INFO:teuthology.orchestra.run.smithi151.stdout: "slow_ops_count": 0 2024-05-08T06:07:18.633 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.633 INFO:teuthology.orchestra.run.smithi151.stdout: "purge_queue": { 2024-05-08T06:07:18.633 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing_ops": 0, 2024-05-08T06:07:18.633 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing_ops_high_water": 0, 2024-05-08T06:07:18.633 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing": 0, 2024-05-08T06:07:18.633 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing_high_water": 0, 2024-05-08T06:07:18.633 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executed_ops": 0, 2024-05-08T06:07:18.633 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executed": 0, 2024-05-08T06:07:18.634 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_item_in_journal": 0 2024-05-08T06:07:18.634 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.634 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T06:07:18.634 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-05-08T06:07:18.634 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 104857600, 2024-05-08T06:07:18.634 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-05-08T06:07:18.634 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 881, 2024-05-08T06:07:18.634 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 922791, 2024-05-08T06:07:18.634 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-05-08T06:07:18.634 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 881, 2024-05-08T06:07:18.634 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 0, 2024-05-08T06:07:18.634 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 0, 2024-05-08T06:07:18.634 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 881, 2024-05-08T06:07:18.634 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 922791, 2024-05-08T06:07:18.635 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-05-08T06:07:18.635 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:18.635 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:18.635 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:18.635 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T06:07:18.635 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.635 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-objecter_bytes": { 2024-05-08T06:07:18.635 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-05-08T06:07:18.635 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 104857600, 2024-05-08T06:07:18.635 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-05-08T06:07:18.635 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 0, 2024-05-08T06:07:18.635 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 0, 2024-05-08T06:07:18.635 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-05-08T06:07:18.636 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 0, 2024-05-08T06:07:18.636 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 39, 2024-05-08T06:07:18.636 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 11422, 2024-05-08T06:07:18.636 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 39, 2024-05-08T06:07:18.636 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 11422, 2024-05-08T06:07:18.636 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-05-08T06:07:18.636 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:18.636 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:18.636 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:18.636 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T06:07:18.636 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.636 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-objecter_ops": { 2024-05-08T06:07:18.636 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-05-08T06:07:18.636 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 1024, 2024-05-08T06:07:18.637 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-05-08T06:07:18.637 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 0, 2024-05-08T06:07:18.637 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 0, 2024-05-08T06:07:18.637 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-05-08T06:07:18.637 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 0, 2024-05-08T06:07:18.637 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 39, 2024-05-08T06:07:18.637 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 39, 2024-05-08T06:07:18.637 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 39, 2024-05-08T06:07:18.637 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 39, 2024-05-08T06:07:18.637 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-05-08T06:07:18.637 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:18.637 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:18.637 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:18.637 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T06:07:18.637 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.638 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-write_buf_throttle": { 2024-05-08T06:07:18.638 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-05-08T06:07:18.638 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 3758096384, 2024-05-08T06:07:18.638 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-05-08T06:07:18.638 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 0, 2024-05-08T06:07:18.638 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 0, 2024-05-08T06:07:18.638 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-05-08T06:07:18.638 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 0, 2024-05-08T06:07:18.638 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 0, 2024-05-08T06:07:18.638 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 0, 2024-05-08T06:07:18.638 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 0, 2024-05-08T06:07:18.638 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 0, 2024-05-08T06:07:18.638 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-05-08T06:07:18.638 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:18.638 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:18.639 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:18.639 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T06:07:18.639 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:18.639 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-write_buf_throttle-0x5618985a2500": { 2024-05-08T06:07:18.639 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-05-08T06:07:18.639 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 3758096384, 2024-05-08T06:07:18.639 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-05-08T06:07:18.639 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 4, 2024-05-08T06:07:18.639 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 1120, 2024-05-08T06:07:18.639 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-05-08T06:07:18.639 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 4, 2024-05-08T06:07:18.639 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 0, 2024-05-08T06:07:18.639 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 0, 2024-05-08T06:07:18.639 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 3, 2024-05-08T06:07:18.639 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 1120, 2024-05-08T06:07:18.639 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-05-08T06:07:18.640 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:18.640 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:18.640 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:18.640 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T06:07:18.640 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T06:07:18.640 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T06:07:19.437 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-05-08T06:07:19.438 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-05-08T06:07:19.438 DEBUG:tasks.check_counter:Getting stats from f 2024-05-08T06:07:19.438 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph daemon mds.f perf dump 2024-05-08T06:07:19.689 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T06:07:20.029 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:19 smithi151 ceph-mon[34815]: pgmap v959: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.8 KiB/s wr, 11 op/s 2024-05-08T06:07:20.227 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:19 smithi082 ceph-mon[30098]: pgmap v959: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.8 KiB/s wr, 11 op/s 2024-05-08T06:07:20.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:19 smithi134 ceph-mon[34132]: pgmap v959: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.8 KiB/s wr, 11 op/s 2024-05-08T06:07:21.472 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T06:07:21.472 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T06:07:21.472 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 2359, 2024-05-08T06:07:21.472 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 2363, 2024-05-08T06:07:21.472 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 599805, 2024-05-08T06:07:21.472 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 2796159, 2024-05-08T06:07:21.472 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 18, 2024-05-08T06:07:21.472 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 5, 2024-05-08T06:07:21.472 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 0.145548672, 2024-05-08T06:07:21.472 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 0.049091439, 2024-05-08T06:07:21.472 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 0.035683058, 2024-05-08T06:07:21.472 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 0.046828011, 2024-05-08T06:07:21.473 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T06:07:21.473 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 2358, 2024-05-08T06:07:21.473 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.115258348, 2024-05-08T06:07:21.473 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000048879 2024-05-08T06:07:21.473 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.473 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2024-05-08T06:07:21.473 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 32, 2024-05-08T06:07:21.473 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000004697, 2024-05-08T06:07:21.473 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000146 2024-05-08T06:07:21.473 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.473 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 6752, 2024-05-08T06:07:21.473 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 5216 2024-05-08T06:07:21.473 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.473 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T06:07:21.473 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 2168, 2024-05-08T06:07:21.474 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 2711, 2024-05-08T06:07:21.474 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 692889, 2024-05-08T06:07:21.474 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 1888665, 2024-05-08T06:07:21.474 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 9, 2024-05-08T06:07:21.474 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 6, 2024-05-08T06:07:21.474 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 0.158559173, 2024-05-08T06:07:21.474 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 0.064500357, 2024-05-08T06:07:21.474 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 0.098844834, 2024-05-08T06:07:21.474 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 0.020660445, 2024-05-08T06:07:21.474 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T06:07:21.474 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 2709, 2024-05-08T06:07:21.474 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.104681869, 2024-05-08T06:07:21.474 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000038642 2024-05-08T06:07:21.474 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.475 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2024-05-08T06:07:21.475 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 2006, 2024-05-08T06:07:21.475 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000380288, 2024-05-08T06:07:21.475 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000189 2024-05-08T06:07:21.475 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.475 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 418096, 2024-05-08T06:07:21.475 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 1528128 2024-05-08T06:07:21.475 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.475 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T06:07:21.475 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 2885, 2024-05-08T06:07:21.475 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 2724, 2024-05-08T06:07:21.475 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 1944497, 2024-05-08T06:07:21.475 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 1451163, 2024-05-08T06:07:21.475 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 32, 2024-05-08T06:07:21.475 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 6, 2024-05-08T06:07:21.476 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 0.223065895, 2024-05-08T06:07:21.476 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 0.079075557, 2024-05-08T06:07:21.476 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 0.114438195, 2024-05-08T06:07:21.476 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 0.035870743, 2024-05-08T06:07:21.476 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T06:07:21.476 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 2727, 2024-05-08T06:07:21.476 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.121875521, 2024-05-08T06:07:21.476 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000044692 2024-05-08T06:07:21.476 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.476 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2024-05-08T06:07:21.476 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 2567, 2024-05-08T06:07:21.476 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000573588, 2024-05-08T06:07:21.476 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000223 2024-05-08T06:07:21.476 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.477 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 919840, 2024-05-08T06:07:21.477 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 236096 2024-05-08T06:07:21.477 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.477 INFO:teuthology.orchestra.run.smithi151.stdout: "cct": { 2024-05-08T06:07:21.477 INFO:teuthology.orchestra.run.smithi151.stdout: "total_workers": 1, 2024-05-08T06:07:21.477 INFO:teuthology.orchestra.run.smithi151.stdout: "unhealthy_workers": 0 2024-05-08T06:07:21.477 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.477 INFO:teuthology.orchestra.run.smithi151.stdout: "finisher-MDSRank": { 2024-05-08T06:07:21.477 INFO:teuthology.orchestra.run.smithi151.stdout: "queue_len": 0, 2024-05-08T06:07:21.477 INFO:teuthology.orchestra.run.smithi151.stdout: "complete_latency": { 2024-05-08T06:07:21.477 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 4141, 2024-05-08T06:07:21.477 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.592764782, 2024-05-08T06:07:21.477 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000143145 2024-05-08T06:07:21.477 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T06:07:21.477 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.478 INFO:teuthology.orchestra.run.smithi151.stdout: "finisher-PurgeQueue": { 2024-05-08T06:07:21.478 INFO:teuthology.orchestra.run.smithi151.stdout: "queue_len": 0, 2024-05-08T06:07:21.478 INFO:teuthology.orchestra.run.smithi151.stdout: "complete_latency": { 2024-05-08T06:07:21.478 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 20, 2024-05-08T06:07:21.478 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000604049, 2024-05-08T06:07:21.478 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000030202 2024-05-08T06:07:21.478 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T06:07:21.478 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.478 INFO:teuthology.orchestra.run.smithi151.stdout: "mds": { 2024-05-08T06:07:21.478 INFO:teuthology.orchestra.run.smithi151.stdout: "request": 331, 2024-05-08T06:07:21.478 INFO:teuthology.orchestra.run.smithi151.stdout: "reply": 328, 2024-05-08T06:07:21.478 INFO:teuthology.orchestra.run.smithi151.stdout: "reply_latency": { 2024-05-08T06:07:21.478 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 328, 2024-05-08T06:07:21.478 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.193124795, 2024-05-08T06:07:21.479 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000588795 2024-05-08T06:07:21.479 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.479 INFO:teuthology.orchestra.run.smithi151.stdout: "slow_reply": 0, 2024-05-08T06:07:21.479 INFO:teuthology.orchestra.run.smithi151.stdout: "forward": 3, 2024-05-08T06:07:21.479 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_fetch_complete": 0, 2024-05-08T06:07:21.479 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_fetch_keys": 0, 2024-05-08T06:07:21.479 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_commit": 11, 2024-05-08T06:07:21.479 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_split": 0, 2024-05-08T06:07:21.479 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_merge": 0, 2024-05-08T06:07:21.479 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes": 329, 2024-05-08T06:07:21.479 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_top": 0, 2024-05-08T06:07:21.479 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_bottom": 329, 2024-05-08T06:07:21.479 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_pin_tail": 0, 2024-05-08T06:07:21.479 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_pinned": 329, 2024-05-08T06:07:21.479 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_expired": 0, 2024-05-08T06:07:21.480 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_with_caps": 306, 2024-05-08T06:07:21.480 INFO:teuthology.orchestra.run.smithi151.stdout: "caps": 306, 2024-05-08T06:07:21.480 INFO:teuthology.orchestra.run.smithi151.stdout: "subtrees": 10, 2024-05-08T06:07:21.480 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse": 569, 2024-05-08T06:07:21.480 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_hit": 475, 2024-05-08T06:07:21.480 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_forward": 0, 2024-05-08T06:07:21.480 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_discover": 10, 2024-05-08T06:07:21.480 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_dir_fetch": 0, 2024-05-08T06:07:21.480 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_remote_ino": 0, 2024-05-08T06:07:21.480 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_lock": 0, 2024-05-08T06:07:21.480 INFO:teuthology.orchestra.run.smithi151.stdout: "load_cent": 0, 2024-05-08T06:07:21.480 INFO:teuthology.orchestra.run.smithi151.stdout: "q": 0, 2024-05-08T06:07:21.480 INFO:teuthology.orchestra.run.smithi151.stdout: "exported": 0, 2024-05-08T06:07:21.480 INFO:teuthology.orchestra.run.smithi151.stdout: "exported_inodes": 0, 2024-05-08T06:07:21.480 INFO:teuthology.orchestra.run.smithi151.stdout: "imported": 8, 2024-05-08T06:07:21.481 INFO:teuthology.orchestra.run.smithi151.stdout: "imported_inodes": 301, 2024-05-08T06:07:21.481 INFO:teuthology.orchestra.run.smithi151.stdout: "openino_dir_fetch": 0, 2024-05-08T06:07:21.481 INFO:teuthology.orchestra.run.smithi151.stdout: "openino_backtrace_fetch": 3979, 2024-05-08T06:07:21.481 INFO:teuthology.orchestra.run.smithi151.stdout: "openino_peer_discover": 1, 2024-05-08T06:07:21.481 INFO:teuthology.orchestra.run.smithi151.stdout: "root_rfiles": 1029, 2024-05-08T06:07:21.481 INFO:teuthology.orchestra.run.smithi151.stdout: "root_rbytes": 1712962860, 2024-05-08T06:07:21.481 INFO:teuthology.orchestra.run.smithi151.stdout: "root_rsnaps": 0, 2024-05-08T06:07:21.481 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_backtrace_fetch": 3979, 2024-05-08T06:07:21.481 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_set_tag": 0, 2024-05-08T06:07:21.481 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_backtrace_repaired": 0, 2024-05-08T06:07:21.481 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_inotable_repaired": 0, 2024-05-08T06:07:21.481 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_dir_inodes": 0, 2024-05-08T06:07:21.481 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_dir_base_inodes": 0, 2024-05-08T06:07:21.481 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_dirfrag_rstats": 0, 2024-05-08T06:07:21.481 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_file_inodes": 3979, 2024-05-08T06:07:21.482 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_inode_file_caps": 0, 2024-05-08T06:07:21.482 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_revoke": 1, 2024-05-08T06:07:21.482 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_grant": 266, 2024-05-08T06:07:21.482 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_trunc": 0, 2024-05-08T06:07:21.482 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-08T06:07:21.482 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-08T06:07:21.482 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_caps": 628, 2024-05-08T06:07:21.482 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_caps_dirty": 335, 2024-05-08T06:07:21.482 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_cap_release": 11, 2024-05-08T06:07:21.482 INFO:teuthology.orchestra.run.smithi151.stdout: "process_request_cap_release": 30 2024-05-08T06:07:21.482 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.482 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_cache": { 2024-05-08T06:07:21.482 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_update": 0, 2024-05-08T06:07:21.482 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_update_receipt": 0, 2024-05-08T06:07:21.482 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_try_discover": 0, 2024-05-08T06:07:21.483 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_send_discover": 4, 2024-05-08T06:07:21.483 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_handle_discover": 0, 2024-05-08T06:07:21.483 INFO:teuthology.orchestra.run.smithi151.stdout: "num_strays": 0, 2024-05-08T06:07:21.483 INFO:teuthology.orchestra.run.smithi151.stdout: "num_strays_delayed": 0, 2024-05-08T06:07:21.483 INFO:teuthology.orchestra.run.smithi151.stdout: "num_strays_enqueuing": 0, 2024-05-08T06:07:21.483 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_created": 5, 2024-05-08T06:07:21.483 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_enqueued": 5, 2024-05-08T06:07:21.483 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_reintegrated": 0, 2024-05-08T06:07:21.483 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_migrated": 0, 2024-05-08T06:07:21.483 INFO:teuthology.orchestra.run.smithi151.stdout: "num_recovering_processing": 0, 2024-05-08T06:07:21.483 INFO:teuthology.orchestra.run.smithi151.stdout: "num_recovering_enqueued": 0, 2024-05-08T06:07:21.483 INFO:teuthology.orchestra.run.smithi151.stdout: "num_recovering_prioritized": 0, 2024-05-08T06:07:21.483 INFO:teuthology.orchestra.run.smithi151.stdout: "recovery_started": 0, 2024-05-08T06:07:21.483 INFO:teuthology.orchestra.run.smithi151.stdout: "recovery_completed": 0, 2024-05-08T06:07:21.483 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_quiesce_path": 0, 2024-05-08T06:07:21.483 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_quiesce_inode": 0, 2024-05-08T06:07:21.484 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_enqueue_scrub": 0, 2024-05-08T06:07:21.484 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_exportdir": 0, 2024-05-08T06:07:21.484 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_flush": 0, 2024-05-08T06:07:21.484 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_fragmentdir": 0, 2024-05-08T06:07:21.484 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_fragstats": 0, 2024-05-08T06:07:21.484 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_inodestats": 0 2024-05-08T06:07:21.484 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.484 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_log": { 2024-05-08T06:07:21.484 INFO:teuthology.orchestra.run.smithi151.stdout: "evlrg": 0, 2024-05-08T06:07:21.484 INFO:teuthology.orchestra.run.smithi151.stdout: "evadd": 1680, 2024-05-08T06:07:21.484 INFO:teuthology.orchestra.run.smithi151.stdout: "evex": 0, 2024-05-08T06:07:21.484 INFO:teuthology.orchestra.run.smithi151.stdout: "evtrm": 0, 2024-05-08T06:07:21.484 INFO:teuthology.orchestra.run.smithi151.stdout: "ev": 1680, 2024-05-08T06:07:21.484 INFO:teuthology.orchestra.run.smithi151.stdout: "evexg": 0, 2024-05-08T06:07:21.484 INFO:teuthology.orchestra.run.smithi151.stdout: "evexd": 0, 2024-05-08T06:07:21.484 INFO:teuthology.orchestra.run.smithi151.stdout: "segadd": 3, 2024-05-08T06:07:21.485 INFO:teuthology.orchestra.run.smithi151.stdout: "segex": 0, 2024-05-08T06:07:21.485 INFO:teuthology.orchestra.run.smithi151.stdout: "segtrm": 0, 2024-05-08T06:07:21.485 INFO:teuthology.orchestra.run.smithi151.stdout: "seg": 3, 2024-05-08T06:07:21.485 INFO:teuthology.orchestra.run.smithi151.stdout: "segmjr": 2, 2024-05-08T06:07:21.485 INFO:teuthology.orchestra.run.smithi151.stdout: "segexg": 0, 2024-05-08T06:07:21.485 INFO:teuthology.orchestra.run.smithi151.stdout: "segexd": 0, 2024-05-08T06:07:21.485 INFO:teuthology.orchestra.run.smithi151.stdout: "expos": 4194304, 2024-05-08T06:07:21.485 INFO:teuthology.orchestra.run.smithi151.stdout: "wrpos": 6100660, 2024-05-08T06:07:21.485 INFO:teuthology.orchestra.run.smithi151.stdout: "rdpos": 0, 2024-05-08T06:07:21.485 INFO:teuthology.orchestra.run.smithi151.stdout: "jlat": { 2024-05-08T06:07:21.485 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 351, 2024-05-08T06:07:21.485 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 2.913643286, 2024-05-08T06:07:21.485 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.008300978 2024-05-08T06:07:21.485 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.485 INFO:teuthology.orchestra.run.smithi151.stdout: "replayed": 0 2024-05-08T06:07:21.486 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.486 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_mem": { 2024-05-08T06:07:21.486 INFO:teuthology.orchestra.run.smithi151.stdout: "ino": 326, 2024-05-08T06:07:21.486 INFO:teuthology.orchestra.run.smithi151.stdout: "ino+": 331, 2024-05-08T06:07:21.486 INFO:teuthology.orchestra.run.smithi151.stdout: "ino-": 5, 2024-05-08T06:07:21.486 INFO:teuthology.orchestra.run.smithi151.stdout: "dir": 27, 2024-05-08T06:07:21.486 INFO:teuthology.orchestra.run.smithi151.stdout: "dir+": 28, 2024-05-08T06:07:21.486 INFO:teuthology.orchestra.run.smithi151.stdout: "dir-": 1, 2024-05-08T06:07:21.486 INFO:teuthology.orchestra.run.smithi151.stdout: "dn": 329, 2024-05-08T06:07:21.486 INFO:teuthology.orchestra.run.smithi151.stdout: "dn+": 359, 2024-05-08T06:07:21.486 INFO:teuthology.orchestra.run.smithi151.stdout: "dn-": 30, 2024-05-08T06:07:21.486 INFO:teuthology.orchestra.run.smithi151.stdout: "cap": 306, 2024-05-08T06:07:21.486 INFO:teuthology.orchestra.run.smithi151.stdout: "cap+": 630, 2024-05-08T06:07:21.486 INFO:teuthology.orchestra.run.smithi151.stdout: "cap-": 324, 2024-05-08T06:07:21.487 INFO:teuthology.orchestra.run.smithi151.stdout: "rss": 57784, 2024-05-08T06:07:21.487 INFO:teuthology.orchestra.run.smithi151.stdout: "heap": 223608 2024-05-08T06:07:21.487 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.487 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_server": { 2024-05-08T06:07:21.487 INFO:teuthology.orchestra.run.smithi151.stdout: "dispatch_client_request": 374, 2024-05-08T06:07:21.487 INFO:teuthology.orchestra.run.smithi151.stdout: "dispatch_server_request": 0, 2024-05-08T06:07:21.487 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_request": 331, 2024-05-08T06:07:21.487 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_session": 24, 2024-05-08T06:07:21.487 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_peer_request": 17, 2024-05-08T06:07:21.487 INFO:teuthology.orchestra.run.smithi151.stdout: "req_create_latency": { 2024-05-08T06:07:21.487 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 11, 2024-05-08T06:07:21.487 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.023760128, 2024-05-08T06:07:21.487 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.002160011 2024-05-08T06:07:21.487 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.487 INFO:teuthology.orchestra.run.smithi151.stdout: "req_getattr_latency": { 2024-05-08T06:07:21.487 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 2, 2024-05-08T06:07:21.488 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.001627726, 2024-05-08T06:07:21.488 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000813863 2024-05-08T06:07:21.488 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.488 INFO:teuthology.orchestra.run.smithi151.stdout: "req_getfilelock_latency": { 2024-05-08T06:07:21.488 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:21.488 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:21.488 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:21.488 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.488 INFO:teuthology.orchestra.run.smithi151.stdout: "req_link_latency": { 2024-05-08T06:07:21.488 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:21.488 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:21.488 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:21.488 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.488 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookup_latency": { 2024-05-08T06:07:21.488 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 190, 2024-05-08T06:07:21.489 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.084104978, 2024-05-08T06:07:21.489 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000442657 2024-05-08T06:07:21.489 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.489 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookuphash_latency": { 2024-05-08T06:07:21.489 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:21.489 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:21.489 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:21.489 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.489 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupino_latency": { 2024-05-08T06:07:21.489 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:21.489 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:21.489 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:21.489 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.489 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupname_latency": { 2024-05-08T06:07:21.489 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:21.490 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:21.490 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:21.490 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.490 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupparent_latency": { 2024-05-08T06:07:21.490 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:21.490 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:21.490 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:21.490 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.490 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupsnap_latency": { 2024-05-08T06:07:21.490 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:21.490 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:21.490 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:21.490 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.490 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lssnap_latency": { 2024-05-08T06:07:21.490 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:21.491 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:21.491 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:21.491 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.491 INFO:teuthology.orchestra.run.smithi151.stdout: "req_mkdir_latency": { 2024-05-08T06:07:21.491 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:21.491 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:21.491 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:21.491 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.492 INFO:teuthology.orchestra.run.smithi151.stdout: "req_mknod_latency": { 2024-05-08T06:07:21.492 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:21.492 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:21.492 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:21.492 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.492 INFO:teuthology.orchestra.run.smithi151.stdout: "req_mksnap_latency": { 2024-05-08T06:07:21.492 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:21.492 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:21.492 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:21.492 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.492 INFO:teuthology.orchestra.run.smithi151.stdout: "req_open_latency": { 2024-05-08T06:07:21.492 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 112, 2024-05-08T06:07:21.492 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.067395909, 2024-05-08T06:07:21.492 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000601749 2024-05-08T06:07:21.493 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.493 INFO:teuthology.orchestra.run.smithi151.stdout: "req_readdir_latency": { 2024-05-08T06:07:21.493 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 8, 2024-05-08T06:07:21.493 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.007267549, 2024-05-08T06:07:21.493 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000908443 2024-05-08T06:07:21.493 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.493 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rename_latency": { 2024-05-08T06:07:21.493 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:21.493 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:21.493 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:21.493 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.493 INFO:teuthology.orchestra.run.smithi151.stdout: "req_renamesnap_latency": { 2024-05-08T06:07:21.493 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:21.493 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:21.493 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:21.494 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.494 INFO:teuthology.orchestra.run.smithi151.stdout: "req_snapdiff_latency": { 2024-05-08T06:07:21.494 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:21.494 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:21.494 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:21.494 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.494 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rmdir_latency": { 2024-05-08T06:07:21.494 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:21.494 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:21.494 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:21.494 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.495 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rmsnap_latency": { 2024-05-08T06:07:21.495 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:21.495 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:21.495 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:21.495 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.495 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rmxattr_latency": { 2024-05-08T06:07:21.495 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:21.495 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:21.495 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:21.495 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.495 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setattr_latency": { 2024-05-08T06:07:21.495 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:21.495 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:21.495 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:21.496 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.496 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setdirlayout_latency": { 2024-05-08T06:07:21.496 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:21.496 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:21.496 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:21.496 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.496 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setfilelock_latency": { 2024-05-08T06:07:21.496 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:21.496 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:21.496 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:21.496 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.496 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setlayout_latency": { 2024-05-08T06:07:21.496 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:21.496 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:21.496 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:21.497 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.497 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setxattr_latency": { 2024-05-08T06:07:21.497 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:21.497 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:21.497 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:21.497 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.497 INFO:teuthology.orchestra.run.smithi151.stdout: "req_symlink_latency": { 2024-05-08T06:07:21.497 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:21.497 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:21.497 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:21.497 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.497 INFO:teuthology.orchestra.run.smithi151.stdout: "req_unlink_latency": { 2024-05-08T06:07:21.497 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 5, 2024-05-08T06:07:21.497 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.008968505, 2024-05-08T06:07:21.497 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.001793701 2024-05-08T06:07:21.498 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.498 INFO:teuthology.orchestra.run.smithi151.stdout: "cap_revoke_eviction": 0, 2024-05-08T06:07:21.498 INFO:teuthology.orchestra.run.smithi151.stdout: "cap_acquisition_throttle": 0, 2024-05-08T06:07:21.498 INFO:teuthology.orchestra.run.smithi151.stdout: "req_getvxattr_latency": { 2024-05-08T06:07:21.498 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:21.498 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:21.498 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:21.498 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T06:07:21.498 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.498 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_sessions": { 2024-05-08T06:07:21.498 INFO:teuthology.orchestra.run.smithi151.stdout: "session_count": 1, 2024-05-08T06:07:21.498 INFO:teuthology.orchestra.run.smithi151.stdout: "session_add": 3, 2024-05-08T06:07:21.498 INFO:teuthology.orchestra.run.smithi151.stdout: "session_remove": 2, 2024-05-08T06:07:21.498 INFO:teuthology.orchestra.run.smithi151.stdout: "sessions_open": 1, 2024-05-08T06:07:21.498 INFO:teuthology.orchestra.run.smithi151.stdout: "sessions_stale": 0, 2024-05-08T06:07:21.499 INFO:teuthology.orchestra.run.smithi151.stdout: "total_load": 8, 2024-05-08T06:07:21.499 INFO:teuthology.orchestra.run.smithi151.stdout: "average_load": 8, 2024-05-08T06:07:21.499 INFO:teuthology.orchestra.run.smithi151.stdout: "avg_session_uptime": 1018, 2024-05-08T06:07:21.499 INFO:teuthology.orchestra.run.smithi151.stdout: "mdthresh_evicted": 0 2024-05-08T06:07:21.499 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.499 INFO:teuthology.orchestra.run.smithi151.stdout: "mempool": { 2024-05-08T06:07:21.499 INFO:teuthology.orchestra.run.smithi151.stdout: "bloom_filter_bytes": 0, 2024-05-08T06:07:21.499 INFO:teuthology.orchestra.run.smithi151.stdout: "bloom_filter_items": 0, 2024-05-08T06:07:21.499 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T06:07:21.499 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_alloc_items": 0, 2024-05-08T06:07:21.499 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T06:07:21.499 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_data_items": 0, 2024-05-08T06:07:21.500 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T06:07:21.500 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T06:07:21.500 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T06:07:21.500 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T06:07:21.500 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T06:07:21.500 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_other_items": 0, 2024-05-08T06:07:21.500 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T06:07:21.500 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T06:07:21.500 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_extent_bytes": 0, 2024-05-08T06:07:21.500 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_extent_items": 0, 2024-05-08T06:07:21.500 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_blob_bytes": 0, 2024-05-08T06:07:21.500 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_blob_items": 0, 2024-05-08T06:07:21.500 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T06:07:21.501 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T06:07:21.501 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T06:07:21.501 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T06:07:21.501 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T06:07:21.501 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_fsck_items": 0, 2024-05-08T06:07:21.501 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_txc_bytes": 0, 2024-05-08T06:07:21.501 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_txc_items": 0, 2024-05-08T06:07:21.501 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T06:07:21.501 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T06:07:21.501 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_bytes": 0, 2024-05-08T06:07:21.501 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_items": 0, 2024-05-08T06:07:21.501 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_bytes": 0, 2024-05-08T06:07:21.501 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_items": 0, 2024-05-08T06:07:21.501 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T06:07:21.501 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_reader_items": 0, 2024-05-08T06:07:21.502 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T06:07:21.502 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_writer_items": 0, 2024-05-08T06:07:21.502 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_anon_bytes": 293280, 2024-05-08T06:07:21.502 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_anon_items": 412, 2024-05-08T06:07:21.502 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_meta_bytes": 0, 2024-05-08T06:07:21.502 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_meta_items": 0, 2024-05-08T06:07:21.502 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_bytes": 0, 2024-05-08T06:07:21.502 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_items": 0, 2024-05-08T06:07:21.502 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_mapbl_bytes": 0, 2024-05-08T06:07:21.502 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_mapbl_items": 0, 2024-05-08T06:07:21.502 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_pglog_bytes": 0, 2024-05-08T06:07:21.502 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_pglog_items": 0, 2024-05-08T06:07:21.502 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_bytes": 7528, 2024-05-08T06:07:21.502 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_items": 158, 2024-05-08T06:07:21.502 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T06:07:21.503 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_mapping_items": 0, 2024-05-08T06:07:21.503 INFO:teuthology.orchestra.run.smithi151.stdout: "pgmap_bytes": 0, 2024-05-08T06:07:21.503 INFO:teuthology.orchestra.run.smithi151.stdout: "pgmap_items": 0, 2024-05-08T06:07:21.503 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_co_bytes": 1148770, 2024-05-08T06:07:21.503 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_co_items": 12442, 2024-05-08T06:07:21.503 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_1_bytes": 0, 2024-05-08T06:07:21.503 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_1_items": 0, 2024-05-08T06:07:21.503 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_2_bytes": 0, 2024-05-08T06:07:21.503 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_2_items": 0 2024-05-08T06:07:21.503 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.503 INFO:teuthology.orchestra.run.smithi151.stdout: "objecter": { 2024-05-08T06:07:21.503 INFO:teuthology.orchestra.run.smithi151.stdout: "op_active": 0, 2024-05-08T06:07:21.503 INFO:teuthology.orchestra.run.smithi151.stdout: "op_laggy": 0, 2024-05-08T06:07:21.503 INFO:teuthology.orchestra.run.smithi151.stdout: "op_send": 4478, 2024-05-08T06:07:21.503 INFO:teuthology.orchestra.run.smithi151.stdout: "op_send_bytes": 1980081, 2024-05-08T06:07:21.504 INFO:teuthology.orchestra.run.smithi151.stdout: "op_resend": 33, 2024-05-08T06:07:21.504 INFO:teuthology.orchestra.run.smithi151.stdout: "op_reply": 4478, 2024-05-08T06:07:21.504 INFO:teuthology.orchestra.run.smithi151.stdout: "op_latency": { 2024-05-08T06:07:21.504 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 4478, 2024-05-08T06:07:21.504 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 9.238891321, 2024-05-08T06:07:21.504 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.002063173 2024-05-08T06:07:21.504 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.504 INFO:teuthology.orchestra.run.smithi151.stdout: "op_inflight": 0, 2024-05-08T06:07:21.504 INFO:teuthology.orchestra.run.smithi151.stdout: "oplen_avg": { 2024-05-08T06:07:21.504 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 4478, 2024-05-08T06:07:21.504 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 4541 2024-05-08T06:07:21.504 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.505 INFO:teuthology.orchestra.run.smithi151.stdout: "op": 4478, 2024-05-08T06:07:21.505 INFO:teuthology.orchestra.run.smithi151.stdout: "op_r": 3980, 2024-05-08T06:07:21.505 INFO:teuthology.orchestra.run.smithi151.stdout: "op_w": 498, 2024-05-08T06:07:21.505 INFO:teuthology.orchestra.run.smithi151.stdout: "op_rmw": 0, 2024-05-08T06:07:21.505 INFO:teuthology.orchestra.run.smithi151.stdout: "op_pg": 0, 2024-05-08T06:07:21.505 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_stat": 0, 2024-05-08T06:07:21.505 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_create": 10, 2024-05-08T06:07:21.505 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_read": 1, 2024-05-08T06:07:21.505 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_write": 352, 2024-05-08T06:07:21.505 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_writefull": 66, 2024-05-08T06:07:21.505 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_writesame": 0, 2024-05-08T06:07:21.505 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_append": 0, 2024-05-08T06:07:21.505 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_zero": 0, 2024-05-08T06:07:21.505 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_truncate": 0, 2024-05-08T06:07:21.505 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_delete": 17, 2024-05-08T06:07:21.506 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_mapext": 0, 2024-05-08T06:07:21.506 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_sparse_read": 0, 2024-05-08T06:07:21.506 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_clonerange": 0, 2024-05-08T06:07:21.506 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_getxattr": 3979, 2024-05-08T06:07:21.506 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_setxattr": 20, 2024-05-08T06:07:21.506 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_cmpxattr": 0, 2024-05-08T06:07:21.506 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_rmxattr": 0, 2024-05-08T06:07:21.506 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_resetxattrs": 0, 2024-05-08T06:07:21.506 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_call": 0, 2024-05-08T06:07:21.506 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_watch": 0, 2024-05-08T06:07:21.506 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_notify": 0, 2024-05-08T06:07:21.506 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_src_cmpxattr": 0, 2024-05-08T06:07:21.506 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_pgls": 0, 2024-05-08T06:07:21.506 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_pgls_filter": 0, 2024-05-08T06:07:21.506 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_other": 0, 2024-05-08T06:07:21.507 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_active": 0, 2024-05-08T06:07:21.507 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_send": 0, 2024-05-08T06:07:21.507 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_resend": 0, 2024-05-08T06:07:21.507 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_ping": 0, 2024-05-08T06:07:21.507 INFO:teuthology.orchestra.run.smithi151.stdout: "poolop_active": 0, 2024-05-08T06:07:21.507 INFO:teuthology.orchestra.run.smithi151.stdout: "poolop_send": 0, 2024-05-08T06:07:21.507 INFO:teuthology.orchestra.run.smithi151.stdout: "poolop_resend": 0, 2024-05-08T06:07:21.507 INFO:teuthology.orchestra.run.smithi151.stdout: "poolstat_active": 0, 2024-05-08T06:07:21.507 INFO:teuthology.orchestra.run.smithi151.stdout: "poolstat_send": 0, 2024-05-08T06:07:21.507 INFO:teuthology.orchestra.run.smithi151.stdout: "poolstat_resend": 0, 2024-05-08T06:07:21.507 INFO:teuthology.orchestra.run.smithi151.stdout: "statfs_active": 0, 2024-05-08T06:07:21.507 INFO:teuthology.orchestra.run.smithi151.stdout: "statfs_send": 0, 2024-05-08T06:07:21.507 INFO:teuthology.orchestra.run.smithi151.stdout: "statfs_resend": 0, 2024-05-08T06:07:21.507 INFO:teuthology.orchestra.run.smithi151.stdout: "command_active": 0, 2024-05-08T06:07:21.507 INFO:teuthology.orchestra.run.smithi151.stdout: "command_send": 0, 2024-05-08T06:07:21.508 INFO:teuthology.orchestra.run.smithi151.stdout: "command_resend": 0, 2024-05-08T06:07:21.508 INFO:teuthology.orchestra.run.smithi151.stdout: "map_epoch": 82, 2024-05-08T06:07:21.508 INFO:teuthology.orchestra.run.smithi151.stdout: "map_full": 0, 2024-05-08T06:07:21.508 INFO:teuthology.orchestra.run.smithi151.stdout: "map_inc": 2, 2024-05-08T06:07:21.508 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_sessions": 12, 2024-05-08T06:07:21.508 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_session_open": 12, 2024-05-08T06:07:21.508 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_session_close": 0, 2024-05-08T06:07:21.508 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_laggy": 0, 2024-05-08T06:07:21.508 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_wr": 80, 2024-05-08T06:07:21.508 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_rd": 0, 2024-05-08T06:07:21.508 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_del": 16 2024-05-08T06:07:21.508 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.508 INFO:teuthology.orchestra.run.smithi151.stdout: "oft": { 2024-05-08T06:07:21.508 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_objs": 1, 2024-05-08T06:07:21.508 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_kv_pairs": 0, 2024-05-08T06:07:21.508 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_updates": 0, 2024-05-08T06:07:21.509 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_removes": 0 2024-05-08T06:07:21.509 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.509 INFO:teuthology.orchestra.run.smithi151.stdout: "osd-slow-ops": { 2024-05-08T06:07:21.509 INFO:teuthology.orchestra.run.smithi151.stdout: "slow_ops_count": 0 2024-05-08T06:07:21.509 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.509 INFO:teuthology.orchestra.run.smithi151.stdout: "purge_queue": { 2024-05-08T06:07:21.509 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing_ops": 0, 2024-05-08T06:07:21.509 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing_ops_high_water": 5, 2024-05-08T06:07:21.509 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing": 0, 2024-05-08T06:07:21.509 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing_high_water": 5, 2024-05-08T06:07:21.509 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executed_ops": 5, 2024-05-08T06:07:21.509 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executed": 5, 2024-05-08T06:07:21.509 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_item_in_journal": 0 2024-05-08T06:07:21.509 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.509 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T06:07:21.510 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-05-08T06:07:21.510 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 104857600, 2024-05-08T06:07:21.510 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-05-08T06:07:21.510 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 7408, 2024-05-08T06:07:21.510 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 2496579, 2024-05-08T06:07:21.510 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-05-08T06:07:21.510 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 7408, 2024-05-08T06:07:21.510 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 0, 2024-05-08T06:07:21.510 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 0, 2024-05-08T06:07:21.510 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 7408, 2024-05-08T06:07:21.510 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 2496579, 2024-05-08T06:07:21.510 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-05-08T06:07:21.510 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:21.510 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:21.511 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:21.511 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T06:07:21.511 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.511 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-objecter_bytes": { 2024-05-08T06:07:21.511 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-05-08T06:07:21.511 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 104857600, 2024-05-08T06:07:21.511 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-05-08T06:07:21.511 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 0, 2024-05-08T06:07:21.511 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 0, 2024-05-08T06:07:21.511 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-05-08T06:07:21.511 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 0, 2024-05-08T06:07:21.511 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 4478, 2024-05-08T06:07:21.511 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 1980586, 2024-05-08T06:07:21.511 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 4478, 2024-05-08T06:07:21.511 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 1980586, 2024-05-08T06:07:21.511 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-05-08T06:07:21.512 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:21.512 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:21.512 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:21.512 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T06:07:21.512 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.512 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-objecter_ops": { 2024-05-08T06:07:21.512 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-05-08T06:07:21.512 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 1024, 2024-05-08T06:07:21.512 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-05-08T06:07:21.512 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 0, 2024-05-08T06:07:21.512 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 0, 2024-05-08T06:07:21.512 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-05-08T06:07:21.512 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 0, 2024-05-08T06:07:21.512 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 4478, 2024-05-08T06:07:21.512 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 4478, 2024-05-08T06:07:21.513 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 4478, 2024-05-08T06:07:21.513 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 4478, 2024-05-08T06:07:21.513 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-05-08T06:07:21.513 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:21.513 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:21.513 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:21.513 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T06:07:21.513 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.513 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-write_buf_throttle": { 2024-05-08T06:07:21.513 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-05-08T06:07:21.513 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 3758096384, 2024-05-08T06:07:21.513 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-05-08T06:07:21.513 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 5, 2024-05-08T06:07:21.513 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 505, 2024-05-08T06:07:21.513 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-05-08T06:07:21.513 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 5, 2024-05-08T06:07:21.514 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 0, 2024-05-08T06:07:21.514 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 0, 2024-05-08T06:07:21.514 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 1, 2024-05-08T06:07:21.514 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 505, 2024-05-08T06:07:21.514 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-05-08T06:07:21.514 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:21.514 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:21.514 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:21.514 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T06:07:21.514 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:21.514 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-write_buf_throttle-0x560b6ce5e500": { 2024-05-08T06:07:21.514 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-05-08T06:07:21.514 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 3758096384, 2024-05-08T06:07:21.514 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-05-08T06:07:21.514 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 1680, 2024-05-08T06:07:21.515 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 1906356, 2024-05-08T06:07:21.515 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-05-08T06:07:21.515 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 1680, 2024-05-08T06:07:21.515 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 0, 2024-05-08T06:07:21.515 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 0, 2024-05-08T06:07:21.515 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 351, 2024-05-08T06:07:21.515 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 1906356, 2024-05-08T06:07:21.515 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-05-08T06:07:21.515 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:21.515 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:21.515 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:21.515 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T06:07:21.515 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T06:07:21.515 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T06:07:22.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:21 smithi151 ceph-mon[34815]: pgmap v960: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-05-08T06:07:22.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:21 smithi082 ceph-mon[30098]: pgmap v960: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-05-08T06:07:22.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:21 smithi134 ceph-mon[34132]: pgmap v960: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-05-08T06:07:22.279 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-05-08T06:07:22.279 INFO:tasks.check_counter:Daemon mds.f mds.imported=8 2024-05-08T06:07:22.279 DEBUG:tasks.check_counter:Getting stats from i 2024-05-08T06:07:22.279 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph daemon mds.i perf dump 2024-05-08T06:07:22.520 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T06:07:24.006 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:23 smithi151 ceph-mon[34815]: pgmap v961: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 9 op/s 2024-05-08T06:07:24.221 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:23 smithi082 ceph-mon[30098]: pgmap v961: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 9 op/s 2024-05-08T06:07:24.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:23 smithi134 ceph-mon[34132]: pgmap v961: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 426 B/s wr, 9 op/s 2024-05-08T06:07:24.286 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T06:07:24.286 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T06:07:24.286 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 43, 2024-05-08T06:07:24.286 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 51, 2024-05-08T06:07:24.286 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 12599, 2024-05-08T06:07:24.286 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 63843, 2024-05-08T06:07:24.287 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 13, 2024-05-08T06:07:24.287 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 4, 2024-05-08T06:07:24.287 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 0.018780544, 2024-05-08T06:07:24.287 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 0.003489308, 2024-05-08T06:07:24.287 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 0.010858881, 2024-05-08T06:07:24.287 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 0.000538320, 2024-05-08T06:07:24.287 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T06:07:24.287 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 45, 2024-05-08T06:07:24.287 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.017638418, 2024-05-08T06:07:24.287 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000391964 2024-05-08T06:07:24.287 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.287 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2024-05-08T06:07:24.287 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 38, 2024-05-08T06:07:24.287 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000007572, 2024-05-08T06:07:24.287 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000199 2024-05-08T06:07:24.288 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.288 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 6272, 2024-05-08T06:07:24.288 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 4272 2024-05-08T06:07:24.288 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.288 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T06:07:24.288 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 1041, 2024-05-08T06:07:24.288 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 1222, 2024-05-08T06:07:24.288 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 1072130, 2024-05-08T06:07:24.288 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 550835, 2024-05-08T06:07:24.288 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 9, 2024-05-08T06:07:24.288 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 4, 2024-05-08T06:07:24.288 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 0.133163563, 2024-05-08T06:07:24.288 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 0.048480136, 2024-05-08T06:07:24.288 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 0.070031946, 2024-05-08T06:07:24.288 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 0.016598368, 2024-05-08T06:07:24.289 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T06:07:24.289 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 1226, 2024-05-08T06:07:24.289 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.076416669, 2024-05-08T06:07:24.289 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000062330 2024-05-08T06:07:24.289 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.289 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2024-05-08T06:07:24.289 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 1422, 2024-05-08T06:07:24.289 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000358188, 2024-05-08T06:07:24.289 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000251 2024-05-08T06:07:24.289 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.289 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 926496, 2024-05-08T06:07:24.289 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 223648 2024-05-08T06:07:24.289 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.289 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T06:07:24.289 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 44, 2024-05-08T06:07:24.290 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 311, 2024-05-08T06:07:24.290 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 8105, 2024-05-08T06:07:24.290 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 978618, 2024-05-08T06:07:24.290 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 37, 2024-05-08T06:07:24.290 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 6, 2024-05-08T06:07:24.290 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 0.025658668, 2024-05-08T06:07:24.290 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 0.011444073, 2024-05-08T06:07:24.290 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 0.010514093, 2024-05-08T06:07:24.290 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 0.000352732, 2024-05-08T06:07:24.290 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T06:07:24.290 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 309, 2024-05-08T06:07:24.290 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.025699097, 2024-05-08T06:07:24.290 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000083168 2024-05-08T06:07:24.291 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.291 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2024-05-08T06:07:24.291 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 35, 2024-05-08T06:07:24.291 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000004386, 2024-05-08T06:07:24.291 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000125 2024-05-08T06:07:24.291 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.291 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 1248, 2024-05-08T06:07:24.291 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 634576 2024-05-08T06:07:24.291 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.291 INFO:teuthology.orchestra.run.smithi151.stdout: "cct": { 2024-05-08T06:07:24.291 INFO:teuthology.orchestra.run.smithi151.stdout: "total_workers": 1, 2024-05-08T06:07:24.291 INFO:teuthology.orchestra.run.smithi151.stdout: "unhealthy_workers": 0 2024-05-08T06:07:24.291 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.291 INFO:teuthology.orchestra.run.smithi151.stdout: "finisher-MDSRank": { 2024-05-08T06:07:24.291 INFO:teuthology.orchestra.run.smithi151.stdout: "queue_len": 0, 2024-05-08T06:07:24.292 INFO:teuthology.orchestra.run.smithi151.stdout: "complete_latency": { 2024-05-08T06:07:24.292 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 52, 2024-05-08T06:07:24.292 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.001946244, 2024-05-08T06:07:24.292 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000037427 2024-05-08T06:07:24.292 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T06:07:24.292 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.292 INFO:teuthology.orchestra.run.smithi151.stdout: "finisher-PurgeQueue": { 2024-05-08T06:07:24.292 INFO:teuthology.orchestra.run.smithi151.stdout: "queue_len": 0, 2024-05-08T06:07:24.292 INFO:teuthology.orchestra.run.smithi151.stdout: "complete_latency": { 2024-05-08T06:07:24.292 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 2, 2024-05-08T06:07:24.292 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000008352, 2024-05-08T06:07:24.292 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000004176 2024-05-08T06:07:24.292 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T06:07:24.292 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.292 INFO:teuthology.orchestra.run.smithi151.stdout: "mds": { 2024-05-08T06:07:24.293 INFO:teuthology.orchestra.run.smithi151.stdout: "request": 2, 2024-05-08T06:07:24.293 INFO:teuthology.orchestra.run.smithi151.stdout: "reply": 1, 2024-05-08T06:07:24.293 INFO:teuthology.orchestra.run.smithi151.stdout: "reply_latency": { 2024-05-08T06:07:24.293 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 1, 2024-05-08T06:07:24.293 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000989085, 2024-05-08T06:07:24.293 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000989085 2024-05-08T06:07:24.293 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.293 INFO:teuthology.orchestra.run.smithi151.stdout: "slow_reply": 0, 2024-05-08T06:07:24.293 INFO:teuthology.orchestra.run.smithi151.stdout: "forward": 1, 2024-05-08T06:07:24.293 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_fetch_complete": 0, 2024-05-08T06:07:24.293 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_fetch_keys": 0, 2024-05-08T06:07:24.293 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_commit": 11, 2024-05-08T06:07:24.293 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_split": 0, 2024-05-08T06:07:24.293 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_merge": 0, 2024-05-08T06:07:24.293 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes": 14, 2024-05-08T06:07:24.294 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_top": 0, 2024-05-08T06:07:24.294 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_bottom": 14, 2024-05-08T06:07:24.294 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_pin_tail": 0, 2024-05-08T06:07:24.294 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_pinned": 14, 2024-05-08T06:07:24.294 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_expired": 0, 2024-05-08T06:07:24.294 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_with_caps": 1, 2024-05-08T06:07:24.294 INFO:teuthology.orchestra.run.smithi151.stdout: "caps": 1, 2024-05-08T06:07:24.294 INFO:teuthology.orchestra.run.smithi151.stdout: "subtrees": 2, 2024-05-08T06:07:24.294 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse": 3, 2024-05-08T06:07:24.294 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_hit": 1, 2024-05-08T06:07:24.294 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_forward": 0, 2024-05-08T06:07:24.294 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_discover": 1, 2024-05-08T06:07:24.294 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_dir_fetch": 0, 2024-05-08T06:07:24.294 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_remote_ino": 0, 2024-05-08T06:07:24.295 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_lock": 0, 2024-05-08T06:07:24.295 INFO:teuthology.orchestra.run.smithi151.stdout: "load_cent": 0, 2024-05-08T06:07:24.295 INFO:teuthology.orchestra.run.smithi151.stdout: "q": 0, 2024-05-08T06:07:24.295 INFO:teuthology.orchestra.run.smithi151.stdout: "exported": 0, 2024-05-08T06:07:24.295 INFO:teuthology.orchestra.run.smithi151.stdout: "exported_inodes": 0, 2024-05-08T06:07:24.295 INFO:teuthology.orchestra.run.smithi151.stdout: "imported": 0, 2024-05-08T06:07:24.295 INFO:teuthology.orchestra.run.smithi151.stdout: "imported_inodes": 0, 2024-05-08T06:07:24.295 INFO:teuthology.orchestra.run.smithi151.stdout: "openino_dir_fetch": 0, 2024-05-08T06:07:24.295 INFO:teuthology.orchestra.run.smithi151.stdout: "openino_backtrace_fetch": 0, 2024-05-08T06:07:24.295 INFO:teuthology.orchestra.run.smithi151.stdout: "openino_peer_discover": 0, 2024-05-08T06:07:24.295 INFO:teuthology.orchestra.run.smithi151.stdout: "root_rfiles": 1029, 2024-05-08T06:07:24.295 INFO:teuthology.orchestra.run.smithi151.stdout: "root_rbytes": 1712962860, 2024-05-08T06:07:24.295 INFO:teuthology.orchestra.run.smithi151.stdout: "root_rsnaps": 0, 2024-05-08T06:07:24.295 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_backtrace_fetch": 0, 2024-05-08T06:07:24.295 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_set_tag": 0, 2024-05-08T06:07:24.296 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_backtrace_repaired": 0, 2024-05-08T06:07:24.296 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_inotable_repaired": 0, 2024-05-08T06:07:24.296 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_dir_inodes": 0, 2024-05-08T06:07:24.296 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_dir_base_inodes": 0, 2024-05-08T06:07:24.296 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_dirfrag_rstats": 0, 2024-05-08T06:07:24.296 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_file_inodes": 0, 2024-05-08T06:07:24.296 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_inode_file_caps": 0, 2024-05-08T06:07:24.296 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_revoke": 1, 2024-05-08T06:07:24.296 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_grant": 2, 2024-05-08T06:07:24.296 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_trunc": 0, 2024-05-08T06:07:24.296 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-08T06:07:24.296 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-08T06:07:24.296 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_caps": 1, 2024-05-08T06:07:24.296 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_caps_dirty": 0, 2024-05-08T06:07:24.296 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_cap_release": 0, 2024-05-08T06:07:24.297 INFO:teuthology.orchestra.run.smithi151.stdout: "process_request_cap_release": 1 2024-05-08T06:07:24.297 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.297 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_cache": { 2024-05-08T06:07:24.297 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_update": 0, 2024-05-08T06:07:24.297 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_update_receipt": 0, 2024-05-08T06:07:24.297 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_try_discover": 0, 2024-05-08T06:07:24.297 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_send_discover": 2, 2024-05-08T06:07:24.297 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_handle_discover": 0, 2024-05-08T06:07:24.297 INFO:teuthology.orchestra.run.smithi151.stdout: "num_strays": 0, 2024-05-08T06:07:24.297 INFO:teuthology.orchestra.run.smithi151.stdout: "num_strays_delayed": 0, 2024-05-08T06:07:24.297 INFO:teuthology.orchestra.run.smithi151.stdout: "num_strays_enqueuing": 0, 2024-05-08T06:07:24.297 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_created": 0, 2024-05-08T06:07:24.297 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_enqueued": 0, 2024-05-08T06:07:24.297 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_reintegrated": 0, 2024-05-08T06:07:24.297 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_migrated": 0, 2024-05-08T06:07:24.297 INFO:teuthology.orchestra.run.smithi151.stdout: "num_recovering_processing": 0, 2024-05-08T06:07:24.298 INFO:teuthology.orchestra.run.smithi151.stdout: "num_recovering_enqueued": 0, 2024-05-08T06:07:24.298 INFO:teuthology.orchestra.run.smithi151.stdout: "num_recovering_prioritized": 0, 2024-05-08T06:07:24.298 INFO:teuthology.orchestra.run.smithi151.stdout: "recovery_started": 0, 2024-05-08T06:07:24.298 INFO:teuthology.orchestra.run.smithi151.stdout: "recovery_completed": 0, 2024-05-08T06:07:24.298 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_quiesce_path": 0, 2024-05-08T06:07:24.298 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_quiesce_inode": 0, 2024-05-08T06:07:24.298 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_enqueue_scrub": 0, 2024-05-08T06:07:24.298 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_exportdir": 0, 2024-05-08T06:07:24.298 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_flush": 0, 2024-05-08T06:07:24.298 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_fragmentdir": 0, 2024-05-08T06:07:24.298 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_fragstats": 0, 2024-05-08T06:07:24.298 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_inodestats": 0 2024-05-08T06:07:24.298 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.298 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_log": { 2024-05-08T06:07:24.299 INFO:teuthology.orchestra.run.smithi151.stdout: "evlrg": 0, 2024-05-08T06:07:24.299 INFO:teuthology.orchestra.run.smithi151.stdout: "evadd": 5, 2024-05-08T06:07:24.299 INFO:teuthology.orchestra.run.smithi151.stdout: "evex": 0, 2024-05-08T06:07:24.299 INFO:teuthology.orchestra.run.smithi151.stdout: "evtrm": 0, 2024-05-08T06:07:24.299 INFO:teuthology.orchestra.run.smithi151.stdout: "ev": 5, 2024-05-08T06:07:24.299 INFO:teuthology.orchestra.run.smithi151.stdout: "evexg": 0, 2024-05-08T06:07:24.299 INFO:teuthology.orchestra.run.smithi151.stdout: "evexd": 0, 2024-05-08T06:07:24.299 INFO:teuthology.orchestra.run.smithi151.stdout: "segadd": 2, 2024-05-08T06:07:24.299 INFO:teuthology.orchestra.run.smithi151.stdout: "segex": 0, 2024-05-08T06:07:24.299 INFO:teuthology.orchestra.run.smithi151.stdout: "segtrm": 0, 2024-05-08T06:07:24.299 INFO:teuthology.orchestra.run.smithi151.stdout: "seg": 2, 2024-05-08T06:07:24.299 INFO:teuthology.orchestra.run.smithi151.stdout: "segmjr": 2, 2024-05-08T06:07:24.299 INFO:teuthology.orchestra.run.smithi151.stdout: "segexg": 0, 2024-05-08T06:07:24.299 INFO:teuthology.orchestra.run.smithi151.stdout: "segexd": 0, 2024-05-08T06:07:24.299 INFO:teuthology.orchestra.run.smithi151.stdout: "expos": 4194304, 2024-05-08T06:07:24.299 INFO:teuthology.orchestra.run.smithi151.stdout: "wrpos": 4195734, 2024-05-08T06:07:24.300 INFO:teuthology.orchestra.run.smithi151.stdout: "rdpos": 0, 2024-05-08T06:07:24.300 INFO:teuthology.orchestra.run.smithi151.stdout: "jlat": { 2024-05-08T06:07:24.300 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 4, 2024-05-08T06:07:24.300 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.007353203, 2024-05-08T06:07:24.300 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.001838300 2024-05-08T06:07:24.300 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.300 INFO:teuthology.orchestra.run.smithi151.stdout: "replayed": 0 2024-05-08T06:07:24.300 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.300 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_mem": { 2024-05-08T06:07:24.300 INFO:teuthology.orchestra.run.smithi151.stdout: "ino": 17, 2024-05-08T06:07:24.300 INFO:teuthology.orchestra.run.smithi151.stdout: "ino+": 17, 2024-05-08T06:07:24.300 INFO:teuthology.orchestra.run.smithi151.stdout: "ino-": 0, 2024-05-08T06:07:24.300 INFO:teuthology.orchestra.run.smithi151.stdout: "dir": 15, 2024-05-08T06:07:24.300 INFO:teuthology.orchestra.run.smithi151.stdout: "dir+": 16, 2024-05-08T06:07:24.300 INFO:teuthology.orchestra.run.smithi151.stdout: "dir-": 1, 2024-05-08T06:07:24.301 INFO:teuthology.orchestra.run.smithi151.stdout: "dn": 14, 2024-05-08T06:07:24.301 INFO:teuthology.orchestra.run.smithi151.stdout: "dn+": 14, 2024-05-08T06:07:24.301 INFO:teuthology.orchestra.run.smithi151.stdout: "dn-": 0, 2024-05-08T06:07:24.301 INFO:teuthology.orchestra.run.smithi151.stdout: "cap": 1, 2024-05-08T06:07:24.301 INFO:teuthology.orchestra.run.smithi151.stdout: "cap+": 1, 2024-05-08T06:07:24.301 INFO:teuthology.orchestra.run.smithi151.stdout: "cap-": 0, 2024-05-08T06:07:24.301 INFO:teuthology.orchestra.run.smithi151.stdout: "rss": 53248, 2024-05-08T06:07:24.301 INFO:teuthology.orchestra.run.smithi151.stdout: "heap": 223608 2024-05-08T06:07:24.301 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.301 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_server": { 2024-05-08T06:07:24.301 INFO:teuthology.orchestra.run.smithi151.stdout: "dispatch_client_request": 3, 2024-05-08T06:07:24.301 INFO:teuthology.orchestra.run.smithi151.stdout: "dispatch_server_request": 0, 2024-05-08T06:07:24.301 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_request": 2, 2024-05-08T06:07:24.301 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_session": 18, 2024-05-08T06:07:24.301 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_peer_request": 0, 2024-05-08T06:07:24.301 INFO:teuthology.orchestra.run.smithi151.stdout: "req_create_latency": { 2024-05-08T06:07:24.302 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:24.302 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:24.302 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:24.302 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.302 INFO:teuthology.orchestra.run.smithi151.stdout: "req_getattr_latency": { 2024-05-08T06:07:24.302 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 1, 2024-05-08T06:07:24.302 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000989085, 2024-05-08T06:07:24.302 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000989085 2024-05-08T06:07:24.302 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.302 INFO:teuthology.orchestra.run.smithi151.stdout: "req_getfilelock_latency": { 2024-05-08T06:07:24.302 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:24.302 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:24.302 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:24.302 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.302 INFO:teuthology.orchestra.run.smithi151.stdout: "req_link_latency": { 2024-05-08T06:07:24.303 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:24.303 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:24.303 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:24.303 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.303 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookup_latency": { 2024-05-08T06:07:24.303 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:24.303 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:24.303 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:24.303 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.303 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookuphash_latency": { 2024-05-08T06:07:24.303 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:24.303 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:24.303 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:24.303 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.303 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupino_latency": { 2024-05-08T06:07:24.303 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:24.303 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:24.304 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:24.304 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.304 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupname_latency": { 2024-05-08T06:07:24.304 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:24.304 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:24.304 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:24.304 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.304 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupparent_latency": { 2024-05-08T06:07:24.304 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:24.304 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:24.304 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:24.304 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.304 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupsnap_latency": { 2024-05-08T06:07:24.304 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:24.304 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:24.304 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:24.305 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.305 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lssnap_latency": { 2024-05-08T06:07:24.305 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:24.305 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:24.305 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:24.305 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.305 INFO:teuthology.orchestra.run.smithi151.stdout: "req_mkdir_latency": { 2024-05-08T06:07:24.305 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:24.306 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:24.306 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:24.306 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.306 INFO:teuthology.orchestra.run.smithi151.stdout: "req_mknod_latency": { 2024-05-08T06:07:24.306 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:24.306 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:24.306 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:24.306 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.306 INFO:teuthology.orchestra.run.smithi151.stdout: "req_mksnap_latency": { 2024-05-08T06:07:24.306 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:24.306 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:24.307 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:24.307 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.307 INFO:teuthology.orchestra.run.smithi151.stdout: "req_open_latency": { 2024-05-08T06:07:24.307 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:24.307 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:24.307 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:24.307 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.307 INFO:teuthology.orchestra.run.smithi151.stdout: "req_readdir_latency": { 2024-05-08T06:07:24.307 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:24.307 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:24.307 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:24.307 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.307 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rename_latency": { 2024-05-08T06:07:24.307 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:24.307 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:24.307 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:24.307 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.308 INFO:teuthology.orchestra.run.smithi151.stdout: "req_renamesnap_latency": { 2024-05-08T06:07:24.308 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:24.308 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:24.308 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:24.308 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.308 INFO:teuthology.orchestra.run.smithi151.stdout: "req_snapdiff_latency": { 2024-05-08T06:07:24.308 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:24.308 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:24.308 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:24.308 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.308 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rmdir_latency": { 2024-05-08T06:07:24.308 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:24.308 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:24.308 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:24.308 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.309 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rmsnap_latency": { 2024-05-08T06:07:24.309 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:24.309 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:24.309 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:24.309 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.309 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rmxattr_latency": { 2024-05-08T06:07:24.309 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:24.309 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:24.309 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:24.309 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.309 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setattr_latency": { 2024-05-08T06:07:24.309 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:24.309 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:24.309 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:24.309 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.309 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setdirlayout_latency": { 2024-05-08T06:07:24.310 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:24.310 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:24.310 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:24.310 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.310 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setfilelock_latency": { 2024-05-08T06:07:24.310 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:24.310 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:24.310 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:24.310 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.310 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setlayout_latency": { 2024-05-08T06:07:24.310 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:24.310 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:24.310 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:24.310 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.311 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setxattr_latency": { 2024-05-08T06:07:24.311 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:24.311 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:24.311 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:24.311 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.311 INFO:teuthology.orchestra.run.smithi151.stdout: "req_symlink_latency": { 2024-05-08T06:07:24.311 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:24.311 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:24.311 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:24.311 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.311 INFO:teuthology.orchestra.run.smithi151.stdout: "req_unlink_latency": { 2024-05-08T06:07:24.311 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:24.312 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:24.312 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:24.312 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.312 INFO:teuthology.orchestra.run.smithi151.stdout: "cap_revoke_eviction": 0, 2024-05-08T06:07:24.312 INFO:teuthology.orchestra.run.smithi151.stdout: "cap_acquisition_throttle": 0, 2024-05-08T06:07:24.312 INFO:teuthology.orchestra.run.smithi151.stdout: "req_getvxattr_latency": { 2024-05-08T06:07:24.312 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:24.312 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:24.312 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:24.312 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T06:07:24.312 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.312 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_sessions": { 2024-05-08T06:07:24.312 INFO:teuthology.orchestra.run.smithi151.stdout: "session_count": 1, 2024-05-08T06:07:24.312 INFO:teuthology.orchestra.run.smithi151.stdout: "session_add": 2, 2024-05-08T06:07:24.313 INFO:teuthology.orchestra.run.smithi151.stdout: "session_remove": 1, 2024-05-08T06:07:24.313 INFO:teuthology.orchestra.run.smithi151.stdout: "sessions_open": 1, 2024-05-08T06:07:24.313 INFO:teuthology.orchestra.run.smithi151.stdout: "sessions_stale": 0, 2024-05-08T06:07:24.313 INFO:teuthology.orchestra.run.smithi151.stdout: "total_load": 1, 2024-05-08T06:07:24.313 INFO:teuthology.orchestra.run.smithi151.stdout: "average_load": 1, 2024-05-08T06:07:24.313 INFO:teuthology.orchestra.run.smithi151.stdout: "avg_session_uptime": 1039, 2024-05-08T06:07:24.313 INFO:teuthology.orchestra.run.smithi151.stdout: "mdthresh_evicted": 0 2024-05-08T06:07:24.313 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.313 INFO:teuthology.orchestra.run.smithi151.stdout: "mempool": { 2024-05-08T06:07:24.313 INFO:teuthology.orchestra.run.smithi151.stdout: "bloom_filter_bytes": 0, 2024-05-08T06:07:24.313 INFO:teuthology.orchestra.run.smithi151.stdout: "bloom_filter_items": 0, 2024-05-08T06:07:24.313 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T06:07:24.313 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_alloc_items": 0, 2024-05-08T06:07:24.313 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T06:07:24.313 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_data_items": 0, 2024-05-08T06:07:24.313 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T06:07:24.314 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T06:07:24.314 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T06:07:24.314 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T06:07:24.314 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T06:07:24.314 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_other_items": 0, 2024-05-08T06:07:24.314 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T06:07:24.314 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T06:07:24.314 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_extent_bytes": 0, 2024-05-08T06:07:24.314 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_extent_items": 0, 2024-05-08T06:07:24.314 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_blob_bytes": 0, 2024-05-08T06:07:24.314 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_blob_items": 0, 2024-05-08T06:07:24.314 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T06:07:24.315 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T06:07:24.315 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T06:07:24.315 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T06:07:24.315 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T06:07:24.315 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_fsck_items": 0, 2024-05-08T06:07:24.315 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_txc_bytes": 0, 2024-05-08T06:07:24.315 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_txc_items": 0, 2024-05-08T06:07:24.315 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T06:07:24.315 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T06:07:24.315 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_bytes": 0, 2024-05-08T06:07:24.315 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_items": 0, 2024-05-08T06:07:24.315 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_bytes": 0, 2024-05-08T06:07:24.315 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_items": 0, 2024-05-08T06:07:24.315 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T06:07:24.315 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_reader_items": 0, 2024-05-08T06:07:24.316 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T06:07:24.316 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_writer_items": 0, 2024-05-08T06:07:24.316 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_anon_bytes": 247479, 2024-05-08T06:07:24.316 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_anon_items": 82, 2024-05-08T06:07:24.316 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_meta_bytes": 0, 2024-05-08T06:07:24.316 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_meta_items": 0, 2024-05-08T06:07:24.316 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_bytes": 0, 2024-05-08T06:07:24.316 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_items": 0, 2024-05-08T06:07:24.316 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_mapbl_bytes": 0, 2024-05-08T06:07:24.316 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_mapbl_items": 0, 2024-05-08T06:07:24.316 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_pglog_bytes": 0, 2024-05-08T06:07:24.316 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_pglog_items": 0, 2024-05-08T06:07:24.316 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_bytes": 7528, 2024-05-08T06:07:24.316 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_items": 158, 2024-05-08T06:07:24.317 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T06:07:24.317 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_mapping_items": 0, 2024-05-08T06:07:24.317 INFO:teuthology.orchestra.run.smithi151.stdout: "pgmap_bytes": 0, 2024-05-08T06:07:24.317 INFO:teuthology.orchestra.run.smithi151.stdout: "pgmap_items": 0, 2024-05-08T06:07:24.317 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_co_bytes": 68037, 2024-05-08T06:07:24.317 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_co_items": 288, 2024-05-08T06:07:24.317 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_1_bytes": 0, 2024-05-08T06:07:24.317 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_1_items": 0, 2024-05-08T06:07:24.317 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_2_bytes": 0, 2024-05-08T06:07:24.317 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_2_items": 0 2024-05-08T06:07:24.317 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.317 INFO:teuthology.orchestra.run.smithi151.stdout: "objecter": { 2024-05-08T06:07:24.317 INFO:teuthology.orchestra.run.smithi151.stdout: "op_active": 0, 2024-05-08T06:07:24.317 INFO:teuthology.orchestra.run.smithi151.stdout: "op_laggy": 0, 2024-05-08T06:07:24.317 INFO:teuthology.orchestra.run.smithi151.stdout: "op_send": 42, 2024-05-08T06:07:24.317 INFO:teuthology.orchestra.run.smithi151.stdout: "op_send_bytes": 12137, 2024-05-08T06:07:24.318 INFO:teuthology.orchestra.run.smithi151.stdout: "op_resend": 33, 2024-05-08T06:07:24.318 INFO:teuthology.orchestra.run.smithi151.stdout: "op_reply": 42, 2024-05-08T06:07:24.318 INFO:teuthology.orchestra.run.smithi151.stdout: "op_latency": { 2024-05-08T06:07:24.318 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 42, 2024-05-08T06:07:24.318 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.248996963, 2024-05-08T06:07:24.318 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.005928499 2024-05-08T06:07:24.318 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.318 INFO:teuthology.orchestra.run.smithi151.stdout: "op_inflight": 0, 2024-05-08T06:07:24.318 INFO:teuthology.orchestra.run.smithi151.stdout: "oplen_avg": { 2024-05-08T06:07:24.318 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 42, 2024-05-08T06:07:24.318 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 66 2024-05-08T06:07:24.318 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.318 INFO:teuthology.orchestra.run.smithi151.stdout: "op": 42, 2024-05-08T06:07:24.318 INFO:teuthology.orchestra.run.smithi151.stdout: "op_r": 0, 2024-05-08T06:07:24.318 INFO:teuthology.orchestra.run.smithi151.stdout: "op_w": 42, 2024-05-08T06:07:24.319 INFO:teuthology.orchestra.run.smithi151.stdout: "op_rmw": 0, 2024-05-08T06:07:24.319 INFO:teuthology.orchestra.run.smithi151.stdout: "op_pg": 0, 2024-05-08T06:07:24.319 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_stat": 0, 2024-05-08T06:07:24.319 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_create": 10, 2024-05-08T06:07:24.319 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_read": 0, 2024-05-08T06:07:24.319 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_write": 4, 2024-05-08T06:07:24.319 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_writefull": 7, 2024-05-08T06:07:24.319 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_writesame": 0, 2024-05-08T06:07:24.319 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_append": 0, 2024-05-08T06:07:24.319 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_zero": 0, 2024-05-08T06:07:24.319 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_truncate": 0, 2024-05-08T06:07:24.319 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_delete": 6, 2024-05-08T06:07:24.319 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_mapext": 0, 2024-05-08T06:07:24.319 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_sparse_read": 0, 2024-05-08T06:07:24.319 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_clonerange": 0, 2024-05-08T06:07:24.319 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_getxattr": 0, 2024-05-08T06:07:24.320 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_setxattr": 20, 2024-05-08T06:07:24.320 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_cmpxattr": 0, 2024-05-08T06:07:24.320 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_rmxattr": 0, 2024-05-08T06:07:24.320 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_resetxattrs": 0, 2024-05-08T06:07:24.320 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_call": 0, 2024-05-08T06:07:24.320 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_watch": 0, 2024-05-08T06:07:24.320 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_notify": 0, 2024-05-08T06:07:24.320 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_src_cmpxattr": 0, 2024-05-08T06:07:24.320 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_pgls": 0, 2024-05-08T06:07:24.320 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_pgls_filter": 0, 2024-05-08T06:07:24.320 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_other": 0, 2024-05-08T06:07:24.320 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_active": 0, 2024-05-08T06:07:24.320 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_send": 0, 2024-05-08T06:07:24.320 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_resend": 0, 2024-05-08T06:07:24.320 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_ping": 0, 2024-05-08T06:07:24.321 INFO:teuthology.orchestra.run.smithi151.stdout: "poolop_active": 0, 2024-05-08T06:07:24.321 INFO:teuthology.orchestra.run.smithi151.stdout: "poolop_send": 0, 2024-05-08T06:07:24.321 INFO:teuthology.orchestra.run.smithi151.stdout: "poolop_resend": 0, 2024-05-08T06:07:24.321 INFO:teuthology.orchestra.run.smithi151.stdout: "poolstat_active": 0, 2024-05-08T06:07:24.321 INFO:teuthology.orchestra.run.smithi151.stdout: "poolstat_send": 0, 2024-05-08T06:07:24.321 INFO:teuthology.orchestra.run.smithi151.stdout: "poolstat_resend": 0, 2024-05-08T06:07:24.321 INFO:teuthology.orchestra.run.smithi151.stdout: "statfs_active": 0, 2024-05-08T06:07:24.321 INFO:teuthology.orchestra.run.smithi151.stdout: "statfs_send": 0, 2024-05-08T06:07:24.321 INFO:teuthology.orchestra.run.smithi151.stdout: "statfs_resend": 0, 2024-05-08T06:07:24.321 INFO:teuthology.orchestra.run.smithi151.stdout: "command_active": 0, 2024-05-08T06:07:24.321 INFO:teuthology.orchestra.run.smithi151.stdout: "command_send": 0, 2024-05-08T06:07:24.321 INFO:teuthology.orchestra.run.smithi151.stdout: "command_resend": 0, 2024-05-08T06:07:24.321 INFO:teuthology.orchestra.run.smithi151.stdout: "map_epoch": 82, 2024-05-08T06:07:24.321 INFO:teuthology.orchestra.run.smithi151.stdout: "map_full": 0, 2024-05-08T06:07:24.321 INFO:teuthology.orchestra.run.smithi151.stdout: "map_inc": 2, 2024-05-08T06:07:24.321 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_sessions": 9, 2024-05-08T06:07:24.322 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_session_open": 13, 2024-05-08T06:07:24.322 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_session_close": 4, 2024-05-08T06:07:24.322 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_laggy": 0, 2024-05-08T06:07:24.322 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_wr": 18, 2024-05-08T06:07:24.322 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_rd": 0, 2024-05-08T06:07:24.322 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_del": 1 2024-05-08T06:07:24.322 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.322 INFO:teuthology.orchestra.run.smithi151.stdout: "oft": { 2024-05-08T06:07:24.322 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_objs": 1, 2024-05-08T06:07:24.322 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_kv_pairs": 0, 2024-05-08T06:07:24.322 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_updates": 0, 2024-05-08T06:07:24.322 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_removes": 0 2024-05-08T06:07:24.322 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.322 INFO:teuthology.orchestra.run.smithi151.stdout: "osd-slow-ops": { 2024-05-08T06:07:24.322 INFO:teuthology.orchestra.run.smithi151.stdout: "slow_ops_count": 0 2024-05-08T06:07:24.323 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.323 INFO:teuthology.orchestra.run.smithi151.stdout: "purge_queue": { 2024-05-08T06:07:24.323 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing_ops": 0, 2024-05-08T06:07:24.323 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing_ops_high_water": 0, 2024-05-08T06:07:24.323 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing": 0, 2024-05-08T06:07:24.323 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing_high_water": 0, 2024-05-08T06:07:24.323 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executed_ops": 0, 2024-05-08T06:07:24.323 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executed": 0, 2024-05-08T06:07:24.323 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_item_in_journal": 0 2024-05-08T06:07:24.323 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.323 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T06:07:24.323 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-05-08T06:07:24.323 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 104857600, 2024-05-08T06:07:24.323 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-05-08T06:07:24.323 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 1124, 2024-05-08T06:07:24.324 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 967035, 2024-05-08T06:07:24.324 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-05-08T06:07:24.324 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 1124, 2024-05-08T06:07:24.324 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 0, 2024-05-08T06:07:24.324 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 0, 2024-05-08T06:07:24.324 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 1124, 2024-05-08T06:07:24.324 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 967035, 2024-05-08T06:07:24.324 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-05-08T06:07:24.324 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:24.324 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:24.324 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:24.324 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T06:07:24.324 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.324 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-objecter_bytes": { 2024-05-08T06:07:24.324 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-05-08T06:07:24.325 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 104857600, 2024-05-08T06:07:24.325 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-05-08T06:07:24.325 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 0, 2024-05-08T06:07:24.325 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 0, 2024-05-08T06:07:24.325 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-05-08T06:07:24.325 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 0, 2024-05-08T06:07:24.325 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 42, 2024-05-08T06:07:24.325 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 12137, 2024-05-08T06:07:24.325 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 42, 2024-05-08T06:07:24.325 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 12137, 2024-05-08T06:07:24.325 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-05-08T06:07:24.325 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:24.325 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:24.325 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:24.325 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T06:07:24.325 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.326 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-objecter_ops": { 2024-05-08T06:07:24.326 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-05-08T06:07:24.326 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 1024, 2024-05-08T06:07:24.326 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-05-08T06:07:24.326 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 0, 2024-05-08T06:07:24.326 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 0, 2024-05-08T06:07:24.326 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-05-08T06:07:24.326 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 0, 2024-05-08T06:07:24.326 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 42, 2024-05-08T06:07:24.326 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 42, 2024-05-08T06:07:24.326 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 42, 2024-05-08T06:07:24.326 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 42, 2024-05-08T06:07:24.326 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-05-08T06:07:24.326 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:24.327 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:24.327 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:24.327 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T06:07:24.327 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.327 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-write_buf_throttle": { 2024-05-08T06:07:24.327 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-05-08T06:07:24.327 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 3758096384, 2024-05-08T06:07:24.327 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-05-08T06:07:24.327 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 0, 2024-05-08T06:07:24.327 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 0, 2024-05-08T06:07:24.327 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-05-08T06:07:24.327 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 0, 2024-05-08T06:07:24.327 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 0, 2024-05-08T06:07:24.327 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 0, 2024-05-08T06:07:24.327 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 0, 2024-05-08T06:07:24.328 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 0, 2024-05-08T06:07:24.328 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-05-08T06:07:24.328 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:24.328 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:24.328 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:24.328 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T06:07:24.328 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:24.328 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-write_buf_throttle-0x55937a2be500": { 2024-05-08T06:07:24.328 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-05-08T06:07:24.328 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 3758096384, 2024-05-08T06:07:24.328 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-05-08T06:07:24.328 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 5, 2024-05-08T06:07:24.328 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 1430, 2024-05-08T06:07:24.328 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-05-08T06:07:24.328 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 5, 2024-05-08T06:07:24.328 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 0, 2024-05-08T06:07:24.329 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 0, 2024-05-08T06:07:24.329 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 4, 2024-05-08T06:07:24.329 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 1430, 2024-05-08T06:07:24.329 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-05-08T06:07:24.329 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:24.329 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:24.329 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:24.329 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T06:07:24.329 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T06:07:24.329 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T06:07:25.127 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2024-05-08T06:07:25.128 INFO:tasks.check_counter:Daemon mds.i mds.imported=0 2024-05-08T06:07:25.128 DEBUG:tasks.check_counter:Getting stats from l 2024-05-08T06:07:25.128 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph daemon mds.l perf dump 2024-05-08T06:07:25.367 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.c/config 2024-05-08T06:07:26.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:25 smithi151 ceph-mon[34815]: pgmap v962: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-08T06:07:26.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:25 smithi082 ceph-mon[30098]: pgmap v962: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-08T06:07:26.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:25 smithi134 ceph-mon[34132]: pgmap v962: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-08T06:07:27.246 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-05-08T06:07:27.246 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-0": { 2024-05-08T06:07:27.246 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 3582, 2024-05-08T06:07:27.247 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 3584, 2024-05-08T06:07:27.247 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 1017527, 2024-05-08T06:07:27.247 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 1139083, 2024-05-08T06:07:27.247 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 6, 2024-05-08T06:07:27.247 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 2, 2024-05-08T06:07:27.247 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 0.263119328, 2024-05-08T06:07:27.247 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 0.083862930, 2024-05-08T06:07:27.247 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 0.065770078, 2024-05-08T06:07:27.247 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 0.094426045, 2024-05-08T06:07:27.247 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T06:07:27.247 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 3582, 2024-05-08T06:07:27.247 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.137205912, 2024-05-08T06:07:27.247 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000038304 2024-05-08T06:07:27.248 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.248 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2024-05-08T06:07:27.248 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:27.248 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:27.248 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:27.248 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.248 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-08T06:07:27.248 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 0 2024-05-08T06:07:27.248 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.248 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-1": { 2024-05-08T06:07:27.248 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 4, 2024-05-08T06:07:27.248 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 277, 2024-05-08T06:07:27.248 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 876, 2024-05-08T06:07:27.248 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 635594, 2024-05-08T06:07:27.248 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 6, 2024-05-08T06:07:27.249 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 3, 2024-05-08T06:07:27.249 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 0.014081463, 2024-05-08T06:07:27.249 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 0.010218661, 2024-05-08T06:07:27.249 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 0.001496551, 2024-05-08T06:07:27.249 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 0.000063750, 2024-05-08T06:07:27.249 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T06:07:27.249 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 275, 2024-05-08T06:07:27.249 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.020145736, 2024-05-08T06:07:27.249 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000073257 2024-05-08T06:07:27.249 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.249 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2024-05-08T06:07:27.249 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:27.249 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:27.249 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:27.249 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.250 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 320, 2024-05-08T06:07:27.250 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 634896 2024-05-08T06:07:27.250 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.250 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-2": { 2024-05-08T06:07:27.250 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 379, 2024-05-08T06:07:27.250 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 368, 2024-05-08T06:07:27.250 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 900636, 2024-05-08T06:07:27.250 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 223646, 2024-05-08T06:07:27.250 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 4, 2024-05-08T06:07:27.250 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 2, 2024-05-08T06:07:27.250 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 0.052258495, 2024-05-08T06:07:27.250 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 0.018877462, 2024-05-08T06:07:27.250 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 0.026664871, 2024-05-08T06:07:27.250 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 0.008366102, 2024-05-08T06:07:27.251 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2024-05-08T06:07:27.251 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 368, 2024-05-08T06:07:27.251 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.017157074, 2024-05-08T06:07:27.251 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000046622 2024-05-08T06:07:27.251 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.251 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2024-05-08T06:07:27.251 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:27.251 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:27.251 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:27.251 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.251 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 900368, 2024-05-08T06:07:27.251 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 223328 2024-05-08T06:07:27.251 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.251 INFO:teuthology.orchestra.run.smithi151.stdout: "cct": { 2024-05-08T06:07:27.251 INFO:teuthology.orchestra.run.smithi151.stdout: "total_workers": 1, 2024-05-08T06:07:27.251 INFO:teuthology.orchestra.run.smithi151.stdout: "unhealthy_workers": 0 2024-05-08T06:07:27.252 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.252 INFO:teuthology.orchestra.run.smithi151.stdout: "finisher-MDSRank": { 2024-05-08T06:07:27.252 INFO:teuthology.orchestra.run.smithi151.stdout: "queue_len": 0, 2024-05-08T06:07:27.252 INFO:teuthology.orchestra.run.smithi151.stdout: "complete_latency": { 2024-05-08T06:07:27.252 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 6024, 2024-05-08T06:07:27.252 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.148337556, 2024-05-08T06:07:27.252 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000024624 2024-05-08T06:07:27.252 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T06:07:27.252 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.252 INFO:teuthology.orchestra.run.smithi151.stdout: "finisher-PurgeQueue": { 2024-05-08T06:07:27.252 INFO:teuthology.orchestra.run.smithi151.stdout: "queue_len": 0, 2024-05-08T06:07:27.252 INFO:teuthology.orchestra.run.smithi151.stdout: "complete_latency": { 2024-05-08T06:07:27.252 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:27.252 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:27.252 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:27.253 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T06:07:27.253 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.253 INFO:teuthology.orchestra.run.smithi151.stdout: "mds": { 2024-05-08T06:07:27.253 INFO:teuthology.orchestra.run.smithi151.stdout: "request": 0, 2024-05-08T06:07:27.253 INFO:teuthology.orchestra.run.smithi151.stdout: "reply": 0, 2024-05-08T06:07:27.253 INFO:teuthology.orchestra.run.smithi151.stdout: "reply_latency": { 2024-05-08T06:07:27.253 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:27.253 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:27.253 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:27.253 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.253 INFO:teuthology.orchestra.run.smithi151.stdout: "slow_reply": 0, 2024-05-08T06:07:27.253 INFO:teuthology.orchestra.run.smithi151.stdout: "forward": 0, 2024-05-08T06:07:27.253 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_fetch_complete": 0, 2024-05-08T06:07:27.253 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_fetch_keys": 0, 2024-05-08T06:07:27.253 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_commit": 0, 2024-05-08T06:07:27.254 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_split": 0, 2024-05-08T06:07:27.254 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_merge": 0, 2024-05-08T06:07:27.254 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes": 0, 2024-05-08T06:07:27.254 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_top": 0, 2024-05-08T06:07:27.254 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_bottom": 0, 2024-05-08T06:07:27.254 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_pin_tail": 0, 2024-05-08T06:07:27.254 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_pinned": 0, 2024-05-08T06:07:27.254 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_expired": 0, 2024-05-08T06:07:27.254 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_with_caps": 0, 2024-05-08T06:07:27.254 INFO:teuthology.orchestra.run.smithi151.stdout: "caps": 0, 2024-05-08T06:07:27.254 INFO:teuthology.orchestra.run.smithi151.stdout: "subtrees": 1, 2024-05-08T06:07:27.254 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse": 0, 2024-05-08T06:07:27.254 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_hit": 0, 2024-05-08T06:07:27.254 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_forward": 0, 2024-05-08T06:07:27.255 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_discover": 0, 2024-05-08T06:07:27.255 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_dir_fetch": 0, 2024-05-08T06:07:27.255 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_remote_ino": 0, 2024-05-08T06:07:27.255 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_lock": 0, 2024-05-08T06:07:27.255 INFO:teuthology.orchestra.run.smithi151.stdout: "load_cent": 0, 2024-05-08T06:07:27.255 INFO:teuthology.orchestra.run.smithi151.stdout: "q": 0, 2024-05-08T06:07:27.255 INFO:teuthology.orchestra.run.smithi151.stdout: "exported": 0, 2024-05-08T06:07:27.255 INFO:teuthology.orchestra.run.smithi151.stdout: "exported_inodes": 0, 2024-05-08T06:07:27.255 INFO:teuthology.orchestra.run.smithi151.stdout: "imported": 0, 2024-05-08T06:07:27.255 INFO:teuthology.orchestra.run.smithi151.stdout: "imported_inodes": 0, 2024-05-08T06:07:27.255 INFO:teuthology.orchestra.run.smithi151.stdout: "openino_dir_fetch": 0, 2024-05-08T06:07:27.255 INFO:teuthology.orchestra.run.smithi151.stdout: "openino_backtrace_fetch": 0, 2024-05-08T06:07:27.255 INFO:teuthology.orchestra.run.smithi151.stdout: "openino_peer_discover": 0, 2024-05-08T06:07:27.255 INFO:teuthology.orchestra.run.smithi151.stdout: "root_rfiles": 0, 2024-05-08T06:07:27.255 INFO:teuthology.orchestra.run.smithi151.stdout: "root_rbytes": 0, 2024-05-08T06:07:27.256 INFO:teuthology.orchestra.run.smithi151.stdout: "root_rsnaps": 0, 2024-05-08T06:07:27.256 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_backtrace_fetch": 0, 2024-05-08T06:07:27.256 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_set_tag": 0, 2024-05-08T06:07:27.256 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_backtrace_repaired": 0, 2024-05-08T06:07:27.256 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_inotable_repaired": 0, 2024-05-08T06:07:27.256 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_dir_inodes": 0, 2024-05-08T06:07:27.256 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_dir_base_inodes": 0, 2024-05-08T06:07:27.256 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_dirfrag_rstats": 0, 2024-05-08T06:07:27.256 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_file_inodes": 0, 2024-05-08T06:07:27.256 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_inode_file_caps": 0, 2024-05-08T06:07:27.256 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_revoke": 0, 2024-05-08T06:07:27.256 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_grant": 0, 2024-05-08T06:07:27.256 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_trunc": 0, 2024-05-08T06:07:27.256 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-08T06:07:27.256 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-08T06:07:27.257 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_caps": 0, 2024-05-08T06:07:27.257 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_caps_dirty": 0, 2024-05-08T06:07:27.257 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_cap_release": 0, 2024-05-08T06:07:27.257 INFO:teuthology.orchestra.run.smithi151.stdout: "process_request_cap_release": 0 2024-05-08T06:07:27.257 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.257 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_cache": { 2024-05-08T06:07:27.257 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_update": 0, 2024-05-08T06:07:27.257 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_update_receipt": 0, 2024-05-08T06:07:27.257 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_try_discover": 0, 2024-05-08T06:07:27.257 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_send_discover": 0, 2024-05-08T06:07:27.257 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_handle_discover": 0, 2024-05-08T06:07:27.257 INFO:teuthology.orchestra.run.smithi151.stdout: "num_strays": 0, 2024-05-08T06:07:27.257 INFO:teuthology.orchestra.run.smithi151.stdout: "num_strays_delayed": 0, 2024-05-08T06:07:27.257 INFO:teuthology.orchestra.run.smithi151.stdout: "num_strays_enqueuing": 0, 2024-05-08T06:07:27.257 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_created": 0, 2024-05-08T06:07:27.257 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_enqueued": 0, 2024-05-08T06:07:27.258 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_reintegrated": 0, 2024-05-08T06:07:27.258 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_migrated": 0, 2024-05-08T06:07:27.258 INFO:teuthology.orchestra.run.smithi151.stdout: "num_recovering_processing": 0, 2024-05-08T06:07:27.258 INFO:teuthology.orchestra.run.smithi151.stdout: "num_recovering_enqueued": 0, 2024-05-08T06:07:27.258 INFO:teuthology.orchestra.run.smithi151.stdout: "num_recovering_prioritized": 0, 2024-05-08T06:07:27.258 INFO:teuthology.orchestra.run.smithi151.stdout: "recovery_started": 0, 2024-05-08T06:07:27.258 INFO:teuthology.orchestra.run.smithi151.stdout: "recovery_completed": 0, 2024-05-08T06:07:27.258 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_quiesce_path": 0, 2024-05-08T06:07:27.258 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_quiesce_inode": 0, 2024-05-08T06:07:27.258 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_enqueue_scrub": 0, 2024-05-08T06:07:27.258 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_exportdir": 0, 2024-05-08T06:07:27.258 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_flush": 0, 2024-05-08T06:07:27.258 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_fragmentdir": 0, 2024-05-08T06:07:27.258 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_fragstats": 0, 2024-05-08T06:07:27.258 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_inodestats": 0 2024-05-08T06:07:27.259 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.259 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_log": { 2024-05-08T06:07:27.259 INFO:teuthology.orchestra.run.smithi151.stdout: "evlrg": 0, 2024-05-08T06:07:27.259 INFO:teuthology.orchestra.run.smithi151.stdout: "evadd": 0, 2024-05-08T06:07:27.259 INFO:teuthology.orchestra.run.smithi151.stdout: "evex": 0, 2024-05-08T06:07:27.259 INFO:teuthology.orchestra.run.smithi151.stdout: "evtrm": 0, 2024-05-08T06:07:27.259 INFO:teuthology.orchestra.run.smithi151.stdout: "ev": 5, 2024-05-08T06:07:27.259 INFO:teuthology.orchestra.run.smithi151.stdout: "evexg": 0, 2024-05-08T06:07:27.259 INFO:teuthology.orchestra.run.smithi151.stdout: "evexd": 0, 2024-05-08T06:07:27.259 INFO:teuthology.orchestra.run.smithi151.stdout: "segadd": 0, 2024-05-08T06:07:27.259 INFO:teuthology.orchestra.run.smithi151.stdout: "segex": 0, 2024-05-08T06:07:27.259 INFO:teuthology.orchestra.run.smithi151.stdout: "segtrm": 0, 2024-05-08T06:07:27.259 INFO:teuthology.orchestra.run.smithi151.stdout: "seg": 2, 2024-05-08T06:07:27.259 INFO:teuthology.orchestra.run.smithi151.stdout: "segmjr": 2, 2024-05-08T06:07:27.259 INFO:teuthology.orchestra.run.smithi151.stdout: "segexg": 0, 2024-05-08T06:07:27.259 INFO:teuthology.orchestra.run.smithi151.stdout: "segexd": 0, 2024-05-08T06:07:27.260 INFO:teuthology.orchestra.run.smithi151.stdout: "expos": 4194304, 2024-05-08T06:07:27.260 INFO:teuthology.orchestra.run.smithi151.stdout: "wrpos": 4195734, 2024-05-08T06:07:27.260 INFO:teuthology.orchestra.run.smithi151.stdout: "rdpos": 4195593, 2024-05-08T06:07:27.260 INFO:teuthology.orchestra.run.smithi151.stdout: "jlat": { 2024-05-08T06:07:27.260 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:27.260 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:27.260 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:27.260 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.260 INFO:teuthology.orchestra.run.smithi151.stdout: "replayed": 5 2024-05-08T06:07:27.260 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.260 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_mem": { 2024-05-08T06:07:27.260 INFO:teuthology.orchestra.run.smithi151.stdout: "ino": 3, 2024-05-08T06:07:27.260 INFO:teuthology.orchestra.run.smithi151.stdout: "ino+": 3, 2024-05-08T06:07:27.260 INFO:teuthology.orchestra.run.smithi151.stdout: "ino-": 0, 2024-05-08T06:07:27.260 INFO:teuthology.orchestra.run.smithi151.stdout: "dir": 1, 2024-05-08T06:07:27.260 INFO:teuthology.orchestra.run.smithi151.stdout: "dir+": 1, 2024-05-08T06:07:27.261 INFO:teuthology.orchestra.run.smithi151.stdout: "dir-": 0, 2024-05-08T06:07:27.261 INFO:teuthology.orchestra.run.smithi151.stdout: "dn": 0, 2024-05-08T06:07:27.261 INFO:teuthology.orchestra.run.smithi151.stdout: "dn+": 0, 2024-05-08T06:07:27.261 INFO:teuthology.orchestra.run.smithi151.stdout: "dn-": 0, 2024-05-08T06:07:27.261 INFO:teuthology.orchestra.run.smithi151.stdout: "cap": 0, 2024-05-08T06:07:27.261 INFO:teuthology.orchestra.run.smithi151.stdout: "cap+": 0, 2024-05-08T06:07:27.261 INFO:teuthology.orchestra.run.smithi151.stdout: "cap-": 0, 2024-05-08T06:07:27.261 INFO:teuthology.orchestra.run.smithi151.stdout: "rss": 50988, 2024-05-08T06:07:27.261 INFO:teuthology.orchestra.run.smithi151.stdout: "heap": 215416 2024-05-08T06:07:27.261 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.261 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_server": { 2024-05-08T06:07:27.261 INFO:teuthology.orchestra.run.smithi151.stdout: "dispatch_client_request": 0, 2024-05-08T06:07:27.261 INFO:teuthology.orchestra.run.smithi151.stdout: "dispatch_server_request": 0, 2024-05-08T06:07:27.261 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_request": 0, 2024-05-08T06:07:27.261 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_session": 0, 2024-05-08T06:07:27.261 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_peer_request": 0, 2024-05-08T06:07:27.262 INFO:teuthology.orchestra.run.smithi151.stdout: "req_create_latency": { 2024-05-08T06:07:27.262 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:27.262 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:27.262 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:27.262 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.262 INFO:teuthology.orchestra.run.smithi151.stdout: "req_getattr_latency": { 2024-05-08T06:07:27.262 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:27.262 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:27.262 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:27.262 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.262 INFO:teuthology.orchestra.run.smithi151.stdout: "req_getfilelock_latency": { 2024-05-08T06:07:27.262 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:27.262 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:27.262 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:27.262 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.262 INFO:teuthology.orchestra.run.smithi151.stdout: "req_link_latency": { 2024-05-08T06:07:27.263 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:27.263 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:27.263 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:27.263 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.263 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookup_latency": { 2024-05-08T06:07:27.263 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:27.263 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:27.263 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:27.263 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.265 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookuphash_latency": { 2024-05-08T06:07:27.265 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:27.265 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:27.265 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:27.265 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.265 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupino_latency": { 2024-05-08T06:07:27.265 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:27.265 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:27.265 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:27.265 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.265 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupname_latency": { 2024-05-08T06:07:27.265 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:27.266 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:27.266 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:27.266 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.266 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupparent_latency": { 2024-05-08T06:07:27.266 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:27.266 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:27.266 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:27.266 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.266 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupsnap_latency": { 2024-05-08T06:07:27.266 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:27.266 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:27.266 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:27.266 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.266 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lssnap_latency": { 2024-05-08T06:07:27.267 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:27.267 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:27.267 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:27.267 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.267 INFO:teuthology.orchestra.run.smithi151.stdout: "req_mkdir_latency": { 2024-05-08T06:07:27.267 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:27.267 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:27.268 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:27.268 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.268 INFO:teuthology.orchestra.run.smithi151.stdout: "req_mknod_latency": { 2024-05-08T06:07:27.268 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:27.268 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:27.268 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:27.268 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.268 INFO:teuthology.orchestra.run.smithi151.stdout: "req_mksnap_latency": { 2024-05-08T06:07:27.268 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:27.268 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:27.268 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:27.268 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.268 INFO:teuthology.orchestra.run.smithi151.stdout: "req_open_latency": { 2024-05-08T06:07:27.268 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:27.269 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:27.269 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:27.269 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.269 INFO:teuthology.orchestra.run.smithi151.stdout: "req_readdir_latency": { 2024-05-08T06:07:27.269 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:27.269 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:27.269 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:27.269 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.269 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rename_latency": { 2024-05-08T06:07:27.269 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:27.269 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:27.269 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:27.269 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.269 INFO:teuthology.orchestra.run.smithi151.stdout: "req_renamesnap_latency": { 2024-05-08T06:07:27.269 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:27.270 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:27.270 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:27.270 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.270 INFO:teuthology.orchestra.run.smithi151.stdout: "req_snapdiff_latency": { 2024-05-08T06:07:27.270 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:27.270 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:27.270 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:27.270 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.270 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rmdir_latency": { 2024-05-08T06:07:27.270 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:27.270 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:27.270 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:27.270 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.270 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rmsnap_latency": { 2024-05-08T06:07:27.270 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:27.271 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:27.271 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:27.271 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.271 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rmxattr_latency": { 2024-05-08T06:07:27.271 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:27.271 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:27.271 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:27.271 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.271 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setattr_latency": { 2024-05-08T06:07:27.271 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:27.271 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:27.271 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:27.271 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.271 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setdirlayout_latency": { 2024-05-08T06:07:27.271 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:27.272 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:27.272 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:27.272 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.272 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setfilelock_latency": { 2024-05-08T06:07:27.272 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:27.272 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:27.272 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:27.272 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.272 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setlayout_latency": { 2024-05-08T06:07:27.272 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:27.272 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:27.272 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:27.272 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.272 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setxattr_latency": { 2024-05-08T06:07:27.273 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:27.273 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:27.273 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:27.273 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.273 INFO:teuthology.orchestra.run.smithi151.stdout: "req_symlink_latency": { 2024-05-08T06:07:27.273 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:27.273 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:27.273 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:27.273 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.273 INFO:teuthology.orchestra.run.smithi151.stdout: "req_unlink_latency": { 2024-05-08T06:07:27.273 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:27.273 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:27.273 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:27.273 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.273 INFO:teuthology.orchestra.run.smithi151.stdout: "cap_revoke_eviction": 0, 2024-05-08T06:07:27.273 INFO:teuthology.orchestra.run.smithi151.stdout: "cap_acquisition_throttle": 0, 2024-05-08T06:07:27.274 INFO:teuthology.orchestra.run.smithi151.stdout: "req_getvxattr_latency": { 2024-05-08T06:07:27.274 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:27.274 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:27.274 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:27.274 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T06:07:27.274 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.274 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_sessions": { 2024-05-08T06:07:27.274 INFO:teuthology.orchestra.run.smithi151.stdout: "session_count": 1, 2024-05-08T06:07:27.274 INFO:teuthology.orchestra.run.smithi151.stdout: "session_add": 2, 2024-05-08T06:07:27.274 INFO:teuthology.orchestra.run.smithi151.stdout: "session_remove": 1, 2024-05-08T06:07:27.274 INFO:teuthology.orchestra.run.smithi151.stdout: "sessions_open": 2, 2024-05-08T06:07:27.274 INFO:teuthology.orchestra.run.smithi151.stdout: "sessions_stale": 0, 2024-05-08T06:07:27.274 INFO:teuthology.orchestra.run.smithi151.stdout: "total_load": 0, 2024-05-08T06:07:27.274 INFO:teuthology.orchestra.run.smithi151.stdout: "average_load": 0, 2024-05-08T06:07:27.275 INFO:teuthology.orchestra.run.smithi151.stdout: "avg_session_uptime": 4335, 2024-05-08T06:07:27.275 INFO:teuthology.orchestra.run.smithi151.stdout: "mdthresh_evicted": 0 2024-05-08T06:07:27.275 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.275 INFO:teuthology.orchestra.run.smithi151.stdout: "mempool": { 2024-05-08T06:07:27.275 INFO:teuthology.orchestra.run.smithi151.stdout: "bloom_filter_bytes": 0, 2024-05-08T06:07:27.275 INFO:teuthology.orchestra.run.smithi151.stdout: "bloom_filter_items": 0, 2024-05-08T06:07:27.275 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_alloc_bytes": 0, 2024-05-08T06:07:27.275 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_alloc_items": 0, 2024-05-08T06:07:27.275 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_data_bytes": 0, 2024-05-08T06:07:27.275 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_data_items": 0, 2024-05-08T06:07:27.275 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-08T06:07:27.275 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_onode_items": 0, 2024-05-08T06:07:27.275 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-08T06:07:27.275 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_meta_items": 0, 2024-05-08T06:07:27.275 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_other_bytes": 0, 2024-05-08T06:07:27.276 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_other_items": 0, 2024-05-08T06:07:27.276 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-08T06:07:27.276 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_buffer_items": 0, 2024-05-08T06:07:27.276 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_extent_bytes": 0, 2024-05-08T06:07:27.276 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_extent_items": 0, 2024-05-08T06:07:27.276 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_blob_bytes": 0, 2024-05-08T06:07:27.276 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_blob_items": 0, 2024-05-08T06:07:27.276 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-08T06:07:27.276 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_shared_blob_items": 0, 2024-05-08T06:07:27.276 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-08T06:07:27.276 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_inline_bl_items": 0, 2024-05-08T06:07:27.276 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_fsck_bytes": 0, 2024-05-08T06:07:27.276 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_fsck_items": 0, 2024-05-08T06:07:27.276 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_txc_bytes": 0, 2024-05-08T06:07:27.276 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_txc_items": 0, 2024-05-08T06:07:27.276 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-08T06:07:27.277 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_deferred_items": 0, 2024-05-08T06:07:27.277 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_bytes": 0, 2024-05-08T06:07:27.277 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_items": 0, 2024-05-08T06:07:27.277 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_bytes": 0, 2024-05-08T06:07:27.277 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_items": 0, 2024-05-08T06:07:27.277 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_reader_bytes": 0, 2024-05-08T06:07:27.277 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_reader_items": 0, 2024-05-08T06:07:27.277 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_writer_bytes": 0, 2024-05-08T06:07:27.277 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_writer_items": 0, 2024-05-08T06:07:27.277 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_anon_bytes": 182833, 2024-05-08T06:07:27.277 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_anon_items": 49, 2024-05-08T06:07:27.277 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_meta_bytes": 0, 2024-05-08T06:07:27.277 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_meta_items": 0, 2024-05-08T06:07:27.277 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_bytes": 0, 2024-05-08T06:07:27.277 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_items": 0, 2024-05-08T06:07:27.277 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_mapbl_bytes": 0, 2024-05-08T06:07:27.278 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_mapbl_items": 0, 2024-05-08T06:07:27.278 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_pglog_bytes": 0, 2024-05-08T06:07:27.278 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_pglog_items": 0, 2024-05-08T06:07:27.278 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_bytes": 7528, 2024-05-08T06:07:27.278 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_items": 158, 2024-05-08T06:07:27.278 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_mapping_bytes": 0, 2024-05-08T06:07:27.278 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_mapping_items": 0, 2024-05-08T06:07:27.278 INFO:teuthology.orchestra.run.smithi151.stdout: "pgmap_bytes": 0, 2024-05-08T06:07:27.278 INFO:teuthology.orchestra.run.smithi151.stdout: "pgmap_items": 0, 2024-05-08T06:07:27.278 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_co_bytes": 8512, 2024-05-08T06:07:27.278 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_co_items": 13, 2024-05-08T06:07:27.278 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_1_bytes": 0, 2024-05-08T06:07:27.278 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_1_items": 0, 2024-05-08T06:07:27.278 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_2_bytes": 0, 2024-05-08T06:07:27.278 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_2_items": 0 2024-05-08T06:07:27.279 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.279 INFO:teuthology.orchestra.run.smithi151.stdout: "objecter": { 2024-05-08T06:07:27.279 INFO:teuthology.orchestra.run.smithi151.stdout: "op_active": 0, 2024-05-08T06:07:27.279 INFO:teuthology.orchestra.run.smithi151.stdout: "op_laggy": 0, 2024-05-08T06:07:27.279 INFO:teuthology.orchestra.run.smithi151.stdout: "op_send": 3585, 2024-05-08T06:07:27.279 INFO:teuthology.orchestra.run.smithi151.stdout: "op_send_bytes": 21, 2024-05-08T06:07:27.279 INFO:teuthology.orchestra.run.smithi151.stdout: "op_resend": 3, 2024-05-08T06:07:27.279 INFO:teuthology.orchestra.run.smithi151.stdout: "op_reply": 3585, 2024-05-08T06:07:27.279 INFO:teuthology.orchestra.run.smithi151.stdout: "op_latency": { 2024-05-08T06:07:27.279 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 3585, 2024-05-08T06:07:27.279 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 3.625957574, 2024-05-08T06:07:27.279 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.001011424 2024-05-08T06:07:27.279 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.279 INFO:teuthology.orchestra.run.smithi151.stdout: "op_inflight": 0, 2024-05-08T06:07:27.279 INFO:teuthology.orchestra.run.smithi151.stdout: "oplen_avg": { 2024-05-08T06:07:27.280 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 3585, 2024-05-08T06:07:27.280 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 3586 2024-05-08T06:07:27.280 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.280 INFO:teuthology.orchestra.run.smithi151.stdout: "op": 3585, 2024-05-08T06:07:27.280 INFO:teuthology.orchestra.run.smithi151.stdout: "op_r": 3585, 2024-05-08T06:07:27.280 INFO:teuthology.orchestra.run.smithi151.stdout: "op_w": 0, 2024-05-08T06:07:27.280 INFO:teuthology.orchestra.run.smithi151.stdout: "op_rmw": 0, 2024-05-08T06:07:27.280 INFO:teuthology.orchestra.run.smithi151.stdout: "op_pg": 0, 2024-05-08T06:07:27.280 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_stat": 2309, 2024-05-08T06:07:27.280 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_create": 0, 2024-05-08T06:07:27.280 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_read": 1274, 2024-05-08T06:07:27.280 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_write": 0, 2024-05-08T06:07:27.280 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_writefull": 0, 2024-05-08T06:07:27.280 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_writesame": 0, 2024-05-08T06:07:27.280 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_append": 0, 2024-05-08T06:07:27.280 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_zero": 0, 2024-05-08T06:07:27.281 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_truncate": 0, 2024-05-08T06:07:27.281 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_delete": 0, 2024-05-08T06:07:27.281 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_mapext": 0, 2024-05-08T06:07:27.281 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_sparse_read": 0, 2024-05-08T06:07:27.281 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_clonerange": 0, 2024-05-08T06:07:27.281 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_getxattr": 1, 2024-05-08T06:07:27.281 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_setxattr": 0, 2024-05-08T06:07:27.281 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_cmpxattr": 0, 2024-05-08T06:07:27.281 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_rmxattr": 0, 2024-05-08T06:07:27.281 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_resetxattrs": 0, 2024-05-08T06:07:27.281 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_call": 0, 2024-05-08T06:07:27.281 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_watch": 0, 2024-05-08T06:07:27.281 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_notify": 0, 2024-05-08T06:07:27.281 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_src_cmpxattr": 0, 2024-05-08T06:07:27.281 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_pgls": 0, 2024-05-08T06:07:27.282 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_pgls_filter": 0, 2024-05-08T06:07:27.282 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_other": 0, 2024-05-08T06:07:27.282 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_active": 0, 2024-05-08T06:07:27.282 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_send": 0, 2024-05-08T06:07:27.282 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_resend": 0, 2024-05-08T06:07:27.282 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_ping": 0, 2024-05-08T06:07:27.282 INFO:teuthology.orchestra.run.smithi151.stdout: "poolop_active": 0, 2024-05-08T06:07:27.282 INFO:teuthology.orchestra.run.smithi151.stdout: "poolop_send": 0, 2024-05-08T06:07:27.282 INFO:teuthology.orchestra.run.smithi151.stdout: "poolop_resend": 0, 2024-05-08T06:07:27.282 INFO:teuthology.orchestra.run.smithi151.stdout: "poolstat_active": 0, 2024-05-08T06:07:27.282 INFO:teuthology.orchestra.run.smithi151.stdout: "poolstat_send": 0, 2024-05-08T06:07:27.282 INFO:teuthology.orchestra.run.smithi151.stdout: "poolstat_resend": 0, 2024-05-08T06:07:27.282 INFO:teuthology.orchestra.run.smithi151.stdout: "statfs_active": 0, 2024-05-08T06:07:27.282 INFO:teuthology.orchestra.run.smithi151.stdout: "statfs_send": 0, 2024-05-08T06:07:27.282 INFO:teuthology.orchestra.run.smithi151.stdout: "statfs_resend": 0, 2024-05-08T06:07:27.283 INFO:teuthology.orchestra.run.smithi151.stdout: "command_active": 0, 2024-05-08T06:07:27.283 INFO:teuthology.orchestra.run.smithi151.stdout: "command_send": 0, 2024-05-08T06:07:27.283 INFO:teuthology.orchestra.run.smithi151.stdout: "command_resend": 0, 2024-05-08T06:07:27.283 INFO:teuthology.orchestra.run.smithi151.stdout: "map_epoch": 82, 2024-05-08T06:07:27.283 INFO:teuthology.orchestra.run.smithi151.stdout: "map_full": 0, 2024-05-08T06:07:27.283 INFO:teuthology.orchestra.run.smithi151.stdout: "map_inc": 2, 2024-05-08T06:07:27.283 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_sessions": 4, 2024-05-08T06:07:27.283 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_session_open": 6, 2024-05-08T06:07:27.283 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_session_close": 2, 2024-05-08T06:07:27.283 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_laggy": 0, 2024-05-08T06:07:27.283 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_wr": 0, 2024-05-08T06:07:27.283 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_rd": 2, 2024-05-08T06:07:27.283 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_del": 0 2024-05-08T06:07:27.283 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.283 INFO:teuthology.orchestra.run.smithi151.stdout: "oft": { 2024-05-08T06:07:27.284 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_objs": 0, 2024-05-08T06:07:27.284 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_kv_pairs": 0, 2024-05-08T06:07:27.284 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_updates": 0, 2024-05-08T06:07:27.284 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_removes": 0 2024-05-08T06:07:27.284 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.284 INFO:teuthology.orchestra.run.smithi151.stdout: "osd-slow-ops": { 2024-05-08T06:07:27.284 INFO:teuthology.orchestra.run.smithi151.stdout: "slow_ops_count": 0 2024-05-08T06:07:27.284 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.284 INFO:teuthology.orchestra.run.smithi151.stdout: "purge_queue": { 2024-05-08T06:07:27.284 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing_ops": 0, 2024-05-08T06:07:27.284 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing_ops_high_water": 0, 2024-05-08T06:07:27.284 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing": 0, 2024-05-08T06:07:27.284 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing_high_water": 0, 2024-05-08T06:07:27.284 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executed_ops": 0, 2024-05-08T06:07:27.284 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executed": 0, 2024-05-08T06:07:27.284 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_item_in_journal": 0 2024-05-08T06:07:27.285 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.285 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-08T06:07:27.285 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-05-08T06:07:27.285 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 104857600, 2024-05-08T06:07:27.285 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-05-08T06:07:27.285 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 3961, 2024-05-08T06:07:27.285 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 1540254, 2024-05-08T06:07:27.285 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-05-08T06:07:27.285 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 3961, 2024-05-08T06:07:27.285 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 0, 2024-05-08T06:07:27.285 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 0, 2024-05-08T06:07:27.285 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 3961, 2024-05-08T06:07:27.285 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 1540254, 2024-05-08T06:07:27.285 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-05-08T06:07:27.285 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:27.286 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:27.286 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:27.286 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T06:07:27.286 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.286 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-objecter_bytes": { 2024-05-08T06:07:27.286 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-05-08T06:07:27.286 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 104857600, 2024-05-08T06:07:27.286 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-05-08T06:07:27.286 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 0, 2024-05-08T06:07:27.286 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 0, 2024-05-08T06:07:27.286 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-05-08T06:07:27.286 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 0, 2024-05-08T06:07:27.286 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 3585, 2024-05-08T06:07:27.286 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 1435, 2024-05-08T06:07:27.286 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 3585, 2024-05-08T06:07:27.287 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 1435, 2024-05-08T06:07:27.287 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-05-08T06:07:27.287 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:27.287 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:27.287 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:27.287 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T06:07:27.287 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.287 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-objecter_ops": { 2024-05-08T06:07:27.287 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-05-08T06:07:27.287 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 1024, 2024-05-08T06:07:27.287 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-05-08T06:07:27.288 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 0, 2024-05-08T06:07:27.288 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 0, 2024-05-08T06:07:27.288 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-05-08T06:07:27.288 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 0, 2024-05-08T06:07:27.288 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 3585, 2024-05-08T06:07:27.288 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 3585, 2024-05-08T06:07:27.288 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 3585, 2024-05-08T06:07:27.288 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 3585, 2024-05-08T06:07:27.288 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-05-08T06:07:27.288 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:27.288 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:27.288 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:27.288 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T06:07:27.288 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.288 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-write_buf_throttle": { 2024-05-08T06:07:27.289 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-05-08T06:07:27.289 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 3758096384, 2024-05-08T06:07:27.289 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-05-08T06:07:27.289 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 0, 2024-05-08T06:07:27.289 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 0, 2024-05-08T06:07:27.289 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-05-08T06:07:27.289 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 0, 2024-05-08T06:07:27.289 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 0, 2024-05-08T06:07:27.289 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 0, 2024-05-08T06:07:27.289 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 0, 2024-05-08T06:07:27.289 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 0, 2024-05-08T06:07:27.289 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-05-08T06:07:27.289 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:27.289 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:27.289 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:27.290 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T06:07:27.290 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-05-08T06:07:27.290 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-write_buf_throttle-0x555d5ccd86e0": { 2024-05-08T06:07:27.290 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-05-08T06:07:27.290 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 3758096384, 2024-05-08T06:07:27.290 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-05-08T06:07:27.290 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 0, 2024-05-08T06:07:27.290 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 0, 2024-05-08T06:07:27.290 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-05-08T06:07:27.290 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 0, 2024-05-08T06:07:27.290 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 0, 2024-05-08T06:07:27.290 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 0, 2024-05-08T06:07:27.290 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 0, 2024-05-08T06:07:27.290 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 0, 2024-05-08T06:07:27.290 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-05-08T06:07:27.291 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-05-08T06:07:27.291 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-05-08T06:07:27.291 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-05-08T06:07:27.291 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T06:07:27.291 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-05-08T06:07:27.291 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-05-08T06:07:28.098 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:27 smithi151 ceph-mon[34815]: pgmap v963: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-05-08T06:07:28.099 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-05-08T06:07:28.099 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-05-08T06:07:28.099 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-05-08T06:07:28.109 INFO:tasks.kclient:Unmounting kernel clients... 2024-05-08T06:07:28.109 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-08T06:07:28.109 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T06:07:28.168 DEBUG:teuthology.orchestra.run.smithi082:> set -ex 2024-05-08T06:07:28.168 DEBUG:teuthology.orchestra.run.smithi082:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-08T06:07:28.220 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph osd blocklist ls 2024-05-08T06:07:28.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:27 smithi082 ceph-mon[30098]: pgmap v963: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-05-08T06:07:28.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:27 smithi134 ceph-mon[34132]: pgmap v963: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-05-08T06:07:28.661 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:07:29.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:29 smithi082 ceph-mon[30098]: pgmap v964: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-08T06:07:30.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:29 smithi151 ceph-mon[34815]: pgmap v964: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-08T06:07:30.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:29 smithi134 ceph-mon[34132]: pgmap v964: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-08T06:07:31.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:31.117+0000 7f3c9ac00700 1 -- 172.21.15.82:0/3077106001 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c9410a490 msgr2=0x7f3c941169a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:07:31.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:31.117+0000 7f3c9ac00700 1 --2- 172.21.15.82:0/3077106001 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c9410a490 0x7f3c941169a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f3c8c00b0a0 tx=0x7f3c8c00b3b0 comp rx=0 tx=0).stop 2024-05-08T06:07:31.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:31.117+0000 7f3c9ac00700 1 -- 172.21.15.82:0/3077106001 shutdown_connections 2024-05-08T06:07:31.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:31.117+0000 7f3c9ac00700 1 --2- 172.21.15.82:0/3077106001 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c9410fb60 0x7f3c9410ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:31.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:31.117+0000 7f3c9ac00700 1 --2- 172.21.15.82:0/3077106001 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c9410a490 0x7f3c941169a0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:31.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:31.117+0000 7f3c9ac00700 1 --2- 172.21.15.82:0/3077106001 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c94109ad0 0x7f3c94109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:31.118 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:31.117+0000 7f3c9ac00700 1 -- 172.21.15.82:0/3077106001 >> 172.21.15.82:0/3077106001 conn(0x7f3c94076c70 msgr2=0x7f3c94079090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:07:31.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:31.118+0000 7f3c9ac00700 1 -- 172.21.15.82:0/3077106001 shutdown_connections 2024-05-08T06:07:31.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:31.118+0000 7f3c9ac00700 1 -- 172.21.15.82:0/3077106001 wait complete. 2024-05-08T06:07:31.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:31.118+0000 7f3c9ac00700 1 Processor -- start 2024-05-08T06:07:31.119 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:31.119+0000 7f3c9ac00700 1 -- start start 2024-05-08T06:07:31.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:31.119+0000 7f3c9ac00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c94109ad0 0x7f3c941a0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:07:31.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:31.119+0000 7f3c9ac00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c9410a490 0x7f3c941a0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:07:31.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:31.119+0000 7f3c9ac00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c9410fb60 0x7f3c941a4a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:07:31.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:31.119+0000 7f3c9ac00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f3c94119d20 con 0x7f3c9410fb60 2024-05-08T06:07:31.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:31.119+0000 7f3c9ac00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3c94119ba0 con 0x7f3c94109ad0 2024-05-08T06:07:31.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:31.119+0000 7f3c9ac00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3c94119ea0 con 0x7f3c9410a490 2024-05-08T06:07:31.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:31.119+0000 7f3c93400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c9410a490 0x7f3c941a0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:07:31.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:31.119+0000 7f3c93e00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c94109ad0 0x7f3c941a0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:07:31.120 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:31.119+0000 7f3c98c00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c9410fb60 0x7f3c941a4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:07:31.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:31.119+0000 7f3c93400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c9410a490 0x7f3c941a0690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:47866/0 (socket says 172.21.15.82:47866) 2024-05-08T06:07:31.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:31.119+0000 7f3c93400700 1 -- 172.21.15.82:0/625892598 learned_addr learned my addr 172.21.15.82:0/625892598 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:07:31.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:31.120+0000 7f3c93400700 1 -- 172.21.15.82:0/625892598 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c94109ad0 msgr2=0x7f3c941a0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:07:31.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:31.120+0000 7f3c93400700 1 --2- 172.21.15.82:0/625892598 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c94109ad0 0x7f3c941a0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:31.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:31.120+0000 7f3c93400700 1 -- 172.21.15.82:0/625892598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c9410fb60 msgr2=0x7f3c941a4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:07:31.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:31.120+0000 7f3c93400700 1 --2- 172.21.15.82:0/625892598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c9410fb60 0x7f3c941a4a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:31.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:31.120+0000 7f3c93400700 1 -- 172.21.15.82:0/625892598 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c941a5160 con 0x7f3c9410a490 2024-05-08T06:07:31.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:31.120+0000 7f3c93400700 1 --2- 172.21.15.82:0/625892598 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c9410a490 0x7f3c941a0690 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f3c8000e9a0 tx=0x7f3c8000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:07:31.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:31.120+0000 7f3c90c00700 1 -- 172.21.15.82:0/625892598 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c8000ca10 con 0x7f3c9410a490 2024-05-08T06:07:31.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:31.120+0000 7f3c90c00700 1 -- 172.21.15.82:0/625892598 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f3c8000cbb0 con 0x7f3c9410a490 2024-05-08T06:07:31.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:31.120+0000 7f3c90c00700 1 -- 172.21.15.82:0/625892598 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c80018680 con 0x7f3c9410a490 2024-05-08T06:07:31.121 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:31.121+0000 7f3c9ac00700 1 -- 172.21.15.82:0/625892598 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c941a5450 con 0x7f3c9410a490 2024-05-08T06:07:31.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:31.121+0000 7f3c9ac00700 1 -- 172.21.15.82:0/625892598 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c941accd0 con 0x7f3c9410a490 2024-05-08T06:07:31.122 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:31.122+0000 7f3c9ac00700 1 -- 172.21.15.82:0/625892598 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c9406a190 con 0x7f3c9410a490 2024-05-08T06:07:31.123 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:31.124+0000 7f3c90c00700 1 -- 172.21.15.82:0/625892598 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f3c80010430 con 0x7f3c9410a490 2024-05-08T06:07:31.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:31.126+0000 7f3c90c00700 1 --2- 172.21.15.82:0/625892598 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3c780b2900 0x7f3c780b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:07:31.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:31.126+0000 7f3c90c00700 1 -- 172.21.15.82:0/625892598 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f3c800e2700 con 0x7f3c9410a490 2024-05-08T06:07:31.125 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:31.126+0000 7f3c93e00700 1 --2- 172.21.15.82:0/625892598 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3c780b2900 0x7f3c780b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:07:31.126 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:31.127+0000 7f3c93e00700 1 --2- 172.21.15.82:0/625892598 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3c780b2900 0x7f3c780b4dc0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3c84007b60 tx=0x7f3c840073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:07:31.127 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:31.128+0000 7f3c90c00700 1 -- 172.21.15.82:0/625892598 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f3c800aa3d0 con 0x7f3c9410a490 2024-05-08T06:07:31.378 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:31.378+0000 7f3c9ac00700 1 -- 172.21.15.82:0/625892598 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3c9402e510 con 0x7f3c9410a490 2024-05-08T06:07:31.379 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:31.379+0000 7f3c90c00700 1 -- 172.21.15.82:0/625892598 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v82) ==== 81+0+590 (secure 0 0 0) 0x7f3c800a9cd0 con 0x7f3c9410a490 2024-05-08T06:07:31.379 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/2761274596 2024-05-09T05:37:43.951218+0000 2024-05-08T06:07:31.379 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/2195734928 2024-05-09T05:37:43.951218+0000 2024-05-08T06:07:31.379 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6801/765895649 2024-05-09T05:37:43.951218+0000 2024-05-08T06:07:31.379 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6800/3546670887 2024-05-09T05:37:11.114057+0000 2024-05-08T06:07:31.379 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6800/765895649 2024-05-09T05:37:43.951218+0000 2024-05-08T06:07:31.379 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3986150437 2024-05-09T05:37:11.114057+0000 2024-05-08T06:07:31.380 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/3457457714 2024-05-09T05:37:11.114057+0000 2024-05-08T06:07:31.380 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/2356749286 2024-05-09T05:37:11.114057+0000 2024-05-08T06:07:31.380 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:6801/3546670887 2024-05-09T05:37:11.114057+0000 2024-05-08T06:07:31.380 INFO:teuthology.orchestra.run.smithi082.stdout:172.21.15.82:0/1694643083 2024-05-09T05:37:43.951218+0000 2024-05-08T06:07:31.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:31.383+0000 7f3c9ac00700 1 -- 172.21.15.82:0/625892598 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3c780b2900 msgr2=0x7f3c780b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:07:31.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:31.383+0000 7f3c9ac00700 1 --2- 172.21.15.82:0/625892598 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3c780b2900 0x7f3c780b4dc0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3c84007b60 tx=0x7f3c840073d0 comp rx=0 tx=0).stop 2024-05-08T06:07:31.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:31.383+0000 7f3c9ac00700 1 -- 172.21.15.82:0/625892598 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c9410a490 msgr2=0x7f3c941a0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:07:31.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:31.383+0000 7f3c9ac00700 1 --2- 172.21.15.82:0/625892598 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c9410a490 0x7f3c941a0690 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f3c8000e9a0 tx=0x7f3c8000ecb0 comp rx=0 tx=0).stop 2024-05-08T06:07:31.383 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:31.383+0000 7f3c9ac00700 1 -- 172.21.15.82:0/625892598 shutdown_connections 2024-05-08T06:07:31.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:31.383+0000 7f3c9ac00700 1 --2- 172.21.15.82:0/625892598 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c94109ad0 0x7f3c941a0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:31.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:31.383+0000 7f3c9ac00700 1 --2- 172.21.15.82:0/625892598 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f3c780b2900 0x7f3c780b4dc0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:31.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:31.383+0000 7f3c9ac00700 1 --2- 172.21.15.82:0/625892598 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f3c9410fb60 0x7f3c941a4a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:31.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:31.384+0000 7f3c9ac00700 1 --2- 172.21.15.82:0/625892598 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c9410a490 0x7f3c941a0690 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:31.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:31.384+0000 7f3c9ac00700 1 -- 172.21.15.82:0/625892598 >> 172.21.15.82:0/625892598 conn(0x7f3c94076c70 msgr2=0x7f3c940773c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:07:31.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:31.384+0000 7f3c9ac00700 1 -- 172.21.15.82:0/625892598 shutdown_connections 2024-05-08T06:07:31.384 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:31.384+0000 7f3c9ac00700 1 -- 172.21.15.82:0/625892598 wait complete. 2024-05-08T06:07:31.385 INFO:teuthology.orchestra.run.smithi082.stderr:listed 10 entries 2024-05-08T06:07:32.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:31 smithi151 ceph-mon[34815]: pgmap v965: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-08T06:07:32.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:31 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/625892598' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-08T06:07:32.201 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:31 smithi082 ceph-mon[30098]: pgmap v965: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-08T06:07:32.201 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:31 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/625892598' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-08T06:07:32.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:31 smithi134 ceph-mon[34132]: pgmap v965: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-08T06:07:32.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:31 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/625892598' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-08T06:07:32.269 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-05-08T06:07:32.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T06:07:32.270 DEBUG:teuthology.orchestra.run.smithi082:> sudo umount /tmp/cephfs 2024-05-08T06:07:32.612 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi082.front.sepia.ceph.com 2024-05-08T06:07:32.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T06:07:32.613 DEBUG:teuthology.orchestra.run.smithi082:> (cd /home/ubuntu/cephtest && exec rmdir -- /tmp/cephfs) 2024-05-08T06:07:32.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T06:07:32.699 DEBUG:teuthology.orchestra.run.smithi082:> ip netns list 2024-05-08T06:07:32.775 INFO:teuthology.orchestra.run.smithi082.stdout:ceph-ns--tmp-cephfs (id: 0) 2024-05-08T06:07:32.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T06:07:32.777 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip netns delete ceph-ns--tmp-cephfs 2024-05-08T06:07:32.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-08T06:07:32.910 DEBUG:teuthology.orchestra.run.smithi082:> sudo ip link delete ceph-brx 2024-05-08T06:07:33.072 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-05-08T06:07:33.083 INFO:tasks.cephadm:Teardown begin 2024-05-08T06:07:33.083 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-08T06:07:33.084 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T06:07:33.550 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:07:33.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:33 smithi082 ceph-mon[30098]: pgmap v966: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-08T06:07:34.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:33 smithi151 ceph-mon[34815]: pgmap v966: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-08T06:07:34.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:33 smithi134 ceph-mon[34132]: pgmap v966: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-08T06:07:35.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:35.844+0000 7f2589800700 1 -- 172.21.15.82:0/2465103818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f258410d9c0 msgr2=0x7f258410fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:07:35.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:35.844+0000 7f2589800700 1 --2- 172.21.15.82:0/2465103818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f258410d9c0 0x7f258410fe80 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f257c00b0a0 tx=0x7f257c00b3b0 comp rx=0 tx=0).stop 2024-05-08T06:07:35.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:35.844+0000 7f2589800700 1 -- 172.21.15.82:0/2465103818 shutdown_connections 2024-05-08T06:07:35.846 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:35.844+0000 7f2589800700 1 --2- 172.21.15.82:0/2465103818 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2584104590 0x7f2584104970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:35.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:35.844+0000 7f2589800700 1 --2- 172.21.15.82:0/2465103818 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f258410d9c0 0x7f258410fe80 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:35.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:35.844+0000 7f2589800700 1 --2- 172.21.15.82:0/2465103818 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2584104eb0 0x7f258410d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:35.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:35.844+0000 7f2589800700 1 -- 172.21.15.82:0/2465103818 >> 172.21.15.82:0/2465103818 conn(0x7f25840fddc0 msgr2=0x7f25841001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:07:35.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:35.844+0000 7f2589800700 1 -- 172.21.15.82:0/2465103818 shutdown_connections 2024-05-08T06:07:35.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:35.844+0000 7f2589800700 1 -- 172.21.15.82:0/2465103818 wait complete. 2024-05-08T06:07:35.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:35.845+0000 7f2589800700 1 Processor -- start 2024-05-08T06:07:35.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:35.846+0000 7f2589800700 1 -- start start 2024-05-08T06:07:35.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:35.846+0000 7f2589800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2584104590 0x7f25841a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:07:35.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:35.846+0000 7f2589800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2584104eb0 0x7f25841a1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:07:35.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:35.846+0000 7f2589800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f258410d9c0 0x7f258419ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:07:35.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:35.846+0000 7f2589800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f25841135e0 con 0x7f2584104590 2024-05-08T06:07:35.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:35.846+0000 7f2589800700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2584113460 con 0x7f258410d9c0 2024-05-08T06:07:35.847 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:35.846+0000 7f2589800700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2584113760 con 0x7f2584104eb0 2024-05-08T06:07:35.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:35.846+0000 7f2583400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2584104eb0 0x7f25841a1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:07:35.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:35.846+0000 7f2583e00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2584104590 0x7f25841a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:07:35.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:35.846+0000 7f2583400700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2584104eb0 0x7f25841a1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:53762/0 (socket says 172.21.15.82:53762) 2024-05-08T06:07:35.848 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:35.846+0000 7f2583400700 1 -- 172.21.15.82:0/3482521105 learned_addr learned my addr 172.21.15.82:0/3482521105 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:07:35.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:35.847+0000 7f2588e00700 1 --2- 172.21.15.82:0/3482521105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f258410d9c0 0x7f258419ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:07:35.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:35.847+0000 7f2583400700 1 -- 172.21.15.82:0/3482521105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f258410d9c0 msgr2=0x7f258419ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:07:35.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:35.847+0000 7f2583400700 1 --2- 172.21.15.82:0/3482521105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f258410d9c0 0x7f258419ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:35.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:35.847+0000 7f2583400700 1 -- 172.21.15.82:0/3482521105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2584104590 msgr2=0x7f25841a18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:07:35.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:35.847+0000 7f2583400700 1 --2- 172.21.15.82:0/3482521105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2584104590 0x7f25841a18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:35.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:35.847+0000 7f2583400700 1 -- 172.21.15.82:0/3482521105 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f258419c1d0 con 0x7f2584104eb0 2024-05-08T06:07:35.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:35.847+0000 7f2588e00700 1 --2- 172.21.15.82:0/3482521105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f258410d9c0 0x7f258419ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:07:35.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:35.847+0000 7f2583e00700 1 --2- 172.21.15.82:0/3482521105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2584104590 0x7f25841a18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:07:35.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:35.847+0000 7f2583400700 1 --2- 172.21.15.82:0/3482521105 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2584104eb0 0x7f25841a1df0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f257000e9f0 tx=0x7f257000ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:07:35.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:35.847+0000 7f2580c00700 1 -- 172.21.15.82:0/3482521105 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2570004a30 con 0x7f2584104eb0 2024-05-08T06:07:35.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:35.848+0000 7f2580c00700 1 -- 172.21.15.82:0/3482521105 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f257000cc70 con 0x7f2584104eb0 2024-05-08T06:07:35.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:35.848+0000 7f2580c00700 1 -- 172.21.15.82:0/3482521105 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2570005600 con 0x7f2584104eb0 2024-05-08T06:07:35.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:35.848+0000 7f2589800700 1 -- 172.21.15.82:0/3482521105 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f258419c4c0 con 0x7f2584104eb0 2024-05-08T06:07:35.849 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:35.848+0000 7f2589800700 1 -- 172.21.15.82:0/3482521105 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25841a8780 con 0x7f2584104eb0 2024-05-08T06:07:35.850 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:35.849+0000 7f2589800700 1 -- 172.21.15.82:0/3482521105 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f258406a190 con 0x7f2584104eb0 2024-05-08T06:07:35.852 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:35.852+0000 7f2580c00700 1 -- 172.21.15.82:0/3482521105 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f257000c7c0 con 0x7f2584104eb0 2024-05-08T06:07:35.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:35.854+0000 7f2580c00700 1 --2- 172.21.15.82:0/3482521105 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f25680b2880 0x7f25680b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:07:35.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:35.854+0000 7f2580c00700 1 -- 172.21.15.82:0/3482521105 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f25700e2600 con 0x7f2584104eb0 2024-05-08T06:07:35.853 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:35.854+0000 7f2583e00700 1 --2- 172.21.15.82:0/3482521105 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f25680b2880 0x7f25680b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:07:35.854 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:35.855+0000 7f2583e00700 1 --2- 172.21.15.82:0/3482521105 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f25680b2880 0x7f25680b4d40 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f258419cbb0 tx=0x7f2574009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:07:35.858 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:35.858+0000 7f2580c00700 1 -- 172.21.15.82:0/3482521105 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f257000ce20 con 0x7f2584104eb0 2024-05-08T06:07:36.138 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:36.138+0000 7f2589800700 1 -- 172.21.15.82:0/3482521105 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f25841a89b0 con 0x7f2584104eb0 2024-05-08T06:07:36.139 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:35 smithi082 ceph-mon[30098]: pgmap v967: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 341 B/s wr, 10 op/s 2024-05-08T06:07:36.139 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:36.139+0000 7f2580c00700 1 -- 172.21.15.82:0/3482521105 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11948 (secure 0 0 0) 0x7f25700aa2d0 con 0x7f2584104eb0 2024-05-08T06:07:36.139 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T06:07:36.140 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14364,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3876883250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3876883250},{"type":"v1","addr":"172.21.15.82:6835","nonce":3876883250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1965070586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1965070586},{"type":"v1","addr":"172.21.15.82:6837","nonce":1965070586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":31,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T05:45:57.654009+0000","modified":"2024-05-08T05:53:20.165672+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24505,"mds_2":24487,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14397":{"gid":14397,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/1890720973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1890720973},{"type":"v1","addr":"172.21.15.82:6839","nonce":1890720973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14409":{"gid":14409,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/2957083305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":2957083305},{"type":"v1","addr":"172.21.15.82:6841","nonce":2957083305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6833/3827691638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3827691638},{"type":"v1","addr":"172.21.15.134:6833","nonce":3827691638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6833/3625067797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3625067797},{"type":"v1","addr":"172.21.15.151:6833","nonce":3625067797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/4074163402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4074163402},{"type":"v1","addr":"172.21.15.134:6835","nonce":4074163402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.134:6837/2212411710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2212411710},{"type":"v1","addr":"172.21.15.134:6837","nonce":2212411710}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":17,"addr":"172.21.15.151:6835/2093655929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2093655929},{"type":"v1","addr":"172.21.15.151:6835","nonce":2093655929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6837/4192404464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":4192404464},{"type":"v1","addr":"172.21.15.151:6837","nonce":4192404464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":14,"addr":"172.21.15.151:6839/2963754236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":2963754236},{"type":"v1","addr":"172.21.15.151:6839","nonce":2963754236}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.134:6839/1145270893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1145270893},{"type":"v1","addr":"172.21.15.134:6839","nonce":1145270893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24505,24506,24487,24475,24467]},"id":1}]} 2024-05-08T06:07:36.142 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:36.143+0000 7f2589800700 1 -- 172.21.15.82:0/3482521105 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f25680b2880 msgr2=0x7f25680b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:07:36.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:36.143+0000 7f2589800700 1 --2- 172.21.15.82:0/3482521105 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f25680b2880 0x7f25680b4d40 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f258419cbb0 tx=0x7f2574009260 comp rx=0 tx=0).stop 2024-05-08T06:07:36.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:36.143+0000 7f2589800700 1 -- 172.21.15.82:0/3482521105 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2584104eb0 msgr2=0x7f25841a1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:07:36.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:36.143+0000 7f2589800700 1 --2- 172.21.15.82:0/3482521105 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2584104eb0 0x7f25841a1df0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f257000e9f0 tx=0x7f257000ed00 comp rx=0 tx=0).stop 2024-05-08T06:07:36.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:36.143+0000 7f2589800700 1 -- 172.21.15.82:0/3482521105 shutdown_connections 2024-05-08T06:07:36.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:36.143+0000 7f2589800700 1 --2- 172.21.15.82:0/3482521105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f258410d9c0 0x7f258419ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:36.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:36.143+0000 7f2589800700 1 --2- 172.21.15.82:0/3482521105 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f25680b2880 0x7f25680b4d40 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:36.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:36.143+0000 7f2589800700 1 --2- 172.21.15.82:0/3482521105 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f2584104590 0x7f25841a18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:36.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:36.143+0000 7f2589800700 1 --2- 172.21.15.82:0/3482521105 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2584104eb0 0x7f25841a1df0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:36.143 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:36.143+0000 7f2589800700 1 -- 172.21.15.82:0/3482521105 >> 172.21.15.82:0/3482521105 conn(0x7f25840fddc0 msgr2=0x7f25841001b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:07:36.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:36.143+0000 7f2589800700 1 -- 172.21.15.82:0/3482521105 shutdown_connections 2024-05-08T06:07:36.144 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:36.143+0000 7f2589800700 1 -- 172.21.15.82:0/3482521105 wait complete. 2024-05-08T06:07:36.144 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 31 2024-05-08T06:07:36.206 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:35 smithi151 ceph-mon[34815]: pgmap v967: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 341 B/s wr, 10 op/s 2024-05-08T06:07:36.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:35 smithi134 ceph-mon[34132]: pgmap v967: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 341 B/s wr, 10 op/s 2024-05-08T06:07:36.970 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph fs dump --format=json 2024-05-08T06:07:37.140 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:36 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/3482521105' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:07:37.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:36 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/3482521105' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:07:37.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:36 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/3482521105' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:07:37.415 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:07:38.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:37 smithi082 ceph-mon[30098]: pgmap v968: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 767 B/s wr, 12 op/s 2024-05-08T06:07:38.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:37 smithi134 ceph-mon[34132]: pgmap v968: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 767 B/s wr, 12 op/s 2024-05-08T06:07:38.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:37 smithi151 ceph-mon[34815]: pgmap v968: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 767 B/s wr, 12 op/s 2024-05-08T06:07:39.690 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:39.690+0000 7fc14de00700 1 -- 172.21.15.82:0/2931698325 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc148103750 msgr2=0x7fc148103b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:07:39.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:39.690+0000 7fc14de00700 1 --2- 172.21.15.82:0/2931698325 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc148103750 0x7fc148103b30 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fc1380099c0 tx=0x7fc138009cd0 comp rx=0 tx=0).stop 2024-05-08T06:07:39.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:39.690+0000 7fc14de00700 1 -- 172.21.15.82:0/2931698325 shutdown_connections 2024-05-08T06:07:39.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:39.690+0000 7fc14de00700 1 --2- 172.21.15.82:0/2931698325 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc148103750 0x7fc148103b30 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:39.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:39.690+0000 7fc14de00700 1 --2- 172.21.15.82:0/2931698325 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc148108850 0x7fc1481103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:39.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:39.690+0000 7fc14de00700 1 --2- 172.21.15.82:0/2931698325 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc148104100 0x7fc148108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:39.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:39.690+0000 7fc14de00700 1 -- 172.21.15.82:0/2931698325 >> 172.21.15.82:0/2931698325 conn(0x7fc14807a600 msgr2=0x7fc14807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:07:39.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:39.690+0000 7fc14de00700 1 -- 172.21.15.82:0/2931698325 shutdown_connections 2024-05-08T06:07:39.691 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:39.690+0000 7fc14de00700 1 -- 172.21.15.82:0/2931698325 wait complete. 2024-05-08T06:07:39.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:39.692+0000 7fc14de00700 1 Processor -- start 2024-05-08T06:07:39.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:39.692+0000 7fc14de00700 1 -- start start 2024-05-08T06:07:39.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:39.692+0000 7fc14de00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc148103750 0x7fc1481a06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:07:39.692 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:39.692+0000 7fc14de00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc148104100 0x7fc1481a0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:07:39.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:39.692+0000 7fc14de00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc148108850 0x7fc14810f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:07:39.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:39.692+0000 7fc14de00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fc148113670 con 0x7fc148108850 2024-05-08T06:07:39.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:39.692+0000 7fc14de00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc1481134f0 con 0x7fc148104100 2024-05-08T06:07:39.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:39.692+0000 7fc14de00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc1481137f0 con 0x7fc148103750 2024-05-08T06:07:39.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:39.693+0000 7fc146a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc148103750 0x7fc1481a06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:07:39.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:39.693+0000 7fc146a00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc148103750 0x7fc1481a06c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.82:53778/0 (socket says 172.21.15.82:53778) 2024-05-08T06:07:39.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:39.693+0000 7fc146a00700 1 -- 172.21.15.82:0/2948495844 learned_addr learned my addr 172.21.15.82:0/2948495844 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:07:39.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:39.693+0000 7fc13fe00700 1 --2- 172.21.15.82:0/2948495844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc148104100 0x7fc1481a0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:07:39.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:39.693+0000 7fc147400700 1 --2- 172.21.15.82:0/2948495844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc148108850 0x7fc14810f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:07:39.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:39.693+0000 7fc146a00700 1 -- 172.21.15.82:0/2948495844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc148104100 msgr2=0x7fc1481a0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:07:39.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:39.693+0000 7fc146a00700 1 --2- 172.21.15.82:0/2948495844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc148104100 0x7fc1481a0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:39.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:39.693+0000 7fc146a00700 1 -- 172.21.15.82:0/2948495844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc148108850 msgr2=0x7fc14810f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:07:39.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:39.693+0000 7fc146a00700 1 --2- 172.21.15.82:0/2948495844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc148108850 0x7fc14810f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:39.693 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:39.693+0000 7fc146a00700 1 -- 172.21.15.82:0/2948495844 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc14810fd90 con 0x7fc148103750 2024-05-08T06:07:39.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:39.693+0000 7fc147400700 1 --2- 172.21.15.82:0/2948495844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc148108850 0x7fc14810f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-08T06:07:39.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:39.693+0000 7fc146a00700 1 --2- 172.21.15.82:0/2948495844 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc148103750 0x7fc1481a06c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc138005910 tx=0x7fc138004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:07:39.694 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:39.694+0000 7fc14ca00700 1 -- 172.21.15.82:0/2948495844 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc138026070 con 0x7fc148103750 2024-05-08T06:07:39.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:39.694+0000 7fc14ca00700 1 -- 172.21.15.82:0/2948495844 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fc138003c70 con 0x7fc148103750 2024-05-08T06:07:39.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:39.694+0000 7fc14ca00700 1 -- 172.21.15.82:0/2948495844 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc13800fb50 con 0x7fc148103750 2024-05-08T06:07:39.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:39.694+0000 7fc14de00700 1 -- 172.21.15.82:0/2948495844 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc148110020 con 0x7fc148103750 2024-05-08T06:07:39.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:39.694+0000 7fc14de00700 1 -- 172.21.15.82:0/2948495844 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc14819c200 con 0x7fc148103750 2024-05-08T06:07:39.695 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:39.695+0000 7fc14de00700 1 -- 172.21.15.82:0/2948495844 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc14806a190 con 0x7fc148103750 2024-05-08T06:07:39.697 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:39.698+0000 7fc14ca00700 1 -- 172.21.15.82:0/2948495844 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fc138029070 con 0x7fc148103750 2024-05-08T06:07:39.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:39.699+0000 7fc14ca00700 1 --2- 172.21.15.82:0/2948495844 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc12c0b2900 0x7fc12c0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:07:39.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:39.699+0000 7fc14ca00700 1 -- 172.21.15.82:0/2948495844 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fc1380e2f20 con 0x7fc148103750 2024-05-08T06:07:39.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:39.699+0000 7fc13fe00700 1 --2- 172.21.15.82:0/2948495844 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc12c0b2900 0x7fc12c0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:07:39.699 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:39.700+0000 7fc13fe00700 1 --2- 172.21.15.82:0/2948495844 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc12c0b2900 0x7fc12c0b4dc0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc1481032e0 tx=0x7fc130009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:07:39.701 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:39.701+0000 7fc14ca00700 1 -- 172.21.15.82:0/2948495844 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc138030080 con 0x7fc148103750 2024-05-08T06:07:39.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:39 smithi082 ceph-mon[30098]: pgmap v969: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 852 B/s wr, 11 op/s 2024-05-08T06:07:39.987 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:39.987+0000 7fc14de00700 1 -- 172.21.15.82:0/2948495844 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc14819ccf0 con 0x7fc148103750 2024-05-08T06:07:39.989 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:39.988+0000 7fc14ca00700 1 -- 172.21.15.82:0/2948495844 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11948 (secure 0 0 0) 0x7fc138013070 con 0x7fc148103750 2024-05-08T06:07:39.989 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T06:07:39.989 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14364,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6835/3876883250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6834","nonce":3876883250},{"type":"v1","addr":"172.21.15.82:6835","nonce":3876883250}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14370,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.82:6837/1965070586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6836","nonce":1965070586},{"type":"v1","addr":"172.21.15.82:6837","nonce":1965070586}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":31,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-08T05:45:57.654009+0000","modified":"2024-05-08T05:53:20.165672+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24506,"mds_1":24505,"mds_2":24487,"mds_3":24475,"mds_4":24467},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14397":{"gid":14397,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6839/1890720973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6838","nonce":1890720973},{"type":"v1","addr":"172.21.15.82:6839","nonce":1890720973}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14409":{"gid":14409,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.82:6841/2957083305","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6840","nonce":2957083305},{"type":"v1","addr":"172.21.15.82:6841","nonce":2957083305}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24425":{"gid":24425,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6833/3827691638","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":3827691638},{"type":"v1","addr":"172.21.15.134:6833","nonce":3827691638}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6833/3625067797","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3625067797},{"type":"v1","addr":"172.21.15.151:6833","nonce":3625067797}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24455":{"gid":24455,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/4074163402","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":4074163402},{"type":"v1","addr":"172.21.15.134:6835","nonce":4074163402}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24467":{"gid":24467,"name":"h","rank":4,"incarnation":25,"state":"up:active","state_seq":16,"addr":"172.21.15.134:6837/2212411710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2212411710},{"type":"v1","addr":"172.21.15.134:6837","nonce":2212411710}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24475":{"gid":24475,"name":"f","rank":3,"incarnation":23,"state":"up:active","state_seq":17,"addr":"172.21.15.151:6835/2093655929","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2093655929},{"type":"v1","addr":"172.21.15.151:6835","nonce":2093655929}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24487":{"gid":24487,"name":"c","rank":2,"incarnation":21,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6837/4192404464","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":4192404464},{"type":"v1","addr":"172.21.15.151:6837","nonce":4192404464}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24505":{"gid":24505,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":14,"addr":"172.21.15.151:6839/2963754236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":2963754236},{"type":"v1","addr":"172.21.15.151:6839","nonce":2963754236}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24506":{"gid":24506,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":7,"addr":"172.21.15.134:6839/1145270893","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1145270893},{"type":"v1","addr":"172.21.15.134:6839","nonce":1145270893}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24506,"qdb_cluster":[24505,24506,24487,24475,24467]},"id":1}]} 2024-05-08T06:07:39.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:39.992+0000 7fc14de00700 1 -- 172.21.15.82:0/2948495844 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc12c0b2900 msgr2=0x7fc12c0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:07:39.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:39.992+0000 7fc14de00700 1 --2- 172.21.15.82:0/2948495844 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc12c0b2900 0x7fc12c0b4dc0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fc1481032e0 tx=0x7fc130009260 comp rx=0 tx=0).stop 2024-05-08T06:07:39.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:39.992+0000 7fc14de00700 1 -- 172.21.15.82:0/2948495844 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc148103750 msgr2=0x7fc1481a06c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:07:39.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:39.992+0000 7fc14de00700 1 --2- 172.21.15.82:0/2948495844 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc148103750 0x7fc1481a06c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc138005910 tx=0x7fc138004270 comp rx=0 tx=0).stop 2024-05-08T06:07:39.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:39.992+0000 7fc14de00700 1 -- 172.21.15.82:0/2948495844 shutdown_connections 2024-05-08T06:07:39.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:39.992+0000 7fc14de00700 1 --2- 172.21.15.82:0/2948495844 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fc12c0b2900 0x7fc12c0b4dc0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:39.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:39.992+0000 7fc14de00700 1 --2- 172.21.15.82:0/2948495844 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fc148108850 0x7fc14810f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:39.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:39.992+0000 7fc14de00700 1 --2- 172.21.15.82:0/2948495844 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc148103750 0x7fc1481a06c0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:39.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:39.992+0000 7fc14de00700 1 --2- 172.21.15.82:0/2948495844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc148104100 0x7fc1481a0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:39.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:39.992+0000 7fc14de00700 1 -- 172.21.15.82:0/2948495844 >> 172.21.15.82:0/2948495844 conn(0x7fc14807a600 msgr2=0x7fc1481019a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:07:39.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:39.992+0000 7fc14de00700 1 -- 172.21.15.82:0/2948495844 shutdown_connections 2024-05-08T06:07:39.993 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:39.992+0000 7fc14de00700 1 -- 172.21.15.82:0/2948495844 wait complete. 2024-05-08T06:07:39.994 INFO:teuthology.orchestra.run.smithi082.stderr:dumped fsmap epoch 31 2024-05-08T06:07:40.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:39 smithi134 ceph-mon[34132]: pgmap v969: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 852 B/s wr, 11 op/s 2024-05-08T06:07:40.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:39 smithi151 ceph-mon[34815]: pgmap v969: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 852 B/s wr, 11 op/s 2024-05-08T06:07:40.795 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph osd dump --format=json 2024-05-08T06:07:41.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:40 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/2948495844' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:07:41.231 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:07:41.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:40 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/2948495844' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:07:41.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:40 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/2948495844' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-08T06:07:42.220 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:41 smithi082 ceph-mon[30098]: pgmap v970: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 852 B/s wr, 11 op/s 2024-05-08T06:07:42.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:41 smithi134 ceph-mon[34132]: pgmap v970: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 852 B/s wr, 11 op/s 2024-05-08T06:07:42.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:41 smithi151 ceph-mon[34815]: pgmap v970: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 852 B/s wr, 11 op/s 2024-05-08T06:07:43.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:43.518+0000 7f5b28200700 1 -- 172.21.15.82:0/2039058478 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5b2010a490 msgr2=0x7f5b201169a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:07:43.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:43.518+0000 7f5b28200700 1 --2- 172.21.15.82:0/2039058478 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5b2010a490 0x7f5b201169a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f5b1800b0a0 tx=0x7f5b1800b3b0 comp rx=0 tx=0).stop 2024-05-08T06:07:43.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:43.519+0000 7f5b28200700 1 -- 172.21.15.82:0/2039058478 shutdown_connections 2024-05-08T06:07:43.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:43.519+0000 7f5b28200700 1 --2- 172.21.15.82:0/2039058478 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5b2010a490 0x7f5b201169a0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:43.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:43.519+0000 7f5b28200700 1 --2- 172.21.15.82:0/2039058478 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b2010fb60 0x7f5b2010ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:43.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:43.519+0000 7f5b28200700 1 --2- 172.21.15.82:0/2039058478 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b20109ad0 0x7f5b20109f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:43.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:43.519+0000 7f5b28200700 1 -- 172.21.15.82:0/2039058478 >> 172.21.15.82:0/2039058478 conn(0x7f5b20076c70 msgr2=0x7f5b201082c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:07:43.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:43.519+0000 7f5b28200700 1 -- 172.21.15.82:0/2039058478 shutdown_connections 2024-05-08T06:07:43.520 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:43.519+0000 7f5b28200700 1 -- 172.21.15.82:0/2039058478 wait complete. 2024-05-08T06:07:43.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:43.520+0000 7f5b28200700 1 Processor -- start 2024-05-08T06:07:43.521 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:43.520+0000 7f5b28200700 1 -- start start 2024-05-08T06:07:43.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:43.521+0000 7f5b28200700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b20109ad0 0x7f5b201a01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:07:43.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:43.521+0000 7f5b28200700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b2010a490 0x7f5b201a06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:07:43.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:43.521+0000 7f5b28200700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5b2010fb60 0x7f5b201a4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:07:43.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:43.521+0000 7f5b28200700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f5b20119d20 con 0x7f5b20109ad0 2024-05-08T06:07:43.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:43.521+0000 7f5b28200700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5b20119ba0 con 0x7f5b2010a490 2024-05-08T06:07:43.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:43.521+0000 7f5b28200700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5b20119ea0 con 0x7f5b2010fb60 2024-05-08T06:07:43.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:43.521+0000 7f5b25800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b20109ad0 0x7f5b201a01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:07:43.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:43.521+0000 7f5b25800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b20109ad0 0x7f5b201a01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55518/0 (socket says 172.21.15.82:55518) 2024-05-08T06:07:43.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:43.521+0000 7f5b25800700 1 -- 172.21.15.82:0/4245334881 learned_addr learned my addr 172.21.15.82:0/4245334881 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:07:43.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:43.521+0000 7f5b24e00700 1 --2- 172.21.15.82:0/4245334881 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b2010a490 0x7f5b201a06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:07:43.522 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:43.521+0000 7f5b26200700 1 --2- 172.21.15.82:0/4245334881 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5b2010fb60 0x7f5b201a4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:07:43.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:43.521+0000 7f5b25800700 1 -- 172.21.15.82:0/4245334881 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5b2010fb60 msgr2=0x7f5b201a4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:07:43.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:43.521+0000 7f5b25800700 1 --2- 172.21.15.82:0/4245334881 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5b2010fb60 0x7f5b201a4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:43.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:43.521+0000 7f5b25800700 1 -- 172.21.15.82:0/4245334881 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b2010a490 msgr2=0x7f5b201a06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:07:43.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:43.521+0000 7f5b25800700 1 --2- 172.21.15.82:0/4245334881 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b2010a490 0x7f5b201a06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:43.523 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:43.521+0000 7f5b25800700 1 -- 172.21.15.82:0/4245334881 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b201a51c0 con 0x7f5b20109ad0 2024-05-08T06:07:43.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:43.522+0000 7f5b25800700 1 --2- 172.21.15.82:0/4245334881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b20109ad0 0x7f5b201a01b0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5b1400eb30 tx=0x7f5b1400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:07:43.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:43.522+0000 7f5b1e000700 1 -- 172.21.15.82:0/4245334881 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b1400cbd0 con 0x7f5b20109ad0 2024-05-08T06:07:43.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:43.522+0000 7f5b28200700 1 -- 172.21.15.82:0/4245334881 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b201a54b0 con 0x7f5b20109ad0 2024-05-08T06:07:43.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:43.522+0000 7f5b1e000700 1 -- 172.21.15.82:0/4245334881 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f5b140044d0 con 0x7f5b20109ad0 2024-05-08T06:07:43.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:43.522+0000 7f5b1e000700 1 -- 172.21.15.82:0/4245334881 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b14003e30 con 0x7f5b20109ad0 2024-05-08T06:07:43.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:43.522+0000 7f5b28200700 1 -- 172.21.15.82:0/4245334881 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b201acd30 con 0x7f5b20109ad0 2024-05-08T06:07:43.524 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:43.524+0000 7f5b28200700 1 -- 172.21.15.82:0/4245334881 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b2006a190 con 0x7f5b20109ad0 2024-05-08T06:07:43.526 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:43.526+0000 7f5b1e000700 1 -- 172.21.15.82:0/4245334881 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f5b14004000 con 0x7f5b20109ad0 2024-05-08T06:07:43.527 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:43.527+0000 7f5b1e000700 1 --2- 172.21.15.82:0/4245334881 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f5b080b2900 0x7f5b080b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:07:43.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:43.527+0000 7f5b1e000700 1 -- 172.21.15.82:0/4245334881 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7f5b140e2540 con 0x7f5b20109ad0 2024-05-08T06:07:43.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:43.528+0000 7f5b24e00700 1 --2- 172.21.15.82:0/4245334881 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f5b080b2900 0x7f5b080b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:07:43.528 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:43.528+0000 7f5b24e00700 1 --2- 172.21.15.82:0/4245334881 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f5b080b2900 0x7f5b080b4dc0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5b20078bc0 tx=0x7f5b0c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:07:43.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:43.533+0000 7f5b1e000700 1 -- 172.21.15.82:0/4245334881 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5b140042f0 con 0x7f5b20109ad0 2024-05-08T06:07:43.766 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:43.765+0000 7f5b28200700 1 -- 172.21.15.82:0/4245334881 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5b201a1540 con 0x7f5b20109ad0 2024-05-08T06:07:43.770 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:43.769+0000 7f5b1e000700 1 -- 172.21.15.82:0/4245334881 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+22631 (secure 0 0 0) 0x7f5b201a1540 con 0x7f5b20109ad0 2024-05-08T06:07:43.771 INFO:teuthology.orchestra.run.smithi082.stdout: 2024-05-08T06:07:43.771 INFO:teuthology.orchestra.run.smithi082.stdout:{"epoch":82,"fsid":"c739a5c8-0cfc-11ef-bc97-c7b262605968","created":"2024-05-08T05:36:37.441393+0000","modified":"2024-05-08T05:46:45.754375+0000","last_up_change":"2024-05-08T05:44:40.677995+0000","last_in_change":"2024-05-08T05:44:20.654220+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-08T05:40:28.102836+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-08T05:45:48.727521+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-08T05:45:53.574048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bc9bd472-b765-4893-84ed-c66b5c1c61b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6802","nonce":4051651615},{"type":"v1","addr":"172.21.15.82:6803","nonce":4051651615}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6804","nonce":4051651615},{"type":"v1","addr":"172.21.15.82:6805","nonce":4051651615}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6808","nonce":4051651615},{"type":"v1","addr":"172.21.15.82:6809","nonce":4051651615}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6806","nonce":4051651615},{"type":"v1","addr":"172.21.15.82:6807","nonce":4051651615}]},"public_addr":"172.21.15.82:6803/4051651615","cluster_addr":"172.21.15.82:6805/4051651615","heartbeat_back_addr":"172.21.15.82:6809/4051651615","heartbeat_front_addr":"172.21.15.82:6807/4051651615","state":["exists","up"]},{"osd":1,"uuid":"ad2d3a6b-8bc5-4177-8757-07e8607ca240","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":2763858634},{"type":"v1","addr":"172.21.15.134:6801","nonce":2763858634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":2763858634},{"type":"v1","addr":"172.21.15.134:6803","nonce":2763858634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":2763858634},{"type":"v1","addr":"172.21.15.134:6807","nonce":2763858634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2763858634},{"type":"v1","addr":"172.21.15.134:6805","nonce":2763858634}]},"public_addr":"172.21.15.134:6801/2763858634","cluster_addr":"172.21.15.134:6803/2763858634","heartbeat_back_addr":"172.21.15.134:6807/2763858634","heartbeat_front_addr":"172.21.15.134:6805/2763858634","state":["exists","up"]},{"osd":2,"uuid":"a06dc8fc-7324-4e42-9487-8cfe372401b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":4193933269},{"type":"v1","addr":"172.21.15.151:6801","nonce":4193933269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":4193933269},{"type":"v1","addr":"172.21.15.151:6803","nonce":4193933269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":4193933269},{"type":"v1","addr":"172.21.15.151:6807","nonce":4193933269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":4193933269},{"type":"v1","addr":"172.21.15.151:6805","nonce":4193933269}]},"public_addr":"172.21.15.151:6801/4193933269","cluster_addr":"172.21.15.151:6803/4193933269","heartbeat_back_addr":"172.21.15.151:6807/4193933269","heartbeat_front_addr":"172.21.15.151:6805/4193933269","state":["exists","up"]},{"osd":3,"uuid":"b8c8bdcd-fbd7-4494-976e-7285408e010e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6810","nonce":2775272422},{"type":"v1","addr":"172.21.15.82:6811","nonce":2775272422}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6812","nonce":2775272422},{"type":"v1","addr":"172.21.15.82:6813","nonce":2775272422}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6816","nonce":2775272422},{"type":"v1","addr":"172.21.15.82:6817","nonce":2775272422}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6814","nonce":2775272422},{"type":"v1","addr":"172.21.15.82:6815","nonce":2775272422}]},"public_addr":"172.21.15.82:6811/2775272422","cluster_addr":"172.21.15.82:6813/2775272422","heartbeat_back_addr":"172.21.15.82:6817/2775272422","heartbeat_front_addr":"172.21.15.82:6815/2775272422","state":["exists","up"]},{"osd":4,"uuid":"391a6040-03d1-483c-9058-308b5998e7c5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3565208751},{"type":"v1","addr":"172.21.15.134:6809","nonce":3565208751}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3565208751},{"type":"v1","addr":"172.21.15.134:6811","nonce":3565208751}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3565208751},{"type":"v1","addr":"172.21.15.134:6815","nonce":3565208751}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3565208751},{"type":"v1","addr":"172.21.15.134:6813","nonce":3565208751}]},"public_addr":"172.21.15.134:6809/3565208751","cluster_addr":"172.21.15.134:6811/3565208751","heartbeat_back_addr":"172.21.15.134:6815/3565208751","heartbeat_front_addr":"172.21.15.134:6813/3565208751","state":["exists","up"]},{"osd":5,"uuid":"dacce079-4aad-474e-b747-1ed60c3c71cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":1925634069},{"type":"v1","addr":"172.21.15.151:6809","nonce":1925634069}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":1925634069},{"type":"v1","addr":"172.21.15.151:6811","nonce":1925634069}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1925634069},{"type":"v1","addr":"172.21.15.151:6815","nonce":1925634069}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1925634069},{"type":"v1","addr":"172.21.15.151:6813","nonce":1925634069}]},"public_addr":"172.21.15.151:6809/1925634069","cluster_addr":"172.21.15.151:6811/1925634069","heartbeat_back_addr":"172.21.15.151:6815/1925634069","heartbeat_front_addr":"172.21.15.151:6813/1925634069","state":["exists","up"]},{"osd":6,"uuid":"6a445bf4-09c4-4e9b-be6e-68ef3c05b365","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6818","nonce":762647976},{"type":"v1","addr":"172.21.15.82:6819","nonce":762647976}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6820","nonce":762647976},{"type":"v1","addr":"172.21.15.82:6821","nonce":762647976}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6824","nonce":762647976},{"type":"v1","addr":"172.21.15.82:6825","nonce":762647976}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6822","nonce":762647976},{"type":"v1","addr":"172.21.15.82:6823","nonce":762647976}]},"public_addr":"172.21.15.82:6819/762647976","cluster_addr":"172.21.15.82:6821/762647976","heartbeat_back_addr":"172.21.15.82:6825/762647976","heartbeat_front_addr":"172.21.15.82:6823/762647976","state":["exists","up"]},{"osd":7,"uuid":"72b0c735-ef30-4823-8ab8-2e5bf7cc3c93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":3006846927},{"type":"v1","addr":"172.21.15.134:6817","nonce":3006846927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":3006846927},{"type":"v1","addr":"172.21.15.134:6819","nonce":3006846927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":3006846927},{"type":"v1","addr":"172.21.15.134:6823","nonce":3006846927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":3006846927},{"type":"v1","addr":"172.21.15.134:6821","nonce":3006846927}]},"public_addr":"172.21.15.134:6817/3006846927","cluster_addr":"172.21.15.134:6819/3006846927","heartbeat_back_addr":"172.21.15.134:6823/3006846927","heartbeat_front_addr":"172.21.15.134:6821/3006846927","state":["exists","up"]},{"osd":8,"uuid":"93e4da0f-48ea-4ab7-b612-26b545b76de6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":787870717},{"type":"v1","addr":"172.21.15.151:6817","nonce":787870717}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":787870717},{"type":"v1","addr":"172.21.15.151:6819","nonce":787870717}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":787870717},{"type":"v1","addr":"172.21.15.151:6823","nonce":787870717}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":787870717},{"type":"v1","addr":"172.21.15.151:6821","nonce":787870717}]},"public_addr":"172.21.15.151:6817/787870717","cluster_addr":"172.21.15.151:6819/787870717","heartbeat_back_addr":"172.21.15.151:6823/787870717","heartbeat_front_addr":"172.21.15.151:6821/787870717","state":["exists","up"]},{"osd":9,"uuid":"ea0070c1-286a-47d3-90cf-d1fada6e3cda","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":60,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6826","nonce":533124002},{"type":"v1","addr":"172.21.15.82:6827","nonce":533124002}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6828","nonce":533124002},{"type":"v1","addr":"172.21.15.82:6829","nonce":533124002}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6832","nonce":533124002},{"type":"v1","addr":"172.21.15.82:6833","nonce":533124002}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.82:6830","nonce":533124002},{"type":"v1","addr":"172.21.15.82:6831","nonce":533124002}]},"public_addr":"172.21.15.82:6827/533124002","cluster_addr":"172.21.15.82:6829/533124002","heartbeat_back_addr":"172.21.15.82:6833/533124002","heartbeat_front_addr":"172.21.15.82:6831/533124002","state":["exists","up"]},{"osd":10,"uuid":"26ca0a0b-ab9e-472f-bb29-428e8c31e5bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":99154842},{"type":"v1","addr":"172.21.15.134:6825","nonce":99154842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":99154842},{"type":"v1","addr":"172.21.15.134:6827","nonce":99154842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":99154842},{"type":"v1","addr":"172.21.15.134:6831","nonce":99154842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":99154842},{"type":"v1","addr":"172.21.15.134:6829","nonce":99154842}]},"public_addr":"172.21.15.134:6825/99154842","cluster_addr":"172.21.15.134:6827/99154842","heartbeat_back_addr":"172.21.15.134:6831/99154842","heartbeat_front_addr":"172.21.15.134:6829/99154842","state":["exists","up"]},{"osd":11,"uuid":"9ae5dca4-acfb-4a46-8601-9d642efde794","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":2242771269},{"type":"v1","addr":"172.21.15.151:6825","nonce":2242771269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2242771269},{"type":"v1","addr":"172.21.15.151:6827","nonce":2242771269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2242771269},{"type":"v1","addr":"172.21.15.151:6831","nonce":2242771269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2242771269},{"type":"v1","addr":"172.21.15.151:6829","nonce":2242771269}]},"public_addr":"172.21.15.151:6825/2242771269","cluster_addr":"172.21.15.151:6827/2242771269","heartbeat_back_addr":"172.21.15.151:6831/2242771269","heartbeat_front_addr":"172.21.15.151:6829/2242771269","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:39:35.575525+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:40:00.672367+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:40:24.558682+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:40:56.791194+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:41:23.031785+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:41:47.926448+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:42:21.231894+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:42:47.599982+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:43:12.950581+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:43:46.333027+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:44:13.457489+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-08T05:44:38.637273+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.14","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.17","mappings":[{"from":4,"to":8}]},{"pgid":"3.1d","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.82:0/2761274596":"2024-05-09T05:37:43.951218+0000","172.21.15.82:0/2195734928":"2024-05-09T05:37:43.951218+0000","172.21.15.82:6801/765895649":"2024-05-09T05:37:43.951218+0000","172.21.15.82:6800/3546670887":"2024-05-09T05:37:11.114057+0000","172.21.15.82:6800/765895649":"2024-05-09T05:37:43.951218+0000","172.21.15.82:0/3986150437":"2024-05-09T05:37:11.114057+0000","172.21.15.82:0/3457457714":"2024-05-09T05:37:11.114057+0000","172.21.15.82:0/2356749286":"2024-05-09T05:37:11.114057+0000","172.21.15.82:6801/3546670887":"2024-05-09T05:37:11.114057+0000","172.21.15.82:0/1694643083":"2024-05-09T05:37:43.951218+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-08T06:07:43.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:43.773+0000 7f5b28200700 1 -- 172.21.15.82:0/4245334881 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f5b080b2900 msgr2=0x7f5b080b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:07:43.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:43.773+0000 7f5b28200700 1 --2- 172.21.15.82:0/4245334881 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f5b080b2900 0x7f5b080b4dc0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f5b20078bc0 tx=0x7f5b0c009260 comp rx=0 tx=0).stop 2024-05-08T06:07:43.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:43.773+0000 7f5b28200700 1 -- 172.21.15.82:0/4245334881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b20109ad0 msgr2=0x7f5b201a01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:07:43.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:43.773+0000 7f5b28200700 1 --2- 172.21.15.82:0/4245334881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b20109ad0 0x7f5b201a01b0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5b1400eb30 tx=0x7f5b1400ee40 comp rx=0 tx=0).stop 2024-05-08T06:07:43.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:43.773+0000 7f5b28200700 1 -- 172.21.15.82:0/4245334881 shutdown_connections 2024-05-08T06:07:43.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:43.773+0000 7f5b28200700 1 --2- 172.21.15.82:0/4245334881 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f5b080b2900 0x7f5b080b4dc0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:43.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:43.773+0000 7f5b28200700 1 --2- 172.21.15.82:0/4245334881 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5b2010fb60 0x7f5b201a4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:43.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:43.773+0000 7f5b28200700 1 --2- 172.21.15.82:0/4245334881 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f5b20109ad0 0x7f5b201a01b0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:43.774 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:43.773+0000 7f5b28200700 1 --2- 172.21.15.82:0/4245334881 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b2010a490 0x7f5b201a06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:43.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:43.773+0000 7f5b28200700 1 -- 172.21.15.82:0/4245334881 >> 172.21.15.82:0/4245334881 conn(0x7f5b20076c70 msgr2=0x7f5b20077250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:07:43.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:43.773+0000 7f5b28200700 1 -- 172.21.15.82:0/4245334881 shutdown_connections 2024-05-08T06:07:43.775 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:43.773+0000 7f5b28200700 1 -- 172.21.15.82:0/4245334881 wait complete. 2024-05-08T06:07:44.101 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:43 smithi082 ceph-mon[30098]: pgmap v971: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 852 B/s wr, 11 op/s 2024-05-08T06:07:44.101 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:43 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/4245334881' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T06:07:44.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:43 smithi134 ceph-mon[34132]: pgmap v971: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 852 B/s wr, 11 op/s 2024-05-08T06:07:44.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:43 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/4245334881' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T06:07:44.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:43 smithi151 ceph-mon[34815]: pgmap v971: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 852 B/s wr, 11 op/s 2024-05-08T06:07:44.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:43 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/4245334881' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-08T06:07:44.566 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph fs fail cephfs 2024-05-08T06:07:45.004 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:07:46.218 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:45 smithi082 ceph-mon[30098]: pgmap v972: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 852 B/s wr, 11 op/s 2024-05-08T06:07:46.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:45 smithi134 ceph-mon[34132]: pgmap v972: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 852 B/s wr, 11 op/s 2024-05-08T06:07:46.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:45 smithi151 ceph-mon[34815]: pgmap v972: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 852 B/s wr, 11 op/s 2024-05-08T06:07:47.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:47.431+0000 7fde06600700 1 -- 172.21.15.82:0/2562706286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde00075ff0 msgr2=0x7fde00114130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:07:47.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:47.431+0000 7fde06600700 1 --2- 172.21.15.82:0/2562706286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde00075ff0 0x7fde00114130 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fdde8009990 tx=0x7fdde8009ca0 comp rx=0 tx=0).stop 2024-05-08T06:07:47.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:47.431+0000 7fde06600700 1 -- 172.21.15.82:0/2562706286 shutdown_connections 2024-05-08T06:07:47.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:47.431+0000 7fde06600700 1 --2- 172.21.15.82:0/2562706286 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde00114670 0x7fde00116a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:47.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:47.431+0000 7fde06600700 1 --2- 172.21.15.82:0/2562706286 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde000756d0 0x7fde00075ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:47.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:47.431+0000 7fde06600700 1 --2- 172.21.15.82:0/2562706286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde00075ff0 0x7fde00114130 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:47.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:47.431+0000 7fde06600700 1 -- 172.21.15.82:0/2562706286 >> 172.21.15.82:0/2562706286 conn(0x7fde0007a600 msgr2=0x7fde0007aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:07:47.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:47.431+0000 7fde06600700 1 -- 172.21.15.82:0/2562706286 shutdown_connections 2024-05-08T06:07:47.432 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:47.431+0000 7fde06600700 1 -- 172.21.15.82:0/2562706286 wait complete. 2024-05-08T06:07:47.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:47.432+0000 7fde06600700 1 Processor -- start 2024-05-08T06:07:47.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:47.432+0000 7fde06600700 1 -- start start 2024-05-08T06:07:47.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:47.432+0000 7fde06600700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde000756d0 0x7fde001a0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:07:47.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:47.433+0000 7fde06600700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde00075ff0 0x7fde001a08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:07:47.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:47.433+0000 7fde06600700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde00114670 0x7fde001a4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:07:47.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:47.433+0000 7fde06600700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7fde00119cd0 con 0x7fde000756d0 2024-05-08T06:07:47.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:47.433+0000 7fde06600700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fde00119b50 con 0x7fde00075ff0 2024-05-08T06:07:47.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:47.433+0000 7fde06600700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fde00119e50 con 0x7fde00114670 2024-05-08T06:07:47.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:47.433+0000 7fddff400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde000756d0 0x7fde001a0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:07:47.434 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:47.433+0000 7fddff400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde000756d0 0x7fde001a0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55528/0 (socket says 172.21.15.82:55528) 2024-05-08T06:07:47.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:47.433+0000 7fddff400700 1 -- 172.21.15.82:0/2938216658 learned_addr learned my addr 172.21.15.82:0/2938216658 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:07:47.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:47.433+0000 7fddf6a00700 1 --2- 172.21.15.82:0/2938216658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde00075ff0 0x7fde001a08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:07:47.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:47.433+0000 7fddffe00700 1 --2- 172.21.15.82:0/2938216658 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde00114670 0x7fde001a4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:07:47.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:47.433+0000 7fddff400700 1 -- 172.21.15.82:0/2938216658 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde00114670 msgr2=0x7fde001a4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:07:47.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:47.433+0000 7fddff400700 1 --2- 172.21.15.82:0/2938216658 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde00114670 0x7fde001a4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:47.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:47.433+0000 7fddff400700 1 -- 172.21.15.82:0/2938216658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde00075ff0 msgr2=0x7fde001a08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:07:47.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:47.433+0000 7fddff400700 1 --2- 172.21.15.82:0/2938216658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde00075ff0 0x7fde001a08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:47.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:47.433+0000 7fddff400700 1 -- 172.21.15.82:0/2938216658 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde001a52f0 con 0x7fde000756d0 2024-05-08T06:07:47.435 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:47.434+0000 7fddff400700 1 --2- 172.21.15.82:0/2938216658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde000756d0 0x7fde001a0390 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fddf000e9a0 tx=0x7fddf000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:07:47.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:47.434+0000 7fddfcc00700 1 -- 172.21.15.82:0/2938216658 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddf000ca10 con 0x7fde000756d0 2024-05-08T06:07:47.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:47.434+0000 7fde06600700 1 -- 172.21.15.82:0/2938216658 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde001a55e0 con 0x7fde000756d0 2024-05-08T06:07:47.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:47.434+0000 7fddfcc00700 1 -- 172.21.15.82:0/2938216658 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7fddf000cbb0 con 0x7fde000756d0 2024-05-08T06:07:47.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:47.434+0000 7fddfcc00700 1 -- 172.21.15.82:0/2938216658 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddf0018680 con 0x7fde000756d0 2024-05-08T06:07:47.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:47.434+0000 7fde06600700 1 -- 172.21.15.82:0/2938216658 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde001ace70 con 0x7fde000756d0 2024-05-08T06:07:47.436 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:47.435+0000 7fde06600700 1 -- 172.21.15.82:0/2938216658 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde0006a190 con 0x7fde000756d0 2024-05-08T06:07:47.438 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:47.438+0000 7fddfcc00700 1 -- 172.21.15.82:0/2938216658 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7fddf0010430 con 0x7fde000756d0 2024-05-08T06:07:47.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:47.440+0000 7fddfcc00700 1 --2- 172.21.15.82:0/2938216658 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fdde40b2900 0x7fdde40b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:07:47.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:47.440+0000 7fddfcc00700 1 -- 172.21.15.82:0/2938216658 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8211+0+0 (secure 0 0 0) 0x7fddf00e2690 con 0x7fde000756d0 2024-05-08T06:07:47.440 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:47.440+0000 7fddf6a00700 1 --2- 172.21.15.82:0/2938216658 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fdde40b2900 0x7fdde40b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:07:47.441 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:47.441+0000 7fddf6a00700 1 --2- 172.21.15.82:0/2938216658 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fdde40b2900 0x7fdde40b4dc0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fde001025c0 tx=0x7fdde800b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:07:47.443 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:47.442+0000 7fddfcc00700 1 -- 172.21.15.82:0/2938216658 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fddf00aa360 con 0x7fde000756d0 2024-05-08T06:07:47.727 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:47.726+0000 7fde06600700 1 -- 172.21.15.82:0/2938216658 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fde001a16f0 con 0x7fde000756d0 2024-05-08T06:07:47.731 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:47.730+0000 7fddfcc00700 1 -- 172.21.15.82:0/2938216658 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v32) ==== 161+0+0 (secure 0 0 0) 0x7fddf00b23e0 con 0x7fde000756d0 2024-05-08T06:07:47.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:47.734+0000 7fde06600700 1 -- 172.21.15.82:0/2938216658 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fdde40b2900 msgr2=0x7fdde40b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:07:47.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:47.734+0000 7fde06600700 1 --2- 172.21.15.82:0/2938216658 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fdde40b2900 0x7fdde40b4dc0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fde001025c0 tx=0x7fdde800b260 comp rx=0 tx=0).stop 2024-05-08T06:07:47.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:47.734+0000 7fde06600700 1 -- 172.21.15.82:0/2938216658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde000756d0 msgr2=0x7fde001a0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:07:47.735 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:47.734+0000 7fde06600700 1 --2- 172.21.15.82:0/2938216658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde000756d0 0x7fde001a0390 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fddf000e9a0 tx=0x7fddf000ecb0 comp rx=0 tx=0).stop 2024-05-08T06:07:47.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:47.735+0000 7fde06600700 1 -- 172.21.15.82:0/2938216658 shutdown_connections 2024-05-08T06:07:47.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:47.735+0000 7fde06600700 1 --2- 172.21.15.82:0/2938216658 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7fdde40b2900 0x7fdde40b4dc0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:47.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:47.735+0000 7fde06600700 1 --2- 172.21.15.82:0/2938216658 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde00114670 0x7fde001a4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:47.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:47.735+0000 7fde06600700 1 --2- 172.21.15.82:0/2938216658 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7fde000756d0 0x7fde001a0390 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:47.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:47.735+0000 7fde06600700 1 --2- 172.21.15.82:0/2938216658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde00075ff0 0x7fde001a08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:47.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:47.735+0000 7fde06600700 1 -- 172.21.15.82:0/2938216658 >> 172.21.15.82:0/2938216658 conn(0x7fde0007a600 msgr2=0x7fde00111500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:07:47.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:47.735+0000 7fde06600700 1 -- 172.21.15.82:0/2938216658 shutdown_connections 2024-05-08T06:07:47.736 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:47.735+0000 7fde06600700 1 -- 172.21.15.82:0/2938216658 wait complete. 2024-05-08T06:07:47.737 INFO:teuthology.orchestra.run.smithi082.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-08T06:07:48.129 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:47 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mon-a[30094]: 2024-05-08T06:07:47.727+0000 7f6a53c00700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-08T06:07:48.129 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:47 smithi082 ceph-mon[30098]: pgmap v973: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 511 B/s wr, 12 op/s 2024-05-08T06:07:48.129 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:47 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/2938216658' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-08T06:07:48.129 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:47 smithi082 ceph-mon[30098]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-08T06:07:48.129 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:47 smithi082 ceph-mon[30098]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-08T06:07:48.129 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:47 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/2938216658' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-05-08T06:07:48.129 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:47 smithi082 ceph-mon[30098]: osdmap e83: 12 total, 12 up, 12 in 2024-05-08T06:07:48.129 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:47 smithi082 ceph-mon[30098]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-05-08T06:07:48.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:47 smithi151 ceph-mon[34815]: pgmap v973: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 511 B/s wr, 12 op/s 2024-05-08T06:07:48.131 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:47 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/2938216658' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-08T06:07:48.131 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:47 smithi151 ceph-mon[34815]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-08T06:07:48.131 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:47 smithi151 ceph-mon[34815]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-08T06:07:48.131 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:47 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/2938216658' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-05-08T06:07:48.131 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:47 smithi151 ceph-mon[34815]: osdmap e83: 12 total, 12 up, 12 in 2024-05-08T06:07:48.131 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:47 smithi151 ceph-mon[34815]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-05-08T06:07:48.131 INFO:journalctl@ceph.mds.a.smithi082.stdout:May 08 06:07:47 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-a[69390]: ignoring --setuser ceph since I am not root 2024-05-08T06:07:48.131 INFO:journalctl@ceph.mds.a.smithi082.stdout:May 08 06:07:47 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-a[69390]: ignoring --setgroup ceph since I am not root 2024-05-08T06:07:48.131 INFO:journalctl@ceph.mds.a.smithi082.stdout:May 08 06:07:47 smithi082 ceph-mds[69394]: -- 172.21.15.82:0/2965892181 <== mon.2 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d2d59a7a40 con 0x55d2d597ac00 2024-05-08T06:07:48.131 INFO:journalctl@ceph.mds.a.smithi082.stdout:May 08 06:07:47 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-a[69390]: starting mds.a at 2024-05-08T06:07:48.132 INFO:journalctl@ceph.mds.c.smithi151.stdout:May 08 06:07:47 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-c[65769]: ignoring --setuser ceph since I am not root 2024-05-08T06:07:48.132 INFO:journalctl@ceph.mds.c.smithi151.stdout:May 08 06:07:47 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-c[65769]: ignoring --setgroup ceph since I am not root 2024-05-08T06:07:48.132 INFO:journalctl@ceph.mds.c.smithi151.stdout:May 08 06:07:47 smithi151 ceph-mds[65773]: -- 172.21.15.151:0/3020333203 <== mon.1 v2:172.21.15.151:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560f3ce5da40 con 0x560f3ce31000 2024-05-08T06:07:48.132 INFO:journalctl@ceph.mds.c.smithi151.stdout:May 08 06:07:47 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-c[65769]: starting mds.c at 2024-05-08T06:07:48.132 INFO:journalctl@ceph.mds.g.smithi082.stdout:May 08 06:07:47 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-g[68982]: ignoring --setuser ceph since I am not root 2024-05-08T06:07:48.132 INFO:journalctl@ceph.mds.g.smithi082.stdout:May 08 06:07:47 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-g[68982]: ignoring --setgroup ceph since I am not root 2024-05-08T06:07:48.132 INFO:journalctl@ceph.mds.g.smithi082.stdout:May 08 06:07:47 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-g[68982]: starting mds.g at 2024-05-08T06:07:48.133 INFO:journalctl@ceph.mds.l.smithi151.stdout:May 08 06:07:47 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-l[65146]: ignoring --setuser ceph since I am not root 2024-05-08T06:07:48.133 INFO:journalctl@ceph.mds.l.smithi151.stdout:May 08 06:07:47 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-l[65146]: ignoring --setgroup ceph since I am not root 2024-05-08T06:07:48.133 INFO:journalctl@ceph.mds.l.smithi151.stdout:May 08 06:07:47 smithi151 ceph-mds[65150]: -- 172.21.15.151:0/764464249 <== mon.1 v2:172.21.15.151:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c8630ada40 con 0x55c863080800 2024-05-08T06:07:48.133 INFO:journalctl@ceph.mds.l.smithi151.stdout:May 08 06:07:47 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-l[65146]: starting mds.l at 2024-05-08T06:07:48.133 INFO:journalctl@ceph.mds.f.smithi151.stdout:May 08 06:07:47 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-f[65460]: ignoring --setuser ceph since I am not root 2024-05-08T06:07:48.133 INFO:journalctl@ceph.mds.f.smithi151.stdout:May 08 06:07:47 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-f[65460]: ignoring --setgroup ceph since I am not root 2024-05-08T06:07:48.133 INFO:journalctl@ceph.mds.f.smithi151.stdout:May 08 06:07:47 smithi151 ceph-mds[65464]: -- 172.21.15.151:0/3838854265 <== mon.1 v2:172.21.15.151:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558852bf7a40 con 0x558852bca800 2024-05-08T06:07:48.133 INFO:journalctl@ceph.mds.f.smithi151.stdout:May 08 06:07:47 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-f[65460]: starting mds.f at 2024-05-08T06:07:48.133 INFO:journalctl@ceph.mds.i.smithi151.stdout:May 08 06:07:47 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-i[66090]: ignoring --setuser ceph since I am not root 2024-05-08T06:07:48.134 INFO:journalctl@ceph.mds.i.smithi151.stdout:May 08 06:07:47 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-i[66090]: ignoring --setgroup ceph since I am not root 2024-05-08T06:07:48.134 INFO:journalctl@ceph.mds.i.smithi151.stdout:May 08 06:07:47 smithi151 ceph-mds[66094]: -- 172.21.15.151:0/1169015219 <== mon.1 v2:172.21.15.151:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5623844f9a40 con 0x5623844cd000 2024-05-08T06:07:48.134 INFO:journalctl@ceph.mds.i.smithi151.stdout:May 08 06:07:47 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-i[66090]: starting mds.i at 2024-05-08T06:07:48.250 INFO:journalctl@ceph.mds.b.smithi134.stdout:May 08 06:07:47 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-b[65010]: ignoring --setuser ceph since I am not root 2024-05-08T06:07:48.250 INFO:journalctl@ceph.mds.b.smithi134.stdout:May 08 06:07:47 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-b[65010]: ignoring --setgroup ceph since I am not root 2024-05-08T06:07:48.250 INFO:journalctl@ceph.mds.b.smithi134.stdout:May 08 06:07:47 smithi134 ceph-mds[65014]: -- 172.21.15.134:0/3328013170 <== mon.2 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5621e4ff7a40 con 0x5621e4fca800 2024-05-08T06:07:48.250 INFO:journalctl@ceph.mds.b.smithi134.stdout:May 08 06:07:47 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-b[65010]: starting mds.b at 2024-05-08T06:07:48.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:47 smithi134 ceph-mon[34132]: pgmap v973: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 511 B/s wr, 12 op/s 2024-05-08T06:07:48.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:47 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/2938216658' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-05-08T06:07:48.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:47 smithi134 ceph-mon[34132]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-05-08T06:07:48.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:47 smithi134 ceph-mon[34132]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-05-08T06:07:48.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:47 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/2938216658' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-05-08T06:07:48.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:47 smithi134 ceph-mon[34132]: osdmap e83: 12 total, 12 up, 12 in 2024-05-08T06:07:48.251 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:47 smithi134 ceph-mon[34132]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-05-08T06:07:48.251 INFO:journalctl@ceph.mds.h.smithi134.stdout:May 08 06:07:47 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-h[64691]: ignoring --setuser ceph since I am not root 2024-05-08T06:07:48.251 INFO:journalctl@ceph.mds.h.smithi134.stdout:May 08 06:07:47 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-h[64691]: ignoring --setgroup ceph since I am not root 2024-05-08T06:07:48.251 INFO:journalctl@ceph.mds.h.smithi134.stdout:May 08 06:07:47 smithi134 ceph-mds[64695]: -- 172.21.15.134:0/2329146691 <== mon.2 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555969865a40 con 0x555969838800 2024-05-08T06:07:48.251 INFO:journalctl@ceph.mds.h.smithi134.stdout:May 08 06:07:47 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-h[64691]: starting mds.h at 2024-05-08T06:07:48.252 INFO:journalctl@ceph.mds.e.smithi134.stdout:May 08 06:07:47 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-e[64371]: ignoring --setuser ceph since I am not root 2024-05-08T06:07:48.252 INFO:journalctl@ceph.mds.e.smithi134.stdout:May 08 06:07:47 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-e[64371]: ignoring --setgroup ceph since I am not root 2024-05-08T06:07:48.252 INFO:journalctl@ceph.mds.e.smithi134.stdout:May 08 06:07:47 smithi134 ceph-mds[64375]: -- 172.21.15.134:0/352819245 <== mon.1 v2:172.21.15.151:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561808099a40 con 0x56180806c800 2024-05-08T06:07:48.252 INFO:journalctl@ceph.mds.e.smithi134.stdout:May 08 06:07:47 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-e[64371]: starting mds.e at 2024-05-08T06:07:48.252 INFO:journalctl@ceph.mds.k.smithi134.stdout:May 08 06:07:47 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-k[64052]: ignoring --setuser ceph since I am not root 2024-05-08T06:07:48.252 INFO:journalctl@ceph.mds.k.smithi134.stdout:May 08 06:07:47 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-k[64052]: ignoring --setgroup ceph since I am not root 2024-05-08T06:07:48.252 INFO:journalctl@ceph.mds.k.smithi134.stdout:May 08 06:07:47 smithi134 ceph-mds[64056]: -- 172.21.15.134:0/399095355 <== mon.1 v2:172.21.15.151:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56345e789a40 con 0x56345e75c800 2024-05-08T06:07:48.252 INFO:journalctl@ceph.mds.k.smithi134.stdout:May 08 06:07:47 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-k[64052]: starting mds.k at 2024-05-08T06:07:48.634 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-05-08T06:07:49.096 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:07:49.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:49 smithi082 ceph-mon[30098]: pgmap v975: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-08T06:07:49.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:49 smithi082 ceph-mon[30098]: mds.? [v2:172.21.15.151:6832/1026413559,v1:172.21.15.151:6833/1026413559] up:boot 2024-05-08T06:07:49.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:49 smithi082 ceph-mon[30098]: mds.? [v2:172.21.15.134:6832/1013535363,v1:172.21.15.134:6834/1013535363] up:boot 2024-05-08T06:07:49.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:49 smithi082 ceph-mon[30098]: mds.? [v2:172.21.15.134:6833/1075606423,v1:172.21.15.134:6835/1075606423] up:boot 2024-05-08T06:07:49.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:49 smithi082 ceph-mon[30098]: mds.? [v2:172.21.15.151:6834/3060949586,v1:172.21.15.151:6835/3060949586] up:boot 2024-05-08T06:07:49.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:49 smithi082 ceph-mon[30098]: mds.? [v2:172.21.15.134:6836/1295605336,v1:172.21.15.134:6837/1295605336] up:boot 2024-05-08T06:07:49.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:49 smithi082 ceph-mon[30098]: mds.? [v2:172.21.15.134:6838/3215811095,v1:172.21.15.134:6839/3215811095] up:boot 2024-05-08T06:07:49.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:49 smithi082 ceph-mon[30098]: mds.? [v2:172.21.15.151:6836/1021912767,v1:172.21.15.151:6837/1021912767] up:boot 2024-05-08T06:07:49.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:49 smithi082 ceph-mon[30098]: mds.? [v2:172.21.15.151:6838/3995544866,v1:172.21.15.151:6839/3995544866] up:boot 2024-05-08T06:07:49.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:49 smithi082 ceph-mon[30098]: mds.? [v2:172.21.15.82:6838/996822361,v1:172.21.15.82:6839/996822361] up:boot 2024-05-08T06:07:49.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:49 smithi082 ceph-mon[30098]: mds.? [v2:172.21.15.82:6840/81389780,v1:172.21.15.82:6841/81389780] up:boot 2024-05-08T06:07:49.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:49 smithi082 ceph-mon[30098]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-05-08T06:07:49.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:49 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-08T06:07:49.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:49 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-08T06:07:49.972 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:49 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-08T06:07:49.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:49 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-08T06:07:49.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:49 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-08T06:07:49.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:49 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-08T06:07:49.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:49 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-08T06:07:49.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:49 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-08T06:07:49.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:49 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-08T06:07:49.973 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:49 smithi082 ceph-mon[30098]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-08T06:07:50.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:49 smithi134 ceph-mon[34132]: pgmap v975: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-08T06:07:50.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:49 smithi134 ceph-mon[34132]: mds.? [v2:172.21.15.151:6832/1026413559,v1:172.21.15.151:6833/1026413559] up:boot 2024-05-08T06:07:50.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:49 smithi134 ceph-mon[34132]: mds.? [v2:172.21.15.134:6832/1013535363,v1:172.21.15.134:6834/1013535363] up:boot 2024-05-08T06:07:50.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:49 smithi134 ceph-mon[34132]: mds.? [v2:172.21.15.134:6833/1075606423,v1:172.21.15.134:6835/1075606423] up:boot 2024-05-08T06:07:50.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:49 smithi134 ceph-mon[34132]: mds.? [v2:172.21.15.151:6834/3060949586,v1:172.21.15.151:6835/3060949586] up:boot 2024-05-08T06:07:50.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:49 smithi134 ceph-mon[34132]: mds.? [v2:172.21.15.134:6836/1295605336,v1:172.21.15.134:6837/1295605336] up:boot 2024-05-08T06:07:50.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:49 smithi134 ceph-mon[34132]: mds.? [v2:172.21.15.134:6838/3215811095,v1:172.21.15.134:6839/3215811095] up:boot 2024-05-08T06:07:50.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:49 smithi134 ceph-mon[34132]: mds.? [v2:172.21.15.151:6836/1021912767,v1:172.21.15.151:6837/1021912767] up:boot 2024-05-08T06:07:50.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:49 smithi134 ceph-mon[34132]: mds.? [v2:172.21.15.151:6838/3995544866,v1:172.21.15.151:6839/3995544866] up:boot 2024-05-08T06:07:50.000 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:49 smithi134 ceph-mon[34132]: mds.? [v2:172.21.15.82:6838/996822361,v1:172.21.15.82:6839/996822361] up:boot 2024-05-08T06:07:50.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:49 smithi134 ceph-mon[34132]: mds.? [v2:172.21.15.82:6840/81389780,v1:172.21.15.82:6841/81389780] up:boot 2024-05-08T06:07:50.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:49 smithi134 ceph-mon[34132]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-05-08T06:07:50.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:49 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-08T06:07:50.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:49 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-08T06:07:50.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:49 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-08T06:07:50.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:49 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-08T06:07:50.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:49 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-08T06:07:50.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:49 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-08T06:07:50.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:49 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-08T06:07:50.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:49 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-08T06:07:50.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:49 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-08T06:07:50.001 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:49 smithi134 ceph-mon[34132]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-08T06:07:50.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:49 smithi151 ceph-mon[34815]: pgmap v975: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-08T06:07:50.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:49 smithi151 ceph-mon[34815]: mds.? [v2:172.21.15.151:6832/1026413559,v1:172.21.15.151:6833/1026413559] up:boot 2024-05-08T06:07:50.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:49 smithi151 ceph-mon[34815]: mds.? [v2:172.21.15.134:6832/1013535363,v1:172.21.15.134:6834/1013535363] up:boot 2024-05-08T06:07:50.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:49 smithi151 ceph-mon[34815]: mds.? [v2:172.21.15.134:6833/1075606423,v1:172.21.15.134:6835/1075606423] up:boot 2024-05-08T06:07:50.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:49 smithi151 ceph-mon[34815]: mds.? [v2:172.21.15.151:6834/3060949586,v1:172.21.15.151:6835/3060949586] up:boot 2024-05-08T06:07:50.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:49 smithi151 ceph-mon[34815]: mds.? [v2:172.21.15.134:6836/1295605336,v1:172.21.15.134:6837/1295605336] up:boot 2024-05-08T06:07:50.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:49 smithi151 ceph-mon[34815]: mds.? [v2:172.21.15.134:6838/3215811095,v1:172.21.15.134:6839/3215811095] up:boot 2024-05-08T06:07:50.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:49 smithi151 ceph-mon[34815]: mds.? [v2:172.21.15.151:6836/1021912767,v1:172.21.15.151:6837/1021912767] up:boot 2024-05-08T06:07:50.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:49 smithi151 ceph-mon[34815]: mds.? [v2:172.21.15.151:6838/3995544866,v1:172.21.15.151:6839/3995544866] up:boot 2024-05-08T06:07:50.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:49 smithi151 ceph-mon[34815]: mds.? [v2:172.21.15.82:6838/996822361,v1:172.21.15.82:6839/996822361] up:boot 2024-05-08T06:07:50.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:49 smithi151 ceph-mon[34815]: mds.? [v2:172.21.15.82:6840/81389780,v1:172.21.15.82:6841/81389780] up:boot 2024-05-08T06:07:50.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:49 smithi151 ceph-mon[34815]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-05-08T06:07:50.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:49 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-08T06:07:50.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:49 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-08T06:07:50.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:49 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-08T06:07:50.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:49 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-08T06:07:50.130 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:49 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-08T06:07:50.131 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:49 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-08T06:07:50.131 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:49 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-08T06:07:50.131 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:49 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-08T06:07:50.131 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:49 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-08T06:07:50.131 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:49 smithi151 ceph-mon[34815]: from='mgr.14152 172.21.15.82:0/3038646902' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-08T06:07:51.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:51.265+0000 7f9b7ce00700 1 -- 172.21.15.82:0/510507236 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b7806c3d0 msgr2=0x7f9b781102a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:07:51.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:51.265+0000 7f9b7ce00700 1 --2- 172.21.15.82:0/510507236 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b7806c3d0 0x7f9b781102a0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f9b70009f90 tx=0x7f9b7000b330 comp rx=0 tx=0).stop 2024-05-08T06:07:51.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:51.265+0000 7f9b7ce00700 1 -- 172.21.15.82:0/510507236 shutdown_connections 2024-05-08T06:07:51.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:51.265+0000 7f9b7ce00700 1 --2- 172.21.15.82:0/510507236 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b78109510 0x7f9b781098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:51.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:51.265+0000 7f9b7ce00700 1 --2- 172.21.15.82:0/510507236 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b7806c3d0 0x7f9b781102a0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:51.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:51.265+0000 7f9b7ce00700 1 --2- 172.21.15.82:0/510507236 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b7806ba10 0x7f9b7806be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:51.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:51.265+0000 7f9b7ce00700 1 -- 172.21.15.82:0/510507236 >> 172.21.15.82:0/510507236 conn(0x7f9b780791e0 msgr2=0x7f9b780795f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:07:51.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:51.265+0000 7f9b7ce00700 1 -- 172.21.15.82:0/510507236 shutdown_connections 2024-05-08T06:07:51.266 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:51.265+0000 7f9b7ce00700 1 -- 172.21.15.82:0/510507236 wait complete. 2024-05-08T06:07:51.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:51.266+0000 7f9b7ce00700 1 Processor -- start 2024-05-08T06:07:51.267 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:51.267+0000 7f9b7ce00700 1 -- start start 2024-05-08T06:07:51.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:51.267+0000 7f9b7ce00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b7806ba10 0x7f9b7819f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:07:51.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:51.267+0000 7f9b7ce00700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b7806c3d0 0x7f9b7819fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:07:51.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:51.267+0000 7f9b7ce00700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b78109510 0x7f9b781997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:07:51.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:51.267+0000 7f9b7ce00700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f9b78113560 con 0x7f9b7806ba10 2024-05-08T06:07:51.268 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:51.267+0000 7f9b7ce00700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9b781133e0 con 0x7f9b78109510 2024-05-08T06:07:51.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:51.267+0000 7f9b7ce00700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9b781136e0 con 0x7f9b7806c3d0 2024-05-08T06:07:51.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:51.267+0000 7f9b77400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b7806ba10 0x7f9b7819f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:07:51.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:51.267+0000 7f9b77400700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b7806ba10 0x7f9b7819f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:55580/0 (socket says 172.21.15.82:55580) 2024-05-08T06:07:51.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:51.267+0000 7f9b77400700 1 -- 172.21.15.82:0/2965155409 learned_addr learned my addr 172.21.15.82:0/2965155409 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:07:51.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:51.267+0000 7f9b77e00700 1 --2- 172.21.15.82:0/2965155409 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b78109510 0x7f9b781997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:07:51.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:51.268+0000 7f9b76a00700 1 --2- 172.21.15.82:0/2965155409 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b7806c3d0 0x7f9b7819fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:07:51.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:51.268+0000 7f9b77e00700 1 -- 172.21.15.82:0/2965155409 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b7806c3d0 msgr2=0x7f9b7819fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:07:51.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:51.268+0000 7f9b77e00700 1 --2- 172.21.15.82:0/2965155409 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b7806c3d0 0x7f9b7819fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:51.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:51.268+0000 7f9b77e00700 1 -- 172.21.15.82:0/2965155409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b7806ba10 msgr2=0x7f9b7819f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:07:51.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:51.268+0000 7f9b77e00700 1 --2- 172.21.15.82:0/2965155409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b7806ba10 0x7f9b7819f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:51.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:51.268+0000 7f9b77e00700 1 -- 172.21.15.82:0/2965155409 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b78199f80 con 0x7f9b78109510 2024-05-08T06:07:51.269 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:51.268+0000 7f9b77400700 1 --2- 172.21.15.82:0/2965155409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b7806ba10 0x7f9b7819f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:07:51.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:51.268+0000 7f9b77e00700 1 --2- 172.21.15.82:0/2965155409 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b78109510 0x7f9b781997a0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f9b70009f90 tx=0x7f9b70009bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:07:51.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:51.268+0000 7f9b6fe00700 1 -- 172.21.15.82:0/2965155409 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b70021070 con 0x7f9b78109510 2024-05-08T06:07:51.270 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:51.269+0000 7f9b7ce00700 1 -- 172.21.15.82:0/2965155409 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b7819a210 con 0x7f9b78109510 2024-05-08T06:07:51.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:51.269+0000 7f9b6fe00700 1 -- 172.21.15.82:0/2965155409 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f9b70007d60 con 0x7f9b78109510 2024-05-08T06:07:51.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:51.269+0000 7f9b6fe00700 1 -- 172.21.15.82:0/2965155409 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b70005040 con 0x7f9b78109510 2024-05-08T06:07:51.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:51.269+0000 7f9b7ce00700 1 -- 172.21.15.82:0/2965155409 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b781a6480 con 0x7f9b78109510 2024-05-08T06:07:51.271 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:51.270+0000 7f9b7ce00700 1 -- 172.21.15.82:0/2965155409 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b78104b10 con 0x7f9b78109510 2024-05-08T06:07:51.272 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:51.272+0000 7f9b6fe00700 1 -- 172.21.15.82:0/2965155409 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f9b70024070 con 0x7f9b78109510 2024-05-08T06:07:51.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:51.273+0000 7f9b6fe00700 1 --2- 172.21.15.82:0/2965155409 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9b5c0b2880 0x7f9b5c0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:07:51.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:51.274+0000 7f9b6fe00700 1 -- 172.21.15.82:0/2965155409 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8641+0+0 (secure 0 0 0) 0x7f9b7000f020 con 0x7f9b78109510 2024-05-08T06:07:51.274 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:51.274+0000 7f9b77400700 1 --2- 172.21.15.82:0/2965155409 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9b5c0b2880 0x7f9b5c0b4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:07:51.275 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:51.275+0000 7f9b77400700 1 --2- 172.21.15.82:0/2965155409 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9b5c0b2880 0x7f9b5c0b4d40 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f9b68005950 tx=0x7f9b68009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:07:51.276 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:51.276+0000 7f9b6fe00700 1 -- 172.21.15.82:0/2965155409 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9b7002b020 con 0x7f9b78109510 2024-05-08T06:07:51.558 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:51.557+0000 7f9b7ce00700 1 -- 172.21.15.82:0/2965155409 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f9b7819acd0 con 0x7f9b78109510 2024-05-08T06:07:51.746 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:51.745+0000 7f9b6fe00700 1 -- 172.21.15.82:0/2965155409 <== mon.2 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v34) ==== 104+0+0 (secure 0 0 0) 0x7f9b700ab6c0 con 0x7f9b78109510 2024-05-08T06:07:51.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:51.749+0000 7f9b7ce00700 1 -- 172.21.15.82:0/2965155409 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9b5c0b2880 msgr2=0x7f9b5c0b4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:07:51.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:51.749+0000 7f9b7ce00700 1 --2- 172.21.15.82:0/2965155409 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9b5c0b2880 0x7f9b5c0b4d40 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f9b68005950 tx=0x7f9b68009310 comp rx=0 tx=0).stop 2024-05-08T06:07:51.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:51.749+0000 7f9b7ce00700 1 -- 172.21.15.82:0/2965155409 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b78109510 msgr2=0x7f9b781997a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:07:51.750 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:51.749+0000 7f9b7ce00700 1 --2- 172.21.15.82:0/2965155409 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b78109510 0x7f9b781997a0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f9b70009f90 tx=0x7f9b70009bd0 comp rx=0 tx=0).stop 2024-05-08T06:07:51.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:51.750+0000 7f9b7ce00700 1 -- 172.21.15.82:0/2965155409 shutdown_connections 2024-05-08T06:07:51.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:51.750+0000 7f9b7ce00700 1 --2- 172.21.15.82:0/2965155409 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b78109510 0x7f9b781997a0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:51.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:51.750+0000 7f9b7ce00700 1 --2- 172.21.15.82:0/2965155409 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f9b5c0b2880 0x7f9b5c0b4d40 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:51.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:51.750+0000 7f9b7ce00700 1 --2- 172.21.15.82:0/2965155409 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f9b7806ba10 0x7f9b7819f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:51.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:51.750+0000 7f9b7ce00700 1 --2- 172.21.15.82:0/2965155409 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b7806c3d0 0x7f9b7819fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:51.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:51.750+0000 7f9b7ce00700 1 -- 172.21.15.82:0/2965155409 >> 172.21.15.82:0/2965155409 conn(0x7f9b780791e0 msgr2=0x7f9b78100530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:07:51.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:51.750+0000 7f9b7ce00700 1 -- 172.21.15.82:0/2965155409 shutdown_connections 2024-05-08T06:07:51.751 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:51.750+0000 7f9b7ce00700 1 -- 172.21.15.82:0/2965155409 wait complete. 2024-05-08T06:07:51.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:51 smithi082 ceph-mon[30098]: pgmap v976: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-05-08T06:07:51.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:51 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/2965155409' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-08T06:07:51.971 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:51 smithi082 ceph-mon[30098]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-08T06:07:52.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:51 smithi151 ceph-mon[34815]: pgmap v976: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-05-08T06:07:52.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:51 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/2965155409' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-08T06:07:52.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:51 smithi151 ceph-mon[34815]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-08T06:07:52.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:51 smithi134 ceph-mon[34132]: pgmap v976: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 9 op/s 2024-05-08T06:07:52.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:51 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/2965155409' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-08T06:07:52.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:51 smithi134 ceph-mon[34132]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-05-08T06:07:52.619 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-08T06:07:52.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:52 smithi082 ceph-mon[30098]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-08T06:07:52.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:52 smithi082 ceph-mon[30098]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-08T06:07:52.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:52 smithi082 ceph-mon[30098]: Cluster is now healthy 2024-05-08T06:07:52.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:52 smithi082 ceph-mon[30098]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-05-08T06:07:52.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:52 smithi082 ceph-mon[30098]: fsmap 12 up:standby 2024-05-08T06:07:53.061 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:07:53.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:52 smithi151 ceph-mon[34815]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-08T06:07:53.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:52 smithi151 ceph-mon[34815]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-08T06:07:53.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:52 smithi151 ceph-mon[34815]: Cluster is now healthy 2024-05-08T06:07:53.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:52 smithi151 ceph-mon[34815]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-05-08T06:07:53.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:52 smithi151 ceph-mon[34815]: fsmap 12 up:standby 2024-05-08T06:07:53.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:52 smithi134 ceph-mon[34132]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-05-08T06:07:53.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:52 smithi134 ceph-mon[34132]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-05-08T06:07:53.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:52 smithi134 ceph-mon[34132]: Cluster is now healthy 2024-05-08T06:07:53.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:52 smithi134 ceph-mon[34132]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-05-08T06:07:53.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:52 smithi134 ceph-mon[34132]: fsmap 12 up:standby 2024-05-08T06:07:53.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:53 smithi082 ceph-mon[30098]: pgmap v977: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-05-08T06:07:54.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:53 smithi151 ceph-mon[34815]: pgmap v977: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-05-08T06:07:54.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:53 smithi134 ceph-mon[34132]: pgmap v977: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 8 op/s 2024-05-08T06:07:55.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:55.279+0000 7f4c45800700 1 -- 172.21.15.82:0/1364113829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c401056c0 msgr2=0x7f4c40105b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:07:55.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:55.279+0000 7f4c45800700 1 --2- 172.21.15.82:0/1364113829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c401056c0 0x7f4c40105b40 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4c2c009990 tx=0x7f4c2c009ca0 comp rx=0 tx=0).stop 2024-05-08T06:07:55.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:55.279+0000 7f4c45800700 1 -- 172.21.15.82:0/1364113829 shutdown_connections 2024-05-08T06:07:55.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:55.279+0000 7f4c45800700 1 --2- 172.21.15.82:0/1364113829 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c4010b6c0 0x7f4c4010baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:55.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:55.279+0000 7f4c45800700 1 --2- 172.21.15.82:0/1364113829 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4c40106080 0x7f4c40112590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:55.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:55.279+0000 7f4c45800700 1 --2- 172.21.15.82:0/1364113829 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c401056c0 0x7f4c40105b40 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:55.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:55.279+0000 7f4c45800700 1 -- 172.21.15.82:0/1364113829 >> 172.21.15.82:0/1364113829 conn(0x7f4c401011b0 msgr2=0x7f4c401035d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:07:55.281 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:55.280+0000 7f4c45800700 1 -- 172.21.15.82:0/1364113829 shutdown_connections 2024-05-08T06:07:55.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:55.280+0000 7f4c45800700 1 -- 172.21.15.82:0/1364113829 wait complete. 2024-05-08T06:07:55.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:55.281+0000 7f4c45800700 1 Processor -- start 2024-05-08T06:07:55.282 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:55.282+0000 7f4c45800700 1 -- start start 2024-05-08T06:07:55.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:55.282+0000 7f4c45800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c401056c0 0x7f4c400779b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:07:55.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:55.282+0000 7f4c45800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4c40106080 0x7f4c40077ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:07:55.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:55.282+0000 7f4c45800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c4010b6c0 0x7f4c40078430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:07:55.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:55.282+0000 7f4c45800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f4c40115900 con 0x7f4c401056c0 2024-05-08T06:07:55.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:55.282+0000 7f4c45800700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4c40115780 con 0x7f4c4010b6c0 2024-05-08T06:07:55.283 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:55.282+0000 7f4c45800700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f4c40115a80 con 0x7f4c40106080 2024-05-08T06:07:55.284 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:55.283+0000 7f4c3ea00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c401056c0 0x7f4c400779b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:07:55.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:55.283+0000 7f4c3ea00700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c401056c0 0x7f4c400779b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47018/0 (socket says 172.21.15.82:47018) 2024-05-08T06:07:55.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:55.283+0000 7f4c3ea00700 1 -- 172.21.15.82:0/965028204 learned_addr learned my addr 172.21.15.82:0/965028204 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:07:55.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:55.283+0000 7f4c3e000700 1 --2- 172.21.15.82:0/965028204 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4c40106080 0x7f4c40077ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:07:55.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:55.283+0000 7f4c3f400700 1 --2- 172.21.15.82:0/965028204 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c4010b6c0 0x7f4c40078430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:07:55.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:55.283+0000 7f4c3ea00700 1 -- 172.21.15.82:0/965028204 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4c40106080 msgr2=0x7f4c40077ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:07:55.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:55.283+0000 7f4c3ea00700 1 --2- 172.21.15.82:0/965028204 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4c40106080 0x7f4c40077ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:55.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:55.283+0000 7f4c3ea00700 1 -- 172.21.15.82:0/965028204 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c4010b6c0 msgr2=0x7f4c40078430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:07:55.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:55.283+0000 7f4c3ea00700 1 --2- 172.21.15.82:0/965028204 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c4010b6c0 0x7f4c40078430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:55.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:55.283+0000 7f4c3ea00700 1 -- 172.21.15.82:0/965028204 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c401ac480 con 0x7f4c401056c0 2024-05-08T06:07:55.285 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:55.284+0000 7f4c3ea00700 1 --2- 172.21.15.82:0/965028204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c401056c0 0x7f4c400779b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4c3000eb30 tx=0x7f4c3000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:07:55.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:55.284+0000 7f4c37400700 1 -- 172.21.15.82:0/965028204 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c3000cbd0 con 0x7f4c401056c0 2024-05-08T06:07:55.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:55.284+0000 7f4c37400700 1 -- 172.21.15.82:0/965028204 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f4c300044d0 con 0x7f4c401056c0 2024-05-08T06:07:55.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:55.284+0000 7f4c45800700 1 -- 172.21.15.82:0/965028204 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c401ac770 con 0x7f4c401056c0 2024-05-08T06:07:55.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:55.284+0000 7f4c37400700 1 -- 172.21.15.82:0/965028204 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c30003e30 con 0x7f4c401056c0 2024-05-08T06:07:55.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:55.284+0000 7f4c45800700 1 -- 172.21.15.82:0/965028204 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c401acd00 con 0x7f4c401056c0 2024-05-08T06:07:55.286 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:55.285+0000 7f4c45800700 1 -- 172.21.15.82:0/965028204 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c40106e00 con 0x7f4c401056c0 2024-05-08T06:07:55.288 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:55.288+0000 7f4c37400700 1 -- 172.21.15.82:0/965028204 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f4c30004000 con 0x7f4c401056c0 2024-05-08T06:07:55.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:55.289+0000 7f4c37400700 1 --2- 172.21.15.82:0/965028204 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f4c240b2900 0x7f4c240b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:07:55.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:55.290+0000 7f4c37400700 1 -- 172.21.15.82:0/965028204 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8641+0+0 (secure 0 0 0) 0x7f4c300e28d0 con 0x7f4c401056c0 2024-05-08T06:07:55.290 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:55.290+0000 7f4c3e000700 1 --2- 172.21.15.82:0/965028204 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f4c240b2900 0x7f4c240b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:07:55.291 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:55.290+0000 7f4c3e000700 1 --2- 172.21.15.82:0/965028204 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f4c240b2900 0x7f4c240b4dc0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f4c40079170 tx=0x7f4c2c00b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:07:55.292 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:55.292+0000 7f4c37400700 1 -- 172.21.15.82:0/965028204 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4c30054df0 con 0x7f4c401056c0 2024-05-08T06:07:55.525 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:55.525+0000 7f4c45800700 1 -- 172.21.15.82:0/965028204 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f4c4002e510 con 0x7f4c401056c0 2024-05-08T06:07:55.784 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:55.784+0000 7f4c37400700 1 -- 172.21.15.82:0/965028204 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v84) ==== 181+0+0 (secure 0 0 0) 0x7f4c300042f0 con 0x7f4c401056c0 2024-05-08T06:07:55.789 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:55.788+0000 7f4c45800700 1 -- 172.21.15.82:0/965028204 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f4c240b2900 msgr2=0x7f4c240b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:07:55.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:55.788+0000 7f4c45800700 1 --2- 172.21.15.82:0/965028204 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f4c240b2900 0x7f4c240b4dc0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f4c40079170 tx=0x7f4c2c00b260 comp rx=0 tx=0).stop 2024-05-08T06:07:55.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:55.788+0000 7f4c45800700 1 -- 172.21.15.82:0/965028204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c401056c0 msgr2=0x7f4c400779b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:07:55.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:55.788+0000 7f4c45800700 1 --2- 172.21.15.82:0/965028204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c401056c0 0x7f4c400779b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4c3000eb30 tx=0x7f4c3000ee40 comp rx=0 tx=0).stop 2024-05-08T06:07:55.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:55.788+0000 7f4c45800700 1 -- 172.21.15.82:0/965028204 shutdown_connections 2024-05-08T06:07:55.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:55.788+0000 7f4c45800700 1 --2- 172.21.15.82:0/965028204 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c4010b6c0 0x7f4c40078430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:55.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:55.789+0000 7f4c45800700 1 --2- 172.21.15.82:0/965028204 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f4c240b2900 0x7f4c240b4dc0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:55.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:55.789+0000 7f4c45800700 1 --2- 172.21.15.82:0/965028204 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f4c401056c0 0x7f4c400779b0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:55.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:55.789+0000 7f4c45800700 1 --2- 172.21.15.82:0/965028204 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4c40106080 0x7f4c40077ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:55.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:55.789+0000 7f4c45800700 1 -- 172.21.15.82:0/965028204 >> 172.21.15.82:0/965028204 conn(0x7f4c401011b0 msgr2=0x7f4c401018e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:07:55.790 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:55.789+0000 7f4c45800700 1 -- 172.21.15.82:0/965028204 shutdown_connections 2024-05-08T06:07:55.791 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:55.789+0000 7f4c45800700 1 -- 172.21.15.82:0/965028204 wait complete. 2024-05-08T06:07:55.791 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_metadata' removed 2024-05-08T06:07:56.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:55 smithi151 ceph-mon[34815]: pgmap v978: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-05-08T06:07:56.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:55 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/965028204' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-08T06:07:56.177 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:55 smithi082 ceph-mon[30098]: pgmap v978: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-05-08T06:07:56.177 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:55 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/965028204' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-08T06:07:56.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:55 smithi134 ceph-mon[34132]: pgmap v978: 97 pgs: 97 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-05-08T06:07:56.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:55 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/965028204' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-08T06:07:56.750 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a shell --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-08T06:07:56.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:56 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/965028204' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-05-08T06:07:56.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:56 smithi082 ceph-mon[30098]: osdmap e84: 12 total, 12 up, 12 in 2024-05-08T06:07:57.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:56 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/965028204' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-05-08T06:07:57.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:56 smithi151 ceph-mon[34815]: osdmap e84: 12 total, 12 up, 12 in 2024-05-08T06:07:57.188 INFO:teuthology.orchestra.run.smithi082.stderr:Inferring config /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/mon.a/config 2024-05-08T06:07:57.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:56 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/965028204' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-05-08T06:07:57.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:56 smithi134 ceph-mon[34132]: osdmap e84: 12 total, 12 up, 12 in 2024-05-08T06:07:57.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:57 smithi082 ceph-mon[30098]: pgmap v980: 65 pgs: 65 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:07:58.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:57 smithi151 ceph-mon[34815]: pgmap v980: 65 pgs: 65 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:07:58.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:57 smithi134 ceph-mon[34132]: pgmap v980: 65 pgs: 65 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:07:59.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:59.529+0000 7f055d800700 1 -- 172.21.15.82:0/1356501821 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0558104100 msgr2=0x7f0558108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:07:59.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:59.529+0000 7f055d800700 1 --2- 172.21.15.82:0/1356501821 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0558104100 0x7f0558108120 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f05400099c0 tx=0x7f0540009cd0 comp rx=0 tx=0).stop 2024-05-08T06:07:59.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:59.529+0000 7f055d800700 1 -- 172.21.15.82:0/1356501821 shutdown_connections 2024-05-08T06:07:59.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:59.529+0000 7f055d800700 1 --2- 172.21.15.82:0/1356501821 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0558108850 0x7f05581103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:59.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:59.529+0000 7f055d800700 1 --2- 172.21.15.82:0/1356501821 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0558103750 0x7f0558103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:59.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:59.529+0000 7f055d800700 1 --2- 172.21.15.82:0/1356501821 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0558104100 0x7f0558108120 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:59.530 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:59.529+0000 7f055d800700 1 -- 172.21.15.82:0/1356501821 >> 172.21.15.82:0/1356501821 conn(0x7f055807a600 msgr2=0x7f055807aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:07:59.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:59.529+0000 7f055d800700 1 -- 172.21.15.82:0/1356501821 shutdown_connections 2024-05-08T06:07:59.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:59.529+0000 7f055d800700 1 -- 172.21.15.82:0/1356501821 wait complete. 2024-05-08T06:07:59.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:59.531+0000 7f055d800700 1 Processor -- start 2024-05-08T06:07:59.531 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:59.531+0000 7f055d800700 1 -- start start 2024-05-08T06:07:59.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:59.531+0000 7f055d800700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0558103750 0x7f055819f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:07:59.532 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:59.532+0000 7f055d800700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0558104100 0x7f055819fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:07:59.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:59.532+0000 7f055d800700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0558108850 0x7f0558199960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:07:59.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:59.532+0000 7f055d800700 1 -- --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_getmap magic: 0 -- 0x7f0558113660 con 0x7f0558104100 2024-05-08T06:07:59.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:59.532+0000 7f055d800700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f05581134e0 con 0x7f0558103750 2024-05-08T06:07:59.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:59.532+0000 7f055d800700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f05581137e0 con 0x7f0558108850 2024-05-08T06:07:59.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:59.532+0000 7f054e000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0558104100 0x7f055819fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:07:59.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:59.532+0000 7f054e000700 1 --2- >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0558104100 0x7f055819fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.82:3300/0 says I am v2:172.21.15.82:47042/0 (socket says 172.21.15.82:47042) 2024-05-08T06:07:59.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:59.532+0000 7f054e000700 1 -- 172.21.15.82:0/3729809042 learned_addr learned my addr 172.21.15.82:0/3729809042 (peer_addr_for_me v2:172.21.15.82:0/0) 2024-05-08T06:07:59.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:59.532+0000 7f0557400700 1 --2- 172.21.15.82:0/3729809042 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0558108850 0x7f0558199960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:07:59.533 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:59.532+0000 7f0556a00700 1 --2- 172.21.15.82:0/3729809042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0558103750 0x7f055819f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:07:59.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:59.532+0000 7f054e000700 1 -- 172.21.15.82:0/3729809042 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0558108850 msgr2=0x7f0558199960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:07:59.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:59.532+0000 7f054e000700 1 --2- 172.21.15.82:0/3729809042 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0558108850 0x7f0558199960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:59.534 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:59.533+0000 7f054e000700 1 -- 172.21.15.82:0/3729809042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0558103750 msgr2=0x7f055819f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:07:59.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:59.533+0000 7f054e000700 1 --2- 172.21.15.82:0/3729809042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0558103750 0x7f055819f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:59.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:59.533+0000 7f054e000700 1 -- 172.21.15.82:0/3729809042 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f055819a0c0 con 0x7f0558104100 2024-05-08T06:07:59.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:59.533+0000 7f0557400700 1 --2- 172.21.15.82:0/3729809042 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0558108850 0x7f0558199960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-08T06:07:59.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:59.533+0000 7f054e000700 1 --2- 172.21.15.82:0/3729809042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0558104100 0x7f055819fc90 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f0540006010 tx=0x7f0540005280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:07:59.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:59.533+0000 7f054fe00700 1 -- 172.21.15.82:0/3729809042 <== mon.0 v2:172.21.15.82:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0540026070 con 0x7f0558104100 2024-05-08T06:07:59.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:59.533+0000 7f055d800700 1 -- 172.21.15.82:0/3729809042 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f055819a350 con 0x7f0558104100 2024-05-08T06:07:59.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:59.533+0000 7f054fe00700 1 -- 172.21.15.82:0/3729809042 <== mon.0 v2:172.21.15.82:3300/0 2 ==== config(26 keys) ==== 1101+0+0 (secure 0 0 0) 0x7f0540005680 con 0x7f0558104100 2024-05-08T06:07:59.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:59.533+0000 7f054fe00700 1 -- 172.21.15.82:0/3729809042 <== mon.0 v2:172.21.15.82:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f054000fb20 con 0x7f0558104100 2024-05-08T06:07:59.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:59.533+0000 7f055d800700 1 -- 172.21.15.82:0/3729809042 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05581a6620 con 0x7f0558104100 2024-05-08T06:07:59.535 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:59.534+0000 7f055d800700 1 -- 172.21.15.82:0/3729809042 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f055806a190 con 0x7f0558104100 2024-05-08T06:07:59.537 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:59.537+0000 7f054fe00700 1 -- 172.21.15.82:0/3729809042 <== mon.0 v2:172.21.15.82:3300/0 4 ==== mgrmap(e 20) ==== 149652+0+0 (secure 0 0 0) 0x7f0540029070 con 0x7f0558104100 2024-05-08T06:07:59.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:59.538+0000 7f054fe00700 1 --2- 172.21.15.82:0/3729809042 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f053c0b2900 0x7f053c0b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-08T06:07:59.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:59.539+0000 7f054fe00700 1 -- 172.21.15.82:0/3729809042 <== mon.0 v2:172.21.15.82:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8087+0+0 (secure 0 0 0) 0x7f05400e30b0 con 0x7f0558104100 2024-05-08T06:07:59.539 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:59.539+0000 7f0556a00700 1 --2- 172.21.15.82:0/3729809042 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f053c0b2900 0x7f053c0b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-08T06:07:59.540 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:59.540+0000 7f0556a00700 1 --2- 172.21.15.82:0/3729809042 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f053c0b2900 0x7f053c0b4dc0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0558108300 tx=0x7f0548009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-08T06:07:59.541 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:59.541+0000 7f054fe00700 1 -- 172.21.15.82:0/3729809042 <== mon.0 v2:172.21.15.82:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0540030020 con 0x7f0558104100 2024-05-08T06:07:59.773 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:59.773+0000 7f055d800700 1 -- 172.21.15.82:0/3729809042 --> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f055802e510 con 0x7f0558104100 2024-05-08T06:07:59.819 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:59.818+0000 7f054fe00700 1 -- 172.21.15.82:0/3729809042 <== mon.0 v2:172.21.15.82:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v85) ==== 169+0+0 (secure 0 0 0) 0x7f0540013070 con 0x7f0558104100 2024-05-08T06:07:59.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:59.824+0000 7f055d800700 1 -- 172.21.15.82:0/3729809042 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f053c0b2900 msgr2=0x7f053c0b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:07:59.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:59.824+0000 7f055d800700 1 --2- 172.21.15.82:0/3729809042 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f053c0b2900 0x7f053c0b4dc0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f0558108300 tx=0x7f0548009260 comp rx=0 tx=0).stop 2024-05-08T06:07:59.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:59.824+0000 7f055d800700 1 -- 172.21.15.82:0/3729809042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0558104100 msgr2=0x7f055819fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-08T06:07:59.825 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:59.824+0000 7f055d800700 1 --2- 172.21.15.82:0/3729809042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0558104100 0x7f055819fc90 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f0540006010 tx=0x7f0540005280 comp rx=0 tx=0).stop 2024-05-08T06:07:59.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:59.825+0000 7f055d800700 1 -- 172.21.15.82:0/3729809042 shutdown_connections 2024-05-08T06:07:59.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:59.825+0000 7f055d800700 1 --2- 172.21.15.82:0/3729809042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0558103750 0x7f055819f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:59.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:59.825+0000 7f055d800700 1 --2- 172.21.15.82:0/3729809042 >> [v2:172.21.15.82:6800/4089180091,v1:172.21.15.82:6801/4089180091] conn(0x7f053c0b2900 0x7f053c0b4dc0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:59.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:59.825+0000 7f055d800700 1 --2- 172.21.15.82:0/3729809042 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0558108850 0x7f0558199960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:59.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:59.825+0000 7f055d800700 1 --2- 172.21.15.82:0/3729809042 >> [v2:172.21.15.82:3300/0,v1:172.21.15.82:6789/0] conn(0x7f0558104100 0x7f055819fc90 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-08T06:07:59.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:59.825+0000 7f055d800700 1 -- 172.21.15.82:0/3729809042 >> 172.21.15.82:0/3729809042 conn(0x7f055807a600 msgr2=0x7f0558101890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-08T06:07:59.826 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:59.825+0000 7f055d800700 1 -- 172.21.15.82:0/3729809042 shutdown_connections 2024-05-08T06:07:59.827 INFO:teuthology.orchestra.run.smithi082.stderr:2024-05-08T06:07:59.825+0000 7f055d800700 1 -- 172.21.15.82:0/3729809042 wait complete. 2024-05-08T06:07:59.831 INFO:teuthology.orchestra.run.smithi082.stderr:pool 'cephfs_data' removed 2024-05-08T06:08:00.112 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:59 smithi082 ceph-mon[30098]: pgmap v981: 65 pgs: 65 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:08:00.112 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:07:59 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/3729809042' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-08T06:08:00.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:59 smithi151 ceph-mon[34815]: pgmap v981: 65 pgs: 65 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:08:00.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:07:59 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/3729809042' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-08T06:08:00.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:59 smithi134 ceph-mon[34132]: pgmap v981: 65 pgs: 65 active+clean; 1.6 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail 2024-05-08T06:08:00.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:07:59 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/3729809042' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-05-08T06:08:00.766 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-08T06:08:00.857 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-08T06:08:00.890 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-08T06:08:00.919 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-05-08T06:08:00.919 DEBUG:teuthology.orchestra.run.smithi082:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-08T06:08:00.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:08:00 smithi082 ceph-mon[30098]: from='client.? 172.21.15.82:0/3729809042' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-05-08T06:08:00.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:08:00 smithi082 ceph-mon[30098]: osdmap e85: 12 total, 12 up, 12 in 2024-05-08T06:08:00.973 DEBUG:teuthology.orchestra.run.smithi134:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-08T06:08:00.990 DEBUG:teuthology.orchestra.run.smithi151:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-08T06:08:01.005 INFO:tasks.cephadm:Stopping all daemons... 2024-05-08T06:08:01.006 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-05-08T06:08:01.006 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mon.a 2024-05-08T06:08:01.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:08:00 smithi151 ceph-mon[34815]: from='client.? 172.21.15.82:0/3729809042' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-05-08T06:08:01.129 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:08:00 smithi151 ceph-mon[34815]: osdmap e85: 12 total, 12 up, 12 in 2024-05-08T06:08:01.249 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:08:00 smithi134 ceph-mon[34132]: from='client.? 172.21.15.82:0/3729809042' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-05-08T06:08:01.250 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:08:00 smithi134 ceph-mon[34132]: osdmap e85: 12 total, 12 up, 12 in 2024-05-08T06:08:01.470 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:08:01 smithi082 systemd[1]: Stopping Ceph mon.a for c739a5c8-0cfc-11ef-bc97-c7b262605968... 2024-05-08T06:08:01.970 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:08:01 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mon-a[30094]: 2024-05-08T06:08:01.607+0000 7f6a5aa00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T06:08:01.974 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:08:01 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mon-a[30094]: 2024-05-08T06:08:01.607+0000 7f6a5aa00700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-05-08T06:08:01.974 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:08:01 smithi082 podman[112237]: 2024-05-08 06:08:01.649738842 +0000 UTC m=+0.241185072 container died e91a456d9489419ab70d73b89a2e6a4ba883d4dcb0f02ca25293da3efb4f943b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mon-a, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-57676-3-bee299f, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-05-08T06:08:02.251 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:08:02 smithi082 podman[112237]: 2024-05-08 06:08:02.250567601 +0000 UTC m=+0.842013784 container cleanup e91a456d9489419ab70d73b89a2e6a4ba883d4dcb0f02ca25293da3efb4f943b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-05-08T06:08:02.251 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:08:02 smithi082 bash[112237]: ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mon-a 2024-05-08T06:08:02.720 INFO:journalctl@ceph.mon.a.smithi082.stdout:May 08 06:08:02 smithi082 podman[112250]: 2024-05-08 06:08:02.477945376 +0000 UTC m=+0.812265761 container remove e91a456d9489419ab70d73b89a2e6a4ba883d4dcb0f02ca25293da3efb4f943b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mon-a, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-57676-3-bee299f, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-08T06:08:02.938 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mon.a.service' 2024-05-08T06:08:03.080 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T06:08:03.081 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-05-08T06:08:03.081 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-05-08T06:08:03.081 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mon.b 2024-05-08T06:08:03.403 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:08:03 smithi134 systemd[1]: Stopping Ceph mon.b for c739a5c8-0cfc-11ef-bc97-c7b262605968... 2024-05-08T06:08:03.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:08:03 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mon-b[34128]: 2024-05-08T06:08:03.403+0000 7f0a41bbe700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T06:08:03.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:08:03 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mon-b[34128]: 2024-05-08T06:08:03.403+0000 7f0a41bbe700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-05-08T06:08:03.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:08:03 smithi134 podman[70922]: 2024-05-08 06:08:03.566805573 +0000 UTC m=+0.289398946 container died 7bfe5449905291d064c15981e498136f0851ffdd9f9a875b02060d77465f3832 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mon-b, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-05-08T06:08:04.229 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:08:03 smithi134 podman[70922]: 2024-05-08 06:08:03.945591935 +0000 UTC m=+0.668185361 container cleanup 7bfe5449905291d064c15981e498136f0851ffdd9f9a875b02060d77465f3832 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mon-b, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-57676-3-bee299f, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-08T06:08:04.230 INFO:journalctl@ceph.mon.b.smithi134.stdout:May 08 06:08:03 smithi134 bash[70922]: ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mon-b 2024-05-08T06:08:04.330 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mon.b.service' 2024-05-08T06:08:04.379 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T06:08:04.379 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-05-08T06:08:04.379 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-05-08T06:08:04.380 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mon.c 2024-05-08T06:08:04.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:08:04 smithi151 systemd[1]: Stopping Ceph mon.c for c739a5c8-0cfc-11ef-bc97-c7b262605968... 2024-05-08T06:08:05.379 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:08:04 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mon-c[34811]: 2024-05-08T06:08:04.918+0000 7fc5e09a6700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T06:08:05.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:08:04 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mon-c[34811]: 2024-05-08T06:08:04.918+0000 7fc5e09a6700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-05-08T06:08:05.380 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:08:05 smithi151 podman[71643]: 2024-05-08 06:08:05.112997771 +0000 UTC m=+0.536894604 container died fe9f1f14c8eaec9ba374ff227dae81b7e3dbe93cd5b25b1458bf186e18d9e8a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mon-c, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-57676-3-bee299f, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-08T06:08:05.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:08:05 smithi151 podman[71643]: 2024-05-08 06:08:05.510985468 +0000 UTC m=+0.934882291 container cleanup fe9f1f14c8eaec9ba374ff227dae81b7e3dbe93cd5b25b1458bf186e18d9e8a0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mon-c, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-57676-3-bee299f, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-08T06:08:05.879 INFO:journalctl@ceph.mon.c.smithi151.stdout:May 08 06:08:05 smithi151 bash[71643]: ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mon-c 2024-05-08T06:08:06.101 DEBUG:teuthology.orchestra.run.smithi151:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mon.c.service' 2024-05-08T06:08:06.145 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T06:08:06.146 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-05-08T06:08:06.146 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-05-08T06:08:06.146 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mgr.x 2024-05-08T06:08:06.715 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 06:08:06 smithi082 systemd[1]: Stopping Ceph mgr.x for c739a5c8-0cfc-11ef-bc97-c7b262605968... 2024-05-08T06:08:06.715 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 06:08:06 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T06:08:06.711+0000 7f6ec2200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T06:08:06.715 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 06:08:06 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x[30333]: 2024-05-08T06:08:06.711+0000 7f6ec2200700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-05-08T06:08:06.970 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 06:08:06 smithi082 podman[112436]: 2024-05-08 06:08:06.826865849 +0000 UTC m=+0.285770327 container died 5805a3b3e699ee60a8bd8838ba1a91105ce7a6f288715f7262b4013d722e2d23 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, io.buildah.version=1.33.5, RELEASE=wip-57676-3-bee299f, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, GIT_CLEAN=True) 2024-05-08T06:08:07.971 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 06:08:07 smithi082 podman[112436]: 2024-05-08 06:08:07.564973622 +0000 UTC m=+1.023878093 container cleanup 5805a3b3e699ee60a8bd8838ba1a91105ce7a6f288715f7262b4013d722e2d23 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-57676-3-bee299f, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240507) 2024-05-08T06:08:07.971 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 06:08:07 smithi082 bash[112436]: ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x 2024-05-08T06:08:07.971 INFO:journalctl@ceph.mgr.x.smithi082.stdout:May 08 06:08:07 smithi082 podman[112451]: 2024-05-08 06:08:07.775299723 +0000 UTC m=+0.935888132 container remove 5805a3b3e699ee60a8bd8838ba1a91105ce7a6f288715f7262b4013d722e2d23 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bee299f4ac344e4c45e550d7a80abcadd7bc3d5a, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-x, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-57676-3-bee299f, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507) 2024-05-08T06:08:08.231 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mgr.x.service' 2024-05-08T06:08:08.344 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T06:08:08.344 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-05-08T06:08:08.344 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-05-08T06:08:08.345 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mgr.y 2024-05-08T06:08:08.695 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 08 06:08:08 smithi134 systemd[1]: Stopping Ceph mgr.y for c739a5c8-0cfc-11ef-bc97-c7b262605968... 2024-05-08T06:08:08.984 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 08 06:08:08 smithi134 podman[71047]: 2024-05-08 06:08:08.695823726 +0000 UTC m=+0.160195243 container died d872a9d9122cff8fe38313329e4039873021c355f6951570effddca160e5590e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-y, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-57676-3-bee299f, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-05-08T06:08:09.250 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 08 06:08:09 smithi134 podman[71047]: 2024-05-08 06:08:09.09232117 +0000 UTC m=+0.556692682 container cleanup d872a9d9122cff8fe38313329e4039873021c355f6951570effddca160e5590e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-y, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-57676-3-bee299f, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0) 2024-05-08T06:08:09.250 INFO:journalctl@ceph.mgr.y.smithi134.stdout:May 08 06:08:09 smithi134 bash[71047]: ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-y 2024-05-08T06:08:09.506 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mgr.y.service' 2024-05-08T06:08:09.540 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T06:08:09.540 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-05-08T06:08:09.540 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-05-08T06:08:09.540 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mgr.z 2024-05-08T06:08:09.879 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 08 06:08:09 smithi151 systemd[1]: Stopping Ceph mgr.z for c739a5c8-0cfc-11ef-bc97-c7b262605968... 2024-05-08T06:08:10.177 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 08 06:08:09 smithi151 podman[71767]: 2024-05-08 06:08:09.888808582 +0000 UTC m=+0.158728749 container died f1002fec0153a3f7ea6bbf271b69d5f924215dc1ef6609036bbca1091588cdd0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-z, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-57676-3-bee299f, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0) 2024-05-08T06:08:10.554 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 08 06:08:10 smithi151 podman[71767]: 2024-05-08 06:08:10.26934611 +0000 UTC m=+0.539266285 container cleanup f1002fec0153a3f7ea6bbf271b69d5f924215dc1ef6609036bbca1091588cdd0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-57676-3-bee299f, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507) 2024-05-08T06:08:10.554 INFO:journalctl@ceph.mgr.z.smithi151.stdout:May 08 06:08:10 smithi151 bash[71767]: ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mgr-z 2024-05-08T06:08:10.683 DEBUG:teuthology.orchestra.run.smithi151:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mgr.z.service' 2024-05-08T06:08:10.716 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T06:08:10.716 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-05-08T06:08:10.716 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-05-08T06:08:10.716 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@osd.0 2024-05-08T06:08:11.106 INFO:journalctl@ceph.osd.0.smithi082.stdout:May 08 06:08:10 smithi082 systemd[1]: Stopping Ceph osd.0 for c739a5c8-0cfc-11ef-bc97-c7b262605968... 2024-05-08T06:08:11.471 INFO:journalctl@ceph.osd.0.smithi082.stdout:May 08 06:08:11 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-0[42221]: 2024-05-08T06:08:11.275+0000 7f25d8a00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T06:08:11.471 INFO:journalctl@ceph.osd.0.smithi082.stdout:May 08 06:08:11 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-0[42221]: 2024-05-08T06:08:11.275+0000 7f25d8a00700 -1 osd.0 85 *** Got signal Terminated *** 2024-05-08T06:08:11.471 INFO:journalctl@ceph.osd.0.smithi082.stdout:May 08 06:08:11 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-0[42221]: 2024-05-08T06:08:11.275+0000 7f25d8a00700 -1 osd.0 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T06:08:17.221 INFO:journalctl@ceph.osd.0.smithi082.stdout:May 08 06:08:16 smithi082 podman[112568]: 2024-05-08 06:08:16.956430325 +0000 UTC m=+5.840865223 container died 0145d59dceca5b4fa6f4767dfdc80b04a2494571edd0fbafe6e015cfa157a055 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-0, org.label-schema.build-date=20240507, RELEASE=wip-57676-3-bee299f, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-05-08T06:08:17.550 INFO:journalctl@ceph.osd.0.smithi082.stdout:May 08 06:08:17 smithi082 podman[112568]: 2024-05-08 06:08:17.52007486 +0000 UTC m=+6.404509718 container cleanup 0145d59dceca5b4fa6f4767dfdc80b04a2494571edd0fbafe6e015cfa157a055 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-0, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-57676-3-bee299f, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-05-08T06:08:17.550 INFO:journalctl@ceph.osd.0.smithi082.stdout:May 08 06:08:17 smithi082 bash[112568]: ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-0 2024-05-08T06:08:17.970 INFO:journalctl@ceph.osd.0.smithi082.stdout:May 08 06:08:17 smithi082 podman[112586]: 2024-05-08 06:08:17.738308006 +0000 UTC m=+0.765926841 container remove 0145d59dceca5b4fa6f4767dfdc80b04a2494571edd0fbafe6e015cfa157a055 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-0, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-05-08T06:08:18.893 INFO:journalctl@ceph.osd.0.smithi082.stdout:May 08 06:08:18 smithi082 podman[112675]: 2024-05-08 06:08:18.45363731 +0000 UTC m=+0.032323757 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T06:08:18.894 INFO:journalctl@ceph.osd.0.smithi082.stdout:May 08 06:08:18 smithi082 podman[112675]: 2024-05-08 06:08:18.564305398 +0000 UTC m=+0.142991905 container create 9a52e4f1d2573e2f4ece98429049add9dfa8642ef2dcbc57d147547a2d877430 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-0-deactivate, RELEASE=wip-57676-3-bee299f, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-05-08T06:08:18.894 INFO:journalctl@ceph.osd.0.smithi082.stdout:May 08 06:08:18 smithi082 podman[112675]: 2024-05-08 06:08:18.893350317 +0000 UTC m=+0.472036807 container init 9a52e4f1d2573e2f4ece98429049add9dfa8642ef2dcbc57d147547a2d877430 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-57676-3-bee299f) 2024-05-08T06:08:19.220 INFO:journalctl@ceph.osd.0.smithi082.stdout:May 08 06:08:18 smithi082 podman[112675]: 2024-05-08 06:08:18.906076853 +0000 UTC m=+0.484763373 container start 9a52e4f1d2573e2f4ece98429049add9dfa8642ef2dcbc57d147547a2d877430 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-0-deactivate, RELEASE=wip-57676-3-bee299f, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-05-08T06:08:19.221 INFO:journalctl@ceph.osd.0.smithi082.stdout:May 08 06:08:18 smithi082 podman[112675]: 2024-05-08 06:08:18.983959695 +0000 UTC m=+0.562646166 container attach 9a52e4f1d2573e2f4ece98429049add9dfa8642ef2dcbc57d147547a2d877430 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-57676-3-bee299f, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-08T06:08:19.721 INFO:journalctl@ceph.osd.0.smithi082.stdout:May 08 06:08:19 smithi082 podman[112675]: 2024-05-08 06:08:19.360160448 +0000 UTC m=+0.938846894 container died 9a52e4f1d2573e2f4ece98429049add9dfa8642ef2dcbc57d147547a2d877430 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, RELEASE=wip-57676-3-bee299f, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-05-08T06:08:20.239 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@osd.0.service' 2024-05-08T06:08:20.348 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T06:08:20.348 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-05-08T06:08:20.348 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-05-08T06:08:20.349 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@osd.1 2024-05-08T06:08:20.654 INFO:journalctl@ceph.osd.1.smithi134.stdout:May 08 06:08:20 smithi134 systemd[1]: Stopping Ceph osd.1 for c739a5c8-0cfc-11ef-bc97-c7b262605968... 2024-05-08T06:08:21.000 INFO:journalctl@ceph.osd.1.smithi134.stdout:May 08 06:08:20 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-1[38728]: 2024-05-08T06:08:20.653+0000 7f301e575700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T06:08:21.000 INFO:journalctl@ceph.osd.1.smithi134.stdout:May 08 06:08:20 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-1[38728]: 2024-05-08T06:08:20.653+0000 7f301e575700 -1 osd.1 85 *** Got signal Terminated *** 2024-05-08T06:08:21.000 INFO:journalctl@ceph.osd.1.smithi134.stdout:May 08 06:08:20 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-1[38728]: 2024-05-08T06:08:20.653+0000 7f301e575700 -1 osd.1 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T06:08:26.462 INFO:journalctl@ceph.osd.1.smithi134.stdout:May 08 06:08:26 smithi134 podman[71172]: 2024-05-08 06:08:26.124114699 +0000 UTC m=+5.586574938 container died ebe3c4c05765a0ef5e9a8637da90562e990f261994ad3d785cf678e0a4ca6ae7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-1, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-57676-3-bee299f, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-05-08T06:08:26.750 INFO:journalctl@ceph.osd.1.smithi134.stdout:May 08 06:08:26 smithi134 podman[71172]: 2024-05-08 06:08:26.563260673 +0000 UTC m=+6.025720953 container cleanup ebe3c4c05765a0ef5e9a8637da90562e990f261994ad3d785cf678e0a4ca6ae7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-1, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=wip-57676-3-bee299f, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-05-08T06:08:26.750 INFO:journalctl@ceph.osd.1.smithi134.stdout:May 08 06:08:26 smithi134 bash[71172]: ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-1 2024-05-08T06:08:27.226 INFO:journalctl@ceph.osd.1.smithi134.stdout:May 08 06:08:26 smithi134 podman[71191]: 2024-05-08 06:08:26.814705367 +0000 UTC m=+0.690990014 container remove ebe3c4c05765a0ef5e9a8637da90562e990f261994ad3d785cf678e0a4ca6ae7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-57676-3-bee299f, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True) 2024-05-08T06:08:27.492 INFO:journalctl@ceph.osd.1.smithi134.stdout:May 08 06:08:27 smithi134 podman[71282]: 2024-05-08 06:08:27.130128791 +0000 UTC m=+0.018058319 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T06:08:27.492 INFO:journalctl@ceph.osd.1.smithi134.stdout:May 08 06:08:27 smithi134 podman[71282]: 2024-05-08 06:08:27.240489381 +0000 UTC m=+0.128418895 container create 74e35f059644f935bd1d851fd65c95562f5e2bffe30c9bef75c2aaa41292bc11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-57676-3-bee299f, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux ) 2024-05-08T06:08:27.750 INFO:journalctl@ceph.osd.1.smithi134.stdout:May 08 06:08:27 smithi134 podman[71282]: 2024-05-08 06:08:27.492927481 +0000 UTC m=+0.380857001 container init 74e35f059644f935bd1d851fd65c95562f5e2bffe30c9bef75c2aaa41292bc11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-08T06:08:27.750 INFO:journalctl@ceph.osd.1.smithi134.stdout:May 08 06:08:27 smithi134 podman[71282]: 2024-05-08 06:08:27.496238687 +0000 UTC m=+0.384168203 container start 74e35f059644f935bd1d851fd65c95562f5e2bffe30c9bef75c2aaa41292bc11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-1-deactivate, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-05-08T06:08:27.750 INFO:journalctl@ceph.osd.1.smithi134.stdout:May 08 06:08:27 smithi134 podman[71282]: 2024-05-08 06:08:27.601439716 +0000 UTC m=+0.489369243 container attach 74e35f059644f935bd1d851fd65c95562f5e2bffe30c9bef75c2aaa41292bc11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-57676-3-bee299f, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-05-08T06:08:28.087 INFO:journalctl@ceph.osd.1.smithi134.stdout:May 08 06:08:27 smithi134 podman[71282]: 2024-05-08 06:08:27.787319846 +0000 UTC m=+0.675249371 container died 74e35f059644f935bd1d851fd65c95562f5e2bffe30c9bef75c2aaa41292bc11 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-05-08T06:08:28.425 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@osd.1.service' 2024-05-08T06:08:28.463 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T06:08:28.463 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-05-08T06:08:28.463 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-05-08T06:08:28.463 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@osd.2 2024-05-08T06:08:28.782 INFO:journalctl@ceph.osd.2.smithi151.stdout:May 08 06:08:28 smithi151 systemd[1]: Stopping Ceph osd.2 for c739a5c8-0cfc-11ef-bc97-c7b262605968... 2024-05-08T06:08:29.129 INFO:journalctl@ceph.osd.2.smithi151.stdout:May 08 06:08:28 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-2[40174]: 2024-05-08T06:08:28.781+0000 7fdcbf41d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T06:08:29.129 INFO:journalctl@ceph.osd.2.smithi151.stdout:May 08 06:08:28 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-2[40174]: 2024-05-08T06:08:28.781+0000 7fdcbf41d700 -1 osd.2 85 *** Got signal Terminated *** 2024-05-08T06:08:29.129 INFO:journalctl@ceph.osd.2.smithi151.stdout:May 08 06:08:28 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-2[40174]: 2024-05-08T06:08:28.781+0000 7fdcbf41d700 -1 osd.2 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T06:08:34.629 INFO:journalctl@ceph.osd.2.smithi151.stdout:May 08 06:08:34 smithi151 podman[71894]: 2024-05-08 06:08:34.361197239 +0000 UTC m=+5.700418723 container died 7813303bf8aa8a79e02db14aa6a4c581c3d586ce556f03f73aac8ac5e0e70a0e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-2, RELEASE=wip-57676-3-bee299f, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-08T06:08:35.026 INFO:journalctl@ceph.osd.2.smithi151.stdout:May 08 06:08:34 smithi151 podman[71894]: 2024-05-08 06:08:34.77500642 +0000 UTC m=+6.114227915 container cleanup 7813303bf8aa8a79e02db14aa6a4c581c3d586ce556f03f73aac8ac5e0e70a0e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-57676-3-bee299f, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-08T06:08:35.027 INFO:journalctl@ceph.osd.2.smithi151.stdout:May 08 06:08:34 smithi151 bash[71894]: ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-2 2024-05-08T06:08:35.379 INFO:journalctl@ceph.osd.2.smithi151.stdout:May 08 06:08:35 smithi151 podman[71911]: 2024-05-08 06:08:35.027309879 +0000 UTC m=+0.664269750 container remove 7813303bf8aa8a79e02db14aa6a4c581c3d586ce556f03f73aac8ac5e0e70a0e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=wip-57676-3-bee299f, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507) 2024-05-08T06:08:35.756 INFO:journalctl@ceph.osd.2.smithi151.stdout:May 08 06:08:35 smithi151 podman[71999]: 2024-05-08 06:08:35.349712806 +0000 UTC m=+0.018233541 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T06:08:35.757 INFO:journalctl@ceph.osd.2.smithi151.stdout:May 08 06:08:35 smithi151 podman[71999]: 2024-05-08 06:08:35.48762628 +0000 UTC m=+0.156147016 container create 9edf4a39442f7ecae4f7dffb0cbb9c979b8d9ee0e1c53148cd69543e5498fbc2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, RELEASE=wip-57676-3-bee299f, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-08T06:08:35.757 INFO:journalctl@ceph.osd.2.smithi151.stdout:May 08 06:08:35 smithi151 podman[71999]: 2024-05-08 06:08:35.757528551 +0000 UTC m=+0.426049287 container init 9edf4a39442f7ecae4f7dffb0cbb9c979b8d9ee0e1c53148cd69543e5498fbc2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-57676-3-bee299f, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-08T06:08:36.054 INFO:journalctl@ceph.osd.2.smithi151.stdout:May 08 06:08:35 smithi151 podman[71999]: 2024-05-08 06:08:35.761116979 +0000 UTC m=+0.429637720 container start 9edf4a39442f7ecae4f7dffb0cbb9c979b8d9ee0e1c53148cd69543e5498fbc2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-2-deactivate, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-08T06:08:36.054 INFO:journalctl@ceph.osd.2.smithi151.stdout:May 08 06:08:35 smithi151 podman[71999]: 2024-05-08 06:08:35.857931289 +0000 UTC m=+0.526452043 container attach 9edf4a39442f7ecae4f7dffb0cbb9c979b8d9ee0e1c53148cd69543e5498fbc2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-57676-3-bee299f, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-05-08T06:08:36.332 INFO:journalctl@ceph.osd.2.smithi151.stdout:May 08 06:08:36 smithi151 podman[71999]: 2024-05-08 06:08:36.055071556 +0000 UTC m=+0.723592301 container died 9edf4a39442f7ecae4f7dffb0cbb9c979b8d9ee0e1c53148cd69543e5498fbc2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-08T06:08:36.732 DEBUG:teuthology.orchestra.run.smithi151:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@osd.2.service' 2024-05-08T06:08:36.770 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T06:08:36.770 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-05-08T06:08:36.771 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-05-08T06:08:36.771 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@osd.3 2024-05-08T06:08:37.221 INFO:journalctl@ceph.osd.3.smithi082.stdout:May 08 06:08:36 smithi082 systemd[1]: Stopping Ceph osd.3 for c739a5c8-0cfc-11ef-bc97-c7b262605968... 2024-05-08T06:08:37.721 INFO:journalctl@ceph.osd.3.smithi082.stdout:May 08 06:08:37 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-3[48715]: 2024-05-08T06:08:37.320+0000 7f4800e00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T06:08:37.721 INFO:journalctl@ceph.osd.3.smithi082.stdout:May 08 06:08:37 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-3[48715]: 2024-05-08T06:08:37.320+0000 7f4800e00700 -1 osd.3 85 *** Got signal Terminated *** 2024-05-08T06:08:37.722 INFO:journalctl@ceph.osd.3.smithi082.stdout:May 08 06:08:37 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-3[48715]: 2024-05-08T06:08:37.320+0000 7f4800e00700 -1 osd.3 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T06:08:38.623 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:08:38 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:08:38.371+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:12.046442+0000 front 2024-05-08T06:08:12.045573+0000 (oldest deadline 2024-05-08T06:08:37.945772+0000) 2024-05-08T06:08:38.879 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 08 06:08:38 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-5[46993]: 2024-05-08T06:08:38.539+0000 7f5a93ea1700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.676852+0000 front 2024-05-08T06:08:13.676961+0000 (oldest deadline 2024-05-08T06:08:38.376522+0000) 2024-05-08T06:08:38.999 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:08:38 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:08:38.701+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:08:39.220 INFO:journalctl@ceph.osd.3.smithi082.stdout:May 08 06:08:39 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-3[48715]: 2024-05-08T06:08:39.171+0000 7f47fc600700 -1 osd.3 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:15.538102+0000 front 2024-05-08T06:08:15.538843+0000 (oldest deadline 2024-05-08T06:08:38.438235+0000) 2024-05-08T06:08:39.220 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:08:38 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:08:38.946+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:14.102601+0000 front 2024-05-08T06:08:14.102288+0000 (oldest deadline 2024-05-08T06:08:38.201828+0000) 2024-05-08T06:08:39.720 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:08:39 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:08:39.385+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:12.046442+0000 front 2024-05-08T06:08:12.045573+0000 (oldest deadline 2024-05-08T06:08:37.945772+0000) 2024-05-08T06:08:39.879 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 08 06:08:39 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-5[46993]: 2024-05-08T06:08:39.512+0000 7f5a93ea1700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.676852+0000 front 2024-05-08T06:08:13.676961+0000 (oldest deadline 2024-05-08T06:08:38.376522+0000) 2024-05-08T06:08:40.000 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:08:39 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:08:39.702+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:08:40.220 INFO:journalctl@ceph.osd.3.smithi082.stdout:May 08 06:08:40 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-3[48715]: 2024-05-08T06:08:40.163+0000 7f47fc600700 -1 osd.3 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:15.538102+0000 front 2024-05-08T06:08:15.538843+0000 (oldest deadline 2024-05-08T06:08:38.438235+0000) 2024-05-08T06:08:40.220 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:08:39 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:08:39.948+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:14.102601+0000 front 2024-05-08T06:08:14.102288+0000 (oldest deadline 2024-05-08T06:08:38.201828+0000) 2024-05-08T06:08:40.720 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:08:40 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:08:40.395+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:12.046442+0000 front 2024-05-08T06:08:12.045573+0000 (oldest deadline 2024-05-08T06:08:37.945772+0000) 2024-05-08T06:08:40.837 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 08 06:08:40 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-5[46993]: 2024-05-08T06:08:40.523+0000 7f5a93ea1700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.676852+0000 front 2024-05-08T06:08:13.676961+0000 (oldest deadline 2024-05-08T06:08:38.376522+0000) 2024-05-08T06:08:41.000 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:08:40 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:08:40.676+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:08:41.129 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:08:40 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:08:40.837+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:08:41.220 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:08:40 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:08:40.952+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:14.102601+0000 front 2024-05-08T06:08:14.102288+0000 (oldest deadline 2024-05-08T06:08:38.201828+0000) 2024-05-08T06:08:41.220 INFO:journalctl@ceph.osd.3.smithi082.stdout:May 08 06:08:41 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-3[48715]: 2024-05-08T06:08:41.125+0000 7f47fc600700 -1 osd.3 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:15.538102+0000 front 2024-05-08T06:08:15.538843+0000 (oldest deadline 2024-05-08T06:08:38.438235+0000) 2024-05-08T06:08:41.720 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:08:41 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:08:41.406+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:12.046442+0000 front 2024-05-08T06:08:12.045573+0000 (oldest deadline 2024-05-08T06:08:37.945772+0000) 2024-05-08T06:08:41.807 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 08 06:08:41 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-5[46993]: 2024-05-08T06:08:41.496+0000 7f5a93ea1700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.676852+0000 front 2024-05-08T06:08:13.676961+0000 (oldest deadline 2024-05-08T06:08:38.376522+0000) 2024-05-08T06:08:41.999 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:08:41 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:08:41.645+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:08:42.129 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:08:41 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:08:41.807+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:08:42.397 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:08:41 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:08:41.974+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:14.102601+0000 front 2024-05-08T06:08:14.102288+0000 (oldest deadline 2024-05-08T06:08:38.201828+0000) 2024-05-08T06:08:42.398 INFO:journalctl@ceph.osd.3.smithi082.stdout:May 08 06:08:42 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-3[48715]: 2024-05-08T06:08:42.102+0000 7f47fc600700 -1 osd.3 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:15.538102+0000 front 2024-05-08T06:08:15.538843+0000 (oldest deadline 2024-05-08T06:08:38.438235+0000) 2024-05-08T06:08:42.720 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:08:42 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:08:42.396+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:12.046442+0000 front 2024-05-08T06:08:12.045573+0000 (oldest deadline 2024-05-08T06:08:37.945772+0000) 2024-05-08T06:08:42.833 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 08 06:08:42 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-5[46993]: 2024-05-08T06:08:42.483+0000 7f5a93ea1700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.676852+0000 front 2024-05-08T06:08:13.676961+0000 (oldest deadline 2024-05-08T06:08:38.376522+0000) 2024-05-08T06:08:43.000 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:08:42 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:08:42.662+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:08:43.129 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:08:42 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:08:42.833+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:08:43.220 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:08:42 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:08:42.952+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:14.102601+0000 front 2024-05-08T06:08:14.102288+0000 (oldest deadline 2024-05-08T06:08:38.201828+0000) 2024-05-08T06:08:43.221 INFO:journalctl@ceph.osd.3.smithi082.stdout:May 08 06:08:43 smithi082 podman[112778]: 2024-05-08 06:08:43.112502434 +0000 UTC m=+5.923618292 container died 6d0bcc496aad4af6c1a2fcaf31bbce4fafd02e4b8f95b8f687508dc16fd10190 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-3, RELEASE=wip-57676-3-bee299f, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-05-08T06:08:43.680 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:08:43 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:08:43.415+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:12.046442+0000 front 2024-05-08T06:08:12.045573+0000 (oldest deadline 2024-05-08T06:08:37.945772+0000) 2024-05-08T06:08:43.854 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 08 06:08:43 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-5[46993]: 2024-05-08T06:08:43.526+0000 7f5a93ea1700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.676852+0000 front 2024-05-08T06:08:13.676961+0000 (oldest deadline 2024-05-08T06:08:38.376522+0000) 2024-05-08T06:08:43.970 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:08:43 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:08:43.925+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:14.102601+0000 front 2024-05-08T06:08:14.102288+0000 (oldest deadline 2024-05-08T06:08:38.201828+0000) 2024-05-08T06:08:43.971 INFO:journalctl@ceph.osd.3.smithi082.stdout:May 08 06:08:43 smithi082 podman[112778]: 2024-05-08 06:08:43.680775538 +0000 UTC m=+6.491891400 container cleanup 6d0bcc496aad4af6c1a2fcaf31bbce4fafd02e4b8f95b8f687508dc16fd10190 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-3, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-57676-3-bee299f, ceph=True) 2024-05-08T06:08:43.971 INFO:journalctl@ceph.osd.3.smithi082.stdout:May 08 06:08:43 smithi082 bash[112778]: ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-3 2024-05-08T06:08:43.999 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:08:43 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:08:43.654+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:08:44.129 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:08:43 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:08:43.854+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:08:44.464 INFO:journalctl@ceph.osd.3.smithi082.stdout:May 08 06:08:43 smithi082 podman[112810]: 2024-05-08 06:08:43.990845115 +0000 UTC m=+0.857019545 container remove 6d0bcc496aad4af6c1a2fcaf31bbce4fafd02e4b8f95b8f687508dc16fd10190 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-3, RELEASE=wip-57676-3-bee299f, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2) 2024-05-08T06:08:44.720 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:08:44 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:08:44.463+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:12.046442+0000 front 2024-05-08T06:08:12.045573+0000 (oldest deadline 2024-05-08T06:08:37.945772+0000) 2024-05-08T06:08:44.868 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 08 06:08:44 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-5[46993]: 2024-05-08T06:08:44.550+0000 7f5a93ea1700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.676852+0000 front 2024-05-08T06:08:13.676961+0000 (oldest deadline 2024-05-08T06:08:38.376522+0000) 2024-05-08T06:08:45.000 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:08:44 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:08:44.699+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:08:45.129 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:08:44 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:08:44.868+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:08:45.154 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:08:44 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:08:44.927+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:14.102601+0000 front 2024-05-08T06:08:14.102288+0000 (oldest deadline 2024-05-08T06:08:38.201828+0000) 2024-05-08T06:08:45.154 INFO:journalctl@ceph.osd.3.smithi082.stdout:May 08 06:08:44 smithi082 podman[112899]: 2024-05-08 06:08:44.720914334 +0000 UTC m=+0.036718501 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T06:08:45.155 INFO:journalctl@ceph.osd.3.smithi082.stdout:May 08 06:08:44 smithi082 podman[112899]: 2024-05-08 06:08:44.833545808 +0000 UTC m=+0.149349996 container create 0d49ddbe5232c810909c6d8883c48cf8821d8317c0e2af996eb1da4a43ed374d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-57676-3-bee299f, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, ceph=True, GIT_BRANCH=HEAD) 2024-05-08T06:08:45.155 INFO:journalctl@ceph.osd.3.smithi082.stdout:May 08 06:08:45 smithi082 podman[112899]: 2024-05-08 06:08:45.154282872 +0000 UTC m=+0.470087077 container init 0d49ddbe5232c810909c6d8883c48cf8821d8317c0e2af996eb1da4a43ed374d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-57676-3-bee299f, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-05-08T06:08:45.470 INFO:journalctl@ceph.osd.3.smithi082.stdout:May 08 06:08:45 smithi082 podman[112899]: 2024-05-08 06:08:45.165931998 +0000 UTC m=+0.481736156 container start 0d49ddbe5232c810909c6d8883c48cf8821d8317c0e2af996eb1da4a43ed374d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-57676-3-bee299f, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-08T06:08:45.470 INFO:journalctl@ceph.osd.3.smithi082.stdout:May 08 06:08:45 smithi082 podman[112899]: 2024-05-08 06:08:45.269707777 +0000 UTC m=+0.585512008 container attach 0d49ddbe5232c810909c6d8883c48cf8821d8317c0e2af996eb1da4a43ed374d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-57676-3-bee299f, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2) 2024-05-08T06:08:45.720 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:08:45 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:08:45.468+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:12.046442+0000 front 2024-05-08T06:08:12.045573+0000 (oldest deadline 2024-05-08T06:08:37.945772+0000) 2024-05-08T06:08:45.720 INFO:journalctl@ceph.osd.3.smithi082.stdout:May 08 06:08:45 smithi082 podman[112899]: 2024-05-08 06:08:45.614432492 +0000 UTC m=+0.930236674 container died 0d49ddbe5232c810909c6d8883c48cf8821d8317c0e2af996eb1da4a43ed374d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-3-deactivate, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-57676-3-bee299f, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True) 2024-05-08T06:08:45.863 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 08 06:08:45 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-5[46993]: 2024-05-08T06:08:45.553+0000 7f5a93ea1700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.676852+0000 front 2024-05-08T06:08:13.676961+0000 (oldest deadline 2024-05-08T06:08:38.376522+0000) 2024-05-08T06:08:46.000 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:08:45 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:08:45.741+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:08:46.129 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:08:45 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:08:45.862+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:08:46.388 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:08:45 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:08:45.974+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:14.102601+0000 front 2024-05-08T06:08:14.102288+0000 (oldest deadline 2024-05-08T06:08:38.201828+0000) 2024-05-08T06:08:46.434 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@osd.3.service' 2024-05-08T06:08:46.548 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T06:08:46.548 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-05-08T06:08:46.549 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-05-08T06:08:46.549 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@osd.4 2024-05-08T06:08:46.720 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:08:46 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:08:46.475+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:12.046442+0000 front 2024-05-08T06:08:12.045573+0000 (oldest deadline 2024-05-08T06:08:37.945772+0000) 2024-05-08T06:08:46.823 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 08 06:08:46 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-5[46993]: 2024-05-08T06:08:46.532+0000 7f5a93ea1700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.676852+0000 front 2024-05-08T06:08:13.676961+0000 (oldest deadline 2024-05-08T06:08:38.376522+0000) 2024-05-08T06:08:46.874 INFO:journalctl@ceph.osd.4.smithi134.stdout:May 08 06:08:46 smithi134 systemd[1]: Stopping Ceph osd.4 for c739a5c8-0cfc-11ef-bc97-c7b262605968... 2024-05-08T06:08:46.875 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:08:46 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:08:46.773+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:08:47.129 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:08:46 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:08:46.823+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:08:47.129 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:08:46 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:08:46.823+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:08:47.250 INFO:journalctl@ceph.osd.4.smithi134.stdout:May 08 06:08:46 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-4[45547]: 2024-05-08T06:08:46.874+0000 7f3f34e77700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T06:08:47.250 INFO:journalctl@ceph.osd.4.smithi134.stdout:May 08 06:08:46 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-4[45547]: 2024-05-08T06:08:46.874+0000 7f3f34e77700 -1 osd.4 85 *** Got signal Terminated *** 2024-05-08T06:08:47.250 INFO:journalctl@ceph.osd.4.smithi134.stdout:May 08 06:08:46 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-4[45547]: 2024-05-08T06:08:46.874+0000 7f3f34e77700 -1 osd.4 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T06:08:47.470 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:08:47 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:08:47.002+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:14.102601+0000 front 2024-05-08T06:08:14.102288+0000 (oldest deadline 2024-05-08T06:08:38.201828+0000) 2024-05-08T06:08:47.470 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:08:47 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:08:47.002+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.604025+0000 front 2024-05-08T06:08:24.604141+0000 (oldest deadline 2024-05-08T06:08:46.304248+0000) 2024-05-08T06:08:47.629 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 08 06:08:47 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-5[46993]: 2024-05-08T06:08:47.572+0000 7f5a93ea1700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.676852+0000 front 2024-05-08T06:08:13.676961+0000 (oldest deadline 2024-05-08T06:08:38.376522+0000) 2024-05-08T06:08:47.956 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:08:47 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:08:47.525+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:12.046442+0000 front 2024-05-08T06:08:12.045573+0000 (oldest deadline 2024-05-08T06:08:37.945772+0000) 2024-05-08T06:08:48.129 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:08:47 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:08:47.857+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:08:48.129 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:08:47 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:08:47.857+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:08:48.220 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:08:47 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:08:47.955+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:14.102601+0000 front 2024-05-08T06:08:14.102288+0000 (oldest deadline 2024-05-08T06:08:38.201828+0000) 2024-05-08T06:08:48.220 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:08:47 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:08:47.955+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.604025+0000 front 2024-05-08T06:08:24.604141+0000 (oldest deadline 2024-05-08T06:08:46.304248+0000) 2024-05-08T06:08:48.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:08:47 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:08:47.791+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:08:48.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:08:47 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:08:47.791+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:25.504732+0000 front 2024-05-08T06:08:25.504827+0000 (oldest deadline 2024-05-08T06:08:47.105412+0000) 2024-05-08T06:08:48.750 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:08:48 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:08:48.337+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.440767+0000 front 2024-05-08T06:08:22.440836+0000 (oldest deadline 2024-05-08T06:08:47.741012+0000) 2024-05-08T06:08:48.879 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 08 06:08:48 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-5[46993]: 2024-05-08T06:08:48.622+0000 7f5a93ea1700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.676852+0000 front 2024-05-08T06:08:13.676961+0000 (oldest deadline 2024-05-08T06:08:38.376522+0000) 2024-05-08T06:08:48.879 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 08 06:08:48 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-5[46993]: 2024-05-08T06:08:48.622+0000 7f5a93ea1700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.277643+0000 front 2024-05-08T06:08:24.277764+0000 (oldest deadline 2024-05-08T06:08:48.377762+0000) 2024-05-08T06:08:48.880 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:08:48 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:08:48.866+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:08:48.880 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:08:48 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:08:48.866+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:08:48.910 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:08:48 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:08:48.529+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:12.046442+0000 front 2024-05-08T06:08:12.045573+0000 (oldest deadline 2024-05-08T06:08:37.945772+0000) 2024-05-08T06:08:48.910 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:08:48 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:08:48.529+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.648698+0000 front 2024-05-08T06:08:22.648127+0000 (oldest deadline 2024-05-08T06:08:47.948258+0000) 2024-05-08T06:08:49.220 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:08:48 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:08:48.910+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:14.102601+0000 front 2024-05-08T06:08:14.102288+0000 (oldest deadline 2024-05-08T06:08:38.201828+0000) 2024-05-08T06:08:49.220 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:08:48 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:08:48.910+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.604025+0000 front 2024-05-08T06:08:24.604141+0000 (oldest deadline 2024-05-08T06:08:46.304248+0000) 2024-05-08T06:08:49.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:08:48 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:08:48.778+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:08:49.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:08:48 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:08:48.778+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:25.504732+0000 front 2024-05-08T06:08:25.504827+0000 (oldest deadline 2024-05-08T06:08:47.105412+0000) 2024-05-08T06:08:49.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:08:49 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:08:49.072+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.621931+0000 front 2024-05-08T06:08:22.621835+0000 (oldest deadline 2024-05-08T06:08:48.521971+0000) 2024-05-08T06:08:49.749 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:08:49 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:08:49.352+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.440767+0000 front 2024-05-08T06:08:22.440836+0000 (oldest deadline 2024-05-08T06:08:47.741012+0000) 2024-05-08T06:08:49.870 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 08 06:08:49 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-5[46993]: 2024-05-08T06:08:49.617+0000 7f5a93ea1700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.676852+0000 front 2024-05-08T06:08:13.676961+0000 (oldest deadline 2024-05-08T06:08:38.376522+0000) 2024-05-08T06:08:49.871 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 08 06:08:49 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-5[46993]: 2024-05-08T06:08:49.617+0000 7f5a93ea1700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.277643+0000 front 2024-05-08T06:08:24.277764+0000 (oldest deadline 2024-05-08T06:08:48.377762+0000) 2024-05-08T06:08:49.933 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:08:49 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:08:49.482+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:12.046442+0000 front 2024-05-08T06:08:12.045573+0000 (oldest deadline 2024-05-08T06:08:37.945772+0000) 2024-05-08T06:08:49.933 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:08:49 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:08:49.482+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.648698+0000 front 2024-05-08T06:08:22.648127+0000 (oldest deadline 2024-05-08T06:08:47.948258+0000) 2024-05-08T06:08:50.129 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:08:50 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:08:50.038+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.621931+0000 front 2024-05-08T06:08:22.621835+0000 (oldest deadline 2024-05-08T06:08:48.521971+0000) 2024-05-08T06:08:50.129 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:08:49 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:08:49.870+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:08:50.129 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:08:49 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:08:49.870+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:08:50.220 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:08:49 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:08:49.932+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:14.102601+0000 front 2024-05-08T06:08:14.102288+0000 (oldest deadline 2024-05-08T06:08:38.201828+0000) 2024-05-08T06:08:50.220 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:08:49 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:08:49.932+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.604025+0000 front 2024-05-08T06:08:24.604141+0000 (oldest deadline 2024-05-08T06:08:46.304248+0000) 2024-05-08T06:08:50.249 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:08:49 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:08:49.814+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:08:50.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:08:49 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:08:49.814+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:25.504732+0000 front 2024-05-08T06:08:25.504827+0000 (oldest deadline 2024-05-08T06:08:47.105412+0000) 2024-05-08T06:08:50.720 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:08:50 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:08:50.443+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:12.046442+0000 front 2024-05-08T06:08:12.045573+0000 (oldest deadline 2024-05-08T06:08:37.945772+0000) 2024-05-08T06:08:50.721 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:08:50 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:08:50.443+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.648698+0000 front 2024-05-08T06:08:22.648127+0000 (oldest deadline 2024-05-08T06:08:47.948258+0000) 2024-05-08T06:08:50.749 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:08:50 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:08:50.325+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.440767+0000 front 2024-05-08T06:08:22.440836+0000 (oldest deadline 2024-05-08T06:08:47.741012+0000) 2024-05-08T06:08:51.066 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 08 06:08:50 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-5[46993]: 2024-05-08T06:08:50.649+0000 7f5a93ea1700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.676852+0000 front 2024-05-08T06:08:13.676961+0000 (oldest deadline 2024-05-08T06:08:38.376522+0000) 2024-05-08T06:08:51.066 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 08 06:08:50 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-5[46993]: 2024-05-08T06:08:50.649+0000 7f5a93ea1700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.277643+0000 front 2024-05-08T06:08:24.277764+0000 (oldest deadline 2024-05-08T06:08:48.377762+0000) 2024-05-08T06:08:51.066 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:08:50 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:08:50.865+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:08:51.066 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:08:50 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:08:50.865+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:08:51.220 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:08:50 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:08:50.943+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:14.102601+0000 front 2024-05-08T06:08:14.102288+0000 (oldest deadline 2024-05-08T06:08:38.201828+0000) 2024-05-08T06:08:51.221 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:08:50 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:08:50.943+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.604025+0000 front 2024-05-08T06:08:24.604141+0000 (oldest deadline 2024-05-08T06:08:46.304248+0000) 2024-05-08T06:08:51.249 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:08:50 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:08:50.800+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:08:51.249 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:08:50 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:08:50.800+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:25.504732+0000 front 2024-05-08T06:08:25.504827+0000 (oldest deadline 2024-05-08T06:08:47.105412+0000) 2024-05-08T06:08:51.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:08:51 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:08:51.066+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.621931+0000 front 2024-05-08T06:08:22.621835+0000 (oldest deadline 2024-05-08T06:08:48.521971+0000) 2024-05-08T06:08:51.625 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:08:51 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:08:51.360+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.440767+0000 front 2024-05-08T06:08:22.440836+0000 (oldest deadline 2024-05-08T06:08:47.741012+0000) 2024-05-08T06:08:51.720 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:08:51 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:08:51.425+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:12.046442+0000 front 2024-05-08T06:08:12.045573+0000 (oldest deadline 2024-05-08T06:08:37.945772+0000) 2024-05-08T06:08:51.720 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:08:51 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:08:51.425+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.648698+0000 front 2024-05-08T06:08:22.648127+0000 (oldest deadline 2024-05-08T06:08:47.948258+0000) 2024-05-08T06:08:51.879 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 08 06:08:51 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-5[46993]: 2024-05-08T06:08:51.615+0000 7f5a93ea1700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.676852+0000 front 2024-05-08T06:08:13.676961+0000 (oldest deadline 2024-05-08T06:08:38.376522+0000) 2024-05-08T06:08:51.879 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 08 06:08:51 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-5[46993]: 2024-05-08T06:08:51.615+0000 7f5a93ea1700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.277643+0000 front 2024-05-08T06:08:24.277764+0000 (oldest deadline 2024-05-08T06:08:48.377762+0000) 2024-05-08T06:08:52.000 INFO:journalctl@ceph.osd.4.smithi134.stdout:May 08 06:08:51 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-4[45547]: 2024-05-08T06:08:51.625+0000 7f3f2d463700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.315430+0000 front 2024-05-08T06:08:24.315462+0000 (oldest deadline 2024-05-08T06:08:51.316194+0000) 2024-05-08T06:08:52.000 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:08:51 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:08:51.833+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:08:52.000 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:08:51 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:08:51.833+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:25.504732+0000 front 2024-05-08T06:08:25.504827+0000 (oldest deadline 2024-05-08T06:08:47.105412+0000) 2024-05-08T06:08:52.220 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:08:51 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:08:51.917+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:14.102601+0000 front 2024-05-08T06:08:14.102288+0000 (oldest deadline 2024-05-08T06:08:38.201828+0000) 2024-05-08T06:08:52.220 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:08:51 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:08:51.917+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.604025+0000 front 2024-05-08T06:08:24.604141+0000 (oldest deadline 2024-05-08T06:08:46.304248+0000) 2024-05-08T06:08:52.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:08:52 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:08:52.019+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.621931+0000 front 2024-05-08T06:08:22.621835+0000 (oldest deadline 2024-05-08T06:08:48.521971+0000) 2024-05-08T06:08:52.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:08:51 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:08:51.897+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:08:52.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:08:51 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:08:51.897+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:08:52.575 INFO:journalctl@ceph.osd.4.smithi134.stdout:May 08 06:08:52 smithi134 podman[71400]: 2024-05-08 06:08:52.282198101 +0000 UTC m=+5.535185999 container died 4f05430349b1f53acb16e4a4c229e9c51bdede270693717c2c9fef68f2f173da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-4, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=wip-57676-3-bee299f, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240507) 2024-05-08T06:08:52.575 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:08:52 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:08:52.312+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.440767+0000 front 2024-05-08T06:08:22.440836+0000 (oldest deadline 2024-05-08T06:08:47.741012+0000) 2024-05-08T06:08:52.720 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:08:52 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:08:52.400+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:12.046442+0000 front 2024-05-08T06:08:12.045573+0000 (oldest deadline 2024-05-08T06:08:37.945772+0000) 2024-05-08T06:08:52.721 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:08:52 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:08:52.400+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.648698+0000 front 2024-05-08T06:08:22.648127+0000 (oldest deadline 2024-05-08T06:08:47.948258+0000) 2024-05-08T06:08:52.879 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 08 06:08:52 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-5[46993]: 2024-05-08T06:08:52.604+0000 7f5a93ea1700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.676852+0000 front 2024-05-08T06:08:13.676961+0000 (oldest deadline 2024-05-08T06:08:38.376522+0000) 2024-05-08T06:08:52.879 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 08 06:08:52 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-5[46993]: 2024-05-08T06:08:52.604+0000 7f5a93ea1700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.277643+0000 front 2024-05-08T06:08:24.277764+0000 (oldest deadline 2024-05-08T06:08:48.377762+0000) 2024-05-08T06:08:52.941 INFO:journalctl@ceph.osd.4.smithi134.stdout:May 08 06:08:52 smithi134 podman[71400]: 2024-05-08 06:08:52.665887712 +0000 UTC m=+5.918875615 container cleanup 4f05430349b1f53acb16e4a4c229e9c51bdede270693717c2c9fef68f2f173da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-4, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, RELEASE=wip-57676-3-bee299f, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2) 2024-05-08T06:08:52.942 INFO:journalctl@ceph.osd.4.smithi134.stdout:May 08 06:08:52 smithi134 bash[71400]: ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-4 2024-05-08T06:08:52.942 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:08:52 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:08:52.802+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:08:52.942 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:08:52 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:08:52.802+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:25.504732+0000 front 2024-05-08T06:08:25.504827+0000 (oldest deadline 2024-05-08T06:08:47.105412+0000) 2024-05-08T06:08:53.220 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:08:52 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:08:52.874+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:14.102601+0000 front 2024-05-08T06:08:14.102288+0000 (oldest deadline 2024-05-08T06:08:38.201828+0000) 2024-05-08T06:08:53.220 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:08:52 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:08:52.874+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.604025+0000 front 2024-05-08T06:08:24.604141+0000 (oldest deadline 2024-05-08T06:08:46.304248+0000) 2024-05-08T06:08:53.249 INFO:journalctl@ceph.osd.4.smithi134.stdout:May 08 06:08:52 smithi134 podman[71417]: 2024-05-08 06:08:52.942331628 +0000 UTC m=+0.660327739 container remove 4f05430349b1f53acb16e4a4c229e9c51bdede270693717c2c9fef68f2f173da (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-4, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=wip-57676-3-bee299f, org.label-schema.schema-version=1.0) 2024-05-08T06:08:53.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:08:53 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:08:53.059+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.621931+0000 front 2024-05-08T06:08:22.621835+0000 (oldest deadline 2024-05-08T06:08:48.521971+0000) 2024-05-08T06:08:53.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:08:52 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:08:52.945+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:08:53.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:08:52 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:08:52.945+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:08:53.561 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:08:53 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:08:53.319+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.440767+0000 front 2024-05-08T06:08:22.440836+0000 (oldest deadline 2024-05-08T06:08:47.741012+0000) 2024-05-08T06:08:53.562 INFO:journalctl@ceph.osd.4.smithi134.stdout:May 08 06:08:53 smithi134 podman[71506]: 2024-05-08 06:08:53.183923514 +0000 UTC m=+0.018060744 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T06:08:53.562 INFO:journalctl@ceph.osd.4.smithi134.stdout:May 08 06:08:53 smithi134 podman[71506]: 2024-05-08 06:08:53.310090211 +0000 UTC m=+0.144227474 container create e80a47c3fe35b21e169b5020311d4b556beca24fd4c5bb48fee9e0e4d1c3503f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-57676-3-bee299f, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-05-08T06:08:53.720 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:08:53 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:08:53.374+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:12.046442+0000 front 2024-05-08T06:08:12.045573+0000 (oldest deadline 2024-05-08T06:08:37.945772+0000) 2024-05-08T06:08:53.721 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:08:53 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:08:53.374+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.648698+0000 front 2024-05-08T06:08:22.648127+0000 (oldest deadline 2024-05-08T06:08:47.948258+0000) 2024-05-08T06:08:53.857 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:08:53 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:08:53.764+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:08:53.857 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:08:53 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:08:53.764+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:25.504732+0000 front 2024-05-08T06:08:25.504827+0000 (oldest deadline 2024-05-08T06:08:47.105412+0000) 2024-05-08T06:08:53.858 INFO:journalctl@ceph.osd.4.smithi134.stdout:May 08 06:08:53 smithi134 podman[71506]: 2024-05-08 06:08:53.562422176 +0000 UTC m=+0.396559397 container init e80a47c3fe35b21e169b5020311d4b556beca24fd4c5bb48fee9e0e4d1c3503f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-57676-3-bee299f, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True) 2024-05-08T06:08:53.858 INFO:journalctl@ceph.osd.4.smithi134.stdout:May 08 06:08:53 smithi134 podman[71506]: 2024-05-08 06:08:53.565486706 +0000 UTC m=+0.399623930 container start e80a47c3fe35b21e169b5020311d4b556beca24fd4c5bb48fee9e0e4d1c3503f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-4-deactivate, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-08T06:08:53.858 INFO:journalctl@ceph.osd.4.smithi134.stdout:May 08 06:08:53 smithi134 podman[71506]: 2024-05-08 06:08:53.662535869 +0000 UTC m=+0.496673100 container attach e80a47c3fe35b21e169b5020311d4b556beca24fd4c5bb48fee9e0e4d1c3503f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, RELEASE=wip-57676-3-bee299f, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-08T06:08:53.879 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 08 06:08:53 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-5[46993]: 2024-05-08T06:08:53.605+0000 7f5a93ea1700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.676852+0000 front 2024-05-08T06:08:13.676961+0000 (oldest deadline 2024-05-08T06:08:38.376522+0000) 2024-05-08T06:08:53.879 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 08 06:08:53 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-5[46993]: 2024-05-08T06:08:53.605+0000 7f5a93ea1700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.277643+0000 front 2024-05-08T06:08:24.277764+0000 (oldest deadline 2024-05-08T06:08:48.377762+0000) 2024-05-08T06:08:54.165 INFO:journalctl@ceph.osd.4.smithi134.stdout:May 08 06:08:53 smithi134 podman[71506]: 2024-05-08 06:08:53.858560837 +0000 UTC m=+0.692698068 container died e80a47c3fe35b21e169b5020311d4b556beca24fd4c5bb48fee9e0e4d1c3503f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-57676-3-bee299f, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-05-08T06:08:54.220 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:08:53 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:08:53.894+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:14.102601+0000 front 2024-05-08T06:08:14.102288+0000 (oldest deadline 2024-05-08T06:08:38.201828+0000) 2024-05-08T06:08:54.220 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:08:53 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:08:53.894+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.604025+0000 front 2024-05-08T06:08:24.604141+0000 (oldest deadline 2024-05-08T06:08:46.304248+0000) 2024-05-08T06:08:54.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:08:54 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:08:54.054+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.621931+0000 front 2024-05-08T06:08:22.621835+0000 (oldest deadline 2024-05-08T06:08:48.521971+0000) 2024-05-08T06:08:54.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:08:53 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:08:53.940+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:08:54.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:08:53 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:08:53.940+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:08:54.490 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:08:54 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:08:54.349+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.440767+0000 front 2024-05-08T06:08:22.440836+0000 (oldest deadline 2024-05-08T06:08:47.741012+0000) 2024-05-08T06:08:54.511 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@osd.4.service' 2024-05-08T06:08:54.550 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T06:08:54.551 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-05-08T06:08:54.551 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-05-08T06:08:54.551 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@osd.5 2024-05-08T06:08:54.720 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:08:54 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:08:54.414+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:12.046442+0000 front 2024-05-08T06:08:12.045573+0000 (oldest deadline 2024-05-08T06:08:37.945772+0000) 2024-05-08T06:08:54.720 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:08:54 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:08:54.414+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.648698+0000 front 2024-05-08T06:08:22.648127+0000 (oldest deadline 2024-05-08T06:08:47.948258+0000) 2024-05-08T06:08:54.879 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 08 06:08:54 smithi151 systemd[1]: Stopping Ceph osd.5 for c739a5c8-0cfc-11ef-bc97-c7b262605968... 2024-05-08T06:08:54.879 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 08 06:08:54 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-5[46993]: 2024-05-08T06:08:54.631+0000 7f5a93ea1700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.676852+0000 front 2024-05-08T06:08:13.676961+0000 (oldest deadline 2024-05-08T06:08:38.376522+0000) 2024-05-08T06:08:54.879 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 08 06:08:54 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-5[46993]: 2024-05-08T06:08:54.631+0000 7f5a93ea1700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.277643+0000 front 2024-05-08T06:08:24.277764+0000 (oldest deadline 2024-05-08T06:08:48.377762+0000) 2024-05-08T06:08:55.220 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:08:54 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:08:54.854+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:14.102601+0000 front 2024-05-08T06:08:14.102288+0000 (oldest deadline 2024-05-08T06:08:38.201828+0000) 2024-05-08T06:08:55.221 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:08:54 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:08:54.854+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.604025+0000 front 2024-05-08T06:08:24.604141+0000 (oldest deadline 2024-05-08T06:08:46.304248+0000) 2024-05-08T06:08:55.221 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:08:54 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:08:54.854+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:31.507102+0000 front 2024-05-08T06:08:31.507556+0000 (oldest deadline 2024-05-08T06:08:54.407403+0000) 2024-05-08T06:08:55.249 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:08:54 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:08:54.767+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:08:55.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:08:54 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:08:54.767+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:25.504732+0000 front 2024-05-08T06:08:25.504827+0000 (oldest deadline 2024-05-08T06:08:47.105412+0000) 2024-05-08T06:08:55.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:08:54 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:08:54.767+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.306974+0000 front 2024-05-08T06:08:32.306880+0000 (oldest deadline 2024-05-08T06:08:54.606868+0000) 2024-05-08T06:08:55.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:08:55 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:08:55.021+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.621931+0000 front 2024-05-08T06:08:22.621835+0000 (oldest deadline 2024-05-08T06:08:48.521971+0000) 2024-05-08T06:08:55.380 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 08 06:08:54 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-5[46993]: 2024-05-08T06:08:54.983+0000 7f5a978ad700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T06:08:55.380 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 08 06:08:54 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-5[46993]: 2024-05-08T06:08:54.983+0000 7f5a978ad700 -1 osd.5 85 *** Got signal Terminated *** 2024-05-08T06:08:55.380 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 08 06:08:54 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-5[46993]: 2024-05-08T06:08:54.983+0000 7f5a978ad700 -1 osd.5 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T06:08:55.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:08:54 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:08:54.908+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:08:55.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:08:54 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:08:54.908+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:08:55.720 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:08:55 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:08:55.442+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:12.046442+0000 front 2024-05-08T06:08:12.045573+0000 (oldest deadline 2024-05-08T06:08:37.945772+0000) 2024-05-08T06:08:55.720 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:08:55 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:08:55.442+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.648698+0000 front 2024-05-08T06:08:22.648127+0000 (oldest deadline 2024-05-08T06:08:47.948258+0000) 2024-05-08T06:08:55.749 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:08:55 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:08:55.373+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.440767+0000 front 2024-05-08T06:08:22.440836+0000 (oldest deadline 2024-05-08T06:08:47.741012+0000) 2024-05-08T06:08:55.861 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 08 06:08:55 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-5[46993]: 2024-05-08T06:08:55.594+0000 7f5a93ea1700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.676852+0000 front 2024-05-08T06:08:13.676961+0000 (oldest deadline 2024-05-08T06:08:38.376522+0000) 2024-05-08T06:08:55.861 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 08 06:08:55 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-5[46993]: 2024-05-08T06:08:55.594+0000 7f5a93ea1700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.277643+0000 front 2024-05-08T06:08:24.277764+0000 (oldest deadline 2024-05-08T06:08:48.377762+0000) 2024-05-08T06:08:55.861 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 08 06:08:55 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-5[46993]: 2024-05-08T06:08:55.594+0000 7f5a93ea1700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:31.179139+0000 front 2024-05-08T06:08:31.179161+0000 (oldest deadline 2024-05-08T06:08:54.679305+0000) 2024-05-08T06:08:56.129 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:08:56 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:08:56.064+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.621931+0000 front 2024-05-08T06:08:22.621835+0000 (oldest deadline 2024-05-08T06:08:48.521971+0000) 2024-05-08T06:08:56.129 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:08:56 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:08:56.064+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:30.822810+0000 front 2024-05-08T06:08:30.822787+0000 (oldest deadline 2024-05-08T06:08:55.523003+0000) 2024-05-08T06:08:56.129 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:08:55 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:08:55.861+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:08:56.130 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:08:55 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:08:55.861+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:08:56.130 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:08:55 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:08:55.861+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.881680+0000 front 2024-05-08T06:08:32.881745+0000 (oldest deadline 2024-05-08T06:08:55.181825+0000) 2024-05-08T06:08:56.220 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:08:55 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:08:55.891+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:14.102601+0000 front 2024-05-08T06:08:14.102288+0000 (oldest deadline 2024-05-08T06:08:38.201828+0000) 2024-05-08T06:08:56.220 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:08:55 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:08:55.891+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.604025+0000 front 2024-05-08T06:08:24.604141+0000 (oldest deadline 2024-05-08T06:08:46.304248+0000) 2024-05-08T06:08:56.220 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:08:55 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:08:55.891+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:31.507102+0000 front 2024-05-08T06:08:31.507556+0000 (oldest deadline 2024-05-08T06:08:54.407403+0000) 2024-05-08T06:08:56.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:08:55 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:08:55.771+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:08:56.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:08:55 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:08:55.771+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:25.504732+0000 front 2024-05-08T06:08:25.504827+0000 (oldest deadline 2024-05-08T06:08:47.105412+0000) 2024-05-08T06:08:56.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:08:55 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:08:55.771+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.306974+0000 front 2024-05-08T06:08:32.306880+0000 (oldest deadline 2024-05-08T06:08:54.606868+0000) 2024-05-08T06:08:56.720 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:08:56 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:08:56.452+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:12.046442+0000 front 2024-05-08T06:08:12.045573+0000 (oldest deadline 2024-05-08T06:08:37.945772+0000) 2024-05-08T06:08:56.720 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:08:56 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:08:56.452+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.648698+0000 front 2024-05-08T06:08:22.648127+0000 (oldest deadline 2024-05-08T06:08:47.948258+0000) 2024-05-08T06:08:56.731 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:08:56 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:08:56.339+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.440767+0000 front 2024-05-08T06:08:22.440836+0000 (oldest deadline 2024-05-08T06:08:47.741012+0000) 2024-05-08T06:08:56.879 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 08 06:08:56 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-5[46993]: 2024-05-08T06:08:56.606+0000 7f5a93ea1700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.676852+0000 front 2024-05-08T06:08:13.676961+0000 (oldest deadline 2024-05-08T06:08:38.376522+0000) 2024-05-08T06:08:56.879 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 08 06:08:56 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-5[46993]: 2024-05-08T06:08:56.606+0000 7f5a93ea1700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.277643+0000 front 2024-05-08T06:08:24.277764+0000 (oldest deadline 2024-05-08T06:08:48.377762+0000) 2024-05-08T06:08:56.879 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 08 06:08:56 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-5[46993]: 2024-05-08T06:08:56.606+0000 7f5a93ea1700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:31.179139+0000 front 2024-05-08T06:08:31.179161+0000 (oldest deadline 2024-05-08T06:08:54.679305+0000) 2024-05-08T06:08:56.879 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:08:56 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:08:56.828+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:08:56.880 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:08:56 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:08:56.828+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:08:56.880 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:08:56 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:08:56.828+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.881680+0000 front 2024-05-08T06:08:32.881745+0000 (oldest deadline 2024-05-08T06:08:55.181825+0000) 2024-05-08T06:08:56.999 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:08:56 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:08:56.732+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:08:57.000 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:08:56 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:08:56.732+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:25.504732+0000 front 2024-05-08T06:08:25.504827+0000 (oldest deadline 2024-05-08T06:08:47.105412+0000) 2024-05-08T06:08:57.000 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:08:56 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:08:56.732+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.306974+0000 front 2024-05-08T06:08:32.306880+0000 (oldest deadline 2024-05-08T06:08:54.606868+0000) 2024-05-08T06:08:57.220 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:08:56 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:08:56.911+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:14.102601+0000 front 2024-05-08T06:08:14.102288+0000 (oldest deadline 2024-05-08T06:08:38.201828+0000) 2024-05-08T06:08:57.220 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:08:56 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:08:56.911+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.604025+0000 front 2024-05-08T06:08:24.604141+0000 (oldest deadline 2024-05-08T06:08:46.304248+0000) 2024-05-08T06:08:57.221 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:08:56 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:08:56.911+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:31.507102+0000 front 2024-05-08T06:08:31.507556+0000 (oldest deadline 2024-05-08T06:08:54.407403+0000) 2024-05-08T06:08:57.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:08:57 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:08:57.089+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.621931+0000 front 2024-05-08T06:08:22.621835+0000 (oldest deadline 2024-05-08T06:08:48.521971+0000) 2024-05-08T06:08:57.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:08:57 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:08:57.089+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:30.822810+0000 front 2024-05-08T06:08:30.822787+0000 (oldest deadline 2024-05-08T06:08:55.523003+0000) 2024-05-08T06:08:57.720 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:08:57 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:08:57.456+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:12.046442+0000 front 2024-05-08T06:08:12.045573+0000 (oldest deadline 2024-05-08T06:08:37.945772+0000) 2024-05-08T06:08:57.720 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:08:57 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:08:57.456+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.648698+0000 front 2024-05-08T06:08:22.648127+0000 (oldest deadline 2024-05-08T06:08:47.948258+0000) 2024-05-08T06:08:57.721 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:08:57 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:08:57.456+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.649960+0000 front 2024-05-08T06:08:32.649891+0000 (oldest deadline 2024-05-08T06:08:56.750128+0000) 2024-05-08T06:08:57.730 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:08:57 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:08:57.296+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.440767+0000 front 2024-05-08T06:08:22.440836+0000 (oldest deadline 2024-05-08T06:08:47.741012+0000) 2024-05-08T06:08:57.730 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:08:57 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:08:57.296+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:30.542607+0000 front 2024-05-08T06:08:30.542626+0000 (oldest deadline 2024-05-08T06:08:56.442639+0000) 2024-05-08T06:08:57.879 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 08 06:08:57 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-5[46993]: 2024-05-08T06:08:57.595+0000 7f5a93ea1700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.676852+0000 front 2024-05-08T06:08:13.676961+0000 (oldest deadline 2024-05-08T06:08:38.376522+0000) 2024-05-08T06:08:57.879 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 08 06:08:57 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-5[46993]: 2024-05-08T06:08:57.595+0000 7f5a93ea1700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.277643+0000 front 2024-05-08T06:08:24.277764+0000 (oldest deadline 2024-05-08T06:08:48.377762+0000) 2024-05-08T06:08:57.879 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 08 06:08:57 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-5[46993]: 2024-05-08T06:08:57.595+0000 7f5a93ea1700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:31.179139+0000 front 2024-05-08T06:08:31.179161+0000 (oldest deadline 2024-05-08T06:08:54.679305+0000) 2024-05-08T06:08:57.880 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:08:57 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:08:57.843+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:08:57.880 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:08:57 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:08:57.843+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:08:57.880 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:08:57 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:08:57.843+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.881680+0000 front 2024-05-08T06:08:32.881745+0000 (oldest deadline 2024-05-08T06:08:55.181825+0000) 2024-05-08T06:08:58.000 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:08:57 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:08:57.731+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:08:58.000 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:08:57 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:08:57.731+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:25.504732+0000 front 2024-05-08T06:08:25.504827+0000 (oldest deadline 2024-05-08T06:08:47.105412+0000) 2024-05-08T06:08:58.000 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:08:57 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:08:57.731+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.306974+0000 front 2024-05-08T06:08:32.306880+0000 (oldest deadline 2024-05-08T06:08:54.606868+0000) 2024-05-08T06:08:58.220 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:08:57 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:08:57.910+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:14.102601+0000 front 2024-05-08T06:08:14.102288+0000 (oldest deadline 2024-05-08T06:08:38.201828+0000) 2024-05-08T06:08:58.221 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:08:57 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:08:57.910+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.604025+0000 front 2024-05-08T06:08:24.604141+0000 (oldest deadline 2024-05-08T06:08:46.304248+0000) 2024-05-08T06:08:58.221 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:08:57 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:08:57.910+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:31.507102+0000 front 2024-05-08T06:08:31.507556+0000 (oldest deadline 2024-05-08T06:08:54.407403+0000) 2024-05-08T06:08:58.380 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:08:58 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:08:58.043+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.621931+0000 front 2024-05-08T06:08:22.621835+0000 (oldest deadline 2024-05-08T06:08:48.521971+0000) 2024-05-08T06:08:58.380 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:08:58 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:08:58.043+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:30.822810+0000 front 2024-05-08T06:08:30.822787+0000 (oldest deadline 2024-05-08T06:08:55.523003+0000) 2024-05-08T06:08:58.720 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:08:58 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:08:58.421+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:12.046442+0000 front 2024-05-08T06:08:12.045573+0000 (oldest deadline 2024-05-08T06:08:37.945772+0000) 2024-05-08T06:08:58.721 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:08:58 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:08:58.421+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.648698+0000 front 2024-05-08T06:08:22.648127+0000 (oldest deadline 2024-05-08T06:08:47.948258+0000) 2024-05-08T06:08:58.721 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:08:58 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:08:58.421+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.649960+0000 front 2024-05-08T06:08:32.649891+0000 (oldest deadline 2024-05-08T06:08:56.750128+0000) 2024-05-08T06:08:58.729 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:08:58 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:08:58.306+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.440767+0000 front 2024-05-08T06:08:22.440836+0000 (oldest deadline 2024-05-08T06:08:47.741012+0000) 2024-05-08T06:08:58.729 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:08:58 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:08:58.306+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:30.542607+0000 front 2024-05-08T06:08:30.542626+0000 (oldest deadline 2024-05-08T06:08:56.442639+0000) 2024-05-08T06:08:58.842 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 08 06:08:58 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-5[46993]: 2024-05-08T06:08:58.558+0000 7f5a93ea1700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.676852+0000 front 2024-05-08T06:08:13.676961+0000 (oldest deadline 2024-05-08T06:08:38.376522+0000) 2024-05-08T06:08:58.843 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 08 06:08:58 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-5[46993]: 2024-05-08T06:08:58.558+0000 7f5a93ea1700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.277643+0000 front 2024-05-08T06:08:24.277764+0000 (oldest deadline 2024-05-08T06:08:48.377762+0000) 2024-05-08T06:08:58.843 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 08 06:08:58 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-5[46993]: 2024-05-08T06:08:58.558+0000 7f5a93ea1700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:31.179139+0000 front 2024-05-08T06:08:31.179161+0000 (oldest deadline 2024-05-08T06:08:54.679305+0000) 2024-05-08T06:08:58.999 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:08:58 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:08:58.729+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:08:59.000 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:08:58 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:08:58.729+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:25.504732+0000 front 2024-05-08T06:08:25.504827+0000 (oldest deadline 2024-05-08T06:08:47.105412+0000) 2024-05-08T06:08:59.000 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:08:58 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:08:58.729+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.306974+0000 front 2024-05-08T06:08:32.306880+0000 (oldest deadline 2024-05-08T06:08:54.606868+0000) 2024-05-08T06:08:59.129 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:08:59 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:08:59.032+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.621931+0000 front 2024-05-08T06:08:22.621835+0000 (oldest deadline 2024-05-08T06:08:48.521971+0000) 2024-05-08T06:08:59.129 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:08:59 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:08:59.032+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:30.822810+0000 front 2024-05-08T06:08:30.822787+0000 (oldest deadline 2024-05-08T06:08:55.523003+0000) 2024-05-08T06:08:59.129 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:08:58 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:08:58.843+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:08:59.129 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:08:58 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:08:58.843+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:08:59.129 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:08:58 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:08:58.843+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.881680+0000 front 2024-05-08T06:08:32.881745+0000 (oldest deadline 2024-05-08T06:08:55.181825+0000) 2024-05-08T06:08:59.220 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:08:58 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:08:58.953+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:14.102601+0000 front 2024-05-08T06:08:14.102288+0000 (oldest deadline 2024-05-08T06:08:38.201828+0000) 2024-05-08T06:08:59.220 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:08:58 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:08:58.953+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.604025+0000 front 2024-05-08T06:08:24.604141+0000 (oldest deadline 2024-05-08T06:08:46.304248+0000) 2024-05-08T06:08:59.220 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:08:58 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:08:58.953+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:31.507102+0000 front 2024-05-08T06:08:31.507556+0000 (oldest deadline 2024-05-08T06:08:54.407403+0000) 2024-05-08T06:08:59.746 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:08:59 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:08:59.346+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.440767+0000 front 2024-05-08T06:08:22.440836+0000 (oldest deadline 2024-05-08T06:08:47.741012+0000) 2024-05-08T06:08:59.746 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:08:59 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:08:59.346+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:30.542607+0000 front 2024-05-08T06:08:30.542626+0000 (oldest deadline 2024-05-08T06:08:56.442639+0000) 2024-05-08T06:08:59.831 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 08 06:08:59 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-5[46993]: 2024-05-08T06:08:59.519+0000 7f5a93ea1700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.676852+0000 front 2024-05-08T06:08:13.676961+0000 (oldest deadline 2024-05-08T06:08:38.376522+0000) 2024-05-08T06:08:59.831 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 08 06:08:59 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-5[46993]: 2024-05-08T06:08:59.519+0000 7f5a93ea1700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.277643+0000 front 2024-05-08T06:08:24.277764+0000 (oldest deadline 2024-05-08T06:08:48.377762+0000) 2024-05-08T06:08:59.831 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 08 06:08:59 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-5[46993]: 2024-05-08T06:08:59.519+0000 7f5a93ea1700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:31.179139+0000 front 2024-05-08T06:08:31.179161+0000 (oldest deadline 2024-05-08T06:08:54.679305+0000) 2024-05-08T06:08:59.970 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:08:59 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:08:59.470+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:12.046442+0000 front 2024-05-08T06:08:12.045573+0000 (oldest deadline 2024-05-08T06:08:37.945772+0000) 2024-05-08T06:08:59.973 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:08:59 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:08:59.470+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.648698+0000 front 2024-05-08T06:08:22.648127+0000 (oldest deadline 2024-05-08T06:08:47.948258+0000) 2024-05-08T06:08:59.973 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:08:59 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:08:59.470+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.649960+0000 front 2024-05-08T06:08:32.649891+0000 (oldest deadline 2024-05-08T06:08:56.750128+0000) 2024-05-08T06:08:59.999 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:08:59 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:08:59.746+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:08:59.999 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:08:59 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:08:59.746+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:25.504732+0000 front 2024-05-08T06:08:25.504827+0000 (oldest deadline 2024-05-08T06:08:47.105412+0000) 2024-05-08T06:09:00.000 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:08:59 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:08:59.746+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.306974+0000 front 2024-05-08T06:08:32.306880+0000 (oldest deadline 2024-05-08T06:08:54.606868+0000) 2024-05-08T06:09:00.129 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:00 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:00.021+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.621931+0000 front 2024-05-08T06:08:22.621835+0000 (oldest deadline 2024-05-08T06:08:48.521971+0000) 2024-05-08T06:09:00.130 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:00 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:00.021+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:30.822810+0000 front 2024-05-08T06:08:30.822787+0000 (oldest deadline 2024-05-08T06:08:55.523003+0000) 2024-05-08T06:09:00.130 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:08:59 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:08:59.831+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:09:00.130 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:08:59 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:08:59.831+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:09:00.130 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:08:59 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:08:59.831+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.881680+0000 front 2024-05-08T06:08:32.881745+0000 (oldest deadline 2024-05-08T06:08:55.181825+0000) 2024-05-08T06:09:00.470 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:08:59 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:08:59.981+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:14.102601+0000 front 2024-05-08T06:08:14.102288+0000 (oldest deadline 2024-05-08T06:08:38.201828+0000) 2024-05-08T06:09:00.470 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:08:59 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:08:59.981+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.604025+0000 front 2024-05-08T06:08:24.604141+0000 (oldest deadline 2024-05-08T06:08:46.304248+0000) 2024-05-08T06:09:00.471 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:08:59 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:08:59.982+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:31.507102+0000 front 2024-05-08T06:08:31.507556+0000 (oldest deadline 2024-05-08T06:08:54.407403+0000) 2024-05-08T06:09:00.676 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 08 06:09:00 smithi151 podman[72119]: 2024-05-08 06:09:00.393906909 +0000 UTC m=+5.651806676 container died 8da8f250c612495860ce90c93cf9ee38566ebe95c295368179743b94f1888d38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-57676-3-bee299f, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-08T06:09:00.749 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:00 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:09:00.345+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.440767+0000 front 2024-05-08T06:08:22.440836+0000 (oldest deadline 2024-05-08T06:08:47.741012+0000) 2024-05-08T06:09:00.750 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:00 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:09:00.345+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:30.542607+0000 front 2024-05-08T06:08:30.542626+0000 (oldest deadline 2024-05-08T06:08:56.442639+0000) 2024-05-08T06:09:00.970 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:00 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:00.511+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:12.046442+0000 front 2024-05-08T06:08:12.045573+0000 (oldest deadline 2024-05-08T06:08:37.945772+0000) 2024-05-08T06:09:00.970 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:00 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:00.511+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.648698+0000 front 2024-05-08T06:08:22.648127+0000 (oldest deadline 2024-05-08T06:08:47.948258+0000) 2024-05-08T06:09:00.970 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:00 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:00.511+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.649960+0000 front 2024-05-08T06:08:32.649891+0000 (oldest deadline 2024-05-08T06:08:56.750128+0000) 2024-05-08T06:09:01.063 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 08 06:09:00 smithi151 podman[72119]: 2024-05-08 06:09:00.76830835 +0000 UTC m=+6.026208148 container cleanup 8da8f250c612495860ce90c93cf9ee38566ebe95c295368179743b94f1888d38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-57676-3-bee299f, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-08T06:09:01.063 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 08 06:09:00 smithi151 bash[72119]: ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-5 2024-05-08T06:09:01.063 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:00 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:00.880+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:09:01.063 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:00 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:00.880+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:09:01.063 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:00 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:00.880+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.881680+0000 front 2024-05-08T06:08:32.881745+0000 (oldest deadline 2024-05-08T06:08:55.181825+0000) 2024-05-08T06:09:01.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:00 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:00.787+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:09:01.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:00 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:00.787+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:25.504732+0000 front 2024-05-08T06:08:25.504827+0000 (oldest deadline 2024-05-08T06:08:47.105412+0000) 2024-05-08T06:09:01.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:00 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:00.787+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.306974+0000 front 2024-05-08T06:08:32.306880+0000 (oldest deadline 2024-05-08T06:08:54.606868+0000) 2024-05-08T06:09:01.379 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 08 06:09:01 smithi151 podman[72138]: 2024-05-08 06:09:01.064019691 +0000 UTC m=+0.662941891 container remove 8da8f250c612495860ce90c93cf9ee38566ebe95c295368179743b94f1888d38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-57676-3-bee299f, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-05-08T06:09:01.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:01 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:01.064+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.621931+0000 front 2024-05-08T06:08:22.621835+0000 (oldest deadline 2024-05-08T06:08:48.521971+0000) 2024-05-08T06:09:01.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:01 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:01.064+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:30.822810+0000 front 2024-05-08T06:08:30.822787+0000 (oldest deadline 2024-05-08T06:08:55.523003+0000) 2024-05-08T06:09:01.470 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:09:01 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:09:01.000+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:14.102601+0000 front 2024-05-08T06:08:14.102288+0000 (oldest deadline 2024-05-08T06:08:38.201828+0000) 2024-05-08T06:09:01.470 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:09:01 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:09:01.000+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.604025+0000 front 2024-05-08T06:08:24.604141+0000 (oldest deadline 2024-05-08T06:08:46.304248+0000) 2024-05-08T06:09:01.470 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:09:01 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:09:01.000+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:31.507102+0000 front 2024-05-08T06:08:31.507556+0000 (oldest deadline 2024-05-08T06:08:54.407403+0000) 2024-05-08T06:09:01.715 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 08 06:09:01 smithi151 podman[72226]: 2024-05-08 06:09:01.327202371 +0000 UTC m=+0.017476305 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T06:09:01.715 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 08 06:09:01 smithi151 podman[72226]: 2024-05-08 06:09:01.446500937 +0000 UTC m=+0.136774864 container create 4e2547fa033bf38fb5bbfa03f246014e44e030fc50aee456ed5dea4e14c71fd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=wip-57676-3-bee299f, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD) 2024-05-08T06:09:01.750 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:01 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:09:01.336+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.440767+0000 front 2024-05-08T06:08:22.440836+0000 (oldest deadline 2024-05-08T06:08:47.741012+0000) 2024-05-08T06:09:01.750 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:01 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:09:01.336+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:30.542607+0000 front 2024-05-08T06:08:30.542626+0000 (oldest deadline 2024-05-08T06:08:56.442639+0000) 2024-05-08T06:09:01.970 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:01 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:01.533+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:12.046442+0000 front 2024-05-08T06:08:12.045573+0000 (oldest deadline 2024-05-08T06:08:37.945772+0000) 2024-05-08T06:09:01.970 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:01 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:01.533+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.648698+0000 front 2024-05-08T06:08:22.648127+0000 (oldest deadline 2024-05-08T06:08:47.948258+0000) 2024-05-08T06:09:01.970 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:01 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:01.533+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.649960+0000 front 2024-05-08T06:08:32.649891+0000 (oldest deadline 2024-05-08T06:08:56.750128+0000) 2024-05-08T06:09:02.012 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:01 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:01.868+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:09:02.012 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:01 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:01.868+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:09:02.012 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:01 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:01.868+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.881680+0000 front 2024-05-08T06:08:32.881745+0000 (oldest deadline 2024-05-08T06:08:55.181825+0000) 2024-05-08T06:09:02.012 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 08 06:09:01 smithi151 podman[72226]: 2024-05-08 06:09:01.716280541 +0000 UTC m=+0.406554462 container init 4e2547fa033bf38fb5bbfa03f246014e44e030fc50aee456ed5dea4e14c71fd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-57676-3-bee299f, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-08T06:09:02.013 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 08 06:09:01 smithi151 podman[72226]: 2024-05-08 06:09:01.719723864 +0000 UTC m=+0.409997786 container start 4e2547fa033bf38fb5bbfa03f246014e44e030fc50aee456ed5dea4e14c71fd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-57676-3-bee299f, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True) 2024-05-08T06:09:02.013 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 08 06:09:01 smithi151 podman[72226]: 2024-05-08 06:09:01.816769814 +0000 UTC m=+0.507043737 container attach 4e2547fa033bf38fb5bbfa03f246014e44e030fc50aee456ed5dea4e14c71fd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-57676-3-bee299f, GIT_CLEAN=True, org.label-schema.build-date=20240507) 2024-05-08T06:09:02.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:01 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:01.791+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:09:02.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:01 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:01.791+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:25.504732+0000 front 2024-05-08T06:08:25.504827+0000 (oldest deadline 2024-05-08T06:08:47.105412+0000) 2024-05-08T06:09:02.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:01 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:01.791+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.306974+0000 front 2024-05-08T06:08:32.306880+0000 (oldest deadline 2024-05-08T06:08:54.606868+0000) 2024-05-08T06:09:02.311 INFO:journalctl@ceph.osd.5.smithi151.stdout:May 08 06:09:02 smithi151 podman[72226]: 2024-05-08 06:09:02.013371323 +0000 UTC m=+0.703645247 container died 4e2547fa033bf38fb5bbfa03f246014e44e030fc50aee456ed5dea4e14c71fd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-57676-3-bee299f, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-05-08T06:09:02.312 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:02 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:02.043+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.621931+0000 front 2024-05-08T06:08:22.621835+0000 (oldest deadline 2024-05-08T06:08:48.521971+0000) 2024-05-08T06:09:02.312 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:02 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:02.043+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:30.822810+0000 front 2024-05-08T06:08:30.822787+0000 (oldest deadline 2024-05-08T06:08:55.523003+0000) 2024-05-08T06:09:02.470 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:09:02 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:09:02.025+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:14.102601+0000 front 2024-05-08T06:08:14.102288+0000 (oldest deadline 2024-05-08T06:08:38.201828+0000) 2024-05-08T06:09:02.470 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:09:02 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:09:02.025+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.604025+0000 front 2024-05-08T06:08:24.604141+0000 (oldest deadline 2024-05-08T06:08:46.304248+0000) 2024-05-08T06:09:02.471 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:09:02 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:09:02.025+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:31.507102+0000 front 2024-05-08T06:08:31.507556+0000 (oldest deadline 2024-05-08T06:08:54.407403+0000) 2024-05-08T06:09:02.589 DEBUG:teuthology.orchestra.run.smithi151:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@osd.5.service' 2024-05-08T06:09:02.626 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T06:09:02.626 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-05-08T06:09:02.626 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-05-08T06:09:02.626 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@osd.6 2024-05-08T06:09:02.749 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:02 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:09:02.384+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.440767+0000 front 2024-05-08T06:08:22.440836+0000 (oldest deadline 2024-05-08T06:08:47.741012+0000) 2024-05-08T06:09:02.750 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:02 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:09:02.384+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:30.542607+0000 front 2024-05-08T06:08:30.542626+0000 (oldest deadline 2024-05-08T06:08:56.442639+0000) 2024-05-08T06:09:02.970 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:09:02 smithi082 systemd[1]: Stopping Ceph osd.6 for c739a5c8-0cfc-11ef-bc97-c7b262605968... 2024-05-08T06:09:02.970 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:02 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:02.580+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:12.046442+0000 front 2024-05-08T06:08:12.045573+0000 (oldest deadline 2024-05-08T06:08:37.945772+0000) 2024-05-08T06:09:02.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:02 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:02.580+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.648698+0000 front 2024-05-08T06:08:22.648127+0000 (oldest deadline 2024-05-08T06:08:47.948258+0000) 2024-05-08T06:09:02.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:02 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:02.580+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.649960+0000 front 2024-05-08T06:08:32.649891+0000 (oldest deadline 2024-05-08T06:08:56.750128+0000) 2024-05-08T06:09:03.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:02 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:02.822+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:09:03.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:02 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:02.822+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:25.504732+0000 front 2024-05-08T06:08:25.504827+0000 (oldest deadline 2024-05-08T06:08:47.105412+0000) 2024-05-08T06:09:03.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:02 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:02.822+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.306974+0000 front 2024-05-08T06:08:32.306880+0000 (oldest deadline 2024-05-08T06:08:54.606868+0000) 2024-05-08T06:09:03.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:03 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:03.003+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.621931+0000 front 2024-05-08T06:08:22.621835+0000 (oldest deadline 2024-05-08T06:08:48.521971+0000) 2024-05-08T06:09:03.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:03 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:03.003+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:30.822810+0000 front 2024-05-08T06:08:30.822787+0000 (oldest deadline 2024-05-08T06:08:55.523003+0000) 2024-05-08T06:09:03.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:02 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:02.881+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:09:03.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:02 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:02.881+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:09:03.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:02 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:02.881+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.881680+0000 front 2024-05-08T06:08:32.881745+0000 (oldest deadline 2024-05-08T06:08:55.181825+0000) 2024-05-08T06:09:03.470 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:09:03 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:09:03.068+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:14.102601+0000 front 2024-05-08T06:08:14.102288+0000 (oldest deadline 2024-05-08T06:08:38.201828+0000) 2024-05-08T06:09:03.471 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:09:03 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:09:03.068+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.604025+0000 front 2024-05-08T06:08:24.604141+0000 (oldest deadline 2024-05-08T06:08:46.304248+0000) 2024-05-08T06:09:03.471 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:09:03 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:09:03.068+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:31.507102+0000 front 2024-05-08T06:08:31.507556+0000 (oldest deadline 2024-05-08T06:08:54.407403+0000) 2024-05-08T06:09:03.471 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:09:03 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:09:03.204+0000 7fe6a3600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T06:09:03.471 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:09:03 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:09:03.204+0000 7fe6a3600700 -1 osd.6 85 *** Got signal Terminated *** 2024-05-08T06:09:03.471 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:09:03 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:09:03.204+0000 7fe6a3600700 -1 osd.6 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T06:09:03.749 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:03 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:09:03.373+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.440767+0000 front 2024-05-08T06:08:22.440836+0000 (oldest deadline 2024-05-08T06:08:47.741012+0000) 2024-05-08T06:09:03.750 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:03 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:09:03.373+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:30.542607+0000 front 2024-05-08T06:08:30.542626+0000 (oldest deadline 2024-05-08T06:08:56.442639+0000) 2024-05-08T06:09:03.970 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:03 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:03.538+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:12.046442+0000 front 2024-05-08T06:08:12.045573+0000 (oldest deadline 2024-05-08T06:08:37.945772+0000) 2024-05-08T06:09:03.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:03 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:03.538+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.648698+0000 front 2024-05-08T06:08:22.648127+0000 (oldest deadline 2024-05-08T06:08:47.948258+0000) 2024-05-08T06:09:03.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:03 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:03.538+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.649960+0000 front 2024-05-08T06:08:32.649891+0000 (oldest deadline 2024-05-08T06:08:56.750128+0000) 2024-05-08T06:09:03.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:03 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:03.538+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:38.452261+0000 front 2024-05-08T06:08:38.452312+0000 (oldest deadline 2024-05-08T06:09:03.151745+0000) 2024-05-08T06:09:04.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:03 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:03.785+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:09:04.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:03 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:03.786+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:25.504732+0000 front 2024-05-08T06:08:25.504827+0000 (oldest deadline 2024-05-08T06:08:47.105412+0000) 2024-05-08T06:09:04.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:03 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:03.786+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.306974+0000 front 2024-05-08T06:08:32.306880+0000 (oldest deadline 2024-05-08T06:08:54.606868+0000) 2024-05-08T06:09:04.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:03 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:03.962+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.621931+0000 front 2024-05-08T06:08:22.621835+0000 (oldest deadline 2024-05-08T06:08:48.521971+0000) 2024-05-08T06:09:04.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:03 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:03.962+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:30.822810+0000 front 2024-05-08T06:08:30.822787+0000 (oldest deadline 2024-05-08T06:08:55.523003+0000) 2024-05-08T06:09:04.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:03 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:03.962+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:40.124458+0000 front 2024-05-08T06:08:40.124762+0000 (oldest deadline 2024-05-08T06:09:03.624373+0000) 2024-05-08T06:09:04.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:03 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:03.887+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:09:04.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:03 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:03.887+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:09:04.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:03 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:03.887+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.881680+0000 front 2024-05-08T06:08:32.881745+0000 (oldest deadline 2024-05-08T06:08:55.181825+0000) 2024-05-08T06:09:04.470 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:09:04 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:09:04.055+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:14.102601+0000 front 2024-05-08T06:08:14.102288+0000 (oldest deadline 2024-05-08T06:08:38.201828+0000) 2024-05-08T06:09:04.470 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:09:04 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:09:04.055+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.604025+0000 front 2024-05-08T06:08:24.604141+0000 (oldest deadline 2024-05-08T06:08:46.304248+0000) 2024-05-08T06:09:04.471 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:09:04 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:09:04.055+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:31.507102+0000 front 2024-05-08T06:08:31.507556+0000 (oldest deadline 2024-05-08T06:08:54.407403+0000) 2024-05-08T06:09:04.749 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:04 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:09:04.342+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.440767+0000 front 2024-05-08T06:08:22.440836+0000 (oldest deadline 2024-05-08T06:08:47.741012+0000) 2024-05-08T06:09:04.750 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:04 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:09:04.342+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:30.542607+0000 front 2024-05-08T06:08:30.542626+0000 (oldest deadline 2024-05-08T06:08:56.442639+0000) 2024-05-08T06:09:04.970 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:04 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:04.563+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:12.046442+0000 front 2024-05-08T06:08:12.045573+0000 (oldest deadline 2024-05-08T06:08:37.945772+0000) 2024-05-08T06:09:04.970 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:04 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:04.563+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.648698+0000 front 2024-05-08T06:08:22.648127+0000 (oldest deadline 2024-05-08T06:08:47.948258+0000) 2024-05-08T06:09:04.970 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:04 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:04.563+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.649960+0000 front 2024-05-08T06:08:32.649891+0000 (oldest deadline 2024-05-08T06:08:56.750128+0000) 2024-05-08T06:09:04.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:04 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:04.563+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:38.452261+0000 front 2024-05-08T06:08:38.452312+0000 (oldest deadline 2024-05-08T06:09:03.151745+0000) 2024-05-08T06:09:05.249 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:04 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:04.822+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:09:05.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:04 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:04.822+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:25.504732+0000 front 2024-05-08T06:08:25.504827+0000 (oldest deadline 2024-05-08T06:08:47.105412+0000) 2024-05-08T06:09:05.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:04 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:04.822+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.306974+0000 front 2024-05-08T06:08:32.306880+0000 (oldest deadline 2024-05-08T06:08:54.606868+0000) 2024-05-08T06:09:05.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:04 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:04.822+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:41.608791+0000 front 2024-05-08T06:08:41.608670+0000 (oldest deadline 2024-05-08T06:09:03.908449+0000) 2024-05-08T06:09:05.280 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:04 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:04.909+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:09:05.280 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:04 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:04.909+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:09:05.281 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:04 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:04.909+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.881680+0000 front 2024-05-08T06:08:32.881745+0000 (oldest deadline 2024-05-08T06:08:55.181825+0000) 2024-05-08T06:09:05.281 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:04 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:04.946+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.621931+0000 front 2024-05-08T06:08:22.621835+0000 (oldest deadline 2024-05-08T06:08:48.521971+0000) 2024-05-08T06:09:05.281 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:04 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:04.946+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:30.822810+0000 front 2024-05-08T06:08:30.822787+0000 (oldest deadline 2024-05-08T06:08:55.523003+0000) 2024-05-08T06:09:05.281 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:04 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:04.946+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:40.124458+0000 front 2024-05-08T06:08:40.124762+0000 (oldest deadline 2024-05-08T06:09:03.624373+0000) 2024-05-08T06:09:05.470 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:09:05 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:09:05.058+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:14.102601+0000 front 2024-05-08T06:08:14.102288+0000 (oldest deadline 2024-05-08T06:08:38.201828+0000) 2024-05-08T06:09:05.471 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:09:05 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:09:05.058+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.604025+0000 front 2024-05-08T06:08:24.604141+0000 (oldest deadline 2024-05-08T06:08:46.304248+0000) 2024-05-08T06:09:05.471 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:09:05 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:09:05.058+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:31.507102+0000 front 2024-05-08T06:08:31.507556+0000 (oldest deadline 2024-05-08T06:08:54.407403+0000) 2024-05-08T06:09:05.471 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:09:05 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:09:05.058+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:40.309306+0000 front 2024-05-08T06:08:40.309407+0000 (oldest deadline 2024-05-08T06:09:05.009477+0000) 2024-05-08T06:09:05.749 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:05 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:09:05.315+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.440767+0000 front 2024-05-08T06:08:22.440836+0000 (oldest deadline 2024-05-08T06:08:47.741012+0000) 2024-05-08T06:09:05.750 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:05 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:09:05.315+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:30.542607+0000 front 2024-05-08T06:08:30.542626+0000 (oldest deadline 2024-05-08T06:08:56.442639+0000) 2024-05-08T06:09:05.970 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:05 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:05.585+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:12.046442+0000 front 2024-05-08T06:08:12.045573+0000 (oldest deadline 2024-05-08T06:08:37.945772+0000) 2024-05-08T06:09:05.970 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:05 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:05.585+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.648698+0000 front 2024-05-08T06:08:22.648127+0000 (oldest deadline 2024-05-08T06:08:47.948258+0000) 2024-05-08T06:09:05.970 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:05 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:05.585+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.649960+0000 front 2024-05-08T06:08:32.649891+0000 (oldest deadline 2024-05-08T06:08:56.750128+0000) 2024-05-08T06:09:05.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:05 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:05.585+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:38.452261+0000 front 2024-05-08T06:08:38.452312+0000 (oldest deadline 2024-05-08T06:09:03.151745+0000) 2024-05-08T06:09:06.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:05 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:05.868+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:09:06.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:05 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:05.868+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:25.504732+0000 front 2024-05-08T06:08:25.504827+0000 (oldest deadline 2024-05-08T06:08:47.105412+0000) 2024-05-08T06:09:06.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:05 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:05.868+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.306974+0000 front 2024-05-08T06:08:32.306880+0000 (oldest deadline 2024-05-08T06:08:54.606868+0000) 2024-05-08T06:09:06.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:05 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:05.868+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:41.608791+0000 front 2024-05-08T06:08:41.608670+0000 (oldest deadline 2024-05-08T06:09:03.908449+0000) 2024-05-08T06:09:06.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:05 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:05.927+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.621931+0000 front 2024-05-08T06:08:22.621835+0000 (oldest deadline 2024-05-08T06:08:48.521971+0000) 2024-05-08T06:09:06.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:05 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:05.927+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:30.822810+0000 front 2024-05-08T06:08:30.822787+0000 (oldest deadline 2024-05-08T06:08:55.523003+0000) 2024-05-08T06:09:06.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:05 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:05.927+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:40.124458+0000 front 2024-05-08T06:08:40.124762+0000 (oldest deadline 2024-05-08T06:09:03.624373+0000) 2024-05-08T06:09:06.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:05 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:05.933+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:09:06.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:05 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:05.933+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:09:06.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:05 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:05.933+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.881680+0000 front 2024-05-08T06:08:32.881745+0000 (oldest deadline 2024-05-08T06:08:55.181825+0000) 2024-05-08T06:09:06.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:05 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:05.933+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:42.183264+0000 front 2024-05-08T06:08:42.183384+0000 (oldest deadline 2024-05-08T06:09:05.083013+0000) 2024-05-08T06:09:06.470 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:09:06 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:09:06.059+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:14.102601+0000 front 2024-05-08T06:08:14.102288+0000 (oldest deadline 2024-05-08T06:08:38.201828+0000) 2024-05-08T06:09:06.470 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:09:06 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:09:06.059+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.604025+0000 front 2024-05-08T06:08:24.604141+0000 (oldest deadline 2024-05-08T06:08:46.304248+0000) 2024-05-08T06:09:06.471 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:09:06 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:09:06.059+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:31.507102+0000 front 2024-05-08T06:08:31.507556+0000 (oldest deadline 2024-05-08T06:08:54.407403+0000) 2024-05-08T06:09:06.471 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:09:06 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:09:06.059+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:40.309306+0000 front 2024-05-08T06:08:40.309407+0000 (oldest deadline 2024-05-08T06:09:05.009477+0000) 2024-05-08T06:09:06.749 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:06 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:09:06.327+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.440767+0000 front 2024-05-08T06:08:22.440836+0000 (oldest deadline 2024-05-08T06:08:47.741012+0000) 2024-05-08T06:09:06.750 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:06 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:09:06.327+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:30.542607+0000 front 2024-05-08T06:08:30.542626+0000 (oldest deadline 2024-05-08T06:08:56.442639+0000) 2024-05-08T06:09:06.970 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:06 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:06.599+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:12.046442+0000 front 2024-05-08T06:08:12.045573+0000 (oldest deadline 2024-05-08T06:08:37.945772+0000) 2024-05-08T06:09:06.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:06 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:06.599+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.648698+0000 front 2024-05-08T06:08:22.648127+0000 (oldest deadline 2024-05-08T06:08:47.948258+0000) 2024-05-08T06:09:06.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:06 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:06.599+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.649960+0000 front 2024-05-08T06:08:32.649891+0000 (oldest deadline 2024-05-08T06:08:56.750128+0000) 2024-05-08T06:09:06.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:06 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:06.599+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:38.452261+0000 front 2024-05-08T06:08:38.452312+0000 (oldest deadline 2024-05-08T06:09:03.151745+0000) 2024-05-08T06:09:07.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:06 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:06.821+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:09:07.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:06 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:06.821+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:25.504732+0000 front 2024-05-08T06:08:25.504827+0000 (oldest deadline 2024-05-08T06:08:47.105412+0000) 2024-05-08T06:09:07.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:06 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:06.821+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.306974+0000 front 2024-05-08T06:08:32.306880+0000 (oldest deadline 2024-05-08T06:08:54.606868+0000) 2024-05-08T06:09:07.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:06 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:06.821+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:41.608791+0000 front 2024-05-08T06:08:41.608670+0000 (oldest deadline 2024-05-08T06:09:03.908449+0000) 2024-05-08T06:09:07.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:06 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:06.970+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.621931+0000 front 2024-05-08T06:08:22.621835+0000 (oldest deadline 2024-05-08T06:08:48.521971+0000) 2024-05-08T06:09:07.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:06 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:06.970+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:30.822810+0000 front 2024-05-08T06:08:30.822787+0000 (oldest deadline 2024-05-08T06:08:55.523003+0000) 2024-05-08T06:09:07.380 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:06 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:06.970+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:40.124458+0000 front 2024-05-08T06:08:40.124762+0000 (oldest deadline 2024-05-08T06:09:03.624373+0000) 2024-05-08T06:09:07.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:06 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:06.973+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:09:07.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:06 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:06.973+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:09:07.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:06 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:06.973+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.881680+0000 front 2024-05-08T06:08:32.881745+0000 (oldest deadline 2024-05-08T06:08:55.181825+0000) 2024-05-08T06:09:07.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:06 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:06.973+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:42.183264+0000 front 2024-05-08T06:08:42.183384+0000 (oldest deadline 2024-05-08T06:09:05.083013+0000) 2024-05-08T06:09:07.470 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:09:07 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:09:07.075+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:14.102601+0000 front 2024-05-08T06:08:14.102288+0000 (oldest deadline 2024-05-08T06:08:38.201828+0000) 2024-05-08T06:09:07.471 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:09:07 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:09:07.075+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.604025+0000 front 2024-05-08T06:08:24.604141+0000 (oldest deadline 2024-05-08T06:08:46.304248+0000) 2024-05-08T06:09:07.471 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:09:07 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:09:07.075+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:31.507102+0000 front 2024-05-08T06:08:31.507556+0000 (oldest deadline 2024-05-08T06:08:54.407403+0000) 2024-05-08T06:09:07.471 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:09:07 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:09:07.075+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:40.309306+0000 front 2024-05-08T06:08:40.309407+0000 (oldest deadline 2024-05-08T06:09:05.009477+0000) 2024-05-08T06:09:07.750 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:07 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:09:07.332+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.440767+0000 front 2024-05-08T06:08:22.440836+0000 (oldest deadline 2024-05-08T06:08:47.741012+0000) 2024-05-08T06:09:07.750 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:07 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:09:07.332+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:30.542607+0000 front 2024-05-08T06:08:30.542626+0000 (oldest deadline 2024-05-08T06:08:56.442639+0000) 2024-05-08T06:09:07.970 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:07 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:07.643+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:12.046442+0000 front 2024-05-08T06:08:12.045573+0000 (oldest deadline 2024-05-08T06:08:37.945772+0000) 2024-05-08T06:09:07.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:07 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:07.643+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.648698+0000 front 2024-05-08T06:08:22.648127+0000 (oldest deadline 2024-05-08T06:08:47.948258+0000) 2024-05-08T06:09:07.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:07 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:07.643+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.649960+0000 front 2024-05-08T06:08:32.649891+0000 (oldest deadline 2024-05-08T06:08:56.750128+0000) 2024-05-08T06:09:07.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:07 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:07.643+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:38.452261+0000 front 2024-05-08T06:08:38.452312+0000 (oldest deadline 2024-05-08T06:09:03.151745+0000) 2024-05-08T06:09:08.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:07 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:07.862+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:09:08.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:07 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:07.862+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:25.504732+0000 front 2024-05-08T06:08:25.504827+0000 (oldest deadline 2024-05-08T06:08:47.105412+0000) 2024-05-08T06:09:08.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:07 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:07.862+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.306974+0000 front 2024-05-08T06:08:32.306880+0000 (oldest deadline 2024-05-08T06:08:54.606868+0000) 2024-05-08T06:09:08.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:07 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:07.862+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:41.608791+0000 front 2024-05-08T06:08:41.608670+0000 (oldest deadline 2024-05-08T06:09:03.908449+0000) 2024-05-08T06:09:08.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:07 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:07.923+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.621931+0000 front 2024-05-08T06:08:22.621835+0000 (oldest deadline 2024-05-08T06:08:48.521971+0000) 2024-05-08T06:09:08.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:07 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:07.923+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:30.822810+0000 front 2024-05-08T06:08:30.822787+0000 (oldest deadline 2024-05-08T06:08:55.523003+0000) 2024-05-08T06:09:08.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:07 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:07.923+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:40.124458+0000 front 2024-05-08T06:08:40.124762+0000 (oldest deadline 2024-05-08T06:09:03.624373+0000) 2024-05-08T06:09:08.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:07 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:07.977+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:09:08.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:07 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:07.977+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:09:08.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:07 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:07.977+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.881680+0000 front 2024-05-08T06:08:32.881745+0000 (oldest deadline 2024-05-08T06:08:55.181825+0000) 2024-05-08T06:09:08.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:07 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:07.977+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:42.183264+0000 front 2024-05-08T06:08:42.183384+0000 (oldest deadline 2024-05-08T06:09:05.083013+0000) 2024-05-08T06:09:08.471 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:09:08 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:09:08.060+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:14.102601+0000 front 2024-05-08T06:08:14.102288+0000 (oldest deadline 2024-05-08T06:08:38.201828+0000) 2024-05-08T06:09:08.471 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:09:08 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:09:08.060+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.604025+0000 front 2024-05-08T06:08:24.604141+0000 (oldest deadline 2024-05-08T06:08:46.304248+0000) 2024-05-08T06:09:08.471 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:09:08 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:09:08.060+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:31.507102+0000 front 2024-05-08T06:08:31.507556+0000 (oldest deadline 2024-05-08T06:08:54.407403+0000) 2024-05-08T06:09:08.471 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:09:08 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6[55231]: 2024-05-08T06:09:08.060+0000 7fe699e00700 -1 osd.6 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:40.309306+0000 front 2024-05-08T06:08:40.309407+0000 (oldest deadline 2024-05-08T06:09:05.009477+0000) 2024-05-08T06:09:08.750 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:08 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:09:08.347+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.440767+0000 front 2024-05-08T06:08:22.440836+0000 (oldest deadline 2024-05-08T06:08:47.741012+0000) 2024-05-08T06:09:08.750 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:08 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:09:08.347+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:30.542607+0000 front 2024-05-08T06:08:30.542626+0000 (oldest deadline 2024-05-08T06:08:56.442639+0000) 2024-05-08T06:09:08.750 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:08 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:09:08.347+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:36.943858+0000 front 2024-05-08T06:08:36.943876+0000 (oldest deadline 2024-05-08T06:09:08.144310+0000) 2024-05-08T06:09:08.928 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:08 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:08.650+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:12.046442+0000 front 2024-05-08T06:08:12.045573+0000 (oldest deadline 2024-05-08T06:08:37.945772+0000) 2024-05-08T06:09:08.928 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:08 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:08.650+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.648698+0000 front 2024-05-08T06:08:22.648127+0000 (oldest deadline 2024-05-08T06:08:47.948258+0000) 2024-05-08T06:09:08.929 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:08 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:08.650+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.649960+0000 front 2024-05-08T06:08:32.649891+0000 (oldest deadline 2024-05-08T06:08:56.750128+0000) 2024-05-08T06:09:08.929 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:08 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:08.650+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:38.452261+0000 front 2024-05-08T06:08:38.452312+0000 (oldest deadline 2024-05-08T06:09:03.151745+0000) 2024-05-08T06:09:09.215 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:09:08 smithi082 podman[113003]: 2024-05-08 06:09:08.928829316 +0000 UTC m=+5.875344828 container died cbe65cc7a36c5202ebe854ee4c23f91e267a588d75297fdc85105f9f09b457e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-57676-3-bee299f, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-05-08T06:09:09.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:08 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:08.897+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:09:09.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:08 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:08.897+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:25.504732+0000 front 2024-05-08T06:08:25.504827+0000 (oldest deadline 2024-05-08T06:08:47.105412+0000) 2024-05-08T06:09:09.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:08 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:08.897+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.306974+0000 front 2024-05-08T06:08:32.306880+0000 (oldest deadline 2024-05-08T06:08:54.606868+0000) 2024-05-08T06:09:09.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:08 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:08.897+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:41.608791+0000 front 2024-05-08T06:08:41.608670+0000 (oldest deadline 2024-05-08T06:09:03.908449+0000) 2024-05-08T06:09:09.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:08 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:08.887+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.621931+0000 front 2024-05-08T06:08:22.621835+0000 (oldest deadline 2024-05-08T06:08:48.521971+0000) 2024-05-08T06:09:09.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:08 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:08.887+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:30.822810+0000 front 2024-05-08T06:08:30.822787+0000 (oldest deadline 2024-05-08T06:08:55.523003+0000) 2024-05-08T06:09:09.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:08 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:08.887+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:40.124458+0000 front 2024-05-08T06:08:40.124762+0000 (oldest deadline 2024-05-08T06:09:03.624373+0000) 2024-05-08T06:09:09.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:09 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:09.006+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:09:09.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:09 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:09.006+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:09:09.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:09 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:09.006+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.881680+0000 front 2024-05-08T06:08:32.881745+0000 (oldest deadline 2024-05-08T06:08:55.181825+0000) 2024-05-08T06:09:09.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:09 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:09.006+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:42.183264+0000 front 2024-05-08T06:08:42.183384+0000 (oldest deadline 2024-05-08T06:09:05.083013+0000) 2024-05-08T06:09:09.519 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:09 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:09:09.356+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.440767+0000 front 2024-05-08T06:08:22.440836+0000 (oldest deadline 2024-05-08T06:08:47.741012+0000) 2024-05-08T06:09:09.519 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:09 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:09:09.356+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:30.542607+0000 front 2024-05-08T06:08:30.542626+0000 (oldest deadline 2024-05-08T06:08:56.442639+0000) 2024-05-08T06:09:09.519 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:09 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:09:09.356+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:36.943858+0000 front 2024-05-08T06:08:36.943876+0000 (oldest deadline 2024-05-08T06:09:08.144310+0000) 2024-05-08T06:09:09.725 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:09:09 smithi082 podman[113003]: 2024-05-08 06:09:09.482609036 +0000 UTC m=+6.429124541 container cleanup cbe65cc7a36c5202ebe854ee4c23f91e267a588d75297fdc85105f9f09b457e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-57676-3-bee299f, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-08T06:09:09.726 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:09:09 smithi082 bash[113003]: ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6 2024-05-08T06:09:09.726 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:09 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:09.655+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:12.046442+0000 front 2024-05-08T06:08:12.045573+0000 (oldest deadline 2024-05-08T06:08:37.945772+0000) 2024-05-08T06:09:09.726 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:09 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:09.655+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.648698+0000 front 2024-05-08T06:08:22.648127+0000 (oldest deadline 2024-05-08T06:08:47.948258+0000) 2024-05-08T06:09:09.726 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:09 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:09.655+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.649960+0000 front 2024-05-08T06:08:32.649891+0000 (oldest deadline 2024-05-08T06:08:56.750128+0000) 2024-05-08T06:09:09.726 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:09 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:09.655+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:38.452261+0000 front 2024-05-08T06:08:38.452312+0000 (oldest deadline 2024-05-08T06:09:03.151745+0000) 2024-05-08T06:09:10.220 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:09:09 smithi082 podman[113021]: 2024-05-08 06:09:09.725606059 +0000 UTC m=+0.783823780 container remove cbe65cc7a36c5202ebe854ee4c23f91e267a588d75297fdc85105f9f09b457e6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, RELEASE=wip-57676-3-bee299f, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-05-08T06:09:10.249 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:09 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:09.943+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:09:10.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:09 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:09.943+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:25.504732+0000 front 2024-05-08T06:08:25.504827+0000 (oldest deadline 2024-05-08T06:08:47.105412+0000) 2024-05-08T06:09:10.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:09 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:09.943+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.306974+0000 front 2024-05-08T06:08:32.306880+0000 (oldest deadline 2024-05-08T06:08:54.606868+0000) 2024-05-08T06:09:10.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:09 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:09.943+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:41.608791+0000 front 2024-05-08T06:08:41.608670+0000 (oldest deadline 2024-05-08T06:09:03.908449+0000) 2024-05-08T06:09:10.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:09 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:09.933+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.621931+0000 front 2024-05-08T06:08:22.621835+0000 (oldest deadline 2024-05-08T06:08:48.521971+0000) 2024-05-08T06:09:10.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:09 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:09.933+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:30.822810+0000 front 2024-05-08T06:08:30.822787+0000 (oldest deadline 2024-05-08T06:08:55.523003+0000) 2024-05-08T06:09:10.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:09 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:09.933+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:40.124458+0000 front 2024-05-08T06:08:40.124762+0000 (oldest deadline 2024-05-08T06:09:03.624373+0000) 2024-05-08T06:09:10.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:10 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:10.029+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:09:10.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:10 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:10.029+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:09:10.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:10 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:10.029+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.881680+0000 front 2024-05-08T06:08:32.881745+0000 (oldest deadline 2024-05-08T06:08:55.181825+0000) 2024-05-08T06:09:10.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:10 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:10.029+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:42.183264+0000 front 2024-05-08T06:08:42.183384+0000 (oldest deadline 2024-05-08T06:09:05.083013+0000) 2024-05-08T06:09:10.713 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:09:10 smithi082 podman[113121]: 2024-05-08 06:09:10.331135653 +0000 UTC m=+0.034981188 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T06:09:10.713 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:09:10 smithi082 podman[113121]: 2024-05-08 06:09:10.426514346 +0000 UTC m=+0.130359916 container create e1af8743c6592f688bfbee86bd61380785b64133a8f8cbf444dd33ed7248c344 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6-deactivate, RELEASE=wip-57676-3-bee299f, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-05-08T06:09:10.713 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:09:10 smithi082 podman[113121]: 2024-05-08 06:09:10.712826231 +0000 UTC m=+0.416671845 container init e1af8743c6592f688bfbee86bd61380785b64133a8f8cbf444dd33ed7248c344 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-57676-3-bee299f, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-08T06:09:10.713 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:10 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:10.665+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:12.046442+0000 front 2024-05-08T06:08:12.045573+0000 (oldest deadline 2024-05-08T06:08:37.945772+0000) 2024-05-08T06:09:10.713 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:10 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:10.665+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.648698+0000 front 2024-05-08T06:08:22.648127+0000 (oldest deadline 2024-05-08T06:08:47.948258+0000) 2024-05-08T06:09:10.713 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:10 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:10.665+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.649960+0000 front 2024-05-08T06:08:32.649891+0000 (oldest deadline 2024-05-08T06:08:56.750128+0000) 2024-05-08T06:09:10.714 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:10 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:10.665+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:38.452261+0000 front 2024-05-08T06:08:38.452312+0000 (oldest deadline 2024-05-08T06:09:03.151745+0000) 2024-05-08T06:09:10.749 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:10 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:09:10.313+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.440767+0000 front 2024-05-08T06:08:22.440836+0000 (oldest deadline 2024-05-08T06:08:47.741012+0000) 2024-05-08T06:09:10.749 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:10 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:09:10.313+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:30.542607+0000 front 2024-05-08T06:08:30.542626+0000 (oldest deadline 2024-05-08T06:08:56.442639+0000) 2024-05-08T06:09:10.750 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:10 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:09:10.313+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:36.943858+0000 front 2024-05-08T06:08:36.943876+0000 (oldest deadline 2024-05-08T06:09:08.144310+0000) 2024-05-08T06:09:10.970 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:09:10 smithi082 podman[113121]: 2024-05-08 06:09:10.723231469 +0000 UTC m=+0.427077008 container start e1af8743c6592f688bfbee86bd61380785b64133a8f8cbf444dd33ed7248c344 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-57676-3-bee299f, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-05-08T06:09:10.970 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:09:10 smithi082 podman[113121]: 2024-05-08 06:09:10.828937858 +0000 UTC m=+0.532783434 container attach e1af8743c6592f688bfbee86bd61380785b64133a8f8cbf444dd33ed7248c344 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6-deactivate, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-57676-3-bee299f, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-08T06:09:11.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:10 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:10.986+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:09:11.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:10 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:10.986+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:25.504732+0000 front 2024-05-08T06:08:25.504827+0000 (oldest deadline 2024-05-08T06:08:47.105412+0000) 2024-05-08T06:09:11.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:10 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:10.986+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.306974+0000 front 2024-05-08T06:08:32.306880+0000 (oldest deadline 2024-05-08T06:08:54.606868+0000) 2024-05-08T06:09:11.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:10 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:10.986+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:41.608791+0000 front 2024-05-08T06:08:41.608670+0000 (oldest deadline 2024-05-08T06:09:03.908449+0000) 2024-05-08T06:09:11.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:10 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:10.908+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.621931+0000 front 2024-05-08T06:08:22.621835+0000 (oldest deadline 2024-05-08T06:08:48.521971+0000) 2024-05-08T06:09:11.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:10 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:10.908+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:30.822810+0000 front 2024-05-08T06:08:30.822787+0000 (oldest deadline 2024-05-08T06:08:55.523003+0000) 2024-05-08T06:09:11.380 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:10 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:10.908+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:40.124458+0000 front 2024-05-08T06:08:40.124762+0000 (oldest deadline 2024-05-08T06:09:03.624373+0000) 2024-05-08T06:09:11.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:11 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:11.036+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:09:11.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:11 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:11.036+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:09:11.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:11 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:11.036+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.881680+0000 front 2024-05-08T06:08:32.881745+0000 (oldest deadline 2024-05-08T06:08:55.181825+0000) 2024-05-08T06:09:11.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:11 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:11.036+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:42.183264+0000 front 2024-05-08T06:08:42.183384+0000 (oldest deadline 2024-05-08T06:09:05.083013+0000) 2024-05-08T06:09:11.471 INFO:journalctl@ceph.osd.6.smithi082.stdout:May 08 06:09:11 smithi082 podman[113121]: 2024-05-08 06:09:11.153842584 +0000 UTC m=+0.857688117 container died e1af8743c6592f688bfbee86bd61380785b64133a8f8cbf444dd33ed7248c344 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, RELEASE=wip-57676-3-bee299f, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-08T06:09:11.750 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:11 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:09:11.264+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.440767+0000 front 2024-05-08T06:08:22.440836+0000 (oldest deadline 2024-05-08T06:08:47.741012+0000) 2024-05-08T06:09:11.750 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:11 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:09:11.264+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:30.542607+0000 front 2024-05-08T06:08:30.542626+0000 (oldest deadline 2024-05-08T06:08:56.442639+0000) 2024-05-08T06:09:11.750 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:11 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:09:11.264+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:36.943858+0000 front 2024-05-08T06:08:36.943876+0000 (oldest deadline 2024-05-08T06:09:08.144310+0000) 2024-05-08T06:09:11.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:11 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:11.620+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:12.046442+0000 front 2024-05-08T06:08:12.045573+0000 (oldest deadline 2024-05-08T06:08:37.945772+0000) 2024-05-08T06:09:11.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:11 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:11.620+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.648698+0000 front 2024-05-08T06:08:22.648127+0000 (oldest deadline 2024-05-08T06:08:47.948258+0000) 2024-05-08T06:09:11.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:11 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:11.620+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.649960+0000 front 2024-05-08T06:08:32.649891+0000 (oldest deadline 2024-05-08T06:08:56.750128+0000) 2024-05-08T06:09:11.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:11 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:11.620+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:38.452261+0000 front 2024-05-08T06:08:38.452312+0000 (oldest deadline 2024-05-08T06:09:03.151745+0000) 2024-05-08T06:09:12.004 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@osd.6.service' 2024-05-08T06:09:12.115 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T06:09:12.115 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-05-08T06:09:12.115 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-05-08T06:09:12.115 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@osd.7 2024-05-08T06:09:12.250 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:12 smithi134 systemd[1]: Stopping Ceph osd.7 for c739a5c8-0cfc-11ef-bc97-c7b262605968... 2024-05-08T06:09:12.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:11 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:11.979+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:09:12.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:11 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:11.979+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:25.504732+0000 front 2024-05-08T06:08:25.504827+0000 (oldest deadline 2024-05-08T06:08:47.105412+0000) 2024-05-08T06:09:12.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:11 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:11.979+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.306974+0000 front 2024-05-08T06:08:32.306880+0000 (oldest deadline 2024-05-08T06:08:54.606868+0000) 2024-05-08T06:09:12.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:11 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:11.979+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:41.608791+0000 front 2024-05-08T06:08:41.608670+0000 (oldest deadline 2024-05-08T06:09:03.908449+0000) 2024-05-08T06:09:12.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:11 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:11.941+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.621931+0000 front 2024-05-08T06:08:22.621835+0000 (oldest deadline 2024-05-08T06:08:48.521971+0000) 2024-05-08T06:09:12.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:11 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:11.941+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:30.822810+0000 front 2024-05-08T06:08:30.822787+0000 (oldest deadline 2024-05-08T06:08:55.523003+0000) 2024-05-08T06:09:12.380 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:11 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:11.941+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:40.124458+0000 front 2024-05-08T06:08:40.124762+0000 (oldest deadline 2024-05-08T06:09:03.624373+0000) 2024-05-08T06:09:12.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:12 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:12.049+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:09:12.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:12 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:12.049+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:09:12.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:12 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:12.049+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.881680+0000 front 2024-05-08T06:08:32.881745+0000 (oldest deadline 2024-05-08T06:08:55.181825+0000) 2024-05-08T06:09:12.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:12 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:12.049+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:42.183264+0000 front 2024-05-08T06:08:42.183384+0000 (oldest deadline 2024-05-08T06:09:05.083013+0000) 2024-05-08T06:09:12.750 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:12 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:09:12.279+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.440767+0000 front 2024-05-08T06:08:22.440836+0000 (oldest deadline 2024-05-08T06:08:47.741012+0000) 2024-05-08T06:09:12.750 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:12 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:09:12.279+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:30.542607+0000 front 2024-05-08T06:08:30.542626+0000 (oldest deadline 2024-05-08T06:08:56.442639+0000) 2024-05-08T06:09:12.750 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:12 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:09:12.279+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:36.943858+0000 front 2024-05-08T06:08:36.943876+0000 (oldest deadline 2024-05-08T06:09:08.144310+0000) 2024-05-08T06:09:12.750 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:12 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:09:12.442+0000 7f8ed7757700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T06:09:12.750 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:12 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:09:12.442+0000 7f8ed7757700 -1 osd.7 85 *** Got signal Terminated *** 2024-05-08T06:09:12.750 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:12 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:09:12.442+0000 7f8ed7757700 -1 osd.7 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T06:09:12.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:12 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:12.582+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:12.046442+0000 front 2024-05-08T06:08:12.045573+0000 (oldest deadline 2024-05-08T06:08:37.945772+0000) 2024-05-08T06:09:12.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:12 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:12.582+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.648698+0000 front 2024-05-08T06:08:22.648127+0000 (oldest deadline 2024-05-08T06:08:47.948258+0000) 2024-05-08T06:09:12.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:12 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:12.582+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.649960+0000 front 2024-05-08T06:08:32.649891+0000 (oldest deadline 2024-05-08T06:08:56.750128+0000) 2024-05-08T06:09:12.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:12 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:12.582+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:38.452261+0000 front 2024-05-08T06:08:38.452312+0000 (oldest deadline 2024-05-08T06:09:03.151745+0000) 2024-05-08T06:09:13.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:12 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:12.973+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:09:13.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:12 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:12.973+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:25.504732+0000 front 2024-05-08T06:08:25.504827+0000 (oldest deadline 2024-05-08T06:08:47.105412+0000) 2024-05-08T06:09:13.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:12 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:12.973+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.306974+0000 front 2024-05-08T06:08:32.306880+0000 (oldest deadline 2024-05-08T06:08:54.606868+0000) 2024-05-08T06:09:13.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:12 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:12.973+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:41.608791+0000 front 2024-05-08T06:08:41.608670+0000 (oldest deadline 2024-05-08T06:09:03.908449+0000) 2024-05-08T06:09:13.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:12 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:12.973+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:50.309634+0000 front 2024-05-08T06:08:50.309683+0000 (oldest deadline 2024-05-08T06:09:12.609838+0000) 2024-05-08T06:09:13.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:12 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:12.932+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.621931+0000 front 2024-05-08T06:08:22.621835+0000 (oldest deadline 2024-05-08T06:08:48.521971+0000) 2024-05-08T06:09:13.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:12 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:12.932+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:30.822810+0000 front 2024-05-08T06:08:30.822787+0000 (oldest deadline 2024-05-08T06:08:55.523003+0000) 2024-05-08T06:09:13.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:12 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:12.932+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:40.124458+0000 front 2024-05-08T06:08:40.124762+0000 (oldest deadline 2024-05-08T06:09:03.624373+0000) 2024-05-08T06:09:13.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:13 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:13.034+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:09:13.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:13 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:13.034+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:09:13.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:13 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:13.034+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.881680+0000 front 2024-05-08T06:08:32.881745+0000 (oldest deadline 2024-05-08T06:08:55.181825+0000) 2024-05-08T06:09:13.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:13 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:13.034+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:42.183264+0000 front 2024-05-08T06:08:42.183384+0000 (oldest deadline 2024-05-08T06:09:05.083013+0000) 2024-05-08T06:09:13.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:13 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:13.034+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:51.484646+0000 front 2024-05-08T06:08:51.484760+0000 (oldest deadline 2024-05-08T06:09:12.584523+0000) 2024-05-08T06:09:13.751 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:13 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:09:13.318+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.440767+0000 front 2024-05-08T06:08:22.440836+0000 (oldest deadline 2024-05-08T06:08:47.741012+0000) 2024-05-08T06:09:13.751 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:13 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:09:13.318+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:30.542607+0000 front 2024-05-08T06:08:30.542626+0000 (oldest deadline 2024-05-08T06:08:56.442639+0000) 2024-05-08T06:09:13.751 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:13 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:09:13.318+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:36.943858+0000 front 2024-05-08T06:08:36.943876+0000 (oldest deadline 2024-05-08T06:09:08.144310+0000) 2024-05-08T06:09:13.970 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:13 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:13.536+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:12.046442+0000 front 2024-05-08T06:08:12.045573+0000 (oldest deadline 2024-05-08T06:08:37.945772+0000) 2024-05-08T06:09:13.970 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:13 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:13.536+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.648698+0000 front 2024-05-08T06:08:22.648127+0000 (oldest deadline 2024-05-08T06:08:47.948258+0000) 2024-05-08T06:09:13.970 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:13 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:13.536+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.649960+0000 front 2024-05-08T06:08:32.649891+0000 (oldest deadline 2024-05-08T06:08:56.750128+0000) 2024-05-08T06:09:13.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:13 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:13.536+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:38.452261+0000 front 2024-05-08T06:08:38.452312+0000 (oldest deadline 2024-05-08T06:09:03.151745+0000) 2024-05-08T06:09:14.335 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:14 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:14.012+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:09:14.335 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:14 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:14.012+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:25.504732+0000 front 2024-05-08T06:08:25.504827+0000 (oldest deadline 2024-05-08T06:08:47.105412+0000) 2024-05-08T06:09:14.335 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:14 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:14.012+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.306974+0000 front 2024-05-08T06:08:32.306880+0000 (oldest deadline 2024-05-08T06:08:54.606868+0000) 2024-05-08T06:09:14.335 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:14 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:14.012+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:41.608791+0000 front 2024-05-08T06:08:41.608670+0000 (oldest deadline 2024-05-08T06:09:03.908449+0000) 2024-05-08T06:09:14.335 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:14 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:14.012+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:50.309634+0000 front 2024-05-08T06:08:50.309683+0000 (oldest deadline 2024-05-08T06:09:12.609838+0000) 2024-05-08T06:09:14.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:13 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:13.909+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.621931+0000 front 2024-05-08T06:08:22.621835+0000 (oldest deadline 2024-05-08T06:08:48.521971+0000) 2024-05-08T06:09:14.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:13 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:13.909+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:30.822810+0000 front 2024-05-08T06:08:30.822787+0000 (oldest deadline 2024-05-08T06:08:55.523003+0000) 2024-05-08T06:09:14.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:13 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:13.909+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:40.124458+0000 front 2024-05-08T06:08:40.124762+0000 (oldest deadline 2024-05-08T06:09:03.624373+0000) 2024-05-08T06:09:14.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:13 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:13.909+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:51.726766+0000 front 2024-05-08T06:08:51.726822+0000 (oldest deadline 2024-05-08T06:09:13.426855+0000) 2024-05-08T06:09:14.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:14 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:14.053+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:09:14.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:14 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:14.053+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:09:14.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:14 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:14.053+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.881680+0000 front 2024-05-08T06:08:32.881745+0000 (oldest deadline 2024-05-08T06:08:55.181825+0000) 2024-05-08T06:09:14.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:14 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:14.053+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:42.183264+0000 front 2024-05-08T06:08:42.183384+0000 (oldest deadline 2024-05-08T06:09:05.083013+0000) 2024-05-08T06:09:14.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:14 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:14.053+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:51.484646+0000 front 2024-05-08T06:08:51.484760+0000 (oldest deadline 2024-05-08T06:09:12.584523+0000) 2024-05-08T06:09:14.750 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:14 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:09:14.335+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.440767+0000 front 2024-05-08T06:08:22.440836+0000 (oldest deadline 2024-05-08T06:08:47.741012+0000) 2024-05-08T06:09:14.750 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:14 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:09:14.335+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:30.542607+0000 front 2024-05-08T06:08:30.542626+0000 (oldest deadline 2024-05-08T06:08:56.442639+0000) 2024-05-08T06:09:14.750 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:14 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:09:14.335+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:36.943858+0000 front 2024-05-08T06:08:36.943876+0000 (oldest deadline 2024-05-08T06:09:08.144310+0000) 2024-05-08T06:09:14.750 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:14 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:09:14.335+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:49.845207+0000 front 2024-05-08T06:08:49.845239+0000 (oldest deadline 2024-05-08T06:09:13.345427+0000) 2024-05-08T06:09:14.970 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:14 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:14.505+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:12.046442+0000 front 2024-05-08T06:08:12.045573+0000 (oldest deadline 2024-05-08T06:08:37.945772+0000) 2024-05-08T06:09:14.970 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:14 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:14.505+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.648698+0000 front 2024-05-08T06:08:22.648127+0000 (oldest deadline 2024-05-08T06:08:47.948258+0000) 2024-05-08T06:09:14.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:14 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:14.505+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.649960+0000 front 2024-05-08T06:08:32.649891+0000 (oldest deadline 2024-05-08T06:08:56.750128+0000) 2024-05-08T06:09:14.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:14 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:14.505+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:38.452261+0000 front 2024-05-08T06:08:38.452312+0000 (oldest deadline 2024-05-08T06:09:03.151745+0000) 2024-05-08T06:09:15.293 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:15 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:15.026+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:09:15.293 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:15 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:15.026+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:25.504732+0000 front 2024-05-08T06:08:25.504827+0000 (oldest deadline 2024-05-08T06:08:47.105412+0000) 2024-05-08T06:09:15.293 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:15 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:15.026+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.306974+0000 front 2024-05-08T06:08:32.306880+0000 (oldest deadline 2024-05-08T06:08:54.606868+0000) 2024-05-08T06:09:15.293 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:15 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:15.026+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:41.608791+0000 front 2024-05-08T06:08:41.608670+0000 (oldest deadline 2024-05-08T06:09:03.908449+0000) 2024-05-08T06:09:15.293 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:15 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:15.026+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:50.309634+0000 front 2024-05-08T06:08:50.309683+0000 (oldest deadline 2024-05-08T06:09:12.609838+0000) 2024-05-08T06:09:15.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:14 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:14.925+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.621931+0000 front 2024-05-08T06:08:22.621835+0000 (oldest deadline 2024-05-08T06:08:48.521971+0000) 2024-05-08T06:09:15.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:14 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:14.925+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:30.822810+0000 front 2024-05-08T06:08:30.822787+0000 (oldest deadline 2024-05-08T06:08:55.523003+0000) 2024-05-08T06:09:15.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:14 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:14.925+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:40.124458+0000 front 2024-05-08T06:08:40.124762+0000 (oldest deadline 2024-05-08T06:09:03.624373+0000) 2024-05-08T06:09:15.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:14 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:14.925+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:51.726766+0000 front 2024-05-08T06:08:51.726822+0000 (oldest deadline 2024-05-08T06:09:13.426855+0000) 2024-05-08T06:09:15.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:15 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:15.087+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:09:15.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:15 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:15.087+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:09:15.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:15 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:15.087+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.881680+0000 front 2024-05-08T06:08:32.881745+0000 (oldest deadline 2024-05-08T06:08:55.181825+0000) 2024-05-08T06:09:15.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:15 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:15.087+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:42.183264+0000 front 2024-05-08T06:08:42.183384+0000 (oldest deadline 2024-05-08T06:09:05.083013+0000) 2024-05-08T06:09:15.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:15 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:15.087+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:51.484646+0000 front 2024-05-08T06:08:51.484760+0000 (oldest deadline 2024-05-08T06:09:12.584523+0000) 2024-05-08T06:09:15.750 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:15 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:09:15.293+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.440767+0000 front 2024-05-08T06:08:22.440836+0000 (oldest deadline 2024-05-08T06:08:47.741012+0000) 2024-05-08T06:09:15.750 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:15 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:09:15.293+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:30.542607+0000 front 2024-05-08T06:08:30.542626+0000 (oldest deadline 2024-05-08T06:08:56.442639+0000) 2024-05-08T06:09:15.750 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:15 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:09:15.293+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:36.943858+0000 front 2024-05-08T06:08:36.943876+0000 (oldest deadline 2024-05-08T06:09:08.144310+0000) 2024-05-08T06:09:15.750 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:15 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:09:15.293+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:49.845207+0000 front 2024-05-08T06:08:49.845239+0000 (oldest deadline 2024-05-08T06:09:13.345427+0000) 2024-05-08T06:09:15.970 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:15 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:15.513+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:12.046442+0000 front 2024-05-08T06:08:12.045573+0000 (oldest deadline 2024-05-08T06:08:37.945772+0000) 2024-05-08T06:09:15.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:15 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:15.513+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.648698+0000 front 2024-05-08T06:08:22.648127+0000 (oldest deadline 2024-05-08T06:08:47.948258+0000) 2024-05-08T06:09:15.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:15 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:15.513+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.649960+0000 front 2024-05-08T06:08:32.649891+0000 (oldest deadline 2024-05-08T06:08:56.750128+0000) 2024-05-08T06:09:15.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:15 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:15.513+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:38.452261+0000 front 2024-05-08T06:08:38.452312+0000 (oldest deadline 2024-05-08T06:09:03.151745+0000) 2024-05-08T06:09:15.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:15 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:15.513+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:50.456664+0000 front 2024-05-08T06:08:50.456817+0000 (oldest deadline 2024-05-08T06:09:14.556770+0000) 2024-05-08T06:09:16.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:15 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:15.993+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:09:16.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:15 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:15.993+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:25.504732+0000 front 2024-05-08T06:08:25.504827+0000 (oldest deadline 2024-05-08T06:08:47.105412+0000) 2024-05-08T06:09:16.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:15 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:15.993+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.306974+0000 front 2024-05-08T06:08:32.306880+0000 (oldest deadline 2024-05-08T06:08:54.606868+0000) 2024-05-08T06:09:16.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:15 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:15.993+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:41.608791+0000 front 2024-05-08T06:08:41.608670+0000 (oldest deadline 2024-05-08T06:09:03.908449+0000) 2024-05-08T06:09:16.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:15 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:15.993+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:50.309634+0000 front 2024-05-08T06:08:50.309683+0000 (oldest deadline 2024-05-08T06:09:12.609838+0000) 2024-05-08T06:09:16.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:15 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:15.897+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.621931+0000 front 2024-05-08T06:08:22.621835+0000 (oldest deadline 2024-05-08T06:08:48.521971+0000) 2024-05-08T06:09:16.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:15 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:15.897+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:30.822810+0000 front 2024-05-08T06:08:30.822787+0000 (oldest deadline 2024-05-08T06:08:55.523003+0000) 2024-05-08T06:09:16.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:15 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:15.897+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:40.124458+0000 front 2024-05-08T06:08:40.124762+0000 (oldest deadline 2024-05-08T06:09:03.624373+0000) 2024-05-08T06:09:16.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:15 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:15.897+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:51.726766+0000 front 2024-05-08T06:08:51.726822+0000 (oldest deadline 2024-05-08T06:09:13.426855+0000) 2024-05-08T06:09:16.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:16 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:16.107+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:09:16.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:16 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:16.107+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:09:16.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:16 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:16.107+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.881680+0000 front 2024-05-08T06:08:32.881745+0000 (oldest deadline 2024-05-08T06:08:55.181825+0000) 2024-05-08T06:09:16.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:16 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:16.107+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:42.183264+0000 front 2024-05-08T06:08:42.183384+0000 (oldest deadline 2024-05-08T06:09:05.083013+0000) 2024-05-08T06:09:16.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:16 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:16.107+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:51.484646+0000 front 2024-05-08T06:08:51.484760+0000 (oldest deadline 2024-05-08T06:09:12.584523+0000) 2024-05-08T06:09:16.750 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:16 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:09:16.261+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.440767+0000 front 2024-05-08T06:08:22.440836+0000 (oldest deadline 2024-05-08T06:08:47.741012+0000) 2024-05-08T06:09:16.750 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:16 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:09:16.261+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:30.542607+0000 front 2024-05-08T06:08:30.542626+0000 (oldest deadline 2024-05-08T06:08:56.442639+0000) 2024-05-08T06:09:16.750 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:16 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:09:16.261+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:36.943858+0000 front 2024-05-08T06:08:36.943876+0000 (oldest deadline 2024-05-08T06:09:08.144310+0000) 2024-05-08T06:09:16.750 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:16 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:09:16.261+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:49.845207+0000 front 2024-05-08T06:08:49.845239+0000 (oldest deadline 2024-05-08T06:09:13.345427+0000) 2024-05-08T06:09:16.970 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:16 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:16.509+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:12.046442+0000 front 2024-05-08T06:08:12.045573+0000 (oldest deadline 2024-05-08T06:08:37.945772+0000) 2024-05-08T06:09:16.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:16 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:16.509+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.648698+0000 front 2024-05-08T06:08:22.648127+0000 (oldest deadline 2024-05-08T06:08:47.948258+0000) 2024-05-08T06:09:16.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:16 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:16.509+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.649960+0000 front 2024-05-08T06:08:32.649891+0000 (oldest deadline 2024-05-08T06:08:56.750128+0000) 2024-05-08T06:09:16.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:16 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:16.509+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:38.452261+0000 front 2024-05-08T06:08:38.452312+0000 (oldest deadline 2024-05-08T06:09:03.151745+0000) 2024-05-08T06:09:16.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:16 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:16.509+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:50.456664+0000 front 2024-05-08T06:08:50.456817+0000 (oldest deadline 2024-05-08T06:09:14.556770+0000) 2024-05-08T06:09:17.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:16 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:16.932+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.621931+0000 front 2024-05-08T06:08:22.621835+0000 (oldest deadline 2024-05-08T06:08:48.521971+0000) 2024-05-08T06:09:17.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:16 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:16.932+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:30.822810+0000 front 2024-05-08T06:08:30.822787+0000 (oldest deadline 2024-05-08T06:08:55.523003+0000) 2024-05-08T06:09:17.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:16 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:16.932+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:40.124458+0000 front 2024-05-08T06:08:40.124762+0000 (oldest deadline 2024-05-08T06:09:03.624373+0000) 2024-05-08T06:09:17.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:16 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:16.932+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:51.726766+0000 front 2024-05-08T06:08:51.726822+0000 (oldest deadline 2024-05-08T06:09:13.426855+0000) 2024-05-08T06:09:17.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:17 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:17.098+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:09:17.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:17 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:17.098+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:09:17.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:17 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:17.098+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.881680+0000 front 2024-05-08T06:08:32.881745+0000 (oldest deadline 2024-05-08T06:08:55.181825+0000) 2024-05-08T06:09:17.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:17 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:17.098+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:42.183264+0000 front 2024-05-08T06:08:42.183384+0000 (oldest deadline 2024-05-08T06:09:05.083013+0000) 2024-05-08T06:09:17.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:17 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:17.098+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:51.484646+0000 front 2024-05-08T06:08:51.484760+0000 (oldest deadline 2024-05-08T06:09:12.584523+0000) 2024-05-08T06:09:17.500 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:17 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:09:17.218+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.440767+0000 front 2024-05-08T06:08:22.440836+0000 (oldest deadline 2024-05-08T06:08:47.741012+0000) 2024-05-08T06:09:17.500 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:17 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:09:17.218+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:30.542607+0000 front 2024-05-08T06:08:30.542626+0000 (oldest deadline 2024-05-08T06:08:56.442639+0000) 2024-05-08T06:09:17.500 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:17 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:09:17.218+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:36.943858+0000 front 2024-05-08T06:08:36.943876+0000 (oldest deadline 2024-05-08T06:09:08.144310+0000) 2024-05-08T06:09:17.500 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:17 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7[52551]: 2024-05-08T06:09:17.218+0000 7f8ed3d4b700 -1 osd.7 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:49.845207+0000 front 2024-05-08T06:08:49.845239+0000 (oldest deadline 2024-05-08T06:09:13.345427+0000) 2024-05-08T06:09:17.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:17 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:17.035+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:09:17.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:17 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:17.035+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:25.504732+0000 front 2024-05-08T06:08:25.504827+0000 (oldest deadline 2024-05-08T06:08:47.105412+0000) 2024-05-08T06:09:17.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:17 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:17.035+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.306974+0000 front 2024-05-08T06:08:32.306880+0000 (oldest deadline 2024-05-08T06:08:54.606868+0000) 2024-05-08T06:09:17.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:17 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:17.035+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:41.608791+0000 front 2024-05-08T06:08:41.608670+0000 (oldest deadline 2024-05-08T06:09:03.908449+0000) 2024-05-08T06:09:17.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:17 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:17.035+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:50.309634+0000 front 2024-05-08T06:08:50.309683+0000 (oldest deadline 2024-05-08T06:09:12.609838+0000) 2024-05-08T06:09:17.970 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:17 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:17.535+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:12.046442+0000 front 2024-05-08T06:08:12.045573+0000 (oldest deadline 2024-05-08T06:08:37.945772+0000) 2024-05-08T06:09:17.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:17 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:17.535+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.648698+0000 front 2024-05-08T06:08:22.648127+0000 (oldest deadline 2024-05-08T06:08:47.948258+0000) 2024-05-08T06:09:17.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:17 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:17.535+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.649960+0000 front 2024-05-08T06:08:32.649891+0000 (oldest deadline 2024-05-08T06:08:56.750128+0000) 2024-05-08T06:09:17.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:17 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:17.535+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:38.452261+0000 front 2024-05-08T06:08:38.452312+0000 (oldest deadline 2024-05-08T06:09:03.151745+0000) 2024-05-08T06:09:17.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:17 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:17.535+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:50.456664+0000 front 2024-05-08T06:08:50.456817+0000 (oldest deadline 2024-05-08T06:09:14.556770+0000) 2024-05-08T06:09:18.209 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:17 smithi134 podman[71623]: 2024-05-08 06:09:17.889723746 +0000 UTC m=+5.580347855 container died 0bd859b196cfefb4f0c68e3660bfeafcd4a8cec2a4b443a8d74fdca392ffd619 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, RELEASE=wip-57676-3-bee299f, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-08T06:09:18.210 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:18 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:18.005+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:09:18.210 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:18 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:18.005+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:25.504732+0000 front 2024-05-08T06:08:25.504827+0000 (oldest deadline 2024-05-08T06:08:47.105412+0000) 2024-05-08T06:09:18.210 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:18 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:18.005+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.306974+0000 front 2024-05-08T06:08:32.306880+0000 (oldest deadline 2024-05-08T06:08:54.606868+0000) 2024-05-08T06:09:18.210 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:18 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:18.005+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:41.608791+0000 front 2024-05-08T06:08:41.608670+0000 (oldest deadline 2024-05-08T06:09:03.908449+0000) 2024-05-08T06:09:18.210 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:18 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:18.005+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:50.309634+0000 front 2024-05-08T06:08:50.309683+0000 (oldest deadline 2024-05-08T06:09:12.609838+0000) 2024-05-08T06:09:18.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:17 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:17.910+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.621931+0000 front 2024-05-08T06:08:22.621835+0000 (oldest deadline 2024-05-08T06:08:48.521971+0000) 2024-05-08T06:09:18.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:17 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:17.910+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:30.822810+0000 front 2024-05-08T06:08:30.822787+0000 (oldest deadline 2024-05-08T06:08:55.523003+0000) 2024-05-08T06:09:18.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:17 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:17.910+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:40.124458+0000 front 2024-05-08T06:08:40.124762+0000 (oldest deadline 2024-05-08T06:09:03.624373+0000) 2024-05-08T06:09:18.380 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:17 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:17.910+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:51.726766+0000 front 2024-05-08T06:08:51.726822+0000 (oldest deadline 2024-05-08T06:09:13.426855+0000) 2024-05-08T06:09:18.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:18 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:18.054+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:09:18.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:18 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:18.054+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:09:18.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:18 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:18.054+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.881680+0000 front 2024-05-08T06:08:32.881745+0000 (oldest deadline 2024-05-08T06:08:55.181825+0000) 2024-05-08T06:09:18.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:18 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:18.054+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:42.183264+0000 front 2024-05-08T06:08:42.183384+0000 (oldest deadline 2024-05-08T06:09:05.083013+0000) 2024-05-08T06:09:18.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:18 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:18.054+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:51.484646+0000 front 2024-05-08T06:08:51.484760+0000 (oldest deadline 2024-05-08T06:09:12.584523+0000) 2024-05-08T06:09:18.500 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:18 smithi134 podman[71623]: 2024-05-08 06:09:18.326768466 +0000 UTC m=+6.017392620 container cleanup 0bd859b196cfefb4f0c68e3660bfeafcd4a8cec2a4b443a8d74fdca392ffd619 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-57676-3-bee299f, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux ) 2024-05-08T06:09:18.500 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:18 smithi134 bash[71623]: ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7 2024-05-08T06:09:18.950 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:18 smithi134 podman[71642]: 2024-05-08 06:09:18.527888718 +0000 UTC m=+0.634116690 container remove 0bd859b196cfefb4f0c68e3660bfeafcd4a8cec2a4b443a8d74fdca392ffd619 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-05-08T06:09:19.116 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:18 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:18.525+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:12.046442+0000 front 2024-05-08T06:08:12.045573+0000 (oldest deadline 2024-05-08T06:08:37.945772+0000) 2024-05-08T06:09:19.116 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:18 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:18.525+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.648698+0000 front 2024-05-08T06:08:22.648127+0000 (oldest deadline 2024-05-08T06:08:47.948258+0000) 2024-05-08T06:09:19.116 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:18 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:18.525+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.649960+0000 front 2024-05-08T06:08:32.649891+0000 (oldest deadline 2024-05-08T06:08:56.750128+0000) 2024-05-08T06:09:19.116 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:18 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:18.525+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:38.452261+0000 front 2024-05-08T06:08:38.452312+0000 (oldest deadline 2024-05-08T06:09:03.151745+0000) 2024-05-08T06:09:19.116 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:18 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:18.525+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:50.456664+0000 front 2024-05-08T06:08:50.456817+0000 (oldest deadline 2024-05-08T06:09:14.556770+0000) 2024-05-08T06:09:19.231 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:18 smithi134 podman[71734]: 2024-05-08 06:09:18.853588203 +0000 UTC m=+0.018008620 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T06:09:19.231 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:18 smithi134 podman[71734]: 2024-05-08 06:09:18.978610059 +0000 UTC m=+0.143030472 container create d0942539f10cdf6858e71b57aeea968da25b87ab386569c64a2f85c97e0d21e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7-deactivate, ceph=True, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, RELEASE=wip-57676-3-bee299f, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-08T06:09:19.231 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:19 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:19.032+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:09:19.231 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:19 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:19.032+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:25.504732+0000 front 2024-05-08T06:08:25.504827+0000 (oldest deadline 2024-05-08T06:08:47.105412+0000) 2024-05-08T06:09:19.231 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:19 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:19.032+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.306974+0000 front 2024-05-08T06:08:32.306880+0000 (oldest deadline 2024-05-08T06:08:54.606868+0000) 2024-05-08T06:09:19.231 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:19 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:19.032+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:41.608791+0000 front 2024-05-08T06:08:41.608670+0000 (oldest deadline 2024-05-08T06:09:03.908449+0000) 2024-05-08T06:09:19.232 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:19 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:19.032+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:50.309634+0000 front 2024-05-08T06:08:50.309683+0000 (oldest deadline 2024-05-08T06:09:12.609838+0000) 2024-05-08T06:09:19.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:18 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:18.957+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.621931+0000 front 2024-05-08T06:08:22.621835+0000 (oldest deadline 2024-05-08T06:08:48.521971+0000) 2024-05-08T06:09:19.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:18 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:18.957+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:30.822810+0000 front 2024-05-08T06:08:30.822787+0000 (oldest deadline 2024-05-08T06:08:55.523003+0000) 2024-05-08T06:09:19.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:18 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:18.957+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:40.124458+0000 front 2024-05-08T06:08:40.124762+0000 (oldest deadline 2024-05-08T06:09:03.624373+0000) 2024-05-08T06:09:19.380 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:18 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:18.957+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:51.726766+0000 front 2024-05-08T06:08:51.726822+0000 (oldest deadline 2024-05-08T06:09:13.426855+0000) 2024-05-08T06:09:19.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:19 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:19.040+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:09:19.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:19 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:19.040+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:09:19.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:19 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:19.040+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.881680+0000 front 2024-05-08T06:08:32.881745+0000 (oldest deadline 2024-05-08T06:08:55.181825+0000) 2024-05-08T06:09:19.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:19 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:19.040+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:42.183264+0000 front 2024-05-08T06:08:42.183384+0000 (oldest deadline 2024-05-08T06:09:05.083013+0000) 2024-05-08T06:09:19.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:19 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:19.040+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:51.484646+0000 front 2024-05-08T06:08:51.484760+0000 (oldest deadline 2024-05-08T06:09:12.584523+0000) 2024-05-08T06:09:19.500 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:19 smithi134 podman[71734]: 2024-05-08 06:09:19.231603252 +0000 UTC m=+0.396023665 container init d0942539f10cdf6858e71b57aeea968da25b87ab386569c64a2f85c97e0d21e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7-deactivate, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-57676-3-bee299f, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-05-08T06:09:19.500 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:19 smithi134 podman[71734]: 2024-05-08 06:09:19.234931987 +0000 UTC m=+0.399352401 container start d0942539f10cdf6858e71b57aeea968da25b87ab386569c64a2f85c97e0d21e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7-deactivate, RELEASE=wip-57676-3-bee299f, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-05-08T06:09:19.500 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:19 smithi134 podman[71734]: 2024-05-08 06:09:19.34001278 +0000 UTC m=+0.504433218 container attach d0942539f10cdf6858e71b57aeea968da25b87ab386569c64a2f85c97e0d21e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7-deactivate, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, RELEASE=wip-57676-3-bee299f, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-05-08T06:09:19.892 INFO:journalctl@ceph.osd.7.smithi134.stdout:May 08 06:09:19 smithi134 podman[71734]: 2024-05-08 06:09:19.52828983 +0000 UTC m=+0.692710250 container died d0942539f10cdf6858e71b57aeea968da25b87ab386569c64a2f85c97e0d21e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-57676-3-bee299f, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507) 2024-05-08T06:09:19.970 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:19 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:19.514+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:12.046442+0000 front 2024-05-08T06:08:12.045573+0000 (oldest deadline 2024-05-08T06:08:37.945772+0000) 2024-05-08T06:09:19.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:19 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:19.514+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.648698+0000 front 2024-05-08T06:08:22.648127+0000 (oldest deadline 2024-05-08T06:08:47.948258+0000) 2024-05-08T06:09:19.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:19 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:19.514+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.649960+0000 front 2024-05-08T06:08:32.649891+0000 (oldest deadline 2024-05-08T06:08:56.750128+0000) 2024-05-08T06:09:19.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:19 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:19.514+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:38.452261+0000 front 2024-05-08T06:08:38.452312+0000 (oldest deadline 2024-05-08T06:09:03.151745+0000) 2024-05-08T06:09:19.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:19 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:19.514+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:50.456664+0000 front 2024-05-08T06:08:50.456817+0000 (oldest deadline 2024-05-08T06:09:14.556770+0000) 2024-05-08T06:09:20.201 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:19 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:19.993+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:09:20.201 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:19 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:19.993+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:25.504732+0000 front 2024-05-08T06:08:25.504827+0000 (oldest deadline 2024-05-08T06:08:47.105412+0000) 2024-05-08T06:09:20.201 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:19 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:19.993+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.306974+0000 front 2024-05-08T06:08:32.306880+0000 (oldest deadline 2024-05-08T06:08:54.606868+0000) 2024-05-08T06:09:20.201 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:19 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:19.993+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:41.608791+0000 front 2024-05-08T06:08:41.608670+0000 (oldest deadline 2024-05-08T06:09:03.908449+0000) 2024-05-08T06:09:20.201 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:19 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:19.993+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:50.309634+0000 front 2024-05-08T06:08:50.309683+0000 (oldest deadline 2024-05-08T06:09:12.609838+0000) 2024-05-08T06:09:20.223 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@osd.7.service' 2024-05-08T06:09:20.264 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T06:09:20.264 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-05-08T06:09:20.264 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-05-08T06:09:20.264 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@osd.8 2024-05-08T06:09:20.292 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:19 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:19.932+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.621931+0000 front 2024-05-08T06:08:22.621835+0000 (oldest deadline 2024-05-08T06:08:48.521971+0000) 2024-05-08T06:09:20.293 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:19 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:19.932+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:30.822810+0000 front 2024-05-08T06:08:30.822787+0000 (oldest deadline 2024-05-08T06:08:55.523003+0000) 2024-05-08T06:09:20.293 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:19 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:19.932+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:40.124458+0000 front 2024-05-08T06:08:40.124762+0000 (oldest deadline 2024-05-08T06:09:03.624373+0000) 2024-05-08T06:09:20.293 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:19 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:19.932+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:51.726766+0000 front 2024-05-08T06:08:51.726822+0000 (oldest deadline 2024-05-08T06:09:13.426855+0000) 2024-05-08T06:09:20.293 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:20 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:20.052+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:09:20.293 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:20 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:20.052+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:09:20.293 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:20 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:20.052+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.881680+0000 front 2024-05-08T06:08:32.881745+0000 (oldest deadline 2024-05-08T06:08:55.181825+0000) 2024-05-08T06:09:20.293 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:20 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:20.052+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:42.183264+0000 front 2024-05-08T06:08:42.183384+0000 (oldest deadline 2024-05-08T06:09:05.083013+0000) 2024-05-08T06:09:20.293 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:20 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:20.052+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:51.484646+0000 front 2024-05-08T06:08:51.484760+0000 (oldest deadline 2024-05-08T06:09:12.584523+0000) 2024-05-08T06:09:20.592 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:20 smithi151 systemd[1]: Stopping Ceph osd.8 for c739a5c8-0cfc-11ef-bc97-c7b262605968... 2024-05-08T06:09:20.720 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:20 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:20.515+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:12.046442+0000 front 2024-05-08T06:08:12.045573+0000 (oldest deadline 2024-05-08T06:08:37.945772+0000) 2024-05-08T06:09:20.721 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:20 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:20.515+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.648698+0000 front 2024-05-08T06:08:22.648127+0000 (oldest deadline 2024-05-08T06:08:47.948258+0000) 2024-05-08T06:09:20.721 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:20 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:20.515+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.649960+0000 front 2024-05-08T06:08:32.649891+0000 (oldest deadline 2024-05-08T06:08:56.750128+0000) 2024-05-08T06:09:20.721 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:20 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:20.515+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:38.452261+0000 front 2024-05-08T06:08:38.452312+0000 (oldest deadline 2024-05-08T06:09:03.151745+0000) 2024-05-08T06:09:20.721 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:20 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:20.515+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:50.456664+0000 front 2024-05-08T06:08:50.456817+0000 (oldest deadline 2024-05-08T06:09:14.556770+0000) 2024-05-08T06:09:20.879 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:20 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:20.590+0000 7f42b7dc4700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T06:09:20.879 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:20 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:20.590+0000 7f42b7dc4700 -1 osd.8 85 *** Got signal Terminated *** 2024-05-08T06:09:20.879 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:20 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:20.590+0000 7f42b7dc4700 -1 osd.8 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T06:09:21.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:21 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:21.005+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:09:21.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:21 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:21.005+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:25.504732+0000 front 2024-05-08T06:08:25.504827+0000 (oldest deadline 2024-05-08T06:08:47.105412+0000) 2024-05-08T06:09:21.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:21 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:21.005+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.306974+0000 front 2024-05-08T06:08:32.306880+0000 (oldest deadline 2024-05-08T06:08:54.606868+0000) 2024-05-08T06:09:21.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:21 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:21.005+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:41.608791+0000 front 2024-05-08T06:08:41.608670+0000 (oldest deadline 2024-05-08T06:09:03.908449+0000) 2024-05-08T06:09:21.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:21 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:21.005+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:50.309634+0000 front 2024-05-08T06:08:50.309683+0000 (oldest deadline 2024-05-08T06:09:12.609838+0000) 2024-05-08T06:09:21.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:21 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:21.005+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:59.611140+0000 front 2024-05-08T06:08:59.611228+0000 (oldest deadline 2024-05-08T06:09:20.710999+0000) 2024-05-08T06:09:21.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:20 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:20.901+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.621931+0000 front 2024-05-08T06:08:22.621835+0000 (oldest deadline 2024-05-08T06:08:48.521971+0000) 2024-05-08T06:09:21.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:20 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:20.901+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:30.822810+0000 front 2024-05-08T06:08:30.822787+0000 (oldest deadline 2024-05-08T06:08:55.523003+0000) 2024-05-08T06:09:21.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:20 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:20.901+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:40.124458+0000 front 2024-05-08T06:08:40.124762+0000 (oldest deadline 2024-05-08T06:09:03.624373+0000) 2024-05-08T06:09:21.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:20 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:20.901+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:51.726766+0000 front 2024-05-08T06:08:51.726822+0000 (oldest deadline 2024-05-08T06:09:13.426855+0000) 2024-05-08T06:09:21.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:21 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:21.020+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:09:21.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:21 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:21.020+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:09:21.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:21 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:21.020+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.881680+0000 front 2024-05-08T06:08:32.881745+0000 (oldest deadline 2024-05-08T06:08:55.181825+0000) 2024-05-08T06:09:21.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:21 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:21.020+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:42.183264+0000 front 2024-05-08T06:08:42.183384+0000 (oldest deadline 2024-05-08T06:09:05.083013+0000) 2024-05-08T06:09:21.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:21 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:21.020+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:51.484646+0000 front 2024-05-08T06:08:51.484760+0000 (oldest deadline 2024-05-08T06:09:12.584523+0000) 2024-05-08T06:09:21.970 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:21 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:21.532+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:12.046442+0000 front 2024-05-08T06:08:12.045573+0000 (oldest deadline 2024-05-08T06:08:37.945772+0000) 2024-05-08T06:09:21.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:21 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:21.532+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.648698+0000 front 2024-05-08T06:08:22.648127+0000 (oldest deadline 2024-05-08T06:08:47.948258+0000) 2024-05-08T06:09:21.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:21 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:21.532+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.649960+0000 front 2024-05-08T06:08:32.649891+0000 (oldest deadline 2024-05-08T06:08:56.750128+0000) 2024-05-08T06:09:21.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:21 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:21.532+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:38.452261+0000 front 2024-05-08T06:08:38.452312+0000 (oldest deadline 2024-05-08T06:09:03.151745+0000) 2024-05-08T06:09:21.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:21 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:21.532+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:50.456664+0000 front 2024-05-08T06:08:50.456817+0000 (oldest deadline 2024-05-08T06:09:14.556770+0000) 2024-05-08T06:09:22.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:21 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:21.981+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:09:22.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:21 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:21.981+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:25.504732+0000 front 2024-05-08T06:08:25.504827+0000 (oldest deadline 2024-05-08T06:08:47.105412+0000) 2024-05-08T06:09:22.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:21 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:21.981+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.306974+0000 front 2024-05-08T06:08:32.306880+0000 (oldest deadline 2024-05-08T06:08:54.606868+0000) 2024-05-08T06:09:22.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:21 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:21.981+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:41.608791+0000 front 2024-05-08T06:08:41.608670+0000 (oldest deadline 2024-05-08T06:09:03.908449+0000) 2024-05-08T06:09:22.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:21 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:21.981+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:50.309634+0000 front 2024-05-08T06:08:50.309683+0000 (oldest deadline 2024-05-08T06:09:12.609838+0000) 2024-05-08T06:09:22.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:21 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:21.981+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:59.611140+0000 front 2024-05-08T06:08:59.611228+0000 (oldest deadline 2024-05-08T06:09:20.710999+0000) 2024-05-08T06:09:22.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:21 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:21.882+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.621931+0000 front 2024-05-08T06:08:22.621835+0000 (oldest deadline 2024-05-08T06:08:48.521971+0000) 2024-05-08T06:09:22.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:21 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:21.882+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:30.822810+0000 front 2024-05-08T06:08:30.822787+0000 (oldest deadline 2024-05-08T06:08:55.523003+0000) 2024-05-08T06:09:22.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:21 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:21.882+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:40.124458+0000 front 2024-05-08T06:08:40.124762+0000 (oldest deadline 2024-05-08T06:09:03.624373+0000) 2024-05-08T06:09:22.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:21 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:21.882+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:51.726766+0000 front 2024-05-08T06:08:51.726822+0000 (oldest deadline 2024-05-08T06:09:13.426855+0000) 2024-05-08T06:09:22.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:21 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:21.995+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:09:22.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:21 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:21.995+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:09:22.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:21 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:21.995+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.881680+0000 front 2024-05-08T06:08:32.881745+0000 (oldest deadline 2024-05-08T06:08:55.181825+0000) 2024-05-08T06:09:22.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:21 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:21.995+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:42.183264+0000 front 2024-05-08T06:08:42.183384+0000 (oldest deadline 2024-05-08T06:09:05.083013+0000) 2024-05-08T06:09:22.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:21 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:21.995+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:51.484646+0000 front 2024-05-08T06:08:51.484760+0000 (oldest deadline 2024-05-08T06:09:12.584523+0000) 2024-05-08T06:09:22.970 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:22 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:22.523+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:12.046442+0000 front 2024-05-08T06:08:12.045573+0000 (oldest deadline 2024-05-08T06:08:37.945772+0000) 2024-05-08T06:09:22.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:22 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:22.523+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.648698+0000 front 2024-05-08T06:08:22.648127+0000 (oldest deadline 2024-05-08T06:08:47.948258+0000) 2024-05-08T06:09:22.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:22 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:22.523+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.649960+0000 front 2024-05-08T06:08:32.649891+0000 (oldest deadline 2024-05-08T06:08:56.750128+0000) 2024-05-08T06:09:22.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:22 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:22.523+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:38.452261+0000 front 2024-05-08T06:08:38.452312+0000 (oldest deadline 2024-05-08T06:09:03.151745+0000) 2024-05-08T06:09:22.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:22 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:22.523+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:50.456664+0000 front 2024-05-08T06:08:50.456817+0000 (oldest deadline 2024-05-08T06:09:14.556770+0000) 2024-05-08T06:09:22.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:22 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:22.523+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:59.258620+0000 front 2024-05-08T06:08:59.258561+0000 (oldest deadline 2024-05-08T06:09:22.158565+0000) 2024-05-08T06:09:23.129 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:22 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:22.846+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.621931+0000 front 2024-05-08T06:08:22.621835+0000 (oldest deadline 2024-05-08T06:08:48.521971+0000) 2024-05-08T06:09:23.129 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:22 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:22.846+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:30.822810+0000 front 2024-05-08T06:08:30.822787+0000 (oldest deadline 2024-05-08T06:08:55.523003+0000) 2024-05-08T06:09:23.129 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:22 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:22.846+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:40.124458+0000 front 2024-05-08T06:08:40.124762+0000 (oldest deadline 2024-05-08T06:09:03.624373+0000) 2024-05-08T06:09:23.129 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:22 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:22.846+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:51.726766+0000 front 2024-05-08T06:08:51.726822+0000 (oldest deadline 2024-05-08T06:09:13.426855+0000) 2024-05-08T06:09:23.129 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:22 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:22.977+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:09:23.129 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:22 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:22.977+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:09:23.130 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:22 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:22.977+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.881680+0000 front 2024-05-08T06:08:32.881745+0000 (oldest deadline 2024-05-08T06:08:55.181825+0000) 2024-05-08T06:09:23.130 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:22 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:22.977+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:42.183264+0000 front 2024-05-08T06:08:42.183384+0000 (oldest deadline 2024-05-08T06:09:05.083013+0000) 2024-05-08T06:09:23.130 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:22 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:22.977+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:51.484646+0000 front 2024-05-08T06:08:51.484760+0000 (oldest deadline 2024-05-08T06:09:12.584523+0000) 2024-05-08T06:09:23.249 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:22 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:22.972+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:09:23.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:22 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:22.972+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:25.504732+0000 front 2024-05-08T06:08:25.504827+0000 (oldest deadline 2024-05-08T06:08:47.105412+0000) 2024-05-08T06:09:23.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:22 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:22.972+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.306974+0000 front 2024-05-08T06:08:32.306880+0000 (oldest deadline 2024-05-08T06:08:54.606868+0000) 2024-05-08T06:09:23.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:22 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:22.972+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:41.608791+0000 front 2024-05-08T06:08:41.608670+0000 (oldest deadline 2024-05-08T06:09:03.908449+0000) 2024-05-08T06:09:23.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:22 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:22.972+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:50.309634+0000 front 2024-05-08T06:08:50.309683+0000 (oldest deadline 2024-05-08T06:09:12.609838+0000) 2024-05-08T06:09:23.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:22 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:22.972+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:59.611140+0000 front 2024-05-08T06:08:59.611228+0000 (oldest deadline 2024-05-08T06:09:20.710999+0000) 2024-05-08T06:09:23.970 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:23 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:23.551+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:12.046442+0000 front 2024-05-08T06:08:12.045573+0000 (oldest deadline 2024-05-08T06:08:37.945772+0000) 2024-05-08T06:09:23.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:23 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:23.551+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.648698+0000 front 2024-05-08T06:08:22.648127+0000 (oldest deadline 2024-05-08T06:08:47.948258+0000) 2024-05-08T06:09:23.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:23 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:23.551+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.649960+0000 front 2024-05-08T06:08:32.649891+0000 (oldest deadline 2024-05-08T06:08:56.750128+0000) 2024-05-08T06:09:23.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:23 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:23.551+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:38.452261+0000 front 2024-05-08T06:08:38.452312+0000 (oldest deadline 2024-05-08T06:09:03.151745+0000) 2024-05-08T06:09:23.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:23 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:23.551+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:50.456664+0000 front 2024-05-08T06:08:50.456817+0000 (oldest deadline 2024-05-08T06:09:14.556770+0000) 2024-05-08T06:09:23.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:23 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:23.551+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:59.258620+0000 front 2024-05-08T06:08:59.258561+0000 (oldest deadline 2024-05-08T06:09:22.158565+0000) 2024-05-08T06:09:24.129 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:23 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:23.807+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.621931+0000 front 2024-05-08T06:08:22.621835+0000 (oldest deadline 2024-05-08T06:08:48.521971+0000) 2024-05-08T06:09:24.129 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:23 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:23.807+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:30.822810+0000 front 2024-05-08T06:08:30.822787+0000 (oldest deadline 2024-05-08T06:08:55.523003+0000) 2024-05-08T06:09:24.129 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:23 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:23.807+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:40.124458+0000 front 2024-05-08T06:08:40.124762+0000 (oldest deadline 2024-05-08T06:09:03.624373+0000) 2024-05-08T06:09:24.129 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:23 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:23.807+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:51.726766+0000 front 2024-05-08T06:08:51.726822+0000 (oldest deadline 2024-05-08T06:09:13.426855+0000) 2024-05-08T06:09:24.130 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:24 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:24.005+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:09:24.130 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:24 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:24.005+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:09:24.130 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:24 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:24.005+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.881680+0000 front 2024-05-08T06:08:32.881745+0000 (oldest deadline 2024-05-08T06:08:55.181825+0000) 2024-05-08T06:09:24.130 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:24 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:24.005+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:42.183264+0000 front 2024-05-08T06:08:42.183384+0000 (oldest deadline 2024-05-08T06:09:05.083013+0000) 2024-05-08T06:09:24.130 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:24 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:24.005+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:51.484646+0000 front 2024-05-08T06:08:51.484760+0000 (oldest deadline 2024-05-08T06:09:12.584523+0000) 2024-05-08T06:09:24.130 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:24 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:24.005+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:58.385982+0000 front 2024-05-08T06:08:58.385882+0000 (oldest deadline 2024-05-08T06:09:23.686022+0000) 2024-05-08T06:09:24.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:24 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:24.005+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:09:24.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:24 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:24.005+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:25.504732+0000 front 2024-05-08T06:08:25.504827+0000 (oldest deadline 2024-05-08T06:08:47.105412+0000) 2024-05-08T06:09:24.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:24 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:24.005+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.306974+0000 front 2024-05-08T06:08:32.306880+0000 (oldest deadline 2024-05-08T06:08:54.606868+0000) 2024-05-08T06:09:24.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:24 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:24.005+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:41.608791+0000 front 2024-05-08T06:08:41.608670+0000 (oldest deadline 2024-05-08T06:09:03.908449+0000) 2024-05-08T06:09:24.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:24 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:24.005+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:50.309634+0000 front 2024-05-08T06:08:50.309683+0000 (oldest deadline 2024-05-08T06:09:12.609838+0000) 2024-05-08T06:09:24.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:24 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:24.005+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:59.611140+0000 front 2024-05-08T06:08:59.611228+0000 (oldest deadline 2024-05-08T06:09:20.710999+0000) 2024-05-08T06:09:24.970 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:24 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:24.536+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:12.046442+0000 front 2024-05-08T06:08:12.045573+0000 (oldest deadline 2024-05-08T06:08:37.945772+0000) 2024-05-08T06:09:24.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:24 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:24.536+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.648698+0000 front 2024-05-08T06:08:22.648127+0000 (oldest deadline 2024-05-08T06:08:47.948258+0000) 2024-05-08T06:09:24.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:24 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:24.536+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.649960+0000 front 2024-05-08T06:08:32.649891+0000 (oldest deadline 2024-05-08T06:08:56.750128+0000) 2024-05-08T06:09:24.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:24 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:24.536+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:38.452261+0000 front 2024-05-08T06:08:38.452312+0000 (oldest deadline 2024-05-08T06:09:03.151745+0000) 2024-05-08T06:09:24.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:24 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:24.536+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:50.456664+0000 front 2024-05-08T06:08:50.456817+0000 (oldest deadline 2024-05-08T06:09:14.556770+0000) 2024-05-08T06:09:24.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:24 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:24.536+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:59.258620+0000 front 2024-05-08T06:08:59.258561+0000 (oldest deadline 2024-05-08T06:09:22.158565+0000) 2024-05-08T06:09:25.025 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:24 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:24.770+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.621931+0000 front 2024-05-08T06:08:22.621835+0000 (oldest deadline 2024-05-08T06:08:48.521971+0000) 2024-05-08T06:09:25.025 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:24 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:24.770+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:30.822810+0000 front 2024-05-08T06:08:30.822787+0000 (oldest deadline 2024-05-08T06:08:55.523003+0000) 2024-05-08T06:09:25.025 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:24 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:24.770+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:40.124458+0000 front 2024-05-08T06:08:40.124762+0000 (oldest deadline 2024-05-08T06:09:03.624373+0000) 2024-05-08T06:09:25.025 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:24 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:24.770+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:51.726766+0000 front 2024-05-08T06:08:51.726822+0000 (oldest deadline 2024-05-08T06:09:13.426855+0000) 2024-05-08T06:09:25.025 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:24 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8[53569]: 2024-05-08T06:09:24.770+0000 7f42b43b8700 -1 osd.8 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:59.729006+0000 front 2024-05-08T06:08:59.728991+0000 (oldest deadline 2024-05-08T06:09:24.429090+0000) 2024-05-08T06:09:25.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:24 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:24.982+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:09:25.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:24 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:24.982+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:25.504732+0000 front 2024-05-08T06:08:25.504827+0000 (oldest deadline 2024-05-08T06:08:47.105412+0000) 2024-05-08T06:09:25.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:24 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:24.982+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.306974+0000 front 2024-05-08T06:08:32.306880+0000 (oldest deadline 2024-05-08T06:08:54.606868+0000) 2024-05-08T06:09:25.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:24 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:24.982+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:41.608791+0000 front 2024-05-08T06:08:41.608670+0000 (oldest deadline 2024-05-08T06:09:03.908449+0000) 2024-05-08T06:09:25.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:24 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:24.982+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:50.309634+0000 front 2024-05-08T06:08:50.309683+0000 (oldest deadline 2024-05-08T06:09:12.609838+0000) 2024-05-08T06:09:25.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:24 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:24.982+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:59.611140+0000 front 2024-05-08T06:08:59.611228+0000 (oldest deadline 2024-05-08T06:09:20.710999+0000) 2024-05-08T06:09:25.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:25 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:25.025+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:09:25.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:25 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:25.025+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:09:25.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:25 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:25.025+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.881680+0000 front 2024-05-08T06:08:32.881745+0000 (oldest deadline 2024-05-08T06:08:55.181825+0000) 2024-05-08T06:09:25.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:25 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:25.025+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:42.183264+0000 front 2024-05-08T06:08:42.183384+0000 (oldest deadline 2024-05-08T06:09:05.083013+0000) 2024-05-08T06:09:25.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:25 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:25.025+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:51.484646+0000 front 2024-05-08T06:08:51.484760+0000 (oldest deadline 2024-05-08T06:09:12.584523+0000) 2024-05-08T06:09:25.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:25 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:25.025+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:58.385982+0000 front 2024-05-08T06:08:58.385882+0000 (oldest deadline 2024-05-08T06:09:23.686022+0000) 2024-05-08T06:09:25.970 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:25 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:25.530+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:12.046442+0000 front 2024-05-08T06:08:12.045573+0000 (oldest deadline 2024-05-08T06:08:37.945772+0000) 2024-05-08T06:09:25.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:25 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:25.530+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.648698+0000 front 2024-05-08T06:08:22.648127+0000 (oldest deadline 2024-05-08T06:08:47.948258+0000) 2024-05-08T06:09:25.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:25 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:25.530+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.649960+0000 front 2024-05-08T06:08:32.649891+0000 (oldest deadline 2024-05-08T06:08:56.750128+0000) 2024-05-08T06:09:25.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:25 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:25.530+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:38.452261+0000 front 2024-05-08T06:08:38.452312+0000 (oldest deadline 2024-05-08T06:09:03.151745+0000) 2024-05-08T06:09:25.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:25 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:25.530+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:50.456664+0000 front 2024-05-08T06:08:50.456817+0000 (oldest deadline 2024-05-08T06:09:14.556770+0000) 2024-05-08T06:09:25.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:25 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:25.530+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:59.258620+0000 front 2024-05-08T06:08:59.258561+0000 (oldest deadline 2024-05-08T06:09:22.158565+0000) 2024-05-08T06:09:26.379 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:26 smithi151 podman[72344]: 2024-05-08 06:09:26.1405363 +0000 UTC m=+5.672012469 container died 69a0f62ec2ece8de693fdd871fbeb236645daa8152784cfad397407216bcf24f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-57676-3-bee299f, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-05-08T06:09:26.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:26 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:26.043+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:09:26.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:26 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:26.043+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:09:26.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:26 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:26.043+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.881680+0000 front 2024-05-08T06:08:32.881745+0000 (oldest deadline 2024-05-08T06:08:55.181825+0000) 2024-05-08T06:09:26.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:26 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:26.043+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:42.183264+0000 front 2024-05-08T06:08:42.183384+0000 (oldest deadline 2024-05-08T06:09:05.083013+0000) 2024-05-08T06:09:26.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:26 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:26.043+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:51.484646+0000 front 2024-05-08T06:08:51.484760+0000 (oldest deadline 2024-05-08T06:09:12.584523+0000) 2024-05-08T06:09:26.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:26 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:26.043+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:58.385982+0000 front 2024-05-08T06:08:58.385882+0000 (oldest deadline 2024-05-08T06:09:23.686022+0000) 2024-05-08T06:09:26.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:26 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:26.003+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:09:26.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:26 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:26.003+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:25.504732+0000 front 2024-05-08T06:08:25.504827+0000 (oldest deadline 2024-05-08T06:08:47.105412+0000) 2024-05-08T06:09:26.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:26 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:26.003+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.306974+0000 front 2024-05-08T06:08:32.306880+0000 (oldest deadline 2024-05-08T06:08:54.606868+0000) 2024-05-08T06:09:26.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:26 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:26.003+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:41.608791+0000 front 2024-05-08T06:08:41.608670+0000 (oldest deadline 2024-05-08T06:09:03.908449+0000) 2024-05-08T06:09:26.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:26 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:26.003+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:50.309634+0000 front 2024-05-08T06:08:50.309683+0000 (oldest deadline 2024-05-08T06:09:12.609838+0000) 2024-05-08T06:09:26.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:26 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:26.003+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:59.611140+0000 front 2024-05-08T06:08:59.611228+0000 (oldest deadline 2024-05-08T06:09:20.710999+0000) 2024-05-08T06:09:26.751 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:26 smithi151 podman[72344]: 2024-05-08 06:09:26.500634795 +0000 UTC m=+6.032110996 container cleanup 69a0f62ec2ece8de693fdd871fbeb236645daa8152784cfad397407216bcf24f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-57676-3-bee299f) 2024-05-08T06:09:26.751 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:26 smithi151 bash[72344]: ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8 2024-05-08T06:09:26.970 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:26 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:26.483+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:12.046442+0000 front 2024-05-08T06:08:12.045573+0000 (oldest deadline 2024-05-08T06:08:37.945772+0000) 2024-05-08T06:09:26.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:26 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:26.483+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.648698+0000 front 2024-05-08T06:08:22.648127+0000 (oldest deadline 2024-05-08T06:08:47.948258+0000) 2024-05-08T06:09:26.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:26 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:26.483+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.649960+0000 front 2024-05-08T06:08:32.649891+0000 (oldest deadline 2024-05-08T06:08:56.750128+0000) 2024-05-08T06:09:26.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:26 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:26.483+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:38.452261+0000 front 2024-05-08T06:08:38.452312+0000 (oldest deadline 2024-05-08T06:09:03.151745+0000) 2024-05-08T06:09:26.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:26 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:26.483+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:50.456664+0000 front 2024-05-08T06:08:50.456817+0000 (oldest deadline 2024-05-08T06:09:14.556770+0000) 2024-05-08T06:09:26.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:26 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:26.483+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:59.258620+0000 front 2024-05-08T06:08:59.258561+0000 (oldest deadline 2024-05-08T06:09:22.158565+0000) 2024-05-08T06:09:27.025 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:26 smithi151 podman[72364]: 2024-05-08 06:09:26.75198576 +0000 UTC m=+0.607128425 container remove 69a0f62ec2ece8de693fdd871fbeb236645daa8152784cfad397407216bcf24f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-57676-3-bee299f, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-05-08T06:09:27.330 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:27 smithi151 podman[72452]: 2024-05-08 06:09:27.061649089 +0000 UTC m=+0.109492368 container create 56e9edbdf26c921fa878183b71404ba3facd9055a69638534550d1f7ef8b8962 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , RELEASE=wip-57676-3-bee299f, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240507) 2024-05-08T06:09:27.331 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:27 smithi151 podman[72452]: 2024-05-08 06:09:26.970283265 +0000 UTC m=+0.018126541 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T06:09:27.331 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:27 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:27.025+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:09:27.331 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:27 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:27.025+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:09:27.331 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:27 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:27.025+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.881680+0000 front 2024-05-08T06:08:32.881745+0000 (oldest deadline 2024-05-08T06:08:55.181825+0000) 2024-05-08T06:09:27.331 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:27 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:27.025+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:42.183264+0000 front 2024-05-08T06:08:42.183384+0000 (oldest deadline 2024-05-08T06:09:05.083013+0000) 2024-05-08T06:09:27.331 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:27 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:27.025+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:51.484646+0000 front 2024-05-08T06:08:51.484760+0000 (oldest deadline 2024-05-08T06:09:12.584523+0000) 2024-05-08T06:09:27.331 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:27 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:27.025+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:58.385982+0000 front 2024-05-08T06:08:58.385882+0000 (oldest deadline 2024-05-08T06:09:23.686022+0000) 2024-05-08T06:09:27.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:27 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:27.034+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:09:27.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:27 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:27.034+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:25.504732+0000 front 2024-05-08T06:08:25.504827+0000 (oldest deadline 2024-05-08T06:08:47.105412+0000) 2024-05-08T06:09:27.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:27 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:27.034+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.306974+0000 front 2024-05-08T06:08:32.306880+0000 (oldest deadline 2024-05-08T06:08:54.606868+0000) 2024-05-08T06:09:27.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:27 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:27.034+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:41.608791+0000 front 2024-05-08T06:08:41.608670+0000 (oldest deadline 2024-05-08T06:09:03.908449+0000) 2024-05-08T06:09:27.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:27 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:27.034+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:50.309634+0000 front 2024-05-08T06:08:50.309683+0000 (oldest deadline 2024-05-08T06:09:12.609838+0000) 2024-05-08T06:09:27.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:27 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:27.034+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:59.611140+0000 front 2024-05-08T06:08:59.611228+0000 (oldest deadline 2024-05-08T06:09:20.710999+0000) 2024-05-08T06:09:27.625 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:27 smithi151 podman[72452]: 2024-05-08 06:09:27.331627442 +0000 UTC m=+0.379470718 container init 56e9edbdf26c921fa878183b71404ba3facd9055a69638534550d1f7ef8b8962 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, RELEASE=wip-57676-3-bee299f) 2024-05-08T06:09:27.625 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:27 smithi151 podman[72452]: 2024-05-08 06:09:27.334854627 +0000 UTC m=+0.382697908 container start 56e9edbdf26c921fa878183b71404ba3facd9055a69638534550d1f7ef8b8962 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-57676-3-bee299f, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux ) 2024-05-08T06:09:27.625 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:27 smithi151 podman[72452]: 2024-05-08 06:09:27.423340647 +0000 UTC m=+0.471183934 container attach 56e9edbdf26c921fa878183b71404ba3facd9055a69638534550d1f7ef8b8962 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-57676-3-bee299f, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-05-08T06:09:27.721 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:27 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:27.437+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:12.046442+0000 front 2024-05-08T06:08:12.045573+0000 (oldest deadline 2024-05-08T06:08:37.945772+0000) 2024-05-08T06:09:27.721 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:27 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:27.437+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.648698+0000 front 2024-05-08T06:08:22.648127+0000 (oldest deadline 2024-05-08T06:08:47.948258+0000) 2024-05-08T06:09:27.721 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:27 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:27.437+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.649960+0000 front 2024-05-08T06:08:32.649891+0000 (oldest deadline 2024-05-08T06:08:56.750128+0000) 2024-05-08T06:09:27.721 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:27 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:27.437+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:38.452261+0000 front 2024-05-08T06:08:38.452312+0000 (oldest deadline 2024-05-08T06:09:03.151745+0000) 2024-05-08T06:09:27.721 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:27 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:27.437+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:50.456664+0000 front 2024-05-08T06:08:50.456817+0000 (oldest deadline 2024-05-08T06:09:14.556770+0000) 2024-05-08T06:09:27.721 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:27 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:27.437+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:59.258620+0000 front 2024-05-08T06:08:59.258561+0000 (oldest deadline 2024-05-08T06:09:22.158565+0000) 2024-05-08T06:09:27.879 INFO:journalctl@ceph.osd.8.smithi151.stdout:May 08 06:09:27 smithi151 podman[72452]: 2024-05-08 06:09:27.625865233 +0000 UTC m=+0.673708502 container died 56e9edbdf26c921fa878183b71404ba3facd9055a69638534550d1f7ef8b8962 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , RELEASE=wip-57676-3-bee299f, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-05-08T06:09:28.161 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:28 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:28.046+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:09:28.161 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:28 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:28.046+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:09:28.162 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:28 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:28.046+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.881680+0000 front 2024-05-08T06:08:32.881745+0000 (oldest deadline 2024-05-08T06:08:55.181825+0000) 2024-05-08T06:09:28.162 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:28 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:28.046+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:42.183264+0000 front 2024-05-08T06:08:42.183384+0000 (oldest deadline 2024-05-08T06:09:05.083013+0000) 2024-05-08T06:09:28.162 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:28 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:28.046+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:51.484646+0000 front 2024-05-08T06:08:51.484760+0000 (oldest deadline 2024-05-08T06:09:12.584523+0000) 2024-05-08T06:09:28.162 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:28 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:28.046+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:58.385982+0000 front 2024-05-08T06:08:58.385882+0000 (oldest deadline 2024-05-08T06:09:23.686022+0000) 2024-05-08T06:09:28.185 DEBUG:teuthology.orchestra.run.smithi151:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@osd.8.service' 2024-05-08T06:09:28.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:27 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:27.994+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:09:28.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:27 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:27.994+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:25.504732+0000 front 2024-05-08T06:08:25.504827+0000 (oldest deadline 2024-05-08T06:08:47.105412+0000) 2024-05-08T06:09:28.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:27 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:27.994+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.306974+0000 front 2024-05-08T06:08:32.306880+0000 (oldest deadline 2024-05-08T06:08:54.606868+0000) 2024-05-08T06:09:28.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:27 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:27.994+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:41.608791+0000 front 2024-05-08T06:08:41.608670+0000 (oldest deadline 2024-05-08T06:09:03.908449+0000) 2024-05-08T06:09:28.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:27 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:27.994+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:50.309634+0000 front 2024-05-08T06:08:50.309683+0000 (oldest deadline 2024-05-08T06:09:12.609838+0000) 2024-05-08T06:09:28.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:27 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:27.994+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:59.611140+0000 front 2024-05-08T06:08:59.611228+0000 (oldest deadline 2024-05-08T06:09:20.710999+0000) 2024-05-08T06:09:28.264 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T06:09:28.265 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-05-08T06:09:28.265 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-05-08T06:09:28.265 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@osd.9 2024-05-08T06:09:28.721 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:28 smithi082 systemd[1]: Stopping Ceph osd.9 for c739a5c8-0cfc-11ef-bc97-c7b262605968... 2024-05-08T06:09:28.721 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:28 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:28.446+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:12.046442+0000 front 2024-05-08T06:08:12.045573+0000 (oldest deadline 2024-05-08T06:08:37.945772+0000) 2024-05-08T06:09:28.721 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:28 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:28.446+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.648698+0000 front 2024-05-08T06:08:22.648127+0000 (oldest deadline 2024-05-08T06:08:47.948258+0000) 2024-05-08T06:09:28.721 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:28 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:28.446+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.649960+0000 front 2024-05-08T06:08:32.649891+0000 (oldest deadline 2024-05-08T06:08:56.750128+0000) 2024-05-08T06:09:28.721 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:28 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:28.446+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:38.452261+0000 front 2024-05-08T06:08:38.452312+0000 (oldest deadline 2024-05-08T06:09:03.151745+0000) 2024-05-08T06:09:28.721 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:28 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:28.446+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:50.456664+0000 front 2024-05-08T06:08:50.456817+0000 (oldest deadline 2024-05-08T06:09:14.556770+0000) 2024-05-08T06:09:28.721 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:28 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:28.446+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:59.258620+0000 front 2024-05-08T06:08:59.258561+0000 (oldest deadline 2024-05-08T06:09:22.158565+0000) 2024-05-08T06:09:29.220 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:28 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:28.808+0000 7fee30000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T06:09:29.221 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:28 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:28.808+0000 7fee30000700 -1 osd.9 85 *** Got signal Terminated *** 2024-05-08T06:09:29.221 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:28 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:28.808+0000 7fee30000700 -1 osd.9 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T06:09:29.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:29 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:29.053+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:09:29.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:29 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:29.053+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:09:29.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:29 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:29.053+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.881680+0000 front 2024-05-08T06:08:32.881745+0000 (oldest deadline 2024-05-08T06:08:55.181825+0000) 2024-05-08T06:09:29.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:29 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:29.053+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:42.183264+0000 front 2024-05-08T06:08:42.183384+0000 (oldest deadline 2024-05-08T06:09:05.083013+0000) 2024-05-08T06:09:29.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:29 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:29.053+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:51.484646+0000 front 2024-05-08T06:08:51.484760+0000 (oldest deadline 2024-05-08T06:09:12.584523+0000) 2024-05-08T06:09:29.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:29 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:29.053+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:58.385982+0000 front 2024-05-08T06:08:58.385882+0000 (oldest deadline 2024-05-08T06:09:23.686022+0000) 2024-05-08T06:09:29.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:29 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:29.006+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:09:29.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:29 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:29.006+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:25.504732+0000 front 2024-05-08T06:08:25.504827+0000 (oldest deadline 2024-05-08T06:08:47.105412+0000) 2024-05-08T06:09:29.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:29 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:29.006+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.306974+0000 front 2024-05-08T06:08:32.306880+0000 (oldest deadline 2024-05-08T06:08:54.606868+0000) 2024-05-08T06:09:29.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:29 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:29.006+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:41.608791+0000 front 2024-05-08T06:08:41.608670+0000 (oldest deadline 2024-05-08T06:09:03.908449+0000) 2024-05-08T06:09:29.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:29 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:29.006+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:50.309634+0000 front 2024-05-08T06:08:50.309683+0000 (oldest deadline 2024-05-08T06:09:12.609838+0000) 2024-05-08T06:09:29.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:29 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:29.006+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:59.611140+0000 front 2024-05-08T06:08:59.611228+0000 (oldest deadline 2024-05-08T06:09:20.710999+0000) 2024-05-08T06:09:29.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:29 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:29.484+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:12.046442+0000 front 2024-05-08T06:08:12.045573+0000 (oldest deadline 2024-05-08T06:08:37.945772+0000) 2024-05-08T06:09:29.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:29 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:29.484+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.648698+0000 front 2024-05-08T06:08:22.648127+0000 (oldest deadline 2024-05-08T06:08:47.948258+0000) 2024-05-08T06:09:29.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:29 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:29.484+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.649960+0000 front 2024-05-08T06:08:32.649891+0000 (oldest deadline 2024-05-08T06:08:56.750128+0000) 2024-05-08T06:09:29.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:29 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:29.484+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:38.452261+0000 front 2024-05-08T06:08:38.452312+0000 (oldest deadline 2024-05-08T06:09:03.151745+0000) 2024-05-08T06:09:29.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:29 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:29.484+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:50.456664+0000 front 2024-05-08T06:08:50.456817+0000 (oldest deadline 2024-05-08T06:09:14.556770+0000) 2024-05-08T06:09:29.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:29 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:29.484+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:59.258620+0000 front 2024-05-08T06:08:59.258561+0000 (oldest deadline 2024-05-08T06:09:22.158565+0000) 2024-05-08T06:09:29.972 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:29 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:29.484+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-05-08T06:09:07.062945+0000 front 2024-05-08T06:09:07.063450+0000 (oldest deadline 2024-05-08T06:09:29.263619+0000) 2024-05-08T06:09:30.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:30 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:30.047+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:09:30.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:30 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:30.047+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:09:30.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:30 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:30.047+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.881680+0000 front 2024-05-08T06:08:32.881745+0000 (oldest deadline 2024-05-08T06:08:55.181825+0000) 2024-05-08T06:09:30.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:30 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:30.047+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:42.183264+0000 front 2024-05-08T06:08:42.183384+0000 (oldest deadline 2024-05-08T06:09:05.083013+0000) 2024-05-08T06:09:30.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:30 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:30.047+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:51.484646+0000 front 2024-05-08T06:08:51.484760+0000 (oldest deadline 2024-05-08T06:09:12.584523+0000) 2024-05-08T06:09:30.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:30 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:30.047+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:58.385982+0000 front 2024-05-08T06:08:58.385882+0000 (oldest deadline 2024-05-08T06:09:23.686022+0000) 2024-05-08T06:09:30.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:30 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:30.056+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:09:30.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:30 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:30.056+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:25.504732+0000 front 2024-05-08T06:08:25.504827+0000 (oldest deadline 2024-05-08T06:08:47.105412+0000) 2024-05-08T06:09:30.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:30 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:30.056+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.306974+0000 front 2024-05-08T06:08:32.306880+0000 (oldest deadline 2024-05-08T06:08:54.606868+0000) 2024-05-08T06:09:30.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:30 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:30.056+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:41.608791+0000 front 2024-05-08T06:08:41.608670+0000 (oldest deadline 2024-05-08T06:09:03.908449+0000) 2024-05-08T06:09:30.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:30 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:30.056+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:50.309634+0000 front 2024-05-08T06:08:50.309683+0000 (oldest deadline 2024-05-08T06:09:12.609838+0000) 2024-05-08T06:09:30.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:30 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:30.056+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:59.611140+0000 front 2024-05-08T06:08:59.611228+0000 (oldest deadline 2024-05-08T06:09:20.710999+0000) 2024-05-08T06:09:30.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:30 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:30.506+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:12.046442+0000 front 2024-05-08T06:08:12.045573+0000 (oldest deadline 2024-05-08T06:08:37.945772+0000) 2024-05-08T06:09:30.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:30 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:30.506+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.648698+0000 front 2024-05-08T06:08:22.648127+0000 (oldest deadline 2024-05-08T06:08:47.948258+0000) 2024-05-08T06:09:30.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:30 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:30.506+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.649960+0000 front 2024-05-08T06:08:32.649891+0000 (oldest deadline 2024-05-08T06:08:56.750128+0000) 2024-05-08T06:09:30.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:30 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:30.506+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:38.452261+0000 front 2024-05-08T06:08:38.452312+0000 (oldest deadline 2024-05-08T06:09:03.151745+0000) 2024-05-08T06:09:30.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:30 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:30.506+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:50.456664+0000 front 2024-05-08T06:08:50.456817+0000 (oldest deadline 2024-05-08T06:09:14.556770+0000) 2024-05-08T06:09:30.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:30 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:30.506+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:59.258620+0000 front 2024-05-08T06:08:59.258561+0000 (oldest deadline 2024-05-08T06:09:22.158565+0000) 2024-05-08T06:09:30.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:30 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:30.506+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-05-08T06:09:07.062945+0000 front 2024-05-08T06:09:07.063450+0000 (oldest deadline 2024-05-08T06:09:29.263619+0000) 2024-05-08T06:09:31.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:31 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:31.035+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:09:31.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:31 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:31.035+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:09:31.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:31 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:31.035+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.881680+0000 front 2024-05-08T06:08:32.881745+0000 (oldest deadline 2024-05-08T06:08:55.181825+0000) 2024-05-08T06:09:31.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:31 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:31.035+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:42.183264+0000 front 2024-05-08T06:08:42.183384+0000 (oldest deadline 2024-05-08T06:09:05.083013+0000) 2024-05-08T06:09:31.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:31 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:31.035+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:51.484646+0000 front 2024-05-08T06:08:51.484760+0000 (oldest deadline 2024-05-08T06:09:12.584523+0000) 2024-05-08T06:09:31.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:31 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:31.035+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:58.385982+0000 front 2024-05-08T06:08:58.385882+0000 (oldest deadline 2024-05-08T06:09:23.686022+0000) 2024-05-08T06:09:31.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:31 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:31.085+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:09:31.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:31 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:31.085+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:25.504732+0000 front 2024-05-08T06:08:25.504827+0000 (oldest deadline 2024-05-08T06:08:47.105412+0000) 2024-05-08T06:09:31.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:31 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:31.085+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.306974+0000 front 2024-05-08T06:08:32.306880+0000 (oldest deadline 2024-05-08T06:08:54.606868+0000) 2024-05-08T06:09:31.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:31 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:31.085+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:41.608791+0000 front 2024-05-08T06:08:41.608670+0000 (oldest deadline 2024-05-08T06:09:03.908449+0000) 2024-05-08T06:09:31.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:31 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:31.085+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:50.309634+0000 front 2024-05-08T06:08:50.309683+0000 (oldest deadline 2024-05-08T06:09:12.609838+0000) 2024-05-08T06:09:31.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:31 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:31.085+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:59.611140+0000 front 2024-05-08T06:08:59.611228+0000 (oldest deadline 2024-05-08T06:09:20.710999+0000) 2024-05-08T06:09:31.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:31 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:31.483+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:12.046442+0000 front 2024-05-08T06:08:12.045573+0000 (oldest deadline 2024-05-08T06:08:37.945772+0000) 2024-05-08T06:09:31.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:31 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:31.483+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.648698+0000 front 2024-05-08T06:08:22.648127+0000 (oldest deadline 2024-05-08T06:08:47.948258+0000) 2024-05-08T06:09:31.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:31 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:31.483+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.649960+0000 front 2024-05-08T06:08:32.649891+0000 (oldest deadline 2024-05-08T06:08:56.750128+0000) 2024-05-08T06:09:31.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:31 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:31.483+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:38.452261+0000 front 2024-05-08T06:08:38.452312+0000 (oldest deadline 2024-05-08T06:09:03.151745+0000) 2024-05-08T06:09:31.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:31 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:31.483+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:50.456664+0000 front 2024-05-08T06:08:50.456817+0000 (oldest deadline 2024-05-08T06:09:14.556770+0000) 2024-05-08T06:09:31.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:31 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:31.483+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:59.258620+0000 front 2024-05-08T06:08:59.258561+0000 (oldest deadline 2024-05-08T06:09:22.158565+0000) 2024-05-08T06:09:31.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:31 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:31.483+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-05-08T06:09:07.062945+0000 front 2024-05-08T06:09:07.063450+0000 (oldest deadline 2024-05-08T06:09:29.263619+0000) 2024-05-08T06:09:32.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:32 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:32.024+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:09:32.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:32 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:32.024+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:09:32.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:32 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:32.024+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.881680+0000 front 2024-05-08T06:08:32.881745+0000 (oldest deadline 2024-05-08T06:08:55.181825+0000) 2024-05-08T06:09:32.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:32 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:32.024+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:42.183264+0000 front 2024-05-08T06:08:42.183384+0000 (oldest deadline 2024-05-08T06:09:05.083013+0000) 2024-05-08T06:09:32.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:32 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:32.024+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:51.484646+0000 front 2024-05-08T06:08:51.484760+0000 (oldest deadline 2024-05-08T06:09:12.584523+0000) 2024-05-08T06:09:32.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:32 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:32.024+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:58.385982+0000 front 2024-05-08T06:08:58.385882+0000 (oldest deadline 2024-05-08T06:09:23.686022+0000) 2024-05-08T06:09:32.499 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:32 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:32.109+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:09:32.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:32 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:32.109+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:25.504732+0000 front 2024-05-08T06:08:25.504827+0000 (oldest deadline 2024-05-08T06:08:47.105412+0000) 2024-05-08T06:09:32.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:32 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:32.109+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.306974+0000 front 2024-05-08T06:08:32.306880+0000 (oldest deadline 2024-05-08T06:08:54.606868+0000) 2024-05-08T06:09:32.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:32 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:32.109+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:41.608791+0000 front 2024-05-08T06:08:41.608670+0000 (oldest deadline 2024-05-08T06:09:03.908449+0000) 2024-05-08T06:09:32.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:32 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:32.109+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:50.309634+0000 front 2024-05-08T06:08:50.309683+0000 (oldest deadline 2024-05-08T06:09:12.609838+0000) 2024-05-08T06:09:32.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:32 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:32.109+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:59.611140+0000 front 2024-05-08T06:08:59.611228+0000 (oldest deadline 2024-05-08T06:09:20.710999+0000) 2024-05-08T06:09:32.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:32 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:32.109+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-05-08T06:09:05.912598+0000 front 2024-05-08T06:09:05.912636+0000 (oldest deadline 2024-05-08T06:09:31.212377+0000) 2024-05-08T06:09:32.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:32 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:32.479+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:12.046442+0000 front 2024-05-08T06:08:12.045573+0000 (oldest deadline 2024-05-08T06:08:37.945772+0000) 2024-05-08T06:09:32.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:32 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:32.479+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.648698+0000 front 2024-05-08T06:08:22.648127+0000 (oldest deadline 2024-05-08T06:08:47.948258+0000) 2024-05-08T06:09:32.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:32 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:32.479+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.649960+0000 front 2024-05-08T06:08:32.649891+0000 (oldest deadline 2024-05-08T06:08:56.750128+0000) 2024-05-08T06:09:32.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:32 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:32.479+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:38.452261+0000 front 2024-05-08T06:08:38.452312+0000 (oldest deadline 2024-05-08T06:09:03.151745+0000) 2024-05-08T06:09:32.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:32 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:32.479+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:50.456664+0000 front 2024-05-08T06:08:50.456817+0000 (oldest deadline 2024-05-08T06:09:14.556770+0000) 2024-05-08T06:09:32.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:32 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:32.479+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:59.258620+0000 front 2024-05-08T06:08:59.258561+0000 (oldest deadline 2024-05-08T06:09:22.158565+0000) 2024-05-08T06:09:32.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:32 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:32.479+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-05-08T06:09:07.062945+0000 front 2024-05-08T06:09:07.063450+0000 (oldest deadline 2024-05-08T06:09:29.263619+0000) 2024-05-08T06:09:33.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:33 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:33.003+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:09:33.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:33 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:33.003+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:09:33.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:33 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:33.003+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.881680+0000 front 2024-05-08T06:08:32.881745+0000 (oldest deadline 2024-05-08T06:08:55.181825+0000) 2024-05-08T06:09:33.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:33 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:33.003+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:42.183264+0000 front 2024-05-08T06:08:42.183384+0000 (oldest deadline 2024-05-08T06:09:05.083013+0000) 2024-05-08T06:09:33.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:33 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:33.003+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:51.484646+0000 front 2024-05-08T06:08:51.484760+0000 (oldest deadline 2024-05-08T06:09:12.584523+0000) 2024-05-08T06:09:33.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:33 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:33.003+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:58.385982+0000 front 2024-05-08T06:08:58.385882+0000 (oldest deadline 2024-05-08T06:09:23.686022+0000) 2024-05-08T06:09:33.499 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:33 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:33.123+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:09:33.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:33 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:33.123+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:25.504732+0000 front 2024-05-08T06:08:25.504827+0000 (oldest deadline 2024-05-08T06:08:47.105412+0000) 2024-05-08T06:09:33.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:33 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:33.123+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.306974+0000 front 2024-05-08T06:08:32.306880+0000 (oldest deadline 2024-05-08T06:08:54.606868+0000) 2024-05-08T06:09:33.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:33 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:33.123+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:41.608791+0000 front 2024-05-08T06:08:41.608670+0000 (oldest deadline 2024-05-08T06:09:03.908449+0000) 2024-05-08T06:09:33.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:33 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:33.123+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:50.309634+0000 front 2024-05-08T06:08:50.309683+0000 (oldest deadline 2024-05-08T06:09:12.609838+0000) 2024-05-08T06:09:33.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:33 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:33.123+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:59.611140+0000 front 2024-05-08T06:08:59.611228+0000 (oldest deadline 2024-05-08T06:09:20.710999+0000) 2024-05-08T06:09:33.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:33 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:33.123+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-05-08T06:09:05.912598+0000 front 2024-05-08T06:09:05.912636+0000 (oldest deadline 2024-05-08T06:09:31.212377+0000) 2024-05-08T06:09:33.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:33 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:33.501+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:12.046442+0000 front 2024-05-08T06:08:12.045573+0000 (oldest deadline 2024-05-08T06:08:37.945772+0000) 2024-05-08T06:09:33.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:33 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:33.501+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:22.648698+0000 front 2024-05-08T06:08:22.648127+0000 (oldest deadline 2024-05-08T06:08:47.948258+0000) 2024-05-08T06:09:33.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:33 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:33.501+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.649960+0000 front 2024-05-08T06:08:32.649891+0000 (oldest deadline 2024-05-08T06:08:56.750128+0000) 2024-05-08T06:09:33.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:33 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:33.501+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:38.452261+0000 front 2024-05-08T06:08:38.452312+0000 (oldest deadline 2024-05-08T06:09:03.151745+0000) 2024-05-08T06:09:33.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:33 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:33.501+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:50.456664+0000 front 2024-05-08T06:08:50.456817+0000 (oldest deadline 2024-05-08T06:09:14.556770+0000) 2024-05-08T06:09:33.971 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:33 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:33.501+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:59.258620+0000 front 2024-05-08T06:08:59.258561+0000 (oldest deadline 2024-05-08T06:09:22.158565+0000) 2024-05-08T06:09:33.972 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:33 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9[62135]: 2024-05-08T06:09:33.501+0000 7fee2b800700 -1 osd.9 85 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-05-08T06:09:07.062945+0000 front 2024-05-08T06:09:07.063450+0000 (oldest deadline 2024-05-08T06:09:29.263619+0000) 2024-05-08T06:09:34.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:33 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:33.962+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:09:34.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:33 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:33.962+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:09:34.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:33 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:33.962+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.881680+0000 front 2024-05-08T06:08:32.881745+0000 (oldest deadline 2024-05-08T06:08:55.181825+0000) 2024-05-08T06:09:34.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:33 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:33.962+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:42.183264+0000 front 2024-05-08T06:08:42.183384+0000 (oldest deadline 2024-05-08T06:09:05.083013+0000) 2024-05-08T06:09:34.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:33 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:33.962+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:51.484646+0000 front 2024-05-08T06:08:51.484760+0000 (oldest deadline 2024-05-08T06:09:12.584523+0000) 2024-05-08T06:09:34.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:33 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:33.962+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:58.385982+0000 front 2024-05-08T06:08:58.385882+0000 (oldest deadline 2024-05-08T06:09:23.686022+0000) 2024-05-08T06:09:34.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:34 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:34.140+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:09:34.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:34 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:34.140+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:25.504732+0000 front 2024-05-08T06:08:25.504827+0000 (oldest deadline 2024-05-08T06:08:47.105412+0000) 2024-05-08T06:09:34.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:34 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:34.140+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.306974+0000 front 2024-05-08T06:08:32.306880+0000 (oldest deadline 2024-05-08T06:08:54.606868+0000) 2024-05-08T06:09:34.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:34 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:34.140+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:41.608791+0000 front 2024-05-08T06:08:41.608670+0000 (oldest deadline 2024-05-08T06:09:03.908449+0000) 2024-05-08T06:09:34.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:34 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:34.140+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:50.309634+0000 front 2024-05-08T06:08:50.309683+0000 (oldest deadline 2024-05-08T06:09:12.609838+0000) 2024-05-08T06:09:34.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:34 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:34.140+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:59.611140+0000 front 2024-05-08T06:08:59.611228+0000 (oldest deadline 2024-05-08T06:09:20.710999+0000) 2024-05-08T06:09:34.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:34 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:34.140+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-05-08T06:09:05.912598+0000 front 2024-05-08T06:09:05.912636+0000 (oldest deadline 2024-05-08T06:09:31.212377+0000) 2024-05-08T06:09:34.749 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:34 smithi082 podman[113227]: 2024-05-08 06:09:34.47172688 +0000 UTC m=+5.792557799 container died a23c1ccf0fbd1d78631fccfe1938e3b9a22ef4fc747c39e50a01f1b31de1456a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-57676-3-bee299f, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux ) 2024-05-08T06:09:35.203 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:34 smithi082 podman[113227]: 2024-05-08 06:09:34.943748814 +0000 UTC m=+6.264579724 container cleanup a23c1ccf0fbd1d78631fccfe1938e3b9a22ef4fc747c39e50a01f1b31de1456a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f) 2024-05-08T06:09:35.204 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:34 smithi082 bash[113227]: ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9 2024-05-08T06:09:35.280 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:35 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:35.005+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:09:35.280 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:35 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:35.005+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:09:35.281 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:35 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:35.005+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.881680+0000 front 2024-05-08T06:08:32.881745+0000 (oldest deadline 2024-05-08T06:08:55.181825+0000) 2024-05-08T06:09:35.281 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:35 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:35.005+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:42.183264+0000 front 2024-05-08T06:08:42.183384+0000 (oldest deadline 2024-05-08T06:09:05.083013+0000) 2024-05-08T06:09:35.281 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:35 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:35.005+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:51.484646+0000 front 2024-05-08T06:08:51.484760+0000 (oldest deadline 2024-05-08T06:09:12.584523+0000) 2024-05-08T06:09:35.281 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:35 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:35.005+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:58.385982+0000 front 2024-05-08T06:08:58.385882+0000 (oldest deadline 2024-05-08T06:09:23.686022+0000) 2024-05-08T06:09:35.470 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:35 smithi082 podman[113246]: 2024-05-08 06:09:35.203408798 +0000 UTC m=+0.711038963 container remove a23c1ccf0fbd1d78631fccfe1938e3b9a22ef4fc747c39e50a01f1b31de1456a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-57676-3-bee299f, org.label-schema.license=GPLv2, ceph=True) 2024-05-08T06:09:35.499 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:35 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:35.144+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:09:35.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:35 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:35.144+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:25.504732+0000 front 2024-05-08T06:08:25.504827+0000 (oldest deadline 2024-05-08T06:08:47.105412+0000) 2024-05-08T06:09:35.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:35 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:35.144+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.306974+0000 front 2024-05-08T06:08:32.306880+0000 (oldest deadline 2024-05-08T06:08:54.606868+0000) 2024-05-08T06:09:35.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:35 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:35.144+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:41.608791+0000 front 2024-05-08T06:08:41.608670+0000 (oldest deadline 2024-05-08T06:09:03.908449+0000) 2024-05-08T06:09:35.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:35 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:35.144+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:50.309634+0000 front 2024-05-08T06:08:50.309683+0000 (oldest deadline 2024-05-08T06:09:12.609838+0000) 2024-05-08T06:09:35.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:35 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:35.144+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:59.611140+0000 front 2024-05-08T06:08:59.611228+0000 (oldest deadline 2024-05-08T06:09:20.710999+0000) 2024-05-08T06:09:35.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:35 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:35.144+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-05-08T06:09:05.912598+0000 front 2024-05-08T06:09:05.912636+0000 (oldest deadline 2024-05-08T06:09:31.212377+0000) 2024-05-08T06:09:36.232 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:35 smithi082 podman[113337]: 2024-05-08 06:09:35.883392036 +0000 UTC m=+0.035051750 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T06:09:36.233 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:35 smithi082 podman[113337]: 2024-05-08 06:09:35.995844346 +0000 UTC m=+0.147504082 container create e6c26d132626d65470b32dd485702f4289c4521c7e341262691361824c0bf168 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-57676-3-bee299f, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-05-08T06:09:36.233 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:36 smithi082 podman[113337]: 2024-05-08 06:09:36.232317792 +0000 UTC m=+0.383977506 container init e6c26d132626d65470b32dd485702f4289c4521c7e341262691361824c0bf168 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9-deactivate, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-57676-3-bee299f, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-08T06:09:36.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:35 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:35.976+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:09:36.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:35 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:35.976+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:09:36.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:35 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:35.976+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.881680+0000 front 2024-05-08T06:08:32.881745+0000 (oldest deadline 2024-05-08T06:08:55.181825+0000) 2024-05-08T06:09:36.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:35 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:35.976+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:42.183264+0000 front 2024-05-08T06:08:42.183384+0000 (oldest deadline 2024-05-08T06:09:05.083013+0000) 2024-05-08T06:09:36.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:35 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:35.976+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:51.484646+0000 front 2024-05-08T06:08:51.484760+0000 (oldest deadline 2024-05-08T06:09:12.584523+0000) 2024-05-08T06:09:36.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:35 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:35.976+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:58.385982+0000 front 2024-05-08T06:08:58.385882+0000 (oldest deadline 2024-05-08T06:09:23.686022+0000) 2024-05-08T06:09:36.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:36 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:36.144+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:09:36.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:36 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:36.144+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:25.504732+0000 front 2024-05-08T06:08:25.504827+0000 (oldest deadline 2024-05-08T06:08:47.105412+0000) 2024-05-08T06:09:36.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:36 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:36.144+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.306974+0000 front 2024-05-08T06:08:32.306880+0000 (oldest deadline 2024-05-08T06:08:54.606868+0000) 2024-05-08T06:09:36.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:36 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:36.144+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:41.608791+0000 front 2024-05-08T06:08:41.608670+0000 (oldest deadline 2024-05-08T06:09:03.908449+0000) 2024-05-08T06:09:36.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:36 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:36.144+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:50.309634+0000 front 2024-05-08T06:08:50.309683+0000 (oldest deadline 2024-05-08T06:09:12.609838+0000) 2024-05-08T06:09:36.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:36 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:36.144+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:59.611140+0000 front 2024-05-08T06:08:59.611228+0000 (oldest deadline 2024-05-08T06:09:20.710999+0000) 2024-05-08T06:09:36.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:36 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:36.144+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-05-08T06:09:05.912598+0000 front 2024-05-08T06:09:05.912636+0000 (oldest deadline 2024-05-08T06:09:31.212377+0000) 2024-05-08T06:09:36.700 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:36 smithi082 podman[113337]: 2024-05-08 06:09:36.242783522 +0000 UTC m=+0.394443224 container start e6c26d132626d65470b32dd485702f4289c4521c7e341262691361824c0bf168 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-57676-3-bee299f, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True) 2024-05-08T06:09:36.700 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:36 smithi082 podman[113337]: 2024-05-08 06:09:36.373022924 +0000 UTC m=+0.524682726 container attach e6c26d132626d65470b32dd485702f4289c4521c7e341262691361824c0bf168 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9-deactivate, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, RELEASE=wip-57676-3-bee299f, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-08T06:09:36.970 INFO:journalctl@ceph.osd.9.smithi082.stdout:May 08 06:09:36 smithi082 podman[113337]: 2024-05-08 06:09:36.701379269 +0000 UTC m=+0.853039051 container died e6c26d132626d65470b32dd485702f4289c4521c7e341262691361824c0bf168 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-57676-3-bee299f, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-08T06:09:37.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:37 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:37.014+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:09:37.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:37 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:37.014+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:09:37.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:37 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:37.014+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.881680+0000 front 2024-05-08T06:08:32.881745+0000 (oldest deadline 2024-05-08T06:08:55.181825+0000) 2024-05-08T06:09:37.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:37 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:37.014+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:42.183264+0000 front 2024-05-08T06:08:42.183384+0000 (oldest deadline 2024-05-08T06:09:05.083013+0000) 2024-05-08T06:09:37.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:37 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:37.014+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:51.484646+0000 front 2024-05-08T06:08:51.484760+0000 (oldest deadline 2024-05-08T06:09:12.584523+0000) 2024-05-08T06:09:37.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:37 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:37.014+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:58.385982+0000 front 2024-05-08T06:08:58.385882+0000 (oldest deadline 2024-05-08T06:09:23.686022+0000) 2024-05-08T06:09:37.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:37 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:37.192+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:09:37.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:37 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:37.192+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:25.504732+0000 front 2024-05-08T06:08:25.504827+0000 (oldest deadline 2024-05-08T06:08:47.105412+0000) 2024-05-08T06:09:37.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:37 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:37.192+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.306974+0000 front 2024-05-08T06:08:32.306880+0000 (oldest deadline 2024-05-08T06:08:54.606868+0000) 2024-05-08T06:09:37.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:37 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:37.192+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:41.608791+0000 front 2024-05-08T06:08:41.608670+0000 (oldest deadline 2024-05-08T06:09:03.908449+0000) 2024-05-08T06:09:37.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:37 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:37.192+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:50.309634+0000 front 2024-05-08T06:08:50.309683+0000 (oldest deadline 2024-05-08T06:09:12.609838+0000) 2024-05-08T06:09:37.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:37 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:37.192+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:59.611140+0000 front 2024-05-08T06:08:59.611228+0000 (oldest deadline 2024-05-08T06:09:20.710999+0000) 2024-05-08T06:09:37.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:37 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:37.192+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-05-08T06:09:05.912598+0000 front 2024-05-08T06:09:05.912636+0000 (oldest deadline 2024-05-08T06:09:31.212377+0000) 2024-05-08T06:09:37.563 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@osd.9.service' 2024-05-08T06:09:37.672 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T06:09:37.672 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-05-08T06:09:37.673 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-05-08T06:09:37.673 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@osd.10 2024-05-08T06:09:37.969 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:37 smithi134 systemd[1]: Stopping Ceph osd.10 for c739a5c8-0cfc-11ef-bc97-c7b262605968... 2024-05-08T06:09:38.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:37 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:37.969+0000 7fa4e71d1700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T06:09:38.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:37 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:37.969+0000 7fa4e71d1700 -1 osd.10 85 *** Got signal Terminated *** 2024-05-08T06:09:38.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:37 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:37.969+0000 7fa4e71d1700 -1 osd.10 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T06:09:38.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:38 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:38.186+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:09:38.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:38 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:38.186+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:25.504732+0000 front 2024-05-08T06:08:25.504827+0000 (oldest deadline 2024-05-08T06:08:47.105412+0000) 2024-05-08T06:09:38.251 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:38 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:38.186+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.306974+0000 front 2024-05-08T06:08:32.306880+0000 (oldest deadline 2024-05-08T06:08:54.606868+0000) 2024-05-08T06:09:38.251 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:38 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:38.186+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:41.608791+0000 front 2024-05-08T06:08:41.608670+0000 (oldest deadline 2024-05-08T06:09:03.908449+0000) 2024-05-08T06:09:38.251 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:38 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:38.186+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:50.309634+0000 front 2024-05-08T06:08:50.309683+0000 (oldest deadline 2024-05-08T06:09:12.609838+0000) 2024-05-08T06:09:38.251 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:38 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:38.186+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:59.611140+0000 front 2024-05-08T06:08:59.611228+0000 (oldest deadline 2024-05-08T06:09:20.710999+0000) 2024-05-08T06:09:38.251 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:38 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:38.186+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-05-08T06:09:05.912598+0000 front 2024-05-08T06:09:05.912636+0000 (oldest deadline 2024-05-08T06:09:31.212377+0000) 2024-05-08T06:09:38.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:37 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:37.982+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:09:38.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:37 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:37.982+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:09:38.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:37 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:37.982+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.881680+0000 front 2024-05-08T06:08:32.881745+0000 (oldest deadline 2024-05-08T06:08:55.181825+0000) 2024-05-08T06:09:38.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:37 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:37.982+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:42.183264+0000 front 2024-05-08T06:08:42.183384+0000 (oldest deadline 2024-05-08T06:09:05.083013+0000) 2024-05-08T06:09:38.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:37 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:37.982+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:51.484646+0000 front 2024-05-08T06:08:51.484760+0000 (oldest deadline 2024-05-08T06:09:12.584523+0000) 2024-05-08T06:09:38.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:37 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:37.982+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:58.385982+0000 front 2024-05-08T06:08:58.385882+0000 (oldest deadline 2024-05-08T06:09:23.686022+0000) 2024-05-08T06:09:39.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:38 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:38.975+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:09:39.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:38 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:38.975+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:09:39.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:38 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:38.975+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.881680+0000 front 2024-05-08T06:08:32.881745+0000 (oldest deadline 2024-05-08T06:08:55.181825+0000) 2024-05-08T06:09:39.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:38 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:38.975+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:42.183264+0000 front 2024-05-08T06:08:42.183384+0000 (oldest deadline 2024-05-08T06:09:05.083013+0000) 2024-05-08T06:09:39.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:38 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:38.975+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:51.484646+0000 front 2024-05-08T06:08:51.484760+0000 (oldest deadline 2024-05-08T06:09:12.584523+0000) 2024-05-08T06:09:39.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:38 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:38.975+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:58.385982+0000 front 2024-05-08T06:08:58.385882+0000 (oldest deadline 2024-05-08T06:09:23.686022+0000) 2024-05-08T06:09:39.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:38 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:38.975+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6820 osd.7 since back 2024-05-08T06:09:15.388357+0000 front 2024-05-08T06:09:15.388263+0000 (oldest deadline 2024-05-08T06:09:38.888187+0000) 2024-05-08T06:09:39.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:39 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:39.198+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:09:39.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:39 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:39.198+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:25.504732+0000 front 2024-05-08T06:08:25.504827+0000 (oldest deadline 2024-05-08T06:08:47.105412+0000) 2024-05-08T06:09:39.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:39 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:39.198+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.306974+0000 front 2024-05-08T06:08:32.306880+0000 (oldest deadline 2024-05-08T06:08:54.606868+0000) 2024-05-08T06:09:39.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:39 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:39.198+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:41.608791+0000 front 2024-05-08T06:08:41.608670+0000 (oldest deadline 2024-05-08T06:09:03.908449+0000) 2024-05-08T06:09:39.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:39 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:39.198+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:50.309634+0000 front 2024-05-08T06:08:50.309683+0000 (oldest deadline 2024-05-08T06:09:12.609838+0000) 2024-05-08T06:09:39.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:39 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:39.198+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:59.611140+0000 front 2024-05-08T06:08:59.611228+0000 (oldest deadline 2024-05-08T06:09:20.710999+0000) 2024-05-08T06:09:39.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:39 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:39.198+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-05-08T06:09:05.912598+0000 front 2024-05-08T06:09:05.912636+0000 (oldest deadline 2024-05-08T06:09:31.212377+0000) 2024-05-08T06:09:40.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:39 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:39.954+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:09:40.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:39 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:39.954+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:09:40.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:39 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:39.954+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.881680+0000 front 2024-05-08T06:08:32.881745+0000 (oldest deadline 2024-05-08T06:08:55.181825+0000) 2024-05-08T06:09:40.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:39 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:39.954+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:42.183264+0000 front 2024-05-08T06:08:42.183384+0000 (oldest deadline 2024-05-08T06:09:05.083013+0000) 2024-05-08T06:09:40.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:39 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:39.954+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:51.484646+0000 front 2024-05-08T06:08:51.484760+0000 (oldest deadline 2024-05-08T06:09:12.584523+0000) 2024-05-08T06:09:40.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:39 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:39.954+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:58.385982+0000 front 2024-05-08T06:08:58.385882+0000 (oldest deadline 2024-05-08T06:09:23.686022+0000) 2024-05-08T06:09:40.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:39 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:39.954+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6820 osd.7 since back 2024-05-08T06:09:15.388357+0000 front 2024-05-08T06:09:15.388263+0000 (oldest deadline 2024-05-08T06:09:38.888187+0000) 2024-05-08T06:09:40.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:40 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:40.165+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:09:40.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:40 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:40.165+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:25.504732+0000 front 2024-05-08T06:08:25.504827+0000 (oldest deadline 2024-05-08T06:08:47.105412+0000) 2024-05-08T06:09:40.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:40 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:40.165+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.306974+0000 front 2024-05-08T06:08:32.306880+0000 (oldest deadline 2024-05-08T06:08:54.606868+0000) 2024-05-08T06:09:40.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:40 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:40.165+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:41.608791+0000 front 2024-05-08T06:08:41.608670+0000 (oldest deadline 2024-05-08T06:09:03.908449+0000) 2024-05-08T06:09:40.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:40 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:40.165+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:50.309634+0000 front 2024-05-08T06:08:50.309683+0000 (oldest deadline 2024-05-08T06:09:12.609838+0000) 2024-05-08T06:09:40.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:40 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:40.165+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:59.611140+0000 front 2024-05-08T06:08:59.611228+0000 (oldest deadline 2024-05-08T06:09:20.710999+0000) 2024-05-08T06:09:40.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:40 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:40.165+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-05-08T06:09:05.912598+0000 front 2024-05-08T06:09:05.912636+0000 (oldest deadline 2024-05-08T06:09:31.212377+0000) 2024-05-08T06:09:41.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:40 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:40.952+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:09:41.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:40 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:40.952+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:09:41.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:40 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:40.952+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.881680+0000 front 2024-05-08T06:08:32.881745+0000 (oldest deadline 2024-05-08T06:08:55.181825+0000) 2024-05-08T06:09:41.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:40 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:40.952+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:42.183264+0000 front 2024-05-08T06:08:42.183384+0000 (oldest deadline 2024-05-08T06:09:05.083013+0000) 2024-05-08T06:09:41.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:40 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:40.952+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:51.484646+0000 front 2024-05-08T06:08:51.484760+0000 (oldest deadline 2024-05-08T06:09:12.584523+0000) 2024-05-08T06:09:41.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:40 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:40.952+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:58.385982+0000 front 2024-05-08T06:08:58.385882+0000 (oldest deadline 2024-05-08T06:09:23.686022+0000) 2024-05-08T06:09:41.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:40 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:40.952+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6820 osd.7 since back 2024-05-08T06:09:15.388357+0000 front 2024-05-08T06:09:15.388263+0000 (oldest deadline 2024-05-08T06:09:38.888187+0000) 2024-05-08T06:09:41.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:41 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:41.164+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:09:41.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:41 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:41.164+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:25.504732+0000 front 2024-05-08T06:08:25.504827+0000 (oldest deadline 2024-05-08T06:08:47.105412+0000) 2024-05-08T06:09:41.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:41 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:41.164+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.306974+0000 front 2024-05-08T06:08:32.306880+0000 (oldest deadline 2024-05-08T06:08:54.606868+0000) 2024-05-08T06:09:41.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:41 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:41.164+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:41.608791+0000 front 2024-05-08T06:08:41.608670+0000 (oldest deadline 2024-05-08T06:09:03.908449+0000) 2024-05-08T06:09:41.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:41 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:41.164+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:50.309634+0000 front 2024-05-08T06:08:50.309683+0000 (oldest deadline 2024-05-08T06:09:12.609838+0000) 2024-05-08T06:09:41.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:41 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:41.164+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:59.611140+0000 front 2024-05-08T06:08:59.611228+0000 (oldest deadline 2024-05-08T06:09:20.710999+0000) 2024-05-08T06:09:41.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:41 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:41.164+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-05-08T06:09:05.912598+0000 front 2024-05-08T06:09:05.912636+0000 (oldest deadline 2024-05-08T06:09:31.212377+0000) 2024-05-08T06:09:42.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:41 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:41.960+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:09:42.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:41 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:41.960+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:09:42.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:41 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:41.960+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.881680+0000 front 2024-05-08T06:08:32.881745+0000 (oldest deadline 2024-05-08T06:08:55.181825+0000) 2024-05-08T06:09:42.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:41 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:41.960+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:42.183264+0000 front 2024-05-08T06:08:42.183384+0000 (oldest deadline 2024-05-08T06:09:05.083013+0000) 2024-05-08T06:09:42.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:41 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:41.960+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:51.484646+0000 front 2024-05-08T06:08:51.484760+0000 (oldest deadline 2024-05-08T06:09:12.584523+0000) 2024-05-08T06:09:42.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:41 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:41.960+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:58.385982+0000 front 2024-05-08T06:08:58.385882+0000 (oldest deadline 2024-05-08T06:09:23.686022+0000) 2024-05-08T06:09:42.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:41 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:41.960+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6820 osd.7 since back 2024-05-08T06:09:15.388357+0000 front 2024-05-08T06:09:15.388263+0000 (oldest deadline 2024-05-08T06:09:38.888187+0000) 2024-05-08T06:09:42.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:42 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:42.200+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:13.302716+0000 front 2024-05-08T06:08:13.302838+0000 (oldest deadline 2024-05-08T06:08:38.602621+0000) 2024-05-08T06:09:42.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:42 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:42.200+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:25.504732+0000 front 2024-05-08T06:08:25.504827+0000 (oldest deadline 2024-05-08T06:08:47.105412+0000) 2024-05-08T06:09:42.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:42 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:42.200+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.306974+0000 front 2024-05-08T06:08:32.306880+0000 (oldest deadline 2024-05-08T06:08:54.606868+0000) 2024-05-08T06:09:42.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:42 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:42.200+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:41.608791+0000 front 2024-05-08T06:08:41.608670+0000 (oldest deadline 2024-05-08T06:09:03.908449+0000) 2024-05-08T06:09:42.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:42 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:42.200+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:50.309634+0000 front 2024-05-08T06:08:50.309683+0000 (oldest deadline 2024-05-08T06:09:12.609838+0000) 2024-05-08T06:09:42.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:42 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:42.200+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:59.611140+0000 front 2024-05-08T06:08:59.611228+0000 (oldest deadline 2024-05-08T06:09:20.710999+0000) 2024-05-08T06:09:42.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:42 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10[59321]: 2024-05-08T06:09:42.200+0000 7fa4df7bd700 -1 osd.10 85 heartbeat_check: no reply from 172.21.15.82:6822 osd.6 since back 2024-05-08T06:09:05.912598+0000 front 2024-05-08T06:09:05.912636+0000 (oldest deadline 2024-05-08T06:09:31.212377+0000) 2024-05-08T06:09:43.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:42 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:42.927+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:09:43.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:42 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:42.927+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:09:43.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:42 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:42.927+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.881680+0000 front 2024-05-08T06:08:32.881745+0000 (oldest deadline 2024-05-08T06:08:55.181825+0000) 2024-05-08T06:09:43.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:42 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:42.927+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:42.183264+0000 front 2024-05-08T06:08:42.183384+0000 (oldest deadline 2024-05-08T06:09:05.083013+0000) 2024-05-08T06:09:43.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:42 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:42.927+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:51.484646+0000 front 2024-05-08T06:08:51.484760+0000 (oldest deadline 2024-05-08T06:09:12.584523+0000) 2024-05-08T06:09:43.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:42 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:42.927+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:58.385982+0000 front 2024-05-08T06:08:58.385882+0000 (oldest deadline 2024-05-08T06:09:23.686022+0000) 2024-05-08T06:09:43.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:42 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:42.927+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6820 osd.7 since back 2024-05-08T06:09:15.388357+0000 front 2024-05-08T06:09:15.388263+0000 (oldest deadline 2024-05-08T06:09:38.888187+0000) 2024-05-08T06:09:43.845 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:43 smithi134 podman[71844]: 2024-05-08 06:09:43.550604633 +0000 UTC m=+5.687828377 container died 119e33bb669ea0073a805547e32d1bc55310fb6c7565147460734c2117e624b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, RELEASE=wip-57676-3-bee299f, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-05-08T06:09:44.170 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:43 smithi134 podman[71844]: 2024-05-08 06:09:43.945060851 +0000 UTC m=+6.082284584 container cleanup 119e33bb669ea0073a805547e32d1bc55310fb6c7565147460734c2117e624b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-57676-3-bee299f, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, GIT_BRANCH=HEAD) 2024-05-08T06:09:44.170 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:43 smithi134 bash[71844]: ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10 2024-05-08T06:09:44.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:43 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:43.945+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:09:44.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:43 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:43.945+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:09:44.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:43 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:43.945+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.881680+0000 front 2024-05-08T06:08:32.881745+0000 (oldest deadline 2024-05-08T06:08:55.181825+0000) 2024-05-08T06:09:44.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:43 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:43.945+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:42.183264+0000 front 2024-05-08T06:08:42.183384+0000 (oldest deadline 2024-05-08T06:09:05.083013+0000) 2024-05-08T06:09:44.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:43 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:43.945+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:51.484646+0000 front 2024-05-08T06:08:51.484760+0000 (oldest deadline 2024-05-08T06:09:12.584523+0000) 2024-05-08T06:09:44.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:43 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:43.945+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:58.385982+0000 front 2024-05-08T06:08:58.385882+0000 (oldest deadline 2024-05-08T06:09:23.686022+0000) 2024-05-08T06:09:44.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:43 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:43.945+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6820 osd.7 since back 2024-05-08T06:09:15.388357+0000 front 2024-05-08T06:09:15.388263+0000 (oldest deadline 2024-05-08T06:09:38.888187+0000) 2024-05-08T06:09:44.496 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:44 smithi134 podman[71873]: 2024-05-08 06:09:44.171118622 +0000 UTC m=+0.611415139 container remove 119e33bb669ea0073a805547e32d1bc55310fb6c7565147460734c2117e624b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f, maintainer=Guillaume Abrioux ) 2024-05-08T06:09:44.750 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:44 smithi134 podman[71963]: 2024-05-08 06:09:44.496761278 +0000 UTC m=+0.104152595 container create 9c505189a397a34962cce48f5ae2d5c83ac07b6ddb979a12d458b860162682a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10-deactivate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, RELEASE=wip-57676-3-bee299f, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True) 2024-05-08T06:09:44.750 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:44 smithi134 podman[71963]: 2024-05-08 06:09:44.410671476 +0000 UTC m=+0.018045929 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T06:09:44.750 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:44 smithi134 podman[71963]: 2024-05-08 06:09:44.69906183 +0000 UTC m=+0.306436260 container init 9c505189a397a34962cce48f5ae2d5c83ac07b6ddb979a12d458b860162682a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10-deactivate, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-57676-3-bee299f, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-05-08T06:09:44.750 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:44 smithi134 podman[71963]: 2024-05-08 06:09:44.702000473 +0000 UTC m=+0.309374908 container start 9c505189a397a34962cce48f5ae2d5c83ac07b6ddb979a12d458b860162682a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10-deactivate, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-05-08T06:09:45.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:44 smithi134 podman[71963]: 2024-05-08 06:09:44.780396787 +0000 UTC m=+0.387771216 container attach 9c505189a397a34962cce48f5ae2d5c83ac07b6ddb979a12d458b860162682a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10-deactivate, GIT_BRANCH=HEAD, RELEASE=wip-57676-3-bee299f, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507) 2024-05-08T06:09:45.250 INFO:journalctl@ceph.osd.10.smithi134.stdout:May 08 06:09:44 smithi134 podman[71963]: 2024-05-08 06:09:44.989946491 +0000 UTC m=+0.597320922 container died 9c505189a397a34962cce48f5ae2d5c83ac07b6ddb979a12d458b860162682a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=wip-57676-3-bee299f, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240507) 2024-05-08T06:09:45.334 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:44 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:44.915+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:09:45.335 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:44 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:44.915+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:09:45.335 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:44 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:44.915+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.881680+0000 front 2024-05-08T06:08:32.881745+0000 (oldest deadline 2024-05-08T06:08:55.181825+0000) 2024-05-08T06:09:45.335 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:44 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:44.915+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:42.183264+0000 front 2024-05-08T06:08:42.183384+0000 (oldest deadline 2024-05-08T06:09:05.083013+0000) 2024-05-08T06:09:45.335 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:44 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:44.915+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:51.484646+0000 front 2024-05-08T06:08:51.484760+0000 (oldest deadline 2024-05-08T06:09:12.584523+0000) 2024-05-08T06:09:45.335 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:44 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:44.915+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:58.385982+0000 front 2024-05-08T06:08:58.385882+0000 (oldest deadline 2024-05-08T06:09:23.686022+0000) 2024-05-08T06:09:45.335 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:44 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:44.915+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6820 osd.7 since back 2024-05-08T06:09:15.388357+0000 front 2024-05-08T06:09:15.388263+0000 (oldest deadline 2024-05-08T06:09:38.888187+0000) 2024-05-08T06:09:45.553 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@osd.10.service' 2024-05-08T06:09:45.592 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T06:09:45.592 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-05-08T06:09:45.592 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-05-08T06:09:45.593 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@osd.11 2024-05-08T06:09:45.879 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:45 smithi151 systemd[1]: Stopping Ceph osd.11 for c739a5c8-0cfc-11ef-bc97-c7b262605968... 2024-05-08T06:09:46.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:45 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:45.881+0000 7fc1c8d88700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T06:09:46.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:45 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:45.881+0000 7fc1c8d88700 -1 osd.11 85 *** Got signal Terminated *** 2024-05-08T06:09:46.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:45 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:45.881+0000 7fc1c8d88700 -1 osd.11 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-08T06:09:46.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:45 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:45.928+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:09:46.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:45 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:45.928+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:09:46.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:45 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:45.928+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.881680+0000 front 2024-05-08T06:08:32.881745+0000 (oldest deadline 2024-05-08T06:08:55.181825+0000) 2024-05-08T06:09:46.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:45 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:45.928+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:42.183264+0000 front 2024-05-08T06:08:42.183384+0000 (oldest deadline 2024-05-08T06:09:05.083013+0000) 2024-05-08T06:09:46.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:45 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:45.928+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:51.484646+0000 front 2024-05-08T06:08:51.484760+0000 (oldest deadline 2024-05-08T06:09:12.584523+0000) 2024-05-08T06:09:46.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:45 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:45.928+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:58.385982+0000 front 2024-05-08T06:08:58.385882+0000 (oldest deadline 2024-05-08T06:09:23.686022+0000) 2024-05-08T06:09:46.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:45 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:45.928+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6820 osd.7 since back 2024-05-08T06:09:15.388357+0000 front 2024-05-08T06:09:15.388263+0000 (oldest deadline 2024-05-08T06:09:38.888187+0000) 2024-05-08T06:09:47.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:46 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:46.920+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:09:47.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:46 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:46.920+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:09:47.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:46 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:46.920+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.881680+0000 front 2024-05-08T06:08:32.881745+0000 (oldest deadline 2024-05-08T06:08:55.181825+0000) 2024-05-08T06:09:47.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:46 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:46.920+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:42.183264+0000 front 2024-05-08T06:08:42.183384+0000 (oldest deadline 2024-05-08T06:09:05.083013+0000) 2024-05-08T06:09:47.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:46 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:46.920+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:51.484646+0000 front 2024-05-08T06:08:51.484760+0000 (oldest deadline 2024-05-08T06:09:12.584523+0000) 2024-05-08T06:09:47.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:46 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:46.920+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:58.385982+0000 front 2024-05-08T06:08:58.385882+0000 (oldest deadline 2024-05-08T06:09:23.686022+0000) 2024-05-08T06:09:47.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:46 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:46.920+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6820 osd.7 since back 2024-05-08T06:09:15.388357+0000 front 2024-05-08T06:09:15.388263+0000 (oldest deadline 2024-05-08T06:09:38.888187+0000) 2024-05-08T06:09:48.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:47 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:47.969+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:09:48.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:47 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:47.969+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:09:48.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:47 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:47.969+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.881680+0000 front 2024-05-08T06:08:32.881745+0000 (oldest deadline 2024-05-08T06:08:55.181825+0000) 2024-05-08T06:09:48.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:47 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:47.970+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:42.183264+0000 front 2024-05-08T06:08:42.183384+0000 (oldest deadline 2024-05-08T06:09:05.083013+0000) 2024-05-08T06:09:48.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:47 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:47.970+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:51.484646+0000 front 2024-05-08T06:08:51.484760+0000 (oldest deadline 2024-05-08T06:09:12.584523+0000) 2024-05-08T06:09:48.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:47 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:47.970+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:58.385982+0000 front 2024-05-08T06:08:58.385882+0000 (oldest deadline 2024-05-08T06:09:23.686022+0000) 2024-05-08T06:09:48.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:47 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:47.970+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6820 osd.7 since back 2024-05-08T06:09:15.388357+0000 front 2024-05-08T06:09:15.388263+0000 (oldest deadline 2024-05-08T06:09:38.888187+0000) 2024-05-08T06:09:49.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:48 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:48.922+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:09:49.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:48 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:48.922+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:09:49.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:48 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:48.922+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.881680+0000 front 2024-05-08T06:08:32.881745+0000 (oldest deadline 2024-05-08T06:08:55.181825+0000) 2024-05-08T06:09:49.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:48 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:48.922+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:42.183264+0000 front 2024-05-08T06:08:42.183384+0000 (oldest deadline 2024-05-08T06:09:05.083013+0000) 2024-05-08T06:09:49.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:48 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:48.922+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:51.484646+0000 front 2024-05-08T06:08:51.484760+0000 (oldest deadline 2024-05-08T06:09:12.584523+0000) 2024-05-08T06:09:49.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:48 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:48.922+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:58.385982+0000 front 2024-05-08T06:08:58.385882+0000 (oldest deadline 2024-05-08T06:09:23.686022+0000) 2024-05-08T06:09:49.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:48 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:48.922+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6820 osd.7 since back 2024-05-08T06:09:15.388357+0000 front 2024-05-08T06:09:15.388263+0000 (oldest deadline 2024-05-08T06:09:38.888187+0000) 2024-05-08T06:09:50.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:49 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:49.933+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6806 osd.0 since back 2024-05-08T06:08:10.778122+0000 front 2024-05-08T06:08:10.778138+0000 (oldest deadline 2024-05-08T06:08:40.778688+0000) 2024-05-08T06:09:50.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:49 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:49.933+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-05-08T06:08:24.780331+0000 front 2024-05-08T06:08:24.780409+0000 (oldest deadline 2024-05-08T06:08:46.480293+0000) 2024-05-08T06:09:50.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:49 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:49.933+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-05-08T06:08:32.881680+0000 front 2024-05-08T06:08:32.881745+0000 (oldest deadline 2024-05-08T06:08:55.181825+0000) 2024-05-08T06:09:50.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:49 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:49.933+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.82:6814 osd.3 since back 2024-05-08T06:08:42.183264+0000 front 2024-05-08T06:08:42.183384+0000 (oldest deadline 2024-05-08T06:09:05.083013+0000) 2024-05-08T06:09:50.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:49 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:49.933+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-05-08T06:08:51.484646+0000 front 2024-05-08T06:08:51.484760+0000 (oldest deadline 2024-05-08T06:09:12.584523+0000) 2024-05-08T06:09:50.379 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:49 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:49.933+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-05-08T06:08:58.385982+0000 front 2024-05-08T06:08:58.385882+0000 (oldest deadline 2024-05-08T06:09:23.686022+0000) 2024-05-08T06:09:50.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:49 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:49.933+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.134:6820 osd.7 since back 2024-05-08T06:09:15.388357+0000 front 2024-05-08T06:09:15.388263+0000 (oldest deadline 2024-05-08T06:09:38.888187+0000) 2024-05-08T06:09:50.380 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:49 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11[60336]: 2024-05-08T06:09:49.933+0000 7fc1c537c700 -1 osd.11 85 heartbeat_check: no reply from 172.21.15.151:6820 osd.8 since back 2024-05-08T06:09:24.089331+0000 front 2024-05-08T06:09:24.089380+0000 (oldest deadline 2024-05-08T06:09:49.389478+0000) 2024-05-08T06:09:51.699 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:51 smithi151 podman[72569]: 2024-05-08 06:09:51.402945663 +0000 UTC m=+5.612167125 container died d1427eaad468f781921c46fd3ad40e150e75a6e37a5a26480e18faca3cd283fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-57676-3-bee299f, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-05-08T06:09:52.024 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:51 smithi151 podman[72569]: 2024-05-08 06:09:51.790346036 +0000 UTC m=+5.999567498 container cleanup d1427eaad468f781921c46fd3ad40e150e75a6e37a5a26480e18faca3cd283fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-57676-3-bee299f, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0) 2024-05-08T06:09:52.024 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:51 smithi151 bash[72569]: ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11 2024-05-08T06:09:52.350 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:52 smithi151 podman[72590]: 2024-05-08 06:09:52.025274783 +0000 UTC m=+0.615135774 container remove d1427eaad468f781921c46fd3ad40e150e75a6e37a5a26480e18faca3cd283fe (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11, org.label-schema.build-date=20240507, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-57676-3-bee299f, org.label-schema.license=GPLv2) 2024-05-08T06:09:52.629 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:52 smithi151 podman[72685]: 2024-05-08 06:09:52.351668166 +0000 UTC m=+0.106945700 container create 997d55eec15749d01448e52fd8c121652878195ad67797b7c8e5bafcf2368591 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11-deactivate, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-57676-3-bee299f, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2) 2024-05-08T06:09:52.629 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:52 smithi151 podman[72685]: 2024-05-08 06:09:52.263205851 +0000 UTC m=+0.018483361 image pull 352576a2df49fbab3aeeba1effbcb7a94815e8fc1f120a55ddc340b4ee63b8ce quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c 2024-05-08T06:09:52.629 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:52 smithi151 podman[72685]: 2024-05-08 06:09:52.570933101 +0000 UTC m=+0.326210593 container init 997d55eec15749d01448e52fd8c121652878195ad67797b7c8e5bafcf2368591 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, GIT_CLEAN=True, RELEASE=wip-57676-3-bee299f, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-08T06:09:52.629 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:52 smithi151 podman[72685]: 2024-05-08 06:09:52.574070215 +0000 UTC m=+0.329347716 container start 997d55eec15749d01448e52fd8c121652878195ad67797b7c8e5bafcf2368591 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-57676-3-bee299f, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True) 2024-05-08T06:09:53.129 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:52 smithi151 podman[72685]: 2024-05-08 06:09:52.656101234 +0000 UTC m=+0.411378737 container attach 997d55eec15749d01448e52fd8c121652878195ad67797b7c8e5bafcf2368591 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11-deactivate, maintainer=Guillaume Abrioux , RELEASE=wip-57676-3-bee299f, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-05-08T06:09:53.130 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:52 smithi151 podman[72685]: 2024-05-08 06:09:52.868101072 +0000 UTC m=+0.623378572 container died 997d55eec15749d01448e52fd8c121652878195ad67797b7c8e5bafcf2368591 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11-deactivate, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, RELEASE=wip-57676-3-bee299f) 2024-05-08T06:09:53.412 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:53 smithi151 podman[72712]: 2024-05-08 06:09:53.397153729 +0000 UTC m=+0.523810939 container remove 997d55eec15749d01448e52fd8c121652878195ad67797b7c8e5bafcf2368591 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-osd-11-deactivate, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240507, RELEASE=wip-57676-3-bee299f, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-05-08T06:09:53.412 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:53 smithi151 systemd[1]: ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@osd.11.service: Deactivated successfully. 2024-05-08T06:09:53.412 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:53 smithi151 systemd[1]: Stopped Ceph osd.11 for c739a5c8-0cfc-11ef-bc97-c7b262605968. 2024-05-08T06:09:53.412 INFO:journalctl@ceph.osd.11.smithi151.stdout:May 08 06:09:53 smithi151 systemd[1]: ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@osd.11.service: Consumed 7min 37.145s CPU time. 2024-05-08T06:09:53.413 DEBUG:teuthology.orchestra.run.smithi151:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@osd.11.service' 2024-05-08T06:09:53.450 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T06:09:53.450 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-05-08T06:09:53.450 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-05-08T06:09:53.450 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mds.a 2024-05-08T06:09:53.970 INFO:journalctl@ceph.mds.a.smithi082.stdout:May 08 06:09:53 smithi082 systemd[1]: Stopping Ceph mds.a for c739a5c8-0cfc-11ef-bc97-c7b262605968... 2024-05-08T06:09:54.470 INFO:journalctl@ceph.mds.a.smithi082.stdout:May 08 06:09:54 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-a[69390]: 2024-05-08T06:09:54.042+0000 7f15bc400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T06:09:54.470 INFO:journalctl@ceph.mds.a.smithi082.stdout:May 08 06:09:54 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-a[69390]: 2024-05-08T06:09:54.042+0000 7f15bc400700 -1 mds.a *** got signal Terminated *** 2024-05-08T06:09:55.970 INFO:journalctl@ceph.mds.a.smithi082.stdout:May 08 06:09:55 smithi082 podman[113442]: 2024-05-08 06:09:55.854628327 +0000 UTC m=+1.964843806 container died b779b6736622d09514fbeb08f1a05146b1e1b98435a226c8d78c53db32da9c2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-a, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507) 2024-05-08T06:09:56.470 INFO:journalctl@ceph.mds.a.smithi082.stdout:May 08 06:09:56 smithi082 podman[113442]: 2024-05-08 06:09:56.318178287 +0000 UTC m=+2.428393760 container cleanup b779b6736622d09514fbeb08f1a05146b1e1b98435a226c8d78c53db32da9c2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-a, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, RELEASE=wip-57676-3-bee299f, org.label-schema.vendor=CentOS) 2024-05-08T06:09:56.470 INFO:journalctl@ceph.mds.a.smithi082.stdout:May 08 06:09:56 smithi082 bash[113442]: ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-a 2024-05-08T06:09:56.941 INFO:journalctl@ceph.mds.a.smithi082.stdout:May 08 06:09:56 smithi082 podman[113465]: 2024-05-08 06:09:56.544450452 +0000 UTC m=+0.672468179 container remove b779b6736622d09514fbeb08f1a05146b1e1b98435a226c8d78c53db32da9c2e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-a, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-57676-3-bee299f, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD) 2024-05-08T06:09:56.983 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mds.a.service' 2024-05-08T06:09:57.092 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T06:09:57.093 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-05-08T06:09:57.093 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-05-08T06:09:57.093 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mds.d 2024-05-08T06:09:57.470 INFO:journalctl@ceph.mds.d.smithi082.stdout:May 08 06:09:57 smithi082 systemd[1]: Stopping Ceph mds.d for c739a5c8-0cfc-11ef-bc97-c7b262605968... 2024-05-08T06:09:57.970 INFO:journalctl@ceph.mds.d.smithi082.stdout:May 08 06:09:57 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-d[68198]: 2024-05-08T06:09:57.636+0000 7fb5f8c00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T06:09:57.971 INFO:journalctl@ceph.mds.d.smithi082.stdout:May 08 06:09:57 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-d[68198]: 2024-05-08T06:09:57.636+0000 7fb5f8c00700 -1 mds.d *** got signal Terminated *** 2024-05-08T06:10:00.720 INFO:journalctl@ceph.mds.d.smithi082.stdout:May 08 06:10:00 smithi082 podman[113575]: 2024-05-08 06:10:00.425268113 +0000 UTC m=+2.910661184 container died fe7abbc85d644b1846e3c20f758738711e61b369acbd5fb6faf03323f9c96cd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-d, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-05-08T06:10:01.017 INFO:journalctl@ceph.mds.d.smithi082.stdout:May 08 06:10:00 smithi082 podman[113575]: 2024-05-08 06:10:00.854935987 +0000 UTC m=+3.340329076 container cleanup fe7abbc85d644b1846e3c20f758738711e61b369acbd5fb6faf03323f9c96cd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-d, RELEASE=wip-57676-3-bee299f, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-05-08T06:10:01.018 INFO:journalctl@ceph.mds.d.smithi082.stdout:May 08 06:10:00 smithi082 bash[113575]: ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-d 2024-05-08T06:10:01.470 INFO:journalctl@ceph.mds.d.smithi082.stdout:May 08 06:10:01 smithi082 podman[113590]: 2024-05-08 06:10:01.017726697 +0000 UTC m=+0.580823852 container remove fe7abbc85d644b1846e3c20f758738711e61b369acbd5fb6faf03323f9c96cd8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-d, RELEASE=wip-57676-3-bee299f, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-05-08T06:10:01.548 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mds.d.service' 2024-05-08T06:10:01.651 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T06:10:01.651 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-05-08T06:10:01.651 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-05-08T06:10:01.652 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mds.g 2024-05-08T06:10:02.220 INFO:journalctl@ceph.mds.g.smithi082.stdout:May 08 06:10:01 smithi082 systemd[1]: Stopping Ceph mds.g for c739a5c8-0cfc-11ef-bc97-c7b262605968... 2024-05-08T06:10:02.720 INFO:journalctl@ceph.mds.g.smithi082.stdout:May 08 06:10:02 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-g[68982]: 2024-05-08T06:10:02.225+0000 7f0dfce00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T06:10:02.720 INFO:journalctl@ceph.mds.g.smithi082.stdout:May 08 06:10:02 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-g[68982]: 2024-05-08T06:10:02.225+0000 7f0dfce00700 -1 mds.g *** got signal Terminated *** 2024-05-08T06:10:04.142 INFO:journalctl@ceph.mds.g.smithi082.stdout:May 08 06:10:03 smithi082 podman[113695]: 2024-05-08 06:10:03.865313944 +0000 UTC m=+1.759168615 container died 3141edc501dd8fe12d8725a918f6b921bfae7a53728fd54dc26da8406d2a2496 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-g, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-57676-3-bee299f, ceph=True) 2024-05-08T06:10:04.463 INFO:journalctl@ceph.mds.g.smithi082.stdout:May 08 06:10:04 smithi082 podman[113695]: 2024-05-08 06:10:04.253692312 +0000 UTC m=+2.147547023 container cleanup 3141edc501dd8fe12d8725a918f6b921bfae7a53728fd54dc26da8406d2a2496 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-g, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-57676-3-bee299f, org.label-schema.build-date=20240507, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-05-08T06:10:04.463 INFO:journalctl@ceph.mds.g.smithi082.stdout:May 08 06:10:04 smithi082 bash[113695]: ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-g 2024-05-08T06:10:04.720 INFO:journalctl@ceph.mds.g.smithi082.stdout:May 08 06:10:04 smithi082 podman[113709]: 2024-05-08 06:10:04.463059138 +0000 UTC m=+0.584525736 container remove 3141edc501dd8fe12d8725a918f6b921bfae7a53728fd54dc26da8406d2a2496 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-g, RELEASE=wip-57676-3-bee299f, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-05-08T06:10:04.961 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mds.g.service' 2024-05-08T06:10:05.064 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T06:10:05.064 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-05-08T06:10:05.065 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-05-08T06:10:05.065 DEBUG:teuthology.orchestra.run.smithi082:> sudo systemctl stop ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mds.j 2024-05-08T06:10:05.720 INFO:journalctl@ceph.mds.j.smithi082.stdout:May 08 06:10:05 smithi082 systemd[1]: Stopping Ceph mds.j for c739a5c8-0cfc-11ef-bc97-c7b262605968... 2024-05-08T06:10:06.221 INFO:journalctl@ceph.mds.j.smithi082.stdout:May 08 06:10:05 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-j[67786]: 2024-05-08T06:10:05.791+0000 7fb0b9200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T06:10:06.221 INFO:journalctl@ceph.mds.j.smithi082.stdout:May 08 06:10:05 smithi082 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-j[67786]: 2024-05-08T06:10:05.791+0000 7fb0b9200700 -1 mds.j *** got signal Terminated *** 2024-05-08T06:10:08.144 INFO:journalctl@ceph.mds.j.smithi082.stdout:May 08 06:10:07 smithi082 podman[113814]: 2024-05-08 06:10:07.859986549 +0000 UTC m=+2.277475975 container died 3379a8a642ed58da3e0951feb5c637cc07afe8a8d05645677bb4aa78fb0448e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-j, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-57676-3-bee299f) 2024-05-08T06:10:08.720 INFO:journalctl@ceph.mds.j.smithi082.stdout:May 08 06:10:08 smithi082 podman[113814]: 2024-05-08 06:10:08.415447768 +0000 UTC m=+2.832937225 container cleanup 3379a8a642ed58da3e0951feb5c637cc07afe8a8d05645677bb4aa78fb0448e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-j, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-57676-3-bee299f, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-05-08T06:10:08.721 INFO:journalctl@ceph.mds.j.smithi082.stdout:May 08 06:10:08 smithi082 bash[113814]: ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-j 2024-05-08T06:10:08.721 INFO:journalctl@ceph.mds.j.smithi082.stdout:May 08 06:10:08 smithi082 podman[113827]: 2024-05-08 06:10:08.608165253 +0000 UTC m=+0.736112988 container remove 3379a8a642ed58da3e0951feb5c637cc07afe8a8d05645677bb4aa78fb0448e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-j, GIT_BRANCH=HEAD, RELEASE=wip-57676-3-bee299f, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-05-08T06:10:09.038 DEBUG:teuthology.orchestra.run.smithi082:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mds.j.service' 2024-05-08T06:10:09.136 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T06:10:09.137 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-05-08T06:10:09.137 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-05-08T06:10:09.137 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mds.b 2024-05-08T06:10:09.461 INFO:journalctl@ceph.mds.b.smithi134.stdout:May 08 06:10:09 smithi134 systemd[1]: Stopping Ceph mds.b for c739a5c8-0cfc-11ef-bc97-c7b262605968... 2024-05-08T06:10:09.749 INFO:journalctl@ceph.mds.b.smithi134.stdout:May 08 06:10:09 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-b[65010]: 2024-05-08T06:10:09.461+0000 7f5347704700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T06:10:09.749 INFO:journalctl@ceph.mds.b.smithi134.stdout:May 08 06:10:09 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-b[65010]: 2024-05-08T06:10:09.461+0000 7f5347704700 -1 mds.b *** got signal Terminated *** 2024-05-08T06:10:12.000 INFO:journalctl@ceph.mds.b.smithi134.stdout:May 08 06:10:11 smithi134 podman[72069]: 2024-05-08 06:10:11.807234681 +0000 UTC m=+2.479745209 container died c991dcbc68f4c51d767279f651496faaaec6be183baadd8f1a06a4f190d0fee5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-b, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, RELEASE=wip-57676-3-bee299f, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, GIT_CLEAN=True) 2024-05-08T06:10:12.336 INFO:journalctl@ceph.mds.b.smithi134.stdout:May 08 06:10:12 smithi134 podman[72069]: 2024-05-08 06:10:12.127248657 +0000 UTC m=+2.799759194 container cleanup c991dcbc68f4c51d767279f651496faaaec6be183baadd8f1a06a4f190d0fee5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-b, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-57676-3-bee299f, ceph=True, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-05-08T06:10:12.336 INFO:journalctl@ceph.mds.b.smithi134.stdout:May 08 06:10:12 smithi134 bash[72069]: ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-b 2024-05-08T06:10:12.461 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mds.b.service' 2024-05-08T06:10:12.496 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T06:10:12.496 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-05-08T06:10:12.496 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-05-08T06:10:12.496 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mds.e 2024-05-08T06:10:12.750 INFO:journalctl@ceph.mds.e.smithi134.stdout:May 08 06:10:12 smithi134 systemd[1]: Stopping Ceph mds.e for c739a5c8-0cfc-11ef-bc97-c7b262605968... 2024-05-08T06:10:13.250 INFO:journalctl@ceph.mds.e.smithi134.stdout:May 08 06:10:12 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-e[64371]: 2024-05-08T06:10:12.855+0000 7fa62fe1f700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T06:10:13.250 INFO:journalctl@ceph.mds.e.smithi134.stdout:May 08 06:10:12 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-e[64371]: 2024-05-08T06:10:12.855+0000 7fa62fe1f700 -1 mds.e *** got signal Terminated *** 2024-05-08T06:10:16.047 INFO:journalctl@ceph.mds.e.smithi134.stdout:May 08 06:10:15 smithi134 podman[72202]: 2024-05-08 06:10:15.795990439 +0000 UTC m=+3.078155843 container died b62b7fbb937a44b8a3b4654fb89cbc7aacd51b5f3ed5929650661e4cdef98c18 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-e, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, RELEASE=wip-57676-3-bee299f, GIT_CLEAN=True, org.label-schema.build-date=20240507) 2024-05-08T06:10:16.414 INFO:journalctl@ceph.mds.e.smithi134.stdout:May 08 06:10:16 smithi134 podman[72202]: 2024-05-08 06:10:16.105740069 +0000 UTC m=+3.387905471 container cleanup b62b7fbb937a44b8a3b4654fb89cbc7aacd51b5f3ed5929650661e4cdef98c18 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-e, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-57676-3-bee299f) 2024-05-08T06:10:16.414 INFO:journalctl@ceph.mds.e.smithi134.stdout:May 08 06:10:16 smithi134 bash[72202]: ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-e 2024-05-08T06:10:16.414 INFO:journalctl@ceph.mds.e.smithi134.stdout:May 08 06:10:16 smithi134 podman[72216]: 2024-05-08 06:10:16.289995404 +0000 UTC m=+0.491065165 container remove b62b7fbb937a44b8a3b4654fb89cbc7aacd51b5f3ed5929650661e4cdef98c18 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-e, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=wip-57676-3-bee299f, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-05-08T06:10:16.434 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mds.e.service' 2024-05-08T06:10:16.465 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T06:10:16.466 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-05-08T06:10:16.466 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-05-08T06:10:16.466 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mds.h 2024-05-08T06:10:16.749 INFO:journalctl@ceph.mds.h.smithi134.stdout:May 08 06:10:16 smithi134 systemd[1]: Stopping Ceph mds.h for c739a5c8-0cfc-11ef-bc97-c7b262605968... 2024-05-08T06:10:17.250 INFO:journalctl@ceph.mds.h.smithi134.stdout:May 08 06:10:16 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-h[64691]: 2024-05-08T06:10:16.785+0000 7f3d6787d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T06:10:17.250 INFO:journalctl@ceph.mds.h.smithi134.stdout:May 08 06:10:16 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-h[64691]: 2024-05-08T06:10:16.785+0000 7f3d6787d700 -1 mds.h *** got signal Terminated *** 2024-05-08T06:10:20.249 INFO:journalctl@ceph.mds.h.smithi134.stdout:May 08 06:10:19 smithi134 podman[72323]: 2024-05-08 06:10:19.814426234 +0000 UTC m=+3.132864703 container died 7ecfb2a1cf8117b4253b1642274d003f81a38430b59ca1c9c0626129a909f398 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-h, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, GIT_CLEAN=True, RELEASE=wip-57676-3-bee299f, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-08T06:10:20.625 INFO:journalctl@ceph.mds.h.smithi134.stdout:May 08 06:10:20 smithi134 podman[72323]: 2024-05-08 06:10:20.400532918 +0000 UTC m=+3.718971387 container cleanup 7ecfb2a1cf8117b4253b1642274d003f81a38430b59ca1c9c0626129a909f398 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-h, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-57676-3-bee299f, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240507, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-08T06:10:20.626 INFO:journalctl@ceph.mds.h.smithi134.stdout:May 08 06:10:20 smithi134 bash[72323]: ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-h 2024-05-08T06:10:20.750 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mds.h.service' 2024-05-08T06:10:20.782 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T06:10:20.782 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-05-08T06:10:20.782 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-05-08T06:10:20.782 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mds.k 2024-05-08T06:10:20.999 INFO:journalctl@ceph.mds.k.smithi134.stdout:May 08 06:10:20 smithi134 systemd[1]: Stopping Ceph mds.k for c739a5c8-0cfc-11ef-bc97-c7b262605968... 2024-05-08T06:10:21.499 INFO:journalctl@ceph.mds.k.smithi134.stdout:May 08 06:10:21 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-k[64052]: 2024-05-08T06:10:21.094+0000 7fd6e9d58700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T06:10:21.500 INFO:journalctl@ceph.mds.k.smithi134.stdout:May 08 06:10:21 smithi134 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-k[64052]: 2024-05-08T06:10:21.094+0000 7fd6e9d58700 -1 mds.k *** got signal Terminated *** 2024-05-08T06:10:24.170 INFO:journalctl@ceph.mds.k.smithi134.stdout:May 08 06:10:23 smithi134 podman[72445]: 2024-05-08 06:10:23.798905088 +0000 UTC m=+2.803721178 container died acaa1f3403b1955794ccce046e04d74d0c0cd3b6006be5173622cda659323ac0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-k, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-57676-3-bee299f, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, ceph=True) 2024-05-08T06:10:24.500 INFO:journalctl@ceph.mds.k.smithi134.stdout:May 08 06:10:24 smithi134 podman[72445]: 2024-05-08 06:10:24.24526534 +0000 UTC m=+3.250081428 container cleanup acaa1f3403b1955794ccce046e04d74d0c0cd3b6006be5173622cda659323ac0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-57676-3-bee299f) 2024-05-08T06:10:24.500 INFO:journalctl@ceph.mds.k.smithi134.stdout:May 08 06:10:24 smithi134 bash[72445]: ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-k 2024-05-08T06:10:24.500 INFO:journalctl@ceph.mds.k.smithi134.stdout:May 08 06:10:24 smithi134 podman[72460]: 2024-05-08 06:10:24.413026961 +0000 UTC m=+0.609284622 container remove acaa1f3403b1955794ccce046e04d74d0c0cd3b6006be5173622cda659323ac0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-k, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, RELEASE=wip-57676-3-bee299f, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-08T06:10:24.660 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mds.k.service' 2024-05-08T06:10:24.691 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T06:10:24.691 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-05-08T06:10:24.691 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-05-08T06:10:24.691 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mds.c 2024-05-08T06:10:25.014 INFO:journalctl@ceph.mds.c.smithi151.stdout:May 08 06:10:24 smithi151 systemd[1]: Stopping Ceph mds.c for c739a5c8-0cfc-11ef-bc97-c7b262605968... 2024-05-08T06:10:25.277 INFO:journalctl@ceph.mds.c.smithi151.stdout:May 08 06:10:25 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-c[65769]: 2024-05-08T06:10:25.013+0000 7efee1dba700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T06:10:25.277 INFO:journalctl@ceph.mds.c.smithi151.stdout:May 08 06:10:25 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-c[65769]: 2024-05-08T06:10:25.013+0000 7efee1dba700 -1 mds.c *** got signal Terminated *** 2024-05-08T06:10:28.129 INFO:journalctl@ceph.mds.c.smithi151.stdout:May 08 06:10:27 smithi151 podman[72794]: 2024-05-08 06:10:27.80135577 +0000 UTC m=+2.909479253 container died 774d1f9f7bcba410b8b6460fcfc30070072a1ba1dfe9cd1246577363f6d3ec51 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-c, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, RELEASE=wip-57676-3-bee299f, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-08T06:10:28.423 INFO:journalctl@ceph.mds.c.smithi151.stdout:May 08 06:10:28 smithi151 podman[72794]: 2024-05-08 06:10:28.222289191 +0000 UTC m=+3.330412663 container cleanup 774d1f9f7bcba410b8b6460fcfc30070072a1ba1dfe9cd1246577363f6d3ec51 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-c, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-57676-3-bee299f, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-05-08T06:10:28.423 INFO:journalctl@ceph.mds.c.smithi151.stdout:May 08 06:10:28 smithi151 bash[72794]: ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-c 2024-05-08T06:10:28.664 DEBUG:teuthology.orchestra.run.smithi151:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mds.c.service' 2024-05-08T06:10:28.685 INFO:journalctl@ceph.mds.c.smithi151.stdout:May 08 06:10:28 smithi151 podman[72820]: 2024-05-08 06:10:28.424163625 +0000 UTC m=+0.625102025 container remove 774d1f9f7bcba410b8b6460fcfc30070072a1ba1dfe9cd1246577363f6d3ec51 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-c, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-57676-3-bee299f, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-05-08T06:10:28.685 INFO:journalctl@ceph.mds.c.smithi151.stdout:May 08 06:10:28 smithi151 systemd[1]: ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mds.c.service: Deactivated successfully. 2024-05-08T06:10:28.685 INFO:journalctl@ceph.mds.c.smithi151.stdout:May 08 06:10:28 smithi151 systemd[1]: Stopped Ceph mds.c for c739a5c8-0cfc-11ef-bc97-c7b262605968. 2024-05-08T06:10:28.685 INFO:journalctl@ceph.mds.c.smithi151.stdout:May 08 06:10:28 smithi151 systemd[1]: ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mds.c.service: Consumed 2.200s CPU time. 2024-05-08T06:10:28.699 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T06:10:28.699 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-05-08T06:10:28.699 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-05-08T06:10:28.699 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mds.f 2024-05-08T06:10:29.018 INFO:journalctl@ceph.mds.f.smithi151.stdout:May 08 06:10:28 smithi151 systemd[1]: Stopping Ceph mds.f for c739a5c8-0cfc-11ef-bc97-c7b262605968... 2024-05-08T06:10:29.379 INFO:journalctl@ceph.mds.f.smithi151.stdout:May 08 06:10:29 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-f[65460]: 2024-05-08T06:10:29.018+0000 7f8856b68700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T06:10:29.379 INFO:journalctl@ceph.mds.f.smithi151.stdout:May 08 06:10:29 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-f[65460]: 2024-05-08T06:10:29.018+0000 7f8856b68700 -1 mds.f *** got signal Terminated *** 2024-05-08T06:10:32.069 INFO:journalctl@ceph.mds.f.smithi151.stdout:May 08 06:10:31 smithi151 podman[72928]: 2024-05-08 06:10:31.811404347 +0000 UTC m=+2.898401107 container died ea9fd08b107f6eedbe13d2a4a39249cc98ce89f15d1afa9b297c497932232aee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-f, org.label-schema.license=GPLv2, RELEASE=wip-57676-3-bee299f, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-05-08T06:10:32.379 INFO:journalctl@ceph.mds.f.smithi151.stdout:May 08 06:10:32 smithi151 podman[72928]: 2024-05-08 06:10:32.160443815 +0000 UTC m=+3.247440569 container cleanup ea9fd08b107f6eedbe13d2a4a39249cc98ce89f15d1afa9b297c497932232aee (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-f, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, RELEASE=wip-57676-3-bee299f, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-05-08T06:10:32.379 INFO:journalctl@ceph.mds.f.smithi151.stdout:May 08 06:10:32 smithi151 bash[72928]: ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-f 2024-05-08T06:10:32.588 DEBUG:teuthology.orchestra.run.smithi151:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mds.f.service' 2024-05-08T06:10:32.621 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T06:10:32.621 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-05-08T06:10:32.621 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-05-08T06:10:32.621 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mds.i 2024-05-08T06:10:32.879 INFO:journalctl@ceph.mds.i.smithi151.stdout:May 08 06:10:32 smithi151 systemd[1]: Stopping Ceph mds.i for c739a5c8-0cfc-11ef-bc97-c7b262605968... 2024-05-08T06:10:33.379 INFO:journalctl@ceph.mds.i.smithi151.stdout:May 08 06:10:32 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-i[66090]: 2024-05-08T06:10:32.981+0000 7f7838fc1700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T06:10:33.379 INFO:journalctl@ceph.mds.i.smithi151.stdout:May 08 06:10:32 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-i[66090]: 2024-05-08T06:10:32.981+0000 7f7838fc1700 -1 mds.i *** got signal Terminated *** 2024-05-08T06:10:36.066 INFO:journalctl@ceph.mds.i.smithi151.stdout:May 08 06:10:35 smithi151 podman[73049]: 2024-05-08 06:10:35.806566622 +0000 UTC m=+2.970541652 container died 6884b7a6179ea498ca9ee49d316d15a97bf12c6fd840f65128f8b38e617dcebd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-i, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, RELEASE=wip-57676-3-bee299f, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-05-08T06:10:36.379 INFO:journalctl@ceph.mds.i.smithi151.stdout:May 08 06:10:36 smithi151 podman[73049]: 2024-05-08 06:10:36.165519815 +0000 UTC m=+3.329494842 container cleanup 6884b7a6179ea498ca9ee49d316d15a97bf12c6fd840f65128f8b38e617dcebd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-i, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-57676-3-bee299f) 2024-05-08T06:10:36.379 INFO:journalctl@ceph.mds.i.smithi151.stdout:May 08 06:10:36 smithi151 bash[73049]: ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-i 2024-05-08T06:10:36.565 DEBUG:teuthology.orchestra.run.smithi151:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mds.i.service' 2024-05-08T06:10:36.596 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T06:10:36.596 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-05-08T06:10:36.596 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-05-08T06:10:36.596 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mds.l 2024-05-08T06:10:36.879 INFO:journalctl@ceph.mds.l.smithi151.stdout:May 08 06:10:36 smithi151 systemd[1]: Stopping Ceph mds.l for c739a5c8-0cfc-11ef-bc97-c7b262605968... 2024-05-08T06:10:37.379 INFO:journalctl@ceph.mds.l.smithi151.stdout:May 08 06:10:36 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-l[65146]: 2024-05-08T06:10:36.928+0000 7f7edb5fa700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-08T06:10:37.379 INFO:journalctl@ceph.mds.l.smithi151.stdout:May 08 06:10:36 smithi151 ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-l[65146]: 2024-05-08T06:10:36.928+0000 7f7edb5fa700 -1 mds.l *** got signal Terminated *** 2024-05-08T06:10:40.086 INFO:journalctl@ceph.mds.l.smithi151.stdout:May 08 06:10:39 smithi151 podman[73171]: 2024-05-08 06:10:39.81733391 +0000 UTC m=+3.007038030 container died bf3a64bfb1378e0eb95c4fa8704d64687bc276876afcc1a2771c7a5670962c26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-l, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-57676-3-bee299f, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-05-08T06:10:40.379 INFO:journalctl@ceph.mds.l.smithi151.stdout:May 08 06:10:40 smithi151 podman[73171]: 2024-05-08 06:10:40.170447395 +0000 UTC m=+3.360151554 container cleanup bf3a64bfb1378e0eb95c4fa8704d64687bc276876afcc1a2771c7a5670962c26 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:5a93a30dfa6b7dac54076fc754f0102ea322f9bbae94f68f29b70eaa3b17b91c, name=ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-l, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-57676-3-bee299f, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD) 2024-05-08T06:10:40.379 INFO:journalctl@ceph.mds.l.smithi151.stdout:May 08 06:10:40 smithi151 bash[73171]: ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968-mds-l 2024-05-08T06:10:40.594 DEBUG:teuthology.orchestra.run.smithi151:> sudo pkill -f 'journalctl -f -n 0 -u ceph-c739a5c8-0cfc-11ef-bc97-c7b262605968@mds.l.service' 2024-05-08T06:10:40.625 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-08T06:10:40.625 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-05-08T06:10:40.626 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 --force --keep-logs 2024-05-08T06:10:40.944 INFO:teuthology.orchestra.run.smithi082.stdout:Deleting cluster with fsid: c739a5c8-0cfc-11ef-bc97-c7b262605968 2024-05-08T06:10:45.844 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 --force --keep-logs 2024-05-08T06:10:46.033 INFO:teuthology.orchestra.run.smithi134.stdout:Deleting cluster with fsid: c739a5c8-0cfc-11ef-bc97-c7b262605968 2024-05-08T06:10:48.490 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 --force --keep-logs 2024-05-08T06:10:48.681 INFO:teuthology.orchestra.run.smithi151.stdout:Deleting cluster with fsid: c739a5c8-0cfc-11ef-bc97-c7b262605968 2024-05-08T06:10:51.054 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-08T06:10:51.149 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-08T06:10:51.190 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-08T06:10:51.215 INFO:tasks.cephadm:Archiving crash dumps... 2024-05-08T06:10:51.225 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/crash to /home/teuthworker/archive/vshankar-2024-05-08_04:00:39-fs:workload-wip-57676-3-testing-default-smithi/7697239/remote/smithi082/crash 2024-05-08T06:10:51.229 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/crash -- . 2024-05-08T06:10:51.322 INFO:teuthology.orchestra.run.smithi082.stderr:tar: /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/crash: Cannot open: No such file or directory 2024-05-08T06:10:51.323 INFO:teuthology.orchestra.run.smithi082.stderr:tar: Error is not recoverable: exiting now 2024-05-08T06:10:51.328 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/crash to /home/teuthworker/archive/vshankar-2024-05-08_04:00:39-fs:workload-wip-57676-3-testing-default-smithi/7697239/remote/smithi134/crash 2024-05-08T06:10:51.329 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/crash -- . 2024-05-08T06:10:51.428 INFO:teuthology.orchestra.run.smithi134.stderr:tar: /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/crash: Cannot open: No such file or directory 2024-05-08T06:10:51.428 INFO:teuthology.orchestra.run.smithi134.stderr:tar: Error is not recoverable: exiting now 2024-05-08T06:10:51.431 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/crash to /home/teuthworker/archive/vshankar-2024-05-08_04:00:39-fs:workload-wip-57676-3-testing-default-smithi/7697239/remote/smithi151/crash 2024-05-08T06:10:51.432 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/crash -- . 2024-05-08T06:10:51.468 INFO:teuthology.orchestra.run.smithi151.stderr:tar: /var/lib/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/crash: Cannot open: No such file or directory 2024-05-08T06:10:51.468 INFO:teuthology.orchestra.run.smithi151.stderr:tar: Error is not recoverable: exiting now 2024-05-08T06:10:51.470 INFO:tasks.cephadm:Checking cluster log for badness... 2024-05-08T06:10:51.471 DEBUG:teuthology.orchestra.run.smithi082:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-05-08T06:10:51.576 INFO:tasks.cephadm:Compressing logs... 2024-05-08T06:10:51.576 DEBUG:teuthology.orchestra.run.smithi082:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-08T06:10:51.582 DEBUG:teuthology.orchestra.run.smithi134:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-08T06:10:51.585 DEBUG:teuthology.orchestra.run.smithi151:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-08T06:10:51.634 INFO:teuthology.orchestra.run.smithi151.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-08T06:10:51.635 INFO:teuthology.orchestra.run.smithi151.stderr:: No such file or directory 2024-05-08T06:10:51.635 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph.log 2024-05-08T06:10:51.635 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/cephadm.log: gzip/var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph.log: -5 --verbose -- /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-osd.2.log 2024-05-08T06:10:51.635 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-mds.f.log 2024-05-08T06:10:51.636 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph.audit.log 2024-05-08T06:10:51.636 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-osd.5.log 2024-05-08T06:10:51.636 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph.audit.log: 92.5% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-08T06:10:51.636 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-mds.c.log 2024-05-08T06:10:51.636 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-mon.c.log 2024-05-08T06:10:51.637 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-osd.5.log: /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-mgr.z.log 2024-05-08T06:10:51.637 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-mds.i.log 2024-05-08T06:10:51.637 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-mgr.z.log: 87.3% -- replaced with /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph.log.gz 2024-05-08T06:10:51.637 INFO:teuthology.orchestra.run.smithi151.stderr: 90.5% -- replaced with /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph.audit.log.gz 2024-05-08T06:10:51.637 INFO:teuthology.orchestra.run.smithi151.stderr: 93.4% -- replaced with /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-mgr.z.log.gz 2024-05-08T06:10:51.637 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph.cephadm.log 2024-05-08T06:10:51.638 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-osd.11.log 2024-05-08T06:10:51.638 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-osd.8.log 2024-05-08T06:10:51.638 INFO:teuthology.orchestra.run.smithi151.stderr: 83.1% -- replaced with /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph.cephadm.log.gz 2024-05-08T06:10:51.638 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-volume.log 2024-05-08T06:10:51.643 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-mds.l.log 2024-05-08T06:10:51.648 INFO:teuthology.orchestra.run.smithi134.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose: No such file or directory 2024-05-08T06:10:51.649 INFO:teuthology.orchestra.run.smithi134.stderr: -- /var/log/ceph/cephadm.log 2024-05-08T06:10:51.649 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph.log 2024-05-08T06:10:51.649 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph.audit.log 2024-05-08T06:10:51.649 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-osd.7.log 2024-05-08T06:10:51.649 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-mds.b.log 2024-05-08T06:10:51.649 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-osd.7.log: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-08T06:10:51.650 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-osd.4.log 2024-05-08T06:10:51.650 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-osd.1.log 2024-05-08T06:10:51.650 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-mds.b.log: /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-mgr.y.log 2024-05-08T06:10:51.650 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-mds.h.log 2024-05-08T06:10:51.650 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-osd.10.log 2024-05-08T06:10:51.650 INFO:teuthology.orchestra.run.smithi134.stderr: 90.5% -- replaced with /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph.audit.log.gz 2024-05-08T06:10:51.651 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph.cephadm.log 2024-05-08T06:10:51.651 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-osd.10.log: 87.3% -- replaced with /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph.log.gz 2024-05-08T06:10:51.651 INFO:teuthology.orchestra.run.smithi134.stderr: 93.3% -- replaced with /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-mgr.y.log.gz 2024-05-08T06:10:51.651 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-mds.e.log 2024-05-08T06:10:51.651 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- 83.1% /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-volume.log 2024-05-08T06:10:51.651 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph.cephadm.log.gz 2024-05-08T06:10:51.652 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-mon.b.log 2024-05-08T06:10:51.656 INFO:teuthology.orchestra.run.smithi082.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-05-08T06:10:51.657 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-08T06:10:51.657 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph.log 2024-05-08T06:10:51.657 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph.audit.log 2024-05-08T06:10:51.657 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-mds.g.log 2024-05-08T06:10:51.657 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-mds.j.log 2024-05-08T06:10:51.657 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-osd.3.log 2024-05-08T06:10:51.658 INFO:teuthology.orchestra.run.smithi082.stderr: 87.3% -- replaced with /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph.log.gz 2024-05-08T06:10:51.658 INFO:teuthology.orchestra.run.smithi082.stderr: 90.3% -- replaced with /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph.audit.log.gz 2024-05-08T06:10:51.658 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-osd.0.log 2024-05-08T06:10:51.658 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-mgr.x.log 2024-05-08T06:10:51.658 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-osd.3.log: /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-mon.a.log 2024-05-08T06:10:51.658 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-osd.6.log 2024-05-08T06:10:51.659 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-mon.a.log: /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph.cephadm.log 2024-05-08T06:10:51.659 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-mds.k.log 2024-05-08T06:10:51.659 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-mon.b.log: 91.0% -- replaced with /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-volume.log.gz 2024-05-08T06:10:51.661 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph.cephadm.log: 94.5% -- replaced with /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-mds.j.log.gz 2024-05-08T06:10:51.661 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-mds.a.log 2024-05-08T06:10:51.661 INFO:teuthology.orchestra.run.smithi082.stderr: 94.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-08T06:10:51.661 INFO:teuthology.orchestra.run.smithi082.stderr: 83.3% -- replaced with /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph.cephadm.log.gz 2024-05-08T06:10:51.662 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-volume.log 2024-05-08T06:10:51.662 INFO:teuthology.orchestra.run.smithi082.stderr:gzip -5 --verbose -- /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-mds.d.log 2024-05-08T06:10:51.663 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-volume.log: /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-mds.l.log: 91.0% -- replaced with /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-volume.log.gz 2024-05-08T06:10:51.667 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-volume.log: /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-mds.d.log: /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-osd.9.log 2024-05-08T06:10:51.679 INFO:teuthology.orchestra.run.smithi082.stderr:/var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-osd.9.log: 90.9% -- replaced with /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-volume.log.gz 2024-05-08T06:10:51.680 INFO:teuthology.orchestra.run.smithi082.stderr: 94.4% -- replaced with /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-mds.d.log.gz 2024-05-08T06:10:51.681 INFO:teuthology.orchestra.run.smithi151.stderr: 93.9% -- replaced with /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-mds.c.log.gz 2024-05-08T06:10:51.701 INFO:teuthology.orchestra.run.smithi151.stderr: 93.6% -- replaced with /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-mds.i.log.gz 2024-05-08T06:10:51.728 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-mds.k.log: 93.7% -- replaced with /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-mds.h.log.gz 2024-05-08T06:10:51.752 INFO:teuthology.orchestra.run.smithi151.stderr: 94.8% -- replaced with /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-mds.l.log.gz 2024-05-08T06:10:51.753 INFO:teuthology.orchestra.run.smithi082.stderr: 94.7% -- replaced with /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-mds.g.log.gz 2024-05-08T06:10:51.784 INFO:teuthology.orchestra.run.smithi134.stderr: 94.7% -- replaced with /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-mds.k.log.gz 2024-05-08T06:10:51.863 INFO:teuthology.orchestra.run.smithi082.stderr: 93.8% -- replaced with /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-mds.a.log.gz 2024-05-08T06:10:52.047 INFO:teuthology.orchestra.run.smithi082.stderr: 90.3% -- replaced with /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-mgr.x.log.gz 2024-05-08T06:10:52.192 INFO:teuthology.orchestra.run.smithi151.stderr: 91.7% -- replaced with /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-mon.c.log.gz 2024-05-08T06:10:52.206 INFO:teuthology.orchestra.run.smithi134.stderr: 94.5% -- replaced with /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-mds.e.log.gz 2024-05-08T06:10:52.231 INFO:teuthology.orchestra.run.smithi134.stderr: 91.7% -- replaced with /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-mon.b.log.gz 2024-05-08T06:10:52.663 INFO:teuthology.orchestra.run.smithi151.stderr: 94.5% -- replaced with /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-mds.f.log.gz 2024-05-08T06:10:53.354 INFO:teuthology.orchestra.run.smithi082.stderr: 90.1% -- replaced with /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-mon.a.log.gz 2024-05-08T06:10:59.521 INFO:teuthology.orchestra.run.smithi134.stderr: 93.9% -- replaced with /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-mds.b.log.gz 2024-05-08T06:11:21.744 INFO:teuthology.orchestra.run.smithi082.stderr: 91.0% -- replaced with /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-osd.9.log.gz 2024-05-08T06:11:28.029 INFO:teuthology.orchestra.run.smithi151.stderr: 91.0% -- replaced with /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-osd.8.log.gz 2024-05-08T06:11:31.579 INFO:teuthology.orchestra.run.smithi134.stderr: 91.4% -- replaced with /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-osd.4.log.gz 2024-05-08T06:11:33.128 INFO:teuthology.orchestra.run.smithi082.stderr: 91.0% -- replaced with /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-osd.6.log.gz 2024-05-08T06:11:35.663 INFO:teuthology.orchestra.run.smithi151.stderr: 91.0% -- replaced with /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-osd.11.log.gz 2024-05-08T06:11:36.823 INFO:teuthology.orchestra.run.smithi134.stderr: 91.1% -- replaced with /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-osd.10.log.gz 2024-05-08T06:11:40.628 INFO:teuthology.orchestra.run.smithi151.stderr: 91.2% -- replaced with /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-osd.5.log.gz 2024-05-08T06:11:40.942 INFO:teuthology.orchestra.run.smithi151.stderr: 91.0% -- replaced with /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-osd.2.log.gz 2024-05-08T06:11:40.944 INFO:teuthology.orchestra.run.smithi151.stderr: 2024-05-08T06:11:40.944 INFO:teuthology.orchestra.run.smithi151.stderr:real 0m49.344s 2024-05-08T06:11:40.944 INFO:teuthology.orchestra.run.smithi151.stderr:user 2m54.871s 2024-05-08T06:11:40.944 INFO:teuthology.orchestra.run.smithi151.stderr:sys 0m5.428s 2024-05-08T06:11:42.689 INFO:teuthology.orchestra.run.smithi134.stderr: 91.1% -- replaced with /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-osd.1.log.gz 2024-05-08T06:11:45.309 INFO:teuthology.orchestra.run.smithi082.stderr: 91.1% -- replaced with /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-osd.3.log.gz 2024-05-08T06:11:48.543 INFO:teuthology.orchestra.run.smithi082.stderr: 91.0% -- replaced with /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-osd.0.log.gz 2024-05-08T06:11:48.546 INFO:teuthology.orchestra.run.smithi082.stderr: 2024-05-08T06:11:48.547 INFO:teuthology.orchestra.run.smithi082.stderr:real 0m56.933s 2024-05-08T06:11:48.547 INFO:teuthology.orchestra.run.smithi082.stderr:user 2m51.719s 2024-05-08T06:11:48.547 INFO:teuthology.orchestra.run.smithi082.stderr:sys 0m12.488s 2024-05-08T06:11:51.063 INFO:teuthology.orchestra.run.smithi134.stderr: 91.0% -- replaced with /var/log/ceph/c739a5c8-0cfc-11ef-bc97-c7b262605968/ceph-osd.7.log.gz 2024-05-08T06:11:51.065 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-05-08T06:11:51.065 INFO:teuthology.orchestra.run.smithi134.stderr:real 0m59.466s 2024-05-08T06:11:51.065 INFO:teuthology.orchestra.run.smithi134.stderr:user 3m18.306s 2024-05-08T06:11:51.065 INFO:teuthology.orchestra.run.smithi134.stderr:sys 0m6.144s 2024-05-08T06:11:51.066 INFO:tasks.cephadm:Archiving logs... 2024-05-08T06:11:51.066 DEBUG:teuthology.misc:Transferring archived files from smithi082:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-05-08_04:00:39-fs:workload-wip-57676-3-testing-default-smithi/7697239/remote/smithi082/log 2024-05-08T06:11:51.067 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-08T06:12:22.610 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-05-08_04:00:39-fs:workload-wip-57676-3-testing-default-smithi/7697239/remote/smithi134/log 2024-05-08T06:12:22.611 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-08T06:12:57.756 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-05-08_04:00:39-fs:workload-wip-57676-3-testing-default-smithi/7697239/remote/smithi151/log 2024-05-08T06:12:57.757 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-08T06:13:29.507 INFO:tasks.cephadm:Removing cluster... 2024-05-08T06:13:29.508 DEBUG:teuthology.orchestra.run.smithi082:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 --force 2024-05-08T06:13:29.827 INFO:teuthology.orchestra.run.smithi082.stdout:Deleting cluster with fsid: c739a5c8-0cfc-11ef-bc97-c7b262605968 2024-05-08T06:13:31.131 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 --force 2024-05-08T06:13:31.324 INFO:teuthology.orchestra.run.smithi134.stdout:Deleting cluster with fsid: c739a5c8-0cfc-11ef-bc97-c7b262605968 2024-05-08T06:13:31.894 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid c739a5c8-0cfc-11ef-bc97-c7b262605968 --force 2024-05-08T06:13:32.086 INFO:teuthology.orchestra.run.smithi151.stdout:Deleting cluster with fsid: c739a5c8-0cfc-11ef-bc97-c7b262605968 2024-05-08T06:13:32.636 INFO:tasks.cephadm:Removing cephadm ... 2024-05-08T06:13:32.636 DEBUG:teuthology.orchestra.run.smithi082:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-08T06:13:32.695 DEBUG:teuthology.orchestra.run.smithi134:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-08T06:13:32.711 DEBUG:teuthology.orchestra.run.smithi151:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-08T06:13:32.727 INFO:tasks.cephadm:Teardown complete 2024-05-08T06:13:32.728 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-08T06:13:32.739 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-08T06:13:32.739 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-08T06:13:32.746 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-08T06:13:32.754 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-08T06:13:32.894 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-08T06:13:32.904 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-08T06:13:32.905 DEBUG:teuthology.orchestra.run.smithi082:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T06:13:32.913 DEBUG:teuthology.orchestra.run.smithi134:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T06:13:32.915 DEBUG:teuthology.orchestra.run.smithi151:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-08T06:13:32.927 INFO:teuthology.orchestra.run.smithi134.stderr:bash: line 1: ntpq: command not found 2024-05-08T06:13:32.929 INFO:teuthology.orchestra.run.smithi151.stderr:bash: line 1: ntpq: command not found 2024-05-08T06:13:32.932 INFO:teuthology.orchestra.run.smithi134.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T06:13:32.932 INFO:teuthology.orchestra.run.smithi134.stdout:=============================================================================== 2024-05-08T06:13:32.932 INFO:teuthology.orchestra.run.smithi134.stdout:^* hv01.front.sepia.ceph.com 3 6 377 31 +374us[ +386us] +/- 62ms 2024-05-08T06:13:32.932 INFO:teuthology.orchestra.run.smithi134.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 30 -643us[ -643us] +/- 59ms 2024-05-08T06:13:32.932 INFO:teuthology.orchestra.run.smithi134.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 32 +345us[ +356us] +/- 85ms 2024-05-08T06:13:32.933 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T06:13:32.933 INFO:teuthology.orchestra.run.smithi151.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T06:13:32.934 INFO:teuthology.orchestra.run.smithi151.stdout:=============================================================================== 2024-05-08T06:13:32.934 INFO:teuthology.orchestra.run.smithi151.stdout:^* hv01.front.sepia.ceph.com 3 6 377 29 +374us[ +370us] +/- 62ms 2024-05-08T06:13:32.934 INFO:teuthology.orchestra.run.smithi151.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 31 -659us[ -663us] +/- 59ms 2024-05-08T06:13:32.934 INFO:teuthology.orchestra.run.smithi151.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 29 +351us[ +347us] +/- 85ms 2024-05-08T06:13:32.934 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T06:13:32.958 INFO:teuthology.orchestra.run.smithi082.stderr:bash: line 1: ntpq: command not found 2024-05-08T06:13:32.968 INFO:teuthology.orchestra.run.smithi082.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-08T06:13:32.968 INFO:teuthology.orchestra.run.smithi082.stdout:=============================================================================== 2024-05-08T06:13:32.968 INFO:teuthology.orchestra.run.smithi082.stdout:^* hv01.front.sepia.ceph.com 3 6 377 33 +378us[ +419us] +/- 62ms 2024-05-08T06:13:32.968 INFO:teuthology.orchestra.run.smithi082.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 29 -621us[ -621us] +/- 59ms 2024-05-08T06:13:32.969 INFO:teuthology.orchestra.run.smithi082.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 29 +348us[ +348us] +/- 85ms 2024-05-08T06:13:32.969 INFO:teuthology.orchestra.run.smithi082.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-08T06:13:32.970 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-08T06:13:32.980 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-08T06:13:32.981 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-08T06:13:32.991 DEBUG:teuthology.orchestra.run.smithi082:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-08T06:13:33.184 DEBUG:teuthology.orchestra.run.smithi134:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-08T06:13:33.250 DEBUG:teuthology.orchestra.run.smithi151:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-08T06:13:33.315 DEBUG:teuthology.orchestra.run.smithi082:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-08T06:13:33.411 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T06:13:33.412 DEBUG:teuthology.orchestra.run.smithi134:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-08T06:13:33.439 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T06:13:33.440 DEBUG:teuthology.orchestra.run.smithi151:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-08T06:13:33.467 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T06:13:33.467 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-08T06:13:33.478 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-08T06:13:33.488 INFO:teuthology.task.internal:Duration was 2759.693413 seconds 2024-05-08T06:13:33.489 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-08T06:13:33.500 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-08T06:13:33.501 DEBUG:teuthology.orchestra.run.smithi082:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-08T06:13:33.508 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-08T06:13:33.510 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-08T06:13:33.545 INFO:teuthology.orchestra.run.smithi134.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T06:13:33.547 INFO:teuthology.orchestra.run.smithi151.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T06:13:33.653 INFO:teuthology.orchestra.run.smithi082.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-08T06:13:34.041 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-08T06:13:34.041 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi082.front.sepia.ceph.com 2024-05-08T06:13:34.041 DEBUG:teuthology.orchestra.run.smithi082:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-08T06:13:34.116 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi134.front.sepia.ceph.com 2024-05-08T06:13:34.117 DEBUG:teuthology.orchestra.run.smithi134:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-08T06:13:34.152 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi151.front.sepia.ceph.com 2024-05-08T06:13:34.152 DEBUG:teuthology.orchestra.run.smithi151:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-08T06:13:34.187 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-08T06:13:34.187 DEBUG:teuthology.orchestra.run.smithi082:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T06:13:34.194 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T06:13:34.197 DEBUG:teuthology.orchestra.run.smithi151:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-08T06:13:34.275 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-08T06:13:34.275 DEBUG:teuthology.orchestra.run.smithi082:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-08T06:13:34.280 DEBUG:teuthology.orchestra.run.smithi134:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-08T06:13:34.283 DEBUG:teuthology.orchestra.run.smithi151:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-08T06:13:35.584 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-08T06:13:35.596 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-08T06:13:35.596 DEBUG:teuthology.orchestra.run.smithi082:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-08T06:13:35.676 DEBUG:teuthology.orchestra.run.smithi134:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-08T06:13:35.704 DEBUG:teuthology.orchestra.run.smithi151:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-08T06:13:35.732 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-08T06:13:35.744 DEBUG:teuthology.orchestra.run.smithi082:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-08T06:13:35.752 DEBUG:teuthology.orchestra.run.smithi134:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-08T06:13:35.754 DEBUG:teuthology.orchestra.run.smithi151:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-08T06:13:35.778 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = core 2024-05-08T06:13:35.799 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern = core 2024-05-08T06:13:35.843 INFO:teuthology.orchestra.run.smithi082.stdout:kernel.core_pattern = core 2024-05-08T06:13:35.885 DEBUG:teuthology.orchestra.run.smithi082:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-08T06:13:35.933 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T06:13:35.933 DEBUG:teuthology.orchestra.run.smithi134:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-08T06:13:35.949 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T06:13:35.949 DEBUG:teuthology.orchestra.run.smithi151:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-08T06:13:35.965 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-08T06:13:35.965 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-08T06:13:35.977 INFO:teuthology.task.internal:Transferring archived files... 2024-05-08T06:13:35.978 DEBUG:teuthology.misc:Transferring archived files from smithi082:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-05-08_04:00:39-fs:workload-wip-57676-3-testing-default-smithi/7697239/remote/smithi082 2024-05-08T06:13:35.979 DEBUG:teuthology.orchestra.run.smithi082:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-08T06:13:36.101 DEBUG:teuthology.misc:Transferring archived files from smithi134:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-05-08_04:00:39-fs:workload-wip-57676-3-testing-default-smithi/7697239/remote/smithi134 2024-05-08T06:13:36.101 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-08T06:13:36.139 DEBUG:teuthology.misc:Transferring archived files from smithi151:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-05-08_04:00:39-fs:workload-wip-57676-3-testing-default-smithi/7697239/remote/smithi151 2024-05-08T06:13:36.139 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-08T06:13:36.178 INFO:teuthology.task.internal:Removing archive directory... 2024-05-08T06:13:36.178 DEBUG:teuthology.orchestra.run.smithi082:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-08T06:13:36.186 DEBUG:teuthology.orchestra.run.smithi134:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-08T06:13:36.188 DEBUG:teuthology.orchestra.run.smithi151:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-08T06:13:36.236 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-08T06:13:36.249 INFO:teuthology.task.internal:Not uploading archives. 2024-05-08T06:13:36.250 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-08T06:13:36.261 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-08T06:13:36.261 DEBUG:teuthology.orchestra.run.smithi082:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-08T06:13:36.266 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-08T06:13:36.269 DEBUG:teuthology.orchestra.run.smithi151:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-08T06:13:36.282 INFO:teuthology.orchestra.run.smithi134.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 8 06:13 /home/ubuntu/cephtest 2024-05-08T06:13:36.287 INFO:teuthology.orchestra.run.smithi151.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 8 06:13 /home/ubuntu/cephtest 2024-05-08T06:13:36.312 INFO:teuthology.orchestra.run.smithi082.stdout: 393623 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 8 06:13 /home/ubuntu/cephtest 2024-05-08T06:13:36.315 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-08T06:13:36.327 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-08T06:13:36.354 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 806ec36b21129f113ce356c007dd59694d340b37 description: fs:workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-quiesce/no 6-workunit/postgres}} duration: 2759.6934127807617 flavor: default owner: scheduled_vshankar@teuthology success: true 2024-05-08T06:13:36.354 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-08T06:13:36.451 INFO:teuthology.run:pass